2023-09-30T22:33:09.755 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T22:33:09.755 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --archive /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047 --name vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/orig.config.yaml 2023-09-30T22:33:09.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:33:09.890 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047 branch: wip-vshankar-testing-quincy-20230929.071619 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: vshankar@redhat.com first_in_suite: false job_id: '7406047' kernel: client: branch: testing flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-quincy-20230929.071619 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 87156194a943657e20fb2be831ae4046cdd8917b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 87156194a943657e20fb2be831ae4046cdd8917b kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-quincy-20230929.071619 sha1: 87156194a943657e20fb2be831ae4046cdd8917b owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2571 sha1: 87156194a943657e20fb2be831ae4046cdd8917b sleep_before_teardown: 0 subset: 519/1024 suite: fs suite_branch: wip-vshankar-testing-quincy-20230929.071619 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_87156194a943657e20fb2be831ae4046cdd8917b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 87156194a943657e20fb2be831ae4046cdd8917b targets: smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPjHJzUbT8LI1oBZ32NJHx/e6yhR1zgIw13aTk2LFkoimAF0f9BlkmwrQc2NtklmWZRwoMcz1GRVP6CwYnGK8Y= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs3M+ZD0mL3oGrX2NgbVTeR/pu1+UfZoiItbPE6GhioE77ykHjbJQ1hdDXdvRbobPyPZaWX/JbKSX9mGlMul/I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-29_10:09:00 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T22:33:09.890 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_87156194a943657e20fb2be831ae4046cdd8917b/qa; will attempt to use it 2023-09-30T22:33:09.891 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_87156194a943657e20fb2be831ae4046cdd8917b/qa/tasks 2023-09-30T22:33:09.891 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T22:33:09.893 INFO:teuthology.task.internal:Checking packages... 2023-09-30T22:33:09.915 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '87156194a943657e20fb2be831ae4046cdd8917b' 2023-09-30T22:33:09.915 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:33:09.915 INFO:teuthology.packaging:ref: None 2023-09-30T22:33:09.915 INFO:teuthology.packaging:tag: None 2023-09-30T22:33:09.915 INFO:teuthology.packaging:branch: wip-vshankar-testing-quincy-20230929.071619 2023-09-30T22:33:09.915 INFO:teuthology.packaging:sha1: 87156194a943657e20fb2be831ae4046cdd8917b 2023-09-30T22:33:09.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-quincy-20230929.071619 2023-09-30T22:33:10.139 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1188.g87156194 2023-09-30T22:33:10.139 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T22:33:10.146 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T22:33:10.146 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T22:33:10.151 INFO:teuthology.task.internal:Saving configuration 2023-09-30T22:33:10.168 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T22:33:10.173 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:33:10.197 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:27:47.297208', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPjHJzUbT8LI1oBZ32NJHx/e6yhR1zgIw13aTk2LFkoimAF0f9BlkmwrQc2NtklmWZRwoMcz1GRVP6CwYnGK8Y='} 2023-09-30T22:33:10.215 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:27:47.298864', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs3M+ZD0mL3oGrX2NgbVTeR/pu1+UfZoiItbPE6GhioE77ykHjbJQ1hdDXdvRbobPyPZaWX/JbKSX9mGlMul/I='} 2023-09-30T22:33:10.215 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T22:33:10.222 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-30T22:33:10.222 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-30T22:33:10.223 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T22:33:10.294 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f226fb5eaf0>, signals=[15]) 2023-09-30T22:33:10.294 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T22:33:10.300 INFO:teuthology.task.internal:Opening connections... 2023-09-30T22:33:10.301 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:33:10.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:33:10.369 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:33:10.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:33:10.438 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T22:33:10.444 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-09-30T22:33:10.467 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-09-30T22:33:10.467 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-09-30T22:33:10.528 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-09-30T22:33:10.528 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2023-09-30T22:33:10.528 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:33:10.529 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:33:10.530 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-09-30T22:33:10.552 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-09-30T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-09-30T22:33:10.575 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-09-30T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-09-30T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8" 2023-09-30T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:33:10.639 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-09-30T22:33:10.660 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T22:33:10.669 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T22:33:10.675 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T22:33:10.675 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:33:10.678 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:33:10.697 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T22:33:10.703 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T22:33:10.703 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:33:10.739 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:33:10.768 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T22:33:10.824 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T22:33:10.838 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-09-30T22:33:10.838 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-09-30T22:33:10.838 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-09-30T22:33:10.841 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:33:10.842 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:33:10.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:33:10.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-30T22:33:10.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:33:10.868 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-30T22:33:11.026 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:33:11.026 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-30T22:33:11.027 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-09-30T22:33:11.050 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:33:11.050 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:33:11.050 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-30T22:33:11.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2023-09-30T22:33:11.202 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:33:11.202 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-30T22:33:11.202 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-09-30T22:33:11.224 INFO:teuthology.orchestra.run.smithi148.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:33:11.224 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:33:11.224 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-30T22:33:11.224 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum upgrade -y linux-firmware 2023-09-30T22:33:15.901 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-09-30T22:33:15.922 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:33:27.838 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - BaseOS 8.3 MB/s | 48 MB 00:05 2023-09-30T22:33:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - BaseOS 8.0 MB/s | 48 MB 00:05 2023-09-30T22:33:34.855 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - Extras 118 kB/s | 18 kB 00:00 2023-09-30T22:33:35.200 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras 58 kB/s | 18 kB 00:00 2023-09-30T22:33:35.422 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-09-30T22:33:35.707 INFO:teuthology.orchestra.run.smithi148.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-09-30T22:33:35.767 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-09-30T22:33:36.051 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-09-30T22:33:37.446 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-09-30T22:33:41.269 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 451 kB/s | 24 kB 00:00 2023-09-30T22:33:42.376 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 2.4 MB/s | 16 MB 00:06 2023-09-30T22:33:45.095 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 1 Package 2023-09-30T22:33:45.096 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:33:45.097 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 286 M 2023-09-30T22:33:45.097 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-09-30T22:33:46.165 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 389 kB/s | 24 kB 00:00 2023-09-30T22:33:50.077 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 1 Package 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:33:50.078 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 286 M 2023-09-30T22:33:50.079 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2023-09-30T22:34:00.602 INFO:teuthology.orchestra.run.smithi142.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 18 MB/s | 286 MB 00:15 2023-09-30T22:34:00.602 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:34:00.602 INFO:teuthology.orchestra.run.smithi142.stdout:Total 18 MB/s | 286 MB 00:15 2023-09-30T22:34:02.301 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-09-30T22:34:02.364 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-09-30T22:34:02.364 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-09-30T22:34:04.153 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-09-30T22:34:04.184 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-09-30T22:34:05.507 INFO:teuthology.orchestra.run.smithi148.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 19 MB/s | 286 MB 00:15 2023-09-30T22:34:05.507 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:34:05.507 INFO:teuthology.orchestra.run.smithi148.stdout:Total 19 MB/s | 286 MB 00:15 2023-09-30T22:34:07.208 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2023-09-30T22:34:07.270 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2023-09-30T22:34:07.271 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2023-09-30T22:34:09.059 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2023-09-30T22:34:09.099 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2023-09-30T22:34:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-09-30T22:34:23.341 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-30T22:34:23.552 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:34:23.787 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:34:23.787 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-30T22:34:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:34:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:34:24.560 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-09-30T22:34:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-09-30T22:34:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:34:24.560 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-09-30T22:34:24.754 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-30T22:34:24.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:34:24.896 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-30T22:34:24.897 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-30T22:34:24.899 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2023-09-30T22:34:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2023-09-30T22:34:28.449 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-30T22:34:28.691 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:34:28.934 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:34:28.934 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-30T22:34:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:34:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:34:29.694 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2023-09-30T22:34:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-09-30T22:34:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:34:29.695 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-09-30T22:34:29.874 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-09-30T22:34:29.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:34:30.094 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-30T22:34:30.095 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-30T22:34:30.097 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi148.front.sepia.ceph.com to complete... 2023-09-30T22:34:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30 22:34:48 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-30T22:34:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2023-09-30 22:34:48-- 2023-09-30T22:34:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 24s 2023-09-30T22:34:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 363M in 23s (15.6 MB/s) 2023-09-30T22:34:48.691 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-30T22:34:48.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-30T22:34:50.382 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2023-09-30T22:34:50.427 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2023-09-30T22:34:50.536 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2023-09-30T22:35:06.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30 22:35:06 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-30T22:35:06.858 INFO:teuthology.orchestra.run.smithi148.stderr:FINISHED --2023-09-30 22:35:06-- 2023-09-30T22:35:06.858 INFO:teuthology.orchestra.run.smithi148.stderr:Total wall clock time: 37s 2023-09-30T22:35:06.859 INFO:teuthology.orchestra.run.smithi148.stderr:Downloaded: 1 files, 363M in 36s (10.0 MB/s) 2023-09-30T22:35:06.860 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-09-30T22:35:06.861 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-30T22:35:08.525 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying... ######################################## 2023-09-30T22:35:08.568 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing... ######################################## 2023-09-30T22:35:08.678 INFO:teuthology.orchestra.run.smithi148.stdout:Updating / installing... 2023-09-30T22:35:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-30T22:35:46.692 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-30T22:35:53.508 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-30T22:35:53.509 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-30T22:35:53.570 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.570 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.570 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.570 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-30T22:35:53.571 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-30T22:35:53.572 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-30T22:35:53.573 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-30T22:35:53.574 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-30T22:35:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-30T22:35:53.576 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-30T22:35:53.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-30T22:35:53.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-30T22:35:53.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-30T22:35:53.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-30T22:35:53.577 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-30T22:35:53.578 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-30T22:35:53.579 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-30T22:35:53.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-30T22:35:53.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-30T22:35:53.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-30T22:35:53.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-30T22:35:53.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-30T22:35:53.580 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-30T22:35:53.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-30T22:35:53.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-30T22:35:53.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-30T22:35:53.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-30T22:35:53.581 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-30T22:35:53.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-30T22:35:53.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-30T22:35:53.582 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-30T22:35:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-30T22:35:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-30T22:35:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-30T22:35:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-30T22:35:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-30T22:35:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-30T22:35:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-30T22:35:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-30T22:35:53.585 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-30T22:35:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-30T22:35:53.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-30T22:35:53.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-30T22:35:53.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-30T22:35:53.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-30T22:35:53.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-30T22:35:53.587 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-30T22:35:53.588 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-30T22:35:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-30T22:35:53.590 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-30T22:35:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-30T22:35:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-30T22:35:53.593 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-30T22:35:53.594 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-30T22:35:53.595 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-30T22:35:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-30T22:35:53.597 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-30T22:35:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-30T22:35:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-30T22:35:53.600 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-30T22:35:53.601 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-30T22:35:53.602 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-30T22:35:53.603 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-30T22:35:53.604 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-30T22:35:53.605 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-30T22:35:53.606 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-30T22:35:53.607 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-30T22:35:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-30T22:35:53.609 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-30T22:35:53.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-30T22:35:53.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-30T22:35:53.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-30T22:35:53.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-30T22:35:53.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-30T22:35:53.610 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-30T22:35:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-30T22:35:53.612 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-30T22:35:53.613 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-30T22:35:53.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-30T22:35:53.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-30T22:35:53.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-30T22:35:53.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-30T22:35:53.614 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-30T22:35:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-30T22:35:53.616 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-30T22:35:53.617 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-30T22:35:53.618 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-30T22:35:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-30T22:35:53.620 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-30T22:35:53.621 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-30T22:35:53.622 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-30T22:35:53.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-30T22:35:53.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-30T22:35:53.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-30T22:35:53.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-30T22:35:53.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-30T22:35:53.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-30T22:35:53.623 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-30T22:35:53.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-30T22:35:53.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-30T22:35:53.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-30T22:35:53.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-30T22:35:53.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-30T22:35:53.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-30T22:35:53.624 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-30T22:35:53.625 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-30T22:35:53.626 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-30T22:35:53.627 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-30T22:35:53.628 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-30T22:35:53.629 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-30T22:35:53.630 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-30T22:35:53.631 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-30T22:35:53.632 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-30T22:35:53.633 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-30T22:35:53.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-30T22:35:53.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-30T22:35:53.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-30T22:35:53.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-30T22:35:53.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-30T22:35:53.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-30T22:35:53.634 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-30T22:35:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-30T22:35:53.636 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-30T22:35:53.637 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-30T22:35:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-30T22:35:53.639 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-30T22:35:53.640 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-30T22:35:53.641 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-30T22:35:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-30T22:35:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-30T22:35:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-30T22:35:53.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-30T22:35:53.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-30T22:35:53.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-30T22:35:53.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-30T22:35:53.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-30T22:35:53.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-30T22:35:53.645 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-30T22:35:53.646 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-30T22:35:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-30T22:35:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-30T22:35:53.649 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-30T22:35:53.650 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-30T22:35:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-30T22:35:53.652 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-30T22:35:53.653 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-30T22:35:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-30T22:35:53.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-30T22:35:53.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-30T22:35:53.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-30T22:35:53.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-30T22:35:53.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-30T22:35:53.655 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-30T22:35:53.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-30T22:35:53.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-30T22:35:53.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-30T22:35:53.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-30T22:35:53.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-30T22:35:53.656 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-30T22:35:53.657 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-30T22:35:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-30T22:35:53.659 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-30T22:35:53.660 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-30T22:35:53.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-30T22:35:53.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-30T22:35:53.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-30T22:35:53.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-30T22:35:53.661 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-30T22:35:53.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-30T22:35:53.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-30T22:35:53.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-30T22:35:53.662 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-30T22:35:53.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-30T22:35:53.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-30T22:35:53.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-30T22:35:53.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-30T22:35:53.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-30T22:35:53.663 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-30T22:35:53.664 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-30T22:35:53.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-30T22:35:53.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-30T22:35:53.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-30T22:35:53.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-30T22:35:53.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-30T22:35:53.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-30T22:35:53.665 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-30T22:35:53.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-30T22:35:53.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-30T22:35:53.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-30T22:35:53.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-30T22:35:53.666 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-30T22:35:53.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-30T22:35:53.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-30T22:35:53.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-30T22:35:53.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-30T22:35:53.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-30T22:35:53.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-30T22:35:53.667 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-30T22:35:53.668 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-30T22:35:53.668 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-30T22:35:53.668 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-30T22:35:53.668 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-30T22:35:53.668 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-30T22:35:53.668 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-30T22:35:53.669 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-30T22:35:53.669 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-30T22:35:53.669 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-30T22:35:53.669 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-30T22:35:53.669 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-30T22:35:53.669 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-30T22:35:53.670 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-30T22:35:53.670 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-30T22:35:53.670 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-30T22:35:53.670 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-30T22:35:53.670 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-30T22:35:53.671 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-30T22:35:53.671 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-30T22:35:53.671 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-30T22:35:53.671 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-30T22:35:53.671 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-30T22:35:53.671 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-30T22:35:53.672 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-30T22:35:53.672 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-30T22:35:53.672 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-30T22:35:53.672 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-30T22:35:53.672 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-30T22:35:53.672 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-30T22:35:53.672 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-30T22:35:53.673 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-30T22:35:53.674 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-30T22:35:53.675 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-30T22:35:53.675 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-30T22:35:53.675 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-30T22:35:53.675 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-30T22:35:53.675 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-30T22:35:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-30T22:35:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-30T22:35:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-30T22:35:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-30T22:35:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-30T22:35:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-30T22:35:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-30T22:35:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-30T22:35:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-30T22:35:53.681 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-30T22:35:53.682 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-30T22:35:53.683 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-30T22:35:53.683 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-30T22:35:53.683 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-30T22:35:53.683 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-30T22:35:53.683 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-30T22:35:53.684 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-30T22:35:53.685 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-30T22:35:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-30T22:35:53.687 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-30T22:35:53.687 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-30T22:35:53.687 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-30T22:35:53.687 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-30T22:35:53.687 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-30T22:35:53.688 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-30T22:35:53.688 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-30T22:35:53.688 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-30T22:35:53.688 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-30T22:35:53.689 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-30T22:35:53.690 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-30T22:35:53.690 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-30T22:35:53.690 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-30T22:35:53.690 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-30T22:35:53.690 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-30T22:35:53.690 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-30T22:35:53.690 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-30T22:35:53.691 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-30T22:35:53.692 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-30T22:35:53.693 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-30T22:35:53.694 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-30T22:35:53.694 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-30T22:35:53.694 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-30T22:35:53.694 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-30T22:35:53.694 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-30T22:35:53.694 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-30T22:35:53.694 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-30T22:35:53.695 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-30T22:35:53.696 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-30T22:35:53.697 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-30T22:35:53.697 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-30T22:35:53.697 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-30T22:35:53.697 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-30T22:35:53.697 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-30T22:35:53.697 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-30T22:35:53.697 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-30T22:35:53.698 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-30T22:35:53.698 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-30T22:35:53.698 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-30T22:35:53.698 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-30T22:35:53.698 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-30T22:35:53.698 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-30T22:35:53.698 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-30T22:35:53.699 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-30T22:35:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-30T22:35:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-30T22:35:53.702 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-30T22:35:53.703 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-30T22:35:53.704 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-30T22:35:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-30T22:35:53.706 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-30T22:35:53.707 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-30T22:35:53.708 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-30T22:35:53.709 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-30T22:35:53.710 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-30T22:35:53.711 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-30T22:35:53.712 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-30T22:35:53.713 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-30T22:35:53.714 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-30T22:35:53.715 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-30T22:35:53.716 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-30T22:35:53.716 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-30T22:35:53.716 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-30T22:35:53.716 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-30T22:35:53.716 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-30T22:35:53.716 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-30T22:35:53.716 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-30T22:35:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-30T22:35:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-30T22:35:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-30T22:35:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-30T22:35:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-30T22:35:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-30T22:35:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-30T22:35:53.718 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-30T22:35:53.719 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-30T22:35:53.719 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-30T22:35:53.719 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-30T22:35:53.719 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-30T22:35:53.719 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-30T22:35:53.719 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-30T22:35:53.720 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-30T22:35:53.720 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-30T22:35:53.720 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-30T22:35:53.720 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-30T22:35:53.720 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-30T22:35:53.720 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-30T22:35:53.721 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-30T22:35:53.722 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-30T22:35:53.722 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-30T22:35:53.722 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-30T22:35:53.722 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-30T22:35:53.722 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-30T22:35:53.722 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-30T22:35:53.722 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-30T22:35:53.723 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-30T22:35:53.724 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-30T22:35:53.725 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-30T22:35:53.726 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-30T22:35:53.727 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-30T22:35:53.728 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-30T22:35:53.729 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-30T22:35:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-30T22:35:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-30T22:35:53.732 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-30T22:35:53.732 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-30T22:35:53.732 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-30T22:35:53.732 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-30T22:35:53.732 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-30T22:35:53.733 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-30T22:35:53.734 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-30T22:35:53.735 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-30T22:35:53.736 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-30T22:35:53.737 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-30T22:35:53.738 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-30T22:35:53.738 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-30T22:35:53.738 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-30T22:35:53.738 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-30T22:35:53.738 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-30T22:35:53.738 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-30T22:35:53.739 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-30T22:35:53.740 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-30T22:35:53.740 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-30T22:35:53.740 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-30T22:35:53.740 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-30T22:35:53.740 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-30T22:35:53.740 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-30T22:35:53.741 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-30T22:35:53.741 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-30T22:35:53.741 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-30T22:35:53.741 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-30T22:35:53.741 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-30T22:35:53.741 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-30T22:35:53.741 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-30T22:35:53.742 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-30T22:35:53.742 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-30T22:35:53.742 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-30T22:35:53.742 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-30T22:35:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-30T22:35:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-30T22:35:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-30T22:35:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-30T22:35:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-30T22:35:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-30T22:35:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-30T22:35:53.745 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-30T22:35:53.746 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-30T22:35:53.746 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-30T22:35:53.746 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-30T22:35:53.746 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-30T22:35:53.746 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-30T22:35:53.746 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-30T22:35:53.746 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-30T22:35:53.747 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-30T22:35:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-30T22:35:53.749 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-30T22:35:53.750 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-30T22:35:53.750 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-30T22:35:53.750 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-30T22:35:53.750 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-30T22:35:53.750 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-30T22:35:53.750 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-30T22:35:53.750 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-30T22:35:53.751 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-30T22:35:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-30T22:35:53.753 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-30T22:35:53.753 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-30T22:35:53.753 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-30T22:35:53.753 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-30T22:35:53.753 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-30T22:35:53.753 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-30T22:35:53.753 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-30T22:35:53.754 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-30T22:35:53.755 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-30T22:35:53.755 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-30T22:35:53.755 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-30T22:35:53.755 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-30T22:35:53.755 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-30T22:35:53.755 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-30T22:35:53.756 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-30T22:35:53.756 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-30T22:35:53.756 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-30T22:35:53.756 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-30T22:35:53.756 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-30T22:35:53.756 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-30T22:35:53.757 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-30T22:35:53.757 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-30T22:35:53.757 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-30T22:35:53.757 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-30T22:35:53.757 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-30T22:35:53.758 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-30T22:35:53.759 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-30T22:35:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-30T22:35:53.761 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-30T22:35:53.761 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-30T22:35:53.761 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-30T22:35:53.761 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-30T22:35:53.762 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-30T22:35:53.762 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-30T22:35:53.762 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-30T22:35:53.762 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-30T22:35:53.762 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-30T22:35:53.762 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-30T22:35:53.763 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-30T22:35:53.763 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-30T22:35:53.763 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-30T22:35:53.763 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-30T22:35:53.763 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-30T22:35:53.763 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-30T22:35:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-30T22:35:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-30T22:35:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-30T22:35:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-30T22:35:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-30T22:35:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-30T22:35:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-30T22:35:53.765 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-30T22:35:53.766 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-30T22:35:53.767 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-30T22:35:53.767 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-30T22:35:53.767 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-30T22:35:53.767 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-30T22:35:53.767 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-30T22:35:53.767 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-30T22:35:53.768 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-30T22:35:53.768 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-30T22:35:53.768 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-30T22:35:53.768 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-30T22:35:53.768 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-30T22:35:53.769 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-30T22:35:53.769 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-30T22:35:53.769 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-30T22:35:53.769 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-30T22:35:53.770 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-30T22:35:53.770 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-30T22:35:53.770 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-30T22:35:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-30T22:35:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-30T22:35:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-30T22:35:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-30T22:35:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-30T22:35:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-30T22:35:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-30T22:35:53.772 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-30T22:35:53.773 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-30T22:35:53.774 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-30T22:35:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-30T22:35:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-30T22:35:53.777 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-30T22:35:53.777 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-30T22:35:53.777 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-30T22:35:53.777 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-30T22:35:53.777 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-30T22:35:53.777 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-30T22:35:53.777 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-30T22:35:53.778 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-30T22:35:53.779 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-30T22:35:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-30T22:35:53.781 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-30T22:35:53.782 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-30T22:35:53.783 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-30T22:35:53.784 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-30T22:35:53.784 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-30T22:35:53.784 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-30T22:35:53.784 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-30T22:35:53.784 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-30T22:35:53.784 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-30T22:35:53.784 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-30T22:35:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-30T22:35:53.786 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-30T22:35:53.787 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-30T22:35:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-30T22:35:53.789 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-30T22:35:53.790 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-30T22:35:53.791 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-30T22:35:53.792 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-30T22:35:53.793 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-30T22:35:53.793 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-30T22:35:53.793 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-30T22:35:53.793 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-30T22:35:53.793 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-30T22:35:53.793 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-30T22:35:53.794 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.794 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-30T22:35:53.822 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2023-09-30T22:35:53.822 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-30T22:35:53.822 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-30T22:35:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-30T22:35:53.824 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.824 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-09-30T22:35:53.824 INFO:teuthology.orchestra.run.smithi142.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-30T22:35:53.824 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-30T22:35:53.824 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.824 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-09-30T22:35:53.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.02 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 129.el8 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Group : System Environment/Base 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 9265586 2023-09-30T22:35:53.903 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Relocations : (not relocatable) 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : CentOS BuildSystem 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2023-09-30T22:35:53.904 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2023-09-30T22:35:53.905 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:35:53.905 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:35:53.905 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:35:53.905 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:35:53.905 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2023-09-30T22:35:53.905 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:35:53.905 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:35:53.906 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:35:53.906 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:53.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:35:56.876 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-09-30T22:35:59.001 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-09-30T22:35:59.003 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-09-30T22:35:59.080 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.tZ2HP0NAfX 2023-09-30T22:35:59.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tZ2HP0NAfX 2023-09-30T22:35:59.164 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.tZ2HP0NAfX 2023-09-30T22:35:59.324 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.tZ2HP0NAfX is 6KB 2023-09-30T22:35:59.372 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.tZ2HP0NAfX 2023-09-30T22:35:59.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:35:59.459 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:35:59.460 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:35:59.460 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:35:59.460 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-09-30T22:35:59.461 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:35:59.617 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2023-09-30T22:36:10.364 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-30T22:36:10.364 DEBUG:teuthology.orchestra.run.smithi148:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-30T22:36:10.424 INFO:teuthology.orchestra.run.smithi148.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.424 INFO:teuthology.orchestra.run.smithi148.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-30T22:36:10.425 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-30T22:36:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-30T22:36:10.427 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-30T22:36:10.428 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-30T22:36:10.429 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-30T22:36:10.429 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-30T22:36:10.429 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-30T22:36:10.429 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-30T22:36:10.429 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-30T22:36:10.429 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-30T22:36:10.429 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-30T22:36:10.430 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-30T22:36:10.431 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-30T22:36:10.432 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-30T22:36:10.432 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-30T22:36:10.432 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-30T22:36:10.432 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-30T22:36:10.432 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-30T22:36:10.432 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-30T22:36:10.432 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-30T22:36:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-30T22:36:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-30T22:36:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-30T22:36:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-30T22:36:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-30T22:36:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-30T22:36:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-30T22:36:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-30T22:36:10.435 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-30T22:36:10.436 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-30T22:36:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-30T22:36:10.438 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-30T22:36:10.438 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-30T22:36:10.438 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-30T22:36:10.438 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-30T22:36:10.438 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-30T22:36:10.438 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-30T22:36:10.438 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-30T22:36:10.439 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-30T22:36:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-30T22:36:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-30T22:36:10.442 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-30T22:36:10.443 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-30T22:36:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-30T22:36:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-30T22:36:10.446 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-30T22:36:10.447 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-30T22:36:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-30T22:36:10.449 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-30T22:36:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-30T22:36:10.451 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-30T22:36:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-30T22:36:10.453 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-30T22:36:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-30T22:36:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-30T22:36:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-30T22:36:10.457 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-30T22:36:10.458 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-30T22:36:10.459 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-30T22:36:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-30T22:36:10.461 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-30T22:36:10.462 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-30T22:36:10.463 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-30T22:36:10.464 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-30T22:36:10.465 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-30T22:36:10.466 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-30T22:36:10.467 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-30T22:36:10.468 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-30T22:36:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-30T22:36:10.470 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-30T22:36:10.471 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-30T22:36:10.472 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-30T22:36:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-30T22:36:10.474 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-30T22:36:10.475 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-30T22:36:10.476 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-30T22:36:10.477 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-30T22:36:10.478 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-30T22:36:10.479 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-30T22:36:10.480 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-30T22:36:10.481 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-30T22:36:10.482 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-30T22:36:10.483 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-30T22:36:10.484 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-30T22:36:10.485 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-30T22:36:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-30T22:36:10.487 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-30T22:36:10.488 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-30T22:36:10.489 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-30T22:36:10.490 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-30T22:36:10.491 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-30T22:36:10.492 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-30T22:36:10.493 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-30T22:36:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-30T22:36:10.495 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-30T22:36:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-30T22:36:10.497 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-30T22:36:10.498 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-30T22:36:10.499 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-30T22:36:10.500 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-30T22:36:10.501 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-30T22:36:10.502 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-30T22:36:10.503 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-30T22:36:10.504 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-30T22:36:10.505 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-30T22:36:10.506 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-30T22:36:10.507 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-30T22:36:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-30T22:36:10.509 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-30T22:36:10.510 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-30T22:36:10.511 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-30T22:36:10.512 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-30T22:36:10.513 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-30T22:36:10.514 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-30T22:36:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-30T22:36:10.516 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-30T22:36:10.517 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-30T22:36:10.518 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-30T22:36:10.519 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-30T22:36:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-30T22:36:10.521 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-30T22:36:10.522 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-30T22:36:10.523 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-30T22:36:10.524 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-30T22:36:10.525 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-30T22:36:10.526 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-30T22:36:10.527 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-30T22:36:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-30T22:36:10.529 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-30T22:36:10.530 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-30T22:36:10.531 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-30T22:36:10.532 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-30T22:36:10.533 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-30T22:36:10.534 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-30T22:36:10.535 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-30T22:36:10.536 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-30T22:36:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-30T22:36:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-30T22:36:10.541 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-30T22:36:10.541 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-30T22:36:10.541 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-30T22:36:10.541 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-30T22:36:10.541 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-30T22:36:10.541 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-30T22:36:10.541 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-30T22:36:10.542 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-30T22:36:10.543 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-30T22:36:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-30T22:36:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-30T22:36:10.546 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-30T22:36:10.547 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-30T22:36:10.548 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-30T22:36:10.549 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-30T22:36:10.550 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-30T22:36:10.551 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-30T22:36:10.552 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-30T22:36:10.553 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-30T22:36:10.554 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-30T22:36:10.555 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-30T22:36:10.556 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-30T22:36:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-30T22:36:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-30T22:36:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-30T22:36:10.560 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-30T22:36:10.561 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-30T22:36:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-30T22:36:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-30T22:36:10.564 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-30T22:36:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-30T22:36:10.566 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-30T22:36:10.567 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-30T22:36:10.568 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-30T22:36:10.569 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-30T22:36:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-30T22:36:10.571 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-30T22:36:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-30T22:36:10.573 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-30T22:36:10.574 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-30T22:36:10.575 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-30T22:36:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-30T22:36:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-30T22:36:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-30T22:36:10.579 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-30T22:36:10.580 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-30T22:36:10.581 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-30T22:36:10.582 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-30T22:36:10.583 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-30T22:36:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-30T22:36:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-30T22:36:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-30T22:36:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-30T22:36:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-30T22:36:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-30T22:36:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-30T22:36:10.591 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-30T22:36:10.592 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-30T22:36:10.593 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-30T22:36:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-30T22:36:10.595 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.595 DEBUG:teuthology.orchestra.run.smithi148:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-30T22:36:10.623 INFO:teuthology.orchestra.run.smithi148.stdout:postinstall scriptlet (using /bin/sh): 2023-09-30T22:36:10.623 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-30T22:36:10.623 INFO:teuthology.orchestra.run.smithi148.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:36:10.623 INFO:teuthology.orchestra.run.smithi148.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:36:10.623 INFO:teuthology.orchestra.run.smithi148.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-30T22:36:10.624 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.625 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2023-09-30T22:36:10.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.02 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 129.el8 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Group : System Environment/Base 2023-09-30T22:36:10.706 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 9265586 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Relocations : (not relocatable) 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : CentOS BuildSystem 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:36:10.707 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:36:10.708 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:36:10.708 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:36:10.708 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2023-09-30T22:36:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:36:10.708 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:36:10.709 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:36:10.709 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:10.709 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:36:14.287 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2023-09-30T22:36:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:done 2023-09-30T22:36:16.459 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-09-30T22:36:16.492 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.rGoWv7nQd4 2023-09-30T22:36:16.493 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rGoWv7nQd4 2023-09-30T22:36:16.571 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.rGoWv7nQd4 2023-09-30T22:36:16.744 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.rGoWv7nQd4 is 6KB 2023-09-30T22:36:16.778 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.rGoWv7nQd4 2023-09-30T22:36:16.798 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:36:16.885 INFO:teuthology.orchestra.run.smithi148.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:36:16.885 INFO:teuthology.orchestra.run.smithi148.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:36:16.885 INFO:teuthology.orchestra.run.smithi148.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:36:16.885 INFO:teuthology.orchestra.run.smithi148.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-09-30T22:36:16.886 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:36:17.104 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2023-09-30T22:36:29.623 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-30T22:36:29.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-30T22:36:29.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:36:47.122 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-09-30T22:36:47.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-30T22:36:47.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:36:48.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-30T22:36:57.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-30T22:36:57.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:37:05.530 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-30T22:37:14.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-30T22:37:14.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:37:17.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-09-30T22:37:29.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-30T22:37:29.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:37:57.158 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T22:38:09.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-30T22:38:09.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:38:09.580 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-09-30T22:38:09.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-30T22:38:09.994 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-30T22:38:09.994 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-09-30T22:38:10.038 INFO:teuthology.orchestra.run.smithi142.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-30T22:38:10.038 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:38:10.039 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:38:10.039 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:38:11.040 DEBUG:teuthology.parallel:result is None 2023-09-30T22:38:29.606 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T22:38:44.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-30T22:38:44.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:38:45.013 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-09-30T22:38:45.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-30T22:38:45.448 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-30T22:38:45.449 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-09-30T22:38:45.494 INFO:teuthology.orchestra.run.smithi148.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-30T22:38:45.494 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:38:45.494 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:38:45.495 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:38:46.495 DEBUG:teuthology.parallel:result is None 2023-09-30T22:38:46.495 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T22:38:46.502 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T22:38:46.502 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:38:46.507 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:38:46.557 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T22:38:46.564 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T22:38:46.584 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T22:38:46.585 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:38:46.589 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:38:46.705 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T22:38:46.711 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T22:38:46.711 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:38:46.716 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:38:46.833 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:38:46.842 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:38:46.863 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:38:46.873 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:38:46.876 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T22:38:46.883 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T22:38:46.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:38:46.887 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:38:46.958 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T22:38:46.970 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T22:38:46.970 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:38:46.974 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:38:47.020 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:38:47.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:38:47.207 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:38:47.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:38:47.351 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:38:47.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:38:47.419 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:38:47.493 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:38:47.563 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:38:47.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:38:47.704 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:38:47.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:38:47.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2023-09-30T22:38:47.777 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2023-09-30T22:38:47.911 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:38:47.929 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:38:48.348 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T22:38:48.364 INFO:teuthology.task.internal:Starting timer... 2023-09-30T22:38:48.364 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T22:38:48.385 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T22:38:48.394 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-30T22:38:48.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2023-09-30T22:38:48.527 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2023-09-30T22:38:48.531 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2023-09-30T22:38:48.662 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2023-09-30T22:38:48.665 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T22:38:48.665 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2023-09-30T22:38:48.717 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2023-09-30T22:38:48.718 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2023-09-30T22:38:48.773 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2023-09-30T22:38:48.773 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2023-09-30T22:38:48.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:38:48.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:38:48.844 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:38:48.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:38:48.914 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T22:38:48.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:38:48.987 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:38:49.056 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T22:38:49.071 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-30T22:38:49.071 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T22:38:49.094 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T22:38:49.095 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T22:49:07.945 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2023-09-30T22:49:07.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-30T22:49:07.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:49:08.030 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-09-30T22:49:08.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-30T22:49:08.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-30T22:49:08.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:49:08.229 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-09-30T22:49:08.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-09-30T22:49:08.339 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T22:49:08.349 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T22:49:08.349 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:49:08.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:49:08.354 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:49:08.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:49:08.424 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:49:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:49:08.457 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:49:08.488 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:49:08.550 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2023-09-30T22:49:08.577 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2023-09-30T22:49:08.583 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2023-09-30T22:49:08.610 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:49:08.610 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2023-09-30T22:49:08.642 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:49:08.643 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:49:08.676 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:49:08.728 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2023-09-30T22:49:08.735 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:49:08.735 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-09-30T22:49:08.735 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.735 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.735 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.735 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.767 INFO:teuthology.orchestra.run.smithi148.stderr:bash: ntpq: command not found 2023-09-30T22:49:08.774 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:49:08.775 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-09-30T22:49:08.775 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.775 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.775 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.775 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:49:08.776 INFO:teuthology.run_tasks:Running task install... 2023-09-30T22:49:08.784 DEBUG:teuthology.task.install:project ceph 2023-09-30T22:49:08.784 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b'}} 2023-09-30T22:49:08.784 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b'} 2023-09-30T22:49:08.784 INFO:teuthology.task.install:Using flavor: default 2023-09-30T22:49:08.793 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:49:08.793 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-30T22:49:08.793 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b', 'tag': None, 'wait_for_package': False} 2023-09-30T22:49:08.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=87156194a943657e20fb2be831ae4046cdd8917b 2023-09-30T22:49:08.795 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b', 'tag': None, 'wait_for_package': False} 2023-09-30T22:49:08.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=87156194a943657e20fb2be831ae4046cdd8917b 2023-09-30T22:49:08.938 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/ 2023-09-30T22:49:08.938 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1188.g87156194 2023-09-30T22:49:09.011 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/ 2023-09-30T22:49:09.011 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1188.g87156194 2023-09-30T22:49:09.113 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:49:09.113 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:49:09.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:49:09.118 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-quincy-20230929.071619/87156194a943657e20fb2be831ae4046cdd8917b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:49:09.118 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:49:09.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:49:09.184 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-30T22:49:09.185 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/87156194a943657e20fb2be831ae4046cdd8917b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:49:09.190 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-30T22:49:09.190 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/87156194a943657e20fb2be831ae4046cdd8917b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:49:09.297 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:49:09.300 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:49:09.393 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:49:09.395 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:49:09.462 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2023-09-30T22:49:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2023-09-30T22:49:09.465 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2023-09-30T22:49:09.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2023-09-30T22:49:09.813 INFO:teuthology.orchestra.run.smithi142.stdout:76 files removed 2023-09-30T22:49:09.817 INFO:teuthology.orchestra.run.smithi148.stdout:76 files removed 2023-09-30T22:49:09.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-30T22:49:09.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-30T22:49:10.657 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 296 kB/s | 78 kB 00:00 2023-09-30T22:49:10.725 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 244 kB/s | 78 kB 00:00 2023-09-30T22:49:11.049 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 26 kB/s | 9.2 kB 00:00 2023-09-30T22:49:11.092 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 28 kB/s | 9.2 kB 00:00 2023-09-30T22:49:11.433 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2023-09-30T22:49:11.451 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 4.4 kB/s | 1.4 kB 00:00 2023-09-30T22:49:13.960 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-09-30T22:49:14.042 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-09-30T22:49:23.469 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 48 MB 00:03 2023-09-30T22:49:24.009 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 48 MB 00:03 2023-09-30T22:49:30.844 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - Extras 92 kB/s | 18 kB 00:00 2023-09-30T22:49:31.342 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras 95 kB/s | 18 kB 00:00 2023-09-30T22:49:31.661 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.9 kB 00:00 2023-09-30T22:49:31.985 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.9 kB 00:00 2023-09-30T22:49:32.279 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 8 - PowerTools 14 MB/s | 6.5 MB 00:00 2023-09-30T22:49:32.452 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - PowerTools 21 MB/s | 6.5 MB 00:00 2023-09-30T22:49:33.889 INFO:teuthology.orchestra.run.smithi148.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-09-30T22:49:34.070 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-09-30T22:49:35.057 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-09-30T22:49:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-09-30T22:49:39.499 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 334 kB/s | 24 kB 00:00 2023-09-30T22:49:40.046 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 427 kB/s | 24 kB 00:00 2023-09-30T22:49:43.925 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:49:43.925 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:49:43.939 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:49:43.939 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:49:43.940 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:49:43.941 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:49:43.942 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-30T22:49:43.944 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-30T22:49:43.947 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-30T22:49:43.948 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-30T22:49:44.171 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-09-30T22:49:44.185 INFO:teuthology.orchestra.run.smithi148.stdout:==================================================================================================== 2023-09-30T22:49:44.185 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2023-09-30T22:49:44.185 INFO:teuthology.orchestra.run.smithi148.stdout:==================================================================================================== 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:17.2.6-1188.g87156194.el8 ceph 6.4 k 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:17.2.6-1188.g87156194.el8 ceph 5.2 M 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:17.2.6-1188.g87156194.el8 ceph 876 k 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1188.g87156194.el8 ceph 162 k 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:17.2.6-1188.g87156194.el8 ceph 1.6 M 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 121 k 2023-09-30T22:49:44.186 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 1.7 M 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 7.4 M 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 47 k 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:17.2.6-1188.g87156194.el8 ceph 17 M 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:17.2.6-1188.g87156194.el8 ceph 52 M 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 267 k 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 80 k 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:17.2.6-1188.g87156194.el8 ceph 255 k 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 18 k 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:49:44.187 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:17.2.6-1188.g87156194.el8 ceph 25 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:17.2.6-1188.g87156194.el8 ceph 797 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:17.2.6-1188.g87156194.el8 ceph 130 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:17.2.6-1188.g87156194.el8 ceph 190 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:17.2.6-1188.g87156194.el8 ceph 370 k 2023-09-30T22:49:44.188 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:17.2.6-1188.g87156194.el8 ceph 358 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:17.2.6-1188.g87156194.el8 ceph 107 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:17.2.6-1188.g87156194.el8 ceph 90 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.5 M 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:17.2.6-1188.g87156194.el8 ceph 173 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:49:44.189 INFO:teuthology.orchestra.run.smithi148.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.5 M 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.6 M 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:49:44.190 INFO:teuthology.orchestra.run.smithi148.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:17.2.6-1188.g87156194.el8 ceph 23 M 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 23 k 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:17.2.6-1188.g87156194.el8 ceph 2.3 M 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 238 k 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.9 M 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:17.2.6-1188.g87156194.el8 ceph 17 M 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 14 k 2023-09-30T22:49:44.191 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:17.2.6-1188.g87156194.el8 ceph 24 k 2023-09-30T22:49:44.192 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:49:44.192 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:49:44.192 INFO:teuthology.orchestra.run.smithi148.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:49:44.192 INFO:teuthology.orchestra.run.smithi148.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:49:44.192 INFO:teuthology.orchestra.run.smithi148.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:49:44.192 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:17.2.6-1188.g87156194.el8 ceph 174 k 2023-09-30T22:49:44.192 INFO:teuthology.orchestra.run.smithi148.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:17.2.6-1188.g87156194.el8 ceph 506 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:17.2.6-1188.g87156194.el8 ceph 5.5 M 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:49:44.193 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-09-30T22:49:44.194 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:17.2.6-1188.g87156194.el8 ceph 45 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:17.2.6-1188.g87156194.el8 ceph 115 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:49:44.195 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:49:44.196 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:49:44.197 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:49:44.198 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:49:44.198 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:49:44.198 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:49:44.199 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:49:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:49:44.201 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2023-09-30T22:49:44.201 INFO:teuthology.orchestra.run.smithi148.stdout:==================================================================================================== 2023-09-30T22:49:44.201 INFO:teuthology.orchestra.run.smithi148.stdout:Install 123 Packages 2023-09-30T22:49:44.201 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 16 Packages 2023-09-30T22:49:44.201 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:49:44.201 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 210 M 2023-09-30T22:49:44.202 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2023-09-30T22:49:44.423 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:49:44.423 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:49:44.437 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:49:44.437 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:49:44.438 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:49:44.439 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:49:44.440 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-30T22:49:44.442 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-30T22:49:44.445 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-30T22:49:44.446 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-30T22:49:44.665 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-09-30T22:49:44.679 INFO:teuthology.orchestra.run.smithi142.stdout:==================================================================================================== 2023-09-30T22:49:44.679 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-09-30T22:49:44.679 INFO:teuthology.orchestra.run.smithi142.stdout:==================================================================================================== 2023-09-30T22:49:44.679 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:17.2.6-1188.g87156194.el8 ceph 6.4 k 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:17.2.6-1188.g87156194.el8 ceph 5.2 M 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:17.2.6-1188.g87156194.el8 ceph 876 k 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1188.g87156194.el8 ceph 162 k 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:17.2.6-1188.g87156194.el8 ceph 1.6 M 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 121 k 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 1.7 M 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 7.4 M 2023-09-30T22:49:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 47 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:17.2.6-1188.g87156194.el8 ceph 17 M 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:17.2.6-1188.g87156194.el8 ceph 52 M 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 267 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 80 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:17.2.6-1188.g87156194.el8 ceph 255 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 18 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:17.2.6-1188.g87156194.el8 ceph 25 k 2023-09-30T22:49:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:17.2.6-1188.g87156194.el8 ceph 797 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:17.2.6-1188.g87156194.el8 ceph 130 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:17.2.6-1188.g87156194.el8 ceph 190 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:17.2.6-1188.g87156194.el8 ceph 370 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:17.2.6-1188.g87156194.el8 ceph 358 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:17.2.6-1188.g87156194.el8 ceph 107 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:17.2.6-1188.g87156194.el8 ceph 90 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.5 M 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:17.2.6-1188.g87156194.el8 ceph 173 k 2023-09-30T22:49:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-09-30T22:49:44.683 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-09-30T22:49:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:49:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:49:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:49:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:49:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:49:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.5 M 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.6 M 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:49:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:17.2.6-1188.g87156194.el8 ceph 23 M 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 23 k 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:17.2.6-1188.g87156194.el8 ceph 2.3 M 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 238 k 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:17.2.6-1188.g87156194.el8 ceph 3.9 M 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:17.2.6-1188.g87156194.el8 ceph 17 M 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1188.g87156194.el8 ceph-noarch 14 k 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:17.2.6-1188.g87156194.el8 ceph 24 k 2023-09-30T22:49:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:17.2.6-1188.g87156194.el8 ceph 174 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:17.2.6-1188.g87156194.el8 ceph 506 k 2023-09-30T22:49:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:17.2.6-1188.g87156194.el8 ceph 5.5 M 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:49:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:17.2.6-1188.g87156194.el8 ceph 45 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:17.2.6-1188.g87156194.el8 ceph 115 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:49:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:49:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:49:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:49:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:49:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout:==================================================================================================== 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout:Install 123 Packages 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 16 Packages 2023-09-30T22:49:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:49:44.694 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 210 M 2023-09-30T22:49:44.694 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-09-30T22:49:44.841 INFO:teuthology.orchestra.run.smithi148.stdout:(1/139): ceph-17.2.6-1188.g87156194.el8.x86_64. 45 kB/s | 6.4 kB 00:00 2023-09-30T22:49:45.342 INFO:teuthology.orchestra.run.smithi148.stdout:(2/139): ceph-fuse-17.2.6-1188.g87156194.el8.x8 1.7 MB/s | 876 kB 00:00 2023-09-30T22:49:45.433 INFO:teuthology.orchestra.run.smithi148.stdout:(3/139): ceph-immutable-object-cache-17.2.6-118 1.7 MB/s | 162 kB 00:00 2023-09-30T22:49:45.548 INFO:teuthology.orchestra.run.smithi142.stdout:(1/139): ceph-17.2.6-1188.g87156194.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-09-30T22:49:46.234 INFO:teuthology.orchestra.run.smithi148.stdout:(4/139): ceph-mds-17.2.6-1188.g87156194.el8.x86 2.9 MB/s | 2.3 MB 00:00 2023-09-30T22:49:46.239 INFO:teuthology.orchestra.run.smithi142.stdout:(2/139): ceph-fuse-17.2.6-1188.g87156194.el8.x8 1.2 MB/s | 876 kB 00:00 2023-09-30T22:49:46.357 INFO:teuthology.orchestra.run.smithi142.stdout:(3/139): ceph-immutable-object-cache-17.2.6-118 1.4 MB/s | 162 kB 00:00 2023-09-30T22:49:46.651 INFO:teuthology.orchestra.run.smithi148.stdout:(5/139): ceph-mgr-17.2.6-1188.g87156194.el8.x86 3.8 MB/s | 1.6 MB 00:00 2023-09-30T22:49:47.473 INFO:teuthology.orchestra.run.smithi142.stdout:(4/139): ceph-mds-17.2.6-1188.g87156194.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-09-30T22:49:47.492 INFO:teuthology.orchestra.run.smithi148.stdout:(6/139): ceph-mon-17.2.6-1188.g87156194.el8.x86 4.7 MB/s | 3.9 MB 00:00 2023-09-30T22:49:48.111 INFO:teuthology.orchestra.run.smithi142.stdout:(5/139): ceph-mgr-17.2.6-1188.g87156194.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-09-30T22:49:48.301 INFO:teuthology.orchestra.run.smithi148.stdout:(7/139): ceph-base-17.2.6-1188.g87156194.el8.x8 1.4 MB/s | 5.2 MB 00:03 2023-09-30T22:49:48.941 INFO:teuthology.orchestra.run.smithi142.stdout:(6/139): ceph-base-17.2.6-1188.g87156194.el8.x8 1.4 MB/s | 5.2 MB 00:03 2023-09-30T22:49:49.125 INFO:teuthology.orchestra.run.smithi142.stdout:(7/139): ceph-mon-17.2.6-1188.g87156194.el8.x86 3.9 MB/s | 3.9 MB 00:01 2023-09-30T22:49:49.735 INFO:teuthology.orchestra.run.smithi148.stdout:(8/139): ceph-osd-17.2.6-1188.g87156194.el8.x86 7.5 MB/s | 17 MB 00:02 2023-09-30T22:49:49.785 INFO:teuthology.orchestra.run.smithi148.stdout:(9/139): ceph-selinux-17.2.6-1188.g87156194.el8 491 kB/s | 24 kB 00:00 2023-09-30T22:49:50.894 INFO:teuthology.orchestra.run.smithi148.stdout:(10/139): ceph-common-17.2.6-1188.g87156194.el8 3.8 MB/s | 23 MB 00:06 2023-09-30T22:49:51.044 INFO:teuthology.orchestra.run.smithi148.stdout:(11/139): cephfs-mirror-17.2.6-1188.g87156194.e 1.7 MB/s | 255 kB 00:00 2023-09-30T22:49:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:(12/139): libcephfs-devel-17.2.6-1188.g87156194 298 kB/s | 25 kB 00:00 2023-09-30T22:49:51.303 INFO:teuthology.orchestra.run.smithi148.stdout:(13/139): libcephfs2-17.2.6-1188.g87156194.el8. 4.5 MB/s | 797 kB 00:00 2023-09-30T22:49:51.395 INFO:teuthology.orchestra.run.smithi148.stdout:(14/139): libcephsqlite-17.2.6-1188.g87156194.e 1.9 MB/s | 174 kB 00:00 2023-09-30T22:49:51.478 INFO:teuthology.orchestra.run.smithi148.stdout:(15/139): librados-devel-17.2.6-1188.g87156194. 1.5 MB/s | 130 kB 00:00 2023-09-30T22:49:51.637 INFO:teuthology.orchestra.run.smithi148.stdout:(16/139): libradosstriper1-17.2.6-1188.g8715619 3.1 MB/s | 506 kB 00:00 2023-09-30T22:49:52.410 INFO:teuthology.orchestra.run.smithi142.stdout:(8/139): ceph-osd-17.2.6-1188.g87156194.el8.x86 4.8 MB/s | 17 MB 00:03 2023-09-30T22:49:52.599 INFO:teuthology.orchestra.run.smithi142.stdout:(9/139): ceph-radosgw-17.2.6-1188.g87156194.el8 4.8 MB/s | 17 MB 00:03 2023-09-30T22:49:52.624 INFO:teuthology.orchestra.run.smithi142.stdout:(10/139): ceph-selinux-17.2.6-1188.g87156194.el 114 kB/s | 24 kB 00:00 2023-09-30T22:49:52.662 INFO:teuthology.orchestra.run.smithi148.stdout:(17/139): librgw2-17.2.6-1188.g87156194.el8.x86 5.4 MB/s | 5.5 MB 00:01 2023-09-30T22:49:52.725 INFO:teuthology.orchestra.run.smithi142.stdout:(11/139): cephfs-mirror-17.2.6-1188.g87156194.e 2.5 MB/s | 255 kB 00:00 2023-09-30T22:49:52.771 INFO:teuthology.orchestra.run.smithi148.stdout:(18/139): python3-ceph-argparse-17.2.6-1188.g87 413 kB/s | 45 kB 00:00 2023-09-30T22:49:52.825 INFO:teuthology.orchestra.run.smithi142.stdout:(12/139): libcephfs-devel-17.2.6-1188.g87156194 249 kB/s | 25 kB 00:00 2023-09-30T22:49:52.871 INFO:teuthology.orchestra.run.smithi148.stdout:(19/139): python3-ceph-common-17.2.6-1188.g8715 1.1 MB/s | 115 kB 00:00 2023-09-30T22:49:53.042 INFO:teuthology.orchestra.run.smithi142.stdout:(13/139): libcephfs2-17.2.6-1188.g87156194.el8. 3.6 MB/s | 797 kB 00:00 2023-09-30T22:49:53.134 INFO:teuthology.orchestra.run.smithi142.stdout:(14/139): libcephsqlite-17.2.6-1188.g87156194.e 1.9 MB/s | 174 kB 00:00 2023-09-30T22:49:53.234 INFO:teuthology.orchestra.run.smithi142.stdout:(15/139): librados-devel-17.2.6-1188.g87156194. 1.3 MB/s | 130 kB 00:00 2023-09-30T22:49:53.579 INFO:teuthology.orchestra.run.smithi148.stdout:(20/139): python3-cephfs-17.2.6-1188.g87156194. 268 kB/s | 190 kB 00:00 2023-09-30T22:49:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:(16/139): libradosstriper1-17.2.6-1188.g8715619 1.4 MB/s | 506 kB 00:00 2023-09-30T22:49:53.963 INFO:teuthology.orchestra.run.smithi148.stdout:(21/139): python3-rados-17.2.6-1188.g87156194.e 966 kB/s | 370 kB 00:00 2023-09-30T22:49:54.122 INFO:teuthology.orchestra.run.smithi148.stdout:(22/139): python3-rbd-17.2.6-1188.g87156194.el8 2.2 MB/s | 358 kB 00:00 2023-09-30T22:49:54.247 INFO:teuthology.orchestra.run.smithi148.stdout:(23/139): python3-rgw-17.2.6-1188.g87156194.el8 856 kB/s | 107 kB 00:00 2023-09-30T22:49:54.356 INFO:teuthology.orchestra.run.smithi148.stdout:(24/139): rbd-fuse-17.2.6-1188.g87156194.el8.x8 837 kB/s | 90 kB 00:00 2023-09-30T22:49:54.743 INFO:teuthology.orchestra.run.smithi142.stdout:(17/139): librgw2-17.2.6-1188.g87156194.el8.x86 4.8 MB/s | 5.5 MB 00:01 2023-09-30T22:49:54.818 INFO:teuthology.orchestra.run.smithi142.stdout:(18/139): python3-ceph-argparse-17.2.6-1188.g87 597 kB/s | 45 kB 00:00 2023-09-30T22:49:54.902 INFO:teuthology.orchestra.run.smithi142.stdout:(19/139): python3-ceph-common-17.2.6-1188.g8715 1.4 MB/s | 115 kB 00:00 2023-09-30T22:49:54.985 INFO:teuthology.orchestra.run.smithi142.stdout:(20/139): python3-cephfs-17.2.6-1188.g87156194. 2.2 MB/s | 190 kB 00:00 2023-09-30T22:49:55.073 INFO:teuthology.orchestra.run.smithi148.stdout:(25/139): rbd-mirror-17.2.6-1188.g87156194.el8. 4.8 MB/s | 3.5 MB 00:00 2023-09-30T22:49:55.102 INFO:teuthology.orchestra.run.smithi142.stdout:(21/139): python3-rados-17.2.6-1188.g87156194.e 3.1 MB/s | 370 kB 00:00 2023-09-30T22:49:55.195 INFO:teuthology.orchestra.run.smithi142.stdout:(22/139): python3-rbd-17.2.6-1188.g87156194.el8 3.8 MB/s | 358 kB 00:00 2023-09-30T22:49:55.278 INFO:teuthology.orchestra.run.smithi142.stdout:(23/139): python3-rgw-17.2.6-1188.g87156194.el8 1.3 MB/s | 107 kB 00:00 2023-09-30T22:49:55.345 INFO:teuthology.orchestra.run.smithi142.stdout:(24/139): rbd-fuse-17.2.6-1188.g87156194.el8.x8 1.3 MB/s | 90 kB 00:00 2023-09-30T22:49:55.548 INFO:teuthology.orchestra.run.smithi148.stdout:(26/139): ceph-test-17.2.6-1188.g87156194.el8.x 9.0 MB/s | 52 MB 00:05 2023-09-30T22:49:55.573 INFO:teuthology.orchestra.run.smithi148.stdout:(27/139): rbd-nbd-17.2.6-1188.g87156194.el8.x86 346 kB/s | 173 kB 00:00 2023-09-30T22:49:55.598 INFO:teuthology.orchestra.run.smithi148.stdout:(28/139): ceph-grafana-dashboards-17.2.6-1188.g 463 kB/s | 23 kB 00:00 2023-09-30T22:49:55.641 INFO:teuthology.orchestra.run.smithi148.stdout:(29/139): ceph-mgr-cephadm-17.2.6-1188.g8715619 1.8 MB/s | 121 kB 00:00 2023-09-30T22:49:55.882 INFO:teuthology.orchestra.run.smithi148.stdout:(30/139): ceph-mgr-dashboard-17.2.6-1188.g87156 6.0 MB/s | 1.7 MB 00:00 2023-09-30T22:49:55.945 INFO:teuthology.orchestra.run.smithi142.stdout:(25/139): rbd-mirror-17.2.6-1188.g87156194.el8. 5.8 MB/s | 3.5 MB 00:00 2023-09-30T22:49:55.966 INFO:teuthology.orchestra.run.smithi148.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1188.g87 2.8 MB/s | 238 kB 00:00 2023-09-30T22:49:56.004 INFO:teuthology.orchestra.run.smithi142.stdout:(26/139): rbd-nbd-17.2.6-1188.g87156194.el8.x86 2.9 MB/s | 173 kB 00:00 2023-09-30T22:49:56.016 INFO:teuthology.orchestra.run.smithi148.stdout:(32/139): ceph-mgr-rook-17.2.6-1188.g87156194.e 947 kB/s | 47 kB 00:00 2023-09-30T22:49:56.054 INFO:teuthology.orchestra.run.smithi142.stdout:(27/139): ceph-grafana-dashboards-17.2.6-1188.g 462 kB/s | 23 kB 00:00 2023-09-30T22:49:56.067 INFO:teuthology.orchestra.run.smithi148.stdout:(33/139): ceph-prometheus-alerts-17.2.6-1188.g8 291 kB/s | 14 kB 00:00 2023-09-30T22:49:56.113 INFO:teuthology.orchestra.run.smithi142.stdout:(28/139): ceph-mgr-cephadm-17.2.6-1188.g8715619 2.0 MB/s | 121 kB 00:00 2023-09-30T22:49:56.142 INFO:teuthology.orchestra.run.smithi148.stdout:(34/139): ceph-volume-17.2.6-1188.g87156194.el8 3.5 MB/s | 267 kB 00:00 2023-09-30T22:49:56.201 INFO:teuthology.orchestra.run.smithi148.stdout:(35/139): cephadm-17.2.6-1188.g87156194.el8.noa 1.3 MB/s | 80 kB 00:00 2023-09-30T22:49:56.401 INFO:teuthology.orchestra.run.smithi148.stdout:(36/139): ceph-radosgw-17.2.6-1188.g87156194.el 2.1 MB/s | 17 MB 00:08 2023-09-30T22:49:56.405 INFO:teuthology.orchestra.run.smithi142.stdout:(29/139): ceph-mgr-dashboard-17.2.6-1188.g87156 5.8 MB/s | 1.7 MB 00:00 2023-09-30T22:49:56.426 INFO:teuthology.orchestra.run.smithi148.stdout:(37/139): cephfs-top-17.2.6-1188.g87156194.el8. 79 kB/s | 18 kB 00:00 2023-09-30T22:49:56.902 INFO:teuthology.orchestra.run.smithi148.stdout:(38/139): ceph-mgr-diskprediction-local-17.2.6- 5.9 MB/s | 7.4 MB 00:01 2023-09-30T22:49:56.913 INFO:teuthology.orchestra.run.smithi142.stdout:(30/139): ceph-common-17.2.6-1188.g87156194.el8 2.0 MB/s | 23 MB 00:11 2023-09-30T22:49:57.064 INFO:teuthology.orchestra.run.smithi142.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1188.g87 1.6 MB/s | 238 kB 00:00 2023-09-30T22:49:57.135 INFO:teuthology.orchestra.run.smithi148.stdout:(39/139): automake-1.16.1-8.el8.noarch.rpm 1.0 MB/s | 740 kB 00:00 2023-09-30T22:49:57.139 INFO:teuthology.orchestra.run.smithi142.stdout:(32/139): ceph-mgr-rook-17.2.6-1188.g87156194.e 632 kB/s | 47 kB 00:00 2023-09-30T22:49:57.160 INFO:teuthology.orchestra.run.smithi148.stdout:(40/139): bison-3.0.4-10.el8.x86_64.rpm 939 kB/s | 688 kB 00:00 2023-09-30T22:49:57.206 INFO:teuthology.orchestra.run.smithi142.stdout:(33/139): ceph-prometheus-alerts-17.2.6-1188.g8 217 kB/s | 14 kB 00:00 2023-09-30T22:49:57.255 INFO:teuthology.orchestra.run.smithi148.stdout:(41/139): jq-1.6-7.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2023-09-30T22:49:57.294 INFO:teuthology.orchestra.run.smithi148.stdout:(42/139): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-09-30T22:49:57.315 INFO:teuthology.orchestra.run.smithi142.stdout:(34/139): ceph-volume-17.2.6-1188.g87156194.el8 2.4 MB/s | 267 kB 00:00 2023-09-30T22:49:57.382 INFO:teuthology.orchestra.run.smithi142.stdout:(35/139): cephadm-17.2.6-1188.g87156194.el8.noa 1.2 MB/s | 80 kB 00:00 2023-09-30T22:49:57.420 INFO:teuthology.orchestra.run.smithi148.stdout:(43/139): libtool-2.4.6-25.el8.x86_64.rpm 4.2 MB/s | 709 kB 00:00 2023-09-30T22:49:57.445 INFO:teuthology.orchestra.run.smithi148.stdout:(44/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-09-30T22:49:57.449 INFO:teuthology.orchestra.run.smithi142.stdout:(36/139): cephfs-top-17.2.6-1188.g87156194.el8. 267 kB/s | 18 kB 00:00 2023-09-30T22:49:57.479 INFO:teuthology.orchestra.run.smithi148.stdout:(45/139): flex-2.6.1-9.el8.x86_64.rpm 554 kB/s | 320 kB 00:00 2023-09-30T22:49:57.530 INFO:teuthology.orchestra.run.smithi148.stdout:(46/139): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-09-30T22:49:57.574 INFO:teuthology.orchestra.run.smithi142.stdout:(37/139): ceph-mgr-diskprediction-local-17.2.6- 6.3 MB/s | 7.4 MB 00:01 2023-09-30T22:49:57.838 INFO:teuthology.orchestra.run.smithi148.stdout:(47/139): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-09-30T22:49:57.921 INFO:teuthology.orchestra.run.smithi148.stdout:(48/139): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-09-30T22:49:57.955 INFO:teuthology.orchestra.run.smithi148.stdout:(49/139): python3-jinja2-2.10.1-3.el8.noarch.rp 4.5 MB/s | 538 kB 00:00 2023-09-30T22:49:58.038 INFO:teuthology.orchestra.run.smithi148.stdout:(50/139): openblas-threads-0.3.15-4.el8.x86_64. 8.7 MB/s | 4.9 MB 00:00 2023-09-30T22:49:58.064 INFO:teuthology.orchestra.run.smithi148.stdout:(51/139): python3-jsonpatch-1.21-2.el8.noarch.r 187 kB/s | 27 kB 00:00 2023-09-30T22:49:58.089 INFO:teuthology.orchestra.run.smithi148.stdout:(52/139): python3-jsonpointer-1.10-11.el8.noarc 149 kB/s | 20 kB 00:00 2023-09-30T22:49:58.133 INFO:teuthology.orchestra.run.smithi142.stdout:(38/139): automake-1.16.1-8.el8.noarch.rpm 1.1 MB/s | 740 kB 00:00 2023-09-30T22:49:58.147 INFO:teuthology.orchestra.run.smithi148.stdout:(53/139): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-09-30T22:49:58.189 INFO:teuthology.orchestra.run.smithi148.stdout:(54/139): python3-markupsafe-0.23-19.el8.x86_64 388 kB/s | 39 kB 00:00 2023-09-30T22:49:58.250 INFO:teuthology.orchestra.run.smithi142.stdout:(39/139): bison-3.0.4-10.el8.x86_64.rpm 1.0 MB/s | 688 kB 00:00 2023-09-30T22:49:58.256 INFO:teuthology.orchestra.run.smithi148.stdout:(55/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-09-30T22:49:58.275 INFO:teuthology.orchestra.run.smithi142.stdout:(40/139): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-09-30T22:49:58.290 INFO:teuthology.orchestra.run.smithi148.stdout:(56/139): python3-prettytable-0.7.2-14.el8.noar 438 kB/s | 44 kB 00:00 2023-09-30T22:49:58.357 INFO:teuthology.orchestra.run.smithi148.stdout:(57/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-09-30T22:49:58.391 INFO:teuthology.orchestra.run.smithi148.stdout:(58/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-09-30T22:49:58.457 INFO:teuthology.orchestra.run.smithi148.stdout:(59/139): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-09-30T22:49:58.483 INFO:teuthology.orchestra.run.smithi148.stdout:(60/139): python3-pyasn1-modules-0.3.7-6.el8.no 877 kB/s | 110 kB 00:00 2023-09-30T22:49:58.525 INFO:teuthology.orchestra.run.smithi148.stdout:(61/139): python3-pytz-2017.2-11.el8.noarch.rpm 426 kB/s | 57 kB 00:00 2023-09-30T22:49:58.600 INFO:teuthology.orchestra.run.smithi148.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2023-09-30T22:49:58.626 INFO:teuthology.orchestra.run.smithi148.stdout:(63/139): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2023-09-30T22:49:58.701 INFO:teuthology.orchestra.run.smithi148.stdout:(64/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 705 kB/s | 71 kB 00:00 2023-09-30T22:49:58.811 INFO:teuthology.orchestra.run.smithi148.stdout:(65/139): elfutils-libelf-devel-0.189-3.el8.x86 333 kB/s | 62 kB 00:00 2023-09-30T22:49:58.850 INFO:teuthology.orchestra.run.smithi142.stdout:(41/139): ceph-test-17.2.6-1188.g87156194.el8.x 8.3 MB/s | 52 MB 00:06 2023-09-30T22:49:58.860 INFO:teuthology.orchestra.run.smithi148.stdout:(66/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.0 MB/s | 48 kB 00:00 2023-09-30T22:49:58.876 INFO:teuthology.orchestra.run.smithi142.stdout:(42/139): jq-1.6-7.el8.x86_64.rpm 324 kB/s | 202 kB 00:00 2023-09-30T22:49:58.909 INFO:teuthology.orchestra.run.smithi142.stdout:(43/139): librdkafka-0.11.4-3.el8.x86_64.rpm 558 kB/s | 354 kB 00:00 2023-09-30T22:49:58.910 INFO:teuthology.orchestra.run.smithi148.stdout:(67/139): fuse-2.9.7-17.el8.x86_64.rpm 397 kB/s | 83 kB 00:00 2023-09-30T22:49:58.952 INFO:teuthology.orchestra.run.smithi148.stdout:(68/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 448 kB/s | 19 kB 00:00 2023-09-30T22:49:58.977 INFO:teuthology.orchestra.run.smithi148.stdout:(69/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.7 MB/s | 561 kB 00:00 2023-09-30T22:49:59.001 INFO:teuthology.orchestra.run.smithi142.stdout:(44/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-09-30T22:49:59.002 INFO:teuthology.orchestra.run.smithi148.stdout:(70/139): libcom_err-devel-1.45.6-5.el8.x86_64. 775 kB/s | 39 kB 00:00 2023-09-30T22:49:59.027 INFO:teuthology.orchestra.run.smithi142.stdout:(45/139): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-09-30T22:49:59.161 INFO:teuthology.orchestra.run.smithi148.stdout:(71/139): python3-scipy-1.0.0-21.module_el8.5.0 19 MB/s | 14 MB 00:00 2023-09-30T22:49:59.186 INFO:teuthology.orchestra.run.smithi148.stdout:(72/139): libquadmath-8.5.0-20.el8.x86_64.rpm 939 kB/s | 172 kB 00:00 2023-09-30T22:49:59.228 INFO:teuthology.orchestra.run.smithi148.stdout:(73/139): libgfortran-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2023-09-30T22:49:59.245 INFO:teuthology.orchestra.run.smithi148.stdout:(74/139): libselinux-devel-2.9-8.el8.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2023-09-30T22:49:59.279 INFO:teuthology.orchestra.run.smithi148.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-30T22:49:59.304 INFO:teuthology.orchestra.run.smithi148.stdout:(76/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 329 kB/s | 47 kB 00:00 2023-09-30T22:49:59.330 INFO:teuthology.orchestra.run.smithi148.stdout:(77/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 359 kB/s | 18 kB 00:00 2023-09-30T22:49:59.349 INFO:teuthology.orchestra.run.smithi148.stdout:(78/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 989 kB/s | 100 kB 00:00 2023-09-30T22:49:59.372 INFO:teuthology.orchestra.run.smithi148.stdout:(79/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 649 kB/s | 44 kB 00:00 2023-09-30T22:49:59.393 INFO:teuthology.orchestra.run.smithi142.stdout:(46/139): openblas-threads-0.3.15-4.el8.x86_64. 13 MB/s | 4.9 MB 00:00 2023-09-30T22:49:59.456 INFO:teuthology.orchestra.run.smithi148.stdout:(80/139): pcre2-devel-10.32-3.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-09-30T22:49:59.482 INFO:teuthology.orchestra.run.smithi148.stdout:(81/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-09-30T22:49:59.497 INFO:teuthology.orchestra.run.smithi142.stdout:(47/139): openblas-0.3.15-4.el8.x86_64.rpm 9.5 MB/s | 4.7 MB 00:00 2023-09-30T22:49:59.514 INFO:teuthology.orchestra.run.smithi148.stdout:(82/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:49:59.557 INFO:teuthology.orchestra.run.smithi148.stdout:(83/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.2 MB/s | 249 kB 00:00 2023-09-30T22:49:59.606 INFO:teuthology.orchestra.run.smithi148.stdout:(84/139): python3-jwt-1.6.1-2.el8.noarch.rpm 860 kB/s | 43 kB 00:00 2023-09-30T22:49:59.619 INFO:teuthology.orchestra.run.smithi142.stdout:(48/139): libtool-2.4.6-25.el8.x86_64.rpm 923 kB/s | 709 kB 00:00 2023-09-30T22:49:59.640 INFO:teuthology.orchestra.run.smithi148.stdout:(85/139): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-09-30T22:49:59.644 INFO:teuthology.orchestra.run.smithi142.stdout:(49/139): python3-jinja2-2.10.1-3.el8.noarch.rp 3.6 MB/s | 538 kB 00:00 2023-09-30T22:49:59.665 INFO:teuthology.orchestra.run.smithi148.stdout:(86/139): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-09-30T22:49:59.691 INFO:teuthology.orchestra.run.smithi148.stdout:(87/139): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-09-30T22:49:59.716 INFO:teuthology.orchestra.run.smithi148.stdout:(88/139): python3-requests-oauthlib-1.0.0-1.el8 850 kB/s | 43 kB 00:00 2023-09-30T22:49:59.728 INFO:teuthology.orchestra.run.smithi142.stdout:(50/139): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2023-09-30T22:49:59.741 INFO:teuthology.orchestra.run.smithi148.stdout:(89/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2023-09-30T22:49:59.753 INFO:teuthology.orchestra.run.smithi142.stdout:(51/139): python3-jsonpatch-1.21-2.el8.noarch.r 198 kB/s | 27 kB 00:00 2023-09-30T22:49:59.770 INFO:teuthology.orchestra.run.smithi142.stdout:(52/139): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2023-09-30T22:49:59.791 INFO:teuthology.orchestra.run.smithi148.stdout:(90/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 777 kB/s | 58 kB 00:00 2023-09-30T22:49:59.829 INFO:teuthology.orchestra.run.smithi142.stdout:(53/139): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-09-30T22:49:59.852 INFO:teuthology.orchestra.run.smithi148.stdout:(91/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.1 MB/s | 3.2 MB 00:00 2023-09-30T22:49:59.862 INFO:teuthology.orchestra.run.smithi142.stdout:(54/139): python3-markupsafe-0.23-19.el8.x86_64 422 kB/s | 39 kB 00:00 2023-09-30T22:49:59.929 INFO:teuthology.orchestra.run.smithi142.stdout:(55/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-09-30T22:49:59.954 INFO:teuthology.orchestra.run.smithi142.stdout:(56/139): python3-prettytable-0.7.2-14.el8.noar 478 kB/s | 44 kB 00:00 2023-09-30T22:50:00.036 INFO:teuthology.orchestra.run.smithi148.stdout:(92/139): liboath-2.6.2-3.el8.x86_64.rpm 240 kB/s | 59 kB 00:00 2023-09-30T22:50:00.046 INFO:teuthology.orchestra.run.smithi142.stdout:(57/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 885 kB/s | 103 kB 00:00 2023-09-30T22:50:00.061 INFO:teuthology.orchestra.run.smithi148.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 377 kB/s | 75 kB 00:00 2023-09-30T22:50:00.072 INFO:teuthology.orchestra.run.smithi142.stdout:(58/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-09-30T22:50:00.103 INFO:teuthology.orchestra.run.smithi148.stdout:(94/139): gperftools-libs-2.7-9.el8.x86_64.rpm 847 kB/s | 306 kB 00:00 2023-09-30T22:50:00.120 INFO:teuthology.orchestra.run.smithi148.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 743 kB/s | 44 kB 00:00 2023-09-30T22:50:00.156 INFO:teuthology.orchestra.run.smithi142.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-09-30T22:50:00.170 INFO:teuthology.orchestra.run.smithi148.stdout:(96/139): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-09-30T22:50:00.172 INFO:teuthology.orchestra.run.smithi142.stdout:(60/139): python3-pytz-2017.2-11.el8.noarch.rpm 567 kB/s | 57 kB 00:00 2023-09-30T22:50:00.195 INFO:teuthology.orchestra.run.smithi148.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 439 kB/s | 33 kB 00:00 2023-09-30T22:50:00.221 INFO:teuthology.orchestra.run.smithi148.stdout:(98/139): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-09-30T22:50:00.240 INFO:teuthology.orchestra.run.smithi142.stdout:(61/139): python3-numpy-1.14.3-10.el8.x86_64.rp 8.0 MB/s | 3.7 MB 00:00 2023-09-30T22:50:00.246 INFO:teuthology.orchestra.run.smithi148.stdout:(99/139): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-09-30T22:50:00.298 INFO:teuthology.orchestra.run.smithi142.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 3.6 MB/s | 457 kB 00:00 2023-09-30T22:50:00.330 INFO:teuthology.orchestra.run.smithi148.stdout:(100/139): python3-google-auth-1.1.1-10.el8.noa 976 kB/s | 81 kB 00:00 2023-09-30T22:50:00.355 INFO:teuthology.orchestra.run.smithi148.stdout:(101/139): python3-cherrypy-18.4.0-1.el8.noarch 2.8 MB/s | 384 kB 00:00 2023-09-30T22:50:00.357 INFO:teuthology.orchestra.run.smithi142.stdout:(63/139): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-09-30T22:50:00.381 INFO:teuthology.orchestra.run.smithi148.stdout:(102/139): python3-cheroot-8.5.2-1.el8.noarch.r 935 kB/s | 173 kB 00:00 2023-09-30T22:50:00.397 INFO:teuthology.orchestra.run.smithi148.stdout:(103/139): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-09-30T22:50:00.407 INFO:teuthology.orchestra.run.smithi142.stdout:(64/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 652 kB/s | 71 kB 00:00 2023-09-30T22:50:00.414 INFO:teuthology.orchestra.run.smithi148.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 299 kB/s | 18 kB 00:00 2023-09-30T22:50:00.473 INFO:teuthology.orchestra.run.smithi148.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 647 kB/s | 49 kB 00:00 2023-09-30T22:50:00.490 INFO:teuthology.orchestra.run.smithi148.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 780 kB/s | 59 kB 00:00 2023-09-30T22:50:00.507 INFO:teuthology.orchestra.run.smithi142.stdout:(65/139): elfutils-libelf-devel-0.189-3.el8.x86 410 kB/s | 62 kB 00:00 2023-09-30T22:50:00.540 INFO:teuthology.orchestra.run.smithi148.stdout:(107/139): python3-kubernetes-11.0.0-6.el8.noar 7.3 MB/s | 1.2 MB 00:00 2023-09-30T22:50:00.557 INFO:teuthology.orchestra.run.smithi148.stdout:(108/139): python3-natsort-7.1.1-2.el8.noarch.r 721 kB/s | 60 kB 00:00 2023-09-30T22:50:00.558 INFO:teuthology.orchestra.run.smithi142.stdout:(66/139): fuse-2.9.7-17.el8.x86_64.rpm 552 kB/s | 83 kB 00:00 2023-09-30T22:50:00.582 INFO:teuthology.orchestra.run.smithi148.stdout:(109/139): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-09-30T22:50:00.583 INFO:teuthology.orchestra.run.smithi142.stdout:(67/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 640 kB/s | 48 kB 00:00 2023-09-30T22:50:00.599 INFO:teuthology.orchestra.run.smithi148.stdout:(110/139): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-09-30T22:50:00.616 INFO:teuthology.orchestra.run.smithi148.stdout:(111/139): python3-repoze-lru-0.7-6.el8.noarch. 571 kB/s | 34 kB 00:00 2023-09-30T22:50:00.633 INFO:teuthology.orchestra.run.smithi142.stdout:(68/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 376 kB/s | 19 kB 00:00 2023-09-30T22:50:00.642 INFO:teuthology.orchestra.run.smithi148.stdout:(112/139): python3-routes-2.4.1-12.el8.noarch.r 3.3 MB/s | 196 kB 00:00 2023-09-30T22:50:00.659 INFO:teuthology.orchestra.run.smithi148.stdout:(113/139): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-09-30T22:50:00.675 INFO:teuthology.orchestra.run.smithi148.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 319 kB/s | 19 kB 00:00 2023-09-30T22:50:00.684 INFO:teuthology.orchestra.run.smithi142.stdout:(69/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.4 MB/s | 561 kB 00:00 2023-09-30T22:50:00.701 INFO:teuthology.orchestra.run.smithi148.stdout:(115/139): python3-singledispatch-3.4.0.3-18.el 406 kB/s | 24 kB 00:00 2023-09-30T22:50:00.709 INFO:teuthology.orchestra.run.smithi142.stdout:(70/139): libcom_err-devel-1.45.6-5.el8.x86_64. 514 kB/s | 39 kB 00:00 2023-09-30T22:50:00.718 INFO:teuthology.orchestra.run.smithi148.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 500 kB/s | 29 kB 00:00 2023-09-30T22:50:00.735 INFO:teuthology.orchestra.run.smithi148.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 467 kB/s | 27 kB 00:00 2023-09-30T22:50:00.768 INFO:teuthology.orchestra.run.smithi148.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 3.7 MB/s | 255 kB 00:00 2023-09-30T22:50:00.802 INFO:teuthology.orchestra.run.smithi148.stdout:(119/139): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2023-09-30T22:50:00.827 INFO:teuthology.orchestra.run.smithi148.stdout:(120/139): python3-websocket-client-0.56.0-5.el 664 kB/s | 61 kB 00:00 2023-09-30T22:50:00.844 INFO:teuthology.orchestra.run.smithi148.stdout:(121/139): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-09-30T22:50:00.851 INFO:teuthology.orchestra.run.smithi142.stdout:(71/139): python3-scipy-1.0.0-21.module_el8.5.0 20 MB/s | 14 MB 00:00 2023-09-30T22:50:00.870 INFO:teuthology.orchestra.run.smithi148.stdout:(122/139): python3-zc-lockfile-2.0-2.el8.noarch 343 kB/s | 23 kB 00:00 2023-09-30T22:50:00.901 INFO:teuthology.orchestra.run.smithi142.stdout:(72/139): libquadmath-8.5.0-20.el8.x86_64.rpm 900 kB/s | 172 kB 00:00 2023-09-30T22:50:00.935 INFO:teuthology.orchestra.run.smithi142.stdout:(73/139): libgfortran-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2023-09-30T22:50:00.951 INFO:teuthology.orchestra.run.smithi142.stdout:(74/139): libselinux-devel-2.9-8.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-09-30T22:50:00.987 INFO:teuthology.orchestra.run.smithi142.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-30T22:50:01.010 INFO:teuthology.orchestra.run.smithi142.stdout:(76/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 295 kB/s | 47 kB 00:00 2023-09-30T22:50:01.036 INFO:teuthology.orchestra.run.smithi142.stdout:(77/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 359 kB/s | 18 kB 00:00 2023-09-30T22:50:01.036 INFO:teuthology.orchestra.run.smithi148.stdout:(123/139): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2023-09-30T22:50:01.061 INFO:teuthology.orchestra.run.smithi142.stdout:(78/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 912 kB/s | 100 kB 00:00 2023-09-30T22:50:01.086 INFO:teuthology.orchestra.run.smithi142.stdout:(79/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 582 kB/s | 44 kB 00:00 2023-09-30T22:50:01.161 INFO:teuthology.orchestra.run.smithi142.stdout:(80/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-09-30T22:50:01.162 INFO:teuthology.orchestra.run.smithi148.stdout:(124/139): NetworkManager-initscripts-updown-1. 1.1 MB/s | 143 kB 00:00 2023-09-30T22:50:01.212 INFO:teuthology.orchestra.run.smithi142.stdout:(81/139): pcre2-devel-10.32-3.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-09-30T22:50:01.220 INFO:teuthology.orchestra.run.smithi148.stdout:(125/139): librados2-17.2.6-1188.g87156194.el8. 9.2 MB/s | 3.5 MB 00:00 2023-09-30T22:50:01.237 INFO:teuthology.orchestra.run.smithi142.stdout:(82/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-09-30T22:50:01.246 INFO:teuthology.orchestra.run.smithi148.stdout:(126/139): elfutils-debuginfod-client-0.189-3.e 914 kB/s | 76 kB 00:00 2023-09-30T22:50:01.287 INFO:teuthology.orchestra.run.smithi142.stdout:(83/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.2 MB/s | 249 kB 00:00 2023-09-30T22:50:01.321 INFO:teuthology.orchestra.run.smithi148.stdout:(127/139): elfutils-libs-0.189-3.el8.x86_64.rpm 4.0 MB/s | 303 kB 00:00 2023-09-30T22:50:01.338 INFO:teuthology.orchestra.run.smithi142.stdout:(84/139): python3-jwt-1.6.1-2.el8.noarch.rpm 854 kB/s | 43 kB 00:00 2023-09-30T22:50:01.371 INFO:teuthology.orchestra.run.smithi148.stdout:(128/139): elfutils-libelf-0.189-3.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2023-09-30T22:50:01.398 INFO:teuthology.orchestra.run.smithi142.stdout:(85/139): python3-cryptography-3.2.1-6.el8.x86_ 3.9 MB/s | 641 kB 00:00 2023-09-30T22:50:01.421 INFO:teuthology.orchestra.run.smithi142.stdout:(86/139): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-09-30T22:50:01.430 INFO:teuthology.orchestra.run.smithi148.stdout:(129/139): libblkid-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:50:01.455 INFO:teuthology.orchestra.run.smithi142.stdout:(87/139): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-09-30T22:50:01.480 INFO:teuthology.orchestra.run.smithi142.stdout:(88/139): python3-requests-oauthlib-1.0.0-1.el8 725 kB/s | 43 kB 00:00 2023-09-30T22:50:01.497 INFO:teuthology.orchestra.run.smithi148.stdout:(130/139): iproute-6.2.0-2.el8.x86_64.rpm 4.9 MB/s | 880 kB 00:00 2023-09-30T22:50:01.506 INFO:teuthology.orchestra.run.smithi142.stdout:(89/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2023-09-30T22:50:01.522 INFO:teuthology.orchestra.run.smithi148.stdout:(131/139): libfdisk-2.32.1-43.el8.x86_64.rpm 2.7 MB/s | 254 kB 00:00 2023-09-30T22:50:01.548 INFO:teuthology.orchestra.run.smithi148.stdout:(132/139): libmount-2.32.1-43.el8.x86_64.rpm 4.6 MB/s | 236 kB 00:00 2023-09-30T22:50:01.556 INFO:teuthology.orchestra.run.smithi142.stdout:(90/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.1 MB/s | 3.2 MB 00:00 2023-09-30T22:50:01.573 INFO:teuthology.orchestra.run.smithi148.stdout:(133/139): libsmartcols-2.32.1-43.el8.x86_64.rp 3.5 MB/s | 179 kB 00:00 2023-09-30T22:50:01.573 INFO:teuthology.orchestra.run.smithi142.stdout:(91/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 629 kB/s | 58 kB 00:00 2023-09-30T22:50:01.599 INFO:teuthology.orchestra.run.smithi148.stdout:(134/139): libuuid-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2023-09-30T22:50:01.648 INFO:teuthology.orchestra.run.smithi148.stdout:(135/139): util-linux-user-2.32.1-43.el8.x86_64 2.0 MB/s | 103 kB 00:00 2023-09-30T22:50:01.716 INFO:teuthology.orchestra.run.smithi142.stdout:(92/139): liboath-2.6.2-3.el8.x86_64.rpm 370 kB/s | 59 kB 00:00 2023-09-30T22:50:01.724 INFO:teuthology.orchestra.run.smithi148.stdout:(136/139): xfsdump-3.1.8-6.el8.x86_64.rpm 4.4 MB/s | 334 kB 00:00 2023-09-30T22:50:01.749 INFO:teuthology.orchestra.run.smithi142.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 428 kB/s | 75 kB 00:00 2023-09-30T22:50:01.824 INFO:teuthology.orchestra.run.smithi142.stdout:(94/139): gperftools-libs-2.7-9.el8.x86_64.rpm 964 kB/s | 306 kB 00:00 2023-09-30T22:50:01.841 INFO:teuthology.orchestra.run.smithi142.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 475 kB/s | 44 kB 00:00 2023-09-30T22:50:01.907 INFO:teuthology.orchestra.run.smithi148.stdout:(137/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2023-09-30T22:50:01.908 INFO:teuthology.orchestra.run.smithi142.stdout:(96/139): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-09-30T22:50:01.925 INFO:teuthology.orchestra.run.smithi142.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 395 kB/s | 33 kB 00:00 2023-09-30T22:50:01.957 INFO:teuthology.orchestra.run.smithi148.stdout:(138/139): util-linux-2.32.1-43.el8.x86_64.rpm 6.4 MB/s | 2.5 MB 00:00 2023-09-30T22:50:01.958 INFO:teuthology.orchestra.run.smithi142.stdout:(98/139): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-09-30T22:50:01.984 INFO:teuthology.orchestra.run.smithi142.stdout:(99/139): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-09-30T22:50:02.034 INFO:teuthology.orchestra.run.smithi142.stdout:(100/139): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-09-30T22:50:02.076 INFO:teuthology.orchestra.run.smithi142.stdout:(101/139): python3-cherrypy-18.4.0-1.el8.noarch 3.2 MB/s | 384 kB 00:00 2023-09-30T22:50:02.101 INFO:teuthology.orchestra.run.smithi142.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-09-30T22:50:02.135 INFO:teuthology.orchestra.run.smithi142.stdout:(103/139): python3-cheroot-8.5.2-1.el8.noarch.r 823 kB/s | 173 kB 00:00 2023-09-30T22:50:02.160 INFO:teuthology.orchestra.run.smithi142.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 210 kB/s | 18 kB 00:00 2023-09-30T22:50:02.186 INFO:teuthology.orchestra.run.smithi142.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 976 kB/s | 49 kB 00:00 2023-09-30T22:50:02.211 INFO:teuthology.orchestra.run.smithi142.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2023-09-30T22:50:02.232 INFO:teuthology.orchestra.run.smithi148.stdout:(139/139): librbd1-17.2.6-1188.g87156194.el8.x8 2.6 MB/s | 3.6 MB 00:01 2023-09-30T22:50:02.236 INFO:teuthology.orchestra.run.smithi142.stdout:(107/139): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-09-30T22:50:02.238 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:50:02.239 INFO:teuthology.orchestra.run.smithi148.stdout:Total 12 MB/s | 210 MB 00:18 2023-09-30T22:50:02.296 INFO:teuthology.orchestra.run.smithi142.stdout:(108/139): python3-kubernetes-11.0.0-6.el8.noar 6.0 MB/s | 1.2 MB 00:00 2023-09-30T22:50:02.329 INFO:teuthology.orchestra.run.smithi142.stdout:(109/139): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-09-30T22:50:02.354 INFO:teuthology.orchestra.run.smithi142.stdout:(110/139): python3-repoze-lru-0.7-6.el8.noarch. 587 kB/s | 34 kB 00:00 2023-09-30T22:50:02.379 INFO:teuthology.orchestra.run.smithi142.stdout:(111/139): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-09-30T22:50:02.404 INFO:teuthology.orchestra.run.smithi142.stdout:(112/139): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-09-30T22:50:02.429 INFO:teuthology.orchestra.run.smithi142.stdout:(113/139): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-09-30T22:50:02.455 INFO:teuthology.orchestra.run.smithi142.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2023-09-30T22:50:02.480 INFO:teuthology.orchestra.run.smithi142.stdout:(115/139): python3-singledispatch-3.4.0.3-18.el 318 kB/s | 24 kB 00:00 2023-09-30T22:50:02.505 INFO:teuthology.orchestra.run.smithi142.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 586 kB/s | 29 kB 00:00 2023-09-30T22:50:02.530 INFO:teuthology.orchestra.run.smithi142.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 367 kB/s | 27 kB 00:00 2023-09-30T22:50:02.564 INFO:teuthology.orchestra.run.smithi142.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 3.0 MB/s | 255 kB 00:00 2023-09-30T22:50:02.589 INFO:teuthology.orchestra.run.smithi142.stdout:(119/139): python3-websocket-client-0.56.0-5.el 1.0 MB/s | 61 kB 00:00 2023-09-30T22:50:02.615 INFO:teuthology.orchestra.run.smithi142.stdout:(120/139): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-09-30T22:50:02.640 INFO:teuthology.orchestra.run.smithi142.stdout:(121/139): python3-zc-lockfile-2.0-2.el8.noarch 459 kB/s | 23 kB 00:00 2023-09-30T22:50:02.665 INFO:teuthology.orchestra.run.smithi142.stdout:(122/139): python3-webob-1.8.5-1.el8.1.noarch.r 1.8 MB/s | 251 kB 00:00 2023-09-30T22:50:02.749 INFO:teuthology.orchestra.run.smithi142.stdout:(123/139): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-09-30T22:50:02.883 INFO:teuthology.orchestra.run.smithi142.stdout:(124/139): NetworkManager-initscripts-updown-1. 1.1 MB/s | 143 kB 00:00 2023-09-30T22:50:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:(125/139): elfutils-debuginfod-client-0.189-3.e 1.5 MB/s | 76 kB 00:00 2023-09-30T22:50:03.033 INFO:teuthology.orchestra.run.smithi142.stdout:(126/139): librados2-17.2.6-1188.g87156194.el8. 8.8 MB/s | 3.5 MB 00:00 2023-09-30T22:50:03.058 INFO:teuthology.orchestra.run.smithi142.stdout:(127/139): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2023-09-30T22:50:03.109 INFO:teuthology.orchestra.run.smithi142.stdout:(128/139): elfutils-libs-0.189-3.el8.x86_64.rpm 3.9 MB/s | 303 kB 00:00 2023-09-30T22:50:03.159 INFO:teuthology.orchestra.run.smithi142.stdout:(129/139): libblkid-2.32.1-43.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-09-30T22:50:03.234 INFO:teuthology.orchestra.run.smithi142.stdout:(130/139): libfdisk-2.32.1-43.el8.x86_64.rpm 3.3 MB/s | 254 kB 00:00 2023-09-30T22:50:03.293 INFO:teuthology.orchestra.run.smithi142.stdout:(131/139): iproute-6.2.0-2.el8.x86_64.rpm 3.7 MB/s | 880 kB 00:00 2023-09-30T22:50:03.351 INFO:teuthology.orchestra.run.smithi142.stdout:(132/139): librbd1-17.2.6-1188.g87156194.el8.x8 5.2 MB/s | 3.6 MB 00:00 2023-09-30T22:50:03.377 INFO:teuthology.orchestra.run.smithi142.stdout:(133/139): libmount-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 236 kB 00:00 2023-09-30T22:50:03.402 INFO:teuthology.orchestra.run.smithi142.stdout:(134/139): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-09-30T22:50:03.427 INFO:teuthology.orchestra.run.smithi142.stdout:(135/139): libuuid-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 99 kB 00:00 2023-09-30T22:50:03.444 INFO:teuthology.orchestra.run.smithi142.stdout:(136/139): util-linux-user-2.32.1-43.el8.x86_64 2.4 MB/s | 103 kB 00:00 2023-09-30T22:50:03.503 INFO:teuthology.orchestra.run.smithi142.stdout:(137/139): xfsdump-3.1.8-6.el8.x86_64.rpm 4.3 MB/s | 334 kB 00:00 2023-09-30T22:50:03.828 INFO:teuthology.orchestra.run.smithi142.stdout:(138/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.8 MB/s | 1.1 MB 00:00 2023-09-30T22:50:03.936 INFO:teuthology.orchestra.run.smithi142.stdout:(139/139): util-linux-2.32.1-43.el8.x86_64.rpm 4.4 MB/s | 2.5 MB 00:00 2023-09-30T22:50:03.939 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:50:03.940 INFO:teuthology.orchestra.run.smithi142.stdout:Total 11 MB/s | 210 MB 00:19 2023-09-30T22:50:03.941 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2023-09-30T22:50:04.355 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2023-09-30T22:50:04.355 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2023-09-30T22:50:05.632 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-09-30T22:50:05.775 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2023-09-30T22:50:05.779 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2023-09-30T22:50:06.041 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-09-30T22:50:06.041 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-09-30T22:50:07.490 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-09-30T22:50:07.493 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-09-30T22:50:11.156 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2023-09-30T22:50:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-09-30T22:50:11.376 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-30T22:50:11.461 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-30T22:50:11.626 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-30T22:50:11.726 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-30T22:50:11.940 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-09-30T22:50:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-09-30T22:50:12.506 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-09-30T22:50:12.712 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-09-30T22:50:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-09-30T22:50:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-09-30T22:50:12.892 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-30T22:50:12.968 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-30T22:50:13.057 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-30T22:50:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-30T22:50:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-30T22:50:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-30T22:50:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-09-30T22:50:13.502 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:17.2.6-1188.g87156194.el8.x86_64 8/155 2023-09-30T22:50:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-09-30T22:50:13.941 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:17.2.6-1188.g87156194.el8.x86_64 8/155 2023-09-30T22:50:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-09-30T22:50:14.193 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:17.2.6-1188.g87156194.el8.x86_64 9/155 2023-09-30T22:50:14.328 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-09-30T22:50:14.346 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:17.2.6-1188.g87156194.el8.x86_64 9/155 2023-09-30T22:50:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 10/155 2023-09-30T22:50:14.526 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-30T22:50:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 10/155 2023-09-30T22:50:14.818 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:17.2.6-1188.g87156194.el8.x86_64 11/155 2023-09-30T22:50:14.944 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-30T22:50:14.959 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-30T22:50:15.168 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:17.2.6-1188.g87156194.el8.x86_64 8/155 2023-09-30T22:50:15.570 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-30T22:50:15.622 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:17.2.6-1188.g87156194.el8.x86_64 8/155 2023-09-30T22:50:15.726 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:17.2.6-1188.g87156194.el8.x86_64 13/155 2023-09-30T22:50:15.813 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:17.2.6-1188.g87156194.el8.x86_64 9/155 2023-09-30T22:50:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:17.2.6-1188.g87156194.el8.x86_64 13/155 2023-09-30T22:50:15.965 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:17.2.6-1188.g87156194.el8.x86_64 9/155 2023-09-30T22:50:16.109 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 10/155 2023-09-30T22:50:16.167 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-30T22:50:16.224 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 10/155 2023-09-30T22:50:16.250 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-30T22:50:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:17.2.6-1188.g87156194.el8.x86_64 11/155 2023-09-30T22:50:16.450 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-09-30T22:50:16.601 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-30T22:50:16.634 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-09-30T22:50:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 17/155 2023-09-30T22:50:16.897 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 17/155 2023-09-30T22:50:17.042 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:17.2.6-1188.g87156194.el8.x86 18/155 2023-09-30T22:50:17.193 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1188.g87156194.el8.x86 18/155 2023-09-30T22:50:17.217 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-30T22:50:17.343 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:17.2.6-1188.g87156194.el8.x86_64 13/155 2023-09-30T22:50:17.412 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-09-30T22:50:17.556 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:17.2.6-1188.g87156194.el8.x86_64 13/155 2023-09-30T22:50:17.575 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-09-30T22:50:17.750 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-30T22:50:17.809 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-30T22:50:17.887 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-30T22:50:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-30T22:50:18.058 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-30T22:50:18.135 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-09-30T22:50:18.293 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-09-30T22:50:18.442 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 17/155 2023-09-30T22:50:18.567 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 17/155 2023-09-30T22:50:18.692 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:17.2.6-1188.g87156194.el8.x86 18/155 2023-09-30T22:50:18.734 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-30T22:50:18.837 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1188.g87156194.el8.x86 18/155 2023-09-30T22:50:18.908 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-09-30T22:50:19.284 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-09-30T22:50:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-09-30T22:50:19.592 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-30T22:50:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-09-30T22:50:19.755 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-30T22:50:19.783 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-30T22:50:19.892 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-30T22:50:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-30T22:50:20.616 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-30T22:50:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-09-30T22:50:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-09-30T22:50:21.150 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-09-30T22:50:21.310 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-09-30T22:50:21.510 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-09-30T22:50:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-09-30T22:50:21.717 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-30T22:50:21.740 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:17.2.6-1188.g87156194.el8. 29/155 2023-09-30T22:50:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:17.2.6-1188.g87156194.el 30/155 2023-09-30T22:50:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:17.2.6-1188.g87156194.el8.x86_6 31/155 2023-09-30T22:50:22.570 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-30T22:50:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-09-30T22:50:23.160 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-09-30T22:50:23.218 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-09-30T22:50:23.348 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-09-30T22:50:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-09-30T22:50:23.587 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-09-30T22:50:23.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:17.2.6-1188.g87156194.el8. 29/155 2023-09-30T22:50:23.870 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-09-30T22:50:23.988 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:17.2.6-1188.g87156194.el 30/155 2023-09-30T22:50:24.066 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-30T22:50:24.251 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:17.2.6-1188.g87156194.el8.x86_6 31/155 2023-09-30T22:50:25.384 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-09-30T22:50:25.758 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-09-30T22:50:26.062 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-09-30T22:50:26.146 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-30T22:50:26.316 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-30T22:50:26.445 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-09-30T22:50:26.666 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-09-30T22:50:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-09-30T22:50:27.045 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:17.2.6-1188.g87156194.el8.x86_64 39/155 2023-09-30T22:50:27.231 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:17.2.6-1188.g87156194.el8.x86_64 40/155 2023-09-30T22:50:27.452 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:17.2.6-1188.g87156194.el8.x86_6 41/155 2023-09-30T22:50:27.632 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-09-30T22:50:27.893 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-09-30T22:50:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-30T22:50:28.235 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-30T22:50:28.419 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-30T22:50:28.432 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-09-30T22:50:28.511 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-09-30T22:50:28.638 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-09-30T22:50:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-09-30T22:50:28.832 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-30T22:50:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-09-30T22:50:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-09-30T22:50:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:17.2.6-1188.g87156194.el8.x86_64 39/155 2023-09-30T22:50:29.440 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-30T22:50:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:17.2.6-1188.g87156194.el8.x86_64 40/155 2023-09-30T22:50:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-30T22:50:29.719 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-30T22:50:29.801 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:17.2.6-1188.g87156194.el8.x86_6 41/155 2023-09-30T22:50:29.933 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-09-30T22:50:29.983 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-09-30T22:50:30.173 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-09-30T22:50:30.207 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-09-30T22:50:30.382 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-09-30T22:50:30.432 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-30T22:50:30.536 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-30T22:50:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-09-30T22:50:30.721 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-09-30T22:50:30.757 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-09-30T22:50:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-09-30T22:50:30.914 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-09-30T22:50:31.012 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-09-30T22:50:31.107 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-09-30T22:50:31.224 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-30T22:50:31.315 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-09-30T22:50:31.511 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-09-30T22:50:31.656 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-09-30T22:50:31.813 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-30T22:50:31.848 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-09-30T22:50:32.039 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-09-30T22:50:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-30T22:50:32.162 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-30T22:50:32.201 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-09-30T22:50:32.381 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-09-30T22:50:32.393 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-09-30T22:50:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-09-30T22:50:32.649 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-09-30T22:50:32.864 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-09-30T22:50:32.881 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-09-30T22:50:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-09-30T22:50:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-09-30T22:50:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-09-30T22:50:33.391 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-09-30T22:50:33.431 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-09-30T22:50:33.616 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-09-30T22:50:33.691 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-09-30T22:50:33.802 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-09-30T22:50:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-09-30T22:50:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-09-30T22:50:34.111 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-09-30T22:50:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-09-30T22:50:34.281 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-09-30T22:50:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-09-30T22:50:34.622 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-09-30T22:50:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-09-30T22:50:34.843 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-09-30T22:50:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-09-30T22:50:35.101 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-09-30T22:50:35.113 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-09-30T22:50:35.328 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-09-30T22:50:35.369 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-09-30T22:50:35.591 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-09-30T22:50:35.599 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-09-30T22:50:35.825 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-09-30T22:50:36.175 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-09-30T22:50:36.467 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-09-30T22:50:36.686 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-09-30T22:50:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-09-30T22:50:36.909 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-09-30T22:50:37.143 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-09-30T22:50:37.286 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-09-30T22:50:37.474 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-09-30T22:50:37.585 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-09-30T22:50:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-09-30T22:50:37.880 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-09-30T22:50:37.998 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-09-30T22:50:38.079 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-09-30T22:50:38.287 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-09-30T22:50:38.352 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-09-30T22:50:38.518 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-09-30T22:50:38.591 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-09-30T22:50:38.727 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-30T22:50:39.037 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-09-30T22:50:39.245 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-09-30T22:50:39.391 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-09-30T22:50:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-09-30T22:50:39.938 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-09-30T22:50:39.953 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-09-30T22:50:40.205 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-09-30T22:50:40.338 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-09-30T22:50:40.362 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-09-30T22:50:40.532 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-09-30T22:50:40.616 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-09-30T22:50:40.700 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-09-30T22:50:40.869 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-09-30T22:50:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-09-30T22:50:41.167 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-09-30T22:50:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-09-30T22:50:41.332 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-09-30T22:50:41.469 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-09-30T22:50:41.472 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-09-30T22:50:41.743 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-09-30T22:50:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-30T22:50:42.375 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-09-30T22:50:42.595 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-09-30T22:50:42.758 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-09-30T22:50:42.975 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-09-30T22:50:43.318 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-09-30T22:50:43.612 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-09-30T22:50:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-09-30T22:50:44.000 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-09-30T22:50:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-09-30T22:50:44.379 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 97/155 2023-09-30T22:50:44.458 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-09-30T22:50:44.622 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 97/155 2023-09-30T22:50:44.708 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-09-30T22:50:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-09-30T22:50:45.289 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-09-30T22:50:45.344 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 97/155 2023-09-30T22:50:45.638 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 98/155 2023-09-30T22:50:45.823 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 98/155 2023-09-30T22:50:46.046 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 99/155 2023-09-30T22:50:48.215 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 97/155 2023-09-30T22:50:48.422 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 97/155 2023-09-30T22:50:49.086 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 97/155 2023-09-30T22:50:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 98/155 2023-09-30T22:50:49.601 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 98/155 2023-09-30T22:50:49.829 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 99/155 2023-09-30T22:51:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 99/155 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /dev 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /run 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2023-09-30T22:51:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2023-09-30T22:51:05.870 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /dev 2023-09-30T22:51:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:06.252 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 100/155 2023-09-30T22:51:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 100/155 2023-09-30T22:51:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 101/155 2023-09-30T22:51:08.388 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 101/155 2023-09-30T22:51:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 102/155 2023-09-30T22:51:09.013 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 102/155 2023-09-30T22:51:09.176 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 103/155 2023-09-30T22:51:09.226 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 103/155 2023-09-30T22:51:09.435 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-09-30T22:51:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-09-30T22:51:09.725 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 99/155 2023-09-30T22:51:09.725 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2023-09-30T22:51:09.725 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2023-09-30T22:51:09.725 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2023-09-30T22:51:09.725 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /run 2023-09-30T22:51:09.725 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2023-09-30T22:51:09.726 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2023-09-30T22:51:09.726 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2023-09-30T22:51:09.726 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2023-09-30T22:51:09.726 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2023-09-30T22:51:09.726 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-30T22:51:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-30T22:51:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-09-30T22:51:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 100/155 2023-09-30T22:51:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-09-30T22:51:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:17.2.6-1188.g87156194.el8.noarch 109/155 2023-09-30T22:51:11.137 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:17.2.6-1188.g87156194.el8.noarch 109/155 2023-09-30T22:51:11.267 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1188.g87156194.e 110/155 2023-09-30T22:51:11.467 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1188.g87156194. 111/155 2023-09-30T22:51:11.659 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noa 112/155 2023-09-30T22:51:11.771 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 100/155 2023-09-30T22:51:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noa 112/155 2023-09-30T22:51:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 101/155 2023-09-30T22:51:12.142 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.n 113/155 2023-09-30T22:51:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 101/155 2023-09-30T22:51:12.509 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 102/155 2023-09-30T22:51:12.961 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 102/155 2023-09-30T22:51:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 103/155 2023-09-30T22:51:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 103/155 2023-09-30T22:51:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.n 113/155 2023-09-30T22:51:13.425 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1188.g871 114/155 2023-09-30T22:51:13.434 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-09-30T22:51:13.553 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1188.g871 114/155 2023-09-30T22:51:13.630 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-09-30T22:51:13.808 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-30T22:51:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-30T22:51:13.933 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1188.g87156194.el 115/155 2023-09-30T22:51:14.134 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 116/155 2023-09-30T22:51:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 116/155 2023-09-30T22:51:14.246 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-09-30T22:51:14.358 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 117/155 2023-09-30T22:51:14.386 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 117/155 2023-09-30T22:51:14.492 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-09-30T22:51:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:17.2.6-1188.g87156194.el8.x86_64 118/155 2023-09-30T22:51:14.750 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-09-30T22:51:15.061 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:17.2.6-1188.g87156194.el8.noarch 109/155 2023-09-30T22:51:15.263 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:17.2.6-1188.g87156194.el8.noarch 109/155 2023-09-30T22:51:15.399 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1188.g87156194.e 110/155 2023-09-30T22:51:15.608 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1188.g87156194. 111/155 2023-09-30T22:51:15.825 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noa 112/155 2023-09-30T22:51:16.081 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noa 112/155 2023-09-30T22:51:16.309 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.n 113/155 2023-09-30T22:51:17.416 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.n 113/155 2023-09-30T22:51:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1188.g871 114/155 2023-09-30T22:51:17.762 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1188.g871 114/155 2023-09-30T22:51:18.192 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1188.g87156194.el 115/155 2023-09-30T22:51:18.435 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 116/155 2023-09-30T22:51:18.501 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 116/155 2023-09-30T22:51:18.691 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 117/155 2023-09-30T22:51:18.719 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 117/155 2023-09-30T22:51:18.951 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:17.2.6-1188.g87156194.el8.x86_64 118/155 2023-09-30T22:51:19.132 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-09-30T22:51:20.072 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-09-30T22:51:21.947 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:17.2.6-1188.g87156194.el8.x86_64 120/155 2023-09-30T22:51:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 121/155 2023-09-30T22:51:22.316 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 121/155 2023-09-30T22:51:22.474 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1188.g87156 122/155 2023-09-30T22:51:22.544 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1188.g87156 122/155 2023-09-30T22:51:22.716 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 123/155 2023-09-30T22:51:23.122 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 123/155 2023-09-30T22:51:23.274 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 124/155 2023-09-30T22:51:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 124/155 2023-09-30T22:51:24.464 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-09-30T22:51:24.622 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:17.2.6-1188.g87156194.el8.x86_64 125/155 2023-09-30T22:51:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-09-30T22:51:25.148 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-09-30T22:51:25.346 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-09-30T22:51:25.511 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-09-30T22:51:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:17.2.6-1188.g87156194.el8.x86_ 130/155 2023-09-30T22:51:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-09-30T22:51:26.180 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:17.2.6-1188.g87156194.el8.noarch 132/155 2023-09-30T22:51:26.335 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:17.2.6-1188.g87156194.el8.x86_64 120/155 2023-09-30T22:51:26.366 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:17.2.6-1188.g87156194.el8.x86_64 133/155 2023-09-30T22:51:26.575 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 121/155 2023-09-30T22:51:26.704 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 121/155 2023-09-30T22:51:26.729 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:17.2.6-1188.g87156194.el8.x86_64 134/155 2023-09-30T22:51:26.882 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1188.g87156 122/155 2023-09-30T22:51:26.952 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1188.g87156 122/155 2023-09-30T22:51:26.967 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-09-30T22:51:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-30T22:51:27.140 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 123/155 2023-09-30T22:51:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-30T22:51:27.394 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-09-30T22:51:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 123/155 2023-09-30T22:51:27.589 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-09-30T22:51:27.702 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-09-30T22:51:27.732 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 124/155 2023-09-30T22:51:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 124/155 2023-09-30T22:51:27.923 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-09-30T22:51:27.950 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-09-30T22:51:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-09-30T22:51:28.250 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-09-30T22:51:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-09-30T22:51:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-30T22:51:28.635 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-30T22:51:28.636 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-30T22:51:28.885 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-30T22:51:28.900 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-30T22:51:29.012 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-30T22:51:29.013 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-30T22:51:29.095 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:17.2.6-1188.g87156194.el8.x86_64 125/155 2023-09-30T22:51:29.281 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-30T22:51:29.450 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-09-30T22:51:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-09-30T22:51:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-09-30T22:51:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-09-30T22:51:29.849 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-30T22:51:29.850 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-30T22:51:29.945 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-09-30T22:51:30.060 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-30T22:51:30.060 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-09-30T22:51:30.110 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-09-30T22:51:30.259 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-09-30T22:51:30.260 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-30T22:51:30.373 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:17.2.6-1188.g87156194.el8.x86_ 130/155 2023-09-30T22:51:30.451 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-30T22:51:30.451 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-30T22:51:30.570 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-09-30T22:51:30.644 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-30T22:51:30.644 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-30T22:51:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:17.2.6-1188.g87156194.el8.noarch 132/155 2023-09-30T22:51:30.843 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-30T22:51:31.007 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:17.2.6-1188.g87156194.el8.x86_64 133/155 2023-09-30T22:51:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-30T22:51:31.274 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-30T22:51:31.275 INFO:teuthology.orchestra.run.smithi148.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-30T22:51:31.275 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:17.2.6-1188.g87156194.el8.x86_64 134/155 2023-09-30T22:51:31.600 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-09-30T22:51:31.764 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-30T22:51:31.795 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-30T22:51:31.987 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:17.2.6-1188.g87156194.el8.x86_64 1/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 2/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 3/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:17.2.6-1188.g87156194.el8.x86_64 4/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1188.g87156 5/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 6/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 7/155 2023-09-30T22:51:31.990 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 8/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 9/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 10/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 11/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:17.2.6-1188.g87156194.el8.x86_64 12/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 13/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:17.2.6-1188.g87156194.el8.x86_ 14/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 15/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 16/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:17.2.6-1188.g87156194.el8.x86_6 17/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:17.2.6-1188.g87156194.el8.x86 18/155 2023-09-30T22:51:31.991 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:17.2.6-1188.g87156194.el8.x86_64 19/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1188.g87156194.el 20/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:17.2.6-1188.g87156194.el8. 21/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:17.2.6-1188.g87156194.el8.x86_6 22/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:17.2.6-1188.g87156194.el8.x86_64 23/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:17.2.6-1188.g87156194.el8.x86_64 24/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:17.2.6-1188.g87156194.el8.x86_64 25/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:17.2.6-1188.g87156194.el8.x86_64 26/155 2023-09-30T22:51:31.992 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 27/155 2023-09-30T22:51:32.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:17.2.6-1188.g87156194.el8.x86_64 28/155 2023-09-30T22:51:32.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1188.g87156194. 29/155 2023-09-30T22:51:32.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noa 30/155 2023-09-30T22:51:32.004 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.n 31/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1188.g871 32/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1188.g87156194.el 33/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 34/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1188.g87156194.e 35/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 36/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:17.2.6-1188.g87156194.el8.noarch 37/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:17.2.6-1188.g87156194.el8.noarch 38/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-09-30T22:51:32.005 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-09-30T22:51:32.006 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-09-30T22:51:32.007 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-09-30T22:51:32.008 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-09-30T22:51:32.009 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-09-30T22:51:32.010 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-09-30T22:51:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-09-30T22:51:32.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-09-30T22:51:32.013 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:17.2.6-1188.g87156194.el8.x86_64 124/155 2023-09-30T22:51:32.013 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-09-30T22:51:32.013 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:17.2.6-1188.g87156194.el8.x86_64 126/155 2023-09-30T22:51:32.013 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-09-30T22:51:32.013 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-09-30T22:51:32.013 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-09-30T22:51:32.013 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-09-30T22:51:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-09-30T22:51:32.015 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-09-30T22:51:32.213 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-09-30T22:51:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-09-30T22:51:32.555 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-09-30T22:51:32.582 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-09-30T22:51:32.782 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-09-30T22:51:32.942 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-09-30T22:51:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-09-30T22:51:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-30T22:51:33.318 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-30T22:51:33.318 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-30T22:51:33.533 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-30T22:51:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-30T22:51:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-30T22:51:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-30T22:51:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-30T22:51:34.087 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:51:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-09-30T22:51:34.119 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.1-8.el8.noarch 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.120 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.121 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.122 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:51:34.123 INFO:teuthology.orchestra.run.smithi148.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:51:34.124 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:51:34.125 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:51:34.125 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-30T22:51:34.125 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-30T22:51:34.125 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:51:34.125 INFO:teuthology.orchestra.run.smithi148.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:51:34.125 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:51:34.125 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-30T22:51:34.126 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:51:34.127 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:51:34.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:51:34.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:51:34.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:51:34.131 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.132 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.132 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:34.132 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:51:34.132 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T22:51:34.132 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-09-30T22:51:34.132 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:51:34.133 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:51:34.134 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:34.134 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-09-30T22:51:34.246 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-09-30T22:51:34.435 DEBUG:teuthology.parallel:result is None 2023-09-30T22:51:34.448 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-30T22:51:34.449 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-30T22:51:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-30T22:51:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-09-30T22:51:34.858 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-09-30T22:51:34.858 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-30T22:51:35.091 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-30T22:51:35.091 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-30T22:51:35.274 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-30T22:51:35.275 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-30T22:51:35.458 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-30T22:51:35.614 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-30T22:51:35.796 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-30T22:51:35.796 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-30T22:51:35.796 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:36.532 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:17.2.6-1188.g87156194.el8.x86_64 1/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 2/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 3/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:17.2.6-1188.g87156194.el8.x86_64 4/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1188.g87156 5/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 6/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 7/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 8/155 2023-09-30T22:51:36.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 9/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 10/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 11/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:17.2.6-1188.g87156194.el8.x86_64 12/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 13/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:17.2.6-1188.g87156194.el8.x86_ 14/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 15/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 16/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:17.2.6-1188.g87156194.el8.x86_6 17/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:17.2.6-1188.g87156194.el8.x86 18/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:17.2.6-1188.g87156194.el8.x86_64 19/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1188.g87156194.el 20/155 2023-09-30T22:51:36.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:17.2.6-1188.g87156194.el8. 21/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:17.2.6-1188.g87156194.el8.x86_6 22/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:17.2.6-1188.g87156194.el8.x86_64 23/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:17.2.6-1188.g87156194.el8.x86_64 24/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:17.2.6-1188.g87156194.el8.x86_64 25/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:17.2.6-1188.g87156194.el8.x86_64 26/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 27/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:17.2.6-1188.g87156194.el8.x86_64 28/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1188.g87156194. 29/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noa 30/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.n 31/155 2023-09-30T22:51:36.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1188.g871 32/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1188.g87156194.el 33/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 34/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1188.g87156194.e 35/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 36/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:17.2.6-1188.g87156194.el8.noarch 37/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:17.2.6-1188.g87156194.el8.noarch 38/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-09-30T22:51:36.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-09-30T22:51:36.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-09-30T22:51:36.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-09-30T22:51:36.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-09-30T22:51:36.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-09-30T22:51:36.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-09-30T22:51:36.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-09-30T22:51:36.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-09-30T22:51:36.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-09-30T22:51:36.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-09-30T22:51:36.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-09-30T22:51:36.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-09-30T22:51:36.542 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-09-30T22:51:36.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-09-30T22:51:36.545 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:17.2.6-1188.g87156194.el8.x86_64 124/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:17.2.6-1188.g87156194.el8.x86_64 126/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-09-30T22:51:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-09-30T22:51:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-09-30T22:51:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-09-30T22:51:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-09-30T22:51:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-09-30T22:51:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-09-30T22:51:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-30T22:51:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-09-30T22:51:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-09-30T22:51:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-09-30T22:51:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-09-30T22:51:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-09-30T22:51:38.636 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2023-09-30T22:51:38.638 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.1-8.el8.noarch 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.640 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:17.2.6-1188.g87156194.el8.noarch 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:51:38.641 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.642 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:51:38.643 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:51:38.644 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:51:38.645 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:51:38.646 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:51:38.647 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:51:38.648 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:17.2.6-1188.g87156194.el8.x86_64 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T22:51:38.649 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-09-30T22:51:38.650 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:51:38.650 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:51:38.650 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:38.650 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-09-30T22:51:38.943 DEBUG:teuthology.parallel:result is None 2023-09-30T22:51:38.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=87156194a943657e20fb2be831ae4046cdd8917b 2023-09-30T22:51:39.088 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:51:39.144 INFO:teuthology.orchestra.run.smithi142.stdout:17.2.6-1188.g87156194.el8 2023-09-30T22:51:39.144 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1188.g87156194.el8 2023-09-30T22:51:39.144 INFO:teuthology.task.install:The correct ceph version 17.2.6-1188.g87156194 is installed. 2023-09-30T22:51:39.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=87156194a943657e20fb2be831ae4046cdd8917b 2023-09-30T22:51:39.397 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:51:39.457 INFO:teuthology.orchestra.run.smithi148.stdout:17.2.6-1188.g87156194.el8 2023-09-30T22:51:39.457 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1188.g87156194.el8 2023-09-30T22:51:39.457 INFO:teuthology.task.install:The correct ceph version 17.2.6-1188.g87156194 is installed. 2023-09-30T22:51:39.457 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T22:51:39.457 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:39.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:51:39.534 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:39.534 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:51:39.610 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T22:51:39.610 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:39.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:51:39.682 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:51:39.791 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:39.792 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:51:39.863 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:51:39.977 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T22:51:39.978 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:39.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:51:40.048 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:51:40.159 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:40.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:51:40.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:51:40.340 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T22:51:40.341 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:40.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:51:40.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:51:40.521 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:40.521 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:51:40.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:51:40.699 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T22:51:40.763 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T22:51:40.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2023-09-30T22:51:40.769 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2023-09-30T22:51:40.838 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T22:51:40.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:51:40.844 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:51:40.912 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T22:51:40.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:51:40.916 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:51:40.993 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-30T22:51:40.993 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-30T22:51:40.993 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-30T22:51:40.994 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:40.994 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T22:51:41.040 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:41.242 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:41.315 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:41.315 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T22:51:41.361 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:41.569 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:41.644 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T22:51:41.644 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T22:51:41.645 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047', 'branch': 'wip-vshankar-testing-quincy-20230929.071619', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7406047', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-quincy-20230929.071619'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-quincy-20230929.071619', 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2571, 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b', 'sleep_before_teardown': 0, 'subset': '519/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-quincy-20230929.071619', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_87156194a943657e20fb2be831ae4046cdd8917b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '87156194a943657e20fb2be831ae4046cdd8917b', 'targets': {'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPjHJzUbT8LI1oBZ32NJHx/e6yhR1zgIw13aTk2LFkoimAF0f9BlkmwrQc2NtklmWZRwoMcz1GRVP6CwYnGK8Y=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs3M+ZD0mL3oGrX2NgbVTeR/pu1+UfZoiItbPE6GhioE77ykHjbJQ1hdDXdvRbobPyPZaWX/JbKSX9mGlMul/I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '87156194a943657e20fb2be831ae4046cdd8917b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-29_10:09:00', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T22:51:41.645 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:51:41.651 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:51:41.697 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:51:41.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:51:41.808 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:41.808 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T22:51:41.853 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T22:51:41.854 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2023-09-30T22:51:41.941 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-30 22:51:36.026344317 +0000 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-30 22:48:15.612429620 +0000 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-30 22:48:15.612429620 +0000 2023-09-30T22:51:41.942 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-30 22:48:15.584430111 +0000 2023-09-30T22:51:41.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T22:51:42.011 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-30T22:51:42.011 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-30T22:51:42.011 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000309283 s, 1.7 MB/s 2023-09-30T22:51:42.014 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T22:51:42.064 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2023-09-30T22:51:42.113 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T22:51:42.113 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-09-30T22:51:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-30 22:51:36.026344317 +0000 2023-09-30T22:51:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-30 22:48:16.441415113 +0000 2023-09-30T22:51:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-30 22:48:16.441415113 +0000 2023-09-30T22:51:42.114 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-30 22:48:16.417415533 +0000 2023-09-30T22:51:42.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T22:51:42.183 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-30T22:51:42.183 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-30T22:51:42.183 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000278726 s, 1.8 MB/s 2023-09-30T22:51:42.186 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T22:51:42.235 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2023-09-30T22:51:42.281 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T22:51:42.281 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:42.281 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-09-30T22:51:42.281 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:42.282 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:42.282 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-30 22:51:36.026344317 +0000 2023-09-30T22:51:42.282 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-30 22:48:17.275400518 +0000 2023-09-30T22:51:42.282 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-30 22:48:17.275400518 +0000 2023-09-30T22:51:42.282 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-30 22:48:17.249400973 +0000 2023-09-30T22:51:42.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T22:51:42.388 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-30T22:51:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-30T22:51:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000289356 s, 1.8 MB/s 2023-09-30T22:51:42.392 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T22:51:42.441 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2023-09-30T22:51:42.488 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T22:51:42.488 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:42.488 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-09-30T22:51:42.488 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:42.489 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:42.489 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-30 22:51:36.026344317 +0000 2023-09-30T22:51:42.489 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-30 22:48:18.271383087 +0000 2023-09-30T22:51:42.489 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-30 22:48:18.271383087 +0000 2023-09-30T22:51:42.489 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-30 22:48:18.246383525 +0000 2023-09-30T22:51:42.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T22:51:42.559 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-30T22:51:42.559 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-30T22:51:42.559 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000285163 s, 1.8 MB/s 2023-09-30T22:51:42.561 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T22:51:42.611 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:42.611 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:42.612 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T22:51:42.660 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T22:51:42.660 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2023-09-30T22:51:42.708 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T22:51:42.708 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:42.708 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-09-30T22:51:42.708 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:42.708 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:42.708 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-09-30 22:51:31.484850524 +0000 2023-09-30T22:51:42.708 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-09-30 22:48:16.663100807 +0000 2023-09-30T22:51:42.709 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-09-30 22:48:16.663100807 +0000 2023-09-30T22:51:42.709 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-09-30 22:48:16.636101435 +0000 2023-09-30T22:51:42.709 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T22:51:42.776 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-09-30T22:51:42.776 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-09-30T22:51:42.776 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000301341 s, 1.7 MB/s 2023-09-30T22:51:42.778 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T22:51:42.826 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2023-09-30T22:51:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T22:51:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:42.872 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-09-30T22:51:42.872 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:42.872 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:42.872 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-09-30 22:51:31.484850524 +0000 2023-09-30T22:51:42.872 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-09-30 22:48:17.516080999 +0000 2023-09-30T22:51:42.872 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-09-30 22:48:17.516080999 +0000 2023-09-30T22:51:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-09-30 22:48:17.488081650 +0000 2023-09-30T22:51:42.873 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T22:51:42.978 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-09-30T22:51:42.978 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-09-30T22:51:42.979 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000486197 s, 1.1 MB/s 2023-09-30T22:51:42.981 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T22:51:43.028 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2023-09-30T22:51:43.074 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-09-30 22:51:31.484850524 +0000 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-09-30 22:48:18.356061493 +0000 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-09-30 22:48:18.356061493 +0000 2023-09-30T22:51:43.075 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-09-30 22:48:18.332062051 +0000 2023-09-30T22:51:43.075 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T22:51:43.181 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-09-30T22:51:43.181 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-09-30T22:51:43.181 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000289954 s, 1.8 MB/s 2023-09-30T22:51:43.183 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T22:51:43.230 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2023-09-30T22:51:43.316 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-09-30 22:51:31.484850524 +0000 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-09-30 22:48:19.209041685 +0000 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-09-30 22:48:19.209041685 +0000 2023-09-30T22:51:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-09-30 22:48:19.184042266 +0000 2023-09-30T22:51:43.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T22:51:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-09-30T22:51:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-09-30T22:51:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000298858 s, 1.7 MB/s 2023-09-30T22:51:43.425 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T22:51:43.472 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:43.472 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:51:43.472 INFO:tasks.ceph:Generating config... 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client] pid file = 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client.0] debug client = 20 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client.1] debug client = 20 2023-09-30T22:51:43.474 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-09-30T22:51:43.475 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-09-30T22:51:43.475 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T22:51:43.475 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T22:51:43.476 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T22:51:43.476 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T22:51:43.476 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T22:51:43.476 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-30T22:51:43.476 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-09-30T22:51:43.476 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-09-30T22:51:43.476 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-09-30T22:51:43.476 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T22:51:43.476 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T22:51:43.476 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-30T22:51:43.476 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-30T22:51:43.476 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-09-30T22:51:43.477 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-30T22:51:43.477 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T22:51:43.478 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T22:51:43.577 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T22:51:43.583 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T22:51:43.680 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:51:43.751 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.142'), ('mon.b', '172.21.15.148'), ('mon.c', '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]')] 2023-09-30T22:51:43.751 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.142,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-30T22:51:43.752 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:43.753 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:51:43.799 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.142 --add b 172.21.15.148 --addv c '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:43.925 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:43.925 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: generated fsid 45159191-1b2c-47ed-b172-96c0a1a05709 2023-09-30T22:51:43.925 INFO:teuthology.orchestra.run.smithi142.stdout:setting min_mon_release = octopus 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 0 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:fsid 45159191-1b2c-47ed-b172-96c0a1a05709 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:last_changed 2023-09-30T22:51:43.925766+0000 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:created 2023-09-30T22:51:43.925766+0000 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:min_mon_release 15 (octopus) 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:election_strategy: 1 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2023-09-30T22:51:43.926 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T22:51:43.928 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:51:43.973 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 45159191-1b2c-47ed-b172-96c0a1a05709... 2023-09-30T22:51:43.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:51:44.019 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:51:44.136 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-09-30T22:51:44.136 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-09-30T22:51:44.136 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:51:44.136 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-09-30T22:51:44.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.136 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-09-30T22:51:44.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:51:44.138 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-09-30T22:51:44.139 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.142,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]" 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 45159191-1b2c-47ed-b172-96c0a1a05709 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.140 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-09-30T22:51:44.141 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-09-30T22:51:44.142 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: memstore device bytes = 200000000 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:51:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 1.0 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: osd mon report interval = 5 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = memstore 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:51:44.144 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:51:44.145 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:51:44.146 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull ratio = 0.6 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.7 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.6 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:51:44.147 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-09-30T22:51:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug objectcacher = 20 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug objecter = 20 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug objectcacher = 20 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug objecter = 20 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-09-30T22:51:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-09-30T22:51:44.150 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-09-30T22:51:44.150 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-09-30T22:51:44.150 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-09-30T22:51:44.150 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-09-30T22:51:44.150 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-09-30T22:51:44.150 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-09-30T22:51:44.150 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2023-09-30T22:51:44.151 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2023-09-30T22:51:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.153 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.142,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]" 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on skipped message = False 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 45159191-1b2c-47ed-b172-96c0a1a05709 2023-09-30T22:51:44.154 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2023-09-30T22:51:44.155 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.156 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 20 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 20 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 10 2023-09-30T22:51:44.157 INFO:teuthology.orchestra.run.smithi148.stdout: memstore device bytes = 200000000 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 1.0 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: osd mon report interval = 5 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = memstore 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2023-09-30T22:51:44.158 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2023-09-30T22:51:44.159 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:51:44.160 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: mon op complaint time = 120 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull ratio = 0.6 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.7 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.6 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2023-09-30T22:51:44.161 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: client mount timeout = 600 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = "" 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2023-09-30T22:51:44.162 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout: debug objectcacher = 20 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout: debug objecter = 20 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout: debug objectcacher = 20 2023-09-30T22:51:44.163 INFO:teuthology.orchestra.run.smithi148.stdout: debug objecter = 20 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout:[mds] 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds = 20 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug frag = True 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug scatterstat = True 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: mds op complaint time = 180 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: mds verify scatter = True 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-09-30T22:51:44.164 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-09-30T22:51:44.171 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T22:51:44.171 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T22:51:44.279 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T22:51:44.279 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:44.279 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T22:51:44.325 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:44.325 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T22:51:44.413 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:51:44.413 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:44.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:51:44.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:51:44.548 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:44.549 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:44.635 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:51:44.636 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:44.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:51:44.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:51:44.732 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:44.732 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:44.818 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T22:51:44.818 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T22:51:44.818 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T22:51:44.935 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T22:51:44.940 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:51:45.062 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:51:45.068 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T22:51:45.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:51:45.183 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:51:45.188 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T22:51:45.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T22:51:45.372 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T22:51:45.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-30T22:51:45.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T22:51:45.564 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T22:51:45.568 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-30T22:51:45.637 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-30T22:51:45.755 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-30T22:51:45.760 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-30T22:51:45.830 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T22:51:45.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T22:51:45.922 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T22:51:45.951 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-30T22:51:46.042 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-30T22:51:46.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-30T22:51:46.164 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-30T22:51:46.194 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-30T22:51:46.284 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-30T22:51:46.314 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T22:51:46.314 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:51:46.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T22:51:46.384 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:46.384 INFO:tasks.ceph:role: osd.0 2023-09-30T22:51:46.384 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:51:46.384 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T22:51:46.460 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:46.460 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:46.460 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:46.461 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:46.461 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:46.461 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:46.461 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:46.461 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:46.461 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:46.461 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:46.893 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-09-30T22:51:46.896 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-09-30T22:51:46.896 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T22:51:47.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T22:51:47.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T22:51:47.246 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:47.246 INFO:tasks.ceph:role: osd.1 2023-09-30T22:51:47.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:51:47.246 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:47.322 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:47.323 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:47.323 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:47.729 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-09-30T22:51:47.732 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-09-30T22:51:47.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-30T22:51:47.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T22:51:47.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T22:51:48.014 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:48.014 INFO:tasks.ceph:role: osd.2 2023-09-30T22:51:48.014 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:51:48.014 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T22:51:48.094 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:48.094 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:48.094 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:48.095 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:48.095 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:48.095 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:48.095 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:48.095 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:48.095 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:48.095 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:48.535 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-09-30T22:51:48.539 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-09-30T22:51:48.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-30T22:51:48.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T22:51:48.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T22:51:48.885 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:48.886 INFO:tasks.ceph:role: osd.3 2023-09-30T22:51:48.886 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:51:48.886 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T22:51:48.961 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:48.962 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:49.399 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-09-30T22:51:49.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-09-30T22:51:49.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-30T22:51:49.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T22:51:49.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:49.751+0000 7f2a3fb0e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T22:51:49.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:49.751+0000 7f2a3fb0e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T22:51:49.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:49.753+0000 7f2a3fb0e540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-09-30T22:51:49.768 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T22:51:49.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:49.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:49.934+0000 7f3ecd8b4540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T22:51:49.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:49.935+0000 7f3ecd8b4540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T22:51:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:49.936+0000 7f3ecd8b4540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-09-30T22:51:49.949 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T22:51:50.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:50.116+0000 7fdb95865540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T22:51:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:50.116+0000 7fdb95865540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T22:51:50.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:50.118+0000 7fdb95865540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-09-30T22:51:50.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T22:51:50.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:50.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:50.299+0000 7f8e35d0c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T22:51:50.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:50.299+0000 7f8e35d0c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T22:51:50.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:50.301+0000 7f8e35d0c540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-09-30T22:51:50.313 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T22:51:50.382 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-30T22:51:50.458 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:50.458 INFO:tasks.ceph:role: osd.4 2023-09-30T22:51:50.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:51:50.458 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T22:51:50.537 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:50.538 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:50.538 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:50.538 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:50.538 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:50.965 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-09-30T22:51:50.970 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-09-30T22:51:50.970 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-30T22:51:51.168 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-30T22:51:51.245 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-30T22:51:51.314 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:51.314 INFO:tasks.ceph:role: osd.5 2023-09-30T22:51:51.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:51:51.314 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:51.389 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:51.390 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:51.390 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:51.801 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-09-30T22:51:51.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-09-30T22:51:51.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-30T22:51:51.951 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-30T22:51:52.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-30T22:51:52.097 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:52.097 INFO:tasks.ceph:role: osd.6 2023-09-30T22:51:52.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:51:52.097 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T22:51:52.174 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:52.175 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:52.621 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-09-30T22:51:52.627 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-09-30T22:51:52.627 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-30T22:51:52.819 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-30T22:51:52.897 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-30T22:51:52.967 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T22:51:52.967 INFO:tasks.ceph:role: osd.7 2023-09-30T22:51:52.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:51:52.967 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T22:51:53.044 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:51:53.044 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:51:53.044 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:51:53.044 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:51:53.045 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:51:53.045 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:51:53.045 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:51:53.045 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:51:53.045 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:51:53.045 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:51:53.474 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-09-30T22:51:53.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-09-30T22:51:53.479 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-30T22:51:53.608 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-30T22:51:53.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:53.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:53.807+0000 7f17de680540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-30T22:51:53.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:53.807+0000 7f17de680540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-30T22:51:53.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:53.809+0000 7f17de680540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-09-30T22:51:53.825 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-30T22:51:53.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:53.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:53.993+0000 7f7133edb540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-30T22:51:53.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:53.993+0000 7f7133edb540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-30T22:51:53.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:53.995+0000 7f7133edb540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-09-30T22:51:54.007 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-30T22:51:54.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:54.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:54.175+0000 7f92b49f2540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-30T22:51:54.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:54.176+0000 7f92b49f2540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-30T22:51:54.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:54.177+0000 7f92b49f2540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-09-30T22:51:54.192 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-30T22:51:54.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:54.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:54.360+0000 7fc2640a6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-30T22:51:54.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:54.361+0000 7fc2640a6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-30T22:51:54.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:51:54.362+0000 7fc2640a6540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-09-30T22:51:54.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-30T22:51:54.446 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T22:51:54.446 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:54.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-30T22:51:54.521 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:54.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T22:51:54.593 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:54.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-30T22:51:54.702 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:54.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T22:51:54.811 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:54.811 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T22:51:54.919 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:54.919 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T22:51:55.029 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:55.029 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T22:51:55.136 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T22:51:55.209 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.209 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-30T22:51:55.319 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.320 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-30T22:51:55.429 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-30T22:51:55.538 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.538 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-30T22:51:55.647 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.647 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-30T22:51:55.756 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-30T22:51:55.865 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:55.865 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T22:51:55.915 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:51:55.915 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-30T22:51:55.961 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:55.961 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-30T22:51:56.006 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:51:56.006 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-30T22:51:56.091 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T22:51:56.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T22:51:56.097 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T22:51:56.162 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2023-09-30T22:51:56.163 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A== 2023-09-30T22:51:56.163 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-09-30T22:51:56.163 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw== 2023-09-30T22:51:56.163 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-09-30T22:51:56.163 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg== 2023-09-30T22:51:56.163 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2023-09-30T22:51:56.163 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg== 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q== 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw== 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w== 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA== 2023-09-30T22:51:56.164 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg== 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg== 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg== 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag== 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2023-09-30T22:51:56.165 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg== 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw== 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw== 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw== 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-09-30T22:51:56.166 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw== 2023-09-30T22:51:56.167 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2023-09-30T22:51:56.167 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ== 2023-09-30T22:51:56.198 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2023-09-30T22:51:56.198 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A== 2023-09-30T22:51:56.198 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-09-30T22:51:56.198 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw== 2023-09-30T22:51:56.198 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-09-30T22:51:56.198 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg== 2023-09-30T22:51:56.198 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg== 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q== 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw== 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w== 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA== 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg== 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-09-30T22:51:56.199 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg== 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg== 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag== 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg== 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw== 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw== 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout:[client.2] 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw== 2023-09-30T22:51:56.200 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2023-09-30T22:51:56.201 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw== 2023-09-30T22:51:56.201 INFO:teuthology.orchestra.run.smithi148.stdout:[client.3] 2023-09-30T22:51:56.201 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ== 2023-09-30T22:51:56.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:51:56.213 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:51:56.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:56.349 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:56.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:56.460 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:56.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.674 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.678 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.786 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.888 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.893 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:56.995 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:51:56.999 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:51:57.102 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:57.106 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:57.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:57.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:51:57.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.329 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.437 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.547 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.651 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.655 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:51:57.759 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:57.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:57.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:57.874 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:57.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:57.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:58.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:58.096 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:51:58.201 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T22:51:58.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T22:51:58.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:51:58.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T22:51:58.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T22:51:58.525 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:51:58.643 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T22:51:58.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T22:51:58.782 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:51:58.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T22:51:58.968 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:58.974 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:51:59.021 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T22:51:59.022 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:51:59.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:51:59.060 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:51:59.060 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:51:59.060 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:51:59.066 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:51:59.066 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:51:59.067 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:51:59.072 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:51:59.072 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T22:51:59.073 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-30T22:51:59.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-30T22:51:59.078 INFO:tasks.ceph.mgr.y:Started 2023-09-30T22:51:59.078 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:51:59.078 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:51:59.082 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:51:59.082 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T22:51:59.083 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T22:51:59.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.276+0000 7f4c577ff700 1 Processor -- start 2023-09-30T22:51:59.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.276+0000 7f4c577ff700 1 -- start start 2023-09-30T22:51:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c577ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:51:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c577ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500d0550 con 0x7f4c500cc3b0 2023-09-30T22:51:59.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c577ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500cf940 con 0x7f4c500cbfe0 2023-09-30T22:51:59.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c577ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500cfc20 con 0x7f4c50157ab0 2023-09-30T22:51:59.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c55d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4c500cc3b0 0x7f4c5006a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47766/0 (socket says 172.21.15.142:47766) 2023-09-30T22:51:59.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 learned_addr learned my addr 172.21.15.142:0/2431435277 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:51:59.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:51:59.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:51:59.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:51:59.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:51:59.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.278+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:51:59.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.479+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:51:59.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.479+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:51:59.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.479+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:51:59.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.479+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:51:59.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.479+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:51:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.880+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:51:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.880+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:51:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.880+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:51:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.880+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:51:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:51:59.880+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:52:00.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:00.682+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:00.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:00.682+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:00.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:00.682+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:00.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:00.682+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:00.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:00.682+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:52:02.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c5015a2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c5015a2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> v1:172.21.15.148:6789/0 conn(0x7f4c500cbfe0 legacy=0x7f4c501573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> v1:172.21.15.142:6789/0 conn(0x7f4c500cc3b0 legacy=0x7f4c5006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500cfc20 con 0x7f4c34003730 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34008da0 con 0x7f4c340061c0 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.278+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:02.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:02.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:02.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:02.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:02.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:02.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:52:02.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.279+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:52:02.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:02.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.480+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:02.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:02.881+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:52:03.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.682+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:03.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.682+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.682+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.682+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.683+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.683+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.683+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.683+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.683+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:03.683+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:52:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 msgr2=0x7f4c34005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c34003730 0x7f4c34005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 reap_dead start 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500cfc20 con 0x7f4c3400b6f0 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c34008da0 con 0x7f4c50157ab0 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340041e0 con 0x7f4c340061c0 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:52:05.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.279+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:52:05.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:05.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:52:05.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.480+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:52:05.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.881+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.881+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:05.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.881+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.881+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.881+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.881+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:05.882+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:52:06.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:06.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:06.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:06.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:06.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:52:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:52:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c5559b700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:52:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:52:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:52:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:52:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:06.683+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:52:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 msgr2=0x7f4c34008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c340061c0 0x7f4c34008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 msgr2=0x7f4c3400b1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.148:3300/0 conn(0x7f4c50157ab0 0x7f4c3400b1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 msgr2=0x7f4c34003b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 --2- 172.21.15.142:0/2431435277 >> v2:172.21.15.142:3300/0 conn(0x7f4c3400b6f0 0x7f4c34003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500cff00 con 0x7f4c34004540 2023-09-30T22:52:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:08.279+0000 7f4c46ffd700 1 -- 172.21.15.142:0/2431435277 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c34005e20 con 0x7f4c340051e0 2023-09-30T22:52:09.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.467+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014496860 0 0) 0x7f4c500cff00 con 0x7f4c34004540 2023-09-30T22:52:09.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.467+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c3c003570 con 0x7f4c34004540 2023-09-30T22:52:09.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.468+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527789539 0 0) 0x7f4c34005e20 con 0x7f4c340051e0 2023-09-30T22:52:09.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.468+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c500cff00 con 0x7f4c340051e0 2023-09-30T22:52:09.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.468+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2956631347 0 0) 0x7f4c3c003570 con 0x7f4c34004540 2023-09-30T22:52:09.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.468+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 >> v1:172.21.15.148:6789/0 conn(0x7f4c340051e0 legacy=0x7f4c340055e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:09.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.468+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34015bb0 con 0x7f4c34004540 2023-09-30T22:52:09.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.468+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f4c4c0124c0 con 0x7f4c34004540 2023-09-30T22:52:09.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 >> v1:172.21.15.142:6789/0 conn(0x7f4c34004540 legacy=0x7f4c34004940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:09.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c55d9c700 1 -- 172.21.15.142:0/2431435277 reap_dead start 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c47fff700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c3c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c47fff700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c47fff700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c0053a0 0x7f4c3c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c00c330 con 0x7f4c3c0053a0 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c00c4a0 con 0x7f4c3c004810 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c00c660 con 0x7f4c3c003c20 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c5559b700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c3c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.469+0000 7f4c55d9c700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c0053a0 0x7f4c3c00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:09.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.470+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 msgr2=0x7f4c3c003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:09.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.470+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c3c003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.470+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c0053a0 msgr2=0x7f4c3c00ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:09.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.470+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c0053a0 0x7f4c3c00ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.470+0000 7f4c54d9a700 1 -- 172.21.15.142:0/2431435277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c003570 con 0x7f4c3c004810 2023-09-30T22:52:09.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.471+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4c34006630 tx=0x7f4c40008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52c007cf2f828a50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:09.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.471+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400178f0 con 0x7f4c3c004810 2023-09-30T22:52:09.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.471+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4001e040 con 0x7f4c3c004810 2023-09-30T22:52:09.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.471+0000 7f4c47fff700 1 -- 172.21.15.142:0/2431435277 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40018c40 con 0x7f4c3c004810 2023-09-30T22:52:09.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 -- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c004810 msgr2=0x7f4c3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:09.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4c34006630 tx=0x7f4c40008040 comp rx=0 tx=0).stop 2023-09-30T22:52:09.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 -- 172.21.15.142:0/2431435277 shutdown_connections 2023-09-30T22:52:09.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c0053a0 0x7f4c3c00ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c004810 0x7f4c3c004c80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 --2- 172.21.15.142:0/2431435277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c3c003ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 -- 172.21.15.142:0/2431435277 >> 172.21.15.142:0/2431435277 conn(0x7f4c500d0a80 msgr2=0x7f4c500d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:09.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 -- 172.21.15.142:0/2431435277 shutdown_connections 2023-09-30T22:52:09.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.472+0000 7f4c577ff700 1 -- 172.21.15.142:0/2431435277 wait complete. 2023-09-30T22:52:09.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.474+0000 7f4c577ff700 1 Processor -- start 2023-09-30T22:52:09.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.474+0000 7f4c577ff700 1 -- start start 2023-09-30T22:52:09.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.475+0000 7f4c577ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c5014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:09.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.475+0000 7f4c577ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c004810 0x7f4c500c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:09.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.475+0000 7f4c577ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c0053a0 0x7f4c500c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:09.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c577ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50158f00 con 0x7f4c3c004810 2023-09-30T22:52:09.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c577ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501582f0 con 0x7f4c3c0053a0 2023-09-30T22:52:09.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c577ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501585d0 con 0x7f4c3c003c20 2023-09-30T22:52:09.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c5559b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c5014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:09.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c5559b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c5014d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:43402/0 (socket says 172.21.15.142:43402) 2023-09-30T22:52:09.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c5559b700 1 -- 172.21.15.142:0/3355005803 learned_addr learned my addr 172.21.15.142:0/3355005803 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:09.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c004810 0x7f4c500c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:09.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c54d9a700 1 -- 172.21.15.142:0/3355005803 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 msgr2=0x7f4c5014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:09.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.476+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c5014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.477+0000 7f4c54d9a700 1 -- 172.21.15.142:0/3355005803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c0053a0 msgr2=0x7f4c500c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:09.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.477+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c0053a0 0x7f4c500c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.477+0000 7f4c54d9a700 1 -- 172.21.15.142:0/3355005803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c501588b0 con 0x7f4c3c004810 2023-09-30T22:52:09.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.477+0000 7f4c54d9a700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c004810 0x7f4c500c6a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006f00 tx=0x7f4c40028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:09.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.478+0000 7f4c457fa700 1 -- 172.21.15.142:0/3355005803 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4002f630 con 0x7f4c3c004810 2023-09-30T22:52:09.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.478+0000 7f4c457fa700 1 -- 172.21.15.142:0/3355005803 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4002f790 con 0x7f4c3c004810 2023-09-30T22:52:09.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.478+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c50158b90 con 0x7f4c3c004810 2023-09-30T22:52:09.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.478+0000 7f4c457fa700 1 -- 172.21.15.142:0/3355005803 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4002fb70 con 0x7f4c3c004810 2023-09-30T22:52:09.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.478+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c50157f10 con 0x7f4c3c004810 2023-09-30T22:52:09.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.478+0000 7f4c457fa700 1 -- 172.21.15.142:0/3355005803 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4c400373f0 con 0x7f4c3c004810 2023-09-30T22:52:09.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.478+0000 7f4c457fa700 1 -- 172.21.15.142:0/3355005803 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4c40023730 con 0x7f4c3c004810 2023-09-30T22:52:09.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.479+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c501590b0 con 0x7f4c3c004810 2023-09-30T22:52:09.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.483+0000 7f4c457fa700 1 -- 172.21.15.142:0/3355005803 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f4c501590b0 con 0x7f4c3c004810 2023-09-30T22:52:09.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.562+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4c5006fc10 con 0x7f4c3c004810 2023-09-30T22:52:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.566+0000 7f4c457fa700 1 -- 172.21.15.142:0/3355005803 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4c40037880 con 0x7f4c3c004810 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c004810 msgr2=0x7f4c500c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c004810 0x7f4c500c6a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006f00 tx=0x7f4c40028000 comp rx=0 tx=0).stop 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 shutdown_connections 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c0053a0 0x7f4c500c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c3c003c20 0x7f4c5014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 --2- 172.21.15.142:0/3355005803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c3c004810 0x7f4c500c6a20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 >> 172.21.15.142:0/3355005803 conn(0x7f4c500d0a80 msgr2=0x7f4c50154eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 shutdown_connections 2023-09-30T22:52:09.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:09.567+0000 7f4c577ff700 1 -- 172.21.15.142:0/3355005803 wait complete. 2023-09-30T22:52:09.570 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2023-09-30T22:52:09.586 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T22:52:09.587 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:52:09.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T22:52:09.636 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:09.635+0000 7f6594a451c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:52:09.643 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:09.642+0000 7f07144671c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:52:09.660 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:52:09.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T22:52:09.729 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:52:09.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T22:52:09.832 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:09.831+0000 7f6594a451c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:52:09.843 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:09.842+0000 7f07144671c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:52:09.862 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-30T22:52:09.862 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T22:52:09.931 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:52:09.931 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-30T22:52:10.002 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:52:10.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-30T22:52:10.116 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:52:10.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-30T22:52:10.185 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-09-30T22:52:10.185 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-30T22:52:10.227 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:10.225+0000 7f07144671c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:52:10.249 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:10.248+0000 7f6594a451c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:52:10.296 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-09-30T22:52:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.522+0000 7f0a7d1ff700 1 Processor -- start 2023-09-30T22:52:10.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.523+0000 7f0a7d1ff700 1 -- start start 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7d1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a78159ba0 0x7f0a7806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7d1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780b0de0 0x7f0a780c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7d1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a780ca410 0x7f0a7815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7d1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a78067d10 con 0x7f0a78159ba0 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7d1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a780ca850 con 0x7f0a780ca410 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7d1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7806af90 con 0x7f0a780b0de0 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780b0de0 0x7f0a780c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a780ca410 0x7f0a7815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780b0de0 0x7f0a780c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:56988/0 (socket says 172.21.15.148:56988) 2023-09-30T22:52:10.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a7659c700 1 -- 172.21.15.148:0/3418831921 learned_addr learned my addr 172.21.15.148:0/3418831921 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.524+0000 7f0a76d9d700 1 --2- 172.21.15.148:0/3418831921 >> v2:172.21.15.142:3300/0 conn(0x7f0a78159ba0 0x7f0a7806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a7659c700 1 -- 172.21.15.148:0/3418831921 >> v2:172.21.15.148:3300/0 conn(0x7f0a780ca410 msgr2=0x7f0a7815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a7659c700 1 --2- 172.21.15.148:0/3418831921 >> v2:172.21.15.148:3300/0 conn(0x7f0a780ca410 0x7f0a7815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a7659c700 1 -- 172.21.15.148:0/3418831921 >> v2:172.21.15.142:3300/0 conn(0x7f0a78159ba0 msgr2=0x7f0a7806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a7659c700 1 --2- 172.21.15.148:0/3418831921 >> v2:172.21.15.142:3300/0 conn(0x7f0a78159ba0 0x7f0a7806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a7659c700 1 -- 172.21.15.148:0/3418831921 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780676c0 con 0x7f0a780b0de0 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a7659c700 1 --2- 172.21.15.148:0/3418831921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780b0de0 0x7f0a780c9ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a780c8e30 tx=0x7f0a6c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=443d2c9f078926b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a75d9b700 1 -- 172.21.15.148:0/3418831921 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00b640 con 0x7f0a780b0de0 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a75d9b700 1 -- 172.21.15.148:0/3418831921 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00b7a0 con 0x7f0a780b0de0 2023-09-30T22:52:10.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.525+0000 7f0a75d9b700 1 -- 172.21.15.148:0/3418831921 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00bb60 con 0x7f0a780b0de0 2023-09-30T22:52:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/3418831921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780b0de0 msgr2=0x7f0a780c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/3418831921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780b0de0 0x7f0a780c9ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a780c8e30 tx=0x7f0a6c009250 comp rx=0 tx=0).stop 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/3418831921 shutdown_connections 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/3418831921 >> v2:172.21.15.148:3300/0 conn(0x7f0a780ca410 0x7f0a7815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/3418831921 >> v2:172.21.15.142:3300/0 conn(0x7f0a78159ba0 0x7f0a7806a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/3418831921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780b0de0 0x7f0a780c9ed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/3418831921 >> 172.21.15.148:0/3418831921 conn(0x7f0a780cb2f0 msgr2=0x7f0a780cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/3418831921 shutdown_connections 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.526+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/3418831921 wait complete. 2023-09-30T22:52:10.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.528+0000 7f0a7d1ff700 1 Processor -- start 2023-09-30T22:52:10.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.528+0000 7f0a7d1ff700 1 -- start start 2023-09-30T22:52:10.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.529+0000 7f0a7d1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780b0de0 0x7f0a7816df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.529+0000 7f0a7d1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780ca410 0x7f0a780c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.529+0000 7f0a7d1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a78159ba0 0x7f0a780b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.529+0000 7f0a7d1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a780c5cd0 con 0x7f0a780b0de0 2023-09-30T22:52:10.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.529+0000 7f0a7d1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a780c5fb0 con 0x7f0a78159ba0 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.529+0000 7f0a7d1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a780c6290 con 0x7f0a780ca410 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a78159ba0 0x7f0a780b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a76d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780b0de0 0x7f0a7816df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a78159ba0 0x7f0a780b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48848/0 (socket says 172.21.15.148:48848) 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780ca410 0x7f0a780c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a76d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780b0de0 0x7f0a7816df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.148:41842/0 (socket says 172.21.15.148:41842) 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7759e700 1 -- 172.21.15.148:0/1903123291 learned_addr learned my addr 172.21.15.148:0/1903123291 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7659c700 1 -- 172.21.15.148:0/1903123291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a78159ba0 msgr2=0x7f0a780b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7659c700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a78159ba0 0x7f0a780b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7659c700 1 -- 172.21.15.148:0/1903123291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780b0de0 msgr2=0x7f0a7816df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7659c700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780b0de0 0x7f0a7816df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a7659c700 1 -- 172.21.15.148:0/1903123291 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0094f0 con 0x7f0a780ca410 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.530+0000 7f0a76d9d700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780b0de0 0x7f0a7816df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a7659c700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780ca410 0x7f0a780c6d70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a7806ec80 tx=0x7f0a6c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a5effd700 1 -- 172.21.15.148:0/1903123291 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00b910 con 0x7f0a780ca410 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a5effd700 1 -- 172.21.15.148:0/1903123291 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00ba70 con 0x7f0a780ca410 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a5effd700 1 -- 172.21.15.148:0/1903123291 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011650 con 0x7f0a780ca410 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a780c6570 con 0x7f0a780ca410 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7816e490 con 0x7f0a780ca410 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a5effd700 1 -- 172.21.15.148:0/1903123291 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0a6c011c80 con 0x7f0a780ca410 2023-09-30T22:52:10.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.531+0000 7f0a5effd700 1 -- 172.21.15.148:0/1903123291 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0a6c02eb10 con 0x7f0a780ca410 2023-09-30T22:52:10.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.532+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a780c6a90 con 0x7f0a780ca410 2023-09-30T22:52:10.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.535+0000 7f0a5effd700 1 -- 172.21.15.148:0/1903123291 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f0a780c6a90 con 0x7f0a780ca410 2023-09-30T22:52:10.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.619+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f0a780679a0 con 0x7f0a780ca410 2023-09-30T22:52:10.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.624+0000 7f0a5effd700 1 -- 172.21.15.148:0/1903123291 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0a6c015020 con 0x7f0a780ca410 2023-09-30T22:52:10.626 INFO:teuthology.orchestra.run.smithi148.stdout:0 2023-09-30T22:52:10.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.625+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780ca410 msgr2=0x7f0a780c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.625+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780ca410 0x7f0a780c6d70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a7806ec80 tx=0x7f0a6c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:10.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.625+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 shutdown_connections 2023-09-30T22:52:10.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.625+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a78159ba0 0x7f0a780b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.625+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780b0de0 0x7f0a7816df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.625+0000 7f0a7d1ff700 1 --2- 172.21.15.148:0/1903123291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a780ca410 0x7f0a780c6d70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.625+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 >> 172.21.15.148:0/1903123291 conn(0x7f0a780cb2f0 msgr2=0x7f0a78158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:10.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.626+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 shutdown_connections 2023-09-30T22:52:10.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.626+0000 7f0a7d1ff700 1 -- 172.21.15.148:0/1903123291 wait complete. 2023-09-30T22:52:10.644 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-09-30T22:52:10.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.833+0000 7fe175fff700 1 Processor -- start 2023-09-30T22:52:10.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.833+0000 7fe175fff700 1 -- start start 2023-09-30T22:52:10.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe175fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe17015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe175fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1700d0550 con 0x7fe1700cc3b0 2023-09-30T22:52:10.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe175fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1700cf940 con 0x7fe1700cbfe0 2023-09-30T22:52:10.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe175fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700cfc20 con 0x7fe170157ab0 2023-09-30T22:52:10.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe16effd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe17015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe16f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe1700cbfe0 0x7fe1701573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57588/0 (socket says 172.21.15.148:57588) 2023-09-30T22:52:10.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe16f7fe700 1 -- 172.21.15.148:0/1820118967 learned_addr learned my addr 172.21.15.148:0/1820118967 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.835+0000 7fe16e7fc700 1 -- 172.21.15.148:0/1820118967 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493864494 0 0) 0x7fe1700cf940 con 0x7fe1700cbfe0 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16e7fc700 1 -- 172.21.15.148:0/1820118967 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe158003570 con 0x7fe1700cbfe0 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16e7fc700 1 -- 172.21.15.148:0/1820118967 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683972911 0 0) 0x7fe1700d0550 con 0x7fe1700cc3b0 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16effd700 1 -- 172.21.15.148:0/1820118967 >> v1:172.21.15.148:6789/0 conn(0x7fe1700cbfe0 legacy=0x7fe1701573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16effd700 1 -- 172.21.15.148:0/1820118967 >> v1:172.21.15.142:6789/0 conn(0x7fe1700cc3b0 legacy=0x7fe17006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16effd700 1 -- 172.21.15.148:0/1820118967 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1700cff00 con 0x7fe170157ab0 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16effd700 1 --2- 172.21.15.148:0/1820118967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe17015a2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe164009940 tx=0x7fe1640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b16d8eac59b0468d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16e7fc700 1 -- 172.21.15.148:0/1820118967 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400b670 con 0x7fe170157ab0 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16e7fc700 1 -- 172.21.15.148:0/1820118967 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400b7d0 con 0x7fe170157ab0 2023-09-30T22:52:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.836+0000 7fe16e7fc700 1 -- 172.21.15.148:0/1820118967 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400bb90 con 0x7fe170157ab0 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.837+0000 7fe175fff700 1 -- 172.21.15.148:0/1820118967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 msgr2=0x7fe17015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.837+0000 7fe175fff700 1 --2- 172.21.15.148:0/1820118967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe17015a2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe164009940 tx=0x7fe1640091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.837+0000 7fe175fff700 1 -- 172.21.15.148:0/1820118967 shutdown_connections 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.837+0000 7fe175fff700 1 --2- 172.21.15.148:0/1820118967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe17015a2a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.837+0000 7fe175fff700 1 -- 172.21.15.148:0/1820118967 >> 172.21.15.148:0/1820118967 conn(0x7fe1700d0a80 msgr2=0x7fe1700d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.837+0000 7fe175fff700 1 -- 172.21.15.148:0/1820118967 shutdown_connections 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.837+0000 7fe175fff700 1 -- 172.21.15.148:0/1820118967 wait complete. 2023-09-30T22:52:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.839+0000 7fe175fff700 1 Processor -- start 2023-09-30T22:52:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.839+0000 7fe175fff700 1 -- start start 2023-09-30T22:52:10.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.840+0000 7fe175fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700cbfe0 0x7fe1700c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.840+0000 7fe175fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1700cc3b0 0x7fe17014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.840+0000 7fe175fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe1700c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:10.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.840+0000 7fe175fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17015a110 con 0x7fe1700cbfe0 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.840+0000 7fe175fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe170159590 con 0x7fe1700cc3b0 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.840+0000 7fe175fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe170159870 con 0x7fe170157ab0 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1700cc3b0 0x7fe17014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700cbfe0 0x7fe1700c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1700cc3b0 0x7fe17014c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48862/0 (socket says 172.21.15.148:48862) 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16effd700 1 -- 172.21.15.148:0/2537611648 learned_addr learned my addr 172.21.15.148:0/2537611648 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16ffff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe1700c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16ffff700 1 -- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1700cc3b0 msgr2=0x7fe17014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16ffff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1700cc3b0 0x7fe17014c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16ffff700 1 -- 172.21.15.148:0/2537611648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700cbfe0 msgr2=0x7fe1700c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16ffff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700cbfe0 0x7fe1700c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16ffff700 1 -- 172.21.15.148:0/2537611648 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009420 con 0x7fe170157ab0 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16effd700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1700cc3b0 0x7fe17014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16f7fe700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700cbfe0 0x7fe1700c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.841+0000 7fe16ffff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe1700c6a50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe168001560 tx=0x7fe1680016c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.842+0000 7fe1577fe700 1 -- 172.21.15.148:0/2537611648 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012630 con 0x7fe170157ab0 2023-09-30T22:52:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.842+0000 7fe1577fe700 1 -- 172.21.15.148:0/2537611648 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168012790 con 0x7fe170157ab0 2023-09-30T22:52:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.842+0000 7fe1577fe700 1 -- 172.21.15.148:0/2537611648 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012b50 con 0x7fe170157ab0 2023-09-30T22:52:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.842+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe170159b50 con 0x7fe170157ab0 2023-09-30T22:52:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.842+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1700c5460 con 0x7fe170157ab0 2023-09-30T22:52:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.842+0000 7fe1577fe700 1 -- 172.21.15.148:0/2537611648 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe168003030 con 0x7fe170157ab0 2023-09-30T22:52:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.842+0000 7fe1577fe700 1 -- 172.21.15.148:0/2537611648 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fe16801a3a0 con 0x7fe170157ab0 2023-09-30T22:52:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.843+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe170069770 con 0x7fe170157ab0 2023-09-30T22:52:10.849 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:10.845+0000 7f07144671c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:52:10.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.846+0000 7fe1577fe700 1 -- 172.21.15.148:0/2537611648 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fe16801b400 con 0x7fe170157ab0 2023-09-30T22:52:10.930 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:10.929+0000 7f6594a451c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:52:10.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.948+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7fe17006fc10 con 0x7fe170157ab0 2023-09-30T22:52:10.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.952+0000 7fe1577fe700 1 -- 172.21.15.148:0/2537611648 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe16801b5a0 con 0x7fe170157ab0 2023-09-30T22:52:10.954 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 msgr2=0x7fe1700c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe1700c6a50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe168001560 tx=0x7fe1680016c0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 shutdown_connections 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe170157ab0 0x7fe1700c6a50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700cbfe0 0x7fe1700c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 --2- 172.21.15.148:0/2537611648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1700cc3b0 0x7fe17014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 >> 172.21.15.148:0/2537611648 conn(0x7fe1700d0a80 msgr2=0x7fe1701565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 shutdown_connections 2023-09-30T22:52:10.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:10.953+0000 7fe175fff700 1 -- 172.21.15.148:0/2537611648 wait complete. 2023-09-30T22:52:10.971 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-09-30T22:52:11.014 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:11.013+0000 7f07144671c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T22:52:11.110 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:11.109+0000 7f6594a451c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T22:52:11.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.159+0000 7f29c43ff700 1 Processor -- start 2023-09-30T22:52:11.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.160+0000 7f29c43ff700 1 -- start start 2023-09-30T22:52:11.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c43ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0cbfe0 0x7f29bc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c43ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29bc0cc3b0 0x7f29bc0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c43ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0d0550 con 0x7f29bc1573a0 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c43ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc0cf750 con 0x7f29bc0cc3b0 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c43ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0cf940 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c219b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0cbfe0 0x7f29bc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c299c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f29bc1573a0 0x7f29bc15d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60256/0 (socket says 172.21.15.148:60256) 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c299c700 1 -- 172.21.15.148:0/4148656410 learned_addr learned my addr 172.21.15.148:0/4148656410 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.161+0000 7f29c199a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29bc0cc3b0 0x7f29bc0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c199a700 1 -- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0cbfe0 msgr2=0x7f29bc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c199a700 1 --2- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0cbfe0 0x7f29bc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c199a700 1 -- 172.21.15.148:0/4148656410 >> v1:172.21.15.148:6789/0 conn(0x7f29bc1573a0 legacy=0x7f29bc15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c199a700 1 -- 172.21.15.148:0/4148656410 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0cfc20 con 0x7f29bc0cc3b0 2023-09-30T22:52:11.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c219b700 1 --2- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0cbfe0 0x7f29bc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:11.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c1199700 1 -- 172.21.15.148:0/4148656410 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151999987 0 0) 0x7f29bc0d0550 con 0x7f29bc1573a0 2023-09-30T22:52:11.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c199a700 1 --2- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cc3b0 0x7f29bc0cf210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009910 tx=0x7f29ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b93838474f33ced server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:11.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c1199700 1 -- 172.21.15.148:0/4148656410 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00b640 con 0x7f29bc0cc3b0 2023-09-30T22:52:11.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c1199700 1 -- 172.21.15.148:0/4148656410 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00b7a0 con 0x7f29bc0cc3b0 2023-09-30T22:52:11.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.162+0000 7f29c1199700 1 -- 172.21.15.148:0/4148656410 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00bb60 con 0x7f29bc0cc3b0 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 -- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cc3b0 msgr2=0x7f29bc0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 --2- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cc3b0 0x7f29bc0cf210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009910 tx=0x7f29ac0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 -- 172.21.15.148:0/4148656410 shutdown_connections 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 --2- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0cbfe0 0x7f29bc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 --2- 172.21.15.148:0/4148656410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cc3b0 0x7f29bc0cf210 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 -- 172.21.15.148:0/4148656410 >> 172.21.15.148:0/4148656410 conn(0x7f29bc0d0a80 msgr2=0x7f29bc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 -- 172.21.15.148:0/4148656410 shutdown_connections 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.163+0000 7f29c43ff700 1 -- 172.21.15.148:0/4148656410 wait complete. 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.165+0000 7f29c43ff700 1 Processor -- start 2023-09-30T22:52:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.165+0000 7f29c43ff700 1 -- start start 2023-09-30T22:52:11.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c43ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cbfe0 0x7f29bc0c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c43ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0cc3b0 0x7f29bc0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c43ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc1573a0 0x7f29bc145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c43ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc16b1d0 con 0x7f29bc0cc3b0 2023-09-30T22:52:11.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c43ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc16a5c0 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c43ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc16a8a0 con 0x7f29bc1573a0 2023-09-30T22:52:11.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c219b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cbfe0 0x7f29bc0c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c299c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc1573a0 0x7f29bc145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c219b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cbfe0 0x7f29bc0c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57476/0 (socket says 172.21.15.148:57476) 2023-09-30T22:52:11.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c219b700 1 -- 172.21.15.148:0/2764404178 learned_addr learned my addr 172.21.15.148:0/2764404178 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:11.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.166+0000 7f29c199a700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0cc3b0 0x7f29bc0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c219b700 1 -- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc1573a0 msgr2=0x7f29bc145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c219b700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc1573a0 0x7f29bc145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c219b700 1 -- 172.21.15.148:0/2764404178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0cc3b0 msgr2=0x7f29bc0c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c219b700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0cc3b0 0x7f29bc0c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c219b700 1 -- 172.21.15.148:0/2764404178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8009420 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c299c700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc1573a0 0x7f29bc145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c219b700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cbfe0 0x7f29bc0c4550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29b800ec80 tx=0x7f29b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29b27fc700 1 -- 172.21.15.148:0/2764404178 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800c920 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29b27fc700 1 -- 172.21.15.148:0/2764404178 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b800ca80 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac009420 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29b27fc700 1 -- 172.21.15.148:0/2764404178 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800ce00 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.167+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc16ae60 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.168+0000 7f29b27fc700 1 -- 172.21.15.148:0/2764404178 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f29b8005c80 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.168+0000 7f29b27fc700 1 -- 172.21.15.148:0/2764404178 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f29b8013d60 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.169+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc069770 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.171+0000 7f29b27fc700 1 -- 172.21.15.148:0/2764404178 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f29b8021060 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.258+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f29bc06fc10 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.262+0000 7f29b27fc700 1 -- 172.21.15.148:0/2764404178 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29b8029020 con 0x7f29bc0cbfe0 2023-09-30T22:52:11.264 INFO:teuthology.orchestra.run.smithi148.stdout:2 2023-09-30T22:52:11.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.263+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cbfe0 msgr2=0x7f29bc0c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.263+0000 7f29c43ff700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cbfe0 0x7f29bc0c4550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29b800ec80 tx=0x7f29b80091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.263+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 shutdown_connections 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.263+0000 7f29c43ff700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc1573a0 0x7f29bc145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.263+0000 7f29c43ff700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc0cbfe0 0x7f29bc0c4550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.263+0000 7f29c43ff700 1 --2- 172.21.15.148:0/2764404178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0cc3b0 0x7f29bc0c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.263+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 >> 172.21.15.148:0/2764404178 conn(0x7f29bc0d0a80 msgr2=0x7f29bc155290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.264+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 shutdown_connections 2023-09-30T22:52:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.264+0000 7f29c43ff700 1 -- 172.21.15.148:0/2764404178 wait complete. 2023-09-30T22:52:11.282 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-09-30T22:52:11.442 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:11.440+0000 7f07144671c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:52:11.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.468+0000 7f7eb1bff700 1 Processor -- start 2023-09-30T22:52:11.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.468+0000 7f7eb1bff700 1 -- start start 2023-09-30T22:52:11.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.469+0000 7f7eb1bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7eac0cbfe0 0x7f7eac15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.469+0000 7f7eb1bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7eac0cc3b0 0x7f7eac0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.469+0000 7f7eb1bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0d0550 con 0x7f7eac1573a0 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.469+0000 7f7eb1bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0cf750 con 0x7f7eac0cc3b0 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.469+0000 7f7eb1bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0cf940 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7eac0cbfe0 0x7f7eac15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaaffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7eac0cc3b0 0x7f7eac0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7eac0cbfe0 0x7f7eac15a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57482/0 (socket says 172.21.15.148:57482) 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eab7fe700 1 -- 172.21.15.148:0/822216366 learned_addr learned my addr 172.21.15.148:0/822216366 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaaffd700 1 --2- 172.21.15.148:0/822216366 >> v2:172.21.15.142:3300/0 conn(0x7f7eac0cc3b0 0x7f7eac0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.148:41048/0 (socket says 172.21.15.148:41048) 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaaffd700 1 -- 172.21.15.148:0/822216366 >> v2:172.21.15.148:3300/0 conn(0x7f7eac0cbfe0 msgr2=0x7f7eac15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaaffd700 1 --2- 172.21.15.148:0/822216366 >> v2:172.21.15.148:3300/0 conn(0x7f7eac0cbfe0 0x7f7eac15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaaffd700 1 -- 172.21.15.148:0/822216366 >> v1:172.21.15.142:6789/0 conn(0x7f7eac1573a0 legacy=0x7f7eac15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaaffd700 1 -- 172.21.15.148:0/822216366 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0cfc20 con 0x7f7eac0cc3b0 2023-09-30T22:52:11.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaa7fc700 1 -- 172.21.15.148:0/822216366 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496199267 0 0) 0x7f7eac0d0550 con 0x7f7eac1573a0 2023-09-30T22:52:11.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eab7fe700 1 --2- 172.21.15.148:0/822216366 >> v2:172.21.15.148:3300/0 conn(0x7f7eac0cbfe0 0x7f7eac15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:11.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.470+0000 7f7eaaffd700 1 --2- 172.21.15.148:0/822216366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac0cc3b0 0x7f7eac0cf210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7eac06cf00 tx=0x7f7ea00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c3b4e724263274 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:11.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eaa7fc700 1 -- 172.21.15.148:0/822216366 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0011630 con 0x7f7eac0cc3b0 2023-09-30T22:52:11.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eaa7fc700 1 -- 172.21.15.148:0/822216366 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0011790 con 0x7f7eac0cc3b0 2023-09-30T22:52:11.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eaa7fc700 1 -- 172.21.15.148:0/822216366 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0011b30 con 0x7f7eac0cc3b0 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 -- 172.21.15.148:0/822216366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac0cc3b0 msgr2=0x7f7eac0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 --2- 172.21.15.148:0/822216366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac0cc3b0 0x7f7eac0cf210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7eac06cf00 tx=0x7f7ea00091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 -- 172.21.15.148:0/822216366 shutdown_connections 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 --2- 172.21.15.148:0/822216366 >> v2:172.21.15.148:3300/0 conn(0x7f7eac0cbfe0 0x7f7eac15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 --2- 172.21.15.148:0/822216366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac0cc3b0 0x7f7eac0cf210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 -- 172.21.15.148:0/822216366 >> 172.21.15.148:0/822216366 conn(0x7f7eac0d0a80 msgr2=0x7f7eac0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 -- 172.21.15.148:0/822216366 shutdown_connections 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.471+0000 7f7eb1bff700 1 -- 172.21.15.148:0/822216366 wait complete. 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.473+0000 7f7eb1bff700 1 Processor -- start 2023-09-30T22:52:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.473+0000 7f7eb1bff700 1 -- start start 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eb1bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eac0cbfe0 0x7f7eac0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eb1bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7eac0cc3b0 0x7f7eac0c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eb1bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac1573a0 0x7f7eac16a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eb1bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0ca640 con 0x7f7eac1573a0 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eb1bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c9a30 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eb1bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c9d10 con 0x7f7eac0cc3b0 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eac0cbfe0 0x7f7eac0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eac0cbfe0 0x7f7eac0caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57484/0 (socket says 172.21.15.148:57484) 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eab7fe700 1 -- 172.21.15.148:0/692757138 learned_addr learned my addr 172.21.15.148:0/692757138 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eaaffd700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7eac0cc3b0 0x7f7eac0c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.474+0000 7f7eabfff700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac1573a0 0x7f7eac16a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eab7fe700 1 -- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7eac0cc3b0 msgr2=0x7f7eac0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eab7fe700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7eac0cc3b0 0x7f7eac0c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eab7fe700 1 -- 172.21.15.148:0/692757138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac1573a0 msgr2=0x7f7eac16a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eab7fe700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac1573a0 0x7f7eac16a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eab7fe700 1 -- 172.21.15.148:0/692757138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0094f0 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eab7fe700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eac0cbfe0 0x7f7eac0caad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00ec50 tx=0x7f7e9c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7e937fe700 1 -- 172.21.15.148:0/692757138 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00c850 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7e937fe700 1 -- 172.21.15.148:0/692757138 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00c9b0 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea0009420 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7e937fe700 1 -- 172.21.15.148:0/692757138 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00cd50 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.475+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac0ca2d0 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.476+0000 7f7e937fe700 1 -- 172.21.15.148:0/692757138 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7e9c005a00 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.476+0000 7f7e937fe700 1 -- 172.21.15.148:0/692757138 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f7e9c013da0 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.476+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac0ca920 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.479+0000 7f7e937fe700 1 -- 172.21.15.148:0/692757138 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f7e9c021060 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.582 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:11.581+0000 7f6594a451c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:52:11.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.587+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f7eac0cfef0 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.591+0000 7f7e937fe700 1 -- 172.21.15.148:0/692757138 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e9c017070 con 0x7f7eac0cbfe0 2023-09-30T22:52:11.593 INFO:teuthology.orchestra.run.smithi148.stdout:3 2023-09-30T22:52:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eac0cbfe0 msgr2=0x7f7eac0caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eac0cbfe0 0x7f7eac0caad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00ec50 tx=0x7f7e9c009250 comp rx=0 tx=0).stop 2023-09-30T22:52:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 shutdown_connections 2023-09-30T22:52:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eac1573a0 0x7f7eac16a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eac0cbfe0 0x7f7eac0caad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 --2- 172.21.15.148:0/692757138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7eac0cc3b0 0x7f7eac0c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 >> 172.21.15.148:0/692757138 conn(0x7f7eac0d0a80 msgr2=0x7f7eac15aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 shutdown_connections 2023-09-30T22:52:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.592+0000 7f7eb1bff700 1 -- 172.21.15.148:0/692757138 wait complete. 2023-09-30T22:52:11.611 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-09-30T22:52:11.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:11.651 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:11.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.803+0000 7fc5ea3ff700 1 Processor -- start 2023-09-30T22:52:11.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.803+0000 7fc5ea3ff700 1 -- start start 2023-09-30T22:52:11.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5ea3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5e4159ba0 0x7fc5e406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5ea3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40b0de0 0x7fc5e40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5ea3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e4067d10 con 0x7fc5e40ca410 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5ea3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e40ca850 con 0x7fc5e4159ba0 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5ea3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e406af90 con 0x7fc5e40b0de0 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5e37fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40b0de0 0x7fc5e40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5e3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5e4159ba0 0x7fc5e406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5e37fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40b0de0 0x7fc5e40c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:52764/0 (socket says 172.21.15.148:52764) 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.805+0000 7fc5e37fe700 1 -- 172.21.15.148:0/2590703630 learned_addr learned my addr 172.21.15.148:0/2590703630 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e37fe700 1 -- 172.21.15.148:0/2590703630 >> v2:172.21.15.142:3300/0 conn(0x7fc5e4159ba0 msgr2=0x7fc5e406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e37fe700 1 --2- 172.21.15.148:0/2590703630 >> v2:172.21.15.142:3300/0 conn(0x7fc5e4159ba0 0x7fc5e406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e37fe700 1 -- 172.21.15.148:0/2590703630 >> v1:172.21.15.142:6789/0 conn(0x7fc5e40ca410 legacy=0x7fc5e415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e37fe700 1 -- 172.21.15.148:0/2590703630 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40676c0 con 0x7fc5e40b0de0 2023-09-30T22:52:11.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e37fe700 1 --2- 172.21.15.148:0/2590703630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40b0de0 0x7fc5e40c9ed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80099b0 tx=0x7fc5d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9777ff5cb05ececc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:11.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e2ffd700 1 -- 172.21.15.148:0/2590703630 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8009ea0 con 0x7fc5e40b0de0 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e2ffd700 1 -- 172.21.15.148:0/2590703630 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800b860 con 0x7fc5e40b0de0 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.806+0000 7fc5e2ffd700 1 -- 172.21.15.148:0/2590703630 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800bc00 con 0x7fc5e40b0de0 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/2590703630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40b0de0 msgr2=0x7fc5e40c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 --2- 172.21.15.148:0/2590703630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40b0de0 0x7fc5e40c9ed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80099b0 tx=0x7fc5d8009250 comp rx=0 tx=0).stop 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/2590703630 shutdown_connections 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 --2- 172.21.15.148:0/2590703630 >> v2:172.21.15.142:3300/0 conn(0x7fc5e4159ba0 0x7fc5e406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 --2- 172.21.15.148:0/2590703630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40b0de0 0x7fc5e40c9ed0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/2590703630 >> 172.21.15.148:0/2590703630 conn(0x7fc5e40cb2f0 msgr2=0x7fc5e40cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:11.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/2590703630 shutdown_connections 2023-09-30T22:52:11.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.807+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/2590703630 wait complete. 2023-09-30T22:52:11.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.809+0000 7fc5ea3ff700 1 Processor -- start 2023-09-30T22:52:11.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.809+0000 7fc5ea3ff700 1 -- start start 2023-09-30T22:52:11.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5ea3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5e40b0de0 0x7fc5e41583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5ea3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40ca410 0x7fc5e40c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5ea3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e4159ba0 0x7fc5e415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:11.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5ea3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40c87c0 con 0x7fc5e4159ba0 2023-09-30T22:52:11.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5ea3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40c5b40 con 0x7fc5e40b0de0 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5ea3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e415ad60 con 0x7fc5e40ca410 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5e3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5e40b0de0 0x7fc5e41583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5e3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5e40b0de0 0x7fc5e41583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57496/0 (socket says 172.21.15.148:57496) 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5e3fff700 1 -- 172.21.15.148:0/1602739224 learned_addr learned my addr 172.21.15.148:0/1602739224 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5e37fe700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40ca410 0x7fc5e40c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.810+0000 7fc5e899c700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e4159ba0 0x7fc5e415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5e3fff700 1 -- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40ca410 msgr2=0x7fc5e40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5e3fff700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40ca410 0x7fc5e40c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5e3fff700 1 -- 172.21.15.148:0/1602739224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e4159ba0 msgr2=0x7fc5e415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5e3fff700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e4159ba0 0x7fc5e415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5e3fff700 1 -- 172.21.15.148:0/1602739224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d80094f0 con 0x7fc5e40b0de0 2023-09-30T22:52:11.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5e3fff700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5e40b0de0 0x7fc5e41583a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400e930 tx=0x7fc5d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:11.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5cbfff700 1 -- 172.21.15.148:0/1602739224 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4013680 con 0x7fc5e40b0de0 2023-09-30T22:52:11.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5cbfff700 1 -- 172.21.15.148:0/1602739224 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40137e0 con 0x7fc5e40b0de0 2023-09-30T22:52:11.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5cbfff700 1 -- 172.21.15.148:0/1602739224 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4013b80 con 0x7fc5e40b0de0 2023-09-30T22:52:11.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e415b040 con 0x7fc5e40b0de0 2023-09-30T22:52:11.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.811+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e40c7fb0 con 0x7fc5e40b0de0 2023-09-30T22:52:11.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.812+0000 7fc5cbfff700 1 -- 172.21.15.148:0/1602739224 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc5d401c6d0 con 0x7fc5e40b0de0 2023-09-30T22:52:11.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.812+0000 7fc5cbfff700 1 -- 172.21.15.148:0/1602739224 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc5d400c510 con 0x7fc5e40b0de0 2023-09-30T22:52:11.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.812+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e40c5e20 con 0x7fc5e40b0de0 2023-09-30T22:52:11.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.815+0000 7fc5cbfff700 1 -- 172.21.15.148:0/1602739224 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fc5d4021060 con 0x7fc5e40b0de0 2023-09-30T22:52:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.899+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fc5e40c5910 con 0x7fc5e40b0de0 2023-09-30T22:52:11.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.904+0000 7fc5cbfff700 1 -- 172.21.15.148:0/1602739224 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5e40c5910 con 0x7fc5e40b0de0 2023-09-30T22:52:11.906 INFO:teuthology.orchestra.run.smithi148.stdout:4 2023-09-30T22:52:11.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5e40b0de0 msgr2=0x7fc5e41583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:11.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5e40b0de0 0x7fc5e41583a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400e930 tx=0x7fc5d40091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 shutdown_connections 2023-09-30T22:52:11.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e4159ba0 0x7fc5e415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5e40b0de0 0x7fc5e41583a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 --2- 172.21.15.148:0/1602739224 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5e40ca410 0x7fc5e40c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 >> 172.21.15.148:0/1602739224 conn(0x7fc5e40cb2f0 msgr2=0x7fc5e40b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 shutdown_connections 2023-09-30T22:52:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:11.905+0000 7fc5ea3ff700 1 -- 172.21.15.148:0/1602739224 wait complete. 2023-09-30T22:52:11.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-09-30T22:52:12.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.153+0000 7f9c51fff700 1 Processor -- start 2023-09-30T22:52:12.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.153+0000 7f9c51fff700 1 -- start start 2023-09-30T22:52:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c51fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c4c157ab0 0x7f9c4c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c51fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9c4c0cc3b0 0x7f9c4c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c51fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0d0550 con 0x7f9c4c0cbfe0 2023-09-30T22:52:12.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c51fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0cf750 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c51fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0cf940 con 0x7f9c4c157ab0 2023-09-30T22:52:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c4affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c4c157ab0 0x7f9c4c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c4affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c4c157ab0 0x7f9c4c15a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57498/0 (socket says 172.21.15.148:57498) 2023-09-30T22:52:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c4affd700 1 -- 172.21.15.148:0/2342768810 learned_addr learned my addr 172.21.15.148:0/2342768810 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.154+0000 7f9c4bfff700 1 --2- 172.21.15.148:0/2342768810 >> v2:172.21.15.142:3300/0 conn(0x7f9c4c0cc3b0 0x7f9c4c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4affd700 1 -- 172.21.15.148:0/2342768810 >> v2:172.21.15.142:3300/0 conn(0x7f9c4c0cc3b0 msgr2=0x7f9c4c0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:12.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4affd700 1 --2- 172.21.15.148:0/2342768810 >> v2:172.21.15.142:3300/0 conn(0x7f9c4c0cc3b0 0x7f9c4c0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4affd700 1 -- 172.21.15.148:0/2342768810 >> v1:172.21.15.142:6789/0 conn(0x7f9c4c0cbfe0 legacy=0x7f9c4c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4affd700 1 -- 172.21.15.148:0/2342768810 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c0cfc20 con 0x7f9c4c157ab0 2023-09-30T22:52:12.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4affd700 1 --2- 172.21.15.148:0/2342768810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c157ab0 0x7f9c4c15a2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0ced20 tx=0x7f9c40009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e606c4c1f7d9ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:12.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4a7fc700 1 -- 172.21.15.148:0/2342768810 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40009e70 con 0x7f9c4c157ab0 2023-09-30T22:52:12.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4a7fc700 1 -- 172.21.15.148:0/2342768810 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000b860 con 0x7f9c4c157ab0 2023-09-30T22:52:12.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.155+0000 7f9c4a7fc700 1 -- 172.21.15.148:0/2342768810 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000bc00 con 0x7f9c4c157ab0 2023-09-30T22:52:12.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 -- 172.21.15.148:0/2342768810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c157ab0 msgr2=0x7f9c4c15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 --2- 172.21.15.148:0/2342768810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c157ab0 0x7f9c4c15a2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0ced20 tx=0x7f9c40009250 comp rx=0 tx=0).stop 2023-09-30T22:52:12.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 -- 172.21.15.148:0/2342768810 shutdown_connections 2023-09-30T22:52:12.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 --2- 172.21.15.148:0/2342768810 >> v2:172.21.15.142:3300/0 conn(0x7f9c4c0cc3b0 0x7f9c4c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 --2- 172.21.15.148:0/2342768810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c157ab0 0x7f9c4c15a2a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 -- 172.21.15.148:0/2342768810 >> 172.21.15.148:0/2342768810 conn(0x7f9c4c0d0a80 msgr2=0x7f9c4c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 -- 172.21.15.148:0/2342768810 shutdown_connections 2023-09-30T22:52:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.156+0000 7f9c51fff700 1 -- 172.21.15.148:0/2342768810 wait complete. 2023-09-30T22:52:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.158+0000 7f9c51fff700 1 Processor -- start 2023-09-30T22:52:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.158+0000 7f9c51fff700 1 -- start start 2023-09-30T22:52:12.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.159+0000 7f9c51fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c4c0cbfe0 0x7f9c4c159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.159+0000 7f9c51fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c0cc3b0 0x7f9c4c144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.159+0000 7f9c51fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c4c157ab0 0x7f9c4c0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c51fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0c5610 con 0x7f9c4c0cbfe0 2023-09-30T22:52:12.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c51fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0c4720 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c51fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0c4a00 con 0x7f9c4c157ab0 2023-09-30T22:52:12.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c0cc3b0 0x7f9c4c144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c0cc3b0 0x7f9c4c144060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57504/0 (socket says 172.21.15.148:57504) 2023-09-30T22:52:12.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 -- 172.21.15.148:0/2522100907 learned_addr learned my addr 172.21.15.148:0/2522100907 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:12.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4b7fe700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c4c0cbfe0 0x7f9c4c159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4bfff700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c4c157ab0 0x7f9c4c0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 -- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c4c157ab0 msgr2=0x7f9c4c0ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c4c157ab0 0x7f9c4c0ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 -- 172.21.15.148:0/2522100907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c4c0cbfe0 msgr2=0x7f9c4c159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c4c0cbfe0 0x7f9c4c159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.160+0000 7f9c4affd700 1 -- 172.21.15.148:0/2522100907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400094f0 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c4affd700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c0cc3b0 0x7f9c4c144060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0cfa80 tx=0x7f9c40017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:12.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c337fe700 1 -- 172.21.15.148:0/2522100907 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000bbe0 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c337fe700 1 -- 172.21.15.148:0/2522100907 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40027450 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c0c4ce0 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c337fe700 1 -- 172.21.15.148:0/2522100907 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40027810 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c0c52a0 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c337fe700 1 -- 172.21.15.148:0/2522100907 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9c4001a430 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.161+0000 7f9c337fe700 1 -- 172.21.15.148:0/2522100907 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f9c40027e40 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.162+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c0c5780 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.164+0000 7f9c337fe700 1 -- 172.21.15.148:0/2522100907 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f9c40015020 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.250+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f9c4c06fc10 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.257+0000 7f9c337fe700 1 -- 172.21.15.148:0/2522100907 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c4001ae60 con 0x7f9c4c0cc3b0 2023-09-30T22:52:12.258 INFO:teuthology.orchestra.run.smithi148.stdout:5 2023-09-30T22:52:12.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c0cc3b0 msgr2=0x7f9c4c144060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c0cc3b0 0x7f9c4c144060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0cfa80 tx=0x7f9c40017000 comp rx=0 tx=0).stop 2023-09-30T22:52:12.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 shutdown_connections 2023-09-30T22:52:12.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c4c157ab0 0x7f9c4c0ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c4c0cbfe0 0x7f9c4c159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 --2- 172.21.15.148:0/2522100907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c4c0cc3b0 0x7f9c4c144060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 >> 172.21.15.148:0/2522100907 conn(0x7f9c4c0d0a80 msgr2=0x7f9c4c06e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:12.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 shutdown_connections 2023-09-30T22:52:12.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.258+0000 7f9c51fff700 1 -- 172.21.15.148:0/2522100907 wait complete. 2023-09-30T22:52:12.276 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-09-30T22:52:12.314 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:12.312+0000 7f07144671c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:52:12.401 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:12.400+0000 7f07144671c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:52:12.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.463+0000 7f2413fff700 1 Processor -- start 2023-09-30T22:52:12.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.463+0000 7f2413fff700 1 -- start start 2023-09-30T22:52:12.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.464+0000 7f2413fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f240c06ab70 0x7f240c0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.464+0000 7f2413fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f2413fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c15b140 con 0x7f240c06a7a0 2023-09-30T22:52:12.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f2413fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c154630 con 0x7f240c06ab70 2023-09-30T22:52:12.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f2413fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0b0090 con 0x7f240c153c70 2023-09-30T22:52:12.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f241259c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f2411d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f240c06a7a0 0x7f240c15b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60270/0 (socket says 172.21.15.148:60270) 2023-09-30T22:52:12.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f2411d9b700 1 -- 172.21.15.148:0/2396002365 learned_addr learned my addr 172.21.15.148:0/2396002365 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-09-30T22:52:12.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f241159a700 1 --2- 172.21.15.148:0/2396002365 >> v2:172.21.15.142:3300/0 conn(0x7f240c06ab70 0x7f240c0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f241259c700 1 -- 172.21.15.148:0/2396002365 >> v2:172.21.15.142:3300/0 conn(0x7f240c06ab70 msgr2=0x7f240c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:12.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f241259c700 1 --2- 172.21.15.148:0/2396002365 >> v2:172.21.15.142:3300/0 conn(0x7f240c06ab70 0x7f240c0b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f241259c700 1 -- 172.21.15.148:0/2396002365 >> v1:172.21.15.148:6789/0 conn(0x7f240c06a7a0 legacy=0x7f240c15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f241259c700 1 -- 172.21.15.148:0/2396002365 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c15a5c0 con 0x7f240c153c70 2023-09-30T22:52:12.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.465+0000 7f2410d99700 1 -- 172.21.15.148:0/2396002365 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593816036 0 0) 0x7f240c15b140 con 0x7f240c06a7a0 2023-09-30T22:52:12.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f241259c700 1 --2- 172.21.15.148:0/2396002365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c1540f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2404009e90 tx=0x7f2404009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b97d6e20cfdb61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2410d99700 1 -- 172.21.15.148:0/2396002365 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400e070 con 0x7f240c153c70 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2410d99700 1 -- 172.21.15.148:0/2396002365 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240400bbf0 con 0x7f240c153c70 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2410d99700 1 -- 172.21.15.148:0/2396002365 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404012430 con 0x7f240c153c70 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2413fff700 1 -- 172.21.15.148:0/2396002365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 msgr2=0x7f240c1540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2413fff700 1 --2- 172.21.15.148:0/2396002365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c1540f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2404009e90 tx=0x7f2404009780 comp rx=0 tx=0).stop 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2413fff700 1 -- 172.21.15.148:0/2396002365 shutdown_connections 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2413fff700 1 --2- 172.21.15.148:0/2396002365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c1540f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.466+0000 7f2413fff700 1 --2- 172.21.15.148:0/2396002365 >> v2:172.21.15.142:3300/0 conn(0x7f240c06ab70 0x7f240c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.467+0000 7f2413fff700 1 -- 172.21.15.148:0/2396002365 >> 172.21.15.148:0/2396002365 conn(0x7f240c0cd790 msgr2=0x7f240c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:12.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.467+0000 7f2413fff700 1 -- 172.21.15.148:0/2396002365 shutdown_connections 2023-09-30T22:52:12.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.467+0000 7f2413fff700 1 -- 172.21.15.148:0/2396002365 wait complete. 2023-09-30T22:52:12.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.468+0000 7f2413fff700 1 Processor -- start 2023-09-30T22:52:12.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.468+0000 7f2413fff700 1 -- start start 2023-09-30T22:52:12.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f2413fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c06a7a0 0x7f240c16a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f2413fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f240c06ab70 0x7f240c1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f2413fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f2413fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0ada30 con 0x7f240c06a7a0 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f2413fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0ad5a0 con 0x7f240c06ab70 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f2413fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c16aa40 con 0x7f240c153c70 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f241159a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f240c06ab70 0x7f240c1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.469+0000 7f241159a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f240c06ab70 0x7f240c1597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57510/0 (socket says 172.21.15.148:57510) 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2411d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c06a7a0 0x7f240c16a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f241159a700 1 -- 172.21.15.148:0/2372332211 learned_addr learned my addr 172.21.15.148:0/2372332211 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f241259c700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2411d9b700 1 -- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 msgr2=0x7f240c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2411d9b700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2411d9b700 1 -- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f240c06ab70 msgr2=0x7f240c1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2411d9b700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f240c06ab70 0x7f240c1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2411d9b700 1 -- 172.21.15.148:0/2372332211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404009a20 con 0x7f240c06a7a0 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f241159a700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f240c06ab70 0x7f240c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2411d9b700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c06a7a0 0x7f240c16a500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f240800c520 tx=0x7f2408007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.470+0000 7f2401ffb700 1 -- 172.21.15.148:0/2372332211 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800ce90 con 0x7f240c06a7a0 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.471+0000 7f2401ffb700 1 -- 172.21.15.148:0/2372332211 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2408005b30 con 0x7f240c06a7a0 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.471+0000 7f2401ffb700 1 -- 172.21.15.148:0/2372332211 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24080070d0 con 0x7f240c06a7a0 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.471+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c159ce0 con 0x7f240c06a7a0 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.471+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c0acc70 con 0x7f240c06a7a0 2023-09-30T22:52:12.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.472+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c0ad880 con 0x7f240c06a7a0 2023-09-30T22:52:12.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.475+0000 7f2401ffb700 1 -- 172.21.15.148:0/2372332211 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f240801c440 con 0x7f240c06a7a0 2023-09-30T22:52:12.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.475+0000 7f2401ffb700 1 -- 172.21.15.148:0/2372332211 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f2408007700 con 0x7f240c06a7a0 2023-09-30T22:52:12.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.477+0000 7f2401ffb700 1 -- 172.21.15.148:0/2372332211 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f2408017070 con 0x7f240c06a7a0 2023-09-30T22:52:12.512 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:12.511+0000 7f6594a451c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:52:12.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.562+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f240c06d350 con 0x7f240c06a7a0 2023-09-30T22:52:12.565 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:12.564+0000 7f07144671c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:52:12.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.569+0000 7f2401ffb700 1 -- 172.21.15.148:0/2372332211 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f240801c6f0 con 0x7f240c06a7a0 2023-09-30T22:52:12.570 INFO:teuthology.orchestra.run.smithi148.stdout:6 2023-09-30T22:52:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c06a7a0 msgr2=0x7f240c16a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c06a7a0 0x7f240c16a500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f240800c520 tx=0x7f2408007f50 comp rx=0 tx=0).stop 2023-09-30T22:52:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 shutdown_connections 2023-09-30T22:52:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f240c153c70 0x7f240c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c06a7a0 0x7f240c16a500 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 --2- 172.21.15.148:0/2372332211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f240c06ab70 0x7f240c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 >> 172.21.15.148:0/2372332211 conn(0x7f240c0cd790 msgr2=0x7f240c067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 shutdown_connections 2023-09-30T22:52:12.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.571+0000 7f2413fff700 1 -- 172.21.15.148:0/2372332211 wait complete. 2023-09-30T22:52:12.588 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-09-30T22:52:12.605 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:12.604+0000 7f6594a451c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:52:12.651 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:12.649+0000 7f07144671c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:52:12.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.772+0000 7f8c499ff700 1 Processor -- start 2023-09-30T22:52:12.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.773+0000 7f8c499ff700 1 -- start start 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c499ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c440b0cc0 0x7f8c440c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c499ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c440b1090 0x7f8c440c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c499ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4406a560 con 0x7f8c440ca410 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c499ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c440b32b0 con 0x7f8c440b0cc0 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c499ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c440ca850 con 0x7f8c440b1090 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c427fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c440b1090 0x7f8c440c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c427fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c440b1090 0x7f8c440c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57526/0 (socket says 172.21.15.148:57526) 2023-09-30T22:52:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c427fc700 1 -- 172.21.15.148:0/1836858965 learned_addr learned my addr 172.21.15.148:0/1836858965 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.774+0000 7f8c42ffd700 1 --2- 172.21.15.148:0/1836858965 >> v2:172.21.15.142:3300/0 conn(0x7f8c440b0cc0 0x7f8c440c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c427fc700 1 -- 172.21.15.148:0/1836858965 >> v2:172.21.15.142:3300/0 conn(0x7f8c440b0cc0 msgr2=0x7f8c440c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c427fc700 1 --2- 172.21.15.148:0/1836858965 >> v2:172.21.15.142:3300/0 conn(0x7f8c440b0cc0 0x7f8c440c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c427fc700 1 -- 172.21.15.148:0/1836858965 >> v1:172.21.15.142:6789/0 conn(0x7f8c440ca410 legacy=0x7f8c4415b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c427fc700 1 -- 172.21.15.148:0/1836858965 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c440cad30 con 0x7f8c440b1090 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c427fc700 1 --2- 172.21.15.148:0/1836858965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c440c9ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8c44070930 tx=0x7f8c38009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25268bfb76f4b9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c41ffb700 1 -- 172.21.15.148:0/1836858965 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38009e70 con 0x7f8c440b1090 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c41ffb700 1 -- 172.21.15.148:0/1836858965 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800b860 con 0x7f8c440b1090 2023-09-30T22:52:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.775+0000 7f8c41ffb700 1 -- 172.21.15.148:0/1836858965 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800bc00 con 0x7f8c440b1090 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 -- 172.21.15.148:0/1836858965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 msgr2=0x7f8c440c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 --2- 172.21.15.148:0/1836858965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c440c9ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8c44070930 tx=0x7f8c38009250 comp rx=0 tx=0).stop 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 -- 172.21.15.148:0/1836858965 shutdown_connections 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 --2- 172.21.15.148:0/1836858965 >> v2:172.21.15.142:3300/0 conn(0x7f8c440b0cc0 0x7f8c440c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 --2- 172.21.15.148:0/1836858965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c440c9ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 -- 172.21.15.148:0/1836858965 >> 172.21.15.148:0/1836858965 conn(0x7f8c440cb2f0 msgr2=0x7f8c440cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 -- 172.21.15.148:0/1836858965 shutdown_connections 2023-09-30T22:52:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.776+0000 7f8c499ff700 1 -- 172.21.15.148:0/1836858965 wait complete. 2023-09-30T22:52:12.780 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:12.777+0000 7f6594a451c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:52:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.777+0000 7f8c499ff700 1 Processor -- start 2023-09-30T22:52:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.777+0000 7f8c499ff700 1 -- start start 2023-09-30T22:52:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.778+0000 7f8c499ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c440b0cc0 0x7f8c4416b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.778+0000 7f8c499ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c44146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.778+0000 7f8c499ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c440ca410 0x7f8c4415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.778+0000 7f8c499ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4416c660 con 0x7f8c440b0cc0 2023-09-30T22:52:12.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.778+0000 7f8c499ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4416b560 con 0x7f8c440b1090 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.778+0000 7f8c499ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4416b770 con 0x7f8c440ca410 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c427fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c44146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c437fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c440ca410 0x7f8c4415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c427fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c44146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57538/0 (socket says 172.21.15.148:57538) 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c427fc700 1 -- 172.21.15.148:0/3740015494 learned_addr learned my addr 172.21.15.148:0/3740015494 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c42ffd700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c440b0cc0 0x7f8c4416b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c42ffd700 1 -- 172.21.15.148:0/3740015494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c440ca410 msgr2=0x7f8c4415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c42ffd700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c440ca410 0x7f8c4415fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c42ffd700 1 -- 172.21.15.148:0/3740015494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 msgr2=0x7f8c44146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c42ffd700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c44146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c42ffd700 1 -- 172.21.15.148:0/3740015494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380094f0 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c427fc700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c44146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.779+0000 7f8c42ffd700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c440b0cc0 0x7f8c4416b020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400ea50 tx=0x7f8c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.780+0000 7f8c2affd700 1 -- 172.21.15.148:0/3740015494 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400ee90 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.780+0000 7f8c2affd700 1 -- 172.21.15.148:0/3740015494 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3400c7f0 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.780+0000 7f8c2affd700 1 -- 172.21.15.148:0/3740015494 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400cb90 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.780+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4416ba50 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.780+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4416c010 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.780+0000 7f8c2affd700 1 -- 172.21.15.148:0/3740015494 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8c34005c80 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.780+0000 7f8c2affd700 1 -- 172.21.15.148:0/3740015494 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f8c34006020 con 0x7f8c440b0cc0 2023-09-30T22:52:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.781+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4406e4b0 con 0x7f8c440b0cc0 2023-09-30T22:52:12.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.783+0000 7f8c2affd700 1 -- 172.21.15.148:0/3740015494 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f8c34021060 con 0x7f8c440b0cc0 2023-09-30T22:52:12.866 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:12.865+0000 7f07144671c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:52:12.866 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:12.865+0000 7f6594a451c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:52:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.867+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f8c440b2450 con 0x7f8c440b0cc0 2023-09-30T22:52:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.875+0000 7f8c2affd700 1 -- 172.21.15.148:0/3740015494 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c34029020 con 0x7f8c440b0cc0 2023-09-30T22:52:12.876 INFO:teuthology.orchestra.run.smithi148.stdout:7 2023-09-30T22:52:12.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c440b0cc0 msgr2=0x7f8c4416b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:12.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c440b0cc0 0x7f8c4416b020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400ea50 tx=0x7f8c340091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 shutdown_connections 2023-09-30T22:52:12.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c440ca410 0x7f8c4415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c440b0cc0 0x7f8c4416b020 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 --2- 172.21.15.148:0/3740015494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c440b1090 0x7f8c44146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:12.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 >> 172.21.15.148:0/3740015494 conn(0x7f8c440cb2f0 msgr2=0x7f8c440cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:12.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 shutdown_connections 2023-09-30T22:52:12.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-09-30T22:52:12.876+0000 7f8c499ff700 1 -- 172.21.15.148:0/3740015494 wait complete. 2023-09-30T22:52:12.893 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:52:12.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:52:12.898 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:52:12.898 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:52:12.898 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:52:12.903 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:52:12.904 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:52:12.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:52:12.910 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:52:12.910 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:52:12.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:52:12.916 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:52:12.916 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-30T22:52:12.916 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-30T22:52:12.938 INFO:tasks.ceph.osd.4:Started 2023-09-30T22:52:12.938 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-30T22:52:12.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-30T22:52:12.944 INFO:tasks.ceph.osd.5:Started 2023-09-30T22:52:12.944 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-30T22:52:12.944 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-30T22:52:12.949 INFO:tasks.ceph.osd.6:Started 2023-09-30T22:52:12.949 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-30T22:52:12.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-30T22:52:12.954 INFO:tasks.ceph.osd.7:Started 2023-09-30T22:52:12.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:12.990 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:12.988+0000 7f07144671c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:52:13.093 INFO:tasks.ceph.osd.1.smithi142.stderr:2023-09-30T22:52:13.092+0000 7f41565bc540 -1 Falling back to public interface 2023-09-30T22:52:13.107 INFO:tasks.ceph.osd.0.smithi142.stderr:2023-09-30T22:52:13.106+0000 7ff757def540 -1 Falling back to public interface 2023-09-30T22:52:13.108 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-09-30T22:52:13.107+0000 7fb976440540 -1 Falling back to public interface 2023-09-30T22:52:13.110 INFO:tasks.ceph.osd.3.smithi142.stderr:2023-09-30T22:52:13.109+0000 7f8fba189540 -1 Falling back to public interface 2023-09-30T22:52:13.114 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-09-30T22:52:13.113+0000 7fd928b89540 -1 Falling back to public interface 2023-09-30T22:52:13.115 INFO:tasks.ceph.osd.2.smithi142.stderr:2023-09-30T22:52:13.114+0000 7f7b8c247540 -1 Falling back to public interface 2023-09-30T22:52:13.116 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:13.115+0000 7f07144671c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T22:52:13.121 INFO:tasks.ceph.osd.1.smithi142.stderr:2023-09-30T22:52:13.120+0000 7f41565bc540 -1 osd.1 0 log_to_monitors true 2023-09-30T22:52:13.121 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-09-30T22:52:13.121+0000 7fb3adc63540 -1 Falling back to public interface 2023-09-30T22:52:13.130 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-09-30T22:52:13.129+0000 7fb976440540 -1 osd.4 0 log_to_monitors true 2023-09-30T22:52:13.133 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:13.133+0000 7f6594a451c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:52:13.139 INFO:tasks.ceph.osd.0.smithi142.stderr:2023-09-30T22:52:13.138+0000 7ff757def540 -1 osd.0 0 log_to_monitors true 2023-09-30T22:52:13.144 INFO:tasks.ceph.osd.3.smithi142.stderr:2023-09-30T22:52:13.143+0000 7f8fba189540 -1 osd.3 0 log_to_monitors true 2023-09-30T22:52:13.146 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-09-30T22:52:13.145+0000 7fd928b89540 -1 osd.5 0 log_to_monitors true 2023-09-30T22:52:13.155 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-09-30T22:52:13.155+0000 7f2762438540 -1 Falling back to public interface 2023-09-30T22:52:13.156 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-09-30T22:52:13.155+0000 7fb3adc63540 -1 osd.6 0 log_to_monitors true 2023-09-30T22:52:13.158 INFO:tasks.ceph.osd.2.smithi142.stderr:2023-09-30T22:52:13.157+0000 7f7b8c247540 -1 osd.2 0 log_to_monitors true 2023-09-30T22:52:13.181 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-09-30T22:52:13.181+0000 7f2762438540 -1 osd.7 0 log_to_monitors true 2023-09-30T22:52:13.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.227+0000 7fefffdff700 1 Processor -- start 2023-09-30T22:52:13.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.227+0000 7fefffdff700 1 -- start start 2023-09-30T22:52:13.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.228+0000 7fefffdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:13.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.228+0000 7fefffdff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80d0550 con 0x7feff80cc3b0 2023-09-30T22:52:13.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.228+0000 7fefffdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80cf940 con 0x7feff8157ab0 2023-09-30T22:52:13.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.228+0000 7fefffdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff80cfc20 con 0x7feff80cbfe0 2023-09-30T22:52:13.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffd39a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7feff80cc3b0 0x7feff81573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43232/0 (socket says 172.21.15.142:43232) 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffd39a700 1 -- 172.21.15.142:0/1741672675 learned_addr learned my addr 172.21.15.142:0/1741672675 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffdb9b700 1 --2- 172.21.15.142:0/1741672675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffcb99700 1 -- 172.21.15.142:0/1741672675 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307757763 0 0) 0x7feff80d0550 con 0x7feff80cc3b0 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffcb99700 1 -- 172.21.15.142:0/1741672675 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe4003570 con 0x7feff80cc3b0 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffcb99700 1 -- 172.21.15.142:0/1741672675 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279263251 0 0) 0x7feff80cf940 con 0x7feff8157ab0 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffcb99700 1 -- 172.21.15.142:0/1741672675 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff80d0550 con 0x7feff8157ab0 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffdb9b700 1 -- 172.21.15.142:0/1741672675 >> v1:172.21.15.148:6789/0 conn(0x7feff8157ab0 legacy=0x7feff806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:13.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffdb9b700 1 -- 172.21.15.142:0/1741672675 >> v1:172.21.15.142:6789/0 conn(0x7feff80cc3b0 legacy=0x7feff81573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:13.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.229+0000 7feffdb9b700 1 -- 172.21.15.142:0/1741672675 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80cff00 con 0x7feff80cbfe0 2023-09-30T22:52:13.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7feffdb9b700 1 --2- 172.21.15.142:0/1741672675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff815a2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feff4009940 tx=0x7feff40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f395b5ca088073 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:13.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7feffcb99700 1 -- 172.21.15.142:0/1741672675 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011630 con 0x7feff80cbfe0 2023-09-30T22:52:13.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7feffcb99700 1 -- 172.21.15.142:0/1741672675 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4011790 con 0x7feff80cbfe0 2023-09-30T22:52:13.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7feffcb99700 1 -- 172.21.15.142:0/1741672675 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011b30 con 0x7feff80cbfe0 2023-09-30T22:52:13.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7fefffdff700 1 -- 172.21.15.142:0/1741672675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 msgr2=0x7feff815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:13.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7fefffdff700 1 --2- 172.21.15.142:0/1741672675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff815a2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feff4009940 tx=0x7feff40091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:13.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7fefffdff700 1 -- 172.21.15.142:0/1741672675 shutdown_connections 2023-09-30T22:52:13.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7fefffdff700 1 --2- 172.21.15.142:0/1741672675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff815a2a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:13.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7fefffdff700 1 -- 172.21.15.142:0/1741672675 >> 172.21.15.142:0/1741672675 conn(0x7feff80d0a80 msgr2=0x7feff80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:13.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7fefffdff700 1 -- 172.21.15.142:0/1741672675 shutdown_connections 2023-09-30T22:52:13.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.230+0000 7fefffdff700 1 -- 172.21.15.142:0/1741672675 wait complete. 2023-09-30T22:52:13.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.232+0000 7fefffdff700 1 Processor -- start 2023-09-30T22:52:13.237 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:13.232+0000 7f07144671c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:52:13.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.232+0000 7fefffdff700 1 -- start start 2023-09-30T22:52:13.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7fefffdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff8153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:13.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7fefffdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff80cc3b0 0x7feff806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:13.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7fefffdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8157ab0 0x7feff80c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:13.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7fefffdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff816ec40 con 0x7feff8157ab0 2023-09-30T22:52:13.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7fefffdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff8152320 con 0x7feff80cc3b0 2023-09-30T22:52:13.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7fefffdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff8153180 con 0x7feff80cbfe0 2023-09-30T22:52:13.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7feffdb9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff8153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:13.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7feffd39a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff80cc3b0 0x7feff806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:13.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7feffe39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8157ab0 0x7feff80c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7feffdb9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff8153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:35186/0 (socket says 172.21.15.142:35186) 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.233+0000 7feffdb9b700 1 -- 172.21.15.142:0/1310048258 learned_addr learned my addr 172.21.15.142:0/1310048258 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7feffdb9b700 1 -- 172.21.15.142:0/1310048258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff80cc3b0 msgr2=0x7feff806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7feffdb9b700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff80cc3b0 0x7feff806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7feffdb9b700 1 -- 172.21.15.142:0/1310048258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8157ab0 msgr2=0x7feff80c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7feffdb9b700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8157ab0 0x7feff80c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7feffdb9b700 1 -- 172.21.15.142:0/1310048258 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4009420 con 0x7feff80cbfe0 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7feffe39c700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8157ab0 0x7feff80c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7feffdb9b700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff8153610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feff4009860 tx=0x7feff4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:13.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7fefedffb700 1 -- 172.21.15.142:0/1310048258 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff401f070 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7fefedffb700 1 -- 172.21.15.142:0/1310048258 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4002f70 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff8152570 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7fefedffb700 1 -- 172.21.15.142:0/1310048258 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4023410 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.234+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff8152b30 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.235+0000 7fefedffb700 1 -- 172.21.15.142:0/1310048258 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feff4023a40 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.235+0000 7fefedffb700 1 -- 172.21.15.142:0/1310048258 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7feff4019a90 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.235+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff8069770 con 0x7feff80cbfe0 2023-09-30T22:52:13.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.238+0000 7fefedffb700 1 -- 172.21.15.142:0/1310048258 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7feff4028070 con 0x7feff80cbfe0 2023-09-30T22:52:13.245 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:13.243+0000 7f6594a451c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:52:13.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.308+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feff806fc10 con 0x7feff80cbfe0 2023-09-30T22:52:13.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.309+0000 7fefedffb700 1 -- 172.21.15.142:0/1310048258 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7feff4015020 con 0x7feff80cbfe0 2023-09-30T22:52:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":10,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:12.869187+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 msgr2=0x7feff8153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff8153610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feff4009860 tx=0x7feff4017000 comp rx=0 tx=0).stop 2023-09-30T22:52:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 shutdown_connections 2023-09-30T22:52:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8157ab0 0x7feff80c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:13.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feff80cbfe0 0x7feff8153610 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:13.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 --2- 172.21.15.142:0/1310048258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff80cc3b0 0x7feff806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:13.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 >> 172.21.15.142:0/1310048258 conn(0x7feff80d0a80 msgr2=0x7feff81555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:13.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 shutdown_connections 2023-09-30T22:52:13.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:13.310+0000 7fefffdff700 1 -- 172.21.15.142:0/1310048258 wait complete. 2023-09-30T22:52:13.329 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T22:52:13.329 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T22:52:13.340 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:13.339+0000 7f6594a451c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T22:52:13.442 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:13.441+0000 7f6594a451c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:52:13.459 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:13.457+0000 7f07144671c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:52:13.559 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:13.557+0000 7f07144671c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:52:13.663 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:13.663+0000 7f6594a451c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:52:13.762 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:13.761+0000 7f6594a451c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:52:13.903 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:13.902+0000 7f07144671c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:52:13.989 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:13.988+0000 7f07144671c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:52:14.107 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:14.106+0000 7f6594a451c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:52:14.134 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:14.194 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:14.194+0000 7f6594a451c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:52:14.305 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.303+0000 7f7de1bff700 1 Processor -- start 2023-09-30T22:52:14.305 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.303+0000 7f7de1bff700 1 -- start start 2023-09-30T22:52:14.307 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7de1bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ddc159980 0x7f7ddc159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:14.307 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7de1bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc06eb70 0x7f7ddc06efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:14.307 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7de1bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc06f510 con 0x7f7ddc0b38d0 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7de1bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc15e6d0 con 0x7f7ddc159980 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7de1bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b0230 con 0x7f7ddc06eb70 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7dd3fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7ddc0b38d0 0x7f7ddc0b62f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43238/0 (socket says 172.21.15.142:43238) 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7dd3fff700 1 -- 172.21.15.142:0/4046181988 learned_addr learned my addr 172.21.15.142:0/4046181988 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7ddbfff700 1 --2- 172.21.15.142:0/4046181988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc06eb70 0x7f7ddc06efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7ddb7fe700 1 --2- 172.21.15.142:0/4046181988 >> v2:172.21.15.148:3300/0 conn(0x7f7ddc159980 0x7f7ddc159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7ddaffd700 1 -- 172.21.15.142:0/4046181988 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480276059 0 0) 0x7f7dc4001110 con 0x7f7ddc0b38d0 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.305+0000 7f7ddaffd700 1 -- 172.21.15.142:0/4046181988 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc8003570 con 0x7f7ddc0b38d0 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddbfff700 1 -- 172.21.15.142:0/4046181988 >> v2:172.21.15.148:3300/0 conn(0x7f7ddc159980 msgr2=0x7f7ddc159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddbfff700 1 --2- 172.21.15.142:0/4046181988 >> v2:172.21.15.148:3300/0 conn(0x7f7ddc159980 0x7f7ddc159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddbfff700 1 -- 172.21.15.142:0/4046181988 >> v1:172.21.15.142:6789/0 conn(0x7f7ddc0b38d0 legacy=0x7f7ddc0b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:14.308 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddbfff700 1 -- 172.21.15.142:0/4046181988 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc15a3a0 con 0x7f7ddc06eb70 2023-09-30T22:52:14.309 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddb7fe700 1 --2- 172.21.15.142:0/4046181988 >> v2:172.21.15.148:3300/0 conn(0x7f7ddc159980 0x7f7ddc159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:14.309 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddbfff700 1 --2- 172.21.15.142:0/4046181988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc06eb70 0x7f7ddc06efd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009e60 tx=0x7f7dd4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c8bddec73271fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:14.309 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddaffd700 1 -- 172.21.15.142:0/4046181988 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400e070 con 0x7f7ddc06eb70 2023-09-30T22:52:14.309 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddaffd700 1 -- 172.21.15.142:0/4046181988 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd400bab0 con 0x7f7ddc06eb70 2023-09-30T22:52:14.309 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.306+0000 7f7ddaffd700 1 -- 172.21.15.142:0/4046181988 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400be70 con 0x7f7ddc06eb70 2023-09-30T22:52:14.310 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 -- 172.21.15.142:0/4046181988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc06eb70 msgr2=0x7f7ddc06efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:14.310 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 --2- 172.21.15.142:0/4046181988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc06eb70 0x7f7ddc06efd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009e60 tx=0x7f7dd4009780 comp rx=0 tx=0).stop 2023-09-30T22:52:14.310 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 -- 172.21.15.142:0/4046181988 shutdown_connections 2023-09-30T22:52:14.310 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 --2- 172.21.15.142:0/4046181988 >> v2:172.21.15.148:3300/0 conn(0x7f7ddc159980 0x7f7ddc159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.311 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 --2- 172.21.15.142:0/4046181988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc06eb70 0x7f7ddc06efd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.311 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 -- 172.21.15.142:0/4046181988 >> 172.21.15.142:0/4046181988 conn(0x7f7ddc0d0a20 msgr2=0x7f7ddc0d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:14.311 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 -- 172.21.15.142:0/4046181988 shutdown_connections 2023-09-30T22:52:14.311 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.307+0000 7f7de1bff700 1 -- 172.21.15.142:0/4046181988 wait complete. 2023-09-30T22:52:14.311 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.309+0000 7f7de1bff700 1 Processor -- start 2023-09-30T22:52:14.311 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.309+0000 7f7de1bff700 1 -- start start 2023-09-30T22:52:14.312 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.310+0000 7f7de1bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ddc06eb70 0x7f7ddc149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:14.312 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.310+0000 7f7de1bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc0b38d0 0x7f7ddc14b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.310+0000 7f7de1bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc159980 0x7f7ddc14b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.310+0000 7f7de1bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc14f670 con 0x7f7ddc0b38d0 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.310+0000 7f7de1bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc150e30 con 0x7f7ddc06eb70 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.310+0000 7f7de1bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b29a0 con 0x7f7ddc159980 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7dd3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc0b38d0 0x7f7ddc14b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddbfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc159980 0x7f7ddc14b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ddc06eb70 0x7f7ddc149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ddc06eb70 0x7f7ddc149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:42774/0 (socket says 172.21.15.142:42774) 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 -- 172.21.15.142:0/762136598 learned_addr learned my addr 172.21.15.142:0/762136598 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddbfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc159980 0x7f7ddc14b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:35214/0 (socket says 172.21.15.142:35214) 2023-09-30T22:52:14.313 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 -- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc159980 msgr2=0x7f7ddc14b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:14.314 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc159980 0x7f7ddc14b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.314 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 -- 172.21.15.142:0/762136598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc0b38d0 msgr2=0x7f7ddc14b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:14.314 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc0b38d0 0x7f7ddc14b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.314 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 -- 172.21.15.142:0/762136598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc009420 con 0x7f7ddc06eb70 2023-09-30T22:52:14.314 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7dd3fff700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc0b38d0 0x7f7ddc14b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:14.314 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddbfff700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc159980 0x7f7ddc14b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:14.314 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.311+0000 7f7ddb7fe700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ddc06eb70 0x7f7ddc149770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00ec80 tx=0x7f7dcc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:14.315 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.312+0000 7f7dd37fe700 1 -- 172.21.15.142:0/762136598 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00c920 con 0x7f7ddc06eb70 2023-09-30T22:52:14.315 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.312+0000 7f7dd37fe700 1 -- 172.21.15.142:0/762136598 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00ca80 con 0x7f7ddc06eb70 2023-09-30T22:52:14.315 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.312+0000 7f7dd37fe700 1 -- 172.21.15.142:0/762136598 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00ce00 con 0x7f7ddc06eb70 2023-09-30T22:52:14.315 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.312+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd4009a20 con 0x7f7ddc06eb70 2023-09-30T22:52:14.315 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.312+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc1507e0 con 0x7f7ddc06eb70 2023-09-30T22:52:14.315 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.312+0000 7f7dd37fe700 1 -- 172.21.15.142:0/762136598 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7dcc005c80 con 0x7f7ddc06eb70 2023-09-30T22:52:14.316 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.312+0000 7f7dd37fe700 1 -- 172.21.15.142:0/762136598 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7f7dcc013d60 con 0x7f7ddc06eb70 2023-09-30T22:52:14.316 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.313+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc0697f0 con 0x7f7ddc06eb70 2023-09-30T22:52:14.317 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.316+0000 7f7dd37fe700 1 -- 172.21.15.142:0/762136598 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f7dcc021060 con 0x7f7ddc06eb70 2023-09-30T22:52:14.389 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.387+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ddc04bb40 con 0x7f7ddc06eb70 2023-09-30T22:52:14.389 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.388+0000 7f7dd37fe700 1 -- 172.21.15.142:0/762136598 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f7dcc029020 con 0x7f7ddc06eb70 2023-09-30T22:52:14.390 INFO:teuthology.misc.health.smithi142.stdout: 2023-09-30T22:52:14.390 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":11,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:13.872466+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:14.394 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.389+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ddc06eb70 msgr2=0x7f7ddc149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.389+0000 7f7de1bff700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ddc06eb70 0x7f7ddc149770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00ec80 tx=0x7f7dcc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.389+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 shutdown_connections 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.389+0000 7f7de1bff700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ddc159980 0x7f7ddc14b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.389+0000 7f7de1bff700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ddc06eb70 0x7f7ddc149770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.389+0000 7f7de1bff700 1 --2- 172.21.15.142:0/762136598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc0b38d0 0x7f7ddc14b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.389+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 >> 172.21.15.142:0/762136598 conn(0x7f7ddc0d0a20 msgr2=0x7f7ddc157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.390+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 shutdown_connections 2023-09-30T22:52:14.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:14.390+0000 7f7de1bff700 1 -- 172.21.15.142:0/762136598 wait complete. 2023-09-30T22:52:14.405 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-30T22:52:14.606 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:14.605+0000 7f07144671c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:52:14.806 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:14.802+0000 7f6594a451c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:52:14.908 INFO:tasks.ceph.osd.3.smithi142.stderr:2023-09-30T22:52:14.907+0000 7f8fae3f7700 -1 osd.3 0 waiting for initial osdmap 2023-09-30T22:52:14.909 INFO:tasks.ceph.osd.1.smithi142.stderr:2023-09-30T22:52:14.908+0000 7f414aff8700 -1 osd.1 0 waiting for initial osdmap 2023-09-30T22:52:14.911 INFO:tasks.ceph.osd.3.smithi142.stderr:2023-09-30T22:52:14.910+0000 7f8fa83eb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.911 INFO:tasks.ceph.osd.1.smithi142.stderr:2023-09-30T22:52:14.910+0000 7f41447eb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.925 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-09-30T22:52:14.925+0000 7fb3a1ff7700 -1 osd.6 0 waiting for initial osdmap 2023-09-30T22:52:14.926 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-09-30T22:52:14.925+0000 7f27567f7700 -1 osd.7 0 waiting for initial osdmap 2023-09-30T22:52:14.926 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-09-30T22:52:14.926+0000 7fb96a7f7700 -1 osd.4 0 waiting for initial osdmap 2023-09-30T22:52:14.927 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-09-30T22:52:14.926+0000 7fd91cdf7700 -1 osd.5 0 waiting for initial osdmap 2023-09-30T22:52:14.927 INFO:tasks.ceph.osd.2.smithi142.stderr:2023-09-30T22:52:14.925+0000 7f7b805f7700 -1 osd.2 0 waiting for initial osdmap 2023-09-30T22:52:14.927 INFO:tasks.ceph.osd.0.smithi142.stderr:2023-09-30T22:52:14.925+0000 7ff74bff7700 -1 osd.0 0 waiting for initial osdmap 2023-09-30T22:52:14.928 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-09-30T22:52:14.928+0000 7fb39bfeb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.929 INFO:tasks.ceph.osd.0.smithi142.stderr:2023-09-30T22:52:14.927+0000 7ff745feb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.929 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-09-30T22:52:14.928+0000 7f27507eb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.929 INFO:tasks.ceph.osd.2.smithi142.stderr:2023-09-30T22:52:14.927+0000 7f7b7a5eb700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.929 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-09-30T22:52:14.928+0000 7fb9647eb700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.930 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-09-30T22:52:14.928+0000 7fd916deb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:52:14.988 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:14.987+0000 7f07144671c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:52:15.161 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:15.160+0000 7f07144671c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:52:15.192 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:15.191+0000 7f6594a451c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:52:15.366 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:15.365+0000 7f6594a451c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:52:15.590 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:15.589+0000 7f07144671c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:52:15.769 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:15.767+0000 7f07144671c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:52:15.797 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:15.797+0000 7f6594a451c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:52:15.963 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:15.961+0000 7f07144671c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T22:52:15.984 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:15.983+0000 7f6594a451c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:52:16.086 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:16.085+0000 7f07144671c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:52:16.179 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:16.179+0000 7f6594a451c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T22:52:16.304 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-09-30T22:52:16.304+0000 7f6594a451c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:52:17.109 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:17.108+0000 7f06d37fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:52:17.110 INFO:tasks.ceph.mgr.y.smithi142.stderr:2023-09-30T22:52:17.108+0000 7f06d37fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:52:21.210 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:21.386 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.385+0000 7ff2ad7ff700 1 Processor -- start 2023-09-30T22:52:21.387 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.386+0000 7ff2ad7ff700 1 -- start start 2023-09-30T22:52:21.389 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2ad7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.389 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2ad7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2a80b38d0 0x7ff2a80b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2ad7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80b6830 con 0x7ff2a806eb70 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2ad7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a815e6d0 con 0x7ff2a80b38d0 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2ad7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b0230 con 0x7ff2a8159980 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2a67fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2a80b38d0 0x7ff2a80b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2a67fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2a80b38d0 0x7ff2a80b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54060/0 (socket says 172.21.15.142:54060) 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2a67fc700 1 -- 172.21.15.142:0/2990257348 learned_addr learned my addr 172.21.15.142:0/2990257348 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2a77fe700 1 --1- 172.21.15.142:0/2990257348 >> v1:172.21.15.142:6789/0 conn(0x7ff2a806eb70 0x7ff2a806a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45444/0 (socket says 172.21.15.142:45444) 2023-09-30T22:52:21.390 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.387+0000 7ff2a6ffd700 1 --2- 172.21.15.142:0/2990257348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a67fc700 1 -- 172.21.15.142:0/2990257348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 msgr2=0x7ff2a8159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a67fc700 1 --2- 172.21.15.142:0/2990257348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a8159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a67fc700 1 -- 172.21.15.142:0/2990257348 >> v1:172.21.15.142:6789/0 conn(0x7ff2a806eb70 legacy=0x7ff2a806a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a67fc700 1 -- 172.21.15.142:0/2990257348 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a815a3a0 con 0x7ff2a80b38d0 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a6ffd700 1 --2- 172.21.15.142:0/2990257348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a8159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a5ffb700 1 -- 172.21.15.142:0/2990257348 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255545548 0 0) 0x7ff2a80b6830 con 0x7ff2a806eb70 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a67fc700 1 --2- 172.21.15.142:0/2990257348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a80b38d0 0x7ff2a80b62f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0099b0 tx=0x7ff29c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923cdb53e9d5c3d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:21.391 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a5ffb700 1 -- 172.21.15.142:0/2990257348 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00b860 con 0x7ff2a80b38d0 2023-09-30T22:52:21.392 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a5ffb700 1 -- 172.21.15.142:0/2990257348 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00b9c0 con 0x7ff2a80b38d0 2023-09-30T22:52:21.392 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.388+0000 7ff2a5ffb700 1 -- 172.21.15.142:0/2990257348 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00bd60 con 0x7ff2a80b38d0 2023-09-30T22:52:21.392 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/2990257348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a80b38d0 msgr2=0x7ff2a80b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.392 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/2990257348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a80b38d0 0x7ff2a80b62f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0099b0 tx=0x7ff29c009250 comp rx=0 tx=0).stop 2023-09-30T22:52:21.392 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/2990257348 shutdown_connections 2023-09-30T22:52:21.392 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/2990257348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a8159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.393 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/2990257348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a80b38d0 0x7ff2a80b62f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.393 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/2990257348 >> 172.21.15.142:0/2990257348 conn(0x7ff2a80d0a20 msgr2=0x7ff2a80d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:21.393 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/2990257348 shutdown_connections 2023-09-30T22:52:21.393 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.389+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/2990257348 wait complete. 2023-09-30T22:52:21.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.391+0000 7ff2ad7ff700 1 Processor -- start 2023-09-30T22:52:21.395 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.391+0000 7ff2ad7ff700 1 -- start start 2023-09-30T22:52:21.396 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.392+0000 7ff2ad7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a806eb70 0x7ff2a80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.396 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.392+0000 7ff2ad7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a80b38d0 0x7ff2a80b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.396 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.392+0000 7ff2ad7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.396 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.392+0000 7ff2ad7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a814f3d0 con 0x7ff2a806eb70 2023-09-30T22:52:21.396 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.392+0000 7ff2ad7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b0eb0 con 0x7ff2a80b38d0 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.392+0000 7ff2ad7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a814fcd0 con 0x7ff2a8159980 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a806eb70 0x7ff2a80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a806eb70 0x7ff2a80b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54066/0 (socket says 172.21.15.142:54066) 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 -- 172.21.15.142:0/3419584985 learned_addr learned my addr 172.21.15.142:0/3419584985 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a77fe700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 -- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 msgr2=0x7ff2a814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a67fc700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a80b38d0 0x7ff2a80b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.399 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 -- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a80b38d0 msgr2=0x7ff2a80b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a80b38d0 0x7ff2a80b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 -- 172.21.15.142:0/3419584985 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0094f0 con 0x7ff2a806eb70 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a77fe700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff2a6ffd700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a806eb70 0x7ff2a80b2cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff29800e900 tx=0x7ff298008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.393+0000 7ff28effd700 1 -- 172.21.15.142:0/3419584985 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800eea0 con 0x7ff2a806eb70 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.394+0000 7ff28effd700 1 -- 172.21.15.142:0/3419584985 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29800c5e0 con 0x7ff2a806eb70 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.394+0000 7ff28effd700 1 -- 172.21.15.142:0/3419584985 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800c980 con 0x7ff2a806eb70 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.394+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a80b0580 con 0x7ff2a806eb70 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.394+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a80b0b40 con 0x7ff2a806eb70 2023-09-30T22:52:21.400 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.395+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a80b1190 con 0x7ff2a806eb70 2023-09-30T22:52:21.401 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.396+0000 7ff28effd700 1 -- 172.21.15.142:0/3419584985 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff29800cd30 con 0x7ff2a806eb70 2023-09-30T22:52:21.401 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.397+0000 7ff28effd700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff294067330 0x7ff2940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.401 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.397+0000 7ff28effd700 1 -- 172.21.15.142:0/3419584985 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff2980845e0 con 0x7ff2a806eb70 2023-09-30T22:52:21.402 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.397+0000 7ff2a67fc700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff294067330 0x7ff2940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.402 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.398+0000 7ff2a67fc700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff294067330 0x7ff2940697e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0099b0 tx=0x7ff29c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:21.402 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.402+0000 7ff28effd700 1 -- 172.21.15.142:0/3419584985 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff298055380 con 0x7ff2a806eb70 2023-09-30T22:52:21.591 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.590+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2a815aba0 con 0x7ff2a806eb70 2023-09-30T22:52:21.592 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.591+0000 7ff28effd700 1 -- 172.21.15.142:0/3419584985 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12271 (secure 0 0 0) 0x7ff298054f10 con 0x7ff2a806eb70 2023-09-30T22:52:21.592 INFO:teuthology.misc.health.smithi142.stdout: 2023-09-30T22:52:21.592 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":16,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:18.915285+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:21.594 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.593+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff294067330 msgr2=0x7ff2940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.594 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.593+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff294067330 0x7ff2940697e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0099b0 tx=0x7ff29c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:21.594 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.593+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a806eb70 msgr2=0x7ff2a80b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.593+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a806eb70 0x7ff2a80b2cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff29800e900 tx=0x7ff298008040 comp rx=0 tx=0).stop 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 shutdown_connections 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff294067330 0x7ff2940697e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2a8159980 0x7ff2a814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a806eb70 0x7ff2a80b2cd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 --2- 172.21.15.142:0/3419584985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a80b38d0 0x7ff2a80b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 >> 172.21.15.142:0/3419584985 conn(0x7ff2a80d0a20 msgr2=0x7ff2a814adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 shutdown_connections 2023-09-30T22:52:21.595 INFO:teuthology.misc.health.smithi142.stderr:2023-09-30T22:52:21.594+0000 7ff2ad7ff700 1 -- 172.21.15.142:0/3419584985 wait complete. 2023-09-30T22:52:21.609 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-30T22:52:21.609 INFO:tasks.ceph:Creating RBD pool 2023-09-30T22:52:21.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-30T22:52:21.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.792+0000 7f1c1c5ff700 1 Processor -- start 2023-09-30T22:52:21.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.792+0000 7f1c1c5ff700 1 -- start start 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.793+0000 7f1c1c5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1c140cbfe0 0x7f1c1415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.793+0000 7f1c1c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c140cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.793+0000 7f1c1c5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140d0550 con 0x7f1c141573a0 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.793+0000 7f1c1c5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c140cf750 con 0x7f1c140cbfe0 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.793+0000 7f1c1c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140cf940 con 0x7f1c140cc3b0 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c1ab9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1c141573a0 0x7f1c1415d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45452/0 (socket says 172.21.15.142:45452) 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c1ab9c700 1 -- 172.21.15.142:0/3704248721 learned_addr learned my addr 172.21.15.142:0/3704248721 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/3704248721 >> v2:172.21.15.148:3300/0 conn(0x7f1c140cbfe0 0x7f1c1415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19b9a700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c140cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704438705 0 0) 0x7f1c140d0550 con 0x7f1c141573a0 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c00003570 con 0x7f1c141573a0 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 455256052 0 0) 0x7f1c00003570 con 0x7f1c141573a0 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 msgr2=0x7f1c140cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c140cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 >> v2:172.21.15.148:3300/0 conn(0x7f1c140cbfe0 msgr2=0x7f1c1415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 --2- 172.21.15.142:0/3704248721 >> v2:172.21.15.148:3300/0 conn(0x7f1c140cbfe0 0x7f1c1415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140cfc20 con 0x7f1c141573a0 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f1c0c0017f0 con 0x7f1c141573a0 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c19b9a700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c140cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.794+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/3704248721 >> v2:172.21.15.148:3300/0 conn(0x7f1c140cbfe0 0x7f1c1415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 >> v1:172.21.15.142:6789/0 conn(0x7f1c141573a0 legacy=0x7f1c1415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19399700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c00003ae0 0x7f1c00003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19399700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19399700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c00004d50 0x7f1c000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140cf940 con 0x7f1c00003ae0 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0000ba60 con 0x7f1c00004d50 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0000bbf0 con 0x7f1c140cc3b0 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c00003ae0 0x7f1c00003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19b9a700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1ab9c700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c00004d50 0x7f1c000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1a39b700 1 -- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 msgr2=0x7f1c00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c00004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1a39b700 1 -- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c00004d50 msgr2=0x7f1c000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:21.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c00004d50 0x7f1c000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1a39b700 1 -- 172.21.15.142:0/3704248721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04009420 con 0x7f1c00003ae0 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c19b9a700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c140cc3b0 0x7f1c00004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.795+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c00003ae0 0x7f1c00003ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009df0 tx=0x7f1c100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bd5575f7776231 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000e920 con 0x7f1c00003ae0 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1000ea80 con 0x7f1c00003ae0 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c19399700 1 -- 172.21.15.142:0/3704248721 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000ee20 con 0x7f1c00003ae0 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/3704248721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c00003ae0 msgr2=0x7f1c00003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c1c5ff700 1 --2- 172.21.15.142:0/3704248721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c00003ae0 0x7f1c00003ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009df0 tx=0x7f1c100091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c1ab9c700 1 -- 172.21.15.142:0/3704248721 reap_dead start 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/3704248721 shutdown_connections 2023-09-30T22:52:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/3704248721 >> 172.21.15.142:0/3704248721 conn(0x7f1c140d0a80 msgr2=0x7f1c140d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:21.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/3704248721 shutdown_connections 2023-09-30T22:52:21.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.796+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/3704248721 wait complete. 2023-09-30T22:52:21.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.798+0000 7f1c1c5ff700 1 Processor -- start 2023-09-30T22:52:21.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.798+0000 7f1c1c5ff700 1 -- start start 2023-09-30T22:52:21.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c00003ae0 0x7f1c1414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1c5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c14158bb0 0x7f1c14159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1c5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c140c5840 0x7f1c140c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1c5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c61f0 con 0x7f1c140c5840 2023-09-30T22:52:21.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1c5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c5270 con 0x7f1c14158bb0 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c4660 con 0x7f1c00003ae0 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c00003ae0 0x7f1c1414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1ab9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c140c5840 0x7f1c140c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c00003ae0 0x7f1c1414f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:36170/0 (socket says 172.21.15.142:36170) 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 -- 172.21.15.142:0/117958653 learned_addr learned my addr 172.21.15.142:0/117958653 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c19b9a700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c14158bb0 0x7f1c14159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 -- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c14158bb0 msgr2=0x7f1c14159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c14158bb0 0x7f1c14159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 -- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c140c5840 msgr2=0x7f1c140c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c140c5840 0x7f1c140c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1a39b700 1 -- 172.21.15.142:0/117958653 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140c4940 con 0x7f1c00003ae0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.799+0000 7f1c1ab9c700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c140c5840 0x7f1c140c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.800+0000 7f1c1a39b700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c00003ae0 0x7f1c1414f9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e790 tx=0x7f1c1001a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.800+0000 7f1c0a7fc700 1 -- 172.21.15.142:0/117958653 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10022070 con 0x7f1c00003ae0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.800+0000 7f1c0a7fc700 1 -- 172.21.15.142:0/117958653 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10013bb0 con 0x7f1c00003ae0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.800+0000 7f1c0a7fc700 1 -- 172.21.15.142:0/117958653 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1001c450 con 0x7f1c00003ae0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.800+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c140c4c20 con 0x7f1c00003ae0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.800+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c14159cc0 con 0x7f1c00003ae0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.801+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140c50c0 con 0x7f1c00003ae0 2023-09-30T22:52:21.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.802+0000 7f1c0a7fc700 1 -- 172.21.15.142:0/117958653 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1c10026070 con 0x7f1c00003ae0 2023-09-30T22:52:21.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.803+0000 7f1c0a7fc700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bf8067330 0x7f1bf80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:21.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.803+0000 7f1c0a7fc700 1 -- 172.21.15.142:0/117958653 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1c10085ea0 con 0x7f1c00003ae0 2023-09-30T22:52:21.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.803+0000 7f1c19b9a700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bf8067330 0x7f1bf80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:21.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.804+0000 7f1c19b9a700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bf8067330 0x7f1bf80697e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c04014350 tx=0x7f1c04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:21.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:21.809+0000 7f1c0a7fc700 1 -- 172.21.15.142:0/117958653 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1c100532b0 con 0x7f1c00003ae0 2023-09-30T22:52:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.000+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1c1415a6d0 con 0x7f1c00003ae0 2023-09-30T22:52:22.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.944+0000 7f1c0a7fc700 1 -- 172.21.15.142:0/117958653 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1c1415a6d0 con 0x7f1c00003ae0 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bf8067330 msgr2=0x7f1bf80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bf8067330 0x7f1bf80697e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c04014350 tx=0x7f1c04008040 comp rx=0 tx=0).stop 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c00003ae0 msgr2=0x7f1c1414f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c00003ae0 0x7f1c1414f9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e790 tx=0x7f1c1001a000 comp rx=0 tx=0).stop 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 shutdown_connections 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bf8067330 0x7f1bf80697e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c140c5840 0x7f1c140c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c00003ae0 0x7f1c1414f9c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 --2- 172.21.15.142:0/117958653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c14158bb0 0x7f1c14159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 >> 172.21.15.142:0/117958653 conn(0x7f1c140d0a80 msgr2=0x7f1c1406d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 shutdown_connections 2023-09-30T22:52:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:22.947+0000 7f1c1c5ff700 1 -- 172.21.15.142:0/117958653 wait complete. 2023-09-30T22:52:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'rbd' created 2023-09-30T22:52:22.966 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-30T22:52:23.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.152+0000 7f0d16fff700 1 Processor -- start 2023-09-30T22:52:23.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.152+0000 7f0d16fff700 1 -- start start 2023-09-30T22:52:23.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d16fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d1015ac40 0x7f0d1015a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:23.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d16fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d100cf180 0x7f0d100cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:23.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d16fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d100cc0b0 0x7f0d1015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:23.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d16fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d100d04e0 con 0x7f0d100cf180 2023-09-30T22:52:23.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d16fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d100cc4d0 con 0x7f0d1015ac40 2023-09-30T22:52:23.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d16fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100cc8f0 con 0x7f0d100cc0b0 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d0ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d100cf180 0x7f0d100cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d14d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d1015ac40 0x7f0d1015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d0ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d100cf180 0x7f0d100cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54086/0 (socket says 172.21.15.142:54086) 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d14d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d1015ac40 0x7f0d1015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:41778/0 (socket says 172.21.15.142:41778) 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d0ffff700 1 -- 172.21.15.142:0/628656967 learned_addr learned my addr 172.21.15.142:0/628656967 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.154+0000 7f0d1559c700 1 --2- 172.21.15.142:0/628656967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d100cc0b0 0x7f0d1015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0ffff700 1 -- 172.21.15.142:0/628656967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d100cc0b0 msgr2=0x7f0d1015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0ffff700 1 --2- 172.21.15.142:0/628656967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d100cc0b0 0x7f0d1015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0ffff700 1 -- 172.21.15.142:0/628656967 >> v2:172.21.15.148:3300/0 conn(0x7f0d1015ac40 msgr2=0x7f0d1015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0ffff700 1 --2- 172.21.15.142:0/628656967 >> v2:172.21.15.148:3300/0 conn(0x7f0d1015ac40 0x7f0d1015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0ffff700 1 -- 172.21.15.142:0/628656967 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100cf8d0 con 0x7f0d100cf180 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0ffff700 1 --2- 172.21.15.142:0/628656967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d100cbb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d100d1b30 tx=0x7f0cfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76a5e3132f5fc43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0f7fe700 1 -- 172.21.15.142:0/628656967 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00b640 con 0x7f0d100cf180 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0f7fe700 1 -- 172.21.15.142:0/628656967 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00b7a0 con 0x7f0d100cf180 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.155+0000 7f0d0f7fe700 1 -- 172.21.15.142:0/628656967 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00bb60 con 0x7f0d100cf180 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 -- 172.21.15.142:0/628656967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 msgr2=0x7f0d100cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 --2- 172.21.15.142:0/628656967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d100cbb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d100d1b30 tx=0x7f0cfc009250 comp rx=0 tx=0).stop 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 -- 172.21.15.142:0/628656967 shutdown_connections 2023-09-30T22:52:23.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 --2- 172.21.15.142:0/628656967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d100cc0b0 0x7f0d1015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 --2- 172.21.15.142:0/628656967 >> v2:172.21.15.148:3300/0 conn(0x7f0d1015ac40 0x7f0d1015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 --2- 172.21.15.142:0/628656967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d100cbb70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 -- 172.21.15.142:0/628656967 >> 172.21.15.142:0/628656967 conn(0x7f0d100d0a80 msgr2=0x7f0d100d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:23.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 -- 172.21.15.142:0/628656967 shutdown_connections 2023-09-30T22:52:23.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.156+0000 7f0d16fff700 1 -- 172.21.15.142:0/628656967 wait complete. 2023-09-30T22:52:23.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.157+0000 7f0d16fff700 1 Processor -- start 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.157+0000 7f0d16fff700 1 -- start start 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.158+0000 7f0d16fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d100cc0b0 0x7f0d10148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.158+0000 7f0d16fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d1015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.158+0000 7f0d16fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d1015ac40 0x7f0d1015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.158+0000 7f0d16fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d101490f0 con 0x7f0d100cf180 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.158+0000 7f0d16fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1016a890 con 0x7f0d100cc0b0 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.158+0000 7f0d16fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1015c800 con 0x7f0d1015ac40 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.158+0000 7f0d0ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d1015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d1015b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54094/0 (socket says 172.21.15.142:54094) 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 -- 172.21.15.142:0/1693352767 learned_addr learned my addr 172.21.15.142:0/1693352767 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:23.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 -- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d1015ac40 msgr2=0x7f0d1015b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d1015ac40 0x7f0d1015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 -- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d100cc0b0 msgr2=0x7f0d10148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d14d9b700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d100cc0b0 0x7f0d10148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d100cc0b0 0x7f0d10148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 -- 172.21.15.142:0/1693352767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0094f0 con 0x7f0d100cf180 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d14d9b700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d100cc0b0 0x7f0d10148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0ffff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d1015b010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc006fd0 tx=0x7f0cfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0cff9700 1 -- 172.21.15.142:0/1693352767 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc000d10 con 0x7f0d100cf180 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0cff9700 1 -- 172.21.15.142:0/1693352767 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00bb20 con 0x7f0d100cf180 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1015cc90 con 0x7f0d100cf180 2023-09-30T22:52:23.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.159+0000 7f0d0cff9700 1 -- 172.21.15.142:0/1693352767 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc011670 con 0x7f0d100cf180 2023-09-30T22:52:23.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.160+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1015bed0 con 0x7f0d100cf180 2023-09-30T22:52:23.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.161+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d100d1930 con 0x7f0d100cf180 2023-09-30T22:52:23.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.162+0000 7f0d0cff9700 1 -- 172.21.15.142:0/1693352767 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0cfc0119e0 con 0x7f0d100cf180 2023-09-30T22:52:23.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.163+0000 7f0d0cff9700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0cf4067330 0x7f0cf40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:23.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.163+0000 7f0d0cff9700 1 -- 172.21.15.142:0/1693352767 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f0cfc086170 con 0x7f0d100cf180 2023-09-30T22:52:23.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.163+0000 7f0d14d9b700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0cf4067330 0x7f0cf40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:23.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.164+0000 7f0d14d9b700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0cf4067330 0x7f0cf40697e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0d04006f00 tx=0x7f0d04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:23.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.168+0000 7f0d0cff9700 1 -- 172.21.15.142:0/1693352767 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0cfc053330 con 0x7f0d100cf180 2023-09-30T22:52:23.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.358+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0d1015c940 con 0x7f0d100cf180 2023-09-30T22:52:23.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.944+0000 7f0d0cff9700 1 -- 172.21.15.142:0/1693352767 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0cfc056950 con 0x7f0d100cf180 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0cf4067330 msgr2=0x7f0cf40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0cf4067330 0x7f0cf40697e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0d04006f00 tx=0x7f0d04008040 comp rx=0 tx=0).stop 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 msgr2=0x7f0d1015b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d1015b010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc006fd0 tx=0x7f0cfc017000 comp rx=0 tx=0).stop 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 shutdown_connections 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0cf4067330 0x7f0cf40697e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d1015ac40 0x7f0d1015b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d100cc0b0 0x7f0d10148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 --2- 172.21.15.142:0/1693352767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d100cf180 0x7f0d1015b010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.947+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 >> 172.21.15.142:0/1693352767 conn(0x7f0d100d0a80 msgr2=0x7f0d1006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.948+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 shutdown_connections 2023-09-30T22:52:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:23.948+0000 7f0d16fff700 1 -- 172.21.15.142:0/1693352767 wait complete. 2023-09-30T22:52:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-30T22:52:23.966 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T22:52:23.967 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:52:23.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:52:23.971 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:52:23.972 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:52:23.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:52:23.976 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:52:23.976 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:52:23.976 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:52:23.981 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:52:23.981 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:52:23.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:52:23.987 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:52:23.988 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T22:52:23.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:24.117 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:52:24.118 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:52:24.134 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:52:24.135 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:52:24.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.192+0000 7ff3939ff700 1 Processor -- start 2023-09-30T22:52:24.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.193+0000 7ff3939ff700 1 -- start start 2023-09-30T22:52:24.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.194+0000 7ff3939ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff38c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.194+0000 7ff3939ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c0d0550 con 0x7ff38c0cbfe0 2023-09-30T22:52:24.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.194+0000 7ff3939ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c0cf940 con 0x7ff38c157ab0 2023-09-30T22:52:24.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.194+0000 7ff3939ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0cfc20 con 0x7ff38c0cc3b0 2023-09-30T22:52:24.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.194+0000 7ff39179b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff38c0cbfe0 0x7ff38c1573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45482/0 (socket says 172.21.15.142:45482) 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.194+0000 7ff39179b700 1 -- 172.21.15.142:0/148352565 learned_addr learned my addr 172.21.15.142:0/148352565 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.194+0000 7ff391f9c700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff38c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995474295 0 0) 0x7ff38c0d0550 con 0x7ff38c0cbfe0 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff378003570 con 0x7ff38c0cbfe0 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013331982 0 0) 0x7ff38c0cf940 con 0x7ff38c157ab0 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff38c0d0550 con 0x7ff38c157ab0 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698792320 0 0) 0x7ff378003570 con 0x7ff38c0cbfe0 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 msgr2=0x7ff38c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff38c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 >> v1:172.21.15.148:6789/0 conn(0x7ff38c157ab0 legacy=0x7ff38c06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0cff00 con 0x7ff38c0cbfe0 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7ff388001470 con 0x7ff38c0cbfe0 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 >> v1:172.21.15.142:6789/0 conn(0x7ff38c0cbfe0 legacy=0x7ff38c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff378003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff378004180 0x7ff378004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff378004d50 0x7ff3780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0cfc20 con 0x7ff378004180 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37800bba0 con 0x7ff378004d50 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37800bd60 con 0x7ff38c0cc3b0 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff39179b700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff378003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff391f9c700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff378004d50 0x7ff3780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.195+0000 7ff390f9a700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff378004180 0x7ff378004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff39179b700 1 -- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff378004d50 msgr2=0x7ff3780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff39179b700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff378004d50 0x7ff3780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff39179b700 1 -- 172.21.15.142:0/148352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff378004180 msgr2=0x7ff378004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff39179b700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff378004180 0x7ff378004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff39179b700 1 -- 172.21.15.142:0/148352565 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378003570 con 0x7ff38c0cc3b0 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff39179b700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff378003c20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c2d0 tx=0x7ff388001e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e2ea639b89fa92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800cbc0 con 0x7ff38c0cc3b0 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38800cd20 con 0x7ff38c0cc3b0 2023-09-30T22:52:24.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.196+0000 7ff383fff700 1 -- 172.21.15.142:0/148352565 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388005b70 con 0x7ff38c0cc3b0 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.197+0000 7ff3939ff700 1 -- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 msgr2=0x7ff378003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.197+0000 7ff3939ff700 1 --2- 172.21.15.142:0/148352565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff378003c20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c2d0 tx=0x7ff388001e10 comp rx=0 tx=0).stop 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.197+0000 7ff391f9c700 1 -- 172.21.15.142:0/148352565 reap_dead start 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.197+0000 7ff3939ff700 1 -- 172.21.15.142:0/148352565 shutdown_connections 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.197+0000 7ff3939ff700 1 -- 172.21.15.142:0/148352565 >> 172.21.15.142:0/148352565 conn(0x7ff38c0d0a80 msgr2=0x7ff38c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.197+0000 7ff3939ff700 1 -- 172.21.15.142:0/148352565 shutdown_connections 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.197+0000 7ff3939ff700 1 -- 172.21.15.142:0/148352565 wait complete. 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.199+0000 7ff3939ff700 1 Processor -- start 2023-09-30T22:52:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.199+0000 7ff3939ff700 1 -- start start 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.200+0000 7ff3939ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff38c0c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.200+0000 7ff3939ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c0c9550 0x7ff38c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.200+0000 7ff3939ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff38c06d710 0x7ff38c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.200+0000 7ff3939ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c06e0f0 con 0x7ff38c06d710 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.200+0000 7ff3939ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0b8540 con 0x7ff38c0c9550 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.200+0000 7ff3939ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0ca840 con 0x7ff38c0cc3b0 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff38c06d710 0x7ff38c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff38c06d710 0x7ff38c06dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54120/0 (socket says 172.21.15.142:54120) 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 -- 172.21.15.142:0/1926846885 learned_addr learned my addr 172.21.15.142:0/1926846885 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff39179b700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff38c0c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff390f9a700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c0c9550 0x7ff38c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 -- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 msgr2=0x7ff38c0c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff38c0c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 -- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c0c9550 msgr2=0x7ff38c0c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c0c9550 0x7ff38c0c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 -- 172.21.15.142:0/1926846885 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0c4680 con 0x7ff38c06d710 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff391f9c700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff38c06d710 0x7ff38c06dbb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff38c15ea20 tx=0x7ff38400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff3817fa700 1 -- 172.21.15.142:0/1926846885 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400e040 con 0x7ff38c06d710 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c0c9fa0 con 0x7ff38c06d710 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff3817fa700 1 -- 172.21.15.142:0/1926846885 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38400f040 con 0x7ff38c06d710 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.201+0000 7ff3817fa700 1 -- 172.21.15.142:0/1926846885 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400fe20 con 0x7ff38c06d710 2023-09-30T22:52:24.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.202+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c0ca560 con 0x7ff38c06d710 2023-09-30T22:52:24.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.203+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c0c4810 con 0x7ff38c06d710 2023-09-30T22:52:24.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.203+0000 7ff3817fa700 1 -- 172.21.15.142:0/1926846885 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff384015640 con 0x7ff38c06d710 2023-09-30T22:52:24.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.204+0000 7ff3817fa700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff370067330 0x7ff3700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.204+0000 7ff3817fa700 1 -- 172.21.15.142:0/1926846885 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff3840850c0 con 0x7ff38c06d710 2023-09-30T22:52:24.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.205+0000 7ff39179b700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff370067330 0x7ff3700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.205+0000 7ff39179b700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff370067330 0x7ff3700697e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff388008fd0 tx=0x7ff388015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:24.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.209+0000 7ff3817fa700 1 -- 172.21.15.142:0/1926846885 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff384055e60 con 0x7ff38c06d710 2023-09-30T22:52:24.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.404+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff38c06fc10 con 0x7ff38c06d710 2023-09-30T22:52:24.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.405+0000 7ff3817fa700 1 -- 172.21.15.142:0/1926846885 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13804 (secure 0 0 0) 0x7ff384009e60 con 0x7ff38c06d710 2023-09-30T22:52:24.406 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:24.406 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":18,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:23.940687+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff370067330 msgr2=0x7ff3700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff370067330 0x7ff3700697e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff388008fd0 tx=0x7ff388015000 comp rx=0 tx=0).stop 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff38c06d710 msgr2=0x7ff38c06dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff38c06d710 0x7ff38c06dbb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff38c15ea20 tx=0x7ff38400b040 comp rx=0 tx=0).stop 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 shutdown_connections 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff370067330 0x7ff3700697e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff38c06d710 0x7ff38c06dbb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff38c0cc3b0 0x7ff38c0c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 --2- 172.21.15.142:0/1926846885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff38c0c9550 0x7ff38c0c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 >> 172.21.15.142:0/1926846885 conn(0x7ff38c0d0a80 msgr2=0x7ff38c159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:24.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 shutdown_connections 2023-09-30T22:52:24.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.408+0000 7ff3939ff700 1 -- 172.21.15.142:0/1926846885 wait complete. 2023-09-30T22:52:24.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:52:24.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:52:24.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.616+0000 7f1ed27ff700 1 Processor -- start 2023-09-30T22:52:24.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.617+0000 7f1ed27ff700 1 -- start start 2023-09-30T22:52:24.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ed27ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1ecc1540a0 0x7f1ecc06b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ed27ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ed27ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc15a8a0 con 0x7f1ecc06a450 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ed27ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc06b990 con 0x7f1ecc1540a0 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ed27ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc06a8d0 con 0x7f1ecc15a090 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ed0d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1ecc06a450 0x7f1ecc15d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45492/0 (socket says 172.21.15.142:45492) 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ed0d9c700 1 -- 172.21.15.142:0/2269477411 learned_addr learned my addr 172.21.15.142:0/2269477411 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ecbfff700 1 --2- 172.21.15.142:0/2269477411 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc1540a0 0x7f1ecc06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.618+0000 7f1ecaffd700 1 -- 172.21.15.142:0/2269477411 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945621985 0 0) 0x7f1ecc15a8a0 con 0x7f1ecc06a450 2023-09-30T22:52:24.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecaffd700 1 -- 172.21.15.142:0/2269477411 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb4003570 con 0x7f1ecc06a450 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecbfff700 1 -- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 msgr2=0x7f1ecc069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecbfff700 1 --2- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecbfff700 1 -- 172.21.15.142:0/2269477411 >> v1:172.21.15.142:6789/0 conn(0x7f1ecc06a450 legacy=0x7f1ecc15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecbfff700 1 -- 172.21.15.142:0/2269477411 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc15ab80 con 0x7f1ecc1540a0 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecbfff700 1 --2- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 0x7f1ecc06b450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009910 tx=0x7f1ebc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=689424ea89b85ecd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecaffd700 1 -- 172.21.15.142:0/2269477411 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc011630 con 0x7f1ecc1540a0 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecaffd700 1 -- 172.21.15.142:0/2269477411 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc011790 con 0x7f1ecc1540a0 2023-09-30T22:52:24.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.619+0000 7f1ecaffd700 1 -- 172.21.15.142:0/2269477411 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc011b30 con 0x7f1ecc1540a0 2023-09-30T22:52:24.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 -- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 msgr2=0x7f1ecc06b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 0x7f1ecc06b450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009910 tx=0x7f1ebc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 -- 172.21.15.142:0/2269477411 shutdown_connections 2023-09-30T22:52:24.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 0x7f1ecc06b450 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/2269477411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 -- 172.21.15.142:0/2269477411 >> 172.21.15.142:0/2269477411 conn(0x7f1ecc06d2f0 msgr2=0x7f1ecc0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:24.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 -- 172.21.15.142:0/2269477411 shutdown_connections 2023-09-30T22:52:24.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.620+0000 7f1ed27ff700 1 -- 172.21.15.142:0/2269477411 wait complete. 2023-09-30T22:52:24.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.621+0000 7f1ed27ff700 1 Processor -- start 2023-09-30T22:52:24.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.622+0000 7f1ed27ff700 1 -- start start 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.622+0000 7f1ed27ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc06a450 0x7f1ecc13f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.622+0000 7f1ed27ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 0x7f1ecc1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.622+0000 7f1ed27ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.622+0000 7f1ed27ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc16b1b0 con 0x7f1ecc06a450 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.622+0000 7f1ed27ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc14fb50 con 0x7f1ecc1540a0 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.622+0000 7f1ed27ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc14fe30 con 0x7f1ecc15a090 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc06a450 0x7f1ecc13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc06a450 0x7f1ecc13f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54126/0 (socket says 172.21.15.142:54126) 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 -- 172.21.15.142:0/1647877026 learned_addr learned my addr 172.21.15.142:0/1647877026 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 0x7f1ecc1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ed0d9c700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 -- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 msgr2=0x7f1ecc159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 -- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 msgr2=0x7f1ecc1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 0x7f1ecc1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 -- 172.21.15.142:0/1647877026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc009420 con 0x7f1ecc06a450 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1ecbfff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc06a450 0x7f1ecc13f370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009f00 tx=0x7f1ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.623+0000 7f1eb3fff700 1 -- 172.21.15.142:0/1647877026 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc01f070 con 0x7f1ecc06a450 2023-09-30T22:52:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.624+0000 7f1eb3fff700 1 -- 172.21.15.142:0/1647877026 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc000bc0 con 0x7f1ecc06a450 2023-09-30T22:52:24.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.624+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc150110 con 0x7f1ecc06a450 2023-09-30T22:52:24.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.624+0000 7f1eb3fff700 1 -- 172.21.15.142:0/1647877026 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc011b30 con 0x7f1ecc06a450 2023-09-30T22:52:24.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.624+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc150910 con 0x7f1ecc06a450 2023-09-30T22:52:24.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.625+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc0697b0 con 0x7f1ecc06a450 2023-09-30T22:52:24.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.625+0000 7f1eb3fff700 1 -- 172.21.15.142:0/1647877026 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1ebc023070 con 0x7f1ecc06a450 2023-09-30T22:52:24.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.626+0000 7f1eb3fff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1eb8067330 0x7f1eb80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:24.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.626+0000 7f1eb3fff700 1 -- 172.21.15.142:0/1647877026 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1ebc085a80 con 0x7f1ecc06a450 2023-09-30T22:52:24.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.627+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1eb8067330 0x7f1eb80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:24.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.627+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1eb8067330 0x7f1eb80697e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc16d850 tx=0x7f1ec00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:24.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.631+0000 7f1eb3fff700 1 -- 172.21.15.142:0/1647877026 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1ebc052ce0 con 0x7f1ecc06a450 2023-09-30T22:52:24.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.820+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ecc15ae60 con 0x7f1ecc06a450 2023-09-30T22:52:24.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.820+0000 7f1eb3fff700 1 -- 172.21.15.142:0/1647877026 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ebc02a070 con 0x7f1ecc06a450 2023-09-30T22:52:24.821 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:52:24.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1eb8067330 msgr2=0x7f1eb80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1eb8067330 0x7f1eb80697e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc16d850 tx=0x7f1ec00091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc06a450 msgr2=0x7f1ecc13f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:24.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc06a450 0x7f1ecc13f370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009f00 tx=0x7f1ebc017000 comp rx=0 tx=0).stop 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 shutdown_connections 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1eb8067330 0x7f1eb80697e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc15a090 0x7f1ecc159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc06a450 0x7f1ecc13f370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 --2- 172.21.15.142:0/1647877026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc1540a0 0x7f1ecc1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 >> 172.21.15.142:0/1647877026 conn(0x7f1ecc06d2f0 msgr2=0x7f1ecc14e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 shutdown_connections 2023-09-30T22:52:24.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:24.823+0000 7f1ed27ff700 1 -- 172.21.15.142:0/1647877026 wait complete. 2023-09-30T22:52:24.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:52:25.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.035+0000 7efd1cdff700 1 Processor -- start 2023-09-30T22:52:25.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.035+0000 7efd1cdff700 1 -- start start 2023-09-30T22:52:25.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.036+0000 7efd1cdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18159f10 0x7efd1806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.036+0000 7efd1cdff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd18067620 0x7efd18067aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.036+0000 7efd1cdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1806b650 con 0x7efd18159b40 2023-09-30T22:52:25.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.036+0000 7efd1cdff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd18067fe0 con 0x7efd18067620 2023-09-30T22:52:25.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.036+0000 7efd1cdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1806aa40 con 0x7efd18159f10 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.036+0000 7efd15d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18159f10 0x7efd1806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd15d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18159f10 0x7efd1806a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:36278/0 (socket says 172.21.15.142:36278) 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd15d9b700 1 -- 172.21.15.142:0/1580427842 learned_addr learned my addr 172.21.15.142:0/1580427842 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd16d9d700 1 --2- 172.21.15.142:0/1580427842 >> v2:172.21.15.148:3300/0 conn(0x7efd18067620 0x7efd18067aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd15d9b700 1 -- 172.21.15.142:0/1580427842 >> v2:172.21.15.148:3300/0 conn(0x7efd18067620 msgr2=0x7efd18067aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd15d9b700 1 --2- 172.21.15.142:0/1580427842 >> v2:172.21.15.148:3300/0 conn(0x7efd18067620 0x7efd18067aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd15d9b700 1 -- 172.21.15.142:0/1580427842 >> v1:172.21.15.148:6789/0 conn(0x7efd18159b40 legacy=0x7efd180683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd15d9b700 1 -- 172.21.15.142:0/1580427842 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1806ad20 con 0x7efd18159f10 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd1559a700 1 -- 172.21.15.142:0/1580427842 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156550451 0 0) 0x7efd1806b650 con 0x7efd18159b40 2023-09-30T22:52:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd15d9b700 1 --2- 172.21.15.142:0/1580427842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18159f10 0x7efd1806a360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0099b0 tx=0x7efd0c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1cde5c72224abc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd1559a700 1 -- 172.21.15.142:0/1580427842 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c009ea0 con 0x7efd18159f10 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd1559a700 1 -- 172.21.15.142:0/1580427842 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c00b860 con 0x7efd18159f10 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.037+0000 7efd1559a700 1 -- 172.21.15.142:0/1580427842 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00bc00 con 0x7efd18159f10 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 -- 172.21.15.142:0/1580427842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18159f10 msgr2=0x7efd1806a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 --2- 172.21.15.142:0/1580427842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18159f10 0x7efd1806a360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0099b0 tx=0x7efd0c009250 comp rx=0 tx=0).stop 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 -- 172.21.15.142:0/1580427842 shutdown_connections 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 --2- 172.21.15.142:0/1580427842 >> v2:172.21.15.148:3300/0 conn(0x7efd18067620 0x7efd18067aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 --2- 172.21.15.142:0/1580427842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18159f10 0x7efd1806a360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 -- 172.21.15.142:0/1580427842 >> 172.21.15.142:0/1580427842 conn(0x7efd180c9950 msgr2=0x7efd180c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 -- 172.21.15.142:0/1580427842 shutdown_connections 2023-09-30T22:52:25.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.038+0000 7efd1cdff700 1 -- 172.21.15.142:0/1580427842 wait complete. 2023-09-30T22:52:25.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.040+0000 7efd1cdff700 1 Processor -- start 2023-09-30T22:52:25.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.040+0000 7efd1cdff700 1 -- start start 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.040+0000 7efd1cdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18067620 0x7efd1814cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd1cdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18159b40 0x7efd1815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd1cdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd18159f10 0x7efd181576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd1cdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1815b2f0 con 0x7efd18159b40 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd1cdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1815c7a0 con 0x7efd18159f10 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd1cdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1816a7b0 con 0x7efd18067620 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18159b40 0x7efd1815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18159b40 0x7efd1815adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54128/0 (socket says 172.21.15.142:54128) 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 -- 172.21.15.142:0/2061505217 learned_addr learned my addr 172.21.15.142:0/2061505217 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd1659c700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18067620 0x7efd1814cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd16d9d700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd18159f10 0x7efd181576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 -- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18067620 msgr2=0x7efd1814cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18067620 0x7efd1814cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 -- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd18159f10 msgr2=0x7efd181576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd18159f10 0x7efd181576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.041+0000 7efd15d9b700 1 -- 172.21.15.142:0/2061505217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0094f0 con 0x7efd18159b40 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.042+0000 7efd15d9b700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18159b40 0x7efd1815adb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd1806ab80 tx=0x7efd0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.042+0000 7efd067fc700 1 -- 172.21.15.142:0/2061505217 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c000d10 con 0x7efd18159b40 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.042+0000 7efd067fc700 1 -- 172.21.15.142:0/2061505217 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c00bbe0 con 0x7efd18159b40 2023-09-30T22:52:25.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.042+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1816aa90 con 0x7efd18159b40 2023-09-30T22:52:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.042+0000 7efd067fc700 1 -- 172.21.15.142:0/2061505217 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c011690 con 0x7efd18159b40 2023-09-30T22:52:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.042+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1816b050 con 0x7efd18159b40 2023-09-30T22:52:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.043+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd180699b0 con 0x7efd18159b40 2023-09-30T22:52:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.044+0000 7efd067fc700 1 -- 172.21.15.142:0/2061505217 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efd0c011ac0 con 0x7efd18159b40 2023-09-30T22:52:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.045+0000 7efd067fc700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcf8067330 0x7efcf80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.045+0000 7efd067fc700 1 -- 172.21.15.142:0/2061505217 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efd0c086110 con 0x7efd18159b40 2023-09-30T22:52:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.045+0000 7efd1659c700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcf8067330 0x7efcf80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.046+0000 7efd1659c700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcf8067330 0x7efcf80697e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd08007fd0 tx=0x7efd08007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.049+0000 7efd067fc700 1 -- 172.21.15.142:0/2061505217 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efd0c0532c0 con 0x7efd18159b40 2023-09-30T22:52:25.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.241+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd1806b000 con 0x7efd18159b40 2023-09-30T22:52:25.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.242+0000 7efd067fc700 1 -- 172.21.15.142:0/2061505217 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd0c0568e0 con 0x7efd18159b40 2023-09-30T22:52:25.242 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcf8067330 msgr2=0x7efcf80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcf8067330 0x7efcf80697e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd08007fd0 tx=0x7efd08007d30 comp rx=0 tx=0).stop 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18159b40 msgr2=0x7efd1815adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18159b40 0x7efd1815adb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd1806ab80 tx=0x7efd0c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 shutdown_connections 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcf8067330 0x7efcf80697e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd18159f10 0x7efd181576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd18067620 0x7efd1814cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 --2- 172.21.15.142:0/2061505217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18159b40 0x7efd1815adb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 >> 172.21.15.142:0/2061505217 conn(0x7efd180c9950 msgr2=0x7efd180c1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:25.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 shutdown_connections 2023-09-30T22:52:25.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.244+0000 7efd1cdff700 1 -- 172.21.15.142:0/2061505217 wait complete. 2023-09-30T22:52:25.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:52:25.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.454+0000 7fcb6dbff700 1 Processor -- start 2023-09-30T22:52:25.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.454+0000 7fcb6dbff700 1 -- start start 2023-09-30T22:52:25.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb6dbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 0x7fcb68161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb6dbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6806d3e0 con 0x7fcb680b00d0 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb6dbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6806dc80 con 0x7fcb680af020 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb6dbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6815b400 con 0x7fcb6806e820 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb66ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcb680b00d0 0x7fcb6806e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45504/0 (socket says 172.21.15.142:45504) 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb66ffd700 1 -- 172.21.15.142:0/3697327280 learned_addr learned my addr 172.21.15.142:0/3697327280 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb67fff700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 0x7fcb68161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224766322 0 0) 0x7fcb6806d3e0 con 0x7fcb680b00d0 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb50003570 con 0x7fcb680b00d0 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739157252 0 0) 0x7fcb6806dc80 con 0x7fcb680af020 2023-09-30T22:52:25.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.456+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb6806d3e0 con 0x7fcb680af020 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472341238 0 0) 0x7fcb50003570 con 0x7fcb680b00d0 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 msgr2=0x7fcb68161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 0x7fcb68161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 >> v1:172.21.15.148:6789/0 conn(0x7fcb680af020 legacy=0x7fcb68156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6806eca0 con 0x7fcb680b00d0 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fcb5c001470 con 0x7fcb680b00d0 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 >> v1:172.21.15.142:6789/0 conn(0x7fcb680b00d0 legacy=0x7fcb6806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb50004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50004810 0x7fcb50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 0x7fcb50005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5000bbf0 con 0x7fcb50003c20 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5000bd60 con 0x7fcb50004810 2023-09-30T22:52:25.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5000e130 con 0x7fcb6806e820 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb677fe700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb50004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb66ffd700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50004810 0x7fcb50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb67fff700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 0x7fcb50005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb677fe700 1 -- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 msgr2=0x7fcb50005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb677fe700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6806e820 0x7fcb50005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb677fe700 1 -- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50004810 msgr2=0x7fcb50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb677fe700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50004810 0x7fcb50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.457+0000 7fcb677fe700 1 -- 172.21.15.142:0/3697327280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50003570 con 0x7fcb50003c20 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb677fe700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb50004010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb58001a50 tx=0x7fcb58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe846c0a559471be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800c5d0 con 0x7fcb50003c20 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800c730 con 0x7fcb50003c20 2023-09-30T22:52:25.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb667fc700 1 -- 172.21.15.142:0/3697327280 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800cad0 con 0x7fcb50003c20 2023-09-30T22:52:25.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb6dbff700 1 -- 172.21.15.142:0/3697327280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 msgr2=0x7fcb50004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb6dbff700 1 --2- 172.21.15.142:0/3697327280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb50004010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb58001a50 tx=0x7fcb58007d30 comp rx=0 tx=0).stop 2023-09-30T22:52:25.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb67fff700 1 -- 172.21.15.142:0/3697327280 reap_dead start 2023-09-30T22:52:25.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb6dbff700 1 -- 172.21.15.142:0/3697327280 shutdown_connections 2023-09-30T22:52:25.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb6dbff700 1 -- 172.21.15.142:0/3697327280 >> 172.21.15.142:0/3697327280 conn(0x7fcb680680c0 msgr2=0x7fcb680c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:25.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.458+0000 7fcb6dbff700 1 -- 172.21.15.142:0/3697327280 shutdown_connections 2023-09-30T22:52:25.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.459+0000 7fcb6dbff700 1 -- 172.21.15.142:0/3697327280 wait complete. 2023-09-30T22:52:25.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.460+0000 7fcb6dbff700 1 Processor -- start 2023-09-30T22:52:25.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.460+0000 7fcb6dbff700 1 -- start start 2023-09-30T22:52:25.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb6dbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb680c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb6dbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6814e1f0 0x7fcb680ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb6dbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb6814e660 0x7fcb680ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb6dbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680a98c0 con 0x7fcb50003c20 2023-09-30T22:52:25.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb6dbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680aa720 con 0x7fcb6814e660 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb6dbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680c6e60 con 0x7fcb6814e1f0 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb680c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb680c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54160/0 (socket says 172.21.15.142:54160) 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb66ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6814e1f0 0x7fcb680ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb677fe700 1 -- 172.21.15.142:0/185566903 learned_addr learned my addr 172.21.15.142:0/185566903 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.461+0000 7fcb67fff700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb6814e660 0x7fcb680ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb677fe700 1 -- 172.21.15.142:0/185566903 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6814e1f0 msgr2=0x7fcb680ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb677fe700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6814e1f0 0x7fcb680ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb677fe700 1 -- 172.21.15.142:0/185566903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb6814e660 msgr2=0x7fcb680ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb677fe700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb6814e660 0x7fcb680ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb677fe700 1 -- 172.21.15.142:0/185566903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680a9b10 con 0x7fcb50003c20 2023-09-30T22:52:25.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb677fe700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb680c6920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb58001ed0 tx=0x7fcb58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb4f7fe700 1 -- 172.21.15.142:0/185566903 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800c5d0 con 0x7fcb50003c20 2023-09-30T22:52:25.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb4f7fe700 1 -- 172.21.15.142:0/185566903 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800cab0 con 0x7fcb50003c20 2023-09-30T22:52:25.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb680a98c0 con 0x7fcb50003c20 2023-09-30T22:52:25.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb4f7fe700 1 -- 172.21.15.142:0/185566903 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5801e630 con 0x7fcb50003c20 2023-09-30T22:52:25.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.462+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb680aa0d0 con 0x7fcb50003c20 2023-09-30T22:52:25.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.463+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb680aaa00 con 0x7fcb50003c20 2023-09-30T22:52:25.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.464+0000 7fcb4f7fe700 1 -- 172.21.15.142:0/185566903 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcb58019070 con 0x7fcb50003c20 2023-09-30T22:52:25.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.465+0000 7fcb4f7fe700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb54067330 0x7fcb540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.465+0000 7fcb4f7fe700 1 -- 172.21.15.142:0/185566903 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcb58085e60 con 0x7fcb50003c20 2023-09-30T22:52:25.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.465+0000 7fcb66ffd700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb54067330 0x7fcb540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.466+0000 7fcb66ffd700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb54067330 0x7fcb540697e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcb680b0030 tx=0x7fcb6806dbf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.469+0000 7fcb4f7fe700 1 -- 172.21.15.142:0/185566903 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcb58053010 con 0x7fcb50003c20 2023-09-30T22:52:25.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.702+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb6806fc10 con 0x7fcb50003c20 2023-09-30T22:52:25.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.703+0000 7fcb4f7fe700 1 -- 172.21.15.142:0/185566903 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fcb5802cde0 con 0x7fcb50003c20 2023-09-30T22:52:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:25.703 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-09-30T22:52:25.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb54067330 msgr2=0x7fcb540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb54067330 0x7fcb540697e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcb680b0030 tx=0x7fcb6806dbf0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 msgr2=0x7fcb680c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb680c6920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb58001ed0 tx=0x7fcb58015000 comp rx=0 tx=0).stop 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 shutdown_connections 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb54067330 0x7fcb540697e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb6814e660 0x7fcb680ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb50003c20 0x7fcb680c6920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 --2- 172.21.15.142:0/185566903 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb6814e1f0 0x7fcb680ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 >> 172.21.15.142:0/185566903 conn(0x7fcb680680c0 msgr2=0x7fcb680ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:25.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 shutdown_connections 2023-09-30T22:52:25.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.705+0000 7fcb6dbff700 1 -- 172.21.15.142:0/185566903 wait complete. 2023-09-30T22:52:25.707 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 3 2023-09-30T22:52:25.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:25.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.911+0000 7ff2c99ff700 1 Processor -- start 2023-09-30T22:52:25.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.911+0000 7ff2c99ff700 1 -- start start 2023-09-30T22:52:25.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.912+0000 7ff2c99ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c40ac3a0 0x7ff2c40aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.912+0000 7ff2c99ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff2c406b930 0x7ff2c40aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.912+0000 7ff2c99ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c4068000 con 0x7ff2c4159b50 2023-09-30T22:52:25.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.912+0000 7ff2c99ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c4069f10 con 0x7ff2c406b930 2023-09-30T22:52:25.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.912+0000 7ff2c99ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4068240 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c2ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff2c4159b50 0x7ff2c40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45514/0 (socket says 172.21.15.142:45514) 2023-09-30T22:52:25.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c2ffd700 1 -- 172.21.15.142:0/3479926679 learned_addr learned my addr 172.21.15.142:0/3479926679 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:25.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c37fe700 1 --2- 172.21.15.142:0/3479926679 >> v2:172.21.15.148:3300/0 conn(0x7ff2c406b930 0x7ff2c40aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c27fc700 1 --2- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c40ac3a0 0x7ff2c40aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c1ffb700 1 -- 172.21.15.142:0/3479926679 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832372626 0 0) 0x7ff2b4001110 con 0x7ff2c4159b50 2023-09-30T22:52:25.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c1ffb700 1 -- 172.21.15.142:0/3479926679 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac003570 con 0x7ff2c4159b50 2023-09-30T22:52:25.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c37fe700 1 -- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c40ac3a0 msgr2=0x7ff2c40aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c37fe700 1 --2- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c40ac3a0 0x7ff2c40aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c37fe700 1 -- 172.21.15.142:0/3479926679 >> v1:172.21.15.142:6789/0 conn(0x7ff2c4159b50 legacy=0x7ff2c40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.913+0000 7ff2c37fe700 1 -- 172.21.15.142:0/3479926679 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4068520 con 0x7ff2c406b930 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c37fe700 1 --2- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 0x7ff2c40aa7e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009e60 tx=0x7ff2bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c5a55ffec1f3abc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c1ffb700 1 -- 172.21.15.142:0/3479926679 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00e070 con 0x7ff2c406b930 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c1ffb700 1 -- 172.21.15.142:0/3479926679 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc00bab0 con 0x7ff2c406b930 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c1ffb700 1 -- 172.21.15.142:0/3479926679 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00be70 con 0x7ff2c406b930 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c99ff700 1 -- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 msgr2=0x7ff2c40aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 0x7ff2c40aa7e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009e60 tx=0x7ff2bc009780 comp rx=0 tx=0).stop 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c99ff700 1 -- 172.21.15.142:0/3479926679 shutdown_connections 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 0x7ff2c40aa7e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/3479926679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c40ac3a0 0x7ff2c40aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.914+0000 7ff2c99ff700 1 -- 172.21.15.142:0/3479926679 >> 172.21.15.142:0/3479926679 conn(0x7ff2c406dab0 msgr2=0x7ff2c40aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:25.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.915+0000 7ff2c99ff700 1 -- 172.21.15.142:0/3479926679 shutdown_connections 2023-09-30T22:52:25.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.915+0000 7ff2c99ff700 1 -- 172.21.15.142:0/3479926679 wait complete. 2023-09-30T22:52:25.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.916+0000 7ff2c99ff700 1 Processor -- start 2023-09-30T22:52:25.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.916+0000 7ff2c99ff700 1 -- start start 2023-09-30T22:52:25.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c99ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 0x7ff2c414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c99ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c40ac3a0 0x7ff2c415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c99ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c4159b50 0x7ff2c415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c99ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4155cc0 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c99ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4155fa0 con 0x7ff2c406b930 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c99ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4156280 con 0x7ff2c4159b50 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c40ac3a0 0x7ff2c415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c40ac3a0 0x7ff2c415a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54168/0 (socket says 172.21.15.142:54168) 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c27fc700 1 -- 172.21.15.142:0/2077164386 learned_addr learned my addr 172.21.15.142:0/2077164386 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.917+0000 7ff2c2ffd700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 0x7ff2c414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c37fe700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c4159b50 0x7ff2c415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c27fc700 1 -- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c4159b50 msgr2=0x7ff2c415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c27fc700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c4159b50 0x7ff2c415ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c27fc700 1 -- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 msgr2=0x7ff2c414c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c27fc700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 0x7ff2c414c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c27fc700 1 -- 172.21.15.142:0/2077164386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc009a20 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c37fe700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c4159b50 0x7ff2c415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c27fc700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c40ac3a0 0x7ff2c415a830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800ec80 tx=0x7ff2b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2aaffd700 1 -- 172.21.15.142:0/2077164386 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800c9d0 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2aaffd700 1 -- 172.21.15.142:0/2077164386 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b800cb30 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2aaffd700 1 -- 172.21.15.142:0/2077164386 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8013470 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c4156560 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.918+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c4156b20 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.919+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c406cfd0 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.920+0000 7ff2aaffd700 1 -- 172.21.15.142:0/2077164386 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff2b8013820 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.921+0000 7ff2aaffd700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2b0067330 0x7ff2b00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:25.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.921+0000 7ff2aaffd700 1 -- 172.21.15.142:0/2077164386 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff2b8084d00 con 0x7ff2c40ac3a0 2023-09-30T22:52:25.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.921+0000 7ff2c2ffd700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2b0067330 0x7ff2b00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:25.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.922+0000 7ff2c2ffd700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2b0067330 0x7ff2b00697e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4001270 tx=0x7ff2b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:25.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:25.925+0000 7ff2aaffd700 1 -- 172.21.15.142:0/2077164386 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff2b8051eb0 con 0x7ff2c40ac3a0 2023-09-30T22:52:26.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.121+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2c414cd80 con 0x7ff2c40ac3a0 2023-09-30T22:52:26.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.122+0000 7ff2aaffd700 1 -- 172.21.15.142:0/2077164386 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13791 (secure 0 0 0) 0x7ff2b8017090 con 0x7ff2c40ac3a0 2023-09-30T22:52:26.123 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:26.123 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":19,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:24.949388+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:26.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2b0067330 msgr2=0x7ff2b00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2b0067330 0x7ff2b00697e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4001270 tx=0x7ff2b4009040 comp rx=0 tx=0).stop 2023-09-30T22:52:26.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c40ac3a0 msgr2=0x7ff2c415a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c40ac3a0 0x7ff2c415a830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800ec80 tx=0x7ff2b80091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 shutdown_connections 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2b0067330 0x7ff2b00697e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c4159b50 0x7ff2c415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2c406b930 0x7ff2c414c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 --2- 172.21.15.142:0/2077164386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c40ac3a0 0x7ff2c415a830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 >> 172.21.15.142:0/2077164386 conn(0x7ff2c406dab0 msgr2=0x7ff2c4158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 shutdown_connections 2023-09-30T22:52:26.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.125+0000 7ff2c99ff700 1 -- 172.21.15.142:0/2077164386 wait complete. 2023-09-30T22:52:26.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:52:26.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:52:26.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.335+0000 7f8e273ff700 1 Processor -- start 2023-09-30T22:52:26.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.335+0000 7f8e273ff700 1 -- start start 2023-09-30T22:52:26.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.336+0000 7f8e273ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e20069f10 0x7f8e200c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.336+0000 7f8e273ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200cb350 0x7f8e200c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.336+0000 7f8e273ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200c7690 con 0x7f8e200c52a0 2023-09-30T22:52:26.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.336+0000 7f8e273ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e201406a0 con 0x7f8e20069f10 2023-09-30T22:52:26.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.336+0000 7f8e273ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200c3a50 con 0x7f8e200cb350 2023-09-30T22:52:26.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.337+0000 7f8e2599c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200cb350 0x7f8e200c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.337+0000 7f8e2499a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e20069f10 0x7f8e200c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.337+0000 7f8e2599c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200cb350 0x7f8e200c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:36316/0 (socket says 172.21.15.142:36316) 2023-09-30T22:52:26.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.337+0000 7f8e2599c700 1 -- 172.21.15.142:0/342872121 learned_addr learned my addr 172.21.15.142:0/342872121 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:26.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.337+0000 7f8e2519b700 1 --1- 172.21.15.142:0/342872121 >> v1:172.21.15.148:6789/0 conn(0x7f8e200c52a0 0x7f8e200c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:44418/0 (socket says 172.21.15.142:44418) 2023-09-30T22:52:26.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.337+0000 7f8e17fff700 1 -- 172.21.15.142:0/342872121 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169360639 0 0) 0x7f8e1c001110 con 0x7f8e200c52a0 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e17fff700 1 -- 172.21.15.142:0/342872121 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c003570 con 0x7f8e200c52a0 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e2499a700 1 -- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200cb350 msgr2=0x7f8e200c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e2499a700 1 --2- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200cb350 0x7f8e200c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e2499a700 1 -- 172.21.15.142:0/342872121 >> v1:172.21.15.148:6789/0 conn(0x7f8e200c52a0 legacy=0x7f8e200c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e2499a700 1 -- 172.21.15.142:0/342872121 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200c7f20 con 0x7f8e20069f10 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e2599c700 1 --2- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200cb350 0x7f8e200c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e2499a700 1 --2- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e20069f10 0x7f8e200c5670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000bbc0 tx=0x7f8e1000b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ae2239f7db4f9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e17fff700 1 -- 172.21.15.142:0/342872121 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000da30 con 0x7f8e20069f10 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e17fff700 1 -- 172.21.15.142:0/342872121 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000db90 con 0x7f8e20069f10 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.338+0000 7f8e17fff700 1 -- 172.21.15.142:0/342872121 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10019480 con 0x7f8e20069f10 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 -- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e20069f10 msgr2=0x7f8e200c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 --2- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e20069f10 0x7f8e200c5670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000bbc0 tx=0x7f8e1000b430 comp rx=0 tx=0).stop 2023-09-30T22:52:26.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 -- 172.21.15.142:0/342872121 shutdown_connections 2023-09-30T22:52:26.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 --2- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200cb350 0x7f8e200c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 --2- 172.21.15.142:0/342872121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e20069f10 0x7f8e200c5670 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 -- 172.21.15.142:0/342872121 >> 172.21.15.142:0/342872121 conn(0x7f8e200cc670 msgr2=0x7f8e200cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:26.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 -- 172.21.15.142:0/342872121 shutdown_connections 2023-09-30T22:52:26.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.339+0000 7f8e273ff700 1 -- 172.21.15.142:0/342872121 wait complete. 2023-09-30T22:52:26.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.340+0000 7f8e273ff700 1 Processor -- start 2023-09-30T22:52:26.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.340+0000 7f8e273ff700 1 -- start start 2023-09-30T22:52:26.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.341+0000 7f8e273ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e20069f10 0x7f8e20156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.341+0000 7f8e273ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200c52a0 0x7f8e200bc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.341+0000 7f8e273ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e200cb350 0x7f8e200ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.341+0000 7f8e273ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201567d0 con 0x7f8e20069f10 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.341+0000 7f8e273ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200bde60 con 0x7f8e200cb350 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.341+0000 7f8e273ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200be140 con 0x7f8e200c52a0 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e20069f10 0x7f8e20156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e20069f10 0x7f8e20156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54172/0 (socket says 172.21.15.142:54172) 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 -- 172.21.15.142:0/2205433127 learned_addr learned my addr 172.21.15.142:0/2205433127 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2599c700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e200cb350 0x7f8e200ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2499a700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200c52a0 0x7f8e200bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 -- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200c52a0 msgr2=0x7f8e200bc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200c52a0 0x7f8e200bc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 -- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e200cb350 msgr2=0x7f8e200ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e200cb350 0x7f8e200ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 -- 172.21.15.142:0/2205433127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18009ae0 con 0x7f8e20069f10 2023-09-30T22:52:26.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2499a700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200c52a0 0x7f8e200bc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:26.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e2519b700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e20069f10 0x7f8e20156290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c7c0 tx=0x7f8e1c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:26.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e157fa700 1 -- 172.21.15.142:0/2205433127 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c007300 con 0x7f8e20069f10 2023-09-30T22:52:26.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e157fa700 1 -- 172.21.15.142:0/2205433127 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c007480 con 0x7f8e20069f10 2023-09-30T22:52:26.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.342+0000 7f8e157fa700 1 -- 172.21.15.142:0/2205433127 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004830 con 0x7f8e20069f10 2023-09-30T22:52:26.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.343+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1000b6d0 con 0x7f8e20069f10 2023-09-30T22:52:26.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.343+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e200be700 con 0x7f8e20069f10 2023-09-30T22:52:26.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.344+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e20069a50 con 0x7f8e20069f10 2023-09-30T22:52:26.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.344+0000 7f8e157fa700 1 -- 172.21.15.142:0/2205433127 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8e1c004ba0 con 0x7f8e20069f10 2023-09-30T22:52:26.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.345+0000 7f8e157fa700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e04067330 0x7f8e040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.345+0000 7f8e157fa700 1 -- 172.21.15.142:0/2205433127 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8e1c083c60 con 0x7f8e20069f10 2023-09-30T22:52:26.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.345+0000 7f8e2499a700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e04067330 0x7f8e040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.346+0000 7f8e2499a700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e04067330 0x7f8e040697e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006a320 tx=0x7f8e1001b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:26.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.349+0000 7f8e157fa700 1 -- 172.21.15.142:0/2205433127 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8e1c050e90 con 0x7f8e20069f10 2023-09-30T22:52:26.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.541+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e200c7690 con 0x7f8e20069f10 2023-09-30T22:52:26.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.541+0000 7f8e157fa700 1 -- 172.21.15.142:0/2205433127 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e200c7690 con 0x7f8e20069f10 2023-09-30T22:52:26.542 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e04067330 msgr2=0x7f8e040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e04067330 0x7f8e040697e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006a320 tx=0x7f8e1001b000 comp rx=0 tx=0).stop 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e20069f10 msgr2=0x7f8e20156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e20069f10 0x7f8e20156290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c7c0 tx=0x7f8e1c007c70 comp rx=0 tx=0).stop 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 shutdown_connections 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e04067330 0x7f8e040697e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e200cb350 0x7f8e200ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e20069f10 0x7f8e20156290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 --2- 172.21.15.142:0/2205433127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e200c52a0 0x7f8e200bc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 >> 172.21.15.142:0/2205433127 conn(0x7f8e200cc670 msgr2=0x7f8e2006d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 shutdown_connections 2023-09-30T22:52:26.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.544+0000 7f8e273ff700 1 -- 172.21.15.142:0/2205433127 wait complete. 2023-09-30T22:52:26.561 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:52:26.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.752+0000 7f0ecd9ff700 1 Processor -- start 2023-09-30T22:52:26.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.753+0000 7f0ecd9ff700 1 -- start start 2023-09-30T22:52:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ecd9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec80ca5e0 0x7f0ec806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ecd9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0ec80b0de0 0x7f0ec80681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ecd9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec8067d10 con 0x7f0ec8159ba0 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ecd9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec806af90 con 0x7f0ec80b0de0 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ecd9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80676c0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ec6ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0ec8159ba0 0x7f0ec80c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45526/0 (socket says 172.21.15.142:45526) 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ec6ffd700 1 -- 172.21.15.142:0/1870143607 learned_addr learned my addr 172.21.15.142:0/1870143607 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ec77fe700 1 --2- 172.21.15.142:0/1870143607 >> v2:172.21.15.148:3300/0 conn(0x7f0ec80b0de0 0x7f0ec80681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ebffff700 1 --2- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec80ca5e0 0x7f0ec806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ec67fc700 1 -- 172.21.15.142:0/1870143607 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695654828 0 0) 0x7f0ec8067d10 con 0x7f0ec8159ba0 2023-09-30T22:52:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.754+0000 7f0ec67fc700 1 -- 172.21.15.142:0/1870143607 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb4003570 con 0x7f0ec8159ba0 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec77fe700 1 -- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec80ca5e0 msgr2=0x7f0ec806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec77fe700 1 --2- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec80ca5e0 0x7f0ec806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec77fe700 1 -- 172.21.15.142:0/1870143607 >> v1:172.21.15.142:6789/0 conn(0x7f0ec8159ba0 legacy=0x7f0ec80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec77fe700 1 -- 172.21.15.142:0/1870143607 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80679a0 con 0x7f0ec80b0de0 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec77fe700 1 --2- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 0x7f0ec80681a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009e60 tx=0x7f0ec0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c58f86118fc0d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec67fc700 1 -- 172.21.15.142:0/1870143607 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000e070 con 0x7f0ec80b0de0 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec67fc700 1 -- 172.21.15.142:0/1870143607 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000bab0 con 0x7f0ec80b0de0 2023-09-30T22:52:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.755+0000 7f0ec67fc700 1 -- 172.21.15.142:0/1870143607 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000be70 con 0x7f0ec80b0de0 2023-09-30T22:52:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 msgr2=0x7f0ec80681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 0x7f0ec80681a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009e60 tx=0x7f0ec0009780 comp rx=0 tx=0).stop 2023-09-30T22:52:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/1870143607 shutdown_connections 2023-09-30T22:52:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 0x7f0ec80681a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/1870143607 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec80ca5e0 0x7f0ec806a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/1870143607 >> 172.21.15.142:0/1870143607 conn(0x7f0ec80cb2f0 msgr2=0x7f0ec80cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/1870143607 shutdown_connections 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.756+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/1870143607 wait complete. 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.757+0000 7f0ecd9ff700 1 Processor -- start 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.758+0000 7f0ecd9ff700 1 -- start start 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.758+0000 7f0ecd9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 0x7f0ec80c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.758+0000 7f0ecd9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec80ca5e0 0x7f0ec816a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.758+0000 7f0ecd9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec8159ba0 0x7f0ec814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.758+0000 7f0ecd9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c5930 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.758+0000 7f0ecd9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c4ab0 con 0x7f0ec80b0de0 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.758+0000 7f0ecd9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec814d1d0 con 0x7f0ec8159ba0 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec80ca5e0 0x7f0ec816a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec80ca5e0 0x7f0ec816a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54184/0 (socket says 172.21.15.142:54184) 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 -- 172.21.15.142:0/2972411069 learned_addr learned my addr 172.21.15.142:0/2972411069 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ec6ffd700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 0x7f0ec80c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ec77fe700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec8159ba0 0x7f0ec814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 -- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec8159ba0 msgr2=0x7f0ec814cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec8159ba0 0x7f0ec814cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 -- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 msgr2=0x7f0ec80c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 0x7f0ec80c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 -- 172.21.15.142:0/2972411069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0009a20 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.759+0000 7f0ebffff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec80ca5e0 0x7f0ec816a8e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000ec80 tx=0x7f0eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.760+0000 7f0ebeffd700 1 -- 172.21.15.142:0/2972411069 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000c9d0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.760+0000 7f0ebeffd700 1 -- 172.21.15.142:0/2972411069 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000cb30 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.760+0000 7f0ebeffd700 1 -- 172.21.15.142:0/2972411069 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0013470 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.760+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec80c9c10 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.760+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec80c4fa0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.761+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec80c5aa0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.761+0000 7f0ebeffd700 1 -- 172.21.15.142:0/2972411069 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0eb0013820 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.762+0000 7f0ebeffd700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0ea8067330 0x7f0ea80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:26.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.762+0000 7f0ebeffd700 1 -- 172.21.15.142:0/2972411069 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0eb0084cb0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.762+0000 7f0ec6ffd700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0ea8067330 0x7f0ea80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:26.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.763+0000 7f0ec6ffd700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0ea8067330 0x7f0ea80697e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80058d0 tx=0x7f0eb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:26.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.766+0000 7f0ebeffd700 1 -- 172.21.15.142:0/2972411069 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0ec80c5aa0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.956+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ec80c5aa0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.957+0000 7f0ebeffd700 1 -- 172.21.15.142:0/2972411069 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ec80c5aa0 con 0x7f0ec80ca5e0 2023-09-30T22:52:26.957 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0ea8067330 msgr2=0x7f0ea80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0ea8067330 0x7f0ea80697e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80058d0 tx=0x7f0eb8009040 comp rx=0 tx=0).stop 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec80ca5e0 msgr2=0x7f0ec816a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec80ca5e0 0x7f0ec816a8e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000ec80 tx=0x7f0eb00091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 shutdown_connections 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0ea8067330 0x7f0ea80697e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ec8159ba0 0x7f0ec814cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec80b0de0 0x7f0ec80c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 --2- 172.21.15.142:0/2972411069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec80ca5e0 0x7f0ec816a8e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:26.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 >> 172.21.15.142:0/2972411069 conn(0x7f0ec80cb2f0 msgr2=0x7f0ec8158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:26.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 shutdown_connections 2023-09-30T22:52:26.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:26.959+0000 7f0ecd9ff700 1 -- 172.21.15.142:0/2972411069 wait complete. 2023-09-30T22:52:26.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:52:27.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.168+0000 7f6648bff700 1 Processor -- start 2023-09-30T22:52:27.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.168+0000 7f6648bff700 1 -- start start 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.170+0000 7f6648bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f664406d3f0 0x7f664406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.170+0000 7f6648bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664415dde0 con 0x7f66440c6da0 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.170+0000 7f6648bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664406b840 con 0x7f664415e270 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.170+0000 7f6648bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664415e710 con 0x7f664406d3f0 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.170+0000 7f664259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f664406d3f0 0x7f664406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.170+0000 7f6641d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f66440c6da0 0x7f664406b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45534/0 (socket says 172.21.15.142:45534) 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.170+0000 7f6641d9b700 1 -- 172.21.15.142:0/3396448592 learned_addr learned my addr 172.21.15.142:0/3396448592 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.171+0000 7f664259c700 1 -- 172.21.15.142:0/3396448592 >> v1:172.21.15.148:6789/0 conn(0x7f664415e270 legacy=0x7f6644159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.171+0000 7f664259c700 1 -- 172.21.15.142:0/3396448592 >> v1:172.21.15.142:6789/0 conn(0x7f66440c6da0 legacy=0x7f664406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.171+0000 7f664259c700 1 -- 172.21.15.142:0/3396448592 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664415d7d0 con 0x7f664406d3f0 2023-09-30T22:52:27.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.171+0000 7f664259c700 1 --2- 172.21.15.142:0/3396448592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f664406d3f0 0x7f664406d7c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6634009910 tx=0x7f66340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5310e0fba76a5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.171+0000 7f664159a700 1 -- 172.21.15.142:0/3396448592 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400b820 con 0x7f664406d3f0 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.171+0000 7f664159a700 1 -- 172.21.15.142:0/3396448592 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663400b980 con 0x7f664406d3f0 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.171+0000 7f664159a700 1 -- 172.21.15.142:0/3396448592 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400bd20 con 0x7f664406d3f0 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.172+0000 7f6648bff700 1 -- 172.21.15.142:0/3396448592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f664406d3f0 msgr2=0x7f664406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.172+0000 7f6648bff700 1 --2- 172.21.15.142:0/3396448592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f664406d3f0 0x7f664406d7c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6634009910 tx=0x7f66340091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.172+0000 7f6648bff700 1 -- 172.21.15.142:0/3396448592 shutdown_connections 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.172+0000 7f6648bff700 1 --2- 172.21.15.142:0/3396448592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f664406d3f0 0x7f664406d7c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.172+0000 7f6648bff700 1 -- 172.21.15.142:0/3396448592 >> 172.21.15.142:0/3396448592 conn(0x7f6644067e30 msgr2=0x7f6644068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.172+0000 7f6648bff700 1 -- 172.21.15.142:0/3396448592 shutdown_connections 2023-09-30T22:52:27.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.172+0000 7f6648bff700 1 -- 172.21.15.142:0/3396448592 wait complete. 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.173+0000 7f6648bff700 1 Processor -- start 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.173+0000 7f6648bff700 1 -- start start 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6648bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f664406d3f0 0x7f66440cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6648bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66440c6da0 0x7f66441580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6648bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f664415e270 0x7f6644158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6648bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664416b270 con 0x7f66440c6da0 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6648bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664416a660 con 0x7f664406d3f0 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6648bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664416a940 con 0x7f664415e270 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66440c6da0 0x7f66441580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66440c6da0 0x7f66441580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54190/0 (socket says 172.21.15.142:54190) 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.174+0000 7f6641d9b700 1 -- 172.21.15.142:0/736473336 learned_addr learned my addr 172.21.15.142:0/736473336 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f664259c700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f664406d3f0 0x7f66440cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6642d9d700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f664415e270 0x7f6644158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6641d9b700 1 -- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f664415e270 msgr2=0x7f6644158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6641d9b700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f664415e270 0x7f6644158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6641d9b700 1 -- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f664406d3f0 msgr2=0x7f66440cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6641d9b700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f664406d3f0 0x7f66440cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6641d9b700 1 -- 172.21.15.142:0/736473336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634009420 con 0x7f66440c6da0 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f664259c700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f664406d3f0 0x7f66440cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6642d9d700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f664415e270 0x7f6644158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6641d9b700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66440c6da0 0x7f66441580c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f663800c7c0 tx=0x7f6638007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:27.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f66327fc700 1 -- 172.21.15.142:0/736473336 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638005b30 con 0x7f66440c6da0 2023-09-30T22:52:27.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f66327fc700 1 -- 172.21.15.142:0/736473336 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638005cb0 con 0x7f66440c6da0 2023-09-30T22:52:27.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664416ac20 con 0x7f66440c6da0 2023-09-30T22:52:27.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f66327fc700 1 -- 172.21.15.142:0/736473336 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638004a80 con 0x7f66440c6da0 2023-09-30T22:52:27.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.175+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664414ef00 con 0x7f66440c6da0 2023-09-30T22:52:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.176+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664416b0c0 con 0x7f66440c6da0 2023-09-30T22:52:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.177+0000 7f66327fc700 1 -- 172.21.15.142:0/736473336 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f66380070f0 con 0x7f66440c6da0 2023-09-30T22:52:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.178+0000 7f66327fc700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6624067330 0x7f66240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.178+0000 7f66327fc700 1 -- 172.21.15.142:0/736473336 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6638083d80 con 0x7f66440c6da0 2023-09-30T22:52:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.179+0000 7f664259c700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6624067330 0x7f66240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.179+0000 7f664259c700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6624067330 0x7f66240697e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6644152e70 tx=0x7f6634017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.182+0000 7f66327fc700 1 -- 172.21.15.142:0/736473336 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6638050fb0 con 0x7f66440c6da0 2023-09-30T22:52:27.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.376+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66440c7230 con 0x7f66440c6da0 2023-09-30T22:52:27.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.377+0000 7f66327fc700 1 -- 172.21.15.142:0/736473336 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6638018020 con 0x7f66440c6da0 2023-09-30T22:52:27.377 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:27.377 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:52:27.378 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:52:27.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.379+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6624067330 msgr2=0x7f66240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.379+0000 7f6648bff700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6624067330 0x7f66240697e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6644152e70 tx=0x7f6634017000 comp rx=0 tx=0).stop 2023-09-30T22:52:27.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.379+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66440c6da0 msgr2=0x7f66441580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.379+0000 7f6648bff700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66440c6da0 0x7f66441580c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f663800c7c0 tx=0x7f6638007f70 comp rx=0 tx=0).stop 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 shutdown_connections 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6624067330 0x7f66240697e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f664415e270 0x7f6644158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f664406d3f0 0x7f66440cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 --2- 172.21.15.142:0/736473336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66440c6da0 0x7f66441580c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 >> 172.21.15.142:0/736473336 conn(0x7f6644067e30 msgr2=0x7f6644157290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 shutdown_connections 2023-09-30T22:52:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.380+0000 7f6648bff700 1 -- 172.21.15.142:0/736473336 wait complete. 2023-09-30T22:52:27.397 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:52:27.397 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:52:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.591+0000 7fb2eb1ff700 1 Processor -- start 2023-09-30T22:52:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.592+0000 7fb2eb1ff700 1 -- start start 2023-09-30T22:52:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.593+0000 7fb2eb1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e415ac40 0x7fb2e415a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.593+0000 7fb2eb1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e40d04e0 con 0x7fb2e40cc280 2023-09-30T22:52:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.593+0000 7fb2eb1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e40cc8f0 con 0x7fb2e40cf180 2023-09-30T22:52:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.593+0000 7fb2eb1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40cf8d0 con 0x7fb2e415ac40 2023-09-30T22:52:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.593+0000 7fb2e979c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb2e40cc280 0x7fb2e406a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45544/0 (socket says 172.21.15.142:45544) 2023-09-30T22:52:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.593+0000 7fb2e979c700 1 -- 172.21.15.142:0/3799294658 learned_addr learned my addr 172.21.15.142:0/3799294658 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.593+0000 7fb2e8f9b700 1 --2- 172.21.15.142:0/3799294658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e415ac40 0x7fb2e415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e37fe700 1 -- 172.21.15.142:0/3799294658 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883817610 0 0) 0x7fb2e40d04e0 con 0x7fb2e40cc280 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e37fe700 1 -- 172.21.15.142:0/3799294658 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d4003570 con 0x7fb2e40cc280 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e37fe700 1 -- 172.21.15.142:0/3799294658 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868946185 0 0) 0x7fb2e40cc8f0 con 0x7fb2e40cf180 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e37fe700 1 -- 172.21.15.142:0/3799294658 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e40d04e0 con 0x7fb2e40cf180 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e8f9b700 1 -- 172.21.15.142:0/3799294658 >> v1:172.21.15.148:6789/0 conn(0x7fb2e40cf180 legacy=0x7fb2e40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e8f9b700 1 -- 172.21.15.142:0/3799294658 >> v1:172.21.15.142:6789/0 conn(0x7fb2e40cc280 legacy=0x7fb2e406a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e8f9b700 1 -- 172.21.15.142:0/3799294658 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e40cfbb0 con 0x7fb2e415ac40 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e8f9b700 1 --2- 172.21.15.142:0/3799294658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e415ac40 0x7fb2e415a220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009910 tx=0x7fb2d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44565a64f1391ce4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e37fe700 1 -- 172.21.15.142:0/3799294658 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8011630 con 0x7fb2e415ac40 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e37fe700 1 -- 172.21.15.142:0/3799294658 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8011790 con 0x7fb2e415ac40 2023-09-30T22:52:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.594+0000 7fb2e37fe700 1 -- 172.21.15.142:0/3799294658 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8011b30 con 0x7fb2e415ac40 2023-09-30T22:52:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.595+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3799294658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e415ac40 msgr2=0x7fb2e415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.595+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3799294658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e415ac40 0x7fb2e415a220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009910 tx=0x7fb2d80091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.595+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3799294658 shutdown_connections 2023-09-30T22:52:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.595+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3799294658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e415ac40 0x7fb2e415a220 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.595+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3799294658 >> 172.21.15.142:0/3799294658 conn(0x7fb2e40d0a80 msgr2=0x7fb2e40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.595+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3799294658 shutdown_connections 2023-09-30T22:52:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.595+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3799294658 wait complete. 2023-09-30T22:52:27.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.596+0000 7fb2eb1ff700 1 Processor -- start 2023-09-30T22:52:27.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.597+0000 7fb2eb1ff700 1 -- start start 2023-09-30T22:52:27.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.597+0000 7fb2eb1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e40cc280 0x7fb2e416b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.597+0000 7fb2eb1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e40cf180 0x7fb2e4159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.597+0000 7fb2eb1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e415ac40 0x7fb2e40c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.597+0000 7fb2eb1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e416b9f0 con 0x7fb2e40cf180 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.597+0000 7fb2eb1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4155850 con 0x7fb2e415ac40 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.597+0000 7fb2eb1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4154c40 con 0x7fb2e40cc280 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e40cf180 0x7fb2e4159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e40cf180 0x7fb2e4159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54196/0 (socket says 172.21.15.142:54196) 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 -- 172.21.15.142:0/3946814552 learned_addr learned my addr 172.21.15.142:0/3946814552 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e8f9b700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e40cc280 0x7fb2e416b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e979c700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e415ac40 0x7fb2e40c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 -- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e40cc280 msgr2=0x7fb2e416b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e40cc280 0x7fb2e416b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 -- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e415ac40 msgr2=0x7fb2e40c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e415ac40 0x7fb2e40c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 -- 172.21.15.142:0/3946814552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009420 con 0x7fb2e40cf180 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e979c700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e415ac40 0x7fb2e40c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e3fff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e40cf180 0x7fb2e4159ae0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000c790 tx=0x7fb2d0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.598+0000 7fb2e0ff9700 1 -- 172.21.15.142:0/3946814552 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0010510 con 0x7fb2e40cf180 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.599+0000 7fb2e0ff9700 1 -- 172.21.15.142:0/3946814552 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0010670 con 0x7fb2e40cf180 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.599+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4154f20 con 0x7fb2e40cf180 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.599+0000 7fb2e0ff9700 1 -- 172.21.15.142:0/3946814552 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0010a30 con 0x7fb2e40cf180 2023-09-30T22:52:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.599+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e41554e0 con 0x7fb2e40cf180 2023-09-30T22:52:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.600+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e40b8330 con 0x7fb2e40cf180 2023-09-30T22:52:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.601+0000 7fb2e0ff9700 1 -- 172.21.15.142:0/3946814552 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb2d001b3b0 con 0x7fb2e40cf180 2023-09-30T22:52:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.601+0000 7fb2e0ff9700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb2c8067330 0x7fb2c80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.601+0000 7fb2e0ff9700 1 -- 172.21.15.142:0/3946814552 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb2d00841b0 con 0x7fb2e40cf180 2023-09-30T22:52:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.602+0000 7fb2e8f9b700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb2c8067330 0x7fb2c80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:27.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.602+0000 7fb2e8f9b700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb2c8067330 0x7fb2c80697e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009860 tx=0x7fb2d8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.605+0000 7fb2e0ff9700 1 -- 172.21.15.142:0/3946814552 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb2e40b8330 con 0x7fb2e40cf180 2023-09-30T22:52:27.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.795+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb2e40b8330 con 0x7fb2e40cf180 2023-09-30T22:52:27.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.973+0000 7fb2e0ff9700 1 -- 172.21.15.142:0/3946814552 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb2e40b8330 con 0x7fb2e40cf180 2023-09-30T22:52:27.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.976+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb2c8067330 msgr2=0x7fb2c80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.976+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb2c8067330 0x7fb2c80697e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009860 tx=0x7fb2d8017000 comp rx=0 tx=0).stop 2023-09-30T22:52:27.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.976+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e40cf180 msgr2=0x7fb2e4159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:27.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.976+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e40cf180 0x7fb2e4159ae0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000c790 tx=0x7fb2d0007e10 comp rx=0 tx=0).stop 2023-09-30T22:52:27.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.978+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 shutdown_connections 2023-09-30T22:52:27.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.978+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb2c8067330 0x7fb2c80697e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.978+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e415ac40 0x7fb2e40c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.978+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2e40cc280 0x7fb2e416b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.978+0000 7fb2eb1ff700 1 --2- 172.21.15.142:0/3946814552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e40cf180 0x7fb2e4159ae0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:27.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.978+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 >> 172.21.15.142:0/3946814552 conn(0x7fb2e40d0a80 msgr2=0x7fb2e406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:27.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.979+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 shutdown_connections 2023-09-30T22:52:27.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:27.980+0000 7fb2eb1ff700 1 -- 172.21.15.142:0/3946814552 wait complete. 2023-09-30T22:52:27.981 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:52:27.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:52:28.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.195+0000 7fb4e95ff700 1 Processor -- start 2023-09-30T22:52:28.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.195+0000 7fb4e95ff700 1 -- start start 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.196+0000 7fb4e95ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e41580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.196+0000 7fb4e95ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb4e40c40e0 0x7fb4e40c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.196+0000 7fb4e95ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40c38d0 con 0x7fb4e4141150 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.196+0000 7fb4e95ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40c4aa0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.196+0000 7fb4e95ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40c6aa0 con 0x7fb4e40c6270 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e27fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e41580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e27fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e41580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:36390/0 (socket says 172.21.15.142:36390) 2023-09-30T22:52:28.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e2ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb4e4141150 0x7fb4e415c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:44442/0 (socket says 172.21.15.142:44442) 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e37fe700 1 --2- 172.21.15.142:0/1178182642 >> v2:172.21.15.148:3300/0 conn(0x7fb4e40c40e0 0x7fb4e40c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e27fc700 1 -- 172.21.15.142:0/1178182642 learned_addr learned my addr 172.21.15.142:0/1178182642 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e1ffb700 1 -- 172.21.15.142:0/1178182642 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083219472 0 0) 0x7fb4e40c38d0 con 0x7fb4e4141150 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e1ffb700 1 -- 172.21.15.142:0/1178182642 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4cc003570 con 0x7fb4e4141150 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e37fe700 1 -- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 msgr2=0x7fb4e41580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e37fe700 1 --2- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e41580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e37fe700 1 -- 172.21.15.142:0/1178182642 >> v1:172.21.15.148:6789/0 conn(0x7fb4e4141150 legacy=0x7fb4e415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e37fe700 1 -- 172.21.15.142:0/1178182642 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e406a040 con 0x7fb4e40c40e0 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.197+0000 7fb4e27fc700 1 --2- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e41580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:28.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.198+0000 7fb4e37fe700 1 --2- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40c4560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009e60 tx=0x7fb4dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a59ec3a61e05370f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:28.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.198+0000 7fb4e1ffb700 1 -- 172.21.15.142:0/1178182642 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00e070 con 0x7fb4e40c40e0 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.198+0000 7fb4e1ffb700 1 -- 172.21.15.142:0/1178182642 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00bab0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.198+0000 7fb4e1ffb700 1 -- 172.21.15.142:0/1178182642 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00be70 con 0x7fb4e40c40e0 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.198+0000 7fb4e95ff700 1 -- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e40c40e0 msgr2=0x7fb4e40c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.198+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40c4560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009e60 tx=0x7fb4dc009780 comp rx=0 tx=0).stop 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.199+0000 7fb4e95ff700 1 -- 172.21.15.142:0/1178182642 shutdown_connections 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.199+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40c4560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.199+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/1178182642 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e41580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.199+0000 7fb4e95ff700 1 -- 172.21.15.142:0/1178182642 >> 172.21.15.142:0/1178182642 conn(0x7fb4e40cc670 msgr2=0x7fb4e40cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.199+0000 7fb4e95ff700 1 -- 172.21.15.142:0/1178182642 shutdown_connections 2023-09-30T22:52:28.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.199+0000 7fb4e95ff700 1 -- 172.21.15.142:0/1178182642 wait complete. 2023-09-30T22:52:28.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.200+0000 7fb4e95ff700 1 Processor -- start 2023-09-30T22:52:28.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.200+0000 7fb4e95ff700 1 -- start start 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e95ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40ba930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e95ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e4159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e95ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e4141150 0x7fb4e4159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e95ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40cbf60 con 0x7fb4e40c40e0 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e95ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e416ba70 con 0x7fb4e4141150 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e95ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40caa30 con 0x7fb4e40c6270 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40ba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40ba930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54206/0 (socket says 172.21.15.142:54206) 2023-09-30T22:52:28.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.201+0000 7fb4e2ffd700 1 -- 172.21.15.142:0/2174450871 learned_addr learned my addr 172.21.15.142:0/2174450871 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e27fc700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e37fe700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e4141150 0x7fb4e4159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e2ffd700 1 -- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 msgr2=0x7fb4e4159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e2ffd700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e4159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e2ffd700 1 -- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e4141150 msgr2=0x7fb4e4159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e2ffd700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e4141150 0x7fb4e4159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e2ffd700 1 -- 172.21.15.142:0/2174450871 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80094f0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e2ffd700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40ba930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400c590 tx=0x7fb4d4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4caffd700 1 -- 172.21.15.142:0/2174450871 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4005a70 con 0x7fb4e40c40e0 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4caffd700 1 -- 172.21.15.142:0/2174450871 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4005bf0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4caffd700 1 -- 172.21.15.142:0/2174450871 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40070d0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.202+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc009a20 con 0x7fb4e40c40e0 2023-09-30T22:52:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.203+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e40ca3e0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.203+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e40ca240 con 0x7fb4e40c40e0 2023-09-30T22:52:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.205+0000 7fb4caffd700 1 -- 172.21.15.142:0/2174450871 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb4d40074c0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.206+0000 7fb4caffd700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb4d0067330 0x7fb4d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:28.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.206+0000 7fb4caffd700 1 -- 172.21.15.142:0/2174450871 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fb4d4083ec0 con 0x7fb4e40c40e0 2023-09-30T22:52:28.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.206+0000 7fb4e27fc700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb4d0067330 0x7fb4d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:28.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.206+0000 7fb4e27fc700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb4d0067330 0x7fb4d00697e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8006d20 tx=0x7fb4d8009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:28.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.210+0000 7fb4caffd700 1 -- 172.21.15.142:0/2174450871 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb4e40ca240 con 0x7fb4e40c40e0 2023-09-30T22:52:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.401+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4e40ca240 con 0x7fb4e40c40e0 2023-09-30T22:52:28.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.983+0000 7fb4caffd700 1 -- 172.21.15.142:0/2174450871 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb4e40ca240 con 0x7fb4e40c40e0 2023-09-30T22:52:28.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.991+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb4d0067330 msgr2=0x7fb4d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:28.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.992+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb4d0067330 0x7fb4d00697e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8006d20 tx=0x7fb4d8009250 comp rx=0 tx=0).stop 2023-09-30T22:52:28.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.992+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c40e0 msgr2=0x7fb4e40ba930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:28.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.992+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40ba930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400c590 tx=0x7fb4d4007e00 comp rx=0 tx=0).stop 2023-09-30T22:52:28.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.994+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 shutdown_connections 2023-09-30T22:52:28.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.994+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb4d0067330 0x7fb4d00697e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.994+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4e4141150 0x7fb4e4159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.994+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c40e0 0x7fb4e40ba930 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400c590 tx=0x7fb4d4007e00 comp rx=0 tx=0).stop 2023-09-30T22:52:28.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.994+0000 7fb4e95ff700 1 --2- 172.21.15.142:0/2174450871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4e40c6270 0x7fb4e4159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:28.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.994+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 >> 172.21.15.142:0/2174450871 conn(0x7fb4e40cc670 msgr2=0x7fb4e413f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:28.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.998+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 shutdown_connections 2023-09-30T22:52:28.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:28.999+0000 7fb4e95ff700 1 -- 172.21.15.142:0/2174450871 wait complete. 2023-09-30T22:52:29.001 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:52:29.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:52:29.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.212+0000 7f9b6a9ff700 1 Processor -- start 2023-09-30T22:52:29.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.213+0000 7f9b6a9ff700 1 -- start start 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b6a9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b64157ab0 0x7f9b6415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b6a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cc3b0 0x7f9b640cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b6a9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b640d0550 con 0x7f9b640cbfe0 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b6a9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640cf750 con 0x7f9b64157ab0 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b6a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b640cf940 con 0x7f9b640cc3b0 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b637fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b64157ab0 0x7f9b6415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b63fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9b640cbfe0 0x7f9b641573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45560/0 (socket says 172.21.15.142:45560) 2023-09-30T22:52:29.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b63fff700 1 -- 172.21.15.142:0/2448348352 learned_addr learned my addr 172.21.15.142:0/2448348352 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.214+0000 7f9b68f9c700 1 --2- 172.21.15.142:0/2448348352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cc3b0 0x7f9b640cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b637fe700 1 -- 172.21.15.142:0/2448348352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cc3b0 msgr2=0x7f9b640cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b637fe700 1 --2- 172.21.15.142:0/2448348352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cc3b0 0x7f9b640cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b637fe700 1 -- 172.21.15.142:0/2448348352 >> v1:172.21.15.142:6789/0 conn(0x7f9b640cbfe0 legacy=0x7f9b641573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b637fe700 1 -- 172.21.15.142:0/2448348352 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b640cfc20 con 0x7f9b64157ab0 2023-09-30T22:52:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b62ffd700 1 -- 172.21.15.142:0/2448348352 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524278042 0 0) 0x7f9b640d0550 con 0x7f9b640cbfe0 2023-09-30T22:52:29.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b637fe700 1 --2- 172.21.15.142:0/2448348352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b6415a2a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9b580098e0 tx=0x7f9b580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d190804d86f29b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:29.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b62ffd700 1 -- 172.21.15.142:0/2448348352 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800b640 con 0x7f9b64157ab0 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b62ffd700 1 -- 172.21.15.142:0/2448348352 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800b7a0 con 0x7f9b64157ab0 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.215+0000 7f9b62ffd700 1 -- 172.21.15.142:0/2448348352 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800bb40 con 0x7f9b64157ab0 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/2448348352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 msgr2=0x7f9b6415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/2448348352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b6415a2a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9b580098e0 tx=0x7f9b580091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/2448348352 shutdown_connections 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/2448348352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cc3b0 0x7f9b640cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/2448348352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b6415a2a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/2448348352 >> 172.21.15.142:0/2448348352 conn(0x7f9b640d0a80 msgr2=0x7f9b640d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/2448348352 shutdown_connections 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.216+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/2448348352 wait complete. 2023-09-30T22:52:29.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.217+0000 7f9b6a9ff700 1 Processor -- start 2023-09-30T22:52:29.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.217+0000 7f9b6a9ff700 1 -- start start 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.218+0000 7f9b6a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cbfe0 0x7f9b64147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.218+0000 7f9b6a9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640cc3b0 0x7f9b64158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.218+0000 7f9b6a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b64159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.218+0000 7f9b6a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6416b740 con 0x7f9b64157ab0 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.218+0000 7f9b6a9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6416b990 con 0x7f9b640cc3b0 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.218+0000 7f9b6a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6416bc70 con 0x7f9b640cbfe0 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b64159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b64159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54214/0 (socket says 172.21.15.142:54214) 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 -- 172.21.15.142:0/52739609 learned_addr learned my addr 172.21.15.142:0/52739609 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b63fff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cbfe0 0x7f9b64147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:29.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b637fe700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640cc3b0 0x7f9b64158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 -- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cbfe0 msgr2=0x7f9b64147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cbfe0 0x7f9b64147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 -- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640cc3b0 msgr2=0x7f9b64158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640cc3b0 0x7f9b64158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 -- 172.21.15.142:0/52739609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58009420 con 0x7f9b64157ab0 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.219+0000 7f9b68f9c700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b64159420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009e90 tx=0x7f9b5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.220+0000 7f9b4bfff700 1 -- 172.21.15.142:0/52739609 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00cb70 con 0x7f9b64157ab0 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.220+0000 7f9b4bfff700 1 -- 172.21.15.142:0/52739609 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c00f040 con 0x7f9b64157ab0 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.220+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6416bf50 con 0x7f9b64157ab0 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.220+0000 7f9b4bfff700 1 -- 172.21.15.142:0/52739609 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c014480 con 0x7f9b64157ab0 2023-09-30T22:52:29.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.220+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b641479c0 con 0x7f9b64157ab0 2023-09-30T22:52:29.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.221+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6416c470 con 0x7f9b64157ab0 2023-09-30T22:52:29.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.222+0000 7f9b4bfff700 1 -- 172.21.15.142:0/52739609 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9b5c014830 con 0x7f9b64157ab0 2023-09-30T22:52:29.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.223+0000 7f9b4bfff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b50067330 0x7f9b500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:29.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.223+0000 7f9b4bfff700 1 -- 172.21.15.142:0/52739609 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f9b5c0855c0 con 0x7f9b64157ab0 2023-09-30T22:52:29.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.223+0000 7f9b63fff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b50067330 0x7f9b500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:29.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.224+0000 7f9b63fff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b50067330 0x7f9b500697e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b54007fd0 tx=0x7f9b54007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:29.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.228+0000 7f9b4bfff700 1 -- 172.21.15.142:0/52739609 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9b6416c470 con 0x7f9b64157ab0 2023-09-30T22:52:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:29.458+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9b6416c470 con 0x7f9b64157ab0 2023-09-30T22:52:30.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.237+0000 7f9b4bfff700 1 -- 172.21.15.142:0/52739609 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9b6416c470 con 0x7f9b64157ab0 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b50067330 msgr2=0x7f9b500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b50067330 0x7f9b500697e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b54007fd0 tx=0x7f9b54007d30 comp rx=0 tx=0).stop 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 msgr2=0x7f9b64159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b64159420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009e90 tx=0x7f9b5c00b040 comp rx=0 tx=0).stop 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 shutdown_connections 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b50067330 0x7f9b500697e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64157ab0 0x7f9b64159420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b640cbfe0 0x7f9b64147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 --2- 172.21.15.142:0/52739609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640cc3b0 0x7f9b64158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.240+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 >> 172.21.15.142:0/52739609 conn(0x7f9b640d0a80 msgr2=0x7f9b64156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:30.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.241+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 shutdown_connections 2023-09-30T22:52:30.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.241+0000 7f9b6a9ff700 1 -- 172.21.15.142:0/52739609 wait complete. 2023-09-30T22:52:30.245 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 3 and data pool 4 2023-09-30T22:52:30.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:30.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.452+0000 7fd3999ff700 1 Processor -- start 2023-09-30T22:52:30.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.452+0000 7fd3999ff700 1 -- start start 2023-09-30T22:52:30.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd3999ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd3940c6da0 0x7fd39406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd3999ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39415dde0 con 0x7fd39406d3f0 2023-09-30T22:52:30.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd3999ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39406b840 con 0x7fd39415e270 2023-09-30T22:52:30.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd3999ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39415e710 con 0x7fd3940c6da0 2023-09-30T22:52:30.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd392ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd39406d3f0 0x7fd39406b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45566/0 (socket says 172.21.15.142:45566) 2023-09-30T22:52:30.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd392ffd700 1 -- 172.21.15.142:0/421338740 learned_addr learned my addr 172.21.15.142:0/421338740 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:30.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd3927fc700 1 --2- 172.21.15.142:0/421338740 >> v2:172.21.15.148:3300/0 conn(0x7fd3940c6da0 0x7fd39406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd391ffb700 1 -- 172.21.15.142:0/421338740 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280705647 0 0) 0x7fd39415dde0 con 0x7fd39406d3f0 2023-09-30T22:52:30.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd391ffb700 1 -- 172.21.15.142:0/421338740 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd37c003570 con 0x7fd39406d3f0 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd391ffb700 1 -- 172.21.15.142:0/421338740 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488313172 0 0) 0x7fd39406b840 con 0x7fd39415e270 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.454+0000 7fd391ffb700 1 -- 172.21.15.142:0/421338740 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39415dde0 con 0x7fd39415e270 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.455+0000 7fd3927fc700 1 -- 172.21.15.142:0/421338740 >> v1:172.21.15.148:6789/0 conn(0x7fd39415e270 legacy=0x7fd394159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.455+0000 7fd3927fc700 1 -- 172.21.15.142:0/421338740 >> v1:172.21.15.142:6789/0 conn(0x7fd39406d3f0 legacy=0x7fd39406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.455+0000 7fd3927fc700 1 -- 172.21.15.142:0/421338740 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39415d7d0 con 0x7fd3940c6da0 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.455+0000 7fd3927fc700 1 --2- 172.21.15.142:0/421338740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 0x7fd39406d7c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd388009910 tx=0x7fd3880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51283c768c937799 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.455+0000 7fd391ffb700 1 -- 172.21.15.142:0/421338740 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388011630 con 0x7fd3940c6da0 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.455+0000 7fd391ffb700 1 -- 172.21.15.142:0/421338740 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388011790 con 0x7fd3940c6da0 2023-09-30T22:52:30.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.455+0000 7fd391ffb700 1 -- 172.21.15.142:0/421338740 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388011b30 con 0x7fd3940c6da0 2023-09-30T22:52:30.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.456+0000 7fd3999ff700 1 -- 172.21.15.142:0/421338740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 msgr2=0x7fd39406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.456+0000 7fd3999ff700 1 --2- 172.21.15.142:0/421338740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 0x7fd39406d7c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd388009910 tx=0x7fd3880091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.456+0000 7fd3999ff700 1 -- 172.21.15.142:0/421338740 shutdown_connections 2023-09-30T22:52:30.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.456+0000 7fd3999ff700 1 --2- 172.21.15.142:0/421338740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 0x7fd39406d7c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.456+0000 7fd3999ff700 1 -- 172.21.15.142:0/421338740 >> 172.21.15.142:0/421338740 conn(0x7fd394067e30 msgr2=0x7fd394068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:30.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.456+0000 7fd3999ff700 1 -- 172.21.15.142:0/421338740 shutdown_connections 2023-09-30T22:52:30.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.456+0000 7fd3999ff700 1 -- 172.21.15.142:0/421338740 wait complete. 2023-09-30T22:52:30.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.458+0000 7fd3999ff700 1 Processor -- start 2023-09-30T22:52:30.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.458+0000 7fd3999ff700 1 -- start start 2023-09-30T22:52:30.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3999ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd39406d3f0 0x7fd3941499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3999ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 0x7fd39416b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3999ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39415e270 0x7fd3940cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3999ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394150340 con 0x7fd39406d3f0 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3999ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394149f00 con 0x7fd3940c6da0 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3999ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39416a8f0 con 0x7fd39415e270 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd39406d3f0 0x7fd3941499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd39406d3f0 0x7fd3941499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54228/0 (socket says 172.21.15.142:54228) 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 -- 172.21.15.142:0/3415575833 learned_addr learned my addr 172.21.15.142:0/3415575833 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3927fc700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 0x7fd39416b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd3937fe700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39415e270 0x7fd3940cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 -- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39415e270 msgr2=0x7fd3940cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39415e270 0x7fd3940cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 -- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 msgr2=0x7fd39416b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 0x7fd39416b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.459+0000 7fd392ffd700 1 -- 172.21.15.142:0/3415575833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009420 con 0x7fd39406d3f0 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.460+0000 7fd392ffd700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd39406d3f0 0x7fd3941499c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c790 tx=0x7fd384007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.460+0000 7fd37affd700 1 -- 172.21.15.142:0/3415575833 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384005b30 con 0x7fd39406d3f0 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.460+0000 7fd37affd700 1 -- 172.21.15.142:0/3415575833 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd384005c90 con 0x7fd39406d3f0 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.460+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39416abd0 con 0x7fd39406d3f0 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.460+0000 7fd37affd700 1 -- 172.21.15.142:0/3415575833 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384007300 con 0x7fd39406d3f0 2023-09-30T22:52:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.460+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39416b190 con 0x7fd39406d3f0 2023-09-30T22:52:30.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.461+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd394069420 con 0x7fd39406d3f0 2023-09-30T22:52:30.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.462+0000 7fd37affd700 1 -- 172.21.15.142:0/3415575833 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd38401b400 con 0x7fd39406d3f0 2023-09-30T22:52:30.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.462+0000 7fd37affd700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd380067330 0x7fd3800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.463+0000 7fd37affd700 1 -- 172.21.15.142:0/3415575833 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd384084780 con 0x7fd39406d3f0 2023-09-30T22:52:30.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.463+0000 7fd3927fc700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd380067330 0x7fd3800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.463+0000 7fd3927fc700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd380067330 0x7fd3800697e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3880093f0 tx=0x7fd388017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:30.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.467+0000 7fd37affd700 1 -- 172.21.15.142:0/3415575833 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd3840550f0 con 0x7fd39406d3f0 2023-09-30T22:52:30.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.656+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3940c7230 con 0x7fd39406d3f0 2023-09-30T22:52:30.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.657+0000 7fd37affd700 1 -- 172.21.15.142:0/3415575833 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fd3840076f0 con 0x7fd39406d3f0 2023-09-30T22:52:30.657 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:30.658 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":22,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:29.459314+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd380067330 msgr2=0x7fd3800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd380067330 0x7fd3800697e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3880093f0 tx=0x7fd388017000 comp rx=0 tx=0).stop 2023-09-30T22:52:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd39406d3f0 msgr2=0x7fd3941499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd39406d3f0 0x7fd3941499c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c790 tx=0x7fd384007ea0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 shutdown_connections 2023-09-30T22:52:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd380067330 0x7fd3800697e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39415e270 0x7fd3940cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd39406d3f0 0x7fd3941499c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 --2- 172.21.15.142:0/3415575833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3940c6da0 0x7fd39416b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 >> 172.21.15.142:0/3415575833 conn(0x7fd394067e30 msgr2=0x7fd394157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 shutdown_connections 2023-09-30T22:52:30.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.659+0000 7fd3999ff700 1 -- 172.21.15.142:0/3415575833 wait complete. 2023-09-30T22:52:30.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:30.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.866+0000 7f0d25dff700 1 Processor -- start 2023-09-30T22:52:30.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.866+0000 7f0d25dff700 1 -- start start 2023-09-30T22:52:30.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d25dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d200c6da0 0x7f0d2006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d25dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d2015e270 0x7f0d20159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d25dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2015dde0 con 0x7f0d2006d3f0 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d25dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2015e710 con 0x7f0d200c6da0 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d25dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2006b840 con 0x7f0d2015e270 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d1f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0d2006d3f0 0x7f0d2006b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45580/0 (socket says 172.21.15.142:45580) 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d1f7fe700 1 -- 172.21.15.142:0/1123836184 learned_addr learned my addr 172.21.15.142:0/1123836184 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d1effd700 1 --2- 172.21.15.142:0/1123836184 >> v2:172.21.15.142:3300/0 conn(0x7f0d200c6da0 0x7f0d2006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.867+0000 7f0d1ffff700 1 --2- 172.21.15.142:0/1123836184 >> v2:172.21.15.148:3300/0 conn(0x7f0d2015e270 0x7f0d20159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1e7fc700 1 -- 172.21.15.142:0/1123836184 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798666905 0 0) 0x7f0d2015dde0 con 0x7f0d2006d3f0 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1e7fc700 1 -- 172.21.15.142:0/1123836184 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d08003570 con 0x7f0d2006d3f0 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1effd700 1 -- 172.21.15.142:0/1123836184 >> v2:172.21.15.148:3300/0 conn(0x7f0d2015e270 msgr2=0x7f0d20159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1effd700 1 --2- 172.21.15.142:0/1123836184 >> v2:172.21.15.148:3300/0 conn(0x7f0d2015e270 0x7f0d20159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1effd700 1 -- 172.21.15.142:0/1123836184 >> v1:172.21.15.142:6789/0 conn(0x7f0d2006d3f0 legacy=0x7f0d2006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1effd700 1 -- 172.21.15.142:0/1123836184 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2015d7d0 con 0x7f0d200c6da0 2023-09-30T22:52:30.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1effd700 1 --2- 172.21.15.142:0/1123836184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d200c6da0 0x7f0d2006d7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d140098e0 tx=0x7f0d140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a953d216da6949 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:30.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1e7fc700 1 -- 172.21.15.142:0/1123836184 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14011630 con 0x7f0d200c6da0 2023-09-30T22:52:30.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1e7fc700 1 -- 172.21.15.142:0/1123836184 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d14011790 con 0x7f0d200c6da0 2023-09-30T22:52:30.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.868+0000 7f0d1e7fc700 1 -- 172.21.15.142:0/1123836184 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14011b30 con 0x7f0d200c6da0 2023-09-30T22:52:30.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 -- 172.21.15.142:0/1123836184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d200c6da0 msgr2=0x7f0d2006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 --2- 172.21.15.142:0/1123836184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d200c6da0 0x7f0d2006d7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d140098e0 tx=0x7f0d140091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 -- 172.21.15.142:0/1123836184 shutdown_connections 2023-09-30T22:52:30.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 --2- 172.21.15.142:0/1123836184 >> v2:172.21.15.148:3300/0 conn(0x7f0d2015e270 0x7f0d20159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 --2- 172.21.15.142:0/1123836184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d200c6da0 0x7f0d2006d7c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 -- 172.21.15.142:0/1123836184 >> 172.21.15.142:0/1123836184 conn(0x7f0d20067e30 msgr2=0x7f0d20068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:30.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 -- 172.21.15.142:0/1123836184 shutdown_connections 2023-09-30T22:52:30.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.869+0000 7f0d25dff700 1 -- 172.21.15.142:0/1123836184 wait complete. 2023-09-30T22:52:30.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.870+0000 7f0d25dff700 1 Processor -- start 2023-09-30T22:52:30.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.871+0000 7f0d25dff700 1 -- start start 2023-09-30T22:52:30.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.871+0000 7f0d25dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2006d3f0 0x7f0d2014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.871+0000 7f0d25dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200c6da0 0x7f0d2014bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.871+0000 7f0d25dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d2015e270 0x7f0d2014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.871+0000 7f0d25dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20149f80 con 0x7f0d2006d3f0 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.871+0000 7f0d25dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2014e8b0 con 0x7f0d2015e270 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.871+0000 7f0d25dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2014c660 con 0x7f0d200c6da0 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2006d3f0 0x7f0d2014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2006d3f0 0x7f0d2014d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54250/0 (socket says 172.21.15.142:54250) 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 -- 172.21.15.142:0/2946615389 learned_addr learned my addr 172.21.15.142:0/2946615389 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1ffff700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d2015e270 0x7f0d2014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1effd700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200c6da0 0x7f0d2014bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 -- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200c6da0 msgr2=0x7f0d2014bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200c6da0 0x7f0d2014bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 -- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d2015e270 msgr2=0x7f0d2014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:30.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d2015e270 0x7f0d2014a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 -- 172.21.15.142:0/2946615389 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14009420 con 0x7f0d2006d3f0 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1effd700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200c6da0 0x7f0d2014bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d1f7fe700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2006d3f0 0x7f0d2014d7e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000c7f0 tx=0x7f0d10007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.872+0000 7f0d077fe700 1 -- 172.21.15.142:0/2946615389 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10005b30 con 0x7f0d2006d3f0 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.873+0000 7f0d077fe700 1 -- 172.21.15.142:0/2946615389 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10005c90 con 0x7f0d2006d3f0 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.873+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2014eb00 con 0x7f0d2006d3f0 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.873+0000 7f0d077fe700 1 -- 172.21.15.142:0/2946615389 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10007320 con 0x7f0d2006d3f0 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.873+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2014ede0 con 0x7f0d2006d3f0 2023-09-30T22:52:30.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.874+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d20069420 con 0x7f0d2006d3f0 2023-09-30T22:52:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.874+0000 7f0d077fe700 1 -- 172.21.15.142:0/2946615389 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0d1001b3b0 con 0x7f0d2006d3f0 2023-09-30T22:52:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.875+0000 7f0d077fe700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d0c067330 0x7f0d0c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.875+0000 7f0d077fe700 1 -- 172.21.15.142:0/2946615389 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0d10084260 con 0x7f0d2006d3f0 2023-09-30T22:52:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.876+0000 7f0d1effd700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d0c067330 0x7f0d0c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.876+0000 7f0d1effd700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d0c067330 0x7f0d0c0697e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d20151410 tx=0x7f0d14017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:30.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:30.880+0000 7f0d077fe700 1 -- 172.21.15.142:0/2946615389 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0d100510c0 con 0x7f0d2006d3f0 2023-09-30T22:52:31.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.077+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d200c7230 con 0x7f0d2006d3f0 2023-09-30T22:52:31.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.078+0000 7f0d077fe700 1 -- 172.21.15.142:0/2946615389 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f0d100546e0 con 0x7f0d2006d3f0 2023-09-30T22:52:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:31.079 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d0c067330 msgr2=0x7f0d0c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d0c067330 0x7f0d0c0697e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d20151410 tx=0x7f0d14017000 comp rx=0 tx=0).stop 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2006d3f0 msgr2=0x7f0d2014d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2006d3f0 0x7f0d2014d7e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000c7f0 tx=0x7f0d10007e00 comp rx=0 tx=0).stop 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 shutdown_connections 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d0c067330 0x7f0d0c0697e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d2015e270 0x7f0d2014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2006d3f0 0x7f0d2014d7e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 --2- 172.21.15.142:0/2946615389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d200c6da0 0x7f0d2014bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 >> 172.21.15.142:0/2946615389 conn(0x7f0d20067e30 msgr2=0x7f0d2015c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 shutdown_connections 2023-09-30T22:52:31.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.080+0000 7f0d25dff700 1 -- 172.21.15.142:0/2946615389 wait complete. 2023-09-30T22:52:31.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:52:31.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.292+0000 7f17d97ff700 1 Processor -- start 2023-09-30T22:52:31.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.293+0000 7f17d97ff700 1 -- start start 2023-09-30T22:52:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d97ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17d40cbfe0 0x7f17d415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d97ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f17d4157ab0 0x7f17d40cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d97ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40d0550 con 0x7f17d40cc3b0 2023-09-30T22:52:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d97ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40cf750 con 0x7f17d40cbfe0 2023-09-30T22:52:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d97ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40cf940 con 0x7f17d4157ab0 2023-09-30T22:52:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d2ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17d40cbfe0 0x7f17d415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d27fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f17d40cc3b0 0x7f17d41573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60282/0 (socket says 172.21.15.142:60282) 2023-09-30T22:52:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.294+0000 7f17d27fc700 1 -- 172.21.15.142:0/1370955091 learned_addr learned my addr 172.21.15.142:0/1370955091 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d37fe700 1 --2- 172.21.15.142:0/1370955091 >> v2:172.21.15.148:3300/0 conn(0x7f17d4157ab0 0x7f17d40cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d1ffb700 1 -- 172.21.15.142:0/1370955091 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172314675 0 0) 0x7f17d40d0550 con 0x7f17d40cc3b0 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d1ffb700 1 -- 172.21.15.142:0/1370955091 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17bc003570 con 0x7f17d40cc3b0 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d2ffd700 1 -- 172.21.15.142:0/1370955091 >> v2:172.21.15.148:3300/0 conn(0x7f17d4157ab0 msgr2=0x7f17d40cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d2ffd700 1 --2- 172.21.15.142:0/1370955091 >> v2:172.21.15.148:3300/0 conn(0x7f17d4157ab0 0x7f17d40cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d2ffd700 1 -- 172.21.15.142:0/1370955091 >> v1:172.21.15.142:6789/0 conn(0x7f17d40cc3b0 legacy=0x7f17d41573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d2ffd700 1 -- 172.21.15.142:0/1370955091 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40cfc20 con 0x7f17d40cbfe0 2023-09-30T22:52:31.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d37fe700 1 --2- 172.21.15.142:0/1370955091 >> v2:172.21.15.148:3300/0 conn(0x7f17d4157ab0 0x7f17d40cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d2ffd700 1 --2- 172.21.15.142:0/1370955091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d415a2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17d40ceaf0 tx=0x7f17c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3625200aa6215d5f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d1ffb700 1 -- 172.21.15.142:0/1370955091 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4011630 con 0x7f17d40cbfe0 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d1ffb700 1 -- 172.21.15.142:0/1370955091 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4011790 con 0x7f17d40cbfe0 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.295+0000 7f17d1ffb700 1 -- 172.21.15.142:0/1370955091 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4011b30 con 0x7f17d40cbfe0 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 -- 172.21.15.142:0/1370955091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 msgr2=0x7f17d415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 --2- 172.21.15.142:0/1370955091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d415a2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17d40ceaf0 tx=0x7f17c40091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 -- 172.21.15.142:0/1370955091 shutdown_connections 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 --2- 172.21.15.142:0/1370955091 >> v2:172.21.15.148:3300/0 conn(0x7f17d4157ab0 0x7f17d40cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 --2- 172.21.15.142:0/1370955091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d415a2a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 -- 172.21.15.142:0/1370955091 >> 172.21.15.142:0/1370955091 conn(0x7f17d40d0a80 msgr2=0x7f17d40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 -- 172.21.15.142:0/1370955091 shutdown_connections 2023-09-30T22:52:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.296+0000 7f17d97ff700 1 -- 172.21.15.142:0/1370955091 wait complete. 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.297+0000 7f17d97ff700 1 Processor -- start 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.297+0000 7f17d97ff700 1 -- start start 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.298+0000 7f17d97ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d4155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.298+0000 7f17d97ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17d40cc3b0 0x7f17d40b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.298+0000 7f17d97ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17d4157ab0 0x7f17d415c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.298+0000 7f17d97ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4155f60 con 0x7f17d40cbfe0 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.298+0000 7f17d97ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c5640 con 0x7f17d4157ab0 2023-09-30T22:52:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.298+0000 7f17d97ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c5920 con 0x7f17d40cc3b0 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d4155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d4155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57008/0 (socket says 172.21.15.142:57008) 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 -- 172.21.15.142:0/2015021609 learned_addr learned my addr 172.21.15.142:0/2015021609 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d27fc700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17d40cc3b0 0x7f17d40b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d37fe700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17d4157ab0 0x7f17d415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 -- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17d40cc3b0 msgr2=0x7f17d40b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17d40cc3b0 0x7f17d40b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 -- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17d4157ab0 msgr2=0x7f17d415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17d4157ab0 0x7f17d415c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 -- 172.21.15.142:0/2015021609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4009420 con 0x7f17d40cbfe0 2023-09-30T22:52:31.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17d2ffd700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d4155a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17c40097b0 tx=0x7f17c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.299+0000 7f17baffd700 1 -- 172.21.15.142:0/2015021609 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4011b10 con 0x7f17d40cbfe0 2023-09-30T22:52:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.300+0000 7f17baffd700 1 -- 172.21.15.142:0/2015021609 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c40233f0 con 0x7f17d40cbfe0 2023-09-30T22:52:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.300+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d40c5c00 con 0x7f17d40cbfe0 2023-09-30T22:52:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.300+0000 7f17baffd700 1 -- 172.21.15.142:0/2015021609 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4023770 con 0x7f17d40cbfe0 2023-09-30T22:52:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.300+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d40c61c0 con 0x7f17d40cbfe0 2023-09-30T22:52:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.301+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d40cb590 con 0x7f17d40cbfe0 2023-09-30T22:52:31.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.302+0000 7f17baffd700 1 -- 172.21.15.142:0/2015021609 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f17c4023b20 con 0x7f17d40cbfe0 2023-09-30T22:52:31.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.302+0000 7f17baffd700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f17c0067330 0x7f17c00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:31.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.303+0000 7f17baffd700 1 -- 172.21.15.142:0/2015021609 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17c4085fd0 con 0x7f17d40cbfe0 2023-09-30T22:52:31.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.303+0000 7f17d27fc700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f17c0067330 0x7f17c00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:31.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.303+0000 7f17d27fc700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f17c0067330 0x7f17c00697e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17d406aad0 tx=0x7f17c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:31.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.307+0000 7f17baffd700 1 -- 172.21.15.142:0/2015021609 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f17c4052eb0 con 0x7f17d40cbfe0 2023-09-30T22:52:31.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:31.537+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f17d406fc10 con 0x7f17d40cbfe0 2023-09-30T22:52:32.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.249+0000 7f17baffd700 1 -- 172.21.15.142:0/2015021609 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f17c40564d0 con 0x7f17d40cbfe0 2023-09-30T22:52:32.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f17c0067330 msgr2=0x7f17c00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f17c0067330 0x7f17c00697e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17d406aad0 tx=0x7f17c8009040 comp rx=0 tx=0).stop 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 msgr2=0x7f17d4155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d4155a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17c40097b0 tx=0x7f17c4017000 comp rx=0 tx=0).stop 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 shutdown_connections 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f17c0067330 0x7f17c00697e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17d4157ab0 0x7f17d415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d40cbfe0 0x7f17d4155a20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 --2- 172.21.15.142:0/2015021609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17d40cc3b0 0x7f17d40b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 >> 172.21.15.142:0/2015021609 conn(0x7f17d40d0a80 msgr2=0x7f17d41567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 shutdown_connections 2023-09-30T22:52:32.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.252+0000 7f17d97ff700 1 -- 172.21.15.142:0/2015021609 wait complete. 2023-09-30T22:52:32.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:52:32.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.463+0000 7f7468fff700 1 Processor -- start 2023-09-30T22:52:32.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.463+0000 7f7468fff700 1 -- start start 2023-09-30T22:52:32.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.464+0000 7f7468fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464159f10 0x7f746406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:32.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.464+0000 7f7468fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7464067620 0x7f7464067aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:32.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.464+0000 7f7468fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746406b650 con 0x7f7464159b40 2023-09-30T22:52:32.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.464+0000 7f7468fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7464067fe0 con 0x7f7464067620 2023-09-30T22:52:32.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.464+0000 7f7468fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746406aa40 con 0x7f7464159f10 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.465+0000 7f7461d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464159f10 0x7f746406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.465+0000 7f7462d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7464067620 0x7f7464067aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.465+0000 7f746259c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7464159b40 0x7f74640683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48226/0 (socket says 172.21.15.142:48226) 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.465+0000 7f746259c700 1 -- 172.21.15.142:0/625208506 learned_addr learned my addr 172.21.15.142:0/625208506 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.465+0000 7f7462d9d700 1 -- 172.21.15.142:0/625208506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464159f10 msgr2=0x7f746406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.466+0000 7f7462d9d700 1 --2- 172.21.15.142:0/625208506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464159f10 0x7f746406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.466+0000 7f7462d9d700 1 -- 172.21.15.142:0/625208506 >> v1:172.21.15.148:6789/0 conn(0x7f7464159b40 legacy=0x7f74640683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.466+0000 7f7462d9d700 1 -- 172.21.15.142:0/625208506 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746406ad20 con 0x7f7464067620 2023-09-30T22:52:32.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.466+0000 7f7462d9d700 1 --2- 172.21.15.142:0/625208506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464067620 0x7f7464067aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f745c009e60 tx=0x7f745c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=383c597aa33c8b8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.466+0000 7f746159a700 1 -- 172.21.15.142:0/625208506 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00e070 con 0x7f7464067620 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.466+0000 7f746159a700 1 -- 172.21.15.142:0/625208506 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c00bb60 con 0x7f7464067620 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.466+0000 7f746159a700 1 -- 172.21.15.142:0/625208506 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c012430 con 0x7f7464067620 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 -- 172.21.15.142:0/625208506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464067620 msgr2=0x7f7464067aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 --2- 172.21.15.142:0/625208506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464067620 0x7f7464067aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f745c009e60 tx=0x7f745c009780 comp rx=0 tx=0).stop 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 -- 172.21.15.142:0/625208506 shutdown_connections 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 --2- 172.21.15.142:0/625208506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464067620 0x7f7464067aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 --2- 172.21.15.142:0/625208506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464159f10 0x7f746406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 -- 172.21.15.142:0/625208506 >> 172.21.15.142:0/625208506 conn(0x7f74640c9950 msgr2=0x7f74640c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:32.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 -- 172.21.15.142:0/625208506 shutdown_connections 2023-09-30T22:52:32.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.467+0000 7f7468fff700 1 -- 172.21.15.142:0/625208506 wait complete. 2023-09-30T22:52:32.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.468+0000 7f7468fff700 1 Processor -- start 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.468+0000 7f7468fff700 1 -- start start 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.469+0000 7f7468fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464067620 0x7f746416a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.469+0000 7f7468fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7464159b40 0x7f746416d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.469+0000 7f7468fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464159f10 0x7f74640c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.469+0000 7f7468fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640c3f90 con 0x7f7464159b40 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.469+0000 7f7468fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640c41e0 con 0x7f7464159f10 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.469+0000 7f7468fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640c44c0 con 0x7f7464067620 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7464159b40 0x7f746416d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7464159b40 0x7f746416d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57016/0 (socket says 172.21.15.142:57016) 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 -- 172.21.15.142:0/2180645928 learned_addr learned my addr 172.21.15.142:0/2180645928 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:32.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f746259c700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464067620 0x7f746416a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 -- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464067620 msgr2=0x7f746416a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464067620 0x7f746416a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7462d9d700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464159f10 0x7f74640c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 -- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464159f10 msgr2=0x7f74640c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464159f10 0x7f74640c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 -- 172.21.15.142:0/2180645928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c009a20 con 0x7f7464159b40 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7462d9d700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464159f10 0x7f74640c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f7461d9b700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7464159b40 0x7f746416d240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f745800e930 tx=0x7f74580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f74527fc700 1 -- 172.21.15.142:0/2180645928 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745800eed0 con 0x7f7464159b40 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.470+0000 7f74527fc700 1 -- 172.21.15.142:0/2180645928 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745800c850 con 0x7f7464159b40 2023-09-30T22:52:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.471+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74640c47a0 con 0x7f7464159b40 2023-09-30T22:52:32.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.471+0000 7f74527fc700 1 -- 172.21.15.142:0/2180645928 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745800cbf0 con 0x7f7464159b40 2023-09-30T22:52:32.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.471+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74640b1ce0 con 0x7f7464159b40 2023-09-30T22:52:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.472+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74640c4320 con 0x7f7464159b40 2023-09-30T22:52:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.473+0000 7f74527fc700 1 -- 172.21.15.142:0/2180645928 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7458013470 con 0x7f7464159b40 2023-09-30T22:52:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.474+0000 7f74527fc700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7444067330 0x7f74440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.474+0000 7f74527fc700 1 -- 172.21.15.142:0/2180645928 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7458084e00 con 0x7f7464159b40 2023-09-30T22:52:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.474+0000 7f746259c700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7444067330 0x7f74440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.474+0000 7f746259c700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7444067330 0x7f74440697e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7454001780 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:32.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.478+0000 7f74527fc700 1 -- 172.21.15.142:0/2180645928 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f74640c4320 con 0x7f7464159b40 2023-09-30T22:52:32.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:32.712+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f74640c4320 con 0x7f7464159b40 2023-09-30T22:52:33.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.254+0000 7f74527fc700 1 -- 172.21.15.142:0/2180645928 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74640c4320 con 0x7f7464159b40 2023-09-30T22:52:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7444067330 msgr2=0x7f74440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7444067330 0x7f74440697e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7454001780 tx=0x7f7454009040 comp rx=0 tx=0).stop 2023-09-30T22:52:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7464159b40 msgr2=0x7f746416d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7464159b40 0x7f746416d240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f745800e930 tx=0x7f74580091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 shutdown_connections 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7444067330 0x7f74440697e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7464159f10 0x7f74640c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7464067620 0x7f746416a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 --2- 172.21.15.142:0/2180645928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7464159b40 0x7f746416d240 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 >> 172.21.15.142:0/2180645928 conn(0x7f74640c9950 msgr2=0x7f7464156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 shutdown_connections 2023-09-30T22:52:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.257+0000 7f7468fff700 1 -- 172.21.15.142:0/2180645928 wait complete. 2023-09-30T22:52:33.277 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:52:33.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.467+0000 7f67f6fff700 1 Processor -- start 2023-09-30T22:52:33.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.467+0000 7f67f6fff700 1 -- start start 2023-09-30T22:52:33.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.469+0000 7f67f6fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67f006b3d0 0x7f67f00b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.469+0000 7f67f6fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f006d470 con 0x7f67f00b1f40 2023-09-30T22:52:33.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.469+0000 7f67f6fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f0157e60 con 0x7f67f0157a90 2023-09-30T22:52:33.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.469+0000 7f67f6fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f00b2380 con 0x7f67f006b3d0 2023-09-30T22:52:33.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.469+0000 7f67effff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67f006b3d0 0x7f67f00b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.469+0000 7f67f559c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f67f00b1f40 0x7f67f006d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60288/0 (socket says 172.21.15.142:60288) 2023-09-30T22:52:33.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67f559c700 1 -- 172.21.15.142:0/2171343762 learned_addr learned my addr 172.21.15.142:0/2171343762 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:33.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67effff700 1 -- 172.21.15.142:0/2171343762 >> v1:172.21.15.148:6789/0 conn(0x7f67f0157a90 legacy=0x7f67f015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67effff700 1 -- 172.21.15.142:0/2171343762 >> v1:172.21.15.142:6789/0 conn(0x7f67f00b1f40 legacy=0x7f67f006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67ef7fe700 1 -- 172.21.15.142:0/2171343762 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354089759 0 0) 0x7f67f0157e60 con 0x7f67f0157a90 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67effff700 1 -- 172.21.15.142:0/2171343762 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00ae880 con 0x7f67f006b3d0 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67effff700 1 --2- 172.21.15.142:0/2171343762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f00b1a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0098e0 tx=0x7f67dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9c5cce28b192ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67ef7fe700 1 -- 172.21.15.142:0/2171343762 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc009e80 con 0x7f67f006b3d0 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67ef7fe700 1 -- 172.21.15.142:0/2171343762 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc00b760 con 0x7f67f006b3d0 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.470+0000 7f67ef7fe700 1 -- 172.21.15.142:0/2171343762 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00bae0 con 0x7f67f006b3d0 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.471+0000 7f67f6fff700 1 -- 172.21.15.142:0/2171343762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 msgr2=0x7f67f00b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.471+0000 7f67f6fff700 1 --2- 172.21.15.142:0/2171343762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f00b1a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0098e0 tx=0x7f67dc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.471+0000 7f67f6fff700 1 -- 172.21.15.142:0/2171343762 shutdown_connections 2023-09-30T22:52:33.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.471+0000 7f67f6fff700 1 --2- 172.21.15.142:0/2171343762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f00b1a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.471+0000 7f67f6fff700 1 -- 172.21.15.142:0/2171343762 >> 172.21.15.142:0/2171343762 conn(0x7f67f00680c0 msgr2=0x7f67f00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:33.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.471+0000 7f67f6fff700 1 -- 172.21.15.142:0/2171343762 shutdown_connections 2023-09-30T22:52:33.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.471+0000 7f67f6fff700 1 -- 172.21.15.142:0/2171343762 wait complete. 2023-09-30T22:52:33.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.473+0000 7f67f6fff700 1 Processor -- start 2023-09-30T22:52:33.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.473+0000 7f67f6fff700 1 -- start start 2023-09-30T22:52:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.473+0000 7f67f6fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f014d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f6fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00b1f40 0x7f67f0158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f6fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f0157a90 0x7f67f0158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f6fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f014df40 con 0x7f67f006b3d0 2023-09-30T22:52:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f6fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f014bf20 con 0x7f67f0157a90 2023-09-30T22:52:33.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f6fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f015ada0 con 0x7f67f00b1f40 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f014d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57030/0 (socket says 172.21.15.142:57030) 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 -- 172.21.15.142:0/3420830405 learned_addr learned my addr 172.21.15.142:0/3420830405 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67effff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00b1f40 0x7f67f0158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f559c700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f0157a90 0x7f67f0158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 -- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00b1f40 msgr2=0x7f67f0158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00b1f40 0x7f67f0158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 -- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f0157a90 msgr2=0x7f67f0158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f0157a90 0x7f67f0158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 -- 172.21.15.142:0/3420830405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc009420 con 0x7f67f006b3d0 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.474+0000 7f67f4d9b700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f014d960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67e400c5e0 tx=0x7f67e4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.475+0000 7f67ecff9700 1 -- 172.21.15.142:0/3420830405 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4011590 con 0x7f67f006b3d0 2023-09-30T22:52:33.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.475+0000 7f67ecff9700 1 -- 172.21.15.142:0/3420830405 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4011710 con 0x7f67f006b3d0 2023-09-30T22:52:33.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.475+0000 7f67ecff9700 1 -- 172.21.15.142:0/3420830405 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4011ad0 con 0x7f67f006b3d0 2023-09-30T22:52:33.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.475+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f014b5f0 con 0x7f67f006b3d0 2023-09-30T22:52:33.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.475+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f014bbb0 con 0x7f67f006b3d0 2023-09-30T22:52:33.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.476+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f0152d20 con 0x7f67f006b3d0 2023-09-30T22:52:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.477+0000 7f67ecff9700 1 -- 172.21.15.142:0/3420830405 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f67e401b3b0 con 0x7f67f006b3d0 2023-09-30T22:52:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.478+0000 7f67ecff9700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f67d4067330 0x7f67d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.478+0000 7f67ecff9700 1 -- 172.21.15.142:0/3420830405 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f67e40840c0 con 0x7f67f006b3d0 2023-09-30T22:52:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.478+0000 7f67effff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f67d4067330 0x7f67d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.478+0000 7f67effff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f67d4067330 0x7f67d40697e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67f006b7c0 tx=0x7f67dc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:33.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.482+0000 7f67ecff9700 1 -- 172.21.15.142:0/3420830405 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f67e4050fc0 con 0x7f67f006b3d0 2023-09-30T22:52:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.714+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67f006fc10 con 0x7f67f006b3d0 2023-09-30T22:52:33.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.715+0000 7f67ecff9700 1 -- 172.21.15.142:0/3420830405 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f67e40545e0 con 0x7f67f006b3d0 2023-09-30T22:52:33.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:33.716 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f67d4067330 msgr2=0x7f67d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f67d4067330 0x7f67d40697e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67f006b7c0 tx=0x7f67dc016000 comp rx=0 tx=0).stop 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 msgr2=0x7f67f014d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f014d960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67e400c5e0 tx=0x7f67e4007f60 comp rx=0 tx=0).stop 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 shutdown_connections 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f67d4067330 0x7f67d40697e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f0157a90 0x7f67f0158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f006b3d0 0x7f67f014d960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 --2- 172.21.15.142:0/3420830405 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00b1f40 0x7f67f0158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 >> 172.21.15.142:0/3420830405 conn(0x7f67f00680c0 msgr2=0x7f67f006ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 shutdown_connections 2023-09-30T22:52:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.717+0000 7f67f6fff700 1 -- 172.21.15.142:0/3420830405 wait complete. 2023-09-30T22:52:33.719 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:52:33.735 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:33.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.923+0000 7fa2c55ff700 1 Processor -- start 2023-09-30T22:52:33.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.923+0000 7fa2c55ff700 1 -- start start 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.924+0000 7fa2c55ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c006d3f0 0x7fa2c006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.924+0000 7fa2c55ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2c00c6da0 0x7fa2c015e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.924+0000 7fa2c55ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2c006b130 0x7fa2c0069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.924+0000 7fa2c55ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c015dde0 con 0x7fa2c00c6da0 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.924+0000 7fa2c55ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c015d7d0 con 0x7fa2c006b130 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.924+0000 7fa2c55ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c7230 con 0x7fa2c006d3f0 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.924+0000 7fa2be7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2c00c6da0 0x7fa2c015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2c00c6da0 0x7fa2c015e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57034/0 (socket says 172.21.15.142:57034) 2023-09-30T22:52:33.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2445397243 learned_addr learned my addr 172.21.15.142:0/2445397243 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2beffd700 1 --2- 172.21.15.142:0/2445397243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c006d3f0 0x7fa2c006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2bf7fe700 1 --2- 172.21.15.142:0/2445397243 >> v2:172.21.15.148:3300/0 conn(0x7fa2c006b130 0x7fa2c0069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2445397243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c006d3f0 msgr2=0x7fa2c006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 --2- 172.21.15.142:0/2445397243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c006d3f0 0x7fa2c006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2445397243 >> v2:172.21.15.148:3300/0 conn(0x7fa2c006b130 msgr2=0x7fa2c0069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 --2- 172.21.15.142:0/2445397243 >> v2:172.21.15.148:3300/0 conn(0x7fa2c006b130 0x7fa2c0069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2445397243 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c015da70 con 0x7fa2c00c6da0 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2be7fc700 1 --2- 172.21.15.142:0/2445397243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c00c6da0 0x7fa2c015e270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0069e90 tx=0x7fa2b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fba85e6fe714227 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:33.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2bdffb700 1 -- 172.21.15.142:0/2445397243 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400b640 con 0x7fa2c00c6da0 2023-09-30T22:52:33.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2bdffb700 1 -- 172.21.15.142:0/2445397243 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400b7a0 con 0x7fa2c00c6da0 2023-09-30T22:52:33.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.925+0000 7fa2bdffb700 1 -- 172.21.15.142:0/2445397243 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400bb60 con 0x7fa2c00c6da0 2023-09-30T22:52:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2445397243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c00c6da0 msgr2=0x7fa2c015e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2445397243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c00c6da0 0x7fa2c015e270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0069e90 tx=0x7fa2b4009250 comp rx=0 tx=0).stop 2023-09-30T22:52:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2445397243 shutdown_connections 2023-09-30T22:52:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2445397243 >> v2:172.21.15.148:3300/0 conn(0x7fa2c006b130 0x7fa2c0069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2445397243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c006d3f0 0x7fa2c006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2445397243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c00c6da0 0x7fa2c015e270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2445397243 >> 172.21.15.142:0/2445397243 conn(0x7fa2c0067e30 msgr2=0x7fa2c0068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2445397243 shutdown_connections 2023-09-30T22:52:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.926+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2445397243 wait complete. 2023-09-30T22:52:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.928+0000 7fa2c55ff700 1 Processor -- start 2023-09-30T22:52:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.928+0000 7fa2c55ff700 1 -- start start 2023-09-30T22:52:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2c55ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2c006b130 0x7fa2c014a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2c55ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c006d3f0 0x7fa2c0150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2c55ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c00c6da0 0x7fa2c014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2c55ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0169fe0 con 0x7fa2c006d3f0 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2c55ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c016a840 con 0x7fa2c006b130 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2c55ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c01511d0 con 0x7fa2c00c6da0 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c006d3f0 0x7fa2c0150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c006d3f0 0x7fa2c0150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57050/0 (socket says 172.21.15.142:57050) 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2915812786 learned_addr learned my addr 172.21.15.142:0/2915812786 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2beffd700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2c006b130 0x7fa2c014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2bf7fe700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c00c6da0 0x7fa2c014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c00c6da0 msgr2=0x7fa2c014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c00c6da0 0x7fa2c014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2c006b130 msgr2=0x7fa2c014a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2c006b130 0x7fa2c014a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2be7fc700 1 -- 172.21.15.142:0/2915812786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40094f0 con 0x7fa2c006d3f0 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.930+0000 7fa2bf7fe700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c00c6da0 0x7fa2c014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.931+0000 7fa2be7fc700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c006d3f0 0x7fa2c0150bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0067a40 tx=0x7fa2b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.931+0000 7fa2a6ffd700 1 -- 172.21.15.142:0/2915812786 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4000d10 con 0x7fa2c006d3f0 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.931+0000 7fa2a6ffd700 1 -- 172.21.15.142:0/2915812786 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400bb20 con 0x7fa2c006d3f0 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.931+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c016a1f0 con 0x7fa2c006d3f0 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.931+0000 7fa2a6ffd700 1 -- 172.21.15.142:0/2915812786 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4011670 con 0x7fa2c006d3f0 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.931+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c014e5f0 con 0x7fa2c006d3f0 2023-09-30T22:52:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.932+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c0069420 con 0x7fa2c006d3f0 2023-09-30T22:52:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.933+0000 7fa2a6ffd700 1 -- 172.21.15.142:0/2915812786 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa2b40119e0 con 0x7fa2c006d3f0 2023-09-30T22:52:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.934+0000 7fa2a6ffd700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2ac067330 0x7fa2ac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.934+0000 7fa2a6ffd700 1 -- 172.21.15.142:0/2915812786 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2b4086360 con 0x7fa2c006d3f0 2023-09-30T22:52:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.934+0000 7fa2beffd700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2ac067330 0x7fa2ac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.934+0000 7fa2beffd700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2ac067330 0x7fa2ac0697e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00cfbc0 tx=0x7fa2b00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:33.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:33.938+0000 7fa2a6ffd700 1 -- 172.21.15.142:0/2915812786 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa2b40531c0 con 0x7fa2c006d3f0 2023-09-30T22:52:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.132+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2c00c7510 con 0x7fa2c006d3f0 2023-09-30T22:52:34.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.133+0000 7fa2a6ffd700 1 -- 172.21.15.142:0/2915812786 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fa2b40567e0 con 0x7fa2c006d3f0 2023-09-30T22:52:34.133 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:34.133 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:34.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2ac067330 msgr2=0x7fa2ac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2ac067330 0x7fa2ac0697e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00cfbc0 tx=0x7fa2b00091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c006d3f0 msgr2=0x7fa2c0150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c006d3f0 0x7fa2c0150bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0067a40 tx=0x7fa2b4017000 comp rx=0 tx=0).stop 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 shutdown_connections 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2ac067330 0x7fa2ac0697e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2c00c6da0 0x7fa2c014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2c006b130 0x7fa2c014a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 --2- 172.21.15.142:0/2915812786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2c006d3f0 0x7fa2c0150bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 >> 172.21.15.142:0/2915812786 conn(0x7fa2c0067e30 msgr2=0x7fa2c01593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 shutdown_connections 2023-09-30T22:52:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.135+0000 7fa2c55ff700 1 -- 172.21.15.142:0/2915812786 wait complete. 2023-09-30T22:52:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:52:34.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:52:34.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.344+0000 7f89281ff700 1 Processor -- start 2023-09-30T22:52:34.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.344+0000 7f89281ff700 1 -- start start 2023-09-30T22:52:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f89281ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89201598e0 0x7f8920159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f89281ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89200cee50 0x7f89200d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f89281ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200cff40 con 0x7f892006b1c0 2023-09-30T22:52:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f89281ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89200d0910 con 0x7f89201598e0 2023-09-30T22:52:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f89281ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89200cf330 con 0x7f89200cee50 2023-09-30T22:52:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f892679c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f892006b1c0 0x7f892015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60290/0 (socket says 172.21.15.142:60290) 2023-09-30T22:52:34.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f892679c700 1 -- 172.21.15.142:0/2270676587 learned_addr learned my addr 172.21.15.142:0/2270676587 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:34.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f8925f9b700 1 --2- 172.21.15.142:0/2270676587 >> v2:172.21.15.142:3300/0 conn(0x7f89201598e0 0x7f8920159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f892579a700 1 --2- 172.21.15.142:0/2270676587 >> v2:172.21.15.148:3300/0 conn(0x7f89200cee50 0x7f89200d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f8925f9b700 1 -- 172.21.15.142:0/2270676587 >> v2:172.21.15.148:3300/0 conn(0x7f89200cee50 msgr2=0x7f89200d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:34.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f8925f9b700 1 --2- 172.21.15.142:0/2270676587 >> v2:172.21.15.148:3300/0 conn(0x7f89200cee50 0x7f89200d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f8925f9b700 1 -- 172.21.15.142:0/2270676587 >> v1:172.21.15.142:6789/0 conn(0x7f892006b1c0 legacy=0x7f892015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.346+0000 7f8925f9b700 1 -- 172.21.15.142:0/2270676587 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200cf610 con 0x7f89201598e0 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f8925f9b700 1 --2- 172.21.15.142:0/2270676587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89201598e0 0x7f8920159cb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89200b36f0 tx=0x7f891c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5de3100455139fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f8924f99700 1 -- 172.21.15.142:0/2270676587 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c011630 con 0x7f89201598e0 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f8924f99700 1 -- 172.21.15.142:0/2270676587 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c011790 con 0x7f89201598e0 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f8924f99700 1 -- 172.21.15.142:0/2270676587 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c011b30 con 0x7f89201598e0 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f89281ff700 1 -- 172.21.15.142:0/2270676587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89201598e0 msgr2=0x7f8920159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f89281ff700 1 --2- 172.21.15.142:0/2270676587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89201598e0 0x7f8920159cb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89200b36f0 tx=0x7f891c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f89281ff700 1 -- 172.21.15.142:0/2270676587 shutdown_connections 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f89281ff700 1 --2- 172.21.15.142:0/2270676587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89201598e0 0x7f8920159cb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f89281ff700 1 --2- 172.21.15.142:0/2270676587 >> v2:172.21.15.148:3300/0 conn(0x7f89200cee50 0x7f89200d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.347+0000 7f89281ff700 1 -- 172.21.15.142:0/2270676587 >> 172.21.15.142:0/2270676587 conn(0x7f89200cd540 msgr2=0x7f89200cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.348+0000 7f89281ff700 1 -- 172.21.15.142:0/2270676587 shutdown_connections 2023-09-30T22:52:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.348+0000 7f89281ff700 1 -- 172.21.15.142:0/2270676587 wait complete. 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.349+0000 7f89281ff700 1 Processor -- start 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.349+0000 7f89281ff700 1 -- start start 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f89281ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f892006b1c0 0x7f8920150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f89281ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89200cee50 0x7f89200c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f89281ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89201598e0 0x7f89200c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f89281ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892015b7a0 con 0x7f89200cee50 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f89281ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8920151490 con 0x7f89201598e0 2023-09-30T22:52:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f89281ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c4790 con 0x7f892006b1c0 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f892579a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89200cee50 0x7f89200c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f892579a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89200cee50 0x7f89200c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57064/0 (socket says 172.21.15.142:57064) 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.350+0000 7f892579a700 1 -- 172.21.15.142:0/1689583375 learned_addr learned my addr 172.21.15.142:0/1689583375 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892579a700 1 -- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f892006b1c0 msgr2=0x7f8920150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f8925f9b700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f892006b1c0 0x7f8920150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892679c700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89201598e0 0x7f89200c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892579a700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f892006b1c0 0x7f8920150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892579a700 1 -- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89201598e0 msgr2=0x7f89200c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892579a700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89201598e0 0x7f89200c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892579a700 1 -- 172.21.15.142:0/1689583375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009420 con 0x7f89200cee50 2023-09-30T22:52:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892679c700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89201598e0 0x7f89200c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f892579a700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89200cee50 0x7f89200c68a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f891000d8c0 tx=0x7f8910008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f8915ffb700 1 -- 172.21.15.142:0/1689583375 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000de60 con 0x7f89200cee50 2023-09-30T22:52:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f8915ffb700 1 -- 172.21.15.142:0/1689583375 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891000b780 con 0x7f89200cee50 2023-09-30T22:52:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f8915ffb700 1 -- 172.21.15.142:0/1689583375 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000bb20 con 0x7f89200cee50 2023-09-30T22:52:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892015af00 con 0x7f89200cee50 2023-09-30T22:52:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.351+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892015b4c0 con 0x7f89200cee50 2023-09-30T22:52:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.352+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89200c4560 con 0x7f89200cee50 2023-09-30T22:52:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.353+0000 7f8915ffb700 1 -- 172.21.15.142:0/1689583375 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f891001e460 con 0x7f89200cee50 2023-09-30T22:52:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.354+0000 7f8915ffb700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8904067330 0x7f89040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.354+0000 7f8915ffb700 1 -- 172.21.15.142:0/1689583375 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f89100852d0 con 0x7f89200cee50 2023-09-30T22:52:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.354+0000 7f8925f9b700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8904067330 0x7f89040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.355+0000 7f8925f9b700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8904067330 0x7f89040697e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f891c0091e0 tx=0x7f891c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:34.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.358+0000 7f8915ffb700 1 -- 172.21.15.142:0/1689583375 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f89200c4560 con 0x7f89200cee50 2023-09-30T22:52:34.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.541+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89200c4560 con 0x7f8904067330 2023-09-30T22:52:34.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.551+0000 7f8915ffb700 1 -- 172.21.15.142:0/1689583375 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278835 (secure 0 0 0) 0x7f89200c4560 con 0x7f8904067330 2023-09-30T22:52:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8904067330 msgr2=0x7f89040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8904067330 0x7f89040697e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f891c0091e0 tx=0x7f891c016000 comp rx=0 tx=0).stop 2023-09-30T22:52:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89200cee50 msgr2=0x7f89200c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89200cee50 0x7f89200c68a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f891000d8c0 tx=0x7f8910008040 comp rx=0 tx=0).stop 2023-09-30T22:52:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 shutdown_connections 2023-09-30T22:52:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8904067330 0x7f89040697e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89201598e0 0x7f89200c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f892006b1c0 0x7f8920150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 --2- 172.21.15.142:0/1689583375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89200cee50 0x7f89200c68a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 >> 172.21.15.142:0/1689583375 conn(0x7f89200cd540 msgr2=0x7f892015dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:34.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 shutdown_connections 2023-09-30T22:52:34.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.555+0000 7f89281ff700 1 -- 172.21.15.142:0/1689583375 wait complete. 2023-09-30T22:52:34.558 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:52:34.573 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-30T22:52:34.103147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560665,"statfs":{"total":1600000000,"available":1598121303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000951"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999723+0000","last_change":"2023-09-30T22:52:29.999656+0000","last_active":"2023-09-30T22:52:29.999723+0000","last_peered":"2023-09-30T22:52:29.999723+0000","last_clean":"2023-09-30T22:52:29.999723+0000","last_became_active":"2023-09-30T22:52:29.999224+0000","last_became_peered":"2023-09-30T22:52:29.999224+0000","last_unstale":"2023-09-30T22:52:29.999723+0000","last_undegraded":"2023-09-30T22:52:29.999723+0000","last_fullsized":"2023-09-30T22:52:29.999723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000978+0000","last_change":"2023-09-30T22:52:30.000930+0000","last_active":"2023-09-30T22:52:30.000978+0000","last_peered":"2023-09-30T22:52:30.000978+0000","last_clean":"2023-09-30T22:52:30.000978+0000","last_became_active":"2023-09-30T22:52:30.000733+0000","last_became_peered":"2023-09-30T22:52:30.000733+0000","last_unstale":"2023-09-30T22:52:30.000978+0000","last_undegraded":"2023-09-30T22:52:30.000978+0000","last_fullsized":"2023-09-30T22:52:30.000978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996453+0000","last_change":"2023-09-30T22:52:29.996378+0000","last_active":"2023-09-30T22:52:29.996453+0000","last_peered":"2023-09-30T22:52:29.996453+0000","last_clean":"2023-09-30T22:52:29.996453+0000","last_became_active":"2023-09-30T22:52:29.996139+0000","last_became_peered":"2023-09-30T22:52:29.996139+0000","last_unstale":"2023-09-30T22:52:29.996453+0000","last_undegraded":"2023-09-30T22:52:29.996453+0000","last_fullsized":"2023-09-30T22:52:29.996453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994761+0000","last_change":"2023-09-30T22:52:29.994384+0000","last_active":"2023-09-30T22:52:29.994761+0000","last_peered":"2023-09-30T22:52:29.994761+0000","last_clean":"2023-09-30T22:52:29.994761+0000","last_became_active":"2023-09-30T22:52:29.994168+0000","last_became_peered":"2023-09-30T22:52:29.994168+0000","last_unstale":"2023-09-30T22:52:29.994761+0000","last_undegraded":"2023-09-30T22:52:29.994761+0000","last_fullsized":"2023-09-30T22:52:29.994761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004482+0000","last_change":"2023-09-30T22:52:30.004022+0000","last_active":"2023-09-30T22:52:30.004482+0000","last_peered":"2023-09-30T22:52:30.004482+0000","last_clean":"2023-09-30T22:52:30.004482+0000","last_became_active":"2023-09-30T22:52:30.003781+0000","last_became_peered":"2023-09-30T22:52:30.003781+0000","last_unstale":"2023-09-30T22:52:30.004482+0000","last_undegraded":"2023-09-30T22:52:30.004482+0000","last_fullsized":"2023-09-30T22:52:30.004482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986014+0000","last_change":"2023-09-30T22:52:29.985910+0000","last_active":"2023-09-30T22:52:29.986014+0000","last_peered":"2023-09-30T22:52:29.986014+0000","last_clean":"2023-09-30T22:52:29.986014+0000","last_became_active":"2023-09-30T22:52:29.985698+0000","last_became_peered":"2023-09-30T22:52:29.985698+0000","last_unstale":"2023-09-30T22:52:29.986014+0000","last_undegraded":"2023-09-30T22:52:29.986014+0000","last_fullsized":"2023-09-30T22:52:29.986014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:02:40.635094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992823+0000","last_change":"2023-09-30T22:52:29.992580+0000","last_active":"2023-09-30T22:52:29.992823+0000","last_peered":"2023-09-30T22:52:29.992823+0000","last_clean":"2023-09-30T22:52:29.992823+0000","last_became_active":"2023-09-30T22:52:29.992055+0000","last_became_peered":"2023-09-30T22:52:29.992055+0000","last_unstale":"2023-09-30T22:52:29.992823+0000","last_undegraded":"2023-09-30T22:52:29.992823+0000","last_fullsized":"2023-09-30T22:52:29.992823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:25.419873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992925+0000","last_change":"2023-09-30T22:52:29.992763+0000","last_active":"2023-09-30T22:52:29.992925+0000","last_peered":"2023-09-30T22:52:29.992925+0000","last_clean":"2023-09-30T22:52:29.992925+0000","last_became_active":"2023-09-30T22:52:29.992537+0000","last_became_peered":"2023-09-30T22:52:29.992537+0000","last_unstale":"2023-09-30T22:52:29.992925+0000","last_undegraded":"2023-09-30T22:52:29.992925+0000","last_fullsized":"2023-09-30T22:52:29.992925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005650+0000","last_change":"2023-09-30T22:52:30.005579+0000","last_active":"2023-09-30T22:52:30.005650+0000","last_peered":"2023-09-30T22:52:30.005650+0000","last_clean":"2023-09-30T22:52:30.005650+0000","last_became_active":"2023-09-30T22:52:30.005151+0000","last_became_peered":"2023-09-30T22:52:30.005151+0000","last_unstale":"2023-09-30T22:52:30.005650+0000","last_undegraded":"2023-09-30T22:52:30.005650+0000","last_fullsized":"2023-09-30T22:52:30.005650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998463+0000","last_change":"2023-09-30T22:52:29.998403+0000","last_active":"2023-09-30T22:52:29.998463+0000","last_peered":"2023-09-30T22:52:29.998463+0000","last_clean":"2023-09-30T22:52:29.998463+0000","last_became_active":"2023-09-30T22:52:29.998170+0000","last_became_peered":"2023-09-30T22:52:29.998170+0000","last_unstale":"2023-09-30T22:52:29.998463+0000","last_undegraded":"2023-09-30T22:52:29.998463+0000","last_fullsized":"2023-09-30T22:52:29.998463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:51.188433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994173+0000","last_change":"2023-09-30T22:52:29.993975+0000","last_active":"2023-09-30T22:52:29.994173+0000","last_peered":"2023-09-30T22:52:29.994173+0000","last_clean":"2023-09-30T22:52:29.994173+0000","last_became_active":"2023-09-30T22:52:29.993354+0000","last_became_peered":"2023-09-30T22:52:29.993354+0000","last_unstale":"2023-09-30T22:52:29.994173+0000","last_undegraded":"2023-09-30T22:52:29.994173+0000","last_fullsized":"2023-09-30T22:52:29.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995287+0000","last_change":"2023-09-30T22:52:29.995056+0000","last_active":"2023-09-30T22:52:29.995287+0000","last_peered":"2023-09-30T22:52:29.995287+0000","last_clean":"2023-09-30T22:52:29.995287+0000","last_became_active":"2023-09-30T22:52:29.994501+0000","last_became_peered":"2023-09-30T22:52:29.994501+0000","last_unstale":"2023-09-30T22:52:29.995287+0000","last_undegraded":"2023-09-30T22:52:29.995287+0000","last_fullsized":"2023-09-30T22:52:29.995287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998543+0000","last_change":"2023-09-30T22:52:29.998468+0000","last_active":"2023-09-30T22:52:29.998543+0000","last_peered":"2023-09-30T22:52:29.998543+0000","last_clean":"2023-09-30T22:52:29.998543+0000","last_became_active":"2023-09-30T22:52:29.998228+0000","last_became_peered":"2023-09-30T22:52:29.998228+0000","last_unstale":"2023-09-30T22:52:29.998543+0000","last_undegraded":"2023-09-30T22:52:29.998543+0000","last_fullsized":"2023-09-30T22:52:29.998543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002051+0000","last_change":"2023-09-30T22:52:30.001990+0000","last_active":"2023-09-30T22:52:30.002051+0000","last_peered":"2023-09-30T22:52:30.002051+0000","last_clean":"2023-09-30T22:52:30.002051+0000","last_became_active":"2023-09-30T22:52:30.001493+0000","last_became_peered":"2023-09-30T22:52:30.001493+0000","last_unstale":"2023-09-30T22:52:30.002051+0000","last_undegraded":"2023-09-30T22:52:30.002051+0000","last_fullsized":"2023-09-30T22:52:30.002051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999408+0000","last_change":"2023-09-30T22:52:29.999359+0000","last_active":"2023-09-30T22:52:29.999408+0000","last_peered":"2023-09-30T22:52:29.999408+0000","last_clean":"2023-09-30T22:52:29.999408+0000","last_became_active":"2023-09-30T22:52:29.999214+0000","last_became_peered":"2023-09-30T22:52:29.999214+0000","last_unstale":"2023-09-30T22:52:29.999408+0000","last_undegraded":"2023-09-30T22:52:29.999408+0000","last_fullsized":"2023-09-30T22:52:29.999408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995996+0000","last_change":"2023-09-30T22:52:29.995287+0000","last_active":"2023-09-30T22:52:29.995996+0000","last_peered":"2023-09-30T22:52:29.995996+0000","last_clean":"2023-09-30T22:52:29.995996+0000","last_became_active":"2023-09-30T22:52:29.994795+0000","last_became_peered":"2023-09-30T22:52:29.994795+0000","last_unstale":"2023-09-30T22:52:29.995996+0000","last_undegraded":"2023-09-30T22:52:29.995996+0000","last_fullsized":"2023-09-30T22:52:29.995996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:15:33.668598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999673+0000","last_change":"2023-09-30T22:52:29.999604+0000","last_active":"2023-09-30T22:52:29.999673+0000","last_peered":"2023-09-30T22:52:29.999673+0000","last_clean":"2023-09-30T22:52:29.999673+0000","last_became_active":"2023-09-30T22:52:29.999184+0000","last_became_peered":"2023-09-30T22:52:29.999184+0000","last_unstale":"2023-09-30T22:52:29.999673+0000","last_undegraded":"2023-09-30T22:52:29.999673+0000","last_fullsized":"2023-09-30T22:52:29.999673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994780+0000","last_change":"2023-09-30T22:52:29.994681+0000","last_active":"2023-09-30T22:52:29.994780+0000","last_peered":"2023-09-30T22:52:29.994780+0000","last_clean":"2023-09-30T22:52:29.994780+0000","last_became_active":"2023-09-30T22:52:29.994446+0000","last_became_peered":"2023-09-30T22:52:29.994446+0000","last_unstale":"2023-09-30T22:52:29.994780+0000","last_undegraded":"2023-09-30T22:52:29.994780+0000","last_fullsized":"2023-09-30T22:52:29.994780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996185+0000","last_change":"2023-09-30T22:52:29.995754+0000","last_active":"2023-09-30T22:52:29.996185+0000","last_peered":"2023-09-30T22:52:29.996185+0000","last_clean":"2023-09-30T22:52:29.996185+0000","last_became_active":"2023-09-30T22:52:29.995499+0000","last_became_peered":"2023-09-30T22:52:29.995499+0000","last_unstale":"2023-09-30T22:52:29.996185+0000","last_undegraded":"2023-09-30T22:52:29.996185+0000","last_fullsized":"2023-09-30T22:52:29.996185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002210+0000","last_change":"2023-09-30T22:52:30.002133+0000","last_active":"2023-09-30T22:52:30.002210+0000","last_peered":"2023-09-30T22:52:30.002210+0000","last_clean":"2023-09-30T22:52:30.002210+0000","last_became_active":"2023-09-30T22:52:30.001781+0000","last_became_peered":"2023-09-30T22:52:30.001781+0000","last_unstale":"2023-09-30T22:52:30.002210+0000","last_undegraded":"2023-09-30T22:52:30.002210+0000","last_fullsized":"2023-09-30T22:52:30.002210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003659+0000","last_change":"2023-09-30T22:52:30.003616+0000","last_active":"2023-09-30T22:52:30.003659+0000","last_peered":"2023-09-30T22:52:30.003659+0000","last_clean":"2023-09-30T22:52:30.003659+0000","last_became_active":"2023-09-30T22:52:30.003350+0000","last_became_peered":"2023-09-30T22:52:30.003350+0000","last_unstale":"2023-09-30T22:52:30.003659+0000","last_undegraded":"2023-09-30T22:52:30.003659+0000","last_fullsized":"2023-09-30T22:52:30.003659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003184+0000","last_change":"2023-09-30T22:52:30.003114+0000","last_active":"2023-09-30T22:52:30.003184+0000","last_peered":"2023-09-30T22:52:30.003184+0000","last_clean":"2023-09-30T22:52:30.003184+0000","last_became_active":"2023-09-30T22:52:30.002889+0000","last_became_peered":"2023-09-30T22:52:30.002889+0000","last_unstale":"2023-09-30T22:52:30.003184+0000","last_undegraded":"2023-09-30T22:52:30.003184+0000","last_fullsized":"2023-09-30T22:52:30.003184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.006633+0000","last_change":"2023-09-30T22:52:30.006559+0000","last_active":"2023-09-30T22:52:30.006633+0000","last_peered":"2023-09-30T22:52:30.006633+0000","last_clean":"2023-09-30T22:52:30.006633+0000","last_became_active":"2023-09-30T22:52:30.006332+0000","last_became_peered":"2023-09-30T22:52:30.006332+0000","last_unstale":"2023-09-30T22:52:30.006633+0000","last_undegraded":"2023-09-30T22:52:30.006633+0000","last_fullsized":"2023-09-30T22:52:30.006633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002227+0000","last_change":"2023-09-30T22:52:30.002139+0000","last_active":"2023-09-30T22:52:30.002227+0000","last_peered":"2023-09-30T22:52:30.002227+0000","last_clean":"2023-09-30T22:52:30.002227+0000","last_became_active":"2023-09-30T22:52:30.001805+0000","last_became_peered":"2023-09-30T22:52:30.001805+0000","last_unstale":"2023-09-30T22:52:30.002227+0000","last_undegraded":"2023-09-30T22:52:30.002227+0000","last_fullsized":"2023-09-30T22:52:30.002227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001758+0000","last_change":"2023-09-30T22:52:30.001685+0000","last_active":"2023-09-30T22:52:30.001758+0000","last_peered":"2023-09-30T22:52:30.001758+0000","last_clean":"2023-09-30T22:52:30.001758+0000","last_became_active":"2023-09-30T22:52:30.001423+0000","last_became_peered":"2023-09-30T22:52:30.001423+0000","last_unstale":"2023-09-30T22:52:30.001758+0000","last_undegraded":"2023-09-30T22:52:30.001758+0000","last_fullsized":"2023-09-30T22:52:30.001758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005462+0000","last_change":"2023-09-30T22:52:30.004937+0000","last_active":"2023-09-30T22:52:30.005462+0000","last_peered":"2023-09-30T22:52:30.005462+0000","last_clean":"2023-09-30T22:52:30.005462+0000","last_became_active":"2023-09-30T22:52:30.004706+0000","last_became_peered":"2023-09-30T22:52:30.004706+0000","last_unstale":"2023-09-30T22:52:30.005462+0000","last_undegraded":"2023-09-30T22:52:30.005462+0000","last_fullsized":"2023-09-30T22:52:30.005462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992856+0000","last_change":"2023-09-30T22:52:29.992721+0000","last_active":"2023-09-30T22:52:29.992856+0000","last_peered":"2023-09-30T22:52:29.992856+0000","last_clean":"2023-09-30T22:52:29.992856+0000","last_became_active":"2023-09-30T22:52:29.992342+0000","last_became_peered":"2023-09-30T22:52:29.992342+0000","last_unstale":"2023-09-30T22:52:29.992856+0000","last_undegraded":"2023-09-30T22:52:29.992856+0000","last_fullsized":"2023-09-30T22:52:29.992856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:24.803074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248905+0000","last_change":"2023-09-30T22:52:28.998829+0000","last_active":"2023-09-30T22:52:30.248905+0000","last_peered":"2023-09-30T22:52:30.248905+0000","last_clean":"2023-09-30T22:52:30.248905+0000","last_became_active":"2023-09-30T22:52:28.998455+0000","last_became_peered":"2023-09-30T22:52:28.998455+0000","last_unstale":"2023-09-30T22:52:30.248905+0000","last_undegraded":"2023-09-30T22:52:30.248905+0000","last_fullsized":"2023-09-30T22:52:30.248905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998559+0000","last_change":"2023-09-30T22:52:29.998485+0000","last_active":"2023-09-30T22:52:29.998559+0000","last_peered":"2023-09-30T22:52:29.998559+0000","last_clean":"2023-09-30T22:52:29.998559+0000","last_became_active":"2023-09-30T22:52:29.998254+0000","last_became_peered":"2023-09-30T22:52:29.998254+0000","last_unstale":"2023-09-30T22:52:29.998559+0000","last_undegraded":"2023-09-30T22:52:29.998559+0000","last_fullsized":"2023-09-30T22:52:29.998559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992280+0000","last_change":"2023-09-30T22:52:28.992995+0000","last_active":"2023-09-30T22:52:29.992280+0000","last_peered":"2023-09-30T22:52:29.992280+0000","last_clean":"2023-09-30T22:52:29.992280+0000","last_became_active":"2023-09-30T22:52:28.992765+0000","last_became_peered":"2023-09-30T22:52:28.992765+0000","last_unstale":"2023-09-30T22:52:29.992280+0000","last_undegraded":"2023-09-30T22:52:29.992280+0000","last_fullsized":"2023-09-30T22:52:29.992280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004464+0000","last_change":"2023-09-30T22:52:30.003848+0000","last_active":"2023-09-30T22:52:30.004464+0000","last_peered":"2023-09-30T22:52:30.004464+0000","last_clean":"2023-09-30T22:52:30.004464+0000","last_became_active":"2023-09-30T22:52:30.002282+0000","last_became_peered":"2023-09-30T22:52:30.002282+0000","last_unstale":"2023-09-30T22:52:30.004464+0000","last_undegraded":"2023-09-30T22:52:30.004464+0000","last_fullsized":"2023-09-30T22:52:30.004464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991202+0000","last_change":"2023-09-30T22:52:28.998425+0000","last_active":"2023-09-30T22:52:29.991202+0000","last_peered":"2023-09-30T22:52:29.991202+0000","last_clean":"2023-09-30T22:52:29.991202+0000","last_became_active":"2023-09-30T22:52:28.998147+0000","last_became_peered":"2023-09-30T22:52:28.998147+0000","last_unstale":"2023-09-30T22:52:29.991202+0000","last_undegraded":"2023-09-30T22:52:29.991202+0000","last_fullsized":"2023-09-30T22:52:29.991202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996031+0000","last_change":"2023-09-30T22:52:29.995807+0000","last_active":"2023-09-30T22:52:29.996031+0000","last_peered":"2023-09-30T22:52:29.996031+0000","last_clean":"2023-09-30T22:52:29.996031+0000","last_became_active":"2023-09-30T22:52:29.995537+0000","last_became_peered":"2023-09-30T22:52:29.995537+0000","last_unstale":"2023-09-30T22:52:29.996031+0000","last_undegraded":"2023-09-30T22:52:29.996031+0000","last_fullsized":"2023-09-30T22:52:29.996031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:34.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993246+0000","last_change":"2023-09-30T22:52:28.998533+0000","last_active":"2023-09-30T22:52:29.993246+0000","last_peered":"2023-09-30T22:52:29.993246+0000","last_clean":"2023-09-30T22:52:29.993246+0000","last_became_active":"2023-09-30T22:52:28.998113+0000","last_became_peered":"2023-09-30T22:52:28.998113+0000","last_unstale":"2023-09-30T22:52:29.993246+0000","last_undegraded":"2023-09-30T22:52:29.993246+0000","last_fullsized":"2023-09-30T22:52:29.993246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993991+0000","last_change":"2023-09-30T22:52:29.993919+0000","last_active":"2023-09-30T22:52:29.993991+0000","last_peered":"2023-09-30T22:52:29.993991+0000","last_clean":"2023-09-30T22:52:29.993991+0000","last_became_active":"2023-09-30T22:52:29.993688+0000","last_became_peered":"2023-09-30T22:52:29.993688+0000","last_unstale":"2023-09-30T22:52:29.993991+0000","last_undegraded":"2023-09-30T22:52:29.993991+0000","last_fullsized":"2023-09-30T22:52:29.993991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983128+0000","last_change":"2023-09-30T22:52:28.996877+0000","last_active":"2023-09-30T22:52:29.983128+0000","last_peered":"2023-09-30T22:52:29.983128+0000","last_clean":"2023-09-30T22:52:29.983128+0000","last_became_active":"2023-09-30T22:52:28.996514+0000","last_became_peered":"2023-09-30T22:52:28.996514+0000","last_unstale":"2023-09-30T22:52:29.983128+0000","last_undegraded":"2023-09-30T22:52:29.983128+0000","last_fullsized":"2023-09-30T22:52:29.983128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999725+0000","last_change":"2023-09-30T22:52:29.999648+0000","last_active":"2023-09-30T22:52:29.999725+0000","last_peered":"2023-09-30T22:52:29.999725+0000","last_clean":"2023-09-30T22:52:29.999725+0000","last_became_active":"2023-09-30T22:52:29.999326+0000","last_became_peered":"2023-09-30T22:52:29.999326+0000","last_unstale":"2023-09-30T22:52:29.999725+0000","last_undegraded":"2023-09-30T22:52:29.999725+0000","last_fullsized":"2023-09-30T22:52:29.999725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245788+0000","last_change":"2023-09-30T22:52:28.989757+0000","last_active":"2023-09-30T22:52:30.245788+0000","last_peered":"2023-09-30T22:52:30.245788+0000","last_clean":"2023-09-30T22:52:30.245788+0000","last_became_active":"2023-09-30T22:52:28.989527+0000","last_became_peered":"2023-09-30T22:52:28.989527+0000","last_unstale":"2023-09-30T22:52:30.245788+0000","last_undegraded":"2023-09-30T22:52:30.245788+0000","last_fullsized":"2023-09-30T22:52:30.245788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002468+0000","last_change":"2023-09-30T22:52:30.001993+0000","last_active":"2023-09-30T22:52:30.002468+0000","last_peered":"2023-09-30T22:52:30.002468+0000","last_clean":"2023-09-30T22:52:30.002468+0000","last_became_active":"2023-09-30T22:52:30.001442+0000","last_became_peered":"2023-09-30T22:52:30.001442+0000","last_unstale":"2023-09-30T22:52:30.002468+0000","last_undegraded":"2023-09-30T22:52:30.002468+0000","last_fullsized":"2023-09-30T22:52:30.002468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.249324+0000","last_change":"2023-09-30T22:52:28.996750+0000","last_active":"2023-09-30T22:52:30.249324+0000","last_peered":"2023-09-30T22:52:30.249324+0000","last_clean":"2023-09-30T22:52:30.249324+0000","last_became_active":"2023-09-30T22:52:28.996452+0000","last_became_peered":"2023-09-30T22:52:28.996452+0000","last_unstale":"2023-09-30T22:52:30.249324+0000","last_undegraded":"2023-09-30T22:52:30.249324+0000","last_fullsized":"2023-09-30T22:52:30.249324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:27.626860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986641+0000","last_change":"2023-09-30T22:52:29.986448+0000","last_active":"2023-09-30T22:52:29.986641+0000","last_peered":"2023-09-30T22:52:29.986641+0000","last_clean":"2023-09-30T22:52:29.986641+0000","last_became_active":"2023-09-30T22:52:29.985949+0000","last_became_peered":"2023-09-30T22:52:29.985949+0000","last_unstale":"2023-09-30T22:52:29.986641+0000","last_undegraded":"2023-09-30T22:52:29.986641+0000","last_fullsized":"2023-09-30T22:52:29.986641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246918+0000","last_change":"2023-09-30T22:52:28.994103+0000","last_active":"2023-09-30T22:52:30.246918+0000","last_peered":"2023-09-30T22:52:30.246918+0000","last_clean":"2023-09-30T22:52:30.246918+0000","last_became_active":"2023-09-30T22:52:28.993565+0000","last_became_peered":"2023-09-30T22:52:28.993565+0000","last_unstale":"2023-09-30T22:52:30.246918+0000","last_undegraded":"2023-09-30T22:52:30.246918+0000","last_fullsized":"2023-09-30T22:52:30.246918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:13.263038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004432+0000","last_change":"2023-09-30T22:52:30.004350+0000","last_active":"2023-09-30T22:52:30.004432+0000","last_peered":"2023-09-30T22:52:30.004432+0000","last_clean":"2023-09-30T22:52:30.004432+0000","last_became_active":"2023-09-30T22:52:30.004122+0000","last_became_peered":"2023-09-30T22:52:30.004122+0000","last_unstale":"2023-09-30T22:52:30.004432+0000","last_undegraded":"2023-09-30T22:52:30.004432+0000","last_fullsized":"2023-09-30T22:52:30.004432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985835+0000","last_change":"2023-09-30T22:52:28.996489+0000","last_active":"2023-09-30T22:52:29.985835+0000","last_peered":"2023-09-30T22:52:29.985835+0000","last_clean":"2023-09-30T22:52:29.985835+0000","last_became_active":"2023-09-30T22:52:28.996265+0000","last_became_peered":"2023-09-30T22:52:28.996265+0000","last_unstale":"2023-09-30T22:52:29.985835+0000","last_undegraded":"2023-09-30T22:52:29.985835+0000","last_fullsized":"2023-09-30T22:52:29.985835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992971+0000","last_change":"2023-09-30T22:52:29.992910+0000","last_active":"2023-09-30T22:52:29.992971+0000","last_peered":"2023-09-30T22:52:29.992971+0000","last_clean":"2023-09-30T22:52:29.992971+0000","last_became_active":"2023-09-30T22:52:29.992692+0000","last_became_peered":"2023-09-30T22:52:29.992692+0000","last_unstale":"2023-09-30T22:52:29.992971+0000","last_undegraded":"2023-09-30T22:52:29.992971+0000","last_fullsized":"2023-09-30T22:52:29.992971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:48.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984470+0000","last_change":"2023-09-30T22:52:28.995355+0000","last_active":"2023-09-30T22:52:29.984470+0000","last_peered":"2023-09-30T22:52:29.984470+0000","last_clean":"2023-09-30T22:52:29.984470+0000","last_became_active":"2023-09-30T22:52:28.995101+0000","last_became_peered":"2023-09-30T22:52:28.995101+0000","last_unstale":"2023-09-30T22:52:29.984470+0000","last_undegraded":"2023-09-30T22:52:29.984470+0000","last_fullsized":"2023-09-30T22:52:29.984470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:42.659983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995682+0000","last_change":"2023-09-30T22:52:29.995214+0000","last_active":"2023-09-30T22:52:29.995682+0000","last_peered":"2023-09-30T22:52:29.995682+0000","last_clean":"2023-09-30T22:52:29.995682+0000","last_became_active":"2023-09-30T22:52:29.994812+0000","last_became_peered":"2023-09-30T22:52:29.994812+0000","last_unstale":"2023-09-30T22:52:29.995682+0000","last_undegraded":"2023-09-30T22:52:29.995682+0000","last_fullsized":"2023-09-30T22:52:29.995682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248817+0000","last_change":"2023-09-30T22:52:28.998681+0000","last_active":"2023-09-30T22:52:30.248817+0000","last_peered":"2023-09-30T22:52:30.248817+0000","last_clean":"2023-09-30T22:52:30.248817+0000","last_became_active":"2023-09-30T22:52:28.998134+0000","last_became_peered":"2023-09-30T22:52:28.998134+0000","last_unstale":"2023-09-30T22:52:30.248817+0000","last_undegraded":"2023-09-30T22:52:30.248817+0000","last_fullsized":"2023-09-30T22:52:30.248817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:20.038280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002410+0000","last_change":"2023-09-30T22:52:30.002333+0000","last_active":"2023-09-30T22:52:30.002410+0000","last_peered":"2023-09-30T22:52:30.002410+0000","last_clean":"2023-09-30T22:52:30.002410+0000","last_became_active":"2023-09-30T22:52:30.002100+0000","last_became_peered":"2023-09-30T22:52:30.002100+0000","last_unstale":"2023-09-30T22:52:30.002410+0000","last_undegraded":"2023-09-30T22:52:30.002410+0000","last_fullsized":"2023-09-30T22:52:30.002410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248442+0000","last_change":"2023-09-30T22:52:28.987245+0000","last_active":"2023-09-30T22:52:30.248442+0000","last_peered":"2023-09-30T22:52:30.248442+0000","last_clean":"2023-09-30T22:52:30.248442+0000","last_became_active":"2023-09-30T22:52:28.987022+0000","last_became_peered":"2023-09-30T22:52:28.987022+0000","last_unstale":"2023-09-30T22:52:30.248442+0000","last_undegraded":"2023-09-30T22:52:30.248442+0000","last_fullsized":"2023-09-30T22:52:30.248442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995980+0000","last_change":"2023-09-30T22:52:29.995141+0000","last_active":"2023-09-30T22:52:29.995980+0000","last_peered":"2023-09-30T22:52:29.995980+0000","last_clean":"2023-09-30T22:52:29.995980+0000","last_became_active":"2023-09-30T22:52:29.994512+0000","last_became_peered":"2023-09-30T22:52:29.994512+0000","last_unstale":"2023-09-30T22:52:29.995980+0000","last_undegraded":"2023-09-30T22:52:29.995980+0000","last_fullsized":"2023-09-30T22:52:29.995980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:49.646123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245185+0000","last_change":"2023-09-30T22:52:28.995188+0000","last_active":"2023-09-30T22:52:30.245185+0000","last_peered":"2023-09-30T22:52:30.245185+0000","last_clean":"2023-09-30T22:52:30.245185+0000","last_became_active":"2023-09-30T22:52:28.994967+0000","last_became_peered":"2023-09-30T22:52:28.994967+0000","last_unstale":"2023-09-30T22:52:30.245185+0000","last_undegraded":"2023-09-30T22:52:30.245185+0000","last_fullsized":"2023-09-30T22:52:30.245185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002064+0000","last_change":"2023-09-30T22:52:30.002007+0000","last_active":"2023-09-30T22:52:30.002064+0000","last_peered":"2023-09-30T22:52:30.002064+0000","last_clean":"2023-09-30T22:52:30.002064+0000","last_became_active":"2023-09-30T22:52:30.001460+0000","last_became_peered":"2023-09-30T22:52:30.001460+0000","last_unstale":"2023-09-30T22:52:30.002064+0000","last_undegraded":"2023-09-30T22:52:30.002064+0000","last_fullsized":"2023-09-30T22:52:30.002064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248680+0000","last_change":"2023-09-30T22:52:29.000836+0000","last_active":"2023-09-30T22:52:30.248680+0000","last_peered":"2023-09-30T22:52:30.248680+0000","last_clean":"2023-09-30T22:52:30.248680+0000","last_became_active":"2023-09-30T22:52:29.000596+0000","last_became_peered":"2023-09-30T22:52:29.000596+0000","last_unstale":"2023-09-30T22:52:30.248680+0000","last_undegraded":"2023-09-30T22:52:30.248680+0000","last_fullsized":"2023-09-30T22:52:30.248680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:52.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985152+0000","last_change":"2023-09-30T22:52:29.985065+0000","last_active":"2023-09-30T22:52:29.985152+0000","last_peered":"2023-09-30T22:52:29.985152+0000","last_clean":"2023-09-30T22:52:29.985152+0000","last_became_active":"2023-09-30T22:52:29.984838+0000","last_became_peered":"2023-09-30T22:52:29.984838+0000","last_unstale":"2023-09-30T22:52:29.985152+0000","last_undegraded":"2023-09-30T22:52:29.985152+0000","last_fullsized":"2023-09-30T22:52:29.985152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991396+0000","last_change":"2023-09-30T22:52:28.992846+0000","last_active":"2023-09-30T22:52:29.991396+0000","last_peered":"2023-09-30T22:52:29.991396+0000","last_clean":"2023-09-30T22:52:29.991396+0000","last_became_active":"2023-09-30T22:52:28.992621+0000","last_became_peered":"2023-09-30T22:52:28.992621+0000","last_unstale":"2023-09-30T22:52:29.991396+0000","last_undegraded":"2023-09-30T22:52:29.991396+0000","last_fullsized":"2023-09-30T22:52:29.991396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:15:35.415866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005444+0000","last_change":"2023-09-30T22:52:30.005297+0000","last_active":"2023-09-30T22:52:30.005444+0000","last_peered":"2023-09-30T22:52:30.005444+0000","last_clean":"2023-09-30T22:52:30.005444+0000","last_became_active":"2023-09-30T22:52:30.005071+0000","last_became_peered":"2023-09-30T22:52:30.005071+0000","last_unstale":"2023-09-30T22:52:30.005444+0000","last_undegraded":"2023-09-30T22:52:30.005444+0000","last_fullsized":"2023-09-30T22:52:30.005444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.988566+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.988328+0000","last_became_peered":"2023-09-30T22:52:28.988328+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000757+0000","last_change":"2023-09-30T22:52:30.000695+0000","last_active":"2023-09-30T22:52:30.000757+0000","last_peered":"2023-09-30T22:52:30.000757+0000","last_clean":"2023-09-30T22:52:30.000757+0000","last_became_active":"2023-09-30T22:52:30.000416+0000","last_became_peered":"2023-09-30T22:52:30.000416+0000","last_unstale":"2023-09-30T22:52:30.000757+0000","last_undegraded":"2023-09-30T22:52:30.000757+0000","last_fullsized":"2023-09-30T22:52:30.000757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982988+0000","last_change":"2023-09-30T22:52:28.993499+0000","last_active":"2023-09-30T22:52:29.982988+0000","last_peered":"2023-09-30T22:52:29.982988+0000","last_clean":"2023-09-30T22:52:29.982988+0000","last_became_active":"2023-09-30T22:52:28.990179+0000","last_became_peered":"2023-09-30T22:52:28.990179+0000","last_unstale":"2023-09-30T22:52:29.982988+0000","last_undegraded":"2023-09-30T22:52:29.982988+0000","last_fullsized":"2023-09-30T22:52:29.982988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:10.753274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995962+0000","last_change":"2023-09-30T22:52:29.995007+0000","last_active":"2023-09-30T22:52:29.995962+0000","last_peered":"2023-09-30T22:52:29.995962+0000","last_clean":"2023-09-30T22:52:29.995962+0000","last_became_active":"2023-09-30T22:52:29.994234+0000","last_became_peered":"2023-09-30T22:52:29.994234+0000","last_unstale":"2023-09-30T22:52:29.995962+0000","last_undegraded":"2023-09-30T22:52:29.995962+0000","last_fullsized":"2023-09-30T22:52:29.995962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:59:32.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982689+0000","last_change":"2023-09-30T22:52:28.995013+0000","last_active":"2023-09-30T22:52:29.982689+0000","last_peered":"2023-09-30T22:52:29.982689+0000","last_clean":"2023-09-30T22:52:29.982689+0000","last_became_active":"2023-09-30T22:52:28.994596+0000","last_became_peered":"2023-09-30T22:52:28.994596+0000","last_unstale":"2023-09-30T22:52:29.982689+0000","last_undegraded":"2023-09-30T22:52:29.982689+0000","last_fullsized":"2023-09-30T22:52:29.982689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:50.179162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986659+0000","last_change":"2023-09-30T22:52:29.986589+0000","last_active":"2023-09-30T22:52:29.986659+0000","last_peered":"2023-09-30T22:52:29.986659+0000","last_clean":"2023-09-30T22:52:29.986659+0000","last_became_active":"2023-09-30T22:52:29.986233+0000","last_became_peered":"2023-09-30T22:52:29.986233+0000","last_unstale":"2023-09-30T22:52:29.986659+0000","last_undegraded":"2023-09-30T22:52:29.986659+0000","last_fullsized":"2023-09-30T22:52:29.986659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993407+0000","last_change":"2023-09-30T22:52:28.992419+0000","last_active":"2023-09-30T22:52:29.993407+0000","last_peered":"2023-09-30T22:52:29.993407+0000","last_clean":"2023-09-30T22:52:29.993407+0000","last_became_active":"2023-09-30T22:52:28.992194+0000","last_became_peered":"2023-09-30T22:52:28.992194+0000","last_unstale":"2023-09-30T22:52:29.993407+0000","last_undegraded":"2023-09-30T22:52:29.993407+0000","last_fullsized":"2023-09-30T22:52:29.993407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005479+0000","last_change":"2023-09-30T22:52:30.005382+0000","last_active":"2023-09-30T22:52:30.005479+0000","last_peered":"2023-09-30T22:52:30.005479+0000","last_clean":"2023-09-30T22:52:30.005479+0000","last_became_active":"2023-09-30T22:52:30.005167+0000","last_became_peered":"2023-09-30T22:52:30.005167+0000","last_unstale":"2023-09-30T22:52:30.005479+0000","last_undegraded":"2023-09-30T22:52:30.005479+0000","last_fullsized":"2023-09-30T22:52:30.005479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991288+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:52:29.991288+0000","last_peered":"2023-09-30T22:52:29.991288+0000","last_clean":"2023-09-30T22:52:29.991288+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:52:29.991288+0000","last_undegraded":"2023-09-30T22:52:29.991288+0000","last_fullsized":"2023-09-30T22:52:29.991288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982887+0000","last_change":"2023-09-30T22:52:28.993144+0000","last_active":"2023-09-30T22:52:29.982887+0000","last_peered":"2023-09-30T22:52:29.982887+0000","last_clean":"2023-09-30T22:52:29.982887+0000","last_became_active":"2023-09-30T22:52:28.992932+0000","last_became_peered":"2023-09-30T22:52:28.992932+0000","last_unstale":"2023-09-30T22:52:29.982887+0000","last_undegraded":"2023-09-30T22:52:29.982887+0000","last_fullsized":"2023-09-30T22:52:29.982887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.987116+0000","last_change":"2023-09-30T22:52:29.987045+0000","last_active":"2023-09-30T22:52:29.987116+0000","last_peered":"2023-09-30T22:52:29.987116+0000","last_clean":"2023-09-30T22:52:29.987116+0000","last_became_active":"2023-09-30T22:52:29.986888+0000","last_became_peered":"2023-09-30T22:52:29.986888+0000","last_unstale":"2023-09-30T22:52:29.987116+0000","last_undegraded":"2023-09-30T22:52:29.987116+0000","last_fullsized":"2023-09-30T22:52:29.987116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984369+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:52:29.984369+0000","last_peered":"2023-09-30T22:52:29.984369+0000","last_clean":"2023-09-30T22:52:29.984369+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:52:29.984369+0000","last_undegraded":"2023-09-30T22:52:29.984369+0000","last_fullsized":"2023-09-30T22:52:29.984369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990050+0000","last_change":"2023-09-30T22:52:28.995710+0000","last_active":"2023-09-30T22:52:29.990050+0000","last_peered":"2023-09-30T22:52:29.990050+0000","last_clean":"2023-09-30T22:52:29.990050+0000","last_became_active":"2023-09-30T22:52:28.995466+0000","last_became_peered":"2023-09-30T22:52:28.995466+0000","last_unstale":"2023-09-30T22:52:29.990050+0000","last_undegraded":"2023-09-30T22:52:29.990050+0000","last_fullsized":"2023-09-30T22:52:29.990050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996250+0000","last_change":"2023-09-30T22:52:29.996115+0000","last_active":"2023-09-30T22:52:29.996250+0000","last_peered":"2023-09-30T22:52:29.996250+0000","last_clean":"2023-09-30T22:52:29.996250+0000","last_became_active":"2023-09-30T22:52:29.995868+0000","last_became_peered":"2023-09-30T22:52:29.995868+0000","last_unstale":"2023-09-30T22:52:29.996250+0000","last_undegraded":"2023-09-30T22:52:29.996250+0000","last_fullsized":"2023-09-30T22:52:29.996250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.989952+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:52:29.989952+0000","last_peered":"2023-09-30T22:52:29.989952+0000","last_clean":"2023-09-30T22:52:29.989952+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:52:29.989952+0000","last_undegraded":"2023-09-30T22:52:29.989952+0000","last_fullsized":"2023-09-30T22:52:29.989952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990961+0000","last_change":"2023-09-30T22:52:28.999654+0000","last_active":"2023-09-30T22:52:29.990961+0000","last_peered":"2023-09-30T22:52:29.990961+0000","last_clean":"2023-09-30T22:52:29.990961+0000","last_became_active":"2023-09-30T22:52:28.999396+0000","last_became_peered":"2023-09-30T22:52:28.999396+0000","last_unstale":"2023-09-30T22:52:29.990961+0000","last_undegraded":"2023-09-30T22:52:29.990961+0000","last_fullsized":"2023-09-30T22:52:29.990961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996005+0000","last_change":"2023-09-30T22:52:29.995237+0000","last_active":"2023-09-30T22:52:29.996005+0000","last_peered":"2023-09-30T22:52:29.996005+0000","last_clean":"2023-09-30T22:52:29.996005+0000","last_became_active":"2023-09-30T22:52:29.994975+0000","last_became_peered":"2023-09-30T22:52:29.994975+0000","last_unstale":"2023-09-30T22:52:29.996005+0000","last_undegraded":"2023-09-30T22:52:29.996005+0000","last_fullsized":"2023-09-30T22:52:29.996005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984408+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:52:29.984408+0000","last_peered":"2023-09-30T22:52:29.984408+0000","last_clean":"2023-09-30T22:52:29.984408+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:52:29.984408+0000","last_undegraded":"2023-09-30T22:52:29.984408+0000","last_fullsized":"2023-09-30T22:52:29.984408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990530+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:52:29.990530+0000","last_peered":"2023-09-30T22:52:29.990530+0000","last_clean":"2023-09-30T22:52:29.990530+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:52:29.990530+0000","last_undegraded":"2023-09-30T22:52:29.990530+0000","last_fullsized":"2023-09-30T22:52:29.990530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992306+0000","last_change":"2023-09-30T22:52:28.995976+0000","last_active":"2023-09-30T22:52:29.992306+0000","last_peered":"2023-09-30T22:52:29.992306+0000","last_clean":"2023-09-30T22:52:29.992306+0000","last_became_active":"2023-09-30T22:52:28.995724+0000","last_became_peered":"2023-09-30T22:52:28.995724+0000","last_unstale":"2023-09-30T22:52:29.992306+0000","last_undegraded":"2023-09-30T22:52:29.992306+0000","last_fullsized":"2023-09-30T22:52:29.992306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992841+0000","last_change":"2023-09-30T22:52:29.992622+0000","last_active":"2023-09-30T22:52:29.992841+0000","last_peered":"2023-09-30T22:52:29.992841+0000","last_clean":"2023-09-30T22:52:29.992841+0000","last_became_active":"2023-09-30T22:52:29.992005+0000","last_became_peered":"2023-09-30T22:52:29.992005+0000","last_unstale":"2023-09-30T22:52:29.992841+0000","last_undegraded":"2023-09-30T22:52:29.992841+0000","last_fullsized":"2023-09-30T22:52:29.992841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:28.590938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982896+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:52:29.982896+0000","last_peered":"2023-09-30T22:52:29.982896+0000","last_clean":"2023-09-30T22:52:29.982896+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:52:29.982896+0000","last_undegraded":"2023-09-30T22:52:29.982896+0000","last_fullsized":"2023-09-30T22:52:29.982896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985789+0000","last_change":"2023-09-30T22:52:28.994561+0000","last_active":"2023-09-30T22:52:29.985789+0000","last_peered":"2023-09-30T22:52:29.985789+0000","last_clean":"2023-09-30T22:52:29.985789+0000","last_became_active":"2023-09-30T22:52:28.994326+0000","last_became_peered":"2023-09-30T22:52:28.994326+0000","last_unstale":"2023-09-30T22:52:29.985789+0000","last_undegraded":"2023-09-30T22:52:29.985789+0000","last_fullsized":"2023-09-30T22:52:29.985789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:11.947068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994260+0000","last_change":"2023-09-30T22:52:29.994185+0000","last_active":"2023-09-30T22:52:29.994260+0000","last_peered":"2023-09-30T22:52:29.994260+0000","last_clean":"2023-09-30T22:52:29.994260+0000","last_became_active":"2023-09-30T22:52:29.993967+0000","last_became_peered":"2023-09-30T22:52:29.993967+0000","last_unstale":"2023-09-30T22:52:29.994260+0000","last_undegraded":"2023-09-30T22:52:29.994260+0000","last_fullsized":"2023-09-30T22:52:29.994260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982819+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:52:29.982819+0000","last_peered":"2023-09-30T22:52:29.982819+0000","last_clean":"2023-09-30T22:52:29.982819+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:52:29.982819+0000","last_undegraded":"2023-09-30T22:52:29.982819+0000","last_fullsized":"2023-09-30T22:52:29.982819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985802+0000","last_change":"2023-09-30T22:52:28.996536+0000","last_active":"2023-09-30T22:52:29.985802+0000","last_peered":"2023-09-30T22:52:29.985802+0000","last_clean":"2023-09-30T22:52:29.985802+0000","last_became_active":"2023-09-30T22:52:28.996306+0000","last_became_peered":"2023-09-30T22:52:28.996306+0000","last_unstale":"2023-09-30T22:52:29.985802+0000","last_undegraded":"2023-09-30T22:52:29.985802+0000","last_fullsized":"2023-09-30T22:52:29.985802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:55.045032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996026+0000","last_change":"2023-09-30T22:52:29.995265+0000","last_active":"2023-09-30T22:52:29.996026+0000","last_peered":"2023-09-30T22:52:29.996026+0000","last_clean":"2023-09-30T22:52:29.996026+0000","last_became_active":"2023-09-30T22:52:29.994582+0000","last_became_peered":"2023-09-30T22:52:29.994582+0000","last_unstale":"2023-09-30T22:52:29.996026+0000","last_undegraded":"2023-09-30T22:52:29.996026+0000","last_fullsized":"2023-09-30T22:52:29.996026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.995448+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.995132+0000","last_became_peered":"2023-09-30T22:52:28.995132+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993209+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:52:29.993209+0000","last_peered":"2023-09-30T22:52:29.993209+0000","last_clean":"2023-09-30T22:52:29.993209+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:52:29.993209+0000","last_undegraded":"2023-09-30T22:52:29.993209+0000","last_fullsized":"2023-09-30T22:52:29.993209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003796+0000","last_change":"2023-09-30T22:52:30.002605+0000","last_active":"2023-09-30T22:52:30.003796+0000","last_peered":"2023-09-30T22:52:30.003796+0000","last_clean":"2023-09-30T22:52:30.003796+0000","last_became_active":"2023-09-30T22:52:30.001819+0000","last_became_peered":"2023-09-30T22:52:30.001819+0000","last_unstale":"2023-09-30T22:52:30.003796+0000","last_undegraded":"2023-09-30T22:52:30.003796+0000","last_fullsized":"2023-09-30T22:52:30.003796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983742+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:52:29.983742+0000","last_peered":"2023-09-30T22:52:29.983742+0000","last_clean":"2023-09-30T22:52:29.983742+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:52:29.983742+0000","last_undegraded":"2023-09-30T22:52:29.983742+0000","last_fullsized":"2023-09-30T22:52:29.983742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993314+0000","last_change":"2023-09-30T22:52:28.993895+0000","last_active":"2023-09-30T22:52:29.993314+0000","last_peered":"2023-09-30T22:52:29.993314+0000","last_clean":"2023-09-30T22:52:29.993314+0000","last_became_active":"2023-09-30T22:52:28.993671+0000","last_became_peered":"2023-09-30T22:52:28.993671+0000","last_unstale":"2023-09-30T22:52:29.993314+0000","last_undegraded":"2023-09-30T22:52:29.993314+0000","last_fullsized":"2023-09-30T22:52:29.993314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985123+0000","last_change":"2023-09-30T22:52:29.984764+0000","last_active":"2023-09-30T22:52:29.985123+0000","last_peered":"2023-09-30T22:52:29.985123+0000","last_clean":"2023-09-30T22:52:29.985123+0000","last_became_active":"2023-09-30T22:52:29.984512+0000","last_became_peered":"2023-09-30T22:52:29.984512+0000","last_unstale":"2023-09-30T22:52:29.985123+0000","last_undegraded":"2023-09-30T22:52:29.985123+0000","last_fullsized":"2023-09-30T22:52:29.985123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245152+0000","last_change":"2023-09-30T22:52:28.992724+0000","last_active":"2023-09-30T22:52:30.245152+0000","last_peered":"2023-09-30T22:52:30.245152+0000","last_clean":"2023-09-30T22:52:30.245152+0000","last_became_active":"2023-09-30T22:52:28.992475+0000","last_became_peered":"2023-09-30T22:52:28.992475+0000","last_unstale":"2023-09-30T22:52:30.245152+0000","last_undegraded":"2023-09-30T22:52:30.245152+0000","last_fullsized":"2023-09-30T22:52:30.245152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002489+0000","last_change":"2023-09-30T22:52:30.002130+0000","last_active":"2023-09-30T22:52:30.002489+0000","last_peered":"2023-09-30T22:52:30.002489+0000","last_clean":"2023-09-30T22:52:30.002489+0000","last_became_active":"2023-09-30T22:52:30.001756+0000","last_became_peered":"2023-09-30T22:52:30.001756+0000","last_unstale":"2023-09-30T22:52:30.002489+0000","last_undegraded":"2023-09-30T22:52:30.002489+0000","last_fullsized":"2023-09-30T22:52:30.002489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.247149+0000","last_change":"2023-09-30T22:52:28.988451+0000","last_active":"2023-09-30T22:52:30.247149+0000","last_peered":"2023-09-30T22:52:30.247149+0000","last_clean":"2023-09-30T22:52:30.247149+0000","last_became_active":"2023-09-30T22:52:28.988208+0000","last_became_peered":"2023-09-30T22:52:28.988208+0000","last_unstale":"2023-09-30T22:52:30.247149+0000","last_undegraded":"2023-09-30T22:52:30.247149+0000","last_fullsized":"2023-09-30T22:52:30.247149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994183+0000","last_change":"2023-09-30T22:52:29.994020+0000","last_active":"2023-09-30T22:52:29.994183+0000","last_peered":"2023-09-30T22:52:29.994183+0000","last_clean":"2023-09-30T22:52:29.994183+0000","last_became_active":"2023-09-30T22:52:29.993783+0000","last_became_peered":"2023-09-30T22:52:29.993783+0000","last_unstale":"2023-09-30T22:52:29.994183+0000","last_undegraded":"2023-09-30T22:52:29.994183+0000","last_fullsized":"2023-09-30T22:52:29.994183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246723+0000","last_change":"2023-09-30T22:52:28.994877+0000","last_active":"2023-09-30T22:52:30.246723+0000","last_peered":"2023-09-30T22:52:30.246723+0000","last_clean":"2023-09-30T22:52:30.246723+0000","last_became_active":"2023-09-30T22:52:28.993855+0000","last_became_peered":"2023-09-30T22:52:28.993855+0000","last_unstale":"2023-09-30T22:52:30.246723+0000","last_undegraded":"2023-09-30T22:52:30.246723+0000","last_fullsized":"2023-09-30T22:52:30.246723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:05.100032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.988016+0000","last_change":"2023-09-30T22:52:29.987968+0000","last_active":"2023-09-30T22:52:29.988016+0000","last_peered":"2023-09-30T22:52:29.988016+0000","last_clean":"2023-09-30T22:52:29.988016+0000","last_became_active":"2023-09-30T22:52:29.987840+0000","last_became_peered":"2023-09-30T22:52:29.987840+0000","last_unstale":"2023-09-30T22:52:29.988016+0000","last_undegraded":"2023-09-30T22:52:29.988016+0000","last_fullsized":"2023-09-30T22:52:29.988016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245418+0000","last_change":"2023-09-30T22:52:28.997114+0000","last_active":"2023-09-30T22:52:30.245418+0000","last_peered":"2023-09-30T22:52:30.245418+0000","last_clean":"2023-09-30T22:52:30.245418+0000","last_became_active":"2023-09-30T22:52:28.996627+0000","last_became_peered":"2023-09-30T22:52:28.996627+0000","last_unstale":"2023-09-30T22:52:30.245418+0000","last_undegraded":"2023-09-30T22:52:30.245418+0000","last_fullsized":"2023-09-30T22:52:30.245418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999051+0000","last_change":"2023-09-30T22:52:29.998983+0000","last_active":"2023-09-30T22:52:29.999051+0000","last_peered":"2023-09-30T22:52:29.999051+0000","last_clean":"2023-09-30T22:52:29.999051+0000","last_became_active":"2023-09-30T22:52:29.998760+0000","last_became_peered":"2023-09-30T22:52:29.998760+0000","last_unstale":"2023-09-30T22:52:29.999051+0000","last_undegraded":"2023-09-30T22:52:29.999051+0000","last_fullsized":"2023-09-30T22:52:29.999051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248249+0000","last_change":"2023-09-30T22:52:28.998655+0000","last_active":"2023-09-30T22:52:30.248249+0000","last_peered":"2023-09-30T22:52:30.248249+0000","last_clean":"2023-09-30T22:52:30.248249+0000","last_became_active":"2023-09-30T22:52:28.998409+0000","last_became_peered":"2023-09-30T22:52:28.998409+0000","last_unstale":"2023-09-30T22:52:30.248249+0000","last_undegraded":"2023-09-30T22:52:30.248249+0000","last_fullsized":"2023-09-30T22:52:30.248249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001122+0000","last_change":"2023-09-30T22:52:30.001062+0000","last_active":"2023-09-30T22:52:30.001122+0000","last_peered":"2023-09-30T22:52:30.001122+0000","last_clean":"2023-09-30T22:52:30.001122+0000","last_became_active":"2023-09-30T22:52:30.000803+0000","last_became_peered":"2023-09-30T22:52:30.000803+0000","last_unstale":"2023-09-30T22:52:30.001122+0000","last_undegraded":"2023-09-30T22:52:30.001122+0000","last_fullsized":"2023-09-30T22:52:30.001122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002078+0000","last_change":"2023-09-30T22:52:30.001992+0000","last_active":"2023-09-30T22:52:30.002078+0000","last_peered":"2023-09-30T22:52:30.002078+0000","last_clean":"2023-09-30T22:52:30.002078+0000","last_became_active":"2023-09-30T22:52:30.001745+0000","last_became_peered":"2023-09-30T22:52:30.001745+0000","last_unstale":"2023-09-30T22:52:30.002078+0000","last_undegraded":"2023-09-30T22:52:30.002078+0000","last_fullsized":"2023-09-30T22:52:30.002078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998638+0000","last_change":"2023-09-30T22:52:29.998560+0000","last_active":"2023-09-30T22:52:29.998638+0000","last_peered":"2023-09-30T22:52:29.998638+0000","last_clean":"2023-09-30T22:52:29.998638+0000","last_became_active":"2023-09-30T22:52:29.997840+0000","last_became_peered":"2023-09-30T22:52:29.997840+0000","last_unstale":"2023-09-30T22:52:29.998638+0000","last_undegraded":"2023-09-30T22:52:29.998638+0000","last_fullsized":"2023-09-30T22:52:29.998638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995699+0000","last_change":"2023-09-30T22:52:29.995634+0000","last_active":"2023-09-30T22:52:29.995699+0000","last_peered":"2023-09-30T22:52:29.995699+0000","last_clean":"2023-09-30T22:52:29.995699+0000","last_became_active":"2023-09-30T22:52:29.995407+0000","last_became_peered":"2023-09-30T22:52:29.995407+0000","last_unstale":"2023-09-30T22:52:29.995699+0000","last_undegraded":"2023-09-30T22:52:29.995699+0000","last_fullsized":"2023-09-30T22:52:29.995699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003196+0000","last_change":"2023-09-30T22:52:30.002695+0000","last_active":"2023-09-30T22:52:30.003196+0000","last_peered":"2023-09-30T22:52:30.003196+0000","last_clean":"2023-09-30T22:52:30.003196+0000","last_became_active":"2023-09-30T22:52:30.002463+0000","last_became_peered":"2023-09-30T22:52:30.002463+0000","last_unstale":"2023-09-30T22:52:30.003196+0000","last_undegraded":"2023-09-30T22:52:30.003196+0000","last_fullsized":"2023-09-30T22:52:30.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:25.402337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996203+0000","last_change":"2023-09-30T22:52:29.996129+0000","last_active":"2023-09-30T22:52:29.996203+0000","last_peered":"2023-09-30T22:52:29.996203+0000","last_clean":"2023-09-30T22:52:29.996203+0000","last_became_active":"2023-09-30T22:52:29.995897+0000","last_became_peered":"2023-09-30T22:52:29.995897+0000","last_unstale":"2023-09-30T22:52:29.996203+0000","last_undegraded":"2023-09-30T22:52:29.996203+0000","last_fullsized":"2023-09-30T22:52:29.996203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917336,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":82,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195230,"statfs":{"total":200000000,"available":199915946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909201,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]}],"pool_statfs":[]}} 2023-09-30T22:52:34.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:52:34.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.802+0000 7f45bebff700 1 Processor -- start 2023-09-30T22:52:34.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.802+0000 7f45bebff700 1 -- start start 2023-09-30T22:52:34.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45bebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b80af020 0x7f45b8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45bebff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45b806e820 0x7f45b815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45bebff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b806d3e0 con 0x7f45b80b00d0 2023-09-30T22:52:34.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45bebff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b806dc80 con 0x7f45b806e820 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45bebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b806b790 con 0x7f45b80af020 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45b7fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f45b80b00d0 0x7f45b806e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60300/0 (socket says 172.21.15.142:60300) 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45b7fff700 1 -- 172.21.15.142:0/1893523549 learned_addr learned my addr 172.21.15.142:0/1893523549 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45bd19c700 1 --2- 172.21.15.142:0/1893523549 >> v2:172.21.15.142:3300/0 conn(0x7f45b806e820 0x7f45b815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45bc99b700 1 --2- 172.21.15.142:0/1893523549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b80af020 0x7f45b8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45b77fe700 1 -- 172.21.15.142:0/1893523549 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376255712 0 0) 0x7f45b806d3e0 con 0x7f45b80b00d0 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.804+0000 7f45b77fe700 1 -- 172.21.15.142:0/1893523549 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a8003570 con 0x7f45b80b00d0 2023-09-30T22:52:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45bd19c700 1 -- 172.21.15.142:0/1893523549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b80af020 msgr2=0x7f45b8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:34.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45bd19c700 1 --2- 172.21.15.142:0/1893523549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b80af020 0x7f45b8156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45bd19c700 1 -- 172.21.15.142:0/1893523549 >> v1:172.21.15.142:6789/0 conn(0x7f45b80b00d0 legacy=0x7f45b806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45bd19c700 1 -- 172.21.15.142:0/1893523549 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b80b0650 con 0x7f45b806e820 2023-09-30T22:52:34.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45bd19c700 1 --2- 172.21.15.142:0/1893523549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b806e820 0x7f45b815a3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009e60 tx=0x7f45b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325d88f66c2071b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:34.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45b77fe700 1 -- 172.21.15.142:0/1893523549 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b000e070 con 0x7f45b806e820 2023-09-30T22:52:34.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45b77fe700 1 -- 172.21.15.142:0/1893523549 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b000bab0 con 0x7f45b806e820 2023-09-30T22:52:34.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.805+0000 7f45b77fe700 1 -- 172.21.15.142:0/1893523549 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b000be30 con 0x7f45b806e820 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 -- 172.21.15.142:0/1893523549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b806e820 msgr2=0x7f45b815a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 --2- 172.21.15.142:0/1893523549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b806e820 0x7f45b815a3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009e60 tx=0x7f45b0009780 comp rx=0 tx=0).stop 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 -- 172.21.15.142:0/1893523549 shutdown_connections 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 --2- 172.21.15.142:0/1893523549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b806e820 0x7f45b815a3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 --2- 172.21.15.142:0/1893523549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b80af020 0x7f45b8156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 -- 172.21.15.142:0/1893523549 >> 172.21.15.142:0/1893523549 conn(0x7f45b80680c0 msgr2=0x7f45b80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 -- 172.21.15.142:0/1893523549 shutdown_connections 2023-09-30T22:52:34.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.806+0000 7f45bebff700 1 -- 172.21.15.142:0/1893523549 wait complete. 2023-09-30T22:52:34.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.807+0000 7f45bebff700 1 Processor -- start 2023-09-30T22:52:34.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.807+0000 7f45bebff700 1 -- start start 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.808+0000 7f45bebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b806e820 0x7f45b8141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.808+0000 7f45bebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b80af020 0x7f45b815e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.808+0000 7f45bebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b80b00d0 0x7f45b815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.808+0000 7f45bebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8144000 con 0x7f45b80af020 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.808+0000 7f45bebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b81442e0 con 0x7f45b80b00d0 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.808+0000 7f45bebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b81445c0 con 0x7f45b806e820 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b80af020 0x7f45b815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b80af020 0x7f45b815e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57094/0 (socket says 172.21.15.142:57094) 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 -- 172.21.15.142:0/79007066 learned_addr learned my addr 172.21.15.142:0/79007066 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:34.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45bc99b700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b806e820 0x7f45b8141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45bd19c700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b80b00d0 0x7f45b815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 -- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b806e820 msgr2=0x7f45b8141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b806e820 0x7f45b8141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 -- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b80b00d0 msgr2=0x7f45b815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b80b00d0 0x7f45b815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 -- 172.21.15.142:0/79007066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b0009a20 con 0x7f45b80af020 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b7fff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b80af020 0x7f45b815e550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45a40011e0 tx=0x7f45a4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b4ff9700 1 -- 172.21.15.142:0/79007066 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4005b30 con 0x7f45b80af020 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b4ff9700 1 -- 172.21.15.142:0/79007066 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4005c90 con 0x7f45b80af020 2023-09-30T22:52:34.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45b4ff9700 1 -- 172.21.15.142:0/79007066 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4007320 con 0x7f45b80af020 2023-09-30T22:52:34.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.809+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b81448a0 con 0x7f45b80af020 2023-09-30T22:52:34.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.810+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b81450a0 con 0x7f45b80af020 2023-09-30T22:52:34.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.811+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b80695b0 con 0x7f45b80af020 2023-09-30T22:52:34.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.811+0000 7f45b4ff9700 1 -- 172.21.15.142:0/79007066 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f45a4007690 con 0x7f45b80af020 2023-09-30T22:52:34.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.812+0000 7f45b4ff9700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f459c067330 0x7f459c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:34.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.812+0000 7f45b4ff9700 1 -- 172.21.15.142:0/79007066 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f45a4084160 con 0x7f45b80af020 2023-09-30T22:52:34.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.812+0000 7f45bc99b700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f459c067330 0x7f459c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:34.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.813+0000 7f45bc99b700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f459c067330 0x7f459c0697e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009d40 tx=0x7f45ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:34.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:34.816+0000 7f45b4ff9700 1 -- 172.21.15.142:0/79007066 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f45a4050fc0 con 0x7f45b80af020 2023-09-30T22:52:35.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.004+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45b806fc10 con 0x7f459c067330 2023-09-30T22:52:35.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.011+0000 7f45b4ff9700 1 -- 172.21.15.142:0/79007066 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278835 (secure 0 0 0) 0x7f45b806fc10 con 0x7f459c067330 2023-09-30T22:52:35.015 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:35.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f459c067330 msgr2=0x7f459c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f459c067330 0x7f459c0697e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009d40 tx=0x7f45ac008040 comp rx=0 tx=0).stop 2023-09-30T22:52:35.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b80af020 msgr2=0x7f45b815e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b80af020 0x7f45b815e550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45a40011e0 tx=0x7f45a4007df0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 shutdown_connections 2023-09-30T22:52:35.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f459c067330 0x7f459c0697e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b80b00d0 0x7f45b815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f45b806e820 0x7f45b8141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 --2- 172.21.15.142:0/79007066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b80af020 0x7f45b815e550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 >> 172.21.15.142:0/79007066 conn(0x7f45b80680c0 msgr2=0x7f45b8155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 shutdown_connections 2023-09-30T22:52:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.016+0000 7f45bebff700 1 -- 172.21.15.142:0/79007066 wait complete. 2023-09-30T22:52:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:52:35.033 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-30T22:52:34.103147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560665,"statfs":{"total":1600000000,"available":1598121303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000951"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999723+0000","last_change":"2023-09-30T22:52:29.999656+0000","last_active":"2023-09-30T22:52:29.999723+0000","last_peered":"2023-09-30T22:52:29.999723+0000","last_clean":"2023-09-30T22:52:29.999723+0000","last_became_active":"2023-09-30T22:52:29.999224+0000","last_became_peered":"2023-09-30T22:52:29.999224+0000","last_unstale":"2023-09-30T22:52:29.999723+0000","last_undegraded":"2023-09-30T22:52:29.999723+0000","last_fullsized":"2023-09-30T22:52:29.999723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000978+0000","last_change":"2023-09-30T22:52:30.000930+0000","last_active":"2023-09-30T22:52:30.000978+0000","last_peered":"2023-09-30T22:52:30.000978+0000","last_clean":"2023-09-30T22:52:30.000978+0000","last_became_active":"2023-09-30T22:52:30.000733+0000","last_became_peered":"2023-09-30T22:52:30.000733+0000","last_unstale":"2023-09-30T22:52:30.000978+0000","last_undegraded":"2023-09-30T22:52:30.000978+0000","last_fullsized":"2023-09-30T22:52:30.000978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996453+0000","last_change":"2023-09-30T22:52:29.996378+0000","last_active":"2023-09-30T22:52:29.996453+0000","last_peered":"2023-09-30T22:52:29.996453+0000","last_clean":"2023-09-30T22:52:29.996453+0000","last_became_active":"2023-09-30T22:52:29.996139+0000","last_became_peered":"2023-09-30T22:52:29.996139+0000","last_unstale":"2023-09-30T22:52:29.996453+0000","last_undegraded":"2023-09-30T22:52:29.996453+0000","last_fullsized":"2023-09-30T22:52:29.996453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994761+0000","last_change":"2023-09-30T22:52:29.994384+0000","last_active":"2023-09-30T22:52:29.994761+0000","last_peered":"2023-09-30T22:52:29.994761+0000","last_clean":"2023-09-30T22:52:29.994761+0000","last_became_active":"2023-09-30T22:52:29.994168+0000","last_became_peered":"2023-09-30T22:52:29.994168+0000","last_unstale":"2023-09-30T22:52:29.994761+0000","last_undegraded":"2023-09-30T22:52:29.994761+0000","last_fullsized":"2023-09-30T22:52:29.994761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004482+0000","last_change":"2023-09-30T22:52:30.004022+0000","last_active":"2023-09-30T22:52:30.004482+0000","last_peered":"2023-09-30T22:52:30.004482+0000","last_clean":"2023-09-30T22:52:30.004482+0000","last_became_active":"2023-09-30T22:52:30.003781+0000","last_became_peered":"2023-09-30T22:52:30.003781+0000","last_unstale":"2023-09-30T22:52:30.004482+0000","last_undegraded":"2023-09-30T22:52:30.004482+0000","last_fullsized":"2023-09-30T22:52:30.004482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986014+0000","last_change":"2023-09-30T22:52:29.985910+0000","last_active":"2023-09-30T22:52:29.986014+0000","last_peered":"2023-09-30T22:52:29.986014+0000","last_clean":"2023-09-30T22:52:29.986014+0000","last_became_active":"2023-09-30T22:52:29.985698+0000","last_became_peered":"2023-09-30T22:52:29.985698+0000","last_unstale":"2023-09-30T22:52:29.986014+0000","last_undegraded":"2023-09-30T22:52:29.986014+0000","last_fullsized":"2023-09-30T22:52:29.986014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:02:40.635094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992823+0000","last_change":"2023-09-30T22:52:29.992580+0000","last_active":"2023-09-30T22:52:29.992823+0000","last_peered":"2023-09-30T22:52:29.992823+0000","last_clean":"2023-09-30T22:52:29.992823+0000","last_became_active":"2023-09-30T22:52:29.992055+0000","last_became_peered":"2023-09-30T22:52:29.992055+0000","last_unstale":"2023-09-30T22:52:29.992823+0000","last_undegraded":"2023-09-30T22:52:29.992823+0000","last_fullsized":"2023-09-30T22:52:29.992823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:25.419873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992925+0000","last_change":"2023-09-30T22:52:29.992763+0000","last_active":"2023-09-30T22:52:29.992925+0000","last_peered":"2023-09-30T22:52:29.992925+0000","last_clean":"2023-09-30T22:52:29.992925+0000","last_became_active":"2023-09-30T22:52:29.992537+0000","last_became_peered":"2023-09-30T22:52:29.992537+0000","last_unstale":"2023-09-30T22:52:29.992925+0000","last_undegraded":"2023-09-30T22:52:29.992925+0000","last_fullsized":"2023-09-30T22:52:29.992925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005650+0000","last_change":"2023-09-30T22:52:30.005579+0000","last_active":"2023-09-30T22:52:30.005650+0000","last_peered":"2023-09-30T22:52:30.005650+0000","last_clean":"2023-09-30T22:52:30.005650+0000","last_became_active":"2023-09-30T22:52:30.005151+0000","last_became_peered":"2023-09-30T22:52:30.005151+0000","last_unstale":"2023-09-30T22:52:30.005650+0000","last_undegraded":"2023-09-30T22:52:30.005650+0000","last_fullsized":"2023-09-30T22:52:30.005650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998463+0000","last_change":"2023-09-30T22:52:29.998403+0000","last_active":"2023-09-30T22:52:29.998463+0000","last_peered":"2023-09-30T22:52:29.998463+0000","last_clean":"2023-09-30T22:52:29.998463+0000","last_became_active":"2023-09-30T22:52:29.998170+0000","last_became_peered":"2023-09-30T22:52:29.998170+0000","last_unstale":"2023-09-30T22:52:29.998463+0000","last_undegraded":"2023-09-30T22:52:29.998463+0000","last_fullsized":"2023-09-30T22:52:29.998463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:51.188433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994173+0000","last_change":"2023-09-30T22:52:29.993975+0000","last_active":"2023-09-30T22:52:29.994173+0000","last_peered":"2023-09-30T22:52:29.994173+0000","last_clean":"2023-09-30T22:52:29.994173+0000","last_became_active":"2023-09-30T22:52:29.993354+0000","last_became_peered":"2023-09-30T22:52:29.993354+0000","last_unstale":"2023-09-30T22:52:29.994173+0000","last_undegraded":"2023-09-30T22:52:29.994173+0000","last_fullsized":"2023-09-30T22:52:29.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995287+0000","last_change":"2023-09-30T22:52:29.995056+0000","last_active":"2023-09-30T22:52:29.995287+0000","last_peered":"2023-09-30T22:52:29.995287+0000","last_clean":"2023-09-30T22:52:29.995287+0000","last_became_active":"2023-09-30T22:52:29.994501+0000","last_became_peered":"2023-09-30T22:52:29.994501+0000","last_unstale":"2023-09-30T22:52:29.995287+0000","last_undegraded":"2023-09-30T22:52:29.995287+0000","last_fullsized":"2023-09-30T22:52:29.995287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998543+0000","last_change":"2023-09-30T22:52:29.998468+0000","last_active":"2023-09-30T22:52:29.998543+0000","last_peered":"2023-09-30T22:52:29.998543+0000","last_clean":"2023-09-30T22:52:29.998543+0000","last_became_active":"2023-09-30T22:52:29.998228+0000","last_became_peered":"2023-09-30T22:52:29.998228+0000","last_unstale":"2023-09-30T22:52:29.998543+0000","last_undegraded":"2023-09-30T22:52:29.998543+0000","last_fullsized":"2023-09-30T22:52:29.998543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002051+0000","last_change":"2023-09-30T22:52:30.001990+0000","last_active":"2023-09-30T22:52:30.002051+0000","last_peered":"2023-09-30T22:52:30.002051+0000","last_clean":"2023-09-30T22:52:30.002051+0000","last_became_active":"2023-09-30T22:52:30.001493+0000","last_became_peered":"2023-09-30T22:52:30.001493+0000","last_unstale":"2023-09-30T22:52:30.002051+0000","last_undegraded":"2023-09-30T22:52:30.002051+0000","last_fullsized":"2023-09-30T22:52:30.002051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999408+0000","last_change":"2023-09-30T22:52:29.999359+0000","last_active":"2023-09-30T22:52:29.999408+0000","last_peered":"2023-09-30T22:52:29.999408+0000","last_clean":"2023-09-30T22:52:29.999408+0000","last_became_active":"2023-09-30T22:52:29.999214+0000","last_became_peered":"2023-09-30T22:52:29.999214+0000","last_unstale":"2023-09-30T22:52:29.999408+0000","last_undegraded":"2023-09-30T22:52:29.999408+0000","last_fullsized":"2023-09-30T22:52:29.999408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995996+0000","last_change":"2023-09-30T22:52:29.995287+0000","last_active":"2023-09-30T22:52:29.995996+0000","last_peered":"2023-09-30T22:52:29.995996+0000","last_clean":"2023-09-30T22:52:29.995996+0000","last_became_active":"2023-09-30T22:52:29.994795+0000","last_became_peered":"2023-09-30T22:52:29.994795+0000","last_unstale":"2023-09-30T22:52:29.995996+0000","last_undegraded":"2023-09-30T22:52:29.995996+0000","last_fullsized":"2023-09-30T22:52:29.995996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:15:33.668598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999673+0000","last_change":"2023-09-30T22:52:29.999604+0000","last_active":"2023-09-30T22:52:29.999673+0000","last_peered":"2023-09-30T22:52:29.999673+0000","last_clean":"2023-09-30T22:52:29.999673+0000","last_became_active":"2023-09-30T22:52:29.999184+0000","last_became_peered":"2023-09-30T22:52:29.999184+0000","last_unstale":"2023-09-30T22:52:29.999673+0000","last_undegraded":"2023-09-30T22:52:29.999673+0000","last_fullsized":"2023-09-30T22:52:29.999673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994780+0000","last_change":"2023-09-30T22:52:29.994681+0000","last_active":"2023-09-30T22:52:29.994780+0000","last_peered":"2023-09-30T22:52:29.994780+0000","last_clean":"2023-09-30T22:52:29.994780+0000","last_became_active":"2023-09-30T22:52:29.994446+0000","last_became_peered":"2023-09-30T22:52:29.994446+0000","last_unstale":"2023-09-30T22:52:29.994780+0000","last_undegraded":"2023-09-30T22:52:29.994780+0000","last_fullsized":"2023-09-30T22:52:29.994780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996185+0000","last_change":"2023-09-30T22:52:29.995754+0000","last_active":"2023-09-30T22:52:29.996185+0000","last_peered":"2023-09-30T22:52:29.996185+0000","last_clean":"2023-09-30T22:52:29.996185+0000","last_became_active":"2023-09-30T22:52:29.995499+0000","last_became_peered":"2023-09-30T22:52:29.995499+0000","last_unstale":"2023-09-30T22:52:29.996185+0000","last_undegraded":"2023-09-30T22:52:29.996185+0000","last_fullsized":"2023-09-30T22:52:29.996185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002210+0000","last_change":"2023-09-30T22:52:30.002133+0000","last_active":"2023-09-30T22:52:30.002210+0000","last_peered":"2023-09-30T22:52:30.002210+0000","last_clean":"2023-09-30T22:52:30.002210+0000","last_became_active":"2023-09-30T22:52:30.001781+0000","last_became_peered":"2023-09-30T22:52:30.001781+0000","last_unstale":"2023-09-30T22:52:30.002210+0000","last_undegraded":"2023-09-30T22:52:30.002210+0000","last_fullsized":"2023-09-30T22:52:30.002210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003659+0000","last_change":"2023-09-30T22:52:30.003616+0000","last_active":"2023-09-30T22:52:30.003659+0000","last_peered":"2023-09-30T22:52:30.003659+0000","last_clean":"2023-09-30T22:52:30.003659+0000","last_became_active":"2023-09-30T22:52:30.003350+0000","last_became_peered":"2023-09-30T22:52:30.003350+0000","last_unstale":"2023-09-30T22:52:30.003659+0000","last_undegraded":"2023-09-30T22:52:30.003659+0000","last_fullsized":"2023-09-30T22:52:30.003659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003184+0000","last_change":"2023-09-30T22:52:30.003114+0000","last_active":"2023-09-30T22:52:30.003184+0000","last_peered":"2023-09-30T22:52:30.003184+0000","last_clean":"2023-09-30T22:52:30.003184+0000","last_became_active":"2023-09-30T22:52:30.002889+0000","last_became_peered":"2023-09-30T22:52:30.002889+0000","last_unstale":"2023-09-30T22:52:30.003184+0000","last_undegraded":"2023-09-30T22:52:30.003184+0000","last_fullsized":"2023-09-30T22:52:30.003184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.006633+0000","last_change":"2023-09-30T22:52:30.006559+0000","last_active":"2023-09-30T22:52:30.006633+0000","last_peered":"2023-09-30T22:52:30.006633+0000","last_clean":"2023-09-30T22:52:30.006633+0000","last_became_active":"2023-09-30T22:52:30.006332+0000","last_became_peered":"2023-09-30T22:52:30.006332+0000","last_unstale":"2023-09-30T22:52:30.006633+0000","last_undegraded":"2023-09-30T22:52:30.006633+0000","last_fullsized":"2023-09-30T22:52:30.006633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002227+0000","last_change":"2023-09-30T22:52:30.002139+0000","last_active":"2023-09-30T22:52:30.002227+0000","last_peered":"2023-09-30T22:52:30.002227+0000","last_clean":"2023-09-30T22:52:30.002227+0000","last_became_active":"2023-09-30T22:52:30.001805+0000","last_became_peered":"2023-09-30T22:52:30.001805+0000","last_unstale":"2023-09-30T22:52:30.002227+0000","last_undegraded":"2023-09-30T22:52:30.002227+0000","last_fullsized":"2023-09-30T22:52:30.002227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001758+0000","last_change":"2023-09-30T22:52:30.001685+0000","last_active":"2023-09-30T22:52:30.001758+0000","last_peered":"2023-09-30T22:52:30.001758+0000","last_clean":"2023-09-30T22:52:30.001758+0000","last_became_active":"2023-09-30T22:52:30.001423+0000","last_became_peered":"2023-09-30T22:52:30.001423+0000","last_unstale":"2023-09-30T22:52:30.001758+0000","last_undegraded":"2023-09-30T22:52:30.001758+0000","last_fullsized":"2023-09-30T22:52:30.001758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005462+0000","last_change":"2023-09-30T22:52:30.004937+0000","last_active":"2023-09-30T22:52:30.005462+0000","last_peered":"2023-09-30T22:52:30.005462+0000","last_clean":"2023-09-30T22:52:30.005462+0000","last_became_active":"2023-09-30T22:52:30.004706+0000","last_became_peered":"2023-09-30T22:52:30.004706+0000","last_unstale":"2023-09-30T22:52:30.005462+0000","last_undegraded":"2023-09-30T22:52:30.005462+0000","last_fullsized":"2023-09-30T22:52:30.005462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992856+0000","last_change":"2023-09-30T22:52:29.992721+0000","last_active":"2023-09-30T22:52:29.992856+0000","last_peered":"2023-09-30T22:52:29.992856+0000","last_clean":"2023-09-30T22:52:29.992856+0000","last_became_active":"2023-09-30T22:52:29.992342+0000","last_became_peered":"2023-09-30T22:52:29.992342+0000","last_unstale":"2023-09-30T22:52:29.992856+0000","last_undegraded":"2023-09-30T22:52:29.992856+0000","last_fullsized":"2023-09-30T22:52:29.992856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:24.803074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248905+0000","last_change":"2023-09-30T22:52:28.998829+0000","last_active":"2023-09-30T22:52:30.248905+0000","last_peered":"2023-09-30T22:52:30.248905+0000","last_clean":"2023-09-30T22:52:30.248905+0000","last_became_active":"2023-09-30T22:52:28.998455+0000","last_became_peered":"2023-09-30T22:52:28.998455+0000","last_unstale":"2023-09-30T22:52:30.248905+0000","last_undegraded":"2023-09-30T22:52:30.248905+0000","last_fullsized":"2023-09-30T22:52:30.248905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998559+0000","last_change":"2023-09-30T22:52:29.998485+0000","last_active":"2023-09-30T22:52:29.998559+0000","last_peered":"2023-09-30T22:52:29.998559+0000","last_clean":"2023-09-30T22:52:29.998559+0000","last_became_active":"2023-09-30T22:52:29.998254+0000","last_became_peered":"2023-09-30T22:52:29.998254+0000","last_unstale":"2023-09-30T22:52:29.998559+0000","last_undegraded":"2023-09-30T22:52:29.998559+0000","last_fullsized":"2023-09-30T22:52:29.998559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992280+0000","last_change":"2023-09-30T22:52:28.992995+0000","last_active":"2023-09-30T22:52:29.992280+0000","last_peered":"2023-09-30T22:52:29.992280+0000","last_clean":"2023-09-30T22:52:29.992280+0000","last_became_active":"2023-09-30T22:52:28.992765+0000","last_became_peered":"2023-09-30T22:52:28.992765+0000","last_unstale":"2023-09-30T22:52:29.992280+0000","last_undegraded":"2023-09-30T22:52:29.992280+0000","last_fullsized":"2023-09-30T22:52:29.992280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004464+0000","last_change":"2023-09-30T22:52:30.003848+0000","last_active":"2023-09-30T22:52:30.004464+0000","last_peered":"2023-09-30T22:52:30.004464+0000","last_clean":"2023-09-30T22:52:30.004464+0000","last_became_active":"2023-09-30T22:52:30.002282+0000","last_became_peered":"2023-09-30T22:52:30.002282+0000","last_unstale":"2023-09-30T22:52:30.004464+0000","last_undegraded":"2023-09-30T22:52:30.004464+0000","last_fullsized":"2023-09-30T22:52:30.004464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991202+0000","last_change":"2023-09-30T22:52:28.998425+0000","last_active":"2023-09-30T22:52:29.991202+0000","last_peered":"2023-09-30T22:52:29.991202+0000","last_clean":"2023-09-30T22:52:29.991202+0000","last_became_active":"2023-09-30T22:52:28.998147+0000","last_became_peered":"2023-09-30T22:52:28.998147+0000","last_unstale":"2023-09-30T22:52:29.991202+0000","last_undegraded":"2023-09-30T22:52:29.991202+0000","last_fullsized":"2023-09-30T22:52:29.991202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996031+0000","last_change":"2023-09-30T22:52:29.995807+0000","last_active":"2023-09-30T22:52:29.996031+0000","last_peered":"2023-09-30T22:52:29.996031+0000","last_clean":"2023-09-30T22:52:29.996031+0000","last_became_active":"2023-09-30T22:52:29.995537+0000","last_became_peered":"2023-09-30T22:52:29.995537+0000","last_unstale":"2023-09-30T22:52:29.996031+0000","last_undegraded":"2023-09-30T22:52:29.996031+0000","last_fullsized":"2023-09-30T22:52:29.996031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:34.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993246+0000","last_change":"2023-09-30T22:52:28.998533+0000","last_active":"2023-09-30T22:52:29.993246+0000","last_peered":"2023-09-30T22:52:29.993246+0000","last_clean":"2023-09-30T22:52:29.993246+0000","last_became_active":"2023-09-30T22:52:28.998113+0000","last_became_peered":"2023-09-30T22:52:28.998113+0000","last_unstale":"2023-09-30T22:52:29.993246+0000","last_undegraded":"2023-09-30T22:52:29.993246+0000","last_fullsized":"2023-09-30T22:52:29.993246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993991+0000","last_change":"2023-09-30T22:52:29.993919+0000","last_active":"2023-09-30T22:52:29.993991+0000","last_peered":"2023-09-30T22:52:29.993991+0000","last_clean":"2023-09-30T22:52:29.993991+0000","last_became_active":"2023-09-30T22:52:29.993688+0000","last_became_peered":"2023-09-30T22:52:29.993688+0000","last_unstale":"2023-09-30T22:52:29.993991+0000","last_undegraded":"2023-09-30T22:52:29.993991+0000","last_fullsized":"2023-09-30T22:52:29.993991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983128+0000","last_change":"2023-09-30T22:52:28.996877+0000","last_active":"2023-09-30T22:52:29.983128+0000","last_peered":"2023-09-30T22:52:29.983128+0000","last_clean":"2023-09-30T22:52:29.983128+0000","last_became_active":"2023-09-30T22:52:28.996514+0000","last_became_peered":"2023-09-30T22:52:28.996514+0000","last_unstale":"2023-09-30T22:52:29.983128+0000","last_undegraded":"2023-09-30T22:52:29.983128+0000","last_fullsized":"2023-09-30T22:52:29.983128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999725+0000","last_change":"2023-09-30T22:52:29.999648+0000","last_active":"2023-09-30T22:52:29.999725+0000","last_peered":"2023-09-30T22:52:29.999725+0000","last_clean":"2023-09-30T22:52:29.999725+0000","last_became_active":"2023-09-30T22:52:29.999326+0000","last_became_peered":"2023-09-30T22:52:29.999326+0000","last_unstale":"2023-09-30T22:52:29.999725+0000","last_undegraded":"2023-09-30T22:52:29.999725+0000","last_fullsized":"2023-09-30T22:52:29.999725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245788+0000","last_change":"2023-09-30T22:52:28.989757+0000","last_active":"2023-09-30T22:52:30.245788+0000","last_peered":"2023-09-30T22:52:30.245788+0000","last_clean":"2023-09-30T22:52:30.245788+0000","last_became_active":"2023-09-30T22:52:28.989527+0000","last_became_peered":"2023-09-30T22:52:28.989527+0000","last_unstale":"2023-09-30T22:52:30.245788+0000","last_undegraded":"2023-09-30T22:52:30.245788+0000","last_fullsized":"2023-09-30T22:52:30.245788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002468+0000","last_change":"2023-09-30T22:52:30.001993+0000","last_active":"2023-09-30T22:52:30.002468+0000","last_peered":"2023-09-30T22:52:30.002468+0000","last_clean":"2023-09-30T22:52:30.002468+0000","last_became_active":"2023-09-30T22:52:30.001442+0000","last_became_peered":"2023-09-30T22:52:30.001442+0000","last_unstale":"2023-09-30T22:52:30.002468+0000","last_undegraded":"2023-09-30T22:52:30.002468+0000","last_fullsized":"2023-09-30T22:52:30.002468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.249324+0000","last_change":"2023-09-30T22:52:28.996750+0000","last_active":"2023-09-30T22:52:30.249324+0000","last_peered":"2023-09-30T22:52:30.249324+0000","last_clean":"2023-09-30T22:52:30.249324+0000","last_became_active":"2023-09-30T22:52:28.996452+0000","last_became_peered":"2023-09-30T22:52:28.996452+0000","last_unstale":"2023-09-30T22:52:30.249324+0000","last_undegraded":"2023-09-30T22:52:30.249324+0000","last_fullsized":"2023-09-30T22:52:30.249324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:27.626860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986641+0000","last_change":"2023-09-30T22:52:29.986448+0000","last_active":"2023-09-30T22:52:29.986641+0000","last_peered":"2023-09-30T22:52:29.986641+0000","last_clean":"2023-09-30T22:52:29.986641+0000","last_became_active":"2023-09-30T22:52:29.985949+0000","last_became_peered":"2023-09-30T22:52:29.985949+0000","last_unstale":"2023-09-30T22:52:29.986641+0000","last_undegraded":"2023-09-30T22:52:29.986641+0000","last_fullsized":"2023-09-30T22:52:29.986641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246918+0000","last_change":"2023-09-30T22:52:28.994103+0000","last_active":"2023-09-30T22:52:30.246918+0000","last_peered":"2023-09-30T22:52:30.246918+0000","last_clean":"2023-09-30T22:52:30.246918+0000","last_became_active":"2023-09-30T22:52:28.993565+0000","last_became_peered":"2023-09-30T22:52:28.993565+0000","last_unstale":"2023-09-30T22:52:30.246918+0000","last_undegraded":"2023-09-30T22:52:30.246918+0000","last_fullsized":"2023-09-30T22:52:30.246918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:13.263038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004432+0000","last_change":"2023-09-30T22:52:30.004350+0000","last_active":"2023-09-30T22:52:30.004432+0000","last_peered":"2023-09-30T22:52:30.004432+0000","last_clean":"2023-09-30T22:52:30.004432+0000","last_became_active":"2023-09-30T22:52:30.004122+0000","last_became_peered":"2023-09-30T22:52:30.004122+0000","last_unstale":"2023-09-30T22:52:30.004432+0000","last_undegraded":"2023-09-30T22:52:30.004432+0000","last_fullsized":"2023-09-30T22:52:30.004432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985835+0000","last_change":"2023-09-30T22:52:28.996489+0000","last_active":"2023-09-30T22:52:29.985835+0000","last_peered":"2023-09-30T22:52:29.985835+0000","last_clean":"2023-09-30T22:52:29.985835+0000","last_became_active":"2023-09-30T22:52:28.996265+0000","last_became_peered":"2023-09-30T22:52:28.996265+0000","last_unstale":"2023-09-30T22:52:29.985835+0000","last_undegraded":"2023-09-30T22:52:29.985835+0000","last_fullsized":"2023-09-30T22:52:29.985835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992971+0000","last_change":"2023-09-30T22:52:29.992910+0000","last_active":"2023-09-30T22:52:29.992971+0000","last_peered":"2023-09-30T22:52:29.992971+0000","last_clean":"2023-09-30T22:52:29.992971+0000","last_became_active":"2023-09-30T22:52:29.992692+0000","last_became_peered":"2023-09-30T22:52:29.992692+0000","last_unstale":"2023-09-30T22:52:29.992971+0000","last_undegraded":"2023-09-30T22:52:29.992971+0000","last_fullsized":"2023-09-30T22:52:29.992971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:48.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984470+0000","last_change":"2023-09-30T22:52:28.995355+0000","last_active":"2023-09-30T22:52:29.984470+0000","last_peered":"2023-09-30T22:52:29.984470+0000","last_clean":"2023-09-30T22:52:29.984470+0000","last_became_active":"2023-09-30T22:52:28.995101+0000","last_became_peered":"2023-09-30T22:52:28.995101+0000","last_unstale":"2023-09-30T22:52:29.984470+0000","last_undegraded":"2023-09-30T22:52:29.984470+0000","last_fullsized":"2023-09-30T22:52:29.984470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:42.659983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995682+0000","last_change":"2023-09-30T22:52:29.995214+0000","last_active":"2023-09-30T22:52:29.995682+0000","last_peered":"2023-09-30T22:52:29.995682+0000","last_clean":"2023-09-30T22:52:29.995682+0000","last_became_active":"2023-09-30T22:52:29.994812+0000","last_became_peered":"2023-09-30T22:52:29.994812+0000","last_unstale":"2023-09-30T22:52:29.995682+0000","last_undegraded":"2023-09-30T22:52:29.995682+0000","last_fullsized":"2023-09-30T22:52:29.995682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248817+0000","last_change":"2023-09-30T22:52:28.998681+0000","last_active":"2023-09-30T22:52:30.248817+0000","last_peered":"2023-09-30T22:52:30.248817+0000","last_clean":"2023-09-30T22:52:30.248817+0000","last_became_active":"2023-09-30T22:52:28.998134+0000","last_became_peered":"2023-09-30T22:52:28.998134+0000","last_unstale":"2023-09-30T22:52:30.248817+0000","last_undegraded":"2023-09-30T22:52:30.248817+0000","last_fullsized":"2023-09-30T22:52:30.248817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:20.038280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002410+0000","last_change":"2023-09-30T22:52:30.002333+0000","last_active":"2023-09-30T22:52:30.002410+0000","last_peered":"2023-09-30T22:52:30.002410+0000","last_clean":"2023-09-30T22:52:30.002410+0000","last_became_active":"2023-09-30T22:52:30.002100+0000","last_became_peered":"2023-09-30T22:52:30.002100+0000","last_unstale":"2023-09-30T22:52:30.002410+0000","last_undegraded":"2023-09-30T22:52:30.002410+0000","last_fullsized":"2023-09-30T22:52:30.002410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248442+0000","last_change":"2023-09-30T22:52:28.987245+0000","last_active":"2023-09-30T22:52:30.248442+0000","last_peered":"2023-09-30T22:52:30.248442+0000","last_clean":"2023-09-30T22:52:30.248442+0000","last_became_active":"2023-09-30T22:52:28.987022+0000","last_became_peered":"2023-09-30T22:52:28.987022+0000","last_unstale":"2023-09-30T22:52:30.248442+0000","last_undegraded":"2023-09-30T22:52:30.248442+0000","last_fullsized":"2023-09-30T22:52:30.248442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995980+0000","last_change":"2023-09-30T22:52:29.995141+0000","last_active":"2023-09-30T22:52:29.995980+0000","last_peered":"2023-09-30T22:52:29.995980+0000","last_clean":"2023-09-30T22:52:29.995980+0000","last_became_active":"2023-09-30T22:52:29.994512+0000","last_became_peered":"2023-09-30T22:52:29.994512+0000","last_unstale":"2023-09-30T22:52:29.995980+0000","last_undegraded":"2023-09-30T22:52:29.995980+0000","last_fullsized":"2023-09-30T22:52:29.995980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:49.646123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245185+0000","last_change":"2023-09-30T22:52:28.995188+0000","last_active":"2023-09-30T22:52:30.245185+0000","last_peered":"2023-09-30T22:52:30.245185+0000","last_clean":"2023-09-30T22:52:30.245185+0000","last_became_active":"2023-09-30T22:52:28.994967+0000","last_became_peered":"2023-09-30T22:52:28.994967+0000","last_unstale":"2023-09-30T22:52:30.245185+0000","last_undegraded":"2023-09-30T22:52:30.245185+0000","last_fullsized":"2023-09-30T22:52:30.245185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002064+0000","last_change":"2023-09-30T22:52:30.002007+0000","last_active":"2023-09-30T22:52:30.002064+0000","last_peered":"2023-09-30T22:52:30.002064+0000","last_clean":"2023-09-30T22:52:30.002064+0000","last_became_active":"2023-09-30T22:52:30.001460+0000","last_became_peered":"2023-09-30T22:52:30.001460+0000","last_unstale":"2023-09-30T22:52:30.002064+0000","last_undegraded":"2023-09-30T22:52:30.002064+0000","last_fullsized":"2023-09-30T22:52:30.002064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248680+0000","last_change":"2023-09-30T22:52:29.000836+0000","last_active":"2023-09-30T22:52:30.248680+0000","last_peered":"2023-09-30T22:52:30.248680+0000","last_clean":"2023-09-30T22:52:30.248680+0000","last_became_active":"2023-09-30T22:52:29.000596+0000","last_became_peered":"2023-09-30T22:52:29.000596+0000","last_unstale":"2023-09-30T22:52:30.248680+0000","last_undegraded":"2023-09-30T22:52:30.248680+0000","last_fullsized":"2023-09-30T22:52:30.248680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:52.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985152+0000","last_change":"2023-09-30T22:52:29.985065+0000","last_active":"2023-09-30T22:52:29.985152+0000","last_peered":"2023-09-30T22:52:29.985152+0000","last_clean":"2023-09-30T22:52:29.985152+0000","last_became_active":"2023-09-30T22:52:29.984838+0000","last_became_peered":"2023-09-30T22:52:29.984838+0000","last_unstale":"2023-09-30T22:52:29.985152+0000","last_undegraded":"2023-09-30T22:52:29.985152+0000","last_fullsized":"2023-09-30T22:52:29.985152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991396+0000","last_change":"2023-09-30T22:52:28.992846+0000","last_active":"2023-09-30T22:52:29.991396+0000","last_peered":"2023-09-30T22:52:29.991396+0000","last_clean":"2023-09-30T22:52:29.991396+0000","last_became_active":"2023-09-30T22:52:28.992621+0000","last_became_peered":"2023-09-30T22:52:28.992621+0000","last_unstale":"2023-09-30T22:52:29.991396+0000","last_undegraded":"2023-09-30T22:52:29.991396+0000","last_fullsized":"2023-09-30T22:52:29.991396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:15:35.415866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005444+0000","last_change":"2023-09-30T22:52:30.005297+0000","last_active":"2023-09-30T22:52:30.005444+0000","last_peered":"2023-09-30T22:52:30.005444+0000","last_clean":"2023-09-30T22:52:30.005444+0000","last_became_active":"2023-09-30T22:52:30.005071+0000","last_became_peered":"2023-09-30T22:52:30.005071+0000","last_unstale":"2023-09-30T22:52:30.005444+0000","last_undegraded":"2023-09-30T22:52:30.005444+0000","last_fullsized":"2023-09-30T22:52:30.005444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.988566+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.988328+0000","last_became_peered":"2023-09-30T22:52:28.988328+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000757+0000","last_change":"2023-09-30T22:52:30.000695+0000","last_active":"2023-09-30T22:52:30.000757+0000","last_peered":"2023-09-30T22:52:30.000757+0000","last_clean":"2023-09-30T22:52:30.000757+0000","last_became_active":"2023-09-30T22:52:30.000416+0000","last_became_peered":"2023-09-30T22:52:30.000416+0000","last_unstale":"2023-09-30T22:52:30.000757+0000","last_undegraded":"2023-09-30T22:52:30.000757+0000","last_fullsized":"2023-09-30T22:52:30.000757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982988+0000","last_change":"2023-09-30T22:52:28.993499+0000","last_active":"2023-09-30T22:52:29.982988+0000","last_peered":"2023-09-30T22:52:29.982988+0000","last_clean":"2023-09-30T22:52:29.982988+0000","last_became_active":"2023-09-30T22:52:28.990179+0000","last_became_peered":"2023-09-30T22:52:28.990179+0000","last_unstale":"2023-09-30T22:52:29.982988+0000","last_undegraded":"2023-09-30T22:52:29.982988+0000","last_fullsized":"2023-09-30T22:52:29.982988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:10.753274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995962+0000","last_change":"2023-09-30T22:52:29.995007+0000","last_active":"2023-09-30T22:52:29.995962+0000","last_peered":"2023-09-30T22:52:29.995962+0000","last_clean":"2023-09-30T22:52:29.995962+0000","last_became_active":"2023-09-30T22:52:29.994234+0000","last_became_peered":"2023-09-30T22:52:29.994234+0000","last_unstale":"2023-09-30T22:52:29.995962+0000","last_undegraded":"2023-09-30T22:52:29.995962+0000","last_fullsized":"2023-09-30T22:52:29.995962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:59:32.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982689+0000","last_change":"2023-09-30T22:52:28.995013+0000","last_active":"2023-09-30T22:52:29.982689+0000","last_peered":"2023-09-30T22:52:29.982689+0000","last_clean":"2023-09-30T22:52:29.982689+0000","last_became_active":"2023-09-30T22:52:28.994596+0000","last_became_peered":"2023-09-30T22:52:28.994596+0000","last_unstale":"2023-09-30T22:52:29.982689+0000","last_undegraded":"2023-09-30T22:52:29.982689+0000","last_fullsized":"2023-09-30T22:52:29.982689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:50.179162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986659+0000","last_change":"2023-09-30T22:52:29.986589+0000","last_active":"2023-09-30T22:52:29.986659+0000","last_peered":"2023-09-30T22:52:29.986659+0000","last_clean":"2023-09-30T22:52:29.986659+0000","last_became_active":"2023-09-30T22:52:29.986233+0000","last_became_peered":"2023-09-30T22:52:29.986233+0000","last_unstale":"2023-09-30T22:52:29.986659+0000","last_undegraded":"2023-09-30T22:52:29.986659+0000","last_fullsized":"2023-09-30T22:52:29.986659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993407+0000","last_change":"2023-09-30T22:52:28.992419+0000","last_active":"2023-09-30T22:52:29.993407+0000","last_peered":"2023-09-30T22:52:29.993407+0000","last_clean":"2023-09-30T22:52:29.993407+0000","last_became_active":"2023-09-30T22:52:28.992194+0000","last_became_peered":"2023-09-30T22:52:28.992194+0000","last_unstale":"2023-09-30T22:52:29.993407+0000","last_undegraded":"2023-09-30T22:52:29.993407+0000","last_fullsized":"2023-09-30T22:52:29.993407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005479+0000","last_change":"2023-09-30T22:52:30.005382+0000","last_active":"2023-09-30T22:52:30.005479+0000","last_peered":"2023-09-30T22:52:30.005479+0000","last_clean":"2023-09-30T22:52:30.005479+0000","last_became_active":"2023-09-30T22:52:30.005167+0000","last_became_peered":"2023-09-30T22:52:30.005167+0000","last_unstale":"2023-09-30T22:52:30.005479+0000","last_undegraded":"2023-09-30T22:52:30.005479+0000","last_fullsized":"2023-09-30T22:52:30.005479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991288+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:52:29.991288+0000","last_peered":"2023-09-30T22:52:29.991288+0000","last_clean":"2023-09-30T22:52:29.991288+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:52:29.991288+0000","last_undegraded":"2023-09-30T22:52:29.991288+0000","last_fullsized":"2023-09-30T22:52:29.991288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982887+0000","last_change":"2023-09-30T22:52:28.993144+0000","last_active":"2023-09-30T22:52:29.982887+0000","last_peered":"2023-09-30T22:52:29.982887+0000","last_clean":"2023-09-30T22:52:29.982887+0000","last_became_active":"2023-09-30T22:52:28.992932+0000","last_became_peered":"2023-09-30T22:52:28.992932+0000","last_unstale":"2023-09-30T22:52:29.982887+0000","last_undegraded":"2023-09-30T22:52:29.982887+0000","last_fullsized":"2023-09-30T22:52:29.982887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.987116+0000","last_change":"2023-09-30T22:52:29.987045+0000","last_active":"2023-09-30T22:52:29.987116+0000","last_peered":"2023-09-30T22:52:29.987116+0000","last_clean":"2023-09-30T22:52:29.987116+0000","last_became_active":"2023-09-30T22:52:29.986888+0000","last_became_peered":"2023-09-30T22:52:29.986888+0000","last_unstale":"2023-09-30T22:52:29.987116+0000","last_undegraded":"2023-09-30T22:52:29.987116+0000","last_fullsized":"2023-09-30T22:52:29.987116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984369+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:52:29.984369+0000","last_peered":"2023-09-30T22:52:29.984369+0000","last_clean":"2023-09-30T22:52:29.984369+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:52:29.984369+0000","last_undegraded":"2023-09-30T22:52:29.984369+0000","last_fullsized":"2023-09-30T22:52:29.984369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990050+0000","last_change":"2023-09-30T22:52:28.995710+0000","last_active":"2023-09-30T22:52:29.990050+0000","last_peered":"2023-09-30T22:52:29.990050+0000","last_clean":"2023-09-30T22:52:29.990050+0000","last_became_active":"2023-09-30T22:52:28.995466+0000","last_became_peered":"2023-09-30T22:52:28.995466+0000","last_unstale":"2023-09-30T22:52:29.990050+0000","last_undegraded":"2023-09-30T22:52:29.990050+0000","last_fullsized":"2023-09-30T22:52:29.990050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996250+0000","last_change":"2023-09-30T22:52:29.996115+0000","last_active":"2023-09-30T22:52:29.996250+0000","last_peered":"2023-09-30T22:52:29.996250+0000","last_clean":"2023-09-30T22:52:29.996250+0000","last_became_active":"2023-09-30T22:52:29.995868+0000","last_became_peered":"2023-09-30T22:52:29.995868+0000","last_unstale":"2023-09-30T22:52:29.996250+0000","last_undegraded":"2023-09-30T22:52:29.996250+0000","last_fullsized":"2023-09-30T22:52:29.996250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.989952+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:52:29.989952+0000","last_peered":"2023-09-30T22:52:29.989952+0000","last_clean":"2023-09-30T22:52:29.989952+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:52:29.989952+0000","last_undegraded":"2023-09-30T22:52:29.989952+0000","last_fullsized":"2023-09-30T22:52:29.989952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990961+0000","last_change":"2023-09-30T22:52:28.999654+0000","last_active":"2023-09-30T22:52:29.990961+0000","last_peered":"2023-09-30T22:52:29.990961+0000","last_clean":"2023-09-30T22:52:29.990961+0000","last_became_active":"2023-09-30T22:52:28.999396+0000","last_became_peered":"2023-09-30T22:52:28.999396+0000","last_unstale":"2023-09-30T22:52:29.990961+0000","last_undegraded":"2023-09-30T22:52:29.990961+0000","last_fullsized":"2023-09-30T22:52:29.990961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996005+0000","last_change":"2023-09-30T22:52:29.995237+0000","last_active":"2023-09-30T22:52:29.996005+0000","last_peered":"2023-09-30T22:52:29.996005+0000","last_clean":"2023-09-30T22:52:29.996005+0000","last_became_active":"2023-09-30T22:52:29.994975+0000","last_became_peered":"2023-09-30T22:52:29.994975+0000","last_unstale":"2023-09-30T22:52:29.996005+0000","last_undegraded":"2023-09-30T22:52:29.996005+0000","last_fullsized":"2023-09-30T22:52:29.996005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984408+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:52:29.984408+0000","last_peered":"2023-09-30T22:52:29.984408+0000","last_clean":"2023-09-30T22:52:29.984408+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:52:29.984408+0000","last_undegraded":"2023-09-30T22:52:29.984408+0000","last_fullsized":"2023-09-30T22:52:29.984408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990530+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:52:29.990530+0000","last_peered":"2023-09-30T22:52:29.990530+0000","last_clean":"2023-09-30T22:52:29.990530+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:52:29.990530+0000","last_undegraded":"2023-09-30T22:52:29.990530+0000","last_fullsized":"2023-09-30T22:52:29.990530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992306+0000","last_change":"2023-09-30T22:52:28.995976+0000","last_active":"2023-09-30T22:52:29.992306+0000","last_peered":"2023-09-30T22:52:29.992306+0000","last_clean":"2023-09-30T22:52:29.992306+0000","last_became_active":"2023-09-30T22:52:28.995724+0000","last_became_peered":"2023-09-30T22:52:28.995724+0000","last_unstale":"2023-09-30T22:52:29.992306+0000","last_undegraded":"2023-09-30T22:52:29.992306+0000","last_fullsized":"2023-09-30T22:52:29.992306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992841+0000","last_change":"2023-09-30T22:52:29.992622+0000","last_active":"2023-09-30T22:52:29.992841+0000","last_peered":"2023-09-30T22:52:29.992841+0000","last_clean":"2023-09-30T22:52:29.992841+0000","last_became_active":"2023-09-30T22:52:29.992005+0000","last_became_peered":"2023-09-30T22:52:29.992005+0000","last_unstale":"2023-09-30T22:52:29.992841+0000","last_undegraded":"2023-09-30T22:52:29.992841+0000","last_fullsized":"2023-09-30T22:52:29.992841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:28.590938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982896+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:52:29.982896+0000","last_peered":"2023-09-30T22:52:29.982896+0000","last_clean":"2023-09-30T22:52:29.982896+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:52:29.982896+0000","last_undegraded":"2023-09-30T22:52:29.982896+0000","last_fullsized":"2023-09-30T22:52:29.982896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985789+0000","last_change":"2023-09-30T22:52:28.994561+0000","last_active":"2023-09-30T22:52:29.985789+0000","last_peered":"2023-09-30T22:52:29.985789+0000","last_clean":"2023-09-30T22:52:29.985789+0000","last_became_active":"2023-09-30T22:52:28.994326+0000","last_became_peered":"2023-09-30T22:52:28.994326+0000","last_unstale":"2023-09-30T22:52:29.985789+0000","last_undegraded":"2023-09-30T22:52:29.985789+0000","last_fullsized":"2023-09-30T22:52:29.985789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:11.947068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994260+0000","last_change":"2023-09-30T22:52:29.994185+0000","last_active":"2023-09-30T22:52:29.994260+0000","last_peered":"2023-09-30T22:52:29.994260+0000","last_clean":"2023-09-30T22:52:29.994260+0000","last_became_active":"2023-09-30T22:52:29.993967+0000","last_became_peered":"2023-09-30T22:52:29.993967+0000","last_unstale":"2023-09-30T22:52:29.994260+0000","last_undegraded":"2023-09-30T22:52:29.994260+0000","last_fullsized":"2023-09-30T22:52:29.994260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982819+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:52:29.982819+0000","last_peered":"2023-09-30T22:52:29.982819+0000","last_clean":"2023-09-30T22:52:29.982819+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:52:29.982819+0000","last_undegraded":"2023-09-30T22:52:29.982819+0000","last_fullsized":"2023-09-30T22:52:29.982819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985802+0000","last_change":"2023-09-30T22:52:28.996536+0000","last_active":"2023-09-30T22:52:29.985802+0000","last_peered":"2023-09-30T22:52:29.985802+0000","last_clean":"2023-09-30T22:52:29.985802+0000","last_became_active":"2023-09-30T22:52:28.996306+0000","last_became_peered":"2023-09-30T22:52:28.996306+0000","last_unstale":"2023-09-30T22:52:29.985802+0000","last_undegraded":"2023-09-30T22:52:29.985802+0000","last_fullsized":"2023-09-30T22:52:29.985802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:55.045032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996026+0000","last_change":"2023-09-30T22:52:29.995265+0000","last_active":"2023-09-30T22:52:29.996026+0000","last_peered":"2023-09-30T22:52:29.996026+0000","last_clean":"2023-09-30T22:52:29.996026+0000","last_became_active":"2023-09-30T22:52:29.994582+0000","last_became_peered":"2023-09-30T22:52:29.994582+0000","last_unstale":"2023-09-30T22:52:29.996026+0000","last_undegraded":"2023-09-30T22:52:29.996026+0000","last_fullsized":"2023-09-30T22:52:29.996026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.995448+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.995132+0000","last_became_peered":"2023-09-30T22:52:28.995132+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993209+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:52:29.993209+0000","last_peered":"2023-09-30T22:52:29.993209+0000","last_clean":"2023-09-30T22:52:29.993209+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:52:29.993209+0000","last_undegraded":"2023-09-30T22:52:29.993209+0000","last_fullsized":"2023-09-30T22:52:29.993209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003796+0000","last_change":"2023-09-30T22:52:30.002605+0000","last_active":"2023-09-30T22:52:30.003796+0000","last_peered":"2023-09-30T22:52:30.003796+0000","last_clean":"2023-09-30T22:52:30.003796+0000","last_became_active":"2023-09-30T22:52:30.001819+0000","last_became_peered":"2023-09-30T22:52:30.001819+0000","last_unstale":"2023-09-30T22:52:30.003796+0000","last_undegraded":"2023-09-30T22:52:30.003796+0000","last_fullsized":"2023-09-30T22:52:30.003796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983742+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:52:29.983742+0000","last_peered":"2023-09-30T22:52:29.983742+0000","last_clean":"2023-09-30T22:52:29.983742+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:52:29.983742+0000","last_undegraded":"2023-09-30T22:52:29.983742+0000","last_fullsized":"2023-09-30T22:52:29.983742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993314+0000","last_change":"2023-09-30T22:52:28.993895+0000","last_active":"2023-09-30T22:52:29.993314+0000","last_peered":"2023-09-30T22:52:29.993314+0000","last_clean":"2023-09-30T22:52:29.993314+0000","last_became_active":"2023-09-30T22:52:28.993671+0000","last_became_peered":"2023-09-30T22:52:28.993671+0000","last_unstale":"2023-09-30T22:52:29.993314+0000","last_undegraded":"2023-09-30T22:52:29.993314+0000","last_fullsized":"2023-09-30T22:52:29.993314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985123+0000","last_change":"2023-09-30T22:52:29.984764+0000","last_active":"2023-09-30T22:52:29.985123+0000","last_peered":"2023-09-30T22:52:29.985123+0000","last_clean":"2023-09-30T22:52:29.985123+0000","last_became_active":"2023-09-30T22:52:29.984512+0000","last_became_peered":"2023-09-30T22:52:29.984512+0000","last_unstale":"2023-09-30T22:52:29.985123+0000","last_undegraded":"2023-09-30T22:52:29.985123+0000","last_fullsized":"2023-09-30T22:52:29.985123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245152+0000","last_change":"2023-09-30T22:52:28.992724+0000","last_active":"2023-09-30T22:52:30.245152+0000","last_peered":"2023-09-30T22:52:30.245152+0000","last_clean":"2023-09-30T22:52:30.245152+0000","last_became_active":"2023-09-30T22:52:28.992475+0000","last_became_peered":"2023-09-30T22:52:28.992475+0000","last_unstale":"2023-09-30T22:52:30.245152+0000","last_undegraded":"2023-09-30T22:52:30.245152+0000","last_fullsized":"2023-09-30T22:52:30.245152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002489+0000","last_change":"2023-09-30T22:52:30.002130+0000","last_active":"2023-09-30T22:52:30.002489+0000","last_peered":"2023-09-30T22:52:30.002489+0000","last_clean":"2023-09-30T22:52:30.002489+0000","last_became_active":"2023-09-30T22:52:30.001756+0000","last_became_peered":"2023-09-30T22:52:30.001756+0000","last_unstale":"2023-09-30T22:52:30.002489+0000","last_undegraded":"2023-09-30T22:52:30.002489+0000","last_fullsized":"2023-09-30T22:52:30.002489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.247149+0000","last_change":"2023-09-30T22:52:28.988451+0000","last_active":"2023-09-30T22:52:30.247149+0000","last_peered":"2023-09-30T22:52:30.247149+0000","last_clean":"2023-09-30T22:52:30.247149+0000","last_became_active":"2023-09-30T22:52:28.988208+0000","last_became_peered":"2023-09-30T22:52:28.988208+0000","last_unstale":"2023-09-30T22:52:30.247149+0000","last_undegraded":"2023-09-30T22:52:30.247149+0000","last_fullsized":"2023-09-30T22:52:30.247149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994183+0000","last_change":"2023-09-30T22:52:29.994020+0000","last_active":"2023-09-30T22:52:29.994183+0000","last_peered":"2023-09-30T22:52:29.994183+0000","last_clean":"2023-09-30T22:52:29.994183+0000","last_became_active":"2023-09-30T22:52:29.993783+0000","last_became_peered":"2023-09-30T22:52:29.993783+0000","last_unstale":"2023-09-30T22:52:29.994183+0000","last_undegraded":"2023-09-30T22:52:29.994183+0000","last_fullsized":"2023-09-30T22:52:29.994183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246723+0000","last_change":"2023-09-30T22:52:28.994877+0000","last_active":"2023-09-30T22:52:30.246723+0000","last_peered":"2023-09-30T22:52:30.246723+0000","last_clean":"2023-09-30T22:52:30.246723+0000","last_became_active":"2023-09-30T22:52:28.993855+0000","last_became_peered":"2023-09-30T22:52:28.993855+0000","last_unstale":"2023-09-30T22:52:30.246723+0000","last_undegraded":"2023-09-30T22:52:30.246723+0000","last_fullsized":"2023-09-30T22:52:30.246723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:05.100032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.988016+0000","last_change":"2023-09-30T22:52:29.987968+0000","last_active":"2023-09-30T22:52:29.988016+0000","last_peered":"2023-09-30T22:52:29.988016+0000","last_clean":"2023-09-30T22:52:29.988016+0000","last_became_active":"2023-09-30T22:52:29.987840+0000","last_became_peered":"2023-09-30T22:52:29.987840+0000","last_unstale":"2023-09-30T22:52:29.988016+0000","last_undegraded":"2023-09-30T22:52:29.988016+0000","last_fullsized":"2023-09-30T22:52:29.988016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245418+0000","last_change":"2023-09-30T22:52:28.997114+0000","last_active":"2023-09-30T22:52:30.245418+0000","last_peered":"2023-09-30T22:52:30.245418+0000","last_clean":"2023-09-30T22:52:30.245418+0000","last_became_active":"2023-09-30T22:52:28.996627+0000","last_became_peered":"2023-09-30T22:52:28.996627+0000","last_unstale":"2023-09-30T22:52:30.245418+0000","last_undegraded":"2023-09-30T22:52:30.245418+0000","last_fullsized":"2023-09-30T22:52:30.245418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999051+0000","last_change":"2023-09-30T22:52:29.998983+0000","last_active":"2023-09-30T22:52:29.999051+0000","last_peered":"2023-09-30T22:52:29.999051+0000","last_clean":"2023-09-30T22:52:29.999051+0000","last_became_active":"2023-09-30T22:52:29.998760+0000","last_became_peered":"2023-09-30T22:52:29.998760+0000","last_unstale":"2023-09-30T22:52:29.999051+0000","last_undegraded":"2023-09-30T22:52:29.999051+0000","last_fullsized":"2023-09-30T22:52:29.999051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248249+0000","last_change":"2023-09-30T22:52:28.998655+0000","last_active":"2023-09-30T22:52:30.248249+0000","last_peered":"2023-09-30T22:52:30.248249+0000","last_clean":"2023-09-30T22:52:30.248249+0000","last_became_active":"2023-09-30T22:52:28.998409+0000","last_became_peered":"2023-09-30T22:52:28.998409+0000","last_unstale":"2023-09-30T22:52:30.248249+0000","last_undegraded":"2023-09-30T22:52:30.248249+0000","last_fullsized":"2023-09-30T22:52:30.248249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001122+0000","last_change":"2023-09-30T22:52:30.001062+0000","last_active":"2023-09-30T22:52:30.001122+0000","last_peered":"2023-09-30T22:52:30.001122+0000","last_clean":"2023-09-30T22:52:30.001122+0000","last_became_active":"2023-09-30T22:52:30.000803+0000","last_became_peered":"2023-09-30T22:52:30.000803+0000","last_unstale":"2023-09-30T22:52:30.001122+0000","last_undegraded":"2023-09-30T22:52:30.001122+0000","last_fullsized":"2023-09-30T22:52:30.001122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002078+0000","last_change":"2023-09-30T22:52:30.001992+0000","last_active":"2023-09-30T22:52:30.002078+0000","last_peered":"2023-09-30T22:52:30.002078+0000","last_clean":"2023-09-30T22:52:30.002078+0000","last_became_active":"2023-09-30T22:52:30.001745+0000","last_became_peered":"2023-09-30T22:52:30.001745+0000","last_unstale":"2023-09-30T22:52:30.002078+0000","last_undegraded":"2023-09-30T22:52:30.002078+0000","last_fullsized":"2023-09-30T22:52:30.002078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998638+0000","last_change":"2023-09-30T22:52:29.998560+0000","last_active":"2023-09-30T22:52:29.998638+0000","last_peered":"2023-09-30T22:52:29.998638+0000","last_clean":"2023-09-30T22:52:29.998638+0000","last_became_active":"2023-09-30T22:52:29.997840+0000","last_became_peered":"2023-09-30T22:52:29.997840+0000","last_unstale":"2023-09-30T22:52:29.998638+0000","last_undegraded":"2023-09-30T22:52:29.998638+0000","last_fullsized":"2023-09-30T22:52:29.998638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995699+0000","last_change":"2023-09-30T22:52:29.995634+0000","last_active":"2023-09-30T22:52:29.995699+0000","last_peered":"2023-09-30T22:52:29.995699+0000","last_clean":"2023-09-30T22:52:29.995699+0000","last_became_active":"2023-09-30T22:52:29.995407+0000","last_became_peered":"2023-09-30T22:52:29.995407+0000","last_unstale":"2023-09-30T22:52:29.995699+0000","last_undegraded":"2023-09-30T22:52:29.995699+0000","last_fullsized":"2023-09-30T22:52:29.995699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003196+0000","last_change":"2023-09-30T22:52:30.002695+0000","last_active":"2023-09-30T22:52:30.003196+0000","last_peered":"2023-09-30T22:52:30.003196+0000","last_clean":"2023-09-30T22:52:30.003196+0000","last_became_active":"2023-09-30T22:52:30.002463+0000","last_became_peered":"2023-09-30T22:52:30.002463+0000","last_unstale":"2023-09-30T22:52:30.003196+0000","last_undegraded":"2023-09-30T22:52:30.003196+0000","last_fullsized":"2023-09-30T22:52:30.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:25.402337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996203+0000","last_change":"2023-09-30T22:52:29.996129+0000","last_active":"2023-09-30T22:52:29.996203+0000","last_peered":"2023-09-30T22:52:29.996203+0000","last_clean":"2023-09-30T22:52:29.996203+0000","last_became_active":"2023-09-30T22:52:29.995897+0000","last_became_peered":"2023-09-30T22:52:29.995897+0000","last_unstale":"2023-09-30T22:52:29.996203+0000","last_undegraded":"2023-09-30T22:52:29.996203+0000","last_fullsized":"2023-09-30T22:52:29.996203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":80,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195231,"statfs":{"total":200000000,"available":199917336,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":82,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195230,"statfs":{"total":200000000,"available":199915946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909201,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]}],"pool_statfs":[]}} 2023-09-30T22:52:35.041 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:52:35.042 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:52:35.042 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:52:35.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:52:35.042 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T22:52:35.136 INFO:tasks.ceph.mds.c.smithi142.stderr:2023-09-30T22:52:35.136+0000 7f960b7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:52:35.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.262+0000 7f64687ff700 1 Processor -- start 2023-09-30T22:52:35.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.263+0000 7f64687ff700 1 -- start start 2023-09-30T22:52:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f64687ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64600cbfe0 0x7f646015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f64687ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f64687ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600d0550 con 0x7f64601573a0 2023-09-30T22:52:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f64687ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600cf750 con 0x7f64600cbfe0 2023-09-30T22:52:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f64687ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600cf940 con 0x7f64600cc3b0 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f646659b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64600cbfe0 0x7f646015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f6465d9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f646659b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64600cbfe0 0x7f646015a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57104/0 (socket says 172.21.15.142:57104) 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f646659b700 1 -- 172.21.15.142:0/1015737241 learned_addr learned my addr 172.21.15.142:0/1015737241 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f646659b700 1 -- 172.21.15.142:0/1015737241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 msgr2=0x7f64600cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f646659b700 1 --2- 172.21.15.142:0/1015737241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.264+0000 7f646659b700 1 -- 172.21.15.142:0/1015737241 >> v1:172.21.15.148:6789/0 conn(0x7f64601573a0 legacy=0x7f646015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f646659b700 1 -- 172.21.15.142:0/1015737241 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600cfc20 con 0x7f64600cbfe0 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f6465599700 1 -- 172.21.15.142:0/1015737241 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109554229 0 0) 0x7f64600d0550 con 0x7f64601573a0 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f646659b700 1 --2- 172.21.15.142:0/1015737241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f646015a2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f645c0099e0 tx=0x7f645c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5941280e245661d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f6465599700 1 -- 172.21.15.142:0/1015737241 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00b820 con 0x7f64600cbfe0 2023-09-30T22:52:35.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f6465599700 1 -- 172.21.15.142:0/1015737241 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c00b980 con 0x7f64600cbfe0 2023-09-30T22:52:35.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f6465599700 1 -- 172.21.15.142:0/1015737241 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00bd20 con 0x7f64600cbfe0 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f64687ff700 1 -- 172.21.15.142:0/1015737241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 msgr2=0x7f646015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.265+0000 7f64687ff700 1 --2- 172.21.15.142:0/1015737241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f646015a2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f645c0099e0 tx=0x7f645c009250 comp rx=0 tx=0).stop 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.266+0000 7f64687ff700 1 -- 172.21.15.142:0/1015737241 shutdown_connections 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.266+0000 7f64687ff700 1 --2- 172.21.15.142:0/1015737241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f646015a2a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.266+0000 7f64687ff700 1 --2- 172.21.15.142:0/1015737241 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.266+0000 7f64687ff700 1 -- 172.21.15.142:0/1015737241 >> 172.21.15.142:0/1015737241 conn(0x7f64600d0a80 msgr2=0x7f64600d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.266+0000 7f64687ff700 1 -- 172.21.15.142:0/1015737241 shutdown_connections 2023-09-30T22:52:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.266+0000 7f64687ff700 1 -- 172.21.15.142:0/1015737241 wait complete. 2023-09-30T22:52:35.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.267+0000 7f64687ff700 1 Processor -- start 2023-09-30T22:52:35.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.267+0000 7f64687ff700 1 -- start start 2023-09-30T22:52:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f64687ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f64601482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f64687ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f64687ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64601573a0 0x7f646015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f64687ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c9540 con 0x7f64600cbfe0 2023-09-30T22:52:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f64687ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c8930 con 0x7f64601573a0 2023-09-30T22:52:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f64687ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c8c10 con 0x7f64600cc3b0 2023-09-30T22:52:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f646659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f64601482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f646659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f64601482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57110/0 (socket says 172.21.15.142:57110) 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f646659b700 1 -- 172.21.15.142:0/2932361915 learned_addr learned my addr 172.21.15.142:0/2932361915 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f6465d9a700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.268+0000 7f6466d9c700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64601573a0 0x7f646015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f646659b700 1 -- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 msgr2=0x7f64600c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f646659b700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f646659b700 1 -- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64601573a0 msgr2=0x7f646015fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f646659b700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64601573a0 0x7f646015fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f646659b700 1 -- 172.21.15.142:0/2932361915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0094f0 con 0x7f64600cbfe0 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f6465d9a700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f646659b700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f64601482f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f645c006fd0 tx=0x7f645c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:35.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f64567fc700 1 -- 172.21.15.142:0/2932361915 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011e20 con 0x7f64600cbfe0 2023-09-30T22:52:35.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f64567fc700 1 -- 172.21.15.142:0/2932361915 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c024440 con 0x7f64600cbfe0 2023-09-30T22:52:35.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f64567fc700 1 -- 172.21.15.142:0/2932361915 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0247e0 con 0x7f64600cbfe0 2023-09-30T22:52:35.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600c8ef0 con 0x7f64600cbfe0 2023-09-30T22:52:35.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.269+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6460148830 con 0x7f64600cbfe0 2023-09-30T22:52:35.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.270+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6460069770 con 0x7f64600cbfe0 2023-09-30T22:52:35.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.271+0000 7f64567fc700 1 -- 172.21.15.142:0/2932361915 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f645c01a420 con 0x7f64600cbfe0 2023-09-30T22:52:35.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.272+0000 7f64567fc700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6444067330 0x7f64440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.272+0000 7f64567fc700 1 -- 172.21.15.142:0/2932361915 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f645c086b80 con 0x7f64600cbfe0 2023-09-30T22:52:35.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.272+0000 7f6465d9a700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6444067330 0x7f64440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.273+0000 7f6465d9a700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6444067330 0x7f64440697e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f646006b680 tx=0x7f6450008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:35.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.276+0000 7f64567fc700 1 -- 172.21.15.142:0/2932361915 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f645c0539e0 con 0x7f64600cbfe0 2023-09-30T22:52:35.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.517+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f646006fc10 con 0x7f64600cbfe0 2023-09-30T22:52:35.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.520+0000 7f64567fc700 1 -- 172.21.15.142:0/2932361915 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164228 (secure 0 0 0) 0x7f645c057000 con 0x7f64600cbfe0 2023-09-30T22:52:35.522 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:35.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6444067330 msgr2=0x7f64440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6444067330 0x7f64440697e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f646006b680 tx=0x7f6450008040 comp rx=0 tx=0).stop 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 msgr2=0x7f64601482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f64601482f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f645c006fd0 tx=0x7f645c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 shutdown_connections 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6444067330 0x7f64440697e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64601573a0 0x7f646015fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64600cbfe0 0x7f64601482f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 --2- 172.21.15.142:0/2932361915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64600cc3b0 0x7f64600c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 >> 172.21.15.142:0/2932361915 conn(0x7f64600d0a80 msgr2=0x7f646006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:35.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 shutdown_connections 2023-09-30T22:52:35.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.523+0000 7f64687ff700 1 -- 172.21.15.142:0/2932361915 wait complete. 2023-09-30T22:52:35.541 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":109332},{"type":"v1","addr":"172.21.15.142:6833","nonce":109332}]},"active_addr":"172.21.15.142:6833/109332","active_change":"2023-09-30T22:52:16.089010+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":585149159}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2537543420}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2376939227}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2885503980}]}]} 2023-09-30T22:52:35.545 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:52:35.545 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:52:35.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:35.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.734+0000 7f1cfe7ff700 1 Processor -- start 2023-09-30T22:52:35.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.734+0000 7f1cfe7ff700 1 -- start start 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.735+0000 7f1cfe7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf81598e0 0x7f1cf8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.735+0000 7f1cfe7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cf80cee50 0x7f1cf80d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.735+0000 7f1cfe7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1cf806b1c0 0x7f1cf815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.735+0000 7f1cfe7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf80cff40 con 0x7f1cf806b1c0 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.735+0000 7f1cfe7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf80d0910 con 0x7f1cf80cee50 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.735+0000 7f1cfe7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80cf330 con 0x7f1cf81598e0 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1cf806b1c0 0x7f1cf815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1cf806b1c0 0x7f1cf815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57114/0 (socket says 172.21.15.142:57114) 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 -- 172.21.15.142:0/147280094 learned_addr learned my addr 172.21.15.142:0/147280094 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cf7fff700 1 --2- 172.21.15.142:0/147280094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf81598e0 0x7f1cf8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cf77fe700 1 --2- 172.21.15.142:0/147280094 >> v2:172.21.15.148:3300/0 conn(0x7f1cf80cee50 0x7f1cf80d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 -- 172.21.15.142:0/147280094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf81598e0 msgr2=0x7f1cf8159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 --2- 172.21.15.142:0/147280094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf81598e0 0x7f1cf8159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 -- 172.21.15.142:0/147280094 >> v2:172.21.15.148:3300/0 conn(0x7f1cf80cee50 msgr2=0x7f1cf80d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 --2- 172.21.15.142:0/147280094 >> v2:172.21.15.148:3300/0 conn(0x7f1cf80cee50 0x7f1cf80d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 -- 172.21.15.142:0/147280094 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80cf610 con 0x7f1cf806b1c0 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cfcd9c700 1 --2- 172.21.15.142:0/147280094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf806b1c0 0x7f1cf815d7d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8064ea0 tx=0x7f1cf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2810de85b6bf4f7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cf6ffd700 1 -- 172.21.15.142:0/147280094 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf000e070 con 0x7f1cf806b1c0 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cf6ffd700 1 -- 172.21.15.142:0/147280094 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf000b970 con 0x7f1cf806b1c0 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.736+0000 7f1cf6ffd700 1 -- 172.21.15.142:0/147280094 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00092e0 con 0x7f1cf806b1c0 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/147280094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf806b1c0 msgr2=0x7f1cf815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/147280094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf806b1c0 0x7f1cf815d7d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8064ea0 tx=0x7f1cf0009840 comp rx=0 tx=0).stop 2023-09-30T22:52:35.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/147280094 shutdown_connections 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/147280094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf806b1c0 0x7f1cf815d7d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/147280094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf81598e0 0x7f1cf8159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/147280094 >> v2:172.21.15.148:3300/0 conn(0x7f1cf80cee50 0x7f1cf80d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/147280094 >> 172.21.15.142:0/147280094 conn(0x7f1cf80cd540 msgr2=0x7f1cf80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/147280094 shutdown_connections 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.737+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/147280094 wait complete. 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.738+0000 7f1cfe7ff700 1 Processor -- start 2023-09-30T22:52:35.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.739+0000 7f1cfe7ff700 1 -- start start 2023-09-30T22:52:35.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.739+0000 7f1cfe7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf806b1c0 0x7f1cf8150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.739+0000 7f1cfe7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf80cee50 0x7f1cf815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cfe7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf81598e0 0x7f1cf815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cfe7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80c5b60 con 0x7f1cf80cee50 2023-09-30T22:52:35.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cfe7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80c5e40 con 0x7f1cf81598e0 2023-09-30T22:52:35.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cfe7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80c6120 con 0x7f1cf806b1c0 2023-09-30T22:52:35.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf80cee50 0x7f1cf815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf80cee50 0x7f1cf815b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57126/0 (socket says 172.21.15.142:57126) 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 -- 172.21.15.142:0/647058882 learned_addr learned my addr 172.21.15.142:0/647058882 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf7fff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf806b1c0 0x7f1cf8150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cfcd9c700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf81598e0 0x7f1cf815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 -- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf806b1c0 msgr2=0x7f1cf8150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf806b1c0 0x7f1cf8150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 -- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf81598e0 msgr2=0x7f1cf815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf81598e0 0x7f1cf815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 -- 172.21.15.142:0/647058882 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0009ae0 con 0x7f1cf80cee50 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cfcd9c700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf81598e0 0x7f1cf815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:35.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.740+0000 7f1cf77fe700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf80cee50 0x7f1cf815b550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00ec50 tx=0x7f1cec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.741+0000 7f1cdffff700 1 -- 172.21.15.142:0/647058882 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00c9d0 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.741+0000 7f1cdffff700 1 -- 172.21.15.142:0/647058882 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00cb30 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.741+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80c6400 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.741+0000 7f1cdffff700 1 -- 172.21.15.142:0/647058882 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec013470 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.741+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf81512f0 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.742+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf80c68a0 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.743+0000 7f1cdffff700 1 -- 172.21.15.142:0/647058882 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1cec0138a0 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.743+0000 7f1cdffff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ce4067330 0x7f1ce40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.743+0000 7f1cdffff700 1 -- 172.21.15.142:0/647058882 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1cec084f40 con 0x7f1cf80cee50 2023-09-30T22:52:35.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.744+0000 7f1cf7fff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ce4067330 0x7f1ce40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:35.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.744+0000 7f1cf7fff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ce4067330 0x7f1ce40697e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009d40 tx=0x7f1ce8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:35.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.748+0000 7f1cdffff700 1 -- 172.21.15.142:0/647058882 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1cec051da0 con 0x7f1cf80cee50 2023-09-30T22:52:35.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.938+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cf806fc10 con 0x7f1cf80cee50 2023-09-30T22:52:35.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.939+0000 7f1cdffff700 1 -- 172.21.15.142:0/647058882 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f1cec017090 con 0x7f1cf80cee50 2023-09-30T22:52:35.942 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:35.942 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ce4067330 msgr2=0x7f1ce40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ce4067330 0x7f1ce40697e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009d40 tx=0x7f1ce8008040 comp rx=0 tx=0).stop 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf80cee50 msgr2=0x7f1cf815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf80cee50 0x7f1cf815b550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00ec50 tx=0x7f1cec0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 shutdown_connections 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ce4067330 0x7f1ce40697e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cf81598e0 0x7f1cf815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cf806b1c0 0x7f1cf8150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 --2- 172.21.15.142:0/647058882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cf80cee50 0x7f1cf815b550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:35.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 >> 172.21.15.142:0/647058882 conn(0x7f1cf80cd540 msgr2=0x7f1cf81589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:35.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 shutdown_connections 2023-09-30T22:52:35.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:35.941+0000 7f1cfe7ff700 1 -- 172.21.15.142:0/647058882 wait complete. 2023-09-30T22:52:35.959 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:52:35.959 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:36.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.149+0000 7fae52bff700 1 Processor -- start 2023-09-30T22:52:36.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.150+0000 7fae52bff700 1 -- start start 2023-09-30T22:52:36.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.151+0000 7fae52bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fae4c0cc3b0 0x7fae4c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.151+0000 7fae52bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0d0550 con 0x7fae4c157ab0 2023-09-30T22:52:36.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.151+0000 7fae52bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0cf940 con 0x7fae4c0cbfe0 2023-09-30T22:52:36.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.151+0000 7fae52bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c0cfc20 con 0x7fae4c0cc3b0 2023-09-30T22:52:36.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.151+0000 7fae4bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fae4c157ab0 0x7fae4c06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60312/0 (socket says 172.21.15.142:60312) 2023-09-30T22:52:36.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.151+0000 7fae4bfff700 1 -- 172.21.15.142:0/1059709546 learned_addr learned my addr 172.21.15.142:0/1059709546 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:36.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.151+0000 7fae5119c700 1 --2- 172.21.15.142:0/1059709546 >> v2:172.21.15.148:3300/0 conn(0x7fae4c0cc3b0 0x7fae4c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538582348 0 0) 0x7fae4c0d0550 con 0x7fae4c157ab0 2023-09-30T22:52:36.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae3c003570 con 0x7fae4c157ab0 2023-09-30T22:52:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664160654 0 0) 0x7fae4c0cf940 con 0x7fae4c0cbfe0 2023-09-30T22:52:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae4c0d0550 con 0x7fae4c0cbfe0 2023-09-30T22:52:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1937772022 0 0) 0x7fae3c003570 con 0x7fae4c157ab0 2023-09-30T22:52:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 >> v2:172.21.15.148:3300/0 conn(0x7fae4c0cc3b0 msgr2=0x7fae4c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 --2- 172.21.15.142:0/1059709546 >> v2:172.21.15.148:3300/0 conn(0x7fae4c0cc3b0 0x7fae4c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 >> v1:172.21.15.148:6789/0 conn(0x7fae4c0cbfe0 legacy=0x7fae4c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0cff00 con 0x7fae4c157ab0 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fae38001470 con 0x7fae4c157ab0 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 >> v1:172.21.15.142:6789/0 conn(0x7fae4c157ab0 legacy=0x7fae4c06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae3c003c40 0x7fae3c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c004810 0x7fae3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae3c005210 0x7fae3c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0cfc20 con 0x7fae3c003c40 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c00c1b0 con 0x7fae3c004810 2023-09-30T22:52:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c00c370 con 0x7fae3c005210 2023-09-30T22:52:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae5099b700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae3c003c40 0x7fae3c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae4bfff700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c004810 0x7fae3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.152+0000 7fae5119c700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae3c005210 0x7fae3c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5099b700 1 -- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae3c005210 msgr2=0x7fae3c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5099b700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae3c005210 0x7fae3c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5099b700 1 -- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c004810 msgr2=0x7fae3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5099b700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c004810 0x7fae3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5099b700 1 -- 172.21.15.142:0/1059709546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c003570 con 0x7fae3c003c40 2023-09-30T22:52:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5119c700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae3c005210 0x7fae3c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5119c700 1 -- 172.21.15.142:0/1059709546 reap_dead start 2023-09-30T22:52:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae5099b700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae3c003c40 0x7fae3c004030 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae400019e0 tx=0x7fae40007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456890ab9242e1de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000c5d0 con 0x7fae3c003c40 2023-09-30T22:52:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4000c730 con 0x7fae3c003c40 2023-09-30T22:52:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.153+0000 7fae4b7fe700 1 -- 172.21.15.142:0/1059709546 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000caf0 con 0x7fae3c003c40 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.154+0000 7fae52bff700 1 -- 172.21.15.142:0/1059709546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae3c003c40 msgr2=0x7fae3c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.154+0000 7fae52bff700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae3c003c40 0x7fae3c004030 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae400019e0 tx=0x7fae40007d30 comp rx=0 tx=0).stop 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.154+0000 7fae52bff700 1 -- 172.21.15.142:0/1059709546 shutdown_connections 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.154+0000 7fae52bff700 1 --2- 172.21.15.142:0/1059709546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae3c003c40 0x7fae3c004030 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.154+0000 7fae52bff700 1 -- 172.21.15.142:0/1059709546 >> 172.21.15.142:0/1059709546 conn(0x7fae4c0d0a80 msgr2=0x7fae4c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.154+0000 7fae52bff700 1 -- 172.21.15.142:0/1059709546 shutdown_connections 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.154+0000 7fae52bff700 1 -- 172.21.15.142:0/1059709546 wait complete. 2023-09-30T22:52:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.155+0000 7fae52bff700 1 Processor -- start 2023-09-30T22:52:36.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.155+0000 7fae52bff700 1 -- start start 2023-09-30T22:52:36.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae52bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c003c40 0x7fae4c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae52bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae4c15d6f0 0x7fae4c15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae52bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4c16aa00 0x7fae4c16ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae52bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0c41f0 con 0x7fae4c16aa00 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae52bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c15e0a0 con 0x7fae3c003c40 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae52bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0c9540 con 0x7fae4c15d6f0 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae5119c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4c16aa00 0x7fae4c16ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae5119c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4c16aa00 0x7fae4c16ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57148/0 (socket says 172.21.15.142:57148) 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.156+0000 7fae5119c700 1 -- 172.21.15.142:0/773111028 learned_addr learned my addr 172.21.15.142:0/773111028 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae4bfff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae4c15d6f0 0x7fae4c15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5099b700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c003c40 0x7fae4c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5119c700 1 -- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae4c15d6f0 msgr2=0x7fae4c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5119c700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae4c15d6f0 0x7fae4c15db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5119c700 1 -- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c003c40 msgr2=0x7fae4c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5119c700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c003c40 0x7fae4c0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5119c700 1 -- 172.21.15.142:0/773111028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0ca550 con 0x7fae4c16aa00 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5099b700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c003c40 0x7fae4c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae4bfff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae4c15d6f0 0x7fae4c15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae5119c700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4c16aa00 0x7fae4c16ae80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae4c15ea20 tx=0x7fae4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae48ff9700 1 -- 172.21.15.142:0/773111028 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4401b070 con 0x7fae4c16aa00 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae48ff9700 1 -- 172.21.15.142:0/773111028 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400f040 con 0x7fae4c16aa00 2023-09-30T22:52:36.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae48ff9700 1 -- 172.21.15.142:0/773111028 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400e050 con 0x7fae4c16aa00 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c0c9790 con 0x7fae4c16aa00 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.157+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c0c9d50 con 0x7fae4c16aa00 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.158+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c069770 con 0x7fae4c16aa00 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.159+0000 7fae48ff9700 1 -- 172.21.15.142:0/773111028 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fae44003020 con 0x7fae4c16aa00 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.160+0000 7fae48ff9700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae30067330 0x7fae300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.160+0000 7fae48ff9700 1 -- 172.21.15.142:0/773111028 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae44085120 con 0x7fae4c16aa00 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.160+0000 7fae5099b700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae30067330 0x7fae300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.161+0000 7fae5099b700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae30067330 0x7fae300697e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae400019e0 tx=0x7fae40015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.164+0000 7fae48ff9700 1 -- 172.21.15.142:0/773111028 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fae44051f80 con 0x7fae4c16aa00 2023-09-30T22:52:36.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.359+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae4c06fc10 con 0x7fae4c16aa00 2023-09-30T22:52:36.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.360+0000 7fae48ff9700 1 -- 172.21.15.142:0/773111028 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fae440555a0 con 0x7fae4c16aa00 2023-09-30T22:52:36.361 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:36.361 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:36.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae30067330 msgr2=0x7fae300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae30067330 0x7fae300697e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae400019e0 tx=0x7fae40015000 comp rx=0 tx=0).stop 2023-09-30T22:52:36.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4c16aa00 msgr2=0x7fae4c16ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4c16aa00 0x7fae4c16ae80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae4c15ea20 tx=0x7fae4400b040 comp rx=0 tx=0).stop 2023-09-30T22:52:36.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 shutdown_connections 2023-09-30T22:52:36.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae30067330 0x7fae300697e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4c16aa00 0x7fae4c16ae80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae3c003c40 0x7fae4c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 --2- 172.21.15.142:0/773111028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae4c15d6f0 0x7fae4c15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 >> 172.21.15.142:0/773111028 conn(0x7fae4c0d0a80 msgr2=0x7fae4c159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 shutdown_connections 2023-09-30T22:52:36.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.363+0000 7fae52bff700 1 -- 172.21.15.142:0/773111028 wait complete. 2023-09-30T22:52:36.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:52:36.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:52:36.382 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:52:36.382 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:52:36.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-30T22:52:36.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-30T22:52:36.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-30T22:52:36.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-30T22:52:36.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.732+0000 7f11bc1ff700 1 Processor -- start 2023-09-30T22:52:36.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.733+0000 7f11bc1ff700 1 -- start start 2023-09-30T22:52:36.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.733+0000 7f2a221ff700 1 Processor -- start 2023-09-30T22:52:36.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.734+0000 7f2a221ff700 1 -- start start 2023-09-30T22:52:36.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.734+0000 7f11bc1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11b41599b0 0x7f11b4069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.734+0000 7f11bc1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b4159d80 0x7f11b40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.735+0000 7f11bc1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b40af6f0 con 0x7f11b406d3e0 2023-09-30T22:52:36.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.735+0000 7f11bc1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b406d950 con 0x7f11b41599b0 2023-09-30T22:52:36.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.735+0000 7f11bc1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b406dc30 con 0x7f11b4159d80 2023-09-30T22:52:36.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.735+0000 7f11b979a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b4159d80 0x7f11b40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.735+0000 7f11b979a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b4159d80 0x7f11b40b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42486/0 (socket says 172.21.15.142:42486) 2023-09-30T22:52:36.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.735+0000 7f11b979a700 1 -- 172.21.15.142:0/1164445586 learned_addr learned my addr 172.21.15.142:0/1164445586 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f11b9f9b700 1 --2- 172.21.15.142:0/1164445586 >> v2:172.21.15.148:3300/0 conn(0x7f11b41599b0 0x7f11b4069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f2a221ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a1c159870 0x7f2a1c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f2a221ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a1c06d9d0 0x7f2a1c06b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f2a221ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c0c6da0 con 0x7f2a1c06e550 2023-09-30T22:52:36.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f2a221ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1c0c72d0 con 0x7f2a1c159870 2023-09-30T22:52:36.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f2a221ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1c15ddd0 con 0x7f2a1c06d9d0 2023-09-30T22:52:36.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f11b979a700 1 -- 172.21.15.142:0/1164445586 >> v2:172.21.15.148:3300/0 conn(0x7f11b41599b0 msgr2=0x7f11b4069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f11b979a700 1 --2- 172.21.15.142:0/1164445586 >> v2:172.21.15.148:3300/0 conn(0x7f11b41599b0 0x7f11b4069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.737+0000 7f11b979a700 1 -- 172.21.15.142:0/1164445586 >> v1:172.21.15.142:6789/0 conn(0x7f11b406d3e0 legacy=0x7f11b40ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.737+0000 7f11b979a700 1 -- 172.21.15.142:0/1164445586 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b406df10 con 0x7f11b4159d80 2023-09-30T22:52:36.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.735+0000 7f47469ff700 1 Processor -- start 2023-09-30T22:52:36.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.736+0000 7f47469ff700 1 -- start start 2023-09-30T22:52:36.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.738+0000 7f11b979a700 1 --2- 172.21.15.142:0/1164445586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b4159d80 0x7f11b40b2140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f11a40099b0 tx=0x7f11a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2cc90dcfd71642 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.738+0000 7f11b8f99700 1 -- 172.21.15.142:0/1164445586 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4009ea0 con 0x7f11b4159d80 2023-09-30T22:52:36.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.738+0000 7f11b8f99700 1 -- 172.21.15.142:0/1164445586 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400b760 con 0x7f11b4159d80 2023-09-30T22:52:36.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.738+0000 7f11b8f99700 1 -- 172.21.15.142:0/1164445586 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400bb00 con 0x7f11b4159d80 2023-09-30T22:52:36.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f2a1b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a1c159870 0x7f2a1c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f2a1b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a1c159870 0x7f2a1c15e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57152/0 (socket says 172.21.15.142:57152) 2023-09-30T22:52:36.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f2a1b7fe700 1 -- 172.21.15.142:0/2511014969 learned_addr learned my addr 172.21.15.142:0/2511014969 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.737+0000 7f878f5ff700 1 Processor -- start 2023-09-30T22:52:36.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.737+0000 7f878f5ff700 1 -- start start 2023-09-30T22:52:36.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f47469ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47400ccd60 0x7f4740161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f47469ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400adcc0 con 0x7f4740154e10 2023-09-30T22:52:36.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f47469ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400ae840 con 0x7f47401551e0 2023-09-30T22:52:36.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f47469ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474006b590 con 0x7f47400ccd60 2023-09-30T22:52:36.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f4744f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47400ccd60 0x7f4740161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f4744f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47400ccd60 0x7f4740161b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57168/0 (socket says 172.21.15.142:57168) 2023-09-30T22:52:36.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f4744f9c700 1 -- 172.21.15.142:0/3529066443 learned_addr learned my addr 172.21.15.142:0/3529066443 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.740+0000 7f2a1bfff700 1 --2- 172.21.15.142:0/2511014969 >> v2:172.21.15.148:3300/0 conn(0x7f2a1c06d9d0 0x7f2a1c06b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.739+0000 7f878f5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f878815b880 0x7f878815f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.740+0000 7f878f5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878806e4e0 con 0x7f878815bc50 2023-09-30T22:52:36.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.740+0000 7f878f5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878806e7c0 con 0x7f878806d940 2023-09-30T22:52:36.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.740+0000 7f878f5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878815e870 con 0x7f878815b880 2023-09-30T22:52:36.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.740+0000 7f878db9c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f878806d940 0x7f8788161b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48278/0 (socket says 172.21.15.142:48278) 2023-09-30T22:52:36.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.740+0000 7f878db9c700 1 -- 172.21.15.142:0/3843465363 learned_addr learned my addr 172.21.15.142:0/3843465363 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:36.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f11bc1ff700 1 -- 172.21.15.142:0/1164445586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b4159d80 msgr2=0x7f11b40b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f11bc1ff700 1 --2- 172.21.15.142:0/1164445586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b4159d80 0x7f11b40b2140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f11a40099b0 tx=0x7f11a4009250 comp rx=0 tx=0).stop 2023-09-30T22:52:36.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f11bc1ff700 1 -- 172.21.15.142:0/1164445586 shutdown_connections 2023-09-30T22:52:36.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464874157 0 0) 0x7f878806e7c0 con 0x7f878806d940 2023-09-30T22:52:36.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8774003570 con 0x7f878806d940 2023-09-30T22:52:36.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f11bc1ff700 1 --2- 172.21.15.142:0/1164445586 >> v2:172.21.15.148:3300/0 conn(0x7f11b41599b0 0x7f11b4069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f11bc1ff700 1 --2- 172.21.15.142:0/1164445586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b4159d80 0x7f11b40b2140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f11bc1ff700 1 -- 172.21.15.142:0/1164445586 >> 172.21.15.142:0/1164445586 conn(0x7f11b4067620 msgr2=0x7f11b4067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f4744f9c700 1 -- 172.21.15.142:0/3529066443 >> v1:172.21.15.148:6789/0 conn(0x7f47401551e0 legacy=0x7f47400cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f4744f9c700 1 -- 172.21.15.142:0/3529066443 >> v1:172.21.15.142:6789/0 conn(0x7f4740154e10 legacy=0x7f47400b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f4744f9c700 1 -- 172.21.15.142:0/3529066443 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400adf10 con 0x7f47400ccd60 2023-09-30T22:52:36.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 777125567 0 0) 0x7f8774003570 con 0x7f878806d940 2023-09-30T22:52:36.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 >> v2:172.21.15.142:3300/0 conn(0x7f878815b880 msgr2=0x7f878815f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 --2- 172.21.15.142:0/3843465363 >> v2:172.21.15.142:3300/0 conn(0x7f878815b880 0x7f878815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 >> v1:172.21.15.142:6789/0 conn(0x7f878815bc50 legacy=0x7f878806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878815eb50 con 0x7f878806d940 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f8780001830 con 0x7f878806d940 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 >> v1:172.21.15.148:6789/0 conn(0x7f878806d940 legacy=0x7f8788161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8774003ae0 0x7f8774003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8774004810 0x7f8774004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87740053c0 0x7f877400ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878815e870 con 0x7f8774004810 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877400c2c0 con 0x7f8774003ae0 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877400c480 con 0x7f87740053c0 2023-09-30T22:52:36.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f2a1b7fe700 1 -- 172.21.15.142:0/2511014969 >> v2:172.21.15.148:3300/0 conn(0x7f2a1c06d9d0 msgr2=0x7f2a1c06b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f2a1b7fe700 1 --2- 172.21.15.142:0/2511014969 >> v2:172.21.15.148:3300/0 conn(0x7f2a1c06d9d0 0x7f2a1c06b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f2a1b7fe700 1 -- 172.21.15.142:0/2511014969 >> v1:172.21.15.142:6789/0 conn(0x7f2a1c06e550 legacy=0x7f2a1c06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.741+0000 7f2a1b7fe700 1 -- 172.21.15.142:0/2511014969 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c06b8a0 con 0x7f2a1c159870 2023-09-30T22:52:36.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f2a1b7fe700 1 --2- 172.21.15.142:0/2511014969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 0x7f2a1c15e260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c15b420 tx=0x7f2a04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9b1b5919d90bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f11bc1ff700 1 -- 172.21.15.142:0/1164445586 shutdown_connections 2023-09-30T22:52:36.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f878db9c700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87740053c0 0x7f877400ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f878d39b700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8774003ae0 0x7f8774003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f4744f9c700 1 --2- 172.21.15.142:0/3529066443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47400ccd60 0x7f4740161b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4738009f20 tx=0x7f4738009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aa8d8db1bdf79f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.742+0000 7f11bc1ff700 1 -- 172.21.15.142:0/1164445586 wait complete. 2023-09-30T22:52:36.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f878db9c700 1 -- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8774003ae0 msgr2=0x7f8774003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f878db9c700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8774003ae0 0x7f8774003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f878db9c700 1 -- 172.21.15.142:0/3843465363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8774004810 msgr2=0x7f8774004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f878db9c700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8774004810 0x7f8774004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f878db9c700 1 -- 172.21.15.142:0/3843465363 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878815eb50 con 0x7f87740053c0 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.743+0000 7f878db9c700 1 -- 172.21.15.142:0/3843465363 reap_dead start 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.744+0000 7f473effd700 1 -- 172.21.15.142:0/3529066443 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473800e070 con 0x7f47400ccd60 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.744+0000 7f473effd700 1 -- 172.21.15.142:0/3529066443 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473800ba80 con 0x7f47400ccd60 2023-09-30T22:52:36.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.744+0000 7f473effd700 1 -- 172.21.15.142:0/3529066443 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47380092e0 con 0x7f47400ccd60 2023-09-30T22:52:36.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.744+0000 7f878db9c700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87740053c0 0x7f877400ba80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f878000a9a0 tx=0x7f878000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d27a4dfb6ff7ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.744+0000 7f11bc1ff700 1 Processor -- start 2023-09-30T22:52:36.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7fcd489ff700 1 Processor -- start 2023-09-30T22:52:36.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7fcd489ff700 1 -- start start 2023-09-30T22:52:36.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7f47469ff700 1 -- 172.21.15.142:0/3529066443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47400ccd60 msgr2=0x7f4740161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7f47469ff700 1 --2- 172.21.15.142:0/3529066443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47400ccd60 0x7f4740161b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4738009f20 tx=0x7f4738009840 comp rx=0 tx=0).stop 2023-09-30T22:52:36.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f47469ff700 1 -- 172.21.15.142:0/3529066443 shutdown_connections 2023-09-30T22:52:36.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f47469ff700 1 --2- 172.21.15.142:0/3529066443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47400ccd60 0x7f4740161b60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f47469ff700 1 -- 172.21.15.142:0/3529066443 >> 172.21.15.142:0/3529066443 conn(0x7f4740067620 msgr2=0x7f4740067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f2a1a7fc700 1 -- 172.21.15.142:0/2511014969 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0400b820 con 0x7f2a1c159870 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f2a1a7fc700 1 -- 172.21.15.142:0/2511014969 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0400b980 con 0x7f2a1c159870 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f2a1a7fc700 1 -- 172.21.15.142:0/2511014969 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0400bd20 con 0x7f2a1c159870 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f2a221ff700 1 -- 172.21.15.142:0/2511014969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 msgr2=0x7f2a1c15e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f2a221ff700 1 --2- 172.21.15.142:0/2511014969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 0x7f2a1c15e260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c15b420 tx=0x7f2a04009250 comp rx=0 tx=0).stop 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7f11bc1ff700 1 -- start start 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f11bc1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b406d3e0 0x7f11b41547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f11bc1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b41599b0 0x7f11b416e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f11bc1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11b4159d80 0x7f11b40c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f11bc1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b4154ce0 con 0x7f11b4159d80 2023-09-30T22:52:36.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f11bc1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40c20b0 con 0x7f11b406d3e0 2023-09-30T22:52:36.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f11bc1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b416f260 con 0x7f11b41599b0 2023-09-30T22:52:36.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f47469ff700 1 -- 172.21.15.142:0/3529066443 shutdown_connections 2023-09-30T22:52:36.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f47469ff700 1 -- 172.21.15.142:0/3529066443 wait complete. 2023-09-30T22:52:36.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f11b979a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b41599b0 0x7f11b416e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f11b979a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b41599b0 0x7f11b416e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42502/0 (socket says 172.21.15.142:42502) 2023-09-30T22:52:36.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f11b979a700 1 -- 172.21.15.142:0/3456675073 learned_addr learned my addr 172.21.15.142:0/3456675073 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800070f0 con 0x7f87740053c0 2023-09-30T22:52:36.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780007290 con 0x7f87740053c0 2023-09-30T22:52:36.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.745+0000 7f877ffff700 1 -- 172.21.15.142:0/3843465363 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780007650 con 0x7f87740053c0 2023-09-30T22:52:36.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f878f5ff700 1 -- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87740053c0 msgr2=0x7f877400ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f878f5ff700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87740053c0 0x7f877400ba80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f878000a9a0 tx=0x7f878000a060 comp rx=0 tx=0).stop 2023-09-30T22:52:36.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.746+0000 7f878f5ff700 1 -- 172.21.15.142:0/3843465363 shutdown_connections 2023-09-30T22:52:36.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f878f5ff700 1 --2- 172.21.15.142:0/3843465363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87740053c0 0x7f877400ba80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f11b9f9b700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b406d3e0 0x7f11b41547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f878f5ff700 1 -- 172.21.15.142:0/3843465363 >> 172.21.15.142:0/3843465363 conn(0x7f8788067e30 msgr2=0x7f8788068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f878f5ff700 1 -- 172.21.15.142:0/3843465363 shutdown_connections 2023-09-30T22:52:36.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.747+0000 7f878f5ff700 1 -- 172.21.15.142:0/3843465363 wait complete. 2023-09-30T22:52:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7f11b979a700 1 -- 172.21.15.142:0/3456675073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b406d3e0 msgr2=0x7f11b41547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7f11b979a700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11b406d3e0 0x7f11b41547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7f11b979a700 1 -- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11b4159d80 msgr2=0x7f11b40c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7f11b979a700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11b4159d80 0x7f11b40c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7f11b979a700 1 -- 172.21.15.142:0/3456675073 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40094f0 con 0x7f11b41599b0 2023-09-30T22:52:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7f11b979a700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b41599b0 0x7f11b416e760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f11a40094c0 tx=0x7f11a4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd440b2110 0x7fcd441628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7fcd489ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4406d470 con 0x7fcd4406b3d0 2023-09-30T22:52:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7fcd489ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd44157e60 con 0x7fcd44157a90 2023-09-30T22:52:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.748+0000 7fcd489ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440ae880 con 0x7fcd440b2110 2023-09-30T22:52:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f47469ff700 1 Processor -- start 2023-09-30T22:52:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f2a221ff700 1 -- 172.21.15.142:0/2511014969 shutdown_connections 2023-09-30T22:52:36.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f2a221ff700 1 --2- 172.21.15.142:0/2511014969 >> v2:172.21.15.148:3300/0 conn(0x7f2a1c06d9d0 0x7f2a1c06b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f2a221ff700 1 --2- 172.21.15.142:0/2511014969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 0x7f2a1c15e260 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f2a221ff700 1 -- 172.21.15.142:0/2511014969 >> 172.21.15.142:0/2511014969 conn(0x7f2a1c067ec0 msgr2=0x7f2a1c0682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7fcd39d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcd4406b3d0 0x7fcd440b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60372/0 (socket says 172.21.15.142:60372) 2023-09-30T22:52:36.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7fcd39d9b700 1 -- 172.21.15.142:0/3936867203 learned_addr learned my addr 172.21.15.142:0/3936867203 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:36.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7fcd42d9d700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd440b2110 0x7fcd441628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a401ddd0 con 0x7f11b41599b0 2023-09-30T22:52:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a401a420 con 0x7f11b41599b0 2023-09-30T22:52:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f47469ff700 1 -- start start 2023-09-30T22:52:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.749+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a401a7e0 con 0x7f11b41599b0 2023-09-30T22:52:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7f878f5ff700 1 Processor -- start 2023-09-30T22:52:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507386165 0 0) 0x7fcd4406d470 con 0x7fcd4406b3d0 2023-09-30T22:52:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd30003570 con 0x7fcd4406b3d0 2023-09-30T22:52:36.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7f878f5ff700 1 -- start start 2023-09-30T22:52:36.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4253690987 0 0) 0x7fcd30003570 con 0x7fcd4406b3d0 2023-09-30T22:52:36.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd440b2110 msgr2=0x7fcd441628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd440b2110 0x7fcd441628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 >> v1:172.21.15.148:6789/0 conn(0x7fcd44157a90 legacy=0x7fcd4415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440aeb60 con 0x7fcd4406b3d0 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fcd34001470 con 0x7fcd4406b3d0 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 >> v1:172.21.15.142:6789/0 conn(0x7fcd4406b3d0 legacy=0x7fcd440b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd30003a90 0x7fcd30003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7fcd41d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd30004810 0x7fcd30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7fcd41d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd300051c0 0x7fcd3000fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440ae880 con 0x7fcd30004810 2023-09-30T22:52:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30010540 con 0x7fcd300051c0 2023-09-30T22:52:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300106b0 con 0x7fcd30003a90 2023-09-30T22:52:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b416f540 con 0x7f11b41599b0 2023-09-30T22:52:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b40c25e0 con 0x7f11b41599b0 2023-09-30T22:52:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11b40695b0 con 0x7f11b41599b0 2023-09-30T22:52:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.750+0000 7f2a221ff700 1 -- 172.21.15.142:0/2511014969 shutdown_connections 2023-09-30T22:52:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7f47469ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47400ccd60 0x7f474015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7f47469ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4740154e10 0x7f474015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7f47469ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f474016e3f0 0x7f474016e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7f47469ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474015edb0 con 0x7f4740154e10 2023-09-30T22:52:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7f47469ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474015f020 con 0x7f47400ccd60 2023-09-30T22:52:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7f47469ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474015f300 con 0x7f474016e3f0 2023-09-30T22:52:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f878f5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87740053c0 0x7f87880c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f878f5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f878816e2a0 0x7f87880c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f878f5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87881611b0 0x7f87881580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f878f5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8788160f40 con 0x7f87740053c0 2023-09-30T22:52:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f878f5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880c9450 con 0x7f87881611b0 2023-09-30T22:52:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f878f5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878816e800 con 0x7f878816e2a0 2023-09-30T22:52:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7f2a221ff700 1 -- 172.21.15.142:0/2511014969 wait complete. 2023-09-30T22:52:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f2a221ff700 1 Processor -- start 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f11a401ab90 con 0x7f11b41599b0 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.751+0000 7fcd39d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd30004810 0x7fcd30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7fcd39d9b700 1 -- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd30003a90 msgr2=0x7fcd30003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7fcd39d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd30003a90 0x7fcd30003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7fcd39d9b700 1 -- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd300051c0 msgr2=0x7fcd3000fe70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7fcd39d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd300051c0 0x7fcd3000fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7fcd39d9b700 1 -- 172.21.15.142:0/3936867203 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440aeb60 con 0x7fcd30004810 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.752+0000 7fcd39d9b700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd30004810 0x7fcd30004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406b7c0 tx=0x7fcd34001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7cc70af5ef8c6c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3400cbe0 con 0x7fcd30004810 2023-09-30T22:52:36.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3400cd60 con 0x7fcd30004810 2023-09-30T22:52:36.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.753+0000 7fcd41d9b700 1 -- 172.21.15.142:0/3936867203 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34005b70 con 0x7fcd30004810 2023-09-30T22:52:36.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7fcd489ff700 1 -- 172.21.15.142:0/3936867203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd30004810 msgr2=0x7fcd30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7fcd489ff700 1 --2- 172.21.15.142:0/3936867203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd30004810 0x7fcd30004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406b7c0 tx=0x7fcd34001e40 comp rx=0 tx=0).stop 2023-09-30T22:52:36.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7f7885dff700 1 Processor -- start 2023-09-30T22:52:36.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7f2a221ff700 1 -- start start 2023-09-30T22:52:36.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f11a9ffb700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1198067480 0x7f1198069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11a4086ee0 con 0x7f11b41599b0 2023-09-30T22:52:36.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f11a9ffb700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f119806fd30 0x7f1198072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 --> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11980727f0 con 0x7f119806fd30 2023-09-30T22:52:36.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11a4087210 con 0x7f11b41599b0 2023-09-30T22:52:36.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f878cb9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f878816e2a0 0x7f87880c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f878cb9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f878816e2a0 0x7f87880c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42540/0 (socket says 172.21.15.142:42540) 2023-09-30T22:52:36.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f878cb9a700 1 -- 172.21.15.142:0/1381705581 learned_addr learned my addr 172.21.15.142:0/1381705581 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7fcd42d9d700 1 -- 172.21.15.142:0/3936867203 reap_dead start 2023-09-30T22:52:36.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7fcd489ff700 1 -- 172.21.15.142:0/3936867203 shutdown_connections 2023-09-30T22:52:36.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7fcd489ff700 1 -- 172.21.15.142:0/3936867203 >> 172.21.15.142:0/3936867203 conn(0x7fcd440680c0 msgr2=0x7fcd440c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7fcd489ff700 1 -- 172.21.15.142:0/3936867203 shutdown_connections 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7fcd489ff700 1 -- 172.21.15.142:0/3936867203 wait complete. 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f2a221ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1c06d9d0 0x7f2a1c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f2a221ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a1c06e550 0x7f2a1c089270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.755+0000 7f2a221ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 0x7f2a1c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f2a221ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0cbc00 con 0x7f2a1c159870 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f2a221ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0cc780 con 0x7f2a1c06e550 2023-09-30T22:52:36.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f2a221ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0cbe50 con 0x7f2a1c06d9d0 2023-09-30T22:52:36.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f11ba79c700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f119806fd30 0x7f1198072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f473ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47400ccd60 0x7f474015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f473ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47400ccd60 0x7f474015e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46748/0 (socket says 172.21.15.142:46748) 2023-09-30T22:52:36.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f473ffff700 1 -- 172.21.15.142:0/808774621 learned_addr learned my addr 172.21.15.142:0/808774621 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f878db9c700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87881611b0 0x7f87881580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f4744f9c700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f474016e3f0 0x7f474016e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f11b9f9b700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1198067480 0x7f1198069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f11ba79c700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f119806fd30 0x7f1198072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f4744f9c700 1 -- 172.21.15.142:0/808774621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47400ccd60 msgr2=0x7f474015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f4744f9c700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47400ccd60 0x7f474015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f4744f9c700 1 -- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4740154e10 msgr2=0x7f474015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f4744f9c700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4740154e10 0x7f474015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f4744f9c700 1 -- 172.21.15.142:0/808774621 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738009ae0 con 0x7f474016e3f0 2023-09-30T22:52:36.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7fcd489ff700 1 Processor -- start 2023-09-30T22:52:36.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.754+0000 7f7885dff700 1 -- start start 2023-09-30T22:52:36.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f7885dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7880155970 0x7f78800ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f7885dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788006dd70 con 0x7f7880156a70 2023-09-30T22:52:36.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f7885dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788006b4a0 con 0x7f7880155d40 2023-09-30T22:52:36.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.756+0000 7f7885dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7880156ee0 con 0x7f7880155970 2023-09-30T22:52:36.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f11b9f9b700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1198067480 0x7f1198069930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0076a0 tx=0x7f11ac00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7f4744f9c700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f474016e3f0 0x7f474016e870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4738015000 tx=0x7f4738018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f878d39b700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87740053c0 0x7f87880c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738008dd0 con 0x7f474016e3f0 2023-09-30T22:52:36.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738026460 con 0x7f474016e3f0 2023-09-30T22:52:36.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738026820 con 0x7f474016e3f0 2023-09-30T22:52:36.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== osd.2 v2:172.21.15.142:6821/109702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f11980727f0 con 0x7f119806fd30 2023-09-30T22:52:36.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f787ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7880156a70 0x7f788015f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60376/0 (socket says 172.21.15.142:60376) 2023-09-30T22:52:36.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f787ffff700 1 -- 172.21.15.142:0/2708144428 learned_addr learned my addr 172.21.15.142:0/2708144428 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:36.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1c06d9d0 0x7f2a1c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1c06d9d0 0x7f2a1c0ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42550/0 (socket says 172.21.15.142:42550) 2023-09-30T22:52:36.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f2a1b7fe700 1 -- 172.21.15.142:0/2955233482 learned_addr learned my addr 172.21.15.142:0/2955233482 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f2a1bfff700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 0x7f2a1c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f2a1affd700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a1c06e550 0x7f2a1c089270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f878d39b700 1 -- 172.21.15.142:0/1381705581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f878816e2a0 msgr2=0x7f87880c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f878d39b700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f878816e2a0 0x7f87880c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f878d39b700 1 -- 172.21.15.142:0/1381705581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87881611b0 msgr2=0x7f87881580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f878d39b700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87881611b0 0x7f87881580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f878d39b700 1 -- 172.21.15.142:0/1381705581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878816eae0 con 0x7f87740053c0 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f878cb9a700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f878816e2a0 0x7f87880c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:36.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f878db9c700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87881611b0 0x7f87881580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:36.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f878d39b700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87740053c0 0x7f87880c6da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8788071e60 tx=0x7f8784008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474015f5e0 con 0x7f474016e3f0 2023-09-30T22:52:36.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47401547c0 con 0x7f474016e3f0 2023-09-30T22:52:36.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.757+0000 7fcd489ff700 1 -- start start 2023-09-30T22:52:36.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd44146d30 0x7fcd4414a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd4414abb0 0x7fcd440b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.758+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd440b0ce0 0x7fcd441693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7fcd489ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44159340 con 0x7fcd4414abb0 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7fcd489ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440b1150 con 0x7fcd440b0ce0 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7fcd489ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44166260 con 0x7fcd44146d30 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7fcd4259c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd44146d30 0x7fcd4414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7fcd4259c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd44146d30 0x7fcd4414a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42564/0 (socket says 172.21.15.142:42564) 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7fcd4259c700 1 -- 172.21.15.142:0/3585899662 learned_addr learned my addr 172.21.15.142:0/3585899662 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd42d9d700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd440b0ce0 0x7fcd441693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd39d9b700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd4414abb0 0x7fcd440b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd4259c700 1 -- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd440b0ce0 msgr2=0x7fcd441693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd4259c700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd440b0ce0 0x7fcd441693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd4259c700 1 -- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd4414abb0 msgr2=0x7fcd440b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd4259c700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd4414abb0 0x7fcd440b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd4259c700 1 -- 172.21.15.142:0/3585899662 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4415aba0 con 0x7fcd44146d30 2023-09-30T22:52:36.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.759+0000 7f787f7fe700 1 --2- 172.21.15.142:0/2708144428 >> v2:172.21.15.148:3300/0 conn(0x7f7880155970 0x7f78800ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f2a1bfff700 1 -- 172.21.15.142:0/2955233482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1c06d9d0 msgr2=0x7f2a1c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f2a1bfff700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1c06d9d0 0x7f2a1c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f2a1bfff700 1 -- 172.21.15.142:0/2955233482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a1c06e550 msgr2=0x7f2a1c089270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f2a1bfff700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a1c06e550 0x7f2a1c089270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f474015b1d0 con 0x7f474016e3f0 2023-09-30T22:52:36.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f2a1bfff700 1 -- 172.21.15.142:0/2955233482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040094f0 con 0x7f2a1c159870 2023-09-30T22:52:36.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7fcd4259c700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd44146d30 0x7fcd4414a670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c7c0 tx=0x7fcd2c00cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c012630 con 0x7fcd44146d30 2023-09-30T22:52:36.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c012790 con 0x7fcd44146d30 2023-09-30T22:52:36.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c012b50 con 0x7fcd44146d30 2023-09-30T22:52:36.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4415ae80 con 0x7fcd44146d30 2023-09-30T22:52:36.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd44165ef0 con 0x7fcd44146d30 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750947641 0 0) 0x7f788006dd70 con 0x7f7880156a70 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7868004680 con 0x7f7880156a70 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893185592 0 0) 0x7f788006b4a0 con 0x7f7880155d40 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.760+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f788006dd70 con 0x7f7880155d40 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 592913459 0 0) 0x7f788006dd70 con 0x7f7880155d40 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 >> v2:172.21.15.148:3300/0 conn(0x7f7880155970 msgr2=0x7f78800ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 --2- 172.21.15.142:0/2708144428 >> v2:172.21.15.148:3300/0 conn(0x7f7880155970 0x7f78800ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 >> v1:172.21.15.142:6789/0 conn(0x7f7880156a70 legacy=0x7f788015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788006d480 con 0x7f7880155d40 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f78700013a0 con 0x7f7880155d40 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 >> v1:172.21.15.148:6789/0 conn(0x7f7880155d40 legacy=0x7f7880156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7868005d60 0x7f7868006130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78680048c0 0x7f7868004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78680052c0 0x7f786800cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7868003560 con 0x7f78680048c0 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680036d0 con 0x7f78680052c0 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.761+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7868003890 con 0x7f7868005d60 2023-09-30T22:52:36.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f2a1bfff700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 0x7f2a1c1415a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00d860 tx=0x7f2a0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f787f7fe700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7868005d60 0x7f7868006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f787effd700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78680048c0 0x7f7868004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd440695b0 con 0x7fcd44146d30 2023-09-30T22:52:36.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f787f7fe700 1 -- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78680052c0 msgr2=0x7f786800cb70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T22:52:36.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f787f7fe700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78680052c0 0x7f786800cb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f787f7fe700 1 -- 172.21.15.142:0/2708144428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78680048c0 msgr2=0x7f7868004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f787f7fe700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78680048c0 0x7f7868004d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f787f7fe700 1 -- 172.21.15.142:0/2708144428 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788006d480 con 0x7f7868005d60 2023-09-30T22:52:36.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.762+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4738003040 con 0x7f474016e3f0 2023-09-30T22:52:36.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.763+0000 7f787ffff700 1 -- 172.21.15.142:0/2708144428 reap_dead start 2023-09-30T22:52:36.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.763+0000 7fc91cdff700 1 Processor -- start 2023-09-30T22:52:36.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.763+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0125f0 con 0x7f2a1c159870 2023-09-30T22:52:36.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.763+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c012750 con 0x7f2a1c159870 2023-09-30T22:52:36.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.763+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c012af0 con 0x7f2a1c159870 2023-09-30T22:52:36.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c0cc130 con 0x7f2a1c159870 2023-09-30T22:52:36.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c0cd150 con 0x7f2a1c159870 2023-09-30T22:52:36.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7f4727fff700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f472c067400 0x7f472c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4738087160 con 0x7f474016e3f0 2023-09-30T22:52:36.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7f4727fff700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f472c06fcb0 0x7f472c0720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 --> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f472c072770 con 0x7f472c06fcb0 2023-09-30T22:52:36.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4738087530 con 0x7f474016e3f0 2023-09-30T22:52:36.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.765+0000 7f473ffff700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f472c067400 0x7f472c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.765+0000 7f473f7fe700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f472c06fcb0 0x7f472c0720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7f473ffff700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f472c067400 0x7f472c0698b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4730007fd0 tx=0x7f4730009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7f473f7fe700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f472c06fcb0 0x7f472c0720c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.764+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcd2c01b400 con 0x7fcd44146d30 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fcd3affd700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd24067480 0x7fcd24069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd2c084f10 con 0x7fcd44146d30 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fcd3affd700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7fcd2406fd30 0x7fcd24072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 --> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd240727f0 con 0x7fcd2406fd30 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd2c085240 con 0x7fcd44146d30 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.763+0000 7fc91cdff700 1 -- start start 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fc91cdff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc918069f10 0x7fc91806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fc91cdff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc91806d920 0x7fc918167c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fc91cdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91815f250 con 0x7fc91815dea0 2023-09-30T22:52:36.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fc91cdff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91806ef60 con 0x7fc91806d920 2023-09-30T22:52:36.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fc91cdff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91815e680 con 0x7fc918069f10 2023-09-30T22:52:36.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== osd.3 v2:172.21.15.142:6812/109696 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f472c072770 con 0x7f472c06fcb0 2023-09-30T22:52:36.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.766+0000 7fcd39d9b700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd24067480 0x7fcd24069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7fc915d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc918069f10 0x7fc91806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7f787f7fe700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7868005d60 0x7f7868006130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7878007440 tx=0x7f7878009710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=618cb41032d1e8ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7fcd42d9d700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7fcd2406fd30 0x7fcd24072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7fc916d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc91806d920 0x7fc918167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7fc916d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc91806d920 0x7fc918167c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57272/0 (socket says 172.21.15.142:57272) 2023-09-30T22:52:36.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7fc916d9d700 1 -- 172.21.15.142:0/90629049 learned_addr learned my addr 172.21.15.142:0/90629049 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.767+0000 7fcd39d9b700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd24067480 0x7fcd24069930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406b7c0 tx=0x7fcd34015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7fc915d9b700 1 -- 172.21.15.142:0/90629049 >> v2:172.21.15.142:3300/0 conn(0x7fc91806d920 msgr2=0x7fc918167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7fc915d9b700 1 --2- 172.21.15.142:0/90629049 >> v2:172.21.15.142:3300/0 conn(0x7fc91806d920 0x7fc918167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7fc915d9b700 1 -- 172.21.15.142:0/90629049 >> v1:172.21.15.148:6789/0 conn(0x7fc91815dea0 legacy=0x7fc9180b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:36.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7fc915d9b700 1 -- 172.21.15.142:0/90629049 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91806dd20 con 0x7fc918069f10 2023-09-30T22:52:36.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878009a40 con 0x7f7868005d60 2023-09-30T22:52:36.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878007cf0 con 0x7f7868005d60 2023-09-30T22:52:36.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7f787e7fc700 1 -- 172.21.15.142:0/2708144428 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878014630 con 0x7f7868005d60 2023-09-30T22:52:36.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2a0c013480 con 0x7f2a1c159870 2023-09-30T22:52:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7fcd42d9d700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7fcd2406fd30 0x7fcd24072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7fc915d9b700 1 --2- 172.21.15.142:0/90629049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc918069f10 0x7fc91806d3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc918063d60 tx=0x7fc9080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6629e3e7f7bd4a1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.768+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784011590 con 0x7f87740053c0 2023-09-30T22:52:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784011710 con 0x7f87740053c0 2023-09-30T22:52:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784011ad0 con 0x7f87740053c0 2023-09-30T22:52:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878816edc0 con 0x7f87740053c0 2023-09-30T22:52:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8788161620 con 0x7f87740053c0 2023-09-30T22:52:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f7885dff700 1 -- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7868005d60 msgr2=0x7f7868006130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f7885dff700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7868005d60 0x7f7868006130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7878007440 tx=0x7f7878009710 comp rx=0 tx=0).stop 2023-09-30T22:52:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a1c069770 con 0x7f2a1c159870 2023-09-30T22:52:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f2a137fe700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29fc067400 0x7f29fc0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a0c084ec0 con 0x7f2a1c159870 2023-09-30T22:52:36.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7f2a137fe700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f29fc06fc30 0x7f29fc072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7f2a1b7fe700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29fc067400 0x7f29fc0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 --> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29fc0726f0 con 0x7f29fc06fc30 2023-09-30T22:52:36.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== osd.4 v2:172.21.15.148:6800/109934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fcd240727f0 con 0x7fcd2406fd30 2023-09-30T22:52:36.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7fc91559a700 1 -- 172.21.15.142:0/90629049 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908011630 con 0x7fc918069f10 2023-09-30T22:52:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7fc91559a700 1 -- 172.21.15.142:0/90629049 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908011790 con 0x7fc918069f10 2023-09-30T22:52:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7fc91559a700 1 -- 172.21.15.142:0/90629049 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908011b50 con 0x7fc918069f10 2023-09-30T22:52:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f7885dff700 1 -- 172.21.15.142:0/2708144428 shutdown_connections 2023-09-30T22:52:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f7885dff700 1 --2- 172.21.15.142:0/2708144428 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7868005d60 0x7f7868006130 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7878007440 tx=0x7f7878009710 comp rx=0 tx=0).stop 2023-09-30T22:52:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.769+0000 7f7885dff700 1 -- 172.21.15.142:0/2708144428 >> 172.21.15.142:0/2708144428 conn(0x7f7880067620 msgr2=0x7f7880067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7f93c29ff700 1 Processor -- start 2023-09-30T22:52:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7fc91cdff700 1 -- 172.21.15.142:0/90629049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc918069f10 msgr2=0x7fc91806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7fc91cdff700 1 --2- 172.21.15.142:0/90629049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc918069f10 0x7fc91806d3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc918063d60 tx=0x7fc9080091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7f7885dff700 1 -- 172.21.15.142:0/2708144428 shutdown_connections 2023-09-30T22:52:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.770+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f878815ef50 con 0x7f87740053c0 2023-09-30T22:52:36.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.771+0000 7f93c29ff700 1 -- start start 2023-09-30T22:52:36.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.772+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f878401c460 con 0x7f87740053c0 2023-09-30T22:52:36.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f877d7fa700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f876c067480 0x7f876c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8784085470 con 0x7f87740053c0 2023-09-30T22:52:36.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f877d7fa700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f876c06fd30 0x7f876c072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 --> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f876c0727f0 con 0x7f876c06fd30 2023-09-30T22:52:36.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87840857a0 con 0x7f87740053c0 2023-09-30T22:52:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f878cb9a700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f876c067480 0x7f876c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f878db9c700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f876c06fd30 0x7f876c072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7fc91cdff700 1 -- 172.21.15.142:0/90629049 shutdown_connections 2023-09-30T22:52:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7fc91cdff700 1 --2- 172.21.15.142:0/90629049 >> v2:172.21.15.142:3300/0 conn(0x7fc91806d920 0x7fc918167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7fc91cdff700 1 --2- 172.21.15.142:0/90629049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc918069f10 0x7fc91806d3e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7fc91cdff700 1 -- 172.21.15.142:0/90629049 >> 172.21.15.142:0/90629049 conn(0x7fc9180680c0 msgr2=0x7fc9180c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.771+0000 7f7885dff700 1 -- 172.21.15.142:0/2708144428 wait complete. 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.773+0000 7f7885dff700 1 Processor -- start 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f7885dff700 1 -- start start 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f7885dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78801693d0 0x7f78801580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f7885dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78801585e0 0x7f7880151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f7885dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880151c80 0x7f7880152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f7885dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880152660 con 0x7f78801585e0 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f7885dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880158a50 con 0x7f7880151c80 2023-09-30T22:52:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f7885dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800c2a60 con 0x7f78801693d0 2023-09-30T22:52:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.773+0000 7f93c29ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc0c6da0 0x7f93bc06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.773+0000 7f93c29ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93bc15dde0 con 0x7f93bc06d3f0 2023-09-30T22:52:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.773+0000 7f93c29ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93bc15e6e0 con 0x7f93bc15e270 2023-09-30T22:52:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.773+0000 7f93c29ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc06b840 con 0x7f93bc0c6da0 2023-09-30T22:52:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f93bb7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc0c6da0 0x7f93bc06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f93bb7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc0c6da0 0x7f93bc06d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42592/0 (socket says 172.21.15.142:42592) 2023-09-30T22:52:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f93bb7fe700 1 -- 172.21.15.142:0/4157376371 learned_addr learned my addr 172.21.15.142:0/4157376371 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.771+0000 7f2a1affd700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f29fc06fc30 0x7f29fc072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.772+0000 7f2a1affd700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f29fc06fc30 0x7f29fc072040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.773+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== osd.0 v2:172.21.15.142:6808/109694 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f29fc0726f0 con 0x7f29fc06fc30 2023-09-30T22:52:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.774+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a0c055830 con 0x7f2a1c159870 2023-09-30T22:52:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f878db9c700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f876c06fd30 0x7f876c072140 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f878cb9a700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f876c067480 0x7f876c069930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8788160ab0 tx=0x7f87780090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78801693d0 0x7f78801580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78801693d0 0x7f78801580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42598/0 (socket says 172.21.15.142:42598) 2023-09-30T22:52:36.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 -- 172.21.15.142:0/1675867703 learned_addr learned my addr 172.21.15.142:0/1675867703 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787ffff700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880151c80 0x7f7880152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f93baffd700 1 -- 172.21.15.142:0/4157376371 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560427672 0 0) 0x7f93bc15e6e0 con 0x7f93bc15e270 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f93baffd700 1 -- 172.21.15.142:0/4157376371 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a4003570 con 0x7f93bc15e270 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f93bb7fe700 1 -- 172.21.15.142:0/4157376371 >> v1:172.21.15.148:6789/0 conn(0x7f93bc15e270 legacy=0x7f93bc159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f93bb7fe700 1 -- 172.21.15.142:0/4157376371 >> v1:172.21.15.142:6789/0 conn(0x7f93bc06d3f0 legacy=0x7f93bc06b130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f93bb7fe700 1 -- 172.21.15.142:0/4157376371 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc15d7d0 con 0x7f93bc0c6da0 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.775+0000 7f93bb7fe700 1 --2- 172.21.15.142:0/4157376371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc0c6da0 0x7f93bc06d7c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0099e0 tx=0x7f93ac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=823a1bb160f9e549 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f93baffd700 1 -- 172.21.15.142:0/4157376371 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00b820 con 0x7f93bc0c6da0 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f93baffd700 1 -- 172.21.15.142:0/4157376371 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac00b980 con 0x7f93bc0c6da0 2023-09-30T22:52:36.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f93baffd700 1 -- 172.21.15.142:0/4157376371 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00bd20 con 0x7f93bc0c6da0 2023-09-30T22:52:36.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f2a1b7fe700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29fc067400 0x7f29fc0698b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009ef0 tx=0x7f2a04016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 -- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880151c80 msgr2=0x7f7880152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7880151c80 0x7f7880152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 -- 172.21.15.142:0/1675867703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78801585e0 msgr2=0x7f7880151740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:52:36.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78801585e0 0x7f7880151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.776+0000 7f787f7fe700 1 -- 172.21.15.142:0/1675867703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880165d60 con 0x7f78801693d0 2023-09-30T22:52:36.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f787f7fe700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78801693d0 0x7f78801580a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7878007a30 tx=0x7f7878018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== osd.1 v2:172.21.15.142:6800/109693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f876c0727f0 con 0x7f876c06fd30 2023-09-30T22:52:36.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f93c29ff700 1 -- 172.21.15.142:0/4157376371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc0c6da0 msgr2=0x7f93bc06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f93c29ff700 1 --2- 172.21.15.142:0/4157376371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc0c6da0 0x7f93bc06d7c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0099e0 tx=0x7f93ac009250 comp rx=0 tx=0).stop 2023-09-30T22:52:36.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7fc91cdff700 1 -- 172.21.15.142:0/90629049 shutdown_connections 2023-09-30T22:52:36.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f93c29ff700 1 -- 172.21.15.142:0/4157376371 shutdown_connections 2023-09-30T22:52:36.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f93c29ff700 1 --2- 172.21.15.142:0/4157376371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc0c6da0 0x7f93bc06d7c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f93c29ff700 1 -- 172.21.15.142:0/4157376371 >> 172.21.15.142:0/4157376371 conn(0x7f93bc067e30 msgr2=0x7f93bc068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7f93c29ff700 1 -- 172.21.15.142:0/4157376371 shutdown_connections 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.778+0000 7f93c29ff700 1 -- 172.21.15.142:0/4157376371 wait complete. 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.777+0000 7fc91cdff700 1 -- 172.21.15.142:0/90629049 wait complete. 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.780+0000 7fc91cdff700 1 Processor -- start 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.780+0000 7fc91cdff700 1 -- start start 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.781+0000 7fc91cdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc918069f10 0x7fc918144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.781+0000 7fc91cdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc91806d920 0x7fc91814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7fc91cdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc91815dea0 0x7fc91814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7fc91cdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91814bb00 con 0x7fc91806d920 2023-09-30T22:52:36.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7fc91cdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91814ae50 con 0x7fc918069f10 2023-09-30T22:52:36.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7fc91cdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91814ce10 con 0x7fc91815dea0 2023-09-30T22:52:36.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.780+0000 7f93c29ff700 1 Processor -- start 2023-09-30T22:52:36.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.780+0000 7f93c29ff700 1 -- start start 2023-09-30T22:52:36.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93c29ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc06d3f0 0x7f93bc0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93c29ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93bc0c6da0 0x7f93bc0ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93c29ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc15e270 0x7f93bc14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93c29ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0cadf0 con 0x7f93bc06d3f0 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93c29ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc088e30 con 0x7f93bc0c6da0 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93c29ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0cdbe0 con 0x7f93bc15e270 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93bb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93bc0c6da0 0x7f93bc0ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93c0f9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc15e270 0x7f93bc14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93bb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93bc0c6da0 0x7f93bc0ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46818/0 (socket says 172.21.15.142:46818) 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.782+0000 7f93bb7fe700 1 -- 172.21.15.142:0/441926029 learned_addr learned my addr 172.21.15.142:0/441926029 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f93bbfff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc06d3f0 0x7f93bc0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f93c0f9c700 1 -- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93bc0c6da0 msgr2=0x7f93bc0ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f93c0f9c700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93bc0c6da0 0x7f93bc0ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f93c0f9c700 1 -- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc06d3f0 msgr2=0x7f93bc0cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f93c0f9c700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93bc06d3f0 0x7f93bc0cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f93c0f9c700 1 -- 172.21.15.142:0/441926029 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0094f0 con 0x7f93bc15e270 2023-09-30T22:52:36.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787801d620 con 0x7f78801693d0 2023-09-30T22:52:36.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878022070 con 0x7f78801693d0 2023-09-30T22:52:36.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.783+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787801d9f0 con 0x7f78801693d0 2023-09-30T22:52:36.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.784+0000 7fc915d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc91806d920 0x7fc91814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.784+0000 7fc915d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc91806d920 0x7fc91814bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57288/0 (socket says 172.21.15.142:57288) 2023-09-30T22:52:36.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.784+0000 7fc915d9b700 1 -- 172.21.15.142:0/30642729 learned_addr learned my addr 172.21.15.142:0/30642729 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:36.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.784+0000 7fc916d9d700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc91815dea0 0x7fc91814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.784+0000 7f93c0f9c700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc15e270 0x7f93bc14c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c840 tx=0x7f93b4002650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.784+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7880166040 con 0x7f78801693d0 2023-09-30T22:52:36.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880166600 con 0x7f78801693d0 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7fc915d9b700 1 -- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc91815dea0 msgr2=0x7fc91814c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7fc915d9b700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc91815dea0 0x7fc91814c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7fc915d9b700 1 -- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc918069f10 msgr2=0x7fc918144960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7fc915d9b700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc918069f10 0x7fc918144960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7fc915d9b700 1 -- 172.21.15.142:0/30642729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc908009420 con 0x7fc91806d920 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.786+0000 7fc915d9b700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc91806d920 0x7fc91814bc70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc908009f50 tx=0x7fc908016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4012630 con 0x7f93bc15e270 2023-09-30T22:52:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40127b0 con 0x7f93bc15e270 2023-09-30T22:52:36.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.785+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4012b70 con 0x7f93bc15e270 2023-09-30T22:52:36.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.786+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc088500 con 0x7f93bc15e270 2023-09-30T22:52:36.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.786+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc088ac0 con 0x7f93bc15e270 2023-09-30T22:52:36.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.786+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78800695b0 con 0x7f78801693d0 2023-09-30T22:52:36.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.787+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908011b10 con 0x7fc91806d920 2023-09-30T22:52:36.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.787+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908020070 con 0x7fc91806d920 2023-09-30T22:52:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.787+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9080276b0 con 0x7fc91806d920 2023-09-30T22:52:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.787+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc918161ff0 con 0x7fc91806d920 2023-09-30T22:52:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.788+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc918161c80 con 0x7fc91806d920 2023-09-30T22:52:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.788+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93bc069420 con 0x7f93bc15e270 2023-09-30T22:52:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.789+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f787801e410 con 0x7f78801693d0 2023-09-30T22:52:36.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.790+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9180695b0 con 0x7fc91806d920 2023-09-30T22:52:36.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.790+0000 7f78677fe700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f786c067480 0x7f786c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.790+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7878024070 con 0x7f78801693d0 2023-09-30T22:52:36.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.791+0000 7f78677fe700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f786c06fd30 0x7f786c072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.791+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 --> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f786c0727f0 con 0x7f786c06fd30 2023-09-30T22:52:36.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.791+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78780896a0 con 0x7f78801693d0 2023-09-30T22:52:36.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.792+0000 7f787ffff700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f786c06fd30 0x7f786c072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.792+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 --> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11b416f6d0 con 0x7f119806fd30 2023-09-30T22:52:36.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.792+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc908027a60 con 0x7fc91806d920 2023-09-30T22:52:36.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.792+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f93b401b400 con 0x7f93bc15e270 2023-09-30T22:52:36.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7fc90e7fc700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8f8067480 0x7fc8f8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7f787effd700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f786c067480 0x7f786c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc908022070 con 0x7fc91806d920 2023-09-30T22:52:36.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7fc90e7fc700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7fc8f806fd30 0x7fc8f8072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 --> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8f80727f0 con 0x7fc8f806fd30 2023-09-30T22:52:36.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc90808c1d0 con 0x7fc91806d920 2023-09-30T22:52:36.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f787ffff700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f786c06fd30 0x7f786c072140 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7f93a3fff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93a8067480 0x7f93a8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.793+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f93b4084e30 con 0x7f93bc15e270 2023-09-30T22:52:36.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f93a3fff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7f93a806fd30 0x7f93a8072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:36.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 --> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93a80727f0 con 0x7f93a806fd30 2023-09-30T22:52:36.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93b4085160 con 0x7f93bc15e270 2023-09-30T22:52:36.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f11a9ffb700 1 -- 172.21.15.142:0/3456675073 <== osd.2 v2:172.21.15.142:6821/109702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11b416f6d0 con 0x7f119806fd30 2023-09-30T22:52:36.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f787effd700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f786c067480 0x7f786c069930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7880163540 tx=0x7f7870009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f93bb7fe700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7f93a806fd30 0x7f93a8072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7fc91659c700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8f8067480 0x7fc8f8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7fc916d9d700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7fc8f806fd30 0x7fc8f8072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.795+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== osd.6 v2:172.21.15.148:6815/109936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f786c0727f0 con 0x7f786c06fd30 2023-09-30T22:52:36.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.794+0000 7f93bbfff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93a8067480 0x7f93a8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:36.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.795+0000 7f93bb7fe700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7f93a806fd30 0x7f93a8072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.795+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f119806fd30 msgr2=0x7f1198072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.795+0000 7f11bc1ff700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f119806fd30 0x7f1198072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1198067480 msgr2=0x7f1198069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11bc1ff700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1198067480 0x7f1198069930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0076a0 tx=0x7f11ac00b040 comp rx=0 tx=0).stop 2023-09-30T22:52:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b41599b0 msgr2=0x7f11b416e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11bc1ff700 1 --2- 172.21.15.142:0/3456675073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11b41599b0 0x7f11b416e760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f11a40094c0 tx=0x7f11a4016000 comp rx=0 tx=0).stop 2023-09-30T22:52:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7fc91659c700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8f8067480 0x7fc8f8069930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc91812d920 tx=0x7fc900006be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11ba79c700 1 -- 172.21.15.142:0/3456675073 reap_dead start 2023-09-30T22:52:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 shutdown_connections 2023-09-30T22:52:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 >> 172.21.15.142:0/3456675073 conn(0x7f11b4067620 msgr2=0x7f11b40cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 shutdown_connections 2023-09-30T22:52:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== osd.7 v2:172.21.15.148:6824/109961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f93a80727f0 con 0x7f93a806fd30 2023-09-30T22:52:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.796+0000 7f93bbfff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93a8067480 0x7f93a8069930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93b0006fd0 tx=0x7f93b0000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.797+0000 7fc916d9d700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7fc8f806fd30 0x7fc8f8072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.797+0000 7f11bc1ff700 1 -- 172.21.15.142:0/3456675073 wait complete. 2023-09-30T22:52:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.798+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== osd.5 v2:172.21.15.148:6808/109935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fc8f80727f0 con 0x7fc8f806fd30 2023-09-30T22:52:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.799+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 --> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f474015f440 con 0x7f472c06fcb0 2023-09-30T22:52:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.800+0000 7f4727fff700 1 -- 172.21.15.142:0/808774621 <== osd.3 v2:172.21.15.142:6812/109696 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f474015f440 con 0x7f472c06fcb0 2023-09-30T22:52:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.801+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f472c06fcb0 msgr2=0x7f472c0720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.801+0000 7f47469ff700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f472c06fcb0 0x7f472c0720c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.802+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f472c067400 msgr2=0x7f472c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.802+0000 7f47469ff700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f472c067400 0x7f472c0698b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4730007fd0 tx=0x7f4730009040 comp rx=0 tx=0).stop 2023-09-30T22:52:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.802+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f474016e3f0 msgr2=0x7f474016e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.802+0000 7f47469ff700 1 --2- 172.21.15.142:0/808774621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f474016e3f0 0x7f474016e870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4738015000 tx=0x7f4738018000 comp rx=0 tx=0).stop 2023-09-30T22:52:36.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.802+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 --> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a1c06fc10 con 0x7f29fc06fc30 2023-09-30T22:52:36.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.802+0000 7f2a137fe700 1 -- 172.21.15.142:0/2955233482 <== osd.0 v2:172.21.15.142:6808/109694 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a1c06fc10 con 0x7f29fc06fc30 2023-09-30T22:52:36.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.802+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 --> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd4406fc10 con 0x7fcd2406fd30 2023-09-30T22:52:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.803+0000 7f4744f9c700 1 -- 172.21.15.142:0/808774621 reap_dead start 2023-09-30T22:52:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.803+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 shutdown_connections 2023-09-30T22:52:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.803+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 >> 172.21.15.142:0/808774621 conn(0x7f4740067620 msgr2=0x7f4740157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.803+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f29fc06fc30 msgr2=0x7f29fc072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.803+0000 7f2a221ff700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f29fc06fc30 0x7f29fc072040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.803+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 shutdown_connections 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29fc067400 msgr2=0x7f29fc0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29fc067400 0x7f29fc0698b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009ef0 tx=0x7f2a04016000 comp rx=0 tx=0).stop 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 msgr2=0x7f2a1c1415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 --2- 172.21.15.142:0/2955233482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1c159870 0x7f2a1c1415a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00d860 tx=0x7f2a0c008040 comp rx=0 tx=0).stop 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a1bfff700 1 -- 172.21.15.142:0/2955233482 reap_dead start 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 shutdown_connections 2023-09-30T22:52:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 >> 172.21.15.142:0/2955233482 conn(0x7f2a1c067ec0 msgr2=0x7f2a1c15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f47469ff700 1 -- 172.21.15.142:0/808774621 wait complete. 2023-09-30T22:52:36.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 shutdown_connections 2023-09-30T22:52:36.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.804+0000 7f2a221ff700 1 -- 172.21.15.142:0/2955233482 wait complete. 2023-09-30T22:52:36.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.806+0000 7fcd3affd700 1 -- 172.21.15.142:0/3585899662 <== osd.4 v2:172.21.15.148:6800/109934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd4406fc10 con 0x7fcd2406fd30 2023-09-30T22:52:36.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.807+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7fcd2406fd30 msgr2=0x7fcd24072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.807+0000 7fcd489ff700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7fcd2406fd30 0x7fcd24072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.807+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 --> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f878815e500 con 0x7f876c06fd30 2023-09-30T22:52:36.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.808+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd24067480 msgr2=0x7fcd24069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.808+0000 7fcd489ff700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd24067480 0x7fcd24069930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406b7c0 tx=0x7fcd34015000 comp rx=0 tx=0).stop 2023-09-30T22:52:36.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.808+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd44146d30 msgr2=0x7fcd4414a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.808+0000 7fcd489ff700 1 --2- 172.21.15.142:0/3585899662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd44146d30 0x7fcd4414a670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c7c0 tx=0x7fcd2c00cb80 comp rx=0 tx=0).stop 2023-09-30T22:52:36.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.808+0000 7fcd42d9d700 1 -- 172.21.15.142:0/3585899662 reap_dead start 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.808+0000 7f877d7fa700 1 -- 172.21.15.142:0/1381705581 <== osd.1 v2:172.21.15.142:6800/109693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f878815e500 con 0x7f876c06fd30 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.809+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f876c06fd30 msgr2=0x7f876c072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.809+0000 7f878f5ff700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f876c06fd30 0x7f876c072140 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.809+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f876c067480 msgr2=0x7f876c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.809+0000 7f878f5ff700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f876c067480 0x7f876c069930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8788160ab0 tx=0x7f87780090f0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.809+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87740053c0 msgr2=0x7f87880c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.809+0000 7f878f5ff700 1 --2- 172.21.15.142:0/1381705581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87740053c0 0x7f87880c6da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8788071e60 tx=0x7f8784008040 comp rx=0 tx=0).stop 2023-09-30T22:52:36.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.809+0000 7f878db9c700 1 -- 172.21.15.142:0/1381705581 reap_dead start 2023-09-30T22:52:36.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.810+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 shutdown_connections 2023-09-30T22:52:36.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.810+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 >> 172.21.15.142:0/3585899662 conn(0x7fcd440680c0 msgr2=0x7fcd440ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.817+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 shutdown_connections 2023-09-30T22:52:36.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.817+0000 7fcd489ff700 1 -- 172.21.15.142:0/3585899662 wait complete. 2023-09-30T22:52:36.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.818+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 shutdown_connections 2023-09-30T22:52:36.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.818+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 >> 172.21.15.142:0/1381705581 conn(0x7f8788067e30 msgr2=0x7f87881551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.818+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 --> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93bc0c7230 con 0x7f93a806fd30 2023-09-30T22:52:36.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.818+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 shutdown_connections 2023-09-30T22:52:36.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.818+0000 7f878f5ff700 1 -- 172.21.15.142:0/1381705581 wait complete. 2023-09-30T22:52:36.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.819+0000 7f93a3fff700 1 -- 172.21.15.142:0/441926029 <== osd.7 v2:172.21.15.148:6824/109961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93bc0c7230 con 0x7f93a806fd30 2023-09-30T22:52:36.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7f93a806fd30 msgr2=0x7f93a8072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7f93a806fd30 0x7f93a8072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93a8067480 msgr2=0x7f93a8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93a8067480 0x7f93a8069930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93b0006fd0 tx=0x7f93b0000f90 comp rx=0 tx=0).stop 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc15e270 msgr2=0x7f93bc14c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 --2- 172.21.15.142:0/441926029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93bc15e270 0x7f93bc14c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c840 tx=0x7f93b4002650 comp rx=0 tx=0).stop 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c0f9c700 1 -- 172.21.15.142:0/441926029 reap_dead start 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 shutdown_connections 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 >> 172.21.15.142:0/441926029 conn(0x7f93bc067e30 msgr2=0x7f93bc157320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 shutdown_connections 2023-09-30T22:52:36.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.821+0000 7f93c29ff700 1 -- 172.21.15.142:0/441926029 wait complete. 2023-09-30T22:52:36.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.822+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 --> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f788006fc10 con 0x7f786c06fd30 2023-09-30T22:52:36.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.823+0000 7f78677fe700 1 -- 172.21.15.142:0/1675867703 <== osd.6 v2:172.21.15.148:6815/109936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f788006fc10 con 0x7f786c06fd30 2023-09-30T22:52:36.842 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.826+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f786c06fd30 msgr2=0x7f786c072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.826+0000 7f7885dff700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f786c06fd30 0x7f786c072140 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f786c067480 msgr2=0x7f786c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f786c067480 0x7f786c069930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7880163540 tx=0x7f7870009040 comp rx=0 tx=0).stop 2023-09-30T22:52:36.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78801693d0 msgr2=0x7f78801580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 --2- 172.21.15.142:0/1675867703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78801693d0 0x7f78801580a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7878007a30 tx=0x7f7878018000 comp rx=0 tx=0).stop 2023-09-30T22:52:36.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f787ffff700 1 -- 172.21.15.142:0/1675867703 reap_dead start 2023-09-30T22:52:36.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:52:36.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 --> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc91806fc10 con 0x7fc8f806fd30 2023-09-30T22:52:36.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 shutdown_connections 2023-09-30T22:52:36.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 >> 172.21.15.142:0/1675867703 conn(0x7f7880067620 msgr2=0x7f78800ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 shutdown_connections 2023-09-30T22:52:36.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.827+0000 7f7885dff700 1 -- 172.21.15.142:0/1675867703 wait complete. 2023-09-30T22:52:36.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.828+0000 7fc90e7fc700 1 -- 172.21.15.142:0/30642729 <== osd.5 v2:172.21.15.148:6808/109935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc910009e90 con 0x7fc8f806fd30 2023-09-30T22:52:36.846 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:52:36.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.831+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7fc8f806fd30 msgr2=0x7fc8f8072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.831+0000 7fc91cdff700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7fc8f806fd30 0x7fc8f8072140 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.831+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8f8067480 msgr2=0x7fc8f8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.831+0000 7fc91cdff700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8f8067480 0x7fc8f8069930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc91812d920 tx=0x7fc900006be0 comp rx=0 tx=0).stop 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.831+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc91806d920 msgr2=0x7fc91814bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.831+0000 7fc91cdff700 1 --2- 172.21.15.142:0/30642729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc91806d920 0x7fc91814bc70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc908009f50 tx=0x7fc908016000 comp rx=0 tx=0).stop 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.832+0000 7fc916d9d700 1 -- 172.21.15.142:0/30642729 reap_dead start 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.832+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 shutdown_connections 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.832+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 >> 172.21.15.142:0/30642729 conn(0x7fc9180680c0 msgr2=0x7fc91806a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.832+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 shutdown_connections 2023-09-30T22:52:36.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:36.832+0000 7fc91cdff700 1 -- 172.21.15.142:0/30642729 wait complete. 2023-09-30T22:52:36.849 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.849 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:52:36.851 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-30T22:52:36.855 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.856 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:52:36.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-30T22:52:36.858 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.858 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-30T22:52:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2023-09-30T22:52:36.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-30T22:52:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.183+0000 7f7503fff700 1 Processor -- start 2023-09-30T22:52:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.183+0000 7f7503fff700 1 -- start start 2023-09-30T22:52:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.185+0000 7f7503fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f74fc155970 0x7f74fc0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.185+0000 7f7503fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.185+0000 7f7503fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc06dd70 con 0x7f74fc155d40 2023-09-30T22:52:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.185+0000 7f7503fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc156ee0 con 0x7f74fc155970 2023-09-30T22:52:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.185+0000 7f7503fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc06b4a0 con 0x7f74fc156a70 2023-09-30T22:52:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.186+0000 7f750159a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f74fc155d40 0x7f74fc156360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48308/0 (socket says 172.21.15.142:48308) 2023-09-30T22:52:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.186+0000 7f750159a700 1 -- 172.21.15.142:0/1625075972 learned_addr learned my addr 172.21.15.142:0/1625075972 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.187+0000 7f750259c700 1 --2- 172.21.15.142:0/1625075972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.187+0000 7f7501d9b700 1 --2- 172.21.15.142:0/1625075972 >> v2:172.21.15.148:3300/0 conn(0x7f74fc155970 0x7f74fc0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.188+0000 7f7500d99700 1 -- 172.21.15.142:0/1625075972 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179620992 0 0) 0x7f74fc06dd70 con 0x7f74fc155d40 2023-09-30T22:52:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.188+0000 7f7500d99700 1 -- 172.21.15.142:0/1625075972 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e4003570 con 0x7f74fc155d40 2023-09-30T22:52:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.188+0000 7f750259c700 1 -- 172.21.15.142:0/1625075972 >> v2:172.21.15.148:3300/0 conn(0x7f74fc155970 msgr2=0x7f74fc0ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.188+0000 7f750259c700 1 --2- 172.21.15.142:0/1625075972 >> v2:172.21.15.148:3300/0 conn(0x7f74fc155970 0x7f74fc0ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.188+0000 7f750259c700 1 -- 172.21.15.142:0/1625075972 >> v1:172.21.15.148:6789/0 conn(0x7f74fc155d40 legacy=0x7f74fc156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.188+0000 7f750259c700 1 -- 172.21.15.142:0/1625075972 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc06d480 con 0x7f74fc156a70 2023-09-30T22:52:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.188+0000 7f750259c700 1 --2- 172.21.15.142:0/1625075972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0aee30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0098e0 tx=0x7f74ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40a5700cd82a1205 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.190+0000 7f7500d99700 1 -- 172.21.15.142:0/1625075972 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00b640 con 0x7f74fc156a70 2023-09-30T22:52:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.190+0000 7f7500d99700 1 -- 172.21.15.142:0/1625075972 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00b7a0 con 0x7f74fc156a70 2023-09-30T22:52:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.190+0000 7f7500d99700 1 -- 172.21.15.142:0/1625075972 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00bb40 con 0x7f74fc156a70 2023-09-30T22:52:37.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.191+0000 7f7503fff700 1 -- 172.21.15.142:0/1625075972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 msgr2=0x7f74fc0aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.191+0000 7f7503fff700 1 --2- 172.21.15.142:0/1625075972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0aee30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0098e0 tx=0x7f74ec0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.192+0000 7f7503fff700 1 -- 172.21.15.142:0/1625075972 shutdown_connections 2023-09-30T22:52:37.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.192+0000 7f7503fff700 1 --2- 172.21.15.142:0/1625075972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0aee30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.192+0000 7f7503fff700 1 --2- 172.21.15.142:0/1625075972 >> v2:172.21.15.148:3300/0 conn(0x7f74fc155970 0x7f74fc0ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.192+0000 7f7503fff700 1 -- 172.21.15.142:0/1625075972 >> 172.21.15.142:0/1625075972 conn(0x7f74fc067620 msgr2=0x7f74fc067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.194+0000 7f7503fff700 1 -- 172.21.15.142:0/1625075972 shutdown_connections 2023-09-30T22:52:37.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.194+0000 7f7503fff700 1 -- 172.21.15.142:0/1625075972 wait complete. 2023-09-30T22:52:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.195+0000 7f125b1ff700 1 Processor -- start 2023-09-30T22:52:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.196+0000 7f7503fff700 1 Processor -- start 2023-09-30T22:52:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.196+0000 7f125b1ff700 1 -- start start 2023-09-30T22:52:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f125b1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12541558e0 0x7f1254155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f125b1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1254068130 0x7f12540ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f125b1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f12540aee30 0x7f1254156360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f125b1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540af2b0 con 0x7f1254068130 2023-09-30T22:52:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f125b1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125406dd70 con 0x7f12540aee30 2023-09-30T22:52:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f125b1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125406d480 con 0x7f12541558e0 2023-09-30T22:52:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.199+0000 7f1253fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1254068130 0x7f12540ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.199+0000 7f1253fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1254068130 0x7f12540ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57296/0 (socket says 172.21.15.142:57296) 2023-09-30T22:52:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.199+0000 7f1253fff700 1 -- 172.21.15.142:0/3523731436 learned_addr learned my addr 172.21.15.142:0/3523731436 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.197+0000 7f7503fff700 1 -- start start 2023-09-30T22:52:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f7503fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74fc155970 0x7f74fc14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f7503fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74fc155d40 0x7f74fc0adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f7503fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f7503fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0c82d0 con 0x7f74fc155d40 2023-09-30T22:52:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f7503fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc16ec30 con 0x7f74fc155970 2023-09-30T22:52:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.198+0000 7f7503fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0b0cb0 con 0x7f74fc156a70 2023-09-30T22:52:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.199+0000 7f1258f9b700 1 --2- 172.21.15.142:0/3523731436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12541558e0 0x7f1254155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.200+0000 7f125979c700 1 --2- 172.21.15.142:0/3523731436 >> v2:172.21.15.148:3300/0 conn(0x7f12540aee30 0x7f1254156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f1258f9b700 1 -- 172.21.15.142:0/3523731436 >> v2:172.21.15.148:3300/0 conn(0x7f12540aee30 msgr2=0x7f1254156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f1258f9b700 1 --2- 172.21.15.142:0/3523731436 >> v2:172.21.15.148:3300/0 conn(0x7f12540aee30 0x7f1254156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f1258f9b700 1 -- 172.21.15.142:0/3523731436 >> v2:172.21.15.142:3300/0 conn(0x7f1254068130 msgr2=0x7f12540ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f1258f9b700 1 --2- 172.21.15.142:0/3523731436 >> v2:172.21.15.142:3300/0 conn(0x7f1254068130 0x7f12540ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f1258f9b700 1 -- 172.21.15.142:0/3523731436 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125406d720 con 0x7f12541558e0 2023-09-30T22:52:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.200+0000 7f7501d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74fc155970 0x7f74fc14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.200+0000 7f7501d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74fc155970 0x7f74fc14f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46850/0 (socket says 172.21.15.142:46850) 2023-09-30T22:52:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.200+0000 7f7501d9b700 1 -- 172.21.15.142:0/2464561403 learned_addr learned my addr 172.21.15.142:0/2464561403 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f7501d9b700 1 -- 172.21.15.142:0/2464561403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 msgr2=0x7f74fc0ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f7501d9b700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f7501d9b700 1 -- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74fc155d40 msgr2=0x7f74fc0adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f7501d9b700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74fc155d40 0x7f74fc0adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.201+0000 7f7501d9b700 1 -- 172.21.15.142:0/2464561403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec009420 con 0x7f74fc155970 2023-09-30T22:52:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.202+0000 7fb48ebff700 1 Processor -- start 2023-09-30T22:52:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.202+0000 7fb48ebff700 1 -- start start 2023-09-30T22:52:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.202+0000 7f1258f9b700 1 --2- 172.21.15.142:0/3523731436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12541558e0 0x7f1254155cb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12540c8a40 tx=0x7f1244009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12986b78df0e50b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.203+0000 7f12537fe700 1 -- 172.21.15.142:0/3523731436 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400e070 con 0x7f12541558e0 2023-09-30T22:52:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.203+0000 7f12537fe700 1 -- 172.21.15.142:0/3523731436 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400bb40 con 0x7f12541558e0 2023-09-30T22:52:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.203+0000 7f12537fe700 1 -- 172.21.15.142:0/3523731436 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244012430 con 0x7f12541558e0 2023-09-30T22:52:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.203+0000 7f454a3ff700 1 Processor -- start 2023-09-30T22:52:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.203+0000 7f454a3ff700 1 -- start start 2023-09-30T22:52:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.203+0000 7fa5707ff700 1 Processor -- start 2023-09-30T22:52:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7fb48ebff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb488154e10 0x7fb4880b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7fb48ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4880ccd60 0x7fb48815e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7fb48ebff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880adcc0 con 0x7fb4881551e0 2023-09-30T22:52:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7fb48ebff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb488162b70 con 0x7fb488154e10 2023-09-30T22:52:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7fb48ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880ae840 con 0x7fb4880ccd60 2023-09-30T22:52:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7fa5707ff700 1 -- start start 2023-09-30T22:52:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7f125b1ff700 1 -- 172.21.15.142:0/3523731436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12541558e0 msgr2=0x7f1254155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7f125b1ff700 1 --2- 172.21.15.142:0/3523731436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12541558e0 0x7f1254155cb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12540c8a40 tx=0x7f1244009780 comp rx=0 tx=0).stop 2023-09-30T22:52:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7fb0357ff700 1 Processor -- start 2023-09-30T22:52:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f454a3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45440c8150 0x7f454415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f454a3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45440c8520 0x7f454415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f454a3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454415a350 con 0x7f454415dcf0 2023-09-30T22:52:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f454a3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45440ae9b0 con 0x7f45440c8520 2023-09-30T22:52:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f454a3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45440af210 con 0x7f45440c8150 2023-09-30T22:52:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f125b1ff700 1 -- 172.21.15.142:0/3523731436 shutdown_connections 2023-09-30T22:52:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f125b1ff700 1 --2- 172.21.15.142:0/3523731436 >> v2:172.21.15.148:3300/0 conn(0x7f12540aee30 0x7f1254156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f125b1ff700 1 --2- 172.21.15.142:0/3523731436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12541558e0 0x7f1254155cb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f125b1ff700 1 --2- 172.21.15.142:0/3523731436 >> v2:172.21.15.142:3300/0 conn(0x7f1254068130 0x7f12540ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f125b1ff700 1 -- 172.21.15.142:0/3523731436 >> 172.21.15.142:0/3523731436 conn(0x7f1254067620 msgr2=0x7f1254067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7f125b1ff700 1 -- 172.21.15.142:0/3523731436 shutdown_connections 2023-09-30T22:52:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.204+0000 7f7501d9b700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74fc155970 0x7f74fc14f5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74f800de70 tx=0x7f74f800f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f74f1ffb700 1 -- 172.21.15.142:0/2464561403 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8009b00 con 0x7f74fc155970 2023-09-30T22:52:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f74f1ffb700 1 -- 172.21.15.142:0/2464561403 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8009c60 con 0x7f74fc155970 2023-09-30T22:52:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f74f1ffb700 1 -- 172.21.15.142:0/2464561403 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80173f0 con 0x7f74fc155970 2023-09-30T22:52:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc14faf0 con 0x7f74fc155970 2023-09-30T22:52:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc16e5e0 con 0x7f74fc155970 2023-09-30T22:52:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc0052b0 con 0x7f74fc155970 2023-09-30T22:52:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f45437fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f454415dcf0 0x7f45440b1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60396/0 (socket says 172.21.15.142:60396) 2023-09-30T22:52:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f45437fe700 1 -- 172.21.15.142:0/2585708086 learned_addr learned my addr 172.21.15.142:0/2585708086 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7f454899c700 1 --2- 172.21.15.142:0/2585708086 >> v2:172.21.15.142:3300/0 conn(0x7f45440c8520 0x7f454415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553692262 0 0) 0x7f454415a350 con 0x7f454415dcf0 2023-09-30T22:52:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f452c003570 con 0x7f454415dcf0 2023-09-30T22:52:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fa5707ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa5680b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fa5707ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5680b24a0 0x7fa56806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7fa56e59b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa5680b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7fb48c99b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb488154e10 0x7fb4880b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7fb48c99b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb488154e10 0x7fb4880b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46852/0 (socket says 172.21.15.142:46852) 2023-09-30T22:52:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7fb48c99b700 1 -- 172.21.15.142:0/3795767265 learned_addr learned my addr 172.21.15.142:0/3795767265 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7fb48d19c700 1 --2- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4880ccd60 0x7fb48815e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb48c99b700 1 -- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4880ccd60 msgr2=0x7fb48815e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb48c99b700 1 --2- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4880ccd60 0x7fb48815e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb48c99b700 1 -- 172.21.15.142:0/3795767265 >> v1:172.21.15.142:6789/0 conn(0x7fb4881551e0 legacy=0x7fb4880cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb48c99b700 1 -- 172.21.15.142:0/3795767265 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48806b590 con 0x7fb488154e10 2023-09-30T22:52:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb48c99b700 1 --2- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb488154e10 0x7fb4880b1f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb480009f20 tx=0x7fb480009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=666624b8de52b81c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb4877fe700 1 -- 172.21.15.142:0/3795767265 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000e070 con 0x7fb488154e10 2023-09-30T22:52:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb4877fe700 1 -- 172.21.15.142:0/3795767265 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48000b990 con 0x7fb488154e10 2023-09-30T22:52:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.206+0000 7fb4877fe700 1 -- 172.21.15.142:0/3795767265 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800092e0 con 0x7fb488154e10 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.205+0000 7fb0357ff700 1 -- start start 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7fb0357ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb030069f10 0x7fb03006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7fb0357ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03015f250 con 0x7fb03006d920 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7fb0357ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03015e680 con 0x7fb03015dea0 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.207+0000 7fb0357ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03006ef60 con 0x7fb030069f10 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7fb02e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb030069f10 0x7fb03006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7fb02e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb030069f10 0x7fb03006d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46874/0 (socket says 172.21.15.142:46874) 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7fb02e7fc700 1 -- 172.21.15.142:0/3525974900 learned_addr learned my addr 172.21.15.142:0/3525974900 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7fb02effd700 1 --1- 172.21.15.142:0/3525974900 >> v1:172.21.15.148:6789/0 conn(0x7fb03015dea0 0x7fb0300b1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48310/0 (socket says 172.21.15.142:48310) 2023-09-30T22:52:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710268827 0 0) 0x7f452c003570 con 0x7f454415dcf0 2023-09-30T22:52:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 >> v2:172.21.15.148:3300/0 conn(0x7f45440c8150 msgr2=0x7f454415d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T22:52:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.208+0000 7f4542ffd700 1 --2- 172.21.15.142:0/2585708086 >> v2:172.21.15.148:3300/0 conn(0x7f45440c8150 0x7f454415d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 >> v2:172.21.15.142:3300/0 conn(0x7f45440c8520 msgr2=0x7f454415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 --2- 172.21.15.142:0/2585708086 >> v2:172.21.15.142:3300/0 conn(0x7f45440c8520 0x7f454415a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45440aec50 con 0x7f454415dcf0 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f4534001470 con 0x7f454415dcf0 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 >> v1:172.21.15.142:6789/0 conn(0x7f454415dcf0 legacy=0x7f45440b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452c003b30 0x7f452c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f452c004810 0x7f452c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f452c0052e0 0x7f452c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45440ae9b0 con 0x7f452c004810 2023-09-30T22:52:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45440af210 con 0x7f452c003b30 2023-09-30T22:52:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c00c2b0 con 0x7f452c0052e0 2023-09-30T22:52:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629233591 0 0) 0x7fb03015e680 con 0x7fb03015dea0 2023-09-30T22:52:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb018003570 con 0x7fb03015dea0 2023-09-30T22:52:37.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7f45437fe700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f452c004810 0x7f452c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718406274 0 0) 0x7fb03015f250 con 0x7fb03006d920 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb03015e680 con 0x7fb03006d920 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1281802940 0 0) 0x7fb018003570 con 0x7fb03015dea0 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 >> v2:172.21.15.148:3300/0 conn(0x7fb030069f10 msgr2=0x7fb03006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 --2- 172.21.15.142:0/3525974900 >> v2:172.21.15.148:3300/0 conn(0x7fb030069f10 0x7fb03006d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 >> v1:172.21.15.142:6789/0 conn(0x7fb03006d920 legacy=0x7fb030167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03006dd20 con 0x7fb03015dea0 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fb0280017b0 con 0x7fb03015dea0 2023-09-30T22:52:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 >> v1:172.21.15.148:6789/0 conn(0x7fb03015dea0 legacy=0x7fb0300b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb018003bf0 0x7fb018003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb018004810 0x7fb018004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb01800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01800c0b0 con 0x7fb0180051c0 2023-09-30T22:52:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01800c220 con 0x7fb018003bf0 2023-09-30T22:52:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01800c3e0 con 0x7fb018004810 2023-09-30T22:52:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7f45437fe700 1 -- 172.21.15.142:0/2585708086 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f452c0052e0 msgr2=0x7f452c00ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7f45437fe700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f452c0052e0 0x7f452c00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7f45437fe700 1 -- 172.21.15.142:0/2585708086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452c003b30 msgr2=0x7f452c003f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7f45437fe700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f452c003b30 0x7f452c003f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7f45437fe700 1 -- 172.21.15.142:0/2585708086 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c003570 con 0x7f452c004810 2023-09-30T22:52:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fb02effd700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb018003bf0 0x7fb018003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fb02f7fe700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb01800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.209+0000 7f125b1ff700 1 -- 172.21.15.142:0/3523731436 wait complete. 2023-09-30T22:52:37.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7f125b1ff700 1 Processor -- start 2023-09-30T22:52:37.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7f125b1ff700 1 -- start start 2023-09-30T22:52:37.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f125b1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1254068130 0x7f1254145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f125b1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12540aee30 0x7f125416e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f125b1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12541558e0 0x7f1254157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f125b1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541463e0 con 0x7f1254068130 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f125b1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254146640 con 0x7f12541558e0 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f125b1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1254146920 con 0x7f12540aee30 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7f1253fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12540aee30 0x7f125416e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7f125979c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12541558e0 0x7f1254157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7f125979c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12541558e0 0x7f1254157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46894/0 (socket says 172.21.15.142:46894) 2023-09-30T22:52:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7f125979c700 1 -- 172.21.15.142:0/2158491270 learned_addr learned my addr 172.21.15.142:0/2158491270 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7f74f1ffb700 1 -- 172.21.15.142:0/2464561403 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f74f8017760 con 0x7f74fc155970 2023-09-30T22:52:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7f74f1ffb700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f74e8067480 0x7f74e8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7f74f1ffb700 1 -- 172.21.15.142:0/2464561403 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74f8084ea0 con 0x7f74fc155970 2023-09-30T22:52:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7f750159a700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f74e8067480 0x7f74e8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7f45437fe700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f452c004810 0x7f452c004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f453400c2d0 tx=0x7f4534001e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9621bd8cad8d7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400cc00 con 0x7f452c004810 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453400cd60 con 0x7f452c004810 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7f4542ffd700 1 -- 172.21.15.142:0/2585708086 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534005b70 con 0x7f452c004810 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7f454a3ff700 1 -- 172.21.15.142:0/2585708086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f452c004810 msgr2=0x7f452c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7f454a3ff700 1 --2- 172.21.15.142:0/2585708086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f452c004810 0x7f452c004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f453400c2d0 tx=0x7f4534001e00 comp rx=0 tx=0).stop 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fa5707ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56815f250 con 0x7fa568069f10 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fa56e59b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa5680b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42654/0 (socket says 172.21.15.142:42654) 2023-09-30T22:52:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fa5707ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56806ef60 con 0x7fa5680b24a0 2023-09-30T22:52:37.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fa5707ff700 1 -- 172.21.15.142:0/4248779387 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56815e680 con 0x7fa56815dea0 2023-09-30T22:52:37.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.210+0000 7fa56e59b700 1 -- 172.21.15.142:0/4248779387 learned_addr learned my addr 172.21.15.142:0/4248779387 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fa56e59b700 1 -- 172.21.15.142:0/4248779387 >> v2:172.21.15.142:3300/0 conn(0x7fa5680b24a0 msgr2=0x7fa56806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fa56e59b700 1 --2- 172.21.15.142:0/4248779387 >> v2:172.21.15.142:3300/0 conn(0x7fa5680b24a0 0x7fa56806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fa56e59b700 1 -- 172.21.15.142:0/4248779387 >> v1:172.21.15.148:6789/0 conn(0x7fa568069f10 legacy=0x7fa5680adcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:52:37.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fa56e59b700 1 -- 172.21.15.142:0/4248779387 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56815e920 con 0x7fa56815dea0 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fa56e59b700 1 --2- 172.21.15.142:0/4248779387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa5680b1f60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009f20 tx=0x7fa55c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e7dd6065501132 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fa56d599700 1 -- 172.21.15.142:0/4248779387 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00e070 con 0x7fa56815dea0 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fa56d599700 1 -- 172.21.15.142:0/4248779387 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c00ba40 con 0x7fa56815dea0 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fa56d599700 1 -- 172.21.15.142:0/4248779387 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0092e0 con 0x7fa56815dea0 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7fa5707ff700 1 -- 172.21.15.142:0/4248779387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 msgr2=0x7fa5680b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7fa5707ff700 1 --2- 172.21.15.142:0/4248779387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa5680b1f60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009f20 tx=0x7fa55c009840 comp rx=0 tx=0).stop 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fa5707ff700 1 -- 172.21.15.142:0/4248779387 shutdown_connections 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fa5707ff700 1 --2- 172.21.15.142:0/4248779387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa5680b1f60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fa5707ff700 1 --2- 172.21.15.142:0/4248779387 >> v2:172.21.15.142:3300/0 conn(0x7fa5680b24a0 0x7fa56806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fa5707ff700 1 -- 172.21.15.142:0/4248779387 >> 172.21.15.142:0/4248779387 conn(0x7fa5680680c0 msgr2=0x7fa5680c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fa5707ff700 1 -- 172.21.15.142:0/4248779387 shutdown_connections 2023-09-30T22:52:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fb48ebff700 1 -- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb488154e10 msgr2=0x7fb4880b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fb48ebff700 1 --2- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb488154e10 0x7fb4880b1f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb480009f20 tx=0x7fb480009840 comp rx=0 tx=0).stop 2023-09-30T22:52:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.211+0000 7fb02e7fc700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb018004810 0x7fb018004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fb02f7fe700 1 -- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb018004810 msgr2=0x7fb018004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fb02f7fe700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb018004810 0x7fb018004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fb02f7fe700 1 -- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb018003bf0 msgr2=0x7fb018003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fb02f7fe700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb018003bf0 0x7fb018003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fb02f7fe700 1 -- 172.21.15.142:0/3525974900 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03006dd20 con 0x7fb0180051c0 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fb02f7fe700 1 -- 172.21.15.142:0/3525974900 reap_dead start 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.212+0000 7fb02f7fe700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb01800ba60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb020001a60 tx=0x7fb020007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2b1a0f3ccd3f9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020001ea0 con 0x7fb0180051c0 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000c5d0 con 0x7fb0180051c0 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.213+0000 7fb02dffb700 1 -- 172.21.15.142:0/3525974900 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000c970 con 0x7fb0180051c0 2023-09-30T22:52:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fb0357ff700 1 -- 172.21.15.142:0/3525974900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 msgr2=0x7fb01800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fb0357ff700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb01800ba60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb020001a60 tx=0x7fb020007cd0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fb0357ff700 1 -- 172.21.15.142:0/3525974900 shutdown_connections 2023-09-30T22:52:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fb0357ff700 1 --2- 172.21.15.142:0/3525974900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb01800ba60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.214+0000 7fb0357ff700 1 -- 172.21.15.142:0/3525974900 >> 172.21.15.142:0/3525974900 conn(0x7fb0300680c0 msgr2=0x7fb0300c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fb48ebff700 1 -- 172.21.15.142:0/3795767265 shutdown_connections 2023-09-30T22:52:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fb48ebff700 1 --2- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb488154e10 0x7fb4880b1f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fb48ebff700 1 --2- 172.21.15.142:0/3795767265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4880ccd60 0x7fb48815e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fb48ebff700 1 -- 172.21.15.142:0/3795767265 >> 172.21.15.142:0/3795767265 conn(0x7fb488067620 msgr2=0x7fb488067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f454899c700 1 --2- 172.21.15.142:0/2585708086 >> v2:172.21.15.142:3300/0 conn(0x7f45440c8520 0x7f454415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f454899c700 1 -- 172.21.15.142:0/2585708086 reap_dead start 2023-09-30T22:52:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f454a3ff700 1 -- 172.21.15.142:0/2585708086 shutdown_connections 2023-09-30T22:52:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f125979c700 1 -- 172.21.15.142:0/2158491270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12540aee30 msgr2=0x7f125416e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f125979c700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12540aee30 0x7f125416e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f125979c700 1 -- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1254068130 msgr2=0x7f1254145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f125979c700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1254068130 0x7f1254145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f454a3ff700 1 -- 172.21.15.142:0/2585708086 >> 172.21.15.142:0/2585708086 conn(0x7f4544067620 msgr2=0x7f4544067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f125979c700 1 -- 172.21.15.142:0/2158491270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009a20 con 0x7f12541558e0 2023-09-30T22:52:37.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fb0357ff700 1 -- 172.21.15.142:0/3525974900 shutdown_connections 2023-09-30T22:52:37.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fa5707ff700 1 -- 172.21.15.142:0/4248779387 wait complete. 2023-09-30T22:52:37.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7fb0357ff700 1 -- 172.21.15.142:0/3525974900 wait complete. 2023-09-30T22:52:37.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.216+0000 7f750159a700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f74e8067480 0x7f74e8069930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0cc350 tx=0x7f74f40060e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.216+0000 7f125979c700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12541558e0 0x7f1254157870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f123c00ea50 tx=0x7f123c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.216+0000 7fb48ebff700 1 -- 172.21.15.142:0/3795767265 shutdown_connections 2023-09-30T22:52:37.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f454a3ff700 1 -- 172.21.15.142:0/2585708086 shutdown_connections 2023-09-30T22:52:37.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.215+0000 7f454a3ff700 1 -- 172.21.15.142:0/2585708086 wait complete. 2023-09-30T22:52:37.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.216+0000 7fb48ebff700 1 -- 172.21.15.142:0/3795767265 wait complete. 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7f454a3ff700 1 Processor -- start 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.218+0000 7f454a3ff700 1 -- start start 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7f454a3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4544165350 0x7f45440c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7f454a3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45440c51e0 0x7f454415b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7f454a3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f454415bea0 0x7f4544177e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7f454a3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454414e9d0 con 0x7f4544165350 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7f454a3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454415c320 con 0x7f45440c51e0 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7f454a3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4544165720 con 0x7f454415bea0 2023-09-30T22:52:37.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7f454899c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f454415bea0 0x7f4544177e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7f454899c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f454415bea0 0x7f4544177e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42684/0 (socket says 172.21.15.142:42684) 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7f454899c700 1 -- 172.21.15.142:0/1864615954 learned_addr learned my addr 172.21.15.142:0/1864615954 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7fa5707ff700 1 Processor -- start 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7fa5707ff700 1 -- start start 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa5707ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa568069f10 0x7fa56814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa5707ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5680b24a0 0x7fa56806a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa5707ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa56806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa5707ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568171e90 con 0x7fa5680b24a0 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa5707ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568172a10 con 0x7fa568069f10 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa5707ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5681720e0 con 0x7fa56815dea0 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa56ed9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa56806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa56ed9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa56806a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42676/0 (socket says 172.21.15.142:42676) 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fa56ed9c700 1 -- 172.21.15.142:0/1347179811 learned_addr learned my addr 172.21.15.142:0/1347179811 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fa56ed9c700 1 -- 172.21.15.142:0/1347179811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa568069f10 msgr2=0x7fa56814b0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fa56ed9c700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa568069f10 0x7fa56814b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fa56ed9c700 1 -- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5680b24a0 msgr2=0x7fa56806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fa56ed9c700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5680b24a0 0x7fa56806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fa56ed9c700 1 -- 172.21.15.142:0/1347179811 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009ae0 con 0x7fa56815dea0 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.218+0000 7fb0357ff700 1 Processor -- start 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.218+0000 7fb0357ff700 1 -- start start 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fb0357ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb0300c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fb0357ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb030156310 0x7fb030156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fb0357ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb030164120 0x7fb0300cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fb0357ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb030163c90 con 0x7fb0180051c0 2023-09-30T22:52:37.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb0357ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0301570b0 con 0x7fb030156310 2023-09-30T22:52:37.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb0357ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb030157330 con 0x7fb030164120 2023-09-30T22:52:37.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7f45437fe700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45440c51e0 0x7f454415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.218+0000 7fb48ebff700 1 Processor -- start 2023-09-30T22:52:37.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.219+0000 7fb48ebff700 1 -- start start 2023-09-30T22:52:37.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb48ebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4880ccd60 0x7fb4881718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb48ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb488154e10 0x7fb488160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb48ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb488160e60 0x7fb48815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb48ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881620a0 con 0x7fb488160e60 2023-09-30T22:52:37.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb48ebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48816ed90 con 0x7fb4880ccd60 2023-09-30T22:52:37.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7fb48ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb488171df0 con 0x7fb488154e10 2023-09-30T22:52:37.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7f454899c700 1 -- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45440c51e0 msgr2=0x7f454415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.220+0000 7f454899c700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45440c51e0 0x7f454415b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7f454899c700 1 -- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4544165350 msgr2=0x7f45440c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7f454899c700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4544165350 0x7f45440c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7f454899c700 1 -- 172.21.15.142:0/1864615954 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45441776b0 con 0x7f454415bea0 2023-09-30T22:52:37.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7fa56ed9c700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa56806a940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa56000b520 tx=0x7fa5600090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7f454899c700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f454415bea0 0x7f4544177e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f454415e8e0 tx=0x7f453c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7fb487fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb488154e10 0x7fb488160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7fb487fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb488154e10 0x7fb488160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42706/0 (socket says 172.21.15.142:42706) 2023-09-30T22:52:37.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7fb487fff700 1 -- 172.21.15.142:0/4205734657 learned_addr learned my addr 172.21.15.142:0/4205734657 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7fb02e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb030156310 0x7fb030156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb02e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb030156310 0x7fb030156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46902/0 (socket says 172.21.15.142:46902) 2023-09-30T22:52:37.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb02e7fc700 1 -- 172.21.15.142:0/2264395934 learned_addr learned my addr 172.21.15.142:0/2264395934 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7f1250ff9700 1 -- 172.21.15.142:0/2158491270 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00c850 con 0x7f12541558e0 2023-09-30T22:52:37.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7f1250ff9700 1 -- 172.21.15.142:0/2158491270 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c00c9d0 con 0x7f12541558e0 2023-09-30T22:52:37.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7f1250ff9700 1 -- 172.21.15.142:0/2158491270 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00cd90 con 0x7f12541558e0 2023-09-30T22:52:37.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1254146c00 con 0x7f12541558e0 2023-09-30T22:52:37.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.217+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12541471c0 con 0x7f12541558e0 2023-09-30T22:52:37.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7f74f1ffb700 1 -- 172.21.15.142:0/2464561403 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f74f8051d80 con 0x7f74fc155970 2023-09-30T22:52:37.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.221+0000 7fb48c99b700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4880ccd60 0x7fb4881718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb48c99b700 1 -- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb488154e10 msgr2=0x7fb488160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb48c99b700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb488154e10 0x7fb488160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb48c99b700 1 -- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb488160e60 msgr2=0x7fb48815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb48c99b700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb488160e60 0x7fb48815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb48c99b700 1 -- 172.21.15.142:0/4205734657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480009ae0 con 0x7fb4880ccd60 2023-09-30T22:52:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb48c99b700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4880ccd60 0x7fb4881718b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb480014000 tx=0x7fb480017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fb02effd700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb0300c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb02f7fe700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb030164120 0x7fb0300cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb02e7fc700 1 -- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb030164120 msgr2=0x7fb0300cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb02e7fc700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb030164120 0x7fb0300cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb02e7fc700 1 -- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 msgr2=0x7fb0300c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb02e7fc700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb0300c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb02e7fc700 1 -- 172.21.15.142:0/2264395934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030163360 con 0x7fb030156310 2023-09-30T22:52:37.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12380052b0 con 0x7f12541558e0 2023-09-30T22:52:37.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7f452bfff700 1 -- 172.21.15.142:0/1864615954 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c019070 con 0x7f454415bea0 2023-09-30T22:52:37.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7f452bfff700 1 -- 172.21.15.142:0/1864615954 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c00f040 con 0x7f454415bea0 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7f452bfff700 1 -- 172.21.15.142:0/1864615954 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c009c70 con 0x7f454415bea0 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4544176dc0 con 0x7f454415bea0 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4544177340 con 0x7f454415bea0 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb484ff9700 1 -- 172.21.15.142:0/4205734657 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480012900 con 0x7fb4880ccd60 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb484ff9700 1 -- 172.21.15.142:0/4205734657 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480012a60 con 0x7fb4880ccd60 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb484ff9700 1 -- 172.21.15.142:0/4205734657 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480012e20 con 0x7fb4880ccd60 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb488161490 con 0x7fb4880ccd60 2023-09-30T22:52:37.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb488161a50 con 0x7fb4880ccd60 2023-09-30T22:52:37.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.222+0000 7fa5667fc700 1 -- 172.21.15.142:0/1347179811 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000f510 con 0x7fa56815dea0 2023-09-30T22:52:37.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fa5667fc700 1 -- 172.21.15.142:0/1347179811 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56000f6b0 con 0x7fa56815dea0 2023-09-30T22:52:37.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fa5667fc700 1 -- 172.21.15.142:0/1347179811 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000fa70 con 0x7fa56815dea0 2023-09-30T22:52:37.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5681723c0 con 0x7fa56815dea0 2023-09-30T22:52:37.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.223+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56814b5e0 con 0x7fa56815dea0 2023-09-30T22:52:37.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.225+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb488162380 con 0x7fb4880ccd60 2023-09-30T22:52:37.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.225+0000 7fb02e7fc700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb030156310 0x7fb030156b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb024011910 tx=0x7fb024008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.225+0000 7f1250ff9700 1 -- 172.21.15.142:0/2158491270 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f123c013680 con 0x7f12541558e0 2023-09-30T22:52:37.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.225+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5500052b0 con 0x7fa56815dea0 2023-09-30T22:52:37.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.226+0000 7fb016ffd700 1 -- 172.21.15.142:0/2264395934 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400f6d0 con 0x7fb030156310 2023-09-30T22:52:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.226+0000 7fb016ffd700 1 -- 172.21.15.142:0/2264395934 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02400f830 con 0x7fb030156310 2023-09-30T22:52:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.226+0000 7fb016ffd700 1 -- 172.21.15.142:0/2264395934 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400fbf0 con 0x7fb030156310 2023-09-30T22:52:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.226+0000 7f1250ff9700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1234067480 0x7f1234069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.227+0000 7f1250ff9700 1 -- 172.21.15.142:0/2158491270 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f123c084e30 con 0x7f12541558e0 2023-09-30T22:52:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.227+0000 7f452bfff700 1 -- 172.21.15.142:0/1864615954 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f453c003020 con 0x7f454415bea0 2023-09-30T22:52:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.227+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45440695b0 con 0x7f454415bea0 2023-09-30T22:52:37.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.228+0000 7fb484ff9700 1 -- 172.21.15.142:0/4205734657 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb48001d630 con 0x7fb4880ccd60 2023-09-30T22:52:37.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.228+0000 7f452bfff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4530067400 0x7f45300698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.228+0000 7f452bfff700 1 -- 172.21.15.142:0/1864615954 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f453c084e80 con 0x7f454415bea0 2023-09-30T22:52:37.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.229+0000 7fb484ff9700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb468067400 0x7fb4680698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.229+0000 7f4543fff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4530067400 0x7f45300698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.229+0000 7f4543fff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4530067400 0x7f45300698b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f454415cee0 tx=0x7f4538006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.228+0000 7fa5667fc700 1 -- 172.21.15.142:0/1347179811 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa56001a400 con 0x7fa56815dea0 2023-09-30T22:52:37.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.229+0000 7fa5667fc700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa54c067480 0x7fa54c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.230+0000 7fa5667fc700 1 -- 172.21.15.142:0/1347179811 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa560084a30 con 0x7fa56815dea0 2023-09-30T22:52:37.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.230+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb030163640 con 0x7fb030156310 2023-09-30T22:52:37.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.230+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb030156780 con 0x7fb030156310 2023-09-30T22:52:37.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.230+0000 7fb487fff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb468067400 0x7fb4680698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.230+0000 7f1258f9b700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1234067480 0x7f1234069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.231+0000 7fa56e59b700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa54c067480 0x7fa54c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.231+0000 7fb484ff9700 1 -- 172.21.15.142:0/4205734657 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb480057f60 con 0x7fb4880ccd60 2023-09-30T22:52:37.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.231+0000 7f1258f9b700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1234067480 0x7f1234069930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12440097c0 tx=0x7f1244019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.231+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb030163e00 con 0x7fb030156310 2023-09-30T22:52:37.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.232+0000 7f1250ff9700 1 -- 172.21.15.142:0/2158491270 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f123c051d10 con 0x7f12541558e0 2023-09-30T22:52:37.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.232+0000 7fb487fff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb468067400 0x7fb4680698b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4880c8ec0 tx=0x7fb4780090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.232+0000 7fa5667fc700 1 -- 172.21.15.142:0/1347179811 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa560051990 con 0x7fa56815dea0 2023-09-30T22:52:37.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.233+0000 7fa56e59b700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa54c067480 0x7fa54c069930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009f20 tx=0x7fa55c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.234+0000 7fb016ffd700 1 -- 172.21.15.142:0/2264395934 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb024015460 con 0x7fb030156310 2023-09-30T22:52:37.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.236+0000 7fb016ffd700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb01c067400 0x7fb01c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.236+0000 7fb016ffd700 1 -- 172.21.15.142:0/2264395934 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb024056010 con 0x7fb030156310 2023-09-30T22:52:37.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.236+0000 7fb484ff9700 1 -- 172.21.15.142:0/4205734657 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb480053ba0 con 0x7fb4880ccd60 2023-09-30T22:52:37.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.236+0000 7f452bfff700 1 -- 172.21.15.142:0/1864615954 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f453c051d60 con 0x7f454415bea0 2023-09-30T22:52:37.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.237+0000 7fb02effd700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb01c067400 0x7fb01c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.238+0000 7fb02effd700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb01c067400 0x7fb01c0698b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0280018e0 tx=0x7fb028009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.241+0000 7fb016ffd700 1 -- 172.21.15.142:0/2264395934 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb024051c50 con 0x7fb030156310 2023-09-30T22:52:37.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.271+0000 7fae6f1ff700 1 Processor -- start 2023-09-30T22:52:37.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.271+0000 7fae6f1ff700 1 -- start start 2023-09-30T22:52:37.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.273+0000 7fae6f1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae680ccaa0 0x7fae6806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.273+0000 7fae6f1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae680b0300 con 0x7fae680aeff0 2023-09-30T22:52:37.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.273+0000 7fae6f1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae680af9d0 con 0x7fae680cc630 2023-09-30T22:52:37.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.273+0000 7fae6f1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae680afcb0 con 0x7fae680ccaa0 2023-09-30T22:52:37.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.274+0000 7fae67fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fae680cc630 0x7fae68069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48312/0 (socket says 172.21.15.142:48312) 2023-09-30T22:52:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.274+0000 7fae67fff700 1 -- 172.21.15.142:0/1504244425 learned_addr learned my addr 172.21.15.142:0/1504244425 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.275+0000 7fae6d79c700 1 --2- 172.21.15.142:0/1504244425 >> v2:172.21.15.142:3300/0 conn(0x7fae680ccaa0 0x7fae6806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.276+0000 7fae677fe700 1 -- 172.21.15.142:0/1504244425 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293821581 0 0) 0x7fae680af9d0 con 0x7fae680cc630 2023-09-30T22:52:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.276+0000 7fae677fe700 1 -- 172.21.15.142:0/1504244425 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae50003570 con 0x7fae680cc630 2023-09-30T22:52:37.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.278+0000 7fae6d79c700 1 -- 172.21.15.142:0/1504244425 >> v1:172.21.15.148:6789/0 conn(0x7fae680cc630 legacy=0x7fae68069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.279+0000 7fae6d79c700 1 -- 172.21.15.142:0/1504244425 >> v1:172.21.15.142:6789/0 conn(0x7fae680aeff0 legacy=0x7fae680b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.279+0000 7fae6d79c700 1 -- 172.21.15.142:0/1504244425 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680aff90 con 0x7fae680ccaa0 2023-09-30T22:52:37.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.279+0000 7fae6d79c700 1 --2- 172.21.15.142:0/1504244425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680ccaa0 0x7fae6806a620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae60009de0 tx=0x7fae60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce93100af7c0c99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.280+0000 7fae677fe700 1 -- 172.21.15.142:0/1504244425 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c001470 con 0x7fae680ccaa0 2023-09-30T22:52:37.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.280+0000 7fae677fe700 1 -- 172.21.15.142:0/1504244425 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000b850 con 0x7fae680ccaa0 2023-09-30T22:52:37.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.280+0000 7fae677fe700 1 -- 172.21.15.142:0/1504244425 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000bbf0 con 0x7fae680ccaa0 2023-09-30T22:52:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.281+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1504244425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680ccaa0 msgr2=0x7fae6806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.281+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1504244425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680ccaa0 0x7fae6806a620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae60009de0 tx=0x7fae60009780 comp rx=0 tx=0).stop 2023-09-30T22:52:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.283+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1504244425 shutdown_connections 2023-09-30T22:52:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.283+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1504244425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680ccaa0 0x7fae6806a620 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.283+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1504244425 >> 172.21.15.142:0/1504244425 conn(0x7fae68067620 msgr2=0x7fae68067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.284+0000 7f8b105ff700 1 Processor -- start 2023-09-30T22:52:37.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.284+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1504244425 shutdown_connections 2023-09-30T22:52:37.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.284+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1504244425 wait complete. 2023-09-30T22:52:37.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.287+0000 7fae6f1ff700 1 Processor -- start 2023-09-30T22:52:37.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.285+0000 7f8b105ff700 1 -- start start 2023-09-30T22:52:37.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.287+0000 7f8b105ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8b0815acb0 0x7f8b080cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.287+0000 7f8b105ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b081594f0 0x7f8b08159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.287+0000 7f8b105ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0815e190 con 0x7f8b080cbaa0 2023-09-30T22:52:37.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.287+0000 7f8b105ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0806b910 con 0x7f8b0815acb0 2023-09-30T22:52:37.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.287+0000 7f8b105ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0815e620 con 0x7f8b081594f0 2023-09-30T22:52:37.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.288+0000 7f8b0eb9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b081594f0 0x7f8b08159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.288+0000 7f8b0eb9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b081594f0 0x7f8b08159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42710/0 (socket says 172.21.15.142:42710) 2023-09-30T22:52:37.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.288+0000 7f8b0eb9c700 1 -- 172.21.15.142:0/4146432830 learned_addr learned my addr 172.21.15.142:0/4146432830 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.289+0000 7f8b0db9a700 1 --2- 172.21.15.142:0/4146432830 >> v2:172.21.15.148:3300/0 conn(0x7f8b0815acb0 0x7f8b080cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.289+0000 7f8b0eb9c700 1 -- 172.21.15.142:0/4146432830 >> v2:172.21.15.148:3300/0 conn(0x7f8b0815acb0 msgr2=0x7f8b080cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.289+0000 7f8b0eb9c700 1 --2- 172.21.15.142:0/4146432830 >> v2:172.21.15.148:3300/0 conn(0x7f8b0815acb0 0x7f8b080cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.289+0000 7f8b0eb9c700 1 -- 172.21.15.142:0/4146432830 >> v1:172.21.15.142:6789/0 conn(0x7f8b080cbaa0 legacy=0x7f8b0806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:37.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.289+0000 7f8b0eb9c700 1 -- 172.21.15.142:0/4146432830 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0815d860 con 0x7f8b081594f0 2023-09-30T22:52:37.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.291+0000 7f8b0eb9c700 1 --2- 172.21.15.142:0/4146432830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b081594f0 0x7f8b08159970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009f20 tx=0x7f8b00009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6628a06c51d8194 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.290+0000 7fae6f1ff700 1 -- start start 2023-09-30T22:52:37.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6f1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae680aeff0 0x7fae68162d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6f1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680cc630 0x7fae680c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6f1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae680ccaa0 0x7fae680c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6f1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680c39b0 con 0x7fae680cc630 2023-09-30T22:52:37.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6f1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680c4810 con 0x7fae680aeff0 2023-09-30T22:52:37.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6f1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae680c3c00 con 0x7fae680ccaa0 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6cf9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae680aeff0 0x7fae68162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6cf9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae680aeff0 0x7fae68162d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46922/0 (socket says 172.21.15.142:46922) 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7fae6cf9b700 1 -- 172.21.15.142:0/1361893083 learned_addr learned my addr 172.21.15.142:0/1361893083 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.293+0000 7fae6cf9b700 1 -- 172.21.15.142:0/1361893083 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae680ccaa0 msgr2=0x7fae680c2750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.293+0000 7fae6cf9b700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae680ccaa0 0x7fae680c2750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.293+0000 7fae6cf9b700 1 -- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680cc630 msgr2=0x7fae680c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.293+0000 7fae6cf9b700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680cc630 0x7fae680c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.293+0000 7fae6cf9b700 1 -- 172.21.15.142:0/1361893083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009a20 con 0x7fae680aeff0 2023-09-30T22:52:37.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7f8b0d399700 1 -- 172.21.15.142:0/4146432830 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000e070 con 0x7f8b081594f0 2023-09-30T22:52:37.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7f8b0d399700 1 -- 172.21.15.142:0/4146432830 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000ba40 con 0x7f8b081594f0 2023-09-30T22:52:37.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.292+0000 7f8b0d399700 1 -- 172.21.15.142:0/4146432830 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b000092e0 con 0x7f8b081594f0 2023-09-30T22:52:37.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.293+0000 7f8b105ff700 1 -- 172.21.15.142:0/4146432830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b081594f0 msgr2=0x7f8b08159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.293+0000 7f8b105ff700 1 --2- 172.21.15.142:0/4146432830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b081594f0 0x7f8b08159970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009f20 tx=0x7f8b00009840 comp rx=0 tx=0).stop 2023-09-30T22:52:37.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7fae6cf9b700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae680aeff0 0x7fae68162d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c5d0 tx=0x7fae58007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7f8b105ff700 1 -- 172.21.15.142:0/4146432830 shutdown_connections 2023-09-30T22:52:37.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7f8b105ff700 1 --2- 172.21.15.142:0/4146432830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b081594f0 0x7f8b08159970 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7f8b105ff700 1 --2- 172.21.15.142:0/4146432830 >> v2:172.21.15.148:3300/0 conn(0x7f8b0815acb0 0x7f8b080cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7f8b105ff700 1 -- 172.21.15.142:0/4146432830 >> 172.21.15.142:0/4146432830 conn(0x7f8b080d14d0 msgr2=0x7f8b080cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7fae64ff9700 1 -- 172.21.15.142:0/1361893083 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58011590 con 0x7fae680aeff0 2023-09-30T22:52:37.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7fae64ff9700 1 -- 172.21.15.142:0/1361893083 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae580116f0 con 0x7fae680aeff0 2023-09-30T22:52:37.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7fae64ff9700 1 -- 172.21.15.142:0/1361893083 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58011a90 con 0x7fae680aeff0 2023-09-30T22:52:37.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae680c3ee0 con 0x7fae680aeff0 2023-09-30T22:52:37.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.294+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae680c44a0 con 0x7fae680aeff0 2023-09-30T22:52:37.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.295+0000 7f8b105ff700 1 -- 172.21.15.142:0/4146432830 shutdown_connections 2023-09-30T22:52:37.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.297+0000 7f8b105ff700 1 -- 172.21.15.142:0/4146432830 wait complete. 2023-09-30T22:52:37.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.296+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae540052e0 con 0x7fae680aeff0 2023-09-30T22:52:37.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.299+0000 7f8b105ff700 1 Processor -- start 2023-09-30T22:52:37.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.299+0000 7f8b105ff700 1 -- start start 2023-09-30T22:52:37.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.301+0000 7f8b105ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b080cbaa0 0x7f8b0806a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.301+0000 7f8b105ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b081594f0 0x7f8b0816dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.301+0000 7f8b105ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b0815acb0 0x7f8b0816e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.301+0000 7f8b105ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0814ebc0 con 0x7f8b081594f0 2023-09-30T22:52:37.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.301+0000 7f8b105ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0816e6f0 con 0x7f8b080cbaa0 2023-09-30T22:52:37.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.301+0000 7f8b105ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0814df80 con 0x7f8b0815acb0 2023-09-30T22:52:37.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.302+0000 7f8b0db9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b081594f0 0x7f8b0816dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.302+0000 7f8b0db9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b081594f0 0x7f8b0816dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57422/0 (socket says 172.21.15.142:57422) 2023-09-30T22:52:37.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.302+0000 7f8b0db9a700 1 -- 172.21.15.142:0/1486240788 learned_addr learned my addr 172.21.15.142:0/1486240788 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:37.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.303+0000 7f8b0db9a700 1 -- 172.21.15.142:0/1486240788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b0815acb0 msgr2=0x7f8b0816e1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:52:37.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.303+0000 7f8b0db9a700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b0815acb0 0x7f8b0816e1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.303+0000 7f8b0db9a700 1 -- 172.21.15.142:0/1486240788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b080cbaa0 msgr2=0x7f8b0806a0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:52:37.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.303+0000 7f8b0db9a700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b080cbaa0 0x7f8b0806a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.303+0000 7f8b0db9a700 1 -- 172.21.15.142:0/1486240788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009ae0 con 0x7f8b081594f0 2023-09-30T22:52:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.301+0000 7fae64ff9700 1 -- 172.21.15.142:0/1361893083 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fae5801c440 con 0x7fae680aeff0 2023-09-30T22:52:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.303+0000 7fae64ff9700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae500678b0 0x7fae50069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.303+0000 7fae64ff9700 1 -- 172.21.15.142:0/1361893083 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae58035e40 con 0x7fae680aeff0 2023-09-30T22:52:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.304+0000 7fae67fff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae500678b0 0x7fae50069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.304+0000 7fae64ff9700 1 -- 172.21.15.142:0/1361893083 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fae58051360 con 0x7fae680aeff0 2023-09-30T22:52:37.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.304+0000 7f8b0db9a700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b081594f0 0x7f8b0816dc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c880 tx=0x7f8af8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.305+0000 7fae67fff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae500678b0 0x7fae50069d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0015a0 tx=0x7fae5c001090 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.305+0000 7f8afe7fc700 1 -- 172.21.15.142:0/1486240788 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8011600 con 0x7f8b081594f0 2023-09-30T22:52:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.305+0000 7f8afe7fc700 1 -- 172.21.15.142:0/1486240788 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af8011780 con 0x7f8b081594f0 2023-09-30T22:52:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.305+0000 7f8afe7fc700 1 -- 172.21.15.142:0/1486240788 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8011b40 con 0x7f8b081594f0 2023-09-30T22:52:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.305+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0814e280 con 0x7f8b081594f0 2023-09-30T22:52:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.306+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0814efe0 con 0x7f8b081594f0 2023-09-30T22:52:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.309+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0814ee30 con 0x7f8b081594f0 2023-09-30T22:52:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.311+0000 7f8afe7fc700 1 -- 172.21.15.142:0/1486240788 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8af8018360 con 0x7f8b081594f0 2023-09-30T22:52:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.312+0000 7f8afe7fc700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8aec067480 0x7f8aec069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.312+0000 7f8afe7fc700 1 -- 172.21.15.142:0/1486240788 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8af8084910 con 0x7f8b081594f0 2023-09-30T22:52:37.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.318+0000 7f8b0e39b700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8aec067480 0x7f8aec069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:37.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.319+0000 7f8b0e39b700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8aec067480 0x7f8aec069930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009740 tx=0x7f8b04006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:37.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.322+0000 7f8afe7fc700 1 -- 172.21.15.142:0/1486240788 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8af80517f0 con 0x7f8b081594f0 2023-09-30T22:52:37.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.650+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4544177840 con 0x7f454415bea0 2023-09-30T22:52:37.654 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.650+0000 7f452bfff700 1 -- 172.21.15.142:0/1864615954 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f453c055380 con 0x7f454415bea0 2023-09-30T22:52:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.654+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4530067400 msgr2=0x7f45300698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.654+0000 7f454a3ff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4530067400 0x7f45300698b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f454415cee0 tx=0x7f4538006c60 comp rx=0 tx=0).stop 2023-09-30T22:52:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.654+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f454415bea0 msgr2=0x7f4544177e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.654+0000 7f454a3ff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f454415bea0 0x7f4544177e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f454415e8e0 tx=0x7f453c00b040 comp rx=0 tx=0).stop 2023-09-30T22:52:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.655+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 shutdown_connections 2023-09-30T22:52:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.655+0000 7f454a3ff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4530067400 0x7f45300698b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.655+0000 7f454a3ff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f454415bea0 0x7f4544177e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.655+0000 7f454a3ff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4544165350 0x7f45440c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.655+0000 7f454a3ff700 1 --2- 172.21.15.142:0/1864615954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45440c51e0 0x7f454415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.655+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 >> 172.21.15.142:0/1864615954 conn(0x7f4544067620 msgr2=0x7f4544159490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.656+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 shutdown_connections 2023-09-30T22:52:37.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.656+0000 7f454a3ff700 1 -- 172.21.15.142:0/1864615954 wait complete. 2023-09-30T22:52:37.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.669+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74dc005560 con 0x7f74fc155970 2023-09-30T22:52:37.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.670+0000 7f74f1ffb700 1 -- 172.21.15.142:0/2464561403 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74f80553a0 con 0x7f74fc155970 2023-09-30T22:52:37.674 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f74e8067480 msgr2=0x7f74e8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f74e8067480 0x7f74e8069930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0cc350 tx=0x7f74f40060e0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74fc155970 msgr2=0x7f74fc14f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74fc155970 0x7f74fc14f5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74f800de70 tx=0x7f74f800f040 comp rx=0 tx=0).stop 2023-09-30T22:52:37.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1238005560 con 0x7f12541558e0 2023-09-30T22:52:37.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 shutdown_connections 2023-09-30T22:52:37.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f74e8067480 0x7f74e8069930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74fc156a70 0x7f74fc0ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74fc155970 0x7f74fc14f5b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 --2- 172.21.15.142:0/2464561403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74fc155d40 0x7f74fc0adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.675+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 >> 172.21.15.142:0/2464561403 conn(0x7f74fc067620 msgr2=0x7f74fc1584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.676+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 shutdown_connections 2023-09-30T22:52:37.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.676+0000 7f1250ff9700 1 -- 172.21.15.142:0/2158491270 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f123c055330 con 0x7f12541558e0 2023-09-30T22:52:37.677 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.676+0000 7f7503fff700 1 -- 172.21.15.142:0/2464561403 wait complete. 2023-09-30T22:52:37.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1234067480 msgr2=0x7f1234069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1234067480 0x7f1234069930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12440097c0 tx=0x7f1244019000 comp rx=0 tx=0).stop 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12541558e0 msgr2=0x7f1254157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12541558e0 0x7f1254157870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f123c00ea50 tx=0x7f123c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 shutdown_connections 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1234067480 0x7f1234069930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12541558e0 0x7f1254157870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1254068130 0x7f1254145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 --2- 172.21.15.142:0/2158491270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12540aee30 0x7f125416e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.680+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 >> 172.21.15.142:0/2158491270 conn(0x7f1254067620 msgr2=0x7f12540ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.681+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 shutdown_connections 2023-09-30T22:52:37.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.681+0000 7f125b1ff700 1 -- 172.21.15.142:0/2158491270 wait complete. 2023-09-30T22:52:37.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.683+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb03006fc10 con 0x7fb030156310 2023-09-30T22:52:37.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.683+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb48806b120 con 0x7fb4880ccd60 2023-09-30T22:52:37.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.683+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa550005830 con 0x7fa56815dea0 2023-09-30T22:52:37.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.684+0000 7fb484ff9700 1 -- 172.21.15.142:0/4205734657 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4800571c0 con 0x7fb4880ccd60 2023-09-30T22:52:37.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.684+0000 7fb016ffd700 1 -- 172.21.15.142:0/2264395934 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb024022090 con 0x7fb030156310 2023-09-30T22:52:37.685 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.684+0000 7fa5667fc700 1 -- 172.21.15.142:0/1347179811 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa560054fb0 con 0x7fa56815dea0 2023-09-30T22:52:37.686 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.687 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-09-30T22:52:37.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.688+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb468067400 msgr2=0x7fb4680698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.688+0000 7fb48ebff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb468067400 0x7fb4680698b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4880c8ec0 tx=0x7fb4780090f0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.688+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4880ccd60 msgr2=0x7fb4881718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.688+0000 7fb48ebff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4880ccd60 0x7fb4881718b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb480014000 tx=0x7fb480017000 comp rx=0 tx=0).stop 2023-09-30T22:52:37.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 shutdown_connections 2023-09-30T22:52:37.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb468067400 0x7fb4680698b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb488160e60 0x7fb48815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4880ccd60 0x7fb4881718b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 --2- 172.21.15.142:0/4205734657 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb488154e10 0x7fb488160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 >> 172.21.15.142:0/4205734657 conn(0x7fb488067620 msgr2=0x7fb4880c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 shutdown_connections 2023-09-30T22:52:37.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa54c067480 msgr2=0x7fa54c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa54c067480 0x7fa54c069930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009f20 tx=0x7fa55c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:37.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 msgr2=0x7fa56806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa56806a940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa56000b520 tx=0x7fa5600090f0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 shutdown_connections 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa54c067480 0x7fa54c069930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa56815dea0 0x7fa56806a940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa568069f10 0x7fa56814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 --2- 172.21.15.142:0/1347179811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5680b24a0 0x7fa56806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 >> 172.21.15.142:0/1347179811 conn(0x7fa5680680c0 msgr2=0x7fa56806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.690+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 shutdown_connections 2023-09-30T22:52:37.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.690+0000 7fa5707ff700 1 -- 172.21.15.142:0/1347179811 wait complete. 2023-09-30T22:52:37.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.689+0000 7fb48ebff700 1 -- 172.21.15.142:0/4205734657 wait complete. 2023-09-30T22:52:37.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.690+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb01c067400 msgr2=0x7fb01c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.690+0000 7fb0357ff700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb01c067400 0x7fb01c0698b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0280018e0 tx=0x7fb028009040 comp rx=0 tx=0).stop 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.690+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb030156310 msgr2=0x7fb030156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.690+0000 7fb0357ff700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb030156310 0x7fb030156b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb024011910 tx=0x7fb024008040 comp rx=0 tx=0).stop 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.691+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 shutdown_connections 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.691+0000 7fb0357ff700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb01c067400 0x7fb01c0698b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.691+0000 7fb0357ff700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb030164120 0x7fb0300cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.691+0000 7fb0357ff700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0180051c0 0x7fb0300c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.691+0000 7fb0357ff700 1 --2- 172.21.15.142:0/2264395934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb030156310 0x7fb030156b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.691+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 >> 172.21.15.142:0/2264395934 conn(0x7fb0300680c0 msgr2=0x7fb03015c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.692+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 shutdown_connections 2023-09-30T22:52:37.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.692+0000 7fb0357ff700 1 -- 172.21.15.142:0/2264395934 wait complete. 2023-09-30T22:52:37.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-09-30T22:52:37.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-09-30T22:52:37.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-09-30T22:52:37.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-09-30T22:52:37.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-09-30T22:52:37.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.726+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fae54005860 con 0x7fae680aeff0 2023-09-30T22:52:37.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.727+0000 7fae64ff9700 1 -- 172.21.15.142:0/1361893083 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae58054980 con 0x7fae680aeff0 2023-09-30T22:52:37.727 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae500678b0 msgr2=0x7fae50069d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae500678b0 0x7fae50069d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0015a0 tx=0x7fae5c001090 comp rx=0 tx=0).stop 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae680aeff0 msgr2=0x7fae68162d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae680aeff0 0x7fae68162d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c5d0 tx=0x7fae58007f20 comp rx=0 tx=0).stop 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 shutdown_connections 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fae500678b0 0x7fae50069d60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae680ccaa0 0x7fae680c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae680aeff0 0x7fae68162d00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 --2- 172.21.15.142:0/1361893083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae680cc630 0x7fae680c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 >> 172.21.15.142:0/1361893083 conn(0x7fae68067620 msgr2=0x7fae68163c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 shutdown_connections 2023-09-30T22:52:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.729+0000 7fae6f1ff700 1 -- 172.21.15.142:0/1361893083 wait complete. 2023-09-30T22:52:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.736+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8b0806fc10 con 0x7f8b081594f0 2023-09-30T22:52:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.736+0000 7f8afe7fc700 1 -- 172.21.15.142:0/1486240788 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8af8015090 con 0x7f8b081594f0 2023-09-30T22:52:37.737 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2023-09-30T22:52:37.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8aec067480 msgr2=0x7f8aec069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8aec067480 0x7f8aec069930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009740 tx=0x7f8b04006c60 comp rx=0 tx=0).stop 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b081594f0 msgr2=0x7f8b0816dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b081594f0 0x7f8b0816dc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c880 tx=0x7f8af8008040 comp rx=0 tx=0).stop 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 shutdown_connections 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8aec067480 0x7f8aec069930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b0815acb0 0x7f8b0816e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b080cbaa0 0x7f8b0806a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 --2- 172.21.15.142:0/1486240788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b081594f0 0x7f8b0816dc70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 >> 172.21.15.142:0/1486240788 conn(0x7f8b080d14d0 msgr2=0x7f8b08157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:37.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 shutdown_connections 2023-09-30T22:52:37.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:37.739+0000 7f8b105ff700 1 -- 172.21.15.142:0/1486240788 wait complete. 2023-09-30T22:52:37.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-09-30T22:52:37.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-09-30T22:52:38.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-30T22:52:38.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:52:38.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:52:38.724 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:52:38.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:52:38.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-30T22:52:38.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-30T22:52:38.758 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-30T22:52:38.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.987+0000 7f76491ff700 1 Processor -- start 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.988+0000 7f76491ff700 1 -- start start 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.990+0000 7f76491ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76441558d0 0x7f76440b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.991+0000 7f76491ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 0x7f76440ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.991+0000 7f76491ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76440b22a0 0x7f7644159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.991+0000 7f76491ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440b0560 con 0x7f76440b22a0 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.991+0000 7f76491ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764406f3a0 con 0x7f76441558d0 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.991+0000 7f76491ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76440b0230 con 0x7f7644155ca0 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76440b22a0 0x7f7644159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76440b22a0 0x7f7644159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57430/0 (socket says 172.21.15.142:57430) 2023-09-30T22:52:38.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 -- 172.21.15.142:0/1926762052 learned_addr learned my addr 172.21.15.142:0/1926762052 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 -- 172.21.15.142:0/1926762052 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 msgr2=0x7f76440ae7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 --2- 172.21.15.142:0/1926762052 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 0x7f76440ae7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 -- 172.21.15.142:0/1926762052 >> v2:172.21.15.148:3300/0 conn(0x7f76441558d0 msgr2=0x7f76440b09f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 --2- 172.21.15.142:0/1926762052 >> v2:172.21.15.148:3300/0 conn(0x7f76441558d0 0x7f76440b09f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.992+0000 7f764359e700 1 -- 172.21.15.142:0/1926762052 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764406ede0 con 0x7f76440b22a0 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.993+0000 7f764359e700 1 --2- 172.21.15.142:0/1926762052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f7644159750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7644063df0 tx=0x7f7638009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c54cb8674a9fd46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.994+0000 7f7641d9b700 1 -- 172.21.15.142:0/1926762052 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800b860 con 0x7f76440b22a0 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.994+0000 7f7641d9b700 1 -- 172.21.15.142:0/1926762052 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763800b9c0 con 0x7f76440b22a0 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.994+0000 7f7641d9b700 1 -- 172.21.15.142:0/1926762052 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800bd80 con 0x7f76440b22a0 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.995+0000 7f76491ff700 1 -- 172.21.15.142:0/1926762052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 msgr2=0x7f7644159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:38.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.995+0000 7f76491ff700 1 --2- 172.21.15.142:0/1926762052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f7644159750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7644063df0 tx=0x7f7638009250 comp rx=0 tx=0).stop 2023-09-30T22:52:39.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.996+0000 7f76491ff700 1 -- 172.21.15.142:0/1926762052 shutdown_connections 2023-09-30T22:52:39.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.996+0000 7f76491ff700 1 --2- 172.21.15.142:0/1926762052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f7644159750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.996+0000 7f76491ff700 1 --2- 172.21.15.142:0/1926762052 >> v2:172.21.15.148:3300/0 conn(0x7f76441558d0 0x7f76440b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.996+0000 7f76491ff700 1 --2- 172.21.15.142:0/1926762052 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 0x7f76440ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.996+0000 7f76491ff700 1 -- 172.21.15.142:0/1926762052 >> 172.21.15.142:0/1926762052 conn(0x7f76440680c0 msgr2=0x7f76440c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.997+0000 7f76491ff700 1 -- 172.21.15.142:0/1926762052 shutdown_connections 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.997+0000 7f76491ff700 1 -- 172.21.15.142:0/1926762052 wait complete. 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.999+0000 7f76491ff700 1 Processor -- start 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:38.999+0000 7f76491ff700 1 -- start start 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.002+0000 7f76491ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f764414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.002+0000 7f76491ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76441558d0 0x7f76440c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.002+0000 7f76491ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 0x7f76440c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.003+0000 7f76491ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76440c5370 con 0x7f76440b22a0 2023-09-30T22:52:39.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.003+0000 7f76491ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76440c2030 con 0x7f76441558d0 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.003+0000 7f76491ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764414dc20 con 0x7f7644155ca0 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f764414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f764414e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57440/0 (socket says 172.21.15.142:57440) 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 -- 172.21.15.142:0/3400352939 learned_addr learned my addr 172.21.15.142:0/3400352939 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 -- 172.21.15.142:0/3400352939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 msgr2=0x7f76440c3e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 0x7f76440c3e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 -- 172.21.15.142:0/3400352939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76441558d0 msgr2=0x7f76440c5e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76441558d0 0x7f76440c5e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.004+0000 7f7642d9d700 1 -- 172.21.15.142:0/3400352939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380094f0 con 0x7f76440b22a0 2023-09-30T22:52:39.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.006+0000 7f7642d9d700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f764414e080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f763400b5e0 tx=0x7f76340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.007+0000 7f7632ffd700 1 -- 172.21.15.142:0/3400352939 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400f510 con 0x7f76440b22a0 2023-09-30T22:52:39.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.007+0000 7f7632ffd700 1 -- 172.21.15.142:0/3400352939 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763400f690 con 0x7f76440b22a0 2023-09-30T22:52:39.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.007+0000 7f7632ffd700 1 -- 172.21.15.142:0/3400352939 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400fa50 con 0x7f76440b22a0 2023-09-30T22:52:39.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.007+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76440c2b50 con 0x7f76440b22a0 2023-09-30T22:52:39.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.007+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76440c27e0 con 0x7f76440b22a0 2023-09-30T22:52:39.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.011+0000 7f7632ffd700 1 -- 172.21.15.142:0/3400352939 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f763401a400 con 0x7f76440b22a0 2023-09-30T22:52:39.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.013+0000 7f7632ffd700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7628067450 0x7f7628069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.013+0000 7f7632ffd700 1 -- 172.21.15.142:0/3400352939 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f76340846f0 con 0x7f76440b22a0 2023-09-30T22:52:39.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.014+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76440695b0 con 0x7f76440b22a0 2023-09-30T22:52:39.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.018+0000 7f764259c700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7628067450 0x7f7628069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.019+0000 7f764259c700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7628067450 0x7f7628069900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7644087130 tx=0x7f763c009370 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.025+0000 7f7632ffd700 1 -- 172.21.15.142:0/3400352939 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7634051650 con 0x7f76440b22a0 2023-09-30T22:52:39.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.069+0000 7f0d953ff700 1 Processor -- start 2023-09-30T22:52:39.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.070+0000 7f0d953ff700 1 -- start start 2023-09-30T22:52:39.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f0d953ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d901551e0 0x7f0d900cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f0d953ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900adcc0 con 0x7f0d90154e10 2023-09-30T22:52:39.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f0d953ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900ae840 con 0x7f0d9006e670 2023-09-30T22:52:39.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f0d953ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d90162b70 con 0x7f0d901551e0 2023-09-30T22:52:39.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f0d8e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d901551e0 0x7f0d900cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f0d8e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d901551e0 0x7f0d900cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46978/0 (socket says 172.21.15.142:46978) 2023-09-30T22:52:39.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f0d8e7fc700 1 -- 172.21.15.142:0/2482485155 learned_addr learned my addr 172.21.15.142:0/2482485155 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.069+0000 7f926ffff700 1 Processor -- start 2023-09-30T22:52:39.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f0d8e7fc700 1 -- 172.21.15.142:0/2482485155 >> v1:172.21.15.148:6789/0 conn(0x7f0d9006e670 legacy=0x7f0d9015e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f0d8e7fc700 1 -- 172.21.15.142:0/2482485155 >> v1:172.21.15.142:6789/0 conn(0x7f0d90154e10 legacy=0x7f0d900b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f0d8e7fc700 1 -- 172.21.15.142:0/2482485155 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9006b590 con 0x7f0d901551e0 2023-09-30T22:52:39.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f0d8e7fc700 1 --2- 172.21.15.142:0/2482485155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d901551e0 0x7f0d900cc650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d800099b0 tx=0x7f0d80009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16f5bcb9629bd353 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.070+0000 7f926ffff700 1 -- start start 2023-09-30T22:52:39.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f926ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9268155970 0x7f92680ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f926ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268155d40 0x7f92680aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f926ffff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926806dd70 con 0x7f9268156360 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f926ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9268156ef0 con 0x7f9268155970 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.072+0000 7f926ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926806b4a0 con 0x7f9268155d40 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f926e59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9268156360 0x7f92681567e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48318/0 (socket says 172.21.15.142:48318) 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f926e59c700 1 -- 172.21.15.142:0/1505737665 learned_addr learned my addr 172.21.15.142:0/1505737665 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926dd9b700 1 --2- 172.21.15.142:0/1505737665 >> v2:172.21.15.148:3300/0 conn(0x7f9268155970 0x7f92680ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926d59a700 1 --2- 172.21.15.142:0/1505737665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268155d40 0x7f92680aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926cd99700 1 -- 172.21.15.142:0/1505737665 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307765831 0 0) 0x7f926806dd70 con 0x7f9268156360 2023-09-30T22:52:39.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926cd99700 1 -- 172.21.15.142:0/1505737665 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9254003570 con 0x7f9268156360 2023-09-30T22:52:39.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926d59a700 1 -- 172.21.15.142:0/1505737665 >> v2:172.21.15.148:3300/0 conn(0x7f9268155970 msgr2=0x7f92680ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926d59a700 1 --2- 172.21.15.142:0/1505737665 >> v2:172.21.15.148:3300/0 conn(0x7f9268155970 0x7f92680ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926d59a700 1 -- 172.21.15.142:0/1505737665 >> v1:172.21.15.148:6789/0 conn(0x7f9268156360 legacy=0x7f92681567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f926d59a700 1 -- 172.21.15.142:0/1505737665 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926806d480 con 0x7f9268155d40 2023-09-30T22:52:39.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f0d8dffb700 1 -- 172.21.15.142:0/2482485155 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000b820 con 0x7f0d901551e0 2023-09-30T22:52:39.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f0d8dffb700 1 -- 172.21.15.142:0/2482485155 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8000b980 con 0x7f0d901551e0 2023-09-30T22:52:39.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f0d8dffb700 1 -- 172.21.15.142:0/2482485155 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000bd00 con 0x7f0d901551e0 2023-09-30T22:52:39.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.076+0000 7f0d953ff700 1 -- 172.21.15.142:0/2482485155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d901551e0 msgr2=0x7f0d900cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.076+0000 7f0d953ff700 1 --2- 172.21.15.142:0/2482485155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d901551e0 0x7f0d900cc650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d800099b0 tx=0x7f0d80009250 comp rx=0 tx=0).stop 2023-09-30T22:52:39.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f926d59a700 1 --2- 172.21.15.142:0/1505737665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268155d40 0x7f92680aee30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f92640098e0 tx=0x7f92640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdcc4a0206efce2a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.076+0000 7f926cd99700 1 -- 172.21.15.142:0/1505737665 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264033640 con 0x7f9268155d40 2023-09-30T22:52:39.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.076+0000 7f926cd99700 1 -- 172.21.15.142:0/1505737665 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92640337a0 con 0x7f9268155d40 2023-09-30T22:52:39.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.076+0000 7f926cd99700 1 -- 172.21.15.142:0/1505737665 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264033b40 con 0x7f9268155d40 2023-09-30T22:52:39.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f926ffff700 1 -- 172.21.15.142:0/1505737665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268155d40 msgr2=0x7f92680aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f926ffff700 1 --2- 172.21.15.142:0/1505737665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268155d40 0x7f92680aee30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f92640098e0 tx=0x7f92640091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f926ffff700 1 -- 172.21.15.142:0/1505737665 shutdown_connections 2023-09-30T22:52:39.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f926ffff700 1 --2- 172.21.15.142:0/1505737665 >> v2:172.21.15.148:3300/0 conn(0x7f9268155970 0x7f92680ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f926ffff700 1 --2- 172.21.15.142:0/1505737665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268155d40 0x7f92680aee30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f926ffff700 1 -- 172.21.15.142:0/1505737665 >> 172.21.15.142:0/1505737665 conn(0x7f9268067620 msgr2=0x7f9268067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.070+0000 7f961f1ff700 1 Processor -- start 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.071+0000 7f961f1ff700 1 -- start start 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f961f1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96180aeba0 0x7f96180b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f961f1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96180aef70 0x7f96180b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f961f1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96180b0300 con 0x7f96180cc630 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f961f1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180af6f0 con 0x7f96180aeba0 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.073+0000 7f961f1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180af9d0 con 0x7f96180aef70 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.074+0000 7f961cf9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96180aeba0 0x7f96180b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f9617fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96180aef70 0x7f96180b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f9617fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96180aef70 0x7f96180b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46994/0 (socket says 172.21.15.142:46994) 2023-09-30T22:52:39.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.075+0000 7f9617fff700 1 -- 172.21.15.142:0/750687394 learned_addr learned my addr 172.21.15.142:0/750687394 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f0d953ff700 1 -- 172.21.15.142:0/2482485155 shutdown_connections 2023-09-30T22:52:39.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f0d953ff700 1 --2- 172.21.15.142:0/2482485155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d901551e0 0x7f0d900cc650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.077+0000 7f0d953ff700 1 -- 172.21.15.142:0/2482485155 >> 172.21.15.142:0/2482485155 conn(0x7f0d90067620 msgr2=0x7f0d90067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.078+0000 7f926ffff700 1 -- 172.21.15.142:0/1505737665 shutdown_connections 2023-09-30T22:52:39.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.078+0000 7f961cf9b700 1 -- 172.21.15.142:0/750687394 >> v2:172.21.15.148:3300/0 conn(0x7f96180aef70 msgr2=0x7f96180b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.078+0000 7f961cf9b700 1 --2- 172.21.15.142:0/750687394 >> v2:172.21.15.148:3300/0 conn(0x7f96180aef70 0x7f96180b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.078+0000 7f961cf9b700 1 -- 172.21.15.142:0/750687394 >> v1:172.21.15.148:6789/0 conn(0x7f96180cc630 legacy=0x7f961816a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.078+0000 7f961cf9b700 1 -- 172.21.15.142:0/750687394 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180afcb0 con 0x7f96180aeba0 2023-09-30T22:52:39.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.079+0000 7f961cf9b700 1 --2- 172.21.15.142:0/750687394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180b1e70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f961806f540 tx=0x7f960800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274ab63e16db1386 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.078+0000 7f926ffff700 1 -- 172.21.15.142:0/1505737665 wait complete. 2023-09-30T22:52:39.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.080+0000 7f0d953ff700 1 -- 172.21.15.142:0/2482485155 shutdown_connections 2023-09-30T22:52:39.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.080+0000 7f0d953ff700 1 -- 172.21.15.142:0/2482485155 wait complete. 2023-09-30T22:52:39.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f0d953ff700 1 Processor -- start 2023-09-30T22:52:39.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.080+0000 7f926ffff700 1 Processor -- start 2023-09-30T22:52:39.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f0d953ff700 1 -- start start 2023-09-30T22:52:39.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.080+0000 7f926ffff700 1 -- start start 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f926ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9268155970 0x7f92681662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f926ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268155d40 0x7f9268153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f926ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268156360 0x7f92680a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f926ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680aeab0 con 0x7f9268155970 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f926ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680c6a80 con 0x7f9268155d40 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f926ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680c4980 con 0x7f9268156360 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268156360 0x7f92680a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268156360 0x7f92680a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42780/0 (socket says 172.21.15.142:42780) 2023-09-30T22:52:39.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 -- 172.21.15.142:0/460172999 learned_addr learned my addr 172.21.15.142:0/460172999 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f96177fe700 1 -- 172.21.15.142:0/750687394 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800db40 con 0x7f96180aeba0 2023-09-30T22:52:39.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f96177fe700 1 -- 172.21.15.142:0/750687394 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800dca0 con 0x7f96180aeba0 2023-09-30T22:52:39.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.082+0000 7f96177fe700 1 -- 172.21.15.142:0/750687394 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608017620 con 0x7f96180aeba0 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f961f1ff700 1 -- 172.21.15.142:0/750687394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 msgr2=0x7f96180b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f961f1ff700 1 --2- 172.21.15.142:0/750687394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180b1e70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f961806f540 tx=0x7f960800b430 comp rx=0 tx=0).stop 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f961f1ff700 1 -- 172.21.15.142:0/750687394 shutdown_connections 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f961f1ff700 1 --2- 172.21.15.142:0/750687394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180b1e70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f961f1ff700 1 --2- 172.21.15.142:0/750687394 >> v2:172.21.15.148:3300/0 conn(0x7f96180aef70 0x7f96180b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f961f1ff700 1 -- 172.21.15.142:0/750687394 >> 172.21.15.142:0/750687394 conn(0x7f9618067620 msgr2=0x7f9618067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f0d953ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9006e670 0x7f0d90140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f0d953ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d90154e10 0x7f0d901406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f0d953ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d90140be0 0x7f0d90141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f0d953ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90159900 con 0x7f0d9006e670 2023-09-30T22:52:39.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f0d953ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90159be0 con 0x7f0d90140be0 2023-09-30T22:52:39.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f0d953ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90159ec0 con 0x7f0d90154e10 2023-09-30T22:52:39.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f961f1ff700 1 -- 172.21.15.142:0/750687394 shutdown_connections 2023-09-30T22:52:39.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.085+0000 7f0d8e7fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d90154e10 0x7f0d901406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.085+0000 7f0d8f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d90140be0 0x7f0d90141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.085+0000 7f0d8f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d90140be0 0x7f0d90141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:47004/0 (socket says 172.21.15.142:47004) 2023-09-30T22:52:39.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.085+0000 7f0d8f7fe700 1 -- 172.21.15.142:0/260588634 learned_addr learned my addr 172.21.15.142:0/260588634 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 -- 172.21.15.142:0/460172999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268155d40 msgr2=0x7f9268153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268155d40 0x7f9268153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 -- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9268155970 msgr2=0x7f92681662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9268155970 0x7f92681662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.083+0000 7f926e59c700 1 -- 172.21.15.142:0/460172999 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264009420 con 0x7f9268156360 2023-09-30T22:52:39.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f926e59c700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268156360 0x7f92680a5ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f925800c560 tx=0x7f9258007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f0d8f7fe700 1 -- 172.21.15.142:0/260588634 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d90154e10 msgr2=0x7f0d901406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f0d8f7fe700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d90154e10 0x7f0d901406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f0d8f7fe700 1 -- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9006e670 msgr2=0x7f0d90140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f0d8f7fe700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9006e670 0x7f0d90140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f0d8f7fe700 1 -- 172.21.15.142:0/260588634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800094f0 con 0x7f0d90140be0 2023-09-30T22:52:39.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.085+0000 7f925dffb700 1 -- 172.21.15.142:0/460172999 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258005c00 con 0x7f9268156360 2023-09-30T22:52:39.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f925dffb700 1 -- 172.21.15.142:0/460172999 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9258005d60 con 0x7f9268156360 2023-09-30T22:52:39.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f925dffb700 1 -- 172.21.15.142:0/460172999 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258007320 con 0x7f9268156360 2023-09-30T22:52:39.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92680c4650 con 0x7f9268156360 2023-09-30T22:52:39.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.086+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92680aefa0 con 0x7f9268156360 2023-09-30T22:52:39.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.084+0000 7f961f1ff700 1 -- 172.21.15.142:0/750687394 wait complete. 2023-09-30T22:52:39.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.087+0000 7f961f1ff700 1 Processor -- start 2023-09-30T22:52:39.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.087+0000 7f0d8f7fe700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d90140be0 0x7f0d90141440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800c910 tx=0x7f0d880016d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.087+0000 7f0e583ff700 1 Processor -- start 2023-09-30T22:52:39.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.087+0000 7f0e583ff700 1 -- start start 2023-09-30T22:52:39.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.088+0000 7f0d76ffd700 1 -- 172.21.15.142:0/260588634 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88012630 con 0x7f0d90140be0 2023-09-30T22:52:39.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.088+0000 7f0d76ffd700 1 -- 172.21.15.142:0/260588634 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d880127b0 con 0x7f0d90140be0 2023-09-30T22:52:39.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.088+0000 7f0d76ffd700 1 -- 172.21.15.142:0/260588634 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88012b70 con 0x7f0d90140be0 2023-09-30T22:52:39.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.088+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9015a1a0 con 0x7f0d90140be0 2023-09-30T22:52:39.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.087+0000 7f961f1ff700 1 -- start start 2023-09-30T22:52:39.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.088+0000 7f271659d700 1 Processor -- start 2023-09-30T22:52:39.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.088+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92480052b0 con 0x7f9268156360 2023-09-30T22:52:39.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.088+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9015a9a0 con 0x7f0d90140be0 2023-09-30T22:52:39.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f271659d700 1 -- start start 2023-09-30T22:52:39.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f925dffb700 1 -- 172.21.15.142:0/460172999 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f925801b3b0 con 0x7f9268156360 2023-09-30T22:52:39.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f0e583ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e500b01e0 0x7f0e501668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f0e583ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0e500b1e70 0x7f0e500b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f0e583ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e500cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f0e583ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e50166de0 con 0x7f0e500b01e0 2023-09-30T22:52:39.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f0e583ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5006e090 con 0x7f0e500b1e70 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.089+0000 7f0e583ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500ccfb0 con 0x7f0e500cc630 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e500cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e500cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42798/0 (socket says 172.21.15.142:42798) 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 -- 172.21.15.142:0/3290914023 learned_addr learned my addr 172.21.15.142:0/3290914023 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5599a700 1 --2- 172.21.15.142:0/3290914023 >> v2:172.21.15.148:3300/0 conn(0x7f0e500b1e70 0x7f0e500b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 -- 172.21.15.142:0/3290914023 >> v2:172.21.15.148:3300/0 conn(0x7f0e500b1e70 msgr2=0x7f0e500b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 --2- 172.21.15.142:0/3290914023 >> v2:172.21.15.148:3300/0 conn(0x7f0e500b1e70 0x7f0e500b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 -- 172.21.15.142:0/3290914023 >> v2:172.21.15.142:3300/0 conn(0x7f0e500b01e0 msgr2=0x7f0e501668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 --2- 172.21.15.142:0/3290914023 >> v2:172.21.15.142:3300/0 conn(0x7f0e500b01e0 0x7f0e501668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5699c700 1 -- 172.21.15.142:0/3290914023 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5016d790 con 0x7f0e500cc630 2023-09-30T22:52:39.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.090+0000 7f0e5599a700 1 --2- 172.21.15.142:0/3290914023 >> v2:172.21.15.148:3300/0 conn(0x7f0e500b1e70 0x7f0e500b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:39.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f961f1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180868b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f961f1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96180aef70 0x7f96180ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f961f1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96180cc630 0x7f96180cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f961f1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c8f10 con 0x7f96180aeba0 2023-09-30T22:52:39.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f961f1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c85e0 con 0x7f96180cc630 2023-09-30T22:52:39.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f0e5699c700 1 --2- 172.21.15.142:0/3290914023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e500cca70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006b990 tx=0x7f0e48009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529087bad33d4858 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f961f1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c88c0 con 0x7f96180aef70 2023-09-30T22:52:39.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f925dffb700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f924c067400 0x7f924c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f925dffb700 1 -- 172.21.15.142:0/460172999 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9258083ec0 con 0x7f9268156360 2023-09-30T22:52:39.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.091+0000 7f926dd9b700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f924c067400 0x7f924c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.092+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d700052b0 con 0x7f0d90140be0 2023-09-30T22:52:39.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f926dd9b700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f924c067400 0x7f924c0698b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9268068500 tx=0x7f926000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.092+0000 7f9617fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96180aef70 0x7f96180ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.092+0000 7f9617fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96180aef70 0x7f96180ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42814/0 (socket says 172.21.15.142:42814) 2023-09-30T22:52:39.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.092+0000 7f9617fff700 1 -- 172.21.15.142:0/3723410761 learned_addr learned my addr 172.21.15.142:0/3723410761 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.092+0000 7f961cf9b700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f961cf9b700 1 -- 172.21.15.142:0/3723410761 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96180aef70 msgr2=0x7f96180ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f961cf9b700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96180aef70 0x7f96180ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f961cf9b700 1 -- 172.21.15.142:0/3723410761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96180cc630 msgr2=0x7f96180cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f961cf9b700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96180cc630 0x7f96180cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f961cf9b700 1 -- 172.21.15.142:0/3723410761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960800b6d0 con 0x7f96180aeba0 2023-09-30T22:52:39.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f961cf9b700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180868b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9608017000 tx=0x7f9608018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f271659d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27100ae3d0 0x7f2710162730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f271659d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271015f260 con 0x7f271006b130 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f271659d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271015e930 con 0x7f271015e230 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f271659d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271015f6f0 con 0x7f27100ae3d0 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f271559b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f271015e230 0x7f27100adcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48348/0 (socket says 172.21.15.142:48348) 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.093+0000 7f271559b700 1 -- 172.21.15.142:0/3072244163 learned_addr learned my addr 172.21.15.142:0/3072244163 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f2714d9a700 1 --2- 172.21.15.142:0/3072244163 >> v2:172.21.15.142:3300/0 conn(0x7f27100ae3d0 0x7f2710162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f2707fff700 1 -- 172.21.15.142:0/3072244163 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009532410 0 0) 0x7f271015f260 con 0x7f271006b130 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f2707fff700 1 -- 172.21.15.142:0/3072244163 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26fc003570 con 0x7f271006b130 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f2714d9a700 1 -- 172.21.15.142:0/3072244163 >> v1:172.21.15.148:6789/0 conn(0x7f271015e230 legacy=0x7f27100adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f2714d9a700 1 -- 172.21.15.142:0/3072244163 >> v1:172.21.15.142:6789/0 conn(0x7f271006b130 legacy=0x7f27100b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.095+0000 7f2714d9a700 1 -- 172.21.15.142:0/3072244163 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271015ec10 con 0x7f27100ae3d0 2023-09-30T22:52:39.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.095+0000 7f2714d9a700 1 --2- 172.21.15.142:0/3072244163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 0x7f2710162730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2708009e60 tx=0x7f2708009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41381f49123caf99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f0d76ffd700 1 -- 172.21.15.142:0/260588634 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0d88003030 con 0x7f0d90140be0 2023-09-30T22:52:39.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.095+0000 7f0d76ffd700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d7c067480 0x7f0d7c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f0d76ffd700 1 -- 172.21.15.142:0/260588634 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0d88084b00 con 0x7f0d90140be0 2023-09-30T22:52:39.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f9614ff9700 1 -- 172.21.15.142:0/3723410761 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608009040 con 0x7f96180aeba0 2023-09-30T22:52:39.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f9614ff9700 1 -- 172.21.15.142:0/3723410761 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608017db0 con 0x7f96180aeba0 2023-09-30T22:52:39.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f9614ff9700 1 -- 172.21.15.142:0/3723410761 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960801f6a0 con 0x7f96180aeba0 2023-09-30T22:52:39.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.094+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96180c8ba0 con 0x7f96180aeba0 2023-09-30T22:52:39.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.095+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9618086df0 con 0x7f96180aeba0 2023-09-30T22:52:39.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f2707fff700 1 -- 172.21.15.142:0/3072244163 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800e070 con 0x7f27100ae3d0 2023-09-30T22:52:39.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f2707fff700 1 -- 172.21.15.142:0/3072244163 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800bb60 con 0x7f27100ae3d0 2023-09-30T22:52:39.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f2707fff700 1 -- 172.21.15.142:0/3072244163 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708012430 con 0x7f27100ae3d0 2023-09-30T22:52:39.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f0e55199700 1 -- 172.21.15.142:0/3290914023 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800e070 con 0x7f0e500cc630 2023-09-30T22:52:39.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f0e55199700 1 -- 172.21.15.142:0/3290914023 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800bad0 con 0x7f0e500cc630 2023-09-30T22:52:39.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f0e55199700 1 -- 172.21.15.142:0/3290914023 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480092e0 con 0x7f0e500cc630 2023-09-30T22:52:39.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f925dffb700 1 -- 172.21.15.142:0/460172999 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f925804b570 con 0x7f9268156360 2023-09-30T22:52:39.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f0d8effd700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d7c067480 0x7f0d7c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.096+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96180695b0 con 0x7f96180aeba0 2023-09-30T22:52:39.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f271659d700 1 -- 172.21.15.142:0/3072244163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 msgr2=0x7f2710162730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f271659d700 1 --2- 172.21.15.142:0/3072244163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 0x7f2710162730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2708009e60 tx=0x7f2708009780 comp rx=0 tx=0).stop 2023-09-30T22:52:39.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0e583ff700 1 -- 172.21.15.142:0/3290914023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 msgr2=0x7f0e500cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0e583ff700 1 --2- 172.21.15.142:0/3290914023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e500cca70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006b990 tx=0x7f0e48009840 comp rx=0 tx=0).stop 2023-09-30T22:52:39.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f271659d700 1 -- 172.21.15.142:0/3072244163 shutdown_connections 2023-09-30T22:52:39.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f271659d700 1 --2- 172.21.15.142:0/3072244163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 0x7f2710162730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f271659d700 1 -- 172.21.15.142:0/3072244163 >> 172.21.15.142:0/3072244163 conn(0x7f27100cc4d0 msgr2=0x7f27100cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0d8effd700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d7c067480 0x7f0d7c069930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097c0 tx=0x7f0d84006ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f271659d700 1 -- 172.21.15.142:0/3072244163 shutdown_connections 2023-09-30T22:52:39.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0e583ff700 1 -- 172.21.15.142:0/3290914023 shutdown_connections 2023-09-30T22:52:39.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0e583ff700 1 --2- 172.21.15.142:0/3290914023 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e500cca70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0e583ff700 1 --2- 172.21.15.142:0/3290914023 >> v2:172.21.15.142:3300/0 conn(0x7f0e500b01e0 0x7f0e501668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0e583ff700 1 --2- 172.21.15.142:0/3290914023 >> v2:172.21.15.148:3300/0 conn(0x7f0e500b1e70 0x7f0e500b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.097+0000 7f0e583ff700 1 -- 172.21.15.142:0/3290914023 >> 172.21.15.142:0/3290914023 conn(0x7f0e50067620 msgr2=0x7f0e50067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.098+0000 7f0e583ff700 1 -- 172.21.15.142:0/3290914023 shutdown_connections 2023-09-30T22:52:39.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.098+0000 7f0e583ff700 1 -- 172.21.15.142:0/3290914023 wait complete. 2023-09-30T22:52:39.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f0d76ffd700 1 -- 172.21.15.142:0/260588634 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0d880519e0 con 0x7f0d90140be0 2023-09-30T22:52:39.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.098+0000 7f271659d700 1 -- 172.21.15.142:0/3072244163 wait complete. 2023-09-30T22:52:39.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.100+0000 7f271659d700 1 Processor -- start 2023-09-30T22:52:39.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.100+0000 7f0e583ff700 1 Processor -- start 2023-09-30T22:52:39.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.100+0000 7f0e583ff700 1 -- start start 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f0e583ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e500b01e0 0x7f0e50177fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f0e583ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e500b1e70 0x7f0e50086850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f0e583ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e50086d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f0e583ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50188020 con 0x7f0e500b1e70 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f0e583ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50178520 con 0x7f0e500b01e0 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f0e583ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50167f90 con 0x7f0e500cc630 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.101+0000 7f271659d700 1 -- start start 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f271659d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006b130 0x7f271015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f271659d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 0x7f271016e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f271659d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271015e230 0x7f2710161d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f271659d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27100c29d0 con 0x7f27100ae3d0 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f271659d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271015d8a0 con 0x7f271006b130 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.102+0000 7f271659d700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271016f070 con 0x7f271015e230 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f271559b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006b130 0x7f271015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f271559b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006b130 0x7f271015d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:47056/0 (socket says 172.21.15.142:47056) 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f271559b700 1 -- 172.21.15.142:0/813057108 learned_addr learned my addr 172.21.15.142:0/813057108 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f2715d9c700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271015e230 0x7f2710161d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f0e5619b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e500b01e0 0x7f0e50177fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f0e5619b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e500b01e0 0x7f0e50177fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:47042/0 (socket says 172.21.15.142:47042) 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f0e5619b700 1 -- 172.21.15.142:0/291921617 learned_addr learned my addr 172.21.15.142:0/291921617 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.103+0000 7f0e5699c700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e50086d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.104+0000 7f0e5599a700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e500b1e70 0x7f0e50086850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.104+0000 7f2714d9a700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 0x7f271016e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.104+0000 7f271559b700 1 -- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271015e230 msgr2=0x7f2710161d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.104+0000 7f271559b700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271015e230 0x7f2710161d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.104+0000 7f271559b700 1 -- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 msgr2=0x7f271016e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.104+0000 7f271559b700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 0x7f271016e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.104+0000 7f271559b700 1 -- 172.21.15.142:0/813057108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009a20 con 0x7f271006b130 2023-09-30T22:52:39.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.105+0000 7f0e5619b700 1 -- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 msgr2=0x7f0e50086d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.105+0000 7f0e5619b700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e50086d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.105+0000 7f0e5619b700 1 -- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e500b1e70 msgr2=0x7f0e50086850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.105+0000 7f0e5619b700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e500b1e70 0x7f0e50086850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.105+0000 7f0e5619b700 1 -- 172.21.15.142:0/291921617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48009ae0 con 0x7f0e500b01e0 2023-09-30T22:52:39.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.105+0000 7f271559b700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006b130 0x7f271015d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f270000c7c0 tx=0x7f2700007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f0e5619b700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e500b01e0 0x7f0e50177fe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b810 tx=0x7f0e40009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f27057fa700 1 -- 172.21.15.142:0/813057108 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700005b30 con 0x7f271006b130 2023-09-30T22:52:39.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271016f350 con 0x7f271006b130 2023-09-30T22:52:39.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27101720a0 con 0x7f271006b130 2023-09-30T22:52:39.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f0e467fc700 1 -- 172.21.15.142:0/291921617 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000f510 con 0x7f0e500b01e0 2023-09-30T22:52:39.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f0e467fc700 1 -- 172.21.15.142:0/291921617 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000f690 con 0x7f0e500b01e0 2023-09-30T22:52:39.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f0e467fc700 1 -- 172.21.15.142:0/291921617 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000fa50 con 0x7f0e500b01e0 2023-09-30T22:52:39.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50178760 con 0x7f0e500b01e0 2023-09-30T22:52:39.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e50168230 con 0x7f0e500b01e0 2023-09-30T22:52:39.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f27057fa700 1 -- 172.21.15.142:0/813057108 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2700005c90 con 0x7f271006b130 2023-09-30T22:52:39.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.106+0000 7f27057fa700 1 -- 172.21.15.142:0/813057108 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700004a80 con 0x7f271006b130 2023-09-30T22:52:39.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.110+0000 7f27057fa700 1 -- 172.21.15.142:0/813057108 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f27000070d0 con 0x7f271006b130 2023-09-30T22:52:39.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.110+0000 7f9614ff9700 1 -- 172.21.15.142:0/3723410761 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f960801fa10 con 0x7f96180aeba0 2023-09-30T22:52:39.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.111+0000 7f27057fa700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26f4067330 0x7f26f40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.112+0000 7f27057fa700 1 -- 172.21.15.142:0/813057108 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2700055200 con 0x7f271006b130 2023-09-30T22:52:39.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.112+0000 7f2714d9a700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26f4067330 0x7f26f40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.112+0000 7f9614ff9700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9604067400 0x7f96040698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.113+0000 7f9614ff9700 1 -- 172.21.15.142:0/3723410761 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9608085fb0 con 0x7f96180aeba0 2023-09-30T22:52:39.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.113+0000 7f9614ff9700 1 -- 172.21.15.142:0/3723410761 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9608086400 con 0x7f96180aeba0 2023-09-30T22:52:39.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.113+0000 7f2714d9a700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26f4067330 0x7f26f40697e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae7d0 tx=0x7f2708019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.114+0000 7f9617fff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9604067400 0x7f96040698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.115+0000 7f9617fff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9604067400 0x7f96040698b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f960c006d40 tx=0x7f960c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.115+0000 7f0e467fc700 1 -- 172.21.15.142:0/291921617 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0e4001a400 con 0x7f0e500b01e0 2023-09-30T22:52:39.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.116+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f00052b0 con 0x7f271006b130 2023-09-30T22:52:39.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.115+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e380052b0 con 0x7f0e500b01e0 2023-09-30T22:52:39.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.116+0000 7f0e467fc700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e34067400 0x7f0e340698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.116+0000 7f0e467fc700 1 -- 172.21.15.142:0/291921617 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e40084780 con 0x7f0e500b01e0 2023-09-30T22:52:39.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.117+0000 7f0e5599a700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e34067400 0x7f0e340698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.118+0000 7f0e5599a700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e34067400 0x7f0e340698b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c006fd0 tx=0x7f0e4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.120+0000 7f0e467fc700 1 -- 172.21.15.142:0/291921617 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0e400516e0 con 0x7f0e500b01e0 2023-09-30T22:52:39.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.127+0000 7f27057fa700 1 -- 172.21.15.142:0/813057108 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f270004b570 con 0x7f271006b130 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.163+0000 7f8b17dff700 1 Processor -- start 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.163+0000 7f8b17dff700 1 -- start start 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.165+0000 7f8b17dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b101551e0 0x7f8b100cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.165+0000 7f8b17dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8b1006e670 0x7f8b100ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.165+0000 7f8b17dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100adcc0 con 0x7f8b10154e10 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.165+0000 7f8b17dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100ae840 con 0x7f8b1006e670 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.165+0000 7f8b17dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1006b590 con 0x7f8b101551e0 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.167+0000 7f8b15b9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8b10154e10 0x7f8b100b1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48354/0 (socket says 172.21.15.142:48354) 2023-09-30T22:52:39.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.167+0000 7f8b15b9b700 1 -- 172.21.15.142:0/2985254653 learned_addr learned my addr 172.21.15.142:0/2985254653 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:39.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.167+0000 7f8b1539a700 1 --2- 172.21.15.142:0/2985254653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b101551e0 0x7f8b100cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.168+0000 7f8b1639c700 1 --2- 172.21.15.142:0/2985254653 >> v2:172.21.15.148:3300/0 conn(0x7f8b1006e670 0x7f8b100ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.169+0000 7f8b1539a700 1 -- 172.21.15.142:0/2985254653 >> v2:172.21.15.148:3300/0 conn(0x7f8b1006e670 msgr2=0x7f8b100ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.169+0000 7f8b1539a700 1 --2- 172.21.15.142:0/2985254653 >> v2:172.21.15.148:3300/0 conn(0x7f8b1006e670 0x7f8b100ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.169+0000 7f8b1539a700 1 -- 172.21.15.142:0/2985254653 >> v1:172.21.15.148:6789/0 conn(0x7f8b10154e10 legacy=0x7f8b100b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.169+0000 7f8b1539a700 1 -- 172.21.15.142:0/2985254653 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100adf10 con 0x7f8b101551e0 2023-09-30T22:52:39.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.169+0000 7f8b1539a700 1 --2- 172.21.15.142:0/2985254653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b101551e0 0x7f8b100cc650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009e60 tx=0x7f8b08009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe232e3176e99a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.171+0000 7f8b14b99700 1 -- 172.21.15.142:0/2985254653 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800e070 con 0x7f8b101551e0 2023-09-30T22:52:39.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.171+0000 7f8b14b99700 1 -- 172.21.15.142:0/2985254653 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800bb30 con 0x7f8b101551e0 2023-09-30T22:52:39.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.171+0000 7f8b14b99700 1 -- 172.21.15.142:0/2985254653 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08012430 con 0x7f8b101551e0 2023-09-30T22:52:39.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.172+0000 7fbba09ff700 1 Processor -- start 2023-09-30T22:52:39.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.172+0000 7f8b17dff700 1 -- 172.21.15.142:0/2985254653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b101551e0 msgr2=0x7f8b100cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.172+0000 7f8b17dff700 1 --2- 172.21.15.142:0/2985254653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b101551e0 0x7f8b100cc650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009e60 tx=0x7f8b08009780 comp rx=0 tx=0).stop 2023-09-30T22:52:39.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.172+0000 7fbba09ff700 1 -- start start 2023-09-30T22:52:39.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.174+0000 7f8b17dff700 1 -- 172.21.15.142:0/2985254653 shutdown_connections 2023-09-30T22:52:39.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.174+0000 7f8b17dff700 1 --2- 172.21.15.142:0/2985254653 >> v2:172.21.15.148:3300/0 conn(0x7f8b1006e670 0x7f8b100ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.174+0000 7f8b17dff700 1 --2- 172.21.15.142:0/2985254653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b101551e0 0x7f8b100cc650 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.174+0000 7f8b17dff700 1 -- 172.21.15.142:0/2985254653 >> 172.21.15.142:0/2985254653 conn(0x7f8b10067620 msgr2=0x7f8b10067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.174+0000 7f8b17dff700 1 -- 172.21.15.142:0/2985254653 shutdown_connections 2023-09-30T22:52:39.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.174+0000 7fbba09ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb9c155970 0x7fbb9c0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.175+0000 7fbba09ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155d40 0x7fbb9c0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.175+0000 7fbba09ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c06dd70 con 0x7fbb9c156360 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.175+0000 7fbba09ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c156ef0 con 0x7fbb9c155970 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.175+0000 7fbba09ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c06b4a0 con 0x7fbb9c155d40 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.175+0000 7fbb99d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155d40 0x7fbb9c0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.175+0000 7fbb99d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155d40 0x7fbb9c0aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42848/0 (socket says 172.21.15.142:42848) 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.175+0000 7fbb99d9b700 1 -- 172.21.15.142:0/46845688 learned_addr learned my addr 172.21.15.142:0/46845688 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.176+0000 7fbb9a59c700 1 --2- 172.21.15.142:0/46845688 >> v2:172.21.15.148:3300/0 conn(0x7fbb9c155970 0x7fbb9c0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.176+0000 7fbb99d9b700 1 -- 172.21.15.142:0/46845688 >> v2:172.21.15.148:3300/0 conn(0x7fbb9c155970 msgr2=0x7fbb9c0ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.176+0000 7fbb99d9b700 1 --2- 172.21.15.142:0/46845688 >> v2:172.21.15.148:3300/0 conn(0x7fbb9c155970 0x7fbb9c0ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.176+0000 7fbb99d9b700 1 -- 172.21.15.142:0/46845688 >> v1:172.21.15.142:6789/0 conn(0x7fbb9c156360 legacy=0x7fbb9c1567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.176+0000 7fbb99d9b700 1 -- 172.21.15.142:0/46845688 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c06d480 con 0x7fbb9c155d40 2023-09-30T22:52:39.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.177+0000 7fbb99d9b700 1 --2- 172.21.15.142:0/46845688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155d40 0x7fbb9c0aee30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0099b0 tx=0x7fbb8c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8952e2f51c4c4d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.178+0000 7fbb9959a700 1 -- 172.21.15.142:0/46845688 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c009ea0 con 0x7fbb9c155d40 2023-09-30T22:52:39.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.178+0000 7fbb9959a700 1 -- 172.21.15.142:0/46845688 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00b860 con 0x7fbb9c155d40 2023-09-30T22:52:39.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.178+0000 7fbb9959a700 1 -- 172.21.15.142:0/46845688 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00bc00 con 0x7fbb9c155d40 2023-09-30T22:52:39.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.174+0000 7f8b17dff700 1 -- 172.21.15.142:0/2985254653 wait complete. 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.177+0000 7f8b17dff700 1 Processor -- start 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.177+0000 7f8b17dff700 1 -- start start 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.179+0000 7f8b17dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b1006e670 0x7f8b10146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.179+0000 7f8b17dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b10154e10 0x7f8b10143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.179+0000 7f8b17dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b10143fd0 0x7f8b1015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.179+0000 7f8b17dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10146ad0 con 0x7f8b10154e10 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.179+0000 7f8b17dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10145be0 con 0x7f8b1006e670 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.179+0000 7f8b17dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10145ec0 con 0x7f8b10143fd0 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.180+0000 7f8b1639c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b10143fd0 0x7f8b1015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.180+0000 7f8b1639c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b10143fd0 0x7f8b1015c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42856/0 (socket says 172.21.15.142:42856) 2023-09-30T22:52:39.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.180+0000 7f8b1639c700 1 -- 172.21.15.142:0/769301437 learned_addr learned my addr 172.21.15.142:0/769301437 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.180+0000 7fbba09ff700 1 -- 172.21.15.142:0/46845688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155d40 msgr2=0x7fbb9c0aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.180+0000 7fbba09ff700 1 --2- 172.21.15.142:0/46845688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155d40 0x7fbb9c0aee30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0099b0 tx=0x7fbb8c009250 comp rx=0 tx=0).stop 2023-09-30T22:52:39.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7f8b15b9b700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b1006e670 0x7f8b10146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7f8b1639c700 1 -- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b1006e670 msgr2=0x7f8b10146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7f8b1639c700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b1006e670 0x7f8b10146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7f8b1639c700 1 -- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b10154e10 msgr2=0x7f8b10143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7f8b1639c700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b10154e10 0x7f8b10143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7f8b1639c700 1 -- 172.21.15.142:0/769301437 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08009a20 con 0x7f8b10143fd0 2023-09-30T22:52:39.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7fbba09ff700 1 -- 172.21.15.142:0/46845688 shutdown_connections 2023-09-30T22:52:39.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7fbba09ff700 1 --2- 172.21.15.142:0/46845688 >> v2:172.21.15.148:3300/0 conn(0x7fbb9c155970 0x7fbb9c0ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7fbba09ff700 1 --2- 172.21.15.142:0/46845688 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155d40 0x7fbb9c0aee30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.181+0000 7fbba09ff700 1 -- 172.21.15.142:0/46845688 >> 172.21.15.142:0/46845688 conn(0x7fbb9c067620 msgr2=0x7fbb9c067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7fbba09ff700 1 -- 172.21.15.142:0/46845688 shutdown_connections 2023-09-30T22:52:39.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7f8b1639c700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b10143fd0 0x7f8b1015c390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c880 tx=0x7f8b0c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7f8b05ffb700 1 -- 172.21.15.142:0/769301437 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c011600 con 0x7f8b10143fd0 2023-09-30T22:52:39.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7f8b05ffb700 1 -- 172.21.15.142:0/769301437 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c011760 con 0x7f8b10143fd0 2023-09-30T22:52:39.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7f8b05ffb700 1 -- 172.21.15.142:0/769301437 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c011ae0 con 0x7f8b10143fd0 2023-09-30T22:52:39.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b101461a0 con 0x7f8b10143fd0 2023-09-30T22:52:39.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b10146760 con 0x7f8b10143fd0 2023-09-30T22:52:39.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.182+0000 7fbba09ff700 1 -- 172.21.15.142:0/46845688 wait complete. 2023-09-30T22:52:39.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.184+0000 7fbba09ff700 1 Processor -- start 2023-09-30T22:52:39.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.185+0000 7fbba09ff700 1 -- start start 2023-09-30T22:52:39.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.186+0000 7fbba09ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155970 0x7fbb9c0c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.186+0000 7fbba09ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb9c155d40 0x7fbb9c13f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.186+0000 7fbba09ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb9c156360 0x7fbb9c14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.186+0000 7fbba09ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c14c090 con 0x7fbb9c155d40 2023-09-30T22:52:39.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.186+0000 7fbba09ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0c1e60 con 0x7fbb9c156360 2023-09-30T22:52:39.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.186+0000 7fbba09ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c13f6c0 con 0x7fbb9c155970 2023-09-30T22:52:39.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.187+0000 7fbb9a59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155970 0x7fbb9c0c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.187+0000 7fbb9a59c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155970 0x7fbb9c0c22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:42862/0 (socket says 172.21.15.142:42862) 2023-09-30T22:52:39.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.187+0000 7fbb9a59c700 1 -- 172.21.15.142:0/1328508074 learned_addr learned my addr 172.21.15.142:0/1328508074 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.187+0000 7fbb9ad9d700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb9c156360 0x7fbb9c14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.187+0000 7fbb99d9b700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb9c155d40 0x7fbb9c13f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.187+0000 7f8b05ffb700 1 -- 172.21.15.142:0/769301437 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8b0c0193f0 con 0x7f8b10143fd0 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.188+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100695b0 con 0x7f8b10143fd0 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.188+0000 7fbb9a59c700 1 -- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb9c156360 msgr2=0x7fbb9c14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.188+0000 7fbb9a59c700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb9c156360 0x7fbb9c14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.188+0000 7fbb9a59c700 1 -- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb9c155d40 msgr2=0x7fbb9c13f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.188+0000 7fbb9a59c700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb9c155d40 0x7fbb9c13f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.188+0000 7fbb9a59c700 1 -- 172.21.15.142:0/1328508074 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0094f0 con 0x7fbb9c155970 2023-09-30T22:52:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.191+0000 7f8b05ffb700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8af4067480 0x7f8af4069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.192+0000 7f8b15b9b700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8af4067480 0x7f8af4069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.192+0000 7f8b05ffb700 1 -- 172.21.15.142:0/769301437 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8b0c084f60 con 0x7f8b10143fd0 2023-09-30T22:52:39.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.193+0000 7fbb9a59c700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155970 0x7fbb9c0c22f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009ef0 tx=0x7fbb9400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.193+0000 7f8b15b9b700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8af4067480 0x7f8af4069930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b100b14c0 tx=0x7f8b00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.198+0000 7f8b05ffb700 1 -- 172.21.15.142:0/769301437 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8b0c0558d0 con 0x7f8b10143fd0 2023-09-30T22:52:39.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.198+0000 7fbb8a7fc700 1 -- 172.21.15.142:0/1328508074 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9400cc20 con 0x7fbb9c155970 2023-09-30T22:52:39.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.198+0000 7fbb8a7fc700 1 -- 172.21.15.142:0/1328508074 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9400f040 con 0x7fbb9c155970 2023-09-30T22:52:39.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.198+0000 7fbb8a7fc700 1 -- 172.21.15.142:0/1328508074 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94014480 con 0x7fbb9c155970 2023-09-30T22:52:39.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.199+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c14bdb0 con 0x7fbb9c155970 2023-09-30T22:52:39.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.199+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c0c1af0 con 0x7fbb9c155970 2023-09-30T22:52:39.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.204+0000 7fbb8a7fc700 1 -- 172.21.15.142:0/1328508074 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbb940147f0 con 0x7fbb9c155970 2023-09-30T22:52:39.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.205+0000 7fbb8a7fc700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb7c067450 0x7fbb7c069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.206+0000 7fbb8a7fc700 1 -- 172.21.15.142:0/1328508074 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbb940855e0 con 0x7fbb9c155970 2023-09-30T22:52:39.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.206+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c0c2140 con 0x7fbb9c155970 2023-09-30T22:52:39.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.207+0000 7fbb99d9b700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb7c067450 0x7fbb7c069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.208+0000 7fbb99d9b700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb7c067450 0x7fbb7c069900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0099b0 tx=0x7fbb8c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.211+0000 7fbb8a7fc700 1 -- 172.21.15.142:0/1328508074 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbb940524c0 con 0x7fbb9c155970 2023-09-30T22:52:39.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.460+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f76440c8d70 con 0x7f76440b22a0 2023-09-30T22:52:39.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.461+0000 7f7632ffd700 1 -- 172.21.15.142:0/3400352939 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7634054c70 con 0x7f76440b22a0 2023-09-30T22:52:39.465 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.465+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7628067450 msgr2=0x7f7628069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.465+0000 7f76491ff700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7628067450 0x7f7628069900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7644087130 tx=0x7f763c009370 comp rx=0 tx=0).stop 2023-09-30T22:52:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.465+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 msgr2=0x7f764414e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.465+0000 7f76491ff700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f764414e080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f763400b5e0 tx=0x7f76340090f0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.466+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 shutdown_connections 2023-09-30T22:52:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.466+0000 7f76491ff700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7628067450 0x7f7628069900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.466+0000 7f76491ff700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7644155ca0 0x7f76440c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.466+0000 7f76491ff700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76440b22a0 0x7f764414e080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.466+0000 7f76491ff700 1 --2- 172.21.15.142:0/3400352939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76441558d0 0x7f76440c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.466+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 >> 172.21.15.142:0/3400352939 conn(0x7f76440680c0 msgr2=0x7f7644069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.467+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 shutdown_connections 2023-09-30T22:52:39.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.467+0000 7f76491ff700 1 -- 172.21.15.142:0/3400352939 wait complete. 2023-09-30T22:52:39.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-09-30T22:52:39.497 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.512+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9248005560 con 0x7f9268156360 2023-09-30T22:52:39.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.513+0000 7f925dffb700 1 -- 172.21.15.142:0/460172999 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9258017090 con 0x7f9268156360 2023-09-30T22:52:39.514 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.515+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f924c067400 msgr2=0x7f924c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.515+0000 7f926ffff700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f924c067400 0x7f924c0698b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9268068500 tx=0x7f926000b040 comp rx=0 tx=0).stop 2023-09-30T22:52:39.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.515+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268156360 msgr2=0x7f92680a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.515+0000 7f926ffff700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268156360 0x7f92680a5ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f925800c560 tx=0x7f9258007d50 comp rx=0 tx=0).stop 2023-09-30T22:52:39.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 shutdown_connections 2023-09-30T22:52:39.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f924c067400 0x7f924c0698b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9268156360 0x7f92680a5ea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9268155970 0x7f92681662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 --2- 172.21.15.142:0/460172999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268155d40 0x7f9268153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 >> 172.21.15.142:0/460172999 conn(0x7f9268067620 msgr2=0x7f92680b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 shutdown_connections 2023-09-30T22:52:39.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.516+0000 7f926ffff700 1 -- 172.21.15.142:0/460172999 wait complete. 2023-09-30T22:52:39.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.534+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0e38005560 con 0x7f0e500b01e0 2023-09-30T22:52:39.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-09-30T22:52:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.534+0000 7f0e467fc700 1 -- 172.21.15.142:0/291921617 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e40054d00 con 0x7f0e500b01e0 2023-09-30T22:52:39.536 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.536 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.537+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96180695b0 con 0x7f96180aeba0 2023-09-30T22:52:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.537+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d70005560 con 0x7f0d90140be0 2023-09-30T22:52:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.537+0000 7f9614ff9700 1 -- 172.21.15.142:0/3723410761 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9608052f10 con 0x7f96180aeba0 2023-09-30T22:52:39.538 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e34067400 msgr2=0x7f0e340698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e34067400 0x7f0e340698b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c006fd0 tx=0x7f0e4c008040 comp rx=0 tx=0).stop 2023-09-30T22:52:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e500b01e0 msgr2=0x7f0e50177fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e500b01e0 0x7f0e50177fe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b810 tx=0x7f0e40009250 comp rx=0 tx=0).stop 2023-09-30T22:52:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 shutdown_connections 2023-09-30T22:52:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e34067400 0x7f0e340698b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e500cc630 0x7f0e50086d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e500b01e0 0x7f0e50177fe0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 --2- 172.21.15.142:0/291921617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e500b1e70 0x7f0e50086850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 >> 172.21.15.142:0/291921617 conn(0x7f0e50067620 msgr2=0x7f0e5016a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.538+0000 7f0d76ffd700 1 -- 172.21.15.142:0/260588634 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d88055000 con 0x7f0d90140be0 2023-09-30T22:52:39.541 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.539+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 shutdown_connections 2023-09-30T22:52:39.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.539+0000 7f0e583ff700 1 -- 172.21.15.142:0/291921617 wait complete. 2023-09-30T22:52:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.540+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9604067400 msgr2=0x7f96040698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.540+0000 7f961f1ff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9604067400 0x7f96040698b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f960c006d40 tx=0x7f960c00b040 comp rx=0 tx=0).stop 2023-09-30T22:52:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.540+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 msgr2=0x7f96180868b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.540+0000 7f961f1ff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180868b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9608017000 tx=0x7f9608018000 comp rx=0 tx=0).stop 2023-09-30T22:52:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.541+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 shutdown_connections 2023-09-30T22:52:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.541+0000 7f961f1ff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9604067400 0x7f96040698b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.541+0000 7f961f1ff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96180cc630 0x7f96180cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.541+0000 7f961f1ff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96180aeba0 0x7f96180868b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.541+0000 7f961f1ff700 1 --2- 172.21.15.142:0/3723410761 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96180aef70 0x7f96180ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.541+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 >> 172.21.15.142:0/3723410761 conn(0x7f9618067620 msgr2=0x7f961806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.541+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 shutdown_connections 2023-09-30T22:52:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f961f1ff700 1 -- 172.21.15.142:0/3723410761 wait complete. 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d7c067480 msgr2=0x7f0d7c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d7c067480 0x7f0d7c069930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097c0 tx=0x7f0d84006ce0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d90140be0 msgr2=0x7f0d90141440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d90140be0 0x7f0d90141440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800c910 tx=0x7f0d880016d0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 shutdown_connections 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d7c067480 0x7f0d7c069930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d90140be0 0x7f0d90141440 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9006e670 0x7f0d90140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 --2- 172.21.15.142:0/260588634 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d90154e10 0x7f0d901406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.542+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 >> 172.21.15.142:0/260588634 conn(0x7f0d90067620 msgr2=0x7f0d900ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.543+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 shutdown_connections 2023-09-30T22:52:39.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.543+0000 7f0d953ff700 1 -- 172.21.15.142:0/260588634 wait complete. 2023-09-30T22:52:39.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2023-09-30T22:52:39.565 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.570+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f26f0005830 con 0x7f271006b130 2023-09-30T22:52:39.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2023-09-30T22:52:39.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.570+0000 7f27057fa700 1 -- 172.21.15.142:0/813057108 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27000548d0 con 0x7f271006b130 2023-09-30T22:52:39.571 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.571 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2023-09-30T22:52:39.574 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26f4067330 msgr2=0x7f26f40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26f4067330 0x7f26f40697e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae7d0 tx=0x7f2708019000 comp rx=0 tx=0).stop 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006b130 msgr2=0x7f271015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006b130 0x7f271015d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f270000c7c0 tx=0x7f2700007f70 comp rx=0 tx=0).stop 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 shutdown_connections 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26f4067330 0x7f26f40697e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f271015e230 0x7f2710161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f271006b130 0x7f271015d360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 --2- 172.21.15.142:0/813057108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27100ae3d0 0x7f271016e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 >> 172.21.15.142:0/813057108 conn(0x7f27100cc4d0 msgr2=0x7f271006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 shutdown_connections 2023-09-30T22:52:39.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.573+0000 7f271659d700 1 -- 172.21.15.142:0/813057108 wait complete. 2023-09-30T22:52:39.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-09-30T22:52:39.600 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.601+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8b10146c10 con 0x7f8b10143fd0 2023-09-30T22:52:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.602+0000 7f8b05ffb700 1 -- 172.21.15.142:0/769301437 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b0c055460 con 0x7f8b10143fd0 2023-09-30T22:52:39.603 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.604+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbb9c06fc10 con 0x7fbb9c155970 2023-09-30T22:52:39.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8af4067480 msgr2=0x7f8af4069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8af4067480 0x7f8af4069930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b100b14c0 tx=0x7f8b00009040 comp rx=0 tx=0).stop 2023-09-30T22:52:39.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b10143fd0 msgr2=0x7f8b1015c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b10143fd0 0x7f8b1015c390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c880 tx=0x7f8b0c008040 comp rx=0 tx=0).stop 2023-09-30T22:52:39.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 shutdown_connections 2023-09-30T22:52:39.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8af4067480 0x7f8af4069930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b10143fd0 0x7f8b1015c390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b1006e670 0x7f8b10146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 --2- 172.21.15.142:0/769301437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b10154e10 0x7f8b10143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 >> 172.21.15.142:0/769301437 conn(0x7f8b10067620 msgr2=0x7f8b100b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7fbb8a7fc700 1 -- 172.21.15.142:0/1328508074 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb94055ae0 con 0x7fbb9c155970 2023-09-30T22:52:39.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 shutdown_connections 2023-09-30T22:52:39.607 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2023-09-30T22:52:39.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.605+0000 7f8b17dff700 1 -- 172.21.15.142:0/769301437 wait complete. 2023-09-30T22:52:39.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb7c067450 msgr2=0x7fbb7c069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb7c067450 0x7fbb7c069900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0099b0 tx=0x7fbb8c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:39.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155970 msgr2=0x7fbb9c0c22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155970 0x7fbb9c0c22f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009ef0 tx=0x7fbb9400b040 comp rx=0 tx=0).stop 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 shutdown_connections 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb7c067450 0x7fbb7c069900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb9c156360 0x7fbb9c14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb9c155970 0x7fbb9c0c22f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.607+0000 7fbba09ff700 1 --2- 172.21.15.142:0/1328508074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb9c155d40 0x7fbb9c13f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.608+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 >> 172.21.15.142:0/1328508074 conn(0x7fbb9c067620 msgr2=0x7fbb9c14c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.608+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 shutdown_connections 2023-09-30T22:52:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.608+0000 7fbba09ff700 1 -- 172.21.15.142:0/1328508074 wait complete. 2023-09-30T22:52:39.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2023-09-30T22:52:39.627 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2023-09-30T22:52:39.627 DEBUG:teuthology.parallel:result is None 2023-09-30T22:52:39.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:52:39.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:52:39.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.854+0000 7fafcd5ff700 1 Processor -- start 2023-09-30T22:52:39.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.854+0000 7fafcd5ff700 1 -- start start 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafcd5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc80ac3a0 0x7fafc80aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafcd5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafc806b930 0x7fafc80aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafcd5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc8068000 con 0x7fafc8159b50 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafcd5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc8069f10 con 0x7fafc806b930 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafcd5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8068240 con 0x7fafc80ac3a0 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafc6ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fafc8159b50 0x7fafc80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60444/0 (socket says 172.21.15.142:60444) 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafc77fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafc806b930 0x7fafc80aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.855+0000 7fafc6ffd700 1 -- 172.21.15.142:0/4130117409 learned_addr learned my addr 172.21.15.142:0/4130117409 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:39.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc67fc700 1 --2- 172.21.15.142:0/4130117409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc80ac3a0 0x7fafc80aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc5ffb700 1 -- 172.21.15.142:0/4130117409 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604736717 0 0) 0x7fafb8001110 con 0x7fafc8159b50 2023-09-30T22:52:39.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc5ffb700 1 -- 172.21.15.142:0/4130117409 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb0003570 con 0x7fafc8159b50 2023-09-30T22:52:39.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc77fe700 1 -- 172.21.15.142:0/4130117409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc80ac3a0 msgr2=0x7fafc80aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:39.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc77fe700 1 --2- 172.21.15.142:0/4130117409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc80ac3a0 0x7fafc80aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc77fe700 1 -- 172.21.15.142:0/4130117409 >> v1:172.21.15.142:6789/0 conn(0x7fafc8159b50 legacy=0x7fafc80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc77fe700 1 -- 172.21.15.142:0/4130117409 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc8068520 con 0x7fafc806b930 2023-09-30T22:52:39.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc67fc700 1 --2- 172.21.15.142:0/4130117409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc80ac3a0 0x7fafc80aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc77fe700 1 --2- 172.21.15.142:0/4130117409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc806b930 0x7fafc80aa7e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009e60 tx=0x7fafc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100622b8c58b0691 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.856+0000 7fafc5ffb700 1 -- 172.21.15.142:0/4130117409 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc000e070 con 0x7fafc806b930 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafc5ffb700 1 -- 172.21.15.142:0/4130117409 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc000bb60 con 0x7fafc806b930 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafc5ffb700 1 -- 172.21.15.142:0/4130117409 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0012430 con 0x7fafc806b930 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 -- 172.21.15.142:0/4130117409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc806b930 msgr2=0x7fafc80aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/4130117409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc806b930 0x7fafc80aa7e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009e60 tx=0x7fafc0009780 comp rx=0 tx=0).stop 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 -- 172.21.15.142:0/4130117409 shutdown_connections 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/4130117409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc806b930 0x7fafc80aa7e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/4130117409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc80ac3a0 0x7fafc80aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 -- 172.21.15.142:0/4130117409 >> 172.21.15.142:0/4130117409 conn(0x7fafc806dab0 msgr2=0x7fafc80aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 -- 172.21.15.142:0/4130117409 shutdown_connections 2023-09-30T22:52:39.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.857+0000 7fafcd5ff700 1 -- 172.21.15.142:0/4130117409 wait complete. 2023-09-30T22:52:39.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.859+0000 7fafcd5ff700 1 Processor -- start 2023-09-30T22:52:39.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.859+0000 7fafcd5ff700 1 -- start start 2023-09-30T22:52:39.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafcd5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc806b930 0x7fafc80b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafcd5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc80ac3a0 0x7fafc814c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafcd5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc8159b50 0x7fafc814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafcd5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80ae8e0 con 0x7fafc80ac3a0 2023-09-30T22:52:39.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafcd5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80c9c90 con 0x7fafc8159b50 2023-09-30T22:52:39.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafcd5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80ae040 con 0x7fafc806b930 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc80ac3a0 0x7fafc814c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc80ac3a0 0x7fafc814c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57548/0 (socket says 172.21.15.142:57548) 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 -- 172.21.15.142:0/1972889605 learned_addr learned my addr 172.21.15.142:0/1972889605 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc77fe700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc8159b50 0x7fafc814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc6ffd700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc806b930 0x7fafc80b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 -- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc806b930 msgr2=0x7fafc80b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc806b930 0x7fafc80b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 -- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc8159b50 msgr2=0x7fafc814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc8159b50 0x7fafc814cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.860+0000 7fafc67fc700 1 -- 172.21.15.142:0/1972889605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009a20 con 0x7fafc80ac3a0 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.861+0000 7fafc67fc700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc80ac3a0 0x7fafc814c610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00e8d0 tx=0x7fafbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.861+0000 7fafaeffd700 1 -- 172.21.15.142:0/1972889605 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc013410 con 0x7fafc80ac3a0 2023-09-30T22:52:39.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.861+0000 7fafaeffd700 1 -- 172.21.15.142:0/1972889605 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc013570 con 0x7fafc80ac3a0 2023-09-30T22:52:39.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.861+0000 7fafaeffd700 1 -- 172.21.15.142:0/1972889605 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc013910 con 0x7fafc80ac3a0 2023-09-30T22:52:39.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.861+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc80ae320 con 0x7fafc80ac3a0 2023-09-30T22:52:39.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.861+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc80c9f30 con 0x7fafc80ac3a0 2023-09-30T22:52:39.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.862+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc806cfd0 con 0x7fafc80ac3a0 2023-09-30T22:52:39.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.863+0000 7fafaeffd700 1 -- 172.21.15.142:0/1972889605 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fafbc013d00 con 0x7fafc80ac3a0 2023-09-30T22:52:39.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.864+0000 7fafaeffd700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fafb4067330 0x7fafb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:39.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.864+0000 7fafaeffd700 1 -- 172.21.15.142:0/1972889605 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fafbc084a20 con 0x7fafc80ac3a0 2023-09-30T22:52:39.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.864+0000 7fafc6ffd700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fafb4067330 0x7fafb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:39.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.865+0000 7fafc6ffd700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fafb4067330 0x7fafb40697e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001270 tx=0x7fafb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:39.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:39.868+0000 7fafaeffd700 1 -- 172.21.15.142:0/1972889605 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fafbc051880 con 0x7fafc80ac3a0 2023-09-30T22:52:40.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.056+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafc806fc10 con 0x7fafb4067330 2023-09-30T22:52:40.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.064+0000 7fafaeffd700 1 -- 172.21.15.142:0/1972889605 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278820 (secure 0 0 0) 0x7fafc806fc10 con 0x7fafb4067330 2023-09-30T22:52:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:40.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.068+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fafb4067330 msgr2=0x7fafb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.068+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fafb4067330 0x7fafb40697e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001270 tx=0x7fafb8009040 comp rx=0 tx=0).stop 2023-09-30T22:52:40.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.068+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc80ac3a0 msgr2=0x7fafc814c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.068+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc80ac3a0 0x7fafc814c610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00e8d0 tx=0x7fafbc008040 comp rx=0 tx=0).stop 2023-09-30T22:52:40.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 shutdown_connections 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fafb4067330 0x7fafb40697e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc8159b50 0x7fafc814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafc806b930 0x7fafc80b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 --2- 172.21.15.142:0/1972889605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc80ac3a0 0x7fafc814c610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 >> 172.21.15.142:0/1972889605 conn(0x7fafc806dab0 msgr2=0x7fafc80a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 shutdown_connections 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.069+0000 7fafcd5ff700 1 -- 172.21.15.142:0/1972889605 wait complete. 2023-09-30T22:52:40.073 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:52:40.087 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-09-30T22:52:38.104034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1854,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560645,"statfs":{"total":1600000000,"available":1598101380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.119767"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999723+0000","last_change":"2023-09-30T22:52:29.999656+0000","last_active":"2023-09-30T22:52:29.999723+0000","last_peered":"2023-09-30T22:52:29.999723+0000","last_clean":"2023-09-30T22:52:29.999723+0000","last_became_active":"2023-09-30T22:52:29.999224+0000","last_became_peered":"2023-09-30T22:52:29.999224+0000","last_unstale":"2023-09-30T22:52:29.999723+0000","last_undegraded":"2023-09-30T22:52:29.999723+0000","last_fullsized":"2023-09-30T22:52:29.999723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000978+0000","last_change":"2023-09-30T22:52:30.000930+0000","last_active":"2023-09-30T22:52:30.000978+0000","last_peered":"2023-09-30T22:52:30.000978+0000","last_clean":"2023-09-30T22:52:30.000978+0000","last_became_active":"2023-09-30T22:52:30.000733+0000","last_became_peered":"2023-09-30T22:52:30.000733+0000","last_unstale":"2023-09-30T22:52:30.000978+0000","last_undegraded":"2023-09-30T22:52:30.000978+0000","last_fullsized":"2023-09-30T22:52:30.000978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996453+0000","last_change":"2023-09-30T22:52:29.996378+0000","last_active":"2023-09-30T22:52:29.996453+0000","last_peered":"2023-09-30T22:52:29.996453+0000","last_clean":"2023-09-30T22:52:29.996453+0000","last_became_active":"2023-09-30T22:52:29.996139+0000","last_became_peered":"2023-09-30T22:52:29.996139+0000","last_unstale":"2023-09-30T22:52:29.996453+0000","last_undegraded":"2023-09-30T22:52:29.996453+0000","last_fullsized":"2023-09-30T22:52:29.996453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994761+0000","last_change":"2023-09-30T22:52:29.994384+0000","last_active":"2023-09-30T22:52:29.994761+0000","last_peered":"2023-09-30T22:52:29.994761+0000","last_clean":"2023-09-30T22:52:29.994761+0000","last_became_active":"2023-09-30T22:52:29.994168+0000","last_became_peered":"2023-09-30T22:52:29.994168+0000","last_unstale":"2023-09-30T22:52:29.994761+0000","last_undegraded":"2023-09-30T22:52:29.994761+0000","last_fullsized":"2023-09-30T22:52:29.994761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004482+0000","last_change":"2023-09-30T22:52:30.004022+0000","last_active":"2023-09-30T22:52:30.004482+0000","last_peered":"2023-09-30T22:52:30.004482+0000","last_clean":"2023-09-30T22:52:30.004482+0000","last_became_active":"2023-09-30T22:52:30.003781+0000","last_became_peered":"2023-09-30T22:52:30.003781+0000","last_unstale":"2023-09-30T22:52:30.004482+0000","last_undegraded":"2023-09-30T22:52:30.004482+0000","last_fullsized":"2023-09-30T22:52:30.004482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986014+0000","last_change":"2023-09-30T22:52:29.985910+0000","last_active":"2023-09-30T22:52:29.986014+0000","last_peered":"2023-09-30T22:52:29.986014+0000","last_clean":"2023-09-30T22:52:29.986014+0000","last_became_active":"2023-09-30T22:52:29.985698+0000","last_became_peered":"2023-09-30T22:52:29.985698+0000","last_unstale":"2023-09-30T22:52:29.986014+0000","last_undegraded":"2023-09-30T22:52:29.986014+0000","last_fullsized":"2023-09-30T22:52:29.986014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:02:40.635094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992823+0000","last_change":"2023-09-30T22:52:29.992580+0000","last_active":"2023-09-30T22:52:29.992823+0000","last_peered":"2023-09-30T22:52:29.992823+0000","last_clean":"2023-09-30T22:52:29.992823+0000","last_became_active":"2023-09-30T22:52:29.992055+0000","last_became_peered":"2023-09-30T22:52:29.992055+0000","last_unstale":"2023-09-30T22:52:29.992823+0000","last_undegraded":"2023-09-30T22:52:29.992823+0000","last_fullsized":"2023-09-30T22:52:29.992823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:25.419873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992925+0000","last_change":"2023-09-30T22:52:29.992763+0000","last_active":"2023-09-30T22:52:29.992925+0000","last_peered":"2023-09-30T22:52:29.992925+0000","last_clean":"2023-09-30T22:52:29.992925+0000","last_became_active":"2023-09-30T22:52:29.992537+0000","last_became_peered":"2023-09-30T22:52:29.992537+0000","last_unstale":"2023-09-30T22:52:29.992925+0000","last_undegraded":"2023-09-30T22:52:29.992925+0000","last_fullsized":"2023-09-30T22:52:29.992925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005650+0000","last_change":"2023-09-30T22:52:30.005579+0000","last_active":"2023-09-30T22:52:30.005650+0000","last_peered":"2023-09-30T22:52:30.005650+0000","last_clean":"2023-09-30T22:52:30.005650+0000","last_became_active":"2023-09-30T22:52:30.005151+0000","last_became_peered":"2023-09-30T22:52:30.005151+0000","last_unstale":"2023-09-30T22:52:30.005650+0000","last_undegraded":"2023-09-30T22:52:30.005650+0000","last_fullsized":"2023-09-30T22:52:30.005650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998463+0000","last_change":"2023-09-30T22:52:29.998403+0000","last_active":"2023-09-30T22:52:29.998463+0000","last_peered":"2023-09-30T22:52:29.998463+0000","last_clean":"2023-09-30T22:52:29.998463+0000","last_became_active":"2023-09-30T22:52:29.998170+0000","last_became_peered":"2023-09-30T22:52:29.998170+0000","last_unstale":"2023-09-30T22:52:29.998463+0000","last_undegraded":"2023-09-30T22:52:29.998463+0000","last_fullsized":"2023-09-30T22:52:29.998463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:51.188433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994173+0000","last_change":"2023-09-30T22:52:29.993975+0000","last_active":"2023-09-30T22:52:29.994173+0000","last_peered":"2023-09-30T22:52:29.994173+0000","last_clean":"2023-09-30T22:52:29.994173+0000","last_became_active":"2023-09-30T22:52:29.993354+0000","last_became_peered":"2023-09-30T22:52:29.993354+0000","last_unstale":"2023-09-30T22:52:29.994173+0000","last_undegraded":"2023-09-30T22:52:29.994173+0000","last_fullsized":"2023-09-30T22:52:29.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995287+0000","last_change":"2023-09-30T22:52:29.995056+0000","last_active":"2023-09-30T22:52:29.995287+0000","last_peered":"2023-09-30T22:52:29.995287+0000","last_clean":"2023-09-30T22:52:29.995287+0000","last_became_active":"2023-09-30T22:52:29.994501+0000","last_became_peered":"2023-09-30T22:52:29.994501+0000","last_unstale":"2023-09-30T22:52:29.995287+0000","last_undegraded":"2023-09-30T22:52:29.995287+0000","last_fullsized":"2023-09-30T22:52:29.995287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998543+0000","last_change":"2023-09-30T22:52:29.998468+0000","last_active":"2023-09-30T22:52:29.998543+0000","last_peered":"2023-09-30T22:52:29.998543+0000","last_clean":"2023-09-30T22:52:29.998543+0000","last_became_active":"2023-09-30T22:52:29.998228+0000","last_became_peered":"2023-09-30T22:52:29.998228+0000","last_unstale":"2023-09-30T22:52:29.998543+0000","last_undegraded":"2023-09-30T22:52:29.998543+0000","last_fullsized":"2023-09-30T22:52:29.998543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002051+0000","last_change":"2023-09-30T22:52:30.001990+0000","last_active":"2023-09-30T22:52:30.002051+0000","last_peered":"2023-09-30T22:52:30.002051+0000","last_clean":"2023-09-30T22:52:30.002051+0000","last_became_active":"2023-09-30T22:52:30.001493+0000","last_became_peered":"2023-09-30T22:52:30.001493+0000","last_unstale":"2023-09-30T22:52:30.002051+0000","last_undegraded":"2023-09-30T22:52:30.002051+0000","last_fullsized":"2023-09-30T22:52:30.002051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999408+0000","last_change":"2023-09-30T22:52:29.999359+0000","last_active":"2023-09-30T22:52:29.999408+0000","last_peered":"2023-09-30T22:52:29.999408+0000","last_clean":"2023-09-30T22:52:29.999408+0000","last_became_active":"2023-09-30T22:52:29.999214+0000","last_became_peered":"2023-09-30T22:52:29.999214+0000","last_unstale":"2023-09-30T22:52:29.999408+0000","last_undegraded":"2023-09-30T22:52:29.999408+0000","last_fullsized":"2023-09-30T22:52:29.999408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995996+0000","last_change":"2023-09-30T22:52:29.995287+0000","last_active":"2023-09-30T22:52:29.995996+0000","last_peered":"2023-09-30T22:52:29.995996+0000","last_clean":"2023-09-30T22:52:29.995996+0000","last_became_active":"2023-09-30T22:52:29.994795+0000","last_became_peered":"2023-09-30T22:52:29.994795+0000","last_unstale":"2023-09-30T22:52:29.995996+0000","last_undegraded":"2023-09-30T22:52:29.995996+0000","last_fullsized":"2023-09-30T22:52:29.995996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:15:33.668598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999673+0000","last_change":"2023-09-30T22:52:29.999604+0000","last_active":"2023-09-30T22:52:29.999673+0000","last_peered":"2023-09-30T22:52:29.999673+0000","last_clean":"2023-09-30T22:52:29.999673+0000","last_became_active":"2023-09-30T22:52:29.999184+0000","last_became_peered":"2023-09-30T22:52:29.999184+0000","last_unstale":"2023-09-30T22:52:29.999673+0000","last_undegraded":"2023-09-30T22:52:29.999673+0000","last_fullsized":"2023-09-30T22:52:29.999673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994780+0000","last_change":"2023-09-30T22:52:29.994681+0000","last_active":"2023-09-30T22:52:29.994780+0000","last_peered":"2023-09-30T22:52:29.994780+0000","last_clean":"2023-09-30T22:52:29.994780+0000","last_became_active":"2023-09-30T22:52:29.994446+0000","last_became_peered":"2023-09-30T22:52:29.994446+0000","last_unstale":"2023-09-30T22:52:29.994780+0000","last_undegraded":"2023-09-30T22:52:29.994780+0000","last_fullsized":"2023-09-30T22:52:29.994780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996185+0000","last_change":"2023-09-30T22:52:29.995754+0000","last_active":"2023-09-30T22:52:29.996185+0000","last_peered":"2023-09-30T22:52:29.996185+0000","last_clean":"2023-09-30T22:52:29.996185+0000","last_became_active":"2023-09-30T22:52:29.995499+0000","last_became_peered":"2023-09-30T22:52:29.995499+0000","last_unstale":"2023-09-30T22:52:29.996185+0000","last_undegraded":"2023-09-30T22:52:29.996185+0000","last_fullsized":"2023-09-30T22:52:29.996185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002210+0000","last_change":"2023-09-30T22:52:30.002133+0000","last_active":"2023-09-30T22:52:30.002210+0000","last_peered":"2023-09-30T22:52:30.002210+0000","last_clean":"2023-09-30T22:52:30.002210+0000","last_became_active":"2023-09-30T22:52:30.001781+0000","last_became_peered":"2023-09-30T22:52:30.001781+0000","last_unstale":"2023-09-30T22:52:30.002210+0000","last_undegraded":"2023-09-30T22:52:30.002210+0000","last_fullsized":"2023-09-30T22:52:30.002210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003659+0000","last_change":"2023-09-30T22:52:30.003616+0000","last_active":"2023-09-30T22:52:30.003659+0000","last_peered":"2023-09-30T22:52:30.003659+0000","last_clean":"2023-09-30T22:52:30.003659+0000","last_became_active":"2023-09-30T22:52:30.003350+0000","last_became_peered":"2023-09-30T22:52:30.003350+0000","last_unstale":"2023-09-30T22:52:30.003659+0000","last_undegraded":"2023-09-30T22:52:30.003659+0000","last_fullsized":"2023-09-30T22:52:30.003659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003184+0000","last_change":"2023-09-30T22:52:30.003114+0000","last_active":"2023-09-30T22:52:30.003184+0000","last_peered":"2023-09-30T22:52:30.003184+0000","last_clean":"2023-09-30T22:52:30.003184+0000","last_became_active":"2023-09-30T22:52:30.002889+0000","last_became_peered":"2023-09-30T22:52:30.002889+0000","last_unstale":"2023-09-30T22:52:30.003184+0000","last_undegraded":"2023-09-30T22:52:30.003184+0000","last_fullsized":"2023-09-30T22:52:30.003184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.006633+0000","last_change":"2023-09-30T22:52:30.006559+0000","last_active":"2023-09-30T22:52:30.006633+0000","last_peered":"2023-09-30T22:52:30.006633+0000","last_clean":"2023-09-30T22:52:30.006633+0000","last_became_active":"2023-09-30T22:52:30.006332+0000","last_became_peered":"2023-09-30T22:52:30.006332+0000","last_unstale":"2023-09-30T22:52:30.006633+0000","last_undegraded":"2023-09-30T22:52:30.006633+0000","last_fullsized":"2023-09-30T22:52:30.006633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002227+0000","last_change":"2023-09-30T22:52:30.002139+0000","last_active":"2023-09-30T22:52:30.002227+0000","last_peered":"2023-09-30T22:52:30.002227+0000","last_clean":"2023-09-30T22:52:30.002227+0000","last_became_active":"2023-09-30T22:52:30.001805+0000","last_became_peered":"2023-09-30T22:52:30.001805+0000","last_unstale":"2023-09-30T22:52:30.002227+0000","last_undegraded":"2023-09-30T22:52:30.002227+0000","last_fullsized":"2023-09-30T22:52:30.002227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001758+0000","last_change":"2023-09-30T22:52:30.001685+0000","last_active":"2023-09-30T22:52:30.001758+0000","last_peered":"2023-09-30T22:52:30.001758+0000","last_clean":"2023-09-30T22:52:30.001758+0000","last_became_active":"2023-09-30T22:52:30.001423+0000","last_became_peered":"2023-09-30T22:52:30.001423+0000","last_unstale":"2023-09-30T22:52:30.001758+0000","last_undegraded":"2023-09-30T22:52:30.001758+0000","last_fullsized":"2023-09-30T22:52:30.001758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005462+0000","last_change":"2023-09-30T22:52:30.004937+0000","last_active":"2023-09-30T22:52:30.005462+0000","last_peered":"2023-09-30T22:52:30.005462+0000","last_clean":"2023-09-30T22:52:30.005462+0000","last_became_active":"2023-09-30T22:52:30.004706+0000","last_became_peered":"2023-09-30T22:52:30.004706+0000","last_unstale":"2023-09-30T22:52:30.005462+0000","last_undegraded":"2023-09-30T22:52:30.005462+0000","last_fullsized":"2023-09-30T22:52:30.005462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992856+0000","last_change":"2023-09-30T22:52:29.992721+0000","last_active":"2023-09-30T22:52:29.992856+0000","last_peered":"2023-09-30T22:52:29.992856+0000","last_clean":"2023-09-30T22:52:29.992856+0000","last_became_active":"2023-09-30T22:52:29.992342+0000","last_became_peered":"2023-09-30T22:52:29.992342+0000","last_unstale":"2023-09-30T22:52:29.992856+0000","last_undegraded":"2023-09-30T22:52:29.992856+0000","last_fullsized":"2023-09-30T22:52:29.992856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:24.803074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248905+0000","last_change":"2023-09-30T22:52:28.998829+0000","last_active":"2023-09-30T22:52:30.248905+0000","last_peered":"2023-09-30T22:52:30.248905+0000","last_clean":"2023-09-30T22:52:30.248905+0000","last_became_active":"2023-09-30T22:52:28.998455+0000","last_became_peered":"2023-09-30T22:52:28.998455+0000","last_unstale":"2023-09-30T22:52:30.248905+0000","last_undegraded":"2023-09-30T22:52:30.248905+0000","last_fullsized":"2023-09-30T22:52:30.248905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998559+0000","last_change":"2023-09-30T22:52:29.998485+0000","last_active":"2023-09-30T22:52:29.998559+0000","last_peered":"2023-09-30T22:52:29.998559+0000","last_clean":"2023-09-30T22:52:29.998559+0000","last_became_active":"2023-09-30T22:52:29.998254+0000","last_became_peered":"2023-09-30T22:52:29.998254+0000","last_unstale":"2023-09-30T22:52:29.998559+0000","last_undegraded":"2023-09-30T22:52:29.998559+0000","last_fullsized":"2023-09-30T22:52:29.998559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992280+0000","last_change":"2023-09-30T22:52:28.992995+0000","last_active":"2023-09-30T22:52:29.992280+0000","last_peered":"2023-09-30T22:52:29.992280+0000","last_clean":"2023-09-30T22:52:29.992280+0000","last_became_active":"2023-09-30T22:52:28.992765+0000","last_became_peered":"2023-09-30T22:52:28.992765+0000","last_unstale":"2023-09-30T22:52:29.992280+0000","last_undegraded":"2023-09-30T22:52:29.992280+0000","last_fullsized":"2023-09-30T22:52:29.992280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004464+0000","last_change":"2023-09-30T22:52:30.003848+0000","last_active":"2023-09-30T22:52:30.004464+0000","last_peered":"2023-09-30T22:52:30.004464+0000","last_clean":"2023-09-30T22:52:30.004464+0000","last_became_active":"2023-09-30T22:52:30.002282+0000","last_became_peered":"2023-09-30T22:52:30.002282+0000","last_unstale":"2023-09-30T22:52:30.004464+0000","last_undegraded":"2023-09-30T22:52:30.004464+0000","last_fullsized":"2023-09-30T22:52:30.004464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991202+0000","last_change":"2023-09-30T22:52:28.998425+0000","last_active":"2023-09-30T22:52:29.991202+0000","last_peered":"2023-09-30T22:52:29.991202+0000","last_clean":"2023-09-30T22:52:29.991202+0000","last_became_active":"2023-09-30T22:52:28.998147+0000","last_became_peered":"2023-09-30T22:52:28.998147+0000","last_unstale":"2023-09-30T22:52:29.991202+0000","last_undegraded":"2023-09-30T22:52:29.991202+0000","last_fullsized":"2023-09-30T22:52:29.991202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996031+0000","last_change":"2023-09-30T22:52:29.995807+0000","last_active":"2023-09-30T22:52:29.996031+0000","last_peered":"2023-09-30T22:52:29.996031+0000","last_clean":"2023-09-30T22:52:29.996031+0000","last_became_active":"2023-09-30T22:52:29.995537+0000","last_became_peered":"2023-09-30T22:52:29.995537+0000","last_unstale":"2023-09-30T22:52:29.996031+0000","last_undegraded":"2023-09-30T22:52:29.996031+0000","last_fullsized":"2023-09-30T22:52:29.996031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:34.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993246+0000","last_change":"2023-09-30T22:52:28.998533+0000","last_active":"2023-09-30T22:52:29.993246+0000","last_peered":"2023-09-30T22:52:29.993246+0000","last_clean":"2023-09-30T22:52:29.993246+0000","last_became_active":"2023-09-30T22:52:28.998113+0000","last_became_peered":"2023-09-30T22:52:28.998113+0000","last_unstale":"2023-09-30T22:52:29.993246+0000","last_undegraded":"2023-09-30T22:52:29.993246+0000","last_fullsized":"2023-09-30T22:52:29.993246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993991+0000","last_change":"2023-09-30T22:52:29.993919+0000","last_active":"2023-09-30T22:52:29.993991+0000","last_peered":"2023-09-30T22:52:29.993991+0000","last_clean":"2023-09-30T22:52:29.993991+0000","last_became_active":"2023-09-30T22:52:29.993688+0000","last_became_peered":"2023-09-30T22:52:29.993688+0000","last_unstale":"2023-09-30T22:52:29.993991+0000","last_undegraded":"2023-09-30T22:52:29.993991+0000","last_fullsized":"2023-09-30T22:52:29.993991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983128+0000","last_change":"2023-09-30T22:52:28.996877+0000","last_active":"2023-09-30T22:52:29.983128+0000","last_peered":"2023-09-30T22:52:29.983128+0000","last_clean":"2023-09-30T22:52:29.983128+0000","last_became_active":"2023-09-30T22:52:28.996514+0000","last_became_peered":"2023-09-30T22:52:28.996514+0000","last_unstale":"2023-09-30T22:52:29.983128+0000","last_undegraded":"2023-09-30T22:52:29.983128+0000","last_fullsized":"2023-09-30T22:52:29.983128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999725+0000","last_change":"2023-09-30T22:52:29.999648+0000","last_active":"2023-09-30T22:52:29.999725+0000","last_peered":"2023-09-30T22:52:29.999725+0000","last_clean":"2023-09-30T22:52:29.999725+0000","last_became_active":"2023-09-30T22:52:29.999326+0000","last_became_peered":"2023-09-30T22:52:29.999326+0000","last_unstale":"2023-09-30T22:52:29.999725+0000","last_undegraded":"2023-09-30T22:52:29.999725+0000","last_fullsized":"2023-09-30T22:52:29.999725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245788+0000","last_change":"2023-09-30T22:52:28.989757+0000","last_active":"2023-09-30T22:52:30.245788+0000","last_peered":"2023-09-30T22:52:30.245788+0000","last_clean":"2023-09-30T22:52:30.245788+0000","last_became_active":"2023-09-30T22:52:28.989527+0000","last_became_peered":"2023-09-30T22:52:28.989527+0000","last_unstale":"2023-09-30T22:52:30.245788+0000","last_undegraded":"2023-09-30T22:52:30.245788+0000","last_fullsized":"2023-09-30T22:52:30.245788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002468+0000","last_change":"2023-09-30T22:52:30.001993+0000","last_active":"2023-09-30T22:52:30.002468+0000","last_peered":"2023-09-30T22:52:30.002468+0000","last_clean":"2023-09-30T22:52:30.002468+0000","last_became_active":"2023-09-30T22:52:30.001442+0000","last_became_peered":"2023-09-30T22:52:30.001442+0000","last_unstale":"2023-09-30T22:52:30.002468+0000","last_undegraded":"2023-09-30T22:52:30.002468+0000","last_fullsized":"2023-09-30T22:52:30.002468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.249324+0000","last_change":"2023-09-30T22:52:28.996750+0000","last_active":"2023-09-30T22:52:30.249324+0000","last_peered":"2023-09-30T22:52:30.249324+0000","last_clean":"2023-09-30T22:52:30.249324+0000","last_became_active":"2023-09-30T22:52:28.996452+0000","last_became_peered":"2023-09-30T22:52:28.996452+0000","last_unstale":"2023-09-30T22:52:30.249324+0000","last_undegraded":"2023-09-30T22:52:30.249324+0000","last_fullsized":"2023-09-30T22:52:30.249324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:27.626860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986641+0000","last_change":"2023-09-30T22:52:29.986448+0000","last_active":"2023-09-30T22:52:29.986641+0000","last_peered":"2023-09-30T22:52:29.986641+0000","last_clean":"2023-09-30T22:52:29.986641+0000","last_became_active":"2023-09-30T22:52:29.985949+0000","last_became_peered":"2023-09-30T22:52:29.985949+0000","last_unstale":"2023-09-30T22:52:29.986641+0000","last_undegraded":"2023-09-30T22:52:29.986641+0000","last_fullsized":"2023-09-30T22:52:29.986641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246918+0000","last_change":"2023-09-30T22:52:28.994103+0000","last_active":"2023-09-30T22:52:30.246918+0000","last_peered":"2023-09-30T22:52:30.246918+0000","last_clean":"2023-09-30T22:52:30.246918+0000","last_became_active":"2023-09-30T22:52:28.993565+0000","last_became_peered":"2023-09-30T22:52:28.993565+0000","last_unstale":"2023-09-30T22:52:30.246918+0000","last_undegraded":"2023-09-30T22:52:30.246918+0000","last_fullsized":"2023-09-30T22:52:30.246918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:13.263038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004432+0000","last_change":"2023-09-30T22:52:30.004350+0000","last_active":"2023-09-30T22:52:30.004432+0000","last_peered":"2023-09-30T22:52:30.004432+0000","last_clean":"2023-09-30T22:52:30.004432+0000","last_became_active":"2023-09-30T22:52:30.004122+0000","last_became_peered":"2023-09-30T22:52:30.004122+0000","last_unstale":"2023-09-30T22:52:30.004432+0000","last_undegraded":"2023-09-30T22:52:30.004432+0000","last_fullsized":"2023-09-30T22:52:30.004432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985835+0000","last_change":"2023-09-30T22:52:28.996489+0000","last_active":"2023-09-30T22:52:29.985835+0000","last_peered":"2023-09-30T22:52:29.985835+0000","last_clean":"2023-09-30T22:52:29.985835+0000","last_became_active":"2023-09-30T22:52:28.996265+0000","last_became_peered":"2023-09-30T22:52:28.996265+0000","last_unstale":"2023-09-30T22:52:29.985835+0000","last_undegraded":"2023-09-30T22:52:29.985835+0000","last_fullsized":"2023-09-30T22:52:29.985835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992971+0000","last_change":"2023-09-30T22:52:29.992910+0000","last_active":"2023-09-30T22:52:29.992971+0000","last_peered":"2023-09-30T22:52:29.992971+0000","last_clean":"2023-09-30T22:52:29.992971+0000","last_became_active":"2023-09-30T22:52:29.992692+0000","last_became_peered":"2023-09-30T22:52:29.992692+0000","last_unstale":"2023-09-30T22:52:29.992971+0000","last_undegraded":"2023-09-30T22:52:29.992971+0000","last_fullsized":"2023-09-30T22:52:29.992971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:48.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984470+0000","last_change":"2023-09-30T22:52:28.995355+0000","last_active":"2023-09-30T22:52:29.984470+0000","last_peered":"2023-09-30T22:52:29.984470+0000","last_clean":"2023-09-30T22:52:29.984470+0000","last_became_active":"2023-09-30T22:52:28.995101+0000","last_became_peered":"2023-09-30T22:52:28.995101+0000","last_unstale":"2023-09-30T22:52:29.984470+0000","last_undegraded":"2023-09-30T22:52:29.984470+0000","last_fullsized":"2023-09-30T22:52:29.984470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:42.659983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995682+0000","last_change":"2023-09-30T22:52:29.995214+0000","last_active":"2023-09-30T22:52:29.995682+0000","last_peered":"2023-09-30T22:52:29.995682+0000","last_clean":"2023-09-30T22:52:29.995682+0000","last_became_active":"2023-09-30T22:52:29.994812+0000","last_became_peered":"2023-09-30T22:52:29.994812+0000","last_unstale":"2023-09-30T22:52:29.995682+0000","last_undegraded":"2023-09-30T22:52:29.995682+0000","last_fullsized":"2023-09-30T22:52:29.995682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248817+0000","last_change":"2023-09-30T22:52:28.998681+0000","last_active":"2023-09-30T22:52:30.248817+0000","last_peered":"2023-09-30T22:52:30.248817+0000","last_clean":"2023-09-30T22:52:30.248817+0000","last_became_active":"2023-09-30T22:52:28.998134+0000","last_became_peered":"2023-09-30T22:52:28.998134+0000","last_unstale":"2023-09-30T22:52:30.248817+0000","last_undegraded":"2023-09-30T22:52:30.248817+0000","last_fullsized":"2023-09-30T22:52:30.248817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:20.038280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002410+0000","last_change":"2023-09-30T22:52:30.002333+0000","last_active":"2023-09-30T22:52:30.002410+0000","last_peered":"2023-09-30T22:52:30.002410+0000","last_clean":"2023-09-30T22:52:30.002410+0000","last_became_active":"2023-09-30T22:52:30.002100+0000","last_became_peered":"2023-09-30T22:52:30.002100+0000","last_unstale":"2023-09-30T22:52:30.002410+0000","last_undegraded":"2023-09-30T22:52:30.002410+0000","last_fullsized":"2023-09-30T22:52:30.002410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248442+0000","last_change":"2023-09-30T22:52:28.987245+0000","last_active":"2023-09-30T22:52:30.248442+0000","last_peered":"2023-09-30T22:52:30.248442+0000","last_clean":"2023-09-30T22:52:30.248442+0000","last_became_active":"2023-09-30T22:52:28.987022+0000","last_became_peered":"2023-09-30T22:52:28.987022+0000","last_unstale":"2023-09-30T22:52:30.248442+0000","last_undegraded":"2023-09-30T22:52:30.248442+0000","last_fullsized":"2023-09-30T22:52:30.248442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995980+0000","last_change":"2023-09-30T22:52:29.995141+0000","last_active":"2023-09-30T22:52:29.995980+0000","last_peered":"2023-09-30T22:52:29.995980+0000","last_clean":"2023-09-30T22:52:29.995980+0000","last_became_active":"2023-09-30T22:52:29.994512+0000","last_became_peered":"2023-09-30T22:52:29.994512+0000","last_unstale":"2023-09-30T22:52:29.995980+0000","last_undegraded":"2023-09-30T22:52:29.995980+0000","last_fullsized":"2023-09-30T22:52:29.995980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:49.646123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245185+0000","last_change":"2023-09-30T22:52:28.995188+0000","last_active":"2023-09-30T22:52:30.245185+0000","last_peered":"2023-09-30T22:52:30.245185+0000","last_clean":"2023-09-30T22:52:30.245185+0000","last_became_active":"2023-09-30T22:52:28.994967+0000","last_became_peered":"2023-09-30T22:52:28.994967+0000","last_unstale":"2023-09-30T22:52:30.245185+0000","last_undegraded":"2023-09-30T22:52:30.245185+0000","last_fullsized":"2023-09-30T22:52:30.245185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002064+0000","last_change":"2023-09-30T22:52:30.002007+0000","last_active":"2023-09-30T22:52:30.002064+0000","last_peered":"2023-09-30T22:52:30.002064+0000","last_clean":"2023-09-30T22:52:30.002064+0000","last_became_active":"2023-09-30T22:52:30.001460+0000","last_became_peered":"2023-09-30T22:52:30.001460+0000","last_unstale":"2023-09-30T22:52:30.002064+0000","last_undegraded":"2023-09-30T22:52:30.002064+0000","last_fullsized":"2023-09-30T22:52:30.002064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248680+0000","last_change":"2023-09-30T22:52:29.000836+0000","last_active":"2023-09-30T22:52:30.248680+0000","last_peered":"2023-09-30T22:52:30.248680+0000","last_clean":"2023-09-30T22:52:30.248680+0000","last_became_active":"2023-09-30T22:52:29.000596+0000","last_became_peered":"2023-09-30T22:52:29.000596+0000","last_unstale":"2023-09-30T22:52:30.248680+0000","last_undegraded":"2023-09-30T22:52:30.248680+0000","last_fullsized":"2023-09-30T22:52:30.248680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:52.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985152+0000","last_change":"2023-09-30T22:52:29.985065+0000","last_active":"2023-09-30T22:52:29.985152+0000","last_peered":"2023-09-30T22:52:29.985152+0000","last_clean":"2023-09-30T22:52:29.985152+0000","last_became_active":"2023-09-30T22:52:29.984838+0000","last_became_peered":"2023-09-30T22:52:29.984838+0000","last_unstale":"2023-09-30T22:52:29.985152+0000","last_undegraded":"2023-09-30T22:52:29.985152+0000","last_fullsized":"2023-09-30T22:52:29.985152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991396+0000","last_change":"2023-09-30T22:52:28.992846+0000","last_active":"2023-09-30T22:52:29.991396+0000","last_peered":"2023-09-30T22:52:29.991396+0000","last_clean":"2023-09-30T22:52:29.991396+0000","last_became_active":"2023-09-30T22:52:28.992621+0000","last_became_peered":"2023-09-30T22:52:28.992621+0000","last_unstale":"2023-09-30T22:52:29.991396+0000","last_undegraded":"2023-09-30T22:52:29.991396+0000","last_fullsized":"2023-09-30T22:52:29.991396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:15:35.415866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005444+0000","last_change":"2023-09-30T22:52:30.005297+0000","last_active":"2023-09-30T22:52:30.005444+0000","last_peered":"2023-09-30T22:52:30.005444+0000","last_clean":"2023-09-30T22:52:30.005444+0000","last_became_active":"2023-09-30T22:52:30.005071+0000","last_became_peered":"2023-09-30T22:52:30.005071+0000","last_unstale":"2023-09-30T22:52:30.005444+0000","last_undegraded":"2023-09-30T22:52:30.005444+0000","last_fullsized":"2023-09-30T22:52:30.005444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.988566+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.988328+0000","last_became_peered":"2023-09-30T22:52:28.988328+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000757+0000","last_change":"2023-09-30T22:52:30.000695+0000","last_active":"2023-09-30T22:52:30.000757+0000","last_peered":"2023-09-30T22:52:30.000757+0000","last_clean":"2023-09-30T22:52:30.000757+0000","last_became_active":"2023-09-30T22:52:30.000416+0000","last_became_peered":"2023-09-30T22:52:30.000416+0000","last_unstale":"2023-09-30T22:52:30.000757+0000","last_undegraded":"2023-09-30T22:52:30.000757+0000","last_fullsized":"2023-09-30T22:52:30.000757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982988+0000","last_change":"2023-09-30T22:52:28.993499+0000","last_active":"2023-09-30T22:52:29.982988+0000","last_peered":"2023-09-30T22:52:29.982988+0000","last_clean":"2023-09-30T22:52:29.982988+0000","last_became_active":"2023-09-30T22:52:28.990179+0000","last_became_peered":"2023-09-30T22:52:28.990179+0000","last_unstale":"2023-09-30T22:52:29.982988+0000","last_undegraded":"2023-09-30T22:52:29.982988+0000","last_fullsized":"2023-09-30T22:52:29.982988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:10.753274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995962+0000","last_change":"2023-09-30T22:52:29.995007+0000","last_active":"2023-09-30T22:52:29.995962+0000","last_peered":"2023-09-30T22:52:29.995962+0000","last_clean":"2023-09-30T22:52:29.995962+0000","last_became_active":"2023-09-30T22:52:29.994234+0000","last_became_peered":"2023-09-30T22:52:29.994234+0000","last_unstale":"2023-09-30T22:52:29.995962+0000","last_undegraded":"2023-09-30T22:52:29.995962+0000","last_fullsized":"2023-09-30T22:52:29.995962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:59:32.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982689+0000","last_change":"2023-09-30T22:52:28.995013+0000","last_active":"2023-09-30T22:52:29.982689+0000","last_peered":"2023-09-30T22:52:29.982689+0000","last_clean":"2023-09-30T22:52:29.982689+0000","last_became_active":"2023-09-30T22:52:28.994596+0000","last_became_peered":"2023-09-30T22:52:28.994596+0000","last_unstale":"2023-09-30T22:52:29.982689+0000","last_undegraded":"2023-09-30T22:52:29.982689+0000","last_fullsized":"2023-09-30T22:52:29.982689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:50.179162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986659+0000","last_change":"2023-09-30T22:52:29.986589+0000","last_active":"2023-09-30T22:52:29.986659+0000","last_peered":"2023-09-30T22:52:29.986659+0000","last_clean":"2023-09-30T22:52:29.986659+0000","last_became_active":"2023-09-30T22:52:29.986233+0000","last_became_peered":"2023-09-30T22:52:29.986233+0000","last_unstale":"2023-09-30T22:52:29.986659+0000","last_undegraded":"2023-09-30T22:52:29.986659+0000","last_fullsized":"2023-09-30T22:52:29.986659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993407+0000","last_change":"2023-09-30T22:52:28.992419+0000","last_active":"2023-09-30T22:52:29.993407+0000","last_peered":"2023-09-30T22:52:29.993407+0000","last_clean":"2023-09-30T22:52:29.993407+0000","last_became_active":"2023-09-30T22:52:28.992194+0000","last_became_peered":"2023-09-30T22:52:28.992194+0000","last_unstale":"2023-09-30T22:52:29.993407+0000","last_undegraded":"2023-09-30T22:52:29.993407+0000","last_fullsized":"2023-09-30T22:52:29.993407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005479+0000","last_change":"2023-09-30T22:52:30.005382+0000","last_active":"2023-09-30T22:52:30.005479+0000","last_peered":"2023-09-30T22:52:30.005479+0000","last_clean":"2023-09-30T22:52:30.005479+0000","last_became_active":"2023-09-30T22:52:30.005167+0000","last_became_peered":"2023-09-30T22:52:30.005167+0000","last_unstale":"2023-09-30T22:52:30.005479+0000","last_undegraded":"2023-09-30T22:52:30.005479+0000","last_fullsized":"2023-09-30T22:52:30.005479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991288+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:52:29.991288+0000","last_peered":"2023-09-30T22:52:29.991288+0000","last_clean":"2023-09-30T22:52:29.991288+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:52:29.991288+0000","last_undegraded":"2023-09-30T22:52:29.991288+0000","last_fullsized":"2023-09-30T22:52:29.991288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982887+0000","last_change":"2023-09-30T22:52:28.993144+0000","last_active":"2023-09-30T22:52:29.982887+0000","last_peered":"2023-09-30T22:52:29.982887+0000","last_clean":"2023-09-30T22:52:29.982887+0000","last_became_active":"2023-09-30T22:52:28.992932+0000","last_became_peered":"2023-09-30T22:52:28.992932+0000","last_unstale":"2023-09-30T22:52:29.982887+0000","last_undegraded":"2023-09-30T22:52:29.982887+0000","last_fullsized":"2023-09-30T22:52:29.982887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.987116+0000","last_change":"2023-09-30T22:52:29.987045+0000","last_active":"2023-09-30T22:52:29.987116+0000","last_peered":"2023-09-30T22:52:29.987116+0000","last_clean":"2023-09-30T22:52:29.987116+0000","last_became_active":"2023-09-30T22:52:29.986888+0000","last_became_peered":"2023-09-30T22:52:29.986888+0000","last_unstale":"2023-09-30T22:52:29.987116+0000","last_undegraded":"2023-09-30T22:52:29.987116+0000","last_fullsized":"2023-09-30T22:52:29.987116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984369+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:52:29.984369+0000","last_peered":"2023-09-30T22:52:29.984369+0000","last_clean":"2023-09-30T22:52:29.984369+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:52:29.984369+0000","last_undegraded":"2023-09-30T22:52:29.984369+0000","last_fullsized":"2023-09-30T22:52:29.984369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990050+0000","last_change":"2023-09-30T22:52:28.995710+0000","last_active":"2023-09-30T22:52:29.990050+0000","last_peered":"2023-09-30T22:52:29.990050+0000","last_clean":"2023-09-30T22:52:29.990050+0000","last_became_active":"2023-09-30T22:52:28.995466+0000","last_became_peered":"2023-09-30T22:52:28.995466+0000","last_unstale":"2023-09-30T22:52:29.990050+0000","last_undegraded":"2023-09-30T22:52:29.990050+0000","last_fullsized":"2023-09-30T22:52:29.990050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996250+0000","last_change":"2023-09-30T22:52:29.996115+0000","last_active":"2023-09-30T22:52:29.996250+0000","last_peered":"2023-09-30T22:52:29.996250+0000","last_clean":"2023-09-30T22:52:29.996250+0000","last_became_active":"2023-09-30T22:52:29.995868+0000","last_became_peered":"2023-09-30T22:52:29.995868+0000","last_unstale":"2023-09-30T22:52:29.996250+0000","last_undegraded":"2023-09-30T22:52:29.996250+0000","last_fullsized":"2023-09-30T22:52:29.996250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.989952+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:52:29.989952+0000","last_peered":"2023-09-30T22:52:29.989952+0000","last_clean":"2023-09-30T22:52:29.989952+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:52:29.989952+0000","last_undegraded":"2023-09-30T22:52:29.989952+0000","last_fullsized":"2023-09-30T22:52:29.989952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990961+0000","last_change":"2023-09-30T22:52:28.999654+0000","last_active":"2023-09-30T22:52:29.990961+0000","last_peered":"2023-09-30T22:52:29.990961+0000","last_clean":"2023-09-30T22:52:29.990961+0000","last_became_active":"2023-09-30T22:52:28.999396+0000","last_became_peered":"2023-09-30T22:52:28.999396+0000","last_unstale":"2023-09-30T22:52:29.990961+0000","last_undegraded":"2023-09-30T22:52:29.990961+0000","last_fullsized":"2023-09-30T22:52:29.990961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996005+0000","last_change":"2023-09-30T22:52:29.995237+0000","last_active":"2023-09-30T22:52:29.996005+0000","last_peered":"2023-09-30T22:52:29.996005+0000","last_clean":"2023-09-30T22:52:29.996005+0000","last_became_active":"2023-09-30T22:52:29.994975+0000","last_became_peered":"2023-09-30T22:52:29.994975+0000","last_unstale":"2023-09-30T22:52:29.996005+0000","last_undegraded":"2023-09-30T22:52:29.996005+0000","last_fullsized":"2023-09-30T22:52:29.996005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984408+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:52:29.984408+0000","last_peered":"2023-09-30T22:52:29.984408+0000","last_clean":"2023-09-30T22:52:29.984408+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:52:29.984408+0000","last_undegraded":"2023-09-30T22:52:29.984408+0000","last_fullsized":"2023-09-30T22:52:29.984408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990530+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:52:29.990530+0000","last_peered":"2023-09-30T22:52:29.990530+0000","last_clean":"2023-09-30T22:52:29.990530+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:52:29.990530+0000","last_undegraded":"2023-09-30T22:52:29.990530+0000","last_fullsized":"2023-09-30T22:52:29.990530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992306+0000","last_change":"2023-09-30T22:52:28.995976+0000","last_active":"2023-09-30T22:52:29.992306+0000","last_peered":"2023-09-30T22:52:29.992306+0000","last_clean":"2023-09-30T22:52:29.992306+0000","last_became_active":"2023-09-30T22:52:28.995724+0000","last_became_peered":"2023-09-30T22:52:28.995724+0000","last_unstale":"2023-09-30T22:52:29.992306+0000","last_undegraded":"2023-09-30T22:52:29.992306+0000","last_fullsized":"2023-09-30T22:52:29.992306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992841+0000","last_change":"2023-09-30T22:52:29.992622+0000","last_active":"2023-09-30T22:52:29.992841+0000","last_peered":"2023-09-30T22:52:29.992841+0000","last_clean":"2023-09-30T22:52:29.992841+0000","last_became_active":"2023-09-30T22:52:29.992005+0000","last_became_peered":"2023-09-30T22:52:29.992005+0000","last_unstale":"2023-09-30T22:52:29.992841+0000","last_undegraded":"2023-09-30T22:52:29.992841+0000","last_fullsized":"2023-09-30T22:52:29.992841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:28.590938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982896+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:52:29.982896+0000","last_peered":"2023-09-30T22:52:29.982896+0000","last_clean":"2023-09-30T22:52:29.982896+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:52:29.982896+0000","last_undegraded":"2023-09-30T22:52:29.982896+0000","last_fullsized":"2023-09-30T22:52:29.982896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985789+0000","last_change":"2023-09-30T22:52:28.994561+0000","last_active":"2023-09-30T22:52:29.985789+0000","last_peered":"2023-09-30T22:52:29.985789+0000","last_clean":"2023-09-30T22:52:29.985789+0000","last_became_active":"2023-09-30T22:52:28.994326+0000","last_became_peered":"2023-09-30T22:52:28.994326+0000","last_unstale":"2023-09-30T22:52:29.985789+0000","last_undegraded":"2023-09-30T22:52:29.985789+0000","last_fullsized":"2023-09-30T22:52:29.985789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:11.947068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994260+0000","last_change":"2023-09-30T22:52:29.994185+0000","last_active":"2023-09-30T22:52:29.994260+0000","last_peered":"2023-09-30T22:52:29.994260+0000","last_clean":"2023-09-30T22:52:29.994260+0000","last_became_active":"2023-09-30T22:52:29.993967+0000","last_became_peered":"2023-09-30T22:52:29.993967+0000","last_unstale":"2023-09-30T22:52:29.994260+0000","last_undegraded":"2023-09-30T22:52:29.994260+0000","last_fullsized":"2023-09-30T22:52:29.994260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982819+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:52:29.982819+0000","last_peered":"2023-09-30T22:52:29.982819+0000","last_clean":"2023-09-30T22:52:29.982819+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:52:29.982819+0000","last_undegraded":"2023-09-30T22:52:29.982819+0000","last_fullsized":"2023-09-30T22:52:29.982819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985802+0000","last_change":"2023-09-30T22:52:28.996536+0000","last_active":"2023-09-30T22:52:29.985802+0000","last_peered":"2023-09-30T22:52:29.985802+0000","last_clean":"2023-09-30T22:52:29.985802+0000","last_became_active":"2023-09-30T22:52:28.996306+0000","last_became_peered":"2023-09-30T22:52:28.996306+0000","last_unstale":"2023-09-30T22:52:29.985802+0000","last_undegraded":"2023-09-30T22:52:29.985802+0000","last_fullsized":"2023-09-30T22:52:29.985802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:55.045032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996026+0000","last_change":"2023-09-30T22:52:29.995265+0000","last_active":"2023-09-30T22:52:29.996026+0000","last_peered":"2023-09-30T22:52:29.996026+0000","last_clean":"2023-09-30T22:52:29.996026+0000","last_became_active":"2023-09-30T22:52:29.994582+0000","last_became_peered":"2023-09-30T22:52:29.994582+0000","last_unstale":"2023-09-30T22:52:29.996026+0000","last_undegraded":"2023-09-30T22:52:29.996026+0000","last_fullsized":"2023-09-30T22:52:29.996026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.995448+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.995132+0000","last_became_peered":"2023-09-30T22:52:28.995132+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993209+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:52:29.993209+0000","last_peered":"2023-09-30T22:52:29.993209+0000","last_clean":"2023-09-30T22:52:29.993209+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:52:29.993209+0000","last_undegraded":"2023-09-30T22:52:29.993209+0000","last_fullsized":"2023-09-30T22:52:29.993209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003796+0000","last_change":"2023-09-30T22:52:30.002605+0000","last_active":"2023-09-30T22:52:30.003796+0000","last_peered":"2023-09-30T22:52:30.003796+0000","last_clean":"2023-09-30T22:52:30.003796+0000","last_became_active":"2023-09-30T22:52:30.001819+0000","last_became_peered":"2023-09-30T22:52:30.001819+0000","last_unstale":"2023-09-30T22:52:30.003796+0000","last_undegraded":"2023-09-30T22:52:30.003796+0000","last_fullsized":"2023-09-30T22:52:30.003796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983742+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:52:29.983742+0000","last_peered":"2023-09-30T22:52:29.983742+0000","last_clean":"2023-09-30T22:52:29.983742+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:52:29.983742+0000","last_undegraded":"2023-09-30T22:52:29.983742+0000","last_fullsized":"2023-09-30T22:52:29.983742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.987321+0000","last_change":"2023-09-30T22:52:28.993895+0000","last_active":"2023-09-30T22:52:30.987321+0000","last_peered":"2023-09-30T22:52:30.987321+0000","last_clean":"2023-09-30T22:52:30.987321+0000","last_became_active":"2023-09-30T22:52:28.993671+0000","last_became_peered":"2023-09-30T22:52:28.993671+0000","last_unstale":"2023-09-30T22:52:30.987321+0000","last_undegraded":"2023-09-30T22:52:30.987321+0000","last_fullsized":"2023-09-30T22:52:30.987321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985123+0000","last_change":"2023-09-30T22:52:29.984764+0000","last_active":"2023-09-30T22:52:29.985123+0000","last_peered":"2023-09-30T22:52:29.985123+0000","last_clean":"2023-09-30T22:52:29.985123+0000","last_became_active":"2023-09-30T22:52:29.984512+0000","last_became_peered":"2023-09-30T22:52:29.984512+0000","last_unstale":"2023-09-30T22:52:29.985123+0000","last_undegraded":"2023-09-30T22:52:29.985123+0000","last_fullsized":"2023-09-30T22:52:29.985123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245152+0000","last_change":"2023-09-30T22:52:28.992724+0000","last_active":"2023-09-30T22:52:30.245152+0000","last_peered":"2023-09-30T22:52:30.245152+0000","last_clean":"2023-09-30T22:52:30.245152+0000","last_became_active":"2023-09-30T22:52:28.992475+0000","last_became_peered":"2023-09-30T22:52:28.992475+0000","last_unstale":"2023-09-30T22:52:30.245152+0000","last_undegraded":"2023-09-30T22:52:30.245152+0000","last_fullsized":"2023-09-30T22:52:30.245152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002489+0000","last_change":"2023-09-30T22:52:30.002130+0000","last_active":"2023-09-30T22:52:30.002489+0000","last_peered":"2023-09-30T22:52:30.002489+0000","last_clean":"2023-09-30T22:52:30.002489+0000","last_became_active":"2023-09-30T22:52:30.001756+0000","last_became_peered":"2023-09-30T22:52:30.001756+0000","last_unstale":"2023-09-30T22:52:30.002489+0000","last_undegraded":"2023-09-30T22:52:30.002489+0000","last_fullsized":"2023-09-30T22:52:30.002489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.247149+0000","last_change":"2023-09-30T22:52:28.988451+0000","last_active":"2023-09-30T22:52:30.247149+0000","last_peered":"2023-09-30T22:52:30.247149+0000","last_clean":"2023-09-30T22:52:30.247149+0000","last_became_active":"2023-09-30T22:52:28.988208+0000","last_became_peered":"2023-09-30T22:52:28.988208+0000","last_unstale":"2023-09-30T22:52:30.247149+0000","last_undegraded":"2023-09-30T22:52:30.247149+0000","last_fullsized":"2023-09-30T22:52:30.247149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994183+0000","last_change":"2023-09-30T22:52:29.994020+0000","last_active":"2023-09-30T22:52:29.994183+0000","last_peered":"2023-09-30T22:52:29.994183+0000","last_clean":"2023-09-30T22:52:29.994183+0000","last_became_active":"2023-09-30T22:52:29.993783+0000","last_became_peered":"2023-09-30T22:52:29.993783+0000","last_unstale":"2023-09-30T22:52:29.994183+0000","last_undegraded":"2023-09-30T22:52:29.994183+0000","last_fullsized":"2023-09-30T22:52:29.994183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246723+0000","last_change":"2023-09-30T22:52:28.994877+0000","last_active":"2023-09-30T22:52:30.246723+0000","last_peered":"2023-09-30T22:52:30.246723+0000","last_clean":"2023-09-30T22:52:30.246723+0000","last_became_active":"2023-09-30T22:52:28.993855+0000","last_became_peered":"2023-09-30T22:52:28.993855+0000","last_unstale":"2023-09-30T22:52:30.246723+0000","last_undegraded":"2023-09-30T22:52:30.246723+0000","last_fullsized":"2023-09-30T22:52:30.246723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:05.100032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.988016+0000","last_change":"2023-09-30T22:52:29.987968+0000","last_active":"2023-09-30T22:52:29.988016+0000","last_peered":"2023-09-30T22:52:29.988016+0000","last_clean":"2023-09-30T22:52:29.988016+0000","last_became_active":"2023-09-30T22:52:29.987840+0000","last_became_peered":"2023-09-30T22:52:29.987840+0000","last_unstale":"2023-09-30T22:52:29.988016+0000","last_undegraded":"2023-09-30T22:52:29.988016+0000","last_fullsized":"2023-09-30T22:52:29.988016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245418+0000","last_change":"2023-09-30T22:52:28.997114+0000","last_active":"2023-09-30T22:52:30.245418+0000","last_peered":"2023-09-30T22:52:30.245418+0000","last_clean":"2023-09-30T22:52:30.245418+0000","last_became_active":"2023-09-30T22:52:28.996627+0000","last_became_peered":"2023-09-30T22:52:28.996627+0000","last_unstale":"2023-09-30T22:52:30.245418+0000","last_undegraded":"2023-09-30T22:52:30.245418+0000","last_fullsized":"2023-09-30T22:52:30.245418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999051+0000","last_change":"2023-09-30T22:52:29.998983+0000","last_active":"2023-09-30T22:52:29.999051+0000","last_peered":"2023-09-30T22:52:29.999051+0000","last_clean":"2023-09-30T22:52:29.999051+0000","last_became_active":"2023-09-30T22:52:29.998760+0000","last_became_peered":"2023-09-30T22:52:29.998760+0000","last_unstale":"2023-09-30T22:52:29.999051+0000","last_undegraded":"2023-09-30T22:52:29.999051+0000","last_fullsized":"2023-09-30T22:52:29.999051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248249+0000","last_change":"2023-09-30T22:52:28.998655+0000","last_active":"2023-09-30T22:52:30.248249+0000","last_peered":"2023-09-30T22:52:30.248249+0000","last_clean":"2023-09-30T22:52:30.248249+0000","last_became_active":"2023-09-30T22:52:28.998409+0000","last_became_peered":"2023-09-30T22:52:28.998409+0000","last_unstale":"2023-09-30T22:52:30.248249+0000","last_undegraded":"2023-09-30T22:52:30.248249+0000","last_fullsized":"2023-09-30T22:52:30.248249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001122+0000","last_change":"2023-09-30T22:52:30.001062+0000","last_active":"2023-09-30T22:52:30.001122+0000","last_peered":"2023-09-30T22:52:30.001122+0000","last_clean":"2023-09-30T22:52:30.001122+0000","last_became_active":"2023-09-30T22:52:30.000803+0000","last_became_peered":"2023-09-30T22:52:30.000803+0000","last_unstale":"2023-09-30T22:52:30.001122+0000","last_undegraded":"2023-09-30T22:52:30.001122+0000","last_fullsized":"2023-09-30T22:52:30.001122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002078+0000","last_change":"2023-09-30T22:52:30.001992+0000","last_active":"2023-09-30T22:52:30.002078+0000","last_peered":"2023-09-30T22:52:30.002078+0000","last_clean":"2023-09-30T22:52:30.002078+0000","last_became_active":"2023-09-30T22:52:30.001745+0000","last_became_peered":"2023-09-30T22:52:30.001745+0000","last_unstale":"2023-09-30T22:52:30.002078+0000","last_undegraded":"2023-09-30T22:52:30.002078+0000","last_fullsized":"2023-09-30T22:52:30.002078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998638+0000","last_change":"2023-09-30T22:52:29.998560+0000","last_active":"2023-09-30T22:52:29.998638+0000","last_peered":"2023-09-30T22:52:29.998638+0000","last_clean":"2023-09-30T22:52:29.998638+0000","last_became_active":"2023-09-30T22:52:29.997840+0000","last_became_peered":"2023-09-30T22:52:29.997840+0000","last_unstale":"2023-09-30T22:52:29.998638+0000","last_undegraded":"2023-09-30T22:52:29.998638+0000","last_fullsized":"2023-09-30T22:52:29.998638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995699+0000","last_change":"2023-09-30T22:52:29.995634+0000","last_active":"2023-09-30T22:52:29.995699+0000","last_peered":"2023-09-30T22:52:29.995699+0000","last_clean":"2023-09-30T22:52:29.995699+0000","last_became_active":"2023-09-30T22:52:29.995407+0000","last_became_peered":"2023-09-30T22:52:29.995407+0000","last_unstale":"2023-09-30T22:52:29.995699+0000","last_undegraded":"2023-09-30T22:52:29.995699+0000","last_fullsized":"2023-09-30T22:52:29.995699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003196+0000","last_change":"2023-09-30T22:52:30.002695+0000","last_active":"2023-09-30T22:52:30.003196+0000","last_peered":"2023-09-30T22:52:30.003196+0000","last_clean":"2023-09-30T22:52:30.003196+0000","last_became_active":"2023-09-30T22:52:30.002463+0000","last_became_peered":"2023-09-30T22:52:30.002463+0000","last_unstale":"2023-09-30T22:52:30.003196+0000","last_undegraded":"2023-09-30T22:52:30.003196+0000","last_fullsized":"2023-09-30T22:52:30.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:25.402337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996203+0000","last_change":"2023-09-30T22:52:29.996129+0000","last_active":"2023-09-30T22:52:29.996203+0000","last_peered":"2023-09-30T22:52:29.996203+0000","last_clean":"2023-09-30T22:52:29.996203+0000","last_became_active":"2023-09-30T22:52:29.995897+0000","last_became_peered":"2023-09-30T22:52:29.995897+0000","last_unstale":"2023-09-30T22:52:29.996203+0000","last_undegraded":"2023-09-30T22:52:29.996203+0000","last_fullsized":"2023-09-30T22:52:29.996203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5190000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6339999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4580000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910695,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909305,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909201,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]}],"pool_statfs":[]}} 2023-09-30T22:52:40.095 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:52:40.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.318+0000 7f40183ff700 1 Processor -- start 2023-09-30T22:52:40.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.318+0000 7f40183ff700 1 -- start start 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f40183ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4010159ae0 0x7f40100cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f40183ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f40100b1180 0x7f40100cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f40183ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401015d910 con 0x7f4010159eb0 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f40183ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401015e920 con 0x7f4010159ae0 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f40183ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401015e490 con 0x7f40100b1180 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f401619b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4010159ae0 0x7f40100cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f401619b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4010159ae0 0x7f40100cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57556/0 (socket says 172.21.15.142:57556) 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f401619b700 1 -- 172.21.15.142:0/3397947757 learned_addr learned my addr 172.21.15.142:0/3397947757 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:40.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.319+0000 7f401599a700 1 --2- 172.21.15.142:0/3397947757 >> v2:172.21.15.148:3300/0 conn(0x7f40100b1180 0x7f40100cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f401619b700 1 -- 172.21.15.142:0/3397947757 >> v2:172.21.15.148:3300/0 conn(0x7f40100b1180 msgr2=0x7f40100cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:40.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f401619b700 1 --2- 172.21.15.142:0/3397947757 >> v2:172.21.15.148:3300/0 conn(0x7f40100b1180 0x7f40100cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f401619b700 1 -- 172.21.15.142:0/3397947757 >> v1:172.21.15.148:6789/0 conn(0x7f4010159eb0 legacy=0x7f4010068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f401619b700 1 -- 172.21.15.142:0/3397947757 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401015db60 con 0x7f4010159ae0 2023-09-30T22:52:40.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f401619b700 1 --2- 172.21.15.142:0/3397947757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f40100cdeb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4010067af0 tx=0x7f400c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb69e2473b81ddc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:40.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f4015199700 1 -- 172.21.15.142:0/3397947757 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c009e70 con 0x7f4010159ae0 2023-09-30T22:52:40.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f4015199700 1 -- 172.21.15.142:0/3397947757 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c00b860 con 0x7f4010159ae0 2023-09-30T22:52:40.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.320+0000 7f4015199700 1 -- 172.21.15.142:0/3397947757 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00bc00 con 0x7f4010159ae0 2023-09-30T22:52:40.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 -- 172.21.15.142:0/3397947757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 msgr2=0x7f40100cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 --2- 172.21.15.142:0/3397947757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f40100cdeb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4010067af0 tx=0x7f400c009250 comp rx=0 tx=0).stop 2023-09-30T22:52:40.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 -- 172.21.15.142:0/3397947757 shutdown_connections 2023-09-30T22:52:40.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 --2- 172.21.15.142:0/3397947757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f40100cdeb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 --2- 172.21.15.142:0/3397947757 >> v2:172.21.15.148:3300/0 conn(0x7f40100b1180 0x7f40100cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 -- 172.21.15.142:0/3397947757 >> 172.21.15.142:0/3397947757 conn(0x7f40100ce8b0 msgr2=0x7f40100cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:40.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 -- 172.21.15.142:0/3397947757 shutdown_connections 2023-09-30T22:52:40.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.321+0000 7f40183ff700 1 -- 172.21.15.142:0/3397947757 wait complete. 2023-09-30T22:52:40.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.322+0000 7f40183ff700 1 Processor -- start 2023-09-30T22:52:40.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.323+0000 7f40183ff700 1 -- start start 2023-09-30T22:52:40.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.323+0000 7f40183ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40100b1180 0x7f4010158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.323+0000 7f40183ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f401016a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f40183ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4010159eb0 0x7f401006ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f40183ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401016b4c0 con 0x7f4010159ae0 2023-09-30T22:52:40.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f40183ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40101593e0 con 0x7f4010159eb0 2023-09-30T22:52:40.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f40183ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401016aa10 con 0x7f40100b1180 2023-09-30T22:52:40.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f401016a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f401016a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57564/0 (socket says 172.21.15.142:57564) 2023-09-30T22:52:40.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 -- 172.21.15.142:0/2092851756 learned_addr learned my addr 172.21.15.142:0/2092851756 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:40.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401619b700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40100b1180 0x7f4010158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401699c700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4010159eb0 0x7f401006ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 -- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40100b1180 msgr2=0x7f4010158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40100b1180 0x7f4010158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 -- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4010159eb0 msgr2=0x7f401006ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4010159eb0 0x7f401006ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 -- 172.21.15.142:0/2092851756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0094f0 con 0x7f4010159ae0 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401699c700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4010159eb0 0x7f401006ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.324+0000 7f401599a700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f401016a4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f400000ec50 tx=0x7f40000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.325+0000 7f40067fc700 1 -- 172.21.15.142:0/2092851756 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000c9d0 con 0x7f4010159ae0 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.325+0000 7f40067fc700 1 -- 172.21.15.142:0/2092851756 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000cb30 con 0x7f4010159ae0 2023-09-30T22:52:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.325+0000 7f40067fc700 1 -- 172.21.15.142:0/2092851756 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000013470 con 0x7f4010159ae0 2023-09-30T22:52:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.325+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4010157560 con 0x7f4010159ae0 2023-09-30T22:52:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.325+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401016af00 con 0x7f4010159ae0 2023-09-30T22:52:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.326+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40101576f0 con 0x7f4010159ae0 2023-09-30T22:52:40.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.326+0000 7f40067fc700 1 -- 172.21.15.142:0/2092851756 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4000013860 con 0x7f4010159ae0 2023-09-30T22:52:40.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.327+0000 7f40067fc700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ff4067330 0x7f3ff40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.327+0000 7f40067fc700 1 -- 172.21.15.142:0/2092851756 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4000084fa0 con 0x7f4010159ae0 2023-09-30T22:52:40.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.327+0000 7f401619b700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ff4067330 0x7f3ff40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.328+0000 7f401619b700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ff4067330 0x7f3ff40697e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4010067af0 tx=0x7f400c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:40.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.332+0000 7f40067fc700 1 -- 172.21.15.142:0/2092851756 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4000051e00 con 0x7f4010159ae0 2023-09-30T22:52:40.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.517+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f401015de40 con 0x7f3ff4067330 2023-09-30T22:52:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.525+0000 7f40067fc700 1 -- 172.21.15.142:0/2092851756 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278821 (secure 0 0 0) 0x7f401015de40 con 0x7f3ff4067330 2023-09-30T22:52:40.529 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ff4067330 msgr2=0x7f3ff40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ff4067330 0x7f3ff40697e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4010067af0 tx=0x7f400c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 msgr2=0x7f401016a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f401016a4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f400000ec50 tx=0x7f40000091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 shutdown_connections 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ff4067330 0x7f3ff40697e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4010159eb0 0x7f401006ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40100b1180 0x7f4010158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 --2- 172.21.15.142:0/2092851756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4010159ae0 0x7f401016a4d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 >> 172.21.15.142:0/2092851756 conn(0x7f40100ce8b0 msgr2=0x7f40100b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:40.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 shutdown_connections 2023-09-30T22:52:40.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.529+0000 7f40183ff700 1 -- 172.21.15.142:0/2092851756 wait complete. 2023-09-30T22:52:40.532 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:52:40.546 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-09-30T22:52:40.104736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1854,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560645,"statfs":{"total":1600000000,"available":1598101380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002252"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999723+0000","last_change":"2023-09-30T22:52:29.999656+0000","last_active":"2023-09-30T22:52:29.999723+0000","last_peered":"2023-09-30T22:52:29.999723+0000","last_clean":"2023-09-30T22:52:29.999723+0000","last_became_active":"2023-09-30T22:52:29.999224+0000","last_became_peered":"2023-09-30T22:52:29.999224+0000","last_unstale":"2023-09-30T22:52:29.999723+0000","last_undegraded":"2023-09-30T22:52:29.999723+0000","last_fullsized":"2023-09-30T22:52:29.999723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000978+0000","last_change":"2023-09-30T22:52:30.000930+0000","last_active":"2023-09-30T22:52:30.000978+0000","last_peered":"2023-09-30T22:52:30.000978+0000","last_clean":"2023-09-30T22:52:30.000978+0000","last_became_active":"2023-09-30T22:52:30.000733+0000","last_became_peered":"2023-09-30T22:52:30.000733+0000","last_unstale":"2023-09-30T22:52:30.000978+0000","last_undegraded":"2023-09-30T22:52:30.000978+0000","last_fullsized":"2023-09-30T22:52:30.000978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996453+0000","last_change":"2023-09-30T22:52:29.996378+0000","last_active":"2023-09-30T22:52:29.996453+0000","last_peered":"2023-09-30T22:52:29.996453+0000","last_clean":"2023-09-30T22:52:29.996453+0000","last_became_active":"2023-09-30T22:52:29.996139+0000","last_became_peered":"2023-09-30T22:52:29.996139+0000","last_unstale":"2023-09-30T22:52:29.996453+0000","last_undegraded":"2023-09-30T22:52:29.996453+0000","last_fullsized":"2023-09-30T22:52:29.996453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994761+0000","last_change":"2023-09-30T22:52:29.994384+0000","last_active":"2023-09-30T22:52:29.994761+0000","last_peered":"2023-09-30T22:52:29.994761+0000","last_clean":"2023-09-30T22:52:29.994761+0000","last_became_active":"2023-09-30T22:52:29.994168+0000","last_became_peered":"2023-09-30T22:52:29.994168+0000","last_unstale":"2023-09-30T22:52:29.994761+0000","last_undegraded":"2023-09-30T22:52:29.994761+0000","last_fullsized":"2023-09-30T22:52:29.994761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004482+0000","last_change":"2023-09-30T22:52:30.004022+0000","last_active":"2023-09-30T22:52:30.004482+0000","last_peered":"2023-09-30T22:52:30.004482+0000","last_clean":"2023-09-30T22:52:30.004482+0000","last_became_active":"2023-09-30T22:52:30.003781+0000","last_became_peered":"2023-09-30T22:52:30.003781+0000","last_unstale":"2023-09-30T22:52:30.004482+0000","last_undegraded":"2023-09-30T22:52:30.004482+0000","last_fullsized":"2023-09-30T22:52:30.004482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986014+0000","last_change":"2023-09-30T22:52:29.985910+0000","last_active":"2023-09-30T22:52:29.986014+0000","last_peered":"2023-09-30T22:52:29.986014+0000","last_clean":"2023-09-30T22:52:29.986014+0000","last_became_active":"2023-09-30T22:52:29.985698+0000","last_became_peered":"2023-09-30T22:52:29.985698+0000","last_unstale":"2023-09-30T22:52:29.986014+0000","last_undegraded":"2023-09-30T22:52:29.986014+0000","last_fullsized":"2023-09-30T22:52:29.986014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:02:40.635094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992823+0000","last_change":"2023-09-30T22:52:29.992580+0000","last_active":"2023-09-30T22:52:29.992823+0000","last_peered":"2023-09-30T22:52:29.992823+0000","last_clean":"2023-09-30T22:52:29.992823+0000","last_became_active":"2023-09-30T22:52:29.992055+0000","last_became_peered":"2023-09-30T22:52:29.992055+0000","last_unstale":"2023-09-30T22:52:29.992823+0000","last_undegraded":"2023-09-30T22:52:29.992823+0000","last_fullsized":"2023-09-30T22:52:29.992823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:25.419873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992925+0000","last_change":"2023-09-30T22:52:29.992763+0000","last_active":"2023-09-30T22:52:29.992925+0000","last_peered":"2023-09-30T22:52:29.992925+0000","last_clean":"2023-09-30T22:52:29.992925+0000","last_became_active":"2023-09-30T22:52:29.992537+0000","last_became_peered":"2023-09-30T22:52:29.992537+0000","last_unstale":"2023-09-30T22:52:29.992925+0000","last_undegraded":"2023-09-30T22:52:29.992925+0000","last_fullsized":"2023-09-30T22:52:29.992925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005650+0000","last_change":"2023-09-30T22:52:30.005579+0000","last_active":"2023-09-30T22:52:30.005650+0000","last_peered":"2023-09-30T22:52:30.005650+0000","last_clean":"2023-09-30T22:52:30.005650+0000","last_became_active":"2023-09-30T22:52:30.005151+0000","last_became_peered":"2023-09-30T22:52:30.005151+0000","last_unstale":"2023-09-30T22:52:30.005650+0000","last_undegraded":"2023-09-30T22:52:30.005650+0000","last_fullsized":"2023-09-30T22:52:30.005650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998463+0000","last_change":"2023-09-30T22:52:29.998403+0000","last_active":"2023-09-30T22:52:29.998463+0000","last_peered":"2023-09-30T22:52:29.998463+0000","last_clean":"2023-09-30T22:52:29.998463+0000","last_became_active":"2023-09-30T22:52:29.998170+0000","last_became_peered":"2023-09-30T22:52:29.998170+0000","last_unstale":"2023-09-30T22:52:29.998463+0000","last_undegraded":"2023-09-30T22:52:29.998463+0000","last_fullsized":"2023-09-30T22:52:29.998463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:51.188433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994173+0000","last_change":"2023-09-30T22:52:29.993975+0000","last_active":"2023-09-30T22:52:29.994173+0000","last_peered":"2023-09-30T22:52:29.994173+0000","last_clean":"2023-09-30T22:52:29.994173+0000","last_became_active":"2023-09-30T22:52:29.993354+0000","last_became_peered":"2023-09-30T22:52:29.993354+0000","last_unstale":"2023-09-30T22:52:29.994173+0000","last_undegraded":"2023-09-30T22:52:29.994173+0000","last_fullsized":"2023-09-30T22:52:29.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995287+0000","last_change":"2023-09-30T22:52:29.995056+0000","last_active":"2023-09-30T22:52:29.995287+0000","last_peered":"2023-09-30T22:52:29.995287+0000","last_clean":"2023-09-30T22:52:29.995287+0000","last_became_active":"2023-09-30T22:52:29.994501+0000","last_became_peered":"2023-09-30T22:52:29.994501+0000","last_unstale":"2023-09-30T22:52:29.995287+0000","last_undegraded":"2023-09-30T22:52:29.995287+0000","last_fullsized":"2023-09-30T22:52:29.995287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998543+0000","last_change":"2023-09-30T22:52:29.998468+0000","last_active":"2023-09-30T22:52:29.998543+0000","last_peered":"2023-09-30T22:52:29.998543+0000","last_clean":"2023-09-30T22:52:29.998543+0000","last_became_active":"2023-09-30T22:52:29.998228+0000","last_became_peered":"2023-09-30T22:52:29.998228+0000","last_unstale":"2023-09-30T22:52:29.998543+0000","last_undegraded":"2023-09-30T22:52:29.998543+0000","last_fullsized":"2023-09-30T22:52:29.998543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002051+0000","last_change":"2023-09-30T22:52:30.001990+0000","last_active":"2023-09-30T22:52:30.002051+0000","last_peered":"2023-09-30T22:52:30.002051+0000","last_clean":"2023-09-30T22:52:30.002051+0000","last_became_active":"2023-09-30T22:52:30.001493+0000","last_became_peered":"2023-09-30T22:52:30.001493+0000","last_unstale":"2023-09-30T22:52:30.002051+0000","last_undegraded":"2023-09-30T22:52:30.002051+0000","last_fullsized":"2023-09-30T22:52:30.002051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999408+0000","last_change":"2023-09-30T22:52:29.999359+0000","last_active":"2023-09-30T22:52:29.999408+0000","last_peered":"2023-09-30T22:52:29.999408+0000","last_clean":"2023-09-30T22:52:29.999408+0000","last_became_active":"2023-09-30T22:52:29.999214+0000","last_became_peered":"2023-09-30T22:52:29.999214+0000","last_unstale":"2023-09-30T22:52:29.999408+0000","last_undegraded":"2023-09-30T22:52:29.999408+0000","last_fullsized":"2023-09-30T22:52:29.999408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995996+0000","last_change":"2023-09-30T22:52:29.995287+0000","last_active":"2023-09-30T22:52:29.995996+0000","last_peered":"2023-09-30T22:52:29.995996+0000","last_clean":"2023-09-30T22:52:29.995996+0000","last_became_active":"2023-09-30T22:52:29.994795+0000","last_became_peered":"2023-09-30T22:52:29.994795+0000","last_unstale":"2023-09-30T22:52:29.995996+0000","last_undegraded":"2023-09-30T22:52:29.995996+0000","last_fullsized":"2023-09-30T22:52:29.995996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:15:33.668598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999673+0000","last_change":"2023-09-30T22:52:29.999604+0000","last_active":"2023-09-30T22:52:29.999673+0000","last_peered":"2023-09-30T22:52:29.999673+0000","last_clean":"2023-09-30T22:52:29.999673+0000","last_became_active":"2023-09-30T22:52:29.999184+0000","last_became_peered":"2023-09-30T22:52:29.999184+0000","last_unstale":"2023-09-30T22:52:29.999673+0000","last_undegraded":"2023-09-30T22:52:29.999673+0000","last_fullsized":"2023-09-30T22:52:29.999673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994780+0000","last_change":"2023-09-30T22:52:29.994681+0000","last_active":"2023-09-30T22:52:29.994780+0000","last_peered":"2023-09-30T22:52:29.994780+0000","last_clean":"2023-09-30T22:52:29.994780+0000","last_became_active":"2023-09-30T22:52:29.994446+0000","last_became_peered":"2023-09-30T22:52:29.994446+0000","last_unstale":"2023-09-30T22:52:29.994780+0000","last_undegraded":"2023-09-30T22:52:29.994780+0000","last_fullsized":"2023-09-30T22:52:29.994780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996185+0000","last_change":"2023-09-30T22:52:29.995754+0000","last_active":"2023-09-30T22:52:29.996185+0000","last_peered":"2023-09-30T22:52:29.996185+0000","last_clean":"2023-09-30T22:52:29.996185+0000","last_became_active":"2023-09-30T22:52:29.995499+0000","last_became_peered":"2023-09-30T22:52:29.995499+0000","last_unstale":"2023-09-30T22:52:29.996185+0000","last_undegraded":"2023-09-30T22:52:29.996185+0000","last_fullsized":"2023-09-30T22:52:29.996185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002210+0000","last_change":"2023-09-30T22:52:30.002133+0000","last_active":"2023-09-30T22:52:30.002210+0000","last_peered":"2023-09-30T22:52:30.002210+0000","last_clean":"2023-09-30T22:52:30.002210+0000","last_became_active":"2023-09-30T22:52:30.001781+0000","last_became_peered":"2023-09-30T22:52:30.001781+0000","last_unstale":"2023-09-30T22:52:30.002210+0000","last_undegraded":"2023-09-30T22:52:30.002210+0000","last_fullsized":"2023-09-30T22:52:30.002210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003659+0000","last_change":"2023-09-30T22:52:30.003616+0000","last_active":"2023-09-30T22:52:30.003659+0000","last_peered":"2023-09-30T22:52:30.003659+0000","last_clean":"2023-09-30T22:52:30.003659+0000","last_became_active":"2023-09-30T22:52:30.003350+0000","last_became_peered":"2023-09-30T22:52:30.003350+0000","last_unstale":"2023-09-30T22:52:30.003659+0000","last_undegraded":"2023-09-30T22:52:30.003659+0000","last_fullsized":"2023-09-30T22:52:30.003659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003184+0000","last_change":"2023-09-30T22:52:30.003114+0000","last_active":"2023-09-30T22:52:30.003184+0000","last_peered":"2023-09-30T22:52:30.003184+0000","last_clean":"2023-09-30T22:52:30.003184+0000","last_became_active":"2023-09-30T22:52:30.002889+0000","last_became_peered":"2023-09-30T22:52:30.002889+0000","last_unstale":"2023-09-30T22:52:30.003184+0000","last_undegraded":"2023-09-30T22:52:30.003184+0000","last_fullsized":"2023-09-30T22:52:30.003184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.006633+0000","last_change":"2023-09-30T22:52:30.006559+0000","last_active":"2023-09-30T22:52:30.006633+0000","last_peered":"2023-09-30T22:52:30.006633+0000","last_clean":"2023-09-30T22:52:30.006633+0000","last_became_active":"2023-09-30T22:52:30.006332+0000","last_became_peered":"2023-09-30T22:52:30.006332+0000","last_unstale":"2023-09-30T22:52:30.006633+0000","last_undegraded":"2023-09-30T22:52:30.006633+0000","last_fullsized":"2023-09-30T22:52:30.006633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002227+0000","last_change":"2023-09-30T22:52:30.002139+0000","last_active":"2023-09-30T22:52:30.002227+0000","last_peered":"2023-09-30T22:52:30.002227+0000","last_clean":"2023-09-30T22:52:30.002227+0000","last_became_active":"2023-09-30T22:52:30.001805+0000","last_became_peered":"2023-09-30T22:52:30.001805+0000","last_unstale":"2023-09-30T22:52:30.002227+0000","last_undegraded":"2023-09-30T22:52:30.002227+0000","last_fullsized":"2023-09-30T22:52:30.002227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:53:08.902885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001758+0000","last_change":"2023-09-30T22:52:30.001685+0000","last_active":"2023-09-30T22:52:30.001758+0000","last_peered":"2023-09-30T22:52:30.001758+0000","last_clean":"2023-09-30T22:52:30.001758+0000","last_became_active":"2023-09-30T22:52:30.001423+0000","last_became_peered":"2023-09-30T22:52:30.001423+0000","last_unstale":"2023-09-30T22:52:30.001758+0000","last_undegraded":"2023-09-30T22:52:30.001758+0000","last_fullsized":"2023-09-30T22:52:30.001758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005462+0000","last_change":"2023-09-30T22:52:30.004937+0000","last_active":"2023-09-30T22:52:30.005462+0000","last_peered":"2023-09-30T22:52:30.005462+0000","last_clean":"2023-09-30T22:52:30.005462+0000","last_became_active":"2023-09-30T22:52:30.004706+0000","last_became_peered":"2023-09-30T22:52:30.004706+0000","last_unstale":"2023-09-30T22:52:30.005462+0000","last_undegraded":"2023-09-30T22:52:30.005462+0000","last_fullsized":"2023-09-30T22:52:30.005462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:43.669254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992856+0000","last_change":"2023-09-30T22:52:29.992721+0000","last_active":"2023-09-30T22:52:29.992856+0000","last_peered":"2023-09-30T22:52:29.992856+0000","last_clean":"2023-09-30T22:52:29.992856+0000","last_became_active":"2023-09-30T22:52:29.992342+0000","last_became_peered":"2023-09-30T22:52:29.992342+0000","last_unstale":"2023-09-30T22:52:29.992856+0000","last_undegraded":"2023-09-30T22:52:29.992856+0000","last_fullsized":"2023-09-30T22:52:29.992856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:24.803074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248905+0000","last_change":"2023-09-30T22:52:28.998829+0000","last_active":"2023-09-30T22:52:30.248905+0000","last_peered":"2023-09-30T22:52:30.248905+0000","last_clean":"2023-09-30T22:52:30.248905+0000","last_became_active":"2023-09-30T22:52:28.998455+0000","last_became_peered":"2023-09-30T22:52:28.998455+0000","last_unstale":"2023-09-30T22:52:30.248905+0000","last_undegraded":"2023-09-30T22:52:30.248905+0000","last_fullsized":"2023-09-30T22:52:30.248905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998559+0000","last_change":"2023-09-30T22:52:29.998485+0000","last_active":"2023-09-30T22:52:29.998559+0000","last_peered":"2023-09-30T22:52:29.998559+0000","last_clean":"2023-09-30T22:52:29.998559+0000","last_became_active":"2023-09-30T22:52:29.998254+0000","last_became_peered":"2023-09-30T22:52:29.998254+0000","last_unstale":"2023-09-30T22:52:29.998559+0000","last_undegraded":"2023-09-30T22:52:29.998559+0000","last_fullsized":"2023-09-30T22:52:29.998559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992280+0000","last_change":"2023-09-30T22:52:28.992995+0000","last_active":"2023-09-30T22:52:29.992280+0000","last_peered":"2023-09-30T22:52:29.992280+0000","last_clean":"2023-09-30T22:52:29.992280+0000","last_became_active":"2023-09-30T22:52:28.992765+0000","last_became_peered":"2023-09-30T22:52:28.992765+0000","last_unstale":"2023-09-30T22:52:29.992280+0000","last_undegraded":"2023-09-30T22:52:29.992280+0000","last_fullsized":"2023-09-30T22:52:29.992280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004464+0000","last_change":"2023-09-30T22:52:30.003848+0000","last_active":"2023-09-30T22:52:30.004464+0000","last_peered":"2023-09-30T22:52:30.004464+0000","last_clean":"2023-09-30T22:52:30.004464+0000","last_became_active":"2023-09-30T22:52:30.002282+0000","last_became_peered":"2023-09-30T22:52:30.002282+0000","last_unstale":"2023-09-30T22:52:30.004464+0000","last_undegraded":"2023-09-30T22:52:30.004464+0000","last_fullsized":"2023-09-30T22:52:30.004464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991202+0000","last_change":"2023-09-30T22:52:28.998425+0000","last_active":"2023-09-30T22:52:29.991202+0000","last_peered":"2023-09-30T22:52:29.991202+0000","last_clean":"2023-09-30T22:52:29.991202+0000","last_became_active":"2023-09-30T22:52:28.998147+0000","last_became_peered":"2023-09-30T22:52:28.998147+0000","last_unstale":"2023-09-30T22:52:29.991202+0000","last_undegraded":"2023-09-30T22:52:29.991202+0000","last_fullsized":"2023-09-30T22:52:29.991202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996031+0000","last_change":"2023-09-30T22:52:29.995807+0000","last_active":"2023-09-30T22:52:29.996031+0000","last_peered":"2023-09-30T22:52:29.996031+0000","last_clean":"2023-09-30T22:52:29.996031+0000","last_became_active":"2023-09-30T22:52:29.995537+0000","last_became_peered":"2023-09-30T22:52:29.995537+0000","last_unstale":"2023-09-30T22:52:29.996031+0000","last_undegraded":"2023-09-30T22:52:29.996031+0000","last_fullsized":"2023-09-30T22:52:29.996031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:34.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993246+0000","last_change":"2023-09-30T22:52:28.998533+0000","last_active":"2023-09-30T22:52:29.993246+0000","last_peered":"2023-09-30T22:52:29.993246+0000","last_clean":"2023-09-30T22:52:29.993246+0000","last_became_active":"2023-09-30T22:52:28.998113+0000","last_became_peered":"2023-09-30T22:52:28.998113+0000","last_unstale":"2023-09-30T22:52:29.993246+0000","last_undegraded":"2023-09-30T22:52:29.993246+0000","last_fullsized":"2023-09-30T22:52:29.993246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993991+0000","last_change":"2023-09-30T22:52:29.993919+0000","last_active":"2023-09-30T22:52:29.993991+0000","last_peered":"2023-09-30T22:52:29.993991+0000","last_clean":"2023-09-30T22:52:29.993991+0000","last_became_active":"2023-09-30T22:52:29.993688+0000","last_became_peered":"2023-09-30T22:52:29.993688+0000","last_unstale":"2023-09-30T22:52:29.993991+0000","last_undegraded":"2023-09-30T22:52:29.993991+0000","last_fullsized":"2023-09-30T22:52:29.993991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983128+0000","last_change":"2023-09-30T22:52:28.996877+0000","last_active":"2023-09-30T22:52:29.983128+0000","last_peered":"2023-09-30T22:52:29.983128+0000","last_clean":"2023-09-30T22:52:29.983128+0000","last_became_active":"2023-09-30T22:52:28.996514+0000","last_became_peered":"2023-09-30T22:52:28.996514+0000","last_unstale":"2023-09-30T22:52:29.983128+0000","last_undegraded":"2023-09-30T22:52:29.983128+0000","last_fullsized":"2023-09-30T22:52:29.983128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999725+0000","last_change":"2023-09-30T22:52:29.999648+0000","last_active":"2023-09-30T22:52:29.999725+0000","last_peered":"2023-09-30T22:52:29.999725+0000","last_clean":"2023-09-30T22:52:29.999725+0000","last_became_active":"2023-09-30T22:52:29.999326+0000","last_became_peered":"2023-09-30T22:52:29.999326+0000","last_unstale":"2023-09-30T22:52:29.999725+0000","last_undegraded":"2023-09-30T22:52:29.999725+0000","last_fullsized":"2023-09-30T22:52:29.999725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:35.281047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245788+0000","last_change":"2023-09-30T22:52:28.989757+0000","last_active":"2023-09-30T22:52:30.245788+0000","last_peered":"2023-09-30T22:52:30.245788+0000","last_clean":"2023-09-30T22:52:30.245788+0000","last_became_active":"2023-09-30T22:52:28.989527+0000","last_became_peered":"2023-09-30T22:52:28.989527+0000","last_unstale":"2023-09-30T22:52:30.245788+0000","last_undegraded":"2023-09-30T22:52:30.245788+0000","last_fullsized":"2023-09-30T22:52:30.245788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:13.491358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002468+0000","last_change":"2023-09-30T22:52:30.001993+0000","last_active":"2023-09-30T22:52:30.002468+0000","last_peered":"2023-09-30T22:52:30.002468+0000","last_clean":"2023-09-30T22:52:30.002468+0000","last_became_active":"2023-09-30T22:52:30.001442+0000","last_became_peered":"2023-09-30T22:52:30.001442+0000","last_unstale":"2023-09-30T22:52:30.002468+0000","last_undegraded":"2023-09-30T22:52:30.002468+0000","last_fullsized":"2023-09-30T22:52:30.002468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.249324+0000","last_change":"2023-09-30T22:52:28.996750+0000","last_active":"2023-09-30T22:52:30.249324+0000","last_peered":"2023-09-30T22:52:30.249324+0000","last_clean":"2023-09-30T22:52:30.249324+0000","last_became_active":"2023-09-30T22:52:28.996452+0000","last_became_peered":"2023-09-30T22:52:28.996452+0000","last_unstale":"2023-09-30T22:52:30.249324+0000","last_undegraded":"2023-09-30T22:52:30.249324+0000","last_fullsized":"2023-09-30T22:52:30.249324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:27.626860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986641+0000","last_change":"2023-09-30T22:52:29.986448+0000","last_active":"2023-09-30T22:52:29.986641+0000","last_peered":"2023-09-30T22:52:29.986641+0000","last_clean":"2023-09-30T22:52:29.986641+0000","last_became_active":"2023-09-30T22:52:29.985949+0000","last_became_peered":"2023-09-30T22:52:29.985949+0000","last_unstale":"2023-09-30T22:52:29.986641+0000","last_undegraded":"2023-09-30T22:52:29.986641+0000","last_fullsized":"2023-09-30T22:52:29.986641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246918+0000","last_change":"2023-09-30T22:52:28.994103+0000","last_active":"2023-09-30T22:52:30.246918+0000","last_peered":"2023-09-30T22:52:30.246918+0000","last_clean":"2023-09-30T22:52:30.246918+0000","last_became_active":"2023-09-30T22:52:28.993565+0000","last_became_peered":"2023-09-30T22:52:28.993565+0000","last_unstale":"2023-09-30T22:52:30.246918+0000","last_undegraded":"2023-09-30T22:52:30.246918+0000","last_fullsized":"2023-09-30T22:52:30.246918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:13.263038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.004432+0000","last_change":"2023-09-30T22:52:30.004350+0000","last_active":"2023-09-30T22:52:30.004432+0000","last_peered":"2023-09-30T22:52:30.004432+0000","last_clean":"2023-09-30T22:52:30.004432+0000","last_became_active":"2023-09-30T22:52:30.004122+0000","last_became_peered":"2023-09-30T22:52:30.004122+0000","last_unstale":"2023-09-30T22:52:30.004432+0000","last_undegraded":"2023-09-30T22:52:30.004432+0000","last_fullsized":"2023-09-30T22:52:30.004432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985835+0000","last_change":"2023-09-30T22:52:28.996489+0000","last_active":"2023-09-30T22:52:29.985835+0000","last_peered":"2023-09-30T22:52:29.985835+0000","last_clean":"2023-09-30T22:52:29.985835+0000","last_became_active":"2023-09-30T22:52:28.996265+0000","last_became_peered":"2023-09-30T22:52:28.996265+0000","last_unstale":"2023-09-30T22:52:29.985835+0000","last_undegraded":"2023-09-30T22:52:29.985835+0000","last_fullsized":"2023-09-30T22:52:29.985835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992971+0000","last_change":"2023-09-30T22:52:29.992910+0000","last_active":"2023-09-30T22:52:29.992971+0000","last_peered":"2023-09-30T22:52:29.992971+0000","last_clean":"2023-09-30T22:52:29.992971+0000","last_became_active":"2023-09-30T22:52:29.992692+0000","last_became_peered":"2023-09-30T22:52:29.992692+0000","last_unstale":"2023-09-30T22:52:29.992971+0000","last_undegraded":"2023-09-30T22:52:29.992971+0000","last_fullsized":"2023-09-30T22:52:29.992971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:48.083326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984470+0000","last_change":"2023-09-30T22:52:28.995355+0000","last_active":"2023-09-30T22:52:29.984470+0000","last_peered":"2023-09-30T22:52:29.984470+0000","last_clean":"2023-09-30T22:52:29.984470+0000","last_became_active":"2023-09-30T22:52:28.995101+0000","last_became_peered":"2023-09-30T22:52:28.995101+0000","last_unstale":"2023-09-30T22:52:29.984470+0000","last_undegraded":"2023-09-30T22:52:29.984470+0000","last_fullsized":"2023-09-30T22:52:29.984470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:42.659983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995682+0000","last_change":"2023-09-30T22:52:29.995214+0000","last_active":"2023-09-30T22:52:29.995682+0000","last_peered":"2023-09-30T22:52:29.995682+0000","last_clean":"2023-09-30T22:52:29.995682+0000","last_became_active":"2023-09-30T22:52:29.994812+0000","last_became_peered":"2023-09-30T22:52:29.994812+0000","last_unstale":"2023-09-30T22:52:29.995682+0000","last_undegraded":"2023-09-30T22:52:29.995682+0000","last_fullsized":"2023-09-30T22:52:29.995682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:52:08.555844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248817+0000","last_change":"2023-09-30T22:52:28.998681+0000","last_active":"2023-09-30T22:52:30.248817+0000","last_peered":"2023-09-30T22:52:30.248817+0000","last_clean":"2023-09-30T22:52:30.248817+0000","last_became_active":"2023-09-30T22:52:28.998134+0000","last_became_peered":"2023-09-30T22:52:28.998134+0000","last_unstale":"2023-09-30T22:52:30.248817+0000","last_undegraded":"2023-09-30T22:52:30.248817+0000","last_fullsized":"2023-09-30T22:52:30.248817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:20.038280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002410+0000","last_change":"2023-09-30T22:52:30.002333+0000","last_active":"2023-09-30T22:52:30.002410+0000","last_peered":"2023-09-30T22:52:30.002410+0000","last_clean":"2023-09-30T22:52:30.002410+0000","last_became_active":"2023-09-30T22:52:30.002100+0000","last_became_peered":"2023-09-30T22:52:30.002100+0000","last_unstale":"2023-09-30T22:52:30.002410+0000","last_undegraded":"2023-09-30T22:52:30.002410+0000","last_fullsized":"2023-09-30T22:52:30.002410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:39.892244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248442+0000","last_change":"2023-09-30T22:52:28.987245+0000","last_active":"2023-09-30T22:52:30.248442+0000","last_peered":"2023-09-30T22:52:30.248442+0000","last_clean":"2023-09-30T22:52:30.248442+0000","last_became_active":"2023-09-30T22:52:28.987022+0000","last_became_peered":"2023-09-30T22:52:28.987022+0000","last_unstale":"2023-09-30T22:52:30.248442+0000","last_undegraded":"2023-09-30T22:52:30.248442+0000","last_fullsized":"2023-09-30T22:52:30.248442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995980+0000","last_change":"2023-09-30T22:52:29.995141+0000","last_active":"2023-09-30T22:52:29.995980+0000","last_peered":"2023-09-30T22:52:29.995980+0000","last_clean":"2023-09-30T22:52:29.995980+0000","last_became_active":"2023-09-30T22:52:29.994512+0000","last_became_peered":"2023-09-30T22:52:29.994512+0000","last_unstale":"2023-09-30T22:52:29.995980+0000","last_undegraded":"2023-09-30T22:52:29.995980+0000","last_fullsized":"2023-09-30T22:52:29.995980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:49.646123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245185+0000","last_change":"2023-09-30T22:52:28.995188+0000","last_active":"2023-09-30T22:52:30.245185+0000","last_peered":"2023-09-30T22:52:30.245185+0000","last_clean":"2023-09-30T22:52:30.245185+0000","last_became_active":"2023-09-30T22:52:28.994967+0000","last_became_peered":"2023-09-30T22:52:28.994967+0000","last_unstale":"2023-09-30T22:52:30.245185+0000","last_undegraded":"2023-09-30T22:52:30.245185+0000","last_fullsized":"2023-09-30T22:52:30.245185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002064+0000","last_change":"2023-09-30T22:52:30.002007+0000","last_active":"2023-09-30T22:52:30.002064+0000","last_peered":"2023-09-30T22:52:30.002064+0000","last_clean":"2023-09-30T22:52:30.002064+0000","last_became_active":"2023-09-30T22:52:30.001460+0000","last_became_peered":"2023-09-30T22:52:30.001460+0000","last_unstale":"2023-09-30T22:52:30.002064+0000","last_undegraded":"2023-09-30T22:52:30.002064+0000","last_fullsized":"2023-09-30T22:52:30.002064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:12.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248680+0000","last_change":"2023-09-30T22:52:29.000836+0000","last_active":"2023-09-30T22:52:30.248680+0000","last_peered":"2023-09-30T22:52:30.248680+0000","last_clean":"2023-09-30T22:52:30.248680+0000","last_became_active":"2023-09-30T22:52:29.000596+0000","last_became_peered":"2023-09-30T22:52:29.000596+0000","last_unstale":"2023-09-30T22:52:30.248680+0000","last_undegraded":"2023-09-30T22:52:30.248680+0000","last_fullsized":"2023-09-30T22:52:30.248680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:52.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985152+0000","last_change":"2023-09-30T22:52:29.985065+0000","last_active":"2023-09-30T22:52:29.985152+0000","last_peered":"2023-09-30T22:52:29.985152+0000","last_clean":"2023-09-30T22:52:29.985152+0000","last_became_active":"2023-09-30T22:52:29.984838+0000","last_became_peered":"2023-09-30T22:52:29.984838+0000","last_unstale":"2023-09-30T22:52:29.985152+0000","last_undegraded":"2023-09-30T22:52:29.985152+0000","last_fullsized":"2023-09-30T22:52:29.985152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991396+0000","last_change":"2023-09-30T22:52:28.992846+0000","last_active":"2023-09-30T22:52:29.991396+0000","last_peered":"2023-09-30T22:52:29.991396+0000","last_clean":"2023-09-30T22:52:29.991396+0000","last_became_active":"2023-09-30T22:52:28.992621+0000","last_became_peered":"2023-09-30T22:52:28.992621+0000","last_unstale":"2023-09-30T22:52:29.991396+0000","last_undegraded":"2023-09-30T22:52:29.991396+0000","last_fullsized":"2023-09-30T22:52:29.991396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:15:35.415866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005444+0000","last_change":"2023-09-30T22:52:30.005297+0000","last_active":"2023-09-30T22:52:30.005444+0000","last_peered":"2023-09-30T22:52:30.005444+0000","last_clean":"2023-09-30T22:52:30.005444+0000","last_became_active":"2023-09-30T22:52:30.005071+0000","last_became_peered":"2023-09-30T22:52:30.005071+0000","last_unstale":"2023-09-30T22:52:30.005444+0000","last_undegraded":"2023-09-30T22:52:30.005444+0000","last_fullsized":"2023-09-30T22:52:30.005444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.988566+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.988328+0000","last_became_peered":"2023-09-30T22:52:28.988328+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.000757+0000","last_change":"2023-09-30T22:52:30.000695+0000","last_active":"2023-09-30T22:52:30.000757+0000","last_peered":"2023-09-30T22:52:30.000757+0000","last_clean":"2023-09-30T22:52:30.000757+0000","last_became_active":"2023-09-30T22:52:30.000416+0000","last_became_peered":"2023-09-30T22:52:30.000416+0000","last_unstale":"2023-09-30T22:52:30.000757+0000","last_undegraded":"2023-09-30T22:52:30.000757+0000","last_fullsized":"2023-09-30T22:52:30.000757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982988+0000","last_change":"2023-09-30T22:52:28.993499+0000","last_active":"2023-09-30T22:52:29.982988+0000","last_peered":"2023-09-30T22:52:29.982988+0000","last_clean":"2023-09-30T22:52:29.982988+0000","last_became_active":"2023-09-30T22:52:28.990179+0000","last_became_peered":"2023-09-30T22:52:28.990179+0000","last_unstale":"2023-09-30T22:52:29.982988+0000","last_undegraded":"2023-09-30T22:52:29.982988+0000","last_fullsized":"2023-09-30T22:52:29.982988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:10.753274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995962+0000","last_change":"2023-09-30T22:52:29.995007+0000","last_active":"2023-09-30T22:52:29.995962+0000","last_peered":"2023-09-30T22:52:29.995962+0000","last_clean":"2023-09-30T22:52:29.995962+0000","last_became_active":"2023-09-30T22:52:29.994234+0000","last_became_peered":"2023-09-30T22:52:29.994234+0000","last_unstale":"2023-09-30T22:52:29.995962+0000","last_undegraded":"2023-09-30T22:52:29.995962+0000","last_fullsized":"2023-09-30T22:52:29.995962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:59:32.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982689+0000","last_change":"2023-09-30T22:52:28.995013+0000","last_active":"2023-09-30T22:52:29.982689+0000","last_peered":"2023-09-30T22:52:29.982689+0000","last_clean":"2023-09-30T22:52:29.982689+0000","last_became_active":"2023-09-30T22:52:28.994596+0000","last_became_peered":"2023-09-30T22:52:28.994596+0000","last_unstale":"2023-09-30T22:52:29.982689+0000","last_undegraded":"2023-09-30T22:52:29.982689+0000","last_fullsized":"2023-09-30T22:52:29.982689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:50.179162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.986659+0000","last_change":"2023-09-30T22:52:29.986589+0000","last_active":"2023-09-30T22:52:29.986659+0000","last_peered":"2023-09-30T22:52:29.986659+0000","last_clean":"2023-09-30T22:52:29.986659+0000","last_became_active":"2023-09-30T22:52:29.986233+0000","last_became_peered":"2023-09-30T22:52:29.986233+0000","last_unstale":"2023-09-30T22:52:29.986659+0000","last_undegraded":"2023-09-30T22:52:29.986659+0000","last_fullsized":"2023-09-30T22:52:29.986659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:14.272309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993407+0000","last_change":"2023-09-30T22:52:28.992419+0000","last_active":"2023-09-30T22:52:29.993407+0000","last_peered":"2023-09-30T22:52:29.993407+0000","last_clean":"2023-09-30T22:52:29.993407+0000","last_became_active":"2023-09-30T22:52:28.992194+0000","last_became_peered":"2023-09-30T22:52:28.992194+0000","last_unstale":"2023-09-30T22:52:29.993407+0000","last_undegraded":"2023-09-30T22:52:29.993407+0000","last_fullsized":"2023-09-30T22:52:29.993407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.005479+0000","last_change":"2023-09-30T22:52:30.005382+0000","last_active":"2023-09-30T22:52:30.005479+0000","last_peered":"2023-09-30T22:52:30.005479+0000","last_clean":"2023-09-30T22:52:30.005479+0000","last_became_active":"2023-09-30T22:52:30.005167+0000","last_became_peered":"2023-09-30T22:52:30.005167+0000","last_unstale":"2023-09-30T22:52:30.005479+0000","last_undegraded":"2023-09-30T22:52:30.005479+0000","last_fullsized":"2023-09-30T22:52:30.005479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.991288+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:52:29.991288+0000","last_peered":"2023-09-30T22:52:29.991288+0000","last_clean":"2023-09-30T22:52:29.991288+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:52:29.991288+0000","last_undegraded":"2023-09-30T22:52:29.991288+0000","last_fullsized":"2023-09-30T22:52:29.991288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982887+0000","last_change":"2023-09-30T22:52:28.993144+0000","last_active":"2023-09-30T22:52:29.982887+0000","last_peered":"2023-09-30T22:52:29.982887+0000","last_clean":"2023-09-30T22:52:29.982887+0000","last_became_active":"2023-09-30T22:52:28.992932+0000","last_became_peered":"2023-09-30T22:52:28.992932+0000","last_unstale":"2023-09-30T22:52:29.982887+0000","last_undegraded":"2023-09-30T22:52:29.982887+0000","last_fullsized":"2023-09-30T22:52:29.982887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:51.121896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.987116+0000","last_change":"2023-09-30T22:52:29.987045+0000","last_active":"2023-09-30T22:52:29.987116+0000","last_peered":"2023-09-30T22:52:29.987116+0000","last_clean":"2023-09-30T22:52:29.987116+0000","last_became_active":"2023-09-30T22:52:29.986888+0000","last_became_peered":"2023-09-30T22:52:29.986888+0000","last_unstale":"2023-09-30T22:52:29.987116+0000","last_undegraded":"2023-09-30T22:52:29.987116+0000","last_fullsized":"2023-09-30T22:52:29.987116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:27.563024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984369+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:52:29.984369+0000","last_peered":"2023-09-30T22:52:29.984369+0000","last_clean":"2023-09-30T22:52:29.984369+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:52:29.984369+0000","last_undegraded":"2023-09-30T22:52:29.984369+0000","last_fullsized":"2023-09-30T22:52:29.984369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990050+0000","last_change":"2023-09-30T22:52:28.995710+0000","last_active":"2023-09-30T22:52:29.990050+0000","last_peered":"2023-09-30T22:52:29.990050+0000","last_clean":"2023-09-30T22:52:29.990050+0000","last_became_active":"2023-09-30T22:52:28.995466+0000","last_became_peered":"2023-09-30T22:52:28.995466+0000","last_unstale":"2023-09-30T22:52:29.990050+0000","last_undegraded":"2023-09-30T22:52:29.990050+0000","last_fullsized":"2023-09-30T22:52:29.990050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:36:44.210939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996250+0000","last_change":"2023-09-30T22:52:29.996115+0000","last_active":"2023-09-30T22:52:29.996250+0000","last_peered":"2023-09-30T22:52:29.996250+0000","last_clean":"2023-09-30T22:52:29.996250+0000","last_became_active":"2023-09-30T22:52:29.995868+0000","last_became_peered":"2023-09-30T22:52:29.995868+0000","last_unstale":"2023-09-30T22:52:29.996250+0000","last_undegraded":"2023-09-30T22:52:29.996250+0000","last_fullsized":"2023-09-30T22:52:29.996250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:06.109303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.989952+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:52:29.989952+0000","last_peered":"2023-09-30T22:52:29.989952+0000","last_clean":"2023-09-30T22:52:29.989952+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:52:29.989952+0000","last_undegraded":"2023-09-30T22:52:29.989952+0000","last_fullsized":"2023-09-30T22:52:29.989952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990961+0000","last_change":"2023-09-30T22:52:28.999654+0000","last_active":"2023-09-30T22:52:29.990961+0000","last_peered":"2023-09-30T22:52:29.990961+0000","last_clean":"2023-09-30T22:52:29.990961+0000","last_became_active":"2023-09-30T22:52:28.999396+0000","last_became_peered":"2023-09-30T22:52:28.999396+0000","last_unstale":"2023-09-30T22:52:29.990961+0000","last_undegraded":"2023-09-30T22:52:29.990961+0000","last_fullsized":"2023-09-30T22:52:29.990961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996005+0000","last_change":"2023-09-30T22:52:29.995237+0000","last_active":"2023-09-30T22:52:29.996005+0000","last_peered":"2023-09-30T22:52:29.996005+0000","last_clean":"2023-09-30T22:52:29.996005+0000","last_became_active":"2023-09-30T22:52:29.994975+0000","last_became_peered":"2023-09-30T22:52:29.994975+0000","last_unstale":"2023-09-30T22:52:29.996005+0000","last_undegraded":"2023-09-30T22:52:29.996005+0000","last_fullsized":"2023-09-30T22:52:29.996005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.984408+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:52:29.984408+0000","last_peered":"2023-09-30T22:52:29.984408+0000","last_clean":"2023-09-30T22:52:29.984408+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:52:29.984408+0000","last_undegraded":"2023-09-30T22:52:29.984408+0000","last_fullsized":"2023-09-30T22:52:29.984408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.990530+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:52:29.990530+0000","last_peered":"2023-09-30T22:52:29.990530+0000","last_clean":"2023-09-30T22:52:29.990530+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:52:29.990530+0000","last_undegraded":"2023-09-30T22:52:29.990530+0000","last_fullsized":"2023-09-30T22:52:29.990530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992306+0000","last_change":"2023-09-30T22:52:28.995976+0000","last_active":"2023-09-30T22:52:29.992306+0000","last_peered":"2023-09-30T22:52:29.992306+0000","last_clean":"2023-09-30T22:52:29.992306+0000","last_became_active":"2023-09-30T22:52:28.995724+0000","last_became_peered":"2023-09-30T22:52:28.995724+0000","last_unstale":"2023-09-30T22:52:29.992306+0000","last_undegraded":"2023-09-30T22:52:29.992306+0000","last_fullsized":"2023-09-30T22:52:29.992306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.992841+0000","last_change":"2023-09-30T22:52:29.992622+0000","last_active":"2023-09-30T22:52:29.992841+0000","last_peered":"2023-09-30T22:52:29.992841+0000","last_clean":"2023-09-30T22:52:29.992841+0000","last_became_active":"2023-09-30T22:52:29.992005+0000","last_became_peered":"2023-09-30T22:52:29.992005+0000","last_unstale":"2023-09-30T22:52:29.992841+0000","last_undegraded":"2023-09-30T22:52:29.992841+0000","last_fullsized":"2023-09-30T22:52:29.992841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:28.590938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982896+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:52:29.982896+0000","last_peered":"2023-09-30T22:52:29.982896+0000","last_clean":"2023-09-30T22:52:29.982896+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:52:29.982896+0000","last_undegraded":"2023-09-30T22:52:29.982896+0000","last_fullsized":"2023-09-30T22:52:29.982896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985789+0000","last_change":"2023-09-30T22:52:28.994561+0000","last_active":"2023-09-30T22:52:29.985789+0000","last_peered":"2023-09-30T22:52:29.985789+0000","last_clean":"2023-09-30T22:52:29.985789+0000","last_became_active":"2023-09-30T22:52:28.994326+0000","last_became_peered":"2023-09-30T22:52:28.994326+0000","last_unstale":"2023-09-30T22:52:29.985789+0000","last_undegraded":"2023-09-30T22:52:29.985789+0000","last_fullsized":"2023-09-30T22:52:29.985789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:11.947068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994260+0000","last_change":"2023-09-30T22:52:29.994185+0000","last_active":"2023-09-30T22:52:29.994260+0000","last_peered":"2023-09-30T22:52:29.994260+0000","last_clean":"2023-09-30T22:52:29.994260+0000","last_became_active":"2023-09-30T22:52:29.993967+0000","last_became_peered":"2023-09-30T22:52:29.993967+0000","last_unstale":"2023-09-30T22:52:29.994260+0000","last_undegraded":"2023-09-30T22:52:29.994260+0000","last_fullsized":"2023-09-30T22:52:29.994260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:41.418978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.982819+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:52:29.982819+0000","last_peered":"2023-09-30T22:52:29.982819+0000","last_clean":"2023-09-30T22:52:29.982819+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:52:29.982819+0000","last_undegraded":"2023-09-30T22:52:29.982819+0000","last_fullsized":"2023-09-30T22:52:29.982819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985802+0000","last_change":"2023-09-30T22:52:28.996536+0000","last_active":"2023-09-30T22:52:29.985802+0000","last_peered":"2023-09-30T22:52:29.985802+0000","last_clean":"2023-09-30T22:52:29.985802+0000","last_became_active":"2023-09-30T22:52:28.996306+0000","last_became_peered":"2023-09-30T22:52:28.996306+0000","last_unstale":"2023-09-30T22:52:29.985802+0000","last_undegraded":"2023-09-30T22:52:29.985802+0000","last_fullsized":"2023-09-30T22:52:29.985802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:55.045032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996026+0000","last_change":"2023-09-30T22:52:29.995265+0000","last_active":"2023-09-30T22:52:29.996026+0000","last_peered":"2023-09-30T22:52:29.996026+0000","last_clean":"2023-09-30T22:52:29.996026+0000","last_became_active":"2023-09-30T22:52:29.994582+0000","last_became_peered":"2023-09-30T22:52:29.994582+0000","last_unstale":"2023-09-30T22:52:29.996026+0000","last_undegraded":"2023-09-30T22:52:29.996026+0000","last_fullsized":"2023-09-30T22:52:29.996026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.244975+0000","last_change":"2023-09-30T22:52:28.995448+0000","last_active":"2023-09-30T22:52:30.244975+0000","last_peered":"2023-09-30T22:52:30.244975+0000","last_clean":"2023-09-30T22:52:30.244975+0000","last_became_active":"2023-09-30T22:52:28.995132+0000","last_became_peered":"2023-09-30T22:52:28.995132+0000","last_unstale":"2023-09-30T22:52:30.244975+0000","last_undegraded":"2023-09-30T22:52:30.244975+0000","last_fullsized":"2023-09-30T22:52:30.244975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:28.417964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.993209+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:52:29.993209+0000","last_peered":"2023-09-30T22:52:29.993209+0000","last_clean":"2023-09-30T22:52:29.993209+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:52:29.993209+0000","last_undegraded":"2023-09-30T22:52:29.993209+0000","last_fullsized":"2023-09-30T22:52:29.993209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003796+0000","last_change":"2023-09-30T22:52:30.002605+0000","last_active":"2023-09-30T22:52:30.003796+0000","last_peered":"2023-09-30T22:52:30.003796+0000","last_clean":"2023-09-30T22:52:30.003796+0000","last_became_active":"2023-09-30T22:52:30.001819+0000","last_became_peered":"2023-09-30T22:52:30.001819+0000","last_unstale":"2023-09-30T22:52:30.003796+0000","last_undegraded":"2023-09-30T22:52:30.003796+0000","last_fullsized":"2023-09-30T22:52:30.003796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.983742+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:52:29.983742+0000","last_peered":"2023-09-30T22:52:29.983742+0000","last_clean":"2023-09-30T22:52:29.983742+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:52:29.983742+0000","last_undegraded":"2023-09-30T22:52:29.983742+0000","last_fullsized":"2023-09-30T22:52:29.983742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.987321+0000","last_change":"2023-09-30T22:52:28.993895+0000","last_active":"2023-09-30T22:52:30.987321+0000","last_peered":"2023-09-30T22:52:30.987321+0000","last_clean":"2023-09-30T22:52:30.987321+0000","last_became_active":"2023-09-30T22:52:28.993671+0000","last_became_peered":"2023-09-30T22:52:28.993671+0000","last_unstale":"2023-09-30T22:52:30.987321+0000","last_undegraded":"2023-09-30T22:52:30.987321+0000","last_fullsized":"2023-09-30T22:52:30.987321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:25:43.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.985123+0000","last_change":"2023-09-30T22:52:29.984764+0000","last_active":"2023-09-30T22:52:29.985123+0000","last_peered":"2023-09-30T22:52:29.985123+0000","last_clean":"2023-09-30T22:52:29.985123+0000","last_became_active":"2023-09-30T22:52:29.984512+0000","last_became_peered":"2023-09-30T22:52:29.984512+0000","last_unstale":"2023-09-30T22:52:29.985123+0000","last_undegraded":"2023-09-30T22:52:29.985123+0000","last_fullsized":"2023-09-30T22:52:29.985123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:53.518718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245152+0000","last_change":"2023-09-30T22:52:28.992724+0000","last_active":"2023-09-30T22:52:30.245152+0000","last_peered":"2023-09-30T22:52:30.245152+0000","last_clean":"2023-09-30T22:52:30.245152+0000","last_became_active":"2023-09-30T22:52:28.992475+0000","last_became_peered":"2023-09-30T22:52:28.992475+0000","last_unstale":"2023-09-30T22:52:30.245152+0000","last_undegraded":"2023-09-30T22:52:30.245152+0000","last_fullsized":"2023-09-30T22:52:30.245152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:08.471321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002489+0000","last_change":"2023-09-30T22:52:30.002130+0000","last_active":"2023-09-30T22:52:30.002489+0000","last_peered":"2023-09-30T22:52:30.002489+0000","last_clean":"2023-09-30T22:52:30.002489+0000","last_became_active":"2023-09-30T22:52:30.001756+0000","last_became_peered":"2023-09-30T22:52:30.001756+0000","last_unstale":"2023-09-30T22:52:30.002489+0000","last_undegraded":"2023-09-30T22:52:30.002489+0000","last_fullsized":"2023-09-30T22:52:30.002489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:06:49.615759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.247149+0000","last_change":"2023-09-30T22:52:28.988451+0000","last_active":"2023-09-30T22:52:30.247149+0000","last_peered":"2023-09-30T22:52:30.247149+0000","last_clean":"2023-09-30T22:52:30.247149+0000","last_became_active":"2023-09-30T22:52:28.988208+0000","last_became_peered":"2023-09-30T22:52:28.988208+0000","last_unstale":"2023-09-30T22:52:30.247149+0000","last_undegraded":"2023-09-30T22:52:30.247149+0000","last_fullsized":"2023-09-30T22:52:30.247149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:36.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.994183+0000","last_change":"2023-09-30T22:52:29.994020+0000","last_active":"2023-09-30T22:52:29.994183+0000","last_peered":"2023-09-30T22:52:29.994183+0000","last_clean":"2023-09-30T22:52:29.994183+0000","last_became_active":"2023-09-30T22:52:29.993783+0000","last_became_peered":"2023-09-30T22:52:29.993783+0000","last_unstale":"2023-09-30T22:52:29.994183+0000","last_undegraded":"2023-09-30T22:52:29.994183+0000","last_fullsized":"2023-09-30T22:52:29.994183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:11.762545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.246723+0000","last_change":"2023-09-30T22:52:28.994877+0000","last_active":"2023-09-30T22:52:30.246723+0000","last_peered":"2023-09-30T22:52:30.246723+0000","last_clean":"2023-09-30T22:52:30.246723+0000","last_became_active":"2023-09-30T22:52:28.993855+0000","last_became_peered":"2023-09-30T22:52:28.993855+0000","last_unstale":"2023-09-30T22:52:30.246723+0000","last_undegraded":"2023-09-30T22:52:30.246723+0000","last_fullsized":"2023-09-30T22:52:30.246723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:00:05.100032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.988016+0000","last_change":"2023-09-30T22:52:29.987968+0000","last_active":"2023-09-30T22:52:29.988016+0000","last_peered":"2023-09-30T22:52:29.988016+0000","last_clean":"2023-09-30T22:52:29.988016+0000","last_became_active":"2023-09-30T22:52:29.987840+0000","last_became_peered":"2023-09-30T22:52:29.987840+0000","last_unstale":"2023-09-30T22:52:29.988016+0000","last_undegraded":"2023-09-30T22:52:29.988016+0000","last_fullsized":"2023-09-30T22:52:29.988016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.245418+0000","last_change":"2023-09-30T22:52:28.997114+0000","last_active":"2023-09-30T22:52:30.245418+0000","last_peered":"2023-09-30T22:52:30.245418+0000","last_clean":"2023-09-30T22:52:30.245418+0000","last_became_active":"2023-09-30T22:52:28.996627+0000","last_became_peered":"2023-09-30T22:52:28.996627+0000","last_unstale":"2023-09-30T22:52:30.245418+0000","last_undegraded":"2023-09-30T22:52:30.245418+0000","last_fullsized":"2023-09-30T22:52:30.245418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:36.974739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.999051+0000","last_change":"2023-09-30T22:52:29.998983+0000","last_active":"2023-09-30T22:52:29.999051+0000","last_peered":"2023-09-30T22:52:29.999051+0000","last_clean":"2023-09-30T22:52:29.999051+0000","last_became_active":"2023-09-30T22:52:29.998760+0000","last_became_peered":"2023-09-30T22:52:29.998760+0000","last_unstale":"2023-09-30T22:52:29.999051+0000","last_undegraded":"2023-09-30T22:52:29.999051+0000","last_fullsized":"2023-09-30T22:52:29.999051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:00:16.600235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.248249+0000","last_change":"2023-09-30T22:52:28.998655+0000","last_active":"2023-09-30T22:52:30.248249+0000","last_peered":"2023-09-30T22:52:30.248249+0000","last_clean":"2023-09-30T22:52:30.248249+0000","last_became_active":"2023-09-30T22:52:28.998409+0000","last_became_peered":"2023-09-30T22:52:28.998409+0000","last_unstale":"2023-09-30T22:52:30.248249+0000","last_undegraded":"2023-09-30T22:52:30.248249+0000","last_fullsized":"2023-09-30T22:52:30.248249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:27.963709+0000","last_clean_scrub_stamp":"2023-09-30T22:52:27.963709+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:46.408679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.001122+0000","last_change":"2023-09-30T22:52:30.001062+0000","last_active":"2023-09-30T22:52:30.001122+0000","last_peered":"2023-09-30T22:52:30.001122+0000","last_clean":"2023-09-30T22:52:30.001122+0000","last_became_active":"2023-09-30T22:52:30.000803+0000","last_became_peered":"2023-09-30T22:52:30.000803+0000","last_unstale":"2023-09-30T22:52:30.001122+0000","last_undegraded":"2023-09-30T22:52:30.001122+0000","last_fullsized":"2023-09-30T22:52:30.001122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.002078+0000","last_change":"2023-09-30T22:52:30.001992+0000","last_active":"2023-09-30T22:52:30.002078+0000","last_peered":"2023-09-30T22:52:30.002078+0000","last_clean":"2023-09-30T22:52:30.002078+0000","last_became_active":"2023-09-30T22:52:30.001745+0000","last_became_peered":"2023-09-30T22:52:30.001745+0000","last_unstale":"2023-09-30T22:52:30.002078+0000","last_undegraded":"2023-09-30T22:52:30.002078+0000","last_fullsized":"2023-09-30T22:52:30.002078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:49.328193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.998638+0000","last_change":"2023-09-30T22:52:29.998560+0000","last_active":"2023-09-30T22:52:29.998638+0000","last_peered":"2023-09-30T22:52:29.998638+0000","last_clean":"2023-09-30T22:52:29.998638+0000","last_became_active":"2023-09-30T22:52:29.997840+0000","last_became_peered":"2023-09-30T22:52:29.997840+0000","last_unstale":"2023-09-30T22:52:29.998638+0000","last_undegraded":"2023-09-30T22:52:29.998638+0000","last_fullsized":"2023-09-30T22:52:29.998638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:28.636131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.995699+0000","last_change":"2023-09-30T22:52:29.995634+0000","last_active":"2023-09-30T22:52:29.995699+0000","last_peered":"2023-09-30T22:52:29.995699+0000","last_clean":"2023-09-30T22:52:29.995699+0000","last_became_active":"2023-09-30T22:52:29.995407+0000","last_became_peered":"2023-09-30T22:52:29.995407+0000","last_unstale":"2023-09-30T22:52:29.995699+0000","last_undegraded":"2023-09-30T22:52:29.995699+0000","last_fullsized":"2023-09-30T22:52:29.995699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:21.321467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:30.003196+0000","last_change":"2023-09-30T22:52:30.002695+0000","last_active":"2023-09-30T22:52:30.003196+0000","last_peered":"2023-09-30T22:52:30.003196+0000","last_clean":"2023-09-30T22:52:30.003196+0000","last_became_active":"2023-09-30T22:52:30.002463+0000","last_became_peered":"2023-09-30T22:52:30.002463+0000","last_unstale":"2023-09-30T22:52:30.003196+0000","last_undegraded":"2023-09-30T22:52:30.003196+0000","last_fullsized":"2023-09-30T22:52:30.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:25.402337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:52:29.996203+0000","last_change":"2023-09-30T22:52:29.996129+0000","last_active":"2023-09-30T22:52:29.996203+0000","last_peered":"2023-09-30T22:52:29.996203+0000","last_clean":"2023-09-30T22:52:29.996203+0000","last_became_active":"2023-09-30T22:52:29.995897+0000","last_became_peered":"2023-09-30T22:52:29.995897+0000","last_unstale":"2023-09-30T22:52:29.996203+0000","last_undegraded":"2023-09-30T22:52:29.996203+0000","last_fullsized":"2023-09-30T22:52:29.996203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:28.972980+0000","last_clean_scrub_stamp":"2023-09-30T22:52:28.972980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:15:23.849824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5190000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6339999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4580000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910695,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909305,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":88,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195223,"statfs":{"total":200000000,"available":199909201,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910841,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":664,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199319919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]}],"pool_statfs":[]}} 2023-09-30T22:52:40.552 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:52:40.552 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:52:40.552 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:52:40.552 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:52:40.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.774+0000 7f842e7ff700 1 Processor -- start 2023-09-30T22:52:40.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.774+0000 7f842e7ff700 1 -- start start 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.775+0000 7f842e7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f84280b1950 0x7f842815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.775+0000 7f842e7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f842815a6c0 0x7f842806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.775+0000 7f842e7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280ad630 con 0x7f84280b1580 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.775+0000 7f842e7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842815ab60 con 0x7f84280b1950 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.775+0000 7f842e7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8428157c20 con 0x7f842815a6c0 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f841ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f84280b1950 0x7f842815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f8427fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f84280b1580 0x7f84280adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60448/0 (socket says 172.21.15.142:60448) 2023-09-30T22:52:40.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f8427fff700 1 -- 172.21.15.142:0/1603878930 learned_addr learned my addr 172.21.15.142:0/1603878930 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f842cd9c700 1 --2- 172.21.15.142:0/1603878930 >> v2:172.21.15.148:3300/0 conn(0x7f842815a6c0 0x7f842806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f841ffff700 1 -- 172.21.15.142:0/1603878930 >> v2:172.21.15.148:3300/0 conn(0x7f842815a6c0 msgr2=0x7f842806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f841ffff700 1 --2- 172.21.15.142:0/1603878930 >> v2:172.21.15.148:3300/0 conn(0x7f842815a6c0 0x7f842806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f841ffff700 1 -- 172.21.15.142:0/1603878930 >> v1:172.21.15.142:6789/0 conn(0x7f84280b1580 legacy=0x7f84280adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f841ffff700 1 -- 172.21.15.142:0/1603878930 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280b3360 con 0x7f84280b1950 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f84277fe700 1 -- 172.21.15.142:0/1603878930 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090793975 0 0) 0x7f84280ad630 con 0x7f84280b1580 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.776+0000 7f841ffff700 1 --2- 172.21.15.142:0/1603878930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1950 0x7f842815a180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f84280b0270 tx=0x7f84100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6808f0fca6aaf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f84277fe700 1 -- 172.21.15.142:0/1603878930 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410009e80 con 0x7f84280b1950 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f84277fe700 1 -- 172.21.15.142:0/1603878930 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000b820 con 0x7f84280b1950 2023-09-30T22:52:40.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f84277fe700 1 -- 172.21.15.142:0/1603878930 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000bba0 con 0x7f84280b1950 2023-09-30T22:52:40.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 -- 172.21.15.142:0/1603878930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1950 msgr2=0x7f842815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 --2- 172.21.15.142:0/1603878930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1950 0x7f842815a180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f84280b0270 tx=0x7f84100091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 -- 172.21.15.142:0/1603878930 shutdown_connections 2023-09-30T22:52:40.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 --2- 172.21.15.142:0/1603878930 >> v2:172.21.15.148:3300/0 conn(0x7f842815a6c0 0x7f842806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 --2- 172.21.15.142:0/1603878930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1950 0x7f842815a180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 -- 172.21.15.142:0/1603878930 >> 172.21.15.142:0/1603878930 conn(0x7f84280ce1f0 msgr2=0x7f8428069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 -- 172.21.15.142:0/1603878930 shutdown_connections 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.777+0000 7f842e7ff700 1 -- 172.21.15.142:0/1603878930 wait complete. 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.779+0000 7f842e7ff700 1 Processor -- start 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.779+0000 7f842e7ff700 1 -- start start 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f842e7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1580 0x7f84280c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f842e7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84280b1950 0x7f842816db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f842e7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f842815a6c0 0x7f84280cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f842e7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842816e760 con 0x7f84280b1580 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f842e7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84280c2a50 con 0x7f842815a6c0 2023-09-30T22:52:40.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f842e7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84280caae0 con 0x7f84280b1950 2023-09-30T22:52:40.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1580 0x7f84280c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1580 0x7f84280c2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57568/0 (socket says 172.21.15.142:57568) 2023-09-30T22:52:40.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 -- 172.21.15.142:0/2380317957 learned_addr learned my addr 172.21.15.142:0/2380317957 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:40.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f841ffff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84280b1950 0x7f842816db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f842cd9c700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f842815a6c0 0x7f84280cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 -- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84280b1950 msgr2=0x7f842816db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84280b1950 0x7f842816db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 -- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f842815a6c0 msgr2=0x7f84280cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f842815a6c0 0x7f84280cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f8427fff700 1 -- 172.21.15.142:0/2380317957 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410009420 con 0x7f84280b1580 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.780+0000 7f841ffff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84280b1950 0x7f842816db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.781+0000 7f8427fff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1580 0x7f84280c2510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f841800c7e0 tx=0x7f8418007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.781+0000 7f8424ff9700 1 -- 172.21.15.142:0/2380317957 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418005b30 con 0x7f84280b1580 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.781+0000 7f8424ff9700 1 -- 172.21.15.142:0/2380317957 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418005c90 con 0x7f84280b1580 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.781+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84280cadc0 con 0x7f84280b1580 2023-09-30T22:52:40.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.781+0000 7f8424ff9700 1 -- 172.21.15.142:0/2380317957 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418007300 con 0x7f84280b1580 2023-09-30T22:52:40.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.781+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84280cb150 con 0x7f84280b1580 2023-09-30T22:52:40.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.782+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8428068620 con 0x7f84280b1580 2023-09-30T22:52:40.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.783+0000 7f8424ff9700 1 -- 172.21.15.142:0/2380317957 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f841801b400 con 0x7f84280b1580 2023-09-30T22:52:40.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.784+0000 7f8424ff9700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8408067330 0x7f84080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:40.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.784+0000 7f8424ff9700 1 -- 172.21.15.142:0/2380317957 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f84180847a0 con 0x7f84280b1580 2023-09-30T22:52:40.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.784+0000 7f841ffff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8408067330 0x7f84080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:40.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.784+0000 7f841ffff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8408067330 0x7f84080697e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84100093f0 tx=0x7f8410017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:40.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:40.788+0000 7f8424ff9700 1 -- 172.21.15.142:0/2380317957 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8418051680 con 0x7f84280b1580 2023-09-30T22:52:41.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.017+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f84280ae1d0 con 0x7f84280b1580 2023-09-30T22:52:41.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.017+0000 7f8424ff9700 1 -- 172.21.15.142:0/2380317957 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8418054ca0 con 0x7f84280b1580 2023-09-30T22:52:41.018 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:41.018 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:52:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8408067330 msgr2=0x7f84080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8408067330 0x7f84080697e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84100093f0 tx=0x7f8410017000 comp rx=0 tx=0).stop 2023-09-30T22:52:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1580 msgr2=0x7f84280c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1580 0x7f84280c2510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f841800c7e0 tx=0x7f8418007df0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 shutdown_connections 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8408067330 0x7f84080697e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f842815a6c0 0x7f84280cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84280b1580 0x7f84280c2510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 --2- 172.21.15.142:0/2380317957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84280b1950 0x7f842816db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 >> 172.21.15.142:0/2380317957 conn(0x7f84280ce1f0 msgr2=0x7f84280aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 shutdown_connections 2023-09-30T22:52:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.020+0000 7f842e7ff700 1 -- 172.21.15.142:0/2380317957 wait complete. 2023-09-30T22:52:41.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:52:41.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:41.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.226+0000 7ff733bff700 1 Processor -- start 2023-09-30T22:52:41.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.226+0000 7ff733bff700 1 -- start start 2023-09-30T22:52:41.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff733bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1580 0x7ff72c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff733bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff72c0b1950 0x7ff72c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff733bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c0ad630 con 0x7ff72c0ae000 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff733bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c157c20 con 0x7ff72c0b1950 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff733bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0b3360 con 0x7ff72c0b1580 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff73219c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff72c0ae000 0x7ff72c06a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44642/0 (socket says 172.21.15.142:44642) 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff73219c700 1 -- 172.21.15.142:0/2089688939 learned_addr learned my addr 172.21.15.142:0/2089688939 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff73199b700 1 --2- 172.21.15.142:0/2089688939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1580 0x7ff72c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff73119a700 1 --2- 172.21.15.142:0/2089688939 >> v2:172.21.15.148:3300/0 conn(0x7ff72c0b1950 0x7ff72c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff730999700 1 -- 172.21.15.142:0/2089688939 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387604319 0 0) 0x7ff72c0ad630 con 0x7ff72c0ae000 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.228+0000 7ff730999700 1 -- 172.21.15.142:0/2089688939 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff718003570 con 0x7ff72c0ae000 2023-09-30T22:52:41.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff73199b700 1 -- 172.21.15.142:0/2089688939 >> v2:172.21.15.148:3300/0 conn(0x7ff72c0b1950 msgr2=0x7ff72c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff730999700 1 -- 172.21.15.142:0/2089688939 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174671790 0 0) 0x7ff718003570 con 0x7ff72c0ae000 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff73199b700 1 --2- 172.21.15.142:0/2089688939 >> v2:172.21.15.148:3300/0 conn(0x7ff72c0b1950 0x7ff72c15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff73199b700 1 -- 172.21.15.142:0/2089688939 >> v1:172.21.15.142:6789/0 conn(0x7ff72c0ae000 legacy=0x7ff72c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff73199b700 1 -- 172.21.15.142:0/2089688939 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c15ad60 con 0x7ff72c0b1580 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff73199b700 1 --2- 172.21.15.142:0/2089688939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1580 0x7ff72c0adac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7280098e0 tx=0x7ff7280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac88268e8b18cedb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff730999700 1 -- 172.21.15.142:0/2089688939 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240017f0 con 0x7ff72c0b1580 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff730999700 1 -- 172.21.15.142:0/2089688939 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff728011420 con 0x7ff72c0b1580 2023-09-30T22:52:41.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.229+0000 7ff730999700 1 -- 172.21.15.142:0/2089688939 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280117c0 con 0x7ff72c0b1580 2023-09-30T22:52:41.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 -- 172.21.15.142:0/2089688939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1580 msgr2=0x7ff72c0adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 --2- 172.21.15.142:0/2089688939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1580 0x7ff72c0adac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7280098e0 tx=0x7ff7280091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 -- 172.21.15.142:0/2089688939 shutdown_connections 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 --2- 172.21.15.142:0/2089688939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1580 0x7ff72c0adac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 --2- 172.21.15.142:0/2089688939 >> v2:172.21.15.148:3300/0 conn(0x7ff72c0b1950 0x7ff72c15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 -- 172.21.15.142:0/2089688939 >> 172.21.15.142:0/2089688939 conn(0x7ff72c0ce1f0 msgr2=0x7ff72c069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 -- 172.21.15.142:0/2089688939 shutdown_connections 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.230+0000 7ff733bff700 1 -- 172.21.15.142:0/2089688939 wait complete. 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.231+0000 7ff733bff700 1 Processor -- start 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.231+0000 7ff733bff700 1 -- start start 2023-09-30T22:52:41.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff733bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c0ae000 0x7ff72c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff733bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff72c0b1580 0x7ff72c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff733bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1950 0x7ff72c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff733bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c1477e0 con 0x7ff72c0b1580 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff733bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0aaac0 con 0x7ff72c0ae000 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff733bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0ca230 con 0x7ff72c0b1950 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff73119a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff72c0b1580 0x7ff72c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff73119a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff72c0b1580 0x7ff72c1472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51382/0 (socket says 172.21.15.142:51382) 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.232+0000 7ff73119a700 1 -- 172.21.15.142:0/2904313462 learned_addr learned my addr 172.21.15.142:0/2904313462 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:41.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73199b700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c0ae000 0x7ff72c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73219c700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1950 0x7ff72c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73119a700 1 -- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1950 msgr2=0x7ff72c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73119a700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1950 0x7ff72c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73119a700 1 -- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c0ae000 msgr2=0x7ff72c067c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73119a700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c0ae000 0x7ff72c067c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73119a700 1 -- 172.21.15.142:0/2904313462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728009420 con 0x7ff72c0b1580 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73219c700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1950 0x7ff72c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff73119a700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff72c0b1580 0x7ff72c1472a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e960 tx=0x7ff71c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff721ffb700 1 -- 172.21.15.142:0/2904313462 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00c850 con 0x7ff72c0b1580 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff721ffb700 1 -- 172.21.15.142:0/2904313462 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00c9b0 con 0x7ff72c0b1580 2023-09-30T22:52:41.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c0cd060 con 0x7ff72c0b1580 2023-09-30T22:52:41.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff721ffb700 1 -- 172.21.15.142:0/2904313462 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00cd50 con 0x7ff72c0b1580 2023-09-30T22:52:41.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.233+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c16adf0 con 0x7ff72c0b1580 2023-09-30T22:52:41.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.234+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c0aac70 con 0x7ff72c0b1580 2023-09-30T22:52:41.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.235+0000 7ff721ffb700 1 -- 172.21.15.142:0/2904313462 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff71c013680 con 0x7ff72c0b1580 2023-09-30T22:52:41.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.236+0000 7ff721ffb700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff710067330 0x7ff7100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.236+0000 7ff721ffb700 1 -- 172.21.15.142:0/2904313462 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff71c084d90 con 0x7ff72c0b1580 2023-09-30T22:52:41.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.236+0000 7ff73199b700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff710067330 0x7ff7100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.237+0000 7ff73199b700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff710067330 0x7ff7100697e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7280093f0 tx=0x7ff728016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:41.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.240+0000 7ff721ffb700 1 -- 172.21.15.142:0/2904313462 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff72c0aac70 con 0x7ff72c0b1580 2023-09-30T22:52:41.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.435+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff72c0aac70 con 0x7ff72c0b1580 2023-09-30T22:52:41.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.436+0000 7ff721ffb700 1 -- 172.21.15.142:0/2904313462 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7ff72c0aac70 con 0x7ff72c0b1580 2023-09-30T22:52:41.437 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:41.437 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.438+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff710067330 msgr2=0x7ff7100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.438+0000 7ff733bff700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff710067330 0x7ff7100697e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7280093f0 tx=0x7ff728016000 comp rx=0 tx=0).stop 2023-09-30T22:52:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.438+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff72c0b1580 msgr2=0x7ff72c1472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.438+0000 7ff733bff700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff72c0b1580 0x7ff72c1472a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e960 tx=0x7ff71c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 shutdown_connections 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff710067330 0x7ff7100697e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff72c0b1950 0x7ff72c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff72c0ae000 0x7ff72c067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 --2- 172.21.15.142:0/2904313462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff72c0b1580 0x7ff72c1472a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 >> 172.21.15.142:0/2904313462 conn(0x7ff72c0ce1f0 msgr2=0x7ff72c159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 shutdown_connections 2023-09-30T22:52:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.439+0000 7ff733bff700 1 -- 172.21.15.142:0/2904313462 wait complete. 2023-09-30T22:52:41.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:52:27.833414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:52:28.438662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:52:41.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:52:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.648+0000 7f7c271ff700 1 Processor -- start 2023-09-30T22:52:41.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.648+0000 7f7c271ff700 1 -- start start 2023-09-30T22:52:41.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c271ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7c20157ab0 0x7f7c2015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c271ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200d0550 con 0x7f7c200cbfe0 2023-09-30T22:52:41.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c271ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200cf940 con 0x7f7c200cc3b0 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c271ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200cfc20 con 0x7f7c20157ab0 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c24f9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7c200cbfe0 0x7f7c201573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44652/0 (socket says 172.21.15.142:44652) 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c24f9b700 1 -- 172.21.15.142:0/1649172756 learned_addr learned my addr 172.21.15.142:0/1649172756 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c1ffff700 1 --2- 172.21.15.142:0/1649172756 >> v2:172.21.15.148:3300/0 conn(0x7f7c20157ab0 0x7f7c2015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c1f7fe700 1 -- 172.21.15.142:0/1649172756 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587420564 0 0) 0x7f7c200d0550 con 0x7f7c200cbfe0 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c1f7fe700 1 -- 172.21.15.142:0/1649172756 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c10003570 con 0x7f7c200cbfe0 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c1f7fe700 1 -- 172.21.15.142:0/1649172756 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486102244 0 0) 0x7f7c200cf940 con 0x7f7c200cc3b0 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.650+0000 7f7c1f7fe700 1 -- 172.21.15.142:0/1649172756 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c200d0550 con 0x7f7c200cc3b0 2023-09-30T22:52:41.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.651+0000 7f7c1ffff700 1 -- 172.21.15.142:0/1649172756 >> v1:172.21.15.148:6789/0 conn(0x7f7c200cc3b0 legacy=0x7f7c2006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.651+0000 7f7c1ffff700 1 -- 172.21.15.142:0/1649172756 >> v1:172.21.15.142:6789/0 conn(0x7f7c200cbfe0 legacy=0x7f7c201573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.651+0000 7f7c1ffff700 1 -- 172.21.15.142:0/1649172756 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200cff00 con 0x7f7c20157ab0 2023-09-30T22:52:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.651+0000 7f7c1ffff700 1 --2- 172.21.15.142:0/1649172756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c20157ab0 0x7f7c2015a2a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0098e0 tx=0x7f7c0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65cd3d3d73abdd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.651+0000 7f7c1f7fe700 1 -- 172.21.15.142:0/1649172756 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011630 con 0x7f7c20157ab0 2023-09-30T22:52:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.651+0000 7f7c1f7fe700 1 -- 172.21.15.142:0/1649172756 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c011790 con 0x7f7c20157ab0 2023-09-30T22:52:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.651+0000 7f7c1f7fe700 1 -- 172.21.15.142:0/1649172756 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011b30 con 0x7f7c20157ab0 2023-09-30T22:52:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.652+0000 7f7c271ff700 1 -- 172.21.15.142:0/1649172756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c20157ab0 msgr2=0x7f7c2015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.652+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1649172756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c20157ab0 0x7f7c2015a2a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0098e0 tx=0x7f7c0c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.652+0000 7f7c271ff700 1 -- 172.21.15.142:0/1649172756 shutdown_connections 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.652+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1649172756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c20157ab0 0x7f7c2015a2a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.652+0000 7f7c271ff700 1 -- 172.21.15.142:0/1649172756 >> 172.21.15.142:0/1649172756 conn(0x7f7c200d0a80 msgr2=0x7f7c200d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.652+0000 7f7c271ff700 1 -- 172.21.15.142:0/1649172756 shutdown_connections 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.652+0000 7f7c271ff700 1 -- 172.21.15.142:0/1649172756 wait complete. 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.653+0000 7f7c271ff700 1 Processor -- start 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.653+0000 7f7c271ff700 1 -- start start 2023-09-30T22:52:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c271ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c200cbfe0 0x7f7c200c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c271ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c200cc3b0 0x7f7c2015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c271ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c20157ab0 0x7f7c201485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c271ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201605b0 con 0x7f7c200cbfe0 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c271ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20158cf0 con 0x7f7c200cc3b0 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c271ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2015fa70 con 0x7f7c20157ab0 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c24f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c200cbfe0 0x7f7c200c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.654+0000 7f7c24f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c200cbfe0 0x7f7c200c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51390/0 (socket says 172.21.15.142:51390) 2023-09-30T22:52:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c24f9b700 1 -- 172.21.15.142:0/1936731854 learned_addr learned my addr 172.21.15.142:0/1936731854 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c1ffff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c200cc3b0 0x7f7c2015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c2579c700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c20157ab0 0x7f7c201485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c24f9b700 1 -- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c20157ab0 msgr2=0x7f7c201485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c24f9b700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c20157ab0 0x7f7c201485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c24f9b700 1 -- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c200cc3b0 msgr2=0x7f7c2015f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c24f9b700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c200cc3b0 0x7f7c2015f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c24f9b700 1 -- 172.21.15.142:0/1936731854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c009420 con 0x7f7c200cbfe0 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c2579c700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c20157ab0 0x7f7c201485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c24f9b700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c200cbfe0 0x7f7c200c46e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c790 tx=0x7f7c14007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:41.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c1cff9700 1 -- 172.21.15.142:0/1936731854 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14005b30 con 0x7f7c200cbfe0 2023-09-30T22:52:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c1cff9700 1 -- 172.21.15.142:0/1936731854 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14005c90 con 0x7f7c200cbfe0 2023-09-30T22:52:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c1cff9700 1 -- 172.21.15.142:0/1936731854 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14007300 con 0x7f7c200cbfe0 2023-09-30T22:52:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.655+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2015fd10 con 0x7f7c200cbfe0 2023-09-30T22:52:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.656+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c201602d0 con 0x7f7c200cbfe0 2023-09-30T22:52:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.657+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20069770 con 0x7f7c200cbfe0 2023-09-30T22:52:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.657+0000 7f7c1cff9700 1 -- 172.21.15.142:0/1936731854 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7c1401b400 con 0x7f7c200cbfe0 2023-09-30T22:52:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.658+0000 7f7c1cff9700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c04067330 0x7f7c040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.658+0000 7f7c1cff9700 1 -- 172.21.15.142:0/1936731854 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c140847e0 con 0x7f7c200cbfe0 2023-09-30T22:52:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.658+0000 7f7c1ffff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c04067330 0x7f7c040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.659+0000 7f7c1ffff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c04067330 0x7f7c040697e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c20157ee0 tx=0x7f7c0c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:41.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.662+0000 7f7c1cff9700 1 -- 172.21.15.142:0/1936731854 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7c140516c0 con 0x7f7c200cbfe0 2023-09-30T22:52:41.780 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:41.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.863+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c2006fc10 con 0x7f7c200cbfe0 2023-09-30T22:52:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.863+0000 7f7c1cff9700 1 -- 172.21.15.142:0/1936731854 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c140076f0 con 0x7f7c200cbfe0 2023-09-30T22:52:41.864 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:52:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.865+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c04067330 msgr2=0x7f7c040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.865+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c04067330 0x7f7c040697e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c20157ee0 tx=0x7f7c0c017000 comp rx=0 tx=0).stop 2023-09-30T22:52:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.865+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c200cbfe0 msgr2=0x7f7c200c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.865+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c200cbfe0 0x7f7c200c46e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c790 tx=0x7f7c14007ea0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 shutdown_connections 2023-09-30T22:52:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c04067330 0x7f7c040697e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c20157ab0 0x7f7c201485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c200cbfe0 0x7f7c200c46e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 --2- 172.21.15.142:0/1936731854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c200cc3b0 0x7f7c2015f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 >> 172.21.15.142:0/1936731854 conn(0x7f7c200d0a80 msgr2=0x7f7c2006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 shutdown_connections 2023-09-30T22:52:41.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:41.866+0000 7f7c271ff700 1 -- 172.21.15.142:0/1936731854 wait complete. 2023-09-30T22:52:41.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:52:42.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.075+0000 7f9e649ff700 1 Processor -- start 2023-09-30T22:52:42.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.075+0000 7f9e649ff700 1 -- start start 2023-09-30T22:52:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.076+0000 7f9e649ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 0x7f9e6006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.076+0000 7f9e649ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e601509d0 0x7f9e6006ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.076+0000 7f9e649ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e601576e0 con 0x7f9e6015a920 2023-09-30T22:52:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.076+0000 7f9e649ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e600cc320 con 0x7f9e601509d0 2023-09-30T22:52:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.076+0000 7f9e649ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6015a490 con 0x7f9e60150600 2023-09-30T22:52:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5ed9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9e6015a920 0x7f9e60156710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44654/0 (socket says 172.21.15.142:44654) 2023-09-30T22:52:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5ed9d700 1 -- 172.21.15.142:0/94824310 learned_addr learned my addr 172.21.15.142:0/94824310 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5e59c700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 0x7f9e6006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/94824310 >> v2:172.21.15.148:3300/0 conn(0x7f9e601509d0 0x7f9e6006ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987574064 0 0) 0x7f9e601576e0 con 0x7f9e6015a920 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e48003570 con 0x7f9e6015a920 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471802114 0 0) 0x7f9e48003570 con 0x7f9e6015a920 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 msgr2=0x7f9e6006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 0x7f9e6006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 >> v2:172.21.15.148:3300/0 conn(0x7f9e601509d0 msgr2=0x7f9e6006ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 --2- 172.21.15.142:0/94824310 >> v2:172.21.15.148:3300/0 conn(0x7f9e601509d0 0x7f9e6006ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e60157400 con 0x7f9e6015a920 2023-09-30T22:52:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f9e580017f0 con 0x7f9e6015a920 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 >> v1:172.21.15.142:6789/0 conn(0x7f9e6015a920 legacy=0x7f9e60156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 0x7f9e48003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e48003fe0 0x7f9e48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48004d50 0x7f9e480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.077+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600cc320 con 0x7f9e48003fe0 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6015a490 con 0x7f9e48004d50 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4800dca0 con 0x7f9e60150600 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e48003fe0 0x7f9e48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5e59c700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 0x7f9e48003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5ed9d700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48004d50 0x7f9e480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5dd9b700 1 -- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 msgr2=0x7f9e48003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e60150600 0x7f9e48003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5dd9b700 1 -- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48004d50 msgr2=0x7f9e480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48004d50 0x7f9e480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5dd9b700 1 -- 172.21.15.142:0/94824310 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e48003570 con 0x7f9e48003fe0 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5ed9d700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48004d50 0x7f9e480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.078+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e48003fe0 0x7f9e48004810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009c00 tx=0x7f9e540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aca0544bf194915 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400e6b0 con 0x7f9e48003fe0 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5400e810 con 0x7f9e48003fe0 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e5d59a700 1 -- 172.21.15.142:0/94824310 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400ebd0 con 0x7f9e48003fe0 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e649ff700 1 -- 172.21.15.142:0/94824310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e48003fe0 msgr2=0x7f9e48004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e649ff700 1 --2- 172.21.15.142:0/94824310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e48003fe0 0x7f9e48004810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009c00 tx=0x7f9e540091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e5ed9d700 1 -- 172.21.15.142:0/94824310 reap_dead start 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e649ff700 1 -- 172.21.15.142:0/94824310 shutdown_connections 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e649ff700 1 -- 172.21.15.142:0/94824310 >> 172.21.15.142:0/94824310 conn(0x7f9e600cc670 msgr2=0x7f9e600cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e649ff700 1 -- 172.21.15.142:0/94824310 shutdown_connections 2023-09-30T22:52:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.079+0000 7f9e649ff700 1 -- 172.21.15.142:0/94824310 wait complete. 2023-09-30T22:52:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.081+0000 7f9e649ff700 1 Processor -- start 2023-09-30T22:52:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.081+0000 7f9e649ff700 1 -- start start 2023-09-30T22:52:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e649ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e48003fe0 0x7f9e6014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e649ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e60142d80 0x7f9e60141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e649ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5a60 0x7f9e60143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e649ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6014b2d0 con 0x7f9e60142d80 2023-09-30T22:52:42.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e649ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60145b20 con 0x7f9e600c5a60 2023-09-30T22:52:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e649ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60145e00 con 0x7f9e48003fe0 2023-09-30T22:52:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e60142d80 0x7f9e60141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e60142d80 0x7f9e60141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51420/0 (socket says 172.21.15.142:51420) 2023-09-30T22:52:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 -- 172.21.15.142:0/3240603970 learned_addr learned my addr 172.21.15.142:0/3240603970 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5e59c700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e48003fe0 0x7f9e6014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5ed9d700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5a60 0x7f9e60143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 -- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e48003fe0 msgr2=0x7f9e6014f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e48003fe0 0x7f9e6014f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 -- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5a60 msgr2=0x7f9e60143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5a60 0x7f9e60143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 -- 172.21.15.142:0/3240603970 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6014fb40 con 0x7f9e60142d80 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5e59c700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e48003fe0 0x7f9e6014f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.083+0000 7f9e5dd9b700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e60142d80 0x7f9e60141dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9e48004730 tx=0x7f9e5401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.084+0000 7f9e4e7fc700 1 -- 172.21.15.142:0/3240603970 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54022070 con 0x7f9e60142d80 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.084+0000 7f9e4e7fc700 1 -- 172.21.15.142:0/3240603970 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5400e980 con 0x7f9e60142d80 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.084+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e601457a0 con 0x7f9e60142d80 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.084+0000 7f9e4e7fc700 1 -- 172.21.15.142:0/3240603970 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54027470 con 0x7f9e60142d80 2023-09-30T22:52:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.084+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e601424c0 con 0x7f9e60142d80 2023-09-30T22:52:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.085+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6014b070 con 0x7f9e60142d80 2023-09-30T22:52:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.086+0000 7f9e4e7fc700 1 -- 172.21.15.142:0/3240603970 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9e5401c450 con 0x7f9e60142d80 2023-09-30T22:52:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.087+0000 7f9e4e7fc700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9e40067330 0x7f9e400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.087+0000 7f9e4e7fc700 1 -- 172.21.15.142:0/3240603970 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e54086850 con 0x7f9e60142d80 2023-09-30T22:52:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.087+0000 7f9e5e59c700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9e40067330 0x7f9e400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.087+0000 7f9e5e59c700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9e40067330 0x7f9e400697e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006dc0 tx=0x7f9e50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.091+0000 7f9e4e7fc700 1 -- 172.21.15.142:0/3240603970 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9e54053770 con 0x7f9e60142d80 2023-09-30T22:52:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.282+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e6006fc10 con 0x7f9e60142d80 2023-09-30T22:52:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.283+0000 7f9e4e7fc700 1 -- 172.21.15.142:0/3240603970 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9e54056cd0 con 0x7f9e60142d80 2023-09-30T22:52:42.283 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:52:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9e40067330 msgr2=0x7f9e400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9e40067330 0x7f9e400697e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006dc0 tx=0x7f9e50008040 comp rx=0 tx=0).stop 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e60142d80 msgr2=0x7f9e60141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e60142d80 0x7f9e60141dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9e48004730 tx=0x7f9e5401a000 comp rx=0 tx=0).stop 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 shutdown_connections 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9e40067330 0x7f9e400697e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5a60 0x7f9e60143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e48003fe0 0x7f9e6014f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 --2- 172.21.15.142:0/3240603970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e60142d80 0x7f9e60141dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 >> 172.21.15.142:0/3240603970 conn(0x7f9e600cc670 msgr2=0x7f9e601584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 shutdown_connections 2023-09-30T22:52:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.285+0000 7f9e649ff700 1 -- 172.21.15.142:0/3240603970 wait complete. 2023-09-30T22:52:42.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:52:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.497+0000 7fad0f5ff700 1 Processor -- start 2023-09-30T22:52:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.497+0000 7fad0f5ff700 1 -- start start 2023-09-30T22:52:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.498+0000 7fad0f5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad08159f10 0x7fad0806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.498+0000 7fad0f5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0806b650 con 0x7fad08067620 2023-09-30T22:52:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.498+0000 7fad0f5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0806aa40 con 0x7fad08159b40 2023-09-30T22:52:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.498+0000 7fad0f5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0806ad20 con 0x7fad08159f10 2023-09-30T22:52:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.498+0000 7fad0cb9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad08159f10 0x7fad0806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.498+0000 7fad0db9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fad08067620 0x7fad08067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44666/0 (socket says 172.21.15.142:44666) 2023-09-30T22:52:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7fad0db9c700 1 -- 172.21.15.142:0/3339388181 learned_addr learned my addr 172.21.15.142:0/3339388181 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:42.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7facfffff700 1 -- 172.21.15.142:0/3339388181 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642172959 0 0) 0x7fad0806b650 con 0x7fad08067620 2023-09-30T22:52:42.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7fad0cb9a700 1 -- 172.21.15.142:0/3339388181 >> v1:172.21.15.148:6789/0 conn(0x7fad08159b40 legacy=0x7fad080683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7fad0cb9a700 1 -- 172.21.15.142:0/3339388181 >> v1:172.21.15.142:6789/0 conn(0x7fad08067620 legacy=0x7fad08067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7fad0cb9a700 1 -- 172.21.15.142:0/3339388181 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0806b000 con 0x7fad08159f10 2023-09-30T22:52:42.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7fad0cb9a700 1 --2- 172.21.15.142:0/3339388181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0806a360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a700ebf5bf194cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7facfffff700 1 -- 172.21.15.142:0/3339388181 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8009e80 con 0x7fad08159f10 2023-09-30T22:52:42.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7facfffff700 1 -- 172.21.15.142:0/3339388181 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800b860 con 0x7fad08159f10 2023-09-30T22:52:42.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.499+0000 7facfffff700 1 -- 172.21.15.142:0/3339388181 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800bbe0 con 0x7fad08159f10 2023-09-30T22:52:42.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.500+0000 7fad0f5ff700 1 -- 172.21.15.142:0/3339388181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 msgr2=0x7fad0806a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.500+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/3339388181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0806a360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.500+0000 7fad0f5ff700 1 -- 172.21.15.142:0/3339388181 shutdown_connections 2023-09-30T22:52:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.500+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/3339388181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0806a360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.500+0000 7fad0f5ff700 1 -- 172.21.15.142:0/3339388181 >> 172.21.15.142:0/3339388181 conn(0x7fad080c9950 msgr2=0x7fad080c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.500+0000 7fad0f5ff700 1 -- 172.21.15.142:0/3339388181 shutdown_connections 2023-09-30T22:52:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.500+0000 7fad0f5ff700 1 -- 172.21.15.142:0/3339388181 wait complete. 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.501+0000 7fad0f5ff700 1 Processor -- start 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.502+0000 7fad0f5ff700 1 -- start start 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.502+0000 7fad0f5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad08067620 0x7fad0815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.502+0000 7fad0f5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad08159b40 0x7fad0815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.502+0000 7fad0f5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0816a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.502+0000 7fad0f5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0814d590 con 0x7fad08159f10 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.502+0000 7fad0f5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815bff0 con 0x7fad08159b40 2023-09-30T22:52:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.502+0000 7fad0f5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815b3e0 con 0x7fad08067620 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0816a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0816a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51448/0 (socket says 172.21.15.142:51448) 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 -- 172.21.15.142:0/2420498382 learned_addr learned my addr 172.21.15.142:0/2420498382 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0cb9a700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad08159b40 0x7fad0815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0d39b700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad08067620 0x7fad0815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 -- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad08067620 msgr2=0x7fad0815adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad08067620 0x7fad0815adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 -- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad08159b40 msgr2=0x7fad0815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad08159b40 0x7fad0815ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 -- 172.21.15.142:0/2420498382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009420 con 0x7fad08159f10 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0d39b700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad08067620 0x7fad0815adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7fad0db9c700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0816a1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad0000cc90 tx=0x7fad00001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.503+0000 7facfd7fa700 1 -- 172.21.15.142:0/2420498382 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000cea0 con 0x7fad08159f10 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.504+0000 7facfd7fa700 1 -- 172.21.15.142:0/2420498382 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000ab70 con 0x7fad08159f10 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.504+0000 7facfd7fa700 1 -- 172.21.15.142:0/2420498382 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000070f0 con 0x7fad08159f10 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.504+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0815b6c0 con 0x7fad08159f10 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.504+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0815bc80 con 0x7fad08159f10 2023-09-30T22:52:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.505+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad080699b0 con 0x7fad08159f10 2023-09-30T22:52:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.505+0000 7facfd7fa700 1 -- 172.21.15.142:0/2420498382 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad000074a0 con 0x7fad08159f10 2023-09-30T22:52:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.506+0000 7facfd7fa700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facec067330 0x7facec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.506+0000 7facfd7fa700 1 -- 172.21.15.142:0/2420498382 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad000850e0 con 0x7fad08159f10 2023-09-30T22:52:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.507+0000 7fad0d39b700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facec067330 0x7facec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.507+0000 7fad0d39b700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facec067330 0x7facec0697e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad04001840 tx=0x7fad04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.511+0000 7facfd7fa700 1 -- 172.21.15.142:0/2420498382 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad00051fc0 con 0x7fad08159f10 2023-09-30T22:52:42.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.699+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad0806fc10 con 0x7fad08159f10 2023-09-30T22:52:42.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.699+0000 7facfd7fa700 1 -- 172.21.15.142:0/2420498382 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad000555e0 con 0x7fad08159f10 2023-09-30T22:52:42.700 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:52:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.701+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facec067330 msgr2=0x7facec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.701+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facec067330 0x7facec0697e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad04001840 tx=0x7fad04009040 comp rx=0 tx=0).stop 2023-09-30T22:52:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.701+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 msgr2=0x7fad0816a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.701+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0816a1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad0000cc90 tx=0x7fad00001a80 comp rx=0 tx=0).stop 2023-09-30T22:52:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 shutdown_connections 2023-09-30T22:52:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facec067330 0x7facec0697e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad08159f10 0x7fad0816a1f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad08067620 0x7fad0815adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 --2- 172.21.15.142:0/2420498382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad08159b40 0x7fad0815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 >> 172.21.15.142:0/2420498382 conn(0x7fad080c9950 msgr2=0x7fad080c2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 shutdown_connections 2023-09-30T22:52:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.702+0000 7fad0f5ff700 1 -- 172.21.15.142:0/2420498382 wait complete. 2023-09-30T22:52:42.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:52:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.911+0000 7fbd1a5ff700 1 Processor -- start 2023-09-30T22:52:42.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.912+0000 7fbd1a5ff700 1 -- start start 2023-09-30T22:52:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd1a5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd14157ab0 0x7fbd1415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd1a5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbd140cc3b0 0x7fbd140cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd1a5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd140d0550 con 0x7fbd140cbfe0 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd1a5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140cf750 con 0x7fbd14157ab0 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd1a5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140cf940 con 0x7fbd140cc3b0 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd137fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd14157ab0 0x7fbd1415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd137fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd14157ab0 0x7fbd1415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51462/0 (socket says 172.21.15.142:51462) 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd137fe700 1 -- 172.21.15.142:0/638809664 learned_addr learned my addr 172.21.15.142:0/638809664 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.913+0000 7fbd18b9c700 1 --2- 172.21.15.142:0/638809664 >> v2:172.21.15.148:3300/0 conn(0x7fbd140cc3b0 0x7fbd140cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd137fe700 1 -- 172.21.15.142:0/638809664 >> v2:172.21.15.148:3300/0 conn(0x7fbd140cc3b0 msgr2=0x7fbd140cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd137fe700 1 --2- 172.21.15.142:0/638809664 >> v2:172.21.15.148:3300/0 conn(0x7fbd140cc3b0 0x7fbd140cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd137fe700 1 -- 172.21.15.142:0/638809664 >> v1:172.21.15.148:6789/0 conn(0x7fbd140cbfe0 legacy=0x7fbd141573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd137fe700 1 -- 172.21.15.142:0/638809664 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140cfc20 con 0x7fbd14157ab0 2023-09-30T22:52:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd137fe700 1 --2- 172.21.15.142:0/638809664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd14157ab0 0x7fbd1415a2a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd140ceaf0 tx=0x7fbd08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0339c1037cb04bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd12ffd700 1 -- 172.21.15.142:0/638809664 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08009e70 con 0x7fbd14157ab0 2023-09-30T22:52:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd12ffd700 1 -- 172.21.15.142:0/638809664 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800b860 con 0x7fbd14157ab0 2023-09-30T22:52:42.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.914+0000 7fbd12ffd700 1 -- 172.21.15.142:0/638809664 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800bc00 con 0x7fbd14157ab0 2023-09-30T22:52:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/638809664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd14157ab0 msgr2=0x7fbd1415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/638809664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd14157ab0 0x7fbd1415a2a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd140ceaf0 tx=0x7fbd08009250 comp rx=0 tx=0).stop 2023-09-30T22:52:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/638809664 shutdown_connections 2023-09-30T22:52:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/638809664 >> v2:172.21.15.148:3300/0 conn(0x7fbd140cc3b0 0x7fbd140cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/638809664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd14157ab0 0x7fbd1415a2a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/638809664 >> 172.21.15.142:0/638809664 conn(0x7fbd140d0a80 msgr2=0x7fbd140d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:42.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/638809664 shutdown_connections 2023-09-30T22:52:42.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.915+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/638809664 wait complete. 2023-09-30T22:52:42.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.916+0000 7fbd1a5ff700 1 Processor -- start 2023-09-30T22:52:42.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.916+0000 7fbd1a5ff700 1 -- start start 2023-09-30T22:52:42.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.917+0000 7fbd1a5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd140cbfe0 0x7fbd14148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.917+0000 7fbd1a5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd140cc3b0 0x7fbd14145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.917+0000 7fbd1a5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd14157ab0 0x7fbd1416a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.917+0000 7fbd1a5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14146db0 con 0x7fbd140cc3b0 2023-09-30T22:52:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.917+0000 7fbd1a5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd141461a0 con 0x7fbd14157ab0 2023-09-30T22:52:42.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.917+0000 7fbd1a5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14146480 con 0x7fbd140cbfe0 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd140cc3b0 0x7fbd14145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd140cc3b0 0x7fbd14145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51478/0 (socket says 172.21.15.142:51478) 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 -- 172.21.15.142:0/694011618 learned_addr learned my addr 172.21.15.142:0/694011618 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd18b9c700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd14157ab0 0x7fbd1416a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd13fff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd140cbfe0 0x7fbd14148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 -- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd140cbfe0 msgr2=0x7fbd14148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd140cbfe0 0x7fbd14148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 -- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd14157ab0 msgr2=0x7fbd1416a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd14157ab0 0x7fbd1416a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:42.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 -- 172.21.15.142:0/694011618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080094f0 con 0x7fbd140cc3b0 2023-09-30T22:52:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbd137fe700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd140cc3b0 0x7fbd14145950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406cf30 tx=0x7fbd08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbcfbfff700 1 -- 172.21.15.142:0/694011618 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800bbe0 con 0x7fbd140cc3b0 2023-09-30T22:52:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.918+0000 7fbcfbfff700 1 -- 172.21.15.142:0/694011618 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd08027450 con 0x7fbd140cc3b0 2023-09-30T22:52:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.919+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd14146760 con 0x7fbd140cc3b0 2023-09-30T22:52:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.919+0000 7fbcfbfff700 1 -- 172.21.15.142:0/694011618 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08027810 con 0x7fbd140cc3b0 2023-09-30T22:52:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.919+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd14145e90 con 0x7fbd140cc3b0 2023-09-30T22:52:42.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.920+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd14069770 con 0x7fbd140cc3b0 2023-09-30T22:52:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.921+0000 7fbcfbfff700 1 -- 172.21.15.142:0/694011618 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbd0801a430 con 0x7fbd140cc3b0 2023-09-30T22:52:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.921+0000 7fbcfbfff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd00067330 0x7fbd000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.922+0000 7fbcfbfff700 1 -- 172.21.15.142:0/694011618 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbd08086a30 con 0x7fbd140cc3b0 2023-09-30T22:52:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.922+0000 7fbd13fff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd00067330 0x7fbd000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:42.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.922+0000 7fbd13fff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd00067330 0x7fbd000697e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd04003a80 tx=0x7fbd04007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:42.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:42.926+0000 7fbcfbfff700 1 -- 172.21.15.142:0/694011618 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbd08053910 con 0x7fbd140cc3b0 2023-09-30T22:52:43.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.116+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd1406fc10 con 0x7fbd140cc3b0 2023-09-30T22:52:43.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.116+0000 7fbcfbfff700 1 -- 172.21.15.142:0/694011618 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd08015020 con 0x7fbd140cc3b0 2023-09-30T22:52:43.117 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:52:43.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd00067330 msgr2=0x7fbd000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd00067330 0x7fbd000697e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd04003a80 tx=0x7fbd04007ec0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd140cc3b0 msgr2=0x7fbd14145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd140cc3b0 0x7fbd14145950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406cf30 tx=0x7fbd08017000 comp rx=0 tx=0).stop 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 shutdown_connections 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd00067330 0x7fbd000697e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd14157ab0 0x7fbd1416a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd140cbfe0 0x7fbd14148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 --2- 172.21.15.142:0/694011618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd140cc3b0 0x7fbd14145950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 >> 172.21.15.142:0/694011618 conn(0x7fbd140d0a80 msgr2=0x7fbd14156770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 shutdown_connections 2023-09-30T22:52:43.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.119+0000 7fbd1a5ff700 1 -- 172.21.15.142:0/694011618 wait complete. 2023-09-30T22:52:43.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:52:43.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.326+0000 7f91fb5ff700 1 Processor -- start 2023-09-30T22:52:43.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.326+0000 7f91fb5ff700 1 -- start start 2023-09-30T22:52:43.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91fb5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91fb5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91f406b930 0x7f91f40aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91fb5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f4068000 con 0x7f91f4159b50 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91fb5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f4069f10 con 0x7f91f406b930 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91fb5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4068240 con 0x7f91f40ac3a0 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91f939b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f91f4159b50 0x7f91f40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44682/0 (socket says 172.21.15.142:44682) 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91f939b700 1 -- 172.21.15.142:0/1824057117 learned_addr learned my addr 172.21.15.142:0/1824057117 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.327+0000 7f91f9b9c700 1 --2- 172.21.15.142:0/1824057117 >> v2:172.21.15.142:3300/0 conn(0x7f91f406b930 0x7f91f40aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91f8b9a700 1 --2- 172.21.15.142:0/1824057117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91ebfff700 1 -- 172.21.15.142:0/1824057117 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694508459 0 0) 0x7f91f0001110 con 0x7f91f4159b50 2023-09-30T22:52:43.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91ebfff700 1 -- 172.21.15.142:0/1824057117 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e0003570 con 0x7f91f4159b50 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91f9b9c700 1 -- 172.21.15.142:0/1824057117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 msgr2=0x7f91f40aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91f9b9c700 1 --2- 172.21.15.142:0/1824057117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91f9b9c700 1 -- 172.21.15.142:0/1824057117 >> v1:172.21.15.142:6789/0 conn(0x7f91f4159b50 legacy=0x7f91f40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91f9b9c700 1 -- 172.21.15.142:0/1824057117 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f4068520 con 0x7f91f406b930 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91f9b9c700 1 --2- 172.21.15.142:0/1824057117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f406b930 0x7f91f40aa7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009e60 tx=0x7f91ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8750859ed1a911a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91ebfff700 1 -- 172.21.15.142:0/1824057117 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00e070 con 0x7f91f406b930 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91ebfff700 1 -- 172.21.15.142:0/1824057117 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00bab0 con 0x7f91f406b930 2023-09-30T22:52:43.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.328+0000 7f91ebfff700 1 -- 172.21.15.142:0/1824057117 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00be70 con 0x7f91f406b930 2023-09-30T22:52:43.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 -- 172.21.15.142:0/1824057117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f406b930 msgr2=0x7f91f40aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/1824057117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f406b930 0x7f91f40aa7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009e60 tx=0x7f91ec009780 comp rx=0 tx=0).stop 2023-09-30T22:52:43.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 -- 172.21.15.142:0/1824057117 shutdown_connections 2023-09-30T22:52:43.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/1824057117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f406b930 0x7f91f40aa7e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/1824057117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 -- 172.21.15.142:0/1824057117 >> 172.21.15.142:0/1824057117 conn(0x7f91f406dab0 msgr2=0x7f91f40aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 -- 172.21.15.142:0/1824057117 shutdown_connections 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.329+0000 7f91fb5ff700 1 -- 172.21.15.142:0/1824057117 wait complete. 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.331+0000 7f91fb5ff700 1 Processor -- start 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.331+0000 7f91fb5ff700 1 -- start start 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91fb5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f406b930 0x7f91f40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91fb5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91fb5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f4159b50 0x7f91f414b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91fb5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40aeae0 con 0x7f91f4159b50 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91fb5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40aded0 con 0x7f91f406b930 2023-09-30T22:52:43.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91fb5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40ae1b0 con 0x7f91f40ac3a0 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f4159b50 0x7f91f414b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f4159b50 0x7f91f414b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51488/0 (socket says 172.21.15.142:51488) 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 -- 172.21.15.142:0/2703356766 learned_addr learned my addr 172.21.15.142:0/2703356766 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f939b700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f406b930 0x7f91f40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f8b9a700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 -- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 msgr2=0x7f91f40ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 -- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f406b930 msgr2=0x7f91f40b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f406b930 0x7f91f40b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f9b9c700 1 -- 172.21.15.142:0/2703356766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009a20 con 0x7f91f4159b50 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.332+0000 7f91f939b700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f406b930 0x7f91f40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:43.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.333+0000 7f91f9b9c700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f4159b50 0x7f91f414b8c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f91f406c8a0 tx=0x7f91ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.333+0000 7f91e97fa700 1 -- 172.21.15.142:0/2703356766 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec027470 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.333+0000 7f91e97fa700 1 -- 172.21.15.142:0/2703356766 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec0275f0 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.333+0000 7f91e97fa700 1 -- 172.21.15.142:0/2703356766 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0279b0 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.333+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f40ae490 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.333+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f40adbc0 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.334+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f406cfd0 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.335+0000 7f91e97fa700 1 -- 172.21.15.142:0/2703356766 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f91ec024070 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.336+0000 7f91e97fa700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d8067330 0x7f91d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.336+0000 7f91e97fa700 1 -- 172.21.15.142:0/2703356766 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f91ec0875f0 con 0x7f91f4159b50 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.336+0000 7f91f939b700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d8067330 0x7f91d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.336+0000 7f91f939b700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d8067330 0x7f91d80697e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91f0001270 tx=0x7f91f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:43.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.340+0000 7f91e97fa700 1 -- 172.21.15.142:0/2703356766 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f91ec054450 con 0x7f91f4159b50 2023-09-30T22:52:43.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.574+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91f40aec20 con 0x7f91f4159b50 2023-09-30T22:52:43.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.575+0000 7f91e97fa700 1 -- 172.21.15.142:0/2703356766 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f91ec057a70 con 0x7f91f4159b50 2023-09-30T22:52:43.575 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:43.575 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:52:43.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d8067330 msgr2=0x7f91d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d8067330 0x7f91d80697e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91f0001270 tx=0x7f91f0009040 comp rx=0 tx=0).stop 2023-09-30T22:52:43.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f4159b50 msgr2=0x7f91f414b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f4159b50 0x7f91f414b8c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f91f406c8a0 tx=0x7f91ec019000 comp rx=0 tx=0).stop 2023-09-30T22:52:43.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 shutdown_connections 2023-09-30T22:52:43.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d8067330 0x7f91d80697e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f4159b50 0x7f91f414b8c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f406b930 0x7f91f40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 --2- 172.21.15.142:0/2703356766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f40ac3a0 0x7f91f40ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 >> 172.21.15.142:0/2703356766 conn(0x7f91f406dab0 msgr2=0x7f91f414e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:43.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 shutdown_connections 2023-09-30T22:52:43.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.577+0000 7f91fb5ff700 1 -- 172.21.15.142:0/2703356766 wait complete. 2023-09-30T22:52:43.579 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:52:43.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:43.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.783+0000 7fd7315ff700 1 Processor -- start 2023-09-30T22:52:43.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.783+0000 7fd7315ff700 1 -- start start 2023-09-30T22:52:43.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.784+0000 7fd7315ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159ae0 0x7fd72c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.784+0000 7fd7315ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd72c0b1180 0x7fd72c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.784+0000 7fd7315ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd72c159eb0 0x7fd72c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.784+0000 7fd7315ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c15e920 con 0x7fd72c159eb0 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.784+0000 7fd7315ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c15d910 con 0x7fd72c0b1180 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.784+0000 7fd7315ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c15e490 con 0x7fd72c159ae0 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd72c159eb0 0x7fd72c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd72c159eb0 0x7fd72c0cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51500/0 (socket says 172.21.15.142:51500) 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 -- 172.21.15.142:0/3425711178 learned_addr learned my addr 172.21.15.142:0/3425711178 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72a7fc700 1 --2- 172.21.15.142:0/3425711178 >> v2:172.21.15.148:3300/0 conn(0x7fd72c0b1180 0x7fd72c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72affd700 1 --2- 172.21.15.142:0/3425711178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159ae0 0x7fd72c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 -- 172.21.15.142:0/3425711178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159ae0 msgr2=0x7fd72c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:43.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 --2- 172.21.15.142:0/3425711178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159ae0 0x7fd72c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 -- 172.21.15.142:0/3425711178 >> v2:172.21.15.148:3300/0 conn(0x7fd72c0b1180 msgr2=0x7fd72c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:43.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 --2- 172.21.15.142:0/3425711178 >> v2:172.21.15.148:3300/0 conn(0x7fd72c0b1180 0x7fd72c0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 -- 172.21.15.142:0/3425711178 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c15db60 con 0x7fd72c159eb0 2023-09-30T22:52:43.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.785+0000 7fd72b7fe700 1 --2- 172.21.15.142:0/3425711178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159eb0 0x7fd72c0cc3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd72c064050 tx=0x7fd724009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5798546c456f4ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:43.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd729ffb700 1 -- 172.21.15.142:0/3425711178 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400e070 con 0x7fd72c159eb0 2023-09-30T22:52:43.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd729ffb700 1 -- 172.21.15.142:0/3425711178 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72400b970 con 0x7fd72c159eb0 2023-09-30T22:52:43.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd729ffb700 1 -- 172.21.15.142:0/3425711178 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7240092e0 con 0x7fd72c159eb0 2023-09-30T22:52:43.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 -- 172.21.15.142:0/3425711178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159eb0 msgr2=0x7fd72c0cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 --2- 172.21.15.142:0/3425711178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159eb0 0x7fd72c0cc3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd72c064050 tx=0x7fd724009840 comp rx=0 tx=0).stop 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 -- 172.21.15.142:0/3425711178 shutdown_connections 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 --2- 172.21.15.142:0/3425711178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159eb0 0x7fd72c0cc3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 --2- 172.21.15.142:0/3425711178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159ae0 0x7fd72c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 --2- 172.21.15.142:0/3425711178 >> v2:172.21.15.148:3300/0 conn(0x7fd72c0b1180 0x7fd72c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 -- 172.21.15.142:0/3425711178 >> 172.21.15.142:0/3425711178 conn(0x7fd72c0ce8b0 msgr2=0x7fd72c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 -- 172.21.15.142:0/3425711178 shutdown_connections 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.786+0000 7fd7315ff700 1 -- 172.21.15.142:0/3425711178 wait complete. 2023-09-30T22:52:43.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.788+0000 7fd7315ff700 1 Processor -- start 2023-09-30T22:52:43.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.789+0000 7fd7315ff700 1 -- start start 2023-09-30T22:52:43.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd7315ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c0b1180 0x7fd72c16a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd7315ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159ae0 0x7fd72c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd7315ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159eb0 0x7fd72c1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd7315ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0c7ec0 con 0x7fd72c159ae0 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd7315ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0c7b70 con 0x7fd72c0b1180 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd7315ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c15bd30 con 0x7fd72c159eb0 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159ae0 0x7fd72c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159ae0 0x7fd72c15b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51506/0 (socket says 172.21.15.142:51506) 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 -- 172.21.15.142:0/237467813 learned_addr learned my addr 172.21.15.142:0/237467813 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72affd700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c0b1180 0x7fd72c16a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72b7fe700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159eb0 0x7fd72c1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 -- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159eb0 msgr2=0x7fd72c1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159eb0 0x7fd72c1554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 -- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c0b1180 msgr2=0x7fd72c16a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c0b1180 0x7fd72c16a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.790+0000 7fd72a7fc700 1 -- 172.21.15.142:0/237467813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724009ae0 con 0x7fd72c159ae0 2023-09-30T22:52:43.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.791+0000 7fd72a7fc700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159ae0 0x7fd72c15b4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd72000ec80 tx=0x7fd7200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:43.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.791+0000 7fd712ffd700 1 -- 172.21.15.142:0/237467813 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000c9d0 con 0x7fd72c159ae0 2023-09-30T22:52:43.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.791+0000 7fd712ffd700 1 -- 172.21.15.142:0/237467813 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72000cb30 con 0x7fd72c159ae0 2023-09-30T22:52:43.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.791+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c15c010 con 0x7fd72c159ae0 2023-09-30T22:52:43.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.791+0000 7fd712ffd700 1 -- 172.21.15.142:0/237467813 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720013470 con 0x7fd72c159ae0 2023-09-30T22:52:43.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.791+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c15c3a0 con 0x7fd72c159ae0 2023-09-30T22:52:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.792+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c15c1a0 con 0x7fd72c159ae0 2023-09-30T22:52:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.793+0000 7fd712ffd700 1 -- 172.21.15.142:0/237467813 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd720013820 con 0x7fd72c159ae0 2023-09-30T22:52:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.794+0000 7fd712ffd700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd718067330 0x7fd7180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.794+0000 7fd712ffd700 1 -- 172.21.15.142:0/237467813 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd720084fc0 con 0x7fd72c159ae0 2023-09-30T22:52:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.794+0000 7fd72affd700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd718067330 0x7fd7180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.794+0000 7fd72affd700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd718067330 0x7fd7180697e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009d40 tx=0x7fd71c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:43.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.798+0000 7fd712ffd700 1 -- 172.21.15.142:0/237467813 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd720051e20 con 0x7fd72c159ae0 2023-09-30T22:52:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.987+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd72c15de40 con 0x7fd72c159ae0 2023-09-30T22:52:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.988+0000 7fd712ffd700 1 -- 172.21.15.142:0/237467813 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fd720017090 con 0x7fd72c159ae0 2023-09-30T22:52:43.988 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:43.988 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:43.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd718067330 msgr2=0x7fd7180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd718067330 0x7fd7180697e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009d40 tx=0x7fd71c008040 comp rx=0 tx=0).stop 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159ae0 msgr2=0x7fd72c15b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159ae0 0x7fd72c15b4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd72000ec80 tx=0x7fd7200091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 shutdown_connections 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd718067330 0x7fd7180697e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd72c159eb0 0x7fd72c1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c0b1180 0x7fd72c16a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 --2- 172.21.15.142:0/237467813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c159ae0 0x7fd72c15b4e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 >> 172.21.15.142:0/237467813 conn(0x7fd72c0ce8b0 msgr2=0x7fd72c069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 shutdown_connections 2023-09-30T22:52:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:43.990+0000 7fd7315ff700 1 -- 172.21.15.142:0/237467813 wait complete. 2023-09-30T22:52:44.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:52:27.833414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:52:28.438662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:52:44.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:52:44.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.202+0000 7f340ebff700 1 Processor -- start 2023-09-30T22:52:44.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.202+0000 7f340ebff700 1 -- start start 2023-09-30T22:52:44.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.203+0000 7f340ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34080c52a0 0x7f34080c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.203+0000 7f340ebff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080c7690 con 0x7f34080cb350 2023-09-30T22:52:44.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.203+0000 7f340ebff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080c7f20 con 0x7f3408069f10 2023-09-30T22:52:44.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.203+0000 7f340ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34081406a0 con 0x7f34080c52a0 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.203+0000 7f340d19c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f34080cb350 0x7f34081605e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44698/0 (socket says 172.21.15.142:44698) 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.203+0000 7f340d19c700 1 -- 172.21.15.142:0/709994068 learned_addr learned my addr 172.21.15.142:0/709994068 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f340c99b700 1 --2- 172.21.15.142:0/709994068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34080c52a0 0x7f34080c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f34077fe700 1 -- 172.21.15.142:0/709994068 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676536644 0 0) 0x7f3400001490 con 0x7f34080cb350 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f34077fe700 1 -- 172.21.15.142:0/709994068 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f8003570 con 0x7f34080cb350 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f34077fe700 1 -- 172.21.15.142:0/709994068 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960368485 0 0) 0x7f34080c7f20 con 0x7f3408069f10 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f34077fe700 1 -- 172.21.15.142:0/709994068 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3400001490 con 0x7f3408069f10 2023-09-30T22:52:44.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f340c99b700 1 -- 172.21.15.142:0/709994068 >> v1:172.21.15.148:6789/0 conn(0x7f3408069f10 legacy=0x7f34080c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f340c99b700 1 -- 172.21.15.142:0/709994068 >> v1:172.21.15.142:6789/0 conn(0x7f34080cb350 legacy=0x7f34081605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f340c99b700 1 -- 172.21.15.142:0/709994068 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080c8e10 con 0x7f34080c52a0 2023-09-30T22:52:44.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.204+0000 7f340c99b700 1 --2- 172.21.15.142:0/709994068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34080c52a0 0x7f34080c88d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009910 tx=0x7f33fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ea440c2e89fe90b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:44.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f34077fe700 1 -- 172.21.15.142:0/709994068 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011630 con 0x7f34080c52a0 2023-09-30T22:52:44.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f34077fe700 1 -- 172.21.15.142:0/709994068 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc011790 con 0x7f34080c52a0 2023-09-30T22:52:44.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f34077fe700 1 -- 172.21.15.142:0/709994068 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011b10 con 0x7f34080c52a0 2023-09-30T22:52:44.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f340ebff700 1 -- 172.21.15.142:0/709994068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34080c52a0 msgr2=0x7f34080c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f340ebff700 1 --2- 172.21.15.142:0/709994068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34080c52a0 0x7f34080c88d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009910 tx=0x7f33fc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f340ebff700 1 -- 172.21.15.142:0/709994068 shutdown_connections 2023-09-30T22:52:44.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f340ebff700 1 --2- 172.21.15.142:0/709994068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34080c52a0 0x7f34080c88d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f340ebff700 1 -- 172.21.15.142:0/709994068 >> 172.21.15.142:0/709994068 conn(0x7f34080cc670 msgr2=0x7f34080cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:44.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f340ebff700 1 -- 172.21.15.142:0/709994068 shutdown_connections 2023-09-30T22:52:44.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.205+0000 7f340ebff700 1 -- 172.21.15.142:0/709994068 wait complete. 2023-09-30T22:52:44.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.207+0000 7f340ebff700 1 Processor -- start 2023-09-30T22:52:44.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.207+0000 7f340ebff700 1 -- start start 2023-09-30T22:52:44.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3408069f10 0x7f34080b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34080c52a0 0x7f3408156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340ebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080cb350 0x7f34080ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340813df00 con 0x7f34080c52a0 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340ebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340813e1a0 con 0x7f34080cb350 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340813e480 con 0x7f3408069f10 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34080c52a0 0x7f3408156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34080c52a0 0x7f3408156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51512/0 (socket says 172.21.15.142:51512) 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 -- 172.21.15.142:0/2409161723 learned_addr learned my addr 172.21.15.142:0/2409161723 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340c99b700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3408069f10 0x7f34080b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340d19c700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080cb350 0x7f34080ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 -- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3408069f10 msgr2=0x7f34080b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3408069f10 0x7f34080b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 -- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080cb350 msgr2=0x7f34080ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080cb350 0x7f34080ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 -- 172.21.15.142:0/2409161723 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc009420 con 0x7f34080c52a0 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f340d19c700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080cb350 0x7f34080ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.208+0000 7f3407fff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34080c52a0 0x7f3408156050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33f400c7c0 tx=0x7f33f4007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.209+0000 7f3404ff9700 1 -- 172.21.15.142:0/2409161723 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4010510 con 0x7f34080c52a0 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.209+0000 7f3404ff9700 1 -- 172.21.15.142:0/2409161723 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f4002e90 con 0x7f34080c52a0 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.209+0000 7f3404ff9700 1 -- 172.21.15.142:0/2409161723 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40108e0 con 0x7f34080c52a0 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.209+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340813e760 con 0x7f34080c52a0 2023-09-30T22:52:44.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.209+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34080b4460 con 0x7f34080c52a0 2023-09-30T22:52:44.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.210+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340813e950 con 0x7f34080c52a0 2023-09-30T22:52:44.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.211+0000 7f3404ff9700 1 -- 172.21.15.142:0/2409161723 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f33f4010cd0 con 0x7f34080c52a0 2023-09-30T22:52:44.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.212+0000 7f3404ff9700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f33ec067330 0x7f33ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.212+0000 7f3404ff9700 1 -- 172.21.15.142:0/2409161723 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f33f4084320 con 0x7f34080c52a0 2023-09-30T22:52:44.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.212+0000 7f340c99b700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f33ec067330 0x7f33ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.212+0000 7f340c99b700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f33ec067330 0x7f33ec0697e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009860 tx=0x7f33fc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:44.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.216+0000 7f3404ff9700 1 -- 172.21.15.142:0/2409161723 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f340813e950 con 0x7f34080c52a0 2023-09-30T22:52:44.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.407+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34081666b0 con 0x7f34080c52a0 2023-09-30T22:52:44.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.407+0000 7f3404ff9700 1 -- 172.21.15.142:0/2409161723 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33f4017020 con 0x7f34080c52a0 2023-09-30T22:52:44.408 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:52:44.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f33ec067330 msgr2=0x7f33ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f33ec067330 0x7f33ec0697e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009860 tx=0x7f33fc017000 comp rx=0 tx=0).stop 2023-09-30T22:52:44.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34080c52a0 msgr2=0x7f3408156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34080c52a0 0x7f3408156050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33f400c7c0 tx=0x7f33f4007de0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 shutdown_connections 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f33ec067330 0x7f33ec0697e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080cb350 0x7f34080ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3408069f10 0x7f34080b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 --2- 172.21.15.142:0/2409161723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34080c52a0 0x7f3408156050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 >> 172.21.15.142:0/2409161723 conn(0x7f34080cc670 msgr2=0x7f34080c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 shutdown_connections 2023-09-30T22:52:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.410+0000 7f340ebff700 1 -- 172.21.15.142:0/2409161723 wait complete. 2023-09-30T22:52:44.427 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:52:44.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.619+0000 7faf0ffff700 1 Processor -- start 2023-09-30T22:52:44.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.619+0000 7faf0ffff700 1 -- start start 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.620+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf08157ab0 0x7faf0815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.620+0000 7faf0ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080d0550 con 0x7faf080cbfe0 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.620+0000 7faf0ffff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080cf940 con 0x7faf080cc3b0 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.620+0000 7faf0ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080cfc20 con 0x7faf08157ab0 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.620+0000 7faf0dd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faf080cbfe0 0x7faf081573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44712/0 (socket says 172.21.15.142:44712) 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0dd9b700 1 -- 172.21.15.142:0/1055751419 learned_addr learned my addr 172.21.15.142:0/1055751419 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0d59a700 1 --2- 172.21.15.142:0/1055751419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf08157ab0 0x7faf0815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0cd99700 1 -- 172.21.15.142:0/1055751419 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710699533 0 0) 0x7faf080d0550 con 0x7faf080cbfe0 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0cd99700 1 -- 172.21.15.142:0/1055751419 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef4003570 con 0x7faf080cbfe0 2023-09-30T22:52:44.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0cd99700 1 -- 172.21.15.142:0/1055751419 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242708815 0 0) 0x7faf080cf940 con 0x7faf080cc3b0 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0cd99700 1 -- 172.21.15.142:0/1055751419 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf080d0550 con 0x7faf080cc3b0 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0d59a700 1 -- 172.21.15.142:0/1055751419 >> v1:172.21.15.148:6789/0 conn(0x7faf080cc3b0 legacy=0x7faf0806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0d59a700 1 -- 172.21.15.142:0/1055751419 >> v1:172.21.15.142:6789/0 conn(0x7faf080cbfe0 legacy=0x7faf081573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0d59a700 1 -- 172.21.15.142:0/1055751419 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080cff00 con 0x7faf08157ab0 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.621+0000 7faf0d59a700 1 --2- 172.21.15.142:0/1055751419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf08157ab0 0x7faf0815a2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faef8009940 tx=0x7faef80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4f7dd17c5d43cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0cd99700 1 -- 172.21.15.142:0/1055751419 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8011630 con 0x7faf08157ab0 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0cd99700 1 -- 172.21.15.142:0/1055751419 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8011790 con 0x7faf08157ab0 2023-09-30T22:52:44.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0cd99700 1 -- 172.21.15.142:0/1055751419 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8011b30 con 0x7faf08157ab0 2023-09-30T22:52:44.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0ffff700 1 -- 172.21.15.142:0/1055751419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf08157ab0 msgr2=0x7faf0815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1055751419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf08157ab0 0x7faf0815a2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faef8009940 tx=0x7faef80091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0ffff700 1 -- 172.21.15.142:0/1055751419 shutdown_connections 2023-09-30T22:52:44.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1055751419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf08157ab0 0x7faf0815a2a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0ffff700 1 -- 172.21.15.142:0/1055751419 >> 172.21.15.142:0/1055751419 conn(0x7faf080d0a80 msgr2=0x7faf080d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:44.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0ffff700 1 -- 172.21.15.142:0/1055751419 shutdown_connections 2023-09-30T22:52:44.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.622+0000 7faf0ffff700 1 -- 172.21.15.142:0/1055751419 wait complete. 2023-09-30T22:52:44.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.624+0000 7faf0ffff700 1 Processor -- start 2023-09-30T22:52:44.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.624+0000 7faf0ffff700 1 -- start start 2023-09-30T22:52:44.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf080cbfe0 0x7faf080c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf080cc3b0 0x7faf08152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf08157ab0 0x7faf080c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0816e620 con 0x7faf08157ab0 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0816e900 con 0x7faf080cbfe0 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0816ebe0 con 0x7faf080cc3b0 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf08157ab0 0x7faf080c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf080cbfe0 0x7faf080c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0d59a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf080cc3b0 0x7faf08152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf08157ab0 0x7faf080c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51526/0 (socket says 172.21.15.142:51526) 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf080cbfe0 0x7faf080c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:33916/0 (socket says 172.21.15.142:33916) 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 -- 172.21.15.142:0/1240658412 learned_addr learned my addr 172.21.15.142:0/1240658412 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 -- 172.21.15.142:0/1240658412 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf080cc3b0 msgr2=0x7faf08152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf080cc3b0 0x7faf08152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 -- 172.21.15.142:0/1240658412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf080cbfe0 msgr2=0x7faf080c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf080cbfe0 0x7faf080c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0e59c700 1 -- 172.21.15.142:0/1240658412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8009420 con 0x7faf08157ab0 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.625+0000 7faf0dd9b700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf080cbfe0 0x7faf080c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.626+0000 7faf0e59c700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf08157ab0 0x7faf080c4e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf0000c910 tx=0x7faf000027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.626+0000 7faefdffb700 1 -- 172.21.15.142:0/1240658412 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00012630 con 0x7faf08157ab0 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.626+0000 7faefdffb700 1 -- 172.21.15.142:0/1240658412 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf000127b0 con 0x7faf08157ab0 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.626+0000 7faefdffb700 1 -- 172.21.15.142:0/1240658412 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00012b70 con 0x7faf08157ab0 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.626+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0816eec0 con 0x7faf08157ab0 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.626+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0816e190 con 0x7faf08157ab0 2023-09-30T22:52:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.627+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf08069770 con 0x7faf08157ab0 2023-09-30T22:52:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.628+0000 7faefdffb700 1 -- 172.21.15.142:0/1240658412 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7faf0001b400 con 0x7faf08157ab0 2023-09-30T22:52:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.629+0000 7faefdffb700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faeec067330 0x7faeec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.629+0000 7faefdffb700 1 -- 172.21.15.142:0/1240658412 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf00084f20 con 0x7faf08157ab0 2023-09-30T22:52:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.629+0000 7faf0dd9b700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faeec067330 0x7faeec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.630+0000 7faf0dd9b700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faeec067330 0x7faeec0697e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf04007fd0 tx=0x7faf04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.634+0000 7faefdffb700 1 -- 172.21.15.142:0/1240658412 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faf00051dc0 con 0x7faf08157ab0 2023-09-30T22:52:44.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.820+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf0806ef10 con 0x7faf08157ab0 2023-09-30T22:52:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.820+0000 7faefdffb700 1 -- 172.21.15.142:0/1240658412 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf00016020 con 0x7faf08157ab0 2023-09-30T22:52:44.821 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:52:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faeec067330 msgr2=0x7faeec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faeec067330 0x7faeec0697e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf04007fd0 tx=0x7faf04009040 comp rx=0 tx=0).stop 2023-09-30T22:52:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf08157ab0 msgr2=0x7faf080c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf08157ab0 0x7faf080c4e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf0000c910 tx=0x7faf000027a0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 shutdown_connections 2023-09-30T22:52:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faeec067330 0x7faeec0697e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf08157ab0 0x7faf080c4e60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf080cbfe0 0x7faf080c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 --2- 172.21.15.142:0/1240658412 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf080cc3b0 0x7faf08152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.822+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 >> 172.21.15.142:0/1240658412 conn(0x7faf080d0a80 msgr2=0x7faf0806e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.823+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 shutdown_connections 2023-09-30T22:52:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:44.823+0000 7faf0ffff700 1 -- 172.21.15.142:0/1240658412 wait complete. 2023-09-30T22:52:44.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:52:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.034+0000 7f89697ff700 1 Processor -- start 2023-09-30T22:52:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.034+0000 7f89697ff700 1 -- start start 2023-09-30T22:52:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89697ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cbfe0 0x7f896415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89697ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89640cc3b0 0x7f89640cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89697ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89640d0550 con 0x7f89641573a0 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89697ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640cf750 con 0x7f89640cc3b0 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89697ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640cf940 con 0x7f89640cbfe0 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89637fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f89641573a0 0x7f896415d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44720/0 (socket says 172.21.15.142:44720) 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89637fe700 1 -- 172.21.15.142:0/1280758440 learned_addr learned my addr 172.21.15.142:0/1280758440 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f89627fc700 1 --2- 172.21.15.142:0/1280758440 >> v2:172.21.15.148:3300/0 conn(0x7f89640cc3b0 0x7f89640cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.035+0000 7f8962ffd700 1 --2- 172.21.15.142:0/1280758440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cbfe0 0x7f896415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8961ffb700 1 -- 172.21.15.142:0/1280758440 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391850000 0 0) 0x7f89640d0550 con 0x7f89641573a0 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8961ffb700 1 -- 172.21.15.142:0/1280758440 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f894c003570 con 0x7f89641573a0 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8962ffd700 1 -- 172.21.15.142:0/1280758440 >> v2:172.21.15.148:3300/0 conn(0x7f89640cc3b0 msgr2=0x7f89640cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8962ffd700 1 --2- 172.21.15.142:0/1280758440 >> v2:172.21.15.148:3300/0 conn(0x7f89640cc3b0 0x7f89640cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8962ffd700 1 -- 172.21.15.142:0/1280758440 >> v1:172.21.15.142:6789/0 conn(0x7f89641573a0 legacy=0x7f896415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8962ffd700 1 -- 172.21.15.142:0/1280758440 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640cfc20 con 0x7f89640cbfe0 2023-09-30T22:52:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f89627fc700 1 --2- 172.21.15.142:0/1280758440 >> v2:172.21.15.148:3300/0 conn(0x7f89640cc3b0 0x7f89640cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8962ffd700 1 --2- 172.21.15.142:0/1280758440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cbfe0 0x7f896415a2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8954009910 tx=0x7f89540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=567630db792bd13c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8961ffb700 1 -- 172.21.15.142:0/1280758440 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011630 con 0x7f89640cbfe0 2023-09-30T22:52:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8961ffb700 1 -- 172.21.15.142:0/1280758440 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954011790 con 0x7f89640cbfe0 2023-09-30T22:52:45.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.036+0000 7f8961ffb700 1 -- 172.21.15.142:0/1280758440 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011b30 con 0x7f89640cbfe0 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 -- 172.21.15.142:0/1280758440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cbfe0 msgr2=0x7f896415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 --2- 172.21.15.142:0/1280758440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cbfe0 0x7f896415a2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8954009910 tx=0x7f89540091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 -- 172.21.15.142:0/1280758440 shutdown_connections 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 --2- 172.21.15.142:0/1280758440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cbfe0 0x7f896415a2a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 --2- 172.21.15.142:0/1280758440 >> v2:172.21.15.148:3300/0 conn(0x7f89640cc3b0 0x7f89640cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 -- 172.21.15.142:0/1280758440 >> 172.21.15.142:0/1280758440 conn(0x7f89640d0a80 msgr2=0x7f89640d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 -- 172.21.15.142:0/1280758440 shutdown_connections 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.037+0000 7f89697ff700 1 -- 172.21.15.142:0/1280758440 wait complete. 2023-09-30T22:52:45.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.039+0000 7f89697ff700 1 Processor -- start 2023-09-30T22:52:45.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.039+0000 7f89697ff700 1 -- start start 2023-09-30T22:52:45.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.040+0000 7f89697ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89640cbfe0 0x7f896416ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.040+0000 7f89697ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cc3b0 0x7f89640cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89697ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89641573a0 0x7f8964154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89697ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640cb3d0 con 0x7f89641573a0 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89697ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c3cf0 con 0x7f89640cbfe0 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89697ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640b86a0 con 0x7f89640cc3b0 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89641573a0 0x7f8964154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89641573a0 0x7f8964154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51532/0 (socket says 172.21.15.142:51532) 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 -- 172.21.15.142:0/2478528805 learned_addr learned my addr 172.21.15.142:0/2478528805 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f8962ffd700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89640cbfe0 0x7f896416ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89627fc700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cc3b0 0x7f89640cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 -- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cc3b0 msgr2=0x7f89640cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cc3b0 0x7f89640cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 -- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89640cbfe0 msgr2=0x7f896416ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89640cbfe0 0x7f896416ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.041+0000 7f89637fe700 1 -- 172.21.15.142:0/2478528805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958009420 con 0x7f89641573a0 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.042+0000 7f89637fe700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89641573a0 0x7f8964154420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f895c00cc40 tx=0x7f895c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.042+0000 7f894affd700 1 -- 172.21.15.142:0/2478528805 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00a830 con 0x7f89641573a0 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.042+0000 7f894affd700 1 -- 172.21.15.142:0/2478528805 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00a990 con 0x7f89641573a0 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.042+0000 7f894affd700 1 -- 172.21.15.142:0/2478528805 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00ad10 con 0x7f89641573a0 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.042+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8954009420 con 0x7f89641573a0 2023-09-30T22:52:45.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.042+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8964154960 con 0x7f89641573a0 2023-09-30T22:52:45.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.043+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640b8830 con 0x7f89641573a0 2023-09-30T22:52:45.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.044+0000 7f894affd700 1 -- 172.21.15.142:0/2478528805 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f895c007300 con 0x7f89641573a0 2023-09-30T22:52:45.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.045+0000 7f894affd700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8950067330 0x7f89500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.045+0000 7f894affd700 1 -- 172.21.15.142:0/2478528805 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f895c084f80 con 0x7f89641573a0 2023-09-30T22:52:45.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.045+0000 7f8962ffd700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8950067330 0x7f89500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.046+0000 7f8962ffd700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8950067330 0x7f89500697e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8954003080 tx=0x7f8954017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.049+0000 7f894affd700 1 -- 172.21.15.142:0/2478528805 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f895c051dd0 con 0x7f89641573a0 2023-09-30T22:52:45.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.240+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f896406fc10 con 0x7f89641573a0 2023-09-30T22:52:45.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.240+0000 7f894affd700 1 -- 172.21.15.142:0/2478528805 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f895c0553f0 con 0x7f89641573a0 2023-09-30T22:52:45.241 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:52:45.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8950067330 msgr2=0x7f89500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8950067330 0x7f89500697e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8954003080 tx=0x7f8954017000 comp rx=0 tx=0).stop 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89641573a0 msgr2=0x7f8964154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89641573a0 0x7f8964154420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f895c00cc40 tx=0x7f895c001a40 comp rx=0 tx=0).stop 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 shutdown_connections 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8950067330 0x7f89500697e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89641573a0 0x7f8964154420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89640cbfe0 0x7f896416ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 --2- 172.21.15.142:0/2478528805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89640cc3b0 0x7f89640cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 >> 172.21.15.142:0/2478528805 conn(0x7f89640d0a80 msgr2=0x7f8964155750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 shutdown_connections 2023-09-30T22:52:45.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.243+0000 7f89697ff700 1 -- 172.21.15.142:0/2478528805 wait complete. 2023-09-30T22:52:45.262 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:52:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.453+0000 7f5a38bff700 1 Processor -- start 2023-09-30T22:52:45.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.453+0000 7f5a38bff700 1 -- start start 2023-09-30T22:52:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a38bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a340cbfe0 0x7f5a3415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a38bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a340cc3b0 0x7f5a340cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a38bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a341573a0 0x7f5a34157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a38bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a340cf750 con 0x7f5a341573a0 2023-09-30T22:52:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a38bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a340d0550 con 0x7f5a340cbfe0 2023-09-30T22:52:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a38bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34157d60 con 0x7f5a340cc3b0 2023-09-30T22:52:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a32d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a341573a0 0x7f5a34157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a32d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a341573a0 0x7f5a34157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51542/0 (socket says 172.21.15.142:51542) 2023-09-30T22:52:45.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a32d9d700 1 -- 172.21.15.142:0/4199327322 learned_addr learned my addr 172.21.15.142:0/4199327322 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a3259c700 1 --2- 172.21.15.142:0/4199327322 >> v2:172.21.15.148:3300/0 conn(0x7f5a340cbfe0 0x7f5a3415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.455+0000 7f5a31d9b700 1 --2- 172.21.15.142:0/4199327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a340cc3b0 0x7f5a340cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a32d9d700 1 -- 172.21.15.142:0/4199327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a340cc3b0 msgr2=0x7f5a340cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a32d9d700 1 --2- 172.21.15.142:0/4199327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a340cc3b0 0x7f5a340cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a32d9d700 1 -- 172.21.15.142:0/4199327322 >> v2:172.21.15.148:3300/0 conn(0x7f5a340cbfe0 msgr2=0x7f5a3415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a32d9d700 1 --2- 172.21.15.142:0/4199327322 >> v2:172.21.15.148:3300/0 conn(0x7f5a340cbfe0 0x7f5a3415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a32d9d700 1 -- 172.21.15.142:0/4199327322 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a340cf940 con 0x7f5a341573a0 2023-09-30T22:52:45.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a32d9d700 1 --2- 172.21.15.142:0/4199327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a341573a0 0x7f5a34157820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009f20 tx=0x7f5a2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d0d9e2f5dfd967 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a3159a700 1 -- 172.21.15.142:0/4199327322 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00e070 con 0x7f5a341573a0 2023-09-30T22:52:45.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a3159a700 1 -- 172.21.15.142:0/4199327322 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00b930 con 0x7f5a341573a0 2023-09-30T22:52:45.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.456+0000 7f5a3159a700 1 -- 172.21.15.142:0/4199327322 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0092e0 con 0x7f5a341573a0 2023-09-30T22:52:45.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 -- 172.21.15.142:0/4199327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a341573a0 msgr2=0x7f5a34157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 --2- 172.21.15.142:0/4199327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a341573a0 0x7f5a34157820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009f20 tx=0x7f5a2c009840 comp rx=0 tx=0).stop 2023-09-30T22:52:45.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 -- 172.21.15.142:0/4199327322 shutdown_connections 2023-09-30T22:52:45.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 --2- 172.21.15.142:0/4199327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a341573a0 0x7f5a34157820 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 --2- 172.21.15.142:0/4199327322 >> v2:172.21.15.148:3300/0 conn(0x7f5a340cbfe0 0x7f5a3415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 --2- 172.21.15.142:0/4199327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a340cc3b0 0x7f5a340cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 -- 172.21.15.142:0/4199327322 >> 172.21.15.142:0/4199327322 conn(0x7f5a340d0a80 msgr2=0x7f5a340d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:45.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 -- 172.21.15.142:0/4199327322 shutdown_connections 2023-09-30T22:52:45.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.457+0000 7f5a38bff700 1 -- 172.21.15.142:0/4199327322 wait complete. 2023-09-30T22:52:45.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.458+0000 7f5a38bff700 1 Processor -- start 2023-09-30T22:52:45.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.458+0000 7f5a38bff700 1 -- start start 2023-09-30T22:52:45.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a38bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a340cbfe0 0x7f5a341443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a38bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a340cc3b0 0x7f5a340b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a38bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a341573a0 0x7f5a340bb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a38bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340b8cf0 con 0x7f5a340cbfe0 2023-09-30T22:52:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a38bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340b8fd0 con 0x7f5a340cc3b0 2023-09-30T22:52:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a38bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340b92b0 con 0x7f5a341573a0 2023-09-30T22:52:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a340cbfe0 0x7f5a341443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a3259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a340cbfe0 0x7f5a341443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51558/0 (socket says 172.21.15.142:51558) 2023-09-30T22:52:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.459+0000 7f5a3259c700 1 -- 172.21.15.142:0/1879907352 learned_addr learned my addr 172.21.15.142:0/1879907352 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:45.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a3259c700 1 -- 172.21.15.142:0/1879907352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a341573a0 msgr2=0x7f5a340bb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a3259c700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a341573a0 0x7f5a340bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a3259c700 1 -- 172.21.15.142:0/1879907352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a340cc3b0 msgr2=0x7f5a340b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a3259c700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a340cc3b0 0x7f5a340b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a3259c700 1 -- 172.21.15.142:0/1879907352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009ae0 con 0x7f5a340cbfe0 2023-09-30T22:52:45.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a3259c700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a340cbfe0 0x7f5a341443b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400ec80 tx=0x7f5a240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a227fc700 1 -- 172.21.15.142:0/1879907352 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400c9d0 con 0x7f5a340cbfe0 2023-09-30T22:52:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a227fc700 1 -- 172.21.15.142:0/1879907352 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2400cb30 con 0x7f5a340cbfe0 2023-09-30T22:52:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a340b9590 con 0x7f5a340cbfe0 2023-09-30T22:52:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a227fc700 1 -- 172.21.15.142:0/1879907352 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24013470 con 0x7f5a340cbfe0 2023-09-30T22:52:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.460+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a341448f0 con 0x7f5a340cbfe0 2023-09-30T22:52:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.461+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a34069770 con 0x7f5a340cbfe0 2023-09-30T22:52:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.462+0000 7f5a227fc700 1 -- 172.21.15.142:0/1879907352 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5a24013820 con 0x7f5a340cbfe0 2023-09-30T22:52:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.463+0000 7f5a227fc700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a14067330 0x7f5a140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.463+0000 7f5a227fc700 1 -- 172.21.15.142:0/1879907352 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a24084fe0 con 0x7f5a340cbfe0 2023-09-30T22:52:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.463+0000 7f5a31d9b700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a14067330 0x7f5a140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.464+0000 7f5a31d9b700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a14067330 0x7f5a140697e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009bb0 tx=0x7f5a280091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.467+0000 7f5a227fc700 1 -- 172.21.15.142:0/1879907352 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5a24051e60 con 0x7f5a340cbfe0 2023-09-30T22:52:45.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.655+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a340d1370 con 0x7f5a340cbfe0 2023-09-30T22:52:45.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.656+0000 7f5a227fc700 1 -- 172.21.15.142:0/1879907352 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a240170a0 con 0x7f5a340cbfe0 2023-09-30T22:52:45.656 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:52:45.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a14067330 msgr2=0x7f5a140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a14067330 0x7f5a140697e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009bb0 tx=0x7f5a280091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a340cbfe0 msgr2=0x7f5a341443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a340cbfe0 0x7f5a341443b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400ec80 tx=0x7f5a240091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 shutdown_connections 2023-09-30T22:52:45.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a14067330 0x7f5a140697e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a341573a0 0x7f5a340bb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a340cbfe0 0x7f5a341443b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 --2- 172.21.15.142:0/1879907352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a340cc3b0 0x7f5a340b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 >> 172.21.15.142:0/1879907352 conn(0x7f5a340d0a80 msgr2=0x7f5a3415c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:45.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 shutdown_connections 2023-09-30T22:52:45.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.658+0000 7f5a38bff700 1 -- 172.21.15.142:0/1879907352 wait complete. 2023-09-30T22:52:45.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:52:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.864+0000 7fdaea7ff700 1 Processor -- start 2023-09-30T22:52:45.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.865+0000 7fdaea7ff700 1 -- start start 2023-09-30T22:52:45.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdaea7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdae41598e0 0x7fdae4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdaea7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae40d03d0 0x7fdae415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdaea7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae406b8d0 con 0x7fdae40cee50 2023-09-30T22:52:45.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdaea7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae40cff40 con 0x7fdae41598e0 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdaea7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40cf330 con 0x7fdae40d03d0 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdae37fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdae40cee50 0x7fdae406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44730/0 (socket says 172.21.15.142:44730) 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdae37fe700 1 -- 172.21.15.142:0/2798306634 learned_addr learned my addr 172.21.15.142:0/2798306634 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdae3fff700 1 --2- 172.21.15.142:0/2798306634 >> v2:172.21.15.148:3300/0 conn(0x7fdae41598e0 0x7fdae4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdae8d9c700 1 --2- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae40d03d0 0x7fdae415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdae2ffd700 1 -- 172.21.15.142:0/2798306634 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269830603 0 0) 0x7fdae406b8d0 con 0x7fdae40cee50 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.866+0000 7fdae2ffd700 1 -- 172.21.15.142:0/2798306634 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdacc003570 con 0x7fdae40cee50 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae3fff700 1 -- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae40d03d0 msgr2=0x7fdae415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae3fff700 1 --2- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae40d03d0 0x7fdae415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae3fff700 1 -- 172.21.15.142:0/2798306634 >> v1:172.21.15.142:6789/0 conn(0x7fdae40cee50 legacy=0x7fdae406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae3fff700 1 -- 172.21.15.142:0/2798306634 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40cf610 con 0x7fdae41598e0 2023-09-30T22:52:45.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae3fff700 1 --2- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae41598e0 0x7fdae4159cb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdad40098e0 tx=0x7fdad40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2b4e088b731c71a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae2ffd700 1 -- 172.21.15.142:0/2798306634 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4011630 con 0x7fdae41598e0 2023-09-30T22:52:45.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae2ffd700 1 -- 172.21.15.142:0/2798306634 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4011790 con 0x7fdae41598e0 2023-09-30T22:52:45.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.867+0000 7fdae2ffd700 1 -- 172.21.15.142:0/2798306634 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4011b30 con 0x7fdae41598e0 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 -- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae41598e0 msgr2=0x7fdae4159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae41598e0 0x7fdae4159cb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdad40098e0 tx=0x7fdad40091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 -- 172.21.15.142:0/2798306634 shutdown_connections 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae41598e0 0x7fdae4159cb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/2798306634 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae40d03d0 0x7fdae415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 -- 172.21.15.142:0/2798306634 >> 172.21.15.142:0/2798306634 conn(0x7fdae40cd540 msgr2=0x7fdae40cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 -- 172.21.15.142:0/2798306634 shutdown_connections 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.868+0000 7fdaea7ff700 1 -- 172.21.15.142:0/2798306634 wait complete. 2023-09-30T22:52:45.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.869+0000 7fdaea7ff700 1 Processor -- start 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.869+0000 7fdaea7ff700 1 -- start start 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.870+0000 7fdaea7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae40cee50 0x7fdae40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.870+0000 7fdaea7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae40d03d0 0x7fdae40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.870+0000 7fdaea7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae41598e0 0x7fdae40b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.870+0000 7fdaea7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4152850 con 0x7fdae40cee50 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.870+0000 7fdaea7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4156820 con 0x7fdae40d03d0 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.870+0000 7fdaea7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40cbeb0 con 0x7fdae41598e0 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.870+0000 7fdae3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae40cee50 0x7fdae40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae40cee50 0x7fdae40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51572/0 (socket says 172.21.15.142:51572) 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 -- 172.21.15.142:0/3785566251 learned_addr learned my addr 172.21.15.142:0/3785566251 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:45.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 -- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae41598e0 msgr2=0x7fdae40b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae41598e0 0x7fdae40b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 -- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae40d03d0 msgr2=0x7fdae40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae37fe700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae40d03d0 0x7fdae40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae40d03d0 0x7fdae40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 -- 172.21.15.142:0/3785566251 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009420 con 0x7fdae40cee50 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae37fe700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae40d03d0 0x7fdae40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdae3fff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae40cee50 0x7fdae40cb970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdae40ce0a0 tx=0x7fdad4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdacbfff700 1 -- 172.21.15.142:0/3785566251 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4011b10 con 0x7fdae40cee50 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdacbfff700 1 -- 172.21.15.142:0/3785566251 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40253f0 con 0x7fdae40cee50 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae40c7600 con 0x7fdae40cee50 2023-09-30T22:52:45.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.871+0000 7fdacbfff700 1 -- 172.21.15.142:0/3785566251 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4025790 con 0x7fdae40cee50 2023-09-30T22:52:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.872+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae40cc0c0 con 0x7fdae40cee50 2023-09-30T22:52:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.873+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae415d2e0 con 0x7fdae40cee50 2023-09-30T22:52:45.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.873+0000 7fdacbfff700 1 -- 172.21.15.142:0/3785566251 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdad4025b80 con 0x7fdae40cee50 2023-09-30T22:52:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.874+0000 7fdacbfff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdad0067330 0x7fdad00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.874+0000 7fdacbfff700 1 -- 172.21.15.142:0/3785566251 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdad4086230 con 0x7fdae40cee50 2023-09-30T22:52:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.874+0000 7fdae37fe700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdad0067330 0x7fdad00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:45.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.875+0000 7fdae37fe700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdad0067330 0x7fdad00697e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdad8007fd0 tx=0x7fdad8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:45.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:45.878+0000 7fdacbfff700 1 -- 172.21.15.142:0/3785566251 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdad4053090 con 0x7fdae40cee50 2023-09-30T22:52:46.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.121+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae40c7600 con 0x7fdae40cee50 2023-09-30T22:52:46.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.121+0000 7fdacbfff700 1 -- 172.21.15.142:0/3785566251 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fdae40c7600 con 0x7fdae40cee50 2023-09-30T22:52:46.122 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:46.122 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:52:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdad0067330 msgr2=0x7fdad00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdad0067330 0x7fdad00697e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdad8007fd0 tx=0x7fdad8009040 comp rx=0 tx=0).stop 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae40cee50 msgr2=0x7fdae40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae40cee50 0x7fdae40cb970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdae40ce0a0 tx=0x7fdad4017000 comp rx=0 tx=0).stop 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 shutdown_connections 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdad0067330 0x7fdad00697e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdae41598e0 0x7fdae40b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdae40cee50 0x7fdae40cb970 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 --2- 172.21.15.142:0/3785566251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae40d03d0 0x7fdae40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 >> 172.21.15.142:0/3785566251 conn(0x7fdae40cd540 msgr2=0x7fdae4156bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 shutdown_connections 2023-09-30T22:52:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.124+0000 7fdaea7ff700 1 -- 172.21.15.142:0/3785566251 wait complete. 2023-09-30T22:52:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:52:46.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:46.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.332+0000 7fe7bb3ff700 1 Processor -- start 2023-09-30T22:52:46.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.332+0000 7fe7bb3ff700 1 -- start start 2023-09-30T22:52:46.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7bb3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7b40b1180 0x7fe7b40cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7bb3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7b4159eb0 0x7fe7b40cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7bb3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b415d910 con 0x7fe7b4159ae0 2023-09-30T22:52:46.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7bb3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b415e920 con 0x7fe7b40b1180 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7bb3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b415e490 con 0x7fe7b4159eb0 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7b899a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7b40b1180 0x7fe7b40cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7b919b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe7b4159ae0 0x7fe7b40cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44732/0 (socket says 172.21.15.142:44732) 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.333+0000 7fe7b919b700 1 -- 172.21.15.142:0/2425920553 learned_addr learned my addr 172.21.15.142:0/2425920553 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7b999c700 1 --2- 172.21.15.142:0/2425920553 >> v2:172.21.15.148:3300/0 conn(0x7fe7b4159eb0 0x7fe7b40cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7abfff700 1 -- 172.21.15.142:0/2425920553 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451540411 0 0) 0x7fe7b415d910 con 0x7fe7b4159ae0 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7b899a700 1 -- 172.21.15.142:0/2425920553 >> v2:172.21.15.148:3300/0 conn(0x7fe7b4159eb0 msgr2=0x7fe7b40cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7b899a700 1 --2- 172.21.15.142:0/2425920553 >> v2:172.21.15.148:3300/0 conn(0x7fe7b4159eb0 0x7fe7b40cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7b899a700 1 -- 172.21.15.142:0/2425920553 >> v1:172.21.15.142:6789/0 conn(0x7fe7b4159ae0 legacy=0x7fe7b40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7b899a700 1 -- 172.21.15.142:0/2425920553 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40ce5c0 con 0x7fe7b40b1180 2023-09-30T22:52:46.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7b999c700 1 --2- 172.21.15.142:0/2425920553 >> v2:172.21.15.148:3300/0 conn(0x7fe7b4159eb0 0x7fe7b40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7b899a700 1 --2- 172.21.15.142:0/2425920553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b40b1180 0x7fe7b40cbe80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40cb3d0 tx=0x7fe7a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bedf87cf8f27b7e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7abfff700 1 -- 172.21.15.142:0/2425920553 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400b6b0 con 0x7fe7b40b1180 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7abfff700 1 -- 172.21.15.142:0/2425920553 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a400b810 con 0x7fe7b40b1180 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.334+0000 7fe7abfff700 1 -- 172.21.15.142:0/2425920553 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400bbb0 con 0x7fe7b40b1180 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/2425920553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b40b1180 msgr2=0x7fe7b40cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/2425920553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b40b1180 0x7fe7b40cbe80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40cb3d0 tx=0x7fe7a40091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/2425920553 shutdown_connections 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/2425920553 >> v2:172.21.15.148:3300/0 conn(0x7fe7b4159eb0 0x7fe7b40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/2425920553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b40b1180 0x7fe7b40cbe80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/2425920553 >> 172.21.15.142:0/2425920553 conn(0x7fe7b40ce8b0 msgr2=0x7fe7b40cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/2425920553 shutdown_connections 2023-09-30T22:52:46.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.335+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/2425920553 wait complete. 2023-09-30T22:52:46.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.336+0000 7fe7bb3ff700 1 Processor -- start 2023-09-30T22:52:46.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.336+0000 7fe7bb3ff700 1 -- start start 2023-09-30T22:52:46.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.337+0000 7fe7bb3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b40b1180 0x7fe7b40b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.337+0000 7fe7bb3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b4159ae0 0x7fe7b41442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.337+0000 7fe7bb3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b4159eb0 0x7fe7b40c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.337+0000 7fe7bb3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40b3080 con 0x7fe7b4159eb0 2023-09-30T22:52:46.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.337+0000 7fe7bb3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40b1dc0 con 0x7fe7b4159ae0 2023-09-30T22:52:46.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.337+0000 7fe7bb3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40b20a0 con 0x7fe7b40b1180 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b4159eb0 0x7fe7b40c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b4159eb0 0x7fe7b40c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51584/0 (socket says 172.21.15.142:51584) 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 -- 172.21.15.142:0/3725966490 learned_addr learned my addr 172.21.15.142:0/3725966490 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b919b700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b40b1180 0x7fe7b40b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b899a700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b4159ae0 0x7fe7b41442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 -- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b40b1180 msgr2=0x7fe7b40b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b40b1180 0x7fe7b40b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 -- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b4159ae0 msgr2=0x7fe7b41442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b4159ae0 0x7fe7b41442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 -- 172.21.15.142:0/3725966490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4009420 con 0x7fe7b4159eb0 2023-09-30T22:52:46.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b919b700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b40b1180 0x7fe7b40b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7b999c700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b4159eb0 0x7fe7b40c9cc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00cef0 tx=0x7fe7ac007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7a97fa700 1 -- 172.21.15.142:0/3725966490 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00add0 con 0x7fe7b4159eb0 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7a97fa700 1 -- 172.21.15.142:0/3725966490 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac016420 con 0x7fe7b4159eb0 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b40b2380 con 0x7fe7b4159eb0 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.338+0000 7fe7a97fa700 1 -- 172.21.15.142:0/3725966490 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0167e0 con 0x7fe7b4159eb0 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.339+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b41447e0 con 0x7fe7b4159eb0 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.340+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b406ea70 con 0x7fe7b4159eb0 2023-09-30T22:52:46.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.340+0000 7fe7a97fa700 1 -- 172.21.15.142:0/3725966490 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe7ac016bd0 con 0x7fe7b4159eb0 2023-09-30T22:52:46.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.341+0000 7fe7a97fa700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe798067330 0x7fe7980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.341+0000 7fe7a97fa700 1 -- 172.21.15.142:0/3725966490 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7ac012070 con 0x7fe7b4159eb0 2023-09-30T22:52:46.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.341+0000 7fe7b919b700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe798067330 0x7fe7980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.342+0000 7fe7b919b700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe798067330 0x7fe7980697e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00011e0 tx=0x7fe7b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:46.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.345+0000 7fe7a97fa700 1 -- 172.21.15.142:0/3725966490 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe7ac04e570 con 0x7fe7b4159eb0 2023-09-30T22:52:46.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.539+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7b40b31c0 con 0x7fe7b4159eb0 2023-09-30T22:52:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.540+0000 7fe7a97fa700 1 -- 172.21.15.142:0/3725966490 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fe7ac0523a0 con 0x7fe7b4159eb0 2023-09-30T22:52:46.540 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:46.541 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe798067330 msgr2=0x7fe7980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe798067330 0x7fe7980697e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00011e0 tx=0x7fe7b0009040 comp rx=0 tx=0).stop 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b4159eb0 msgr2=0x7fe7b40c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b4159eb0 0x7fe7b40c9cc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00cef0 tx=0x7fe7ac007860 comp rx=0 tx=0).stop 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 shutdown_connections 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe798067330 0x7fe7980697e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b4159eb0 0x7fe7b40c9cc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b40b1180 0x7fe7b40b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 --2- 172.21.15.142:0/3725966490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b4159ae0 0x7fe7b41442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.542+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 >> 172.21.15.142:0/3725966490 conn(0x7fe7b40ce8b0 msgr2=0x7fe7b406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.543+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 shutdown_connections 2023-09-30T22:52:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.543+0000 7fe7bb3ff700 1 -- 172.21.15.142:0/3725966490 wait complete. 2023-09-30T22:52:46.561 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:52:46.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.750+0000 7f34501ff700 1 Processor -- start 2023-09-30T22:52:46.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.750+0000 7f34501ff700 1 -- start start 2023-09-30T22:52:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f34501ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34480cc590 0x7f3448164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f34501ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344815d910 con 0x7f34480b1180 2023-09-30T22:52:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f34501ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344815e490 con 0x7f3448159ae0 2023-09-30T22:52:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f34501ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344815e920 con 0x7f34480cc590 2023-09-30T22:52:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f344e79c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34480cc590 0x7f3448164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f344d79a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f34480b1180 0x7f34480cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44742/0 (socket says 172.21.15.142:44742) 2023-09-30T22:52:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f344d79a700 1 -- 172.21.15.142:0/3434610751 learned_addr learned my addr 172.21.15.142:0/3434610751 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f344cf99700 1 -- 172.21.15.142:0/3434610751 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332752603 0 0) 0x7f344815d910 con 0x7f34480b1180 2023-09-30T22:52:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f344e79c700 1 -- 172.21.15.142:0/3434610751 >> v1:172.21.15.148:6789/0 conn(0x7f3448159ae0 legacy=0x7f34480cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f344e79c700 1 -- 172.21.15.142:0/3434610751 >> v1:172.21.15.142:6789/0 conn(0x7f34480b1180 legacy=0x7f34480cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.752+0000 7f344e79c700 1 -- 172.21.15.142:0/3434610751 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480ce5c0 con 0x7f34480cc590 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.753+0000 7f344e79c700 1 --2- 172.21.15.142:0/3434610751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34480cc590 0x7f3448164cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e60 tx=0x7f3440009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ddd0dc92008694 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.753+0000 7f344cf99700 1 -- 172.21.15.142:0/3434610751 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000e070 con 0x7f34480cc590 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.753+0000 7f344cf99700 1 -- 172.21.15.142:0/3434610751 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344000bc30 con 0x7f34480cc590 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.753+0000 7f344cf99700 1 -- 172.21.15.142:0/3434610751 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440012430 con 0x7f34480cc590 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.753+0000 7f34501ff700 1 -- 172.21.15.142:0/3434610751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34480cc590 msgr2=0x7f3448164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.753+0000 7f34501ff700 1 --2- 172.21.15.142:0/3434610751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34480cc590 0x7f3448164cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e60 tx=0x7f3440009780 comp rx=0 tx=0).stop 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.754+0000 7f34501ff700 1 -- 172.21.15.142:0/3434610751 shutdown_connections 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.754+0000 7f34501ff700 1 --2- 172.21.15.142:0/3434610751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34480cc590 0x7f3448164cb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.754+0000 7f34501ff700 1 -- 172.21.15.142:0/3434610751 >> 172.21.15.142:0/3434610751 conn(0x7f34480ce8b0 msgr2=0x7f34480cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.754+0000 7f34501ff700 1 -- 172.21.15.142:0/3434610751 shutdown_connections 2023-09-30T22:52:46.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.754+0000 7f34501ff700 1 -- 172.21.15.142:0/3434610751 wait complete. 2023-09-30T22:52:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.755+0000 7f34501ff700 1 Processor -- start 2023-09-30T22:52:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.755+0000 7f34501ff700 1 -- start start 2023-09-30T22:52:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f34501ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34480b1180 0x7f3448153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f34501ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34480cc590 0x7f344815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f34501ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3448159ae0 0x7f344815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f34501ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480c81f0 con 0x7f3448159ae0 2023-09-30T22:52:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f34501ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480c7c10 con 0x7f34480b1180 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f34501ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344815b110 con 0x7f34480cc590 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f344e79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3448159ae0 0x7f344815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f344e79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3448159ae0 0x7f344815c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51610/0 (socket says 172.21.15.142:51610) 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f344e79c700 1 -- 172.21.15.142:0/1315697512 learned_addr learned my addr 172.21.15.142:0/1315697512 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f344d79a700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34480cc590 0x7f344815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.756+0000 7f344df9b700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34480b1180 0x7f3448153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f344e79c700 1 -- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34480cc590 msgr2=0x7f344815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f344e79c700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34480cc590 0x7f344815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f344e79c700 1 -- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34480b1180 msgr2=0x7f3448153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f344e79c700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34480b1180 0x7f3448153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f344e79c700 1 -- 172.21.15.142:0/1315697512 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440009a20 con 0x7f3448159ae0 2023-09-30T22:52:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f344e79c700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3448159ae0 0x7f344815c0f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3448063f90 tx=0x7f3440019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f343dffb700 1 -- 172.21.15.142:0/1315697512 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440027470 con 0x7f3448159ae0 2023-09-30T22:52:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f343dffb700 1 -- 172.21.15.142:0/1315697512 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34400275d0 con 0x7f3448159ae0 2023-09-30T22:52:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f343dffb700 1 -- 172.21.15.142:0/1315697512 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440027970 con 0x7f3448159ae0 2023-09-30T22:52:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.757+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34480c7e80 con 0x7f3448159ae0 2023-09-30T22:52:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.758+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344815adb0 con 0x7f3448159ae0 2023-09-30T22:52:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.759+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344806ea70 con 0x7f3448159ae0 2023-09-30T22:52:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.759+0000 7f343dffb700 1 -- 172.21.15.142:0/1315697512 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3440024070 con 0x7f3448159ae0 2023-09-30T22:52:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.760+0000 7f343dffb700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f342c067330 0x7f342c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.760+0000 7f343dffb700 1 -- 172.21.15.142:0/1315697512 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3440087420 con 0x7f3448159ae0 2023-09-30T22:52:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.760+0000 7f344df9b700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f342c067330 0x7f342c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.761+0000 7f344df9b700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f342c067330 0x7f342c0697e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34480b0bf0 tx=0x7f3444009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.764+0000 7f343dffb700 1 -- 172.21.15.142:0/1315697512 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3440054280 con 0x7f3448159ae0 2023-09-30T22:52:46.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.998+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f344815db60 con 0x7f3448159ae0 2023-09-30T22:52:46.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:46.999+0000 7f343dffb700 1 -- 172.21.15.142:0/1315697512 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f34400578a0 con 0x7f3448159ae0 2023-09-30T22:52:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:46.999 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:52:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f342c067330 msgr2=0x7f342c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f342c067330 0x7f342c0697e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34480b0bf0 tx=0x7f3444009040 comp rx=0 tx=0).stop 2023-09-30T22:52:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3448159ae0 msgr2=0x7f344815c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3448159ae0 0x7f344815c0f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3448063f90 tx=0x7f3440019000 comp rx=0 tx=0).stop 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 shutdown_connections 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f342c067330 0x7f342c0697e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3448159ae0 0x7f344815c0f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34480b1180 0x7f3448153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 --2- 172.21.15.142:0/1315697512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34480cc590 0x7f344815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 >> 172.21.15.142:0/1315697512 conn(0x7f34480ce8b0 msgr2=0x7f34481543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 shutdown_connections 2023-09-30T22:52:47.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.001+0000 7f34501ff700 1 -- 172.21.15.142:0/1315697512 wait complete. 2023-09-30T22:52:47.004 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:52:47.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:52:29.459705+0000', 'modified': '2023-09-30T22:52:33.248797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/1468486287', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 1468486287}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 1468486287}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:52:47.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:52:47.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-30T22:52:47.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.617+0000 7f0a1d1ff700 1 Processor -- start 2023-09-30T22:52:47.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.617+0000 7f0a1d1ff700 1 -- start start 2023-09-30T22:52:47.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1d1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a181598e0 0x7f0a18159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1d1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a180d03d0 0x7f0a1815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1d1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1806b8d0 con 0x7f0a180cee50 2023-09-30T22:52:47.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1d1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a180cff40 con 0x7f0a180d03d0 2023-09-30T22:52:47.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1d1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a180cf330 con 0x7f0a181598e0 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a180d03d0 0x7f0a1815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a180d03d0 0x7f0a1815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51626/0 (socket says 172.21.15.142:51626) 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1759e700 1 -- 172.21.15.142:0/3105703766 learned_addr learned my addr 172.21.15.142:0/3105703766 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3105703766 >> v2:172.21.15.148:3300/0 conn(0x7f0a181598e0 0x7f0a18159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1759e700 1 -- 172.21.15.142:0/3105703766 >> v2:172.21.15.148:3300/0 conn(0x7f0a181598e0 msgr2=0x7f0a18159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3105703766 >> v2:172.21.15.148:3300/0 conn(0x7f0a181598e0 0x7f0a18159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1759e700 1 -- 172.21.15.142:0/3105703766 >> v1:172.21.15.148:6789/0 conn(0x7f0a180cee50 legacy=0x7f0a1806b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.619+0000 7f0a1759e700 1 -- 172.21.15.142:0/3105703766 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180cf610 con 0x7f0a180d03d0 2023-09-30T22:52:47.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.620+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3105703766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a180d03d0 0x7f0a1815d7d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a180ce070 tx=0x7f0a10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a5b12df3907fba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:47.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.620+0000 7f0a15d9b700 1 -- 172.21.15.142:0/3105703766 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000e070 con 0x7f0a180d03d0 2023-09-30T22:52:47.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.620+0000 7f0a15d9b700 1 -- 172.21.15.142:0/3105703766 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1000ba20 con 0x7f0a180d03d0 2023-09-30T22:52:47.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.620+0000 7f0a15d9b700 1 -- 172.21.15.142:0/3105703766 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100092e0 con 0x7f0a180d03d0 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.620+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3105703766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a180d03d0 msgr2=0x7f0a1815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.620+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3105703766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a180d03d0 0x7f0a1815d7d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a180ce070 tx=0x7f0a10009840 comp rx=0 tx=0).stop 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.621+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3105703766 shutdown_connections 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.621+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3105703766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a180d03d0 0x7f0a1815d7d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.621+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3105703766 >> v2:172.21.15.148:3300/0 conn(0x7f0a181598e0 0x7f0a18159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.621+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3105703766 >> 172.21.15.142:0/3105703766 conn(0x7f0a180cd540 msgr2=0x7f0a180cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.621+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3105703766 shutdown_connections 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.621+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3105703766 wait complete. 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.622+0000 7f0a1d1ff700 1 Processor -- start 2023-09-30T22:52:47.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.622+0000 7f0a1d1ff700 1 -- start start 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1d1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a180cee50 0x7f0a181528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1d1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a180d03d0 0x7f0a18150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1d1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a181598e0 0x7f0a180c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1d1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18151420 con 0x7f0a181598e0 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1d1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180c6d00 con 0x7f0a180cee50 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1d1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18152ed0 con 0x7f0a180d03d0 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a181598e0 0x7f0a180c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a181598e0 0x7f0a180c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51638/0 (socket says 172.21.15.142:51638) 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1759e700 1 -- 172.21.15.142:0/3615276298 learned_addr learned my addr 172.21.15.142:0/3615276298 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a180cee50 0x7f0a181528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.623+0000 7f0a1659c700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a180d03d0 0x7f0a18150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1759e700 1 -- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a180d03d0 msgr2=0x7f0a18150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a180d03d0 0x7f0a18150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1759e700 1 -- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a180cee50 msgr2=0x7f0a181528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a180cee50 0x7f0a181528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1759e700 1 -- 172.21.15.142:0/3615276298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10009ae0 con 0x7f0a181598e0 2023-09-30T22:52:47.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1659c700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a180d03d0 0x7f0a18150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:47.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a181598e0 0x7f0a180c67c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009880 tx=0x7f0a10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:47.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f09feffd700 1 -- 172.21.15.142:0/3615276298 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10008bb0 con 0x7f0a181598e0 2023-09-30T22:52:47.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f09feffd700 1 -- 172.21.15.142:0/3615276298 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10008d10 con 0x7f0a181598e0 2023-09-30T22:52:47.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a181531b0 con 0x7f0a181598e0 2023-09-30T22:52:47.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f09feffd700 1 -- 172.21.15.142:0/3615276298 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100266b0 con 0x7f0a181598e0 2023-09-30T22:52:47.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.624+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a18153770 con 0x7f0a181598e0 2023-09-30T22:52:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.626+0000 7f09feffd700 1 -- 172.21.15.142:0/3615276298 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0a10003040 con 0x7f0a181598e0 2023-09-30T22:52:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.627+0000 7f09feffd700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a04067330 0x7f0a040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.627+0000 7f09feffd700 1 -- 172.21.15.142:0/3615276298 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a10086b10 con 0x7f0a181598e0 2023-09-30T22:52:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.627+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a04067330 0x7f0a040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.628+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a04067330 0x7f0a040697e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009d10 tx=0x7f0a080091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.629+0000 7f0a2b823b80 1 Processor -- start 2023-09-30T22:52:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.629+0000 7f0a2b823b80 1 -- start start 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800170820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800155f40 0x555800178f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5558001794d0 0x555800179940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555800043310 con 0x555800170450 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x555800080130 con 0x555800155f40 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55580007daf0 con 0x5558001794d0 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a16d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800170820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a16d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800170820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51644/0 (socket says 172.21.15.142:51644) 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.630+0000 7f0a16d9d700 1 -- 172.21.15.142:0/4102403445 learned_addr learned my addr 172.21.15.142:0/4102403445 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a1659c700 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800155f40 0x555800178f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a1759e700 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5558001794d0 0x555800179940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a16d9d700 1 -- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5558001794d0 msgr2=0x555800179940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5558001794d0 0x555800179940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a16d9d700 1 -- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800155f40 msgr2=0x555800178f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800155f40 0x555800178f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a16d9d700 1 -- 172.21.15.142:0/4102403445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ffe7f790 con 0x555800170450 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800170820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a08011e30 tx=0x7f0a08019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3120b17dee7f658 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f09f7fff700 1 -- 172.21.15.142:0/4102403445 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08014e70 con 0x555800170450 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f09f7fff700 1 -- 172.21.15.142:0/4102403445 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08021450 con 0x555800170450 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.631+0000 7f09f7fff700 1 -- 172.21.15.142:0/4102403445 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080217d0 con 0x555800170450 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 -- 172.21.15.142:0/4102403445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 msgr2=0x555800170820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800170820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a08011e30 tx=0x7f0a08019000 comp rx=0 tx=0).stop 2023-09-30T22:52:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 -- 172.21.15.142:0/4102403445 shutdown_connections 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5558001794d0 0x555800179940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800170820 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/4102403445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800155f40 0x555800178f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 -- 172.21.15.142:0/4102403445 >> 172.21.15.142:0/4102403445 conn(0x555800173880 msgr2=0x555800173c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 -- 172.21.15.142:0/4102403445 shutdown_connections 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.632+0000 7f0a2b823b80 1 -- 172.21.15.142:0/4102403445 wait complete. 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.633+0000 7f0a2b823b80 1 -- start start 2023-09-30T22:52:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.633+0000 7f0a2b823b80 1 Processor -- start 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580014f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x555800171780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558000798e0 con 0x5558001794d0 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x555800025980 con 0x555800170450 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x555800025620 con 0x555800155f40 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a2b823b80 10 client.0 _ll_register_callbacks cb 0x5557ffe88a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a1759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x555800171780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a1659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a16d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a1659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580014f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:34022/0 (socket says 172.21.15.142:34022) 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.634+0000 7f0a1659c700 1 -- 172.21.15.142:0/3888702024 learned_addr learned my addr 172.21.15.142:0/3888702024 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a1759e700 1 -- 172.21.15.142:0/3888702024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 msgr2=0x55580012ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a1759e700 1 -- 172.21.15.142:0/3888702024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 msgr2=0x55580014f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580014f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a1759e700 1 -- 172.21.15.142:0/3888702024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a08011a70 con 0x5558001794d0 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x555800171780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a10084fb0 tx=0x7f0a10084e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310c552afd26550a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f09f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:52:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f09f57fa700 1 -- 172.21.15.142:0/3888702024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000e070 con 0x5558001794d0 2023-09-30T22:52:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f09f57fa700 1 -- 172.21.15.142:0/3888702024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a10080e30 con 0x5558001794d0 2023-09-30T22:52:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55580011dd60 con 0x5558001794d0 2023-09-30T22:52:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f09f57fa700 1 -- 172.21.15.142:0/3888702024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a100576d0 con 0x5558001794d0 2023-09-30T22:52:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a2b823b80 10 client.4662 fetch_fsmap learned FSMap version 8 2023-09-30T22:52:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5557fff6c0a0 con 0x5558001794d0 2023-09-30T22:52:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f09f57fa700 1 -- 172.21.15.142:0/3888702024 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10072020 con 0x5558001794d0 2023-09-30T22:52:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f09f57fa700 1 -- 172.21.15.142:0/3888702024 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a10056bc0 con 0x5558001794d0 2023-09-30T22:52:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a2b823b80 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:52:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.635+0000 7f0a2b823b80 10 client.4662 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.636+0000 7f0a2b823b80 20 client.4662 populate_metadata read hostname 'smithi142' 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.636+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001720f0 0x55580016f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.636+0000 7f0a2b823b80 4 client.4662 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.636+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 --> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558000fab30 con 0x5558001720f0 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.636+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001720f0 0x55580016f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.636+0000 7f09f57fa700 10 client.4662 ms_handle_connect on v2:172.21.15.142:6835/1468486287 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.636+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001720f0 0x55580016f300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23f57c0b83706602 server_cookie=4795bdf6517f1b22 in_seq=0 out_seq=0 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f09f57fa700 1 -- 172.21.15.142:0/3888702024 <== mds.0 v2:172.21.15.142:6835/1468486287 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x5558000fab30 con 0x5558001720f0 2023-09-30T22:52:47.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f09f57fa700 10 client.4662 handle_command_reply: tid=0 2023-09-30T22:52:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 client.4662 shutdown 2023-09-30T22:52:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 msgr2=0x555800171780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x555800171780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a10084fb0 tx=0x7f0a10084e30 comp rx=0 tx=0).stop 2023-09-30T22:52:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 shutdown_connections 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001720f0 0x55580016f300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x555800171780 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f09f57fa700 0 client.4662 ms_handle_reset on v2:172.21.15.142:6835/1468486287 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3888702024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 >> 172.21.15.142:0/3888702024 conn(0x555800173880 msgr2=0x555800125c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 shutdown_connections 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.637+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3888702024 wait complete. 2023-09-30T22:52:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.638+0000 7f0a2b823b80 20 client.4662 trim_cache size 0 max 16384 2023-09-30T22:52:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.655+0000 7f0a2b823b80 1 Processor -- start 2023-09-30T22:52:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.655+0000 7f0a2b823b80 1 -- start start 2023-09-30T22:52:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.655+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580012b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x5558001518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557fff111e0 con 0x5558001794d0 2023-09-30T22:52:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x555800153ae0 con 0x555800170450 2023-09-30T22:52:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55580012b9f0 con 0x555800155f40 2023-09-30T22:52:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x5558001518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x5558001518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51674/0 (socket says 172.21.15.142:51674) 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 -- 172.21.15.142:0/925389372 learned_addr learned my addr 172.21.15.142:0/925389372 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1659c700 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580012b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 -- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 msgr2=0x55580012ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 -- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 msgr2=0x55580012b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580012b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 -- 172.21.15.142:0/925389372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558000483c0 con 0x5558001794d0 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1659c700 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580012b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f0a1759e700 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x5558001518a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a100540f0 tx=0x7f0a1006e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bef55682be49f05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.656+0000 7f09fcff9700 1 -- 172.21.15.142:0/925389372 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10053a10 con 0x5558001794d0 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f09fcff9700 1 -- 172.21.15.142:0/925389372 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10072040 con 0x5558001794d0 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f09fcff9700 1 -- 172.21.15.142:0/925389372 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100576d0 con 0x5558001794d0 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 -- 172.21.15.142:0/925389372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 msgr2=0x5558001518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x5558001518a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a100540f0 tx=0x7f0a1006e000 comp rx=0 tx=0).stop 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 -- 172.21.15.142:0/925389372 shutdown_connections 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5558001794d0 0x5558001518a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x55580012ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/925389372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555800170450 0x55580012b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 -- 172.21.15.142:0/925389372 >> 172.21.15.142:0/925389372 conn(0x555800173880 msgr2=0x555800132ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 -- 172.21.15.142:0/925389372 shutdown_connections 2023-09-30T22:52:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.657+0000 7f0a2b823b80 1 -- 172.21.15.142:0/925389372 wait complete. 2023-09-30T22:52:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.658+0000 7f0a2b823b80 1 -- start start 2023-09-30T22:52:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.658+0000 7f0a2b823b80 1 Processor -- start 2023-09-30T22:52:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x555800125590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800125ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a2b823b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558001794d0 0x555800128e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558001d5d40 con 0x555800170450 2023-09-30T22:52:47.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558001516f0 con 0x5558001794d0 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a2b823b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55580016fef0 con 0x555800155f40 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a2b823b80 10 client.0 _ll_register_callbacks cb 0x5557ffe88a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a1659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800125ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a1659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800125ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51678/0 (socket says 172.21.15.142:51678) 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a1659c700 1 -- 172.21.15.142:0/3786121637 learned_addr learned my addr 172.21.15.142:0/3786121637 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x555800125590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.659+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558001794d0 0x555800128e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a1659c700 1 -- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 msgr2=0x555800125590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a1659c700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x555800125590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a1659c700 1 -- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558001794d0 msgr2=0x555800128e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a1659c700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558001794d0 0x555800128e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a1659c700 1 -- 172.21.15.142:0/3786121637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557fff6c0a0 con 0x555800170450 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a1759e700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558001794d0 0x555800128e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a1659c700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800125ad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55580012bb70 tx=0x7f0a0c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce4191892c8721c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f09f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f09f57fa700 1 -- 172.21.15.142:0/3786121637 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c003600 con 0x555800170450 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f09f57fa700 1 -- 172.21.15.142:0/3786121637 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a0c017640 con 0x555800170450 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a08021450 con 0x555800170450 2023-09-30T22:52:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f09f57fa700 1 -- 172.21.15.142:0/3786121637 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a0c017a50 con 0x555800170450 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a2b823b80 10 client.4668 fetch_fsmap learned FSMap version 8 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.660+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5557ffee01d0 con 0x555800170450 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f09f57fa700 1 -- 172.21.15.142:0/3786121637 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08021450 con 0x555800170450 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f09f57fa700 1 -- 172.21.15.142:0/3786121637 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a0c012030 con 0x555800170450 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a2b823b80 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a2b823b80 10 client.4668 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a2b823b80 20 client.4668 populate_metadata read hostname 'smithi142' 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001d4290 0x5558001d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a2b823b80 4 client.4668 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 --> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55580001c8d0 con 0x5558001d4290 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001d4290 0x5558001d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f09f57fa700 10 client.4668 ms_handle_connect on v2:172.21.15.142:6835/1468486287 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.661+0000 7f0a16d9d700 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001d4290 0x5558001d4660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe4ced22df990a8 server_cookie=cbefae6c198d10e5 in_seq=0 out_seq=0 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f09f57fa700 1 -- 172.21.15.142:0/3786121637 <== mds.0 v2:172.21.15.142:6835/1468486287 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55580001c8d0 con 0x5558001d4290 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f09f57fa700 10 client.4668 handle_command_reply: tid=0 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 client.4668 shutdown 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 msgr2=0x555800125ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800125ad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55580012bb70 tx=0x7f0a0c009040 comp rx=0 tx=0).stop 2023-09-30T22:52:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 shutdown_connections 2023-09-30T22:52:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:6835/1468486287,v1:172.21.15.142:6837/1468486287] conn(0x5558001d4290 0x5558001d4660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558001794d0 0x555800128e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x555800155f40 0x555800125590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f09f57fa700 0 client.4668 ms_handle_reset on v2:172.21.15.142:6835/1468486287 2023-09-30T22:52:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 --2- 172.21.15.142:0/3786121637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555800170450 0x555800125ad0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 >> 172.21.15.142:0/3786121637 conn(0x555800173880 msgr2=0x555800126fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 shutdown_connections 2023-09-30T22:52:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 1 -- 172.21.15.142:0/3786121637 wait complete. 2023-09-30T22:52:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.662+0000 7f0a2b823b80 20 client.4668 trim_cache size 0 max 16384 2023-09-30T22:52:47.675 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4284, 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 17.425506158000001, 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 8, 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 23, 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 23, 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 23.539859776 2023-09-30T22:52:47.676 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:52:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a04067330 msgr2=0x7f0a040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a04067330 0x7f0a040697e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009d10 tx=0x7f0a080091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a181598e0 msgr2=0x7f0a180c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a181598e0 0x7f0a180c67c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009880 tx=0x7f0a10018000 comp rx=0 tx=0).stop 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 shutdown_connections 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a04067330 0x7f0a040697e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a181598e0 0x7f0a180c67c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a180cee50 0x7f0a181528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 --2- 172.21.15.142:0/3615276298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a180d03d0 0x7f0a18150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 >> 172.21.15.142:0/3615276298 conn(0x7f0a180cd540 msgr2=0x7f0a180b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 shutdown_connections 2023-09-30T22:52:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:47.663+0000 7f0a1d1ff700 1 -- 172.21.15.142:0/3615276298 wait complete. 2023-09-30T22:52:47.680 INFO:teuthology.run_tasks:Running task kclient... 2023-09-30T22:52:47.701 INFO:tasks.kclient:Mounting kernel clients... 2023-09-30T22:52:47.702 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-30T22:52:47.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:47.702 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:52:47.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:47.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-09-30T22:52:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-09-30T22:52:47.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:52:47.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:47.867 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:52:47.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:47.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-09-30T22:52:47.986 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-09-30T22:52:47.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:52:47.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:47.988 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:52:48.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:48.041 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-09-30T22:52:48.118 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-09-30T22:52:48.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:52:48.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:48.122 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:52:48.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:48.172 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-09-30T22:52:48.245 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-09-30T22:52:48.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:52:48.248 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-09-30T22:52:48.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:52:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.439+0000 7f1ad8dff700 1 Processor -- start 2023-09-30T22:52:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.439+0000 7f1ad8dff700 1 -- start start 2023-09-30T22:52:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.440+0000 7f1ad8dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40af020 0x7f1ad4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.440+0000 7f1ad8dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad406d3e0 con 0x7f1ad406e820 2023-09-30T22:52:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.440+0000 7f1ad8dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad406dc80 con 0x7f1ad40b00d0 2023-09-30T22:52:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.440+0000 7f1ad8dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad406b790 con 0x7f1ad40af020 2023-09-30T22:52:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.440+0000 7f1ad2d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1ad406e820 0x7f1ad415a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:44750/0 (socket says 172.21.15.142:44750) 2023-09-30T22:52:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad2d9d700 1 -- 172.21.15.142:0/1108956225 learned_addr learned my addr 172.21.15.142:0/1108956225 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad259c700 1 --2- 172.21.15.142:0/1108956225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40af020 0x7f1ad4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad159a700 1 -- 172.21.15.142:0/1108956225 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197470712 0 0) 0x7f1ad406dc80 con 0x7f1ad40b00d0 2023-09-30T22:52:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad159a700 1 -- 172.21.15.142:0/1108956225 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1abc003570 con 0x7f1ad40b00d0 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad159a700 1 -- 172.21.15.142:0/1108956225 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344142753 0 0) 0x7f1ad406d3e0 con 0x7f1ad406e820 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad159a700 1 -- 172.21.15.142:0/1108956225 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad406dc80 con 0x7f1ad406e820 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad259c700 1 -- 172.21.15.142:0/1108956225 >> v1:172.21.15.148:6789/0 conn(0x7f1ad40b00d0 legacy=0x7f1ad406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad259c700 1 -- 172.21.15.142:0/1108956225 >> v1:172.21.15.142:6789/0 conn(0x7f1ad406e820 legacy=0x7f1ad415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad259c700 1 -- 172.21.15.142:0/1108956225 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40b0650 con 0x7f1ad40af020 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.441+0000 7f1ad259c700 1 --2- 172.21.15.142:0/1108956225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40af020 0x7f1ad4156d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009910 tx=0x7f1ac40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9df88f25df1e44 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad159a700 1 -- 172.21.15.142:0/1108956225 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4011630 con 0x7f1ad40af020 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad159a700 1 -- 172.21.15.142:0/1108956225 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4011790 con 0x7f1ad40af020 2023-09-30T22:52:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad159a700 1 -- 172.21.15.142:0/1108956225 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4011b30 con 0x7f1ad40af020 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad8dff700 1 -- 172.21.15.142:0/1108956225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40af020 msgr2=0x7f1ad4156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/1108956225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40af020 0x7f1ad4156d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009910 tx=0x7f1ac40091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad8dff700 1 -- 172.21.15.142:0/1108956225 shutdown_connections 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/1108956225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40af020 0x7f1ad4156d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad8dff700 1 -- 172.21.15.142:0/1108956225 >> 172.21.15.142:0/1108956225 conn(0x7f1ad40680c0 msgr2=0x7f1ad40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad8dff700 1 -- 172.21.15.142:0/1108956225 shutdown_connections 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.442+0000 7f1ad8dff700 1 -- 172.21.15.142:0/1108956225 wait complete. 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.444+0000 7f1ad8dff700 1 Processor -- start 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.444+0000 7f1ad8dff700 1 -- start start 2023-09-30T22:52:48.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad8dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ad406e820 0x7f1ad4150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad8dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ad40af020 0x7f1ad40c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad8dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40b00d0 0x7f1ad4153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad8dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c25c0 con 0x7f1ad406e820 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad8dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c1c90 con 0x7f1ad40af020 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad8dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c1f70 con 0x7f1ad40b00d0 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ad406e820 0x7f1ad4150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ad406e820 0x7f1ad4150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51694/0 (socket says 172.21.15.142:51694) 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 -- 172.21.15.142:0/242318311 learned_addr learned my addr 172.21.15.142:0/242318311 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad2d9d700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40b00d0 0x7f1ad4153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad1d9b700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ad40af020 0x7f1ad40c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:48.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 -- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40b00d0 msgr2=0x7f1ad4153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40b00d0 0x7f1ad4153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 -- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ad40af020 msgr2=0x7f1ad40c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ad40af020 0x7f1ad40c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad259c700 1 -- 172.21.15.142:0/242318311 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009420 con 0x7f1ad406e820 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.445+0000 7f1ad1d9b700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ad40af020 0x7f1ad40c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.446+0000 7f1ad259c700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ad406e820 0x7f1ad4150c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009f00 tx=0x7f1ac4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.446+0000 7f1ac27fc700 1 -- 172.21.15.142:0/242318311 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac401f070 con 0x7f1ad406e820 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.446+0000 7f1ac27fc700 1 -- 172.21.15.142:0/242318311 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4000bc0 con 0x7f1ad406e820 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.446+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad40c2250 con 0x7f1ad406e820 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.446+0000 7f1ac27fc700 1 -- 172.21.15.142:0/242318311 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4025420 con 0x7f1ad406e820 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.446+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad40c2f90 con 0x7f1ad406e820 2023-09-30T22:52:48.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.447+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad40c3240 con 0x7f1ad406e820 2023-09-30T22:52:48.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.448+0000 7f1ac27fc700 1 -- 172.21.15.142:0/242318311 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1ac4023070 con 0x7f1ad406e820 2023-09-30T22:52:48.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.449+0000 7f1ac27fc700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ab4067330 0x7f1ab40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:48.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.449+0000 7f1ac27fc700 1 -- 172.21.15.142:0/242318311 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ac4086070 con 0x7f1ad406e820 2023-09-30T22:52:48.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.449+0000 7f1ad1d9b700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ab4067330 0x7f1ab40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:48.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.450+0000 7f1ad1d9b700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ab4067330 0x7f1ab40697e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ad415c360 tx=0x7f1ac8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:48.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.453+0000 7f1ac27fc700 1 -- 172.21.15.142:0/242318311 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1ac40b7570 con 0x7f1ad406e820 2023-09-30T22:52:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.685+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ad4154800 con 0x7f1ad406e820 2023-09-30T22:52:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.686+0000 7f1ac27fc700 1 -- 172.21.15.142:0/242318311 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ac402a070 con 0x7f1ad406e820 2023-09-30T22:52:48.686 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:52:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ab4067330 msgr2=0x7f1ab40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ab4067330 0x7f1ab40697e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ad415c360 tx=0x7f1ac8009040 comp rx=0 tx=0).stop 2023-09-30T22:52:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ad406e820 msgr2=0x7f1ad4150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ad406e820 0x7f1ad4150c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009f00 tx=0x7f1ac4017000 comp rx=0 tx=0).stop 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 shutdown_connections 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ab4067330 0x7f1ab40697e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ad40b00d0 0x7f1ad4153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ad406e820 0x7f1ad4150c70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 --2- 172.21.15.142:0/242318311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ad40af020 0x7f1ad40c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 >> 172.21.15.142:0/242318311 conn(0x7f1ad40680c0 msgr2=0x7f1ad4155650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 shutdown_connections 2023-09-30T22:52:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:48.688+0000 7f1ad8dff700 1 -- 172.21.15.142:0/242318311 wait complete. 2023-09-30T22:52:48.706 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:52:48.706 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:52:48.706 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:52:48.706 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:52:48.706 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:52:48.707 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:52:48.707 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:52:48.707 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:52:48.707 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:52:48.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:48.707 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:52:48.754 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:48.754 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:48.754 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:48.754 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:48.754 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:48.754 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:48.754 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42289sec preferred_lft 42289sec 2023-09-30T22:52:48.755 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:52:48.756 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:48.756 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T22:52:48.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:48.756 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:48.756 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:48.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2023-09-30T22:52:48.757 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2023-09-30T22:52:48.757 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2023-09-30T22:52:48.757 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T22:52:48.757 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:49.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:49.178 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:52:49.248 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:52:49.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:49.252 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:52:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:52:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:52:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:52:49.319 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:52:49.319 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:52:49.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:49.319 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:49.320 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:49.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:52:49.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:52:49.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:52:49.320 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:50.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:50.014 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:52:50.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:50.061 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-09-30T22:52:50.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:50.149 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:50.149 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:50.150 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:52:50.150 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T22:52:50.150 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:50.293 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T22:52:50.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:50.293 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:50.293 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:50.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T22:52:50.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T22:52:50.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T22:52:50.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T22:52:50.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T22:52:50.294 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:50.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:50.558 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:50.559 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:50.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:52:50.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T22:52:50.559 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:50.730 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:50.730 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:52:50.776 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:52:50.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:50.776 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:52:50.861 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:52:50.861 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:52:50.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:52:51.001 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:52:51.001 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:52:51.001 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:52:51.419 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:52:51.419 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:52:51.419 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:52:51.419 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:51.420 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:51.442 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:52:51.442 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:52:51.443 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:52:51.443 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:51.443 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:51.443 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:52:51.443 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:52:51.444 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:52:51.447 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:52:51.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:51.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:52:51.518 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-09-30T22:52:51.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:52:51.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.708+0000 7f12715ff700 1 Processor -- start 2023-09-30T22:52:51.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.708+0000 7f12715ff700 1 -- start start 2023-09-30T22:52:51.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.709+0000 7f12715ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f126c157a90 0x7f126c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:51.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.709+0000 7f12715ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f126c06b3d0 0x7f126c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:51.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.709+0000 7f12715ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c0b1f40 0x7f126c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:51.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.709+0000 7f12715ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0b23c0 con 0x7f126c06b3d0 2023-09-30T22:52:51.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.709+0000 7f12715ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c06d470 con 0x7f126c157a90 2023-09-30T22:52:51.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.709+0000 7f12715ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c157e60 con 0x7f126c0b1f40 2023-09-30T22:52:51.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f126c06b3d0 0x7f126c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:51.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f126c06b3d0 0x7f126c0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34778/0 (socket says 172.21.15.142:34778) 2023-09-30T22:52:51.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 -- 172.21.15.142:0/166072141 learned_addr learned my addr 172.21.15.142:0/166072141 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:51.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126b7fe700 1 --2- 172.21.15.142:0/166072141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c0b1f40 0x7f126c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:51.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126affd700 1 --2- 172.21.15.142:0/166072141 >> v2:172.21.15.148:3300/0 conn(0x7f126c157a90 0x7f126c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:51.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 -- 172.21.15.142:0/166072141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c0b1f40 msgr2=0x7f126c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:51.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 --2- 172.21.15.142:0/166072141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c0b1f40 0x7f126c069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 -- 172.21.15.142:0/166072141 >> v2:172.21.15.148:3300/0 conn(0x7f126c157a90 msgr2=0x7f126c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:51.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 --2- 172.21.15.142:0/166072141 >> v2:172.21.15.148:3300/0 conn(0x7f126c157a90 0x7f126c15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.710+0000 7f126a7fc700 1 -- 172.21.15.142:0/166072141 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c15c430 con 0x7f126c06b3d0 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.711+0000 7f126a7fc700 1 --2- 172.21.15.142:0/166072141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c06b3d0 0x7f126c0b1a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f126c06d1e0 tx=0x7f1260009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505102572b9e8b21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.711+0000 7f1269ffb700 1 -- 172.21.15.142:0/166072141 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126000b640 con 0x7f126c06b3d0 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.711+0000 7f1269ffb700 1 -- 172.21.15.142:0/166072141 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126000b7a0 con 0x7f126c06b3d0 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.711+0000 7f1269ffb700 1 -- 172.21.15.142:0/166072141 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126000bb60 con 0x7f126c06b3d0 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.711+0000 7f12715ff700 1 -- 172.21.15.142:0/166072141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c06b3d0 msgr2=0x7f126c0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.711+0000 7f12715ff700 1 --2- 172.21.15.142:0/166072141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c06b3d0 0x7f126c0b1a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f126c06d1e0 tx=0x7f1260009250 comp rx=0 tx=0).stop 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.712+0000 7f12715ff700 1 -- 172.21.15.142:0/166072141 shutdown_connections 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.712+0000 7f12715ff700 1 --2- 172.21.15.142:0/166072141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c0b1f40 0x7f126c069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.712+0000 7f12715ff700 1 --2- 172.21.15.142:0/166072141 >> v2:172.21.15.148:3300/0 conn(0x7f126c157a90 0x7f126c15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.712+0000 7f12715ff700 1 --2- 172.21.15.142:0/166072141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c06b3d0 0x7f126c0b1a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.712+0000 7f12715ff700 1 -- 172.21.15.142:0/166072141 >> 172.21.15.142:0/166072141 conn(0x7f126c0680c0 msgr2=0x7f126c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:51.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.712+0000 7f12715ff700 1 -- 172.21.15.142:0/166072141 shutdown_connections 2023-09-30T22:52:51.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.712+0000 7f12715ff700 1 -- 172.21.15.142:0/166072141 wait complete. 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.713+0000 7f12715ff700 1 Processor -- start 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.713+0000 7f12715ff700 1 -- start start 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.714+0000 7f12715ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c06b3d0 0x7f126c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.714+0000 7f12715ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c0b1f40 0x7f126c0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.714+0000 7f12715ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126c157a90 0x7f126c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.714+0000 7f12715ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0b04f0 con 0x7f126c0b1f40 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.714+0000 7f12715ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1406d0 con 0x7f126c157a90 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.714+0000 7f12715ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1409b0 con 0x7f126c06b3d0 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.714+0000 7f126a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c0b1f40 0x7f126c0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:51.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c0b1f40 0x7f126c0afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34792/0 (socket says 172.21.15.142:34792) 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 -- 172.21.15.142:0/2097638637 learned_addr learned my addr 172.21.15.142:0/2097638637 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126affd700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c06b3d0 0x7f126c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126b7fe700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126c157a90 0x7f126c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 -- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c06b3d0 msgr2=0x7f126c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c06b3d0 0x7f126c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 -- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126c157a90 msgr2=0x7f126c15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126c157a90 0x7f126c15a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 -- 172.21.15.142:0/2097638637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600094f0 con 0x7f126c0b1f40 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126b7fe700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126c157a90 0x7f126c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f126a7fc700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c0b1f40 0x7f126c0afa50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f126c068600 tx=0x7f1260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f1252ffd700 1 -- 172.21.15.142:0/2097638637 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260000d10 con 0x7f126c0b1f40 2023-09-30T22:52:51.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f1252ffd700 1 -- 172.21.15.142:0/2097638637 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126000bb20 con 0x7f126c0b1f40 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f1252ffd700 1 -- 172.21.15.142:0/2097638637 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260011630 con 0x7f126c0b1f40 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.715+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c140c90 con 0x7f126c0b1f40 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.716+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0aff90 con 0x7f126c0b1f40 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.717+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c0b02b0 con 0x7f126c0b1f40 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.717+0000 7f1252ffd700 1 -- 172.21.15.142:0/2097638637 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f12600119a0 con 0x7f126c0b1f40 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.718+0000 7f1252ffd700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1258067330 0x7f12580697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.718+0000 7f1252ffd700 1 -- 172.21.15.142:0/2097638637 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1260085f30 con 0x7f126c0b1f40 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.719+0000 7f126affd700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1258067330 0x7f12580697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:51.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.719+0000 7f126affd700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1258067330 0x7f12580697e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f125c009ca0 tx=0x7f125c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:51.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.723+0000 7f1252ffd700 1 -- 172.21.15.142:0/2097638637 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1260052ec0 con 0x7f126c0b1f40 2023-09-30T22:52:51.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.955+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f126c0b0630 con 0x7f126c0b1f40 2023-09-30T22:52:51.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.955+0000 7f1252ffd700 1 -- 172.21.15.142:0/2097638637 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1260015070 con 0x7f126c0b1f40 2023-09-30T22:52:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1258067330 msgr2=0x7f12580697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1258067330 0x7f12580697e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f125c009ca0 tx=0x7f125c008040 comp rx=0 tx=0).stop 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c0b1f40 msgr2=0x7f126c0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c0b1f40 0x7f126c0afa50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f126c068600 tx=0x7f1260017000 comp rx=0 tx=0).stop 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 shutdown_connections 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1258067330 0x7f12580697e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126c157a90 0x7f126c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f126c06b3d0 0x7f126c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 --2- 172.21.15.142:0/2097638637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f126c0b1f40 0x7f126c0afa50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 >> 172.21.15.142:0/2097638637 conn(0x7f126c0680c0 msgr2=0x7f126c0ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.957+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 shutdown_connections 2023-09-30T22:52:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:51.958+0000 7f12715ff700 1 -- 172.21.15.142:0/2097638637 wait complete. 2023-09-30T22:52:51.976 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:52:51.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:52:51.976 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:52:51.976 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-30T22:52:51.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-30T22:52:51.976 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:52:51.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:52:51.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:52:51.977 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-30T22:52:51.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:51.977 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:52:52.023 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:52.023 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:52.024 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42286sec preferred_lft 42286sec 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:52:52.025 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.026 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:52:52.026 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:52:52.026 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link tentative 2023-09-30T22:52:52.026 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.027 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:52:52.094 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:52:52.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.097 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:52:52.146 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:52:52.146 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:52:52.146 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:52:52.146 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:52:52.146 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:52:52.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.147 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:52.147 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:52.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:52:52.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:52:52.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:52:52.148 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:52.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.316 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:52:52.363 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:52:52.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.364 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-09-30T22:52:52.451 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-30T22:52:52.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.451 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:52.452 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:52.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:52:52.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-30T22:52:52.452 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:52.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-30T22:52:52.664 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 8e:e8:34:74:01:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T22:52:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T22:52:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::8ce8:34ff:fe74:14f/64 scope link tentative 2023-09-30T22:52:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-30T22:52:52.739 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:52.740 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.741 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:52:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 8e:e8:34:74:01:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T22:52:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T22:52:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::8ce8:34ff:fe74:14f/64 scope link 2023-09-30T22:52:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:52.743 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-30T22:52:52.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.743 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:52.743 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:52.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-30T22:52:52.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-30T22:52:52.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-30T22:52:52.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-30T22:52:52.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-30T22:52:52.744 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:52.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:52.985 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:52:52.985 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:52:52.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2023-09-30T22:52:52.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2023-09-30T22:52:52.985 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:52:53.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:53.159 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-30T22:52:53.205 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-30T22:52:53.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:53.206 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-30T22:52:53.292 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:52:53.292 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:52:53.292 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-30T22:52:53.432 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-30T22:52:53.432 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-30T22:52:53.432 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:52:53.446 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-30T22:52:53.446 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-30T22:52:53.446 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:52:53.447 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:53.447 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:53.466 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-30T22:52:53.467 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-30T22:52:53.467 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:52:53.467 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:53.467 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:53.467 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:52:53.467 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:52:53.467 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:52:53.471 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:52:53.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:53.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-30T22:52:53.541 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-09-30T22:52:53.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:52:53.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.727+0000 7f099c5ff700 1 Processor -- start 2023-09-30T22:52:53.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.727+0000 7f099c5ff700 1 -- start start 2023-09-30T22:52:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.728+0000 7f099c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09940af020 0x7f0994156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.728+0000 7f099c5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f099406e820 0x7f099415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.728+0000 7f099c5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099406d3e0 con 0x7f09940b00d0 2023-09-30T22:52:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.728+0000 7f099c5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099406dc80 con 0x7f099406e820 2023-09-30T22:52:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.728+0000 7f099c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099406b790 con 0x7f09940af020 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f099406e820 0x7f099415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f099406e820 0x7f099415a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34808/0 (socket says 172.21.15.142:34808) 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 -- 172.21.15.142:0/3875256028 learned_addr learned my addr 172.21.15.142:0/3875256028 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099a39b700 1 --2- 172.21.15.142:0/3875256028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09940af020 0x7f0994156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 -- 172.21.15.142:0/3875256028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09940af020 msgr2=0x7f0994156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 --2- 172.21.15.142:0/3875256028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09940af020 0x7f0994156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 -- 172.21.15.142:0/3875256028 >> v1:172.21.15.148:6789/0 conn(0x7f09940b00d0 legacy=0x7f099406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 -- 172.21.15.142:0/3875256028 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940b0650 con 0x7f099406e820 2023-09-30T22:52:53.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.729+0000 7f099ab9c700 1 --2- 172.21.15.142:0/3875256028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f099406e820 0x7f099415a3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f098c009f20 tx=0x7f098c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a215846f5cffc888 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:53.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f0999399700 1 -- 172.21.15.142:0/3875256028 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0092e0 con 0x7f099406e820 2023-09-30T22:52:53.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f0999399700 1 -- 172.21.15.142:0/3875256028 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00b9d0 con 0x7f099406e820 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f0999399700 1 -- 172.21.15.142:0/3875256028 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00bd90 con 0x7f099406e820 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 -- 172.21.15.142:0/3875256028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f099406e820 msgr2=0x7f099415a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 --2- 172.21.15.142:0/3875256028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f099406e820 0x7f099415a3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f098c009f20 tx=0x7f098c009840 comp rx=0 tx=0).stop 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 -- 172.21.15.142:0/3875256028 shutdown_connections 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 --2- 172.21.15.142:0/3875256028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f099406e820 0x7f099415a3f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 --2- 172.21.15.142:0/3875256028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09940af020 0x7f0994156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 -- 172.21.15.142:0/3875256028 >> 172.21.15.142:0/3875256028 conn(0x7f09940680c0 msgr2=0x7f09940c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 -- 172.21.15.142:0/3875256028 shutdown_connections 2023-09-30T22:52:53.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.730+0000 7f099c5ff700 1 -- 172.21.15.142:0/3875256028 wait complete. 2023-09-30T22:52:53.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.732+0000 7f099c5ff700 1 Processor -- start 2023-09-30T22:52:53.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.733+0000 7f099c5ff700 1 -- start start 2023-09-30T22:52:53.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f099406e820 0x7f09940c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:53.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099c5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09940af020 0x7f09940c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:53.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099c5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09940b00d0 0x7f099414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099c5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099414e960 con 0x7f09940af020 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099c5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994169fb0 con 0x7f09940b00d0 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940c7350 con 0x7f099406e820 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f0999b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09940af020 0x7f09940c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f0999b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09940af020 0x7f09940c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34816/0 (socket says 172.21.15.142:34816) 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f0999b9a700 1 -- 172.21.15.142:0/1811777355 learned_addr learned my addr 172.21.15.142:0/1811777355 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099a39b700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f099406e820 0x7f09940c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.734+0000 7f099ab9c700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09940b00d0 0x7f099414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f0999b9a700 1 -- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f099406e820 msgr2=0x7f09940c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f0999b9a700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f099406e820 0x7f09940c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f0999b9a700 1 -- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09940b00d0 msgr2=0x7f099414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f0999b9a700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09940b00d0 0x7f099414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f0999b9a700 1 -- 172.21.15.142:0/1811777355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009ae0 con 0x7f09940af020 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f099a39b700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f099406e820 0x7f09940c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f0999b9a700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09940af020 0x7f09940c7640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f098400c4e0 tx=0x7f098400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f098a7fc700 1 -- 172.21.15.142:0/1811777355 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011590 con 0x7f09940af020 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f098a7fc700 1 -- 172.21.15.142:0/1811777355 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984011710 con 0x7f09940af020 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f098a7fc700 1 -- 172.21.15.142:0/1811777355 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011ad0 con 0x7f09940af020 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099416a230 con 0x7f09940af020 2023-09-30T22:52:53.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.735+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09940c6d90 con 0x7f09940af020 2023-09-30T22:52:53.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.736+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099406b9d0 con 0x7f09940af020 2023-09-30T22:52:53.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.737+0000 7f098a7fc700 1 -- 172.21.15.142:0/1811777355 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f098401b3b0 con 0x7f09940af020 2023-09-30T22:52:53.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.738+0000 7f098a7fc700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0978067330 0x7f09780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:53.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.738+0000 7f098a7fc700 1 -- 172.21.15.142:0/1811777355 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0984083f60 con 0x7f09940af020 2023-09-30T22:52:53.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.738+0000 7f099a39b700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0978067330 0x7f09780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:53.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.739+0000 7f099a39b700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0978067330 0x7f09780697e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0990011480 tx=0x7f09900091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:53.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.742+0000 7f098a7fc700 1 -- 172.21.15.142:0/1811777355 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0984050e60 con 0x7f09940af020 2023-09-30T22:52:53.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.973+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f099416a3c0 con 0x7f09940af020 2023-09-30T22:52:53.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.973+0000 7f098a7fc700 1 -- 172.21.15.142:0/1811777355 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0984017070 con 0x7f09940af020 2023-09-30T22:52:53.975 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:52:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0978067330 msgr2=0x7f09780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:53.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0978067330 0x7f09780697e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0990011480 tx=0x7f09900091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09940af020 msgr2=0x7f09940c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09940af020 0x7f09940c7640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f098400c4e0 tx=0x7f098400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 shutdown_connections 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0978067330 0x7f09780697e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09940b00d0 0x7f099414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f099406e820 0x7f09940c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 --2- 172.21.15.142:0/1811777355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09940af020 0x7f09940c7640 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 >> 172.21.15.142:0/1811777355 conn(0x7f09940680c0 msgr2=0x7f0994069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 shutdown_connections 2023-09-30T22:52:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:53.976+0000 7f099c5ff700 1 -- 172.21.15.142:0/1811777355 wait complete. 2023-09-30T22:52:53.995 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:52:53.995 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:52:53.995 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:52:53.995 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:52:53.996 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:52:53.996 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:52:53.996 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:52:53.996 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:52:53.996 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:52:53.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:53.996 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:52:54.049 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:54.049 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:54.049 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:54.049 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:54.049 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:54.050 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:52:54.051 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42315sec preferred_lft 42315sec 2023-09-30T22:52:54.051 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:52:54.051 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:54.052 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T22:52:54.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:54.052 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:54.052 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:54.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2023-09-30T22:52:54.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2023-09-30T22:52:54.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2023-09-30T22:52:54.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T22:52:54.052 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:54.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:54.482 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:52:54.552 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:52:54.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:54.555 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:52:54.620 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:52:54.621 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:52:54.621 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:52:54.621 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:52:54.621 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:52:54.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:54.621 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:54.622 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:54.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:52:54.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:52:54.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:52:54.622 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:55.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:55.296 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:52:55.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:55.344 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2023-09-30T22:52:55.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:55.391 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:55.391 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:55.391 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:52:55.391 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-30T22:52:55.391 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:55.573 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-30T22:52:55.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:55.573 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:55.573 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:55.573 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-30T22:52:55.573 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T22:52:55.574 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-30T22:52:55.574 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-30T22:52:55.574 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-30T22:52:55.574 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:55.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:55.846 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:55.846 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:55.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:52:55.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T22:52:55.846 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:56.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:56.019 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:52:56.065 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:52:56.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:56.065 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:52:56.151 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:52:56.151 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:52:56.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:52:56.291 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:52:56.291 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:52:56.291 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:52:56.715 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:52:56.715 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:52:56.716 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:52:56.716 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:56.716 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:52:56.739 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:52:56.744 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:52:56.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:56.744 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:52:56.814 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-09-30T22:52:56.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:52:57.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.011+0000 7f23cbbff700 1 Processor -- start 2023-09-30T22:52:57.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.011+0000 7f23cbbff700 1 -- start start 2023-09-30T22:52:57.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.012+0000 7f23cbbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23c41599f0 0x7f23c406e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:57.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.012+0000 7f23cbbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23c406e660 0x7f23c406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:57.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.012+0000 7f23cbbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c415e4a0 con 0x7f23c406ae10 2023-09-30T22:52:57.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.012+0000 7f23cbbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c406b210 con 0x7f23c406e660 2023-09-30T22:52:57.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.012+0000 7f23cbbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c406b490 con 0x7f23c41599f0 2023-09-30T22:52:57.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c919a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23c406e660 0x7f23c406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:57.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c919a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23c406e660 0x7f23c406a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34832/0 (socket says 172.21.15.142:34832) 2023-09-30T22:52:57.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c919a700 1 -- 172.21.15.142:0/1642649785 learned_addr learned my addr 172.21.15.142:0/1642649785 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:57.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c999b700 1 --2- 172.21.15.142:0/1642649785 >> v2:172.21.15.148:3300/0 conn(0x7f23c41599f0 0x7f23c406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:57.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c919a700 1 -- 172.21.15.142:0/1642649785 >> v2:172.21.15.148:3300/0 conn(0x7f23c41599f0 msgr2=0x7f23c406e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:57.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c919a700 1 --2- 172.21.15.142:0/1642649785 >> v2:172.21.15.148:3300/0 conn(0x7f23c41599f0 0x7f23c406e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c919a700 1 -- 172.21.15.142:0/1642649785 >> v1:172.21.15.148:6789/0 conn(0x7f23c406ae10 legacy=0x7f23c415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:57.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c919a700 1 -- 172.21.15.142:0/1642649785 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c406d360 con 0x7f23c406e660 2023-09-30T22:52:57.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.013+0000 7f23c8999700 1 -- 172.21.15.142:0/1642649785 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411598545 0 0) 0x7f23c415e4a0 con 0x7f23c406ae10 2023-09-30T22:52:57.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23c919a700 1 --2- 172.21.15.142:0/1642649785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c406a8d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f23c406ba30 tx=0x7f23b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf4df1562f1e1a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:57.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23c8999700 1 -- 172.21.15.142:0/1642649785 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4009e60 con 0x7f23c406e660 2023-09-30T22:52:57.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23c8999700 1 -- 172.21.15.142:0/1642649785 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b400b860 con 0x7f23c406e660 2023-09-30T22:52:57.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23c8999700 1 -- 172.21.15.142:0/1642649785 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b400bc00 con 0x7f23c406e660 2023-09-30T22:52:57.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23cbbff700 1 -- 172.21.15.142:0/1642649785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 msgr2=0x7f23c406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:57.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1642649785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c406a8d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f23c406ba30 tx=0x7f23b4009250 comp rx=0 tx=0).stop 2023-09-30T22:52:57.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23cbbff700 1 -- 172.21.15.142:0/1642649785 shutdown_connections 2023-09-30T22:52:57.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1642649785 >> v2:172.21.15.148:3300/0 conn(0x7f23c41599f0 0x7f23c406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1642649785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c406a8d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23cbbff700 1 -- 172.21.15.142:0/1642649785 >> 172.21.15.142:0/1642649785 conn(0x7f23c40d1560 msgr2=0x7f23c40cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:57.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.014+0000 7f23cbbff700 1 -- 172.21.15.142:0/1642649785 shutdown_connections 2023-09-30T22:52:57.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.015+0000 7f23cbbff700 1 -- 172.21.15.142:0/1642649785 wait complete. 2023-09-30T22:52:57.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.016+0000 7f23cbbff700 1 Processor -- start 2023-09-30T22:52:57.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.016+0000 7f23cbbff700 1 -- start start 2023-09-30T22:52:57.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23cbbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c406ae10 0x7f23c4159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:57.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23cbbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:57.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23cbbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23c41599f0 0x7f23c4152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:57.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23cbbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c415b0d0 con 0x7f23c406e660 2023-09-30T22:52:57.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23cbbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c415de20 con 0x7f23c406ae10 2023-09-30T22:52:57.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23cbbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c415a4c0 con 0x7f23c41599f0 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23c919a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23c919a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c415d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34838/0 (socket says 172.21.15.142:34838) 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23c919a700 1 -- 172.21.15.142:0/1009430165 learned_addr learned my addr 172.21.15.142:0/1009430165 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23ca19c700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23c41599f0 0x7f23c4152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.017+0000 7f23c999b700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c406ae10 0x7f23c4159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23c919a700 1 -- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23c41599f0 msgr2=0x7f23c4152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23c919a700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23c41599f0 0x7f23c4152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23c919a700 1 -- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c406ae10 msgr2=0x7f23c4159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23c919a700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c406ae10 0x7f23c4159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23c919a700 1 -- 172.21.15.142:0/1009430165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4009490 con 0x7f23c406e660 2023-09-30T22:52:57.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23c919a700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c415d8e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23c4067ad0 tx=0x7f23b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:57.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23b9ffb700 1 -- 172.21.15.142:0/1009430165 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b401f070 con 0x7f23c406e660 2023-09-30T22:52:57.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23b9ffb700 1 -- 172.21.15.142:0/1009430165 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b4000bc0 con 0x7f23c406e660 2023-09-30T22:52:57.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23b9ffb700 1 -- 172.21.15.142:0/1009430165 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4025420 con 0x7f23c406e660 2023-09-30T22:52:57.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c415a7a0 con 0x7f23c406e660 2023-09-30T22:52:57.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.018+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c415ad60 con 0x7f23c406e660 2023-09-30T22:52:57.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.019+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c4069770 con 0x7f23c406e660 2023-09-30T22:52:57.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.020+0000 7f23b9ffb700 1 -- 172.21.15.142:0/1009430165 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f23b4023070 con 0x7f23c406e660 2023-09-30T22:52:57.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.021+0000 7f23b9ffb700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f23a8067330 0x7f23a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:57.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.021+0000 7f23b9ffb700 1 -- 172.21.15.142:0/1009430165 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23b4085f30 con 0x7f23c406e660 2023-09-30T22:52:57.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.021+0000 7f23c999b700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f23a8067330 0x7f23a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:57.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.022+0000 7f23c999b700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f23a8067330 0x7f23a80697e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009d00 tx=0x7f23c0009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:57.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.026+0000 7f23b9ffb700 1 -- 172.21.15.142:0/1009430165 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f23b4052e10 con 0x7f23c406e660 2023-09-30T22:52:57.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.263+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f23c415b210 con 0x7f23c406e660 2023-09-30T22:52:57.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.263+0000 7f23b9ffb700 1 -- 172.21.15.142:0/1009430165 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f23b402a070 con 0x7f23c406e660 2023-09-30T22:52:57.265 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:52:57.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.265+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f23a8067330 msgr2=0x7f23a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:57.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.265+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f23a8067330 0x7f23a80697e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009d00 tx=0x7f23c0009120 comp rx=0 tx=0).stop 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.265+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 msgr2=0x7f23c415d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.265+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c415d8e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23c4067ad0 tx=0x7f23b4017000 comp rx=0 tx=0).stop 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.265+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 shutdown_connections 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.266+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f23a8067330 0x7f23a80697e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.266+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23c41599f0 0x7f23c4152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.266+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c406ae10 0x7f23c4159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.266+0000 7f23cbbff700 1 --2- 172.21.15.142:0/1009430165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23c406e660 0x7f23c415d8e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.266+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 >> 172.21.15.142:0/1009430165 conn(0x7f23c40d1560 msgr2=0x7f23c40ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.266+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 shutdown_connections 2023-09-30T22:52:57.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:57.266+0000 7f23cbbff700 1 -- 172.21.15.142:0/1009430165 wait complete. 2023-09-30T22:52:57.284 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:52:57.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:52:57.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:52:57.285 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-30T22:52:57.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-30T22:52:57.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:52:57.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:52:57.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:52:57.285 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-30T22:52:57.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.285 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:57.333 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:52:57.334 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link tentative 2023-09-30T22:52:57.335 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.336 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:52:57.404 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:52:57.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.407 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:52:57.455 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:52:57.455 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:52:57.455 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:52:57.455 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:52:57.456 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:52:57.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.457 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:57.457 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:57.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:52:57.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:52:57.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:52:57.457 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:57.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.629 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:52:57.676 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:52:57.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.677 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2023-09-30T22:52:57.762 INFO:teuthology.orchestra.run.smithi148.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-30T22:52:57.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.763 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:57.763 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:57.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:52:57.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-30T22:52:57.764 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:57.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-30T22:52:57.976 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether b2:2b:03:70:0b:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T22:52:57.977 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.978 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::b02b:3ff:fe70:bae/64 scope link 2023-09-30T22:52:57.978 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:57.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:57.979 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:52:58.050 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether b2:2b:03:70:0b:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T22:52:58.051 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T22:52:58.051 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:58.051 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::b02b:3ff:fe70:bae/64 scope link 2023-09-30T22:52:58.051 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:52:58.053 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-30T22:52:58.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:58.053 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:58.053 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:58.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-30T22:52:58.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-30T22:52:58.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-30T22:52:58.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-30T22:52:58.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-30T22:52:58.054 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:58.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:58.297 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:52:58.297 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:52:58.297 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.1 up 2023-09-30T22:52:58.297 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.1 master ceph-brx 2023-09-30T22:52:58.297 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:52:58.471 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:58.472 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-30T22:52:58.518 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-30T22:52:58.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:52:58.518 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-30T22:52:58.603 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:52:58.603 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:52:58.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-30T22:52:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-30T22:52:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-30T22:52:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:52:58.756 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-30T22:52:58.756 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-30T22:52:58.756 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:52:58.756 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:58.756 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:52:58.777 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:52:58.780 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:52:58.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:52:58.781 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-30T22:52:58.849 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-30T22:52:58.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:52:59.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.063+0000 7fcbdcdff700 1 Processor -- start 2023-09-30T22:52:59.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.064+0000 7fcbdcdff700 1 -- start start 2023-09-30T22:52:59.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.065+0000 7fcbdcdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd8143350 0x7fcbd80cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.065+0000 7fcbdcdff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd80cc6b0 con 0x7fcbd815de20 2023-09-30T22:52:59.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.065+0000 7fcbdcdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd80cb7d0 con 0x7fcbd80692f0 2023-09-30T22:52:59.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.065+0000 7fcbdcdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80cbaa0 con 0x7fcbd8143350 2023-09-30T22:52:59.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.065+0000 7fcbd6d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcbd815de20 0x7fcbd806a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:57452/0 (socket says 172.21.15.142:57452) 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.065+0000 7fcbd6d9d700 1 -- 172.21.15.142:0/522013350 learned_addr learned my addr 172.21.15.142:0/522013350 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.065+0000 7fcbd659c700 1 --2- 172.21.15.142:0/522013350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd8143350 0x7fcbd80cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd559a700 1 -- 172.21.15.142:0/522013350 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971512913 0 0) 0x7fcbd80cc6b0 con 0x7fcbd815de20 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd559a700 1 -- 172.21.15.142:0/522013350 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc0003570 con 0x7fcbd815de20 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd559a700 1 -- 172.21.15.142:0/522013350 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259070922 0 0) 0x7fcbd80cb7d0 con 0x7fcbd80692f0 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd559a700 1 -- 172.21.15.142:0/522013350 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd80cc6b0 con 0x7fcbd80692f0 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd659c700 1 -- 172.21.15.142:0/522013350 >> v1:172.21.15.148:6789/0 conn(0x7fcbd80692f0 legacy=0x7fcbd815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd659c700 1 -- 172.21.15.142:0/522013350 >> v1:172.21.15.142:6789/0 conn(0x7fcbd815de20 legacy=0x7fcbd806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd659c700 1 -- 172.21.15.142:0/522013350 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd80cbd80 con 0x7fcbd8143350 2023-09-30T22:52:59.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd659c700 1 --2- 172.21.15.142:0/522013350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd8143350 0x7fcbd80cb290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009910 tx=0x7fcbc80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac43390c31d9c37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd559a700 1 -- 172.21.15.142:0/522013350 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8011630 con 0x7fcbd8143350 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd559a700 1 -- 172.21.15.142:0/522013350 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc8011790 con 0x7fcbd8143350 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.066+0000 7fcbd559a700 1 -- 172.21.15.142:0/522013350 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8011b30 con 0x7fcbd8143350 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.067+0000 7fcbdcdff700 1 -- 172.21.15.142:0/522013350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd8143350 msgr2=0x7fcbd80cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.067+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/522013350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd8143350 0x7fcbd80cb290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009910 tx=0x7fcbc80091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.067+0000 7fcbdcdff700 1 -- 172.21.15.142:0/522013350 shutdown_connections 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.067+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/522013350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd8143350 0x7fcbd80cb290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.067+0000 7fcbdcdff700 1 -- 172.21.15.142:0/522013350 >> 172.21.15.142:0/522013350 conn(0x7fcbd80ce8e0 msgr2=0x7fcbd80cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.067+0000 7fcbdcdff700 1 -- 172.21.15.142:0/522013350 shutdown_connections 2023-09-30T22:52:59.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.067+0000 7fcbdcdff700 1 -- 172.21.15.142:0/522013350 wait complete. 2023-09-30T22:52:59.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.068+0000 7fcbdcdff700 1 Processor -- start 2023-09-30T22:52:59.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.069+0000 7fcbdcdff700 1 -- start start 2023-09-30T22:52:59.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.069+0000 7fcbdcdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd80692f0 0x7fcbd815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbdcdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbd8143350 0x7fcbd8169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbdcdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbd815de20 0x7fcbd813ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbdcdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd816afa0 con 0x7fcbd815de20 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbdcdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd816a9e0 con 0x7fcbd8143350 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbdcdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd816acc0 con 0x7fcbd80692f0 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbd815de20 0x7fcbd813ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd80692f0 0x7fcbd815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbd815de20 0x7fcbd813ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34852/0 (socket says 172.21.15.142:34852) 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 -- 172.21.15.142:0/4210797599 learned_addr learned my addr 172.21.15.142:0/4210797599 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd80692f0 0x7fcbd815cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:36876/0 (socket says 172.21.15.142:36876) 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd5d9b700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbd8143350 0x7fcbd8169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 -- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd80692f0 msgr2=0x7fcbd815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd80692f0 0x7fcbd815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 -- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbd8143350 msgr2=0x7fcbd8169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbd8143350 0x7fcbd8169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 -- 172.21.15.142:0/4210797599 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8009420 con 0x7fcbd815de20 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd659c700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd80692f0 0x7fcbd815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.070+0000 7fcbd6d9d700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbd815de20 0x7fcbd813ee80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0002250 tx=0x7fcbd00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.071+0000 7fcbc67fc700 1 -- 172.21.15.142:0/4210797599 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000a7e0 con 0x7fcbd815de20 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.071+0000 7fcbc67fc700 1 -- 172.21.15.142:0/4210797599 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd000a940 con 0x7fcbd815de20 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.071+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd80a5650 con 0x7fcbd815de20 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.071+0000 7fcbc67fc700 1 -- 172.21.15.142:0/4210797599 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000ad00 con 0x7fcbd815de20 2023-09-30T22:52:59.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.071+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd813fb30 con 0x7fcbd815de20 2023-09-30T22:52:59.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.072+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd80a5b70 con 0x7fcbd815de20 2023-09-30T22:52:59.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.073+0000 7fcbc67fc700 1 -- 172.21.15.142:0/4210797599 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcbd0007300 con 0x7fcbd815de20 2023-09-30T22:52:59.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.074+0000 7fcbc67fc700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcbb8067330 0x7fcbb80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.074+0000 7fcbc67fc700 1 -- 172.21.15.142:0/4210797599 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcbd0084de0 con 0x7fcbd815de20 2023-09-30T22:52:59.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.074+0000 7fcbd659c700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcbb8067330 0x7fcbb80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.075+0000 7fcbd659c700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcbb8067330 0x7fcbb80697e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009860 tx=0x7fcbc8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.078+0000 7fcbc67fc700 1 -- 172.21.15.142:0/4210797599 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcbd0051d60 con 0x7fcbd815de20 2023-09-30T22:52:59.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.272+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbd80cc060 con 0x7fcbd815de20 2023-09-30T22:52:59.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.273+0000 7fcbc67fc700 1 -- 172.21.15.142:0/4210797599 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fcbd000ae60 con 0x7fcbd815de20 2023-09-30T22:52:59.274 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:52:59.274 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcbb8067330 msgr2=0x7fcbb80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcbb8067330 0x7fcbb80697e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009860 tx=0x7fcbc8017000 comp rx=0 tx=0).stop 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbd815de20 msgr2=0x7fcbd813ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbd815de20 0x7fcbd813ee80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0002250 tx=0x7fcbd00019c0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 shutdown_connections 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcbb8067330 0x7fcbb80697e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbd815de20 0x7fcbd813ee80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcbd80692f0 0x7fcbd815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 --2- 172.21.15.142:0/4210797599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcbd8143350 0x7fcbd8169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 >> 172.21.15.142:0/4210797599 conn(0x7fcbd80ce8e0 msgr2=0x7fcbd80cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:59.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 shutdown_connections 2023-09-30T22:52:59.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.275+0000 7fcbdcdff700 1 -- 172.21.15.142:0/4210797599 wait complete. 2023-09-30T22:52:59.294 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:52:27.833414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:52:28.438662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:52:59.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:52:59.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.487+0000 7fd7b1bff700 1 Processor -- start 2023-09-30T22:52:59.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.488+0000 7fd7b1bff700 1 -- start start 2023-09-30T22:52:59.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7b1bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7b1bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd7ac0b0de0 0x7fd7ac0681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7b1bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac067d10 con 0x7fd7ac159ba0 2023-09-30T22:52:59.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7b1bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac06af90 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7b1bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0676c0 con 0x7fd7ac0ca5e0 2023-09-30T22:52:59.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7ab7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd7ac159ba0 0x7fd7ac0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:42814/0 (socket says 172.21.15.142:42814) 2023-09-30T22:52:59.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7ab7fe700 1 -- 172.21.15.142:0/3380402207 learned_addr learned my addr 172.21.15.142:0/3380402207 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:52:59.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7aaffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7abfff700 1 --2- 172.21.15.142:0/3380402207 >> v2:172.21.15.148:3300/0 conn(0x7fd7ac0b0de0 0x7fd7ac0681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7aa7fc700 1 -- 172.21.15.142:0/3380402207 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146416215 0 0) 0x7fd7ac067d10 con 0x7fd7ac159ba0 2023-09-30T22:52:59.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.489+0000 7fd7aa7fc700 1 -- 172.21.15.142:0/3380402207 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd794003570 con 0x7fd7ac159ba0 2023-09-30T22:52:59.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7abfff700 1 -- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 msgr2=0x7fd7ac06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:59.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7abfff700 1 --2- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7abfff700 1 -- 172.21.15.142:0/3380402207 >> v1:172.21.15.148:6789/0 conn(0x7fd7ac159ba0 legacy=0x7fd7ac0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7abfff700 1 -- 172.21.15.142:0/3380402207 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac0679a0 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7aaffd700 1 --2- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:59.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7abfff700 1 --2- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0681a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009e60 tx=0x7fd7a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e39e6d50ddbf8662 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7aa7fc700 1 -- 172.21.15.142:0/3380402207 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400e070 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7aa7fc700 1 -- 172.21.15.142:0/3380402207 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a400bab0 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.490+0000 7fd7aa7fc700 1 -- 172.21.15.142:0/3380402207 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400be70 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 -- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac0b0de0 msgr2=0x7fd7ac0681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0681a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009e60 tx=0x7fd7a4009780 comp rx=0 tx=0).stop 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 -- 172.21.15.142:0/3380402207 shutdown_connections 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0681a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/3380402207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 -- 172.21.15.142:0/3380402207 >> 172.21.15.142:0/3380402207 conn(0x7fd7ac0cb2f0 msgr2=0x7fd7ac0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 -- 172.21.15.142:0/3380402207 shutdown_connections 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.491+0000 7fd7b1bff700 1 -- 172.21.15.142:0/3380402207 wait complete. 2023-09-30T22:52:59.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.492+0000 7fd7b1bff700 1 Processor -- start 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.492+0000 7fd7b1bff700 1 -- start start 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.493+0000 7fd7b1bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.493+0000 7fd7b1bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.493+0000 7fd7b1bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac159ba0 0x7fd7ac0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.493+0000 7fd7b1bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c6370 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.493+0000 7fd7b1bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c49c0 con 0x7fd7ac159ba0 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.493+0000 7fd7b1bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c59d0 con 0x7fd7ac0ca5e0 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34862/0 (socket says 172.21.15.142:34862) 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 -- 172.21.15.142:0/457377915 learned_addr learned my addr 172.21.15.142:0/457377915 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7aaffd700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7abfff700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac159ba0 0x7fd7ac0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 -- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 msgr2=0x7fd7ac0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac0afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 -- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac159ba0 msgr2=0x7fd7ac0b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac159ba0 0x7fd7ac0b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.494+0000 7fd7ab7fe700 1 -- 172.21.15.142:0/457377915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0009420 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.495+0000 7fd7ab7fe700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0c8050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c590 tx=0x7fd79c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.495+0000 7fd7937fe700 1 -- 172.21.15.142:0/457377915 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c005b30 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.495+0000 7fd7937fe700 1 -- 172.21.15.142:0/457377915 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c005c90 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.495+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a4009a20 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.495+0000 7fd7937fe700 1 -- 172.21.15.142:0/457377915 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c007320 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.495+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac0c5f90 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.496+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac0c64b0 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.497+0000 7fd7937fe700 1 -- 172.21.15.142:0/457377915 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd79c01c440 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.498+0000 7fd7937fe700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd798067330 0x7fd7980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.498+0000 7fd7937fe700 1 -- 172.21.15.142:0/457377915 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd79c083fc0 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.498+0000 7fd7aaffd700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd798067330 0x7fd7980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.499+0000 7fd7aaffd700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd798067330 0x7fd7980697e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac158ba0 tx=0x7fd7a00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.503+0000 7fd7937fe700 1 -- 172.21.15.142:0/457377915 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd7ac0c64b0 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.689+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7ac0c64b0 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.689+0000 7fd7937fe700 1 -- 172.21.15.142:0/457377915 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7ac0c64b0 con 0x7fd7ac0b0de0 2023-09-30T22:52:59.691 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:52:59.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd798067330 msgr2=0x7fd7980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd798067330 0x7fd7980697e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac158ba0 tx=0x7fd7a00091a0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac0b0de0 msgr2=0x7fd7ac0c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0c8050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c590 tx=0x7fd79c007e00 comp rx=0 tx=0).stop 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 shutdown_connections 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd798067330 0x7fd7980697e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7ac159ba0 0x7fd7ac0b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac0b0de0 0x7fd7ac0c8050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 --2- 172.21.15.142:0/457377915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7ac0ca5e0 0x7fd7ac0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 >> 172.21.15.142:0/457377915 conn(0x7fd7ac0cb2f0 msgr2=0x7fd7ac15bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:59.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 shutdown_connections 2023-09-30T22:52:59.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.692+0000 7fd7b1bff700 1 -- 172.21.15.142:0/457377915 wait complete. 2023-09-30T22:52:59.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:52:59.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.901+0000 7fcb469ff700 1 Processor -- start 2023-09-30T22:52:59.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.901+0000 7fcb469ff700 1 -- start start 2023-09-30T22:52:59.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.902+0000 7fcb469ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb40159ba0 0x7fcb4006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.902+0000 7fcb469ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400ca5e0 0x7fcb400681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.902+0000 7fcb469ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb40067d10 con 0x7fcb400b0de0 2023-09-30T22:52:59.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb469ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4006af90 con 0x7fcb40159ba0 2023-09-30T22:52:59.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb469ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400676c0 con 0x7fcb400ca5e0 2023-09-30T22:52:59.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb3ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb40159ba0 0x7fcb4006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb3ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb40159ba0 0x7fcb4006a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34870/0 (socket says 172.21.15.142:34870) 2023-09-30T22:52:59.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb3ffff700 1 -- 172.21.15.142:0/3069485702 learned_addr learned my addr 172.21.15.142:0/3069485702 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:59.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb44f9c700 1 --2- 172.21.15.142:0/3069485702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400ca5e0 0x7fcb400681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb3ffff700 1 -- 172.21.15.142:0/3069485702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400ca5e0 msgr2=0x7fcb400681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:52:59.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb3ffff700 1 --2- 172.21.15.142:0/3069485702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400ca5e0 0x7fcb400681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb3ffff700 1 -- 172.21.15.142:0/3069485702 >> v1:172.21.15.148:6789/0 conn(0x7fcb400b0de0 legacy=0x7fcb400c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.903+0000 7fcb3ffff700 1 -- 172.21.15.142:0/3069485702 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb400679a0 con 0x7fcb40159ba0 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.904+0000 7fcb3ffff700 1 --2- 172.21.15.142:0/3069485702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb40159ba0 0x7fcb4006a8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb300099b0 tx=0x7fcb30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a74c535c6c3c95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.904+0000 7fcb3effd700 1 -- 172.21.15.142:0/3069485702 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30009ea0 con 0x7fcb40159ba0 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.904+0000 7fcb3effd700 1 -- 172.21.15.142:0/3069485702 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000b860 con 0x7fcb40159ba0 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.904+0000 7fcb3effd700 1 -- 172.21.15.142:0/3069485702 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000bc00 con 0x7fcb40159ba0 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.904+0000 7fcb469ff700 1 -- 172.21.15.142:0/3069485702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb40159ba0 msgr2=0x7fcb4006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.904+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3069485702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb40159ba0 0x7fcb4006a8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb300099b0 tx=0x7fcb30009250 comp rx=0 tx=0).stop 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.905+0000 7fcb469ff700 1 -- 172.21.15.142:0/3069485702 shutdown_connections 2023-09-30T22:52:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.905+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3069485702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400ca5e0 0x7fcb400681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.905+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3069485702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb40159ba0 0x7fcb4006a8d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.905+0000 7fcb469ff700 1 -- 172.21.15.142:0/3069485702 >> 172.21.15.142:0/3069485702 conn(0x7fcb400cb2f0 msgr2=0x7fcb400cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:52:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.905+0000 7fcb469ff700 1 -- 172.21.15.142:0/3069485702 shutdown_connections 2023-09-30T22:52:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.905+0000 7fcb469ff700 1 -- 172.21.15.142:0/3069485702 wait complete. 2023-09-30T22:52:59.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.906+0000 7fcb469ff700 1 Processor -- start 2023-09-30T22:52:59.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.906+0000 7fcb469ff700 1 -- start start 2023-09-30T22:52:59.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.907+0000 7fcb469ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400b0de0 0x7fcb400c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.907+0000 7fcb469ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb400ca5e0 0x7fcb40157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.907+0000 7fcb469ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb40159ba0 0x7fcb40157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.907+0000 7fcb469ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400b07a0 con 0x7fcb400ca5e0 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.907+0000 7fcb469ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40157ac0 con 0x7fcb40159ba0 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.907+0000 7fcb469ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400c2190 con 0x7fcb400b0de0 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.907+0000 7fcb3f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb400ca5e0 0x7fcb40157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400b0de0 0x7fcb400c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400b0de0 0x7fcb400c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:36914/0 (socket says 172.21.15.142:36914) 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3ffff700 1 -- 172.21.15.142:0/3215062666 learned_addr learned my addr 172.21.15.142:0/3215062666 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb44f9c700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb40159ba0 0x7fcb40157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3f7fe700 1 -- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400b0de0 msgr2=0x7fcb400c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3f7fe700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400b0de0 0x7fcb400c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3f7fe700 1 -- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb40159ba0 msgr2=0x7fcb40157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3f7fe700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb40159ba0 0x7fcb40157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3f7fe700 1 -- 172.21.15.142:0/3215062666 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300094f0 con 0x7fcb400ca5e0 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3ffff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400b0de0 0x7fcb400c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb3f7fe700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb400ca5e0 0x7fcb40157040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c590 tx=0x7fcb34007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.908+0000 7fcb27fff700 1 -- 172.21.15.142:0/3215062666 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34011590 con 0x7fcb400ca5e0 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.909+0000 7fcb27fff700 1 -- 172.21.15.142:0/3215062666 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb34011710 con 0x7fcb400ca5e0 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.909+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb400c2430 con 0x7fcb400ca5e0 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.909+0000 7fcb27fff700 1 -- 172.21.15.142:0/3215062666 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34011ad0 con 0x7fcb400ca5e0 2023-09-30T22:52:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.909+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4015d420 con 0x7fcb400ca5e0 2023-09-30T22:52:59.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.910+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb400c2c30 con 0x7fcb400ca5e0 2023-09-30T22:52:59.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.910+0000 7fcb27fff700 1 -- 172.21.15.142:0/3215062666 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcb3401b3b0 con 0x7fcb400ca5e0 2023-09-30T22:52:59.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.911+0000 7fcb27fff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:52:59.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.911+0000 7fcb27fff700 1 -- 172.21.15.142:0/3215062666 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb34083f40 con 0x7fcb400ca5e0 2023-09-30T22:52:59.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.912+0000 7fcb3ffff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:52:59.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.912+0000 7fcb3ffff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb30003080 tx=0x7fcb30017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:52:59.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:52:59.915+0000 7fcb27fff700 1 -- 172.21.15.142:0/3215062666 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcb400c2c30 con 0x7fcb400ca5e0 2023-09-30T22:53:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.105+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb400c2c30 con 0x7fcb400ca5e0 2023-09-30T22:53:00.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.106+0000 7fcb27fff700 1 -- 172.21.15.142:0/3215062666 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb400c2c30 con 0x7fcb400ca5e0 2023-09-30T22:53:00.107 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 msgr2=0x7fcb2c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb30003080 tx=0x7fcb30017000 comp rx=0 tx=0).stop 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb400ca5e0 msgr2=0x7fcb40157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb400ca5e0 0x7fcb40157040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c590 tx=0x7fcb34007ec0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 shutdown_connections 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb40159ba0 0x7fcb40157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb400b0de0 0x7fcb400c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 --2- 172.21.15.142:0/3215062666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb400ca5e0 0x7fcb40157040 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 >> 172.21.15.142:0/3215062666 conn(0x7fcb400cb2f0 msgr2=0x7fcb400ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:00.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 shutdown_connections 2023-09-30T22:53:00.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.108+0000 7fcb469ff700 1 -- 172.21.15.142:0/3215062666 wait complete. 2023-09-30T22:53:00.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:53:00.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.319+0000 7fad47dff700 1 Processor -- start 2023-09-30T22:53:00.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.319+0000 7fad47dff700 1 -- start start 2023-09-30T22:53:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.320+0000 7fad47dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fad400cc3b0 0x7fad4015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.320+0000 7fad47dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400d0550 con 0x7fad400cbfe0 2023-09-30T22:53:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.320+0000 7fad47dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400cf940 con 0x7fad40157ab0 2023-09-30T22:53:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.320+0000 7fad47dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad400cfc20 con 0x7fad400cc3b0 2023-09-30T22:53:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad45b9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fad400cbfe0 0x7fad401573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:57456/0 (socket says 172.21.15.142:57456) 2023-09-30T22:53:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad45b9b700 1 -- 172.21.15.142:0/3246665978 learned_addr learned my addr 172.21.15.142:0/3246665978 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad4639c700 1 --2- 172.21.15.142:0/3246665978 >> v2:172.21.15.148:3300/0 conn(0x7fad400cc3b0 0x7fad4015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466344228 0 0) 0x7fad400d0550 con 0x7fad400cbfe0 2023-09-30T22:53:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c003570 con 0x7fad400cbfe0 2023-09-30T22:53:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379524230 0 0) 0x7fad400cf940 con 0x7fad40157ab0 2023-09-30T22:53:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad400d0550 con 0x7fad40157ab0 2023-09-30T22:53:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad4639c700 1 -- 172.21.15.142:0/3246665978 >> v1:172.21.15.148:6789/0 conn(0x7fad40157ab0 legacy=0x7fad4006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101220732 0 0) 0x7fad2c003570 con 0x7fad400cbfe0 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad4639c700 1 -- 172.21.15.142:0/3246665978 >> v1:172.21.15.142:6789/0 conn(0x7fad400cbfe0 legacy=0x7fad401573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.321+0000 7fad4639c700 1 -- 172.21.15.142:0/3246665978 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400cff00 con 0x7fad400cc3b0 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.322+0000 7fad4639c700 1 --2- 172.21.15.142:0/3246665978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad400cc3b0 0x7fad4015a2a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e60 tx=0x7fad38009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713139ede8e14526 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.322+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800e070 con 0x7fad400cc3b0 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.322+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800b7a0 con 0x7fad400cc3b0 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.322+0000 7fad44b99700 1 -- 172.21.15.142:0/3246665978 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c001470 con 0x7fad400cc3b0 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.323+0000 7fad47dff700 1 -- 172.21.15.142:0/3246665978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad400cc3b0 msgr2=0x7fad4015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.323+0000 7fad47dff700 1 --2- 172.21.15.142:0/3246665978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad400cc3b0 0x7fad4015a2a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e60 tx=0x7fad38009780 comp rx=0 tx=0).stop 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.323+0000 7fad47dff700 1 -- 172.21.15.142:0/3246665978 shutdown_connections 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.323+0000 7fad47dff700 1 --2- 172.21.15.142:0/3246665978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad400cc3b0 0x7fad4015a2a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.323+0000 7fad47dff700 1 -- 172.21.15.142:0/3246665978 >> 172.21.15.142:0/3246665978 conn(0x7fad400d0a80 msgr2=0x7fad400d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.323+0000 7fad47dff700 1 -- 172.21.15.142:0/3246665978 shutdown_connections 2023-09-30T22:53:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.323+0000 7fad47dff700 1 -- 172.21.15.142:0/3246665978 wait complete. 2023-09-30T22:53:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.325+0000 7fad47dff700 1 Processor -- start 2023-09-30T22:53:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.325+0000 7fad47dff700 1 -- start start 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad47dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad400cbfe0 0x7fad401585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad47dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad400cc3b0 0x7fad401482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad47dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad40157ab0 0x7fad400c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad47dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40158b00 con 0x7fad400cbfe0 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad47dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40159290 con 0x7fad40157ab0 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad47dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad40159570 con 0x7fad400cc3b0 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad45b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad400cbfe0 0x7fad401585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad45b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad400cbfe0 0x7fad401585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34884/0 (socket says 172.21.15.142:34884) 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.326+0000 7fad45b9b700 1 -- 172.21.15.142:0/2741601116 learned_addr learned my addr 172.21.15.142:0/2741601116 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad4639c700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad40157ab0 0x7fad400c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad4539a700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad400cc3b0 0x7fad401482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad45b9b700 1 -- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad400cc3b0 msgr2=0x7fad401482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad45b9b700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad400cc3b0 0x7fad401482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad45b9b700 1 -- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad40157ab0 msgr2=0x7fad400c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad45b9b700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad40157ab0 0x7fad400c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad45b9b700 1 -- 172.21.15.142:0/2741601116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38009a20 con 0x7fad400cbfe0 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad45b9b700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad400cbfe0 0x7fad401585c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00cb70 tx=0x7fad3c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad35ffb700 1 -- 172.21.15.142:0/2741601116 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c007e90 con 0x7fad400cbfe0 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad35ffb700 1 -- 172.21.15.142:0/2741601116 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c007360 con 0x7fad400cbfe0 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad35ffb700 1 -- 172.21.15.142:0/2741601116 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004830 con 0x7fad400cbfe0 2023-09-30T22:53:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.327+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40159850 con 0x7fad400cbfe0 2023-09-30T22:53:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.328+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad40159e10 con 0x7fad400cbfe0 2023-09-30T22:53:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.329+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad40069770 con 0x7fad400cbfe0 2023-09-30T22:53:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.329+0000 7fad35ffb700 1 -- 172.21.15.142:0/2741601116 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad3c004be0 con 0x7fad400cbfe0 2023-09-30T22:53:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.330+0000 7fad35ffb700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.330+0000 7fad35ffb700 1 -- 172.21.15.142:0/2741601116 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad3c083f90 con 0x7fad400cbfe0 2023-09-30T22:53:00.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.330+0000 7fad4539a700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.331+0000 7fad4539a700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fad40155d60 tx=0x7fad30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:00.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.334+0000 7fad35ffb700 1 -- 172.21.15.142:0/2741601116 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad3c050e70 con 0x7fad400cbfe0 2023-09-30T22:53:00.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.526+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad4006fc10 con 0x7fad400cbfe0 2023-09-30T22:53:00.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.526+0000 7fad35ffb700 1 -- 172.21.15.142:0/2741601116 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad3c0180a0 con 0x7fad400cbfe0 2023-09-30T22:53:00.527 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:53:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 msgr2=0x7fad240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fad40155d60 tx=0x7fad30009040 comp rx=0 tx=0).stop 2023-09-30T22:53:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad400cbfe0 msgr2=0x7fad401585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad400cbfe0 0x7fad401585c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00cb70 tx=0x7fad3c001b50 comp rx=0 tx=0).stop 2023-09-30T22:53:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 shutdown_connections 2023-09-30T22:53:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad40157ab0 0x7fad400c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad400cbfe0 0x7fad401585c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 --2- 172.21.15.142:0/2741601116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad400cc3b0 0x7fad401482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.528+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 >> 172.21.15.142:0/2741601116 conn(0x7fad400d0a80 msgr2=0x7fad4006a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:00.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.529+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 shutdown_connections 2023-09-30T22:53:00.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.529+0000 7fad47dff700 1 -- 172.21.15.142:0/2741601116 wait complete. 2023-09-30T22:53:00.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:53:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.737+0000 7f7a8adff700 1 Processor -- start 2023-09-30T22:53:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.737+0000 7f7a8adff700 1 -- start start 2023-09-30T22:53:00.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.738+0000 7f7a8adff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7a840cbfe0 0x7f7a8415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.738+0000 7f7a8adff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a840cc3b0 0x7f7a840cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.738+0000 7f7a8adff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a840d0550 con 0x7f7a841573a0 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.738+0000 7f7a8adff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a840cf750 con 0x7f7a840cc3b0 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.738+0000 7f7a8adff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a840cf940 con 0x7f7a840cbfe0 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a840cc3b0 0x7f7a840cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a840cc3b0 0x7f7a840cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34898/0 (socket says 172.21.15.142:34898) 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 -- 172.21.15.142:0/63843573 learned_addr learned my addr 172.21.15.142:0/63843573 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a88b9b700 1 --2- 172.21.15.142:0/63843573 >> v2:172.21.15.148:3300/0 conn(0x7f7a840cbfe0 0x7f7a8415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 -- 172.21.15.142:0/63843573 >> v2:172.21.15.148:3300/0 conn(0x7f7a840cbfe0 msgr2=0x7f7a8415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 --2- 172.21.15.142:0/63843573 >> v2:172.21.15.148:3300/0 conn(0x7f7a840cbfe0 0x7f7a8415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 -- 172.21.15.142:0/63843573 >> v1:172.21.15.148:6789/0 conn(0x7f7a841573a0 legacy=0x7f7a8415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 -- 172.21.15.142:0/63843573 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a840cfc20 con 0x7f7a840cc3b0 2023-09-30T22:53:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.739+0000 7f7a83fff700 1 --2- 172.21.15.142:0/63843573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cc3b0 0x7f7a840cf210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406cf00 tx=0x7f7a70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b4f4862972ef1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:00.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a837fe700 1 -- 172.21.15.142:0/63843573 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000b860 con 0x7f7a840cc3b0 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a837fe700 1 -- 172.21.15.142:0/63843573 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000b9c0 con 0x7f7a840cc3b0 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a837fe700 1 -- 172.21.15.142:0/63843573 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000bd60 con 0x7f7a840cc3b0 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 -- 172.21.15.142:0/63843573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cc3b0 msgr2=0x7f7a840cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 --2- 172.21.15.142:0/63843573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cc3b0 0x7f7a840cf210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406cf00 tx=0x7f7a70009250 comp rx=0 tx=0).stop 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 -- 172.21.15.142:0/63843573 shutdown_connections 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 --2- 172.21.15.142:0/63843573 >> v2:172.21.15.148:3300/0 conn(0x7f7a840cbfe0 0x7f7a8415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 --2- 172.21.15.142:0/63843573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cc3b0 0x7f7a840cf210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 -- 172.21.15.142:0/63843573 >> 172.21.15.142:0/63843573 conn(0x7f7a840d0a80 msgr2=0x7f7a840d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 -- 172.21.15.142:0/63843573 shutdown_connections 2023-09-30T22:53:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.740+0000 7f7a8adff700 1 -- 172.21.15.142:0/63843573 wait complete. 2023-09-30T22:53:00.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.742+0000 7f7a8adff700 1 Processor -- start 2023-09-30T22:53:00.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.742+0000 7f7a8adff700 1 -- start start 2023-09-30T22:53:00.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a8adff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cbfe0 0x7f7a840c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a8adff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a840cc3b0 0x7f7a840b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a8adff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a841573a0 0x7f7a840c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a8adff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a840c6030 con 0x7f7a840cbfe0 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a8adff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a840c5420 con 0x7f7a840cc3b0 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a8adff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a840c5700 con 0x7f7a841573a0 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a88b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cbfe0 0x7f7a840c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a88b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cbfe0 0x7f7a840c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34902/0 (socket says 172.21.15.142:34902) 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a88b9b700 1 -- 172.21.15.142:0/3798298390 learned_addr learned my addr 172.21.15.142:0/3798298390 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a83fff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a840cc3b0 0x7f7a840b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a88b9b700 1 -- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a841573a0 msgr2=0x7f7a840c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.743+0000 7f7a8939c700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a841573a0 0x7f7a840c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a88b9b700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a841573a0 0x7f7a840c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a88b9b700 1 -- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a840cc3b0 msgr2=0x7f7a840b8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a88b9b700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a840cc3b0 0x7f7a840b8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a88b9b700 1 -- 172.21.15.142:0/3798298390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700094f0 con 0x7f7a840cbfe0 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a83fff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a840cc3b0 0x7f7a840b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a8939c700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a841573a0 0x7f7a840c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a88b9b700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cbfe0 0x7f7a840c9820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800d890 tx=0x7f7a78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a80ff9700 1 -- 172.21.15.142:0/3798298390 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7800b600 con 0x7f7a840cbfe0 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a80ff9700 1 -- 172.21.15.142:0/3798298390 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7800b760 con 0x7f7a840cbfe0 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a80ff9700 1 -- 172.21.15.142:0/3798298390 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7800bae0 con 0x7f7a840cbfe0 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a840c59e0 con 0x7f7a840cbfe0 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.744+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a840c9d60 con 0x7f7a840cbfe0 2023-09-30T22:53:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.745+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a840c6310 con 0x7f7a840cbfe0 2023-09-30T22:53:00.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.746+0000 7f7a80ff9700 1 -- 172.21.15.142:0/3798298390 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7a7801e460 con 0x7f7a840cbfe0 2023-09-30T22:53:00.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.747+0000 7f7a80ff9700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:00.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.747+0000 7f7a80ff9700 1 -- 172.21.15.142:0/3798298390 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a780852f0 con 0x7f7a840cbfe0 2023-09-30T22:53:00.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.747+0000 7f7a83fff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:00.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.748+0000 7f7a83fff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406cf00 tx=0x7f7a70017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:00.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.751+0000 7f7a80ff9700 1 -- 172.21.15.142:0/3798298390 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7a78052150 con 0x7f7a840cbfe0 2023-09-30T22:53:00.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.939+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a840c9f50 con 0x7f7a840cbfe0 2023-09-30T22:53:00.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.940+0000 7f7a80ff9700 1 -- 172.21.15.142:0/3798298390 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a78055770 con 0x7f7a840cbfe0 2023-09-30T22:53:00.942 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:53:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.942+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 msgr2=0x7f7a680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.942+0000 7f7a8adff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406cf00 tx=0x7f7a70017000 comp rx=0 tx=0).stop 2023-09-30T22:53:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.942+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cbfe0 msgr2=0x7f7a840c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.942+0000 7f7a8adff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cbfe0 0x7f7a840c9820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800d890 tx=0x7f7a78008040 comp rx=0 tx=0).stop 2023-09-30T22:53:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 shutdown_connections 2023-09-30T22:53:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a841573a0 0x7f7a840c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a840cbfe0 0x7f7a840c9820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 --2- 172.21.15.142:0/3798298390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a840cc3b0 0x7f7a840b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 >> 172.21.15.142:0/3798298390 conn(0x7f7a840d0a80 msgr2=0x7f7a841567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 shutdown_connections 2023-09-30T22:53:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:00.943+0000 7f7a8adff700 1 -- 172.21.15.142:0/3798298390 wait complete. 2023-09-30T22:53:00.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:01.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.151+0000 7ff9d6dff700 1 Processor -- start 2023-09-30T22:53:01.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.151+0000 7ff9d6dff700 1 -- start start 2023-09-30T22:53:01.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9d6dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 0x7ff9d006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9d6dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015dde0 con 0x7ff9d006d3f0 2023-09-30T22:53:01.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9d6dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015e6e0 con 0x7ff9d015e270 2023-09-30T22:53:01.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9d6dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d006b840 con 0x7ff9d00c6da0 2023-09-30T22:53:01.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9d4b9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff9d006d3f0 0x7ff9d006b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45328/0 (socket says 172.21.15.142:45328) 2023-09-30T22:53:01.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9d4b9b700 1 -- 172.21.15.142:0/2752565767 learned_addr learned my addr 172.21.15.142:0/2752565767 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:01.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9cffff700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 0x7ff9d006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016698593 0 0) 0x7ff9d015dde0 con 0x7ff9d006d3f0 2023-09-30T22:53:01.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.153+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c0003570 con 0x7ff9d006d3f0 2023-09-30T22:53:01.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783359043 0 0) 0x7ff9d015e6e0 con 0x7ff9d015e270 2023-09-30T22:53:01.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d015dde0 con 0x7ff9d015e270 2023-09-30T22:53:01.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482724867 0 0) 0x7ff9c0003570 con 0x7ff9d006d3f0 2023-09-30T22:53:01.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 msgr2=0x7ff9d006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:01.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 0x7ff9d006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 >> v1:172.21.15.148:6789/0 conn(0x7ff9d015e270 legacy=0x7ff9d0159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d015d7d0 con 0x7ff9d006d3f0 2023-09-30T22:53:01.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7ff9c4001470 con 0x7ff9d006d3f0 2023-09-30T22:53:01.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 >> v1:172.21.15.142:6789/0 conn(0x7ff9d006d3f0 legacy=0x7ff9d006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 0x7ff9c0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c0004d50 0x7ff9c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d006b840 con 0x7ff9c0004180 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c000bba0 con 0x7ff9c0004d50 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c000bd60 con 0x7ff9d00c6da0 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9cffff700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9d4b9b700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 0x7ff9c0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.154+0000 7ff9d539c700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c0004d50 0x7ff9c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cffff700 1 -- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 msgr2=0x7ff9c0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cffff700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 0x7ff9c0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cffff700 1 -- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c0004d50 msgr2=0x7ff9c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:01.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cffff700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c0004d50 0x7ff9c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cffff700 1 -- 172.21.15.142:0/2752565767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0003570 con 0x7ff9c0004180 2023-09-30T22:53:01.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9d4b9b700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d00c6da0 0x7ff9c0003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:01.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cffff700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9c0004810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009c00 tx=0x7ff9bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a11bfe97e584f2a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00e710 con 0x7ff9c0004180 2023-09-30T22:53:01.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc00e870 con 0x7ff9c0004180 2023-09-30T22:53:01.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9cf7fe700 1 -- 172.21.15.142:0/2752565767 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00ec30 con 0x7ff9c0004180 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9d6dff700 1 -- 172.21.15.142:0/2752565767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 msgr2=0x7ff9c0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.155+0000 7ff9d6dff700 1 --2- 172.21.15.142:0/2752565767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9c0004810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009c00 tx=0x7ff9bc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.156+0000 7ff9d539c700 1 -- 172.21.15.142:0/2752565767 reap_dead start 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.156+0000 7ff9d6dff700 1 -- 172.21.15.142:0/2752565767 shutdown_connections 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.156+0000 7ff9d6dff700 1 -- 172.21.15.142:0/2752565767 >> 172.21.15.142:0/2752565767 conn(0x7ff9d0067e30 msgr2=0x7ff9d0068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.156+0000 7ff9d6dff700 1 -- 172.21.15.142:0/2752565767 shutdown_connections 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.156+0000 7ff9d6dff700 1 -- 172.21.15.142:0/2752565767 wait complete. 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.157+0000 7ff9d6dff700 1 Processor -- start 2023-09-30T22:53:01.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.157+0000 7ff9d6dff700 1 -- start start 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d6dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9d014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d6dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d014d000 0x7ff9d0151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d6dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d014e510 0x7ff9d0169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d6dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01515a0 con 0x7ff9c0004180 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d6dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d014bff0 con 0x7ff9d014d000 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d6dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d014c240 con 0x7ff9d014e510 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d4b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9d014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.158+0000 7ff9d4b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9d014dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58282/0 (socket says 172.21.15.142:58282) 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d4b9b700 1 -- 172.21.15.142:0/4134754740 learned_addr learned my addr 172.21.15.142:0/4134754740 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:01.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9cffff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d014d000 0x7ff9d0151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d539c700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d014e510 0x7ff9d0169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d4b9b700 1 -- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d014e510 msgr2=0x7ff9d0169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d4b9b700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d014e510 0x7ff9d0169a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d4b9b700 1 -- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d014d000 msgr2=0x7ff9d0151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d4b9b700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d014d000 0x7ff9d0151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d4b9b700 1 -- 172.21.15.142:0/4134754740 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d014c520 con 0x7ff9c0004180 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d4b9b700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9d014dc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40010e0 tx=0x7ff9d015d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9ccff9700 1 -- 172.21.15.142:0/4134754740 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400c5a0 con 0x7ff9c0004180 2023-09-30T22:53:01.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9ccff9700 1 -- 172.21.15.142:0/4134754740 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c400c700 con 0x7ff9c0004180 2023-09-30T22:53:01.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d014c800 con 0x7ff9c0004180 2023-09-30T22:53:01.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.159+0000 7ff9ccff9700 1 -- 172.21.15.142:0/4134754740 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400caa0 con 0x7ff9c0004180 2023-09-30T22:53:01.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.160+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d014e990 con 0x7ff9c0004180 2023-09-30T22:53:01.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.161+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0069420 con 0x7ff9c0004180 2023-09-30T22:53:01.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.161+0000 7ff9ccff9700 1 -- 172.21.15.142:0/4134754740 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff9c401d460 con 0x7ff9c0004180 2023-09-30T22:53:01.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.162+0000 7ff9ccff9700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff9b4067330 0x7ff9b40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.162+0000 7ff9ccff9700 1 -- 172.21.15.142:0/4134754740 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff9c4084b80 con 0x7ff9c0004180 2023-09-30T22:53:01.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.163+0000 7ff9cffff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff9b4067330 0x7ff9b40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.163+0000 7ff9cffff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff9b4067330 0x7ff9b40697e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0091e0 tx=0x7ff9bc01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.166+0000 7ff9ccff9700 1 -- 172.21.15.142:0/4134754740 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff9c4051a80 con 0x7ff9c0004180 2023-09-30T22:53:01.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.358+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9d00c7230 con 0x7ff9c0004180 2023-09-30T22:53:01.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.359+0000 7ff9ccff9700 1 -- 172.21.15.142:0/4134754740 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7ff9c40550a0 con 0x7ff9c0004180 2023-09-30T22:53:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:01.361 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:01.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.361+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff9b4067330 msgr2=0x7ff9b40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.361+0000 7ff9d6dff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff9b4067330 0x7ff9b40697e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0091e0 tx=0x7ff9bc01a000 comp rx=0 tx=0).stop 2023-09-30T22:53:01.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.361+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 msgr2=0x7ff9d014dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.361+0000 7ff9d6dff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9d014dc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40010e0 tx=0x7ff9d015d960 comp rx=0 tx=0).stop 2023-09-30T22:53:01.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 shutdown_connections 2023-09-30T22:53:01.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff9b4067330 0x7ff9b40697e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d014e510 0x7ff9d0169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9c0004180 0x7ff9d014dc80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 --2- 172.21.15.142:0/4134754740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d014d000 0x7ff9d0151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 >> 172.21.15.142:0/4134754740 conn(0x7ff9d0067e30 msgr2=0x7ff9d0069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:01.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 shutdown_connections 2023-09-30T22:53:01.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.362+0000 7ff9d6dff700 1 -- 172.21.15.142:0/4134754740 wait complete. 2023-09-30T22:53:01.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:52:27.833414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:52:28.438662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:53:01.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:53:01.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.573+0000 7fb27e5ff700 1 Processor -- start 2023-09-30T22:53:01.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.573+0000 7fb27e5ff700 1 -- start start 2023-09-30T22:53:01.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb27e5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2780cbfe0 0x7fb27815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb27e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278157ab0 0x7fb2780cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb27e5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2780d0550 con 0x7fb2780cc3b0 2023-09-30T22:53:01.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb27e5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2780cf750 con 0x7fb2780cbfe0 2023-09-30T22:53:01.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb27e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780cf940 con 0x7fb278157ab0 2023-09-30T22:53:01.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb277fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2780cbfe0 0x7fb27815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb2777fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb2780cc3b0 0x7fb2781573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45340/0 (socket says 172.21.15.142:45340) 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb2777fe700 1 -- 172.21.15.142:0/1528934141 learned_addr learned my addr 172.21.15.142:0/1528934141 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb27cb9c700 1 --2- 172.21.15.142:0/1528934141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278157ab0 0x7fb2780cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb277fff700 1 -- 172.21.15.142:0/1528934141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278157ab0 msgr2=0x7fb2780cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb276ffd700 1 -- 172.21.15.142:0/1528934141 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712069749 0 0) 0x7fb2780d0550 con 0x7fb2780cc3b0 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb277fff700 1 --2- 172.21.15.142:0/1528934141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278157ab0 0x7fb2780cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb277fff700 1 -- 172.21.15.142:0/1528934141 >> v1:172.21.15.142:6789/0 conn(0x7fb2780cc3b0 legacy=0x7fb2781573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb277fff700 1 -- 172.21.15.142:0/1528934141 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2780cfc20 con 0x7fb2780cbfe0 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.575+0000 7fb27cb9c700 1 --2- 172.21.15.142:0/1528934141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278157ab0 0x7fb2780cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:01.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb277fff700 1 --2- 172.21.15.142:0/1528934141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cbfe0 0x7fb27815a2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb2680098e0 tx=0x7fb2680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e188d8be387b9a66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb276ffd700 1 -- 172.21.15.142:0/1528934141 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268009e80 con 0x7fb2780cbfe0 2023-09-30T22:53:01.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb276ffd700 1 -- 172.21.15.142:0/1528934141 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26800b860 con 0x7fb2780cbfe0 2023-09-30T22:53:01.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb276ffd700 1 -- 172.21.15.142:0/1528934141 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800bbe0 con 0x7fb2780cbfe0 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1528934141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cbfe0 msgr2=0x7fb27815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1528934141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cbfe0 0x7fb27815a2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb2680098e0 tx=0x7fb2680091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1528934141 shutdown_connections 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1528934141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cbfe0 0x7fb27815a2a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1528934141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278157ab0 0x7fb2780cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.576+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1528934141 >> 172.21.15.142:0/1528934141 conn(0x7fb2780d0a80 msgr2=0x7fb2780d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.577+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1528934141 shutdown_connections 2023-09-30T22:53:01.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.577+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1528934141 wait complete. 2023-09-30T22:53:01.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.578+0000 7fb27e5ff700 1 Processor -- start 2023-09-30T22:53:01.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.578+0000 7fb27e5ff700 1 -- start start 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb27e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2780cbfe0 0x7fb27816ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb27e5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cc3b0 0x7fb278147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb27e5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278157ab0 0x7fb27815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb27e5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780c5cc0 con 0x7fb2780cc3b0 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb27e5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27816b380 con 0x7fb278157ab0 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb27e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780c77a0 con 0x7fb2780cbfe0 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb2777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cc3b0 0x7fb278147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb2777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cc3b0 0x7fb278147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58298/0 (socket says 172.21.15.142:58298) 2023-09-30T22:53:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb2777fe700 1 -- 172.21.15.142:0/1485327322 learned_addr learned my addr 172.21.15.142:0/1485327322 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:01.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb27cb9c700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278157ab0 0x7fb27815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.579+0000 7fb277fff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2780cbfe0 0x7fb27816ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb2777fe700 1 -- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2780cbfe0 msgr2=0x7fb27816ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb2777fe700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2780cbfe0 0x7fb27816ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb2777fe700 1 -- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278157ab0 msgr2=0x7fb27815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb2777fe700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278157ab0 0x7fb27815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb2777fe700 1 -- 172.21.15.142:0/1485327322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268009420 con 0x7fb2780cc3b0 2023-09-30T22:53:01.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb2777fe700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cc3b0 0x7fb278147480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c7e0 tx=0x7fb26c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb25ffff700 1 -- 172.21.15.142:0/1485327322 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c005b30 con 0x7fb2780cc3b0 2023-09-30T22:53:01.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb25ffff700 1 -- 172.21.15.142:0/1485327322 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c005c90 con 0x7fb2780cc3b0 2023-09-30T22:53:01.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2780c5000 con 0x7fb2780cc3b0 2023-09-30T22:53:01.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb25ffff700 1 -- 172.21.15.142:0/1485327322 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c007300 con 0x7fb2780cc3b0 2023-09-30T22:53:01.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.580+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2780c5950 con 0x7fb2780cc3b0 2023-09-30T22:53:01.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.581+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2780cb580 con 0x7fb2780cc3b0 2023-09-30T22:53:01.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.582+0000 7fb25ffff700 1 -- 172.21.15.142:0/1485327322 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb26c01b400 con 0x7fb2780cc3b0 2023-09-30T22:53:01.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.583+0000 7fb25ffff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb264067330 0x7fb2640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.583+0000 7fb25ffff700 1 -- 172.21.15.142:0/1485327322 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb26c084710 con 0x7fb2780cc3b0 2023-09-30T22:53:01.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.583+0000 7fb277fff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb264067330 0x7fb2640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.584+0000 7fb277fff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb264067330 0x7fb2640697e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb2680091e0 tx=0x7fb268017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.587+0000 7fb25ffff700 1 -- 172.21.15.142:0/1485327322 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb26c051690 con 0x7fb2780cc3b0 2023-09-30T22:53:01.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.773+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2780c5e00 con 0x7fb2780cc3b0 2023-09-30T22:53:01.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.774+0000 7fb25ffff700 1 -- 172.21.15.142:0/1485327322 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb26c054cb0 con 0x7fb2780cc3b0 2023-09-30T22:53:01.775 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:53:01.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb264067330 msgr2=0x7fb2640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb264067330 0x7fb2640697e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb2680091e0 tx=0x7fb268017000 comp rx=0 tx=0).stop 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cc3b0 msgr2=0x7fb278147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cc3b0 0x7fb278147480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c7e0 tx=0x7fb26c007df0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 shutdown_connections 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb264067330 0x7fb2640697e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278157ab0 0x7fb27815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb2780cbfe0 0x7fb27816ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 --2- 172.21.15.142:0/1485327322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2780cc3b0 0x7fb278147480 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 >> 172.21.15.142:0/1485327322 conn(0x7fb2780d0a80 msgr2=0x7fb278156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 shutdown_connections 2023-09-30T22:53:01.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.776+0000 7fb27e5ff700 1 -- 172.21.15.142:0/1485327322 wait complete. 2023-09-30T22:53:01.795 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:53:01.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.987+0000 7f8c865ff700 1 Processor -- start 2023-09-30T22:53:01.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.987+0000 7f8c865ff700 1 -- start start 2023-09-30T22:53:01.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.988+0000 7f8c865ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c800cbfe0 0x7f8c8015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.988+0000 7f8c865ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c80157ab0 0x7f8c800cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.988+0000 7f8c865ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c800d0550 con 0x7f8c800cc3b0 2023-09-30T22:53:01.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.988+0000 7f8c865ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c800cf750 con 0x7f8c800cbfe0 2023-09-30T22:53:01.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.988+0000 7f8c865ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800cf940 con 0x7f8c80157ab0 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c7ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c800cbfe0 0x7f8c8015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c7f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8c800cc3b0 0x7f8c801573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:55710/0 (socket says 172.21.15.142:55710) 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c7f7fe700 1 -- 172.21.15.142:0/1074572663 learned_addr learned my addr 172.21.15.142:0/1074572663 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c84b9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c80157ab0 0x7f8c800cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c84b9c700 1 -- 172.21.15.142:0/1074572663 >> v2:172.21.15.148:3300/0 conn(0x7f8c800cbfe0 msgr2=0x7f8c8015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c84b9c700 1 --2- 172.21.15.142:0/1074572663 >> v2:172.21.15.148:3300/0 conn(0x7f8c800cbfe0 0x7f8c8015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c84b9c700 1 -- 172.21.15.142:0/1074572663 >> v1:172.21.15.148:6789/0 conn(0x7f8c800cc3b0 legacy=0x7f8c801573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c84b9c700 1 -- 172.21.15.142:0/1074572663 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c800cfc20 con 0x7f8c80157ab0 2023-09-30T22:53:01.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.989+0000 7f8c7ffff700 1 --2- 172.21.15.142:0/1074572663 >> v2:172.21.15.148:3300/0 conn(0x7f8c800cbfe0 0x7f8c8015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:01.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c84b9c700 1 --2- 172.21.15.142:0/1074572663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c80157ab0 0x7f8c800cf210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009e60 tx=0x7f8c78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a5a9af7dbaa1b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c7effd700 1 -- 172.21.15.142:0/1074572663 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800e070 con 0x7f8c80157ab0 2023-09-30T22:53:01.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c7effd700 1 -- 172.21.15.142:0/1074572663 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7800bb60 con 0x7f8c80157ab0 2023-09-30T22:53:01.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c7effd700 1 -- 172.21.15.142:0/1074572663 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78012430 con 0x7f8c80157ab0 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c865ff700 1 -- 172.21.15.142:0/1074572663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c80157ab0 msgr2=0x7f8c800cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1074572663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c80157ab0 0x7f8c800cf210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009e60 tx=0x7f8c78009780 comp rx=0 tx=0).stop 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c865ff700 1 -- 172.21.15.142:0/1074572663 shutdown_connections 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1074572663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c80157ab0 0x7f8c800cf210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1074572663 >> v2:172.21.15.148:3300/0 conn(0x7f8c800cbfe0 0x7f8c8015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.990+0000 7f8c865ff700 1 -- 172.21.15.142:0/1074572663 >> 172.21.15.142:0/1074572663 conn(0x7f8c800d0a80 msgr2=0x7f8c800d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.991+0000 7f8c865ff700 1 -- 172.21.15.142:0/1074572663 shutdown_connections 2023-09-30T22:53:01.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.991+0000 7f8c865ff700 1 -- 172.21.15.142:0/1074572663 wait complete. 2023-09-30T22:53:01.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.992+0000 7f8c865ff700 1 Processor -- start 2023-09-30T22:53:01.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.992+0000 7f8c865ff700 1 -- start start 2023-09-30T22:53:01.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c865ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800cbfe0 0x7f8c800c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c865ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800cc3b0 0x7f8c8014a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c865ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c80157ab0 0x7f8c800c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:01.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c865ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800c4be0 con 0x7f8c80157ab0 2023-09-30T22:53:01.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c865ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800c5030 con 0x7f8c800cc3b0 2023-09-30T22:53:01.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c865ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800c5310 con 0x7f8c800cbfe0 2023-09-30T22:53:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c7ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800cbfe0 0x7f8c800c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c84b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c80157ab0 0x7f8c800c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c7ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800cbfe0 0x7f8c800c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:50742/0 (socket says 172.21.15.142:50742) 2023-09-30T22:53:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c7ffff700 1 -- 172.21.15.142:0/1486137378 learned_addr learned my addr 172.21.15.142:0/1486137378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.994+0000 7f8c7f7fe700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800cc3b0 0x7f8c8014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c84b9c700 1 -- 172.21.15.142:0/1486137378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800cbfe0 msgr2=0x7f8c800c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c84b9c700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800cbfe0 0x7f8c800c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c84b9c700 1 -- 172.21.15.142:0/1486137378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800cc3b0 msgr2=0x7f8c8014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c84b9c700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800cc3b0 0x7f8c8014a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c84b9c700 1 -- 172.21.15.142:0/1486137378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70009420 con 0x7f8c80157ab0 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c84b9c700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c80157ab0 0x7f8c800c5df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c78016000 tx=0x7f8c78019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c67fff700 1 -- 172.21.15.142:0/1486137378 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78012ea0 con 0x7f8c80157ab0 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c67fff700 1 -- 172.21.15.142:0/1486137378 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c78027470 con 0x7f8c80157ab0 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c78009a20 con 0x7f8c80157ab0 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.995+0000 7f8c67fff700 1 -- 172.21.15.142:0/1486137378 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78027850 con 0x7f8c80157ab0 2023-09-30T22:53:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.996+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c800c58d0 con 0x7f8c80157ab0 2023-09-30T22:53:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.997+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c80069770 con 0x7f8c80157ab0 2023-09-30T22:53:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.998+0000 7f8c67fff700 1 -- 172.21.15.142:0/1486137378 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8c78024070 con 0x7f8c80157ab0 2023-09-30T22:53:02.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.999+0000 7f8c67fff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c6c067330 0x7f8c6c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.999+0000 7f8c67fff700 1 -- 172.21.15.142:0/1486137378 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c780871f0 con 0x7f8c80157ab0 2023-09-30T22:53:02.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:01.999+0000 7f8c7ffff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c6c067330 0x7f8c6c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.000+0000 7f8c7ffff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c6c067330 0x7f8c6c0697e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c70011310 tx=0x7f8c700091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:02.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.004+0000 7f8c67fff700 1 -- 172.21.15.142:0/1486137378 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8c78054050 con 0x7f8c80157ab0 2023-09-30T22:53:02.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.194+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c8006fc10 con 0x7f8c80157ab0 2023-09-30T22:53:02.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.195+0000 7f8c67fff700 1 -- 172.21.15.142:0/1486137378 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c78057670 con 0x7f8c80157ab0 2023-09-30T22:53:02.196 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c6c067330 msgr2=0x7f8c6c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c6c067330 0x7f8c6c0697e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c70011310 tx=0x7f8c700091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c80157ab0 msgr2=0x7f8c800c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c80157ab0 0x7f8c800c5df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c78016000 tx=0x7f8c78019000 comp rx=0 tx=0).stop 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 shutdown_connections 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c6c067330 0x7f8c6c0697e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c80157ab0 0x7f8c800c5df0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800cbfe0 0x7f8c800c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 --2- 172.21.15.142:0/1486137378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800cc3b0 0x7f8c8014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 >> 172.21.15.142:0/1486137378 conn(0x7f8c800d0a80 msgr2=0x7f8c80156650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:02.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 shutdown_connections 2023-09-30T22:53:02.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.197+0000 7f8c865ff700 1 -- 172.21.15.142:0/1486137378 wait complete. 2023-09-30T22:53:02.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:53:02.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.407+0000 7f68f77ff700 1 Processor -- start 2023-09-30T22:53:02.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.407+0000 7f68f77ff700 1 -- start start 2023-09-30T22:53:02.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.408+0000 7f68f77ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f68f0159f10 0x7f68f006a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.408+0000 7f68f77ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f006b650 con 0x7f68f0067620 2023-09-30T22:53:02.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.408+0000 7f68f77ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f006aa40 con 0x7f68f0159b40 2023-09-30T22:53:02.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.408+0000 7f68f77ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f006ad20 con 0x7f68f0159f10 2023-09-30T22:53:02.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.408+0000 7f68f5d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f68f0067620 0x7f68f0067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45342/0 (socket says 172.21.15.142:45342) 2023-09-30T22:53:02.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.408+0000 7f68f5d9c700 1 -- 172.21.15.142:0/4175107180 learned_addr learned my addr 172.21.15.142:0/4175107180 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:02.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.409+0000 7f68f4d9a700 1 --2- 172.21.15.142:0/4175107180 >> v2:172.21.15.148:3300/0 conn(0x7f68f0159f10 0x7f68f006a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.409+0000 7f68f4d9a700 1 -- 172.21.15.142:0/4175107180 >> v1:172.21.15.148:6789/0 conn(0x7f68f0159b40 legacy=0x7f68f00683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.409+0000 7f68f4d9a700 1 -- 172.21.15.142:0/4175107180 >> v1:172.21.15.142:6789/0 conn(0x7f68f0067620 legacy=0x7f68f0067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.409+0000 7f68f4d9a700 1 -- 172.21.15.142:0/4175107180 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f006b000 con 0x7f68f0159f10 2023-09-30T22:53:02.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.409+0000 7f68f4d9a700 1 --2- 172.21.15.142:0/4175107180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 0x7f68f006a360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098e0 tx=0x7f68e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5f702f40012726 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:02.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.411+0000 7f68e7fff700 1 -- 172.21.15.142:0/4175107180 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0009e80 con 0x7f68f0159f10 2023-09-30T22:53:02.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.411+0000 7f68e7fff700 1 -- 172.21.15.142:0/4175107180 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e000b860 con 0x7f68f0159f10 2023-09-30T22:53:02.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.411+0000 7f68e7fff700 1 -- 172.21.15.142:0/4175107180 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e000bbe0 con 0x7f68f0159f10 2023-09-30T22:53:02.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.412+0000 7f68f77ff700 1 -- 172.21.15.142:0/4175107180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 msgr2=0x7f68f006a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.412+0000 7f68f77ff700 1 --2- 172.21.15.142:0/4175107180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 0x7f68f006a360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098e0 tx=0x7f68e00091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.412+0000 7f68f77ff700 1 -- 172.21.15.142:0/4175107180 shutdown_connections 2023-09-30T22:53:02.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.412+0000 7f68f77ff700 1 --2- 172.21.15.142:0/4175107180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 0x7f68f006a360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.412+0000 7f68f77ff700 1 -- 172.21.15.142:0/4175107180 >> 172.21.15.142:0/4175107180 conn(0x7f68f00c9950 msgr2=0x7f68f00c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:02.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.412+0000 7f68f77ff700 1 -- 172.21.15.142:0/4175107180 shutdown_connections 2023-09-30T22:53:02.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.412+0000 7f68f77ff700 1 -- 172.21.15.142:0/4175107180 wait complete. 2023-09-30T22:53:02.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.413+0000 7f68f77ff700 1 Processor -- start 2023-09-30T22:53:02.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.413+0000 7f68f77ff700 1 -- start start 2023-09-30T22:53:02.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.414+0000 7f68f77ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f0067620 0x7f68f015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.414+0000 7f68f77ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f0159b40 0x7f68f00c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.414+0000 7f68f77ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 0x7f68f016a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.414+0000 7f68f77ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f015b9a0 con 0x7f68f0159b40 2023-09-30T22:53:02.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.414+0000 7f68f77ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00affb0 con 0x7f68f0159f10 2023-09-30T22:53:02.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.414+0000 7f68f77ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f015cbf0 con 0x7f68f0067620 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f0159b40 0x7f68f00c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f0159b40 0x7f68f00c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58308/0 (socket says 172.21.15.142:58308) 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 -- 172.21.15.142:0/1451442595 learned_addr learned my addr 172.21.15.142:0/1451442595 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f5d9c700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 0x7f68f016a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f559b700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f0067620 0x7f68f015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 -- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f0067620 msgr2=0x7f68f015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f0067620 0x7f68f015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 -- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 msgr2=0x7f68f016a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 0x7f68f016a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 -- 172.21.15.142:0/1451442595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009420 con 0x7f68f0159b40 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.415+0000 7f68f4d9a700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f0159b40 0x7f68f00c51d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f68e000b3c0 tx=0x7f68e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:02.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.416+0000 7f68e57fa700 1 -- 172.21.15.142:0/1451442595 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e000b9d0 con 0x7f68f0159b40 2023-09-30T22:53:02.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.416+0000 7f68e57fa700 1 -- 172.21.15.142:0/1451442595 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e000bb30 con 0x7f68f0159b40 2023-09-30T22:53:02.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.416+0000 7f68e57fa700 1 -- 172.21.15.142:0/1451442595 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0025650 con 0x7f68f0159b40 2023-09-30T22:53:02.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.416+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f015b5d0 con 0x7f68f0159b40 2023-09-30T22:53:02.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.416+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f015d120 con 0x7f68f0159b40 2023-09-30T22:53:02.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.417+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f015bae0 con 0x7f68f0159b40 2023-09-30T22:53:02.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.418+0000 7f68e57fa700 1 -- 172.21.15.142:0/1451442595 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f68e0023070 con 0x7f68f0159b40 2023-09-30T22:53:02.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.418+0000 7f68e57fa700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d4067330 0x7f68d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.418+0000 7f68e57fa700 1 -- 172.21.15.142:0/1451442595 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f68e0086090 con 0x7f68f0159b40 2023-09-30T22:53:02.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.419+0000 7f68f559b700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d4067330 0x7f68d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.419+0000 7f68f559b700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d4067330 0x7f68d40697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f68ec003a80 tx=0x7f68ec007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:02.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.423+0000 7f68e57fa700 1 -- 172.21.15.142:0/1451442595 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f68f015bae0 con 0x7f68f0159b40 2023-09-30T22:53:02.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.614+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68f015bae0 con 0x7f68f0159b40 2023-09-30T22:53:02.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.615+0000 7f68e57fa700 1 -- 172.21.15.142:0/1451442595 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68f015bae0 con 0x7f68f0159b40 2023-09-30T22:53:02.616 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d4067330 msgr2=0x7f68d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d4067330 0x7f68d40697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f68ec003a80 tx=0x7f68ec007ec0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f0159b40 msgr2=0x7f68f00c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f0159b40 0x7f68f00c51d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f68e000b3c0 tx=0x7f68e0017000 comp rx=0 tx=0).stop 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 shutdown_connections 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d4067330 0x7f68d40697e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f0159f10 0x7f68f016a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f0067620 0x7f68f015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 --2- 172.21.15.142:0/1451442595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f0159b40 0x7f68f00c51d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 >> 172.21.15.142:0/1451442595 conn(0x7f68f00c9950 msgr2=0x7f68f00cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:02.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 shutdown_connections 2023-09-30T22:53:02.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.617+0000 7f68f77ff700 1 -- 172.21.15.142:0/1451442595 wait complete. 2023-09-30T22:53:02.637 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:53:02.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.826+0000 7fe54e5ff700 1 Processor -- start 2023-09-30T22:53:02.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.827+0000 7fe54e5ff700 1 -- start start 2023-09-30T22:53:02.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.828+0000 7fe54e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 0x7fe5481580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.828+0000 7fe54e5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480c38d0 con 0x7fe548141150 2023-09-30T22:53:02.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.828+0000 7fe54e5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480c6aa0 con 0x7fe5480c40e0 2023-09-30T22:53:02.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.828+0000 7fe54e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54806a040 con 0x7fe5480c6270 2023-09-30T22:53:02.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.828+0000 7fe547fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe548141150 0x7fe54815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45344/0 (socket says 172.21.15.142:45344) 2023-09-30T22:53:02.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.828+0000 7fe547fff700 1 -- 172.21.15.142:0/850578057 learned_addr learned my addr 172.21.15.142:0/850578057 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:02.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe5477fe700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 0x7fe5481580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760497630 0 0) 0x7fe5480c38d0 con 0x7fe548141150 2023-09-30T22:53:02.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe530003570 con 0x7fe548141150 2023-09-30T22:53:02.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2523701065 0 0) 0x7fe530003570 con 0x7fe548141150 2023-09-30T22:53:02.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 msgr2=0x7fe5481580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:02.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 0x7fe5481580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 >> v1:172.21.15.148:6789/0 conn(0x7fe5480c40e0 legacy=0x7fe54806aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480c67c0 con 0x7fe548141150 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fe538001470 con 0x7fe548141150 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 >> v1:172.21.15.142:6789/0 conn(0x7fe548141150 legacy=0x7fe54815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530003a90 0x7fe530003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 0x7fe530004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530004d50 0x7fe5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54806a040 con 0x7fe530004d50 2023-09-30T22:53:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53000bb40 con 0x7fe530003a90 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53000bd00 con 0x7fe5480c6270 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.829+0000 7fe54cb9c700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530004d50 0x7fe5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe5477fe700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 0x7fe530004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe547fff700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530003a90 0x7fe530003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe54cb9c700 1 -- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 msgr2=0x7fe530004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe54cb9c700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480c6270 0x7fe530004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe54cb9c700 1 -- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530003a90 msgr2=0x7fe530003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe54cb9c700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530003a90 0x7fe530003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe54cb9c700 1 -- 172.21.15.142:0/850578057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530003570 con 0x7fe530004d50 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe547fff700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530003a90 0x7fe530003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe54cb9c700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530004d50 0x7fe5300051c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe540002170 tx=0x7fe5400017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414befc1bba49c02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540001ae0 con 0x7fe530004d50 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54000c940 con 0x7fe530004d50 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.830+0000 7fe546ffd700 1 -- 172.21.15.142:0/850578057 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000cce0 con 0x7fe530004d50 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.831+0000 7fe54e5ff700 1 -- 172.21.15.142:0/850578057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530004d50 msgr2=0x7fe5300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.831+0000 7fe54e5ff700 1 --2- 172.21.15.142:0/850578057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530004d50 0x7fe5300051c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe540002170 tx=0x7fe5400017d0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.831+0000 7fe54cb9c700 1 -- 172.21.15.142:0/850578057 reap_dead start 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.831+0000 7fe54e5ff700 1 -- 172.21.15.142:0/850578057 shutdown_connections 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.831+0000 7fe54e5ff700 1 -- 172.21.15.142:0/850578057 >> 172.21.15.142:0/850578057 conn(0x7fe5480cc670 msgr2=0x7fe5480cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:02.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.831+0000 7fe54e5ff700 1 -- 172.21.15.142:0/850578057 shutdown_connections 2023-09-30T22:53:02.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.831+0000 7fe54e5ff700 1 -- 172.21.15.142:0/850578057 wait complete. 2023-09-30T22:53:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.832+0000 7fe54e5ff700 1 Processor -- start 2023-09-30T22:53:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.833+0000 7fe54e5ff700 1 -- start start 2023-09-30T22:53:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.833+0000 7fe54e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480b6740 0x7fe548169260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.833+0000 7fe54e5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe548157860 0x7fe54806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.833+0000 7fe54e5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5480b5bb0 0x7fe54806d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.833+0000 7fe54e5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5481697a0 con 0x7fe5480b5bb0 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.833+0000 7fe54e5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54816bdc0 con 0x7fe548157860 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.833+0000 7fe54e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54816c010 con 0x7fe5480b6740 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5480b5bb0 0x7fe54806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5480b5bb0 0x7fe54806d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58326/0 (socket says 172.21.15.142:58326) 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 -- 172.21.15.142:0/3220907213 learned_addr learned my addr 172.21.15.142:0/3220907213 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 -- 172.21.15.142:0/3220907213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480b6740 msgr2=0x7fe548169260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480b6740 0x7fe548169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 -- 172.21.15.142:0/3220907213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe548157860 msgr2=0x7fe54806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe548157860 0x7fe54806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 -- 172.21.15.142:0/3220907213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54816c2f0 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe54cb9c700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5480b5bb0 0x7fe54806d650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe53000bb10 tx=0x7fe540016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe52ffff700 1 -- 172.21.15.142:0/3220907213 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540001ae0 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.834+0000 7fe52ffff700 1 -- 172.21.15.142:0/3220907213 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540021070 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.835+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54816c5d0 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.835+0000 7fe52ffff700 1 -- 172.21.15.142:0/3220907213 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540006df0 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.835+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54816cb90 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.836+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe548069a50 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.836+0000 7fe52ffff700 1 -- 172.21.15.142:0/3220907213 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe540023070 con 0x7fe5480b5bb0 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.837+0000 7fe52ffff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe534067330 0x7fe5340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.837+0000 7fe52ffff700 1 -- 172.21.15.142:0/3220907213 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5400865b0 con 0x7fe5480b5bb0 2023-09-30T22:53:02.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.838+0000 7fe547fff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe534067330 0x7fe5340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:02.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.838+0000 7fe547fff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe534067330 0x7fe5340697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe538004890 tx=0x7fe538001b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:02.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:02.842+0000 7fe52ffff700 1 -- 172.21.15.142:0/3220907213 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe5400534b0 con 0x7fe5480b5bb0 2023-09-30T22:53:03.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.030+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe54806fc10 con 0x7fe5480b5bb0 2023-09-30T22:53:03.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.030+0000 7fe52ffff700 1 -- 172.21.15.142:0/3220907213 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe540056ad0 con 0x7fe5480b5bb0 2023-09-30T22:53:03.031 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:53:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe534067330 msgr2=0x7fe5340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe534067330 0x7fe5340697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe538004890 tx=0x7fe538001b10 comp rx=0 tx=0).stop 2023-09-30T22:53:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5480b5bb0 msgr2=0x7fe54806d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5480b5bb0 0x7fe54806d650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe53000bb10 tx=0x7fe540016000 comp rx=0 tx=0).stop 2023-09-30T22:53:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 shutdown_connections 2023-09-30T22:53:03.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe534067330 0x7fe5340697e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5480b5bb0 0x7fe54806d650 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5480b6740 0x7fe548169260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 --2- 172.21.15.142:0/3220907213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe548157860 0x7fe54806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 >> 172.21.15.142:0/3220907213 conn(0x7fe5480cc670 msgr2=0x7fe54813f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:03.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.032+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 shutdown_connections 2023-09-30T22:53:03.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.033+0000 7fe54e5ff700 1 -- 172.21.15.142:0/3220907213 wait complete. 2023-09-30T22:53:03.052 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:03.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.238+0000 7f6a769ff700 1 Processor -- start 2023-09-30T22:53:03.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.238+0000 7f6a769ff700 1 -- start start 2023-09-30T22:53:03.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a769ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a7006d3f0 0x7f6a7006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a769ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a7015e270 0x7f6a70159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a769ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7015dde0 con 0x7f6a700c6da0 2023-09-30T22:53:03.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a769ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7015e710 con 0x7f6a7015e270 2023-09-30T22:53:03.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a769ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7006b840 con 0x7f6a7006d3f0 2023-09-30T22:53:03.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a74f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a7015e270 0x7f6a70159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a74f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a7015e270 0x7f6a70159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58342/0 (socket says 172.21.15.142:58342) 2023-09-30T22:53:03.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a74f9c700 1 -- 172.21.15.142:0/201589740 learned_addr learned my addr 172.21.15.142:0/201589740 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:03.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.240+0000 7f6a6ffff700 1 --2- 172.21.15.142:0/201589740 >> v2:172.21.15.148:3300/0 conn(0x7f6a7006d3f0 0x7f6a7006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a74f9c700 1 -- 172.21.15.142:0/201589740 >> v2:172.21.15.148:3300/0 conn(0x7f6a7006d3f0 msgr2=0x7f6a7006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:03.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a74f9c700 1 --2- 172.21.15.142:0/201589740 >> v2:172.21.15.148:3300/0 conn(0x7f6a7006d3f0 0x7f6a7006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a74f9c700 1 -- 172.21.15.142:0/201589740 >> v1:172.21.15.148:6789/0 conn(0x7f6a700c6da0 legacy=0x7f6a7006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a74f9c700 1 -- 172.21.15.142:0/201589740 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7015d7d0 con 0x7f6a7015e270 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a74f9c700 1 --2- 172.21.15.142:0/201589740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7015e270 0x7f6a70159550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009f20 tx=0x7f6a68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf6e6390d317ba7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a6effd700 1 -- 172.21.15.142:0/201589740 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800e070 con 0x7f6a7015e270 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a6effd700 1 -- 172.21.15.142:0/201589740 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800ba40 con 0x7f6a7015e270 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.241+0000 7f6a6effd700 1 -- 172.21.15.142:0/201589740 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a680092e0 con 0x7f6a7015e270 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 -- 172.21.15.142:0/201589740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7015e270 msgr2=0x7f6a70159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 --2- 172.21.15.142:0/201589740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7015e270 0x7f6a70159550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009f20 tx=0x7f6a68009840 comp rx=0 tx=0).stop 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 -- 172.21.15.142:0/201589740 shutdown_connections 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 --2- 172.21.15.142:0/201589740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a7015e270 0x7f6a70159550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 --2- 172.21.15.142:0/201589740 >> v2:172.21.15.148:3300/0 conn(0x7f6a7006d3f0 0x7f6a7006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 -- 172.21.15.142:0/201589740 >> 172.21.15.142:0/201589740 conn(0x7f6a70067e30 msgr2=0x7f6a70068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:03.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 -- 172.21.15.142:0/201589740 shutdown_connections 2023-09-30T22:53:03.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.242+0000 7f6a769ff700 1 -- 172.21.15.142:0/201589740 wait complete. 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.243+0000 7f6a769ff700 1 Processor -- start 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.243+0000 7f6a769ff700 1 -- start start 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.244+0000 7f6a769ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7006d3f0 0x7f6a700cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.244+0000 7f6a769ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a700c6da0 0x7f6a70143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.244+0000 7f6a769ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7015e270 0x7f6a700cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.244+0000 7f6a769ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7016b740 con 0x7f6a700c6da0 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.244+0000 7f6a769ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7016ba20 con 0x7f6a7006d3f0 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.244+0000 7f6a769ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7016bd00 con 0x7f6a7015e270 2023-09-30T22:53:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a700c6da0 0x7f6a70143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a700c6da0 0x7f6a70143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58350/0 (socket says 172.21.15.142:58350) 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 -- 172.21.15.142:0/1333681391 learned_addr learned my addr 172.21.15.142:0/1333681391 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6ffff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7006d3f0 0x7f6a700cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a74f9c700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7015e270 0x7f6a700cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 -- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7015e270 msgr2=0x7f6a700cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7015e270 0x7f6a700cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 -- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7006d3f0 msgr2=0x7f6a700cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7006d3f0 0x7f6a700cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 -- 172.21.15.142:0/1333681391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009ae0 con 0x7f6a700c6da0 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a74f9c700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7015e270 0x7f6a700cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6ffff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7006d3f0 0x7f6a700cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:03.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.245+0000 7f6a6f7fe700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a700c6da0 0x7f6a70143c70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c590 tx=0x7f6a6400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:03.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.246+0000 7f6a57fff700 1 -- 172.21.15.142:0/1333681391 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64011590 con 0x7f6a700c6da0 2023-09-30T22:53:03.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.246+0000 7f6a57fff700 1 -- 172.21.15.142:0/1333681391 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640116f0 con 0x7f6a700c6da0 2023-09-30T22:53:03.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.246+0000 7f6a57fff700 1 -- 172.21.15.142:0/1333681391 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64011ab0 con 0x7f6a700c6da0 2023-09-30T22:53:03.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.246+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7016bfe0 con 0x7f6a700c6da0 2023-09-30T22:53:03.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.246+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a701441b0 con 0x7f6a700c6da0 2023-09-30T22:53:03.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.247+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7016c500 con 0x7f6a700c6da0 2023-09-30T22:53:03.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.248+0000 7f6a57fff700 1 -- 172.21.15.142:0/1333681391 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6a6401b3b0 con 0x7f6a700c6da0 2023-09-30T22:53:03.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.249+0000 7f6a57fff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a5c067330 0x7f6a5c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.249+0000 7f6a57fff700 1 -- 172.21.15.142:0/1333681391 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a64084160 con 0x7f6a700c6da0 2023-09-30T22:53:03.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.249+0000 7f6a6ffff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a5c067330 0x7f6a5c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.250+0000 7f6a6ffff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a5c067330 0x7f6a5c0697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a60006fd0 tx=0x7f6a60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:03.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.253+0000 7f6a57fff700 1 -- 172.21.15.142:0/1333681391 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6a7016c500 con 0x7f6a700c6da0 2023-09-30T22:53:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.449+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a7016c500 con 0x7f6a700c6da0 2023-09-30T22:53:03.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.450+0000 7f6a57fff700 1 -- 172.21.15.142:0/1333681391 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f6a7016c500 con 0x7f6a700c6da0 2023-09-30T22:53:03.452 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:03.452 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:03.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a5c067330 msgr2=0x7f6a5c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a5c067330 0x7f6a5c0697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a60006fd0 tx=0x7f6a60008040 comp rx=0 tx=0).stop 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a700c6da0 msgr2=0x7f6a70143c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a700c6da0 0x7f6a70143c70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c590 tx=0x7f6a6400c950 comp rx=0 tx=0).stop 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 shutdown_connections 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a5c067330 0x7f6a5c0697e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7015e270 0x7f6a700cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7006d3f0 0x7f6a700cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 --2- 172.21.15.142:0/1333681391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a700c6da0 0x7f6a70143c70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 >> 172.21.15.142:0/1333681391 conn(0x7f6a70067e30 msgr2=0x7f6a70153120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 shutdown_connections 2023-09-30T22:53:03.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.453+0000 7f6a769ff700 1 -- 172.21.15.142:0/1333681391 wait complete. 2023-09-30T22:53:03.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:52:27.833414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:52:28.438662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:53:03.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:53:03.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.663+0000 7f2f2afff700 1 Processor -- start 2023-09-30T22:53:03.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.663+0000 7f2f2afff700 1 -- start start 2023-09-30T22:53:03.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2afff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2f240cc3b0 0x7f2f2415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2afff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f240d0550 con 0x7f2f240cbfe0 2023-09-30T22:53:03.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2afff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f240cf940 con 0x7f2f24157ab0 2023-09-30T22:53:03.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2afff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f240cfc20 con 0x7f2f240cc3b0 2023-09-30T22:53:03.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2959c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2f240cc3b0 0x7f2f2415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f28d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2f240cbfe0 0x7f2f241573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45358/0 (socket says 172.21.15.142:45358) 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2959c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2f240cc3b0 0x7f2f2415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58358/0 (socket says 172.21.15.142:58358) 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f28d9b700 1 -- 172.21.15.142:0/297394115 learned_addr learned my addr 172.21.15.142:0/297394115 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2959c700 1 -- 172.21.15.142:0/297394115 >> v1:172.21.15.148:6789/0 conn(0x7f2f24157ab0 legacy=0x7f2f2406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2959c700 1 -- 172.21.15.142:0/297394115 >> v1:172.21.15.142:6789/0 conn(0x7f2f240cbfe0 legacy=0x7f2f241573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f2959c700 1 -- 172.21.15.142:0/297394115 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f240cff00 con 0x7f2f240cc3b0 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.665+0000 7f2f237fe700 1 -- 172.21.15.142:0/297394115 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728921179 0 0) 0x7f2f240d0550 con 0x7f2f240cbfe0 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f2959c700 1 --2- 172.21.15.142:0/297394115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cc3b0 0x7f2f2415a2a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009e60 tx=0x7f2f1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2203ef35588bea82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f237fe700 1 -- 172.21.15.142:0/297394115 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00e070 con 0x7f2f240cc3b0 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f237fe700 1 -- 172.21.15.142:0/297394115 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00bc30 con 0x7f2f240cc3b0 2023-09-30T22:53:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f237fe700 1 -- 172.21.15.142:0/297394115 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c012430 con 0x7f2f240cc3b0 2023-09-30T22:53:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f2afff700 1 -- 172.21.15.142:0/297394115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cc3b0 msgr2=0x7f2f2415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f2afff700 1 --2- 172.21.15.142:0/297394115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cc3b0 0x7f2f2415a2a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009e60 tx=0x7f2f1c009780 comp rx=0 tx=0).stop 2023-09-30T22:53:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f2afff700 1 -- 172.21.15.142:0/297394115 shutdown_connections 2023-09-30T22:53:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f2afff700 1 --2- 172.21.15.142:0/297394115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cc3b0 0x7f2f2415a2a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.666+0000 7f2f2afff700 1 -- 172.21.15.142:0/297394115 >> 172.21.15.142:0/297394115 conn(0x7f2f240d0a80 msgr2=0x7f2f240d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.667+0000 7f2f2afff700 1 -- 172.21.15.142:0/297394115 shutdown_connections 2023-09-30T22:53:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.667+0000 7f2f2afff700 1 -- 172.21.15.142:0/297394115 wait complete. 2023-09-30T22:53:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.669+0000 7f2f2afff700 1 Processor -- start 2023-09-30T22:53:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.669+0000 7f2f2afff700 1 -- start start 2023-09-30T22:53:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f2afff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cbfe0 0x7f2f240c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f2afff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f240cc3b0 0x7f2f240c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f2afff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f24157ab0 0x7f2f2416a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f2afff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240c9e00 con 0x7f2f240cbfe0 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f2afff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240c7450 con 0x7f2f240cc3b0 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f2afff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2416bcd0 con 0x7f2f24157ab0 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f28d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cbfe0 0x7f2f240c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f28d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cbfe0 0x7f2f240c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58366/0 (socket says 172.21.15.142:58366) 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f28d9b700 1 -- 172.21.15.142:0/2851592956 learned_addr learned my addr 172.21.15.142:0/2851592956 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.670+0000 7f2f23fff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f240cc3b0 0x7f2f240c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f2959c700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f24157ab0 0x7f2f2416a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f28d9b700 1 -- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f24157ab0 msgr2=0x7f2f2416a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f28d9b700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f24157ab0 0x7f2f2416a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f28d9b700 1 -- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f240cc3b0 msgr2=0x7f2f240c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f28d9b700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f240cc3b0 0x7f2f240c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f28d9b700 1 -- 172.21.15.142:0/2851592956 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c009a20 con 0x7f2f240cbfe0 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f28d9b700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cbfe0 0x7f2f240c9380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c7e0 tx=0x7f2f18007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f20ff9700 1 -- 172.21.15.142:0/2851592956 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18005b30 con 0x7f2f240cbfe0 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f20ff9700 1 -- 172.21.15.142:0/2851592956 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18005c90 con 0x7f2f240cbfe0 2023-09-30T22:53:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f24155dd0 con 0x7f2f240cbfe0 2023-09-30T22:53:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f20ff9700 1 -- 172.21.15.142:0/2851592956 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18007300 con 0x7f2f240cbfe0 2023-09-30T22:53:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.671+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f240ca340 con 0x7f2f240cbfe0 2023-09-30T22:53:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.673+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f24069770 con 0x7f2f240cbfe0 2023-09-30T22:53:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.673+0000 7f2f20ff9700 1 -- 172.21.15.142:0/2851592956 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2f1801b3b0 con 0x7f2f240cbfe0 2023-09-30T22:53:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.674+0000 7f2f20ff9700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2f08067330 0x7f2f080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.674+0000 7f2f20ff9700 1 -- 172.21.15.142:0/2851592956 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2f18084140 con 0x7f2f240cbfe0 2023-09-30T22:53:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.674+0000 7f2f23fff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2f08067330 0x7f2f080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.675+0000 7f2f23fff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2f08067330 0x7f2f080697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f240c4500 tx=0x7f2f10007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.678+0000 7f2f20ff9700 1 -- 172.21.15.142:0/2851592956 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2f18050fa0 con 0x7f2f240cbfe0 2023-09-30T22:53:03.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.867+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f2406fc10 con 0x7f2f240cbfe0 2023-09-30T22:53:03.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.867+0000 7f2f20ff9700 1 -- 172.21.15.142:0/2851592956 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f18001d60 con 0x7f2f240cbfe0 2023-09-30T22:53:03.869 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:53:03.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.869+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2f08067330 msgr2=0x7f2f080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.869+0000 7f2f2afff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2f08067330 0x7f2f080697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f240c4500 tx=0x7f2f10007ec0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.869+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cbfe0 msgr2=0x7f2f240c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:03.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.869+0000 7f2f2afff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cbfe0 0x7f2f240c9380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c7e0 tx=0x7f2f18007df0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 shutdown_connections 2023-09-30T22:53:03.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2f08067330 0x7f2f080697e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2f24157ab0 0x7f2f2416a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f240cbfe0 0x7f2f240c9380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 --2- 172.21.15.142:0/2851592956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f240cc3b0 0x7f2f240c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:03.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 >> 172.21.15.142:0/2851592956 conn(0x7f2f240d0a80 msgr2=0x7f2f24156650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:03.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 shutdown_connections 2023-09-30T22:53:03.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:03.870+0000 7f2f2afff700 1 -- 172.21.15.142:0/2851592956 wait complete. 2023-09-30T22:53:03.888 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:53:04.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.078+0000 7f7a6c9ff700 1 Processor -- start 2023-09-30T22:53:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.078+0000 7f7a6c9ff700 1 -- start start 2023-09-30T22:53:04.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6c9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a680c52a0 0x7f7a680c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6c9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a68069f10 0x7f7a680c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6c9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a680c7690 con 0x7f7a680c5bb0 2023-09-30T22:53:04.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6c9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a681406a0 con 0x7f7a68069f10 2023-09-30T22:53:04.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6c9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680c3a50 con 0x7f7a680c52a0 2023-09-30T22:53:04.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a65d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a68069f10 0x7f7a680c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a66d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7a680c5bb0 0x7f7a680ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45368/0 (socket says 172.21.15.142:45368) 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a66d9d700 1 -- 172.21.15.142:0/2500170857 learned_addr learned my addr 172.21.15.142:0/2500170857 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6659c700 1 --2- 172.21.15.142:0/2500170857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a680c52a0 0x7f7a680c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6559a700 1 -- 172.21.15.142:0/2500170857 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277363177 0 0) 0x7f7a60001490 con 0x7f7a680c5bb0 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a6559a700 1 -- 172.21.15.142:0/2500170857 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a50003570 con 0x7f7a680c5bb0 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a65d9b700 1 -- 172.21.15.142:0/2500170857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a680c52a0 msgr2=0x7f7a680c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a65d9b700 1 --2- 172.21.15.142:0/2500170857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a680c52a0 0x7f7a680c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a65d9b700 1 -- 172.21.15.142:0/2500170857 >> v1:172.21.15.142:6789/0 conn(0x7f7a680c5bb0 legacy=0x7f7a680ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.080+0000 7f7a65d9b700 1 -- 172.21.15.142:0/2500170857 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680c7f20 con 0x7f7a68069f10 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.081+0000 7f7a65d9b700 1 --2- 172.21.15.142:0/2500170857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a68069f10 0x7f7a680c5670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009940 tx=0x7f7a5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185af8961780f7fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.081+0000 7f7a6559a700 1 -- 172.21.15.142:0/2500170857 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c011630 con 0x7f7a68069f10 2023-09-30T22:53:04.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.081+0000 7f7a6559a700 1 -- 172.21.15.142:0/2500170857 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c011790 con 0x7f7a68069f10 2023-09-30T22:53:04.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.081+0000 7f7a6559a700 1 -- 172.21.15.142:0/2500170857 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c011b50 con 0x7f7a68069f10 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.081+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2500170857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a68069f10 msgr2=0x7f7a680c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.081+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2500170857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a68069f10 0x7f7a680c5670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009940 tx=0x7f7a5c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.082+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2500170857 shutdown_connections 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.082+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2500170857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a680c52a0 0x7f7a680c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.082+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2500170857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a68069f10 0x7f7a680c5670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.082+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2500170857 >> 172.21.15.142:0/2500170857 conn(0x7f7a680cc670 msgr2=0x7f7a680cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.082+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2500170857 shutdown_connections 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.082+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2500170857 wait complete. 2023-09-30T22:53:04.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.084+0000 7f7a6c9ff700 1 Processor -- start 2023-09-30T22:53:04.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.084+0000 7f7a6c9ff700 1 -- start start 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a6c9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a68069f10 0x7f7a6812d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a6c9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a680c52a0 0x7f7a680c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a6c9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a680c5bb0 0x7f7a68155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a6c9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68156740 con 0x7f7a680c5bb0 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a6c9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680c3030 con 0x7f7a680c52a0 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a6c9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680c1da0 con 0x7f7a68069f10 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a66d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a680c5bb0 0x7f7a68155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a66d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a680c5bb0 0x7f7a68155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58398/0 (socket says 172.21.15.142:58398) 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.085+0000 7f7a66d9d700 1 -- 172.21.15.142:0/2985139987 learned_addr learned my addr 172.21.15.142:0/2985139987 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:04.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a6659c700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a68069f10 0x7f7a6812d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a65d9b700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a680c52a0 0x7f7a680c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a66d9d700 1 -- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a68069f10 msgr2=0x7f7a6812d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a66d9d700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a68069f10 0x7f7a6812d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a66d9d700 1 -- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a680c52a0 msgr2=0x7f7a680c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a66d9d700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a680c52a0 0x7f7a680c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a66d9d700 1 -- 172.21.15.142:0/2985139987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c009420 con 0x7f7a680c5bb0 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a66d9d700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a680c5bb0 0x7f7a68155b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000cc40 tx=0x7f7a60001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a567fc700 1 -- 172.21.15.142:0/2985139987 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000a850 con 0x7f7a680c5bb0 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a567fc700 1 -- 172.21.15.142:0/2985139987 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6000a9b0 con 0x7f7a680c5bb0 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a680c2640 con 0x7f7a680c5bb0 2023-09-30T22:53:04.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.086+0000 7f7a567fc700 1 -- 172.21.15.142:0/2985139987 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000ad30 con 0x7f7a680c5bb0 2023-09-30T22:53:04.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.087+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a680c1ff0 con 0x7f7a680c5bb0 2023-09-30T22:53:04.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.087+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6812a840 con 0x7f7a680c5bb0 2023-09-30T22:53:04.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.088+0000 7f7a567fc700 1 -- 172.21.15.142:0/2985139987 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7a60007300 con 0x7f7a680c5bb0 2023-09-30T22:53:04.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.089+0000 7f7a567fc700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a48067330 0x7f7a480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.089+0000 7f7a567fc700 1 -- 172.21.15.142:0/2985139987 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a60084cd0 con 0x7f7a680c5bb0 2023-09-30T22:53:04.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.090+0000 7f7a6659c700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a48067330 0x7f7a480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.090+0000 7f7a6659c700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a48067330 0x7f7a480697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009db0 tx=0x7f7a580091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.093+0000 7f7a567fc700 1 -- 172.21.15.142:0/2985139987 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7a60051bb0 con 0x7f7a680c5bb0 2023-09-30T22:53:04.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.286+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a680c7690 con 0x7f7a680c5bb0 2023-09-30T22:53:04.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.287+0000 7f7a567fc700 1 -- 172.21.15.142:0/2985139987 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a680c7690 con 0x7f7a680c5bb0 2023-09-30T22:53:04.288 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:53:04.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a48067330 msgr2=0x7f7a480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a48067330 0x7f7a480697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009db0 tx=0x7f7a580091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a680c5bb0 msgr2=0x7f7a68155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a680c5bb0 0x7f7a68155b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000cc40 tx=0x7f7a60001a30 comp rx=0 tx=0).stop 2023-09-30T22:53:04.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 shutdown_connections 2023-09-30T22:53:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a48067330 0x7f7a480697e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a680c5bb0 0x7f7a68155b80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a68069f10 0x7f7a6812d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 --2- 172.21.15.142:0/2985139987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a680c52a0 0x7f7a680c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.289+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 >> 172.21.15.142:0/2985139987 conn(0x7f7a680cc670 msgr2=0x7f7a6813f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.290+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 shutdown_connections 2023-09-30T22:53:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.290+0000 7f7a6c9ff700 1 -- 172.21.15.142:0/2985139987 wait complete. 2023-09-30T22:53:04.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:53:04.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.501+0000 7f2a9b5ff700 1 Processor -- start 2023-09-30T22:53:04.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.501+0000 7f2a9b5ff700 1 -- start start 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.502+0000 7f2a9b5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a940cbfe0 0x7f2a9415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.502+0000 7f2a9b5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a94157ab0 0x7f2a940cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.502+0000 7f2a9b5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a940d0550 con 0x7f2a940cc3b0 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.502+0000 7f2a9b5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a940cf750 con 0x7f2a940cbfe0 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.502+0000 7f2a9b5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940cf940 con 0x7f2a94157ab0 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a9939b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a940cbfe0 0x7f2a9415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a98b9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2a940cc3b0 0x7f2a941573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45378/0 (socket says 172.21.15.142:45378) 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a9939b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a940cbfe0 0x7f2a9415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58410/0 (socket says 172.21.15.142:58410) 2023-09-30T22:53:04.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a98b9a700 1 -- 172.21.15.142:0/3227989356 learned_addr learned my addr 172.21.15.142:0/3227989356 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a99b9c700 1 --2- 172.21.15.142:0/3227989356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a94157ab0 0x7f2a940cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a9939b700 1 -- 172.21.15.142:0/3227989356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a94157ab0 msgr2=0x7f2a940cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a9939b700 1 --2- 172.21.15.142:0/3227989356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a94157ab0 0x7f2a940cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a9939b700 1 -- 172.21.15.142:0/3227989356 >> v1:172.21.15.142:6789/0 conn(0x7f2a940cc3b0 legacy=0x7f2a941573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a9939b700 1 -- 172.21.15.142:0/3227989356 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940cfc20 con 0x7f2a940cbfe0 2023-09-30T22:53:04.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a8bfff700 1 -- 172.21.15.142:0/3227989356 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529595915 0 0) 0x7f2a940d0550 con 0x7f2a940cc3b0 2023-09-30T22:53:04.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.503+0000 7f2a9939b700 1 --2- 172.21.15.142:0/3227989356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a9415a2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a900098e0 tx=0x7f2a900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32ec1195856f4ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a8bfff700 1 -- 172.21.15.142:0/3227989356 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90009e80 con 0x7f2a940cbfe0 2023-09-30T22:53:04.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a8bfff700 1 -- 172.21.15.142:0/3227989356 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9000b860 con 0x7f2a940cbfe0 2023-09-30T22:53:04.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a8bfff700 1 -- 172.21.15.142:0/3227989356 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000bbe0 con 0x7f2a940cbfe0 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/3227989356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 msgr2=0x7f2a9415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/3227989356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a9415a2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a900098e0 tx=0x7f2a900091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/3227989356 shutdown_connections 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/3227989356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a9415a2a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/3227989356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a94157ab0 0x7f2a940cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/3227989356 >> 172.21.15.142:0/3227989356 conn(0x7f2a940d0a80 msgr2=0x7f2a940d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/3227989356 shutdown_connections 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.504+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/3227989356 wait complete. 2023-09-30T22:53:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.506+0000 7f2a9b5ff700 1 Processor -- start 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.506+0000 7f2a9b5ff700 1 -- start start 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9b5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a94154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9b5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a940cc3b0 0x7f2a940c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9b5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94157ab0 0x7f2a940c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9b5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94155900 con 0x7f2a940cbfe0 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9b5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940c9010 con 0x7f2a94157ab0 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9b5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940c8720 con 0x7f2a940cc3b0 2023-09-30T22:53:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9939b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a94154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9939b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a94154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58418/0 (socket says 172.21.15.142:58418) 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a9939b700 1 -- 172.21.15.142:0/2872635704 learned_addr learned my addr 172.21.15.142:0/2872635704 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a98b9a700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a940cc3b0 0x7f2a940c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.507+0000 7f2a99b9c700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94157ab0 0x7f2a940c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9939b700 1 -- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a940cc3b0 msgr2=0x7f2a940c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9939b700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a940cc3b0 0x7f2a940c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9939b700 1 -- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94157ab0 msgr2=0x7f2a940c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9939b700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94157ab0 0x7f2a940c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9939b700 1 -- 172.21.15.142:0/2872635704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90009420 con 0x7f2a940cbfe0 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a99b9c700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94157ab0 0x7f2a940c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9939b700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a94154f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a9406cf30 tx=0x7f2a90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a897fa700 1 -- 172.21.15.142:0/2872635704 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000bbe0 con 0x7f2a940cbfe0 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a897fa700 1 -- 172.21.15.142:0/2872635704 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90011420 con 0x7f2a940cbfe0 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a940c89c0 con 0x7f2a940cbfe0 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a897fa700 1 -- 172.21.15.142:0/2872635704 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a900117c0 con 0x7f2a940cbfe0 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.508+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a941554d0 con 0x7f2a940cbfe0 2023-09-30T22:53:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.509+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a94069770 con 0x7f2a940cbfe0 2023-09-30T22:53:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.510+0000 7f2a897fa700 1 -- 172.21.15.142:0/2872635704 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2a90011bb0 con 0x7f2a940cbfe0 2023-09-30T22:53:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.511+0000 7f2a897fa700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a78067330 0x7f2a780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.511+0000 7f2a897fa700 1 -- 172.21.15.142:0/2872635704 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a90086620 con 0x7f2a940cbfe0 2023-09-30T22:53:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.511+0000 7f2a98b9a700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a78067330 0x7f2a780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.512+0000 7f2a98b9a700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a78067330 0x7f2a780697e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a940cba80 tx=0x7f2a84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.516+0000 7f2a897fa700 1 -- 172.21.15.142:0/2872635704 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2a90053480 con 0x7f2a940cbfe0 2023-09-30T22:53:04.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.704+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a940c92f0 con 0x7f2a940cbfe0 2023-09-30T22:53:04.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.704+0000 7f2a897fa700 1 -- 172.21.15.142:0/2872635704 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a90011e60 con 0x7f2a940cbfe0 2023-09-30T22:53:04.706 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:53:04.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a78067330 msgr2=0x7f2a780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a78067330 0x7f2a780697e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a940cba80 tx=0x7f2a84009040 comp rx=0 tx=0).stop 2023-09-30T22:53:04.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 msgr2=0x7f2a94154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a94154f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a9406cf30 tx=0x7f2a90017000 comp rx=0 tx=0).stop 2023-09-30T22:53:04.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 shutdown_connections 2023-09-30T22:53:04.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a78067330 0x7f2a780697e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94157ab0 0x7f2a940c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a940cbfe0 0x7f2a94154f90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 --2- 172.21.15.142:0/2872635704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a940cc3b0 0x7f2a940c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 >> 172.21.15.142:0/2872635704 conn(0x7f2a940d0a80 msgr2=0x7f2a94155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:04.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 shutdown_connections 2023-09-30T22:53:04.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.707+0000 7f2a9b5ff700 1 -- 172.21.15.142:0/2872635704 wait complete. 2023-09-30T22:53:04.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:53:04.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.916+0000 7f9cb75ff700 1 Processor -- start 2023-09-30T22:53:04.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.916+0000 7f9cb75ff700 1 -- start start 2023-09-30T22:53:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb75ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9cb00c52a0 0x7f9cb00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb75ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb75ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9cb00c5bb0 0x7f9cb00ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb75ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb01406a0 con 0x7f9cb00c5bb0 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb75ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00c3a50 con 0x7f9cb00c52a0 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb75ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00c7690 con 0x7f9cb0069f10 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb5b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9cb00c5bb0 0x7f9cb00ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb5b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9cb00c5bb0 0x7f9cb00ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58422/0 (socket says 172.21.15.142:58422) 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb5b9c700 1 -- 172.21.15.142:0/685244606 learned_addr learned my addr 172.21.15.142:0/685244606 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb539b700 1 --2- 172.21.15.142:0/685244606 >> v2:172.21.15.148:3300/0 conn(0x7f9cb00c52a0 0x7f9cb00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.918+0000 7f9cb4b9a700 1 --2- 172.21.15.142:0/685244606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9cb5b9c700 1 -- 172.21.15.142:0/685244606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 msgr2=0x7f9cb00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9cb5b9c700 1 --2- 172.21.15.142:0/685244606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb00c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9cb5b9c700 1 -- 172.21.15.142:0/685244606 >> v2:172.21.15.148:3300/0 conn(0x7f9cb00c52a0 msgr2=0x7f9cb00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9cb5b9c700 1 --2- 172.21.15.142:0/685244606 >> v2:172.21.15.148:3300/0 conn(0x7f9cb00c52a0 0x7f9cb00c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9cb5b9c700 1 -- 172.21.15.142:0/685244606 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb00c7f20 con 0x7f9cb00c5bb0 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9cb5b9c700 1 --2- 172.21.15.142:0/685244606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c5bb0 0x7f9cb00ca340 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009f50 tx=0x7f9ca8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f912a3f2094c0b93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9ca7fff700 1 -- 172.21.15.142:0/685244606 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca800e070 con 0x7f9cb00c5bb0 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9ca7fff700 1 -- 172.21.15.142:0/685244606 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca800ba30 con 0x7f9cb00c5bb0 2023-09-30T22:53:04.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.919+0000 7f9ca7fff700 1 -- 172.21.15.142:0/685244606 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80092e0 con 0x7f9cb00c5bb0 2023-09-30T22:53:04.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 -- 172.21.15.142:0/685244606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c5bb0 msgr2=0x7f9cb00ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/685244606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c5bb0 0x7f9cb00ca340 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009f50 tx=0x7f9ca8009840 comp rx=0 tx=0).stop 2023-09-30T22:53:04.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 -- 172.21.15.142:0/685244606 shutdown_connections 2023-09-30T22:53:04.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/685244606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c5bb0 0x7f9cb00ca340 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/685244606 >> v2:172.21.15.148:3300/0 conn(0x7f9cb00c52a0 0x7f9cb00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/685244606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb00c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 -- 172.21.15.142:0/685244606 >> 172.21.15.142:0/685244606 conn(0x7f9cb00cc670 msgr2=0x7f9cb00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 -- 172.21.15.142:0/685244606 shutdown_connections 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.920+0000 7f9cb75ff700 1 -- 172.21.15.142:0/685244606 wait complete. 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.921+0000 7f9cb75ff700 1 Processor -- start 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.922+0000 7f9cb75ff700 1 -- start start 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.922+0000 7f9cb75ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb01561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.922+0000 7f9cb75ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c52a0 0x7f9cb0138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.922+0000 7f9cb75ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00c5bb0 0x7f9cb01392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.922+0000 7f9cb75ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0136030 con 0x7f9cb00c52a0 2023-09-30T22:53:04.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.922+0000 7f9cb75ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0135420 con 0x7f9cb00c5bb0 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb75ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0135700 con 0x7f9cb0069f10 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c52a0 0x7f9cb0138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c52a0 0x7f9cb0138d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58424/0 (socket says 172.21.15.142:58424) 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 -- 172.21.15.142:0/1547399605 learned_addr learned my addr 172.21.15.142:0/1547399605 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb5b9c700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00c5bb0 0x7f9cb01392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb539b700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb01561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 -- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 msgr2=0x7f9cb01561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb01561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 -- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00c5bb0 msgr2=0x7f9cb01392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00c5bb0 0x7f9cb01392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:04.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.923+0000 7f9cb4b9a700 1 -- 172.21.15.142:0/1547399605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca8009ae0 con 0x7f9cb00c52a0 2023-09-30T22:53:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.924+0000 7f9cb4b9a700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c52a0 0x7f9cb0138d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006b00 tx=0x7f9ca0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.924+0000 7f9ca57fa700 1 -- 172.21.15.142:0/1547399605 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00125f0 con 0x7f9cb00c52a0 2023-09-30T22:53:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.924+0000 7f9ca57fa700 1 -- 172.21.15.142:0/1547399605 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0012770 con 0x7f9cb00c52a0 2023-09-30T22:53:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.924+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb01359e0 con 0x7f9cb00c52a0 2023-09-30T22:53:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.924+0000 7f9ca57fa700 1 -- 172.21.15.142:0/1547399605 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0012b30 con 0x7f9cb00c52a0 2023-09-30T22:53:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.924+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb01350d0 con 0x7f9cb00c52a0 2023-09-30T22:53:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.925+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb01361a0 con 0x7f9cb00c52a0 2023-09-30T22:53:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.926+0000 7f9ca57fa700 1 -- 172.21.15.142:0/1547399605 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9ca001e460 con 0x7f9cb00c52a0 2023-09-30T22:53:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.927+0000 7f9ca57fa700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c94067330 0x7f9c940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.927+0000 7f9ca57fa700 1 -- 172.21.15.142:0/1547399605 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ca00850d0 con 0x7f9cb00c52a0 2023-09-30T22:53:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.927+0000 7f9cb539b700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c94067330 0x7f9c940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.927+0000 7f9cb539b700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c94067330 0x7f9c940697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9cac006fd0 tx=0x7f9cac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:04.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:04.931+0000 7f9ca57fa700 1 -- 172.21.15.142:0/1547399605 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9ca0051fd0 con 0x7f9cb00c52a0 2023-09-30T22:53:05.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.119+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9cb006fc10 con 0x7f9cb00c52a0 2023-09-30T22:53:05.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.120+0000 7f9ca57fa700 1 -- 172.21.15.142:0/1547399605 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ca00555f0 con 0x7f9cb00c52a0 2023-09-30T22:53:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.122+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c94067330 msgr2=0x7f9c940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.122+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c94067330 0x7f9c940697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9cac006fd0 tx=0x7f9cac008040 comp rx=0 tx=0).stop 2023-09-30T22:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.122+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c52a0 msgr2=0x7f9cb0138d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.122+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c52a0 0x7f9cb0138d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006b00 tx=0x7f9ca0008040 comp rx=0 tx=0).stop 2023-09-30T22:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 shutdown_connections 2023-09-30T22:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c94067330 0x7f9c940697e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb00c5bb0 0x7f9cb01392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cb0069f10 0x7f9cb01561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 --2- 172.21.15.142:0/1547399605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cb00c52a0 0x7f9cb0138d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 >> 172.21.15.142:0/1547399605 conn(0x7f9cb00cc670 msgr2=0x7f9cb013f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:05.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 shutdown_connections 2023-09-30T22:53:05.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.123+0000 7f9cb75ff700 1 -- 172.21.15.142:0/1547399605 wait complete. 2023-09-30T22:53:05.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:05.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.330+0000 7fa083dff700 1 Processor -- start 2023-09-30T22:53:05.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.331+0000 7fa083dff700 1 -- start start 2023-09-30T22:53:05.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa083dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa07c143350 0x7fa07c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa083dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c0692f0 0x7fa07c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa083dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c15e0b0 con 0x7fa07c15dc50 2023-09-30T22:53:05.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa083dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0cc6b0 con 0x7fa07c143350 2023-09-30T22:53:05.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa083dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0cb7d0 con 0x7fa07c0692f0 2023-09-30T22:53:05.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa081b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa07c143350 0x7fa07c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa08239c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa07c15dc50 0x7fa07c068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45388/0 (socket says 172.21.15.142:45388) 2023-09-30T22:53:05.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa08239c700 1 -- 172.21.15.142:0/1546544808 learned_addr learned my addr 172.21.15.142:0/1546544808 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:05.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.332+0000 7fa08139a700 1 --2- 172.21.15.142:0/1546544808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c0692f0 0x7fa07c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa081b9b700 1 -- 172.21.15.142:0/1546544808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c0692f0 msgr2=0x7fa07c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa081b9b700 1 --2- 172.21.15.142:0/1546544808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c0692f0 0x7fa07c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa081b9b700 1 -- 172.21.15.142:0/1546544808 >> v1:172.21.15.142:6789/0 conn(0x7fa07c15dc50 legacy=0x7fa07c068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa081b9b700 1 -- 172.21.15.142:0/1546544808 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0cbaa0 con 0x7fa07c143350 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa080b99700 1 -- 172.21.15.142:0/1546544808 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257631482 0 0) 0x7fa074001490 con 0x7fa07c15dc50 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa081b9b700 1 --2- 172.21.15.142:0/1546544808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0cb290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa0780098e0 tx=0x7fa0780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14de836be5929847 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa080b99700 1 -- 172.21.15.142:0/1546544808 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800b640 con 0x7fa07c143350 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa080b99700 1 -- 172.21.15.142:0/1546544808 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07800b7a0 con 0x7fa07c143350 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.333+0000 7fa080b99700 1 -- 172.21.15.142:0/1546544808 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800bb40 con 0x7fa07c143350 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 -- 172.21.15.142:0/1546544808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 msgr2=0x7fa07c0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 --2- 172.21.15.142:0/1546544808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0cb290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa0780098e0 tx=0x7fa0780091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 -- 172.21.15.142:0/1546544808 shutdown_connections 2023-09-30T22:53:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 --2- 172.21.15.142:0/1546544808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0cb290 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 --2- 172.21.15.142:0/1546544808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c0692f0 0x7fa07c15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 -- 172.21.15.142:0/1546544808 >> 172.21.15.142:0/1546544808 conn(0x7fa07c0ce8e0 msgr2=0x7fa07c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 -- 172.21.15.142:0/1546544808 shutdown_connections 2023-09-30T22:53:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.334+0000 7fa083dff700 1 -- 172.21.15.142:0/1546544808 wait complete. 2023-09-30T22:53:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.336+0000 7fa083dff700 1 Processor -- start 2023-09-30T22:53:05.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.336+0000 7fa083dff700 1 -- start start 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.337+0000 7fa083dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07c0692f0 0x7fa07c16b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.337+0000 7fa083dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0a5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.337+0000 7fa083dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c15dc50 0x7fa07c15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.337+0000 7fa083dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c16b5d0 con 0x7fa07c143350 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.337+0000 7fa083dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0a5a60 con 0x7fa07c0692f0 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.337+0000 7fa083dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c16c3f0 con 0x7fa07c15dc50 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0a5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58450/0 (socket says 172.21.15.142:58450) 2023-09-30T22:53:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 -- 172.21.15.142:0/68406058 learned_addr learned my addr 172.21.15.142:0/68406058 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa081b9b700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07c0692f0 0x7fa07c16b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08239c700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c15dc50 0x7fa07c15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 -- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c15dc50 msgr2=0x7fa07c15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c15dc50 0x7fa07c15c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 -- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07c0692f0 msgr2=0x7fa07c16b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07c0692f0 0x7fa07c16b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 -- 172.21.15.142:0/68406058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078009420 con 0x7fa07c143350 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa08139a700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0a5520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00ecb0 tx=0x7fa06c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.338+0000 7fa071ffb700 1 -- 172.21.15.142:0/68406058 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00c850 con 0x7fa07c143350 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.339+0000 7fa071ffb700 1 -- 172.21.15.142:0/68406058 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00c9b0 con 0x7fa07c143350 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.339+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c16b7e0 con 0x7fa07c143350 2023-09-30T22:53:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.339+0000 7fa071ffb700 1 -- 172.21.15.142:0/68406058 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00cd50 con 0x7fa07c143350 2023-09-30T22:53:05.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.339+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c16c080 con 0x7fa07c143350 2023-09-30T22:53:05.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.340+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c16bbe0 con 0x7fa07c143350 2023-09-30T22:53:05.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.341+0000 7fa071ffb700 1 -- 172.21.15.142:0/68406058 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa06c013680 con 0x7fa07c143350 2023-09-30T22:53:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.342+0000 7fa071ffb700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa060067330 0x7fa0600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.342+0000 7fa071ffb700 1 -- 172.21.15.142:0/68406058 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa06c084db0 con 0x7fa07c143350 2023-09-30T22:53:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.342+0000 7fa081b9b700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa060067330 0x7fa0600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.342+0000 7fa081b9b700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa060067330 0x7fa0600697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0780093f0 tx=0x7fa078017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:05.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.346+0000 7fa071ffb700 1 -- 172.21.15.142:0/68406058 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa06c051cb0 con 0x7fa07c143350 2023-09-30T22:53:05.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.539+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa07c16c530 con 0x7fa07c143350 2023-09-30T22:53:05.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.540+0000 7fa071ffb700 1 -- 172.21.15.142:0/68406058 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fa06c0552d0 con 0x7fa07c143350 2023-09-30T22:53:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:05.541 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:05.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa060067330 msgr2=0x7fa0600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa060067330 0x7fa0600697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0780093f0 tx=0x7fa078017000 comp rx=0 tx=0).stop 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 msgr2=0x7fa07c0a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0a5520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00ecb0 tx=0x7fa06c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 shutdown_connections 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa060067330 0x7fa0600697e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa07c15dc50 0x7fa07c15c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07c0692f0 0x7fa07c16b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 --2- 172.21.15.142:0/68406058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c143350 0x7fa07c0a5520 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 >> 172.21.15.142:0/68406058 conn(0x7fa07c0ce8e0 msgr2=0x7fa07c0cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 shutdown_connections 2023-09-30T22:53:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.542+0000 7fa083dff700 1 -- 172.21.15.142:0/68406058 wait complete. 2023-09-30T22:53:05.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:52:27.833414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:52:28.438662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:53:05.561 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:53:05.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.752+0000 7f2af55ff700 1 Processor -- start 2023-09-30T22:53:05.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.752+0000 7f2af55ff700 1 -- start start 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.753+0000 7f2af55ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2af00c52a0 0x7f2af00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.753+0000 7f2af55ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2af0069f10 0x7f2af00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.753+0000 7f2af55ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af00c5bb0 0x7f2af00ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2af55ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af01406a0 con 0x7f2af0069f10 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2af55ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af00c3a50 con 0x7f2af00c52a0 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2af55ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00c7690 con 0x7f2af00c5bb0 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2af0069f10 0x7f2af00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2af0069f10 0x7f2af00c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58462/0 (socket says 172.21.15.142:58462) 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 -- 172.21.15.142:0/2449718105 learned_addr learned my addr 172.21.15.142:0/2449718105 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aeeffd700 1 --2- 172.21.15.142:0/2449718105 >> v2:172.21.15.148:3300/0 conn(0x7f2af00c52a0 0x7f2af00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aef7fe700 1 --2- 172.21.15.142:0/2449718105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af00c5bb0 0x7f2af00ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 -- 172.21.15.142:0/2449718105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af00c5bb0 msgr2=0x7f2af00ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 --2- 172.21.15.142:0/2449718105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af00c5bb0 0x7f2af00ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 -- 172.21.15.142:0/2449718105 >> v2:172.21.15.148:3300/0 conn(0x7f2af00c52a0 msgr2=0x7f2af00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 --2- 172.21.15.142:0/2449718105 >> v2:172.21.15.148:3300/0 conn(0x7f2af00c52a0 0x7f2af00c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aee7fc700 1 -- 172.21.15.142:0/2449718105 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af00c7f20 con 0x7f2af0069f10 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.754+0000 7f2aeeffd700 1 --2- 172.21.15.142:0/2449718105 >> v2:172.21.15.148:3300/0 conn(0x7f2af00c52a0 0x7f2af00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2aee7fc700 1 --2- 172.21.15.142:0/2449718105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af0069f10 0x7f2af00c5670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2af00c9040 tx=0x7f2ae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9148e8ae4e50fce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:05.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2aedffb700 1 -- 172.21.15.142:0/2449718105 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400b820 con 0x7f2af0069f10 2023-09-30T22:53:05.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2aedffb700 1 -- 172.21.15.142:0/2449718105 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400b980 con 0x7f2af0069f10 2023-09-30T22:53:05.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2aedffb700 1 -- 172.21.15.142:0/2449718105 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400bd20 con 0x7f2af0069f10 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 -- 172.21.15.142:0/2449718105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af0069f10 msgr2=0x7f2af00c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 --2- 172.21.15.142:0/2449718105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af0069f10 0x7f2af00c5670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2af00c9040 tx=0x7f2ae4009250 comp rx=0 tx=0).stop 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 -- 172.21.15.142:0/2449718105 shutdown_connections 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 --2- 172.21.15.142:0/2449718105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af00c5bb0 0x7f2af00ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 --2- 172.21.15.142:0/2449718105 >> v2:172.21.15.148:3300/0 conn(0x7f2af00c52a0 0x7f2af00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 --2- 172.21.15.142:0/2449718105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af0069f10 0x7f2af00c5670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 -- 172.21.15.142:0/2449718105 >> 172.21.15.142:0/2449718105 conn(0x7f2af00cc670 msgr2=0x7f2af00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 -- 172.21.15.142:0/2449718105 shutdown_connections 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.755+0000 7f2af55ff700 1 -- 172.21.15.142:0/2449718105 wait complete. 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.757+0000 7f2af55ff700 1 Processor -- start 2023-09-30T22:53:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.757+0000 7f2af55ff700 1 -- start start 2023-09-30T22:53:05.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2af55ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af0069f10 0x7f2af0168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2af55ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af00c52a0 0x7f2af0157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2af55ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af00c5bb0 0x7f2af0156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2af55ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af01579c0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2af55ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0158470 con 0x7f2af00c52a0 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2af55ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0158a40 con 0x7f2af0069f10 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2aef7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af00c5bb0 0x7f2af0156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2aef7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af00c5bb0 0x7f2af0156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58464/0 (socket says 172.21.15.142:58464) 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2aef7fe700 1 -- 172.21.15.142:0/3823987550 learned_addr learned my addr 172.21.15.142:0/3823987550 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2aee7fc700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af00c52a0 0x7f2af0157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2aeeffd700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af0069f10 0x7f2af0168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.758+0000 7f2aef7fe700 1 -- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af0069f10 msgr2=0x7f2af0168f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2aef7fe700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af0069f10 0x7f2af0168f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2aef7fe700 1 -- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af00c52a0 msgr2=0x7f2af0157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2aef7fe700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af00c52a0 0x7f2af0157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2aef7fe700 1 -- 172.21.15.142:0/3823987550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40094f0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2aeeffd700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af0069f10 0x7f2af0168f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2aef7fe700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af00c5bb0 0x7f2af0156070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007f50 tx=0x7f2ae8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2ad6ffd700 1 -- 172.21.15.142:0/3823987550 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae800ecd0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2ad6ffd700 1 -- 172.21.15.142:0/3823987550 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae800ee50 con 0x7f2af00c5bb0 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af0157bd0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2ad6ffd700 1 -- 172.21.15.142:0/3823987550 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8014670 con 0x7f2af00c5bb0 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.759+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af0158190 con 0x7f2af00c5bb0 2023-09-30T22:53:05.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.760+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af0158c40 con 0x7f2af00c5bb0 2023-09-30T22:53:05.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.761+0000 7f2ad6ffd700 1 -- 172.21.15.142:0/3823987550 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2ae80149e0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.762+0000 7f2ad6ffd700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2adc067330 0x7f2adc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:05.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.762+0000 7f2ad6ffd700 1 -- 172.21.15.142:0/3823987550 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ae8085350 con 0x7f2af00c5bb0 2023-09-30T22:53:05.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.762+0000 7f2aeeffd700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2adc067330 0x7f2adc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:05.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.762+0000 7f2aeeffd700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2adc067330 0x7f2adc0697e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0006f00 tx=0x7f2ae0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:05.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.766+0000 7f2ad6ffd700 1 -- 172.21.15.142:0/3823987550 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2ae80521b0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.957+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2af00cc0c0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.958+0000 7f2ad6ffd700 1 -- 172.21.15.142:0/3823987550 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ae80557d0 con 0x7f2af00c5bb0 2023-09-30T22:53:05.959 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:53:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2adc067330 msgr2=0x7f2adc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2adc067330 0x7f2adc0697e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0006f00 tx=0x7f2ae0008040 comp rx=0 tx=0).stop 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af00c5bb0 msgr2=0x7f2af0156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af00c5bb0 0x7f2af0156070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007f50 tx=0x7f2ae8009860 comp rx=0 tx=0).stop 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 shutdown_connections 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2adc067330 0x7f2adc0697e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2af00c5bb0 0x7f2af0156070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2af0069f10 0x7f2af0168f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 --2- 172.21.15.142:0/3823987550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af00c52a0 0x7f2af0157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 >> 172.21.15.142:0/3823987550 conn(0x7f2af00cc670 msgr2=0x7f2af013c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 shutdown_connections 2023-09-30T22:53:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:05.960+0000 7f2af55ff700 1 -- 172.21.15.142:0/3823987550 wait complete. 2023-09-30T22:53:05.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:53:06.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.171+0000 7f11053ff700 1 Processor -- start 2023-09-30T22:53:06.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.171+0000 7f11053ff700 1 -- start start 2023-09-30T22:53:06.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f11053ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11000c52a0 0x7f11000c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f11053ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1100069f10 0x7f11000c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f11053ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f11053ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11001406a0 con 0x7f1100069f10 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f11053ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000c3a50 con 0x7f11000c52a0 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f11053ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c7690 con 0x7f11000c5bb0 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f10fe7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1100069f10 0x7f11000c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f10fe7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1100069f10 0x7f11000c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58472/0 (socket says 172.21.15.142:58472) 2023-09-30T22:53:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f10fe7fc700 1 -- 172.21.15.142:0/2485080908 learned_addr learned my addr 172.21.15.142:0/2485080908 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:06.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f10feffd700 1 --2- 172.21.15.142:0/2485080908 >> v2:172.21.15.148:3300/0 conn(0x7f11000c52a0 0x7f11000c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.172+0000 7f10ff7fe700 1 --2- 172.21.15.142:0/2485080908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fe7fc700 1 -- 172.21.15.142:0/2485080908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 msgr2=0x7f11000ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:06.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fe7fc700 1 --2- 172.21.15.142:0/2485080908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fe7fc700 1 -- 172.21.15.142:0/2485080908 >> v2:172.21.15.148:3300/0 conn(0x7f11000c52a0 msgr2=0x7f11000c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:06.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fe7fc700 1 --2- 172.21.15.142:0/2485080908 >> v2:172.21.15.148:3300/0 conn(0x7f11000c52a0 0x7f11000c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fe7fc700 1 -- 172.21.15.142:0/2485080908 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000c7f20 con 0x7f1100069f10 2023-09-30T22:53:06.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fe7fc700 1 --2- 172.21.15.142:0/2485080908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1100069f10 0x7f11000c5670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11000c9040 tx=0x7f10f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbc775f1591d537 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:06.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fdffb700 1 -- 172.21.15.142:0/2485080908 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400b640 con 0x7f1100069f10 2023-09-30T22:53:06.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fdffb700 1 -- 172.21.15.142:0/2485080908 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400b7a0 con 0x7f1100069f10 2023-09-30T22:53:06.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.173+0000 7f10fdffb700 1 -- 172.21.15.142:0/2485080908 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400bb40 con 0x7f1100069f10 2023-09-30T22:53:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 -- 172.21.15.142:0/2485080908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1100069f10 msgr2=0x7f11000c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 --2- 172.21.15.142:0/2485080908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1100069f10 0x7f11000c5670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11000c9040 tx=0x7f10f4009250 comp rx=0 tx=0).stop 2023-09-30T22:53:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 -- 172.21.15.142:0/2485080908 shutdown_connections 2023-09-30T22:53:06.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 --2- 172.21.15.142:0/2485080908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 --2- 172.21.15.142:0/2485080908 >> v2:172.21.15.148:3300/0 conn(0x7f11000c52a0 0x7f11000c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 --2- 172.21.15.142:0/2485080908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1100069f10 0x7f11000c5670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 -- 172.21.15.142:0/2485080908 >> 172.21.15.142:0/2485080908 conn(0x7f11000cc670 msgr2=0x7f11000cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:06.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 -- 172.21.15.142:0/2485080908 shutdown_connections 2023-09-30T22:53:06.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.174+0000 7f11053ff700 1 -- 172.21.15.142:0/2485080908 wait complete. 2023-09-30T22:53:06.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.176+0000 7f11053ff700 1 Processor -- start 2023-09-30T22:53:06.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.176+0000 7f11053ff700 1 -- start start 2023-09-30T22:53:06.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f11053ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1100069f10 0x7f11000c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f11053ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11000c52a0 0x7f110016a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f11053ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f11053ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c2c10 con 0x7f11000c52a0 2023-09-30T22:53:06.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f11053ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c2040 con 0x7f1100069f10 2023-09-30T22:53:06.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f11053ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c22e0 con 0x7f11000c5bb0 2023-09-30T22:53:06.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11000c52a0 0x7f110016a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11000c52a0 0x7f110016a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58480/0 (socket says 172.21.15.142:58480) 2023-09-30T22:53:06.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 -- 172.21.15.142:0/797821095 learned_addr learned my addr 172.21.15.142:0/797821095 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:06.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10feffd700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1100069f10 0x7f11000c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10ff7fe700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 -- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 msgr2=0x7f11000c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 -- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1100069f10 msgr2=0x7f11000c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1100069f10 0x7f11000c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10fe7fc700 1 -- 172.21.15.142:0/797821095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40094f0 con 0x7f11000c52a0 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.177+0000 7f10feffd700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1100069f10 0x7f11000c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.178+0000 7f10fe7fc700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11000c52a0 0x7f110016a110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10f40099b0 tx=0x7f10f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.178+0000 7f10e6ffd700 1 -- 172.21.15.142:0/797821095 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400bb20 con 0x7f11000c52a0 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.178+0000 7f10e6ffd700 1 -- 172.21.15.142:0/797821095 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4011420 con 0x7f11000c52a0 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.178+0000 7f10e6ffd700 1 -- 172.21.15.142:0/797821095 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40117c0 con 0x7f11000c52a0 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.178+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11000c25c0 con 0x7f11000c52a0 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.178+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110016a650 con 0x7f11000c52a0 2023-09-30T22:53:06.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.179+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1100069a50 con 0x7f11000c52a0 2023-09-30T22:53:06.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.180+0000 7f10e6ffd700 1 -- 172.21.15.142:0/797821095 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f10f4011bb0 con 0x7f11000c52a0 2023-09-30T22:53:06.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.181+0000 7f10e6ffd700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f10ec067330 0x7f10ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.181+0000 7f10e6ffd700 1 -- 172.21.15.142:0/797821095 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f10f4086590 con 0x7f11000c52a0 2023-09-30T22:53:06.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.181+0000 7f10feffd700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f10ec067330 0x7f10ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.182+0000 7f10feffd700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f10ec067330 0x7f10ec0697e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f110013f8f0 tx=0x7f10f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:06.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.185+0000 7f10e6ffd700 1 -- 172.21.15.142:0/797821095 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f10f40533f0 con 0x7f11000c52a0 2023-09-30T22:53:06.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.375+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11000c2d50 con 0x7f11000c52a0 2023-09-30T22:53:06.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.375+0000 7f10e6ffd700 1 -- 172.21.15.142:0/797821095 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f10f4011e60 con 0x7f11000c52a0 2023-09-30T22:53:06.377 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:53:06.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f10ec067330 msgr2=0x7f10ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f10ec067330 0x7f10ec0697e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f110013f8f0 tx=0x7f10f0008040 comp rx=0 tx=0).stop 2023-09-30T22:53:06.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11000c52a0 msgr2=0x7f110016a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11000c52a0 0x7f110016a110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10f40099b0 tx=0x7f10f4017000 comp rx=0 tx=0).stop 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 shutdown_connections 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f10ec067330 0x7f10ec0697e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11000c5bb0 0x7f11000c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1100069f10 0x7f11000c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 --2- 172.21.15.142:0/797821095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11000c52a0 0x7f110016a110 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 >> 172.21.15.142:0/797821095 conn(0x7f11000cc670 msgr2=0x7f110006dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 shutdown_connections 2023-09-30T22:53:06.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.378+0000 7f11053ff700 1 -- 172.21.15.142:0/797821095 wait complete. 2023-09-30T22:53:06.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:53:06.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.589+0000 7f46f47ff700 1 Processor -- start 2023-09-30T22:53:06.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.589+0000 7f46f47ff700 1 -- start start 2023-09-30T22:53:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.590+0000 7f46f47ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46ec159ba0 0x7f46ec06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.590+0000 7f46f47ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 0x7f46ec0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.590+0000 7f46f47ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec067d10 con 0x7f46ec0ca410 2023-09-30T22:53:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.590+0000 7f46f47ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0ca850 con 0x7f46ec159ba0 2023-09-30T22:53:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.590+0000 7f46f47ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec06af90 con 0x7f46ec0b0de0 2023-09-30T22:53:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.590+0000 7f46f2d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f46ec0ca410 0x7f46ec15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45402/0 (socket says 172.21.15.142:45402) 2023-09-30T22:53:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.590+0000 7f46f2d9c700 1 -- 172.21.15.142:0/3623157450 learned_addr learned my addr 172.21.15.142:0/3623157450 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f259b700 1 --2- 172.21.15.142:0/3623157450 >> v2:172.21.15.148:3300/0 conn(0x7f46ec159ba0 0x7f46ec06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 0x7f46ec0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495627856 0 0) 0x7f46ec067d10 con 0x7f46ec0ca410 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d8003570 con 0x7f46ec0ca410 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 138721940 0 0) 0x7f46d8003570 con 0x7f46ec0ca410 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 msgr2=0x7f46ec0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 0x7f46ec0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 >> v2:172.21.15.148:3300/0 conn(0x7f46ec159ba0 msgr2=0x7f46ec06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:06.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 --2- 172.21.15.142:0/3623157450 >> v2:172.21.15.148:3300/0 conn(0x7f46ec159ba0 0x7f46ec06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0676c0 con 0x7f46ec0ca410 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f46e40017f0 con 0x7f46ec0ca410 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 >> v1:172.21.15.142:6789/0 conn(0x7f46ec0ca410 legacy=0x7f46ec15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 0x7f46d8003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46d8004d50 0x7f46d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0ca850 con 0x7f46d80040b0 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec06af90 con 0x7f46d8004d50 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.591+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d800bb60 con 0x7f46ec0b0de0 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f259b700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 0x7f46d8003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f2d9c700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46d8004d50 0x7f46d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f1d9a700 1 -- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 msgr2=0x7f46d8003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec0b0de0 0x7f46d8003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f1d9a700 1 -- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46d8004d50 msgr2=0x7f46d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46d8004d50 0x7f46d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f1d9a700 1 -- 172.21.15.142:0/3623157450 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8003570 con 0x7f46d80040b0 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.592+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46d8004810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46dc006f00 tx=0x7f46dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fff3f737d5ea40 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00e710 con 0x7f46d80040b0 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00e870 con 0x7f46d80040b0 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f1599700 1 -- 172.21.15.142:0/3623157450 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00ec30 con 0x7f46d80040b0 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f47ff700 1 -- 172.21.15.142:0/3623157450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 msgr2=0x7f46d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f47ff700 1 --2- 172.21.15.142:0/3623157450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46d8004810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46dc006f00 tx=0x7f46dc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f2d9c700 1 -- 172.21.15.142:0/3623157450 reap_dead start 2023-09-30T22:53:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f47ff700 1 -- 172.21.15.142:0/3623157450 shutdown_connections 2023-09-30T22:53:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f47ff700 1 -- 172.21.15.142:0/3623157450 >> 172.21.15.142:0/3623157450 conn(0x7f46ec0cb2f0 msgr2=0x7f46ec0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f47ff700 1 -- 172.21.15.142:0/3623157450 shutdown_connections 2023-09-30T22:53:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.593+0000 7f46f47ff700 1 -- 172.21.15.142:0/3623157450 wait complete. 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.595+0000 7f46f47ff700 1 Processor -- start 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.595+0000 7f46f47ff700 1 -- start start 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f47ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46ec0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f47ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec169da0 0x7f46ec15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f47ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46ec16a210 0x7f46ec15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f47ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec15d130 con 0x7f46d80040b0 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f47ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec15c220 con 0x7f46ec16a210 2023-09-30T22:53:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f47ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec15af40 con 0x7f46ec169da0 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46ec0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46ec0c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58502/0 (socket says 172.21.15.142:58502) 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 -- 172.21.15.142:0/2274027240 learned_addr learned my addr 172.21.15.142:0/2274027240 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec169da0 0x7f46ec15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f2d9c700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46ec16a210 0x7f46ec15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 -- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec169da0 msgr2=0x7f46ec15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec169da0 0x7f46ec15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 -- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46ec16a210 msgr2=0x7f46ec15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46ec16a210 0x7f46ec15cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f259b700 1 -- 172.21.15.142:0/2274027240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec15ac60 con 0x7f46d80040b0 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.596+0000 7f46f2d9c700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46ec16a210 0x7f46ec15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.597+0000 7f46f259b700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46ec0c7cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f46e8011d40 tx=0x7f46e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.597+0000 7f46e27fc700 1 -- 172.21.15.142:0/2274027240 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800fac0 con 0x7f46d80040b0 2023-09-30T22:53:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.597+0000 7f46e27fc700 1 -- 172.21.15.142:0/2274027240 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e800fc20 con 0x7f46d80040b0 2023-09-30T22:53:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.597+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec15bbd0 con 0x7f46d80040b0 2023-09-30T22:53:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.597+0000 7f46e27fc700 1 -- 172.21.15.142:0/2274027240 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8014440 con 0x7f46d80040b0 2023-09-30T22:53:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.597+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec0c8210 con 0x7f46d80040b0 2023-09-30T22:53:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.598+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec06e4b0 con 0x7f46d80040b0 2023-09-30T22:53:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.599+0000 7f46e27fc700 1 -- 172.21.15.142:0/2274027240 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f46e8014870 con 0x7f46d80040b0 2023-09-30T22:53:06.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.600+0000 7f46e27fc700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f46d0067330 0x7f46d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:06.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.600+0000 7f46e27fc700 1 -- 172.21.15.142:0/2274027240 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46e8018030 con 0x7f46d80040b0 2023-09-30T22:53:06.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.600+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f46d0067330 0x7f46d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:06.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.600+0000 7f46f1d9a700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f46d0067330 0x7f46d00697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0091e0 tx=0x7f46dc01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:06.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.604+0000 7f46e27fc700 1 -- 172.21.15.142:0/2274027240 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f46e8052580 con 0x7f46d80040b0 2023-09-30T22:53:06.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.791+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46ec0679a0 con 0x7f46d80040b0 2023-09-30T22:53:06.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.792+0000 7f46e27fc700 1 -- 172.21.15.142:0/2274027240 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46e8055ba0 con 0x7f46d80040b0 2023-09-30T22:53:06.793 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f46d0067330 msgr2=0x7f46d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f46d0067330 0x7f46d00697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0091e0 tx=0x7f46dc01a000 comp rx=0 tx=0).stop 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 msgr2=0x7f46ec0c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46ec0c7cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f46e8011d40 tx=0x7f46e80091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 shutdown_connections 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f46d0067330 0x7f46d00697e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46ec16a210 0x7f46ec15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d80040b0 0x7f46ec0c7cd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 --2- 172.21.15.142:0/2274027240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46ec169da0 0x7f46ec15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:06.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.794+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 >> 172.21.15.142:0/2274027240 conn(0x7f46ec0cb2f0 msgr2=0x7f46ec0cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:06.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.795+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 shutdown_connections 2023-09-30T22:53:06.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:06.795+0000 7f46f47ff700 1 -- 172.21.15.142:0/2274027240 wait complete. 2023-09-30T22:53:06.813 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:53:07.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.005+0000 7fb0fe3ff700 1 Processor -- start 2023-09-30T22:53:07.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.005+0000 7fb0fe3ff700 1 -- start start 2023-09-30T22:53:07.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.006+0000 7fb0fe3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb0f80cbfe0 0x7fb0f815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.006+0000 7fb0fe3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb0f80cc3b0 0x7fb0f80cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0fe3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80d0550 con 0x7fb0f81573a0 2023-09-30T22:53:07.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0fe3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f80cf750 con 0x7fb0f80cbfe0 2023-09-30T22:53:07.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0fe3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f80cf940 con 0x7fb0f80cc3b0 2023-09-30T22:53:07.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb0f80cbfe0 0x7fb0f815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb0f80cbfe0 0x7fb0f815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58516/0 (socket says 172.21.15.142:58516) 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0fc99c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb0f81573a0 0x7fb0f815d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45410/0 (socket says 172.21.15.142:45410) 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f7fff700 1 -- 172.21.15.142:0/680350570 learned_addr learned my addr 172.21.15.142:0/680350570 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f77fe700 1 --2- 172.21.15.142:0/680350570 >> v2:172.21.15.148:3300/0 conn(0x7fb0f80cc3b0 0x7fb0f80cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f7fff700 1 -- 172.21.15.142:0/680350570 >> v2:172.21.15.148:3300/0 conn(0x7fb0f80cc3b0 msgr2=0x7fb0f80cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f7fff700 1 --2- 172.21.15.142:0/680350570 >> v2:172.21.15.148:3300/0 conn(0x7fb0f80cc3b0 0x7fb0f80cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f7fff700 1 -- 172.21.15.142:0/680350570 >> v1:172.21.15.142:6789/0 conn(0x7fb0f81573a0 legacy=0x7fb0f815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f7fff700 1 -- 172.21.15.142:0/680350570 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80cfc20 con 0x7fb0f80cbfe0 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.007+0000 7fb0f6ffd700 1 -- 172.21.15.142:0/680350570 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651107442 0 0) 0x7fb0f80d0550 con 0x7fb0f81573a0 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0f7fff700 1 --2- 172.21.15.142:0/680350570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f80cbfe0 0x7fb0f815a2a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ced20 tx=0x7fb0e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491473f397407072 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:07.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0f6ffd700 1 -- 172.21.15.142:0/680350570 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800b860 con 0x7fb0f80cbfe0 2023-09-30T22:53:07.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0f6ffd700 1 -- 172.21.15.142:0/680350570 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e800b9c0 con 0x7fb0f80cbfe0 2023-09-30T22:53:07.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0f6ffd700 1 -- 172.21.15.142:0/680350570 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800bd60 con 0x7fb0f80cbfe0 2023-09-30T22:53:07.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/680350570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f80cbfe0 msgr2=0x7fb0f815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/680350570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f80cbfe0 0x7fb0f815a2a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ced20 tx=0x7fb0e8009250 comp rx=0 tx=0).stop 2023-09-30T22:53:07.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/680350570 shutdown_connections 2023-09-30T22:53:07.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/680350570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f80cbfe0 0x7fb0f815a2a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/680350570 >> v2:172.21.15.148:3300/0 conn(0x7fb0f80cc3b0 0x7fb0f80cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.008+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/680350570 >> 172.21.15.142:0/680350570 conn(0x7fb0f80d0a80 msgr2=0x7fb0f80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:07.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.009+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/680350570 shutdown_connections 2023-09-30T22:53:07.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.009+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/680350570 wait complete. 2023-09-30T22:53:07.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.010+0000 7fb0fe3ff700 1 Processor -- start 2023-09-30T22:53:07.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.010+0000 7fb0fe3ff700 1 -- start start 2023-09-30T22:53:07.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fe3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0f80cbfe0 0x7fb0f8158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fe3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0f80cc3b0 0x7fb0f816a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fe3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f81573a0 0x7fb0f816aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fe3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f816b6f0 con 0x7fb0f81573a0 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fe3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f816bcb0 con 0x7fb0f80cc3b0 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fe3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80b85c0 con 0x7fb0f80cbfe0 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fc99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f81573a0 0x7fb0f816aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fc99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f81573a0 0x7fb0f816aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58526/0 (socket says 172.21.15.142:58526) 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0fc99c700 1 -- 172.21.15.142:0/2350144445 learned_addr learned my addr 172.21.15.142:0/2350144445 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.011+0000 7fb0f7fff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0f80cbfe0 0x7fb0f8158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0f77fe700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0f80cc3b0 0x7fb0f816a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fc99c700 1 -- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0f80cbfe0 msgr2=0x7fb0f8158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fc99c700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0f80cbfe0 0x7fb0f8158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fc99c700 1 -- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0f80cc3b0 msgr2=0x7fb0f816a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fc99c700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0f80cc3b0 0x7fb0f816a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fc99c700 1 -- 172.21.15.142:0/2350144445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80094f0 con 0x7fb0f81573a0 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0f77fe700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0f80cc3b0 0x7fb0f816a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fc99c700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f81573a0 0x7fb0f816aa10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000ccf0 tx=0x7fb0f0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0dffff700 1 -- 172.21.15.142:0/2350144445 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f000ce30 con 0x7fb0f81573a0 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0dffff700 1 -- 172.21.15.142:0/2350144445 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0005df0 con 0x7fb0f81573a0 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f8158cf0 con 0x7fb0f81573a0 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0dffff700 1 -- 172.21.15.142:0/2350144445 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f000ab70 con 0x7fb0f81573a0 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.012+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f816b940 con 0x7fb0f81573a0 2023-09-30T22:53:07.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.013+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f806b820 con 0x7fb0f81573a0 2023-09-30T22:53:07.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.014+0000 7fb0dffff700 1 -- 172.21.15.142:0/2350144445 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb0f00070f0 con 0x7fb0f81573a0 2023-09-30T22:53:07.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.015+0000 7fb0dffff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0e4067330 0x7fb0e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.015+0000 7fb0dffff700 1 -- 172.21.15.142:0/2350144445 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0f0084d20 con 0x7fb0f81573a0 2023-09-30T22:53:07.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.015+0000 7fb0f7fff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0e4067330 0x7fb0e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.016+0000 7fb0f7fff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0e4067330 0x7fb0e40697e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ced20 tx=0x7fb0e8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:07.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.019+0000 7fb0dffff700 1 -- 172.21.15.142:0/2350144445 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb0f0051ca0 con 0x7fb0f81573a0 2023-09-30T22:53:07.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.208+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0f806fc10 con 0x7fb0f81573a0 2023-09-30T22:53:07.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.208+0000 7fb0dffff700 1 -- 172.21.15.142:0/2350144445 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0f00552c0 con 0x7fb0f81573a0 2023-09-30T22:53:07.210 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:53:07.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.210+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0e4067330 msgr2=0x7fb0e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.210+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0e4067330 0x7fb0e40697e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ced20 tx=0x7fb0e8017000 comp rx=0 tx=0).stop 2023-09-30T22:53:07.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.210+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f81573a0 msgr2=0x7fb0f816aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.210+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f81573a0 0x7fb0f816aa10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000ccf0 tx=0x7fb0f0001a70 comp rx=0 tx=0).stop 2023-09-30T22:53:07.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 shutdown_connections 2023-09-30T22:53:07.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0e4067330 0x7fb0e40697e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f81573a0 0x7fb0f816aa10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0f80cbfe0 0x7fb0f8158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 --2- 172.21.15.142:0/2350144445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0f80cc3b0 0x7fb0f816a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 >> 172.21.15.142:0/2350144445 conn(0x7fb0f80d0a80 msgr2=0x7fb0f8156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:07.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 shutdown_connections 2023-09-30T22:53:07.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.211+0000 7fb0fe3ff700 1 -- 172.21.15.142:0/2350144445 wait complete. 2023-09-30T22:53:07.240 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-09-30T22:53:07.240 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-09-30T22:53:07.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-09-30T22:53:07.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.429+0000 7f09a759e700 1 Processor -- start 2023-09-30T22:53:07.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.429+0000 7f09a759e700 1 -- start start 2023-09-30T22:53:07.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09a806ab70 0x7f09a8069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09a80b3a50 0x7f09a8159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a759e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a806db20 con 0x7f09a806af40 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a806cf50 con 0x7f09a806ab70 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a759e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a806a450 con 0x7f09a80b3a50 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09a806ab70 0x7f09a8069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09a806ab70 0x7f09a8069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58536/0 (socket says 172.21.15.142:58536) 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.431+0000 7f09a659c700 1 -- 172.21.15.142:0/1203680748 learned_addr learned my addr 172.21.15.142:0/1203680748 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a5d9b700 1 --2- 172.21.15.142:0/1203680748 >> v2:172.21.15.148:3300/0 conn(0x7f09a80b3a50 0x7f09a8159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a659c700 1 -- 172.21.15.142:0/1203680748 >> v2:172.21.15.148:3300/0 conn(0x7f09a80b3a50 msgr2=0x7f09a8159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:07.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a659c700 1 --2- 172.21.15.142:0/1203680748 >> v2:172.21.15.148:3300/0 conn(0x7f09a80b3a50 0x7f09a8159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a659c700 1 -- 172.21.15.142:0/1203680748 >> v1:172.21.15.148:6789/0 conn(0x7f09a806af40 legacy=0x7f09a815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a659c700 1 -- 172.21.15.142:0/1203680748 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80cc8e0 con 0x7f09a806ab70 2023-09-30T22:53:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a5d9b700 1 --2- 172.21.15.142:0/1203680748 >> v2:172.21.15.148:3300/0 conn(0x7f09a80b3a50 0x7f09a8159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a659c700 1 --2- 172.21.15.142:0/1203680748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a8069f10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09a8064f60 tx=0x7f0998009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192bf66bc5cedab1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a559a700 1 -- 172.21.15.142:0/1203680748 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800b8b0 con 0x7f09a806ab70 2023-09-30T22:53:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a559a700 1 -- 172.21.15.142:0/1203680748 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800ba10 con 0x7f09a806ab70 2023-09-30T22:53:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.432+0000 7f09a559a700 1 -- 172.21.15.142:0/1203680748 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800bdb0 con 0x7f09a806ab70 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 -- 172.21.15.142:0/1203680748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 msgr2=0x7f09a8069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 --2- 172.21.15.142:0/1203680748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a8069f10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09a8064f60 tx=0x7f0998009250 comp rx=0 tx=0).stop 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 -- 172.21.15.142:0/1203680748 shutdown_connections 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 --2- 172.21.15.142:0/1203680748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a8069f10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 --2- 172.21.15.142:0/1203680748 >> v2:172.21.15.148:3300/0 conn(0x7f09a80b3a50 0x7f09a8159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 -- 172.21.15.142:0/1203680748 >> 172.21.15.142:0/1203680748 conn(0x7f09a80cd2e0 msgr2=0x7f09a80cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 -- 172.21.15.142:0/1203680748 shutdown_connections 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.433+0000 7f09a759e700 1 -- 172.21.15.142:0/1203680748 wait complete. 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.434+0000 7f09a759e700 1 Processor -- start 2023-09-30T22:53:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.435+0000 7f09a759e700 1 -- start start 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.435+0000 7f09a759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.435+0000 7f09a759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09a806af40 0x7f09a81559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.435+0000 7f09a759e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09a80b3a50 0x7f09a80c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.435+0000 7f09a759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80c6120 con 0x7f09a806ab70 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.435+0000 7f09a759e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8155ef0 con 0x7f09a806af40 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.435+0000 7f09a759e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80c7d90 con 0x7f09a80b3a50 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a815cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58548/0 (socket says 172.21.15.142:58548) 2023-09-30T22:53:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 -- 172.21.15.142:0/264701729 learned_addr learned my addr 172.21.15.142:0/264701729 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:07.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 -- 172.21.15.142:0/264701729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09a80b3a50 msgr2=0x7f09a80c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09a80b3a50 0x7f09a80c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 -- 172.21.15.142:0/264701729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09a806af40 msgr2=0x7f09a81559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09a806af40 0x7f09a81559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 -- 172.21.15.142:0/264701729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980094f0 con 0x7f09a806ab70 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09a659c700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a815cc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0998009290 tx=0x7f0998016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.436+0000 7f09967fc700 1 -- 172.21.15.142:0/264701729 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998011e60 con 0x7f09a806ab70 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.437+0000 7f09967fc700 1 -- 172.21.15.142:0/264701729 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998020070 con 0x7f09a806ab70 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.437+0000 7f09967fc700 1 -- 172.21.15.142:0/264701729 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099801b6a0 con 0x7f09a806ab70 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.437+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a815de10 con 0x7f09a806ab70 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.437+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a80c6300 con 0x7f09a806ab70 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.438+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a8064bc0 con 0x7f09a806ab70 2023-09-30T22:53:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.438+0000 7f09967fc700 1 -- 172.21.15.142:0/264701729 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0998022030 con 0x7f09a806ab70 2023-09-30T22:53:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.440+0000 7f09967fc700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0988067330 0x7f09880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.440+0000 7f09967fc700 1 -- 172.21.15.142:0/264701729 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0998086c80 con 0x7f09a806ab70 2023-09-30T22:53:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.440+0000 7f09a5d9b700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0988067330 0x7f09880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.440+0000 7f09a5d9b700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0988067330 0x7f09880697e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f099c006fd0 tx=0x7f099c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.444+0000 7f09967fc700 1 -- 172.21.15.142:0/264701729 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0998053ae0 con 0x7f09a806ab70 2023-09-30T22:53:07.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:07.707+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f09a8064bc0 con 0x7f09a806ab70 2023-09-30T22:53:08.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.434+0000 7f09967fc700 1 -- 172.21.15.142:0/264701729 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v56) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0998057100 con 0x7f09a806ab70 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0988067330 msgr2=0x7f09880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0988067330 0x7f09880697e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f099c006fd0 tx=0x7f099c008040 comp rx=0 tx=0).stop 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 msgr2=0x7f09a815cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a815cc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0998009290 tx=0x7f0998016000 comp rx=0 tx=0).stop 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 shutdown_connections 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0988067330 0x7f09880697e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09a80b3a50 0x7f09a80c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:08.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a806ab70 0x7f09a815cc80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:08.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 --2- 172.21.15.142:0/264701729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09a806af40 0x7f09a81559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:08.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.437+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 >> 172.21.15.142:0/264701729 conn(0x7f09a80cd2e0 msgr2=0x7f09a80cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:08.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.438+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 shutdown_connections 2023-09-30T22:53:08.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.438+0000 7f09a759e700 1 -- 172.21.15.142:0/264701729 wait complete. 2023-09-30T22:53:08.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-30T22:53:08.666 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_objectstore":"memstore"} 2023-09-30T22:53:08.666 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-30T22:53:08.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:53:08.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.857+0000 7f00487ff700 1 Processor -- start 2023-09-30T22:53:08.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.857+0000 7f00487ff700 1 -- start start 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.858+0000 7f00487ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00400cb350 0x7f00401615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.858+0000 7f00487ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400c7690 con 0x7f0040069f10 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f00487ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400c7f20 con 0x7f00400c52a0 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f00487ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00401406a0 con 0x7f00400cb350 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0046d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00400cb350 0x7f00401615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0045d9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0040069f10 0x7f00400c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45412/0 (socket says 172.21.15.142:45412) 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0046d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00400cb350 0x7f00401615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58552/0 (socket says 172.21.15.142:58552) 2023-09-30T22:53:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0045d9a700 1 -- 172.21.15.142:0/3007609699 learned_addr learned my addr 172.21.15.142:0/3007609699 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0046d9c700 1 -- 172.21.15.142:0/3007609699 >> v1:172.21.15.148:6789/0 conn(0x7f00400c52a0 legacy=0x7f00400c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0046d9c700 1 -- 172.21.15.142:0/3007609699 >> v1:172.21.15.142:6789/0 conn(0x7f0040069f10 legacy=0x7f00400c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0046d9c700 1 -- 172.21.15.142:0/3007609699 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004006a3f0 con 0x7f00400cb350 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.859+0000 7f0045599700 1 -- 172.21.15.142:0/3007609699 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794089155 0 0) 0x7f0030001110 con 0x7f0040069f10 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f0046d9c700 1 --2- 172.21.15.142:0/3007609699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00400cb350 0x7f00401615f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0038009e60 tx=0x7f0038009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f9f33389b76986 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f0045599700 1 -- 172.21.15.142:0/3007609699 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800e070 con 0x7f00400cb350 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f0045599700 1 -- 172.21.15.142:0/3007609699 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800bc30 con 0x7f00400cb350 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f0045599700 1 -- 172.21.15.142:0/3007609699 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038012430 con 0x7f00400cb350 2023-09-30T22:53:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f00487ff700 1 -- 172.21.15.142:0/3007609699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00400cb350 msgr2=0x7f00401615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f00487ff700 1 --2- 172.21.15.142:0/3007609699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00400cb350 0x7f00401615f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0038009e60 tx=0x7f0038009780 comp rx=0 tx=0).stop 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f00487ff700 1 -- 172.21.15.142:0/3007609699 shutdown_connections 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f00487ff700 1 --2- 172.21.15.142:0/3007609699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00400cb350 0x7f00401615f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f00487ff700 1 -- 172.21.15.142:0/3007609699 >> 172.21.15.142:0/3007609699 conn(0x7f00400cc670 msgr2=0x7f00400cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.860+0000 7f00487ff700 1 -- 172.21.15.142:0/3007609699 shutdown_connections 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.861+0000 7f00487ff700 1 -- 172.21.15.142:0/3007609699 wait complete. 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.862+0000 7f00487ff700 1 Processor -- start 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.862+0000 7f00487ff700 1 -- start start 2023-09-30T22:53:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f00487ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0040069f10 0x7f004015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f00487ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00400c52a0 0x7f0040156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f00487ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00400cb350 0x7f00400c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f00487ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004016c850 con 0x7f0040069f10 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f00487ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004016bc60 con 0x7f00400cb350 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f00487ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004016bf20 con 0x7f00400c52a0 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f004659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0040069f10 0x7f004015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f004659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0040069f10 0x7f004015dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58562/0 (socket says 172.21.15.142:58562) 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f004659b700 1 -- 172.21.15.142:0/726157341 learned_addr learned my addr 172.21.15.142:0/726157341 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.863+0000 7f0045d9a700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00400c52a0 0x7f0040156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:08.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f004659b700 1 -- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00400c52a0 msgr2=0x7f0040156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f0046d9c700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00400cb350 0x7f00400c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f004659b700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00400c52a0 0x7f0040156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f004659b700 1 -- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00400cb350 msgr2=0x7f00400c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f004659b700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00400cb350 0x7f00400c0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f004659b700 1 -- 172.21.15.142:0/726157341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009a20 con 0x7f0040069f10 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f0046d9c700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00400cb350 0x7f00400c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f004659b700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0040069f10 0x7f004015dea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f003c00c790 tx=0x7f003c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f00367fc700 1 -- 172.21.15.142:0/726157341 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c012630 con 0x7f0040069f10 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f00367fc700 1 -- 172.21.15.142:0/726157341 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c0127b0 con 0x7f0040069f10 2023-09-30T22:53:08.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f00367fc700 1 -- 172.21.15.142:0/726157341 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c012b70 con 0x7f0040069f10 2023-09-30T22:53:08.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004016c200 con 0x7f0040069f10 2023-09-30T22:53:08.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.864+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00401696b0 con 0x7f0040069f10 2023-09-30T22:53:08.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.865+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0040069a50 con 0x7f0040069f10 2023-09-30T22:53:08.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.866+0000 7f00367fc700 1 -- 172.21.15.142:0/726157341 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f003c01b400 con 0x7f0040069f10 2023-09-30T22:53:08.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.867+0000 7f00367fc700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0024067330 0x7f00240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:08.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.867+0000 7f00367fc700 1 -- 172.21.15.142:0/726157341 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f003c0847f0 con 0x7f0040069f10 2023-09-30T22:53:08.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.867+0000 7f0045d9a700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0024067330 0x7f00240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:08.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.868+0000 7f0045d9a700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0024067330 0x7f00240697e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f004015d5d0 tx=0x7f0030009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:08.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:08.871+0000 7f00367fc700 1 -- 172.21.15.142:0/726157341 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f003c051650 con 0x7f0040069f10 2023-09-30T22:53:09.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.062+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f004006f7f0 con 0x7f0040069f10 2023-09-30T22:53:09.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.066+0000 7f00367fc700 1 -- 172.21.15.142:0/726157341 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f003c054c70 con 0x7f0040069f10 2023-09-30T22:53:09.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.068+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0024067330 msgr2=0x7f00240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:09.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.068+0000 7f00487ff700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0024067330 0x7f00240697e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f004015d5d0 tx=0x7f0030009040 comp rx=0 tx=0).stop 2023-09-30T22:53:09.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0040069f10 msgr2=0x7f004015dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0040069f10 0x7f004015dea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f003c00c790 tx=0x7f003c007f60 comp rx=0 tx=0).stop 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 shutdown_connections 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0024067330 0x7f00240697e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00400cb350 0x7f00400c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0040069f10 0x7f004015dea0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 --2- 172.21.15.142:0/726157341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00400c52a0 0x7f0040156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 >> 172.21.15.142:0/726157341 conn(0x7f00400cc670 msgr2=0x7f004013c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 shutdown_connections 2023-09-30T22:53:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:09.069+0000 7f00487ff700 1 -- 172.21.15.142:0/726157341 wait complete. 2023-09-30T22:53:09.087 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:53:09.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:53:09.189 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:53:09.299 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:53:09.299 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:53:09.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:09.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-30T22:53:09.392 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:53:09.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:09.393 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:53:09.448 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:53:09.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:09.448 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-09-30T22:53:09.536 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:53:09.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:09.537 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:53:09.592 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-09-30T22:53:09.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:09.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-09-30T22:53:09.675 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:53:09.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:09.675 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-30T22:53:09.721 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-09-30T22:53:09.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:09.722 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-09-30T22:53:09.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:53:09.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:09.807 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-30T22:53:09.854 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:53:09.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:10.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.045+0000 7f8d16bff700 1 Processor -- start 2023-09-30T22:53:10.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.046+0000 7f8d16bff700 1 -- start start 2023-09-30T22:53:10.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d16bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d10159ae0 0x7f8d100cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d16bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d10069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d16bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1015d910 con 0x7f8d100b1180 2023-09-30T22:53:10.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d16bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1015e920 con 0x7f8d10159ae0 2023-09-30T22:53:10.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d16bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015e490 con 0x7f8d100cc590 2023-09-30T22:53:10.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d1499b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d10159ae0 0x7f8d100cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d0ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8d100b1180 0x7f8d100cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45418/0 (socket says 172.21.15.142:45418) 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d0ffff700 1 -- 172.21.15.142:0/3296605297 learned_addr learned my addr 172.21.15.142:0/3296605297 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.047+0000 7f8d1519c700 1 --2- 172.21.15.142:0/3296605297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d10069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d1499b700 1 -- 172.21.15.142:0/3296605297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 msgr2=0x7f8d10069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d1499b700 1 --2- 172.21.15.142:0/3296605297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d10069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d1499b700 1 -- 172.21.15.142:0/3296605297 >> v1:172.21.15.142:6789/0 conn(0x7f8d100b1180 legacy=0x7f8d100cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d1499b700 1 -- 172.21.15.142:0/3296605297 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1015db60 con 0x7f8d10159ae0 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d0f7fe700 1 -- 172.21.15.142:0/3296605297 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678376392 0 0) 0x7f8d1015d910 con 0x7f8d100b1180 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d1499b700 1 --2- 172.21.15.142:0/3296605297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d100cdeb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8d040098e0 tx=0x7f8d040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55e163a1295e896 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d0f7fe700 1 -- 172.21.15.142:0/3296605297 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400b640 con 0x7f8d10159ae0 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d0f7fe700 1 -- 172.21.15.142:0/3296605297 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0400b7a0 con 0x7f8d10159ae0 2023-09-30T22:53:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d0f7fe700 1 -- 172.21.15.142:0/3296605297 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400bb40 con 0x7f8d10159ae0 2023-09-30T22:53:10.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d16bff700 1 -- 172.21.15.142:0/3296605297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 msgr2=0x7f8d100cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.048+0000 7f8d16bff700 1 --2- 172.21.15.142:0/3296605297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d100cdeb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8d040098e0 tx=0x7f8d040091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.049+0000 7f8d16bff700 1 -- 172.21.15.142:0/3296605297 shutdown_connections 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.049+0000 7f8d16bff700 1 --2- 172.21.15.142:0/3296605297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d100cdeb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.049+0000 7f8d16bff700 1 --2- 172.21.15.142:0/3296605297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d10069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.049+0000 7f8d16bff700 1 -- 172.21.15.142:0/3296605297 >> 172.21.15.142:0/3296605297 conn(0x7f8d100ce8b0 msgr2=0x7f8d100cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.049+0000 7f8d16bff700 1 -- 172.21.15.142:0/3296605297 shutdown_connections 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.049+0000 7f8d16bff700 1 -- 172.21.15.142:0/3296605297 wait complete. 2023-09-30T22:53:10.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.050+0000 7f8d16bff700 1 Processor -- start 2023-09-30T22:53:10.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.050+0000 7f8d16bff700 1 -- start start 2023-09-30T22:53:10.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.051+0000 7f8d16bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d100b1180 0x7f8d100caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.051+0000 7f8d16bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d1015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.051+0000 7f8d16bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d1015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.051+0000 7f8d16bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100c91c0 con 0x7f8d10159ae0 2023-09-30T22:53:10.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.051+0000 7f8d16bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100c8840 con 0x7f8d100b1180 2023-09-30T22:53:10.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.051+0000 7f8d16bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100c8560 con 0x7f8d100cc590 2023-09-30T22:53:10.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d1015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d1015b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58582/0 (socket says 172.21.15.142:58582) 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 -- 172.21.15.142:0/1073426254 learned_addr learned my addr 172.21.15.142:0/1073426254 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d0ffff700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d1015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1499b700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d100b1180 0x7f8d100caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 -- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 msgr2=0x7f8d1015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d1015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 -- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d100b1180 msgr2=0x7f8d100caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d100b1180 0x7f8d100caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 -- 172.21.15.142:0/1073426254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04009420 con 0x7f8d10159ae0 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.052+0000 7f8d1519c700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d1015b3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009e90 tx=0x7f8d0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.053+0000 7f8d0cff9700 1 -- 172.21.15.142:0/1073426254 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800cb70 con 0x7f8d10159ae0 2023-09-30T22:53:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.053+0000 7f8d0cff9700 1 -- 172.21.15.142:0/1073426254 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0800f040 con 0x7f8d10159ae0 2023-09-30T22:53:10.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.053+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d100c8b70 con 0x7f8d10159ae0 2023-09-30T22:53:10.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.053+0000 7f8d0cff9700 1 -- 172.21.15.142:0/1073426254 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08014480 con 0x7f8d10159ae0 2023-09-30T22:53:10.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.053+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d100cb000 con 0x7f8d10159ae0 2023-09-30T22:53:10.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.054+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1006ea70 con 0x7f8d10159ae0 2023-09-30T22:53:10.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.055+0000 7f8d0cff9700 1 -- 172.21.15.142:0/1073426254 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8d08014830 con 0x7f8d10159ae0 2023-09-30T22:53:10.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.055+0000 7f8d0cff9700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cf4067330 0x7f8cf40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.056+0000 7f8d0cff9700 1 -- 172.21.15.142:0/1073426254 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d080856c0 con 0x7f8d10159ae0 2023-09-30T22:53:10.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.056+0000 7f8d1499b700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cf4067330 0x7f8cf40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.056+0000 7f8d1499b700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cf4067330 0x7f8cf40697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d040093f0 tx=0x7f8d04017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.060+0000 7f8d0cff9700 1 -- 172.21.15.142:0/1073426254 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8d08052520 con 0x7f8d10159ae0 2023-09-30T22:53:10.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.294+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d100c9300 con 0x7f8d10159ae0 2023-09-30T22:53:10.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.295+0000 7f8d0cff9700 1 -- 172.21.15.142:0/1073426254 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f8d0805b020 con 0x7f8d10159ae0 2023-09-30T22:53:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:10.296 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cf4067330 msgr2=0x7f8cf40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cf4067330 0x7f8cf40697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d040093f0 tx=0x7f8d04017000 comp rx=0 tx=0).stop 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 msgr2=0x7f8d1015b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d1015b3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009e90 tx=0x7f8d0800b040 comp rx=0 tx=0).stop 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 shutdown_connections 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cf4067330 0x7f8cf40697e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d10159ae0 0x7f8d1015b3c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d100b1180 0x7f8d100caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 --2- 172.21.15.142:0/1073426254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d100cc590 0x7f8d1015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 >> 172.21.15.142:0/1073426254 conn(0x7f8d100ce8b0 msgr2=0x7f8d100cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:10.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 shutdown_connections 2023-09-30T22:53:10.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.297+0000 7f8d16bff700 1 -- 172.21.15.142:0/1073426254 wait complete. 2023-09-30T22:53:10.300 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:53:10.316 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:10.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.506+0000 7f91cabff700 1 Processor -- start 2023-09-30T22:53:10.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.506+0000 7f91cabff700 1 -- start start 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.507+0000 7f91cabff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91c4157a90 0x7f91c415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.507+0000 7f91cabff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91c406b3d0 0x7f91c40b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.507+0000 7f91cabff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c406d470 con 0x7f91c40b1f40 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.507+0000 7f91cabff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c4157e60 con 0x7f91c406b3d0 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.507+0000 7f91cabff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40b2380 con 0x7f91c4157a90 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91c406b3d0 0x7f91c40b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91c406b3d0 0x7f91c40b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58588/0 (socket says 172.21.15.142:58588) 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 -- 172.21.15.142:0/3716495439 learned_addr learned my addr 172.21.15.142:0/3716495439 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c899b700 1 --2- 172.21.15.142:0/3716495439 >> v2:172.21.15.148:3300/0 conn(0x7f91c4157a90 0x7f91c415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 -- 172.21.15.142:0/3716495439 >> v2:172.21.15.148:3300/0 conn(0x7f91c4157a90 msgr2=0x7f91c415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 --2- 172.21.15.142:0/3716495439 >> v2:172.21.15.148:3300/0 conn(0x7f91c4157a90 0x7f91c415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 -- 172.21.15.142:0/3716495439 >> v1:172.21.15.148:6789/0 conn(0x7f91c40b1f40 legacy=0x7f91c4069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 -- 172.21.15.142:0/3716495439 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c415c430 con 0x7f91c406b3d0 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c899b700 1 --2- 172.21.15.142:0/3716495439 >> v2:172.21.15.148:3300/0 conn(0x7f91c4157a90 0x7f91c415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c3fff700 1 --2- 172.21.15.142:0/3716495439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c406b3d0 0x7f91c40b1a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91c406d1e0 tx=0x7f91b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f995bc5b44af1719 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.508+0000 7f91c37fe700 1 -- 172.21.15.142:0/3716495439 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000b820 con 0x7f91c406b3d0 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91c37fe700 1 -- 172.21.15.142:0/3716495439 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b000b980 con 0x7f91c406b3d0 2023-09-30T22:53:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91c37fe700 1 -- 172.21.15.142:0/3716495439 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000bd20 con 0x7f91c406b3d0 2023-09-30T22:53:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 -- 172.21.15.142:0/3716495439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c406b3d0 msgr2=0x7f91c40b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 --2- 172.21.15.142:0/3716495439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c406b3d0 0x7f91c40b1a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91c406d1e0 tx=0x7f91b0009250 comp rx=0 tx=0).stop 2023-09-30T22:53:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 -- 172.21.15.142:0/3716495439 shutdown_connections 2023-09-30T22:53:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 --2- 172.21.15.142:0/3716495439 >> v2:172.21.15.148:3300/0 conn(0x7f91c4157a90 0x7f91c415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 --2- 172.21.15.142:0/3716495439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c406b3d0 0x7f91c40b1a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 -- 172.21.15.142:0/3716495439 >> 172.21.15.142:0/3716495439 conn(0x7f91c40680c0 msgr2=0x7f91c40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 -- 172.21.15.142:0/3716495439 shutdown_connections 2023-09-30T22:53:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.509+0000 7f91cabff700 1 -- 172.21.15.142:0/3716495439 wait complete. 2023-09-30T22:53:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.511+0000 7f91cabff700 1 Processor -- start 2023-09-30T22:53:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.511+0000 7f91cabff700 1 -- start start 2023-09-30T22:53:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91cabff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91c406b3d0 0x7f91c4150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91cabff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c40b1f40 0x7f91c4153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91cabff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91c4157a90 0x7f91c40c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91cabff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40a54b0 con 0x7f91c40b1f40 2023-09-30T22:53:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91cabff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c416a1c0 con 0x7f91c4157a90 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91cabff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4151080 con 0x7f91c406b3d0 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c40b1f40 0x7f91c4153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c40b1f40 0x7f91c4153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58600/0 (socket says 172.21.15.142:58600) 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 -- 172.21.15.142:0/2910163528 learned_addr learned my addr 172.21.15.142:0/2910163528 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c899b700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91c406b3d0 0x7f91c4150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c919c700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91c4157a90 0x7f91c40c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 -- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91c406b3d0 msgr2=0x7f91c4150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91c406b3d0 0x7f91c4150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 -- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91c4157a90 msgr2=0x7f91c40c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91c4157a90 0x7f91c40c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c3fff700 1 -- 172.21.15.142:0/2910163528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00094f0 con 0x7f91c40b1f40 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c899b700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91c406b3d0 0x7f91c4150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.512+0000 7f91c919c700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91c4157a90 0x7f91c40c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.513+0000 7f91c3fff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c40b1f40 0x7f91c4153470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f91c4068600 tx=0x7f91b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.513+0000 7f91c0ff9700 1 -- 172.21.15.142:0/2910163528 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0011e20 con 0x7f91c40b1f40 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.513+0000 7f91c0ff9700 1 -- 172.21.15.142:0/2910163528 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0020070 con 0x7f91c40b1f40 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.513+0000 7f91c0ff9700 1 -- 172.21.15.142:0/2910163528 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b001b6a0 con 0x7f91c40b1f40 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.513+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4153ec0 con 0x7f91c40b1f40 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.513+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4154480 con 0x7f91c40b1f40 2023-09-30T22:53:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.514+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c416a370 con 0x7f91c40b1f40 2023-09-30T22:53:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.515+0000 7f91c0ff9700 1 -- 172.21.15.142:0/2910163528 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f91b0022030 con 0x7f91c40b1f40 2023-09-30T22:53:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.516+0000 7f91c0ff9700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91a8067330 0x7f91a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.516+0000 7f91c0ff9700 1 -- 172.21.15.142:0/2910163528 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f91b0086b10 con 0x7f91c40b1f40 2023-09-30T22:53:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.516+0000 7f91c899b700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91a8067330 0x7f91a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.517+0000 7f91c899b700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91a8067330 0x7f91a80697e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91b8008b20 tx=0x7f91b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.520+0000 7f91c0ff9700 1 -- 172.21.15.142:0/2910163528 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f91c416a370 con 0x7f91c40b1f40 2023-09-30T22:53:10.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.712+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91c416a370 con 0x7f91c40b1f40 2023-09-30T22:53:10.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.713+0000 7f91c0ff9700 1 -- 172.21.15.142:0/2910163528 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f91c416a370 con 0x7f91c40b1f40 2023-09-30T22:53:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:10.715 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:10.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.715+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91a8067330 msgr2=0x7f91a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.715+0000 7f91cabff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91a8067330 0x7f91a80697e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91b8008b20 tx=0x7f91b8008040 comp rx=0 tx=0).stop 2023-09-30T22:53:10.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c40b1f40 msgr2=0x7f91c4153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c40b1f40 0x7f91c4153470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f91c4068600 tx=0x7f91b0016000 comp rx=0 tx=0).stop 2023-09-30T22:53:10.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 shutdown_connections 2023-09-30T22:53:10.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91a8067330 0x7f91a80697e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91c4157a90 0x7f91c40c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91c406b3d0 0x7f91c4150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 --2- 172.21.15.142:0/2910163528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c40b1f40 0x7f91c4153470 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 >> 172.21.15.142:0/2910163528 conn(0x7f91c40680c0 msgr2=0x7f91c4151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:10.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 shutdown_connections 2023-09-30T22:53:10.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.716+0000 7f91cabff700 1 -- 172.21.15.142:0/2910163528 wait complete. 2023-09-30T22:53:10.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:52:27.833414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:52:28.438662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:53:10.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:53:10.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.927+0000 7fc4dbfff700 1 Processor -- start 2023-09-30T22:53:10.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.927+0000 7fc4dbfff700 1 -- start start 2023-09-30T22:53:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.928+0000 7fc4dbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc4d40b0de0 0x7fc4d406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.928+0000 7fc4dbfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d4067d10 con 0x7fc4d4159ba0 2023-09-30T22:53:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.928+0000 7fc4dbfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d406af90 con 0x7fc4d40ca5e0 2023-09-30T22:53:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.928+0000 7fc4dbfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d40676c0 con 0x7fc4d40b0de0 2023-09-30T22:53:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4da59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc4d40b0de0 0x7fc4d406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4d9d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc4d4159ba0 0x7fc4d40c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42558/0 (socket says 172.21.15.142:42558) 2023-09-30T22:53:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4d9d9b700 1 -- 172.21.15.142:0/1378226000 learned_addr learned my addr 172.21.15.142:0/1378226000 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:10.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4d8d99700 1 -- 172.21.15.142:0/1378226000 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342989710 0 0) 0x7fc4d4067d10 con 0x7fc4d4159ba0 2023-09-30T22:53:10.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4d8d99700 1 -- 172.21.15.142:0/1378226000 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c0003570 con 0x7fc4d4159ba0 2023-09-30T22:53:10.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4d8d99700 1 -- 172.21.15.142:0/1378226000 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269278776 0 0) 0x7fc4d406af90 con 0x7fc4d40ca5e0 2023-09-30T22:53:10.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4da59c700 1 -- 172.21.15.142:0/1378226000 >> v1:172.21.15.148:6789/0 conn(0x7fc4d40ca5e0 legacy=0x7fc4d40681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4da59c700 1 -- 172.21.15.142:0/1378226000 >> v1:172.21.15.142:6789/0 conn(0x7fc4d4159ba0 legacy=0x7fc4d40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4da59c700 1 -- 172.21.15.142:0/1378226000 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40679a0 con 0x7fc4d40b0de0 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.929+0000 7fc4da59c700 1 --2- 172.21.15.142:0/1378226000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d406a8d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009e60 tx=0x7fc4cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff86f86dee2b478 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4d8d99700 1 -- 172.21.15.142:0/1378226000 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00e070 con 0x7fc4d40b0de0 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4d8d99700 1 -- 172.21.15.142:0/1378226000 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc00bb60 con 0x7fc4d40b0de0 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4d8d99700 1 -- 172.21.15.142:0/1378226000 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00bee0 con 0x7fc4d40b0de0 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4dbfff700 1 -- 172.21.15.142:0/1378226000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 msgr2=0x7fc4d406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/1378226000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d406a8d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009e60 tx=0x7fc4cc009780 comp rx=0 tx=0).stop 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4dbfff700 1 -- 172.21.15.142:0/1378226000 shutdown_connections 2023-09-30T22:53:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/1378226000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d406a8d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4dbfff700 1 -- 172.21.15.142:0/1378226000 >> 172.21.15.142:0/1378226000 conn(0x7fc4d40cb2f0 msgr2=0x7fc4d40cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4dbfff700 1 -- 172.21.15.142:0/1378226000 shutdown_connections 2023-09-30T22:53:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.930+0000 7fc4dbfff700 1 -- 172.21.15.142:0/1378226000 wait complete. 2023-09-30T22:53:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.932+0000 7fc4dbfff700 1 Processor -- start 2023-09-30T22:53:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.933+0000 7fc4dbfff700 1 -- start start 2023-09-30T22:53:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4dbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4dbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4d40ca5e0 0x7fc4d414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4dbfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4d4159ba0 0x7fc4d40b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4dbfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d414d2b0 con 0x7fc4d40b0de0 2023-09-30T22:53:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4dbfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d415b0f0 con 0x7fc4d40ca5e0 2023-09-30T22:53:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4dbfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d415a4e0 con 0x7fc4d4159ba0 2023-09-30T22:53:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39104/0 (socket says 172.21.15.142:39104) 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 -- 172.21.15.142:0/497182505 learned_addr learned my addr 172.21.15.142:0/497182505 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4da59c700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4d4159ba0 0x7fc4d40b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d959a700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4d40ca5e0 0x7fc4d414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 -- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4d4159ba0 msgr2=0x7fc4d40b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4d4159ba0 0x7fc4d40b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 -- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4d40ca5e0 msgr2=0x7fc4d414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4d40ca5e0 0x7fc4d414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d9d9b700 1 -- 172.21.15.142:0/497182505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc009a20 con 0x7fc4d40b0de0 2023-09-30T22:53:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.934+0000 7fc4d959a700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4d40ca5e0 0x7fc4d414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.935+0000 7fc4d9d9b700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d415e280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c590 tx=0x7fc4d0007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.935+0000 7fc4c9ffb700 1 -- 172.21.15.142:0/497182505 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0005b30 con 0x7fc4d40b0de0 2023-09-30T22:53:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.935+0000 7fc4c9ffb700 1 -- 172.21.15.142:0/497182505 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d0005c90 con 0x7fc4d40b0de0 2023-09-30T22:53:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.935+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d415a7c0 con 0x7fc4d40b0de0 2023-09-30T22:53:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.935+0000 7fc4c9ffb700 1 -- 172.21.15.142:0/497182505 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0007320 con 0x7fc4d40b0de0 2023-09-30T22:53:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.935+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d415ad80 con 0x7fc4d40b0de0 2023-09-30T22:53:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.936+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d406e4b0 con 0x7fc4d40b0de0 2023-09-30T22:53:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.937+0000 7fc4c9ffb700 1 -- 172.21.15.142:0/497182505 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc4d0007690 con 0x7fc4d40b0de0 2023-09-30T22:53:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.938+0000 7fc4c9ffb700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc4b8067330 0x7fc4b80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.938+0000 7fc4c9ffb700 1 -- 172.21.15.142:0/497182505 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc4d0084000 con 0x7fc4d40b0de0 2023-09-30T22:53:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.938+0000 7fc4d959a700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc4b8067330 0x7fc4b80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.939+0000 7fc4d959a700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc4b8067330 0x7fc4b80697e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40c28b0 tx=0x7fc4c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:10.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:10.942+0000 7fc4c9ffb700 1 -- 172.21.15.142:0/497182505 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc4d0050f00 con 0x7fc4d40b0de0 2023-09-30T22:53:11.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.129+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4d40cac40 con 0x7fc4d40b0de0 2023-09-30T22:53:11.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.130+0000 7fc4c9ffb700 1 -- 172.21.15.142:0/497182505 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4d0017020 con 0x7fc4d40b0de0 2023-09-30T22:53:11.131 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc4b8067330 msgr2=0x7fc4b80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc4b8067330 0x7fc4b80697e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40c28b0 tx=0x7fc4c4009040 comp rx=0 tx=0).stop 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 msgr2=0x7fc4d415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d415e280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c590 tx=0x7fc4d0007e80 comp rx=0 tx=0).stop 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 shutdown_connections 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc4b8067330 0x7fc4b80697e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4d4159ba0 0x7fc4d40b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4d40b0de0 0x7fc4d415e280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 --2- 172.21.15.142:0/497182505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4d40ca5e0 0x7fc4d414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 >> 172.21.15.142:0/497182505 conn(0x7fc4d40cb2f0 msgr2=0x7fc4d40b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:11.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 shutdown_connections 2023-09-30T22:53:11.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.132+0000 7fc4dbfff700 1 -- 172.21.15.142:0/497182505 wait complete. 2023-09-30T22:53:11.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:53:11.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.342+0000 7fd8eafff700 1 Processor -- start 2023-09-30T22:53:11.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.342+0000 7fd8eafff700 1 -- start start 2023-09-30T22:53:11.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.343+0000 7fd8eafff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8e4159ba0 0x7fd8e406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8eafff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e4067d10 con 0x7fd8e40b0de0 2023-09-30T22:53:11.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8eafff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e406af90 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8eafff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40676c0 con 0x7fd8e4159ba0 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8e8d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8e4159ba0 0x7fd8e406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8e3fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd8e40b0de0 0x7fd8e40c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42562/0 (socket says 172.21.15.142:42562) 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8e3fff700 1 -- 172.21.15.142:0/3184862032 learned_addr learned my addr 172.21.15.142:0/3184862032 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8e8d9b700 1 -- 172.21.15.142:0/3184862032 >> v1:172.21.15.148:6789/0 conn(0x7fd8e40ca5e0 legacy=0x7fd8e40681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8e37fe700 1 -- 172.21.15.142:0/3184862032 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520880160 0 0) 0x7fd8e4067d10 con 0x7fd8e40b0de0 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8e8d9b700 1 -- 172.21.15.142:0/3184862032 >> v1:172.21.15.142:6789/0 conn(0x7fd8e40b0de0 legacy=0x7fd8e40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.344+0000 7fd8e8d9b700 1 -- 172.21.15.142:0/3184862032 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40679a0 con 0x7fd8e4159ba0 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8e8d9b700 1 --2- 172.21.15.142:0/3184862032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e4159ba0 0x7fd8e406a8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80098e0 tx=0x7fd8d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a530f9f5d2dbba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8e37fe700 1 -- 172.21.15.142:0/3184862032 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8009e80 con 0x7fd8e4159ba0 2023-09-30T22:53:11.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8e37fe700 1 -- 172.21.15.142:0/3184862032 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800b820 con 0x7fd8e4159ba0 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8e37fe700 1 -- 172.21.15.142:0/3184862032 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800bba0 con 0x7fd8e4159ba0 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8eafff700 1 -- 172.21.15.142:0/3184862032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e4159ba0 msgr2=0x7fd8e406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8eafff700 1 --2- 172.21.15.142:0/3184862032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e4159ba0 0x7fd8e406a8d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80098e0 tx=0x7fd8d80091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8eafff700 1 -- 172.21.15.142:0/3184862032 shutdown_connections 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8eafff700 1 --2- 172.21.15.142:0/3184862032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e4159ba0 0x7fd8e406a8d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.345+0000 7fd8eafff700 1 -- 172.21.15.142:0/3184862032 >> 172.21.15.142:0/3184862032 conn(0x7fd8e40cb2f0 msgr2=0x7fd8e40cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.346+0000 7fd8eafff700 1 -- 172.21.15.142:0/3184862032 shutdown_connections 2023-09-30T22:53:11.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.346+0000 7fd8eafff700 1 -- 172.21.15.142:0/3184862032 wait complete. 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.347+0000 7fd8eafff700 1 Processor -- start 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.347+0000 7fd8eafff700 1 -- start start 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8eafff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8e40b0de0 0x7fd8e4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8eafff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e40ca5e0 0x7fd8e40b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8eafff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8e4159ba0 0x7fd8e40b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8eafff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e416aee0 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8eafff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e415b430 con 0x7fd8e40b0de0 2023-09-30T22:53:11.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8eafff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e416a5b0 con 0x7fd8e4159ba0 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8e3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e40ca5e0 0x7fd8e40b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8e3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e40ca5e0 0x7fd8e40b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39122/0 (socket says 172.21.15.142:39122) 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8e3fff700 1 -- 172.21.15.142:0/4074719654 learned_addr learned my addr 172.21.15.142:0/4074719654 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.348+0000 7fd8e8d9b700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8e40b0de0 0x7fd8e4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e959c700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8e4159ba0 0x7fd8e40b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e3fff700 1 -- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8e4159ba0 msgr2=0x7fd8e40b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e3fff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8e4159ba0 0x7fd8e40b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e3fff700 1 -- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8e40b0de0 msgr2=0x7fd8e4154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e3fff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8e40b0de0 0x7fd8e4154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e3fff700 1 -- 172.21.15.142:0/4074719654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8009420 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e3fff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e40ca5e0 0x7fd8e40b31a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000c810 tx=0x7fd8d0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e0ff9700 1 -- 172.21.15.142:0/4074719654 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0005b30 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e0ff9700 1 -- 172.21.15.142:0/4074719654 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0005c90 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8e0ff9700 1 -- 172.21.15.142:0/4074719654 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0007300 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.349+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e416a890 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.350+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e416b370 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.350+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e416b090 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.351+0000 7fd8e0ff9700 1 -- 172.21.15.142:0/4074719654 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd8d001b3b0 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.352+0000 7fd8e0ff9700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd8c8067330 0x7fd8c80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.352+0000 7fd8e0ff9700 1 -- 172.21.15.142:0/4074719654 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8d0084210 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.352+0000 7fd8e8d9b700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd8c8067330 0x7fd8c80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.353+0000 7fd8e8d9b700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd8c8067330 0x7fd8c80697e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80030c0 tx=0x7fd8d8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:11.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.357+0000 7fd8e0ff9700 1 -- 172.21.15.142:0/4074719654 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd8e416b090 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.546+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8e416b020 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.546+0000 7fd8e0ff9700 1 -- 172.21.15.142:0/4074719654 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd8d0051070 con 0x7fd8e40ca5e0 2023-09-30T22:53:11.548 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:53:11.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd8c8067330 msgr2=0x7fd8c80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd8c8067330 0x7fd8c80697e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80030c0 tx=0x7fd8d8016000 comp rx=0 tx=0).stop 2023-09-30T22:53:11.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e40ca5e0 msgr2=0x7fd8e40b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e40ca5e0 0x7fd8e40b31a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000c810 tx=0x7fd8d0007df0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 shutdown_connections 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd8c8067330 0x7fd8c80697e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8e4159ba0 0x7fd8e40b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8e40b0de0 0x7fd8e4154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 --2- 172.21.15.142:0/4074719654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e40ca5e0 0x7fd8e40b31a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 >> 172.21.15.142:0/4074719654 conn(0x7fd8e40cb2f0 msgr2=0x7fd8e40cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 shutdown_connections 2023-09-30T22:53:11.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.549+0000 7fd8eafff700 1 -- 172.21.15.142:0/4074719654 wait complete. 2023-09-30T22:53:11.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:53:11.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.757+0000 7faa09fff700 1 Processor -- start 2023-09-30T22:53:11.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.757+0000 7faa09fff700 1 -- start start 2023-09-30T22:53:11.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.758+0000 7faa09fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c52a0 0x7faa040c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.758+0000 7faa09fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa04069f10 0x7faa040c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.758+0000 7faa09fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa040c7690 con 0x7faa040c5bb0 2023-09-30T22:53:11.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.758+0000 7faa09fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa041406a0 con 0x7faa04069f10 2023-09-30T22:53:11.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.758+0000 7faa09fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c3a50 con 0x7faa040c52a0 2023-09-30T22:53:11.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.758+0000 7faa02ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa04069f10 0x7faa040c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa02ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa04069f10 0x7faa040c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39124/0 (socket says 172.21.15.142:39124) 2023-09-30T22:53:11.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa02ffd700 1 -- 172.21.15.142:0/623909350 learned_addr learned my addr 172.21.15.142:0/623909350 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:11.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa037fe700 1 --2- 172.21.15.142:0/623909350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c52a0 0x7faa040c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa02ffd700 1 -- 172.21.15.142:0/623909350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c52a0 msgr2=0x7faa040c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:11.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa02ffd700 1 --2- 172.21.15.142:0/623909350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c52a0 0x7faa040c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa02ffd700 1 -- 172.21.15.142:0/623909350 >> v1:172.21.15.148:6789/0 conn(0x7faa040c5bb0 legacy=0x7faa040ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa02ffd700 1 -- 172.21.15.142:0/623909350 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040c7f20 con 0x7faa04069f10 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa02ffd700 1 --2- 172.21.15.142:0/623909350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa04069f10 0x7faa040c5670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009a10 tx=0x7fa9f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b34c2031cb686a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.759+0000 7faa027fc700 1 -- 172.21.15.142:0/623909350 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800b7e0 con 0x7faa04069f10 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa027fc700 1 -- 172.21.15.142:0/623909350 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800b940 con 0x7faa04069f10 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa027fc700 1 -- 172.21.15.142:0/623909350 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800bce0 con 0x7faa04069f10 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 -- 172.21.15.142:0/623909350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa04069f10 msgr2=0x7faa040c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 --2- 172.21.15.142:0/623909350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa04069f10 0x7faa040c5670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009a10 tx=0x7fa9f8009250 comp rx=0 tx=0).stop 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 -- 172.21.15.142:0/623909350 shutdown_connections 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 --2- 172.21.15.142:0/623909350 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c52a0 0x7faa040c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 --2- 172.21.15.142:0/623909350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa04069f10 0x7faa040c5670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 -- 172.21.15.142:0/623909350 >> 172.21.15.142:0/623909350 conn(0x7faa040cc670 msgr2=0x7faa040cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 -- 172.21.15.142:0/623909350 shutdown_connections 2023-09-30T22:53:11.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.760+0000 7faa09fff700 1 -- 172.21.15.142:0/623909350 wait complete. 2023-09-30T22:53:11.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.762+0000 7faa09fff700 1 Processor -- start 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.762+0000 7faa09fff700 1 -- start start 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa09fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04069f10 0x7faa0413f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa09fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040c52a0 0x7faa0413f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa09fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c5bb0 0x7faa0415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa09fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0413e860 con 0x7faa040c52a0 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa09fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c04f0 con 0x7faa04069f10 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa09fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c01f0 con 0x7faa040c5bb0 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040c52a0 0x7faa0413f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040c52a0 0x7faa0413f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39126/0 (socket says 172.21.15.142:39126) 2023-09-30T22:53:11.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 -- 172.21.15.142:0/296366705 learned_addr learned my addr 172.21.15.142:0/296366705 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa037fe700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04069f10 0x7faa0413f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa03fff700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c5bb0 0x7faa0415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 -- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c5bb0 msgr2=0x7faa0415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c5bb0 0x7faa0415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 -- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04069f10 msgr2=0x7faa0413f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04069f10 0x7faa0413f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.763+0000 7faa02ffd700 1 -- 172.21.15.142:0/296366705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80094f0 con 0x7faa040c52a0 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.764+0000 7faa02ffd700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040c52a0 0x7faa0413f740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa0406c260 tx=0x7fa9f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.764+0000 7fa9eb7fe700 1 -- 172.21.15.142:0/296366705 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800bcc0 con 0x7faa040c52a0 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.764+0000 7fa9eb7fe700 1 -- 172.21.15.142:0/296366705 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800be90 con 0x7faa040c52a0 2023-09-30T22:53:11.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.764+0000 7fa9eb7fe700 1 -- 172.21.15.142:0/296366705 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8024670 con 0x7faa040c52a0 2023-09-30T22:53:11.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.764+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0415cd50 con 0x7faa040c52a0 2023-09-30T22:53:11.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.764+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0415d310 con 0x7faa040c52a0 2023-09-30T22:53:11.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.765+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa040c0680 con 0x7faa040c52a0 2023-09-30T22:53:11.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.766+0000 7fa9eb7fe700 1 -- 172.21.15.142:0/296366705 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa9f802d440 con 0x7faa040c52a0 2023-09-30T22:53:11.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.767+0000 7fa9eb7fe700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa9f0067330 0x7fa9f00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:11.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.767+0000 7fa9eb7fe700 1 -- 172.21.15.142:0/296366705 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9f8086510 con 0x7faa040c52a0 2023-09-30T22:53:11.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.767+0000 7faa037fe700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa9f0067330 0x7fa9f00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:11.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.768+0000 7faa037fe700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa9f0067330 0x7fa9f00697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009db0 tx=0x7fa9f40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:11.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.771+0000 7fa9eb7fe700 1 -- 172.21.15.142:0/296366705 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa9f8053370 con 0x7faa040c52a0 2023-09-30T22:53:11.898 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:11.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:11.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.963+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa0415a2d0 con 0x7faa040c52a0 2023-09-30T22:53:11.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.963+0000 7fa9eb7fe700 1 -- 172.21.15.142:0/296366705 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa9f8056990 con 0x7faa040c52a0 2023-09-30T22:53:11.965 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:53:11.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa9f0067330 msgr2=0x7fa9f00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa9f0067330 0x7fa9f00697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009db0 tx=0x7fa9f40091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040c52a0 msgr2=0x7faa0413f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040c52a0 0x7faa0413f740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa0406c260 tx=0x7fa9f8017000 comp rx=0 tx=0).stop 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 shutdown_connections 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa9f0067330 0x7fa9f00697e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa040c5bb0 0x7faa0415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04069f10 0x7faa0413f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 --2- 172.21.15.142:0/296366705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa040c52a0 0x7faa0413f740 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 >> 172.21.15.142:0/296366705 conn(0x7faa040cc670 msgr2=0x7faa040cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 shutdown_connections 2023-09-30T22:53:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:11.966+0000 7faa09fff700 1 -- 172.21.15.142:0/296366705 wait complete. 2023-09-30T22:53:11.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:53:12.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.178+0000 7f2131bff700 1 Processor -- start 2023-09-30T22:53:12.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.178+0000 7f2131bff700 1 -- start start 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.179+0000 7f2131bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.179+0000 7f2131bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f212c067620 0x7f212c067aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.179+0000 7f2131bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c06b650 con 0x7f212c159f10 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.179+0000 7f2131bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c067fe0 con 0x7f212c067620 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.179+0000 7f2131bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c06aa40 con 0x7f212c159b40 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f212c067620 0x7f212c067aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212b7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f212c159f10 0x7f212c0683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:43830/0 (socket says 172.21.15.142:43830) 2023-09-30T22:53:12.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212affd700 1 -- 172.21.15.142:0/1366466821 learned_addr learned my addr 172.21.15.142:0/1366466821 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:12.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212a7fc700 1 -- 172.21.15.142:0/1366466821 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693571416 0 0) 0x7f212c06b650 con 0x7f212c159f10 2023-09-30T22:53:12.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212b7fe700 1 -- 172.21.15.142:0/1366466821 >> v2:172.21.15.142:3300/0 conn(0x7f212c067620 msgr2=0x7f212c067aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:12.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212b7fe700 1 --2- 172.21.15.142:0/1366466821 >> v2:172.21.15.142:3300/0 conn(0x7f212c067620 0x7f212c067aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212b7fe700 1 -- 172.21.15.142:0/1366466821 >> v1:172.21.15.148:6789/0 conn(0x7f212c159f10 legacy=0x7f212c0683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212b7fe700 1 -- 172.21.15.142:0/1366466821 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c06ad20 con 0x7f212c159b40 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.180+0000 7f212bfff700 1 --2- 172.21.15.142:0/1366466821 >> v2:172.21.15.142:3300/0 conn(0x7f212c067620 0x7f212c067aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.181+0000 7f212b7fe700 1 --2- 172.21.15.142:0/1366466821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c06a360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f211c0098e0 tx=0x7f211c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=966a486cddcb1c57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.181+0000 7f212a7fc700 1 -- 172.21.15.142:0/1366466821 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00b640 con 0x7f212c159b40 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.181+0000 7f212a7fc700 1 -- 172.21.15.142:0/1366466821 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c00b7a0 con 0x7f212c159b40 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.181+0000 7f212a7fc700 1 -- 172.21.15.142:0/1366466821 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00bb40 con 0x7f212c159b40 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.181+0000 7f2131bff700 1 -- 172.21.15.142:0/1366466821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 msgr2=0x7f212c06a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.181+0000 7f2131bff700 1 --2- 172.21.15.142:0/1366466821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c06a360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f211c0098e0 tx=0x7f211c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.182+0000 7f2131bff700 1 -- 172.21.15.142:0/1366466821 shutdown_connections 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.182+0000 7f2131bff700 1 --2- 172.21.15.142:0/1366466821 >> v2:172.21.15.142:3300/0 conn(0x7f212c067620 0x7f212c067aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.182+0000 7f2131bff700 1 --2- 172.21.15.142:0/1366466821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c06a360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.182+0000 7f2131bff700 1 -- 172.21.15.142:0/1366466821 >> 172.21.15.142:0/1366466821 conn(0x7f212c0c9950 msgr2=0x7f212c0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:12.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.182+0000 7f2131bff700 1 -- 172.21.15.142:0/1366466821 shutdown_connections 2023-09-30T22:53:12.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.182+0000 7f2131bff700 1 -- 172.21.15.142:0/1366466821 wait complete. 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.183+0000 7f2131bff700 1 Processor -- start 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.183+0000 7f2131bff700 1 -- start start 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f2131bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f212c067620 0x7f212c14ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f2131bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f2131bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f212c159f10 0x7f212c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f2131bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c14d370 con 0x7f212c159f10 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f2131bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0b1e80 con 0x7f212c067620 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f2131bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0b1270 con 0x7f212c159b40 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f212bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f212c159f10 0x7f212c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f212bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f212c159f10 0x7f212c15d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39146/0 (socket says 172.21.15.142:39146) 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.184+0000 7f212bfff700 1 -- 172.21.15.142:0/1610784313 learned_addr learned my addr 172.21.15.142:0/1610784313 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212b7fe700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f212c067620 0x7f212c14ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212affd700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212bfff700 1 -- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 msgr2=0x7f212c15bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212bfff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c15bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212bfff700 1 -- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f212c067620 msgr2=0x7f212c14ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212bfff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f212c067620 0x7f212c14ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212bfff700 1 -- 172.21.15.142:0/1610784313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009a20 con 0x7f212c159f10 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f212bfff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f212c159f10 0x7f212c15d650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2124009f20 tx=0x7f212400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f21137fe700 1 -- 172.21.15.142:0/1610784313 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212400cb70 con 0x7f212c159f10 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f21137fe700 1 -- 172.21.15.142:0/1610784313 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212400f040 con 0x7f212c159f10 2023-09-30T22:53:12.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c009420 con 0x7f212c159f10 2023-09-30T22:53:12.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.185+0000 7f21137fe700 1 -- 172.21.15.142:0/1610784313 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124014480 con 0x7f212c159f10 2023-09-30T22:53:12.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.186+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c0b18b0 con 0x7f212c159f10 2023-09-30T22:53:12.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.186+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c0b1c30 con 0x7f212c159f10 2023-09-30T22:53:12.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.187+0000 7f21137fe700 1 -- 172.21.15.142:0/1610784313 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2124003020 con 0x7f212c159f10 2023-09-30T22:53:12.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.189+0000 7f21137fe700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2118067330 0x7f21180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.189+0000 7f21137fe700 1 -- 172.21.15.142:0/1610784313 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2124085470 con 0x7f212c159f10 2023-09-30T22:53:12.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.189+0000 7f212b7fe700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2118067330 0x7f21180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.189+0000 7f212b7fe700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2118067330 0x7f21180697e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f211c0091e0 tx=0x7f211c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:12.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.193+0000 7f21137fe700 1 -- 172.21.15.142:0/1610784313 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f21240522d0 con 0x7f212c159f10 2023-09-30T22:53:12.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.381+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f212c06b000 con 0x7f212c159f10 2023-09-30T22:53:12.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.382+0000 7f21137fe700 1 -- 172.21.15.142:0/1610784313 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21240558f0 con 0x7f212c159f10 2023-09-30T22:53:12.383 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:53:12.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2118067330 msgr2=0x7f21180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2118067330 0x7f21180697e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f211c0091e0 tx=0x7f211c017000 comp rx=0 tx=0).stop 2023-09-30T22:53:12.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f212c159f10 msgr2=0x7f212c15d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f212c159f10 0x7f212c15d650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2124009f20 tx=0x7f212400b040 comp rx=0 tx=0).stop 2023-09-30T22:53:12.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 shutdown_connections 2023-09-30T22:53:12.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2118067330 0x7f21180697e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f212c159f10 0x7f212c15d650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f212c067620 0x7f212c14ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 --2- 172.21.15.142:0/1610784313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f212c159b40 0x7f212c15bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.384+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 >> 172.21.15.142:0/1610784313 conn(0x7f212c0c9950 msgr2=0x7f212c156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:12.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.385+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 shutdown_connections 2023-09-30T22:53:12.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.385+0000 7f2131bff700 1 -- 172.21.15.142:0/1610784313 wait complete. 2023-09-30T22:53:12.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:12.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.593+0000 7efef21ff700 1 Processor -- start 2023-09-30T22:53:12.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.593+0000 7efef21ff700 1 -- start start 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.594+0000 7efef21ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efeec0aebf0 0x7efeec06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.594+0000 7efef21ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efeec06f190 0x7efeec159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.594+0000 7efef21ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0b0ee0 con 0x7efeec15a0d0 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.594+0000 7efef21ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec0aefc0 con 0x7efeec0aebf0 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.594+0000 7efef21ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec15a4d0 con 0x7efeec06f190 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeebfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7efeec15a0d0 0x7efeec156590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42570/0 (socket says 172.21.15.142:42570) 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeeb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efeec0aebf0 0x7efeec06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeebfff700 1 -- 172.21.15.142:0/2444953566 learned_addr learned my addr 172.21.15.142:0/2444953566 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:12.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeeaffd700 1 --2- 172.21.15.142:0/2444953566 >> v2:172.21.15.148:3300/0 conn(0x7efeec06f190 0x7efeec159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeea7fc700 1 -- 172.21.15.142:0/2444953566 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124246199 0 0) 0x7efeec0b0ee0 con 0x7efeec15a0d0 2023-09-30T22:53:12.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeeb7fe700 1 -- 172.21.15.142:0/2444953566 >> v2:172.21.15.148:3300/0 conn(0x7efeec06f190 msgr2=0x7efeec159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:12.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeeb7fe700 1 --2- 172.21.15.142:0/2444953566 >> v2:172.21.15.148:3300/0 conn(0x7efeec06f190 0x7efeec159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeeb7fe700 1 -- 172.21.15.142:0/2444953566 >> v1:172.21.15.142:6789/0 conn(0x7efeec15a0d0 legacy=0x7efeec156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeeb7fe700 1 -- 172.21.15.142:0/2444953566 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0b02d0 con 0x7efeec0aebf0 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.595+0000 7efeeb7fe700 1 --2- 172.21.15.142:0/2444953566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec06ec50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efeec06ce90 tx=0x7efedc00a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a2e8c6143761b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efeea7fc700 1 -- 172.21.15.142:0/2444953566 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00c970 con 0x7efeec0aebf0 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efeea7fc700 1 -- 172.21.15.142:0/2444953566 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc00cad0 con 0x7efeec0aebf0 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efeea7fc700 1 -- 172.21.15.142:0/2444953566 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00ce70 con 0x7efeec0aebf0 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 -- 172.21.15.142:0/2444953566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 msgr2=0x7efeec06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 --2- 172.21.15.142:0/2444953566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec06ec50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efeec06ce90 tx=0x7efedc00a330 comp rx=0 tx=0).stop 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 -- 172.21.15.142:0/2444953566 shutdown_connections 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 --2- 172.21.15.142:0/2444953566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec06ec50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 --2- 172.21.15.142:0/2444953566 >> v2:172.21.15.148:3300/0 conn(0x7efeec06f190 0x7efeec159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 -- 172.21.15.142:0/2444953566 >> 172.21.15.142:0/2444953566 conn(0x7efeec0680c0 msgr2=0x7efeec0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:12.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 -- 172.21.15.142:0/2444953566 shutdown_connections 2023-09-30T22:53:12.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.596+0000 7efef21ff700 1 -- 172.21.15.142:0/2444953566 wait complete. 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.598+0000 7efef21ff700 1 Processor -- start 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.598+0000 7efef21ff700 1 -- start start 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efef21ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeec06f190 0x7efeec15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efef21ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efef21ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efeec15a0d0 0x7efeec14d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efef21ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec150810 con 0x7efeec0aebf0 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efef21ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec14da70 con 0x7efeec06f190 2023-09-30T22:53:12.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efef21ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec14dd50 con 0x7efeec15a0d0 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec14cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39172/0 (socket says 172.21.15.142:39172) 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 -- 172.21.15.142:0/3174227346 learned_addr learned my addr 172.21.15.142:0/3174227346 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeb7fe700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeec06f190 0x7efeec15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 -- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efeec15a0d0 msgr2=0x7efeec14d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeebfff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efeec15a0d0 0x7efeec14d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efeec15a0d0 0x7efeec14d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 -- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeec06f190 msgr2=0x7efeec15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeec06f190 0x7efeec15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeaffd700 1 -- 172.21.15.142:0/3174227346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc00a5d0 con 0x7efeec0aebf0 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeeb7fe700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeec06f190 0x7efeec15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:12.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.599+0000 7efeebfff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efeec15a0d0 0x7efeec14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:12.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.600+0000 7efeeaffd700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec14cda0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efee000d890 tx=0x7efee0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:12.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.600+0000 7efed37fe700 1 -- 172.21.15.142:0/3174227346 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000b600 con 0x7efeec0aebf0 2023-09-30T22:53:12.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.600+0000 7efed37fe700 1 -- 172.21.15.142:0/3174227346 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee000b760 con 0x7efeec0aebf0 2023-09-30T22:53:12.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.600+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec14e030 con 0x7efeec0aebf0 2023-09-30T22:53:12.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.600+0000 7efed37fe700 1 -- 172.21.15.142:0/3174227346 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000bae0 con 0x7efeec0aebf0 2023-09-30T22:53:12.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.600+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec14e5f0 con 0x7efeec0aebf0 2023-09-30T22:53:12.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.601+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec14e7e0 con 0x7efeec0aebf0 2023-09-30T22:53:12.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.602+0000 7efed37fe700 1 -- 172.21.15.142:0/3174227346 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efee001e460 con 0x7efeec0aebf0 2023-09-30T22:53:12.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.603+0000 7efed37fe700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efed8067330 0x7efed80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:12.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.603+0000 7efed37fe700 1 -- 172.21.15.142:0/3174227346 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efee0085300 con 0x7efeec0aebf0 2023-09-30T22:53:12.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.603+0000 7efeeb7fe700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efed8067330 0x7efed80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:12.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.604+0000 7efeeb7fe700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efed8067330 0x7efed80697e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efedc003080 tx=0x7efedc01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:12.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.607+0000 7efed37fe700 1 -- 172.21.15.142:0/3174227346 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efee0052160 con 0x7efeec0aebf0 2023-09-30T22:53:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.839+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efeec06fc10 con 0x7efeec0aebf0 2023-09-30T22:53:12.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.840+0000 7efed37fe700 1 -- 172.21.15.142:0/3174227346 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7efee0055780 con 0x7efeec0aebf0 2023-09-30T22:53:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:12.841 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:53:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efed8067330 msgr2=0x7efed80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efed8067330 0x7efed80697e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efedc003080 tx=0x7efedc01a000 comp rx=0 tx=0).stop 2023-09-30T22:53:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 msgr2=0x7efeec14cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec14cda0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efee000d890 tx=0x7efee0008040 comp rx=0 tx=0).stop 2023-09-30T22:53:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 shutdown_connections 2023-09-30T22:53:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efed8067330 0x7efed80697e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efeec15a0d0 0x7efeec14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeec06f190 0x7efeec15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 --2- 172.21.15.142:0/3174227346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeec0aebf0 0x7efeec14cda0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 >> 172.21.15.142:0/3174227346 conn(0x7efeec0680c0 msgr2=0x7efeec0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 shutdown_connections 2023-09-30T22:53:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:12.842+0000 7efef21ff700 1 -- 172.21.15.142:0/3174227346 wait complete. 2023-09-30T22:53:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:53:12.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:13.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.051+0000 7f0de59ff700 1 Processor -- start 2023-09-30T22:53:13.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.051+0000 7f0de59ff700 1 -- start start 2023-09-30T22:53:13.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.052+0000 7f0de59ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0de006d3f0 0x7f0de006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0de59ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de015dde0 con 0x7f0de00c6da0 2023-09-30T22:53:13.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0de59ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de006b840 con 0x7f0de015e270 2023-09-30T22:53:13.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0de59ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de015e710 con 0x7f0de006d3f0 2023-09-30T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0dde7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0de00c6da0 0x7f0de006b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42578/0 (socket says 172.21.15.142:42578) 2023-09-30T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0dde7fc700 1 -- 172.21.15.142:0/374690245 learned_addr learned my addr 172.21.15.142:0/374690245 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0ddeffd700 1 --2- 172.21.15.142:0/374690245 >> v2:172.21.15.148:3300/0 conn(0x7f0de006d3f0 0x7f0de006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0dddffb700 1 -- 172.21.15.142:0/374690245 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153970387 0 0) 0x7f0de015dde0 con 0x7f0de00c6da0 2023-09-30T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0dddffb700 1 -- 172.21.15.142:0/374690245 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc8003570 con 0x7f0de00c6da0 2023-09-30T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0dddffb700 1 -- 172.21.15.142:0/374690245 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779297620 0 0) 0x7f0de006b840 con 0x7f0de015e270 2023-09-30T22:53:13.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.053+0000 7f0dddffb700 1 -- 172.21.15.142:0/374690245 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de015dde0 con 0x7f0de015e270 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.054+0000 7f0ddeffd700 1 -- 172.21.15.142:0/374690245 >> v1:172.21.15.148:6789/0 conn(0x7f0de015e270 legacy=0x7f0de0159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.054+0000 7f0ddeffd700 1 -- 172.21.15.142:0/374690245 >> v1:172.21.15.142:6789/0 conn(0x7f0de00c6da0 legacy=0x7f0de006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.054+0000 7f0ddeffd700 1 -- 172.21.15.142:0/374690245 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de015d7d0 con 0x7f0de006d3f0 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.054+0000 7f0ddeffd700 1 --2- 172.21.15.142:0/374690245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de006d3f0 0x7f0de006d7c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009910 tx=0x7f0dd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9928643870f84a7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.054+0000 7f0dddffb700 1 -- 172.21.15.142:0/374690245 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0011630 con 0x7f0de006d3f0 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.054+0000 7f0dddffb700 1 -- 172.21.15.142:0/374690245 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd0011790 con 0x7f0de006d3f0 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.054+0000 7f0dddffb700 1 -- 172.21.15.142:0/374690245 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0011b30 con 0x7f0de006d3f0 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.055+0000 7f0de59ff700 1 -- 172.21.15.142:0/374690245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de006d3f0 msgr2=0x7f0de006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.055+0000 7f0de59ff700 1 --2- 172.21.15.142:0/374690245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de006d3f0 0x7f0de006d7c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009910 tx=0x7f0dd00091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.055+0000 7f0de59ff700 1 -- 172.21.15.142:0/374690245 shutdown_connections 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.055+0000 7f0de59ff700 1 --2- 172.21.15.142:0/374690245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de006d3f0 0x7f0de006d7c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.055+0000 7f0de59ff700 1 -- 172.21.15.142:0/374690245 >> 172.21.15.142:0/374690245 conn(0x7f0de0067e30 msgr2=0x7f0de0068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:13.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.055+0000 7f0de59ff700 1 -- 172.21.15.142:0/374690245 shutdown_connections 2023-09-30T22:53:13.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.055+0000 7f0de59ff700 1 -- 172.21.15.142:0/374690245 wait complete. 2023-09-30T22:53:13.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.056+0000 7f0de59ff700 1 Processor -- start 2023-09-30T22:53:13.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.056+0000 7f0de59ff700 1 -- start start 2023-09-30T22:53:13.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.057+0000 7f0de59ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0de006d3f0 0x7f0de0150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.057+0000 7f0de59ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0de00c6da0 0x7f0de014d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.057+0000 7f0de59ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de015e270 0x7f0de014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.057+0000 7f0de59ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de014e2b0 con 0x7f0de00c6da0 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.057+0000 7f0de59ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de014b1b0 con 0x7f0de015e270 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.057+0000 7f0de59ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de014b490 con 0x7f0de006d3f0 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.057+0000 7f0dde7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0de00c6da0 0x7f0de014d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0ddeffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0de006d3f0 0x7f0de0150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0ddf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de015e270 0x7f0de014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0de00c6da0 0x7f0de014d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39188/0 (socket says 172.21.15.142:39188) 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 -- 172.21.15.142:0/3212878290 learned_addr learned my addr 172.21.15.142:0/3212878290 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 -- 172.21.15.142:0/3212878290 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0de006d3f0 msgr2=0x7f0de0150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0de006d3f0 0x7f0de0150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 -- 172.21.15.142:0/3212878290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de015e270 msgr2=0x7f0de014c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de015e270 0x7f0de014c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 -- 172.21.15.142:0/3212878290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009420 con 0x7f0de00c6da0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.058+0000 7f0dde7fc700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0de00c6da0 0x7f0de014d8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c790 tx=0x7f0dd4007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.059+0000 7f0dc6ffd700 1 -- 172.21.15.142:0/3212878290 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4005b30 con 0x7f0de00c6da0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.059+0000 7f0dc6ffd700 1 -- 172.21.15.142:0/3212878290 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4005c90 con 0x7f0de00c6da0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.059+0000 7f0dc6ffd700 1 -- 172.21.15.142:0/3212878290 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4007300 con 0x7f0de00c6da0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.059+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de014df10 con 0x7f0de00c6da0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.059+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de016ae80 con 0x7f0de00c6da0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.060+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de014b010 con 0x7f0de00c6da0 2023-09-30T22:53:13.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.061+0000 7f0dc6ffd700 1 -- 172.21.15.142:0/3212878290 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0dd401b3b0 con 0x7f0de00c6da0 2023-09-30T22:53:13.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.062+0000 7f0dc6ffd700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0dcc067330 0x7f0dcc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.062+0000 7f0dc6ffd700 1 -- 172.21.15.142:0/3212878290 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0dd4084120 con 0x7f0de00c6da0 2023-09-30T22:53:13.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.062+0000 7f0ddeffd700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0dcc067330 0x7f0dcc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.063+0000 7f0ddeffd700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0dcc067330 0x7f0dcc0697e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00093f0 tx=0x7f0dd0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.066+0000 7f0dc6ffd700 1 -- 172.21.15.142:0/3212878290 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0de014b010 con 0x7f0de00c6da0 2023-09-30T22:53:13.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.254+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0de014b010 con 0x7f0de00c6da0 2023-09-30T22:53:13.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.255+0000 7f0dc6ffd700 1 -- 172.21.15.142:0/3212878290 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f0de014b010 con 0x7f0de00c6da0 2023-09-30T22:53:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:13.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0dcc067330 msgr2=0x7f0dcc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0dcc067330 0x7f0dcc0697e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00093f0 tx=0x7f0dd0017000 comp rx=0 tx=0).stop 2023-09-30T22:53:13.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0de00c6da0 msgr2=0x7f0de014d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0de00c6da0 0x7f0de014d8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c790 tx=0x7f0dd4007e80 comp rx=0 tx=0).stop 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 shutdown_connections 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0dcc067330 0x7f0dcc0697e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0de015e270 0x7f0de014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0de006d3f0 0x7f0de0150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 --2- 172.21.15.142:0/3212878290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0de00c6da0 0x7f0de014d8f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 >> 172.21.15.142:0/3212878290 conn(0x7f0de0067e30 msgr2=0x7f0de01552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 shutdown_connections 2023-09-30T22:53:13.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.258+0000 7f0de59ff700 1 -- 172.21.15.142:0/3212878290 wait complete. 2023-09-30T22:53:13.277 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:53:13.277 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:13.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.464+0000 7f968e7ff700 1 Processor -- start 2023-09-30T22:53:13.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.464+0000 7f968e7ff700 1 -- start start 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f968e7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f968806d3f0 0x7f968806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f968e7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96880c6da0 0x7f968815e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f968e7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968815dde0 con 0x7f968806b130 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f968e7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968815d7d0 con 0x7f96880c6da0 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f968e7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96880c7230 con 0x7f968806d3f0 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f968cd9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f968806b130 0x7f9688069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42588/0 (socket says 172.21.15.142:42588) 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f968cd9c700 1 -- 172.21.15.142:0/635117506 learned_addr learned my addr 172.21.15.142:0/635117506 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f96877fe700 1 --2- 172.21.15.142:0/635117506 >> v2:172.21.15.142:3300/0 conn(0x7f96880c6da0 0x7f968815e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f9687fff700 1 --2- 172.21.15.142:0/635117506 >> v2:172.21.15.148:3300/0 conn(0x7f968806d3f0 0x7f968806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.466+0000 7f9686ffd700 1 -- 172.21.15.142:0/635117506 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784675073 0 0) 0x7f968815dde0 con 0x7f968806b130 2023-09-30T22:53:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f9686ffd700 1 -- 172.21.15.142:0/635117506 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9670003570 con 0x7f968806b130 2023-09-30T22:53:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f96877fe700 1 -- 172.21.15.142:0/635117506 >> v2:172.21.15.148:3300/0 conn(0x7f968806d3f0 msgr2=0x7f968806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f96877fe700 1 --2- 172.21.15.142:0/635117506 >> v2:172.21.15.148:3300/0 conn(0x7f968806d3f0 0x7f968806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f96877fe700 1 -- 172.21.15.142:0/635117506 >> v1:172.21.15.142:6789/0 conn(0x7f968806b130 legacy=0x7f9688069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f96877fe700 1 -- 172.21.15.142:0/635117506 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968815da70 con 0x7f96880c6da0 2023-09-30T22:53:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f96877fe700 1 --2- 172.21.15.142:0/635117506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96880c6da0 0x7f968815e270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f967c0098e0 tx=0x7f967c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d37db9aa789915 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f9686ffd700 1 -- 172.21.15.142:0/635117506 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c011630 con 0x7f96880c6da0 2023-09-30T22:53:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f9686ffd700 1 -- 172.21.15.142:0/635117506 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c011790 con 0x7f96880c6da0 2023-09-30T22:53:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.467+0000 7f9686ffd700 1 -- 172.21.15.142:0/635117506 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c011b30 con 0x7f96880c6da0 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 -- 172.21.15.142:0/635117506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96880c6da0 msgr2=0x7f968815e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 --2- 172.21.15.142:0/635117506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96880c6da0 0x7f968815e270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f967c0098e0 tx=0x7f967c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 -- 172.21.15.142:0/635117506 shutdown_connections 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 --2- 172.21.15.142:0/635117506 >> v2:172.21.15.148:3300/0 conn(0x7f968806d3f0 0x7f968806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 --2- 172.21.15.142:0/635117506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96880c6da0 0x7f968815e270 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 -- 172.21.15.142:0/635117506 >> 172.21.15.142:0/635117506 conn(0x7f9688067e30 msgr2=0x7f9688068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 -- 172.21.15.142:0/635117506 shutdown_connections 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.468+0000 7f968e7ff700 1 -- 172.21.15.142:0/635117506 wait complete. 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.469+0000 7f968e7ff700 1 Processor -- start 2023-09-30T22:53:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.469+0000 7f968e7ff700 1 -- start start 2023-09-30T22:53:13.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.470+0000 7f968e7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968806b130 0x7f968813e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.470+0000 7f968e7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f968806d3f0 0x7f968813ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.470+0000 7f968e7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96880c6da0 0x7f96881539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.470+0000 7f968e7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9688140450 con 0x7f968806b130 2023-09-30T22:53:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.470+0000 7f968e7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968813ebc0 con 0x7f96880c6da0 2023-09-30T22:53:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.470+0000 7f968e7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968813f840 con 0x7f968806d3f0 2023-09-30T22:53:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.470+0000 7f9687fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968806b130 0x7f968813e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968806b130 0x7f968813e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39210/0 (socket says 172.21.15.142:39210) 2023-09-30T22:53:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 -- 172.21.15.142:0/2141536474 learned_addr learned my addr 172.21.15.142:0/2141536474 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f96877fe700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f968806d3f0 0x7f968813ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f968cd9c700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96880c6da0 0x7f96881539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 -- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f968806d3f0 msgr2=0x7f968813ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f968806d3f0 0x7f968813ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 -- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96880c6da0 msgr2=0x7f96881539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96880c6da0 0x7f96881539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 -- 172.21.15.142:0/2141536474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009420 con 0x7f968806b130 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f9687fff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968806b130 0x7f968813e680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f967800ec80 tx=0x7f96780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f966ffff700 1 -- 172.21.15.142:0/2141536474 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800c850 con 0x7f968806b130 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f966ffff700 1 -- 172.21.15.142:0/2141536474 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967800c9b0 con 0x7f968806b130 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.471+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968813fb20 con 0x7f968806b130 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.472+0000 7f966ffff700 1 -- 172.21.15.142:0/2141536474 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800cd50 con 0x7f968806b130 2023-09-30T22:53:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.472+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96881400e0 con 0x7f968806b130 2023-09-30T22:53:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.473+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9688140730 con 0x7f968806b130 2023-09-30T22:53:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.474+0000 7f966ffff700 1 -- 172.21.15.142:0/2141536474 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9678013680 con 0x7f968806b130 2023-09-30T22:53:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.474+0000 7f966ffff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9674067330 0x7f96740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.474+0000 7f966ffff700 1 -- 172.21.15.142:0/2141536474 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9678084ea0 con 0x7f968806b130 2023-09-30T22:53:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.475+0000 7f96877fe700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9674067330 0x7f96740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.475+0000 7f96877fe700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9674067330 0x7f96740697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f967c0091e0 tx=0x7f967c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.480+0000 7f966ffff700 1 -- 172.21.15.142:0/2141536474 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9678051d00 con 0x7f968806b130 2023-09-30T22:53:13.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.712+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96880c7510 con 0x7f968806b130 2023-09-30T22:53:13.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.712+0000 7f966ffff700 1 -- 172.21.15.142:0/2141536474 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f9678055320 con 0x7f968806b130 2023-09-30T22:53:13.713 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:13.713 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:53:13.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9674067330 msgr2=0x7f96740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9674067330 0x7f96740697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f967c0091e0 tx=0x7f967c017000 comp rx=0 tx=0).stop 2023-09-30T22:53:13.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968806b130 msgr2=0x7f968813e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968806b130 0x7f968813e680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f967800ec80 tx=0x7f96780091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 shutdown_connections 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9674067330 0x7f96740697e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96880c6da0 0x7f96881539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968806b130 0x7f968813e680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 --2- 172.21.15.142:0/2141536474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f968806d3f0 0x7f968813ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 >> 172.21.15.142:0/2141536474 conn(0x7f9688067e30 msgr2=0x7f9688068200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 shutdown_connections 2023-09-30T22:53:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.714+0000 7f968e7ff700 1 -- 172.21.15.142:0/2141536474 wait complete. 2023-09-30T22:53:13.717 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:53:13.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:13.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.920+0000 7f20a05ff700 1 Processor -- start 2023-09-30T22:53:13.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.920+0000 7f20a05ff700 1 -- start start 2023-09-30T22:53:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.921+0000 7f20a05ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20980c6da0 0x7f209806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.921+0000 7f20a05ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f209815e270 0x7f2098159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.921+0000 7f20a05ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209815dde0 con 0x7f209806d3f0 2023-09-30T22:53:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.921+0000 7f20a05ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209815e710 con 0x7f20980c6da0 2023-09-30T22:53:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f20a05ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209806b840 con 0x7f209815e270 2023-09-30T22:53:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209e39b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f209806d3f0 0x7f209806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42602/0 (socket says 172.21.15.142:42602) 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209db9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20980c6da0 0x7f209806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209e39b700 1 -- 172.21.15.142:0/299774292 learned_addr learned my addr 172.21.15.142:0/299774292 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209eb9c700 1 --2- 172.21.15.142:0/299774292 >> v2:172.21.15.148:3300/0 conn(0x7f209815e270 0x7f2098159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209d399700 1 -- 172.21.15.142:0/299774292 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202726630 0 0) 0x7f209815dde0 con 0x7f209806d3f0 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209d399700 1 -- 172.21.15.142:0/299774292 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2084003570 con 0x7f209806d3f0 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209db9a700 1 -- 172.21.15.142:0/299774292 >> v2:172.21.15.148:3300/0 conn(0x7f209815e270 msgr2=0x7f2098159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209db9a700 1 --2- 172.21.15.142:0/299774292 >> v2:172.21.15.148:3300/0 conn(0x7f209815e270 0x7f2098159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209db9a700 1 -- 172.21.15.142:0/299774292 >> v1:172.21.15.142:6789/0 conn(0x7f209806d3f0 legacy=0x7f209806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.922+0000 7f209db9a700 1 -- 172.21.15.142:0/299774292 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209815d7d0 con 0x7f20980c6da0 2023-09-30T22:53:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.923+0000 7f209db9a700 1 --2- 172.21.15.142:0/299774292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f209806d7c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f20880098e0 tx=0x7f20880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb596b7d69f846e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.923+0000 7f209d399700 1 -- 172.21.15.142:0/299774292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011630 con 0x7f20980c6da0 2023-09-30T22:53:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.923+0000 7f209d399700 1 -- 172.21.15.142:0/299774292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088011790 con 0x7f20980c6da0 2023-09-30T22:53:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.923+0000 7f209d399700 1 -- 172.21.15.142:0/299774292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011b30 con 0x7f20980c6da0 2023-09-30T22:53:13.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.923+0000 7f20a05ff700 1 -- 172.21.15.142:0/299774292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 msgr2=0x7f209806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.923+0000 7f20a05ff700 1 --2- 172.21.15.142:0/299774292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f209806d7c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f20880098e0 tx=0x7f20880091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.924+0000 7f20a05ff700 1 -- 172.21.15.142:0/299774292 shutdown_connections 2023-09-30T22:53:13.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.924+0000 7f20a05ff700 1 --2- 172.21.15.142:0/299774292 >> v2:172.21.15.148:3300/0 conn(0x7f209815e270 0x7f2098159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.924+0000 7f20a05ff700 1 --2- 172.21.15.142:0/299774292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f209806d7c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.924+0000 7f20a05ff700 1 -- 172.21.15.142:0/299774292 >> 172.21.15.142:0/299774292 conn(0x7f2098067e30 msgr2=0x7f2098068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.924+0000 7f20a05ff700 1 -- 172.21.15.142:0/299774292 shutdown_connections 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.924+0000 7f20a05ff700 1 -- 172.21.15.142:0/299774292 wait complete. 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.925+0000 7f20a05ff700 1 Processor -- start 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.925+0000 7f20a05ff700 1 -- start start 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f20a05ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f209806d3f0 0x7f209816a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f20a05ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f2098143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f20a05ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f209815e270 0x7f20980cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f20a05ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20980cab10 con 0x7f20980c6da0 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f20a05ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209816a960 con 0x7f209815e270 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f20a05ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209816ac40 con 0x7f209806d3f0 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f209db9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f2098143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f209db9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f2098143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39230/0 (socket says 172.21.15.142:39230) 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f209db9a700 1 -- 172.21.15.142:0/2107191121 learned_addr learned my addr 172.21.15.142:0/2107191121 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f209e39b700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f209806d3f0 0x7f209816a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.926+0000 7f209eb9c700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f209815e270 0x7f20980cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f209db9a700 1 -- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f209806d3f0 msgr2=0x7f209816a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f209db9a700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f209806d3f0 0x7f209816a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f209db9a700 1 -- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f209815e270 msgr2=0x7f20980cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f209db9a700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f209815e270 0x7f20980cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f209db9a700 1 -- 172.21.15.142:0/2107191121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088009420 con 0x7f20980c6da0 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f209eb9c700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f209815e270 0x7f20980cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f209db9a700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f2098143d10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f20880091e0 tx=0x7f2088017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f208e7fc700 1 -- 172.21.15.142:0/2107191121 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208801bb60 con 0x7f20980c6da0 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f208e7fc700 1 -- 172.21.15.142:0/2107191121 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208801bce0 con 0x7f20980c6da0 2023-09-30T22:53:13.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209816af20 con 0x7f20980c6da0 2023-09-30T22:53:13.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f208e7fc700 1 -- 172.21.15.142:0/2107191121 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088025670 con 0x7f20980c6da0 2023-09-30T22:53:13.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.927+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209816a650 con 0x7f20980c6da0 2023-09-30T22:53:13.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.928+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20980caff0 con 0x7f20980c6da0 2023-09-30T22:53:13.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.929+0000 7f208e7fc700 1 -- 172.21.15.142:0/2107191121 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2088023070 con 0x7f20980c6da0 2023-09-30T22:53:13.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.930+0000 7f208e7fc700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f207c067330 0x7f207c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:13.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.930+0000 7f208e7fc700 1 -- 172.21.15.142:0/2107191121 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2088086140 con 0x7f20980c6da0 2023-09-30T22:53:13.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.930+0000 7f209e39b700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f207c067330 0x7f207c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:13.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.931+0000 7f209e39b700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f207c067330 0x7f207c0697e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2094007fd0 tx=0x7f2094009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:13.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:13.934+0000 7f208e7fc700 1 -- 172.21.15.142:0/2107191121 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2088052fa0 con 0x7f20980c6da0 2023-09-30T22:53:14.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.167+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20980c7230 con 0x7f20980c6da0 2023-09-30T22:53:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.168+0000 7f208e7fc700 1 -- 172.21.15.142:0/2107191121 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f20880565c0 con 0x7f20980c6da0 2023-09-30T22:53:14.168 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:14.168 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4138030612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4138030612},{"type":"v1","addr":"172.21.15.148:6835","nonce":4138030612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/954967983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":954967983},{"type":"v1","addr":"172.21.15.148:6834","nonce":954967983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/183447851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":183447851},{"type":"v1","addr":"172.21.15.142:6836","nonce":183447851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:52:29.459705+0000","modified":"2023-09-30T22:52:33.248797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1468486287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1468486287},{"type":"v1","addr":"172.21.15.142:6837","nonce":1468486287}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:53:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f207c067330 msgr2=0x7f207c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f207c067330 0x7f207c0697e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2094007fd0 tx=0x7f2094009040 comp rx=0 tx=0).stop 2023-09-30T22:53:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 msgr2=0x7f2098143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f2098143d10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f20880091e0 tx=0x7f2088017000 comp rx=0 tx=0).stop 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 shutdown_connections 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f207c067330 0x7f207c0697e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f209815e270 0x7f20980cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f209806d3f0 0x7f209816a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 --2- 172.21.15.142:0/2107191121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20980c6da0 0x7f2098143d10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 >> 172.21.15.142:0/2107191121 conn(0x7f2098067e30 msgr2=0x7f20981531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 shutdown_connections 2023-09-30T22:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.171+0000 7f20a05ff700 1 -- 172.21.15.142:0/2107191121 wait complete. 2023-09-30T22:53:14.173 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-30T22:53:14.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:14.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.378+0000 7f7a0ddff700 1 Processor -- start 2023-09-30T22:53:14.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.378+0000 7f7a0ddff700 1 -- start start 2023-09-30T22:53:14.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.379+0000 7f7a0ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 0x7f7a08159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.379+0000 7f7a0ddff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7a080d03d0 0x7f7a0815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.379+0000 7f7a0ddff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0806b8d0 con 0x7f7a081598e0 2023-09-30T22:53:14.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.379+0000 7f7a0ddff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080cff40 con 0x7f7a080d03d0 2023-09-30T22:53:14.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.379+0000 7f7a0ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080cf330 con 0x7f7a080cee50 2023-09-30T22:53:14.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a077fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7a081598e0 0x7f7a0806b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42606/0 (socket says 172.21.15.142:42606) 2023-09-30T22:53:14.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a077fe700 1 -- 172.21.15.142:0/1042761288 learned_addr learned my addr 172.21.15.142:0/1042761288 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:14.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a06ffd700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 0x7f7a08159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a07fff700 1 --2- 172.21.15.142:0/1042761288 >> v2:172.21.15.148:3300/0 conn(0x7f7a080d03d0 0x7f7a0815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704819016 0 0) 0x7f7a0806b8d0 con 0x7f7a081598e0 2023-09-30T22:53:14.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f0003570 con 0x7f7a081598e0 2023-09-30T22:53:14.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4064057841 0 0) 0x7f79f0003570 con 0x7f7a081598e0 2023-09-30T22:53:14.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 msgr2=0x7f7a08159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 0x7f7a08159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 >> v2:172.21.15.148:3300/0 conn(0x7f7a080d03d0 msgr2=0x7f7a0815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 --2- 172.21.15.142:0/1042761288 >> v2:172.21.15.148:3300/0 conn(0x7f7a080d03d0 0x7f7a0815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080cf610 con 0x7f7a081598e0 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f79f8001470 con 0x7f7a081598e0 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 >> v1:172.21.15.142:6789/0 conn(0x7f7a081598e0 legacy=0x7f7a0806b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0003a60 0x7f79f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.380+0000 7f7a067fc700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 0x7f79f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a067fc700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f0004d50 0x7f79f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080cff40 con 0x7f79f0004d50 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080cf330 con 0x7f79f0003a60 2023-09-30T22:53:14.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f000ba60 con 0x7f7a080cee50 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a07fff700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f0004d50 0x7f79f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a077fe700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0003a60 0x7f79f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a06ffd700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 0x7f79f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a07fff700 1 -- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 msgr2=0x7f79f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a07fff700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080cee50 0x7f79f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a07fff700 1 -- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0003a60 msgr2=0x7f79f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a07fff700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0003a60 0x7f79f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a07fff700 1 -- 172.21.15.142:0/1042761288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f0003570 con 0x7f79f0004d50 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.381+0000 7f7a07fff700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f0004d50 0x7f79f00051c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000e210 tx=0x7f7a0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbb70ed22f89db7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000ea60 con 0x7f79f0004d50 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0000f040 con 0x7f79f0004d50 2023-09-30T22:53:14.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a067fc700 1 -- 172.21.15.142:0/1042761288 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000ee10 con 0x7f79f0004d50 2023-09-30T22:53:14.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a0ddff700 1 -- 172.21.15.142:0/1042761288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f0004d50 msgr2=0x7f79f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a0ddff700 1 --2- 172.21.15.142:0/1042761288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f0004d50 0x7f79f00051c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000e210 tx=0x7f7a0000b040 comp rx=0 tx=0).stop 2023-09-30T22:53:14.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a07fff700 1 -- 172.21.15.142:0/1042761288 reap_dead start 2023-09-30T22:53:14.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a0ddff700 1 -- 172.21.15.142:0/1042761288 shutdown_connections 2023-09-30T22:53:14.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a0ddff700 1 -- 172.21.15.142:0/1042761288 >> 172.21.15.142:0/1042761288 conn(0x7f7a080cd540 msgr2=0x7f7a080cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:14.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a0ddff700 1 -- 172.21.15.142:0/1042761288 shutdown_connections 2023-09-30T22:53:14.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.382+0000 7f7a0ddff700 1 -- 172.21.15.142:0/1042761288 wait complete. 2023-09-30T22:53:14.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.384+0000 7f7a0ddff700 1 Processor -- start 2023-09-30T22:53:14.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.384+0000 7f7a0ddff700 1 -- start start 2023-09-30T22:53:14.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a0ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080c82d0 0x7f7a080c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a0ddff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a080c9f10 0x7f7a0816a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a0ddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a0816a920 0x7f7a0816ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a0ddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080c5530 con 0x7f7a0816a920 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a0ddff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0816b2d0 con 0x7f7a080c9f10 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a0ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080ca750 con 0x7f7a080c82d0 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a0816a920 0x7f7a0816ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a0816a920 0x7f7a0816ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39258/0 (socket says 172.21.15.142:39258) 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 -- 172.21.15.142:0/935647063 learned_addr learned my addr 172.21.15.142:0/935647063 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a06ffd700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a080c9f10 0x7f7a0816a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a077fe700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080c82d0 0x7f7a080c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 -- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080c82d0 msgr2=0x7f7a080c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080c82d0 0x7f7a080c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 -- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a080c9f10 msgr2=0x7f7a0816a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a080c9f10 0x7f7a0816a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a07fff700 1 -- 172.21.15.142:0/935647063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080caa30 con 0x7f7a0816a920 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a077fe700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080c82d0 0x7f7a080c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.385+0000 7f7a06ffd700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a080c9f10 0x7f7a0816a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.386+0000 7f7a07fff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a0816a920 0x7f7a0816ad90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000e800 tx=0x7f7a0001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.386+0000 7f79ef7fe700 1 -- 172.21.15.142:0/935647063 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0001d630 con 0x7f7a0816a920 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.386+0000 7f79ef7fe700 1 -- 172.21.15.142:0/935647063 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0001d7d0 con 0x7f7a0816a920 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.386+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a080cad10 con 0x7f7a0816a920 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.386+0000 7f79ef7fe700 1 -- 172.21.15.142:0/935647063 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0001db90 con 0x7f7a0816a920 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.386+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a080ca380 con 0x7f7a0816a920 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.387+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a080caea0 con 0x7f7a0816a920 2023-09-30T22:53:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.388+0000 7f79ef7fe700 1 -- 172.21.15.142:0/935647063 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7a00003040 con 0x7f7a0816a920 2023-09-30T22:53:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.389+0000 7f79ef7fe700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f79f4067330 0x7f79f40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.389+0000 7f79ef7fe700 1 -- 172.21.15.142:0/935647063 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a00085da0 con 0x7f7a0816a920 2023-09-30T22:53:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.389+0000 7f7a077fe700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f79f4067330 0x7f79f40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.390+0000 7f7a077fe700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f79f4067330 0x7f79f40697e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79f80079e0 tx=0x7f79f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.393+0000 7f79ef7fe700 1 -- 172.21.15.142:0/935647063 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7a00052ca0 con 0x7f7a0816a920 2023-09-30T22:53:14.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.586+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a0815e670 con 0x7f7a0816a920 2023-09-30T22:53:14.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.587+0000 7f79ef7fe700 1 -- 172.21.15.142:0/935647063 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f7a00018070 con 0x7f7a0816a920 2023-09-30T22:53:14.588 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:14.588 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:52:30.980362+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:52:27.833414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:52:28.438662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:14.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f79f4067330 msgr2=0x7f79f40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f79f4067330 0x7f79f40697e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79f80079e0 tx=0x7f79f8009040 comp rx=0 tx=0).stop 2023-09-30T22:53:14.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a0816a920 msgr2=0x7f7a0816ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a0816a920 0x7f7a0816ad90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000e800 tx=0x7f7a0001a000 comp rx=0 tx=0).stop 2023-09-30T22:53:14.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 shutdown_connections 2023-09-30T22:53:14.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f79f4067330 0x7f79f40697e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a0816a920 0x7f7a0816ad90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a080c82d0 0x7f7a080c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 --2- 172.21.15.142:0/935647063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a080c9f10 0x7f7a0816a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.589+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 >> 172.21.15.142:0/935647063 conn(0x7f7a080cd540 msgr2=0x7f7a081589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:14.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.590+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 shutdown_connections 2023-09-30T22:53:14.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.590+0000 7f7a0ddff700 1 -- 172.21.15.142:0/935647063 wait complete. 2023-09-30T22:53:14.607 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:53:14.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.798+0000 7f944f7ff700 1 Processor -- start 2023-09-30T22:53:14.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.798+0000 7f944f7ff700 1 -- start start 2023-09-30T22:53:14.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.799+0000 7f944f7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9448157a90 0x7f944815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.799+0000 7f944f7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94480b2110 0x7f944806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.799+0000 7f944f7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944806d470 con 0x7f944806b3d0 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.799+0000 7f944f7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9448157e60 con 0x7f9448157a90 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.799+0000 7f944f7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944815c430 con 0x7f94480b2110 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9448157a90 0x7f944815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9448157a90 0x7f944815bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39272/0 (socket says 172.21.15.142:39272) 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 -- 172.21.15.142:0/2527754117 learned_addr learned my addr 172.21.15.142:0/2527754117 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:14.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944dd9c700 1 --2- 172.21.15.142:0/2527754117 >> v2:172.21.15.148:3300/0 conn(0x7f94480b2110 0x7f944806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 -- 172.21.15.142:0/2527754117 >> v2:172.21.15.148:3300/0 conn(0x7f94480b2110 msgr2=0x7f944806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 --2- 172.21.15.142:0/2527754117 >> v2:172.21.15.148:3300/0 conn(0x7f94480b2110 0x7f944806d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 -- 172.21.15.142:0/2527754117 >> v1:172.21.15.148:6789/0 conn(0x7f944806b3d0 legacy=0x7f94480b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 -- 172.21.15.142:0/2527754117 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480ae880 con 0x7f9448157a90 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.800+0000 7f944d59b700 1 --2- 172.21.15.142:0/2527754117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9448157a90 0x7f944815bef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94480c89c0 tx=0x7f9444009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738d203d1e4c4767 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f943ffff700 1 -- 172.21.15.142:0/2527754117 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400b860 con 0x7f9448157a90 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f943ffff700 1 -- 172.21.15.142:0/2527754117 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400b9c0 con 0x7f9448157a90 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f943ffff700 1 -- 172.21.15.142:0/2527754117 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400bd60 con 0x7f9448157a90 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 -- 172.21.15.142:0/2527754117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9448157a90 msgr2=0x7f944815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 --2- 172.21.15.142:0/2527754117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9448157a90 0x7f944815bef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94480c89c0 tx=0x7f9444009250 comp rx=0 tx=0).stop 2023-09-30T22:53:14.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 -- 172.21.15.142:0/2527754117 shutdown_connections 2023-09-30T22:53:14.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 --2- 172.21.15.142:0/2527754117 >> v2:172.21.15.148:3300/0 conn(0x7f94480b2110 0x7f944806d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 --2- 172.21.15.142:0/2527754117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9448157a90 0x7f944815bef0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 -- 172.21.15.142:0/2527754117 >> 172.21.15.142:0/2527754117 conn(0x7f94480680c0 msgr2=0x7f94480c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:14.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 -- 172.21.15.142:0/2527754117 shutdown_connections 2023-09-30T22:53:14.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.801+0000 7f944f7ff700 1 -- 172.21.15.142:0/2527754117 wait complete. 2023-09-30T22:53:14.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.803+0000 7f944f7ff700 1 Processor -- start 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.803+0000 7f944f7ff700 1 -- start start 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944f7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f944806b3d0 0x7f9448158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944f7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94480b2110 0x7f9448169c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944f7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9448157a90 0x7f944814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944f7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9448158fc0 con 0x7f94480b2110 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944f7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944814b440 con 0x7f944806b3d0 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944f7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94481591e0 con 0x7f9448157a90 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944cd9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94480b2110 0x7f9448169c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944cd9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94480b2110 0x7f9448169c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39280/0 (socket says 172.21.15.142:39280) 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944cd9a700 1 -- 172.21.15.142:0/1515678293 learned_addr learned my addr 172.21.15.142:0/1515678293 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:14.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944dd9c700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9448157a90 0x7f944814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944d59b700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f944806b3d0 0x7f9448158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.804+0000 7f944cd9a700 1 -- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9448157a90 msgr2=0x7f944814b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f944cd9a700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9448157a90 0x7f944814b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f944cd9a700 1 -- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f944806b3d0 msgr2=0x7f9448158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:14.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f944cd9a700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f944806b3d0 0x7f9448158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:14.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f944cd9a700 1 -- 172.21.15.142:0/1515678293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440094f0 con 0x7f94480b2110 2023-09-30T22:53:14.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f944cd9a700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94480b2110 0x7f9448169c80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f943800c590 tx=0x7f9438007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:14.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f943d7fa700 1 -- 172.21.15.142:0/1515678293 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011590 con 0x7f94480b2110 2023-09-30T22:53:14.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f943d7fa700 1 -- 172.21.15.142:0/1515678293 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9438011710 con 0x7f94480b2110 2023-09-30T22:53:14.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94481594c0 con 0x7f94480b2110 2023-09-30T22:53:14.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f943d7fa700 1 -- 172.21.15.142:0/1515678293 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011ad0 con 0x7f94480b2110 2023-09-30T22:53:14.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.805+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9448159a80 con 0x7f94480b2110 2023-09-30T22:53:14.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.806+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94480695b0 con 0x7f94480b2110 2023-09-30T22:53:14.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.807+0000 7f943d7fa700 1 -- 172.21.15.142:0/1515678293 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f943801a360 con 0x7f94480b2110 2023-09-30T22:53:14.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.808+0000 7f943d7fa700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f942c067330 0x7f942c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:14.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.808+0000 7f943d7fa700 1 -- 172.21.15.142:0/1515678293 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9438083b10 con 0x7f94480b2110 2023-09-30T22:53:14.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.808+0000 7f944d59b700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f942c067330 0x7f942c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:14.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.809+0000 7f944d59b700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f942c067330 0x7f942c0697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94480c89c0 tx=0x7f9444017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:14.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:14.812+0000 7f943d7fa700 1 -- 172.21.15.142:0/1515678293 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9438050a10 con 0x7f94480b2110 2023-09-30T22:53:15.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.045+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f944806fc10 con 0x7f94480b2110 2023-09-30T22:53:15.046 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:53:15.046+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:53:15.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.050+0000 7f943d7fa700 1 -- 172.21.15.142:0/1515678293 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9438017090 con 0x7f94480b2110 2023-09-30T22:53:15.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f942c067330 msgr2=0x7f942c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f942c067330 0x7f942c0697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94480c89c0 tx=0x7f9444017000 comp rx=0 tx=0).stop 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94480b2110 msgr2=0x7f9448169c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94480b2110 0x7f9448169c80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f943800c590 tx=0x7f9438007f50 comp rx=0 tx=0).stop 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 shutdown_connections 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f942c067330 0x7f942c0697e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9448157a90 0x7f944814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f944806b3d0 0x7f9448158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 --2- 172.21.15.142:0/1515678293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94480b2110 0x7f9448169c80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 >> 172.21.15.142:0/1515678293 conn(0x7f94480680c0 msgr2=0x7f94480ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:15.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 shutdown_connections 2023-09-30T22:53:15.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.053+0000 7f944f7ff700 1 -- 172.21.15.142:0/1515678293 wait complete. 2023-09-30T22:53:15.055 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:53:15.056 INFO:tasks.ceph.mds.c.smithi142.stderr: -2122> 2023-09-30T22:52:35.136+0000 7f960b7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:53:15.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:53:15.098 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:53:15.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.267+0000 7fb4921ff700 1 Processor -- start 2023-09-30T22:53:15.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.267+0000 7fb4921ff700 1 -- start start 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0ca5e0 0x7fb48c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb4921ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb48c0b0de0 0x7fb48c0681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb4921ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c067d10 con 0x7fb48c159ba0 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb4921ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c06af90 con 0x7fb48c0b0de0 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb4921ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0676c0 con 0x7fb48c0ca5e0 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb48bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb48c0b0de0 0x7fb48c0681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb48b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb48c159ba0 0x7fb48c0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42616/0 (socket says 172.21.15.142:42616) 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.268+0000 7fb48b7fe700 1 -- 172.21.15.142:0/774343289 learned_addr learned my addr 172.21.15.142:0/774343289 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:15.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48affd700 1 --2- 172.21.15.142:0/774343289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0ca5e0 0x7fb48c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48bfff700 1 -- 172.21.15.142:0/774343289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0ca5e0 msgr2=0x7fb48c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48bfff700 1 --2- 172.21.15.142:0/774343289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0ca5e0 0x7fb48c06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48bfff700 1 -- 172.21.15.142:0/774343289 >> v1:172.21.15.142:6789/0 conn(0x7fb48c159ba0 legacy=0x7fb48c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48bfff700 1 -- 172.21.15.142:0/774343289 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0679a0 con 0x7fb48c0b0de0 2023-09-30T22:53:15.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48a7fc700 1 -- 172.21.15.142:0/774343289 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123147949 0 0) 0x7fb48c067d10 con 0x7fb48c159ba0 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48bfff700 1 --2- 172.21.15.142:0/774343289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0681a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb484009e60 tx=0x7fb484009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44ea84ffee0f0fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48a7fc700 1 -- 172.21.15.142:0/774343289 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400e070 con 0x7fb48c0b0de0 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48a7fc700 1 -- 172.21.15.142:0/774343289 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48400bb60 con 0x7fb48c0b0de0 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.269+0000 7fb48a7fc700 1 -- 172.21.15.142:0/774343289 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484012430 con 0x7fb48c0b0de0 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 -- 172.21.15.142:0/774343289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 msgr2=0x7fb48c0681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 --2- 172.21.15.142:0/774343289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0681a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb484009e60 tx=0x7fb484009780 comp rx=0 tx=0).stop 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 -- 172.21.15.142:0/774343289 shutdown_connections 2023-09-30T22:53:15.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 --2- 172.21.15.142:0/774343289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0681a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 --2- 172.21.15.142:0/774343289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0ca5e0 0x7fb48c06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 -- 172.21.15.142:0/774343289 >> 172.21.15.142:0/774343289 conn(0x7fb48c0cb2f0 msgr2=0x7fb48c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 -- 172.21.15.142:0/774343289 shutdown_connections 2023-09-30T22:53:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.270+0000 7fb4921ff700 1 -- 172.21.15.142:0/774343289 wait complete. 2023-09-30T22:53:15.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.272+0000 7fb4921ff700 1 Processor -- start 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.272+0000 7fb4921ff700 1 -- start start 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0ca5e0 0x7fb48c0c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c159ba0 0x7fb48c14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb4921ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0c8710 con 0x7fb48c0b0de0 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb4921ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0c3dc0 con 0x7fb48c0ca5e0 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb4921ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0c2ad0 con 0x7fb48c159ba0 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:15.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39308/0 (socket says 172.21.15.142:39308) 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 -- 172.21.15.142:0/1328865904 learned_addr learned my addr 172.21.15.142:0/1328865904 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48bfff700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c159ba0 0x7fb48c14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48affd700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0ca5e0 0x7fb48c0c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 -- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c159ba0 msgr2=0x7fb48c14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c159ba0 0x7fb48c14bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 -- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0ca5e0 msgr2=0x7fb48c0c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0ca5e0 0x7fb48c0c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 -- 172.21.15.142:0/1328865904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009a20 con 0x7fb48c0b0de0 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48affd700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0ca5e0 0x7fb48c0c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:15.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.273+0000 7fb48b7fe700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0c3880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00c5e0 tx=0x7fb47c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:15.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.274+0000 7fb4737fe700 1 -- 172.21.15.142:0/1328865904 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c005b30 con 0x7fb48c0b0de0 2023-09-30T22:53:15.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.274+0000 7fb4737fe700 1 -- 172.21.15.142:0/1328865904 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c005c90 con 0x7fb48c0b0de0 2023-09-30T22:53:15.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.274+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c0c2db0 con 0x7fb48c0b0de0 2023-09-30T22:53:15.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.274+0000 7fb4737fe700 1 -- 172.21.15.142:0/1328865904 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0072e0 con 0x7fb48c0b0de0 2023-09-30T22:53:15.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.274+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c0c27c0 con 0x7fb48c0b0de0 2023-09-30T22:53:15.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.275+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c06edb0 con 0x7fb48c0b0de0 2023-09-30T22:53:15.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.276+0000 7fb4737fe700 1 -- 172.21.15.142:0/1328865904 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb47c012400 con 0x7fb48c0b0de0 2023-09-30T22:53:15.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.277+0000 7fb4737fe700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb478067330 0x7fb4780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:15.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.277+0000 7fb4737fe700 1 -- 172.21.15.142:0/1328865904 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb47c0840d0 con 0x7fb48c0b0de0 2023-09-30T22:53:15.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.277+0000 7fb48affd700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb478067330 0x7fb4780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:15.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.277+0000 7fb48affd700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb478067330 0x7fb4780697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb480006f00 tx=0x7fb480008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:15.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.281+0000 7fb4737fe700 1 -- 172.21.15.142:0/1328865904 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb47c04b570 con 0x7fb48c0b0de0 2023-09-30T22:53:15.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:15.512+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb48c0c3250 con 0x7fb48c0b0de0 2023-09-30T22:53:16.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.052+0000 7fb4737fe700 1 -- 172.21.15.142:0/1328865904 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb47c050fb0 con 0x7fb48c0b0de0 2023-09-30T22:53:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb478067330 msgr2=0x7fb4780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb478067330 0x7fb4780697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb480006f00 tx=0x7fb480008040 comp rx=0 tx=0).stop 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 msgr2=0x7fb48c0c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0c3880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00c5e0 tx=0x7fb47c001070 comp rx=0 tx=0).stop 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 shutdown_connections 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb478067330 0x7fb4780697e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c159ba0 0x7fb48c14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb48c0b0de0 0x7fb48c0c3880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 --2- 172.21.15.142:0/1328865904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0ca5e0 0x7fb48c0c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 >> 172.21.15.142:0/1328865904 conn(0x7fb48c0cb2f0 msgr2=0x7fb48c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 shutdown_connections 2023-09-30T22:53:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.055+0000 7fb4921ff700 1 -- 172.21.15.142:0/1328865904 wait complete. 2023-09-30T22:53:16.075 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.312+0000 7f69973ff700 1 Processor -- start 2023-09-30T22:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.312+0000 7f69973ff700 1 -- start start 2023-09-30T22:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.313+0000 7f69973ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f699015ac40 0x7f699015a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.313+0000 7f69973ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f69900cf180 0x7f69900cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.313+0000 7f69973ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f699015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.313+0000 7f69973ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69900d04e0 con 0x7f699015ac40 2023-09-30T22:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.313+0000 7f69973ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69900cc4d0 con 0x7f69900cf180 2023-09-30T22:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.313+0000 7f69973ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69900cc8f0 con 0x7f69900cc0b0 2023-09-30T22:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f699015ac40 0x7f699015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f699015ac40 0x7f699015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39312/0 (socket says 172.21.15.142:39312) 2023-09-30T22:53:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 -- 172.21.15.142:0/1077429904 learned_addr learned my addr 172.21.15.142:0/1077429904 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699599c700 1 --2- 172.21.15.142:0/1077429904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f699015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 -- 172.21.15.142:0/1077429904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 msgr2=0x7f699015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699499a700 1 --2- 172.21.15.142:0/1077429904 >> v2:172.21.15.148:3300/0 conn(0x7f69900cf180 0x7f69900cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 --2- 172.21.15.142:0/1077429904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f699015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 -- 172.21.15.142:0/1077429904 >> v2:172.21.15.148:3300/0 conn(0x7f69900cf180 msgr2=0x7f69900cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 --2- 172.21.15.142:0/1077429904 >> v2:172.21.15.148:3300/0 conn(0x7f69900cf180 0x7f69900cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 -- 172.21.15.142:0/1077429904 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900cf8d0 con 0x7f699015ac40 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699599c700 1 --2- 172.21.15.142:0/1077429904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f699015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.314+0000 7f699519b700 1 --2- 172.21.15.142:0/1077429904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f699015ac40 0x7f699015a220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f69900cd4c0 tx=0x7f698c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce84394f5bb9708 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f6987fff700 1 -- 172.21.15.142:0/1077429904 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c00b860 con 0x7f699015ac40 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f6987fff700 1 -- 172.21.15.142:0/1077429904 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c00b9c0 con 0x7f699015ac40 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f6987fff700 1 -- 172.21.15.142:0/1077429904 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c00bd60 con 0x7f699015ac40 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 -- 172.21.15.142:0/1077429904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f699015ac40 msgr2=0x7f699015a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 --2- 172.21.15.142:0/1077429904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f699015ac40 0x7f699015a220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f69900cd4c0 tx=0x7f698c009250 comp rx=0 tx=0).stop 2023-09-30T22:53:16.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 -- 172.21.15.142:0/1077429904 shutdown_connections 2023-09-30T22:53:16.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 --2- 172.21.15.142:0/1077429904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f699015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 --2- 172.21.15.142:0/1077429904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f699015ac40 0x7f699015a220 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 --2- 172.21.15.142:0/1077429904 >> v2:172.21.15.148:3300/0 conn(0x7f69900cf180 0x7f69900cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 -- 172.21.15.142:0/1077429904 >> 172.21.15.142:0/1077429904 conn(0x7f69900d0a80 msgr2=0x7f69900d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:16.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 -- 172.21.15.142:0/1077429904 shutdown_connections 2023-09-30T22:53:16.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.315+0000 7f69973ff700 1 -- 172.21.15.142:0/1077429904 wait complete. 2023-09-30T22:53:16.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.317+0000 7f69973ff700 1 Processor -- start 2023-09-30T22:53:16.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.317+0000 7f69973ff700 1 -- start start 2023-09-30T22:53:16.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f69973ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f69901596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:16.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f69973ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900cf180 0x7f6990157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:16.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f69973ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f699015ac40 0x7f699014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f69973ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990159bf0 con 0x7f69900cf180 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f69973ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69901583e0 con 0x7f699015ac40 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f69973ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6990159220 con 0x7f69900cc0b0 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900cf180 0x7f6990157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900cf180 0x7f6990157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39324/0 (socket says 172.21.15.142:39324) 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 -- 172.21.15.142:0/522424959 learned_addr learned my addr 172.21.15.142:0/522424959 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699519b700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f69901596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699599c700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f699015ac40 0x7f699014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 -- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 msgr2=0x7f69901596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f69901596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 -- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f699015ac40 msgr2=0x7f699014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f699015ac40 0x7f699014cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699499a700 1 -- 172.21.15.142:0/522424959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c0094f0 con 0x7f69900cf180 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.318+0000 7f699599c700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f699015ac40 0x7f699014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.319+0000 7f699499a700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900cf180 0x7f6990157ea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f698000c7d0 tx=0x7f6980008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.319+0000 7f69857fa700 1 -- 172.21.15.142:0/522424959 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980011600 con 0x7f69900cf180 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.319+0000 7f69857fa700 1 -- 172.21.15.142:0/522424959 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6980011760 con 0x7f69900cf180 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.319+0000 7f69857fa700 1 -- 172.21.15.142:0/522424959 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980011b20 con 0x7f69900cf180 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.319+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699014d070 con 0x7f69900cf180 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.319+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69901588f0 con 0x7f69900cf180 2023-09-30T22:53:16.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.320+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6990069770 con 0x7f69900cf180 2023-09-30T22:53:16.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.321+0000 7f69857fa700 1 -- 172.21.15.142:0/522424959 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6980018350 con 0x7f69900cf180 2023-09-30T22:53:16.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.322+0000 7f69857fa700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6974067330 0x7f69740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:16.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.322+0000 7f69857fa700 1 -- 172.21.15.142:0/522424959 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f6980084af0 con 0x7f69900cf180 2023-09-30T22:53:16.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.322+0000 7f699519b700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6974067330 0x7f69740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:16.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.323+0000 7f699519b700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6974067330 0x7f69740697e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69900cd4c0 tx=0x7f698c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:16.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.326+0000 7f69857fa700 1 -- 172.21.15.142:0/522424959 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6980051920 con 0x7f69900cf180 2023-09-30T22:53:16.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:16.517+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6990159360 con 0x7f69900cf180 2023-09-30T22:53:17.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.466+0000 7f69857fa700 1 -- 172.21.15.142:0/522424959 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f698001e0d0 con 0x7f69900cf180 2023-09-30T22:53:17.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6974067330 msgr2=0x7f69740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:17.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6974067330 0x7f69740697e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69900cd4c0 tx=0x7f698c017000 comp rx=0 tx=0).stop 2023-09-30T22:53:17.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900cf180 msgr2=0x7f6990157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:17.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900cf180 0x7f6990157ea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f698000c7d0 tx=0x7f6980008040 comp rx=0 tx=0).stop 2023-09-30T22:53:17.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 shutdown_connections 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6974067330 0x7f69740697e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f699015ac40 0x7f699014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900cc0b0 0x7f69901596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 --2- 172.21.15.142:0/522424959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900cf180 0x7f6990157ea0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 >> 172.21.15.142:0/522424959 conn(0x7f69900d0a80 msgr2=0x7f699015c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 shutdown_connections 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.470+0000 7f69973ff700 1 -- 172.21.15.142:0/522424959 wait complete. 2023-09-30T22:53:17.471 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:53:17.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:53:17.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.693+0000 7f63545ff700 1 Processor -- start 2023-09-30T22:53:17.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.693+0000 7f63545ff700 1 -- start start 2023-09-30T22:53:17.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.694+0000 7f63545ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f634c0aa3c0 0x7f634c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.694+0000 7f63545ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.694+0000 7f63545ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f634c0aa790 0x7f634c06a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.694+0000 7f63545ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c06d7f0 con 0x7f634c0aa790 2023-09-30T22:53:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.694+0000 7f63545ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c15e790 con 0x7f634c0aa3c0 2023-09-30T22:53:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.694+0000 7f63545ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cc980 con 0x7f634c0a98c0 2023-09-30T22:53:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f634c0aa790 0x7f634c06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f634c0aa790 0x7f634c06a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39328/0 (socket says 172.21.15.142:39328) 2023-09-30T22:53:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 -- 172.21.15.142:0/857542842 learned_addr learned my addr 172.21.15.142:0/857542842 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6351b9a700 1 --2- 172.21.15.142:0/857542842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f635239b700 1 --2- 172.21.15.142:0/857542842 >> v2:172.21.15.148:3300/0 conn(0x7f634c0aa3c0 0x7f634c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 -- 172.21.15.142:0/857542842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 msgr2=0x7f634c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 --2- 172.21.15.142:0/857542842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 -- 172.21.15.142:0/857542842 >> v2:172.21.15.148:3300/0 conn(0x7f634c0aa3c0 msgr2=0x7f634c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 --2- 172.21.15.142:0/857542842 >> v2:172.21.15.148:3300/0 conn(0x7f634c0aa3c0 0x7f634c15e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 -- 172.21.15.142:0/857542842 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c06b3a0 con 0x7f634c0aa790 2023-09-30T22:53:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.695+0000 7f6352b9c700 1 --2- 172.21.15.142:0/857542842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c06a450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f634c064800 tx=0x7f6344009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2cf0358de9819a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:17.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f6351399700 1 -- 172.21.15.142:0/857542842 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400e070 con 0x7f634c0aa790 2023-09-30T22:53:17.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f6351399700 1 -- 172.21.15.142:0/857542842 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634400bad0 con 0x7f634c0aa790 2023-09-30T22:53:17.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f6351399700 1 -- 172.21.15.142:0/857542842 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63440092e0 con 0x7f634c0aa790 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 -- 172.21.15.142:0/857542842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 msgr2=0x7f634c06a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 --2- 172.21.15.142:0/857542842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c06a450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f634c064800 tx=0x7f6344009840 comp rx=0 tx=0).stop 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 -- 172.21.15.142:0/857542842 shutdown_connections 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 --2- 172.21.15.142:0/857542842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c06a450 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 --2- 172.21.15.142:0/857542842 >> v2:172.21.15.148:3300/0 conn(0x7f634c0aa3c0 0x7f634c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 --2- 172.21.15.142:0/857542842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 -- 172.21.15.142:0/857542842 >> 172.21.15.142:0/857542842 conn(0x7f634c0680a0 msgr2=0x7f634c0ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.696+0000 7f63545ff700 1 -- 172.21.15.142:0/857542842 shutdown_connections 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.697+0000 7f63545ff700 1 -- 172.21.15.142:0/857542842 wait complete. 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.699+0000 7f63545ff700 1 Processor -- start 2023-09-30T22:53:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.699+0000 7f63545ff700 1 -- start start 2023-09-30T22:53:17.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f63545ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f63545ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f634c0aa3c0 0x7f634c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f63545ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f63545ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0c9450 con 0x7f634c0aa790 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f63545ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b0020 con 0x7f634c0aa3c0 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f63545ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cc1a0 con 0x7f634c0a98c0 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f6352b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f6352b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c0cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39338/0 (socket says 172.21.15.142:39338) 2023-09-30T22:53:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f6352b9c700 1 -- 172.21.15.142:0/2440007906 learned_addr learned my addr 172.21.15.142:0/2440007906 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f635239b700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.700+0000 7f6351b9a700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f634c0aa3c0 0x7f634c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f6352b9c700 1 -- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 msgr2=0x7f634c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f6352b9c700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f6352b9c700 1 -- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f634c0aa3c0 msgr2=0x7f634c0cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f6352b9c700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f634c0aa3c0 0x7f634c0cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f6352b9c700 1 -- 172.21.15.142:0/2440007906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009ae0 con 0x7f634c0aa790 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f6352b9c700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c0cb100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6344009880 tx=0x7f6344018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f63427fc700 1 -- 172.21.15.142:0/2440007906 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63440032f0 con 0x7f634c0aa790 2023-09-30T22:53:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f63427fc700 1 -- 172.21.15.142:0/2440007906 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344007c50 con 0x7f634c0aa790 2023-09-30T22:53:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c0afcf0 con 0x7f634c0aa790 2023-09-30T22:53:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f63427fc700 1 -- 172.21.15.142:0/2440007906 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634401d420 con 0x7f634c0aa790 2023-09-30T22:53:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.701+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c0cbec0 con 0x7f634c0aa790 2023-09-30T22:53:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.702+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c069b30 con 0x7f634c0aa790 2023-09-30T22:53:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.703+0000 7f63427fc700 1 -- 172.21.15.142:0/2440007906 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6344003040 con 0x7f634c0aa790 2023-09-30T22:53:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.704+0000 7f63427fc700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6330067330 0x7f63300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.704+0000 7f63427fc700 1 -- 172.21.15.142:0/2440007906 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f6344086200 con 0x7f634c0aa790 2023-09-30T22:53:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.704+0000 7f635239b700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6330067330 0x7f63300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.705+0000 7f635239b700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6330067330 0x7f63300697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6348006fd0 tx=0x7f6348008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:17.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.709+0000 7f63427fc700 1 -- 172.21.15.142:0/2440007906 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f63440531c0 con 0x7f634c0aa790 2023-09-30T22:53:17.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:17.898+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f634c0b0160 con 0x7f634c0aa790 2023-09-30T22:53:18.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.477+0000 7f63427fc700 1 -- 172.21.15.142:0/2440007906 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f63440567e0 con 0x7f634c0aa790 2023-09-30T22:53:18.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6330067330 msgr2=0x7f63300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:18.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6330067330 0x7f63300697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6348006fd0 tx=0x7f6348008040 comp rx=0 tx=0).stop 2023-09-30T22:53:18.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 msgr2=0x7f634c0cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c0cb100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6344009880 tx=0x7f6344018000 comp rx=0 tx=0).stop 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 shutdown_connections 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6330067330 0x7f63300697e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f634c0aa790 0x7f634c0cb100 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f634c0a98c0 0x7f634c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 --2- 172.21.15.142:0/2440007906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f634c0aa3c0 0x7f634c0cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 >> 172.21.15.142:0/2440007906 conn(0x7f634c0680a0 msgr2=0x7f634c153000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 shutdown_connections 2023-09-30T22:53:18.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.480+0000 7f63545ff700 1 -- 172.21.15.142:0/2440007906 wait complete. 2023-09-30T22:53:18.482 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:53:18.502 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:53:18.502 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:53:18.502 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:53:18.503 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:53:18.503 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:53:18.503 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:53:18.503 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:53:18.503 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:53:18.503 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:53:18.503 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:53:18.504 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:53:18.504 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:53:18.504 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:53:18.504 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:53:18.504 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:53:18.504 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:53:18.517 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:53:18.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:53:18.519 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:53:18.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:53:18.523 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:53:18.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:53:18.524 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:53:18.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:53:18.563 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:53:18.563 DEBUG:teuthology.parallel:result is None 2023-09-30T22:53:18.565 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:53:18.566 DEBUG:teuthology.parallel:result is None 2023-09-30T22:53:18.568 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:53:18.568 DEBUG:teuthology.parallel:result is None 2023-09-30T22:53:18.570 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:53:18.571 DEBUG:teuthology.parallel:result is None 2023-09-30T22:53:18.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:53:18.709 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:53:18.710 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:53:18.715 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:53:18.715 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:53:18.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.777+0000 7f1c6b9ff700 1 Processor -- start 2023-09-30T22:53:18.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.777+0000 7f1c6b9ff700 1 -- start start 2023-09-30T22:53:18.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6b9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1c640cbfe0 0x7f1c6415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:18.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6b9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c640d0550 con 0x7f1c64157ab0 2023-09-30T22:53:18.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6b9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c640cf940 con 0x7f1c640cc3b0 2023-09-30T22:53:18.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6b9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c640cfc20 con 0x7f1c640cbfe0 2023-09-30T22:53:18.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6979b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1c640cbfe0 0x7f1c6415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:18.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c69f9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1c64157ab0 0x7f1c6406a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42634/0 (socket says 172.21.15.142:42634) 2023-09-30T22:53:18.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c69f9c700 1 -- 172.21.15.142:0/2545181789 learned_addr learned my addr 172.21.15.142:0/2545181789 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6979b700 1 -- 172.21.15.142:0/2545181789 >> v1:172.21.15.148:6789/0 conn(0x7f1c640cc3b0 legacy=0x7f1c641573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6979b700 1 -- 172.21.15.142:0/2545181789 >> v1:172.21.15.142:6789/0 conn(0x7f1c64157ab0 legacy=0x7f1c6406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.779+0000 7f1c6979b700 1 -- 172.21.15.142:0/2545181789 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c640cff00 con 0x7f1c640cbfe0 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c6979b700 1 --2- 172.21.15.142:0/2545181789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cbfe0 0x7f1c6415a2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c600098e0 tx=0x7f1c600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40afb5289cb9966 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c5bfff700 1 -- 172.21.15.142:0/2545181789 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60009e80 con 0x7f1c640cbfe0 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c5bfff700 1 -- 172.21.15.142:0/2545181789 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000b860 con 0x7f1c640cbfe0 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c5bfff700 1 -- 172.21.15.142:0/2545181789 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000bbe0 con 0x7f1c640cbfe0 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/2545181789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cbfe0 msgr2=0x7f1c6415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:18.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/2545181789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cbfe0 0x7f1c6415a2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c600098e0 tx=0x7f1c600091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/2545181789 shutdown_connections 2023-09-30T22:53:18.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/2545181789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cbfe0 0x7f1c6415a2a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.780+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/2545181789 >> 172.21.15.142:0/2545181789 conn(0x7f1c640d0a80 msgr2=0x7f1c640d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:18.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.781+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/2545181789 shutdown_connections 2023-09-30T22:53:18.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.781+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/2545181789 wait complete. 2023-09-30T22:53:18.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.782+0000 7f1c6b9ff700 1 Processor -- start 2023-09-30T22:53:18.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.782+0000 7f1c6b9ff700 1 -- start start 2023-09-30T22:53:18.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c6b9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c640cbfe0 0x7f1c640c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:18.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c6b9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cc3b0 0x7f1c6416a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:18.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c6b9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c64157ab0 0x7f1c640b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:18.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c6b9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64158de0 con 0x7f1c640cc3b0 2023-09-30T22:53:18.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c6b9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641581d0 con 0x7f1c64157ab0 2023-09-30T22:53:18.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c6b9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641584b0 con 0x7f1c640cbfe0 2023-09-30T22:53:18.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c68f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cc3b0 0x7f1c6416a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:18.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c68f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cc3b0 0x7f1c6416a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39388/0 (socket says 172.21.15.142:39388) 2023-09-30T22:53:18.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c68f9a700 1 -- 172.21.15.142:0/881794445 learned_addr learned my addr 172.21.15.142:0/881794445 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:18.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c6979b700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c640cbfe0 0x7f1c640c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:18.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.783+0000 7f1c69f9c700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c64157ab0 0x7f1c640b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:18.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c68f9a700 1 -- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c640cbfe0 msgr2=0x7f1c640c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:18.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c68f9a700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c640cbfe0 0x7f1c640c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c68f9a700 1 -- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c64157ab0 msgr2=0x7f1c640b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:18.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c68f9a700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c64157ab0 0x7f1c640b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:18.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c68f9a700 1 -- 172.21.15.142:0/881794445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60009420 con 0x7f1c640cc3b0 2023-09-30T22:53:18.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c68f9a700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cc3b0 0x7f1c6416a7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400c590 tx=0x7f1c5400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:18.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c597fa700 1 -- 172.21.15.142:0/881794445 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54011590 con 0x7f1c640cc3b0 2023-09-30T22:53:18.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c597fa700 1 -- 172.21.15.142:0/881794445 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54011710 con 0x7f1c640cc3b0 2023-09-30T22:53:18.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c64158790 con 0x7f1c640cc3b0 2023-09-30T22:53:18.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c597fa700 1 -- 172.21.15.142:0/881794445 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54011ad0 con 0x7f1c640cc3b0 2023-09-30T22:53:18.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.784+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c640c4220 con 0x7f1c640cc3b0 2023-09-30T22:53:18.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.786+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c64158f50 con 0x7f1c640cc3b0 2023-09-30T22:53:18.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.786+0000 7f1c597fa700 1 -- 172.21.15.142:0/881794445 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1c5401b3b0 con 0x7f1c640cc3b0 2023-09-30T22:53:18.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.787+0000 7f1c597fa700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c48067330 0x7f1c480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:18.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.787+0000 7f1c597fa700 1 -- 172.21.15.142:0/881794445 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1c54083d20 con 0x7f1c640cc3b0 2023-09-30T22:53:18.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.787+0000 7f1c6979b700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c48067330 0x7f1c480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:18.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.788+0000 7f1c6979b700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c48067330 0x7f1c480697e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c600093f0 tx=0x7f1c60017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:18.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.791+0000 7f1c597fa700 1 -- 172.21.15.142:0/881794445 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1c54050f20 con 0x7f1c640cc3b0 2023-09-30T22:53:18.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:18.995+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1c64156db0 con 0x7f1c640cc3b0 2023-09-30T22:53:20.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.277+0000 7f1c597fa700 1 -- 172.21.15.142:0/881794445 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1c54017020 con 0x7f1c640cc3b0 2023-09-30T22:53:20.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.280+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c48067330 msgr2=0x7f1c480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.280+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c48067330 0x7f1c480697e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c600093f0 tx=0x7f1c60017000 comp rx=0 tx=0).stop 2023-09-30T22:53:20.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.280+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cc3b0 msgr2=0x7f1c6416a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.280+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cc3b0 0x7f1c6416a7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400c590 tx=0x7f1c5400c8a0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 shutdown_connections 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c48067330 0x7f1c480697e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c64157ab0 0x7f1c640b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c640cbfe0 0x7f1c640c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 --2- 172.21.15.142:0/881794445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c640cc3b0 0x7f1c6416a7a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 >> 172.21.15.142:0/881794445 conn(0x7f1c640d0a80 msgr2=0x7f1c640cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 shutdown_connections 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.281+0000 7f1c6b9ff700 1 -- 172.21.15.142:0/881794445 wait complete. 2023-09-30T22:53:20.339 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:53:20.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:53:20.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.534+0000 7f7de77ff700 1 Processor -- start 2023-09-30T22:53:20.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.534+0000 7f7de77ff700 1 -- start start 2023-09-30T22:53:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.535+0000 7f7de77ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 0x7f7de0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.535+0000 7f7de77ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de00b0ee0 con 0x7f7de00aebf0 2023-09-30T22:53:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.535+0000 7f7de77ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de015a520 con 0x7f7de0069f10 2023-09-30T22:53:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.535+0000 7f7de77ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00aefc0 con 0x7f7de0159b90 2023-09-30T22:53:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.535+0000 7f7de559b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7de00aebf0 0x7f7de006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42644/0 (socket says 172.21.15.142:42644) 2023-09-30T22:53:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.535+0000 7f7de559b700 1 -- 172.21.15.142:0/417207982 learned_addr learned my addr 172.21.15.142:0/417207982 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:20.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 0x7f7de0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:20.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046596692 0 0) 0x7f7de00b0ee0 con 0x7f7de00aebf0 2023-09-30T22:53:20.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dcc004680 con 0x7f7de00aebf0 2023-09-30T22:53:20.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521754986 0 0) 0x7f7dcc004680 con 0x7f7de00aebf0 2023-09-30T22:53:20.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 msgr2=0x7f7de0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 0x7f7de0159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 >> v1:172.21.15.148:6789/0 conn(0x7f7de0069f10 legacy=0x7f7de006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de006f360 con 0x7f7de00aebf0 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f7ddc001470 con 0x7f7de00aebf0 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 >> v1:172.21.15.142:6789/0 conn(0x7f7de00aebf0 legacy=0x7f7de006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 0x7f7dcc004ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dcc005120 0x7f7dcc005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dcc005e60 0x7f7dcc0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00aefc0 con 0x7f7dcc005120 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc00cd00 con 0x7f7dcc005e60 2023-09-30T22:53:20.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.536+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc00cec0 con 0x7f7de0159b90 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dcc005120 0x7f7dcc005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de559b700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 0x7f7dcc004ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de5d9c700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dcc005e60 0x7f7dcc0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de4d9a700 1 -- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 msgr2=0x7f7dcc004ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de0159b90 0x7f7dcc004ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de4d9a700 1 -- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dcc005e60 msgr2=0x7f7dcc0062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dcc005e60 0x7f7dcc0062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de4d9a700 1 -- 172.21.15.142:0/417207982 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc004680 con 0x7f7dcc005120 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.537+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dcc005120 0x7f7dcc005920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0006f00 tx=0x7f7dd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a67320d30732634 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000e710 con 0x7f7dcc005120 2023-09-30T22:53:20.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000e870 con 0x7f7dcc005120 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7dd7fff700 1 -- 172.21.15.142:0/417207982 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000ec30 con 0x7f7dcc005120 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7de77ff700 1 -- 172.21.15.142:0/417207982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dcc005120 msgr2=0x7f7dcc005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7de77ff700 1 --2- 172.21.15.142:0/417207982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dcc005120 0x7f7dcc005920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0006f00 tx=0x7f7dd00091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7de5d9c700 1 -- 172.21.15.142:0/417207982 reap_dead start 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7de77ff700 1 -- 172.21.15.142:0/417207982 shutdown_connections 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7de77ff700 1 -- 172.21.15.142:0/417207982 >> 172.21.15.142:0/417207982 conn(0x7f7de00680c0 msgr2=0x7f7de00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7de77ff700 1 -- 172.21.15.142:0/417207982 shutdown_connections 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.538+0000 7f7de77ff700 1 -- 172.21.15.142:0/417207982 wait complete. 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.540+0000 7f7de77ff700 1 Processor -- start 2023-09-30T22:53:20.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.540+0000 7f7de77ff700 1 -- start start 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de77ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dcc005120 0x7f7de0153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de77ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de0151540 0x7f7de0149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de77ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de0155220 0x7f7de0155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de77ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0152600 con 0x7f7de0151540 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de77ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0155bd0 con 0x7f7de0155220 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de77ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00c74e0 con 0x7f7dcc005120 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de0151540 0x7f7de0149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:20.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de0151540 0x7f7de0149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39400/0 (socket says 172.21.15.142:39400) 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 -- 172.21.15.142:0/1945285825 learned_addr learned my addr 172.21.15.142:0/1945285825 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 -- 172.21.15.142:0/1945285825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dcc005120 msgr2=0x7f7de0153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dcc005120 0x7f7de0153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 -- 172.21.15.142:0/1945285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de0155220 msgr2=0x7f7de0155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de0155220 0x7f7de0155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.541+0000 7f7de4d9a700 1 -- 172.21.15.142:0/1945285825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00c71b0 con 0x7f7de0151540 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.542+0000 7f7de4d9a700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de0151540 0x7f7de0149350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0068e0 tx=0x7f7dd0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.542+0000 7f7dd57fa700 1 -- 172.21.15.142:0/1945285825 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000e710 con 0x7f7de0151540 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.542+0000 7f7dd57fa700 1 -- 172.21.15.142:0/1945285825 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000ec10 con 0x7f7de0151540 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.542+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de0151d60 con 0x7f7de0151540 2023-09-30T22:53:20.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.542+0000 7f7dd57fa700 1 -- 172.21.15.142:0/1945285825 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00246a0 con 0x7f7de0151540 2023-09-30T22:53:20.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.542+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de0152320 con 0x7f7de0151540 2023-09-30T22:53:20.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.543+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de00695b0 con 0x7f7de0151540 2023-09-30T22:53:20.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.544+0000 7f7dd57fa700 1 -- 172.21.15.142:0/1945285825 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7dd0020070 con 0x7f7de0151540 2023-09-30T22:53:20.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.544+0000 7f7dd57fa700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dc4067360 0x7f7dc4069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:20.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.545+0000 7f7dd57fa700 1 -- 172.21.15.142:0/1945285825 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7dd00865f0 con 0x7f7de0151540 2023-09-30T22:53:20.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.545+0000 7f7de559b700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dc4067360 0x7f7dc4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:20.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.545+0000 7f7de559b700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dc4067360 0x7f7dc4069810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc007d70 tx=0x7f7ddc001e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:20.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.549+0000 7f7dd57fa700 1 -- 172.21.15.142:0/1945285825 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7dd0053850 con 0x7f7de0151540 2023-09-30T22:53:20.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.811+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7de00c7620 con 0x7f7de0151540 2023-09-30T22:53:20.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.811+0000 7f7dd57fa700 1 -- 172.21.15.142:0/1945285825 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7dd0056e70 con 0x7f7de0151540 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:53:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:53:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:53:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:53:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:53:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:53:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:53:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:53:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.bootstrap-mds", 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCZphhlxvIpGxAA/s+UnFaR/PTt+rKKkF2Pig==", 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile bootstrap-mds" 2023-09-30T22:53:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.bootstrap-mgr", 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCZphhlFAAqGxAAqHTtQJ3CbtE3Z+Bbe+QcBQ==", 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.bootstrap-osd", 2023-09-30T22:53:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCZphhleRQqGxAAer9czuSAGb6LEzVHoBoB7Q==", 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile bootstrap-osd" 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.bootstrap-rbd", 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCZphhlwh8qGxAAREAeV/JK7vSW6a8wAgMPww==", 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCZphhldygqGxAAZirhHyZnksxrz5u/fcDODw==", 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.bootstrap-rgw", 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCZphhlMzEqGxAA94uaNqRkNnCI8DNRQcB/fg==", 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:53:20.831 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:53:20.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.813+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dc4067360 msgr2=0x7f7dc4069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.813+0000 7f7de77ff700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dc4067360 0x7f7dc4069810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc007d70 tx=0x7f7ddc001e50 comp rx=0 tx=0).stop 2023-09-30T22:53:20.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.813+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de0151540 msgr2=0x7f7de0149350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:20.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.813+0000 7f7de77ff700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de0151540 0x7f7de0149350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0068e0 tx=0x7f7dd0019000 comp rx=0 tx=0).stop 2023-09-30T22:53:20.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 shutdown_connections 2023-09-30T22:53:20.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dc4067360 0x7f7dc4069810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de0155220 0x7f7de0155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dcc005120 0x7f7de0153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 --2- 172.21.15.142:0/1945285825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de0151540 0x7f7de0149350 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:20.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 >> 172.21.15.142:0/1945285825 conn(0x7f7de00680c0 msgr2=0x7f7de0154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:20.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 shutdown_connections 2023-09-30T22:53:20.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:20.814+0000 7f7de77ff700 1 -- 172.21.15.142:0/1945285825 wait complete. 2023-09-30T22:53:20.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-30T22:53:21.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.026+0000 7ff768dff700 1 Processor -- start 2023-09-30T22:53:21.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.026+0000 7ff768dff700 1 -- start start 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.027+0000 7ff768dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff764157ab0 0x7ff76415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.027+0000 7ff768dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7640cc3b0 0x7ff7640cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.027+0000 7ff768dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640d0550 con 0x7ff7640cbfe0 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.027+0000 7ff768dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640cf750 con 0x7ff7640cc3b0 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.027+0000 7ff768dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640cf940 con 0x7ff764157ab0 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.027+0000 7ff762d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7640cc3b0 0x7ff7640cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff762d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7640cc3b0 0x7ff7640cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39454/0 (socket says 172.21.15.142:39454) 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff762d9d700 1 -- 172.21.15.142:0/3862793651 learned_addr learned my addr 172.21.15.142:0/3862793651 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:21.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff761d9b700 1 --2- 172.21.15.142:0/3862793651 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff764157ab0 0x7ff76415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff762d9d700 1 -- 172.21.15.142:0/3862793651 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff764157ab0 msgr2=0x7ff76415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:21.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff762d9d700 1 --2- 172.21.15.142:0/3862793651 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff764157ab0 0x7ff76415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff762d9d700 1 -- 172.21.15.142:0/3862793651 >> v1:172.21.15.148:6789/0 conn(0x7ff7640cbfe0 legacy=0x7ff7641573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff762d9d700 1 -- 172.21.15.142:0/3862793651 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640cfc20 con 0x7ff7640cc3b0 2023-09-30T22:53:21.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff76159a700 1 -- 172.21.15.142:0/3862793651 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596253014 0 0) 0x7ff7640d0550 con 0x7ff7640cbfe0 2023-09-30T22:53:21.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff762d9d700 1 --2- 172.21.15.142:0/3862793651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7640cc3b0 0x7ff7640cf210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009f50 tx=0x7ff75c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3bedbba9fceae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.028+0000 7ff76159a700 1 -- 172.21.15.142:0/3862793651 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00e070 con 0x7ff7640cc3b0 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff76159a700 1 -- 172.21.15.142:0/3862793651 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c00b9c0 con 0x7ff7640cc3b0 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff76159a700 1 -- 172.21.15.142:0/3862793651 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0092e0 con 0x7ff7640cc3b0 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 -- 172.21.15.142:0/3862793651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7640cc3b0 msgr2=0x7ff7640cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 --2- 172.21.15.142:0/3862793651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7640cc3b0 0x7ff7640cf210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009f50 tx=0x7ff75c009840 comp rx=0 tx=0).stop 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 -- 172.21.15.142:0/3862793651 shutdown_connections 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 --2- 172.21.15.142:0/3862793651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7640cc3b0 0x7ff7640cf210 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 --2- 172.21.15.142:0/3862793651 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff764157ab0 0x7ff76415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 -- 172.21.15.142:0/3862793651 >> 172.21.15.142:0/3862793651 conn(0x7ff7640d0a80 msgr2=0x7ff7640d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 -- 172.21.15.142:0/3862793651 shutdown_connections 2023-09-30T22:53:21.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.029+0000 7ff768dff700 1 -- 172.21.15.142:0/3862793651 wait complete. 2023-09-30T22:53:21.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.031+0000 7ff768dff700 1 Processor -- start 2023-09-30T22:53:21.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.031+0000 7ff768dff700 1 -- start start 2023-09-30T22:53:21.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff768dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7640cbfe0 0x7ff76415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff768dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7640cc3b0 0x7ff7640c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff768dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff764157ab0 0x7ff7641480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff768dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764158c50 con 0x7ff764157ab0 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff768dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76416de60 con 0x7ff7640cc3b0 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff768dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76416e140 con 0x7ff7640cbfe0 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff764157ab0 0x7ff7641480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff764157ab0 0x7ff7641480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39470/0 (socket says 172.21.15.142:39470) 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 -- 172.21.15.142:0/2082989933 learned_addr learned my addr 172.21.15.142:0/2082989933 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 -- 172.21.15.142:0/2082989933 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7640cbfe0 msgr2=0x7ff76415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7640cbfe0 0x7ff76415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 -- 172.21.15.142:0/2082989933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7640cc3b0 msgr2=0x7ff7640c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7640cc3b0 0x7ff7640c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.032+0000 7ff762d9d700 1 -- 172.21.15.142:0/2082989933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c009ae0 con 0x7ff764157ab0 2023-09-30T22:53:21.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.033+0000 7ff762d9d700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff764157ab0 0x7ff7641480a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009880 tx=0x7ff75c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:21.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.033+0000 7ff7527fc700 1 -- 172.21.15.142:0/2082989933 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c007c20 con 0x7ff764157ab0 2023-09-30T22:53:21.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.033+0000 7ff7527fc700 1 -- 172.21.15.142:0/2082989933 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c007da0 con 0x7ff764157ab0 2023-09-30T22:53:21.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.033+0000 7ff7527fc700 1 -- 172.21.15.142:0/2082989933 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0266b0 con 0x7ff764157ab0 2023-09-30T22:53:21.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.033+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76416e420 con 0x7ff764157ab0 2023-09-30T22:53:21.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.033+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76415c390 con 0x7ff764157ab0 2023-09-30T22:53:21.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.034+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76415c5d0 con 0x7ff764157ab0 2023-09-30T22:53:21.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.035+0000 7ff7527fc700 1 -- 172.21.15.142:0/2082989933 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff75c026a60 con 0x7ff764157ab0 2023-09-30T22:53:21.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.036+0000 7ff7527fc700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff744067330 0x7ff7440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.036+0000 7ff7527fc700 1 -- 172.21.15.142:0/2082989933 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff75c0867e0 con 0x7ff764157ab0 2023-09-30T22:53:21.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.036+0000 7ff76259c700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff744067330 0x7ff7440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.037+0000 7ff76259c700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff744067330 0x7ff7440697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff7540016f0 tx=0x7ff7540079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:21.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.040+0000 7ff7527fc700 1 -- 172.21.15.142:0/2082989933 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff75c053990 con 0x7ff764157ab0 2023-09-30T22:53:21.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.308+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff764158d90 con 0x7ff764157ab0 2023-09-30T22:53:21.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.313+0000 7ff7527fc700 1 -- 172.21.15.142:0/2082989933 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff75c056fb0 con 0x7ff764157ab0 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff744067330 msgr2=0x7ff7440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff744067330 0x7ff7440697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff7540016f0 tx=0x7ff7540079b0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff764157ab0 msgr2=0x7ff7641480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff764157ab0 0x7ff7641480a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009880 tx=0x7ff75c018000 comp rx=0 tx=0).stop 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 shutdown_connections 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff744067330 0x7ff7440697e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff764157ab0 0x7ff7641480a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7640cbfe0 0x7ff76415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 --2- 172.21.15.142:0/2082989933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7640cc3b0 0x7ff7640c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 >> 172.21.15.142:0/2082989933 conn(0x7ff7640d0a80 msgr2=0x7ff76406b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:21.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 shutdown_connections 2023-09-30T22:53:21.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.315+0000 7ff768dff700 1 -- 172.21.15.142:0/2082989933 wait complete. 2023-09-30T22:53:21.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-30T22:53:21.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.525+0000 7fe2a53ff700 1 Processor -- start 2023-09-30T22:53:21.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.525+0000 7fe2a53ff700 1 -- start start 2023-09-30T22:53:21.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.526+0000 7fe2a53ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2a00b00d0 0x7fe2a006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.526+0000 7fe2a53ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.526+0000 7fe2a53ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a006d3e0 con 0x7fe2a00af020 2023-09-30T22:53:21.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.526+0000 7fe2a53ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a006dc80 con 0x7fe2a00b00d0 2023-09-30T22:53:21.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.526+0000 7fe2a53ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a006b790 con 0x7fe2a006e650 2023-09-30T22:53:21.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2a00b00d0 0x7fe2a006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2a00b00d0 0x7fe2a006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39484/0 (socket says 172.21.15.142:39484) 2023-09-30T22:53:21.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 -- 172.21.15.142:0/2176046338 learned_addr learned my addr 172.21.15.142:0/2176046338 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:21.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29f7fe700 1 --2- 172.21.15.142:0/2176046338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 -- 172.21.15.142:0/2176046338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 msgr2=0x7fe2a015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:21.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 --2- 172.21.15.142:0/2176046338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 -- 172.21.15.142:0/2176046338 >> v1:172.21.15.148:6789/0 conn(0x7fe2a00af020 legacy=0x7fe2a0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 -- 172.21.15.142:0/2176046338 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a00b0650 con 0x7fe2a00b00d0 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29f7fe700 1 --2- 172.21.15.142:0/2176046338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29e7fc700 1 --2- 172.21.15.142:0/2176046338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00b00d0 0x7fe2a006e110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe2940099b0 tx=0x7fe294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba0916a46d603e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.527+0000 7fe29dffb700 1 -- 172.21.15.142:0/2176046338 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29400b860 con 0x7fe2a00b00d0 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe29dffb700 1 -- 172.21.15.142:0/2176046338 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29400b9c0 con 0x7fe2a00b00d0 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe29dffb700 1 -- 172.21.15.142:0/2176046338 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29400bd60 con 0x7fe2a00b00d0 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 -- 172.21.15.142:0/2176046338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00b00d0 msgr2=0x7fe2a006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/2176046338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00b00d0 0x7fe2a006e110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe2940099b0 tx=0x7fe294009250 comp rx=0 tx=0).stop 2023-09-30T22:53:21.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 -- 172.21.15.142:0/2176046338 shutdown_connections 2023-09-30T22:53:21.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/2176046338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/2176046338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00b00d0 0x7fe2a006e110 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 -- 172.21.15.142:0/2176046338 >> 172.21.15.142:0/2176046338 conn(0x7fe2a00680c0 msgr2=0x7fe2a00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:21.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 -- 172.21.15.142:0/2176046338 shutdown_connections 2023-09-30T22:53:21.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.528+0000 7fe2a53ff700 1 -- 172.21.15.142:0/2176046338 wait complete. 2023-09-30T22:53:21.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.530+0000 7fe2a53ff700 1 Processor -- start 2023-09-30T22:53:21.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.530+0000 7fe2a53ff700 1 -- start start 2023-09-30T22:53:21.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe2a53ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe2a53ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00af020 0x7fe2a0140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe2a53ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a00b00d0 0x7fe2a0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe2a53ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0140660 con 0x7fe2a00af020 2023-09-30T22:53:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe2a53ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0154040 con 0x7fe2a00b00d0 2023-09-30T22:53:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe2a53ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0151e70 con 0x7fe2a006e650 2023-09-30T22:53:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00af020 0x7fe2a0140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00af020 0x7fe2a0140120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39490/0 (socket says 172.21.15.142:39490) 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 -- 172.21.15.142:0/148168236 learned_addr learned my addr 172.21.15.142:0/148168236 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29effd700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29f7fe700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a00b00d0 0x7fe2a0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 -- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 msgr2=0x7fe2a0152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a0152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 -- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a00b00d0 msgr2=0x7fe2a0158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a00b00d0 0x7fe2a0158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29e7fc700 1 -- 172.21.15.142:0/148168236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940094f0 con 0x7fe2a00af020 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29effd700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.531+0000 7fe29f7fe700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a00b00d0 0x7fe2a0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.532+0000 7fe29e7fc700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00af020 0x7fe2a0140120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe294009290 tx=0x7fe294017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.532+0000 7fe286ffd700 1 -- 172.21.15.142:0/148168236 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294026480 con 0x7fe2a00af020 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.532+0000 7fe286ffd700 1 -- 172.21.15.142:0/148168236 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29401f070 con 0x7fe2a00af020 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.532+0000 7fe286ffd700 1 -- 172.21.15.142:0/148168236 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294026830 con 0x7fe2a00af020 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.532+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a0152150 con 0x7fe2a00af020 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.532+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a0152710 con 0x7fe2a00af020 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.533+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a0152930 con 0x7fe2a00af020 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.534+0000 7fe286ffd700 1 -- 172.21.15.142:0/148168236 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe294026ba0 con 0x7fe2a00af020 2023-09-30T22:53:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.535+0000 7fe286ffd700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe28c067330 0x7fe28c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:21.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.535+0000 7fe286ffd700 1 -- 172.21.15.142:0/148168236 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe294021070 con 0x7fe2a00af020 2023-09-30T22:53:21.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.535+0000 7fe29effd700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe28c067330 0x7fe28c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:21.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.536+0000 7fe29effd700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe28c067330 0x7fe28c0697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe290007fd0 tx=0x7fe290009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:21.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.539+0000 7fe286ffd700 1 -- 172.21.15.142:0/148168236 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe2940538c0 con 0x7fe2a00af020 2023-09-30T22:53:21.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.804+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe2a006fc10 con 0x7fe2a00af020 2023-09-30T22:53:21.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.808+0000 7fe286ffd700 1 -- 172.21.15.142:0/148168236 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe29402b0a0 con 0x7fe2a00af020 2023-09-30T22:53:21.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.810+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe28c067330 msgr2=0x7fe28c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.810+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe28c067330 0x7fe28c0697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe290007fd0 tx=0x7fe290009040 comp rx=0 tx=0).stop 2023-09-30T22:53:21.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00af020 msgr2=0x7fe2a0140120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:21.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00af020 0x7fe2a0140120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe294009290 tx=0x7fe294017000 comp rx=0 tx=0).stop 2023-09-30T22:53:21.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 shutdown_connections 2023-09-30T22:53:21.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe28c067330 0x7fe28c0697e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2a00b00d0 0x7fe2a0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2a006e650 0x7fe2a0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 --2- 172.21.15.142:0/148168236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2a00af020 0x7fe2a0140120 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:21.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 >> 172.21.15.142:0/148168236 conn(0x7fe2a00680c0 msgr2=0x7fe2a00c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:21.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 shutdown_connections 2023-09-30T22:53:21.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:21.811+0000 7fe2a53ff700 1 -- 172.21.15.142:0/148168236 wait complete. 2023-09-30T22:53:21.828 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-30T22:53:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.017+0000 7f8d68fff700 1 Processor -- start 2023-09-30T22:53:22.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.017+0000 7f8d68fff700 1 -- start start 2023-09-30T22:53:22.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.018+0000 7f8d68fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d641598e0 0x7f8d64159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.018+0000 7f8d68fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d640cee50 0x7f8d640d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.018+0000 7f8d68fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d6406b1c0 0x7f8d6415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.018+0000 7f8d68fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d640cff40 con 0x7f8d641598e0 2023-09-30T22:53:22.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.018+0000 7f8d68fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d640d0910 con 0x7f8d640cee50 2023-09-30T22:53:22.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.018+0000 7f8d68fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640cf330 con 0x7f8d6406b1c0 2023-09-30T22:53:22.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d641598e0 0x7f8d64159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d641598e0 0x7f8d64159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39492/0 (socket says 172.21.15.142:39492) 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 -- 172.21.15.142:0/3131200813 learned_addr learned my addr 172.21.15.142:0/3131200813 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d5bfff700 1 --2- 172.21.15.142:0/3131200813 >> v2:172.21.15.148:3300/0 conn(0x7f8d640cee50 0x7f8d640d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 -- 172.21.15.142:0/3131200813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d6406b1c0 msgr2=0x7f8d6415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d62d9d700 1 --2- 172.21.15.142:0/3131200813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d6406b1c0 0x7f8d6415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 --2- 172.21.15.142:0/3131200813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d6406b1c0 0x7f8d6415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 -- 172.21.15.142:0/3131200813 >> v2:172.21.15.148:3300/0 conn(0x7f8d640cee50 msgr2=0x7f8d640d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 --2- 172.21.15.142:0/3131200813 >> v2:172.21.15.148:3300/0 conn(0x7f8d640cee50 0x7f8d640d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 -- 172.21.15.142:0/3131200813 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640cf610 con 0x7f8d641598e0 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d5bfff700 1 --2- 172.21.15.142:0/3131200813 >> v2:172.21.15.148:3300/0 conn(0x7f8d640cee50 0x7f8d640d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:22.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d62d9d700 1 --2- 172.21.15.142:0/3131200813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d6406b1c0 0x7f8d6415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:22.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.019+0000 7f8d6259c700 1 --2- 172.21.15.142:0/3131200813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d64159cb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d640b36f0 tx=0x7f8d54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecbe15a5b43b78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:22.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d61d9b700 1 -- 172.21.15.142:0/3131200813 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400b860 con 0x7f8d641598e0 2023-09-30T22:53:22.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d61d9b700 1 -- 172.21.15.142:0/3131200813 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5400b9c0 con 0x7f8d641598e0 2023-09-30T22:53:22.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d61d9b700 1 -- 172.21.15.142:0/3131200813 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400bd60 con 0x7f8d641598e0 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 -- 172.21.15.142:0/3131200813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 msgr2=0x7f8d64159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 --2- 172.21.15.142:0/3131200813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d64159cb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d640b36f0 tx=0x7f8d54009250 comp rx=0 tx=0).stop 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 -- 172.21.15.142:0/3131200813 shutdown_connections 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 --2- 172.21.15.142:0/3131200813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d6406b1c0 0x7f8d6415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 --2- 172.21.15.142:0/3131200813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d64159cb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 --2- 172.21.15.142:0/3131200813 >> v2:172.21.15.148:3300/0 conn(0x7f8d640cee50 0x7f8d640d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 -- 172.21.15.142:0/3131200813 >> 172.21.15.142:0/3131200813 conn(0x7f8d640cd540 msgr2=0x7f8d640cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:22.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.020+0000 7f8d68fff700 1 -- 172.21.15.142:0/3131200813 shutdown_connections 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.021+0000 7f8d68fff700 1 -- 172.21.15.142:0/3131200813 wait complete. 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.022+0000 7f8d68fff700 1 Processor -- start 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.022+0000 7f8d68fff700 1 -- start start 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d68fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d6406b1c0 0x7f8d64150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d68fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d640cee50 0x7f8d640c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d68fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d640c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d68fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6416b520 con 0x7f8d641598e0 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d68fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6415c4b0 con 0x7f8d6406b1c0 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d68fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6415c790 con 0x7f8d640cee50 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d62d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d640c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d62d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d640c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39508/0 (socket says 172.21.15.142:39508) 2023-09-30T22:53:22.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.023+0000 7f8d62d9d700 1 -- 172.21.15.142:0/1927149732 learned_addr learned my addr 172.21.15.142:0/1927149732 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d6259c700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d6406b1c0 0x7f8d64150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d5bfff700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d640cee50 0x7f8d640c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d62d9d700 1 -- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d640cee50 msgr2=0x7f8d640c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d62d9d700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d640cee50 0x7f8d640c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d62d9d700 1 -- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d6406b1c0 msgr2=0x7f8d64150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d62d9d700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d6406b1c0 0x7f8d64150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d62d9d700 1 -- 172.21.15.142:0/1927149732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540094f0 con 0x7f8d641598e0 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d62d9d700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d640c6e80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00ce40 tx=0x7f8d5c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d5a7fc700 1 -- 172.21.15.142:0/1927149732 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00adf0 con 0x7f8d641598e0 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d5a7fc700 1 -- 172.21.15.142:0/1927149732 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c016420 con 0x7f8d641598e0 2023-09-30T22:53:22.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d640c4600 con 0x7f8d641598e0 2023-09-30T22:53:22.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d5a7fc700 1 -- 172.21.15.142:0/1927149732 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0167e0 con 0x7f8d641598e0 2023-09-30T22:53:22.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.024+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6415ca70 con 0x7f8d641598e0 2023-09-30T22:53:22.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.026+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d640c4b20 con 0x7f8d641598e0 2023-09-30T22:53:22.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.026+0000 7f8d5a7fc700 1 -- 172.21.15.142:0/1927149732 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8d5c016b50 con 0x7f8d641598e0 2023-09-30T22:53:22.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.027+0000 7f8d5a7fc700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d44067330 0x7f8d440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.027+0000 7f8d5a7fc700 1 -- 172.21.15.142:0/1927149732 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8d5c012070 con 0x7f8d641598e0 2023-09-30T22:53:22.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.027+0000 7f8d6259c700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d44067330 0x7f8d440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.028+0000 7f8d6259c700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d44067330 0x7f8d440697e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d640b36f0 tx=0x7f8d54017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:22.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.032+0000 7f8d5a7fc700 1 -- 172.21.15.142:0/1927149732 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8d5c04e570 con 0x7f8d641598e0 2023-09-30T22:53:22.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.298+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f8d6406fc10 con 0x7f8d641598e0 2023-09-30T22:53:22.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.302+0000 7f8d5a7fc700 1 -- 172.21.15.142:0/1927149732 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8d640c4b20 con 0x7f8d641598e0 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d44067330 msgr2=0x7f8d440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d44067330 0x7f8d440697e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d640b36f0 tx=0x7f8d54017000 comp rx=0 tx=0).stop 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 msgr2=0x7f8d640c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d640c6e80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00ce40 tx=0x7f8d5c0077d0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 shutdown_connections 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d44067330 0x7f8d440697e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d641598e0 0x7f8d640c6e80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d6406b1c0 0x7f8d64150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 --2- 172.21.15.142:0/1927149732 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d640cee50 0x7f8d640c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.304+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 >> 172.21.15.142:0/1927149732 conn(0x7f8d640cd540 msgr2=0x7f8d64158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:22.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.305+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 shutdown_connections 2023-09-30T22:53:22.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.305+0000 7f8d68fff700 1 -- 172.21.15.142:0/1927149732 wait complete. 2023-09-30T22:53:22.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-30T22:53:22.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.514+0000 7f6bcf5ff700 1 Processor -- start 2023-09-30T22:53:22.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.514+0000 7f6bcf5ff700 1 -- start start 2023-09-30T22:53:22.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcf5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bc815dee0 0x7f6bc8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcf5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc806b8d0 con 0x7f6bc81598e0 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcf5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80cff40 con 0x7f6bc80cee50 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcf5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80cf330 con 0x7f6bc815dee0 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcdb9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bc815dee0 0x7f6bc8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcd39b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6bc81598e0 0x7f6bc806b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45414/0 (socket says 172.21.15.142:45414) 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcd39b700 1 -- 172.21.15.142:0/3981014822 learned_addr learned my addr 172.21.15.142:0/3981014822 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bbffff700 1 -- 172.21.15.142:0/3981014822 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586303449 0 0) 0x7f6bc806b8d0 con 0x7f6bc81598e0 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bbffff700 1 -- 172.21.15.142:0/3981014822 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb4003570 con 0x7f6bc81598e0 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcdb9c700 1 -- 172.21.15.142:0/3981014822 >> v1:172.21.15.148:6789/0 conn(0x7f6bc80cee50 legacy=0x7f6bc815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bbffff700 1 -- 172.21.15.142:0/3981014822 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421153356 0 0) 0x7f6bc80cff40 con 0x7f6bc80cee50 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcdb9c700 1 -- 172.21.15.142:0/3981014822 >> v1:172.21.15.142:6789/0 conn(0x7f6bc81598e0 legacy=0x7f6bc806b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.516+0000 7f6bcdb9c700 1 -- 172.21.15.142:0/3981014822 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80cf610 con 0x7f6bc815dee0 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bcdb9c700 1 --2- 172.21.15.142:0/3981014822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc815dee0 0x7f6bc8159cb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e60 tx=0x7f6bc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32dd985a192e5a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bbffff700 1 -- 172.21.15.142:0/3981014822 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000e070 con 0x7f6bc815dee0 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bbffff700 1 -- 172.21.15.142:0/3981014822 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000bb60 con 0x7f6bc815dee0 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bbffff700 1 -- 172.21.15.142:0/3981014822 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0012430 con 0x7f6bc815dee0 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/3981014822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc815dee0 msgr2=0x7f6bc8159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/3981014822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc815dee0 0x7f6bc8159cb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e60 tx=0x7f6bc0009780 comp rx=0 tx=0).stop 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/3981014822 shutdown_connections 2023-09-30T22:53:22.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.517+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/3981014822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc815dee0 0x7f6bc8159cb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.518+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/3981014822 >> 172.21.15.142:0/3981014822 conn(0x7f6bc80cd540 msgr2=0x7f6bc80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:22.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.518+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/3981014822 shutdown_connections 2023-09-30T22:53:22.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.518+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/3981014822 wait complete. 2023-09-30T22:53:22.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.519+0000 7f6bcf5ff700 1 Processor -- start 2023-09-30T22:53:22.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.519+0000 7f6bcf5ff700 1 -- start start 2023-09-30T22:53:22.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcf5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc80cee50 0x7f6bc8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcf5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc81598e0 0x7f6bc80c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcf5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc815dee0 0x7f6bc8157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcf5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80c6e00 con 0x7f6bc80cee50 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcf5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80c7290 con 0x7f6bc81598e0 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcf5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80c61f0 con 0x7f6bc815dee0 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcd39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc80cee50 0x7f6bc8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcd39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc80cee50 0x7f6bc8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39532/0 (socket says 172.21.15.142:39532) 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcd39b700 1 -- 172.21.15.142:0/1946550096 learned_addr learned my addr 172.21.15.142:0/1946550096 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bccb9a700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc81598e0 0x7f6bc80c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.520+0000 7f6bcdb9c700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc815dee0 0x7f6bc8157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcd39b700 1 -- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc815dee0 msgr2=0x7f6bc8157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcd39b700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc815dee0 0x7f6bc8157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcd39b700 1 -- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc81598e0 msgr2=0x7f6bc80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcd39b700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc81598e0 0x7f6bc80c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcd39b700 1 -- 172.21.15.142:0/1946550096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009a20 con 0x7f6bc80cee50 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcd39b700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc80cee50 0x7f6bc8154810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40011e0 tx=0x7f6bc4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bbd7fa700 1 -- 172.21.15.142:0/1946550096 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4005b30 con 0x7f6bc80cee50 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bbd7fa700 1 -- 172.21.15.142:0/1946550096 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4005c90 con 0x7f6bc80cee50 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bbd7fa700 1 -- 172.21.15.142:0/1946550096 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4007300 con 0x7f6bc80cee50 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc80c64d0 con 0x7f6bc80cee50 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.521+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc80c6a90 con 0x7f6bc80cee50 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.522+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc80697b0 con 0x7f6bc80cee50 2023-09-30T22:53:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.523+0000 7f6bbd7fa700 1 -- 172.21.15.142:0/1946550096 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6bc4007670 con 0x7f6bc80cee50 2023-09-30T22:53:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.524+0000 7f6bbd7fa700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bac067330 0x7f6bac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.524+0000 7f6bbd7fa700 1 -- 172.21.15.142:0/1946550096 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6bc4083d40 con 0x7f6bc80cee50 2023-09-30T22:53:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.524+0000 7f6bccb9a700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bac067330 0x7f6bac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.525+0000 7f6bccb9a700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bac067330 0x7f6bac0697e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8158a10 tx=0x7f6bb8007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:22.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.528+0000 7f6bbd7fa700 1 -- 172.21.15.142:0/1946550096 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6bc4050ef0 con 0x7f6bc80cee50 2023-09-30T22:53:22.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.794+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6bc80c70e0 con 0x7f6bc80cee50 2023-09-30T22:53:22.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.798+0000 7f6bbd7fa700 1 -- 172.21.15.142:0/1946550096 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6bc4017020 con 0x7f6bc80cee50 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.800+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bac067330 msgr2=0x7f6bac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.800+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bac067330 0x7f6bac0697e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8158a10 tx=0x7f6bb8007ec0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.800+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc80cee50 msgr2=0x7f6bc8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.800+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc80cee50 0x7f6bc8154810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40011e0 tx=0x7f6bc4007df0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 shutdown_connections 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bac067330 0x7f6bac0697e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc815dee0 0x7f6bc8157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc80cee50 0x7f6bc8154810 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 --2- 172.21.15.142:0/1946550096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc81598e0 0x7f6bc80c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:22.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 >> 172.21.15.142:0/1946550096 conn(0x7f6bc80cd540 msgr2=0x7f6bc80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:22.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 shutdown_connections 2023-09-30T22:53:22.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:22.801+0000 7f6bcf5ff700 1 -- 172.21.15.142:0/1946550096 wait complete. 2023-09-30T22:53:22.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-30T22:53:23.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.009+0000 7f5cc3dff700 1 Processor -- start 2023-09-30T22:53:23.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.009+0000 7f5cc3dff700 1 -- start start 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.011+0000 7f5cc3dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5cbc0aebf0 0x7f5cbc06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.011+0000 7f5cc3dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.011+0000 7f5cc3dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cbc0b0ee0 con 0x7f5cbc06f190 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.011+0000 7f5cc3dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc0aefc0 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.011+0000 7f5cc3dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0b02d0 con 0x7f5cbc15a2a0 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc139a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5cbc06f190 0x7f5cbc159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45422/0 (socket says 172.21.15.142:45422) 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc139a700 1 -- 172.21.15.142:0/3081244902 learned_addr learned my addr 172.21.15.142:0/3081244902 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc239c700 1 --2- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc1b9b700 1 --2- 172.21.15.142:0/3081244902 >> v2:172.21.15.148:3300/0 conn(0x7f5cbc0aebf0 0x7f5cbc06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc0b99700 1 -- 172.21.15.142:0/3081244902 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634134465 0 0) 0x7f5cbc0b0ee0 con 0x7f5cbc06f190 2023-09-30T22:53:23.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc0b99700 1 -- 172.21.15.142:0/3081244902 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca8003570 con 0x7f5cbc06f190 2023-09-30T22:53:23.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc1b9b700 1 -- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 msgr2=0x7f5cbc069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:23.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc1b9b700 1 --2- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc1b9b700 1 -- 172.21.15.142:0/3081244902 >> v1:172.21.15.142:6789/0 conn(0x7f5cbc06f190 legacy=0x7f5cbc159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc1b9b700 1 -- 172.21.15.142:0/3081244902 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc0b05b0 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.012+0000 7f5cc239c700 1 --2- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc1b9b700 1 --2- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc06ec50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009910 tx=0x7f5cb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac266c136c71589 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc0b99700 1 -- 172.21.15.142:0/3081244902 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8011630 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc0b99700 1 -- 172.21.15.142:0/3081244902 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb8011790 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc0b99700 1 -- 172.21.15.142:0/3081244902 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8011b30 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc3dff700 1 -- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc0aebf0 msgr2=0x7f5cbc06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc06ec50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009910 tx=0x7f5cb80091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc3dff700 1 -- 172.21.15.142:0/3081244902 shutdown_connections 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc06ec50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/3081244902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc3dff700 1 -- 172.21.15.142:0/3081244902 >> 172.21.15.142:0/3081244902 conn(0x7f5cbc0680c0 msgr2=0x7f5cbc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:23.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.013+0000 7f5cc3dff700 1 -- 172.21.15.142:0/3081244902 shutdown_connections 2023-09-30T22:53:23.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.014+0000 7f5cc3dff700 1 -- 172.21.15.142:0/3081244902 wait complete. 2023-09-30T22:53:23.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.015+0000 7f5cc3dff700 1 Processor -- start 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.015+0000 7f5cc3dff700 1 -- start start 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc3dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc06f190 0x7f5cbc13bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc3dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc3dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc3dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc165df0 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc3dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc15b5c0 con 0x7f5cbc06f190 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc3dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc15b8a0 con 0x7f5cbc15a2a0 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39534/0 (socket says 172.21.15.142:39534) 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc139a700 1 -- 172.21.15.142:0/1392162815 learned_addr learned my addr 172.21.15.142:0/1392162815 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:23.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.016+0000 7f5cc1b9b700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc06f190 0x7f5cbc13bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc239c700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc139a700 1 -- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 msgr2=0x7f5cbc155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc139a700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc139a700 1 -- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc06f190 msgr2=0x7f5cbc13bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc139a700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc06f190 0x7f5cbc13bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc139a700 1 -- 172.21.15.142:0/1392162815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4009a20 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc139a700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc15abe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00c7c0 tx=0x7f5cac007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cb1ffb700 1 -- 172.21.15.142:0/1392162815 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac005cd0 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb8009420 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cb1ffb700 1 -- 172.21.15.142:0/1392162815 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac005e30 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.017+0000 7f5cb1ffb700 1 -- 172.21.15.142:0/1392162815 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac007320 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.018+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc165a80 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.018+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc165fa0 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.019+0000 7f5cb1ffb700 1 -- 172.21.15.142:0/1392162815 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5cac01b3b0 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.020+0000 7f5cb1ffb700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5ca0067330 0x7f5ca00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.020+0000 7f5cb1ffb700 1 -- 172.21.15.142:0/1392162815 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5cac083f70 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.020+0000 7f5cc1b9b700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5ca0067330 0x7f5ca00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.021+0000 7f5cc1b9b700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5ca0067330 0x7f5ca00697e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80091e0 tx=0x7f5cb8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:23.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.024+0000 7f5cb1ffb700 1 -- 172.21.15.142:0/1392162815 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5cbc165fa0 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.290+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5cbc165f30 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.294+0000 7f5cb1ffb700 1 -- 172.21.15.142:0/1392162815 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5cac017020 con 0x7f5cbc0aebf0 2023-09-30T22:53:23.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5ca0067330 msgr2=0x7f5ca00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5ca0067330 0x7f5ca00697e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80091e0 tx=0x7f5cb8017000 comp rx=0 tx=0).stop 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc0aebf0 msgr2=0x7f5cbc15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc15abe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00c7c0 tx=0x7f5cac007e00 comp rx=0 tx=0).stop 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 shutdown_connections 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5ca0067330 0x7f5ca00697e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc15a2a0 0x7f5cbc155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc06f190 0x7f5cbc13bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 --2- 172.21.15.142:0/1392162815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc0aebf0 0x7f5cbc15abe0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 >> 172.21.15.142:0/1392162815 conn(0x7f5cbc0680c0 msgr2=0x7f5cbc1544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 shutdown_connections 2023-09-30T22:53:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.297+0000 7f5cc3dff700 1 -- 172.21.15.142:0/1392162815 wait complete. 2023-09-30T22:53:23.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-30T22:53:23.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.505+0000 7f7a595ff700 1 Processor -- start 2023-09-30T22:53:23.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.505+0000 7f7a595ff700 1 -- start start 2023-09-30T22:53:23.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.506+0000 7f7a595ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7a540af020 0x7f7a54156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a595ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5406d3e0 con 0x7f7a5406e820 2023-09-30T22:53:23.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a595ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5406dc80 con 0x7f7a540b00d0 2023-09-30T22:53:23.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a595ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5406eca0 con 0x7f7a540af020 2023-09-30T22:53:23.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a537fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7a5406e820 0x7f7a5415a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45436/0 (socket says 172.21.15.142:45436) 2023-09-30T22:53:23.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a537fe700 1 -- 172.21.15.142:0/4187601526 learned_addr learned my addr 172.21.15.142:0/4187601526 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:23.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a52ffd700 1 --2- 172.21.15.142:0/4187601526 >> v2:172.21.15.148:3300/0 conn(0x7f7a540af020 0x7f7a54156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a51ffb700 1 -- 172.21.15.142:0/4187601526 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418934829 0 0) 0x7f7a5406d3e0 con 0x7f7a5406e820 2023-09-30T22:53:23.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a51ffb700 1 -- 172.21.15.142:0/4187601526 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a3c003570 con 0x7f7a5406e820 2023-09-30T22:53:23.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a51ffb700 1 -- 172.21.15.142:0/4187601526 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3502564959 0 0) 0x7f7a3c003570 con 0x7f7a5406e820 2023-09-30T22:53:23.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.507+0000 7f7a52ffd700 1 -- 172.21.15.142:0/4187601526 >> v1:172.21.15.148:6789/0 conn(0x7f7a540b00d0 legacy=0x7f7a5406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.508+0000 7f7a52ffd700 1 -- 172.21.15.142:0/4187601526 >> v1:172.21.15.142:6789/0 conn(0x7f7a5406e820 legacy=0x7f7a5415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.508+0000 7f7a52ffd700 1 -- 172.21.15.142:0/4187601526 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5406b790 con 0x7f7a540af020 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.508+0000 7f7a52ffd700 1 --2- 172.21.15.142:0/4187601526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540af020 0x7f7a54156d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009910 tx=0x7f7a440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f85517c353d5a02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.508+0000 7f7a51ffb700 1 -- 172.21.15.142:0/4187601526 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0017f0 con 0x7f7a540af020 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.508+0000 7f7a51ffb700 1 -- 172.21.15.142:0/4187601526 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a44011420 con 0x7f7a540af020 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.508+0000 7f7a51ffb700 1 -- 172.21.15.142:0/4187601526 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440117c0 con 0x7f7a540af020 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.509+0000 7f7a595ff700 1 -- 172.21.15.142:0/4187601526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540af020 msgr2=0x7f7a54156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.509+0000 7f7a595ff700 1 --2- 172.21.15.142:0/4187601526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540af020 0x7f7a54156d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009910 tx=0x7f7a440091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.509+0000 7f7a595ff700 1 -- 172.21.15.142:0/4187601526 shutdown_connections 2023-09-30T22:53:23.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.509+0000 7f7a595ff700 1 --2- 172.21.15.142:0/4187601526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540af020 0x7f7a54156d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.509+0000 7f7a595ff700 1 -- 172.21.15.142:0/4187601526 >> 172.21.15.142:0/4187601526 conn(0x7f7a540680c0 msgr2=0x7f7a540c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:23.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.509+0000 7f7a595ff700 1 -- 172.21.15.142:0/4187601526 shutdown_connections 2023-09-30T22:53:23.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.509+0000 7f7a595ff700 1 -- 172.21.15.142:0/4187601526 wait complete. 2023-09-30T22:53:23.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.510+0000 7f7a595ff700 1 Processor -- start 2023-09-30T22:53:23.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.510+0000 7f7a595ff700 1 -- start start 2023-09-30T22:53:23.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.511+0000 7f7a595ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a5406e820 0x7f7a5414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.511+0000 7f7a595ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a540af020 0x7f7a540c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.511+0000 7f7a595ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540b00d0 0x7f7a540c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.511+0000 7f7a595ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540c5670 con 0x7f7a540af020 2023-09-30T22:53:23.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.511+0000 7f7a595ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540c5950 con 0x7f7a540b00d0 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.511+0000 7f7a595ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540c5c30 con 0x7f7a5406e820 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.511+0000 7f7a527fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a540af020 0x7f7a540c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a540af020 0x7f7a540c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39544/0 (socket says 172.21.15.142:39544) 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 -- 172.21.15.142:0/2599269003 learned_addr learned my addr 172.21.15.142:0/2599269003 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a52ffd700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a5406e820 0x7f7a5414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 -- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a5406e820 msgr2=0x7f7a5414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a5406e820 0x7f7a5414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 -- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540b00d0 msgr2=0x7f7a540c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a537fe700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540b00d0 0x7f7a540c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540b00d0 0x7f7a540c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 -- 172.21.15.142:0/2599269003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44009420 con 0x7f7a540af020 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a537fe700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540b00d0 0x7f7a540c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a527fc700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a540af020 0x7f7a540c75c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c4e0 tx=0x7f7a4800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a3affd700 1 -- 172.21.15.142:0/2599269003 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48011590 con 0x7f7a540af020 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a3affd700 1 -- 172.21.15.142:0/2599269003 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48011710 con 0x7f7a540af020 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a3affd700 1 -- 172.21.15.142:0/2599269003 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48011ad0 con 0x7f7a540af020 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.512+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a540c5f10 con 0x7f7a540af020 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.513+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5414b610 con 0x7f7a540af020 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.514+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5414b7d0 con 0x7f7a540af020 2023-09-30T22:53:23.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.515+0000 7f7a3affd700 1 -- 172.21.15.142:0/2599269003 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7a4801b3b0 con 0x7f7a540af020 2023-09-30T22:53:23.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.516+0000 7f7a3affd700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a40067330 0x7f7a400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:23.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.516+0000 7f7a3affd700 1 -- 172.21.15.142:0/2599269003 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7a48083d30 con 0x7f7a540af020 2023-09-30T22:53:23.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.516+0000 7f7a52ffd700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a40067330 0x7f7a400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:23.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.516+0000 7f7a52ffd700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a40067330 0x7f7a400697e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009910 tx=0x7f7a44016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:23.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.519+0000 7f7a3affd700 1 -- 172.21.15.142:0/2599269003 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7a48050f80 con 0x7f7a540af020 2023-09-30T22:53:23.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.782+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f7a540cd490 con 0x7f7a540af020 2023-09-30T22:53:23.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.786+0000 7f7a3affd700 1 -- 172.21.15.142:0/2599269003 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7a48017020 con 0x7f7a540af020 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a40067330 msgr2=0x7f7a400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a40067330 0x7f7a400697e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009910 tx=0x7f7a44016000 comp rx=0 tx=0).stop 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a540af020 msgr2=0x7f7a540c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a540af020 0x7f7a540c75c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c4e0 tx=0x7f7a4800c8a0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 shutdown_connections 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a40067330 0x7f7a400697e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a540b00d0 0x7f7a540c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a5406e820 0x7f7a5414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 --2- 172.21.15.142:0/2599269003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a540af020 0x7f7a540c75c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:23.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 >> 172.21.15.142:0/2599269003 conn(0x7f7a540680c0 msgr2=0x7f7a540cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:23.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 shutdown_connections 2023-09-30T22:53:23.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.789+0000 7f7a595ff700 1 -- 172.21.15.142:0/2599269003 wait complete. 2023-09-30T22:53:23.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:23.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.995+0000 7f671a7ff700 1 Processor -- start 2023-09-30T22:53:23.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.996+0000 7f671a7ff700 1 -- start start 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f671a7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67141598e0 0x7f6714159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f671a7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67140cee50 0x7f67140d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f671a7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67140cff40 con 0x7f671406b1c0 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f671a7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67140d0910 con 0x7f67141598e0 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f671a7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67140cf330 con 0x7f67140cee50 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f6713fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67141598e0 0x7f6714159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f6718d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f671406b1c0 0x7f671415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45452/0 (socket says 172.21.15.142:45452) 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f6718d9c700 1 -- 172.21.15.142:0/2449676240 learned_addr learned my addr 172.21.15.142:0/2449676240 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.997+0000 7f67137fe700 1 --2- 172.21.15.142:0/2449676240 >> v2:172.21.15.148:3300/0 conn(0x7f67140cee50 0x7f67140d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6712ffd700 1 -- 172.21.15.142:0/2449676240 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150689202 0 0) 0x7f67140cff40 con 0x7f671406b1c0 2023-09-30T22:53:24.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6712ffd700 1 -- 172.21.15.142:0/2449676240 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66fc003570 con 0x7f671406b1c0 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6713fff700 1 -- 172.21.15.142:0/2449676240 >> v2:172.21.15.148:3300/0 conn(0x7f67140cee50 msgr2=0x7f67140d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6713fff700 1 --2- 172.21.15.142:0/2449676240 >> v2:172.21.15.148:3300/0 conn(0x7f67140cee50 0x7f67140d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6713fff700 1 -- 172.21.15.142:0/2449676240 >> v1:172.21.15.142:6789/0 conn(0x7f671406b1c0 legacy=0x7f671415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6713fff700 1 -- 172.21.15.142:0/2449676240 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140cf610 con 0x7f67141598e0 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6713fff700 1 --2- 172.21.15.142:0/2449676240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67141598e0 0x7f6714159cb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f67140b36f0 tx=0x7f67040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f801e5a3a9131df0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6712ffd700 1 -- 172.21.15.142:0/2449676240 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011630 con 0x7f67141598e0 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6712ffd700 1 -- 172.21.15.142:0/2449676240 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040117b0 con 0x7f67141598e0 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.998+0000 7f6712ffd700 1 -- 172.21.15.142:0/2449676240 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011b70 con 0x7f67141598e0 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 -- 172.21.15.142:0/2449676240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67141598e0 msgr2=0x7f6714159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2449676240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67141598e0 0x7f6714159cb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f67140b36f0 tx=0x7f67040091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 -- 172.21.15.142:0/2449676240 shutdown_connections 2023-09-30T22:53:24.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2449676240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67141598e0 0x7f6714159cb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2449676240 >> v2:172.21.15.148:3300/0 conn(0x7f67140cee50 0x7f67140d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 -- 172.21.15.142:0/2449676240 >> 172.21.15.142:0/2449676240 conn(0x7f67140cd540 msgr2=0x7f67140cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:24.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 -- 172.21.15.142:0/2449676240 shutdown_connections 2023-09-30T22:53:24.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:23.999+0000 7f671a7ff700 1 -- 172.21.15.142:0/2449676240 wait complete. 2023-09-30T22:53:24.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.000+0000 7f671a7ff700 1 Processor -- start 2023-09-30T22:53:24.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.000+0000 7f671a7ff700 1 -- start start 2023-09-30T22:53:24.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.001+0000 7f671a7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f671406b1c0 0x7f671415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.001+0000 7f671a7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140cee50 0x7f6714154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.001+0000 7f671a7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67141598e0 0x7f6714153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.001+0000 7f671a7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67141531d0 con 0x7f67140cee50 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.001+0000 7f671a7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6714154b30 con 0x7f67141598e0 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.001+0000 7f671a7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6714154e10 con 0x7f671406b1c0 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140cee50 0x7f6714154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140cee50 0x7f6714154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39570/0 (socket says 172.21.15.142:39570) 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 -- 172.21.15.142:0/2287253939 learned_addr learned my addr 172.21.15.142:0/2287253939 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f6718d9c700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67141598e0 0x7f6714153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f6713fff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f671406b1c0 0x7f671415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 -- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f671406b1c0 msgr2=0x7f671415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f671406b1c0 0x7f671415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 -- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67141598e0 msgr2=0x7f6714153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67141598e0 0x7f6714153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 -- 172.21.15.142:0/2287253939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704009420 con 0x7f67140cee50 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f6718d9c700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67141598e0 0x7f6714153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f6713fff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f671406b1c0 0x7f671415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f67137fe700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140cee50 0x7f6714154430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f670800ec80 tx=0x7f67080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f66fbfff700 1 -- 172.21.15.142:0/2287253939 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800c9d0 con 0x7f67140cee50 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f66fbfff700 1 -- 172.21.15.142:0/2287253939 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800cb30 con 0x7f67140cee50 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f66fbfff700 1 -- 172.21.15.142:0/2287253939 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708013470 con 0x7f67140cee50 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.002+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6714152b80 con 0x7f67140cee50 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.003+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6714153ba0 con 0x7f67140cee50 2023-09-30T22:53:24.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.004+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67140697b0 con 0x7f67140cee50 2023-09-30T22:53:24.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.005+0000 7f66fbfff700 1 -- 172.21.15.142:0/2287253939 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6708013820 con 0x7f67140cee50 2023-09-30T22:53:24.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.006+0000 7f66fbfff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6700067330 0x7f67000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.006+0000 7f66fbfff700 1 -- 172.21.15.142:0/2287253939 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6708084c70 con 0x7f67140cee50 2023-09-30T22:53:24.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.006+0000 7f6713fff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6700067330 0x7f67000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.006+0000 7f6713fff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6700067330 0x7f67000697e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67140b36f0 tx=0x7f6704017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.010+0000 7f66fbfff700 1 -- 172.21.15.142:0/2287253939 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6708051e20 con 0x7f67140cee50 2023-09-30T22:53:24.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.202+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f671406fc10 con 0x7f67140cee50 2023-09-30T22:53:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.203+0000 7f66fbfff700 1 -- 172.21.15.142:0/2287253939 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+13794 (secure 0 0 0) 0x7f6708017090 con 0x7f67140cee50 2023-09-30T22:53:24.204 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:24.204 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":31,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:20.273271+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:24.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6700067330 msgr2=0x7f67000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6700067330 0x7f67000697e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67140b36f0 tx=0x7f6704017000 comp rx=0 tx=0).stop 2023-09-30T22:53:24.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140cee50 msgr2=0x7f6714154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140cee50 0x7f6714154430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f670800ec80 tx=0x7f67080091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 shutdown_connections 2023-09-30T22:53:24.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6700067330 0x7f67000697e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67141598e0 0x7f6714153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f671406b1c0 0x7f671415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 --2- 172.21.15.142:0/2287253939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67140cee50 0x7f6714154430 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 >> 172.21.15.142:0/2287253939 conn(0x7f67140cd540 msgr2=0x7f671415f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:24.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 shutdown_connections 2023-09-30T22:53:24.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.206+0000 7f671a7ff700 1 -- 172.21.15.142:0/2287253939 wait complete. 2023-09-30T22:53:24.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:53:24.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:53:24.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.416+0000 7fada19ff700 1 Processor -- start 2023-09-30T22:53:24.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.416+0000 7fada19ff700 1 -- start start 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.417+0000 7fada19ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 0x7fad9c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.417+0000 7fada19ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fad9c0ca5e0 0x7fad9c0681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.417+0000 7fada19ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c067d10 con 0x7fad9c0b0de0 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.417+0000 7fada19ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c06af90 con 0x7fad9c0ca5e0 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.417+0000 7fada19ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0676c0 con 0x7fad9c159ba0 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad9a7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fad9c0b0de0 0x7fad9c0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45460/0 (socket says 172.21.15.142:45460) 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad9a7fc700 1 -- 172.21.15.142:0/67909424 learned_addr learned my addr 172.21.15.142:0/67909424 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:24.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad9affd700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 0x7fad9c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/67909424 >> v2:172.21.15.148:3300/0 conn(0x7fad9c0ca5e0 0x7fad9c0681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513096129 0 0) 0x7fad9c067d10 con 0x7fad9c0b0de0 2023-09-30T22:53:24.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad84003570 con 0x7fad9c0b0de0 2023-09-30T22:53:24.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2257004771 0 0) 0x7fad84003570 con 0x7fad9c0b0de0 2023-09-30T22:53:24.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 msgr2=0x7fad9c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:24.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 0x7fad9c06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 >> v2:172.21.15.148:3300/0 conn(0x7fad9c0ca5e0 msgr2=0x7fad9c0681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 --2- 172.21.15.142:0/67909424 >> v2:172.21.15.148:3300/0 conn(0x7fad9c0ca5e0 0x7fad9c0681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0679a0 con 0x7fad9c0b0de0 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fad90001470 con 0x7fad9c0b0de0 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/67909424 >> v2:172.21.15.148:3300/0 conn(0x7fad9c0ca5e0 0x7fad9c0681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.418+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 >> v1:172.21.15.142:6789/0 conn(0x7fad9c0b0de0 legacy=0x7fad9c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad99ffb700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 0x7fad84003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad99ffb700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad84003fe0 0x7fad84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad99ffb700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c06af90 con 0x7fad84004d50 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0676c0 con 0x7fad84003fe0 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8400ba90 con 0x7fad9c159ba0 2023-09-30T22:53:24.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9affd700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 0x7fad84003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9a7fc700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad84003fe0 0x7fad84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9b7fe700 1 -- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 msgr2=0x7fad84003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:24.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159ba0 0x7fad84003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9b7fe700 1 -- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad84003fe0 msgr2=0x7fad84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:24.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad84003fe0 0x7fad84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9b7fe700 1 -- 172.21.15.142:0/67909424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84003570 con 0x7fad84004d50 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.419+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad840051c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0ca9e0 tx=0x7fad9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edafd32eade79ce2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9400ebe0 con 0x7fad84004d50 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9400f040 con 0x7fad84004d50 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fad99ffb700 1 -- 172.21.15.142:0/67909424 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94014480 con 0x7fad84004d50 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fada19ff700 1 -- 172.21.15.142:0/67909424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 msgr2=0x7fad840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fada19ff700 1 --2- 172.21.15.142:0/67909424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad840051c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0ca9e0 tx=0x7fad9400b040 comp rx=0 tx=0).stop 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fad9b7fe700 1 -- 172.21.15.142:0/67909424 reap_dead start 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fada19ff700 1 -- 172.21.15.142:0/67909424 shutdown_connections 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fada19ff700 1 -- 172.21.15.142:0/67909424 >> 172.21.15.142:0/67909424 conn(0x7fad9c0cb2f0 msgr2=0x7fad9c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fada19ff700 1 -- 172.21.15.142:0/67909424 shutdown_connections 2023-09-30T22:53:24.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.420+0000 7fada19ff700 1 -- 172.21.15.142:0/67909424 wait complete. 2023-09-30T22:53:24.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.422+0000 7fada19ff700 1 Processor -- start 2023-09-30T22:53:24.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.422+0000 7fada19ff700 1 -- start start 2023-09-30T22:53:24.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fada19ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad9c14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fada19ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159fe0 0x7fad9c15ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fada19ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad9c15d370 0x7fad9c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fada19ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c15e440 con 0x7fad84004d50 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fada19ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c15d830 con 0x7fad9c15d370 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fada19ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c15db10 con 0x7fad9c159fe0 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad9c14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad9c14bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39586/0 (socket says 172.21.15.142:39586) 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 -- 172.21.15.142:0/3630081620 learned_addr learned my addr 172.21.15.142:0/3630081620 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad9c15d370 0x7fad9c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9a7fc700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159fe0 0x7fad9c15ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 -- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159fe0 msgr2=0x7fad9c15ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159fe0 0x7fad9c15ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 -- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad9c15d370 msgr2=0x7fad9c0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad9c15d370 0x7fad9c0cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9affd700 1 -- 172.21.15.142:0/3630081620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c15ddf0 con 0x7fad84004d50 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9b7fe700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad9c15d370 0x7fad9c0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.423+0000 7fad9a7fc700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159fe0 0x7fad9c15ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.424+0000 7fad9affd700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad9c14bcf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006ac0 tx=0x7fad8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.424+0000 7fad82ffd700 1 -- 172.21.15.142:0/3630081620 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00fa10 con 0x7fad84004d50 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.424+0000 7fad82ffd700 1 -- 172.21.15.142:0/3630081620 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00fb70 con 0x7fad84004d50 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.424+0000 7fad82ffd700 1 -- 172.21.15.142:0/3630081620 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c014440 con 0x7fad84004d50 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.424+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c15e0d0 con 0x7fad84004d50 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.424+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c0cde60 con 0x7fad84004d50 2023-09-30T22:53:24.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.425+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c06e4b0 con 0x7fad84004d50 2023-09-30T22:53:24.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.426+0000 7fad82ffd700 1 -- 172.21.15.142:0/3630081620 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad8c014870 con 0x7fad84004d50 2023-09-30T22:53:24.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.427+0000 7fad82ffd700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad88067330 0x7fad880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.427+0000 7fad82ffd700 1 -- 172.21.15.142:0/3630081620 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fad8c018030 con 0x7fad84004d50 2023-09-30T22:53:24.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.427+0000 7fad9a7fc700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad88067330 0x7fad880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.428+0000 7fad9a7fc700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad88067330 0x7fad880697e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad90000e10 tx=0x7fad90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.431+0000 7fad82ffd700 1 -- 172.21.15.142:0/3630081620 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad8c0525b0 con 0x7fad84004d50 2023-09-30T22:53:24.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.622+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad9c0cac40 con 0x7fad84004d50 2023-09-30T22:53:24.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.622+0000 7fad82ffd700 1 -- 172.21.15.142:0/3630081620 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad8c055bd0 con 0x7fad84004d50 2023-09-30T22:53:24.622 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:53:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.624+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad88067330 msgr2=0x7fad880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.624+0000 7fada19ff700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad88067330 0x7fad880697e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad90000e10 tx=0x7fad90009040 comp rx=0 tx=0).stop 2023-09-30T22:53:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.624+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 msgr2=0x7fad9c14bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.624+0000 7fada19ff700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad9c14bcf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006ac0 tx=0x7fad8c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 shutdown_connections 2023-09-30T22:53:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad88067330 0x7fad880697e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad9c15d370 0x7fad9c0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad84004d50 0x7fad9c14bcf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 --2- 172.21.15.142:0/3630081620 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad9c159fe0 0x7fad9c15ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 >> 172.21.15.142:0/3630081620 conn(0x7fad9c0cb2f0 msgr2=0x7fad9c157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 shutdown_connections 2023-09-30T22:53:24.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.625+0000 7fada19ff700 1 -- 172.21.15.142:0/3630081620 wait complete. 2023-09-30T22:53:24.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:53:24.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.834+0000 7fbac35ff700 1 Processor -- start 2023-09-30T22:53:24.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.835+0000 7fbac35ff700 1 -- start start 2023-09-30T22:53:24.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.836+0000 7fbac35ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbabc0cc3b0 0x7fbabc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.836+0000 7fbac35ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc0d0550 con 0x7fbabc157ab0 2023-09-30T22:53:24.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.836+0000 7fbac35ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc0cf940 con 0x7fbabc0cbfe0 2023-09-30T22:53:24.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.836+0000 7fbac35ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc0cfc20 con 0x7fbabc0cc3b0 2023-09-30T22:53:24.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.836+0000 7fbac0b9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbabc157ab0 0x7fbabc06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45466/0 (socket says 172.21.15.142:45466) 2023-09-30T22:53:24.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.836+0000 7fbac0b9a700 1 -- 172.21.15.142:0/767460437 learned_addr learned my addr 172.21.15.142:0/767460437 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:24.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.836+0000 7fbac1b9c700 1 --2- 172.21.15.142:0/767460437 >> v2:172.21.15.142:3300/0 conn(0x7fbabc0cc3b0 0x7fbabc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbab3fff700 1 -- 172.21.15.142:0/767460437 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612563712 0 0) 0x7fbabc0d0550 con 0x7fbabc157ab0 2023-09-30T22:53:24.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbac1b9c700 1 -- 172.21.15.142:0/767460437 >> v1:172.21.15.148:6789/0 conn(0x7fbabc0cbfe0 legacy=0x7fbabc1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:24.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbac1b9c700 1 -- 172.21.15.142:0/767460437 >> v1:172.21.15.142:6789/0 conn(0x7fbabc157ab0 legacy=0x7fbabc06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbac1b9c700 1 -- 172.21.15.142:0/767460437 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc0cff00 con 0x7fbabc0cc3b0 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbac1b9c700 1 --2- 172.21.15.142:0/767460437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc0cc3b0 0x7fbabc15a2a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009e60 tx=0x7fbab4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec5c2e0b7e5f6db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbab3fff700 1 -- 172.21.15.142:0/767460437 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400e070 con 0x7fbabc0cc3b0 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbab3fff700 1 -- 172.21.15.142:0/767460437 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab400bbf0 con 0x7fbabc0cc3b0 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.837+0000 7fbab3fff700 1 -- 172.21.15.142:0/767460437 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4012430 con 0x7fbabc0cc3b0 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.838+0000 7fbac35ff700 1 -- 172.21.15.142:0/767460437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc0cc3b0 msgr2=0x7fbabc15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.838+0000 7fbac35ff700 1 --2- 172.21.15.142:0/767460437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc0cc3b0 0x7fbabc15a2a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009e60 tx=0x7fbab4009780 comp rx=0 tx=0).stop 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.838+0000 7fbac35ff700 1 -- 172.21.15.142:0/767460437 shutdown_connections 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.838+0000 7fbac35ff700 1 --2- 172.21.15.142:0/767460437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc0cc3b0 0x7fbabc15a2a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.838+0000 7fbac35ff700 1 -- 172.21.15.142:0/767460437 >> 172.21.15.142:0/767460437 conn(0x7fbabc0d0a80 msgr2=0x7fbabc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:24.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.838+0000 7fbac35ff700 1 -- 172.21.15.142:0/767460437 shutdown_connections 2023-09-30T22:53:24.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.838+0000 7fbac35ff700 1 -- 172.21.15.142:0/767460437 wait complete. 2023-09-30T22:53:24.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.839+0000 7fbac35ff700 1 Processor -- start 2023-09-30T22:53:24.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.839+0000 7fbac35ff700 1 -- start start 2023-09-30T22:53:24.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.840+0000 7fbac35ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbabc0cbfe0 0x7fbabc1454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.840+0000 7fbac35ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbabc0cc3b0 0x7fbabc0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.840+0000 7fbac35ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc157ab0 0x7fbabc0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.840+0000 7fbac35ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0c8580 con 0x7fbabc157ab0 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.840+0000 7fbac35ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0c93e0 con 0x7fbabc0cc3b0 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.840+0000 7fbac35ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc145a30 con 0x7fbabc0cbfe0 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc157ab0 0x7fbabc0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc157ab0 0x7fbabc0c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39614/0 (socket says 172.21.15.142:39614) 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 -- 172.21.15.142:0/2706077126 learned_addr learned my addr 172.21.15.142:0/2706077126 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac0b9a700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbabc0cc3b0 0x7fbabc0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac139b700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbabc0cbfe0 0x7fbabc1454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 -- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbabc0cbfe0 msgr2=0x7fbabc1454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbabc0cbfe0 0x7fbabc1454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 -- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbabc0cc3b0 msgr2=0x7fbabc0c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:24.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbabc0cc3b0 0x7fbabc0c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:24.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 -- 172.21.15.142:0/2706077126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4009a20 con 0x7fbabc157ab0 2023-09-30T22:53:24.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.841+0000 7fbac1b9c700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc157ab0 0x7fbabc0c5b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbab400b6c0 tx=0x7fbab4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.842+0000 7fbab17fa700 1 -- 172.21.15.142:0/2706077126 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab401e640 con 0x7fbabc157ab0 2023-09-30T22:53:24.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.842+0000 7fbab17fa700 1 -- 172.21.15.142:0/2706077126 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab401e7a0 con 0x7fbabc157ab0 2023-09-30T22:53:24.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.842+0000 7fbab17fa700 1 -- 172.21.15.142:0/2706077126 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab401eb60 con 0x7fbabc157ab0 2023-09-30T22:53:24.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.842+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc0c87d0 con 0x7fbabc157ab0 2023-09-30T22:53:24.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.842+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc0c8d90 con 0x7fbabc157ab0 2023-09-30T22:53:24.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.843+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc069770 con 0x7fbabc157ab0 2023-09-30T22:53:24.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.843+0000 7fbab17fa700 1 -- 172.21.15.142:0/2706077126 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbab4024070 con 0x7fbabc157ab0 2023-09-30T22:53:24.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.844+0000 7fbab17fa700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbaa0067330 0x7fbaa00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:24.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.844+0000 7fbab17fa700 1 -- 172.21.15.142:0/2706077126 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbab4087310 con 0x7fbabc157ab0 2023-09-30T22:53:24.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.844+0000 7fbac139b700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbaa0067330 0x7fbaa00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:24.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.845+0000 7fbac139b700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbaa0067330 0x7fbaa00697e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0c5190 tx=0x7fbab8007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:24.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:24.849+0000 7fbab17fa700 1 -- 172.21.15.142:0/2706077126 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbab4054570 con 0x7fbabc157ab0 2023-09-30T22:53:25.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.035+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbabc06fc10 con 0x7fbabc157ab0 2023-09-30T22:53:25.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.035+0000 7fbab17fa700 1 -- 172.21.15.142:0/2706077126 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbab4057b90 con 0x7fbabc157ab0 2023-09-30T22:53:25.036 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:53:25.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbaa0067330 msgr2=0x7fbaa00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbaa0067330 0x7fbaa00697e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0c5190 tx=0x7fbab8007ea0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc157ab0 msgr2=0x7fbabc0c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc157ab0 0x7fbabc0c5b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbab400b6c0 tx=0x7fbab4018000 comp rx=0 tx=0).stop 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 shutdown_connections 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbaa0067330 0x7fbaa00697e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbabc157ab0 0x7fbabc0c5b70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbabc0cbfe0 0x7fbabc1454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 --2- 172.21.15.142:0/2706077126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbabc0cc3b0 0x7fbabc0c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 >> 172.21.15.142:0/2706077126 conn(0x7fbabc0d0a80 msgr2=0x7fbabc159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 shutdown_connections 2023-09-30T22:53:25.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.038+0000 7fbac35ff700 1 -- 172.21.15.142:0/2706077126 wait complete. 2023-09-30T22:53:25.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:53:25.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.246+0000 7f2c3f5ff700 1 Processor -- start 2023-09-30T22:53:25.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.246+0000 7f2c3f5ff700 1 -- start start 2023-09-30T22:53:25.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.247+0000 7f2c3f5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c380692f0 0x7f2c3815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.247+0000 7f2c3f5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c3815dc50 0x7f2c3806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3f5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c380cc6b0 con 0x7f2c38143350 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3f5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3815e050 con 0x7f2c3815dc50 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3f5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c380cbaa0 con 0x7f2c380692f0 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3db9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c3815dc50 0x7f2c3806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3d39b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2c38143350 0x7f2c380cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45474/0 (socket says 172.21.15.142:45474) 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3d39b700 1 -- 172.21.15.142:0/4123463716 learned_addr learned my addr 172.21.15.142:0/4123463716 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3cb9a700 1 --2- 172.21.15.142:0/4123463716 >> v2:172.21.15.148:3300/0 conn(0x7f2c380692f0 0x7f2c3815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3db9c700 1 -- 172.21.15.142:0/4123463716 >> v2:172.21.15.148:3300/0 conn(0x7f2c380692f0 msgr2=0x7f2c3815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3db9c700 1 --2- 172.21.15.142:0/4123463716 >> v2:172.21.15.148:3300/0 conn(0x7f2c380692f0 0x7f2c3815d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3db9c700 1 -- 172.21.15.142:0/4123463716 >> v1:172.21.15.142:6789/0 conn(0x7f2c38143350 legacy=0x7f2c380cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.248+0000 7f2c3db9c700 1 -- 172.21.15.142:0/4123463716 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c380cbd80 con 0x7f2c3815dc50 2023-09-30T22:53:25.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3db9c700 1 --2- 172.21.15.142:0/4123463716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3815dc50 0x7f2c3806a0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2c38069c90 tx=0x7f2c30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4d1bae4f750b0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:25.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c2ffff700 1 -- 172.21.15.142:0/4123463716 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000e070 con 0x7f2c3815dc50 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c2ffff700 1 -- 172.21.15.142:0/4123463716 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3000bb60 con 0x7f2c3815dc50 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c2ffff700 1 -- 172.21.15.142:0/4123463716 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30012430 con 0x7f2c3815dc50 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/4123463716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3815dc50 msgr2=0x7f2c3806a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/4123463716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3815dc50 0x7f2c3806a0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2c38069c90 tx=0x7f2c30009780 comp rx=0 tx=0).stop 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/4123463716 shutdown_connections 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/4123463716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3815dc50 0x7f2c3806a0c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/4123463716 >> v2:172.21.15.148:3300/0 conn(0x7f2c380692f0 0x7f2c3815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/4123463716 >> 172.21.15.142:0/4123463716 conn(0x7f2c380ce8e0 msgr2=0x7f2c380cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:25.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.249+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/4123463716 shutdown_connections 2023-09-30T22:53:25.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.250+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/4123463716 wait complete. 2023-09-30T22:53:25.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.251+0000 7f2c3f5ff700 1 Processor -- start 2023-09-30T22:53:25.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.251+0000 7f2c3f5ff700 1 -- start start 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3f5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c380692f0 0x7f2c380a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3f5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c38143350 0x7f2c380a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3f5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c3815dc50 0x7f2c38158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3f5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380a5f00 con 0x7f2c38143350 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3f5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380a61e0 con 0x7f2c380692f0 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3f5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380a64c0 con 0x7f2c3815dc50 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3cb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c38143350 0x7f2c380a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3cb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c38143350 0x7f2c380a54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39638/0 (socket says 172.21.15.142:39638) 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3cb9a700 1 -- 172.21.15.142:0/855711530 learned_addr learned my addr 172.21.15.142:0/855711530 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3db9c700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c3815dc50 0x7f2c38158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3cb9a700 1 -- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c3815dc50 msgr2=0x7f2c38158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.252+0000 7f2c3d39b700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c380692f0 0x7f2c380a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3cb9a700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c3815dc50 0x7f2c38158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3cb9a700 1 -- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c380692f0 msgr2=0x7f2c380a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3cb9a700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c380692f0 0x7f2c380a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3cb9a700 1 -- 172.21.15.142:0/855711530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30009a20 con 0x7f2c38143350 2023-09-30T22:53:25.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3db9c700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c3815dc50 0x7f2c38158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3d39b700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c380692f0 0x7f2c380a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3cb9a700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c38143350 0x7f2c380a54b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800ec80 tx=0x7f2c280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c2d7fa700 1 -- 172.21.15.142:0/855711530 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800c9d0 con 0x7f2c38143350 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c2d7fa700 1 -- 172.21.15.142:0/855711530 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2800cb30 con 0x7f2c38143350 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c380b19c0 con 0x7f2c38143350 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c2d7fa700 1 -- 172.21.15.142:0/855711530 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28013470 con 0x7f2c38143350 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.253+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c380a7400 con 0x7f2c38143350 2023-09-30T22:53:25.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.254+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c380b1820 con 0x7f2c38143350 2023-09-30T22:53:25.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.255+0000 7f2c2d7fa700 1 -- 172.21.15.142:0/855711530 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2c28013820 con 0x7f2c38143350 2023-09-30T22:53:25.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.256+0000 7f2c2d7fa700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c1c067330 0x7f2c1c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.256+0000 7f2c2d7fa700 1 -- 172.21.15.142:0/855711530 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c28084cb0 con 0x7f2c38143350 2023-09-30T22:53:25.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.256+0000 7f2c3d39b700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c1c067330 0x7f2c1c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.257+0000 7f2c3d39b700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c1c067330 0x7f2c1c0697e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2c34001820 tx=0x7f2c34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:25.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.260+0000 7f2c2d7fa700 1 -- 172.21.15.142:0/855711530 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2c380b1820 con 0x7f2c38143350 2023-09-30T22:53:25.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.452+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2c380b1820 con 0x7f2c38143350 2023-09-30T22:53:25.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.452+0000 7f2c2d7fa700 1 -- 172.21.15.142:0/855711530 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2c28021090 con 0x7f2c38143350 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:25.453 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:53:25.454 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:53:25.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:25.454 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:53:25.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c1c067330 msgr2=0x7f2c1c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c1c067330 0x7f2c1c0697e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2c34001820 tx=0x7f2c34009040 comp rx=0 tx=0).stop 2023-09-30T22:53:25.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c38143350 msgr2=0x7f2c380a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c38143350 0x7f2c380a54b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800ec80 tx=0x7f2c280091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 shutdown_connections 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c1c067330 0x7f2c1c0697e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c3815dc50 0x7f2c38158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c380692f0 0x7f2c380a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 --2- 172.21.15.142:0/855711530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c38143350 0x7f2c380a54b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 >> 172.21.15.142:0/855711530 conn(0x7f2c380ce8e0 msgr2=0x7f2c380c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 shutdown_connections 2023-09-30T22:53:25.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.455+0000 7f2c3f5ff700 1 -- 172.21.15.142:0/855711530 wait complete. 2023-09-30T22:53:25.473 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:53:25.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:53:25.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.666+0000 7f3d6a5ff700 1 Processor -- start 2023-09-30T22:53:25.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.666+0000 7f3d6a5ff700 1 -- start start 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.667+0000 7f3d6a5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d640ca240 0x7f3d6406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.667+0000 7f3d6a5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3d6406ace0 0x7f3d64157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.667+0000 7f3d6a5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6406b120 con 0x7f3d64150730 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.667+0000 7f3d6a5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d640cc340 con 0x7f3d640ca240 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.667+0000 7f3d6a5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d640ca790 con 0x7f3d6406ace0 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d640ca240 0x7f3d6406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d640ca240 0x7f3d6406a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39642/0 (socket says 172.21.15.142:39642) 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 -- 172.21.15.142:0/3802361766 learned_addr learned my addr 172.21.15.142:0/3802361766 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:25.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d68b9c700 1 --2- 172.21.15.142:0/3802361766 >> v2:172.21.15.148:3300/0 conn(0x7f3d6406ace0 0x7f3d64157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 -- 172.21.15.142:0/3802361766 >> v2:172.21.15.148:3300/0 conn(0x7f3d6406ace0 msgr2=0x7f3d64157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 --2- 172.21.15.142:0/3802361766 >> v2:172.21.15.148:3300/0 conn(0x7f3d6406ace0 0x7f3d64157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 -- 172.21.15.142:0/3802361766 >> v1:172.21.15.148:6789/0 conn(0x7f3d64150730 legacy=0x7f3d64157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 -- 172.21.15.142:0/3802361766 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d640caa70 con 0x7f3d640ca240 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.668+0000 7f3d637fe700 1 --2- 172.21.15.142:0/3802361766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d640ca240 0x7f3d6406a7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d640c9090 tx=0x7f3d58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e7986a1a0ada4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d62ffd700 1 -- 172.21.15.142:0/3802361766 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800b820 con 0x7f3d640ca240 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d62ffd700 1 -- 172.21.15.142:0/3802361766 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5800b980 con 0x7f3d640ca240 2023-09-30T22:53:25.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d62ffd700 1 -- 172.21.15.142:0/3802361766 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800bd20 con 0x7f3d640ca240 2023-09-30T22:53:25.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3802361766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d640ca240 msgr2=0x7f3d6406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3802361766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d640ca240 0x7f3d6406a7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d640c9090 tx=0x7f3d58009250 comp rx=0 tx=0).stop 2023-09-30T22:53:25.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3802361766 shutdown_connections 2023-09-30T22:53:25.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3802361766 >> v2:172.21.15.148:3300/0 conn(0x7f3d6406ace0 0x7f3d64157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3802361766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d640ca240 0x7f3d6406a7a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3802361766 >> 172.21.15.142:0/3802361766 conn(0x7f3d640cc670 msgr2=0x7f3d640cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:25.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3802361766 shutdown_connections 2023-09-30T22:53:25.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.669+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3802361766 wait complete. 2023-09-30T22:53:25.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.671+0000 7f3d6a5ff700 1 Processor -- start 2023-09-30T22:53:25.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.671+0000 7f3d6a5ff700 1 -- start start 2023-09-30T22:53:25.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d6a5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6406ace0 0x7f3d64145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d6a5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d640ca240 0x7f3d6416bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d6a5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64150730 0x7f3d6416c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d6a5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d64149370 con 0x7f3d6406ace0 2023-09-30T22:53:25.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d6a5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d64149e70 con 0x7f3d64150730 2023-09-30T22:53:25.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d6a5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d64148db0 con 0x7f3d640ca240 2023-09-30T22:53:25.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d63fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6406ace0 0x7f3d64145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d63fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6406ace0 0x7f3d64145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39654/0 (socket says 172.21.15.142:39654) 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d63fff700 1 -- 172.21.15.142:0/3465499100 learned_addr learned my addr 172.21.15.142:0/3465499100 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d637fe700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d640ca240 0x7f3d6416bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d68b9c700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64150730 0x7f3d6416c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d63fff700 1 -- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d640ca240 msgr2=0x7f3d6416bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d63fff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d640ca240 0x7f3d6416bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d63fff700 1 -- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64150730 msgr2=0x7f3d6416c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.672+0000 7f3d63fff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64150730 0x7f3d6416c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d63fff700 1 -- 172.21.15.142:0/3465499100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580094f0 con 0x7f3d6406ace0 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d68b9c700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64150730 0x7f3d6416c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:25.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d63fff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6406ace0 0x7f3d64145820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400b5e0 tx=0x7f3d54009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:25.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d4bfff700 1 -- 172.21.15.142:0/3465499100 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400f510 con 0x7f3d6406ace0 2023-09-30T22:53:25.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d4bfff700 1 -- 172.21.15.142:0/3465499100 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5400f670 con 0x7f3d6406ace0 2023-09-30T22:53:25.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d4bfff700 1 -- 172.21.15.142:0/3465499100 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400fa30 con 0x7f3d6406ace0 2023-09-30T22:53:25.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d64149090 con 0x7f3d6406ace0 2023-09-30T22:53:25.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.673+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d64145d60 con 0x7f3d6406ace0 2023-09-30T22:53:25.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.674+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d64069a50 con 0x7f3d6406ace0 2023-09-30T22:53:25.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.675+0000 7f3d4bfff700 1 -- 172.21.15.142:0/3465499100 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3d5401a400 con 0x7f3d6406ace0 2023-09-30T22:53:25.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.676+0000 7f3d4bfff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d50067330 0x7f3d500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:25.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.676+0000 7f3d4bfff700 1 -- 172.21.15.142:0/3465499100 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3d540844c0 con 0x7f3d6406ace0 2023-09-30T22:53:25.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.676+0000 7f3d637fe700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d50067330 0x7f3d500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:25.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.677+0000 7f3d637fe700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d50067330 0x7f3d500697e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d640ca6c0 tx=0x7f3d58016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:25.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.680+0000 7f3d4bfff700 1 -- 172.21.15.142:0/3465499100 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3d540516f0 con 0x7f3d6406ace0 2023-09-30T22:53:25.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:25.870+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3d6406fc10 con 0x7f3d6406ace0 2023-09-30T22:53:26.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.502+0000 7f3d4bfff700 1 -- 172.21.15.142:0/3465499100 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3d54054d10 con 0x7f3d6406ace0 2023-09-30T22:53:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d50067330 msgr2=0x7f3d500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d50067330 0x7f3d500697e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d640ca6c0 tx=0x7f3d58016000 comp rx=0 tx=0).stop 2023-09-30T22:53:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6406ace0 msgr2=0x7f3d64145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6406ace0 0x7f3d64145820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400b5e0 tx=0x7f3d54009120 comp rx=0 tx=0).stop 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 shutdown_connections 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d50067330 0x7f3d500697e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64150730 0x7f3d6416c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6406ace0 0x7f3d64145820 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 --2- 172.21.15.142:0/3465499100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d640ca240 0x7f3d6416bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 >> 172.21.15.142:0/3465499100 conn(0x7f3d640cc670 msgr2=0x7f3d640c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 shutdown_connections 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.507+0000 7f3d6a5ff700 1 -- 172.21.15.142:0/3465499100 wait complete. 2023-09-30T22:53:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:53:26.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:53:26.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.723+0000 7f51ae5ff700 1 Processor -- start 2023-09-30T22:53:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.723+0000 7f51ae5ff700 1 -- start start 2023-09-30T22:53:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.724+0000 7f51ae5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51a80c52a0 0x7f51a80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51ae5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51a8069f10 0x7f51a80c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51ae5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a80c5bb0 0x7f51a80ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51ae5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a81406a0 con 0x7f51a80c52a0 2023-09-30T22:53:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51ae5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a80c3a50 con 0x7f51a8069f10 2023-09-30T22:53:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51ae5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80c7690 con 0x7f51a80c5bb0 2023-09-30T22:53:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51a80c52a0 0x7f51a80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51a80c52a0 0x7f51a80c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39662/0 (socket says 172.21.15.142:39662) 2023-09-30T22:53:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 -- 172.21.15.142:0/2223737578 learned_addr learned my addr 172.21.15.142:0/2223737578 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a77fe700 1 --2- 172.21.15.142:0/2223737578 >> v2:172.21.15.148:3300/0 conn(0x7f51a8069f10 0x7f51a80c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51acb9c700 1 --2- 172.21.15.142:0/2223737578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a80c5bb0 0x7f51a80ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 -- 172.21.15.142:0/2223737578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a80c5bb0 msgr2=0x7f51a80ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 --2- 172.21.15.142:0/2223737578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a80c5bb0 0x7f51a80ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 -- 172.21.15.142:0/2223737578 >> v2:172.21.15.148:3300/0 conn(0x7f51a8069f10 msgr2=0x7f51a80c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:26.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 --2- 172.21.15.142:0/2223737578 >> v2:172.21.15.148:3300/0 conn(0x7f51a8069f10 0x7f51a80c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a7fff700 1 -- 172.21.15.142:0/2223737578 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80c7f20 con 0x7f51a80c52a0 2023-09-30T22:53:26.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.725+0000 7f51a77fe700 1 --2- 172.21.15.142:0/2223737578 >> v2:172.21.15.148:3300/0 conn(0x7f51a8069f10 0x7f51a80c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:26.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.726+0000 7f51a7fff700 1 --2- 172.21.15.142:0/2223737578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a80c88d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51a806b940 tx=0x7f5198009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c2b6196b796393 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:26.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.726+0000 7f51a6ffd700 1 -- 172.21.15.142:0/2223737578 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519800b820 con 0x7f51a80c52a0 2023-09-30T22:53:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.726+0000 7f51a6ffd700 1 -- 172.21.15.142:0/2223737578 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519800b980 con 0x7f51a80c52a0 2023-09-30T22:53:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.726+0000 7f51a6ffd700 1 -- 172.21.15.142:0/2223737578 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519800bd20 con 0x7f51a80c52a0 2023-09-30T22:53:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.726+0000 7f51ae5ff700 1 -- 172.21.15.142:0/2223737578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 msgr2=0x7f51a80c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.726+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/2223737578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a80c88d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51a806b940 tx=0x7f5198009250 comp rx=0 tx=0).stop 2023-09-30T22:53:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.727+0000 7f51ae5ff700 1 -- 172.21.15.142:0/2223737578 shutdown_connections 2023-09-30T22:53:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.727+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/2223737578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a80c5bb0 0x7f51a80ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.727+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/2223737578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a80c88d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.727+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/2223737578 >> v2:172.21.15.148:3300/0 conn(0x7f51a8069f10 0x7f51a80c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.727+0000 7f51ae5ff700 1 -- 172.21.15.142:0/2223737578 >> 172.21.15.142:0/2223737578 conn(0x7f51a80cc670 msgr2=0x7f51a80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.727+0000 7f51ae5ff700 1 -- 172.21.15.142:0/2223737578 shutdown_connections 2023-09-30T22:53:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.727+0000 7f51ae5ff700 1 -- 172.21.15.142:0/2223737578 wait complete. 2023-09-30T22:53:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.728+0000 7f51ae5ff700 1 Processor -- start 2023-09-30T22:53:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.728+0000 7f51ae5ff700 1 -- start start 2023-09-30T22:53:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51ae5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a8069f10 0x7f51a80b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51ae5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a816ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51ae5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a80c5bb0 0x7f51a80c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51ae5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a816b1b0 con 0x7f51a80c52a0 2023-09-30T22:53:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51ae5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80b58a0 con 0x7f51a80c5bb0 2023-09-30T22:53:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51ae5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80b5d30 con 0x7f51a8069f10 2023-09-30T22:53:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51a77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a816ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.729+0000 7f51a77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a816ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39664/0 (socket says 172.21.15.142:39664) 2023-09-30T22:53:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51a77fe700 1 -- 172.21.15.142:0/1124032301 learned_addr learned my addr 172.21.15.142:0/1124032301 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51a77fe700 1 -- 172.21.15.142:0/1124032301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a8069f10 msgr2=0x7f51a80b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51a77fe700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a8069f10 0x7f51a80b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51a77fe700 1 -- 172.21.15.142:0/1124032301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a80c5bb0 msgr2=0x7f51a80c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51a77fe700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a80c5bb0 0x7f51a80c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51a77fe700 1 -- 172.21.15.142:0/1124032301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980094f0 con 0x7f51a80c52a0 2023-09-30T22:53:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51a77fe700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a816ac70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f519c00d890 tx=0x7f519c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f518ffff700 1 -- 172.21.15.142:0/1124032301 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0125f0 con 0x7f51a80c52a0 2023-09-30T22:53:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f518ffff700 1 -- 172.21.15.142:0/1124032301 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c012750 con 0x7f51a80c52a0 2023-09-30T22:53:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a80b4c90 con 0x7f51a80c52a0 2023-09-30T22:53:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.730+0000 7f518ffff700 1 -- 172.21.15.142:0/1124032301 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c012af0 con 0x7f51a80c52a0 2023-09-30T22:53:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.731+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a80b5250 con 0x7f51a80c52a0 2023-09-30T22:53:26.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.731+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a8069a50 con 0x7f51a80c52a0 2023-09-30T22:53:26.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.732+0000 7f518ffff700 1 -- 172.21.15.142:0/1124032301 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f519c014430 con 0x7f51a80c52a0 2023-09-30T22:53:26.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.734+0000 7f518ffff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5194067330 0x7f51940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:26.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.734+0000 7f518ffff700 1 -- 172.21.15.142:0/1124032301 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f519c084fd0 con 0x7f51a80c52a0 2023-09-30T22:53:26.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.734+0000 7f51a7fff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5194067330 0x7f51940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:26.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.734+0000 7f51a7fff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5194067330 0x7f51940697e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51a806b940 tx=0x7f5198017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:26.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.739+0000 7f518ffff700 1 -- 172.21.15.142:0/1124032301 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f519c052010 con 0x7f51a80c52a0 2023-09-30T22:53:26.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:26.927+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f51a80b59e0 con 0x7f51a80c52a0 2023-09-30T22:53:27.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.511+0000 7f518ffff700 1 -- 172.21.15.142:0/1124032301 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f519c055630 con 0x7f51a80c52a0 2023-09-30T22:53:27.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.516+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5194067330 msgr2=0x7f51940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:27.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.516+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5194067330 0x7f51940697e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51a806b940 tx=0x7f5198017000 comp rx=0 tx=0).stop 2023-09-30T22:53:27.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.516+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 msgr2=0x7f51a816ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:27.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.516+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a816ac70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f519c00d890 tx=0x7f519c008040 comp rx=0 tx=0).stop 2023-09-30T22:53:27.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.518+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 shutdown_connections 2023-09-30T22:53:27.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.518+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5194067330 0x7f51940697e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.518+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a80c5bb0 0x7f51a80c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.518+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a8069f10 0x7f51a80b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.518+0000 7f51ae5ff700 1 --2- 172.21.15.142:0/1124032301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a80c52a0 0x7f51a816ac70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.518+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 >> 172.21.15.142:0/1124032301 conn(0x7f51a80cc670 msgr2=0x7f51a80cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.519+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 shutdown_connections 2023-09-30T22:53:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.519+0000 7f51ae5ff700 1 -- 172.21.15.142:0/1124032301 wait complete. 2023-09-30T22:53:27.521 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:53:27.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:53:27.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.731+0000 7f079bfff700 1 Processor -- start 2023-09-30T22:53:27.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.731+0000 7f079bfff700 1 -- start start 2023-09-30T22:53:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.732+0000 7f079bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f07940cbfe0 0x7f079415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.732+0000 7f079bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07940cc3b0 0x7f07940cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.732+0000 7f079bfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07940d0550 con 0x7f07941573a0 2023-09-30T22:53:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.732+0000 7f079bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07940cf750 con 0x7f07940cc3b0 2023-09-30T22:53:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079bfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07940cf940 con 0x7f07940cbfe0 2023-09-30T22:53:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079959a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07940cc3b0 0x7f07940cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079959a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07940cc3b0 0x7f07940cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39670/0 (socket says 172.21.15.142:39670) 2023-09-30T22:53:27.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079959a700 1 -- 172.21.15.142:0/4094538944 learned_addr learned my addr 172.21.15.142:0/4094538944 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:27.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f0799d9b700 1 --2- 172.21.15.142:0/4094538944 >> v2:172.21.15.148:3300/0 conn(0x7f07940cbfe0 0x7f079415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:27.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079959a700 1 -- 172.21.15.142:0/4094538944 >> v2:172.21.15.148:3300/0 conn(0x7f07940cbfe0 msgr2=0x7f079415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:27.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079959a700 1 --2- 172.21.15.142:0/4094538944 >> v2:172.21.15.148:3300/0 conn(0x7f07940cbfe0 0x7f079415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079959a700 1 -- 172.21.15.142:0/4094538944 >> v1:172.21.15.148:6789/0 conn(0x7f07941573a0 legacy=0x7f079415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:27.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f079959a700 1 -- 172.21.15.142:0/4094538944 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940cfc20 con 0x7f07940cc3b0 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.733+0000 7f0799d9b700 1 --2- 172.21.15.142:0/4094538944 >> v2:172.21.15.148:3300/0 conn(0x7f07940cbfe0 0x7f079415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f079959a700 1 --2- 172.21.15.142:0/4094538944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07940cc3b0 0x7f07940cf210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f079406cf00 tx=0x7f0784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81074a10073d9b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f0798d99700 1 -- 172.21.15.142:0/4094538944 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400b860 con 0x7f07940cc3b0 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f0798d99700 1 -- 172.21.15.142:0/4094538944 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400b9c0 con 0x7f07940cc3b0 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f0798d99700 1 -- 172.21.15.142:0/4094538944 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400bd60 con 0x7f07940cc3b0 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f079bfff700 1 -- 172.21.15.142:0/4094538944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07940cc3b0 msgr2=0x7f07940cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f079bfff700 1 --2- 172.21.15.142:0/4094538944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07940cc3b0 0x7f07940cf210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f079406cf00 tx=0x7f0784009250 comp rx=0 tx=0).stop 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f079bfff700 1 -- 172.21.15.142:0/4094538944 shutdown_connections 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f079bfff700 1 --2- 172.21.15.142:0/4094538944 >> v2:172.21.15.148:3300/0 conn(0x7f07940cbfe0 0x7f079415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f079bfff700 1 --2- 172.21.15.142:0/4094538944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07940cc3b0 0x7f07940cf210 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.734+0000 7f079bfff700 1 -- 172.21.15.142:0/4094538944 >> 172.21.15.142:0/4094538944 conn(0x7f07940d0a80 msgr2=0x7f07940d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.735+0000 7f079bfff700 1 -- 172.21.15.142:0/4094538944 shutdown_connections 2023-09-30T22:53:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.735+0000 7f079bfff700 1 -- 172.21.15.142:0/4094538944 wait complete. 2023-09-30T22:53:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.736+0000 7f079bfff700 1 Processor -- start 2023-09-30T22:53:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.736+0000 7f079bfff700 1 -- start start 2023-09-30T22:53:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07940cbfe0 0x7f07940c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07940cc3b0 0x7f07940c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07941573a0 0x7f07940b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940c9f80 con 0x7f07941573a0 2023-09-30T22:53:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079bfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940ca260 con 0x7f07940cbfe0 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079bfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07940ca540 con 0x7f07940cc3b0 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07941573a0 0x7f07940b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07941573a0 0x7f07940b8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39684/0 (socket says 172.21.15.142:39684) 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079a59c700 1 -- 172.21.15.142:0/3671279148 learned_addr learned my addr 172.21.15.142:0/3671279148 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f0799d9b700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07940cbfe0 0x7f07940c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.737+0000 7f079959a700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07940cc3b0 0x7f07940c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079a59c700 1 -- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07940cc3b0 msgr2=0x7f07940c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079a59c700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07940cc3b0 0x7f07940c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079a59c700 1 -- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07940cbfe0 msgr2=0x7f07940c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079a59c700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07940cbfe0 0x7f07940c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079a59c700 1 -- 172.21.15.142:0/3671279148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07840094f0 con 0x7f07941573a0 2023-09-30T22:53:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079a59c700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07941573a0 0x7f07940b8330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c840 tx=0x7f078c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:27.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f0789ffb700 1 -- 172.21.15.142:0/3671279148 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c012630 con 0x7f07941573a0 2023-09-30T22:53:27.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f0789ffb700 1 -- 172.21.15.142:0/3671279148 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c0127b0 con 0x7f07941573a0 2023-09-30T22:53:27.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07940ca820 con 0x7f07941573a0 2023-09-30T22:53:27.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f0789ffb700 1 -- 172.21.15.142:0/3671279148 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c012b70 con 0x7f07941573a0 2023-09-30T22:53:27.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.738+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07940c4160 con 0x7f07941573a0 2023-09-30T22:53:27.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.740+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07940cad40 con 0x7f07941573a0 2023-09-30T22:53:27.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.741+0000 7f0789ffb700 1 -- 172.21.15.142:0/3671279148 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f078c01a3a0 con 0x7f07941573a0 2023-09-30T22:53:27.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.741+0000 7f0789ffb700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0778067330 0x7f07780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:27.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.742+0000 7f0789ffb700 1 -- 172.21.15.142:0/3671279148 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f078c084d20 con 0x7f07941573a0 2023-09-30T22:53:27.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.742+0000 7f0799d9b700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0778067330 0x7f07780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:27.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.742+0000 7f0799d9b700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0778067330 0x7f07780697e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0790006f00 tx=0x7f0790008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:27.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.746+0000 7f0789ffb700 1 -- 172.21.15.142:0/3671279148 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f07940cad40 con 0x7f07941573a0 2023-09-30T22:53:27.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:27.980+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f07940cad40 con 0x7f07941573a0 2023-09-30T22:53:28.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.527+0000 7f0789ffb700 1 -- 172.21.15.142:0/3671279148 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f07940cad40 con 0x7f07941573a0 2023-09-30T22:53:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0778067330 msgr2=0x7f07780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0778067330 0x7f07780697e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0790006f00 tx=0x7f0790008040 comp rx=0 tx=0).stop 2023-09-30T22:53:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07941573a0 msgr2=0x7f07940b8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07941573a0 0x7f07940b8330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c840 tx=0x7f078c001670 comp rx=0 tx=0).stop 2023-09-30T22:53:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 shutdown_connections 2023-09-30T22:53:28.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0778067330 0x7f07780697e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07941573a0 0x7f07940b8330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07940cbfe0 0x7f07940c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 --2- 172.21.15.142:0/3671279148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07940cc3b0 0x7f07940c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.531+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 >> 172.21.15.142:0/3671279148 conn(0x7f07940d0a80 msgr2=0x7f079406a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.533+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 shutdown_connections 2023-09-30T22:53:28.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.533+0000 7f079bfff700 1 -- 172.21.15.142:0/3671279148 wait complete. 2023-09-30T22:53:28.537 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 5 and data pool 6 2023-09-30T22:53:28.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:28.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.745+0000 7f803afff700 1 Processor -- start 2023-09-30T22:53:28.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.746+0000 7f803afff700 1 -- start start 2023-09-30T22:53:28.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.747+0000 7f803afff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80340b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:28.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.747+0000 7f803afff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803406d470 con 0x7f80340b1f40 2023-09-30T22:53:28.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.747+0000 7f803afff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8034157e60 con 0x7f8034157a90 2023-09-30T22:53:28.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.747+0000 7f803afff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80340b23e0 con 0x7f803406b3d0 2023-09-30T22:53:28.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.747+0000 7f803959c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f80340b1f40 0x7f803406d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45488/0 (socket says 172.21.15.142:45488) 2023-09-30T22:53:28.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.747+0000 7f803959c700 1 -- 172.21.15.142:0/314745917 learned_addr learned my addr 172.21.15.142:0/314745917 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:28.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.747+0000 7f8033fff700 1 --2- 172.21.15.142:0/314745917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80340b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:28.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f80337fe700 1 -- 172.21.15.142:0/314745917 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279847021 0 0) 0x7f803406d470 con 0x7f80340b1f40 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f80337fe700 1 -- 172.21.15.142:0/314745917 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8024003570 con 0x7f80340b1f40 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f80337fe700 1 -- 172.21.15.142:0/314745917 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069771485 0 0) 0x7f8034157e60 con 0x7f8034157a90 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f8033fff700 1 -- 172.21.15.142:0/314745917 >> v1:172.21.15.148:6789/0 conn(0x7f8034157a90 legacy=0x7f803415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f8033fff700 1 -- 172.21.15.142:0/314745917 >> v1:172.21.15.142:6789/0 conn(0x7f80340b1f40 legacy=0x7f803406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f8033fff700 1 -- 172.21.15.142:0/314745917 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340ae880 con 0x7f803406b3d0 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f8033fff700 1 --2- 172.21.15.142:0/314745917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80340b1a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8020009910 tx=0x7f80200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3230d95a8158da71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f80337fe700 1 -- 172.21.15.142:0/314745917 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000b680 con 0x7f803406b3d0 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f80337fe700 1 -- 172.21.15.142:0/314745917 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802000b7e0 con 0x7f803406b3d0 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.748+0000 7f80337fe700 1 -- 172.21.15.142:0/314745917 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000bba0 con 0x7f803406b3d0 2023-09-30T22:53:28.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.749+0000 7f803afff700 1 -- 172.21.15.142:0/314745917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 msgr2=0x7f80340b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.749+0000 7f803afff700 1 --2- 172.21.15.142:0/314745917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80340b1a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8020009910 tx=0x7f80200091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.749+0000 7f803afff700 1 -- 172.21.15.142:0/314745917 shutdown_connections 2023-09-30T22:53:28.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.749+0000 7f803afff700 1 --2- 172.21.15.142:0/314745917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80340b1a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.749+0000 7f803afff700 1 -- 172.21.15.142:0/314745917 >> 172.21.15.142:0/314745917 conn(0x7f80340680c0 msgr2=0x7f80340c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:28.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.749+0000 7f803afff700 1 -- 172.21.15.142:0/314745917 shutdown_connections 2023-09-30T22:53:28.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.749+0000 7f803afff700 1 -- 172.21.15.142:0/314745917 wait complete. 2023-09-30T22:53:28.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.750+0000 7f803afff700 1 Processor -- start 2023-09-30T22:53:28.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.751+0000 7f803afff700 1 -- start start 2023-09-30T22:53:28.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.751+0000 7f803afff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80341549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:28.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.751+0000 7f803afff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80340b1f40 0x7f803415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:28.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.751+0000 7f803afff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8034157a90 0x7f803414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f803afff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803415c790 con 0x7f80340b1f40 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f803afff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8034154f20 con 0x7f8034157a90 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f803afff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803415ca30 con 0x7f803406b3d0 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80340b1f40 0x7f803415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80340b1f40 0x7f803415a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39694/0 (socket says 172.21.15.142:39694) 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 -- 172.21.15.142:0/2676472388 learned_addr learned my addr 172.21.15.142:0/2676472388 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8038d9b700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80341549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f803959c700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8034157a90 0x7f803414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 -- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 msgr2=0x7f80341549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80341549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 -- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8034157a90 msgr2=0x7f803414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8034157a90 0x7f803414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 -- 172.21.15.142:0/2676472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020009420 con 0x7f80340b1f40 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.752+0000 7f8033fff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80340b1f40 0x7f803415a120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8020013000 tx=0x7f8020017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.753+0000 7f8030ff9700 1 -- 172.21.15.142:0/2676472388 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000bb60 con 0x7f80340b1f40 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.753+0000 7f8030ff9700 1 -- 172.21.15.142:0/2676472388 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8020027450 con 0x7f80340b1f40 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.753+0000 7f8030ff9700 1 -- 172.21.15.142:0/2676472388 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80200277f0 con 0x7f80340b1f40 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.753+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803415cd10 con 0x7f80340b1f40 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.753+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803415aa70 con 0x7f80340b1f40 2023-09-30T22:53:28.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.754+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803415d230 con 0x7f80340b1f40 2023-09-30T22:53:28.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.755+0000 7f8030ff9700 1 -- 172.21.15.142:0/2676472388 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f802001a430 con 0x7f80340b1f40 2023-09-30T22:53:28.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.756+0000 7f8030ff9700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:28.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.756+0000 7f8030ff9700 1 -- 172.21.15.142:0/2676472388 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8020086b50 con 0x7f80340b1f40 2023-09-30T22:53:28.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.756+0000 7f8038d9b700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:28.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.757+0000 7f8038d9b700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8028003820 tx=0x7f8028009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:28.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.761+0000 7f8030ff9700 1 -- 172.21.15.142:0/2676472388 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f803415d230 con 0x7f80340b1f40 2023-09-30T22:53:28.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.950+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f803415d230 con 0x7f80340b1f40 2023-09-30T22:53:28.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.951+0000 7f8030ff9700 1 -- 172.21.15.142:0/2676472388 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17023 (secure 0 0 0) 0x7f803415d230 con 0x7f80340b1f40 2023-09-30T22:53:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:28.952 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":34,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:27.981157+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:53:25.907895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T22:53:26.965039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 msgr2=0x7f80180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8028003820 tx=0x7f8028009040 comp rx=0 tx=0).stop 2023-09-30T22:53:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80340b1f40 msgr2=0x7f803415a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80340b1f40 0x7f803415a120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8020013000 tx=0x7f8020017000 comp rx=0 tx=0).stop 2023-09-30T22:53:28.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 shutdown_connections 2023-09-30T22:53:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8034157a90 0x7f803414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f803406b3d0 0x7f80341549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 --2- 172.21.15.142:0/2676472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80340b1f40 0x7f803415a120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 >> 172.21.15.142:0/2676472388 conn(0x7f80340680c0 msgr2=0x7f80340cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 shutdown_connections 2023-09-30T22:53:28.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:28.954+0000 7f803afff700 1 -- 172.21.15.142:0/2676472388 wait complete. 2023-09-30T22:53:28.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:29.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.161+0000 7ff62ebff700 1 Processor -- start 2023-09-30T22:53:29.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.161+0000 7ff62ebff700 1 -- start start 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff62ebff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff62806d3f0 0x7ff62806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff62ebff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6280c6da0 0x7ff62815e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff62ebff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62815dde0 con 0x7ff62806b130 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff62ebff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62815d7d0 con 0x7ff6280c6da0 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff62ebff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6280c7230 con 0x7ff62806d3f0 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff627fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6280c6da0 0x7ff62815e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff627fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6280c6da0 0x7ff62815e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39698/0 (socket says 172.21.15.142:39698) 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff62d19c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff62806b130 0x7ff628069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45500/0 (socket says 172.21.15.142:45500) 2023-09-30T22:53:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff627fff700 1 -- 172.21.15.142:0/948372853 learned_addr learned my addr 172.21.15.142:0/948372853 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.163+0000 7ff62c99b700 1 --2- 172.21.15.142:0/948372853 >> v2:172.21.15.148:3300/0 conn(0x7ff62806d3f0 0x7ff62806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff627fff700 1 -- 172.21.15.142:0/948372853 >> v2:172.21.15.148:3300/0 conn(0x7ff62806d3f0 msgr2=0x7ff62806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff627fff700 1 --2- 172.21.15.142:0/948372853 >> v2:172.21.15.148:3300/0 conn(0x7ff62806d3f0 0x7ff62806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff627fff700 1 -- 172.21.15.142:0/948372853 >> v1:172.21.15.142:6789/0 conn(0x7ff62806b130 legacy=0x7ff628069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff627fff700 1 -- 172.21.15.142:0/948372853 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62815da70 con 0x7ff6280c6da0 2023-09-30T22:53:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff6277fe700 1 -- 172.21.15.142:0/948372853 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446245729 0 0) 0x7ff62815dde0 con 0x7ff62806b130 2023-09-30T22:53:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff627fff700 1 --2- 172.21.15.142:0/948372853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6280c6da0 0x7ff62815e270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff6140099b0 tx=0x7ff614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08d070a1361df5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:29.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff6277fe700 1 -- 172.21.15.142:0/948372853 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614009ea0 con 0x7ff6280c6da0 2023-09-30T22:53:29.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff6277fe700 1 -- 172.21.15.142:0/948372853 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61400b820 con 0x7ff6280c6da0 2023-09-30T22:53:29.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.164+0000 7ff6277fe700 1 -- 172.21.15.142:0/948372853 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400bbc0 con 0x7ff6280c6da0 2023-09-30T22:53:29.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 -- 172.21.15.142:0/948372853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6280c6da0 msgr2=0x7ff62815e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 --2- 172.21.15.142:0/948372853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6280c6da0 0x7ff62815e270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff6140099b0 tx=0x7ff614009250 comp rx=0 tx=0).stop 2023-09-30T22:53:29.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 -- 172.21.15.142:0/948372853 shutdown_connections 2023-09-30T22:53:29.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 --2- 172.21.15.142:0/948372853 >> v2:172.21.15.148:3300/0 conn(0x7ff62806d3f0 0x7ff62806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 --2- 172.21.15.142:0/948372853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6280c6da0 0x7ff62815e270 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 -- 172.21.15.142:0/948372853 >> 172.21.15.142:0/948372853 conn(0x7ff628067e30 msgr2=0x7ff628068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:29.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 -- 172.21.15.142:0/948372853 shutdown_connections 2023-09-30T22:53:29.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.165+0000 7ff62ebff700 1 -- 172.21.15.142:0/948372853 wait complete. 2023-09-30T22:53:29.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.166+0000 7ff62ebff700 1 Processor -- start 2023-09-30T22:53:29.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.166+0000 7ff62ebff700 1 -- start start 2023-09-30T22:53:29.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.167+0000 7ff62ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff62806b130 0x7ff6280ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.167+0000 7ff62ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff62806d3f0 0x7ff6280cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.167+0000 7ff62ebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6280c6da0 0x7ff628141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.167+0000 7ff62ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280ca930 con 0x7ff62806b130 2023-09-30T22:53:29.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.167+0000 7ff62ebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280ca000 con 0x7ff6280c6da0 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.167+0000 7ff62ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280ca2e0 con 0x7ff62806d3f0 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.167+0000 7ff62c99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff62806b130 0x7ff6280ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff62806b130 0x7ff6280ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39704/0 (socket says 172.21.15.142:39704) 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 -- 172.21.15.142:0/1279974704 learned_addr learned my addr 172.21.15.142:0/1279974704 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 -- 172.21.15.142:0/1279974704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff62806d3f0 msgr2=0x7ff6280cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff62806d3f0 0x7ff6280cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 -- 172.21.15.142:0/1279974704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6280c6da0 msgr2=0x7ff628141ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6280c6da0 0x7ff628141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 -- 172.21.15.142:0/1279974704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6140094f0 con 0x7ff62806b130 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62c99b700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff62806b130 0x7ff6280ccfc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00ec80 tx=0x7ff61c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff624ff9700 1 -- 172.21.15.142:0/1279974704 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c00c9d0 con 0x7ff62806b130 2023-09-30T22:53:29.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff624ff9700 1 -- 172.21.15.142:0/1279974704 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c00cb30 con 0x7ff62806b130 2023-09-30T22:53:29.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff624ff9700 1 -- 172.21.15.142:0/1279974704 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c013470 con 0x7ff62806b130 2023-09-30T22:53:29.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.168+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6280ca5c0 con 0x7ff62806b130 2023-09-30T22:53:29.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.169+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6281421e0 con 0x7ff62806b130 2023-09-30T22:53:29.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.169+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff628069420 con 0x7ff62806b130 2023-09-30T22:53:29.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.170+0000 7ff624ff9700 1 -- 172.21.15.142:0/1279974704 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff61c013820 con 0x7ff62806b130 2023-09-30T22:53:29.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.171+0000 7ff624ff9700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff60c067330 0x7ff60c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.171+0000 7ff624ff9700 1 -- 172.21.15.142:0/1279974704 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff61c084fe0 con 0x7ff62806b130 2023-09-30T22:53:29.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.171+0000 7ff627fff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff60c067330 0x7ff60c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.172+0000 7ff627fff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff60c067330 0x7ff60c0697e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6140099b0 tx=0x7ff614017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:29.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.175+0000 7ff624ff9700 1 -- 172.21.15.142:0/1279974704 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff61c051e60 con 0x7ff62806b130 2023-09-30T22:53:29.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.369+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6280c7510 con 0x7ff62806b130 2023-09-30T22:53:29.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.370+0000 7ff624ff9700 1 -- 172.21.15.142:0/1279974704 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17023 (secure 0 0 0) 0x7ff61c017090 con 0x7ff62806b130 2023-09-30T22:53:29.371 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:29.371 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":34,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:27.981157+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:53:25.907895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T22:53:26.965039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:29.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff60c067330 msgr2=0x7ff60c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff60c067330 0x7ff60c0697e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6140099b0 tx=0x7ff614017000 comp rx=0 tx=0).stop 2023-09-30T22:53:29.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff62806b130 msgr2=0x7ff6280ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff62806b130 0x7ff6280ccfc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00ec80 tx=0x7ff61c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 shutdown_connections 2023-09-30T22:53:29.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff60c067330 0x7ff60c0697e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6280c6da0 0x7ff628141ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff62806b130 0x7ff6280ccfc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 --2- 172.21.15.142:0/1279974704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff62806d3f0 0x7ff6280cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 >> 172.21.15.142:0/1279974704 conn(0x7ff628067e30 msgr2=0x7ff6280cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:29.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 shutdown_connections 2023-09-30T22:53:29.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.373+0000 7ff62ebff700 1 -- 172.21.15.142:0/1279974704 wait complete. 2023-09-30T22:53:29.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:53:29.485 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-09-30T22:53:29.485+0000 7fb17e7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:53:29.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.585+0000 7f43609ff700 1 Processor -- start 2023-09-30T22:53:29.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.585+0000 7f43609ff700 1 -- start start 2023-09-30T22:53:29.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.586+0000 7f43609ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f435c0c52a0 0x7f435c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.586+0000 7f43609ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.586+0000 7f43609ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c0c7690 con 0x7f435c069f10 2023-09-30T22:53:29.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.586+0000 7f43609ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c1406a0 con 0x7f435c0c52a0 2023-09-30T22:53:29.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.586+0000 7f43609ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c3a50 con 0x7f435c0cb350 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f435c0c52a0 0x7f435c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435ad9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f435c0c52a0 0x7f435c0c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:38502/0 (socket says 172.21.15.142:38502) 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435ad9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c1605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:53696/0 (socket says 172.21.15.142:53696) 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f4359d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f435c069f10 0x7f435c0c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:34626/0 (socket says 172.21.15.142:34626) 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435a59c700 1 -- 172.21.15.142:0/927017775 learned_addr learned my addr 172.21.15.142:0/927017775 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435ad9d700 1 -- 172.21.15.142:0/927017775 >> v2:172.21.15.148:3300/0 conn(0x7f435c0c52a0 msgr2=0x7f435c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435ad9d700 1 --2- 172.21.15.142:0/927017775 >> v2:172.21.15.148:3300/0 conn(0x7f435c0c52a0 0x7f435c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435ad9d700 1 -- 172.21.15.142:0/927017775 >> v1:172.21.15.148:6789/0 conn(0x7f435c069f10 legacy=0x7f435c0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435959a700 1 -- 172.21.15.142:0/927017775 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651415766 0 0) 0x7f4350001110 con 0x7f435c069f10 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.587+0000 7f435ad9d700 1 -- 172.21.15.142:0/927017775 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0c7f20 con 0x7f435c0cb350 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f435ad9d700 1 --2- 172.21.15.142:0/927017775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c1605e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f435400d0d0 tx=0x7f435400b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b02211c1d8f229f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f435959a700 1 -- 172.21.15.142:0/927017775 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354010070 con 0x7f435c0cb350 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f435959a700 1 -- 172.21.15.142:0/927017775 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435400b2e0 con 0x7f435c0cb350 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f435959a700 1 -- 172.21.15.142:0/927017775 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400dd80 con 0x7f435c0cb350 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f43609ff700 1 -- 172.21.15.142:0/927017775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 msgr2=0x7f435c1605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f43609ff700 1 --2- 172.21.15.142:0/927017775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c1605e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f435400d0d0 tx=0x7f435400b990 comp rx=0 tx=0).stop 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f43609ff700 1 -- 172.21.15.142:0/927017775 shutdown_connections 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f43609ff700 1 --2- 172.21.15.142:0/927017775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c1605e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f43609ff700 1 --2- 172.21.15.142:0/927017775 >> v2:172.21.15.148:3300/0 conn(0x7f435c0c52a0 0x7f435c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.588+0000 7f43609ff700 1 -- 172.21.15.142:0/927017775 >> 172.21.15.142:0/927017775 conn(0x7f435c0cc670 msgr2=0x7f435c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:29.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.589+0000 7f43609ff700 1 -- 172.21.15.142:0/927017775 shutdown_connections 2023-09-30T22:53:29.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.589+0000 7f43609ff700 1 -- 172.21.15.142:0/927017775 wait complete. 2023-09-30T22:53:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.590+0000 7f43609ff700 1 Processor -- start 2023-09-30T22:53:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.590+0000 7f43609ff700 1 -- start start 2023-09-30T22:53:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f43609ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f435c069f10 0x7f435c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f43609ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435c0c52a0 0x7f435c0c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f43609ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f43609ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c1120 con 0x7f435c069f10 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f43609ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c2100 con 0x7f435c0c52a0 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f43609ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c0b60 con 0x7f435c0cb350 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f435a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f435c069f10 0x7f435c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f435a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f435c069f10 0x7f435c1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39708/0 (socket says 172.21.15.142:39708) 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.591+0000 7f435a59c700 1 -- 172.21.15.142:0/7182480 learned_addr learned my addr 172.21.15.142:0/7182480 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f4359d9b700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435c0c52a0 0x7f435c0c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435ad9d700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435a59c700 1 -- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 msgr2=0x7f435c15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435a59c700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c15f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435a59c700 1 -- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435c0c52a0 msgr2=0x7f435c0c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435a59c700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435c0c52a0 0x7f435c0c0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435a59c700 1 -- 172.21.15.142:0/7182480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435400bc30 con 0x7f435c069f10 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435ad9d700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f4359d9b700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435c0c52a0 0x7f435c0c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f435a59c700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f435c069f10 0x7f435c1560e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f434c00ea00 tx=0x7f434c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f434a7fc700 1 -- 172.21.15.142:0/7182480 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00c850 con 0x7f435c069f10 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f434a7fc700 1 -- 172.21.15.142:0/7182480 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c00c9b0 con 0x7f435c069f10 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0c0e40 con 0x7f435c069f10 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f434a7fc700 1 -- 172.21.15.142:0/7182480 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00cd30 con 0x7f435c069f10 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.592+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c156620 con 0x7f435c069f10 2023-09-30T22:53:29.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.593+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c0c23e0 con 0x7f435c069f10 2023-09-30T22:53:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.594+0000 7f434a7fc700 1 -- 172.21.15.142:0/7182480 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f434c013680 con 0x7f435c069f10 2023-09-30T22:53:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.595+0000 7f434a7fc700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f433c067330 0x7f433c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:29.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.595+0000 7f434a7fc700 1 -- 172.21.15.142:0/7182480 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f434c084ed0 con 0x7f435c069f10 2023-09-30T22:53:29.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.595+0000 7f4359d9b700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f433c067330 0x7f433c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:29.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.596+0000 7f4359d9b700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f433c067330 0x7f433c0697e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f435c06a320 tx=0x7f4350009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:29.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.599+0000 7f434a7fc700 1 -- 172.21.15.142:0/7182480 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f434c051d30 con 0x7f435c069f10 2023-09-30T22:53:29.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:29.833+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f435c06fc10 con 0x7f435c069f10 2023-09-30T22:53:30.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.533+0000 7f434a7fc700 1 -- 172.21.15.142:0/7182480 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f434c055350 con 0x7f435c069f10 2023-09-30T22:53:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.536+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f433c067330 msgr2=0x7f433c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.536+0000 7f43609ff700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f433c067330 0x7f433c0697e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f435c06a320 tx=0x7f4350009040 comp rx=0 tx=0).stop 2023-09-30T22:53:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.536+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f435c069f10 msgr2=0x7f435c1560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.536+0000 7f43609ff700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f435c069f10 0x7f435c1560e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f434c00ea00 tx=0x7f434c009250 comp rx=0 tx=0).stop 2023-09-30T22:53:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.536+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 shutdown_connections 2023-09-30T22:53:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.536+0000 7f43609ff700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f433c067330 0x7f433c0697e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.536+0000 7f43609ff700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f435c0cb350 0x7f435c15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.537+0000 7f43609ff700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f435c069f10 0x7f435c1560e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.537+0000 7f43609ff700 1 --2- 172.21.15.142:0/7182480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435c0c52a0 0x7f435c0c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.537+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 >> 172.21.15.142:0/7182480 conn(0x7f435c0cc670 msgr2=0x7f435c06e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.537+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 shutdown_connections 2023-09-30T22:53:30.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.537+0000 7f43609ff700 1 -- 172.21.15.142:0/7182480 wait complete. 2023-09-30T22:53:30.558 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:53:30.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.758+0000 7f90cb3ff700 1 Processor -- start 2023-09-30T22:53:30.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.758+0000 7f90cb3ff700 1 -- start start 2023-09-30T22:53:30.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.759+0000 7f90cb3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c4150600 0x7f90c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:30.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.759+0000 7f90cb3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f90c41509d0 0x7f90c406ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:30.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.759+0000 7f90cb3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c41576e0 con 0x7f90c415a920 2023-09-30T22:53:30.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.759+0000 7f90cb3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40cc320 con 0x7f90c41509d0 2023-09-30T22:53:30.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.759+0000 7f90cb3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c406a620 con 0x7f90c4150600 2023-09-30T22:53:30.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c999c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f90c415a920 0x7f90c4069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:45512/0 (socket says 172.21.15.142:45512) 2023-09-30T22:53:30.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c999c700 1 -- 172.21.15.142:0/2674502529 learned_addr learned my addr 172.21.15.142:0/2674502529 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c919b700 1 --2- 172.21.15.142:0/2674502529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c4150600 0x7f90c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c899a700 1 --2- 172.21.15.142:0/2674502529 >> v2:172.21.15.148:3300/0 conn(0x7f90c41509d0 0x7f90c406ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90bbfff700 1 -- 172.21.15.142:0/2674502529 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717095152 0 0) 0x7f90c41576e0 con 0x7f90c415a920 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90bbfff700 1 -- 172.21.15.142:0/2674502529 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b0003570 con 0x7f90c415a920 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c919b700 1 -- 172.21.15.142:0/2674502529 >> v2:172.21.15.148:3300/0 conn(0x7f90c41509d0 msgr2=0x7f90c406ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c919b700 1 --2- 172.21.15.142:0/2674502529 >> v2:172.21.15.148:3300/0 conn(0x7f90c41509d0 0x7f90c406ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c919b700 1 -- 172.21.15.142:0/2674502529 >> v1:172.21.15.142:6789/0 conn(0x7f90c415a920 legacy=0x7f90c4069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:30.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90bbfff700 1 -- 172.21.15.142:0/2674502529 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811083883 0 0) 0x7f90b0003570 con 0x7f90c415a920 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.760+0000 7f90c919b700 1 -- 172.21.15.142:0/2674502529 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c415a490 con 0x7f90c4150600 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.761+0000 7f90c919b700 1 --2- 172.21.15.142:0/2674502529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c4150600 0x7f90c406a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90c00098e0 tx=0x7f90c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db03f9c257f86c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.761+0000 7f90bbfff700 1 -- 172.21.15.142:0/2674502529 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0011630 con 0x7f90c4150600 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.761+0000 7f90bbfff700 1 -- 172.21.15.142:0/2674502529 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0011790 con 0x7f90c4150600 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.761+0000 7f90bbfff700 1 -- 172.21.15.142:0/2674502529 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0011b30 con 0x7f90c4150600 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.761+0000 7f90cb3ff700 1 -- 172.21.15.142:0/2674502529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c4150600 msgr2=0x7f90c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.761+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/2674502529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c4150600 0x7f90c406a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90c00098e0 tx=0x7f90c00091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.762+0000 7f90cb3ff700 1 -- 172.21.15.142:0/2674502529 shutdown_connections 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.762+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/2674502529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c4150600 0x7f90c406a7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.762+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/2674502529 >> v2:172.21.15.148:3300/0 conn(0x7f90c41509d0 0x7f90c406ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.762+0000 7f90cb3ff700 1 -- 172.21.15.142:0/2674502529 >> 172.21.15.142:0/2674502529 conn(0x7f90c40cc670 msgr2=0x7f90c40cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:30.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.762+0000 7f90cb3ff700 1 -- 172.21.15.142:0/2674502529 shutdown_connections 2023-09-30T22:53:30.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.762+0000 7f90cb3ff700 1 -- 172.21.15.142:0/2674502529 wait complete. 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.763+0000 7f90cb3ff700 1 Processor -- start 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.763+0000 7f90cb3ff700 1 -- start start 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90cb3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90c4150600 0x7f90c414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90cb3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c41509d0 0x7f90c415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90cb3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c415a920 0x7f90c415ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90cb3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c415e950 con 0x7f90c415a920 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90cb3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c415bd20 con 0x7f90c4150600 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90cb3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c415b760 con 0x7f90c41509d0 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90c999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c415a920 0x7f90c415ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:30.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90c999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c415a920 0x7f90c415ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39712/0 (socket says 172.21.15.142:39712) 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90c999c700 1 -- 172.21.15.142:0/4015064778 learned_addr learned my addr 172.21.15.142:0/4015064778 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.764+0000 7f90c899a700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c41509d0 0x7f90c415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90c919b700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90c4150600 0x7f90c414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90c999c700 1 -- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c41509d0 msgr2=0x7f90c415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90c999c700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c41509d0 0x7f90c415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90c999c700 1 -- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90c4150600 msgr2=0x7f90c414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90c999c700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90c4150600 0x7f90c414e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90c999c700 1 -- 172.21.15.142:0/4015064778 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009420 con 0x7f90c415a920 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90c999c700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c415a920 0x7f90c415ede0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00c930 tx=0x7f90bc0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90b97fa700 1 -- 172.21.15.142:0/4015064778 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004dc0 con 0x7f90c415a920 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90b97fa700 1 -- 172.21.15.142:0/4015064778 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc007150 con 0x7f90c415a920 2023-09-30T22:53:30.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90b97fa700 1 -- 172.21.15.142:0/4015064778 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0074d0 con 0x7f90c415a920 2023-09-30T22:53:30.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.765+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c415ba40 con 0x7f90c415a920 2023-09-30T22:53:30.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.766+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c415b2c0 con 0x7f90c415a920 2023-09-30T22:53:30.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.766+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c4069a50 con 0x7f90c415a920 2023-09-30T22:53:30.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.767+0000 7f90b97fa700 1 -- 172.21.15.142:0/4015064778 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f90bc007880 con 0x7f90c415a920 2023-09-30T22:53:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.768+0000 7f90b97fa700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f90a8067330 0x7f90a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.768+0000 7f90b97fa700 1 -- 172.21.15.142:0/4015064778 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90bc083f00 con 0x7f90c415a920 2023-09-30T22:53:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.768+0000 7f90c919b700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f90a8067330 0x7f90a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:30.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.769+0000 7f90c919b700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f90a8067330 0x7f90a80697e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90c00091e0 tx=0x7f90c0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:30.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:30.772+0000 7f90b97fa700 1 -- 172.21.15.142:0/4015064778 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f90bc04b570 con 0x7f90c415a920 2023-09-30T22:53:31.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.006+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f90c406fc10 con 0x7f90c415a920 2023-09-30T22:53:31.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.540+0000 7f90b97fa700 1 -- 172.21.15.142:0/4015064778 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f90bc018070 con 0x7f90c415a920 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f90a8067330 msgr2=0x7f90a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f90a8067330 0x7f90a80697e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90c00091e0 tx=0x7f90c0017000 comp rx=0 tx=0).stop 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c415a920 msgr2=0x7f90c415ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c415a920 0x7f90c415ede0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00c930 tx=0x7f90bc0016f0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 shutdown_connections 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f90a8067330 0x7f90a80697e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c415a920 0x7f90c415ede0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90c4150600 0x7f90c414e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 --2- 172.21.15.142:0/4015064778 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90c41509d0 0x7f90c415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 >> 172.21.15.142:0/4015064778 conn(0x7f90c40cc670 msgr2=0x7f90c40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:31.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 shutdown_connections 2023-09-30T22:53:31.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.543+0000 7f90cb3ff700 1 -- 172.21.15.142:0/4015064778 wait complete. 2023-09-30T22:53:31.562 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:31.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.753+0000 7fc11c3ff700 1 Processor -- start 2023-09-30T22:53:31.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.753+0000 7fc11c3ff700 1 -- start start 2023-09-30T22:53:31.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.755+0000 7fc11c3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140af020 0x7fc114156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:31.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.755+0000 7fc11c3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1140b00d0 0x7fc11406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:31.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.755+0000 7fc11c3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11406d3e0 con 0x7fc11406e650 2023-09-30T22:53:31.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.755+0000 7fc11c3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11415b400 con 0x7fc1140b00d0 2023-09-30T22:53:31.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.755+0000 7fc11c3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11406dc80 con 0x7fc1140af020 2023-09-30T22:53:31.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.755+0000 7fc11999a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1140b00d0 0x7fc11406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:31.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.755+0000 7fc11a19b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140af020 0x7fc114156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11a99c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc11406e650 0x7fc1140b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:39416/0 (socket says 172.21.15.142:39416) 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11a99c700 1 -- 172.21.15.142:0/429678932 learned_addr learned my addr 172.21.15.142:0/429678932 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11999a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1140b00d0 0x7fc11406e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:33704/0 (socket says 172.21.15.142:33704) 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc119199700 1 -- 172.21.15.142:0/429678932 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075948538 0 0) 0x7fc11406d3e0 con 0x7fc11406e650 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc119199700 1 -- 172.21.15.142:0/429678932 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc100003570 con 0x7fc11406e650 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11a19b700 1 -- 172.21.15.142:0/429678932 >> v2:172.21.15.148:3300/0 conn(0x7fc1140b00d0 msgr2=0x7fc11406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11a19b700 1 --2- 172.21.15.142:0/429678932 >> v2:172.21.15.148:3300/0 conn(0x7fc1140b00d0 0x7fc11406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11a19b700 1 -- 172.21.15.142:0/429678932 >> v1:172.21.15.148:6789/0 conn(0x7fc11406e650 legacy=0x7fc1140b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11a19b700 1 -- 172.21.15.142:0/429678932 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11406b790 con 0x7fc1140af020 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11999a700 1 --2- 172.21.15.142:0/429678932 >> v2:172.21.15.148:3300/0 conn(0x7fc1140b00d0 0x7fc11406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:31.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.756+0000 7fc11a19b700 1 --2- 172.21.15.142:0/429678932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140af020 0x7fc114156d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1100098e0 tx=0x7fc1100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca4a73da92e87f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc119199700 1 -- 172.21.15.142:0/429678932 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110011630 con 0x7fc1140af020 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc119199700 1 -- 172.21.15.142:0/429678932 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc110011790 con 0x7fc1140af020 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc119199700 1 -- 172.21.15.142:0/429678932 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110011b30 con 0x7fc1140af020 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 -- 172.21.15.142:0/429678932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140af020 msgr2=0x7fc114156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/429678932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140af020 0x7fc114156d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1100098e0 tx=0x7fc1100091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 -- 172.21.15.142:0/429678932 shutdown_connections 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/429678932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140af020 0x7fc114156d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/429678932 >> v2:172.21.15.148:3300/0 conn(0x7fc1140b00d0 0x7fc11406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 -- 172.21.15.142:0/429678932 >> 172.21.15.142:0/429678932 conn(0x7fc1140680c0 msgr2=0x7fc1140c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 -- 172.21.15.142:0/429678932 shutdown_connections 2023-09-30T22:53:31.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.757+0000 7fc11c3ff700 1 -- 172.21.15.142:0/429678932 wait complete. 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.759+0000 7fc11c3ff700 1 Processor -- start 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.759+0000 7fc11c3ff700 1 -- start start 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11c3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11406e650 0x7fc11416ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11c3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1140af020 0x7fc11416d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11c3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140b00d0 0x7fc11415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11c3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11416daf0 con 0x7fc11406e650 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11c3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11416b390 con 0x7fc1140af020 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11c3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11416dd20 con 0x7fc1140b00d0 2023-09-30T22:53:31.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11a19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11406e650 0x7fc11416ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11a19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11406e650 0x7fc11416ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47040/0 (socket says 172.21.15.142:47040) 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11a19b700 1 -- 172.21.15.142:0/2359381131 learned_addr learned my addr 172.21.15.142:0/2359381131 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11999a700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1140af020 0x7fc11416d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.760+0000 7fc11a99c700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140b00d0 0x7fc11415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11a19b700 1 -- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140b00d0 msgr2=0x7fc11415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11a19b700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140b00d0 0x7fc11415a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11a19b700 1 -- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1140af020 msgr2=0x7fc11416d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11a19b700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1140af020 0x7fc11416d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11a19b700 1 -- 172.21.15.142:0/2359381131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104009420 con 0x7fc11406e650 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11a19b700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11406e650 0x7fc11416ab50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc11406ddc0 tx=0x7fc110017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc10a7fc700 1 -- 172.21.15.142:0/2359381131 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11001f070 con 0x7fc11406e650 2023-09-30T22:53:31.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc10a7fc700 1 -- 172.21.15.142:0/2359381131 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc110000bc0 con 0x7fc11406e650 2023-09-30T22:53:31.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc110009420 con 0x7fc11406e650 2023-09-30T22:53:31.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc10a7fc700 1 -- 172.21.15.142:0/2359381131 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110011b30 con 0x7fc11406e650 2023-09-30T22:53:31.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.761+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11416e2e0 con 0x7fc11406e650 2023-09-30T22:53:31.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.762+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1140695b0 con 0x7fc11406e650 2023-09-30T22:53:31.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.763+0000 7fc10a7fc700 1 -- 172.21.15.142:0/2359381131 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc110023070 con 0x7fc11406e650 2023-09-30T22:53:31.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.764+0000 7fc10a7fc700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0f8067330 0x7fc0f80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:31.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.764+0000 7fc10a7fc700 1 -- 172.21.15.142:0/2359381131 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc110085f00 con 0x7fc11406e650 2023-09-30T22:53:31.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.764+0000 7fc11999a700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0f8067330 0x7fc0f80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:31.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.765+0000 7fc11999a700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0f8067330 0x7fc0f80697e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1140cd2d0 tx=0x7fc1040091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:31.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:31.768+0000 7fc10a7fc700 1 -- 172.21.15.142:0/2359381131 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc110052d60 con 0x7fc11406e650 2023-09-30T22:53:32.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.000+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc11416b180 con 0x7fc11406e650 2023-09-30T22:53:32.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.001+0000 7fc10a7fc700 1 -- 172.21.15.142:0/2359381131 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fc11002a020 con 0x7fc11406e650 2023-09-30T22:53:32.001 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:32.001 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.003+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0f8067330 msgr2=0x7fc0f80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.003+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0f8067330 0x7fc0f80697e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1140cd2d0 tx=0x7fc1040091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.003+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11406e650 msgr2=0x7fc11416ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.003+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11406e650 0x7fc11416ab50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc11406ddc0 tx=0x7fc110017000 comp rx=0 tx=0).stop 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.003+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 shutdown_connections 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.004+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0f8067330 0x7fc0f80697e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.004+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1140b00d0 0x7fc11415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.004+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11406e650 0x7fc11416ab50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.004+0000 7fc11c3ff700 1 --2- 172.21.15.142:0/2359381131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1140af020 0x7fc11416d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.004+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 >> 172.21.15.142:0/2359381131 conn(0x7fc1140680c0 msgr2=0x7fc114155350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:32.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.004+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 shutdown_connections 2023-09-30T22:53:32.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.004+0000 7fc11c3ff700 1 -- 172.21.15.142:0/2359381131 wait complete. 2023-09-30T22:53:32.005 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:32.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:32.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.212+0000 7f46797ff700 1 Processor -- start 2023-09-30T22:53:32.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.212+0000 7f46797ff700 1 -- start start 2023-09-30T22:53:32.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.213+0000 7f46797ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f467415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.213+0000 7f46797ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f467415dc50 0x7f467406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.213+0000 7f46797ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467415e0b0 con 0x7f4674143350 2023-09-30T22:53:32.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.213+0000 7f46797ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740cc6b0 con 0x7f467415dc50 2023-09-30T22:53:32.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.213+0000 7f46797ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740cbaa0 con 0x7f46740692f0 2023-09-30T22:53:32.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f467415dc50 0x7f467406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f467415dc50 0x7f467406a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47042/0 (socket says 172.21.15.142:47042) 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 -- 172.21.15.142:0/1917808341 learned_addr learned my addr 172.21.15.142:0/1917808341 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46727fc700 1 --2- 172.21.15.142:0/1917808341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f467415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 -- 172.21.15.142:0/1917808341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 msgr2=0x7f467415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 --2- 172.21.15.142:0/1917808341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f467415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 -- 172.21.15.142:0/1917808341 >> v1:172.21.15.148:6789/0 conn(0x7f4674143350 legacy=0x7f46740cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 -- 172.21.15.142:0/1917808341 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740cbd80 con 0x7f467415dc50 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46727fc700 1 --2- 172.21.15.142:0/1917808341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f467415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:32.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.214+0000 7f46737fe700 1 --2- 172.21.15.142:0/1917808341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f467415dc50 0x7f467406a0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f466c009f20 tx=0x7f466c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0702d29a7939d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:32.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f4671ffb700 1 -- 172.21.15.142:0/1917808341 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00e070 con 0x7f467415dc50 2023-09-30T22:53:32.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f4671ffb700 1 -- 172.21.15.142:0/1917808341 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c00ba80 con 0x7f467415dc50 2023-09-30T22:53:32.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f4671ffb700 1 -- 172.21.15.142:0/1917808341 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0092e0 con 0x7f467415dc50 2023-09-30T22:53:32.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 -- 172.21.15.142:0/1917808341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f467415dc50 msgr2=0x7f467406a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 --2- 172.21.15.142:0/1917808341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f467415dc50 0x7f467406a0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f466c009f20 tx=0x7f466c009840 comp rx=0 tx=0).stop 2023-09-30T22:53:32.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 -- 172.21.15.142:0/1917808341 shutdown_connections 2023-09-30T22:53:32.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 --2- 172.21.15.142:0/1917808341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f467415dc50 0x7f467406a0c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 --2- 172.21.15.142:0/1917808341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f467415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 -- 172.21.15.142:0/1917808341 >> 172.21.15.142:0/1917808341 conn(0x7f46740ce8e0 msgr2=0x7f46740cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 -- 172.21.15.142:0/1917808341 shutdown_connections 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.215+0000 7f46797ff700 1 -- 172.21.15.142:0/1917808341 wait complete. 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.217+0000 7f46797ff700 1 Processor -- start 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.217+0000 7f46797ff700 1 -- start start 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46797ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f46741564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46797ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4674143350 0x7f46740ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46797ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f467415dc50 0x7f46740caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46797ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467415a1e0 con 0x7f4674143350 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46797ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467415a4c0 con 0x7f467415dc50 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46797ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467415cd30 con 0x7f46740692f0 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4674143350 0x7f46740ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4674143350 0x7f46740ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47056/0 (socket says 172.21.15.142:47056) 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 -- 172.21.15.142:0/3932370363 learned_addr learned my addr 172.21.15.142:0/3932370363 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f4672ffd700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f46741564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46737fe700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f467415dc50 0x7f46740caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 -- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 msgr2=0x7f46741564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f46741564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 -- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f467415dc50 msgr2=0x7f46740caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f467415dc50 0x7f46740caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.218+0000 7f46727fc700 1 -- 172.21.15.142:0/3932370363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009ae0 con 0x7f4674143350 2023-09-30T22:53:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.219+0000 7f46727fc700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4674143350 0x7f46740ca530 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f466800e8d0 tx=0x7f4668008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:32.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.219+0000 7f465affd700 1 -- 172.21.15.142:0/3932370363 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800ee70 con 0x7f4674143350 2023-09-30T22:53:32.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.219+0000 7f465affd700 1 -- 172.21.15.142:0/3932370363 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466800c5e0 con 0x7f4674143350 2023-09-30T22:53:32.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.219+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467415d010 con 0x7f4674143350 2023-09-30T22:53:32.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.219+0000 7f465affd700 1 -- 172.21.15.142:0/3932370363 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800c980 con 0x7f4674143350 2023-09-30T22:53:32.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.219+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4674156a00 con 0x7f4674143350 2023-09-30T22:53:32.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.220+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467415a630 con 0x7f4674143350 2023-09-30T22:53:32.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.221+0000 7f465affd700 1 -- 172.21.15.142:0/3932370363 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4668013410 con 0x7f4674143350 2023-09-30T22:53:32.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.222+0000 7f465affd700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4660067330 0x7f46600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.222+0000 7f465affd700 1 -- 172.21.15.142:0/3932370363 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4668084a40 con 0x7f4674143350 2023-09-30T22:53:32.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.222+0000 7f4672ffd700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4660067330 0x7f46600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.223+0000 7f4672ffd700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4660067330 0x7f46600697e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46740c9540 tx=0x7f4664009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:32.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.226+0000 7f465affd700 1 -- 172.21.15.142:0/3932370363 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f46680518a0 con 0x7f4674143350 2023-09-30T22:53:32.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.420+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46740cc060 con 0x7f4674143350 2023-09-30T22:53:32.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.421+0000 7f465affd700 1 -- 172.21.15.142:0/3932370363 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f4668054ec0 con 0x7f4674143350 2023-09-30T22:53:32.421 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:32.421 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":35,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:29.506315+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:53:25.907895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T22:53:26.965039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:32.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4660067330 msgr2=0x7f46600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4660067330 0x7f46600697e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46740c9540 tx=0x7f4664009040 comp rx=0 tx=0).stop 2023-09-30T22:53:32.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4674143350 msgr2=0x7f46740ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4674143350 0x7f46740ca530 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f466800e8d0 tx=0x7f4668008040 comp rx=0 tx=0).stop 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 shutdown_connections 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4660067330 0x7f46600697e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f467415dc50 0x7f46740caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46740692f0 0x7f46741564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 --2- 172.21.15.142:0/3932370363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4674143350 0x7f46740ca530 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 >> 172.21.15.142:0/3932370363 conn(0x7f46740ce8e0 msgr2=0x7f46741401e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 shutdown_connections 2023-09-30T22:53:32.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.423+0000 7f46797ff700 1 -- 172.21.15.142:0/3932370363 wait complete. 2023-09-30T22:53:32.441 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:53:32.441 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:53:32.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.632+0000 7fb35afff700 1 Processor -- start 2023-09-30T22:53:32.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.632+0000 7fb35afff700 1 -- start start 2023-09-30T22:53:32.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb35afff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3540692f0 0x7fb35415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb35afff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb35415dc50 0x7fb35406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb35afff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540cc6b0 con 0x7fb354143350 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb35afff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35415e050 con 0x7fb3540692f0 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb35afff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3540cbaa0 con 0x7fb35415dc50 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb353fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3540692f0 0x7fb35415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb353fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3540692f0 0x7fb35415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47064/0 (socket says 172.21.15.142:47064) 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.633+0000 7fb353fff700 1 -- 172.21.15.142:0/4183325893 learned_addr learned my addr 172.21.15.142:0/4183325893 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb35959c700 1 --2- 172.21.15.142:0/4183325893 >> v2:172.21.15.148:3300/0 conn(0x7fb35415dc50 0x7fb35406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb353fff700 1 -- 172.21.15.142:0/4183325893 >> v2:172.21.15.148:3300/0 conn(0x7fb35415dc50 msgr2=0x7fb35406a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb353fff700 1 --2- 172.21.15.142:0/4183325893 >> v2:172.21.15.148:3300/0 conn(0x7fb35415dc50 0x7fb35406a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb353fff700 1 -- 172.21.15.142:0/4183325893 >> v1:172.21.15.148:6789/0 conn(0x7fb354143350 legacy=0x7fb3540cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb353fff700 1 -- 172.21.15.142:0/4183325893 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3540cbd80 con 0x7fb3540692f0 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb353fff700 1 --2- 172.21.15.142:0/4183325893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3540692f0 0x7fb35415d710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb354069cf0 tx=0x7fb340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bafda589d911731 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb3537fe700 1 -- 172.21.15.142:0/4183325893 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000b820 con 0x7fb3540692f0 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb3537fe700 1 -- 172.21.15.142:0/4183325893 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000b980 con 0x7fb3540692f0 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.634+0000 7fb3537fe700 1 -- 172.21.15.142:0/4183325893 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000bd20 con 0x7fb3540692f0 2023-09-30T22:53:32.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 -- 172.21.15.142:0/4183325893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3540692f0 msgr2=0x7fb35415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 --2- 172.21.15.142:0/4183325893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3540692f0 0x7fb35415d710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb354069cf0 tx=0x7fb340009250 comp rx=0 tx=0).stop 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 -- 172.21.15.142:0/4183325893 shutdown_connections 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 --2- 172.21.15.142:0/4183325893 >> v2:172.21.15.148:3300/0 conn(0x7fb35415dc50 0x7fb35406a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 --2- 172.21.15.142:0/4183325893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3540692f0 0x7fb35415d710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 -- 172.21.15.142:0/4183325893 >> 172.21.15.142:0/4183325893 conn(0x7fb3540ce8e0 msgr2=0x7fb3540cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 -- 172.21.15.142:0/4183325893 shutdown_connections 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.635+0000 7fb35afff700 1 -- 172.21.15.142:0/4183325893 wait complete. 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.636+0000 7fb35afff700 1 Processor -- start 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.637+0000 7fb35afff700 1 -- start start 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.637+0000 7fb35afff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3540692f0 0x7fb354136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.637+0000 7fb35afff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb354143350 0x7fb35413a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.637+0000 7fb35afff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb35415dc50 0x7fb35413ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.637+0000 7fb35afff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540b3790 con 0x7fb35415dc50 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.637+0000 7fb35afff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540b3a70 con 0x7fb354143350 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.637+0000 7fb35afff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540b3d50 con 0x7fb3540692f0 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb35415dc50 0x7fb35413ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb35415dc50 0x7fb35413ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47068/0 (socket says 172.21.15.142:47068) 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 -- 172.21.15.142:0/4113357945 learned_addr learned my addr 172.21.15.142:0/4113357945 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb353fff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb354143350 0x7fb35413a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb358d9b700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3540692f0 0x7fb354136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 -- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3540692f0 msgr2=0x7fb354136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3540692f0 0x7fb354136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 -- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb354143350 msgr2=0x7fb35413a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb354143350 0x7fb35413a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 -- 172.21.15.142:0/4113357945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400094f0 con 0x7fb35415dc50 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb353fff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb354143350 0x7fb35413a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.638+0000 7fb35959c700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb35415dc50 0x7fb35413ad10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb34c007f20 tx=0x7fb34c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.639+0000 7fb350ff9700 1 -- 172.21.15.142:0/4113357945 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00eca0 con 0x7fb35415dc50 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.639+0000 7fb350ff9700 1 -- 172.21.15.142:0/4113357945 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c00ee20 con 0x7fb35415dc50 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.639+0000 7fb350ff9700 1 -- 172.21.15.142:0/4113357945 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c014670 con 0x7fb35415dc50 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.639+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3540b4030 con 0x7fb35415dc50 2023-09-30T22:53:32.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.639+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3540b2a40 con 0x7fb35415dc50 2023-09-30T22:53:32.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.640+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35406ea70 con 0x7fb35415dc50 2023-09-30T22:53:32.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.641+0000 7fb350ff9700 1 -- 172.21.15.142:0/4113357945 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb34c0149e0 con 0x7fb35415dc50 2023-09-30T22:53:32.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.641+0000 7fb350ff9700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb338067330 0x7fb3380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:32.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.641+0000 7fb350ff9700 1 -- 172.21.15.142:0/4113357945 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb34c0853a0 con 0x7fb35415dc50 2023-09-30T22:53:32.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.642+0000 7fb358d9b700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb338067330 0x7fb3380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:32.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.642+0000 7fb358d9b700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb338067330 0x7fb3380697e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb348003870 tx=0x7fb348009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:32.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.646+0000 7fb350ff9700 1 -- 172.21.15.142:0/4113357945 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb34c052200 con 0x7fb35415dc50 2023-09-30T22:53:32.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.832+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3540cc060 con 0x7fb338067330 2023-09-30T22:53:32.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.842+0000 7fb350ff9700 1 -- 172.21.15.142:0/4113357945 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301842 (secure 0 0 0) 0x7fb3540cc060 con 0x7fb338067330 2023-09-30T22:53:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:32.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.846+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb338067330 msgr2=0x7fb3380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb338067330 0x7fb3380697e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb348003870 tx=0x7fb348009040 comp rx=0 tx=0).stop 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb35415dc50 msgr2=0x7fb35413ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb35415dc50 0x7fb35413ad10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb34c007f20 tx=0x7fb34c009860 comp rx=0 tx=0).stop 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 shutdown_connections 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb338067330 0x7fb3380697e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb35415dc50 0x7fb35413ad10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3540692f0 0x7fb354136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 --2- 172.21.15.142:0/4113357945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb354143350 0x7fb35413a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 >> 172.21.15.142:0/4113357945 conn(0x7fb3540ce8e0 msgr2=0x7fb3540cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:32.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 shutdown_connections 2023-09-30T22:53:32.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:32.847+0000 7fb35afff700 1 -- 172.21.15.142:0/4113357945 wait complete. 2023-09-30T22:53:32.850 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:53:32.865 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-09-30T22:53:32.115178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592584,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2395,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560104,"statfs":{"total":1600000000,"available":1597547145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.613468"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522036+0000","last_change":"2023-09-30T22:53:28.521844+0000","last_active":"2023-09-30T22:53:28.522036+0000","last_peered":"2023-09-30T22:53:28.522036+0000","last_clean":"2023-09-30T22:53:28.522036+0000","last_became_active":"2023-09-30T22:53:28.521523+0000","last_became_peered":"2023-09-30T22:53:28.521523+0000","last_unstale":"2023-09-30T22:53:28.522036+0000","last_undegraded":"2023-09-30T22:53:28.522036+0000","last_fullsized":"2023-09-30T22:53:28.522036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:59.351514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513441+0000","last_change":"2023-09-30T22:53:28.513362+0000","last_active":"2023-09-30T22:53:28.513441+0000","last_peered":"2023-09-30T22:53:28.513441+0000","last_clean":"2023-09-30T22:53:28.513441+0000","last_became_active":"2023-09-30T22:53:28.513102+0000","last_became_peered":"2023-09-30T22:53:28.513102+0000","last_unstale":"2023-09-30T22:53:28.513441+0000","last_undegraded":"2023-09-30T22:53:28.513441+0000","last_fullsized":"2023-09-30T22:53:28.513441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:50.326775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523601+0000","last_change":"2023-09-30T22:53:28.523032+0000","last_active":"2023-09-30T22:53:28.523601+0000","last_peered":"2023-09-30T22:53:28.523601+0000","last_clean":"2023-09-30T22:53:28.523601+0000","last_became_active":"2023-09-30T22:53:28.522810+0000","last_became_peered":"2023-09-30T22:53:28.522810+0000","last_unstale":"2023-09-30T22:53:28.523601+0000","last_undegraded":"2023-09-30T22:53:28.523601+0000","last_fullsized":"2023-09-30T22:53:28.523601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:53.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524515+0000","last_change":"2023-09-30T22:53:28.524309+0000","last_active":"2023-09-30T22:53:28.524515+0000","last_peered":"2023-09-30T22:53:28.524515+0000","last_clean":"2023-09-30T22:53:28.524515+0000","last_became_active":"2023-09-30T22:53:28.523815+0000","last_became_peered":"2023-09-30T22:53:28.523815+0000","last_unstale":"2023-09-30T22:53:28.524515+0000","last_undegraded":"2023-09-30T22:53:28.524515+0000","last_fullsized":"2023-09-30T22:53:28.524515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:56.402195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523891+0000","last_change":"2023-09-30T22:53:28.523789+0000","last_active":"2023-09-30T22:53:28.523891+0000","last_peered":"2023-09-30T22:53:28.523891+0000","last_clean":"2023-09-30T22:53:28.523891+0000","last_became_active":"2023-09-30T22:53:28.523542+0000","last_became_peered":"2023-09-30T22:53:28.523542+0000","last_unstale":"2023-09-30T22:53:28.523891+0000","last_undegraded":"2023-09-30T22:53:28.523891+0000","last_fullsized":"2023-09-30T22:53:28.523891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515993+0000","last_change":"2023-09-30T22:53:28.515784+0000","last_active":"2023-09-30T22:53:28.515993+0000","last_peered":"2023-09-30T22:53:28.515993+0000","last_clean":"2023-09-30T22:53:28.515993+0000","last_became_active":"2023-09-30T22:53:28.515565+0000","last_became_peered":"2023-09-30T22:53:28.515565+0000","last_unstale":"2023-09-30T22:53:28.515993+0000","last_undegraded":"2023-09-30T22:53:28.515993+0000","last_fullsized":"2023-09-30T22:53:28.515993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:53.264810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525125+0000","last_change":"2023-09-30T22:53:28.524944+0000","last_active":"2023-09-30T22:53:28.525125+0000","last_peered":"2023-09-30T22:53:28.525125+0000","last_clean":"2023-09-30T22:53:28.525125+0000","last_became_active":"2023-09-30T22:53:28.523435+0000","last_became_peered":"2023-09-30T22:53:28.523435+0000","last_unstale":"2023-09-30T22:53:28.525125+0000","last_undegraded":"2023-09-30T22:53:28.525125+0000","last_fullsized":"2023-09-30T22:53:28.525125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:18.496971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527102+0000","last_change":"2023-09-30T22:53:28.526469+0000","last_active":"2023-09-30T22:53:28.527102+0000","last_peered":"2023-09-30T22:53:28.527102+0000","last_clean":"2023-09-30T22:53:28.527102+0000","last_became_active":"2023-09-30T22:53:28.525921+0000","last_became_peered":"2023-09-30T22:53:28.525921+0000","last_unstale":"2023-09-30T22:53:28.527102+0000","last_undegraded":"2023-09-30T22:53:28.527102+0000","last_fullsized":"2023-09-30T22:53:28.527102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:57.146828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511245+0000","last_change":"2023-09-30T22:53:28.511148+0000","last_active":"2023-09-30T22:53:28.511245+0000","last_peered":"2023-09-30T22:53:28.511245+0000","last_clean":"2023-09-30T22:53:28.511245+0000","last_became_active":"2023-09-30T22:53:28.510877+0000","last_became_peered":"2023-09-30T22:53:28.510877+0000","last_unstale":"2023-09-30T22:53:28.511245+0000","last_undegraded":"2023-09-30T22:53:28.511245+0000","last_fullsized":"2023-09-30T22:53:28.511245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524522+0000","last_change":"2023-09-30T22:53:28.523149+0000","last_active":"2023-09-30T22:53:28.524522+0000","last_peered":"2023-09-30T22:53:28.524522+0000","last_clean":"2023-09-30T22:53:28.524522+0000","last_became_active":"2023-09-30T22:53:28.522693+0000","last_became_peered":"2023-09-30T22:53:28.522693+0000","last_unstale":"2023-09-30T22:53:28.524522+0000","last_undegraded":"2023-09-30T22:53:28.524522+0000","last_fullsized":"2023-09-30T22:53:28.524522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:24.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526829+0000","last_change":"2023-09-30T22:53:28.526578+0000","last_active":"2023-09-30T22:53:28.526829+0000","last_peered":"2023-09-30T22:53:28.526829+0000","last_clean":"2023-09-30T22:53:28.526829+0000","last_became_active":"2023-09-30T22:53:28.526345+0000","last_became_peered":"2023-09-30T22:53:28.526345+0000","last_unstale":"2023-09-30T22:53:28.526829+0000","last_undegraded":"2023-09-30T22:53:28.526829+0000","last_fullsized":"2023-09-30T22:53:28.526829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513911+0000","last_change":"2023-09-30T22:53:28.513759+0000","last_active":"2023-09-30T22:53:28.513911+0000","last_peered":"2023-09-30T22:53:28.513911+0000","last_clean":"2023-09-30T22:53:28.513911+0000","last_became_active":"2023-09-30T22:53:28.513397+0000","last_became_peered":"2023-09-30T22:53:28.513397+0000","last_unstale":"2023-09-30T22:53:28.513911+0000","last_undegraded":"2023-09-30T22:53:28.513911+0000","last_fullsized":"2023-09-30T22:53:28.513911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517049+0000","last_change":"2023-09-30T22:53:28.516976+0000","last_active":"2023-09-30T22:53:28.517049+0000","last_peered":"2023-09-30T22:53:28.517049+0000","last_clean":"2023-09-30T22:53:28.517049+0000","last_became_active":"2023-09-30T22:53:28.516752+0000","last_became_peered":"2023-09-30T22:53:28.516752+0000","last_unstale":"2023-09-30T22:53:28.517049+0000","last_undegraded":"2023-09-30T22:53:28.517049+0000","last_fullsized":"2023-09-30T22:53:28.517049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:14.222289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520873+0000","last_change":"2023-09-30T22:53:28.520771+0000","last_active":"2023-09-30T22:53:28.520873+0000","last_peered":"2023-09-30T22:53:28.520873+0000","last_clean":"2023-09-30T22:53:28.520873+0000","last_became_active":"2023-09-30T22:53:28.520479+0000","last_became_peered":"2023-09-30T22:53:28.520479+0000","last_unstale":"2023-09-30T22:53:28.520873+0000","last_undegraded":"2023-09-30T22:53:28.520873+0000","last_fullsized":"2023-09-30T22:53:28.520873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524568+0000","last_change":"2023-09-30T22:53:28.524203+0000","last_active":"2023-09-30T22:53:28.524568+0000","last_peered":"2023-09-30T22:53:28.524568+0000","last_clean":"2023-09-30T22:53:28.524568+0000","last_became_active":"2023-09-30T22:53:28.523569+0000","last_became_peered":"2023-09-30T22:53:28.523569+0000","last_unstale":"2023-09-30T22:53:28.524568+0000","last_undegraded":"2023-09-30T22:53:28.524568+0000","last_fullsized":"2023-09-30T22:53:28.524568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:48:48.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523512+0000","last_change":"2023-09-30T22:53:28.523441+0000","last_active":"2023-09-30T22:53:28.523512+0000","last_peered":"2023-09-30T22:53:28.523512+0000","last_clean":"2023-09-30T22:53:28.523512+0000","last_became_active":"2023-09-30T22:53:28.523060+0000","last_became_peered":"2023-09-30T22:53:28.523060+0000","last_unstale":"2023-09-30T22:53:28.523512+0000","last_undegraded":"2023-09-30T22:53:28.523512+0000","last_fullsized":"2023-09-30T22:53:28.523512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521320+0000","last_change":"2023-09-30T22:53:28.521259+0000","last_active":"2023-09-30T22:53:28.521320+0000","last_peered":"2023-09-30T22:53:28.521320+0000","last_clean":"2023-09-30T22:53:28.521320+0000","last_became_active":"2023-09-30T22:53:28.520791+0000","last_became_peered":"2023-09-30T22:53:28.520791+0000","last_unstale":"2023-09-30T22:53:28.521320+0000","last_undegraded":"2023-09-30T22:53:28.521320+0000","last_fullsized":"2023-09-30T22:53:28.521320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523920+0000","last_change":"2023-09-30T22:53:28.523845+0000","last_active":"2023-09-30T22:53:28.523920+0000","last_peered":"2023-09-30T22:53:28.523920+0000","last_clean":"2023-09-30T22:53:28.523920+0000","last_became_active":"2023-09-30T22:53:28.523587+0000","last_became_peered":"2023-09-30T22:53:28.523587+0000","last_unstale":"2023-09-30T22:53:28.523920+0000","last_undegraded":"2023-09-30T22:53:28.523920+0000","last_fullsized":"2023-09-30T22:53:28.523920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521215+0000","last_change":"2023-09-30T22:53:28.521142+0000","last_active":"2023-09-30T22:53:28.521215+0000","last_peered":"2023-09-30T22:53:28.521215+0000","last_clean":"2023-09-30T22:53:28.521215+0000","last_became_active":"2023-09-30T22:53:28.520866+0000","last_became_peered":"2023-09-30T22:53:28.520866+0000","last_unstale":"2023-09-30T22:53:28.521215+0000","last_undegraded":"2023-09-30T22:53:28.521215+0000","last_fullsized":"2023-09-30T22:53:28.521215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528033+0000","last_change":"2023-09-30T22:53:28.527707+0000","last_active":"2023-09-30T22:53:28.528033+0000","last_peered":"2023-09-30T22:53:28.528033+0000","last_clean":"2023-09-30T22:53:28.528033+0000","last_became_active":"2023-09-30T22:53:28.527483+0000","last_became_peered":"2023-09-30T22:53:28.527483+0000","last_unstale":"2023-09-30T22:53:28.528033+0000","last_undegraded":"2023-09-30T22:53:28.528033+0000","last_fullsized":"2023-09-30T22:53:28.528033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:06.946949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519144+0000","last_change":"2023-09-30T22:53:28.519070+0000","last_active":"2023-09-30T22:53:28.519144+0000","last_peered":"2023-09-30T22:53:28.519144+0000","last_clean":"2023-09-30T22:53:28.519144+0000","last_became_active":"2023-09-30T22:53:28.518852+0000","last_became_peered":"2023-09-30T22:53:28.518852+0000","last_unstale":"2023-09-30T22:53:28.519144+0000","last_undegraded":"2023-09-30T22:53:28.519144+0000","last_fullsized":"2023-09-30T22:53:28.519144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527117+0000","last_change":"2023-09-30T22:53:28.526708+0000","last_active":"2023-09-30T22:53:28.527117+0000","last_peered":"2023-09-30T22:53:28.527117+0000","last_clean":"2023-09-30T22:53:28.527117+0000","last_became_active":"2023-09-30T22:53:28.526478+0000","last_became_peered":"2023-09-30T22:53:28.526478+0000","last_unstale":"2023-09-30T22:53:28.527117+0000","last_undegraded":"2023-09-30T22:53:28.527117+0000","last_fullsized":"2023-09-30T22:53:28.527117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:57:09.485295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524561+0000","last_change":"2023-09-30T22:53:28.524489+0000","last_active":"2023-09-30T22:53:28.524561+0000","last_peered":"2023-09-30T22:53:28.524561+0000","last_clean":"2023-09-30T22:53:28.524561+0000","last_became_active":"2023-09-30T22:53:28.524252+0000","last_became_peered":"2023-09-30T22:53:28.524252+0000","last_unstale":"2023-09-30T22:53:28.524561+0000","last_undegraded":"2023-09-30T22:53:28.524561+0000","last_fullsized":"2023-09-30T22:53:28.524561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524505+0000","last_change":"2023-09-30T22:53:28.522426+0000","last_active":"2023-09-30T22:53:28.524505+0000","last_peered":"2023-09-30T22:53:28.524505+0000","last_clean":"2023-09-30T22:53:28.524505+0000","last_became_active":"2023-09-30T22:53:28.521202+0000","last_became_peered":"2023-09-30T22:53:28.521202+0000","last_unstale":"2023-09-30T22:53:28.524505+0000","last_undegraded":"2023-09-30T22:53:28.524505+0000","last_fullsized":"2023-09-30T22:53:28.524505+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:23.130881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524590+0000","last_change":"2023-09-30T22:53:28.524378+0000","last_active":"2023-09-30T22:53:28.524590+0000","last_peered":"2023-09-30T22:53:28.524590+0000","last_clean":"2023-09-30T22:53:28.524590+0000","last_became_active":"2023-09-30T22:53:28.523927+0000","last_became_peered":"2023-09-30T22:53:28.523927+0000","last_unstale":"2023-09-30T22:53:28.524590+0000","last_undegraded":"2023-09-30T22:53:28.524590+0000","last_fullsized":"2023-09-30T22:53:28.524590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:50.593476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528068+0000","last_change":"2023-09-30T22:53:28.527965+0000","last_active":"2023-09-30T22:53:28.528068+0000","last_peered":"2023-09-30T22:53:28.528068+0000","last_clean":"2023-09-30T22:53:28.528068+0000","last_became_active":"2023-09-30T22:53:28.527612+0000","last_became_peered":"2023-09-30T22:53:28.527612+0000","last_unstale":"2023-09-30T22:53:28.528068+0000","last_undegraded":"2023-09-30T22:53:28.528068+0000","last_fullsized":"2023-09-30T22:53:28.528068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:39.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538999+0000","last_change":"2023-09-30T22:53:27.516465+0000","last_active":"2023-09-30T22:53:28.538999+0000","last_peered":"2023-09-30T22:53:28.538999+0000","last_clean":"2023-09-30T22:53:28.538999+0000","last_became_active":"2023-09-30T22:53:27.516253+0000","last_became_peered":"2023-09-30T22:53:27.516253+0000","last_unstale":"2023-09-30T22:53:28.538999+0000","last_undegraded":"2023-09-30T22:53:28.538999+0000","last_fullsized":"2023-09-30T22:53:28.538999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522280+0000","last_change":"2023-09-30T22:53:28.522137+0000","last_active":"2023-09-30T22:53:28.522280+0000","last_peered":"2023-09-30T22:53:28.522280+0000","last_clean":"2023-09-30T22:53:28.522280+0000","last_became_active":"2023-09-30T22:53:28.521672+0000","last_became_peered":"2023-09-30T22:53:28.521672+0000","last_unstale":"2023-09-30T22:53:28.522280+0000","last_undegraded":"2023-09-30T22:53:28.522280+0000","last_fullsized":"2023-09-30T22:53:28.522280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:13.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534160+0000","last_change":"2023-09-30T22:53:27.513083+0000","last_active":"2023-09-30T22:53:28.534160+0000","last_peered":"2023-09-30T22:53:28.534160+0000","last_clean":"2023-09-30T22:53:28.534160+0000","last_became_active":"2023-09-30T22:53:27.512830+0000","last_became_peered":"2023-09-30T22:53:27.512830+0000","last_unstale":"2023-09-30T22:53:28.534160+0000","last_undegraded":"2023-09-30T22:53:28.534160+0000","last_fullsized":"2023-09-30T22:53:28.534160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536132+0000","last_change":"2023-09-30T22:53:27.521745+0000","last_active":"2023-09-30T22:53:28.536132+0000","last_peered":"2023-09-30T22:53:28.536132+0000","last_clean":"2023-09-30T22:53:28.536132+0000","last_became_active":"2023-09-30T22:53:27.521383+0000","last_became_peered":"2023-09-30T22:53:27.521383+0000","last_unstale":"2023-09-30T22:53:28.536132+0000","last_undegraded":"2023-09-30T22:53:28.536132+0000","last_fullsized":"2023-09-30T22:53:28.536132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519546+0000","last_change":"2023-09-30T22:53:28.519421+0000","last_active":"2023-09-30T22:53:28.519546+0000","last_peered":"2023-09-30T22:53:28.519546+0000","last_clean":"2023-09-30T22:53:28.519546+0000","last_became_active":"2023-09-30T22:53:28.519181+0000","last_became_peered":"2023-09-30T22:53:28.519181+0000","last_unstale":"2023-09-30T22:53:28.519546+0000","last_undegraded":"2023-09-30T22:53:28.519546+0000","last_fullsized":"2023-09-30T22:53:28.519546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:32.735104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535058+0000","last_change":"2023-09-30T22:53:27.517467+0000","last_active":"2023-09-30T22:53:28.535058+0000","last_peered":"2023-09-30T22:53:28.535058+0000","last_clean":"2023-09-30T22:53:28.535058+0000","last_became_active":"2023-09-30T22:53:27.517231+0000","last_became_peered":"2023-09-30T22:53:27.517231+0000","last_unstale":"2023-09-30T22:53:28.535058+0000","last_undegraded":"2023-09-30T22:53:28.535058+0000","last_fullsized":"2023-09-30T22:53:28.535058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521506+0000","last_change":"2023-09-30T22:53:28.520868+0000","last_active":"2023-09-30T22:53:28.521506+0000","last_peered":"2023-09-30T22:53:28.521506+0000","last_clean":"2023-09-30T22:53:28.521506+0000","last_became_active":"2023-09-30T22:53:28.520629+0000","last_became_peered":"2023-09-30T22:53:28.520629+0000","last_unstale":"2023-09-30T22:53:28.521506+0000","last_undegraded":"2023-09-30T22:53:28.521506+0000","last_fullsized":"2023-09-30T22:53:28.521506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:18:44.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535219+0000","last_change":"2023-09-30T22:53:27.517083+0000","last_active":"2023-09-30T22:53:28.535219+0000","last_peered":"2023-09-30T22:53:28.535219+0000","last_clean":"2023-09-30T22:53:28.535219+0000","last_became_active":"2023-09-30T22:53:27.516834+0000","last_became_peered":"2023-09-30T22:53:27.516834+0000","last_unstale":"2023-09-30T22:53:28.535219+0000","last_undegraded":"2023-09-30T22:53:28.535219+0000","last_fullsized":"2023-09-30T22:53:28.535219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519698+0000","last_change":"2023-09-30T22:53:28.519090+0000","last_active":"2023-09-30T22:53:28.519698+0000","last_peered":"2023-09-30T22:53:28.519698+0000","last_clean":"2023-09-30T22:53:28.519698+0000","last_became_active":"2023-09-30T22:53:28.518864+0000","last_became_peered":"2023-09-30T22:53:28.518864+0000","last_unstale":"2023-09-30T22:53:28.519698+0000","last_undegraded":"2023-09-30T22:53:28.519698+0000","last_fullsized":"2023-09-30T22:53:28.519698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:38:50.812517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534282+0000","last_change":"2023-09-30T22:53:27.521214+0000","last_active":"2023-09-30T22:53:28.534282+0000","last_peered":"2023-09-30T22:53:28.534282+0000","last_clean":"2023-09-30T22:53:28.534282+0000","last_became_active":"2023-09-30T22:53:27.521000+0000","last_became_peered":"2023-09-30T22:53:27.521000+0000","last_unstale":"2023-09-30T22:53:28.534282+0000","last_undegraded":"2023-09-30T22:53:28.534282+0000","last_fullsized":"2023-09-30T22:53:28.534282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519955+0000","last_change":"2023-09-30T22:53:27.520810+0000","last_active":"2023-09-30T22:53:28.519955+0000","last_peered":"2023-09-30T22:53:28.519955+0000","last_clean":"2023-09-30T22:53:28.519955+0000","last_became_active":"2023-09-30T22:53:27.520051+0000","last_became_peered":"2023-09-30T22:53:27.520051+0000","last_unstale":"2023-09-30T22:53:28.519955+0000","last_undegraded":"2023-09-30T22:53:28.519955+0000","last_fullsized":"2023-09-30T22:53:28.519955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516891+0000","last_change":"2023-09-30T22:53:28.516799+0000","last_active":"2023-09-30T22:53:28.516891+0000","last_peered":"2023-09-30T22:53:28.516891+0000","last_clean":"2023-09-30T22:53:28.516891+0000","last_became_active":"2023-09-30T22:53:28.516580+0000","last_became_peered":"2023-09-30T22:53:28.516580+0000","last_unstale":"2023-09-30T22:53:28.516891+0000","last_undegraded":"2023-09-30T22:53:28.516891+0000","last_fullsized":"2023-09-30T22:53:28.516891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516147+0000","last_change":"2023-09-30T22:53:27.519471+0000","last_active":"2023-09-30T22:53:28.516147+0000","last_peered":"2023-09-30T22:53:28.516147+0000","last_clean":"2023-09-30T22:53:28.516147+0000","last_became_active":"2023-09-30T22:53:27.518947+0000","last_became_peered":"2023-09-30T22:53:27.518947+0000","last_unstale":"2023-09-30T22:53:28.516147+0000","last_undegraded":"2023-09-30T22:53:28.516147+0000","last_fullsized":"2023-09-30T22:53:28.516147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:14.863213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524538+0000","last_change":"2023-09-30T22:53:28.524453+0000","last_active":"2023-09-30T22:53:28.524538+0000","last_peered":"2023-09-30T22:53:28.524538+0000","last_clean":"2023-09-30T22:53:28.524538+0000","last_became_active":"2023-09-30T22:53:28.524098+0000","last_became_peered":"2023-09-30T22:53:28.524098+0000","last_unstale":"2023-09-30T22:53:28.524538+0000","last_undegraded":"2023-09-30T22:53:28.524538+0000","last_fullsized":"2023-09-30T22:53:28.524538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:25.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517878+0000","last_change":"2023-09-30T22:53:27.517464+0000","last_active":"2023-09-30T22:53:28.517878+0000","last_peered":"2023-09-30T22:53:28.517878+0000","last_clean":"2023-09-30T22:53:28.517878+0000","last_became_active":"2023-09-30T22:53:27.516983+0000","last_became_peered":"2023-09-30T22:53:27.516983+0000","last_unstale":"2023-09-30T22:53:28.517878+0000","last_undegraded":"2023-09-30T22:53:28.517878+0000","last_fullsized":"2023-09-30T22:53:28.517878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523916+0000","last_change":"2023-09-30T22:53:28.523841+0000","last_active":"2023-09-30T22:53:28.523916+0000","last_peered":"2023-09-30T22:53:28.523916+0000","last_clean":"2023-09-30T22:53:28.523916+0000","last_became_active":"2023-09-30T22:53:28.523574+0000","last_became_peered":"2023-09-30T22:53:28.523574+0000","last_unstale":"2023-09-30T22:53:28.523916+0000","last_undegraded":"2023-09-30T22:53:28.523916+0000","last_fullsized":"2023-09-30T22:53:28.523916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.503298+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528052+0000","last_change":"2023-09-30T22:53:28.527814+0000","last_active":"2023-09-30T22:53:28.528052+0000","last_peered":"2023-09-30T22:53:28.528052+0000","last_clean":"2023-09-30T22:53:28.528052+0000","last_became_active":"2023-09-30T22:53:28.527339+0000","last_became_peered":"2023-09-30T22:53:28.527339+0000","last_unstale":"2023-09-30T22:53:28.528052+0000","last_undegraded":"2023-09-30T22:53:28.528052+0000","last_fullsized":"2023-09-30T22:53:28.528052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:10.461181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502916+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524484+0000","last_change":"2023-09-30T22:53:28.521854+0000","last_active":"2023-09-30T22:53:28.524484+0000","last_peered":"2023-09-30T22:53:28.524484+0000","last_clean":"2023-09-30T22:53:28.524484+0000","last_became_active":"2023-09-30T22:53:28.521590+0000","last_became_peered":"2023-09-30T22:53:28.521590+0000","last_unstale":"2023-09-30T22:53:28.524484+0000","last_undegraded":"2023-09-30T22:53:28.524484+0000","last_fullsized":"2023-09-30T22:53:28.524484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:07.541785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538839+0000","last_change":"2023-09-30T22:53:27.520637+0000","last_active":"2023-09-30T22:53:28.538839+0000","last_peered":"2023-09-30T22:53:28.538839+0000","last_clean":"2023-09-30T22:53:28.538839+0000","last_became_active":"2023-09-30T22:53:27.519273+0000","last_became_peered":"2023-09-30T22:53:27.519273+0000","last_unstale":"2023-09-30T22:53:28.538839+0000","last_undegraded":"2023-09-30T22:53:28.538839+0000","last_fullsized":"2023-09-30T22:53:28.538839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527146+0000","last_change":"2023-09-30T22:53:28.527020+0000","last_active":"2023-09-30T22:53:28.527146+0000","last_peered":"2023-09-30T22:53:28.527146+0000","last_clean":"2023-09-30T22:53:28.527146+0000","last_became_active":"2023-09-30T22:53:28.526664+0000","last_became_peered":"2023-09-30T22:53:28.526664+0000","last_unstale":"2023-09-30T22:53:28.527146+0000","last_undegraded":"2023-09-30T22:53:28.527146+0000","last_fullsized":"2023-09-30T22:53:28.527146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:13.114495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536461+0000","last_change":"2023-09-30T22:53:27.521604+0000","last_active":"2023-09-30T22:53:28.536461+0000","last_peered":"2023-09-30T22:53:28.536461+0000","last_clean":"2023-09-30T22:53:28.536461+0000","last_became_active":"2023-09-30T22:53:27.521088+0000","last_became_peered":"2023-09-30T22:53:27.521088+0000","last_unstale":"2023-09-30T22:53:28.536461+0000","last_undegraded":"2023-09-30T22:53:28.536461+0000","last_fullsized":"2023-09-30T22:53:28.536461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519512+0000","last_change":"2023-09-30T22:53:28.518412+0000","last_active":"2023-09-30T22:53:28.519512+0000","last_peered":"2023-09-30T22:53:28.519512+0000","last_clean":"2023-09-30T22:53:28.519512+0000","last_became_active":"2023-09-30T22:53:28.517871+0000","last_became_peered":"2023-09-30T22:53:28.517871+0000","last_unstale":"2023-09-30T22:53:28.519512+0000","last_undegraded":"2023-09-30T22:53:28.519512+0000","last_fullsized":"2023-09-30T22:53:28.519512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511856+0000","last_change":"2023-09-30T22:53:27.517581+0000","last_active":"2023-09-30T22:53:28.511856+0000","last_peered":"2023-09-30T22:53:28.511856+0000","last_clean":"2023-09-30T22:53:28.511856+0000","last_became_active":"2023-09-30T22:53:27.517341+0000","last_became_peered":"2023-09-30T22:53:27.517341+0000","last_unstale":"2023-09-30T22:53:28.511856+0000","last_undegraded":"2023-09-30T22:53:28.511856+0000","last_fullsized":"2023-09-30T22:53:28.511856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526246+0000","last_change":"2023-09-30T22:53:28.525685+0000","last_active":"2023-09-30T22:53:28.526246+0000","last_peered":"2023-09-30T22:53:28.526246+0000","last_clean":"2023-09-30T22:53:28.526246+0000","last_became_active":"2023-09-30T22:53:28.525403+0000","last_became_peered":"2023-09-30T22:53:28.525403+0000","last_unstale":"2023-09-30T22:53:28.526246+0000","last_undegraded":"2023-09-30T22:53:28.526246+0000","last_fullsized":"2023-09-30T22:53:28.526246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502937+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513109+0000","last_change":"2023-09-30T22:53:28.513034+0000","last_active":"2023-09-30T22:53:28.513109+0000","last_peered":"2023-09-30T22:53:28.513109+0000","last_clean":"2023-09-30T22:53:28.513109+0000","last_became_active":"2023-09-30T22:53:28.512753+0000","last_became_peered":"2023-09-30T22:53:28.512753+0000","last_unstale":"2023-09-30T22:53:28.513109+0000","last_undegraded":"2023-09-30T22:53:28.513109+0000","last_fullsized":"2023-09-30T22:53:28.513109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538127+0000","last_change":"2023-09-30T22:53:27.516048+0000","last_active":"2023-09-30T22:53:28.538127+0000","last_peered":"2023-09-30T22:53:28.538127+0000","last_clean":"2023-09-30T22:53:28.538127+0000","last_became_active":"2023-09-30T22:53:27.515566+0000","last_became_peered":"2023-09-30T22:53:27.515566+0000","last_unstale":"2023-09-30T22:53:28.538127+0000","last_undegraded":"2023-09-30T22:53:28.538127+0000","last_fullsized":"2023-09-30T22:53:28.538127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:32.867025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519529+0000","last_change":"2023-09-30T22:53:28.518549+0000","last_active":"2023-09-30T22:53:28.519529+0000","last_peered":"2023-09-30T22:53:28.519529+0000","last_clean":"2023-09-30T22:53:28.519529+0000","last_became_active":"2023-09-30T22:53:28.518178+0000","last_became_peered":"2023-09-30T22:53:28.518178+0000","last_unstale":"2023-09-30T22:53:28.519529+0000","last_undegraded":"2023-09-30T22:53:28.519529+0000","last_fullsized":"2023-09-30T22:53:28.519529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.533325+0000","last_change":"2023-09-30T22:53:27.519544+0000","last_active":"2023-09-30T22:53:28.533325+0000","last_peered":"2023-09-30T22:53:28.533325+0000","last_clean":"2023-09-30T22:53:28.533325+0000","last_became_active":"2023-09-30T22:53:27.519269+0000","last_became_peered":"2023-09-30T22:53:27.519269+0000","last_unstale":"2023-09-30T22:53:28.533325+0000","last_undegraded":"2023-09-30T22:53:28.533325+0000","last_fullsized":"2023-09-30T22:53:28.533325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:22.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524412+0000","last_change":"2023-09-30T22:53:28.519623+0000","last_active":"2023-09-30T22:53:28.524412+0000","last_peered":"2023-09-30T22:53:28.524412+0000","last_clean":"2023-09-30T22:53:28.524412+0000","last_became_active":"2023-09-30T22:53:28.519379+0000","last_became_peered":"2023-09-30T22:53:28.519379+0000","last_unstale":"2023-09-30T22:53:28.524412+0000","last_undegraded":"2023-09-30T22:53:28.524412+0000","last_fullsized":"2023-09-30T22:53:28.524412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:43:42.198369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502704+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524371+0000","last_change":"2023-09-30T22:53:28.517717+0000","last_active":"2023-09-30T22:53:28.524371+0000","last_peered":"2023-09-30T22:53:28.524371+0000","last_clean":"2023-09-30T22:53:28.524371+0000","last_became_active":"2023-09-30T22:53:28.517459+0000","last_became_peered":"2023-09-30T22:53:28.517459+0000","last_unstale":"2023-09-30T22:53:28.524371+0000","last_undegraded":"2023-09-30T22:53:28.524371+0000","last_fullsized":"2023-09-30T22:53:28.524371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:04.012099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534031+0000","last_change":"2023-09-30T22:53:27.519451+0000","last_active":"2023-09-30T22:53:28.534031+0000","last_peered":"2023-09-30T22:53:28.534031+0000","last_clean":"2023-09-30T22:53:28.534031+0000","last_became_active":"2023-09-30T22:53:27.519207+0000","last_became_peered":"2023-09-30T22:53:27.519207+0000","last_unstale":"2023-09-30T22:53:28.534031+0000","last_undegraded":"2023-09-30T22:53:28.534031+0000","last_fullsized":"2023-09-30T22:53:28.534031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:54.470913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523493+0000","last_change":"2023-09-30T22:53:28.523288+0000","last_active":"2023-09-30T22:53:28.523493+0000","last_peered":"2023-09-30T22:53:28.523493+0000","last_clean":"2023-09-30T22:53:28.523493+0000","last_became_active":"2023-09-30T22:53:28.522752+0000","last_became_peered":"2023-09-30T22:53:28.522752+0000","last_unstale":"2023-09-30T22:53:28.523493+0000","last_undegraded":"2023-09-30T22:53:28.523493+0000","last_fullsized":"2023-09-30T22:53:28.523493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514427+0000","last_change":"2023-09-30T22:53:27.513959+0000","last_active":"2023-09-30T22:53:28.514427+0000","last_peered":"2023-09-30T22:53:28.514427+0000","last_clean":"2023-09-30T22:53:28.514427+0000","last_became_active":"2023-09-30T22:53:27.513732+0000","last_became_peered":"2023-09-30T22:53:27.513732+0000","last_unstale":"2023-09-30T22:53:28.514427+0000","last_undegraded":"2023-09-30T22:53:28.514427+0000","last_fullsized":"2023-09-30T22:53:28.514427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536715+0000","last_change":"2023-09-30T22:53:27.516148+0000","last_active":"2023-09-30T22:53:28.536715+0000","last_peered":"2023-09-30T22:53:28.536715+0000","last_clean":"2023-09-30T22:53:28.536715+0000","last_became_active":"2023-09-30T22:53:27.514962+0000","last_became_peered":"2023-09-30T22:53:27.514962+0000","last_unstale":"2023-09-30T22:53:28.536715+0000","last_undegraded":"2023-09-30T22:53:28.536715+0000","last_fullsized":"2023-09-30T22:53:28.536715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:55.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525445+0000","last_change":"2023-09-30T22:53:28.525377+0000","last_active":"2023-09-30T22:53:28.525445+0000","last_peered":"2023-09-30T22:53:28.525445+0000","last_clean":"2023-09-30T22:53:28.525445+0000","last_became_active":"2023-09-30T22:53:28.525124+0000","last_became_peered":"2023-09-30T22:53:28.525124+0000","last_unstale":"2023-09-30T22:53:28.525445+0000","last_undegraded":"2023-09-30T22:53:28.525445+0000","last_fullsized":"2023-09-30T22:53:28.525445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:51:22.092802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511256+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.511256+0000","last_peered":"2023-09-30T22:53:28.511256+0000","last_clean":"2023-09-30T22:53:28.511256+0000","last_became_active":"2023-09-30T22:53:27.516236+0000","last_became_peered":"2023-09-30T22:53:27.516236+0000","last_unstale":"2023-09-30T22:53:28.511256+0000","last_undegraded":"2023-09-30T22:53:28.511256+0000","last_fullsized":"2023-09-30T22:53:28.511256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526264+0000","last_change":"2023-09-30T22:53:28.526005+0000","last_active":"2023-09-30T22:53:28.526264+0000","last_peered":"2023-09-30T22:53:28.526264+0000","last_clean":"2023-09-30T22:53:28.526264+0000","last_became_active":"2023-09-30T22:53:28.525429+0000","last_became_peered":"2023-09-30T22:53:28.525429+0000","last_unstale":"2023-09-30T22:53:28.526264+0000","last_undegraded":"2023-09-30T22:53:28.526264+0000","last_fullsized":"2023-09-30T22:53:28.526264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515992+0000","last_change":"2023-09-30T22:53:27.519633+0000","last_active":"2023-09-30T22:53:28.515992+0000","last_peered":"2023-09-30T22:53:28.515992+0000","last_clean":"2023-09-30T22:53:28.515992+0000","last_became_active":"2023-09-30T22:53:27.519232+0000","last_became_peered":"2023-09-30T22:53:27.519232+0000","last_unstale":"2023-09-30T22:53:28.515992+0000","last_undegraded":"2023-09-30T22:53:28.515992+0000","last_fullsized":"2023-09-30T22:53:28.515992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:51.349781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527132+0000","last_change":"2023-09-30T22:53:28.526862+0000","last_active":"2023-09-30T22:53:28.527132+0000","last_peered":"2023-09-30T22:53:28.527132+0000","last_clean":"2023-09-30T22:53:28.527132+0000","last_became_active":"2023-09-30T22:53:28.526232+0000","last_became_peered":"2023-09-30T22:53:28.526232+0000","last_unstale":"2023-09-30T22:53:28.527132+0000","last_undegraded":"2023-09-30T22:53:28.527132+0000","last_fullsized":"2023-09-30T22:53:28.527132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:17.258231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.512067+0000","last_change":"2023-09-30T22:53:27.520705+0000","last_active":"2023-09-30T22:53:28.512067+0000","last_peered":"2023-09-30T22:53:28.512067+0000","last_clean":"2023-09-30T22:53:28.512067+0000","last_became_active":"2023-09-30T22:53:27.520103+0000","last_became_peered":"2023-09-30T22:53:27.520103+0000","last_unstale":"2023-09-30T22:53:28.512067+0000","last_undegraded":"2023-09-30T22:53:28.512067+0000","last_fullsized":"2023-09-30T22:53:28.512067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:24.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521264+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521264+0000","last_peered":"2023-09-30T22:53:28.521264+0000","last_clean":"2023-09-30T22:53:28.521264+0000","last_became_active":"2023-09-30T22:53:28.520956+0000","last_became_peered":"2023-09-30T22:53:28.520956+0000","last_unstale":"2023-09-30T22:53:28.521264+0000","last_undegraded":"2023-09-30T22:53:28.521264+0000","last_fullsized":"2023-09-30T22:53:28.521264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518003+0000","last_change":"2023-09-30T22:53:27.516312+0000","last_active":"2023-09-30T22:53:28.518003+0000","last_peered":"2023-09-30T22:53:28.518003+0000","last_clean":"2023-09-30T22:53:28.518003+0000","last_became_active":"2023-09-30T22:53:27.516077+0000","last_became_peered":"2023-09-30T22:53:27.516077+0000","last_unstale":"2023-09-30T22:53:28.518003+0000","last_undegraded":"2023-09-30T22:53:28.518003+0000","last_fullsized":"2023-09-30T22:53:28.518003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:23.956508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514093+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:53:28.514093+0000","last_peered":"2023-09-30T22:53:28.514093+0000","last_clean":"2023-09-30T22:53:28.514093+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:53:28.514093+0000","last_undegraded":"2023-09-30T22:53:28.514093+0000","last_fullsized":"2023-09-30T22:53:28.514093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520799+0000","last_change":"2023-09-30T22:53:28.520729+0000","last_active":"2023-09-30T22:53:28.520799+0000","last_peered":"2023-09-30T22:53:28.520799+0000","last_clean":"2023-09-30T22:53:28.520799+0000","last_became_active":"2023-09-30T22:53:28.520513+0000","last_became_peered":"2023-09-30T22:53:28.520513+0000","last_unstale":"2023-09-30T22:53:28.520799+0000","last_undegraded":"2023-09-30T22:53:28.520799+0000","last_fullsized":"2023-09-30T22:53:28.520799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509593+0000","last_change":"2023-09-30T22:53:27.518551+0000","last_active":"2023-09-30T22:53:28.509593+0000","last_peered":"2023-09-30T22:53:28.509593+0000","last_clean":"2023-09-30T22:53:28.509593+0000","last_became_active":"2023-09-30T22:53:27.518302+0000","last_became_peered":"2023-09-30T22:53:27.518302+0000","last_unstale":"2023-09-30T22:53:28.509593+0000","last_undegraded":"2023-09-30T22:53:28.509593+0000","last_fullsized":"2023-09-30T22:53:28.509593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:47.454460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277246+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:53:20.277246+0000","last_peered":"2023-09-30T22:53:20.277246+0000","last_clean":"2023-09-30T22:53:20.277246+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:53:20.277246+0000","last_undegraded":"2023-09-30T22:53:20.277246+0000","last_fullsized":"2023-09-30T22:53:20.277246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526279+0000","last_change":"2023-09-30T22:53:28.526154+0000","last_active":"2023-09-30T22:53:28.526279+0000","last_peered":"2023-09-30T22:53:28.526279+0000","last_clean":"2023-09-30T22:53:28.526279+0000","last_became_active":"2023-09-30T22:53:28.525783+0000","last_became_peered":"2023-09-30T22:53:28.525783+0000","last_unstale":"2023-09-30T22:53:28.526279+0000","last_undegraded":"2023-09-30T22:53:28.526279+0000","last_fullsized":"2023-09-30T22:53:28.526279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508773+0000","last_change":"2023-09-30T22:53:27.518889+0000","last_active":"2023-09-30T22:53:28.508773+0000","last_peered":"2023-09-30T22:53:28.508773+0000","last_clean":"2023-09-30T22:53:28.508773+0000","last_became_active":"2023-09-30T22:53:27.518640+0000","last_became_peered":"2023-09-30T22:53:27.518640+0000","last_unstale":"2023-09-30T22:53:28.508773+0000","last_undegraded":"2023-09-30T22:53:28.508773+0000","last_fullsized":"2023-09-30T22:53:28.508773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:24.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508872+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:53:28.508872+0000","last_peered":"2023-09-30T22:53:28.508872+0000","last_clean":"2023-09-30T22:53:28.508872+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:53:28.508872+0000","last_undegraded":"2023-09-30T22:53:28.508872+0000","last_fullsized":"2023-09-30T22:53:28.508872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517216+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.517216+0000","last_peered":"2023-09-30T22:53:28.517216+0000","last_clean":"2023-09-30T22:53:28.517216+0000","last_became_active":"2023-09-30T22:53:27.516261+0000","last_became_peered":"2023-09-30T22:53:27.516261+0000","last_unstale":"2023-09-30T22:53:28.517216+0000","last_undegraded":"2023-09-30T22:53:28.517216+0000","last_fullsized":"2023-09-30T22:53:28.517216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:22.220152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277304+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:53:20.277304+0000","last_peered":"2023-09-30T22:53:20.277304+0000","last_clean":"2023-09-30T22:53:20.277304+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:53:20.277304+0000","last_undegraded":"2023-09-30T22:53:20.277304+0000","last_fullsized":"2023-09-30T22:53:20.277304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513331+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:53:28.513331+0000","last_peered":"2023-09-30T22:53:28.513331+0000","last_clean":"2023-09-30T22:53:28.513331+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:53:28.513331+0000","last_undegraded":"2023-09-30T22:53:28.513331+0000","last_fullsized":"2023-09-30T22:53:28.513331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521299+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521299+0000","last_peered":"2023-09-30T22:53:28.521299+0000","last_clean":"2023-09-30T22:53:28.521299+0000","last_became_active":"2023-09-30T22:53:28.520925+0000","last_became_peered":"2023-09-30T22:53:28.520925+0000","last_unstale":"2023-09-30T22:53:28.521299+0000","last_undegraded":"2023-09-30T22:53:28.521299+0000","last_fullsized":"2023-09-30T22:53:28.521299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502591+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277246+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:53:20.277246+0000","last_peered":"2023-09-30T22:53:20.277246+0000","last_clean":"2023-09-30T22:53:20.277246+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:53:20.277246+0000","last_undegraded":"2023-09-30T22:53:20.277246+0000","last_fullsized":"2023-09-30T22:53:20.277246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521298+0000","last_change":"2023-09-30T22:53:28.521190+0000","last_active":"2023-09-30T22:53:28.521298+0000","last_peered":"2023-09-30T22:53:28.521298+0000","last_clean":"2023-09-30T22:53:28.521298+0000","last_became_active":"2023-09-30T22:53:28.520955+0000","last_became_peered":"2023-09-30T22:53:28.520955+0000","last_unstale":"2023-09-30T22:53:28.521298+0000","last_undegraded":"2023-09-30T22:53:28.521298+0000","last_fullsized":"2023-09-30T22:53:28.521298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517510+0000","last_change":"2023-09-30T22:53:27.516490+0000","last_active":"2023-09-30T22:53:28.517510+0000","last_peered":"2023-09-30T22:53:28.517510+0000","last_clean":"2023-09-30T22:53:28.517510+0000","last_became_active":"2023-09-30T22:53:27.516254+0000","last_became_peered":"2023-09-30T22:53:27.516254+0000","last_unstale":"2023-09-30T22:53:28.517510+0000","last_undegraded":"2023-09-30T22:53:28.517510+0000","last_fullsized":"2023-09-30T22:53:28.517510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:33:29.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277456+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:53:20.277456+0000","last_peered":"2023-09-30T22:53:20.277456+0000","last_clean":"2023-09-30T22:53:20.277456+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:53:20.277456+0000","last_undegraded":"2023-09-30T22:53:20.277456+0000","last_fullsized":"2023-09-30T22:53:20.277456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502576+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518201+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:53:28.518201+0000","last_peered":"2023-09-30T22:53:28.518201+0000","last_clean":"2023-09-30T22:53:28.518201+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:53:28.518201+0000","last_undegraded":"2023-09-30T22:53:28.518201+0000","last_fullsized":"2023-09-30T22:53:28.518201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519732+0000","last_change":"2023-09-30T22:53:28.519554+0000","last_active":"2023-09-30T22:53:28.519732+0000","last_peered":"2023-09-30T22:53:28.519732+0000","last_clean":"2023-09-30T22:53:28.519732+0000","last_became_active":"2023-09-30T22:53:28.519318+0000","last_became_peered":"2023-09-30T22:53:28.519318+0000","last_unstale":"2023-09-30T22:53:28.519732+0000","last_undegraded":"2023-09-30T22:53:28.519732+0000","last_fullsized":"2023-09-30T22:53:28.519732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520210+0000","last_change":"2023-09-30T22:53:27.520302+0000","last_active":"2023-09-30T22:53:28.520210+0000","last_peered":"2023-09-30T22:53:28.520210+0000","last_clean":"2023-09-30T22:53:28.520210+0000","last_became_active":"2023-09-30T22:53:27.518956+0000","last_became_peered":"2023-09-30T22:53:27.518956+0000","last_unstale":"2023-09-30T22:53:28.520210+0000","last_undegraded":"2023-09-30T22:53:28.520210+0000","last_fullsized":"2023-09-30T22:53:28.520210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277400+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:53:20.277400+0000","last_peered":"2023-09-30T22:53:20.277400+0000","last_clean":"2023-09-30T22:53:20.277400+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:53:20.277400+0000","last_undegraded":"2023-09-30T22:53:20.277400+0000","last_fullsized":"2023-09-30T22:53:20.277400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.624},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.752}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838200,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.79100000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.74399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.879}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.0249999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.96599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.374},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.504},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.442}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.036}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":1.22},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.0740000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":1.21}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":1.2330000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46800000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.434}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.871},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.81699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":160,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.434}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.179},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.377},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.502}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":159,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65800000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.78000000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70799999999999996}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77100000000000002}]}]}],"pool_statfs":[]}} 2023-09-30T22:53:32.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:53:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.094+0000 7fc8f1bff700 1 Processor -- start 2023-09-30T22:53:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.094+0000 7fc8f1bff700 1 -- start start 2023-09-30T22:53:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.095+0000 7fc8f1bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8ec0b1180 0x7fc8ec0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.095+0000 7fc8f1bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8ec159eb0 0x7fc8ec0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.095+0000 7fc8f1bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec15d910 con 0x7fc8ec159ae0 2023-09-30T22:53:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.095+0000 7fc8f1bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec15e920 con 0x7fc8ec159eb0 2023-09-30T22:53:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.095+0000 7fc8f1bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec15e490 con 0x7fc8ec0b1180 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8ec159eb0 0x7fc8ec0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8ec159eb0 0x7fc8ec0cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47078/0 (socket says 172.21.15.142:47078) 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 -- 172.21.15.142:0/306451512 learned_addr learned my addr 172.21.15.142:0/306451512 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8eaffd700 1 --2- 172.21.15.142:0/306451512 >> v2:172.21.15.148:3300/0 conn(0x7fc8ec0b1180 0x7fc8ec0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 -- 172.21.15.142:0/306451512 >> v2:172.21.15.148:3300/0 conn(0x7fc8ec0b1180 msgr2=0x7fc8ec0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 --2- 172.21.15.142:0/306451512 >> v2:172.21.15.148:3300/0 conn(0x7fc8ec0b1180 0x7fc8ec0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 -- 172.21.15.142:0/306451512 >> v1:172.21.15.148:6789/0 conn(0x7fc8ec159ae0 legacy=0x7fc8ec0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 -- 172.21.15.142:0/306451512 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0ce5c0 con 0x7fc8ec159eb0 2023-09-30T22:53:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.096+0000 7fc8ebfff700 1 --2- 172.21.15.142:0/306451512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec0cc3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec067af0 tx=0x7fc8e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8678cf8731206780 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:33.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8ea7fc700 1 -- 172.21.15.142:0/306451512 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400e070 con 0x7fc8ec159eb0 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8ea7fc700 1 -- 172.21.15.142:0/306451512 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400ba10 con 0x7fc8ec159eb0 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8ea7fc700 1 -- 172.21.15.142:0/306451512 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40092e0 con 0x7fc8ec159eb0 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 -- 172.21.15.142:0/306451512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159eb0 msgr2=0x7fc8ec0cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/306451512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec0cc3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec067af0 tx=0x7fc8e4009840 comp rx=0 tx=0).stop 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 -- 172.21.15.142:0/306451512 shutdown_connections 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/306451512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec0cc3c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/306451512 >> v2:172.21.15.148:3300/0 conn(0x7fc8ec0b1180 0x7fc8ec0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 -- 172.21.15.142:0/306451512 >> 172.21.15.142:0/306451512 conn(0x7fc8ec0ce8b0 msgr2=0x7fc8ec0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 -- 172.21.15.142:0/306451512 shutdown_connections 2023-09-30T22:53:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.097+0000 7fc8f1bff700 1 -- 172.21.15.142:0/306451512 wait complete. 2023-09-30T22:53:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.099+0000 7fc8f1bff700 1 Processor -- start 2023-09-30T22:53:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.099+0000 7fc8f1bff700 1 -- start start 2023-09-30T22:53:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8f1bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ec0b1180 0x7fc8ec0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8f1bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159ae0 0x7fc8ec16aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8f1bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8f1bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec16b430 con 0x7fc8ec159ae0 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8f1bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0caff0 con 0x7fc8ec159eb0 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8f1bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1592c0 con 0x7fc8ec0b1180 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8eaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159ae0 0x7fc8ec16aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8eaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159ae0 0x7fc8ec16aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47092/0 (socket says 172.21.15.142:47092) 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8eaffd700 1 -- 172.21.15.142:0/2566455838 learned_addr learned my addr 172.21.15.142:0/2566455838 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8ebfff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.100+0000 7fc8eb7fe700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ec0b1180 0x7fc8ec0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8eaffd700 1 -- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ec0b1180 msgr2=0x7fc8ec0c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8eaffd700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ec0b1180 0x7fc8ec0c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8eaffd700 1 -- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ec159eb0 msgr2=0x7fc8ec144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8eaffd700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8eaffd700 1 -- 172.21.15.142:0/2566455838 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4009ae0 con 0x7fc8ec159ae0 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8ebfff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8eb7fe700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ec0b1180 0x7fc8ec0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8eaffd700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159ae0 0x7fc8ec16aef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000d860 tx=0x7fc8e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8d37fe700 1 -- 172.21.15.142:0/2566455838 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00125f0 con 0x7fc8ec159ae0 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8d37fe700 1 -- 172.21.15.142:0/2566455838 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0012750 con 0x7fc8ec159ae0 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8d37fe700 1 -- 172.21.15.142:0/2566455838 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0012ad0 con 0x7fc8ec159ae0 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec0ca4b0 con 0x7fc8ec159ae0 2023-09-30T22:53:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.101+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec155410 con 0x7fc8ec159ae0 2023-09-30T22:53:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.102+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec06ea70 con 0x7fc8ec159ae0 2023-09-30T22:53:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.103+0000 7fc8d37fe700 1 -- 172.21.15.142:0/2566455838 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc8e001e460 con 0x7fc8ec159ae0 2023-09-30T22:53:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.104+0000 7fc8d37fe700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8d8067330 0x7fc8d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.104+0000 7fc8d37fe700 1 -- 172.21.15.142:0/2566455838 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8e00852b0 con 0x7fc8ec159ae0 2023-09-30T22:53:33.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.104+0000 7fc8eb7fe700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8d8067330 0x7fc8d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.105+0000 7fc8eb7fe700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8d8067330 0x7fc8d80697e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc007fd0 tx=0x7fc8dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:33.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.108+0000 7fc8d37fe700 1 -- 172.21.15.142:0/2566455838 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc8e0055ba0 con 0x7fc8ec159ae0 2023-09-30T22:53:33.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.295+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8ec15db60 con 0x7fc8d8067330 2023-09-30T22:53:33.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.304+0000 7fc8d37fe700 1 -- 172.21.15.142:0/2566455838 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301842 (secure 0 0 0) 0x7fc8ec15db60 con 0x7fc8d8067330 2023-09-30T22:53:33.308 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8d8067330 msgr2=0x7fc8d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8d8067330 0x7fc8d80697e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc007fd0 tx=0x7fc8dc009040 comp rx=0 tx=0).stop 2023-09-30T22:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159ae0 msgr2=0x7fc8ec16aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159ae0 0x7fc8ec16aef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000d860 tx=0x7fc8e0008040 comp rx=0 tx=0).stop 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 shutdown_connections 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc8d8067330 0x7fc8d80697e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ec159eb0 0x7fc8ec144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ec0b1180 0x7fc8ec0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 --2- 172.21.15.142:0/2566455838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ec159ae0 0x7fc8ec16aef0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 >> 172.21.15.142:0/2566455838 conn(0x7fc8ec0ce8b0 msgr2=0x7fc8ec1532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 shutdown_connections 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.308+0000 7fc8f1bff700 1 -- 172.21.15.142:0/2566455838 wait complete. 2023-09-30T22:53:33.311 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:53:33.327 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-09-30T22:53:32.115178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592584,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2395,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560104,"statfs":{"total":1600000000,"available":1597547145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.613468"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522036+0000","last_change":"2023-09-30T22:53:28.521844+0000","last_active":"2023-09-30T22:53:28.522036+0000","last_peered":"2023-09-30T22:53:28.522036+0000","last_clean":"2023-09-30T22:53:28.522036+0000","last_became_active":"2023-09-30T22:53:28.521523+0000","last_became_peered":"2023-09-30T22:53:28.521523+0000","last_unstale":"2023-09-30T22:53:28.522036+0000","last_undegraded":"2023-09-30T22:53:28.522036+0000","last_fullsized":"2023-09-30T22:53:28.522036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:59.351514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513441+0000","last_change":"2023-09-30T22:53:28.513362+0000","last_active":"2023-09-30T22:53:28.513441+0000","last_peered":"2023-09-30T22:53:28.513441+0000","last_clean":"2023-09-30T22:53:28.513441+0000","last_became_active":"2023-09-30T22:53:28.513102+0000","last_became_peered":"2023-09-30T22:53:28.513102+0000","last_unstale":"2023-09-30T22:53:28.513441+0000","last_undegraded":"2023-09-30T22:53:28.513441+0000","last_fullsized":"2023-09-30T22:53:28.513441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:50.326775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523601+0000","last_change":"2023-09-30T22:53:28.523032+0000","last_active":"2023-09-30T22:53:28.523601+0000","last_peered":"2023-09-30T22:53:28.523601+0000","last_clean":"2023-09-30T22:53:28.523601+0000","last_became_active":"2023-09-30T22:53:28.522810+0000","last_became_peered":"2023-09-30T22:53:28.522810+0000","last_unstale":"2023-09-30T22:53:28.523601+0000","last_undegraded":"2023-09-30T22:53:28.523601+0000","last_fullsized":"2023-09-30T22:53:28.523601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:53.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524515+0000","last_change":"2023-09-30T22:53:28.524309+0000","last_active":"2023-09-30T22:53:28.524515+0000","last_peered":"2023-09-30T22:53:28.524515+0000","last_clean":"2023-09-30T22:53:28.524515+0000","last_became_active":"2023-09-30T22:53:28.523815+0000","last_became_peered":"2023-09-30T22:53:28.523815+0000","last_unstale":"2023-09-30T22:53:28.524515+0000","last_undegraded":"2023-09-30T22:53:28.524515+0000","last_fullsized":"2023-09-30T22:53:28.524515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:56.402195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523891+0000","last_change":"2023-09-30T22:53:28.523789+0000","last_active":"2023-09-30T22:53:28.523891+0000","last_peered":"2023-09-30T22:53:28.523891+0000","last_clean":"2023-09-30T22:53:28.523891+0000","last_became_active":"2023-09-30T22:53:28.523542+0000","last_became_peered":"2023-09-30T22:53:28.523542+0000","last_unstale":"2023-09-30T22:53:28.523891+0000","last_undegraded":"2023-09-30T22:53:28.523891+0000","last_fullsized":"2023-09-30T22:53:28.523891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515993+0000","last_change":"2023-09-30T22:53:28.515784+0000","last_active":"2023-09-30T22:53:28.515993+0000","last_peered":"2023-09-30T22:53:28.515993+0000","last_clean":"2023-09-30T22:53:28.515993+0000","last_became_active":"2023-09-30T22:53:28.515565+0000","last_became_peered":"2023-09-30T22:53:28.515565+0000","last_unstale":"2023-09-30T22:53:28.515993+0000","last_undegraded":"2023-09-30T22:53:28.515993+0000","last_fullsized":"2023-09-30T22:53:28.515993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:53.264810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525125+0000","last_change":"2023-09-30T22:53:28.524944+0000","last_active":"2023-09-30T22:53:28.525125+0000","last_peered":"2023-09-30T22:53:28.525125+0000","last_clean":"2023-09-30T22:53:28.525125+0000","last_became_active":"2023-09-30T22:53:28.523435+0000","last_became_peered":"2023-09-30T22:53:28.523435+0000","last_unstale":"2023-09-30T22:53:28.525125+0000","last_undegraded":"2023-09-30T22:53:28.525125+0000","last_fullsized":"2023-09-30T22:53:28.525125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:18.496971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527102+0000","last_change":"2023-09-30T22:53:28.526469+0000","last_active":"2023-09-30T22:53:28.527102+0000","last_peered":"2023-09-30T22:53:28.527102+0000","last_clean":"2023-09-30T22:53:28.527102+0000","last_became_active":"2023-09-30T22:53:28.525921+0000","last_became_peered":"2023-09-30T22:53:28.525921+0000","last_unstale":"2023-09-30T22:53:28.527102+0000","last_undegraded":"2023-09-30T22:53:28.527102+0000","last_fullsized":"2023-09-30T22:53:28.527102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:57.146828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511245+0000","last_change":"2023-09-30T22:53:28.511148+0000","last_active":"2023-09-30T22:53:28.511245+0000","last_peered":"2023-09-30T22:53:28.511245+0000","last_clean":"2023-09-30T22:53:28.511245+0000","last_became_active":"2023-09-30T22:53:28.510877+0000","last_became_peered":"2023-09-30T22:53:28.510877+0000","last_unstale":"2023-09-30T22:53:28.511245+0000","last_undegraded":"2023-09-30T22:53:28.511245+0000","last_fullsized":"2023-09-30T22:53:28.511245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524522+0000","last_change":"2023-09-30T22:53:28.523149+0000","last_active":"2023-09-30T22:53:28.524522+0000","last_peered":"2023-09-30T22:53:28.524522+0000","last_clean":"2023-09-30T22:53:28.524522+0000","last_became_active":"2023-09-30T22:53:28.522693+0000","last_became_peered":"2023-09-30T22:53:28.522693+0000","last_unstale":"2023-09-30T22:53:28.524522+0000","last_undegraded":"2023-09-30T22:53:28.524522+0000","last_fullsized":"2023-09-30T22:53:28.524522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:24.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526829+0000","last_change":"2023-09-30T22:53:28.526578+0000","last_active":"2023-09-30T22:53:28.526829+0000","last_peered":"2023-09-30T22:53:28.526829+0000","last_clean":"2023-09-30T22:53:28.526829+0000","last_became_active":"2023-09-30T22:53:28.526345+0000","last_became_peered":"2023-09-30T22:53:28.526345+0000","last_unstale":"2023-09-30T22:53:28.526829+0000","last_undegraded":"2023-09-30T22:53:28.526829+0000","last_fullsized":"2023-09-30T22:53:28.526829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513911+0000","last_change":"2023-09-30T22:53:28.513759+0000","last_active":"2023-09-30T22:53:28.513911+0000","last_peered":"2023-09-30T22:53:28.513911+0000","last_clean":"2023-09-30T22:53:28.513911+0000","last_became_active":"2023-09-30T22:53:28.513397+0000","last_became_peered":"2023-09-30T22:53:28.513397+0000","last_unstale":"2023-09-30T22:53:28.513911+0000","last_undegraded":"2023-09-30T22:53:28.513911+0000","last_fullsized":"2023-09-30T22:53:28.513911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517049+0000","last_change":"2023-09-30T22:53:28.516976+0000","last_active":"2023-09-30T22:53:28.517049+0000","last_peered":"2023-09-30T22:53:28.517049+0000","last_clean":"2023-09-30T22:53:28.517049+0000","last_became_active":"2023-09-30T22:53:28.516752+0000","last_became_peered":"2023-09-30T22:53:28.516752+0000","last_unstale":"2023-09-30T22:53:28.517049+0000","last_undegraded":"2023-09-30T22:53:28.517049+0000","last_fullsized":"2023-09-30T22:53:28.517049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:14.222289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520873+0000","last_change":"2023-09-30T22:53:28.520771+0000","last_active":"2023-09-30T22:53:28.520873+0000","last_peered":"2023-09-30T22:53:28.520873+0000","last_clean":"2023-09-30T22:53:28.520873+0000","last_became_active":"2023-09-30T22:53:28.520479+0000","last_became_peered":"2023-09-30T22:53:28.520479+0000","last_unstale":"2023-09-30T22:53:28.520873+0000","last_undegraded":"2023-09-30T22:53:28.520873+0000","last_fullsized":"2023-09-30T22:53:28.520873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524568+0000","last_change":"2023-09-30T22:53:28.524203+0000","last_active":"2023-09-30T22:53:28.524568+0000","last_peered":"2023-09-30T22:53:28.524568+0000","last_clean":"2023-09-30T22:53:28.524568+0000","last_became_active":"2023-09-30T22:53:28.523569+0000","last_became_peered":"2023-09-30T22:53:28.523569+0000","last_unstale":"2023-09-30T22:53:28.524568+0000","last_undegraded":"2023-09-30T22:53:28.524568+0000","last_fullsized":"2023-09-30T22:53:28.524568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:48:48.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523512+0000","last_change":"2023-09-30T22:53:28.523441+0000","last_active":"2023-09-30T22:53:28.523512+0000","last_peered":"2023-09-30T22:53:28.523512+0000","last_clean":"2023-09-30T22:53:28.523512+0000","last_became_active":"2023-09-30T22:53:28.523060+0000","last_became_peered":"2023-09-30T22:53:28.523060+0000","last_unstale":"2023-09-30T22:53:28.523512+0000","last_undegraded":"2023-09-30T22:53:28.523512+0000","last_fullsized":"2023-09-30T22:53:28.523512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521320+0000","last_change":"2023-09-30T22:53:28.521259+0000","last_active":"2023-09-30T22:53:28.521320+0000","last_peered":"2023-09-30T22:53:28.521320+0000","last_clean":"2023-09-30T22:53:28.521320+0000","last_became_active":"2023-09-30T22:53:28.520791+0000","last_became_peered":"2023-09-30T22:53:28.520791+0000","last_unstale":"2023-09-30T22:53:28.521320+0000","last_undegraded":"2023-09-30T22:53:28.521320+0000","last_fullsized":"2023-09-30T22:53:28.521320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523920+0000","last_change":"2023-09-30T22:53:28.523845+0000","last_active":"2023-09-30T22:53:28.523920+0000","last_peered":"2023-09-30T22:53:28.523920+0000","last_clean":"2023-09-30T22:53:28.523920+0000","last_became_active":"2023-09-30T22:53:28.523587+0000","last_became_peered":"2023-09-30T22:53:28.523587+0000","last_unstale":"2023-09-30T22:53:28.523920+0000","last_undegraded":"2023-09-30T22:53:28.523920+0000","last_fullsized":"2023-09-30T22:53:28.523920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521215+0000","last_change":"2023-09-30T22:53:28.521142+0000","last_active":"2023-09-30T22:53:28.521215+0000","last_peered":"2023-09-30T22:53:28.521215+0000","last_clean":"2023-09-30T22:53:28.521215+0000","last_became_active":"2023-09-30T22:53:28.520866+0000","last_became_peered":"2023-09-30T22:53:28.520866+0000","last_unstale":"2023-09-30T22:53:28.521215+0000","last_undegraded":"2023-09-30T22:53:28.521215+0000","last_fullsized":"2023-09-30T22:53:28.521215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528033+0000","last_change":"2023-09-30T22:53:28.527707+0000","last_active":"2023-09-30T22:53:28.528033+0000","last_peered":"2023-09-30T22:53:28.528033+0000","last_clean":"2023-09-30T22:53:28.528033+0000","last_became_active":"2023-09-30T22:53:28.527483+0000","last_became_peered":"2023-09-30T22:53:28.527483+0000","last_unstale":"2023-09-30T22:53:28.528033+0000","last_undegraded":"2023-09-30T22:53:28.528033+0000","last_fullsized":"2023-09-30T22:53:28.528033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:06.946949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519144+0000","last_change":"2023-09-30T22:53:28.519070+0000","last_active":"2023-09-30T22:53:28.519144+0000","last_peered":"2023-09-30T22:53:28.519144+0000","last_clean":"2023-09-30T22:53:28.519144+0000","last_became_active":"2023-09-30T22:53:28.518852+0000","last_became_peered":"2023-09-30T22:53:28.518852+0000","last_unstale":"2023-09-30T22:53:28.519144+0000","last_undegraded":"2023-09-30T22:53:28.519144+0000","last_fullsized":"2023-09-30T22:53:28.519144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527117+0000","last_change":"2023-09-30T22:53:28.526708+0000","last_active":"2023-09-30T22:53:28.527117+0000","last_peered":"2023-09-30T22:53:28.527117+0000","last_clean":"2023-09-30T22:53:28.527117+0000","last_became_active":"2023-09-30T22:53:28.526478+0000","last_became_peered":"2023-09-30T22:53:28.526478+0000","last_unstale":"2023-09-30T22:53:28.527117+0000","last_undegraded":"2023-09-30T22:53:28.527117+0000","last_fullsized":"2023-09-30T22:53:28.527117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:57:09.485295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524561+0000","last_change":"2023-09-30T22:53:28.524489+0000","last_active":"2023-09-30T22:53:28.524561+0000","last_peered":"2023-09-30T22:53:28.524561+0000","last_clean":"2023-09-30T22:53:28.524561+0000","last_became_active":"2023-09-30T22:53:28.524252+0000","last_became_peered":"2023-09-30T22:53:28.524252+0000","last_unstale":"2023-09-30T22:53:28.524561+0000","last_undegraded":"2023-09-30T22:53:28.524561+0000","last_fullsized":"2023-09-30T22:53:28.524561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524505+0000","last_change":"2023-09-30T22:53:28.522426+0000","last_active":"2023-09-30T22:53:28.524505+0000","last_peered":"2023-09-30T22:53:28.524505+0000","last_clean":"2023-09-30T22:53:28.524505+0000","last_became_active":"2023-09-30T22:53:28.521202+0000","last_became_peered":"2023-09-30T22:53:28.521202+0000","last_unstale":"2023-09-30T22:53:28.524505+0000","last_undegraded":"2023-09-30T22:53:28.524505+0000","last_fullsized":"2023-09-30T22:53:28.524505+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:23.130881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524590+0000","last_change":"2023-09-30T22:53:28.524378+0000","last_active":"2023-09-30T22:53:28.524590+0000","last_peered":"2023-09-30T22:53:28.524590+0000","last_clean":"2023-09-30T22:53:28.524590+0000","last_became_active":"2023-09-30T22:53:28.523927+0000","last_became_peered":"2023-09-30T22:53:28.523927+0000","last_unstale":"2023-09-30T22:53:28.524590+0000","last_undegraded":"2023-09-30T22:53:28.524590+0000","last_fullsized":"2023-09-30T22:53:28.524590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:50.593476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528068+0000","last_change":"2023-09-30T22:53:28.527965+0000","last_active":"2023-09-30T22:53:28.528068+0000","last_peered":"2023-09-30T22:53:28.528068+0000","last_clean":"2023-09-30T22:53:28.528068+0000","last_became_active":"2023-09-30T22:53:28.527612+0000","last_became_peered":"2023-09-30T22:53:28.527612+0000","last_unstale":"2023-09-30T22:53:28.528068+0000","last_undegraded":"2023-09-30T22:53:28.528068+0000","last_fullsized":"2023-09-30T22:53:28.528068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:39.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538999+0000","last_change":"2023-09-30T22:53:27.516465+0000","last_active":"2023-09-30T22:53:28.538999+0000","last_peered":"2023-09-30T22:53:28.538999+0000","last_clean":"2023-09-30T22:53:28.538999+0000","last_became_active":"2023-09-30T22:53:27.516253+0000","last_became_peered":"2023-09-30T22:53:27.516253+0000","last_unstale":"2023-09-30T22:53:28.538999+0000","last_undegraded":"2023-09-30T22:53:28.538999+0000","last_fullsized":"2023-09-30T22:53:28.538999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522280+0000","last_change":"2023-09-30T22:53:28.522137+0000","last_active":"2023-09-30T22:53:28.522280+0000","last_peered":"2023-09-30T22:53:28.522280+0000","last_clean":"2023-09-30T22:53:28.522280+0000","last_became_active":"2023-09-30T22:53:28.521672+0000","last_became_peered":"2023-09-30T22:53:28.521672+0000","last_unstale":"2023-09-30T22:53:28.522280+0000","last_undegraded":"2023-09-30T22:53:28.522280+0000","last_fullsized":"2023-09-30T22:53:28.522280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:13.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534160+0000","last_change":"2023-09-30T22:53:27.513083+0000","last_active":"2023-09-30T22:53:28.534160+0000","last_peered":"2023-09-30T22:53:28.534160+0000","last_clean":"2023-09-30T22:53:28.534160+0000","last_became_active":"2023-09-30T22:53:27.512830+0000","last_became_peered":"2023-09-30T22:53:27.512830+0000","last_unstale":"2023-09-30T22:53:28.534160+0000","last_undegraded":"2023-09-30T22:53:28.534160+0000","last_fullsized":"2023-09-30T22:53:28.534160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536132+0000","last_change":"2023-09-30T22:53:27.521745+0000","last_active":"2023-09-30T22:53:28.536132+0000","last_peered":"2023-09-30T22:53:28.536132+0000","last_clean":"2023-09-30T22:53:28.536132+0000","last_became_active":"2023-09-30T22:53:27.521383+0000","last_became_peered":"2023-09-30T22:53:27.521383+0000","last_unstale":"2023-09-30T22:53:28.536132+0000","last_undegraded":"2023-09-30T22:53:28.536132+0000","last_fullsized":"2023-09-30T22:53:28.536132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519546+0000","last_change":"2023-09-30T22:53:28.519421+0000","last_active":"2023-09-30T22:53:28.519546+0000","last_peered":"2023-09-30T22:53:28.519546+0000","last_clean":"2023-09-30T22:53:28.519546+0000","last_became_active":"2023-09-30T22:53:28.519181+0000","last_became_peered":"2023-09-30T22:53:28.519181+0000","last_unstale":"2023-09-30T22:53:28.519546+0000","last_undegraded":"2023-09-30T22:53:28.519546+0000","last_fullsized":"2023-09-30T22:53:28.519546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:32.735104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535058+0000","last_change":"2023-09-30T22:53:27.517467+0000","last_active":"2023-09-30T22:53:28.535058+0000","last_peered":"2023-09-30T22:53:28.535058+0000","last_clean":"2023-09-30T22:53:28.535058+0000","last_became_active":"2023-09-30T22:53:27.517231+0000","last_became_peered":"2023-09-30T22:53:27.517231+0000","last_unstale":"2023-09-30T22:53:28.535058+0000","last_undegraded":"2023-09-30T22:53:28.535058+0000","last_fullsized":"2023-09-30T22:53:28.535058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521506+0000","last_change":"2023-09-30T22:53:28.520868+0000","last_active":"2023-09-30T22:53:28.521506+0000","last_peered":"2023-09-30T22:53:28.521506+0000","last_clean":"2023-09-30T22:53:28.521506+0000","last_became_active":"2023-09-30T22:53:28.520629+0000","last_became_peered":"2023-09-30T22:53:28.520629+0000","last_unstale":"2023-09-30T22:53:28.521506+0000","last_undegraded":"2023-09-30T22:53:28.521506+0000","last_fullsized":"2023-09-30T22:53:28.521506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:18:44.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535219+0000","last_change":"2023-09-30T22:53:27.517083+0000","last_active":"2023-09-30T22:53:28.535219+0000","last_peered":"2023-09-30T22:53:28.535219+0000","last_clean":"2023-09-30T22:53:28.535219+0000","last_became_active":"2023-09-30T22:53:27.516834+0000","last_became_peered":"2023-09-30T22:53:27.516834+0000","last_unstale":"2023-09-30T22:53:28.535219+0000","last_undegraded":"2023-09-30T22:53:28.535219+0000","last_fullsized":"2023-09-30T22:53:28.535219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519698+0000","last_change":"2023-09-30T22:53:28.519090+0000","last_active":"2023-09-30T22:53:28.519698+0000","last_peered":"2023-09-30T22:53:28.519698+0000","last_clean":"2023-09-30T22:53:28.519698+0000","last_became_active":"2023-09-30T22:53:28.518864+0000","last_became_peered":"2023-09-30T22:53:28.518864+0000","last_unstale":"2023-09-30T22:53:28.519698+0000","last_undegraded":"2023-09-30T22:53:28.519698+0000","last_fullsized":"2023-09-30T22:53:28.519698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:38:50.812517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534282+0000","last_change":"2023-09-30T22:53:27.521214+0000","last_active":"2023-09-30T22:53:28.534282+0000","last_peered":"2023-09-30T22:53:28.534282+0000","last_clean":"2023-09-30T22:53:28.534282+0000","last_became_active":"2023-09-30T22:53:27.521000+0000","last_became_peered":"2023-09-30T22:53:27.521000+0000","last_unstale":"2023-09-30T22:53:28.534282+0000","last_undegraded":"2023-09-30T22:53:28.534282+0000","last_fullsized":"2023-09-30T22:53:28.534282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519955+0000","last_change":"2023-09-30T22:53:27.520810+0000","last_active":"2023-09-30T22:53:28.519955+0000","last_peered":"2023-09-30T22:53:28.519955+0000","last_clean":"2023-09-30T22:53:28.519955+0000","last_became_active":"2023-09-30T22:53:27.520051+0000","last_became_peered":"2023-09-30T22:53:27.520051+0000","last_unstale":"2023-09-30T22:53:28.519955+0000","last_undegraded":"2023-09-30T22:53:28.519955+0000","last_fullsized":"2023-09-30T22:53:28.519955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516891+0000","last_change":"2023-09-30T22:53:28.516799+0000","last_active":"2023-09-30T22:53:28.516891+0000","last_peered":"2023-09-30T22:53:28.516891+0000","last_clean":"2023-09-30T22:53:28.516891+0000","last_became_active":"2023-09-30T22:53:28.516580+0000","last_became_peered":"2023-09-30T22:53:28.516580+0000","last_unstale":"2023-09-30T22:53:28.516891+0000","last_undegraded":"2023-09-30T22:53:28.516891+0000","last_fullsized":"2023-09-30T22:53:28.516891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516147+0000","last_change":"2023-09-30T22:53:27.519471+0000","last_active":"2023-09-30T22:53:28.516147+0000","last_peered":"2023-09-30T22:53:28.516147+0000","last_clean":"2023-09-30T22:53:28.516147+0000","last_became_active":"2023-09-30T22:53:27.518947+0000","last_became_peered":"2023-09-30T22:53:27.518947+0000","last_unstale":"2023-09-30T22:53:28.516147+0000","last_undegraded":"2023-09-30T22:53:28.516147+0000","last_fullsized":"2023-09-30T22:53:28.516147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:14.863213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524538+0000","last_change":"2023-09-30T22:53:28.524453+0000","last_active":"2023-09-30T22:53:28.524538+0000","last_peered":"2023-09-30T22:53:28.524538+0000","last_clean":"2023-09-30T22:53:28.524538+0000","last_became_active":"2023-09-30T22:53:28.524098+0000","last_became_peered":"2023-09-30T22:53:28.524098+0000","last_unstale":"2023-09-30T22:53:28.524538+0000","last_undegraded":"2023-09-30T22:53:28.524538+0000","last_fullsized":"2023-09-30T22:53:28.524538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:25.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517878+0000","last_change":"2023-09-30T22:53:27.517464+0000","last_active":"2023-09-30T22:53:28.517878+0000","last_peered":"2023-09-30T22:53:28.517878+0000","last_clean":"2023-09-30T22:53:28.517878+0000","last_became_active":"2023-09-30T22:53:27.516983+0000","last_became_peered":"2023-09-30T22:53:27.516983+0000","last_unstale":"2023-09-30T22:53:28.517878+0000","last_undegraded":"2023-09-30T22:53:28.517878+0000","last_fullsized":"2023-09-30T22:53:28.517878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523916+0000","last_change":"2023-09-30T22:53:28.523841+0000","last_active":"2023-09-30T22:53:28.523916+0000","last_peered":"2023-09-30T22:53:28.523916+0000","last_clean":"2023-09-30T22:53:28.523916+0000","last_became_active":"2023-09-30T22:53:28.523574+0000","last_became_peered":"2023-09-30T22:53:28.523574+0000","last_unstale":"2023-09-30T22:53:28.523916+0000","last_undegraded":"2023-09-30T22:53:28.523916+0000","last_fullsized":"2023-09-30T22:53:28.523916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.503298+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528052+0000","last_change":"2023-09-30T22:53:28.527814+0000","last_active":"2023-09-30T22:53:28.528052+0000","last_peered":"2023-09-30T22:53:28.528052+0000","last_clean":"2023-09-30T22:53:28.528052+0000","last_became_active":"2023-09-30T22:53:28.527339+0000","last_became_peered":"2023-09-30T22:53:28.527339+0000","last_unstale":"2023-09-30T22:53:28.528052+0000","last_undegraded":"2023-09-30T22:53:28.528052+0000","last_fullsized":"2023-09-30T22:53:28.528052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:10.461181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502916+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524484+0000","last_change":"2023-09-30T22:53:28.521854+0000","last_active":"2023-09-30T22:53:28.524484+0000","last_peered":"2023-09-30T22:53:28.524484+0000","last_clean":"2023-09-30T22:53:28.524484+0000","last_became_active":"2023-09-30T22:53:28.521590+0000","last_became_peered":"2023-09-30T22:53:28.521590+0000","last_unstale":"2023-09-30T22:53:28.524484+0000","last_undegraded":"2023-09-30T22:53:28.524484+0000","last_fullsized":"2023-09-30T22:53:28.524484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:07.541785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538839+0000","last_change":"2023-09-30T22:53:27.520637+0000","last_active":"2023-09-30T22:53:28.538839+0000","last_peered":"2023-09-30T22:53:28.538839+0000","last_clean":"2023-09-30T22:53:28.538839+0000","last_became_active":"2023-09-30T22:53:27.519273+0000","last_became_peered":"2023-09-30T22:53:27.519273+0000","last_unstale":"2023-09-30T22:53:28.538839+0000","last_undegraded":"2023-09-30T22:53:28.538839+0000","last_fullsized":"2023-09-30T22:53:28.538839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527146+0000","last_change":"2023-09-30T22:53:28.527020+0000","last_active":"2023-09-30T22:53:28.527146+0000","last_peered":"2023-09-30T22:53:28.527146+0000","last_clean":"2023-09-30T22:53:28.527146+0000","last_became_active":"2023-09-30T22:53:28.526664+0000","last_became_peered":"2023-09-30T22:53:28.526664+0000","last_unstale":"2023-09-30T22:53:28.527146+0000","last_undegraded":"2023-09-30T22:53:28.527146+0000","last_fullsized":"2023-09-30T22:53:28.527146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:13.114495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536461+0000","last_change":"2023-09-30T22:53:27.521604+0000","last_active":"2023-09-30T22:53:28.536461+0000","last_peered":"2023-09-30T22:53:28.536461+0000","last_clean":"2023-09-30T22:53:28.536461+0000","last_became_active":"2023-09-30T22:53:27.521088+0000","last_became_peered":"2023-09-30T22:53:27.521088+0000","last_unstale":"2023-09-30T22:53:28.536461+0000","last_undegraded":"2023-09-30T22:53:28.536461+0000","last_fullsized":"2023-09-30T22:53:28.536461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519512+0000","last_change":"2023-09-30T22:53:28.518412+0000","last_active":"2023-09-30T22:53:28.519512+0000","last_peered":"2023-09-30T22:53:28.519512+0000","last_clean":"2023-09-30T22:53:28.519512+0000","last_became_active":"2023-09-30T22:53:28.517871+0000","last_became_peered":"2023-09-30T22:53:28.517871+0000","last_unstale":"2023-09-30T22:53:28.519512+0000","last_undegraded":"2023-09-30T22:53:28.519512+0000","last_fullsized":"2023-09-30T22:53:28.519512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511856+0000","last_change":"2023-09-30T22:53:27.517581+0000","last_active":"2023-09-30T22:53:28.511856+0000","last_peered":"2023-09-30T22:53:28.511856+0000","last_clean":"2023-09-30T22:53:28.511856+0000","last_became_active":"2023-09-30T22:53:27.517341+0000","last_became_peered":"2023-09-30T22:53:27.517341+0000","last_unstale":"2023-09-30T22:53:28.511856+0000","last_undegraded":"2023-09-30T22:53:28.511856+0000","last_fullsized":"2023-09-30T22:53:28.511856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526246+0000","last_change":"2023-09-30T22:53:28.525685+0000","last_active":"2023-09-30T22:53:28.526246+0000","last_peered":"2023-09-30T22:53:28.526246+0000","last_clean":"2023-09-30T22:53:28.526246+0000","last_became_active":"2023-09-30T22:53:28.525403+0000","last_became_peered":"2023-09-30T22:53:28.525403+0000","last_unstale":"2023-09-30T22:53:28.526246+0000","last_undegraded":"2023-09-30T22:53:28.526246+0000","last_fullsized":"2023-09-30T22:53:28.526246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502937+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513109+0000","last_change":"2023-09-30T22:53:28.513034+0000","last_active":"2023-09-30T22:53:28.513109+0000","last_peered":"2023-09-30T22:53:28.513109+0000","last_clean":"2023-09-30T22:53:28.513109+0000","last_became_active":"2023-09-30T22:53:28.512753+0000","last_became_peered":"2023-09-30T22:53:28.512753+0000","last_unstale":"2023-09-30T22:53:28.513109+0000","last_undegraded":"2023-09-30T22:53:28.513109+0000","last_fullsized":"2023-09-30T22:53:28.513109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538127+0000","last_change":"2023-09-30T22:53:27.516048+0000","last_active":"2023-09-30T22:53:28.538127+0000","last_peered":"2023-09-30T22:53:28.538127+0000","last_clean":"2023-09-30T22:53:28.538127+0000","last_became_active":"2023-09-30T22:53:27.515566+0000","last_became_peered":"2023-09-30T22:53:27.515566+0000","last_unstale":"2023-09-30T22:53:28.538127+0000","last_undegraded":"2023-09-30T22:53:28.538127+0000","last_fullsized":"2023-09-30T22:53:28.538127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:32.867025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519529+0000","last_change":"2023-09-30T22:53:28.518549+0000","last_active":"2023-09-30T22:53:28.519529+0000","last_peered":"2023-09-30T22:53:28.519529+0000","last_clean":"2023-09-30T22:53:28.519529+0000","last_became_active":"2023-09-30T22:53:28.518178+0000","last_became_peered":"2023-09-30T22:53:28.518178+0000","last_unstale":"2023-09-30T22:53:28.519529+0000","last_undegraded":"2023-09-30T22:53:28.519529+0000","last_fullsized":"2023-09-30T22:53:28.519529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.533325+0000","last_change":"2023-09-30T22:53:27.519544+0000","last_active":"2023-09-30T22:53:28.533325+0000","last_peered":"2023-09-30T22:53:28.533325+0000","last_clean":"2023-09-30T22:53:28.533325+0000","last_became_active":"2023-09-30T22:53:27.519269+0000","last_became_peered":"2023-09-30T22:53:27.519269+0000","last_unstale":"2023-09-30T22:53:28.533325+0000","last_undegraded":"2023-09-30T22:53:28.533325+0000","last_fullsized":"2023-09-30T22:53:28.533325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:22.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524412+0000","last_change":"2023-09-30T22:53:28.519623+0000","last_active":"2023-09-30T22:53:28.524412+0000","last_peered":"2023-09-30T22:53:28.524412+0000","last_clean":"2023-09-30T22:53:28.524412+0000","last_became_active":"2023-09-30T22:53:28.519379+0000","last_became_peered":"2023-09-30T22:53:28.519379+0000","last_unstale":"2023-09-30T22:53:28.524412+0000","last_undegraded":"2023-09-30T22:53:28.524412+0000","last_fullsized":"2023-09-30T22:53:28.524412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:43:42.198369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502704+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524371+0000","last_change":"2023-09-30T22:53:28.517717+0000","last_active":"2023-09-30T22:53:28.524371+0000","last_peered":"2023-09-30T22:53:28.524371+0000","last_clean":"2023-09-30T22:53:28.524371+0000","last_became_active":"2023-09-30T22:53:28.517459+0000","last_became_peered":"2023-09-30T22:53:28.517459+0000","last_unstale":"2023-09-30T22:53:28.524371+0000","last_undegraded":"2023-09-30T22:53:28.524371+0000","last_fullsized":"2023-09-30T22:53:28.524371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:04.012099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534031+0000","last_change":"2023-09-30T22:53:27.519451+0000","last_active":"2023-09-30T22:53:28.534031+0000","last_peered":"2023-09-30T22:53:28.534031+0000","last_clean":"2023-09-30T22:53:28.534031+0000","last_became_active":"2023-09-30T22:53:27.519207+0000","last_became_peered":"2023-09-30T22:53:27.519207+0000","last_unstale":"2023-09-30T22:53:28.534031+0000","last_undegraded":"2023-09-30T22:53:28.534031+0000","last_fullsized":"2023-09-30T22:53:28.534031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:54.470913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523493+0000","last_change":"2023-09-30T22:53:28.523288+0000","last_active":"2023-09-30T22:53:28.523493+0000","last_peered":"2023-09-30T22:53:28.523493+0000","last_clean":"2023-09-30T22:53:28.523493+0000","last_became_active":"2023-09-30T22:53:28.522752+0000","last_became_peered":"2023-09-30T22:53:28.522752+0000","last_unstale":"2023-09-30T22:53:28.523493+0000","last_undegraded":"2023-09-30T22:53:28.523493+0000","last_fullsized":"2023-09-30T22:53:28.523493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514427+0000","last_change":"2023-09-30T22:53:27.513959+0000","last_active":"2023-09-30T22:53:28.514427+0000","last_peered":"2023-09-30T22:53:28.514427+0000","last_clean":"2023-09-30T22:53:28.514427+0000","last_became_active":"2023-09-30T22:53:27.513732+0000","last_became_peered":"2023-09-30T22:53:27.513732+0000","last_unstale":"2023-09-30T22:53:28.514427+0000","last_undegraded":"2023-09-30T22:53:28.514427+0000","last_fullsized":"2023-09-30T22:53:28.514427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536715+0000","last_change":"2023-09-30T22:53:27.516148+0000","last_active":"2023-09-30T22:53:28.536715+0000","last_peered":"2023-09-30T22:53:28.536715+0000","last_clean":"2023-09-30T22:53:28.536715+0000","last_became_active":"2023-09-30T22:53:27.514962+0000","last_became_peered":"2023-09-30T22:53:27.514962+0000","last_unstale":"2023-09-30T22:53:28.536715+0000","last_undegraded":"2023-09-30T22:53:28.536715+0000","last_fullsized":"2023-09-30T22:53:28.536715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:55.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525445+0000","last_change":"2023-09-30T22:53:28.525377+0000","last_active":"2023-09-30T22:53:28.525445+0000","last_peered":"2023-09-30T22:53:28.525445+0000","last_clean":"2023-09-30T22:53:28.525445+0000","last_became_active":"2023-09-30T22:53:28.525124+0000","last_became_peered":"2023-09-30T22:53:28.525124+0000","last_unstale":"2023-09-30T22:53:28.525445+0000","last_undegraded":"2023-09-30T22:53:28.525445+0000","last_fullsized":"2023-09-30T22:53:28.525445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:51:22.092802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511256+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.511256+0000","last_peered":"2023-09-30T22:53:28.511256+0000","last_clean":"2023-09-30T22:53:28.511256+0000","last_became_active":"2023-09-30T22:53:27.516236+0000","last_became_peered":"2023-09-30T22:53:27.516236+0000","last_unstale":"2023-09-30T22:53:28.511256+0000","last_undegraded":"2023-09-30T22:53:28.511256+0000","last_fullsized":"2023-09-30T22:53:28.511256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526264+0000","last_change":"2023-09-30T22:53:28.526005+0000","last_active":"2023-09-30T22:53:28.526264+0000","last_peered":"2023-09-30T22:53:28.526264+0000","last_clean":"2023-09-30T22:53:28.526264+0000","last_became_active":"2023-09-30T22:53:28.525429+0000","last_became_peered":"2023-09-30T22:53:28.525429+0000","last_unstale":"2023-09-30T22:53:28.526264+0000","last_undegraded":"2023-09-30T22:53:28.526264+0000","last_fullsized":"2023-09-30T22:53:28.526264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515992+0000","last_change":"2023-09-30T22:53:27.519633+0000","last_active":"2023-09-30T22:53:28.515992+0000","last_peered":"2023-09-30T22:53:28.515992+0000","last_clean":"2023-09-30T22:53:28.515992+0000","last_became_active":"2023-09-30T22:53:27.519232+0000","last_became_peered":"2023-09-30T22:53:27.519232+0000","last_unstale":"2023-09-30T22:53:28.515992+0000","last_undegraded":"2023-09-30T22:53:28.515992+0000","last_fullsized":"2023-09-30T22:53:28.515992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:51.349781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527132+0000","last_change":"2023-09-30T22:53:28.526862+0000","last_active":"2023-09-30T22:53:28.527132+0000","last_peered":"2023-09-30T22:53:28.527132+0000","last_clean":"2023-09-30T22:53:28.527132+0000","last_became_active":"2023-09-30T22:53:28.526232+0000","last_became_peered":"2023-09-30T22:53:28.526232+0000","last_unstale":"2023-09-30T22:53:28.527132+0000","last_undegraded":"2023-09-30T22:53:28.527132+0000","last_fullsized":"2023-09-30T22:53:28.527132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:17.258231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.512067+0000","last_change":"2023-09-30T22:53:27.520705+0000","last_active":"2023-09-30T22:53:28.512067+0000","last_peered":"2023-09-30T22:53:28.512067+0000","last_clean":"2023-09-30T22:53:28.512067+0000","last_became_active":"2023-09-30T22:53:27.520103+0000","last_became_peered":"2023-09-30T22:53:27.520103+0000","last_unstale":"2023-09-30T22:53:28.512067+0000","last_undegraded":"2023-09-30T22:53:28.512067+0000","last_fullsized":"2023-09-30T22:53:28.512067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:24.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521264+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521264+0000","last_peered":"2023-09-30T22:53:28.521264+0000","last_clean":"2023-09-30T22:53:28.521264+0000","last_became_active":"2023-09-30T22:53:28.520956+0000","last_became_peered":"2023-09-30T22:53:28.520956+0000","last_unstale":"2023-09-30T22:53:28.521264+0000","last_undegraded":"2023-09-30T22:53:28.521264+0000","last_fullsized":"2023-09-30T22:53:28.521264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518003+0000","last_change":"2023-09-30T22:53:27.516312+0000","last_active":"2023-09-30T22:53:28.518003+0000","last_peered":"2023-09-30T22:53:28.518003+0000","last_clean":"2023-09-30T22:53:28.518003+0000","last_became_active":"2023-09-30T22:53:27.516077+0000","last_became_peered":"2023-09-30T22:53:27.516077+0000","last_unstale":"2023-09-30T22:53:28.518003+0000","last_undegraded":"2023-09-30T22:53:28.518003+0000","last_fullsized":"2023-09-30T22:53:28.518003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:23.956508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514093+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:53:28.514093+0000","last_peered":"2023-09-30T22:53:28.514093+0000","last_clean":"2023-09-30T22:53:28.514093+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:53:28.514093+0000","last_undegraded":"2023-09-30T22:53:28.514093+0000","last_fullsized":"2023-09-30T22:53:28.514093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520799+0000","last_change":"2023-09-30T22:53:28.520729+0000","last_active":"2023-09-30T22:53:28.520799+0000","last_peered":"2023-09-30T22:53:28.520799+0000","last_clean":"2023-09-30T22:53:28.520799+0000","last_became_active":"2023-09-30T22:53:28.520513+0000","last_became_peered":"2023-09-30T22:53:28.520513+0000","last_unstale":"2023-09-30T22:53:28.520799+0000","last_undegraded":"2023-09-30T22:53:28.520799+0000","last_fullsized":"2023-09-30T22:53:28.520799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509593+0000","last_change":"2023-09-30T22:53:27.518551+0000","last_active":"2023-09-30T22:53:28.509593+0000","last_peered":"2023-09-30T22:53:28.509593+0000","last_clean":"2023-09-30T22:53:28.509593+0000","last_became_active":"2023-09-30T22:53:27.518302+0000","last_became_peered":"2023-09-30T22:53:27.518302+0000","last_unstale":"2023-09-30T22:53:28.509593+0000","last_undegraded":"2023-09-30T22:53:28.509593+0000","last_fullsized":"2023-09-30T22:53:28.509593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:47.454460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277246+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:53:20.277246+0000","last_peered":"2023-09-30T22:53:20.277246+0000","last_clean":"2023-09-30T22:53:20.277246+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:53:20.277246+0000","last_undegraded":"2023-09-30T22:53:20.277246+0000","last_fullsized":"2023-09-30T22:53:20.277246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526279+0000","last_change":"2023-09-30T22:53:28.526154+0000","last_active":"2023-09-30T22:53:28.526279+0000","last_peered":"2023-09-30T22:53:28.526279+0000","last_clean":"2023-09-30T22:53:28.526279+0000","last_became_active":"2023-09-30T22:53:28.525783+0000","last_became_peered":"2023-09-30T22:53:28.525783+0000","last_unstale":"2023-09-30T22:53:28.526279+0000","last_undegraded":"2023-09-30T22:53:28.526279+0000","last_fullsized":"2023-09-30T22:53:28.526279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508773+0000","last_change":"2023-09-30T22:53:27.518889+0000","last_active":"2023-09-30T22:53:28.508773+0000","last_peered":"2023-09-30T22:53:28.508773+0000","last_clean":"2023-09-30T22:53:28.508773+0000","last_became_active":"2023-09-30T22:53:27.518640+0000","last_became_peered":"2023-09-30T22:53:27.518640+0000","last_unstale":"2023-09-30T22:53:28.508773+0000","last_undegraded":"2023-09-30T22:53:28.508773+0000","last_fullsized":"2023-09-30T22:53:28.508773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:24.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508872+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:53:28.508872+0000","last_peered":"2023-09-30T22:53:28.508872+0000","last_clean":"2023-09-30T22:53:28.508872+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:53:28.508872+0000","last_undegraded":"2023-09-30T22:53:28.508872+0000","last_fullsized":"2023-09-30T22:53:28.508872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517216+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.517216+0000","last_peered":"2023-09-30T22:53:28.517216+0000","last_clean":"2023-09-30T22:53:28.517216+0000","last_became_active":"2023-09-30T22:53:27.516261+0000","last_became_peered":"2023-09-30T22:53:27.516261+0000","last_unstale":"2023-09-30T22:53:28.517216+0000","last_undegraded":"2023-09-30T22:53:28.517216+0000","last_fullsized":"2023-09-30T22:53:28.517216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:22.220152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277304+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:53:20.277304+0000","last_peered":"2023-09-30T22:53:20.277304+0000","last_clean":"2023-09-30T22:53:20.277304+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:53:20.277304+0000","last_undegraded":"2023-09-30T22:53:20.277304+0000","last_fullsized":"2023-09-30T22:53:20.277304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513331+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:53:28.513331+0000","last_peered":"2023-09-30T22:53:28.513331+0000","last_clean":"2023-09-30T22:53:28.513331+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:53:28.513331+0000","last_undegraded":"2023-09-30T22:53:28.513331+0000","last_fullsized":"2023-09-30T22:53:28.513331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521299+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521299+0000","last_peered":"2023-09-30T22:53:28.521299+0000","last_clean":"2023-09-30T22:53:28.521299+0000","last_became_active":"2023-09-30T22:53:28.520925+0000","last_became_peered":"2023-09-30T22:53:28.520925+0000","last_unstale":"2023-09-30T22:53:28.521299+0000","last_undegraded":"2023-09-30T22:53:28.521299+0000","last_fullsized":"2023-09-30T22:53:28.521299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502591+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277246+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:53:20.277246+0000","last_peered":"2023-09-30T22:53:20.277246+0000","last_clean":"2023-09-30T22:53:20.277246+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:53:20.277246+0000","last_undegraded":"2023-09-30T22:53:20.277246+0000","last_fullsized":"2023-09-30T22:53:20.277246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521298+0000","last_change":"2023-09-30T22:53:28.521190+0000","last_active":"2023-09-30T22:53:28.521298+0000","last_peered":"2023-09-30T22:53:28.521298+0000","last_clean":"2023-09-30T22:53:28.521298+0000","last_became_active":"2023-09-30T22:53:28.520955+0000","last_became_peered":"2023-09-30T22:53:28.520955+0000","last_unstale":"2023-09-30T22:53:28.521298+0000","last_undegraded":"2023-09-30T22:53:28.521298+0000","last_fullsized":"2023-09-30T22:53:28.521298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517510+0000","last_change":"2023-09-30T22:53:27.516490+0000","last_active":"2023-09-30T22:53:28.517510+0000","last_peered":"2023-09-30T22:53:28.517510+0000","last_clean":"2023-09-30T22:53:28.517510+0000","last_became_active":"2023-09-30T22:53:27.516254+0000","last_became_peered":"2023-09-30T22:53:27.516254+0000","last_unstale":"2023-09-30T22:53:28.517510+0000","last_undegraded":"2023-09-30T22:53:28.517510+0000","last_fullsized":"2023-09-30T22:53:28.517510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:33:29.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277456+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:53:20.277456+0000","last_peered":"2023-09-30T22:53:20.277456+0000","last_clean":"2023-09-30T22:53:20.277456+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:53:20.277456+0000","last_undegraded":"2023-09-30T22:53:20.277456+0000","last_fullsized":"2023-09-30T22:53:20.277456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502576+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518201+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:53:28.518201+0000","last_peered":"2023-09-30T22:53:28.518201+0000","last_clean":"2023-09-30T22:53:28.518201+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:53:28.518201+0000","last_undegraded":"2023-09-30T22:53:28.518201+0000","last_fullsized":"2023-09-30T22:53:28.518201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519732+0000","last_change":"2023-09-30T22:53:28.519554+0000","last_active":"2023-09-30T22:53:28.519732+0000","last_peered":"2023-09-30T22:53:28.519732+0000","last_clean":"2023-09-30T22:53:28.519732+0000","last_became_active":"2023-09-30T22:53:28.519318+0000","last_became_peered":"2023-09-30T22:53:28.519318+0000","last_unstale":"2023-09-30T22:53:28.519732+0000","last_undegraded":"2023-09-30T22:53:28.519732+0000","last_fullsized":"2023-09-30T22:53:28.519732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520210+0000","last_change":"2023-09-30T22:53:27.520302+0000","last_active":"2023-09-30T22:53:28.520210+0000","last_peered":"2023-09-30T22:53:28.520210+0000","last_clean":"2023-09-30T22:53:28.520210+0000","last_became_active":"2023-09-30T22:53:27.518956+0000","last_became_peered":"2023-09-30T22:53:27.518956+0000","last_unstale":"2023-09-30T22:53:28.520210+0000","last_undegraded":"2023-09-30T22:53:28.520210+0000","last_fullsized":"2023-09-30T22:53:28.520210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277400+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:53:20.277400+0000","last_peered":"2023-09-30T22:53:20.277400+0000","last_clean":"2023-09-30T22:53:20.277400+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:53:20.277400+0000","last_undegraded":"2023-09-30T22:53:20.277400+0000","last_fullsized":"2023-09-30T22:53:20.277400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.624},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.752}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838200,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.79100000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.74399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.879}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.0249999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.96599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.374},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.504},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.442}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.036}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":1.22},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.0740000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":1.21}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":1.2330000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46800000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.434}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.871},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.81699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":160,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.434}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.179},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.377},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.502}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":159,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65800000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.78000000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70799999999999996}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77100000000000002}]}]}],"pool_statfs":[]}} 2023-09-30T22:53:33.337 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:53:33.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.558+0000 7f798f9ff700 1 Processor -- start 2023-09-30T22:53:33.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.558+0000 7f798f9ff700 1 -- start start 2023-09-30T22:53:33.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.559+0000 7f798f9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f79880af020 0x7f7988156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.559+0000 7f798f9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79880b00d0 0x7f798806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798f9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798806d3e0 con 0x7f798806e650 2023-09-30T22:53:33.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798f9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798815b400 con 0x7f79880af020 2023-09-30T22:53:33.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798f9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798806dc80 con 0x7f79880b00d0 2023-09-30T22:53:33.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798d79b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f79880af020 0x7f7988156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798cf9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79880b00d0 0x7f798806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798cf9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79880b00d0 0x7f798806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:41000/0 (socket says 172.21.15.142:41000) 2023-09-30T22:53:33.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798cf9a700 1 -- 172.21.15.142:0/558301169 learned_addr learned my addr 172.21.15.142:0/558301169 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:33.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.560+0000 7f798df9c700 1 --1- 172.21.15.142:0/558301169 >> v1:172.21.15.148:6789/0 conn(0x7f798806e650 0x7f79880b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:39446/0 (socket says 172.21.15.142:39446) 2023-09-30T22:53:33.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f797ffff700 1 -- 172.21.15.142:0/558301169 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013042976 0 0) 0x7f798806d3e0 con 0x7f798806e650 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f797ffff700 1 -- 172.21.15.142:0/558301169 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7974003570 con 0x7f798806e650 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f798d79b700 1 -- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79880b00d0 msgr2=0x7f798806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f798d79b700 1 --2- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79880b00d0 0x7f798806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f798d79b700 1 -- 172.21.15.142:0/558301169 >> v1:172.21.15.148:6789/0 conn(0x7f798806e650 legacy=0x7f79880b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f798d79b700 1 -- 172.21.15.142:0/558301169 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798806b790 con 0x7f79880af020 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f798cf9a700 1 --2- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79880b00d0 0x7f798806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f798d79b700 1 --2- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880af020 0x7f7988156d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f79840098e0 tx=0x7f79840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939097aea56c86d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f797ffff700 1 -- 172.21.15.142:0/558301169 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984011630 con 0x7f79880af020 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f797ffff700 1 -- 172.21.15.142:0/558301169 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984011790 con 0x7f79880af020 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.561+0000 7f797ffff700 1 -- 172.21.15.142:0/558301169 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984011b30 con 0x7f79880af020 2023-09-30T22:53:33.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 -- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880af020 msgr2=0x7f7988156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 --2- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880af020 0x7f7988156d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f79840098e0 tx=0x7f79840091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 -- 172.21.15.142:0/558301169 shutdown_connections 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 --2- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880af020 0x7f7988156d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 --2- 172.21.15.142:0/558301169 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79880b00d0 0x7f798806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 -- 172.21.15.142:0/558301169 >> 172.21.15.142:0/558301169 conn(0x7f79880680c0 msgr2=0x7f79880c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 -- 172.21.15.142:0/558301169 shutdown_connections 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.562+0000 7f798f9ff700 1 -- 172.21.15.142:0/558301169 wait complete. 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.563+0000 7f798f9ff700 1 Processor -- start 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.564+0000 7f798f9ff700 1 -- start start 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.564+0000 7f798f9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f798806e650 0x7f798813d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.564+0000 7f798f9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79880af020 0x7f79880c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.564+0000 7f798f9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880b00d0 0x7f79880c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.564+0000 7f798f9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798816c150 con 0x7f79880af020 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.564+0000 7f798f9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798816c430 con 0x7f79880b00d0 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.564+0000 7f798f9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798816c710 con 0x7f798806e650 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79880af020 0x7f79880c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79880af020 0x7f79880c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47100/0 (socket says 172.21.15.142:47100) 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 -- 172.21.15.142:0/2374331349 learned_addr learned my addr 172.21.15.142:0/2374331349 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798df9c700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880b00d0 0x7f79880c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798d79b700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f798806e650 0x7f798813d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 -- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f798806e650 msgr2=0x7f798813d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f798806e650 0x7f798813d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 -- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880b00d0 msgr2=0x7f79880c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880b00d0 0x7f79880c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 -- 172.21.15.142:0/2374331349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780094f0 con 0x7f79880af020 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798df9c700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880b00d0 0x7f79880c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798d79b700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f798806e650 0x7f798813d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.565+0000 7f798cf9a700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79880af020 0x7f79880c5ec0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f797800ec50 tx=0x7f7978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.566+0000 7f797d7fa700 1 -- 172.21.15.142:0/2374331349 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800c9d0 con 0x7f79880af020 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.566+0000 7f797d7fa700 1 -- 172.21.15.142:0/2374331349 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797800cb30 con 0x7f79880af020 2023-09-30T22:53:33.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.566+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7984009420 con 0x7f79880af020 2023-09-30T22:53:33.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.566+0000 7f797d7fa700 1 -- 172.21.15.142:0/2374331349 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978013470 con 0x7f79880af020 2023-09-30T22:53:33.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.566+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798816ccd0 con 0x7f79880af020 2023-09-30T22:53:33.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.567+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79880c8730 con 0x7f79880af020 2023-09-30T22:53:33.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.568+0000 7f797d7fa700 1 -- 172.21.15.142:0/2374331349 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7978013860 con 0x7f79880af020 2023-09-30T22:53:33.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.569+0000 7f797d7fa700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f796c067330 0x7f796c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:33.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.569+0000 7f797d7fa700 1 -- 172.21.15.142:0/2374331349 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7978085320 con 0x7f79880af020 2023-09-30T22:53:33.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.569+0000 7f798d79b700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f796c067330 0x7f796c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:33.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.570+0000 7f798d79b700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f796c067330 0x7f796c0697e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79840091e0 tx=0x7f7984017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:33.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.573+0000 7f797d7fa700 1 -- 172.21.15.142:0/2374331349 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7978052220 con 0x7f79880af020 2023-09-30T22:53:33.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.761+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7988162510 con 0x7f796c067330 2023-09-30T22:53:33.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.769+0000 7f797d7fa700 1 -- 172.21.15.142:0/2374331349 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301842 (secure 0 0 0) 0x7f7988162510 con 0x7f796c067330 2023-09-30T22:53:33.773 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f796c067330 msgr2=0x7f796c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f796c067330 0x7f796c0697e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79840091e0 tx=0x7f7984017000 comp rx=0 tx=0).stop 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79880af020 msgr2=0x7f79880c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79880af020 0x7f79880c5ec0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f797800ec50 tx=0x7f7978009250 comp rx=0 tx=0).stop 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 shutdown_connections 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f796c067330 0x7f796c0697e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79880b00d0 0x7f79880c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f798806e650 0x7f798813d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 --2- 172.21.15.142:0/2374331349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79880af020 0x7f79880c5ec0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 >> 172.21.15.142:0/2374331349 conn(0x7f79880680c0 msgr2=0x7f7988159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:33.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 shutdown_connections 2023-09-30T22:53:33.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:33.774+0000 7f798f9ff700 1 -- 172.21.15.142:0/2374331349 wait complete. 2023-09-30T22:53:33.777 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:53:33.791 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-09-30T22:53:32.115178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592584,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2395,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560104,"statfs":{"total":1600000000,"available":1597547145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.613468"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522036+0000","last_change":"2023-09-30T22:53:28.521844+0000","last_active":"2023-09-30T22:53:28.522036+0000","last_peered":"2023-09-30T22:53:28.522036+0000","last_clean":"2023-09-30T22:53:28.522036+0000","last_became_active":"2023-09-30T22:53:28.521523+0000","last_became_peered":"2023-09-30T22:53:28.521523+0000","last_unstale":"2023-09-30T22:53:28.522036+0000","last_undegraded":"2023-09-30T22:53:28.522036+0000","last_fullsized":"2023-09-30T22:53:28.522036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:59.351514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513441+0000","last_change":"2023-09-30T22:53:28.513362+0000","last_active":"2023-09-30T22:53:28.513441+0000","last_peered":"2023-09-30T22:53:28.513441+0000","last_clean":"2023-09-30T22:53:28.513441+0000","last_became_active":"2023-09-30T22:53:28.513102+0000","last_became_peered":"2023-09-30T22:53:28.513102+0000","last_unstale":"2023-09-30T22:53:28.513441+0000","last_undegraded":"2023-09-30T22:53:28.513441+0000","last_fullsized":"2023-09-30T22:53:28.513441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:50.326775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523601+0000","last_change":"2023-09-30T22:53:28.523032+0000","last_active":"2023-09-30T22:53:28.523601+0000","last_peered":"2023-09-30T22:53:28.523601+0000","last_clean":"2023-09-30T22:53:28.523601+0000","last_became_active":"2023-09-30T22:53:28.522810+0000","last_became_peered":"2023-09-30T22:53:28.522810+0000","last_unstale":"2023-09-30T22:53:28.523601+0000","last_undegraded":"2023-09-30T22:53:28.523601+0000","last_fullsized":"2023-09-30T22:53:28.523601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:53.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524515+0000","last_change":"2023-09-30T22:53:28.524309+0000","last_active":"2023-09-30T22:53:28.524515+0000","last_peered":"2023-09-30T22:53:28.524515+0000","last_clean":"2023-09-30T22:53:28.524515+0000","last_became_active":"2023-09-30T22:53:28.523815+0000","last_became_peered":"2023-09-30T22:53:28.523815+0000","last_unstale":"2023-09-30T22:53:28.524515+0000","last_undegraded":"2023-09-30T22:53:28.524515+0000","last_fullsized":"2023-09-30T22:53:28.524515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:56.402195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523891+0000","last_change":"2023-09-30T22:53:28.523789+0000","last_active":"2023-09-30T22:53:28.523891+0000","last_peered":"2023-09-30T22:53:28.523891+0000","last_clean":"2023-09-30T22:53:28.523891+0000","last_became_active":"2023-09-30T22:53:28.523542+0000","last_became_peered":"2023-09-30T22:53:28.523542+0000","last_unstale":"2023-09-30T22:53:28.523891+0000","last_undegraded":"2023-09-30T22:53:28.523891+0000","last_fullsized":"2023-09-30T22:53:28.523891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515993+0000","last_change":"2023-09-30T22:53:28.515784+0000","last_active":"2023-09-30T22:53:28.515993+0000","last_peered":"2023-09-30T22:53:28.515993+0000","last_clean":"2023-09-30T22:53:28.515993+0000","last_became_active":"2023-09-30T22:53:28.515565+0000","last_became_peered":"2023-09-30T22:53:28.515565+0000","last_unstale":"2023-09-30T22:53:28.515993+0000","last_undegraded":"2023-09-30T22:53:28.515993+0000","last_fullsized":"2023-09-30T22:53:28.515993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:53.264810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525125+0000","last_change":"2023-09-30T22:53:28.524944+0000","last_active":"2023-09-30T22:53:28.525125+0000","last_peered":"2023-09-30T22:53:28.525125+0000","last_clean":"2023-09-30T22:53:28.525125+0000","last_became_active":"2023-09-30T22:53:28.523435+0000","last_became_peered":"2023-09-30T22:53:28.523435+0000","last_unstale":"2023-09-30T22:53:28.525125+0000","last_undegraded":"2023-09-30T22:53:28.525125+0000","last_fullsized":"2023-09-30T22:53:28.525125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:18.496971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527102+0000","last_change":"2023-09-30T22:53:28.526469+0000","last_active":"2023-09-30T22:53:28.527102+0000","last_peered":"2023-09-30T22:53:28.527102+0000","last_clean":"2023-09-30T22:53:28.527102+0000","last_became_active":"2023-09-30T22:53:28.525921+0000","last_became_peered":"2023-09-30T22:53:28.525921+0000","last_unstale":"2023-09-30T22:53:28.527102+0000","last_undegraded":"2023-09-30T22:53:28.527102+0000","last_fullsized":"2023-09-30T22:53:28.527102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:57.146828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511245+0000","last_change":"2023-09-30T22:53:28.511148+0000","last_active":"2023-09-30T22:53:28.511245+0000","last_peered":"2023-09-30T22:53:28.511245+0000","last_clean":"2023-09-30T22:53:28.511245+0000","last_became_active":"2023-09-30T22:53:28.510877+0000","last_became_peered":"2023-09-30T22:53:28.510877+0000","last_unstale":"2023-09-30T22:53:28.511245+0000","last_undegraded":"2023-09-30T22:53:28.511245+0000","last_fullsized":"2023-09-30T22:53:28.511245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524522+0000","last_change":"2023-09-30T22:53:28.523149+0000","last_active":"2023-09-30T22:53:28.524522+0000","last_peered":"2023-09-30T22:53:28.524522+0000","last_clean":"2023-09-30T22:53:28.524522+0000","last_became_active":"2023-09-30T22:53:28.522693+0000","last_became_peered":"2023-09-30T22:53:28.522693+0000","last_unstale":"2023-09-30T22:53:28.524522+0000","last_undegraded":"2023-09-30T22:53:28.524522+0000","last_fullsized":"2023-09-30T22:53:28.524522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:24.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526829+0000","last_change":"2023-09-30T22:53:28.526578+0000","last_active":"2023-09-30T22:53:28.526829+0000","last_peered":"2023-09-30T22:53:28.526829+0000","last_clean":"2023-09-30T22:53:28.526829+0000","last_became_active":"2023-09-30T22:53:28.526345+0000","last_became_peered":"2023-09-30T22:53:28.526345+0000","last_unstale":"2023-09-30T22:53:28.526829+0000","last_undegraded":"2023-09-30T22:53:28.526829+0000","last_fullsized":"2023-09-30T22:53:28.526829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513911+0000","last_change":"2023-09-30T22:53:28.513759+0000","last_active":"2023-09-30T22:53:28.513911+0000","last_peered":"2023-09-30T22:53:28.513911+0000","last_clean":"2023-09-30T22:53:28.513911+0000","last_became_active":"2023-09-30T22:53:28.513397+0000","last_became_peered":"2023-09-30T22:53:28.513397+0000","last_unstale":"2023-09-30T22:53:28.513911+0000","last_undegraded":"2023-09-30T22:53:28.513911+0000","last_fullsized":"2023-09-30T22:53:28.513911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517049+0000","last_change":"2023-09-30T22:53:28.516976+0000","last_active":"2023-09-30T22:53:28.517049+0000","last_peered":"2023-09-30T22:53:28.517049+0000","last_clean":"2023-09-30T22:53:28.517049+0000","last_became_active":"2023-09-30T22:53:28.516752+0000","last_became_peered":"2023-09-30T22:53:28.516752+0000","last_unstale":"2023-09-30T22:53:28.517049+0000","last_undegraded":"2023-09-30T22:53:28.517049+0000","last_fullsized":"2023-09-30T22:53:28.517049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:14.222289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520873+0000","last_change":"2023-09-30T22:53:28.520771+0000","last_active":"2023-09-30T22:53:28.520873+0000","last_peered":"2023-09-30T22:53:28.520873+0000","last_clean":"2023-09-30T22:53:28.520873+0000","last_became_active":"2023-09-30T22:53:28.520479+0000","last_became_peered":"2023-09-30T22:53:28.520479+0000","last_unstale":"2023-09-30T22:53:28.520873+0000","last_undegraded":"2023-09-30T22:53:28.520873+0000","last_fullsized":"2023-09-30T22:53:28.520873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524568+0000","last_change":"2023-09-30T22:53:28.524203+0000","last_active":"2023-09-30T22:53:28.524568+0000","last_peered":"2023-09-30T22:53:28.524568+0000","last_clean":"2023-09-30T22:53:28.524568+0000","last_became_active":"2023-09-30T22:53:28.523569+0000","last_became_peered":"2023-09-30T22:53:28.523569+0000","last_unstale":"2023-09-30T22:53:28.524568+0000","last_undegraded":"2023-09-30T22:53:28.524568+0000","last_fullsized":"2023-09-30T22:53:28.524568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:48:48.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523512+0000","last_change":"2023-09-30T22:53:28.523441+0000","last_active":"2023-09-30T22:53:28.523512+0000","last_peered":"2023-09-30T22:53:28.523512+0000","last_clean":"2023-09-30T22:53:28.523512+0000","last_became_active":"2023-09-30T22:53:28.523060+0000","last_became_peered":"2023-09-30T22:53:28.523060+0000","last_unstale":"2023-09-30T22:53:28.523512+0000","last_undegraded":"2023-09-30T22:53:28.523512+0000","last_fullsized":"2023-09-30T22:53:28.523512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521320+0000","last_change":"2023-09-30T22:53:28.521259+0000","last_active":"2023-09-30T22:53:28.521320+0000","last_peered":"2023-09-30T22:53:28.521320+0000","last_clean":"2023-09-30T22:53:28.521320+0000","last_became_active":"2023-09-30T22:53:28.520791+0000","last_became_peered":"2023-09-30T22:53:28.520791+0000","last_unstale":"2023-09-30T22:53:28.521320+0000","last_undegraded":"2023-09-30T22:53:28.521320+0000","last_fullsized":"2023-09-30T22:53:28.521320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523920+0000","last_change":"2023-09-30T22:53:28.523845+0000","last_active":"2023-09-30T22:53:28.523920+0000","last_peered":"2023-09-30T22:53:28.523920+0000","last_clean":"2023-09-30T22:53:28.523920+0000","last_became_active":"2023-09-30T22:53:28.523587+0000","last_became_peered":"2023-09-30T22:53:28.523587+0000","last_unstale":"2023-09-30T22:53:28.523920+0000","last_undegraded":"2023-09-30T22:53:28.523920+0000","last_fullsized":"2023-09-30T22:53:28.523920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521215+0000","last_change":"2023-09-30T22:53:28.521142+0000","last_active":"2023-09-30T22:53:28.521215+0000","last_peered":"2023-09-30T22:53:28.521215+0000","last_clean":"2023-09-30T22:53:28.521215+0000","last_became_active":"2023-09-30T22:53:28.520866+0000","last_became_peered":"2023-09-30T22:53:28.520866+0000","last_unstale":"2023-09-30T22:53:28.521215+0000","last_undegraded":"2023-09-30T22:53:28.521215+0000","last_fullsized":"2023-09-30T22:53:28.521215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528033+0000","last_change":"2023-09-30T22:53:28.527707+0000","last_active":"2023-09-30T22:53:28.528033+0000","last_peered":"2023-09-30T22:53:28.528033+0000","last_clean":"2023-09-30T22:53:28.528033+0000","last_became_active":"2023-09-30T22:53:28.527483+0000","last_became_peered":"2023-09-30T22:53:28.527483+0000","last_unstale":"2023-09-30T22:53:28.528033+0000","last_undegraded":"2023-09-30T22:53:28.528033+0000","last_fullsized":"2023-09-30T22:53:28.528033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:06.946949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519144+0000","last_change":"2023-09-30T22:53:28.519070+0000","last_active":"2023-09-30T22:53:28.519144+0000","last_peered":"2023-09-30T22:53:28.519144+0000","last_clean":"2023-09-30T22:53:28.519144+0000","last_became_active":"2023-09-30T22:53:28.518852+0000","last_became_peered":"2023-09-30T22:53:28.518852+0000","last_unstale":"2023-09-30T22:53:28.519144+0000","last_undegraded":"2023-09-30T22:53:28.519144+0000","last_fullsized":"2023-09-30T22:53:28.519144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527117+0000","last_change":"2023-09-30T22:53:28.526708+0000","last_active":"2023-09-30T22:53:28.527117+0000","last_peered":"2023-09-30T22:53:28.527117+0000","last_clean":"2023-09-30T22:53:28.527117+0000","last_became_active":"2023-09-30T22:53:28.526478+0000","last_became_peered":"2023-09-30T22:53:28.526478+0000","last_unstale":"2023-09-30T22:53:28.527117+0000","last_undegraded":"2023-09-30T22:53:28.527117+0000","last_fullsized":"2023-09-30T22:53:28.527117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:57:09.485295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524561+0000","last_change":"2023-09-30T22:53:28.524489+0000","last_active":"2023-09-30T22:53:28.524561+0000","last_peered":"2023-09-30T22:53:28.524561+0000","last_clean":"2023-09-30T22:53:28.524561+0000","last_became_active":"2023-09-30T22:53:28.524252+0000","last_became_peered":"2023-09-30T22:53:28.524252+0000","last_unstale":"2023-09-30T22:53:28.524561+0000","last_undegraded":"2023-09-30T22:53:28.524561+0000","last_fullsized":"2023-09-30T22:53:28.524561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524505+0000","last_change":"2023-09-30T22:53:28.522426+0000","last_active":"2023-09-30T22:53:28.524505+0000","last_peered":"2023-09-30T22:53:28.524505+0000","last_clean":"2023-09-30T22:53:28.524505+0000","last_became_active":"2023-09-30T22:53:28.521202+0000","last_became_peered":"2023-09-30T22:53:28.521202+0000","last_unstale":"2023-09-30T22:53:28.524505+0000","last_undegraded":"2023-09-30T22:53:28.524505+0000","last_fullsized":"2023-09-30T22:53:28.524505+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:23.130881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524590+0000","last_change":"2023-09-30T22:53:28.524378+0000","last_active":"2023-09-30T22:53:28.524590+0000","last_peered":"2023-09-30T22:53:28.524590+0000","last_clean":"2023-09-30T22:53:28.524590+0000","last_became_active":"2023-09-30T22:53:28.523927+0000","last_became_peered":"2023-09-30T22:53:28.523927+0000","last_unstale":"2023-09-30T22:53:28.524590+0000","last_undegraded":"2023-09-30T22:53:28.524590+0000","last_fullsized":"2023-09-30T22:53:28.524590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:50.593476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528068+0000","last_change":"2023-09-30T22:53:28.527965+0000","last_active":"2023-09-30T22:53:28.528068+0000","last_peered":"2023-09-30T22:53:28.528068+0000","last_clean":"2023-09-30T22:53:28.528068+0000","last_became_active":"2023-09-30T22:53:28.527612+0000","last_became_peered":"2023-09-30T22:53:28.527612+0000","last_unstale":"2023-09-30T22:53:28.528068+0000","last_undegraded":"2023-09-30T22:53:28.528068+0000","last_fullsized":"2023-09-30T22:53:28.528068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:39.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538999+0000","last_change":"2023-09-30T22:53:27.516465+0000","last_active":"2023-09-30T22:53:28.538999+0000","last_peered":"2023-09-30T22:53:28.538999+0000","last_clean":"2023-09-30T22:53:28.538999+0000","last_became_active":"2023-09-30T22:53:27.516253+0000","last_became_peered":"2023-09-30T22:53:27.516253+0000","last_unstale":"2023-09-30T22:53:28.538999+0000","last_undegraded":"2023-09-30T22:53:28.538999+0000","last_fullsized":"2023-09-30T22:53:28.538999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522280+0000","last_change":"2023-09-30T22:53:28.522137+0000","last_active":"2023-09-30T22:53:28.522280+0000","last_peered":"2023-09-30T22:53:28.522280+0000","last_clean":"2023-09-30T22:53:28.522280+0000","last_became_active":"2023-09-30T22:53:28.521672+0000","last_became_peered":"2023-09-30T22:53:28.521672+0000","last_unstale":"2023-09-30T22:53:28.522280+0000","last_undegraded":"2023-09-30T22:53:28.522280+0000","last_fullsized":"2023-09-30T22:53:28.522280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:13.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534160+0000","last_change":"2023-09-30T22:53:27.513083+0000","last_active":"2023-09-30T22:53:28.534160+0000","last_peered":"2023-09-30T22:53:28.534160+0000","last_clean":"2023-09-30T22:53:28.534160+0000","last_became_active":"2023-09-30T22:53:27.512830+0000","last_became_peered":"2023-09-30T22:53:27.512830+0000","last_unstale":"2023-09-30T22:53:28.534160+0000","last_undegraded":"2023-09-30T22:53:28.534160+0000","last_fullsized":"2023-09-30T22:53:28.534160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536132+0000","last_change":"2023-09-30T22:53:27.521745+0000","last_active":"2023-09-30T22:53:28.536132+0000","last_peered":"2023-09-30T22:53:28.536132+0000","last_clean":"2023-09-30T22:53:28.536132+0000","last_became_active":"2023-09-30T22:53:27.521383+0000","last_became_peered":"2023-09-30T22:53:27.521383+0000","last_unstale":"2023-09-30T22:53:28.536132+0000","last_undegraded":"2023-09-30T22:53:28.536132+0000","last_fullsized":"2023-09-30T22:53:28.536132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519546+0000","last_change":"2023-09-30T22:53:28.519421+0000","last_active":"2023-09-30T22:53:28.519546+0000","last_peered":"2023-09-30T22:53:28.519546+0000","last_clean":"2023-09-30T22:53:28.519546+0000","last_became_active":"2023-09-30T22:53:28.519181+0000","last_became_peered":"2023-09-30T22:53:28.519181+0000","last_unstale":"2023-09-30T22:53:28.519546+0000","last_undegraded":"2023-09-30T22:53:28.519546+0000","last_fullsized":"2023-09-30T22:53:28.519546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:32.735104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535058+0000","last_change":"2023-09-30T22:53:27.517467+0000","last_active":"2023-09-30T22:53:28.535058+0000","last_peered":"2023-09-30T22:53:28.535058+0000","last_clean":"2023-09-30T22:53:28.535058+0000","last_became_active":"2023-09-30T22:53:27.517231+0000","last_became_peered":"2023-09-30T22:53:27.517231+0000","last_unstale":"2023-09-30T22:53:28.535058+0000","last_undegraded":"2023-09-30T22:53:28.535058+0000","last_fullsized":"2023-09-30T22:53:28.535058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521506+0000","last_change":"2023-09-30T22:53:28.520868+0000","last_active":"2023-09-30T22:53:28.521506+0000","last_peered":"2023-09-30T22:53:28.521506+0000","last_clean":"2023-09-30T22:53:28.521506+0000","last_became_active":"2023-09-30T22:53:28.520629+0000","last_became_peered":"2023-09-30T22:53:28.520629+0000","last_unstale":"2023-09-30T22:53:28.521506+0000","last_undegraded":"2023-09-30T22:53:28.521506+0000","last_fullsized":"2023-09-30T22:53:28.521506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:18:44.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535219+0000","last_change":"2023-09-30T22:53:27.517083+0000","last_active":"2023-09-30T22:53:28.535219+0000","last_peered":"2023-09-30T22:53:28.535219+0000","last_clean":"2023-09-30T22:53:28.535219+0000","last_became_active":"2023-09-30T22:53:27.516834+0000","last_became_peered":"2023-09-30T22:53:27.516834+0000","last_unstale":"2023-09-30T22:53:28.535219+0000","last_undegraded":"2023-09-30T22:53:28.535219+0000","last_fullsized":"2023-09-30T22:53:28.535219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519698+0000","last_change":"2023-09-30T22:53:28.519090+0000","last_active":"2023-09-30T22:53:28.519698+0000","last_peered":"2023-09-30T22:53:28.519698+0000","last_clean":"2023-09-30T22:53:28.519698+0000","last_became_active":"2023-09-30T22:53:28.518864+0000","last_became_peered":"2023-09-30T22:53:28.518864+0000","last_unstale":"2023-09-30T22:53:28.519698+0000","last_undegraded":"2023-09-30T22:53:28.519698+0000","last_fullsized":"2023-09-30T22:53:28.519698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:38:50.812517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534282+0000","last_change":"2023-09-30T22:53:27.521214+0000","last_active":"2023-09-30T22:53:28.534282+0000","last_peered":"2023-09-30T22:53:28.534282+0000","last_clean":"2023-09-30T22:53:28.534282+0000","last_became_active":"2023-09-30T22:53:27.521000+0000","last_became_peered":"2023-09-30T22:53:27.521000+0000","last_unstale":"2023-09-30T22:53:28.534282+0000","last_undegraded":"2023-09-30T22:53:28.534282+0000","last_fullsized":"2023-09-30T22:53:28.534282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519955+0000","last_change":"2023-09-30T22:53:27.520810+0000","last_active":"2023-09-30T22:53:28.519955+0000","last_peered":"2023-09-30T22:53:28.519955+0000","last_clean":"2023-09-30T22:53:28.519955+0000","last_became_active":"2023-09-30T22:53:27.520051+0000","last_became_peered":"2023-09-30T22:53:27.520051+0000","last_unstale":"2023-09-30T22:53:28.519955+0000","last_undegraded":"2023-09-30T22:53:28.519955+0000","last_fullsized":"2023-09-30T22:53:28.519955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516891+0000","last_change":"2023-09-30T22:53:28.516799+0000","last_active":"2023-09-30T22:53:28.516891+0000","last_peered":"2023-09-30T22:53:28.516891+0000","last_clean":"2023-09-30T22:53:28.516891+0000","last_became_active":"2023-09-30T22:53:28.516580+0000","last_became_peered":"2023-09-30T22:53:28.516580+0000","last_unstale":"2023-09-30T22:53:28.516891+0000","last_undegraded":"2023-09-30T22:53:28.516891+0000","last_fullsized":"2023-09-30T22:53:28.516891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516147+0000","last_change":"2023-09-30T22:53:27.519471+0000","last_active":"2023-09-30T22:53:28.516147+0000","last_peered":"2023-09-30T22:53:28.516147+0000","last_clean":"2023-09-30T22:53:28.516147+0000","last_became_active":"2023-09-30T22:53:27.518947+0000","last_became_peered":"2023-09-30T22:53:27.518947+0000","last_unstale":"2023-09-30T22:53:28.516147+0000","last_undegraded":"2023-09-30T22:53:28.516147+0000","last_fullsized":"2023-09-30T22:53:28.516147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:14.863213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524538+0000","last_change":"2023-09-30T22:53:28.524453+0000","last_active":"2023-09-30T22:53:28.524538+0000","last_peered":"2023-09-30T22:53:28.524538+0000","last_clean":"2023-09-30T22:53:28.524538+0000","last_became_active":"2023-09-30T22:53:28.524098+0000","last_became_peered":"2023-09-30T22:53:28.524098+0000","last_unstale":"2023-09-30T22:53:28.524538+0000","last_undegraded":"2023-09-30T22:53:28.524538+0000","last_fullsized":"2023-09-30T22:53:28.524538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:25.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517878+0000","last_change":"2023-09-30T22:53:27.517464+0000","last_active":"2023-09-30T22:53:28.517878+0000","last_peered":"2023-09-30T22:53:28.517878+0000","last_clean":"2023-09-30T22:53:28.517878+0000","last_became_active":"2023-09-30T22:53:27.516983+0000","last_became_peered":"2023-09-30T22:53:27.516983+0000","last_unstale":"2023-09-30T22:53:28.517878+0000","last_undegraded":"2023-09-30T22:53:28.517878+0000","last_fullsized":"2023-09-30T22:53:28.517878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523916+0000","last_change":"2023-09-30T22:53:28.523841+0000","last_active":"2023-09-30T22:53:28.523916+0000","last_peered":"2023-09-30T22:53:28.523916+0000","last_clean":"2023-09-30T22:53:28.523916+0000","last_became_active":"2023-09-30T22:53:28.523574+0000","last_became_peered":"2023-09-30T22:53:28.523574+0000","last_unstale":"2023-09-30T22:53:28.523916+0000","last_undegraded":"2023-09-30T22:53:28.523916+0000","last_fullsized":"2023-09-30T22:53:28.523916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.503298+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528052+0000","last_change":"2023-09-30T22:53:28.527814+0000","last_active":"2023-09-30T22:53:28.528052+0000","last_peered":"2023-09-30T22:53:28.528052+0000","last_clean":"2023-09-30T22:53:28.528052+0000","last_became_active":"2023-09-30T22:53:28.527339+0000","last_became_peered":"2023-09-30T22:53:28.527339+0000","last_unstale":"2023-09-30T22:53:28.528052+0000","last_undegraded":"2023-09-30T22:53:28.528052+0000","last_fullsized":"2023-09-30T22:53:28.528052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:10.461181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502916+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524484+0000","last_change":"2023-09-30T22:53:28.521854+0000","last_active":"2023-09-30T22:53:28.524484+0000","last_peered":"2023-09-30T22:53:28.524484+0000","last_clean":"2023-09-30T22:53:28.524484+0000","last_became_active":"2023-09-30T22:53:28.521590+0000","last_became_peered":"2023-09-30T22:53:28.521590+0000","last_unstale":"2023-09-30T22:53:28.524484+0000","last_undegraded":"2023-09-30T22:53:28.524484+0000","last_fullsized":"2023-09-30T22:53:28.524484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:07.541785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538839+0000","last_change":"2023-09-30T22:53:27.520637+0000","last_active":"2023-09-30T22:53:28.538839+0000","last_peered":"2023-09-30T22:53:28.538839+0000","last_clean":"2023-09-30T22:53:28.538839+0000","last_became_active":"2023-09-30T22:53:27.519273+0000","last_became_peered":"2023-09-30T22:53:27.519273+0000","last_unstale":"2023-09-30T22:53:28.538839+0000","last_undegraded":"2023-09-30T22:53:28.538839+0000","last_fullsized":"2023-09-30T22:53:28.538839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527146+0000","last_change":"2023-09-30T22:53:28.527020+0000","last_active":"2023-09-30T22:53:28.527146+0000","last_peered":"2023-09-30T22:53:28.527146+0000","last_clean":"2023-09-30T22:53:28.527146+0000","last_became_active":"2023-09-30T22:53:28.526664+0000","last_became_peered":"2023-09-30T22:53:28.526664+0000","last_unstale":"2023-09-30T22:53:28.527146+0000","last_undegraded":"2023-09-30T22:53:28.527146+0000","last_fullsized":"2023-09-30T22:53:28.527146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:13.114495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536461+0000","last_change":"2023-09-30T22:53:27.521604+0000","last_active":"2023-09-30T22:53:28.536461+0000","last_peered":"2023-09-30T22:53:28.536461+0000","last_clean":"2023-09-30T22:53:28.536461+0000","last_became_active":"2023-09-30T22:53:27.521088+0000","last_became_peered":"2023-09-30T22:53:27.521088+0000","last_unstale":"2023-09-30T22:53:28.536461+0000","last_undegraded":"2023-09-30T22:53:28.536461+0000","last_fullsized":"2023-09-30T22:53:28.536461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519512+0000","last_change":"2023-09-30T22:53:28.518412+0000","last_active":"2023-09-30T22:53:28.519512+0000","last_peered":"2023-09-30T22:53:28.519512+0000","last_clean":"2023-09-30T22:53:28.519512+0000","last_became_active":"2023-09-30T22:53:28.517871+0000","last_became_peered":"2023-09-30T22:53:28.517871+0000","last_unstale":"2023-09-30T22:53:28.519512+0000","last_undegraded":"2023-09-30T22:53:28.519512+0000","last_fullsized":"2023-09-30T22:53:28.519512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511856+0000","last_change":"2023-09-30T22:53:27.517581+0000","last_active":"2023-09-30T22:53:28.511856+0000","last_peered":"2023-09-30T22:53:28.511856+0000","last_clean":"2023-09-30T22:53:28.511856+0000","last_became_active":"2023-09-30T22:53:27.517341+0000","last_became_peered":"2023-09-30T22:53:27.517341+0000","last_unstale":"2023-09-30T22:53:28.511856+0000","last_undegraded":"2023-09-30T22:53:28.511856+0000","last_fullsized":"2023-09-30T22:53:28.511856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526246+0000","last_change":"2023-09-30T22:53:28.525685+0000","last_active":"2023-09-30T22:53:28.526246+0000","last_peered":"2023-09-30T22:53:28.526246+0000","last_clean":"2023-09-30T22:53:28.526246+0000","last_became_active":"2023-09-30T22:53:28.525403+0000","last_became_peered":"2023-09-30T22:53:28.525403+0000","last_unstale":"2023-09-30T22:53:28.526246+0000","last_undegraded":"2023-09-30T22:53:28.526246+0000","last_fullsized":"2023-09-30T22:53:28.526246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502937+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513109+0000","last_change":"2023-09-30T22:53:28.513034+0000","last_active":"2023-09-30T22:53:28.513109+0000","last_peered":"2023-09-30T22:53:28.513109+0000","last_clean":"2023-09-30T22:53:28.513109+0000","last_became_active":"2023-09-30T22:53:28.512753+0000","last_became_peered":"2023-09-30T22:53:28.512753+0000","last_unstale":"2023-09-30T22:53:28.513109+0000","last_undegraded":"2023-09-30T22:53:28.513109+0000","last_fullsized":"2023-09-30T22:53:28.513109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538127+0000","last_change":"2023-09-30T22:53:27.516048+0000","last_active":"2023-09-30T22:53:28.538127+0000","last_peered":"2023-09-30T22:53:28.538127+0000","last_clean":"2023-09-30T22:53:28.538127+0000","last_became_active":"2023-09-30T22:53:27.515566+0000","last_became_peered":"2023-09-30T22:53:27.515566+0000","last_unstale":"2023-09-30T22:53:28.538127+0000","last_undegraded":"2023-09-30T22:53:28.538127+0000","last_fullsized":"2023-09-30T22:53:28.538127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:32.867025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519529+0000","last_change":"2023-09-30T22:53:28.518549+0000","last_active":"2023-09-30T22:53:28.519529+0000","last_peered":"2023-09-30T22:53:28.519529+0000","last_clean":"2023-09-30T22:53:28.519529+0000","last_became_active":"2023-09-30T22:53:28.518178+0000","last_became_peered":"2023-09-30T22:53:28.518178+0000","last_unstale":"2023-09-30T22:53:28.519529+0000","last_undegraded":"2023-09-30T22:53:28.519529+0000","last_fullsized":"2023-09-30T22:53:28.519529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.533325+0000","last_change":"2023-09-30T22:53:27.519544+0000","last_active":"2023-09-30T22:53:28.533325+0000","last_peered":"2023-09-30T22:53:28.533325+0000","last_clean":"2023-09-30T22:53:28.533325+0000","last_became_active":"2023-09-30T22:53:27.519269+0000","last_became_peered":"2023-09-30T22:53:27.519269+0000","last_unstale":"2023-09-30T22:53:28.533325+0000","last_undegraded":"2023-09-30T22:53:28.533325+0000","last_fullsized":"2023-09-30T22:53:28.533325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:22.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524412+0000","last_change":"2023-09-30T22:53:28.519623+0000","last_active":"2023-09-30T22:53:28.524412+0000","last_peered":"2023-09-30T22:53:28.524412+0000","last_clean":"2023-09-30T22:53:28.524412+0000","last_became_active":"2023-09-30T22:53:28.519379+0000","last_became_peered":"2023-09-30T22:53:28.519379+0000","last_unstale":"2023-09-30T22:53:28.524412+0000","last_undegraded":"2023-09-30T22:53:28.524412+0000","last_fullsized":"2023-09-30T22:53:28.524412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:43:42.198369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502704+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524371+0000","last_change":"2023-09-30T22:53:28.517717+0000","last_active":"2023-09-30T22:53:28.524371+0000","last_peered":"2023-09-30T22:53:28.524371+0000","last_clean":"2023-09-30T22:53:28.524371+0000","last_became_active":"2023-09-30T22:53:28.517459+0000","last_became_peered":"2023-09-30T22:53:28.517459+0000","last_unstale":"2023-09-30T22:53:28.524371+0000","last_undegraded":"2023-09-30T22:53:28.524371+0000","last_fullsized":"2023-09-30T22:53:28.524371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:04.012099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534031+0000","last_change":"2023-09-30T22:53:27.519451+0000","last_active":"2023-09-30T22:53:28.534031+0000","last_peered":"2023-09-30T22:53:28.534031+0000","last_clean":"2023-09-30T22:53:28.534031+0000","last_became_active":"2023-09-30T22:53:27.519207+0000","last_became_peered":"2023-09-30T22:53:27.519207+0000","last_unstale":"2023-09-30T22:53:28.534031+0000","last_undegraded":"2023-09-30T22:53:28.534031+0000","last_fullsized":"2023-09-30T22:53:28.534031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:54.470913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523493+0000","last_change":"2023-09-30T22:53:28.523288+0000","last_active":"2023-09-30T22:53:28.523493+0000","last_peered":"2023-09-30T22:53:28.523493+0000","last_clean":"2023-09-30T22:53:28.523493+0000","last_became_active":"2023-09-30T22:53:28.522752+0000","last_became_peered":"2023-09-30T22:53:28.522752+0000","last_unstale":"2023-09-30T22:53:28.523493+0000","last_undegraded":"2023-09-30T22:53:28.523493+0000","last_fullsized":"2023-09-30T22:53:28.523493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514427+0000","last_change":"2023-09-30T22:53:27.513959+0000","last_active":"2023-09-30T22:53:28.514427+0000","last_peered":"2023-09-30T22:53:28.514427+0000","last_clean":"2023-09-30T22:53:28.514427+0000","last_became_active":"2023-09-30T22:53:27.513732+0000","last_became_peered":"2023-09-30T22:53:27.513732+0000","last_unstale":"2023-09-30T22:53:28.514427+0000","last_undegraded":"2023-09-30T22:53:28.514427+0000","last_fullsized":"2023-09-30T22:53:28.514427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536715+0000","last_change":"2023-09-30T22:53:27.516148+0000","last_active":"2023-09-30T22:53:28.536715+0000","last_peered":"2023-09-30T22:53:28.536715+0000","last_clean":"2023-09-30T22:53:28.536715+0000","last_became_active":"2023-09-30T22:53:27.514962+0000","last_became_peered":"2023-09-30T22:53:27.514962+0000","last_unstale":"2023-09-30T22:53:28.536715+0000","last_undegraded":"2023-09-30T22:53:28.536715+0000","last_fullsized":"2023-09-30T22:53:28.536715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:55.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525445+0000","last_change":"2023-09-30T22:53:28.525377+0000","last_active":"2023-09-30T22:53:28.525445+0000","last_peered":"2023-09-30T22:53:28.525445+0000","last_clean":"2023-09-30T22:53:28.525445+0000","last_became_active":"2023-09-30T22:53:28.525124+0000","last_became_peered":"2023-09-30T22:53:28.525124+0000","last_unstale":"2023-09-30T22:53:28.525445+0000","last_undegraded":"2023-09-30T22:53:28.525445+0000","last_fullsized":"2023-09-30T22:53:28.525445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:51:22.092802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511256+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.511256+0000","last_peered":"2023-09-30T22:53:28.511256+0000","last_clean":"2023-09-30T22:53:28.511256+0000","last_became_active":"2023-09-30T22:53:27.516236+0000","last_became_peered":"2023-09-30T22:53:27.516236+0000","last_unstale":"2023-09-30T22:53:28.511256+0000","last_undegraded":"2023-09-30T22:53:28.511256+0000","last_fullsized":"2023-09-30T22:53:28.511256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526264+0000","last_change":"2023-09-30T22:53:28.526005+0000","last_active":"2023-09-30T22:53:28.526264+0000","last_peered":"2023-09-30T22:53:28.526264+0000","last_clean":"2023-09-30T22:53:28.526264+0000","last_became_active":"2023-09-30T22:53:28.525429+0000","last_became_peered":"2023-09-30T22:53:28.525429+0000","last_unstale":"2023-09-30T22:53:28.526264+0000","last_undegraded":"2023-09-30T22:53:28.526264+0000","last_fullsized":"2023-09-30T22:53:28.526264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515992+0000","last_change":"2023-09-30T22:53:27.519633+0000","last_active":"2023-09-30T22:53:28.515992+0000","last_peered":"2023-09-30T22:53:28.515992+0000","last_clean":"2023-09-30T22:53:28.515992+0000","last_became_active":"2023-09-30T22:53:27.519232+0000","last_became_peered":"2023-09-30T22:53:27.519232+0000","last_unstale":"2023-09-30T22:53:28.515992+0000","last_undegraded":"2023-09-30T22:53:28.515992+0000","last_fullsized":"2023-09-30T22:53:28.515992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:51.349781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527132+0000","last_change":"2023-09-30T22:53:28.526862+0000","last_active":"2023-09-30T22:53:28.527132+0000","last_peered":"2023-09-30T22:53:28.527132+0000","last_clean":"2023-09-30T22:53:28.527132+0000","last_became_active":"2023-09-30T22:53:28.526232+0000","last_became_peered":"2023-09-30T22:53:28.526232+0000","last_unstale":"2023-09-30T22:53:28.527132+0000","last_undegraded":"2023-09-30T22:53:28.527132+0000","last_fullsized":"2023-09-30T22:53:28.527132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:17.258231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.512067+0000","last_change":"2023-09-30T22:53:27.520705+0000","last_active":"2023-09-30T22:53:28.512067+0000","last_peered":"2023-09-30T22:53:28.512067+0000","last_clean":"2023-09-30T22:53:28.512067+0000","last_became_active":"2023-09-30T22:53:27.520103+0000","last_became_peered":"2023-09-30T22:53:27.520103+0000","last_unstale":"2023-09-30T22:53:28.512067+0000","last_undegraded":"2023-09-30T22:53:28.512067+0000","last_fullsized":"2023-09-30T22:53:28.512067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:24.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521264+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521264+0000","last_peered":"2023-09-30T22:53:28.521264+0000","last_clean":"2023-09-30T22:53:28.521264+0000","last_became_active":"2023-09-30T22:53:28.520956+0000","last_became_peered":"2023-09-30T22:53:28.520956+0000","last_unstale":"2023-09-30T22:53:28.521264+0000","last_undegraded":"2023-09-30T22:53:28.521264+0000","last_fullsized":"2023-09-30T22:53:28.521264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518003+0000","last_change":"2023-09-30T22:53:27.516312+0000","last_active":"2023-09-30T22:53:28.518003+0000","last_peered":"2023-09-30T22:53:28.518003+0000","last_clean":"2023-09-30T22:53:28.518003+0000","last_became_active":"2023-09-30T22:53:27.516077+0000","last_became_peered":"2023-09-30T22:53:27.516077+0000","last_unstale":"2023-09-30T22:53:28.518003+0000","last_undegraded":"2023-09-30T22:53:28.518003+0000","last_fullsized":"2023-09-30T22:53:28.518003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:23.956508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514093+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:53:28.514093+0000","last_peered":"2023-09-30T22:53:28.514093+0000","last_clean":"2023-09-30T22:53:28.514093+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:53:28.514093+0000","last_undegraded":"2023-09-30T22:53:28.514093+0000","last_fullsized":"2023-09-30T22:53:28.514093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520799+0000","last_change":"2023-09-30T22:53:28.520729+0000","last_active":"2023-09-30T22:53:28.520799+0000","last_peered":"2023-09-30T22:53:28.520799+0000","last_clean":"2023-09-30T22:53:28.520799+0000","last_became_active":"2023-09-30T22:53:28.520513+0000","last_became_peered":"2023-09-30T22:53:28.520513+0000","last_unstale":"2023-09-30T22:53:28.520799+0000","last_undegraded":"2023-09-30T22:53:28.520799+0000","last_fullsized":"2023-09-30T22:53:28.520799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509593+0000","last_change":"2023-09-30T22:53:27.518551+0000","last_active":"2023-09-30T22:53:28.509593+0000","last_peered":"2023-09-30T22:53:28.509593+0000","last_clean":"2023-09-30T22:53:28.509593+0000","last_became_active":"2023-09-30T22:53:27.518302+0000","last_became_peered":"2023-09-30T22:53:27.518302+0000","last_unstale":"2023-09-30T22:53:28.509593+0000","last_undegraded":"2023-09-30T22:53:28.509593+0000","last_fullsized":"2023-09-30T22:53:28.509593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:47.454460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277246+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:53:20.277246+0000","last_peered":"2023-09-30T22:53:20.277246+0000","last_clean":"2023-09-30T22:53:20.277246+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:53:20.277246+0000","last_undegraded":"2023-09-30T22:53:20.277246+0000","last_fullsized":"2023-09-30T22:53:20.277246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526279+0000","last_change":"2023-09-30T22:53:28.526154+0000","last_active":"2023-09-30T22:53:28.526279+0000","last_peered":"2023-09-30T22:53:28.526279+0000","last_clean":"2023-09-30T22:53:28.526279+0000","last_became_active":"2023-09-30T22:53:28.525783+0000","last_became_peered":"2023-09-30T22:53:28.525783+0000","last_unstale":"2023-09-30T22:53:28.526279+0000","last_undegraded":"2023-09-30T22:53:28.526279+0000","last_fullsized":"2023-09-30T22:53:28.526279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508773+0000","last_change":"2023-09-30T22:53:27.518889+0000","last_active":"2023-09-30T22:53:28.508773+0000","last_peered":"2023-09-30T22:53:28.508773+0000","last_clean":"2023-09-30T22:53:28.508773+0000","last_became_active":"2023-09-30T22:53:27.518640+0000","last_became_peered":"2023-09-30T22:53:27.518640+0000","last_unstale":"2023-09-30T22:53:28.508773+0000","last_undegraded":"2023-09-30T22:53:28.508773+0000","last_fullsized":"2023-09-30T22:53:28.508773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:24.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508872+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:53:28.508872+0000","last_peered":"2023-09-30T22:53:28.508872+0000","last_clean":"2023-09-30T22:53:28.508872+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:53:28.508872+0000","last_undegraded":"2023-09-30T22:53:28.508872+0000","last_fullsized":"2023-09-30T22:53:28.508872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517216+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.517216+0000","last_peered":"2023-09-30T22:53:28.517216+0000","last_clean":"2023-09-30T22:53:28.517216+0000","last_became_active":"2023-09-30T22:53:27.516261+0000","last_became_peered":"2023-09-30T22:53:27.516261+0000","last_unstale":"2023-09-30T22:53:28.517216+0000","last_undegraded":"2023-09-30T22:53:28.517216+0000","last_fullsized":"2023-09-30T22:53:28.517216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:22.220152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277304+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:53:20.277304+0000","last_peered":"2023-09-30T22:53:20.277304+0000","last_clean":"2023-09-30T22:53:20.277304+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:53:20.277304+0000","last_undegraded":"2023-09-30T22:53:20.277304+0000","last_fullsized":"2023-09-30T22:53:20.277304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513331+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:53:28.513331+0000","last_peered":"2023-09-30T22:53:28.513331+0000","last_clean":"2023-09-30T22:53:28.513331+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:53:28.513331+0000","last_undegraded":"2023-09-30T22:53:28.513331+0000","last_fullsized":"2023-09-30T22:53:28.513331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521299+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521299+0000","last_peered":"2023-09-30T22:53:28.521299+0000","last_clean":"2023-09-30T22:53:28.521299+0000","last_became_active":"2023-09-30T22:53:28.520925+0000","last_became_peered":"2023-09-30T22:53:28.520925+0000","last_unstale":"2023-09-30T22:53:28.521299+0000","last_undegraded":"2023-09-30T22:53:28.521299+0000","last_fullsized":"2023-09-30T22:53:28.521299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502591+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277246+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:53:20.277246+0000","last_peered":"2023-09-30T22:53:20.277246+0000","last_clean":"2023-09-30T22:53:20.277246+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:53:20.277246+0000","last_undegraded":"2023-09-30T22:53:20.277246+0000","last_fullsized":"2023-09-30T22:53:20.277246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521298+0000","last_change":"2023-09-30T22:53:28.521190+0000","last_active":"2023-09-30T22:53:28.521298+0000","last_peered":"2023-09-30T22:53:28.521298+0000","last_clean":"2023-09-30T22:53:28.521298+0000","last_became_active":"2023-09-30T22:53:28.520955+0000","last_became_peered":"2023-09-30T22:53:28.520955+0000","last_unstale":"2023-09-30T22:53:28.521298+0000","last_undegraded":"2023-09-30T22:53:28.521298+0000","last_fullsized":"2023-09-30T22:53:28.521298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517510+0000","last_change":"2023-09-30T22:53:27.516490+0000","last_active":"2023-09-30T22:53:28.517510+0000","last_peered":"2023-09-30T22:53:28.517510+0000","last_clean":"2023-09-30T22:53:28.517510+0000","last_became_active":"2023-09-30T22:53:27.516254+0000","last_became_peered":"2023-09-30T22:53:27.516254+0000","last_unstale":"2023-09-30T22:53:28.517510+0000","last_undegraded":"2023-09-30T22:53:28.517510+0000","last_fullsized":"2023-09-30T22:53:28.517510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:33:29.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277456+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:53:20.277456+0000","last_peered":"2023-09-30T22:53:20.277456+0000","last_clean":"2023-09-30T22:53:20.277456+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:53:20.277456+0000","last_undegraded":"2023-09-30T22:53:20.277456+0000","last_fullsized":"2023-09-30T22:53:20.277456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:53:27.501519+0000","last_change":"2023-09-30T22:53:27.501519+0000","last_active":"2023-09-30T22:53:27.501519+0000","last_peered":"2023-09-30T22:53:27.501519+0000","last_clean":"2023-09-30T22:53:27.501519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:27.501519+0000","last_undegraded":"2023-09-30T22:53:27.501519+0000","last_fullsized":"2023-09-30T22:53:27.501519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:53:26.494834+0000","last_change":"2023-09-30T22:53:26.502576+0000","last_active":"2023-09-30T22:53:26.494834+0000","last_peered":"2023-09-30T22:53:26.494834+0000","last_clean":"2023-09-30T22:53:26.494834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:53:26.494834+0000","last_undegraded":"2023-09-30T22:53:26.494834+0000","last_fullsized":"2023-09-30T22:53:26.494834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518201+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:53:28.518201+0000","last_peered":"2023-09-30T22:53:28.518201+0000","last_clean":"2023-09-30T22:53:28.518201+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:53:28.518201+0000","last_undegraded":"2023-09-30T22:53:28.518201+0000","last_fullsized":"2023-09-30T22:53:28.518201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519732+0000","last_change":"2023-09-30T22:53:28.519554+0000","last_active":"2023-09-30T22:53:28.519732+0000","last_peered":"2023-09-30T22:53:28.519732+0000","last_clean":"2023-09-30T22:53:28.519732+0000","last_became_active":"2023-09-30T22:53:28.519318+0000","last_became_peered":"2023-09-30T22:53:28.519318+0000","last_unstale":"2023-09-30T22:53:28.519732+0000","last_undegraded":"2023-09-30T22:53:28.519732+0000","last_fullsized":"2023-09-30T22:53:28.519732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520210+0000","last_change":"2023-09-30T22:53:27.520302+0000","last_active":"2023-09-30T22:53:28.520210+0000","last_peered":"2023-09-30T22:53:28.520210+0000","last_clean":"2023-09-30T22:53:28.520210+0000","last_became_active":"2023-09-30T22:53:27.518956+0000","last_became_peered":"2023-09-30T22:53:27.518956+0000","last_unstale":"2023-09-30T22:53:28.520210+0000","last_undegraded":"2023-09-30T22:53:28.520210+0000","last_fullsized":"2023-09-30T22:53:28.520210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-30T22:53:20.277400+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:53:20.277400+0000","last_peered":"2023-09-30T22:53:20.277400+0000","last_clean":"2023-09-30T22:53:20.277400+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:53:20.277400+0000","last_undegraded":"2023-09-30T22:53:20.277400+0000","last_fullsized":"2023-09-30T22:53:20.277400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.624},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.752}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838200,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.79100000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.74399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.879}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.0249999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.96599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.374},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.504},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.442}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.036}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":1.22},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.0740000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":1.21}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":1.2330000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46800000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.434}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.871},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.81699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":160,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.434}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.179},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.377},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.502}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":159,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65800000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.78000000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70799999999999996}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77100000000000002}]}]}],"pool_statfs":[]}} 2023-09-30T22:53:33.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-09-30T22:53:33.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-09-30T22:53:33.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-09-30T22:53:33.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-09-30T22:53:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-09-30T22:53:33.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-09-30T22:53:33.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-09-30T22:53:33.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:53:26.494834+0000', 'last_change': '2023-09-30T22:53:26.503298+0000', 'last_active': '2023-09-30T22:53:26.494834+0000', 'last_peered': '2023-09-30T22:53:26.494834+0000', 'last_clean': '2023-09-30T22:53:26.494834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:26.494834+0000', 'last_undegraded': '2023-09-30T22:53:26.494834+0000', 'last_fullsized': '2023-09-30T22:53:26.494834+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:53:33.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:53:26.494834+0000', 'last_change': '2023-09-30T22:53:26.502916+0000', 'last_active': '2023-09-30T22:53:26.494834+0000', 'last_peered': '2023-09-30T22:53:26.494834+0000', 'last_clean': '2023-09-30T22:53:26.494834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:26.494834+0000', 'last_undegraded': '2023-09-30T22:53:26.494834+0000', 'last_fullsized': '2023-09-30T22:53:26.494834+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:53:26.494834+0000', 'last_change': '2023-09-30T22:53:26.502937+0000', 'last_active': '2023-09-30T22:53:26.494834+0000', 'last_peered': '2023-09-30T22:53:26.494834+0000', 'last_clean': '2023-09-30T22:53:26.494834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:26.494834+0000', 'last_undegraded': '2023-09-30T22:53:26.494834+0000', 'last_fullsized': '2023-09-30T22:53:26.494834+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:53:26.494834+0000', 'last_change': '2023-09-30T22:53:26.502704+0000', 'last_active': '2023-09-30T22:53:26.494834+0000', 'last_peered': '2023-09-30T22:53:26.494834+0000', 'last_clean': '2023-09-30T22:53:26.494834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:26.494834+0000', 'last_undegraded': '2023-09-30T22:53:26.494834+0000', 'last_fullsized': '2023-09-30T22:53:26.494834+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-09-30T22:53:33.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-09-30T22:53:33.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:53:26.494834+0000', 'last_change': '2023-09-30T22:53:26.502591+0000', 'last_active': '2023-09-30T22:53:26.494834+0000', 'last_peered': '2023-09-30T22:53:26.494834+0000', 'last_clean': '2023-09-30T22:53:26.494834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:26.494834+0000', 'last_undegraded': '2023-09-30T22:53:26.494834+0000', 'last_fullsized': '2023-09-30T22:53:26.494834+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:53:33.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-09-30T22:53:33.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:53:27.501519+0000', 'last_change': '2023-09-30T22:53:27.501519+0000', 'last_active': '2023-09-30T22:53:27.501519+0000', 'last_peered': '2023-09-30T22:53:27.501519+0000', 'last_clean': '2023-09-30T22:53:27.501519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:27.501519+0000', 'last_undegraded': '2023-09-30T22:53:27.501519+0000', 'last_fullsized': '2023-09-30T22:53:27.501519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:27.501519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:53:33.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-09-30T22:53:33.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:53:26.494834+0000', 'last_change': '2023-09-30T22:53:26.502576+0000', 'last_active': '2023-09-30T22:53:26.494834+0000', 'last_peered': '2023-09-30T22:53:26.494834+0000', 'last_clean': '2023-09-30T22:53:26.494834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:53:26.494834+0000', 'last_undegraded': '2023-09-30T22:53:26.494834+0000', 'last_fullsized': '2023-09-30T22:53:26.494834+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'last_clean_scrub_stamp': '2023-09-30T22:53:26.494834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:53:33.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T22:53:34.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.020+0000 7fbb2fdff700 1 Processor -- start 2023-09-30T22:53:34.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.021+0000 7fbb2fdff700 1 -- start start 2023-09-30T22:53:34.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2fdff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb28157a90 0x7fbb2815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2fdff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb280b2110 0x7fbb2806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2fdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2806d470 con 0x7fbb2806b3d0 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2fdff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb28157e60 con 0x7fbb280b2110 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2fdff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2815c430 con 0x7fbb28157a90 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2e39c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb280b2110 0x7fbb2806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2e39c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb280b2110 0x7fbb2806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47102/0 (socket says 172.21.15.142:47102) 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2e39c700 1 -- 172.21.15.142:0/4116770039 learned_addr learned my addr 172.21.15.142:0/4116770039 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.022+0000 7fbb2db9b700 1 --2- 172.21.15.142:0/4116770039 >> v2:172.21.15.148:3300/0 conn(0x7fbb28157a90 0x7fbb2815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2e39c700 1 -- 172.21.15.142:0/4116770039 >> v2:172.21.15.148:3300/0 conn(0x7fbb28157a90 msgr2=0x7fbb2815bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2e39c700 1 --2- 172.21.15.142:0/4116770039 >> v2:172.21.15.148:3300/0 conn(0x7fbb28157a90 0x7fbb2815bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2e39c700 1 -- 172.21.15.142:0/4116770039 >> v1:172.21.15.148:6789/0 conn(0x7fbb2806b3d0 legacy=0x7fbb280b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2e39c700 1 -- 172.21.15.142:0/4116770039 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280ae880 con 0x7fbb280b2110 2023-09-30T22:53:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2cb99700 1 -- 172.21.15.142:0/4116770039 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095523875 0 0) 0x7fbb2806d470 con 0x7fbb2806b3d0 2023-09-30T22:53:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2e39c700 1 --2- 172.21.15.142:0/4116770039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb280b2110 0x7fbb2806d900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbb2806d1e0 tx=0x7fbb20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84f01091460a16f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2cb99700 1 -- 172.21.15.142:0/4116770039 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000e070 con 0x7fbb280b2110 2023-09-30T22:53:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2cb99700 1 -- 172.21.15.142:0/4116770039 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2000ba20 con 0x7fbb280b2110 2023-09-30T22:53:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.023+0000 7fbb2cb99700 1 -- 172.21.15.142:0/4116770039 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb200092e0 con 0x7fbb280b2110 2023-09-30T22:53:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 -- 172.21.15.142:0/4116770039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb280b2110 msgr2=0x7fbb2806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/4116770039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb280b2110 0x7fbb2806d900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbb2806d1e0 tx=0x7fbb20009840 comp rx=0 tx=0).stop 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 -- 172.21.15.142:0/4116770039 shutdown_connections 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/4116770039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb280b2110 0x7fbb2806d900 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/4116770039 >> v2:172.21.15.148:3300/0 conn(0x7fbb28157a90 0x7fbb2815bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 -- 172.21.15.142:0/4116770039 >> 172.21.15.142:0/4116770039 conn(0x7fbb280680c0 msgr2=0x7fbb280c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 -- 172.21.15.142:0/4116770039 shutdown_connections 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.024+0000 7fbb2fdff700 1 -- 172.21.15.142:0/4116770039 wait complete. 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.025+0000 7fbb2fdff700 1 Processor -- start 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.026+0000 7fbb2fdff700 1 -- start start 2023-09-30T22:53:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.026+0000 7fbb2fdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb2806b3d0 0x7fbb28156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.026+0000 7fbb2fdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb280b2110 0x7fbb28154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.026+0000 7fbb2fdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb28157a90 0x7fbb2815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.026+0000 7fbb2fdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28157380 con 0x7fbb2806b3d0 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.026+0000 7fbb2fdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28152d40 con 0x7fbb28157a90 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.026+0000 7fbb2fdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28154fe0 con 0x7fbb280b2110 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb2806b3d0 0x7fbb28156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb2806b3d0 0x7fbb28156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47106/0 (socket says 172.21.15.142:47106) 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 -- 172.21.15.142:0/3027513782 learned_addr learned my addr 172.21.15.142:0/3027513782 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2d39a700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb280b2110 0x7fbb28154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2e39c700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb28157a90 0x7fbb2815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 -- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb280b2110 msgr2=0x7fbb28154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb280b2110 0x7fbb28154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 -- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb28157a90 msgr2=0x7fbb2815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb28157a90 0x7fbb2815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 -- 172.21.15.142:0/3027513782 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009ae0 con 0x7fbb2806b3d0 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2d39a700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb280b2110 0x7fbb28154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb2db9b700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb2806b3d0 0x7fbb28156470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400ec80 tx=0x7fbb240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.027+0000 7fbb1dffb700 1 -- 172.21.15.142:0/3027513782 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400c9d0 con 0x7fbb2806b3d0 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.028+0000 7fbb1dffb700 1 -- 172.21.15.142:0/3027513782 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2400cb30 con 0x7fbb2806b3d0 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.028+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb28156ae0 con 0x7fbb2806b3d0 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.028+0000 7fbb1dffb700 1 -- 172.21.15.142:0/3027513782 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24013470 con 0x7fbb2806b3d0 2023-09-30T22:53:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.028+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb281570a0 con 0x7fbb2806b3d0 2023-09-30T22:53:34.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.029+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb280695b0 con 0x7fbb2806b3d0 2023-09-30T22:53:34.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.030+0000 7fbb1dffb700 1 -- 172.21.15.142:0/3027513782 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbb24013820 con 0x7fbb2806b3d0 2023-09-30T22:53:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.031+0000 7fbb1dffb700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb0c067330 0x7fbb0c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.031+0000 7fbb1dffb700 1 -- 172.21.15.142:0/3027513782 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbb24085760 con 0x7fbb2806b3d0 2023-09-30T22:53:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.031+0000 7fbb2d39a700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb0c067330 0x7fbb0c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.031+0000 7fbb2d39a700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb0c067330 0x7fbb0c0697e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb18007fd0 tx=0x7fbb18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:34.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.034+0000 7fbb1dffb700 1 -- 172.21.15.142:0/3027513782 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbb24052640 con 0x7fbb2806b3d0 2023-09-30T22:53:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.301+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbb2815e5d0 con 0x7fbb2806b3d0 2023-09-30T22:53:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.302+0000 7fbb1dffb700 1 -- 172.21.15.142:0/3027513782 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1717 (secure 0 0 0) 0x7fbb240176d0 con 0x7fbb2806b3d0 2023-09-30T22:53:34.302 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:34.302 INFO:teuthology.orchestra.run.smithi142.stdout:{"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":84,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1696114335,"num_in_osds":8,"osd_in_since":1696114332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"unknown","count":12},{"state_name":"creating+peering","count":6}],"num_pgs":105,"num_pools":4,"num_objects":19,"data_bytes":592584,"bytes_used":2452855,"bytes_avail":1597547145,"bytes_total":1600000000,"unknown_pgs_ratio":0.11428571492433548,"inactive_pgs_ratio":0.05714285746216774,"write_bytes_sec":2189,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4983}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-09-30T22:53:18.112881+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-09-30T22:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb0c067330 msgr2=0x7fbb0c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb0c067330 0x7fbb0c0697e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb18007fd0 tx=0x7fbb18009040 comp rx=0 tx=0).stop 2023-09-30T22:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb2806b3d0 msgr2=0x7fbb28156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb2806b3d0 0x7fbb28156470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400ec80 tx=0x7fbb240091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 shutdown_connections 2023-09-30T22:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb0c067330 0x7fbb0c0697e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb28157a90 0x7fbb2815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb2806b3d0 0x7fbb28156470 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 --2- 172.21.15.142:0/3027513782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb280b2110 0x7fbb28154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 >> 172.21.15.142:0/3027513782 conn(0x7fbb280680c0 msgr2=0x7fbb281519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 shutdown_connections 2023-09-30T22:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.304+0000 7fbb2fdff700 1 -- 172.21.15.142:0/3027513782 wait complete. 2023-09-30T22:53:34.322 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T22:53:34.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:53:34.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.511+0000 7f231d5ff700 1 Processor -- start 2023-09-30T22:53:34.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.511+0000 7f231d5ff700 1 -- start start 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f231d5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2318159ae0 0x7f23180cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f231d5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23180b1180 0x7f23180cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f231d5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231815d910 con 0x7f2318159eb0 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f231d5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231815e920 con 0x7f2318159ae0 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f231d5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231815e490 con 0x7f23180b1180 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f2316ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2318159ae0 0x7f23180cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f2316ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2318159ae0 0x7f23180cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47114/0 (socket says 172.21.15.142:47114) 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f2316ffd700 1 -- 172.21.15.142:0/3895328552 learned_addr learned my addr 172.21.15.142:0/3895328552 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:34.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f23167fc700 1 --2- 172.21.15.142:0/3895328552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23180b1180 0x7f23180cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f2316ffd700 1 -- 172.21.15.142:0/3895328552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23180b1180 msgr2=0x7f23180cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:34.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.513+0000 7f2316ffd700 1 --2- 172.21.15.142:0/3895328552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23180b1180 0x7f23180cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.514+0000 7f2316ffd700 1 -- 172.21.15.142:0/3895328552 >> v1:172.21.15.148:6789/0 conn(0x7f2318159eb0 legacy=0x7f2318068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.514+0000 7f2316ffd700 1 -- 172.21.15.142:0/3895328552 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231815db60 con 0x7f2318159ae0 2023-09-30T22:53:34.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.514+0000 7f2316ffd700 1 --2- 172.21.15.142:0/3895328552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159ae0 0x7f23180cdeb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d3ef8f02da26d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:34.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.514+0000 7f2315ffb700 1 -- 172.21.15.142:0/3895328552 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800b860 con 0x7f2318159ae0 2023-09-30T22:53:34.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.514+0000 7f2315ffb700 1 -- 172.21.15.142:0/3895328552 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800b9c0 con 0x7f2318159ae0 2023-09-30T22:53:34.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.514+0000 7f2315ffb700 1 -- 172.21.15.142:0/3895328552 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800bd60 con 0x7f2318159ae0 2023-09-30T22:53:34.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 -- 172.21.15.142:0/3895328552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159ae0 msgr2=0x7f23180cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 --2- 172.21.15.142:0/3895328552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159ae0 0x7f23180cdeb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308009250 comp rx=0 tx=0).stop 2023-09-30T22:53:34.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 -- 172.21.15.142:0/3895328552 shutdown_connections 2023-09-30T22:53:34.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 --2- 172.21.15.142:0/3895328552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159ae0 0x7f23180cdeb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 --2- 172.21.15.142:0/3895328552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23180b1180 0x7f23180cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 -- 172.21.15.142:0/3895328552 >> 172.21.15.142:0/3895328552 conn(0x7f23180ce8b0 msgr2=0x7f23180cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:34.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 -- 172.21.15.142:0/3895328552 shutdown_connections 2023-09-30T22:53:34.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.515+0000 7f231d5ff700 1 -- 172.21.15.142:0/3895328552 wait complete. 2023-09-30T22:53:34.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.517+0000 7f231d5ff700 1 Processor -- start 2023-09-30T22:53:34.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.517+0000 7f231d5ff700 1 -- start start 2023-09-30T22:53:34.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.518+0000 7f231d5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23180b1180 0x7f23181483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.518+0000 7f231d5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318159ae0 0x7f23180c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.518+0000 7f231d5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159eb0 0x7f23180ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.518+0000 7f231d5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231815b860 con 0x7f2318159eb0 2023-09-30T22:53:34.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.518+0000 7f231d5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231816b530 con 0x7f23180b1180 2023-09-30T22:53:34.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.518+0000 7f231d5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180c8f30 con 0x7f2318159ae0 2023-09-30T22:53:34.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.518+0000 7f23177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159eb0 0x7f23180ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159eb0 0x7f23180ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47126/0 (socket says 172.21.15.142:47126) 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 -- 172.21.15.142:0/644749728 learned_addr learned my addr 172.21.15.142:0/644749728 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f2316ffd700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23180b1180 0x7f23181483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23167fc700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318159ae0 0x7f23180c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 -- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318159ae0 msgr2=0x7f23180c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318159ae0 0x7f23180c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 -- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23180b1180 msgr2=0x7f23181483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23180b1180 0x7f23181483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 -- 172.21.15.142:0/644749728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080094f0 con 0x7f2318159eb0 2023-09-30T22:53:34.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f23177fe700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159eb0 0x7f23180ca120 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f231000c840 tx=0x7f2310001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:34.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f22feffd700 1 -- 172.21.15.142:0/644749728 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310012630 con 0x7f2318159eb0 2023-09-30T22:53:34.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f22feffd700 1 -- 172.21.15.142:0/644749728 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23100127b0 con 0x7f2318159eb0 2023-09-30T22:53:34.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23180c9210 con 0x7f2318159eb0 2023-09-30T22:53:34.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f22feffd700 1 -- 172.21.15.142:0/644749728 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310012b70 con 0x7f2318159eb0 2023-09-30T22:53:34.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.519+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318148920 con 0x7f2318159eb0 2023-09-30T22:53:34.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.521+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231815ba10 con 0x7f2318159eb0 2023-09-30T22:53:34.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.521+0000 7f22feffd700 1 -- 172.21.15.142:0/644749728 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2310003030 con 0x7f2318159eb0 2023-09-30T22:53:34.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.522+0000 7f22feffd700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:34.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.522+0000 7f22feffd700 1 -- 172.21.15.142:0/644749728 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2310084c00 con 0x7f2318159eb0 2023-09-30T22:53:34.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.523+0000 7f2316ffd700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:34.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.523+0000 7f2316ffd700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:34.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.527+0000 7f22feffd700 1 -- 172.21.15.142:0/644749728 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f231815ba10 con 0x7f2318159eb0 2023-09-30T22:53:34.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.713+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2318069260 con 0x7f2304067330 2023-09-30T22:53:34.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.722+0000 7f22feffd700 1 -- 172.21.15.142:0/644749728 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303505 (secure 0 0 0) 0x7f2318069260 con 0x7f2304067330 2023-09-30T22:53:34.726 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 msgr2=0x7f23040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308017000 comp rx=0 tx=0).stop 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159eb0 msgr2=0x7f23180ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159eb0 0x7f23180ca120 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f231000c840 tx=0x7f2310001670 comp rx=0 tx=0).stop 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 shutdown_connections 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2318159eb0 0x7f23180ca120 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23180b1180 0x7f23181483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 --2- 172.21.15.142:0/644749728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318159ae0 0x7f23180c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:34.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 >> 172.21.15.142:0/644749728 conn(0x7f23180ce8b0 msgr2=0x7f23180b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:34.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 shutdown_connections 2023-09-30T22:53:34.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:34.727+0000 7f231d5ff700 1 -- 172.21.15.142:0/644749728 wait complete. 2023-09-30T22:53:34.730 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:53:34.745 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-09-30T22:53:34.115562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560078,"statfs":{"total":1600000000,"available":1597520524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.606469"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522036+0000","last_change":"2023-09-30T22:53:28.521844+0000","last_active":"2023-09-30T22:53:28.522036+0000","last_peered":"2023-09-30T22:53:28.522036+0000","last_clean":"2023-09-30T22:53:28.522036+0000","last_became_active":"2023-09-30T22:53:28.521523+0000","last_became_peered":"2023-09-30T22:53:28.521523+0000","last_unstale":"2023-09-30T22:53:28.522036+0000","last_undegraded":"2023-09-30T22:53:28.522036+0000","last_fullsized":"2023-09-30T22:53:28.522036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:59.351514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513441+0000","last_change":"2023-09-30T22:53:28.513362+0000","last_active":"2023-09-30T22:53:28.513441+0000","last_peered":"2023-09-30T22:53:28.513441+0000","last_clean":"2023-09-30T22:53:28.513441+0000","last_became_active":"2023-09-30T22:53:28.513102+0000","last_became_peered":"2023-09-30T22:53:28.513102+0000","last_unstale":"2023-09-30T22:53:28.513441+0000","last_undegraded":"2023-09-30T22:53:28.513441+0000","last_fullsized":"2023-09-30T22:53:28.513441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:50.326775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523601+0000","last_change":"2023-09-30T22:53:28.523032+0000","last_active":"2023-09-30T22:53:28.523601+0000","last_peered":"2023-09-30T22:53:28.523601+0000","last_clean":"2023-09-30T22:53:28.523601+0000","last_became_active":"2023-09-30T22:53:28.522810+0000","last_became_peered":"2023-09-30T22:53:28.522810+0000","last_unstale":"2023-09-30T22:53:28.523601+0000","last_undegraded":"2023-09-30T22:53:28.523601+0000","last_fullsized":"2023-09-30T22:53:28.523601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:53.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524515+0000","last_change":"2023-09-30T22:53:28.524309+0000","last_active":"2023-09-30T22:53:28.524515+0000","last_peered":"2023-09-30T22:53:28.524515+0000","last_clean":"2023-09-30T22:53:28.524515+0000","last_became_active":"2023-09-30T22:53:28.523815+0000","last_became_peered":"2023-09-30T22:53:28.523815+0000","last_unstale":"2023-09-30T22:53:28.524515+0000","last_undegraded":"2023-09-30T22:53:28.524515+0000","last_fullsized":"2023-09-30T22:53:28.524515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:56.402195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523891+0000","last_change":"2023-09-30T22:53:28.523789+0000","last_active":"2023-09-30T22:53:28.523891+0000","last_peered":"2023-09-30T22:53:28.523891+0000","last_clean":"2023-09-30T22:53:28.523891+0000","last_became_active":"2023-09-30T22:53:28.523542+0000","last_became_peered":"2023-09-30T22:53:28.523542+0000","last_unstale":"2023-09-30T22:53:28.523891+0000","last_undegraded":"2023-09-30T22:53:28.523891+0000","last_fullsized":"2023-09-30T22:53:28.523891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515993+0000","last_change":"2023-09-30T22:53:28.515784+0000","last_active":"2023-09-30T22:53:28.515993+0000","last_peered":"2023-09-30T22:53:28.515993+0000","last_clean":"2023-09-30T22:53:28.515993+0000","last_became_active":"2023-09-30T22:53:28.515565+0000","last_became_peered":"2023-09-30T22:53:28.515565+0000","last_unstale":"2023-09-30T22:53:28.515993+0000","last_undegraded":"2023-09-30T22:53:28.515993+0000","last_fullsized":"2023-09-30T22:53:28.515993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:53.264810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525125+0000","last_change":"2023-09-30T22:53:28.524944+0000","last_active":"2023-09-30T22:53:28.525125+0000","last_peered":"2023-09-30T22:53:28.525125+0000","last_clean":"2023-09-30T22:53:28.525125+0000","last_became_active":"2023-09-30T22:53:28.523435+0000","last_became_peered":"2023-09-30T22:53:28.523435+0000","last_unstale":"2023-09-30T22:53:28.525125+0000","last_undegraded":"2023-09-30T22:53:28.525125+0000","last_fullsized":"2023-09-30T22:53:28.525125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:18.496971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527102+0000","last_change":"2023-09-30T22:53:28.526469+0000","last_active":"2023-09-30T22:53:28.527102+0000","last_peered":"2023-09-30T22:53:28.527102+0000","last_clean":"2023-09-30T22:53:28.527102+0000","last_became_active":"2023-09-30T22:53:28.525921+0000","last_became_peered":"2023-09-30T22:53:28.525921+0000","last_unstale":"2023-09-30T22:53:28.527102+0000","last_undegraded":"2023-09-30T22:53:28.527102+0000","last_fullsized":"2023-09-30T22:53:28.527102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:57.146828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511245+0000","last_change":"2023-09-30T22:53:28.511148+0000","last_active":"2023-09-30T22:53:28.511245+0000","last_peered":"2023-09-30T22:53:28.511245+0000","last_clean":"2023-09-30T22:53:28.511245+0000","last_became_active":"2023-09-30T22:53:28.510877+0000","last_became_peered":"2023-09-30T22:53:28.510877+0000","last_unstale":"2023-09-30T22:53:28.511245+0000","last_undegraded":"2023-09-30T22:53:28.511245+0000","last_fullsized":"2023-09-30T22:53:28.511245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524522+0000","last_change":"2023-09-30T22:53:28.523149+0000","last_active":"2023-09-30T22:53:28.524522+0000","last_peered":"2023-09-30T22:53:28.524522+0000","last_clean":"2023-09-30T22:53:28.524522+0000","last_became_active":"2023-09-30T22:53:28.522693+0000","last_became_peered":"2023-09-30T22:53:28.522693+0000","last_unstale":"2023-09-30T22:53:28.524522+0000","last_undegraded":"2023-09-30T22:53:28.524522+0000","last_fullsized":"2023-09-30T22:53:28.524522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:24.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526829+0000","last_change":"2023-09-30T22:53:28.526578+0000","last_active":"2023-09-30T22:53:28.526829+0000","last_peered":"2023-09-30T22:53:28.526829+0000","last_clean":"2023-09-30T22:53:28.526829+0000","last_became_active":"2023-09-30T22:53:28.526345+0000","last_became_peered":"2023-09-30T22:53:28.526345+0000","last_unstale":"2023-09-30T22:53:28.526829+0000","last_undegraded":"2023-09-30T22:53:28.526829+0000","last_fullsized":"2023-09-30T22:53:28.526829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513911+0000","last_change":"2023-09-30T22:53:28.513759+0000","last_active":"2023-09-30T22:53:28.513911+0000","last_peered":"2023-09-30T22:53:28.513911+0000","last_clean":"2023-09-30T22:53:28.513911+0000","last_became_active":"2023-09-30T22:53:28.513397+0000","last_became_peered":"2023-09-30T22:53:28.513397+0000","last_unstale":"2023-09-30T22:53:28.513911+0000","last_undegraded":"2023-09-30T22:53:28.513911+0000","last_fullsized":"2023-09-30T22:53:28.513911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517049+0000","last_change":"2023-09-30T22:53:28.516976+0000","last_active":"2023-09-30T22:53:28.517049+0000","last_peered":"2023-09-30T22:53:28.517049+0000","last_clean":"2023-09-30T22:53:28.517049+0000","last_became_active":"2023-09-30T22:53:28.516752+0000","last_became_peered":"2023-09-30T22:53:28.516752+0000","last_unstale":"2023-09-30T22:53:28.517049+0000","last_undegraded":"2023-09-30T22:53:28.517049+0000","last_fullsized":"2023-09-30T22:53:28.517049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:14.222289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520873+0000","last_change":"2023-09-30T22:53:28.520771+0000","last_active":"2023-09-30T22:53:28.520873+0000","last_peered":"2023-09-30T22:53:28.520873+0000","last_clean":"2023-09-30T22:53:28.520873+0000","last_became_active":"2023-09-30T22:53:28.520479+0000","last_became_peered":"2023-09-30T22:53:28.520479+0000","last_unstale":"2023-09-30T22:53:28.520873+0000","last_undegraded":"2023-09-30T22:53:28.520873+0000","last_fullsized":"2023-09-30T22:53:28.520873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517292+0000","last_change":"2023-09-30T22:53:28.512912+0000","last_active":"2023-09-30T22:53:28.517292+0000","last_peered":"2023-09-30T22:53:28.517292+0000","last_clean":"2023-09-30T22:53:28.517292+0000","last_became_active":"2023-09-30T22:53:28.512640+0000","last_became_peered":"2023-09-30T22:53:28.512640+0000","last_unstale":"2023-09-30T22:53:28.517292+0000","last_undegraded":"2023-09-30T22:53:28.517292+0000","last_fullsized":"2023-09-30T22:53:28.517292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:25.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524568+0000","last_change":"2023-09-30T22:53:28.524203+0000","last_active":"2023-09-30T22:53:28.524568+0000","last_peered":"2023-09-30T22:53:28.524568+0000","last_clean":"2023-09-30T22:53:28.524568+0000","last_became_active":"2023-09-30T22:53:28.523569+0000","last_became_peered":"2023-09-30T22:53:28.523569+0000","last_unstale":"2023-09-30T22:53:28.524568+0000","last_undegraded":"2023-09-30T22:53:28.524568+0000","last_fullsized":"2023-09-30T22:53:28.524568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:48:48.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521991+0000","last_change":"2023-09-30T22:53:28.521829+0000","last_active":"2023-09-30T22:53:28.521991+0000","last_peered":"2023-09-30T22:53:28.521991+0000","last_clean":"2023-09-30T22:53:28.521991+0000","last_became_active":"2023-09-30T22:53:28.521617+0000","last_became_peered":"2023-09-30T22:53:28.521617+0000","last_unstale":"2023-09-30T22:53:28.521991+0000","last_undegraded":"2023-09-30T22:53:28.521991+0000","last_fullsized":"2023-09-30T22:53:28.521991+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:12.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519013+0000","last_change":"2023-09-30T22:53:28.518767+0000","last_active":"2023-09-30T22:53:28.519013+0000","last_peered":"2023-09-30T22:53:28.519013+0000","last_clean":"2023-09-30T22:53:28.519013+0000","last_became_active":"2023-09-30T22:53:28.518141+0000","last_became_peered":"2023-09-30T22:53:28.518141+0000","last_unstale":"2023-09-30T22:53:28.519013+0000","last_undegraded":"2023-09-30T22:53:28.519013+0000","last_fullsized":"2023-09-30T22:53:28.519013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:39.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523512+0000","last_change":"2023-09-30T22:53:28.523441+0000","last_active":"2023-09-30T22:53:28.523512+0000","last_peered":"2023-09-30T22:53:28.523512+0000","last_clean":"2023-09-30T22:53:28.523512+0000","last_became_active":"2023-09-30T22:53:28.523060+0000","last_became_peered":"2023-09-30T22:53:28.523060+0000","last_unstale":"2023-09-30T22:53:28.523512+0000","last_undegraded":"2023-09-30T22:53:28.523512+0000","last_fullsized":"2023-09-30T22:53:28.523512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521320+0000","last_change":"2023-09-30T22:53:28.521259+0000","last_active":"2023-09-30T22:53:28.521320+0000","last_peered":"2023-09-30T22:53:28.521320+0000","last_clean":"2023-09-30T22:53:28.521320+0000","last_became_active":"2023-09-30T22:53:28.520791+0000","last_became_peered":"2023-09-30T22:53:28.520791+0000","last_unstale":"2023-09-30T22:53:28.521320+0000","last_undegraded":"2023-09-30T22:53:28.521320+0000","last_fullsized":"2023-09-30T22:53:28.521320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523920+0000","last_change":"2023-09-30T22:53:28.523845+0000","last_active":"2023-09-30T22:53:28.523920+0000","last_peered":"2023-09-30T22:53:28.523920+0000","last_clean":"2023-09-30T22:53:28.523920+0000","last_became_active":"2023-09-30T22:53:28.523587+0000","last_became_peered":"2023-09-30T22:53:28.523587+0000","last_unstale":"2023-09-30T22:53:28.523920+0000","last_undegraded":"2023-09-30T22:53:28.523920+0000","last_fullsized":"2023-09-30T22:53:28.523920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521215+0000","last_change":"2023-09-30T22:53:28.521142+0000","last_active":"2023-09-30T22:53:28.521215+0000","last_peered":"2023-09-30T22:53:28.521215+0000","last_clean":"2023-09-30T22:53:28.521215+0000","last_became_active":"2023-09-30T22:53:28.520866+0000","last_became_peered":"2023-09-30T22:53:28.520866+0000","last_unstale":"2023-09-30T22:53:28.521215+0000","last_undegraded":"2023-09-30T22:53:28.521215+0000","last_fullsized":"2023-09-30T22:53:28.521215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517945+0000","last_change":"2023-09-30T22:53:28.516913+0000","last_active":"2023-09-30T22:53:28.517945+0000","last_peered":"2023-09-30T22:53:28.517945+0000","last_clean":"2023-09-30T22:53:28.517945+0000","last_became_active":"2023-09-30T22:53:28.516675+0000","last_became_peered":"2023-09-30T22:53:28.516675+0000","last_unstale":"2023-09-30T22:53:28.517945+0000","last_undegraded":"2023-09-30T22:53:28.517945+0000","last_fullsized":"2023-09-30T22:53:28.517945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:59.351514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528033+0000","last_change":"2023-09-30T22:53:28.527707+0000","last_active":"2023-09-30T22:53:28.528033+0000","last_peered":"2023-09-30T22:53:28.528033+0000","last_clean":"2023-09-30T22:53:28.528033+0000","last_became_active":"2023-09-30T22:53:28.527483+0000","last_became_peered":"2023-09-30T22:53:28.527483+0000","last_unstale":"2023-09-30T22:53:28.528033+0000","last_undegraded":"2023-09-30T22:53:28.528033+0000","last_fullsized":"2023-09-30T22:53:28.528033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:06.946949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519144+0000","last_change":"2023-09-30T22:53:28.519070+0000","last_active":"2023-09-30T22:53:28.519144+0000","last_peered":"2023-09-30T22:53:28.519144+0000","last_clean":"2023-09-30T22:53:28.519144+0000","last_became_active":"2023-09-30T22:53:28.518852+0000","last_became_peered":"2023-09-30T22:53:28.518852+0000","last_unstale":"2023-09-30T22:53:28.519144+0000","last_undegraded":"2023-09-30T22:53:28.519144+0000","last_fullsized":"2023-09-30T22:53:28.519144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527117+0000","last_change":"2023-09-30T22:53:28.526708+0000","last_active":"2023-09-30T22:53:28.527117+0000","last_peered":"2023-09-30T22:53:28.527117+0000","last_clean":"2023-09-30T22:53:28.527117+0000","last_became_active":"2023-09-30T22:53:28.526478+0000","last_became_peered":"2023-09-30T22:53:28.526478+0000","last_unstale":"2023-09-30T22:53:28.527117+0000","last_undegraded":"2023-09-30T22:53:28.527117+0000","last_fullsized":"2023-09-30T22:53:28.527117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:57:09.485295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524561+0000","last_change":"2023-09-30T22:53:28.524489+0000","last_active":"2023-09-30T22:53:28.524561+0000","last_peered":"2023-09-30T22:53:28.524561+0000","last_clean":"2023-09-30T22:53:28.524561+0000","last_became_active":"2023-09-30T22:53:28.524252+0000","last_became_peered":"2023-09-30T22:53:28.524252+0000","last_unstale":"2023-09-30T22:53:28.524561+0000","last_undegraded":"2023-09-30T22:53:28.524561+0000","last_fullsized":"2023-09-30T22:53:28.524561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524505+0000","last_change":"2023-09-30T22:53:28.522426+0000","last_active":"2023-09-30T22:53:28.524505+0000","last_peered":"2023-09-30T22:53:28.524505+0000","last_clean":"2023-09-30T22:53:28.524505+0000","last_became_active":"2023-09-30T22:53:28.521202+0000","last_became_peered":"2023-09-30T22:53:28.521202+0000","last_unstale":"2023-09-30T22:53:28.524505+0000","last_undegraded":"2023-09-30T22:53:28.524505+0000","last_fullsized":"2023-09-30T22:53:28.524505+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:23.130881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519041+0000","last_change":"2023-09-30T22:53:28.518909+0000","last_active":"2023-09-30T22:53:28.519041+0000","last_peered":"2023-09-30T22:53:28.519041+0000","last_clean":"2023-09-30T22:53:28.519041+0000","last_became_active":"2023-09-30T22:53:28.518433+0000","last_became_peered":"2023-09-30T22:53:28.518433+0000","last_unstale":"2023-09-30T22:53:28.519041+0000","last_undegraded":"2023-09-30T22:53:28.519041+0000","last_fullsized":"2023-09-30T22:53:28.519041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:06.946949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517929+0000","last_change":"2023-09-30T22:53:28.515961+0000","last_active":"2023-09-30T22:53:28.517929+0000","last_peered":"2023-09-30T22:53:28.517929+0000","last_clean":"2023-09-30T22:53:28.517929+0000","last_became_active":"2023-09-30T22:53:28.515689+0000","last_became_peered":"2023-09-30T22:53:28.515689+0000","last_unstale":"2023-09-30T22:53:28.517929+0000","last_undegraded":"2023-09-30T22:53:28.517929+0000","last_fullsized":"2023-09-30T22:53:28.517929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:11:41.978885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524590+0000","last_change":"2023-09-30T22:53:28.524378+0000","last_active":"2023-09-30T22:53:28.524590+0000","last_peered":"2023-09-30T22:53:28.524590+0000","last_clean":"2023-09-30T22:53:28.524590+0000","last_became_active":"2023-09-30T22:53:28.523927+0000","last_became_peered":"2023-09-30T22:53:28.523927+0000","last_unstale":"2023-09-30T22:53:28.524590+0000","last_undegraded":"2023-09-30T22:53:28.524590+0000","last_fullsized":"2023-09-30T22:53:28.524590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:50.593476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528068+0000","last_change":"2023-09-30T22:53:28.527965+0000","last_active":"2023-09-30T22:53:28.528068+0000","last_peered":"2023-09-30T22:53:28.528068+0000","last_clean":"2023-09-30T22:53:28.528068+0000","last_became_active":"2023-09-30T22:53:28.527612+0000","last_became_peered":"2023-09-30T22:53:28.527612+0000","last_unstale":"2023-09-30T22:53:28.528068+0000","last_undegraded":"2023-09-30T22:53:28.528068+0000","last_fullsized":"2023-09-30T22:53:28.528068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:39.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517904+0000","last_change":"2023-09-30T22:53:28.515730+0000","last_active":"2023-09-30T22:53:28.517904+0000","last_peered":"2023-09-30T22:53:28.517904+0000","last_clean":"2023-09-30T22:53:28.517904+0000","last_became_active":"2023-09-30T22:53:28.515285+0000","last_became_peered":"2023-09-30T22:53:28.515285+0000","last_unstale":"2023-09-30T22:53:28.517904+0000","last_undegraded":"2023-09-30T22:53:28.517904+0000","last_fullsized":"2023-09-30T22:53:28.517904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:23:47.940060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538999+0000","last_change":"2023-09-30T22:53:27.516465+0000","last_active":"2023-09-30T22:53:28.538999+0000","last_peered":"2023-09-30T22:53:28.538999+0000","last_clean":"2023-09-30T22:53:28.538999+0000","last_became_active":"2023-09-30T22:53:27.516253+0000","last_became_peered":"2023-09-30T22:53:27.516253+0000","last_unstale":"2023-09-30T22:53:28.538999+0000","last_undegraded":"2023-09-30T22:53:28.538999+0000","last_fullsized":"2023-09-30T22:53:28.538999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522280+0000","last_change":"2023-09-30T22:53:28.522137+0000","last_active":"2023-09-30T22:53:28.522280+0000","last_peered":"2023-09-30T22:53:28.522280+0000","last_clean":"2023-09-30T22:53:28.522280+0000","last_became_active":"2023-09-30T22:53:28.521672+0000","last_became_peered":"2023-09-30T22:53:28.521672+0000","last_unstale":"2023-09-30T22:53:28.522280+0000","last_undegraded":"2023-09-30T22:53:28.522280+0000","last_fullsized":"2023-09-30T22:53:28.522280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:13.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534160+0000","last_change":"2023-09-30T22:53:27.513083+0000","last_active":"2023-09-30T22:53:28.534160+0000","last_peered":"2023-09-30T22:53:28.534160+0000","last_clean":"2023-09-30T22:53:28.534160+0000","last_became_active":"2023-09-30T22:53:27.512830+0000","last_became_peered":"2023-09-30T22:53:27.512830+0000","last_unstale":"2023-09-30T22:53:28.534160+0000","last_undegraded":"2023-09-30T22:53:28.534160+0000","last_fullsized":"2023-09-30T22:53:28.534160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518995+0000","last_change":"2023-09-30T22:53:28.518755+0000","last_active":"2023-09-30T22:53:28.518995+0000","last_peered":"2023-09-30T22:53:28.518995+0000","last_clean":"2023-09-30T22:53:28.518995+0000","last_became_active":"2023-09-30T22:53:28.518120+0000","last_became_peered":"2023-09-30T22:53:28.518120+0000","last_unstale":"2023-09-30T22:53:28.518995+0000","last_undegraded":"2023-09-30T22:53:28.518995+0000","last_fullsized":"2023-09-30T22:53:28.518995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:13.114495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536132+0000","last_change":"2023-09-30T22:53:27.521745+0000","last_active":"2023-09-30T22:53:28.536132+0000","last_peered":"2023-09-30T22:53:28.536132+0000","last_clean":"2023-09-30T22:53:28.536132+0000","last_became_active":"2023-09-30T22:53:27.521383+0000","last_became_peered":"2023-09-30T22:53:27.521383+0000","last_unstale":"2023-09-30T22:53:28.536132+0000","last_undegraded":"2023-09-30T22:53:28.536132+0000","last_fullsized":"2023-09-30T22:53:28.536132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519546+0000","last_change":"2023-09-30T22:53:28.519421+0000","last_active":"2023-09-30T22:53:28.519546+0000","last_peered":"2023-09-30T22:53:28.519546+0000","last_clean":"2023-09-30T22:53:28.519546+0000","last_became_active":"2023-09-30T22:53:28.519181+0000","last_became_peered":"2023-09-30T22:53:28.519181+0000","last_unstale":"2023-09-30T22:53:28.519546+0000","last_undegraded":"2023-09-30T22:53:28.519546+0000","last_fullsized":"2023-09-30T22:53:28.519546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:32.735104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535058+0000","last_change":"2023-09-30T22:53:27.517467+0000","last_active":"2023-09-30T22:53:28.535058+0000","last_peered":"2023-09-30T22:53:28.535058+0000","last_clean":"2023-09-30T22:53:28.535058+0000","last_became_active":"2023-09-30T22:53:27.517231+0000","last_became_peered":"2023-09-30T22:53:27.517231+0000","last_unstale":"2023-09-30T22:53:28.535058+0000","last_undegraded":"2023-09-30T22:53:28.535058+0000","last_fullsized":"2023-09-30T22:53:28.535058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521506+0000","last_change":"2023-09-30T22:53:28.520868+0000","last_active":"2023-09-30T22:53:28.521506+0000","last_peered":"2023-09-30T22:53:28.521506+0000","last_clean":"2023-09-30T22:53:28.521506+0000","last_became_active":"2023-09-30T22:53:28.520629+0000","last_became_peered":"2023-09-30T22:53:28.520629+0000","last_unstale":"2023-09-30T22:53:28.521506+0000","last_undegraded":"2023-09-30T22:53:28.521506+0000","last_fullsized":"2023-09-30T22:53:28.521506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:18:44.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535219+0000","last_change":"2023-09-30T22:53:27.517083+0000","last_active":"2023-09-30T22:53:28.535219+0000","last_peered":"2023-09-30T22:53:28.535219+0000","last_clean":"2023-09-30T22:53:28.535219+0000","last_became_active":"2023-09-30T22:53:27.516834+0000","last_became_peered":"2023-09-30T22:53:27.516834+0000","last_unstale":"2023-09-30T22:53:28.535219+0000","last_undegraded":"2023-09-30T22:53:28.535219+0000","last_fullsized":"2023-09-30T22:53:28.535219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519698+0000","last_change":"2023-09-30T22:53:28.519090+0000","last_active":"2023-09-30T22:53:28.519698+0000","last_peered":"2023-09-30T22:53:28.519698+0000","last_clean":"2023-09-30T22:53:28.519698+0000","last_became_active":"2023-09-30T22:53:28.518864+0000","last_became_peered":"2023-09-30T22:53:28.518864+0000","last_unstale":"2023-09-30T22:53:28.519698+0000","last_undegraded":"2023-09-30T22:53:28.519698+0000","last_fullsized":"2023-09-30T22:53:28.519698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:38:50.812517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534282+0000","last_change":"2023-09-30T22:53:27.521214+0000","last_active":"2023-09-30T22:53:28.534282+0000","last_peered":"2023-09-30T22:53:28.534282+0000","last_clean":"2023-09-30T22:53:28.534282+0000","last_became_active":"2023-09-30T22:53:27.521000+0000","last_became_peered":"2023-09-30T22:53:27.521000+0000","last_unstale":"2023-09-30T22:53:28.534282+0000","last_undegraded":"2023-09-30T22:53:28.534282+0000","last_fullsized":"2023-09-30T22:53:28.534282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519060+0000","last_change":"2023-09-30T22:53:28.518918+0000","last_active":"2023-09-30T22:53:28.519060+0000","last_peered":"2023-09-30T22:53:28.519060+0000","last_clean":"2023-09-30T22:53:28.519060+0000","last_became_active":"2023-09-30T22:53:28.518448+0000","last_became_peered":"2023-09-30T22:53:28.518448+0000","last_unstale":"2023-09-30T22:53:28.519060+0000","last_undegraded":"2023-09-30T22:53:28.519060+0000","last_fullsized":"2023-09-30T22:53:28.519060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:57:09.485295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519955+0000","last_change":"2023-09-30T22:53:27.520810+0000","last_active":"2023-09-30T22:53:28.519955+0000","last_peered":"2023-09-30T22:53:28.519955+0000","last_clean":"2023-09-30T22:53:28.519955+0000","last_became_active":"2023-09-30T22:53:27.520051+0000","last_became_peered":"2023-09-30T22:53:27.520051+0000","last_unstale":"2023-09-30T22:53:28.519955+0000","last_undegraded":"2023-09-30T22:53:28.519955+0000","last_fullsized":"2023-09-30T22:53:28.519955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516891+0000","last_change":"2023-09-30T22:53:28.516799+0000","last_active":"2023-09-30T22:53:28.516891+0000","last_peered":"2023-09-30T22:53:28.516891+0000","last_clean":"2023-09-30T22:53:28.516891+0000","last_became_active":"2023-09-30T22:53:28.516580+0000","last_became_peered":"2023-09-30T22:53:28.516580+0000","last_unstale":"2023-09-30T22:53:28.516891+0000","last_undegraded":"2023-09-30T22:53:28.516891+0000","last_fullsized":"2023-09-30T22:53:28.516891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516147+0000","last_change":"2023-09-30T22:53:27.519471+0000","last_active":"2023-09-30T22:53:28.516147+0000","last_peered":"2023-09-30T22:53:28.516147+0000","last_clean":"2023-09-30T22:53:28.516147+0000","last_became_active":"2023-09-30T22:53:27.518947+0000","last_became_peered":"2023-09-30T22:53:27.518947+0000","last_unstale":"2023-09-30T22:53:28.516147+0000","last_undegraded":"2023-09-30T22:53:28.516147+0000","last_fullsized":"2023-09-30T22:53:28.516147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:14.863213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524538+0000","last_change":"2023-09-30T22:53:28.524453+0000","last_active":"2023-09-30T22:53:28.524538+0000","last_peered":"2023-09-30T22:53:28.524538+0000","last_clean":"2023-09-30T22:53:28.524538+0000","last_became_active":"2023-09-30T22:53:28.524098+0000","last_became_peered":"2023-09-30T22:53:28.524098+0000","last_unstale":"2023-09-30T22:53:28.524538+0000","last_undegraded":"2023-09-30T22:53:28.524538+0000","last_fullsized":"2023-09-30T22:53:28.524538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:25.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517878+0000","last_change":"2023-09-30T22:53:27.517464+0000","last_active":"2023-09-30T22:53:28.517878+0000","last_peered":"2023-09-30T22:53:28.517878+0000","last_clean":"2023-09-30T22:53:28.517878+0000","last_became_active":"2023-09-30T22:53:27.516983+0000","last_became_peered":"2023-09-30T22:53:27.516983+0000","last_unstale":"2023-09-30T22:53:28.517878+0000","last_undegraded":"2023-09-30T22:53:28.517878+0000","last_fullsized":"2023-09-30T22:53:28.517878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523916+0000","last_change":"2023-09-30T22:53:28.523841+0000","last_active":"2023-09-30T22:53:28.523916+0000","last_peered":"2023-09-30T22:53:28.523916+0000","last_clean":"2023-09-30T22:53:28.523916+0000","last_became_active":"2023-09-30T22:53:28.523574+0000","last_became_peered":"2023-09-30T22:53:28.523574+0000","last_unstale":"2023-09-30T22:53:28.523916+0000","last_undegraded":"2023-09-30T22:53:28.523916+0000","last_fullsized":"2023-09-30T22:53:28.523916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509683+0000","last_change":"2023-09-30T22:53:27.510430+0000","last_active":"2023-09-30T22:53:28.509683+0000","last_peered":"2023-09-30T22:53:28.509683+0000","last_clean":"2023-09-30T22:53:28.509683+0000","last_became_active":"2023-09-30T22:53:27.510188+0000","last_became_peered":"2023-09-30T22:53:27.510188+0000","last_unstale":"2023-09-30T22:53:28.509683+0000","last_undegraded":"2023-09-30T22:53:28.509683+0000","last_fullsized":"2023-09-30T22:53:28.509683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:00.134991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528052+0000","last_change":"2023-09-30T22:53:28.527814+0000","last_active":"2023-09-30T22:53:28.528052+0000","last_peered":"2023-09-30T22:53:28.528052+0000","last_clean":"2023-09-30T22:53:28.528052+0000","last_became_active":"2023-09-30T22:53:28.527339+0000","last_became_peered":"2023-09-30T22:53:28.527339+0000","last_unstale":"2023-09-30T22:53:28.528052+0000","last_undegraded":"2023-09-30T22:53:28.528052+0000","last_fullsized":"2023-09-30T22:53:28.528052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:10.461181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535266+0000","last_change":"2023-09-30T22:53:27.517326+0000","last_active":"2023-09-30T22:53:28.535266+0000","last_peered":"2023-09-30T22:53:28.535266+0000","last_clean":"2023-09-30T22:53:28.535266+0000","last_became_active":"2023-09-30T22:53:27.517098+0000","last_became_peered":"2023-09-30T22:53:27.517098+0000","last_unstale":"2023-09-30T22:53:28.535266+0000","last_undegraded":"2023-09-30T22:53:28.535266+0000","last_fullsized":"2023-09-30T22:53:28.535266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:13.215603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524484+0000","last_change":"2023-09-30T22:53:28.521854+0000","last_active":"2023-09-30T22:53:28.524484+0000","last_peered":"2023-09-30T22:53:28.524484+0000","last_clean":"2023-09-30T22:53:28.524484+0000","last_became_active":"2023-09-30T22:53:28.521590+0000","last_became_peered":"2023-09-30T22:53:28.521590+0000","last_unstale":"2023-09-30T22:53:28.524484+0000","last_undegraded":"2023-09-30T22:53:28.524484+0000","last_fullsized":"2023-09-30T22:53:28.524484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:07.541785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538839+0000","last_change":"2023-09-30T22:53:27.520637+0000","last_active":"2023-09-30T22:53:28.538839+0000","last_peered":"2023-09-30T22:53:28.538839+0000","last_clean":"2023-09-30T22:53:28.538839+0000","last_became_active":"2023-09-30T22:53:27.519273+0000","last_became_peered":"2023-09-30T22:53:27.519273+0000","last_unstale":"2023-09-30T22:53:28.538839+0000","last_undegraded":"2023-09-30T22:53:28.538839+0000","last_fullsized":"2023-09-30T22:53:28.538839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527146+0000","last_change":"2023-09-30T22:53:28.527020+0000","last_active":"2023-09-30T22:53:28.527146+0000","last_peered":"2023-09-30T22:53:28.527146+0000","last_clean":"2023-09-30T22:53:28.527146+0000","last_became_active":"2023-09-30T22:53:28.526664+0000","last_became_peered":"2023-09-30T22:53:28.526664+0000","last_unstale":"2023-09-30T22:53:28.527146+0000","last_undegraded":"2023-09-30T22:53:28.527146+0000","last_fullsized":"2023-09-30T22:53:28.527146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:13.114495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536461+0000","last_change":"2023-09-30T22:53:27.521604+0000","last_active":"2023-09-30T22:53:28.536461+0000","last_peered":"2023-09-30T22:53:28.536461+0000","last_clean":"2023-09-30T22:53:28.536461+0000","last_became_active":"2023-09-30T22:53:27.521088+0000","last_became_peered":"2023-09-30T22:53:27.521088+0000","last_unstale":"2023-09-30T22:53:28.536461+0000","last_undegraded":"2023-09-30T22:53:28.536461+0000","last_fullsized":"2023-09-30T22:53:28.536461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519512+0000","last_change":"2023-09-30T22:53:28.518412+0000","last_active":"2023-09-30T22:53:28.519512+0000","last_peered":"2023-09-30T22:53:28.519512+0000","last_clean":"2023-09-30T22:53:28.519512+0000","last_became_active":"2023-09-30T22:53:28.517871+0000","last_became_peered":"2023-09-30T22:53:28.517871+0000","last_unstale":"2023-09-30T22:53:28.519512+0000","last_undegraded":"2023-09-30T22:53:28.519512+0000","last_fullsized":"2023-09-30T22:53:28.519512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511856+0000","last_change":"2023-09-30T22:53:27.517581+0000","last_active":"2023-09-30T22:53:28.511856+0000","last_peered":"2023-09-30T22:53:28.511856+0000","last_clean":"2023-09-30T22:53:28.511856+0000","last_became_active":"2023-09-30T22:53:27.517341+0000","last_became_peered":"2023-09-30T22:53:27.517341+0000","last_unstale":"2023-09-30T22:53:28.511856+0000","last_undegraded":"2023-09-30T22:53:28.511856+0000","last_fullsized":"2023-09-30T22:53:28.511856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526246+0000","last_change":"2023-09-30T22:53:28.525685+0000","last_active":"2023-09-30T22:53:28.526246+0000","last_peered":"2023-09-30T22:53:28.526246+0000","last_clean":"2023-09-30T22:53:28.526246+0000","last_became_active":"2023-09-30T22:53:28.525403+0000","last_became_peered":"2023-09-30T22:53:28.525403+0000","last_unstale":"2023-09-30T22:53:28.526246+0000","last_undegraded":"2023-09-30T22:53:28.526246+0000","last_fullsized":"2023-09-30T22:53:28.526246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509518+0000","last_change":"2023-09-30T22:53:27.518671+0000","last_active":"2023-09-30T22:53:28.509518+0000","last_peered":"2023-09-30T22:53:28.509518+0000","last_clean":"2023-09-30T22:53:28.509518+0000","last_became_active":"2023-09-30T22:53:27.518248+0000","last_became_peered":"2023-09-30T22:53:27.518248+0000","last_unstale":"2023-09-30T22:53:28.509518+0000","last_undegraded":"2023-09-30T22:53:28.509518+0000","last_fullsized":"2023-09-30T22:53:28.509518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:17.490285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513109+0000","last_change":"2023-09-30T22:53:28.513034+0000","last_active":"2023-09-30T22:53:28.513109+0000","last_peered":"2023-09-30T22:53:28.513109+0000","last_clean":"2023-09-30T22:53:28.513109+0000","last_became_active":"2023-09-30T22:53:28.512753+0000","last_became_peered":"2023-09-30T22:53:28.512753+0000","last_unstale":"2023-09-30T22:53:28.513109+0000","last_undegraded":"2023-09-30T22:53:28.513109+0000","last_fullsized":"2023-09-30T22:53:28.513109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538127+0000","last_change":"2023-09-30T22:53:27.516048+0000","last_active":"2023-09-30T22:53:28.538127+0000","last_peered":"2023-09-30T22:53:28.538127+0000","last_clean":"2023-09-30T22:53:28.538127+0000","last_became_active":"2023-09-30T22:53:27.515566+0000","last_became_peered":"2023-09-30T22:53:27.515566+0000","last_unstale":"2023-09-30T22:53:28.538127+0000","last_undegraded":"2023-09-30T22:53:28.538127+0000","last_fullsized":"2023-09-30T22:53:28.538127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:32.867025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519529+0000","last_change":"2023-09-30T22:53:28.518549+0000","last_active":"2023-09-30T22:53:28.519529+0000","last_peered":"2023-09-30T22:53:28.519529+0000","last_clean":"2023-09-30T22:53:28.519529+0000","last_became_active":"2023-09-30T22:53:28.518178+0000","last_became_peered":"2023-09-30T22:53:28.518178+0000","last_unstale":"2023-09-30T22:53:28.519529+0000","last_undegraded":"2023-09-30T22:53:28.519529+0000","last_fullsized":"2023-09-30T22:53:28.519529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.533325+0000","last_change":"2023-09-30T22:53:27.519544+0000","last_active":"2023-09-30T22:53:28.533325+0000","last_peered":"2023-09-30T22:53:28.533325+0000","last_clean":"2023-09-30T22:53:28.533325+0000","last_became_active":"2023-09-30T22:53:27.519269+0000","last_became_peered":"2023-09-30T22:53:27.519269+0000","last_unstale":"2023-09-30T22:53:28.533325+0000","last_undegraded":"2023-09-30T22:53:28.533325+0000","last_fullsized":"2023-09-30T22:53:28.533325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:22.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524412+0000","last_change":"2023-09-30T22:53:28.519623+0000","last_active":"2023-09-30T22:53:28.524412+0000","last_peered":"2023-09-30T22:53:28.524412+0000","last_clean":"2023-09-30T22:53:28.524412+0000","last_became_active":"2023-09-30T22:53:28.519379+0000","last_became_peered":"2023-09-30T22:53:28.519379+0000","last_unstale":"2023-09-30T22:53:28.524412+0000","last_undegraded":"2023-09-30T22:53:28.524412+0000","last_fullsized":"2023-09-30T22:53:28.524412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:43:42.198369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536377+0000","last_change":"2023-09-30T22:53:27.516588+0000","last_active":"2023-09-30T22:53:28.536377+0000","last_peered":"2023-09-30T22:53:28.536377+0000","last_clean":"2023-09-30T22:53:28.536377+0000","last_became_active":"2023-09-30T22:53:27.516377+0000","last_became_peered":"2023-09-30T22:53:27.516377+0000","last_unstale":"2023-09-30T22:53:28.536377+0000","last_undegraded":"2023-09-30T22:53:28.536377+0000","last_fullsized":"2023-09-30T22:53:28.536377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:49.586790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524371+0000","last_change":"2023-09-30T22:53:28.517717+0000","last_active":"2023-09-30T22:53:28.524371+0000","last_peered":"2023-09-30T22:53:28.524371+0000","last_clean":"2023-09-30T22:53:28.524371+0000","last_became_active":"2023-09-30T22:53:28.517459+0000","last_became_peered":"2023-09-30T22:53:28.517459+0000","last_unstale":"2023-09-30T22:53:28.524371+0000","last_undegraded":"2023-09-30T22:53:28.524371+0000","last_fullsized":"2023-09-30T22:53:28.524371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:04.012099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534031+0000","last_change":"2023-09-30T22:53:27.519451+0000","last_active":"2023-09-30T22:53:28.534031+0000","last_peered":"2023-09-30T22:53:28.534031+0000","last_clean":"2023-09-30T22:53:28.534031+0000","last_became_active":"2023-09-30T22:53:27.519207+0000","last_became_peered":"2023-09-30T22:53:27.519207+0000","last_unstale":"2023-09-30T22:53:28.534031+0000","last_undegraded":"2023-09-30T22:53:28.534031+0000","last_fullsized":"2023-09-30T22:53:28.534031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:54.470913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523493+0000","last_change":"2023-09-30T22:53:28.523288+0000","last_active":"2023-09-30T22:53:28.523493+0000","last_peered":"2023-09-30T22:53:28.523493+0000","last_clean":"2023-09-30T22:53:28.523493+0000","last_became_active":"2023-09-30T22:53:28.522752+0000","last_became_peered":"2023-09-30T22:53:28.522752+0000","last_unstale":"2023-09-30T22:53:28.523493+0000","last_undegraded":"2023-09-30T22:53:28.523493+0000","last_fullsized":"2023-09-30T22:53:28.523493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514427+0000","last_change":"2023-09-30T22:53:27.513959+0000","last_active":"2023-09-30T22:53:28.514427+0000","last_peered":"2023-09-30T22:53:28.514427+0000","last_clean":"2023-09-30T22:53:28.514427+0000","last_became_active":"2023-09-30T22:53:27.513732+0000","last_became_peered":"2023-09-30T22:53:27.513732+0000","last_unstale":"2023-09-30T22:53:28.514427+0000","last_undegraded":"2023-09-30T22:53:28.514427+0000","last_fullsized":"2023-09-30T22:53:28.514427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517310+0000","last_change":"2023-09-30T22:53:28.512966+0000","last_active":"2023-09-30T22:53:28.517310+0000","last_peered":"2023-09-30T22:53:28.517310+0000","last_clean":"2023-09-30T22:53:28.517310+0000","last_became_active":"2023-09-30T22:53:28.512646+0000","last_became_peered":"2023-09-30T22:53:28.512646+0000","last_unstale":"2023-09-30T22:53:28.517310+0000","last_undegraded":"2023-09-30T22:53:28.517310+0000","last_fullsized":"2023-09-30T22:53:28.517310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:10.461181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536715+0000","last_change":"2023-09-30T22:53:27.516148+0000","last_active":"2023-09-30T22:53:28.536715+0000","last_peered":"2023-09-30T22:53:28.536715+0000","last_clean":"2023-09-30T22:53:28.536715+0000","last_became_active":"2023-09-30T22:53:27.514962+0000","last_became_peered":"2023-09-30T22:53:27.514962+0000","last_unstale":"2023-09-30T22:53:28.536715+0000","last_undegraded":"2023-09-30T22:53:28.536715+0000","last_fullsized":"2023-09-30T22:53:28.536715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:55.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525445+0000","last_change":"2023-09-30T22:53:28.525377+0000","last_active":"2023-09-30T22:53:28.525445+0000","last_peered":"2023-09-30T22:53:28.525445+0000","last_clean":"2023-09-30T22:53:28.525445+0000","last_became_active":"2023-09-30T22:53:28.525124+0000","last_became_peered":"2023-09-30T22:53:28.525124+0000","last_unstale":"2023-09-30T22:53:28.525445+0000","last_undegraded":"2023-09-30T22:53:28.525445+0000","last_fullsized":"2023-09-30T22:53:28.525445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:51:22.092802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511256+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.511256+0000","last_peered":"2023-09-30T22:53:28.511256+0000","last_clean":"2023-09-30T22:53:28.511256+0000","last_became_active":"2023-09-30T22:53:27.516236+0000","last_became_peered":"2023-09-30T22:53:27.516236+0000","last_unstale":"2023-09-30T22:53:28.511256+0000","last_undegraded":"2023-09-30T22:53:28.511256+0000","last_fullsized":"2023-09-30T22:53:28.511256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526264+0000","last_change":"2023-09-30T22:53:28.526005+0000","last_active":"2023-09-30T22:53:28.526264+0000","last_peered":"2023-09-30T22:53:28.526264+0000","last_clean":"2023-09-30T22:53:28.526264+0000","last_became_active":"2023-09-30T22:53:28.525429+0000","last_became_peered":"2023-09-30T22:53:28.525429+0000","last_unstale":"2023-09-30T22:53:28.526264+0000","last_undegraded":"2023-09-30T22:53:28.526264+0000","last_fullsized":"2023-09-30T22:53:28.526264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515992+0000","last_change":"2023-09-30T22:53:27.519633+0000","last_active":"2023-09-30T22:53:28.515992+0000","last_peered":"2023-09-30T22:53:28.515992+0000","last_clean":"2023-09-30T22:53:28.515992+0000","last_became_active":"2023-09-30T22:53:27.519232+0000","last_became_peered":"2023-09-30T22:53:27.519232+0000","last_unstale":"2023-09-30T22:53:28.515992+0000","last_undegraded":"2023-09-30T22:53:28.515992+0000","last_fullsized":"2023-09-30T22:53:28.515992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:51.349781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527132+0000","last_change":"2023-09-30T22:53:28.526862+0000","last_active":"2023-09-30T22:53:28.527132+0000","last_peered":"2023-09-30T22:53:28.527132+0000","last_clean":"2023-09-30T22:53:28.527132+0000","last_became_active":"2023-09-30T22:53:28.526232+0000","last_became_peered":"2023-09-30T22:53:28.526232+0000","last_unstale":"2023-09-30T22:53:28.527132+0000","last_undegraded":"2023-09-30T22:53:28.527132+0000","last_fullsized":"2023-09-30T22:53:28.527132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:17.258231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.512067+0000","last_change":"2023-09-30T22:53:27.520705+0000","last_active":"2023-09-30T22:53:28.512067+0000","last_peered":"2023-09-30T22:53:28.512067+0000","last_clean":"2023-09-30T22:53:28.512067+0000","last_became_active":"2023-09-30T22:53:27.520103+0000","last_became_peered":"2023-09-30T22:53:27.520103+0000","last_unstale":"2023-09-30T22:53:28.512067+0000","last_undegraded":"2023-09-30T22:53:28.512067+0000","last_fullsized":"2023-09-30T22:53:28.512067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:24.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521264+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521264+0000","last_peered":"2023-09-30T22:53:28.521264+0000","last_clean":"2023-09-30T22:53:28.521264+0000","last_became_active":"2023-09-30T22:53:28.520956+0000","last_became_peered":"2023-09-30T22:53:28.520956+0000","last_unstale":"2023-09-30T22:53:28.521264+0000","last_undegraded":"2023-09-30T22:53:28.521264+0000","last_fullsized":"2023-09-30T22:53:28.521264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518003+0000","last_change":"2023-09-30T22:53:27.516312+0000","last_active":"2023-09-30T22:53:28.518003+0000","last_peered":"2023-09-30T22:53:28.518003+0000","last_clean":"2023-09-30T22:53:28.518003+0000","last_became_active":"2023-09-30T22:53:27.516077+0000","last_became_peered":"2023-09-30T22:53:27.516077+0000","last_unstale":"2023-09-30T22:53:28.518003+0000","last_undegraded":"2023-09-30T22:53:28.518003+0000","last_fullsized":"2023-09-30T22:53:28.518003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:23.956508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514093+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:53:28.514093+0000","last_peered":"2023-09-30T22:53:28.514093+0000","last_clean":"2023-09-30T22:53:28.514093+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:53:28.514093+0000","last_undegraded":"2023-09-30T22:53:28.514093+0000","last_fullsized":"2023-09-30T22:53:28.514093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520799+0000","last_change":"2023-09-30T22:53:28.520729+0000","last_active":"2023-09-30T22:53:28.520799+0000","last_peered":"2023-09-30T22:53:28.520799+0000","last_clean":"2023-09-30T22:53:28.520799+0000","last_became_active":"2023-09-30T22:53:28.520513+0000","last_became_peered":"2023-09-30T22:53:28.520513+0000","last_unstale":"2023-09-30T22:53:28.520799+0000","last_undegraded":"2023-09-30T22:53:28.520799+0000","last_fullsized":"2023-09-30T22:53:28.520799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509593+0000","last_change":"2023-09-30T22:53:27.518551+0000","last_active":"2023-09-30T22:53:28.509593+0000","last_peered":"2023-09-30T22:53:28.509593+0000","last_clean":"2023-09-30T22:53:28.509593+0000","last_became_active":"2023-09-30T22:53:27.518302+0000","last_became_peered":"2023-09-30T22:53:27.518302+0000","last_unstale":"2023-09-30T22:53:28.509593+0000","last_undegraded":"2023-09-30T22:53:28.509593+0000","last_fullsized":"2023-09-30T22:53:28.509593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:47.454460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509969+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:53:28.509969+0000","last_peered":"2023-09-30T22:53:28.509969+0000","last_clean":"2023-09-30T22:53:28.509969+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:53:28.509969+0000","last_undegraded":"2023-09-30T22:53:28.509969+0000","last_fullsized":"2023-09-30T22:53:28.509969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526279+0000","last_change":"2023-09-30T22:53:28.526154+0000","last_active":"2023-09-30T22:53:28.526279+0000","last_peered":"2023-09-30T22:53:28.526279+0000","last_clean":"2023-09-30T22:53:28.526279+0000","last_became_active":"2023-09-30T22:53:28.525783+0000","last_became_peered":"2023-09-30T22:53:28.525783+0000","last_unstale":"2023-09-30T22:53:28.526279+0000","last_undegraded":"2023-09-30T22:53:28.526279+0000","last_fullsized":"2023-09-30T22:53:28.526279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508773+0000","last_change":"2023-09-30T22:53:27.518889+0000","last_active":"2023-09-30T22:53:28.508773+0000","last_peered":"2023-09-30T22:53:28.508773+0000","last_clean":"2023-09-30T22:53:28.508773+0000","last_became_active":"2023-09-30T22:53:27.518640+0000","last_became_peered":"2023-09-30T22:53:27.518640+0000","last_unstale":"2023-09-30T22:53:28.508773+0000","last_undegraded":"2023-09-30T22:53:28.508773+0000","last_fullsized":"2023-09-30T22:53:28.508773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:24.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508872+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:53:28.508872+0000","last_peered":"2023-09-30T22:53:28.508872+0000","last_clean":"2023-09-30T22:53:28.508872+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:53:28.508872+0000","last_undegraded":"2023-09-30T22:53:28.508872+0000","last_fullsized":"2023-09-30T22:53:28.508872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517975+0000","last_change":"2023-09-30T22:53:28.517844+0000","last_active":"2023-09-30T22:53:28.517975+0000","last_peered":"2023-09-30T22:53:28.517975+0000","last_clean":"2023-09-30T22:53:28.517975+0000","last_became_active":"2023-09-30T22:53:28.517579+0000","last_became_peered":"2023-09-30T22:53:28.517579+0000","last_unstale":"2023-09-30T22:53:28.517975+0000","last_undegraded":"2023-09-30T22:53:28.517975+0000","last_fullsized":"2023-09-30T22:53:28.517975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:56.402195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517216+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.517216+0000","last_peered":"2023-09-30T22:53:28.517216+0000","last_clean":"2023-09-30T22:53:28.517216+0000","last_became_active":"2023-09-30T22:53:27.516261+0000","last_became_peered":"2023-09-30T22:53:27.516261+0000","last_unstale":"2023-09-30T22:53:28.517216+0000","last_undegraded":"2023-09-30T22:53:28.517216+0000","last_fullsized":"2023-09-30T22:53:28.517216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:22.220152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509715+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:53:28.509715+0000","last_peered":"2023-09-30T22:53:28.509715+0000","last_clean":"2023-09-30T22:53:28.509715+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:53:28.509715+0000","last_undegraded":"2023-09-30T22:53:28.509715+0000","last_fullsized":"2023-09-30T22:53:28.509715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513331+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:53:28.513331+0000","last_peered":"2023-09-30T22:53:28.513331+0000","last_clean":"2023-09-30T22:53:28.513331+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:53:28.513331+0000","last_undegraded":"2023-09-30T22:53:28.513331+0000","last_fullsized":"2023-09-30T22:53:28.513331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521299+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521299+0000","last_peered":"2023-09-30T22:53:28.521299+0000","last_clean":"2023-09-30T22:53:28.521299+0000","last_became_active":"2023-09-30T22:53:28.520925+0000","last_became_peered":"2023-09-30T22:53:28.520925+0000","last_unstale":"2023-09-30T22:53:28.521299+0000","last_undegraded":"2023-09-30T22:53:28.521299+0000","last_fullsized":"2023-09-30T22:53:28.521299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535759+0000","last_change":"2023-09-30T22:53:27.513347+0000","last_active":"2023-09-30T22:53:28.535759+0000","last_peered":"2023-09-30T22:53:28.535759+0000","last_clean":"2023-09-30T22:53:28.535759+0000","last_became_active":"2023-09-30T22:53:27.513127+0000","last_became_peered":"2023-09-30T22:53:27.513127+0000","last_unstale":"2023-09-30T22:53:28.535759+0000","last_undegraded":"2023-09-30T22:53:28.535759+0000","last_fullsized":"2023-09-30T22:53:28.535759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:06.535100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509399+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:53:28.509399+0000","last_peered":"2023-09-30T22:53:28.509399+0000","last_clean":"2023-09-30T22:53:28.509399+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:53:28.509399+0000","last_undegraded":"2023-09-30T22:53:28.509399+0000","last_fullsized":"2023-09-30T22:53:28.509399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521298+0000","last_change":"2023-09-30T22:53:28.521190+0000","last_active":"2023-09-30T22:53:28.521298+0000","last_peered":"2023-09-30T22:53:28.521298+0000","last_clean":"2023-09-30T22:53:28.521298+0000","last_became_active":"2023-09-30T22:53:28.520955+0000","last_became_peered":"2023-09-30T22:53:28.520955+0000","last_unstale":"2023-09-30T22:53:28.521298+0000","last_undegraded":"2023-09-30T22:53:28.521298+0000","last_fullsized":"2023-09-30T22:53:28.521298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517510+0000","last_change":"2023-09-30T22:53:27.516490+0000","last_active":"2023-09-30T22:53:28.517510+0000","last_peered":"2023-09-30T22:53:28.517510+0000","last_clean":"2023-09-30T22:53:28.517510+0000","last_became_active":"2023-09-30T22:53:27.516254+0000","last_became_peered":"2023-09-30T22:53:27.516254+0000","last_unstale":"2023-09-30T22:53:28.517510+0000","last_undegraded":"2023-09-30T22:53:28.517510+0000","last_fullsized":"2023-09-30T22:53:28.517510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:33:29.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509312+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:53:28.509312+0000","last_peered":"2023-09-30T22:53:28.509312+0000","last_clean":"2023-09-30T22:53:28.509312+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:53:28.509312+0000","last_undegraded":"2023-09-30T22:53:28.509312+0000","last_fullsized":"2023-09-30T22:53:28.509312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521668+0000","last_change":"2023-09-30T22:53:28.519726+0000","last_active":"2023-09-30T22:53:28.521668+0000","last_peered":"2023-09-30T22:53:28.521668+0000","last_clean":"2023-09-30T22:53:28.521668+0000","last_became_active":"2023-09-30T22:53:28.519499+0000","last_became_peered":"2023-09-30T22:53:28.519499+0000","last_unstale":"2023-09-30T22:53:28.521668+0000","last_undegraded":"2023-09-30T22:53:28.521668+0000","last_fullsized":"2023-09-30T22:53:28.521668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:26:12.180534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508433+0000","last_change":"2023-09-30T22:53:27.514765+0000","last_active":"2023-09-30T22:53:28.508433+0000","last_peered":"2023-09-30T22:53:28.508433+0000","last_clean":"2023-09-30T22:53:28.508433+0000","last_became_active":"2023-09-30T22:53:27.514536+0000","last_became_peered":"2023-09-30T22:53:27.514536+0000","last_unstale":"2023-09-30T22:53:28.508433+0000","last_undegraded":"2023-09-30T22:53:28.508433+0000","last_fullsized":"2023-09-30T22:53:28.508433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:03.005413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518201+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:53:28.518201+0000","last_peered":"2023-09-30T22:53:28.518201+0000","last_clean":"2023-09-30T22:53:28.518201+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:53:28.518201+0000","last_undegraded":"2023-09-30T22:53:28.518201+0000","last_fullsized":"2023-09-30T22:53:28.518201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519732+0000","last_change":"2023-09-30T22:53:28.519554+0000","last_active":"2023-09-30T22:53:28.519732+0000","last_peered":"2023-09-30T22:53:28.519732+0000","last_clean":"2023-09-30T22:53:28.519732+0000","last_became_active":"2023-09-30T22:53:28.519318+0000","last_became_peered":"2023-09-30T22:53:28.519318+0000","last_unstale":"2023-09-30T22:53:28.519732+0000","last_undegraded":"2023-09-30T22:53:28.519732+0000","last_fullsized":"2023-09-30T22:53:28.519732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520210+0000","last_change":"2023-09-30T22:53:27.520302+0000","last_active":"2023-09-30T22:53:28.520210+0000","last_peered":"2023-09-30T22:53:28.520210+0000","last_clean":"2023-09-30T22:53:28.520210+0000","last_became_active":"2023-09-30T22:53:27.518956+0000","last_became_peered":"2023-09-30T22:53:27.518956+0000","last_unstale":"2023-09-30T22:53:28.520210+0000","last_undegraded":"2023-09-30T22:53:28.520210+0000","last_fullsized":"2023-09-30T22:53:28.520210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509889+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:53:28.509889+0000","last_peered":"2023-09-30T22:53:28.509889+0000","last_clean":"2023-09-30T22:53:28.509889+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:53:28.509889+0000","last_undegraded":"2023-09-30T22:53:28.509889+0000","last_fullsized":"2023-09-30T22:53:28.509889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.624},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.752}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838200,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.79100000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.74399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.879}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.0249999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.96599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.374},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.504},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.442}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.036}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":1.22},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.0740000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":1.21}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":1.2330000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46800000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.434}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.871},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.81699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":160,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.434}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.179},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.877}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":159,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65800000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.78000000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70799999999999996}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77100000000000002}]}]}],"pool_statfs":[]}} 2023-09-30T22:53:37.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:53:37.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.952+0000 7f6be23ff700 1 Processor -- start 2023-09-30T22:53:37.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.952+0000 7f6be23ff700 1 -- start start 2023-09-30T22:53:37.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6be23ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bdc0cee50 0x7f6bdc159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6be23ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0d03d0 0x7f6bdc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6be23ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc06b8d0 con 0x7f6bdc1598e0 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6be23ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc0cff40 con 0x7f6bdc0cee50 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6be23ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0cf330 con 0x7f6bdc0d03d0 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6bdb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bdc0cee50 0x7f6bdc159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6bdb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bdc0cee50 0x7f6bdc159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47128/0 (socket says 172.21.15.142:47128) 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6bdb7fe700 1 -- 172.21.15.142:0/235189226 learned_addr learned my addr 172.21.15.142:0/235189226 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6be099c700 1 --2- 172.21.15.142:0/235189226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0d03d0 0x7f6bdc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6bdb7fe700 1 -- 172.21.15.142:0/235189226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0d03d0 msgr2=0x7f6bdc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:37.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6bdb7fe700 1 --2- 172.21.15.142:0/235189226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0d03d0 0x7f6bdc15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:37.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6bdb7fe700 1 -- 172.21.15.142:0/235189226 >> v1:172.21.15.148:6789/0 conn(0x7f6bdc1598e0 legacy=0x7f6bdc06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:37.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.954+0000 7f6bdb7fe700 1 -- 172.21.15.142:0/235189226 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0cf610 con 0x7f6bdc0cee50 2023-09-30T22:53:37.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.955+0000 7f6bdb7fe700 1 --2- 172.21.15.142:0/235189226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc0cee50 0x7f6bdc159cb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00099b0 tx=0x7f6bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a4dc5f3c7169f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.955+0000 7f6bdaffd700 1 -- 172.21.15.142:0/235189226 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000b860 con 0x7f6bdc0cee50 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.955+0000 7f6bdaffd700 1 -- 172.21.15.142:0/235189226 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000b9c0 con 0x7f6bdc0cee50 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.955+0000 7f6bdaffd700 1 -- 172.21.15.142:0/235189226 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000bd60 con 0x7f6bdc0cee50 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.955+0000 7f6be23ff700 1 -- 172.21.15.142:0/235189226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc0cee50 msgr2=0x7f6bdc159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.955+0000 7f6be23ff700 1 --2- 172.21.15.142:0/235189226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc0cee50 0x7f6bdc159cb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00099b0 tx=0x7f6bd0009250 comp rx=0 tx=0).stop 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.956+0000 7f6be23ff700 1 -- 172.21.15.142:0/235189226 shutdown_connections 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.956+0000 7f6be23ff700 1 --2- 172.21.15.142:0/235189226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0d03d0 0x7f6bdc15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:37.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.956+0000 7f6be23ff700 1 --2- 172.21.15.142:0/235189226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc0cee50 0x7f6bdc159cb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:37.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.956+0000 7f6be23ff700 1 -- 172.21.15.142:0/235189226 >> 172.21.15.142:0/235189226 conn(0x7f6bdc0cd540 msgr2=0x7f6bdc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:37.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.956+0000 7f6be23ff700 1 -- 172.21.15.142:0/235189226 shutdown_connections 2023-09-30T22:53:37.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.956+0000 7f6be23ff700 1 -- 172.21.15.142:0/235189226 wait complete. 2023-09-30T22:53:37.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.957+0000 7f6be23ff700 1 Processor -- start 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.957+0000 7f6be23ff700 1 -- start start 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be23ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0cee50 0x7f6bdc15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be23ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc0d03d0 0x7f6bdc153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be23ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc1598e0 0x7f6bdc150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be23ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc154140 con 0x7f6bdc1598e0 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be23ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc151b70 con 0x7f6bdc0d03d0 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be23ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc15c210 con 0x7f6bdc0cee50 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be099c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc1598e0 0x7f6bdc150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be099c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc1598e0 0x7f6bdc150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47138/0 (socket says 172.21.15.142:47138) 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6be099c700 1 -- 172.21.15.142:0/141006572 learned_addr learned my addr 172.21.15.142:0/141006572 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:37.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6bdb7fe700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc0d03d0 0x7f6bdc153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.958+0000 7f6bdbfff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0cee50 0x7f6bdc15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6be099c700 1 -- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0cee50 msgr2=0x7f6bdc15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6be099c700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0cee50 0x7f6bdc15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6be099c700 1 -- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc0d03d0 msgr2=0x7f6bdc153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6be099c700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc0d03d0 0x7f6bdc153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6be099c700 1 -- 172.21.15.142:0/141006572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd00094f0 con 0x7f6bdc1598e0 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6be099c700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc1598e0 0x7f6bdc150f50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009fd0 tx=0x7f6bd4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6bc3fff700 1 -- 172.21.15.142:0/141006572 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400ebf0 con 0x7f6bdc1598e0 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6bc3fff700 1 -- 172.21.15.142:0/141006572 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd400ed50 con 0x7f6bdc1598e0 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc15b970 con 0x7f6bdc1598e0 2023-09-30T22:53:37.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.959+0000 7f6bc3fff700 1 -- 172.21.15.142:0/141006572 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4014670 con 0x7f6bdc1598e0 2023-09-30T22:53:37.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.960+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc15bf30 con 0x7f6bdc1598e0 2023-09-30T22:53:37.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.961+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc151d00 con 0x7f6bdc1598e0 2023-09-30T22:53:37.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.961+0000 7f6bc3fff700 1 -- 172.21.15.142:0/141006572 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6bd40149e0 con 0x7f6bdc1598e0 2023-09-30T22:53:37.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.963+0000 7f6bc3fff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bc8067330 0x7f6bc80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:37.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.963+0000 7f6bc3fff700 1 -- 172.21.15.142:0/141006572 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bd40852e0 con 0x7f6bdc1598e0 2023-09-30T22:53:37.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.963+0000 7f6bdbfff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bc8067330 0x7f6bc80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:37.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.963+0000 7f6bdbfff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bc8067330 0x7f6bc80697e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0039e0 tx=0x7f6bcc007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:37.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:37.967+0000 7f6bc3fff700 1 -- 172.21.15.142:0/141006572 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6bd4052140 con 0x7f6bdc1598e0 2023-09-30T22:53:38.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.153+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bdc06fc10 con 0x7f6bc8067330 2023-09-30T22:53:38.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.161+0000 7f6bc3fff700 1 -- 172.21.15.142:0/141006572 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303493 (secure 0 0 0) 0x7f6bdc06fc10 con 0x7f6bc8067330 2023-09-30T22:53:38.165 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.165+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bc8067330 msgr2=0x7f6bc80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.165+0000 7f6be23ff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bc8067330 0x7f6bc80697e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0039e0 tx=0x7f6bcc007ec0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.165+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc1598e0 msgr2=0x7f6bdc150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.165+0000 7f6be23ff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc1598e0 0x7f6bdc150f50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009fd0 tx=0x7f6bd4009900 comp rx=0 tx=0).stop 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 shutdown_connections 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6bc8067330 0x7f6bc80697e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bdc1598e0 0x7f6bdc150f50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bdc0cee50 0x7f6bdc15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 --2- 172.21.15.142:0/141006572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc0d03d0 0x7f6bdc153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 >> 172.21.15.142:0/141006572 conn(0x7f6bdc0cd540 msgr2=0x7f6bdc0631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 shutdown_connections 2023-09-30T22:53:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.166+0000 7f6be23ff700 1 -- 172.21.15.142:0/141006572 wait complete. 2023-09-30T22:53:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:53:38.183 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-09-30T22:53:38.116345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560078,"statfs":{"total":1600000000,"available":1597520524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.606487"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522036+0000","last_change":"2023-09-30T22:53:28.521844+0000","last_active":"2023-09-30T22:53:28.522036+0000","last_peered":"2023-09-30T22:53:28.522036+0000","last_clean":"2023-09-30T22:53:28.522036+0000","last_became_active":"2023-09-30T22:53:28.521523+0000","last_became_peered":"2023-09-30T22:53:28.521523+0000","last_unstale":"2023-09-30T22:53:28.522036+0000","last_undegraded":"2023-09-30T22:53:28.522036+0000","last_fullsized":"2023-09-30T22:53:28.522036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:59.351514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513441+0000","last_change":"2023-09-30T22:53:28.513362+0000","last_active":"2023-09-30T22:53:28.513441+0000","last_peered":"2023-09-30T22:53:28.513441+0000","last_clean":"2023-09-30T22:53:28.513441+0000","last_became_active":"2023-09-30T22:53:28.513102+0000","last_became_peered":"2023-09-30T22:53:28.513102+0000","last_unstale":"2023-09-30T22:53:28.513441+0000","last_undegraded":"2023-09-30T22:53:28.513441+0000","last_fullsized":"2023-09-30T22:53:28.513441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:50.326775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523601+0000","last_change":"2023-09-30T22:53:28.523032+0000","last_active":"2023-09-30T22:53:28.523601+0000","last_peered":"2023-09-30T22:53:28.523601+0000","last_clean":"2023-09-30T22:53:28.523601+0000","last_became_active":"2023-09-30T22:53:28.522810+0000","last_became_peered":"2023-09-30T22:53:28.522810+0000","last_unstale":"2023-09-30T22:53:28.523601+0000","last_undegraded":"2023-09-30T22:53:28.523601+0000","last_fullsized":"2023-09-30T22:53:28.523601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:53.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524515+0000","last_change":"2023-09-30T22:53:28.524309+0000","last_active":"2023-09-30T22:53:28.524515+0000","last_peered":"2023-09-30T22:53:28.524515+0000","last_clean":"2023-09-30T22:53:28.524515+0000","last_became_active":"2023-09-30T22:53:28.523815+0000","last_became_peered":"2023-09-30T22:53:28.523815+0000","last_unstale":"2023-09-30T22:53:28.524515+0000","last_undegraded":"2023-09-30T22:53:28.524515+0000","last_fullsized":"2023-09-30T22:53:28.524515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:56.402195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523891+0000","last_change":"2023-09-30T22:53:28.523789+0000","last_active":"2023-09-30T22:53:28.523891+0000","last_peered":"2023-09-30T22:53:28.523891+0000","last_clean":"2023-09-30T22:53:28.523891+0000","last_became_active":"2023-09-30T22:53:28.523542+0000","last_became_peered":"2023-09-30T22:53:28.523542+0000","last_unstale":"2023-09-30T22:53:28.523891+0000","last_undegraded":"2023-09-30T22:53:28.523891+0000","last_fullsized":"2023-09-30T22:53:28.523891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515993+0000","last_change":"2023-09-30T22:53:28.515784+0000","last_active":"2023-09-30T22:53:28.515993+0000","last_peered":"2023-09-30T22:53:28.515993+0000","last_clean":"2023-09-30T22:53:28.515993+0000","last_became_active":"2023-09-30T22:53:28.515565+0000","last_became_peered":"2023-09-30T22:53:28.515565+0000","last_unstale":"2023-09-30T22:53:28.515993+0000","last_undegraded":"2023-09-30T22:53:28.515993+0000","last_fullsized":"2023-09-30T22:53:28.515993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:53.264810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525125+0000","last_change":"2023-09-30T22:53:28.524944+0000","last_active":"2023-09-30T22:53:28.525125+0000","last_peered":"2023-09-30T22:53:28.525125+0000","last_clean":"2023-09-30T22:53:28.525125+0000","last_became_active":"2023-09-30T22:53:28.523435+0000","last_became_peered":"2023-09-30T22:53:28.523435+0000","last_unstale":"2023-09-30T22:53:28.525125+0000","last_undegraded":"2023-09-30T22:53:28.525125+0000","last_fullsized":"2023-09-30T22:53:28.525125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:18.496971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527102+0000","last_change":"2023-09-30T22:53:28.526469+0000","last_active":"2023-09-30T22:53:28.527102+0000","last_peered":"2023-09-30T22:53:28.527102+0000","last_clean":"2023-09-30T22:53:28.527102+0000","last_became_active":"2023-09-30T22:53:28.525921+0000","last_became_peered":"2023-09-30T22:53:28.525921+0000","last_unstale":"2023-09-30T22:53:28.527102+0000","last_undegraded":"2023-09-30T22:53:28.527102+0000","last_fullsized":"2023-09-30T22:53:28.527102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:57.146828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511245+0000","last_change":"2023-09-30T22:53:28.511148+0000","last_active":"2023-09-30T22:53:28.511245+0000","last_peered":"2023-09-30T22:53:28.511245+0000","last_clean":"2023-09-30T22:53:28.511245+0000","last_became_active":"2023-09-30T22:53:28.510877+0000","last_became_peered":"2023-09-30T22:53:28.510877+0000","last_unstale":"2023-09-30T22:53:28.511245+0000","last_undegraded":"2023-09-30T22:53:28.511245+0000","last_fullsized":"2023-09-30T22:53:28.511245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524522+0000","last_change":"2023-09-30T22:53:28.523149+0000","last_active":"2023-09-30T22:53:28.524522+0000","last_peered":"2023-09-30T22:53:28.524522+0000","last_clean":"2023-09-30T22:53:28.524522+0000","last_became_active":"2023-09-30T22:53:28.522693+0000","last_became_peered":"2023-09-30T22:53:28.522693+0000","last_unstale":"2023-09-30T22:53:28.524522+0000","last_undegraded":"2023-09-30T22:53:28.524522+0000","last_fullsized":"2023-09-30T22:53:28.524522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:24.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526829+0000","last_change":"2023-09-30T22:53:28.526578+0000","last_active":"2023-09-30T22:53:28.526829+0000","last_peered":"2023-09-30T22:53:28.526829+0000","last_clean":"2023-09-30T22:53:28.526829+0000","last_became_active":"2023-09-30T22:53:28.526345+0000","last_became_peered":"2023-09-30T22:53:28.526345+0000","last_unstale":"2023-09-30T22:53:28.526829+0000","last_undegraded":"2023-09-30T22:53:28.526829+0000","last_fullsized":"2023-09-30T22:53:28.526829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513911+0000","last_change":"2023-09-30T22:53:28.513759+0000","last_active":"2023-09-30T22:53:28.513911+0000","last_peered":"2023-09-30T22:53:28.513911+0000","last_clean":"2023-09-30T22:53:28.513911+0000","last_became_active":"2023-09-30T22:53:28.513397+0000","last_became_peered":"2023-09-30T22:53:28.513397+0000","last_unstale":"2023-09-30T22:53:28.513911+0000","last_undegraded":"2023-09-30T22:53:28.513911+0000","last_fullsized":"2023-09-30T22:53:28.513911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517049+0000","last_change":"2023-09-30T22:53:28.516976+0000","last_active":"2023-09-30T22:53:28.517049+0000","last_peered":"2023-09-30T22:53:28.517049+0000","last_clean":"2023-09-30T22:53:28.517049+0000","last_became_active":"2023-09-30T22:53:28.516752+0000","last_became_peered":"2023-09-30T22:53:28.516752+0000","last_unstale":"2023-09-30T22:53:28.517049+0000","last_undegraded":"2023-09-30T22:53:28.517049+0000","last_fullsized":"2023-09-30T22:53:28.517049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:14.222289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520873+0000","last_change":"2023-09-30T22:53:28.520771+0000","last_active":"2023-09-30T22:53:28.520873+0000","last_peered":"2023-09-30T22:53:28.520873+0000","last_clean":"2023-09-30T22:53:28.520873+0000","last_became_active":"2023-09-30T22:53:28.520479+0000","last_became_peered":"2023-09-30T22:53:28.520479+0000","last_unstale":"2023-09-30T22:53:28.520873+0000","last_undegraded":"2023-09-30T22:53:28.520873+0000","last_fullsized":"2023-09-30T22:53:28.520873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517292+0000","last_change":"2023-09-30T22:53:28.512912+0000","last_active":"2023-09-30T22:53:28.517292+0000","last_peered":"2023-09-30T22:53:28.517292+0000","last_clean":"2023-09-30T22:53:28.517292+0000","last_became_active":"2023-09-30T22:53:28.512640+0000","last_became_peered":"2023-09-30T22:53:28.512640+0000","last_unstale":"2023-09-30T22:53:28.517292+0000","last_undegraded":"2023-09-30T22:53:28.517292+0000","last_fullsized":"2023-09-30T22:53:28.517292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:25.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524568+0000","last_change":"2023-09-30T22:53:28.524203+0000","last_active":"2023-09-30T22:53:28.524568+0000","last_peered":"2023-09-30T22:53:28.524568+0000","last_clean":"2023-09-30T22:53:28.524568+0000","last_became_active":"2023-09-30T22:53:28.523569+0000","last_became_peered":"2023-09-30T22:53:28.523569+0000","last_unstale":"2023-09-30T22:53:28.524568+0000","last_undegraded":"2023-09-30T22:53:28.524568+0000","last_fullsized":"2023-09-30T22:53:28.524568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:48:48.935341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521991+0000","last_change":"2023-09-30T22:53:28.521829+0000","last_active":"2023-09-30T22:53:28.521991+0000","last_peered":"2023-09-30T22:53:28.521991+0000","last_clean":"2023-09-30T22:53:28.521991+0000","last_became_active":"2023-09-30T22:53:28.521617+0000","last_became_peered":"2023-09-30T22:53:28.521617+0000","last_unstale":"2023-09-30T22:53:28.521991+0000","last_undegraded":"2023-09-30T22:53:28.521991+0000","last_fullsized":"2023-09-30T22:53:28.521991+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:12.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519013+0000","last_change":"2023-09-30T22:53:28.518767+0000","last_active":"2023-09-30T22:53:28.519013+0000","last_peered":"2023-09-30T22:53:28.519013+0000","last_clean":"2023-09-30T22:53:28.519013+0000","last_became_active":"2023-09-30T22:53:28.518141+0000","last_became_peered":"2023-09-30T22:53:28.518141+0000","last_unstale":"2023-09-30T22:53:28.519013+0000","last_undegraded":"2023-09-30T22:53:28.519013+0000","last_fullsized":"2023-09-30T22:53:28.519013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:39.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523512+0000","last_change":"2023-09-30T22:53:28.523441+0000","last_active":"2023-09-30T22:53:28.523512+0000","last_peered":"2023-09-30T22:53:28.523512+0000","last_clean":"2023-09-30T22:53:28.523512+0000","last_became_active":"2023-09-30T22:53:28.523060+0000","last_became_peered":"2023-09-30T22:53:28.523060+0000","last_unstale":"2023-09-30T22:53:28.523512+0000","last_undegraded":"2023-09-30T22:53:28.523512+0000","last_fullsized":"2023-09-30T22:53:28.523512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521320+0000","last_change":"2023-09-30T22:53:28.521259+0000","last_active":"2023-09-30T22:53:28.521320+0000","last_peered":"2023-09-30T22:53:28.521320+0000","last_clean":"2023-09-30T22:53:28.521320+0000","last_became_active":"2023-09-30T22:53:28.520791+0000","last_became_peered":"2023-09-30T22:53:28.520791+0000","last_unstale":"2023-09-30T22:53:28.521320+0000","last_undegraded":"2023-09-30T22:53:28.521320+0000","last_fullsized":"2023-09-30T22:53:28.521320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523920+0000","last_change":"2023-09-30T22:53:28.523845+0000","last_active":"2023-09-30T22:53:28.523920+0000","last_peered":"2023-09-30T22:53:28.523920+0000","last_clean":"2023-09-30T22:53:28.523920+0000","last_became_active":"2023-09-30T22:53:28.523587+0000","last_became_peered":"2023-09-30T22:53:28.523587+0000","last_unstale":"2023-09-30T22:53:28.523920+0000","last_undegraded":"2023-09-30T22:53:28.523920+0000","last_fullsized":"2023-09-30T22:53:28.523920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521215+0000","last_change":"2023-09-30T22:53:28.521142+0000","last_active":"2023-09-30T22:53:28.521215+0000","last_peered":"2023-09-30T22:53:28.521215+0000","last_clean":"2023-09-30T22:53:28.521215+0000","last_became_active":"2023-09-30T22:53:28.520866+0000","last_became_peered":"2023-09-30T22:53:28.520866+0000","last_unstale":"2023-09-30T22:53:28.521215+0000","last_undegraded":"2023-09-30T22:53:28.521215+0000","last_fullsized":"2023-09-30T22:53:28.521215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:14.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517945+0000","last_change":"2023-09-30T22:53:28.516913+0000","last_active":"2023-09-30T22:53:28.517945+0000","last_peered":"2023-09-30T22:53:28.517945+0000","last_clean":"2023-09-30T22:53:28.517945+0000","last_became_active":"2023-09-30T22:53:28.516675+0000","last_became_peered":"2023-09-30T22:53:28.516675+0000","last_unstale":"2023-09-30T22:53:28.517945+0000","last_undegraded":"2023-09-30T22:53:28.517945+0000","last_fullsized":"2023-09-30T22:53:28.517945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:59.351514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528033+0000","last_change":"2023-09-30T22:53:28.527707+0000","last_active":"2023-09-30T22:53:28.528033+0000","last_peered":"2023-09-30T22:53:28.528033+0000","last_clean":"2023-09-30T22:53:28.528033+0000","last_became_active":"2023-09-30T22:53:28.527483+0000","last_became_peered":"2023-09-30T22:53:28.527483+0000","last_unstale":"2023-09-30T22:53:28.528033+0000","last_undegraded":"2023-09-30T22:53:28.528033+0000","last_fullsized":"2023-09-30T22:53:28.528033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:06.946949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519144+0000","last_change":"2023-09-30T22:53:28.519070+0000","last_active":"2023-09-30T22:53:28.519144+0000","last_peered":"2023-09-30T22:53:28.519144+0000","last_clean":"2023-09-30T22:53:28.519144+0000","last_became_active":"2023-09-30T22:53:28.518852+0000","last_became_peered":"2023-09-30T22:53:28.518852+0000","last_unstale":"2023-09-30T22:53:28.519144+0000","last_undegraded":"2023-09-30T22:53:28.519144+0000","last_fullsized":"2023-09-30T22:53:28.519144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527117+0000","last_change":"2023-09-30T22:53:28.526708+0000","last_active":"2023-09-30T22:53:28.527117+0000","last_peered":"2023-09-30T22:53:28.527117+0000","last_clean":"2023-09-30T22:53:28.527117+0000","last_became_active":"2023-09-30T22:53:28.526478+0000","last_became_peered":"2023-09-30T22:53:28.526478+0000","last_unstale":"2023-09-30T22:53:28.527117+0000","last_undegraded":"2023-09-30T22:53:28.527117+0000","last_fullsized":"2023-09-30T22:53:28.527117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:57:09.485295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524561+0000","last_change":"2023-09-30T22:53:28.524489+0000","last_active":"2023-09-30T22:53:28.524561+0000","last_peered":"2023-09-30T22:53:28.524561+0000","last_clean":"2023-09-30T22:53:28.524561+0000","last_became_active":"2023-09-30T22:53:28.524252+0000","last_became_peered":"2023-09-30T22:53:28.524252+0000","last_unstale":"2023-09-30T22:53:28.524561+0000","last_undegraded":"2023-09-30T22:53:28.524561+0000","last_fullsized":"2023-09-30T22:53:28.524561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524505+0000","last_change":"2023-09-30T22:53:28.522426+0000","last_active":"2023-09-30T22:53:28.524505+0000","last_peered":"2023-09-30T22:53:28.524505+0000","last_clean":"2023-09-30T22:53:28.524505+0000","last_became_active":"2023-09-30T22:53:28.521202+0000","last_became_peered":"2023-09-30T22:53:28.521202+0000","last_unstale":"2023-09-30T22:53:28.524505+0000","last_undegraded":"2023-09-30T22:53:28.524505+0000","last_fullsized":"2023-09-30T22:53:28.524505+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:23.130881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519041+0000","last_change":"2023-09-30T22:53:28.518909+0000","last_active":"2023-09-30T22:53:28.519041+0000","last_peered":"2023-09-30T22:53:28.519041+0000","last_clean":"2023-09-30T22:53:28.519041+0000","last_became_active":"2023-09-30T22:53:28.518433+0000","last_became_peered":"2023-09-30T22:53:28.518433+0000","last_unstale":"2023-09-30T22:53:28.519041+0000","last_undegraded":"2023-09-30T22:53:28.519041+0000","last_fullsized":"2023-09-30T22:53:28.519041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:06.946949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517929+0000","last_change":"2023-09-30T22:53:28.515961+0000","last_active":"2023-09-30T22:53:28.517929+0000","last_peered":"2023-09-30T22:53:28.517929+0000","last_clean":"2023-09-30T22:53:28.517929+0000","last_became_active":"2023-09-30T22:53:28.515689+0000","last_became_peered":"2023-09-30T22:53:28.515689+0000","last_unstale":"2023-09-30T22:53:28.517929+0000","last_undegraded":"2023-09-30T22:53:28.517929+0000","last_fullsized":"2023-09-30T22:53:28.517929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:11:41.978885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524590+0000","last_change":"2023-09-30T22:53:28.524378+0000","last_active":"2023-09-30T22:53:28.524590+0000","last_peered":"2023-09-30T22:53:28.524590+0000","last_clean":"2023-09-30T22:53:28.524590+0000","last_became_active":"2023-09-30T22:53:28.523927+0000","last_became_peered":"2023-09-30T22:53:28.523927+0000","last_unstale":"2023-09-30T22:53:28.524590+0000","last_undegraded":"2023-09-30T22:53:28.524590+0000","last_fullsized":"2023-09-30T22:53:28.524590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:50.593476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528068+0000","last_change":"2023-09-30T22:53:28.527965+0000","last_active":"2023-09-30T22:53:28.528068+0000","last_peered":"2023-09-30T22:53:28.528068+0000","last_clean":"2023-09-30T22:53:28.528068+0000","last_became_active":"2023-09-30T22:53:28.527612+0000","last_became_peered":"2023-09-30T22:53:28.527612+0000","last_unstale":"2023-09-30T22:53:28.528068+0000","last_undegraded":"2023-09-30T22:53:28.528068+0000","last_fullsized":"2023-09-30T22:53:28.528068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:39.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517904+0000","last_change":"2023-09-30T22:53:28.515730+0000","last_active":"2023-09-30T22:53:28.517904+0000","last_peered":"2023-09-30T22:53:28.517904+0000","last_clean":"2023-09-30T22:53:28.517904+0000","last_became_active":"2023-09-30T22:53:28.515285+0000","last_became_peered":"2023-09-30T22:53:28.515285+0000","last_unstale":"2023-09-30T22:53:28.517904+0000","last_undegraded":"2023-09-30T22:53:28.517904+0000","last_fullsized":"2023-09-30T22:53:28.517904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:23:47.940060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538999+0000","last_change":"2023-09-30T22:53:27.516465+0000","last_active":"2023-09-30T22:53:28.538999+0000","last_peered":"2023-09-30T22:53:28.538999+0000","last_clean":"2023-09-30T22:53:28.538999+0000","last_became_active":"2023-09-30T22:53:27.516253+0000","last_became_peered":"2023-09-30T22:53:27.516253+0000","last_unstale":"2023-09-30T22:53:28.538999+0000","last_undegraded":"2023-09-30T22:53:28.538999+0000","last_fullsized":"2023-09-30T22:53:28.538999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.522280+0000","last_change":"2023-09-30T22:53:28.522137+0000","last_active":"2023-09-30T22:53:28.522280+0000","last_peered":"2023-09-30T22:53:28.522280+0000","last_clean":"2023-09-30T22:53:28.522280+0000","last_became_active":"2023-09-30T22:53:28.521672+0000","last_became_peered":"2023-09-30T22:53:28.521672+0000","last_unstale":"2023-09-30T22:53:28.522280+0000","last_undegraded":"2023-09-30T22:53:28.522280+0000","last_fullsized":"2023-09-30T22:53:28.522280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:13.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534160+0000","last_change":"2023-09-30T22:53:27.513083+0000","last_active":"2023-09-30T22:53:28.534160+0000","last_peered":"2023-09-30T22:53:28.534160+0000","last_clean":"2023-09-30T22:53:28.534160+0000","last_became_active":"2023-09-30T22:53:27.512830+0000","last_became_peered":"2023-09-30T22:53:27.512830+0000","last_unstale":"2023-09-30T22:53:28.534160+0000","last_undegraded":"2023-09-30T22:53:28.534160+0000","last_fullsized":"2023-09-30T22:53:28.534160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518995+0000","last_change":"2023-09-30T22:53:28.518755+0000","last_active":"2023-09-30T22:53:28.518995+0000","last_peered":"2023-09-30T22:53:28.518995+0000","last_clean":"2023-09-30T22:53:28.518995+0000","last_became_active":"2023-09-30T22:53:28.518120+0000","last_became_peered":"2023-09-30T22:53:28.518120+0000","last_unstale":"2023-09-30T22:53:28.518995+0000","last_undegraded":"2023-09-30T22:53:28.518995+0000","last_fullsized":"2023-09-30T22:53:28.518995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:13.114495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536132+0000","last_change":"2023-09-30T22:53:27.521745+0000","last_active":"2023-09-30T22:53:28.536132+0000","last_peered":"2023-09-30T22:53:28.536132+0000","last_clean":"2023-09-30T22:53:28.536132+0000","last_became_active":"2023-09-30T22:53:27.521383+0000","last_became_peered":"2023-09-30T22:53:27.521383+0000","last_unstale":"2023-09-30T22:53:28.536132+0000","last_undegraded":"2023-09-30T22:53:28.536132+0000","last_fullsized":"2023-09-30T22:53:28.536132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:27.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519546+0000","last_change":"2023-09-30T22:53:28.519421+0000","last_active":"2023-09-30T22:53:28.519546+0000","last_peered":"2023-09-30T22:53:28.519546+0000","last_clean":"2023-09-30T22:53:28.519546+0000","last_became_active":"2023-09-30T22:53:28.519181+0000","last_became_peered":"2023-09-30T22:53:28.519181+0000","last_unstale":"2023-09-30T22:53:28.519546+0000","last_undegraded":"2023-09-30T22:53:28.519546+0000","last_fullsized":"2023-09-30T22:53:28.519546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:32.735104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535058+0000","last_change":"2023-09-30T22:53:27.517467+0000","last_active":"2023-09-30T22:53:28.535058+0000","last_peered":"2023-09-30T22:53:28.535058+0000","last_clean":"2023-09-30T22:53:28.535058+0000","last_became_active":"2023-09-30T22:53:27.517231+0000","last_became_peered":"2023-09-30T22:53:27.517231+0000","last_unstale":"2023-09-30T22:53:28.535058+0000","last_undegraded":"2023-09-30T22:53:28.535058+0000","last_fullsized":"2023-09-30T22:53:28.535058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:31.871527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521506+0000","last_change":"2023-09-30T22:53:28.520868+0000","last_active":"2023-09-30T22:53:28.521506+0000","last_peered":"2023-09-30T22:53:28.521506+0000","last_clean":"2023-09-30T22:53:28.521506+0000","last_became_active":"2023-09-30T22:53:28.520629+0000","last_became_peered":"2023-09-30T22:53:28.520629+0000","last_unstale":"2023-09-30T22:53:28.521506+0000","last_undegraded":"2023-09-30T22:53:28.521506+0000","last_fullsized":"2023-09-30T22:53:28.521506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:18:44.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535219+0000","last_change":"2023-09-30T22:53:27.517083+0000","last_active":"2023-09-30T22:53:28.535219+0000","last_peered":"2023-09-30T22:53:28.535219+0000","last_clean":"2023-09-30T22:53:28.535219+0000","last_became_active":"2023-09-30T22:53:27.516834+0000","last_became_peered":"2023-09-30T22:53:27.516834+0000","last_unstale":"2023-09-30T22:53:28.535219+0000","last_undegraded":"2023-09-30T22:53:28.535219+0000","last_fullsized":"2023-09-30T22:53:28.535219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519698+0000","last_change":"2023-09-30T22:53:28.519090+0000","last_active":"2023-09-30T22:53:28.519698+0000","last_peered":"2023-09-30T22:53:28.519698+0000","last_clean":"2023-09-30T22:53:28.519698+0000","last_became_active":"2023-09-30T22:53:28.518864+0000","last_became_peered":"2023-09-30T22:53:28.518864+0000","last_unstale":"2023-09-30T22:53:28.519698+0000","last_undegraded":"2023-09-30T22:53:28.519698+0000","last_fullsized":"2023-09-30T22:53:28.519698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:38:50.812517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534282+0000","last_change":"2023-09-30T22:53:27.521214+0000","last_active":"2023-09-30T22:53:28.534282+0000","last_peered":"2023-09-30T22:53:28.534282+0000","last_clean":"2023-09-30T22:53:28.534282+0000","last_became_active":"2023-09-30T22:53:27.521000+0000","last_became_peered":"2023-09-30T22:53:27.521000+0000","last_unstale":"2023-09-30T22:53:28.534282+0000","last_undegraded":"2023-09-30T22:53:28.534282+0000","last_fullsized":"2023-09-30T22:53:28.534282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519060+0000","last_change":"2023-09-30T22:53:28.518918+0000","last_active":"2023-09-30T22:53:28.519060+0000","last_peered":"2023-09-30T22:53:28.519060+0000","last_clean":"2023-09-30T22:53:28.519060+0000","last_became_active":"2023-09-30T22:53:28.518448+0000","last_became_peered":"2023-09-30T22:53:28.518448+0000","last_unstale":"2023-09-30T22:53:28.519060+0000","last_undegraded":"2023-09-30T22:53:28.519060+0000","last_fullsized":"2023-09-30T22:53:28.519060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:57:09.485295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519955+0000","last_change":"2023-09-30T22:53:27.520810+0000","last_active":"2023-09-30T22:53:28.519955+0000","last_peered":"2023-09-30T22:53:28.519955+0000","last_clean":"2023-09-30T22:53:28.519955+0000","last_became_active":"2023-09-30T22:53:27.520051+0000","last_became_peered":"2023-09-30T22:53:27.520051+0000","last_unstale":"2023-09-30T22:53:28.519955+0000","last_undegraded":"2023-09-30T22:53:28.519955+0000","last_fullsized":"2023-09-30T22:53:28.519955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:13:12.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516891+0000","last_change":"2023-09-30T22:53:28.516799+0000","last_active":"2023-09-30T22:53:28.516891+0000","last_peered":"2023-09-30T22:53:28.516891+0000","last_clean":"2023-09-30T22:53:28.516891+0000","last_became_active":"2023-09-30T22:53:28.516580+0000","last_became_peered":"2023-09-30T22:53:28.516580+0000","last_unstale":"2023-09-30T22:53:28.516891+0000","last_undegraded":"2023-09-30T22:53:28.516891+0000","last_fullsized":"2023-09-30T22:53:28.516891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.516147+0000","last_change":"2023-09-30T22:53:27.519471+0000","last_active":"2023-09-30T22:53:28.516147+0000","last_peered":"2023-09-30T22:53:28.516147+0000","last_clean":"2023-09-30T22:53:28.516147+0000","last_became_active":"2023-09-30T22:53:27.518947+0000","last_became_peered":"2023-09-30T22:53:27.518947+0000","last_unstale":"2023-09-30T22:53:28.516147+0000","last_undegraded":"2023-09-30T22:53:28.516147+0000","last_fullsized":"2023-09-30T22:53:28.516147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:14.863213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524538+0000","last_change":"2023-09-30T22:53:28.524453+0000","last_active":"2023-09-30T22:53:28.524538+0000","last_peered":"2023-09-30T22:53:28.524538+0000","last_clean":"2023-09-30T22:53:28.524538+0000","last_became_active":"2023-09-30T22:53:28.524098+0000","last_became_peered":"2023-09-30T22:53:28.524098+0000","last_unstale":"2023-09-30T22:53:28.524538+0000","last_undegraded":"2023-09-30T22:53:28.524538+0000","last_fullsized":"2023-09-30T22:53:28.524538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:25.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517878+0000","last_change":"2023-09-30T22:53:27.517464+0000","last_active":"2023-09-30T22:53:28.517878+0000","last_peered":"2023-09-30T22:53:28.517878+0000","last_clean":"2023-09-30T22:53:28.517878+0000","last_became_active":"2023-09-30T22:53:27.516983+0000","last_became_peered":"2023-09-30T22:53:27.516983+0000","last_unstale":"2023-09-30T22:53:28.517878+0000","last_undegraded":"2023-09-30T22:53:28.517878+0000","last_fullsized":"2023-09-30T22:53:28.517878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:52.258124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523916+0000","last_change":"2023-09-30T22:53:28.523841+0000","last_active":"2023-09-30T22:53:28.523916+0000","last_peered":"2023-09-30T22:53:28.523916+0000","last_clean":"2023-09-30T22:53:28.523916+0000","last_became_active":"2023-09-30T22:53:28.523574+0000","last_became_peered":"2023-09-30T22:53:28.523574+0000","last_unstale":"2023-09-30T22:53:28.523916+0000","last_undegraded":"2023-09-30T22:53:28.523916+0000","last_fullsized":"2023-09-30T22:53:28.523916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509683+0000","last_change":"2023-09-30T22:53:27.510430+0000","last_active":"2023-09-30T22:53:28.509683+0000","last_peered":"2023-09-30T22:53:28.509683+0000","last_clean":"2023-09-30T22:53:28.509683+0000","last_became_active":"2023-09-30T22:53:27.510188+0000","last_became_peered":"2023-09-30T22:53:27.510188+0000","last_unstale":"2023-09-30T22:53:28.509683+0000","last_undegraded":"2023-09-30T22:53:28.509683+0000","last_fullsized":"2023-09-30T22:53:28.509683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:00.134991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.528052+0000","last_change":"2023-09-30T22:53:28.527814+0000","last_active":"2023-09-30T22:53:28.528052+0000","last_peered":"2023-09-30T22:53:28.528052+0000","last_clean":"2023-09-30T22:53:28.528052+0000","last_became_active":"2023-09-30T22:53:28.527339+0000","last_became_peered":"2023-09-30T22:53:28.527339+0000","last_unstale":"2023-09-30T22:53:28.528052+0000","last_undegraded":"2023-09-30T22:53:28.528052+0000","last_fullsized":"2023-09-30T22:53:28.528052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:10.461181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535266+0000","last_change":"2023-09-30T22:53:27.517326+0000","last_active":"2023-09-30T22:53:28.535266+0000","last_peered":"2023-09-30T22:53:28.535266+0000","last_clean":"2023-09-30T22:53:28.535266+0000","last_became_active":"2023-09-30T22:53:27.517098+0000","last_became_peered":"2023-09-30T22:53:27.517098+0000","last_unstale":"2023-09-30T22:53:28.535266+0000","last_undegraded":"2023-09-30T22:53:28.535266+0000","last_fullsized":"2023-09-30T22:53:28.535266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:13.215603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524484+0000","last_change":"2023-09-30T22:53:28.521854+0000","last_active":"2023-09-30T22:53:28.524484+0000","last_peered":"2023-09-30T22:53:28.524484+0000","last_clean":"2023-09-30T22:53:28.524484+0000","last_became_active":"2023-09-30T22:53:28.521590+0000","last_became_peered":"2023-09-30T22:53:28.521590+0000","last_unstale":"2023-09-30T22:53:28.524484+0000","last_undegraded":"2023-09-30T22:53:28.524484+0000","last_fullsized":"2023-09-30T22:53:28.524484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:07.541785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538839+0000","last_change":"2023-09-30T22:53:27.520637+0000","last_active":"2023-09-30T22:53:28.538839+0000","last_peered":"2023-09-30T22:53:28.538839+0000","last_clean":"2023-09-30T22:53:28.538839+0000","last_became_active":"2023-09-30T22:53:27.519273+0000","last_became_peered":"2023-09-30T22:53:27.519273+0000","last_unstale":"2023-09-30T22:53:28.538839+0000","last_undegraded":"2023-09-30T22:53:28.538839+0000","last_fullsized":"2023-09-30T22:53:28.538839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:31.728418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527146+0000","last_change":"2023-09-30T22:53:28.527020+0000","last_active":"2023-09-30T22:53:28.527146+0000","last_peered":"2023-09-30T22:53:28.527146+0000","last_clean":"2023-09-30T22:53:28.527146+0000","last_became_active":"2023-09-30T22:53:28.526664+0000","last_became_peered":"2023-09-30T22:53:28.526664+0000","last_unstale":"2023-09-30T22:53:28.527146+0000","last_undegraded":"2023-09-30T22:53:28.527146+0000","last_fullsized":"2023-09-30T22:53:28.527146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:13.114495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536461+0000","last_change":"2023-09-30T22:53:27.521604+0000","last_active":"2023-09-30T22:53:28.536461+0000","last_peered":"2023-09-30T22:53:28.536461+0000","last_clean":"2023-09-30T22:53:28.536461+0000","last_became_active":"2023-09-30T22:53:27.521088+0000","last_became_peered":"2023-09-30T22:53:27.521088+0000","last_unstale":"2023-09-30T22:53:28.536461+0000","last_undegraded":"2023-09-30T22:53:28.536461+0000","last_fullsized":"2023-09-30T22:53:28.536461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:32:49.320089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519512+0000","last_change":"2023-09-30T22:53:28.518412+0000","last_active":"2023-09-30T22:53:28.519512+0000","last_peered":"2023-09-30T22:53:28.519512+0000","last_clean":"2023-09-30T22:53:28.519512+0000","last_became_active":"2023-09-30T22:53:28.517871+0000","last_became_peered":"2023-09-30T22:53:28.517871+0000","last_unstale":"2023-09-30T22:53:28.519512+0000","last_undegraded":"2023-09-30T22:53:28.519512+0000","last_fullsized":"2023-09-30T22:53:28.519512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511856+0000","last_change":"2023-09-30T22:53:27.517581+0000","last_active":"2023-09-30T22:53:28.511856+0000","last_peered":"2023-09-30T22:53:28.511856+0000","last_clean":"2023-09-30T22:53:28.511856+0000","last_became_active":"2023-09-30T22:53:27.517341+0000","last_became_peered":"2023-09-30T22:53:27.517341+0000","last_unstale":"2023-09-30T22:53:28.511856+0000","last_undegraded":"2023-09-30T22:53:28.511856+0000","last_fullsized":"2023-09-30T22:53:28.511856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:01.471477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526246+0000","last_change":"2023-09-30T22:53:28.525685+0000","last_active":"2023-09-30T22:53:28.526246+0000","last_peered":"2023-09-30T22:53:28.526246+0000","last_clean":"2023-09-30T22:53:28.526246+0000","last_became_active":"2023-09-30T22:53:28.525403+0000","last_became_peered":"2023-09-30T22:53:28.525403+0000","last_unstale":"2023-09-30T22:53:28.526246+0000","last_undegraded":"2023-09-30T22:53:28.526246+0000","last_fullsized":"2023-09-30T22:53:28.526246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509518+0000","last_change":"2023-09-30T22:53:27.518671+0000","last_active":"2023-09-30T22:53:28.509518+0000","last_peered":"2023-09-30T22:53:28.509518+0000","last_clean":"2023-09-30T22:53:28.509518+0000","last_became_active":"2023-09-30T22:53:27.518248+0000","last_became_peered":"2023-09-30T22:53:27.518248+0000","last_unstale":"2023-09-30T22:53:28.509518+0000","last_undegraded":"2023-09-30T22:53:28.509518+0000","last_fullsized":"2023-09-30T22:53:28.509518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:17.490285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513109+0000","last_change":"2023-09-30T22:53:28.513034+0000","last_active":"2023-09-30T22:53:28.513109+0000","last_peered":"2023-09-30T22:53:28.513109+0000","last_clean":"2023-09-30T22:53:28.513109+0000","last_became_active":"2023-09-30T22:53:28.512753+0000","last_became_peered":"2023-09-30T22:53:28.512753+0000","last_unstale":"2023-09-30T22:53:28.513109+0000","last_undegraded":"2023-09-30T22:53:28.513109+0000","last_fullsized":"2023-09-30T22:53:28.513109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.538127+0000","last_change":"2023-09-30T22:53:27.516048+0000","last_active":"2023-09-30T22:53:28.538127+0000","last_peered":"2023-09-30T22:53:28.538127+0000","last_clean":"2023-09-30T22:53:28.538127+0000","last_became_active":"2023-09-30T22:53:27.515566+0000","last_became_peered":"2023-09-30T22:53:27.515566+0000","last_unstale":"2023-09-30T22:53:28.538127+0000","last_undegraded":"2023-09-30T22:53:28.538127+0000","last_fullsized":"2023-09-30T22:53:28.538127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:32.867025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519529+0000","last_change":"2023-09-30T22:53:28.518549+0000","last_active":"2023-09-30T22:53:28.519529+0000","last_peered":"2023-09-30T22:53:28.519529+0000","last_clean":"2023-09-30T22:53:28.519529+0000","last_became_active":"2023-09-30T22:53:28.518178+0000","last_became_peered":"2023-09-30T22:53:28.518178+0000","last_unstale":"2023-09-30T22:53:28.519529+0000","last_undegraded":"2023-09-30T22:53:28.519529+0000","last_fullsized":"2023-09-30T22:53:28.519529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.533325+0000","last_change":"2023-09-30T22:53:27.519544+0000","last_active":"2023-09-30T22:53:28.533325+0000","last_peered":"2023-09-30T22:53:28.533325+0000","last_clean":"2023-09-30T22:53:28.533325+0000","last_became_active":"2023-09-30T22:53:27.519269+0000","last_became_peered":"2023-09-30T22:53:27.519269+0000","last_unstale":"2023-09-30T22:53:28.533325+0000","last_undegraded":"2023-09-30T22:53:28.533325+0000","last_fullsized":"2023-09-30T22:53:28.533325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:22.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524412+0000","last_change":"2023-09-30T22:53:28.519623+0000","last_active":"2023-09-30T22:53:28.524412+0000","last_peered":"2023-09-30T22:53:28.524412+0000","last_clean":"2023-09-30T22:53:28.524412+0000","last_became_active":"2023-09-30T22:53:28.519379+0000","last_became_peered":"2023-09-30T22:53:28.519379+0000","last_unstale":"2023-09-30T22:53:28.524412+0000","last_undegraded":"2023-09-30T22:53:28.524412+0000","last_fullsized":"2023-09-30T22:53:28.524412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:43:42.198369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536377+0000","last_change":"2023-09-30T22:53:27.516588+0000","last_active":"2023-09-30T22:53:28.536377+0000","last_peered":"2023-09-30T22:53:28.536377+0000","last_clean":"2023-09-30T22:53:28.536377+0000","last_became_active":"2023-09-30T22:53:27.516377+0000","last_became_peered":"2023-09-30T22:53:27.516377+0000","last_unstale":"2023-09-30T22:53:28.536377+0000","last_undegraded":"2023-09-30T22:53:28.536377+0000","last_fullsized":"2023-09-30T22:53:28.536377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:49.586790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.524371+0000","last_change":"2023-09-30T22:53:28.517717+0000","last_active":"2023-09-30T22:53:28.524371+0000","last_peered":"2023-09-30T22:53:28.524371+0000","last_clean":"2023-09-30T22:53:28.524371+0000","last_became_active":"2023-09-30T22:53:28.517459+0000","last_became_peered":"2023-09-30T22:53:28.517459+0000","last_unstale":"2023-09-30T22:53:28.524371+0000","last_undegraded":"2023-09-30T22:53:28.524371+0000","last_fullsized":"2023-09-30T22:53:28.524371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:04.012099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.534031+0000","last_change":"2023-09-30T22:53:27.519451+0000","last_active":"2023-09-30T22:53:28.534031+0000","last_peered":"2023-09-30T22:53:28.534031+0000","last_clean":"2023-09-30T22:53:28.534031+0000","last_became_active":"2023-09-30T22:53:27.519207+0000","last_became_peered":"2023-09-30T22:53:27.519207+0000","last_unstale":"2023-09-30T22:53:28.534031+0000","last_undegraded":"2023-09-30T22:53:28.534031+0000","last_fullsized":"2023-09-30T22:53:28.534031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:54.470913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.523493+0000","last_change":"2023-09-30T22:53:28.523288+0000","last_active":"2023-09-30T22:53:28.523493+0000","last_peered":"2023-09-30T22:53:28.523493+0000","last_clean":"2023-09-30T22:53:28.523493+0000","last_became_active":"2023-09-30T22:53:28.522752+0000","last_became_peered":"2023-09-30T22:53:28.522752+0000","last_unstale":"2023-09-30T22:53:28.523493+0000","last_undegraded":"2023-09-30T22:53:28.523493+0000","last_fullsized":"2023-09-30T22:53:28.523493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:24.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514427+0000","last_change":"2023-09-30T22:53:27.513959+0000","last_active":"2023-09-30T22:53:28.514427+0000","last_peered":"2023-09-30T22:53:28.514427+0000","last_clean":"2023-09-30T22:53:28.514427+0000","last_became_active":"2023-09-30T22:53:27.513732+0000","last_became_peered":"2023-09-30T22:53:27.513732+0000","last_unstale":"2023-09-30T22:53:28.514427+0000","last_undegraded":"2023-09-30T22:53:28.514427+0000","last_fullsized":"2023-09-30T22:53:28.514427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:13.978353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517310+0000","last_change":"2023-09-30T22:53:28.512966+0000","last_active":"2023-09-30T22:53:28.517310+0000","last_peered":"2023-09-30T22:53:28.517310+0000","last_clean":"2023-09-30T22:53:28.517310+0000","last_became_active":"2023-09-30T22:53:28.512646+0000","last_became_peered":"2023-09-30T22:53:28.512646+0000","last_unstale":"2023-09-30T22:53:28.517310+0000","last_undegraded":"2023-09-30T22:53:28.517310+0000","last_fullsized":"2023-09-30T22:53:28.517310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:49:10.461181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.536715+0000","last_change":"2023-09-30T22:53:27.516148+0000","last_active":"2023-09-30T22:53:28.536715+0000","last_peered":"2023-09-30T22:53:28.536715+0000","last_clean":"2023-09-30T22:53:28.536715+0000","last_became_active":"2023-09-30T22:53:27.514962+0000","last_became_peered":"2023-09-30T22:53:27.514962+0000","last_unstale":"2023-09-30T22:53:28.536715+0000","last_undegraded":"2023-09-30T22:53:28.536715+0000","last_fullsized":"2023-09-30T22:53:28.536715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:55.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.525445+0000","last_change":"2023-09-30T22:53:28.525377+0000","last_active":"2023-09-30T22:53:28.525445+0000","last_peered":"2023-09-30T22:53:28.525445+0000","last_clean":"2023-09-30T22:53:28.525445+0000","last_became_active":"2023-09-30T22:53:28.525124+0000","last_became_peered":"2023-09-30T22:53:28.525124+0000","last_unstale":"2023-09-30T22:53:28.525445+0000","last_undegraded":"2023-09-30T22:53:28.525445+0000","last_fullsized":"2023-09-30T22:53:28.525445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:51:22.092802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.511256+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.511256+0000","last_peered":"2023-09-30T22:53:28.511256+0000","last_clean":"2023-09-30T22:53:28.511256+0000","last_became_active":"2023-09-30T22:53:27.516236+0000","last_became_peered":"2023-09-30T22:53:27.516236+0000","last_unstale":"2023-09-30T22:53:28.511256+0000","last_undegraded":"2023-09-30T22:53:28.511256+0000","last_fullsized":"2023-09-30T22:53:28.511256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:21:00.800017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526264+0000","last_change":"2023-09-30T22:53:28.526005+0000","last_active":"2023-09-30T22:53:28.526264+0000","last_peered":"2023-09-30T22:53:28.526264+0000","last_clean":"2023-09-30T22:53:28.526264+0000","last_became_active":"2023-09-30T22:53:28.525429+0000","last_became_peered":"2023-09-30T22:53:28.525429+0000","last_unstale":"2023-09-30T22:53:28.526264+0000","last_undegraded":"2023-09-30T22:53:28.526264+0000","last_fullsized":"2023-09-30T22:53:28.526264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:15.869899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.515992+0000","last_change":"2023-09-30T22:53:27.519633+0000","last_active":"2023-09-30T22:53:28.515992+0000","last_peered":"2023-09-30T22:53:28.515992+0000","last_clean":"2023-09-30T22:53:28.515992+0000","last_became_active":"2023-09-30T22:53:27.519232+0000","last_became_peered":"2023-09-30T22:53:27.519232+0000","last_unstale":"2023-09-30T22:53:28.515992+0000","last_undegraded":"2023-09-30T22:53:28.515992+0000","last_fullsized":"2023-09-30T22:53:28.515992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:51.349781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.527132+0000","last_change":"2023-09-30T22:53:28.526862+0000","last_active":"2023-09-30T22:53:28.527132+0000","last_peered":"2023-09-30T22:53:28.527132+0000","last_clean":"2023-09-30T22:53:28.527132+0000","last_became_active":"2023-09-30T22:53:28.526232+0000","last_became_peered":"2023-09-30T22:53:28.526232+0000","last_unstale":"2023-09-30T22:53:28.527132+0000","last_undegraded":"2023-09-30T22:53:28.527132+0000","last_fullsized":"2023-09-30T22:53:28.527132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:17.258231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.512067+0000","last_change":"2023-09-30T22:53:27.520705+0000","last_active":"2023-09-30T22:53:28.512067+0000","last_peered":"2023-09-30T22:53:28.512067+0000","last_clean":"2023-09-30T22:53:28.512067+0000","last_became_active":"2023-09-30T22:53:27.520103+0000","last_became_peered":"2023-09-30T22:53:27.520103+0000","last_unstale":"2023-09-30T22:53:28.512067+0000","last_undegraded":"2023-09-30T22:53:28.512067+0000","last_fullsized":"2023-09-30T22:53:28.512067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:24.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521264+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521264+0000","last_peered":"2023-09-30T22:53:28.521264+0000","last_clean":"2023-09-30T22:53:28.521264+0000","last_became_active":"2023-09-30T22:53:28.520956+0000","last_became_peered":"2023-09-30T22:53:28.520956+0000","last_unstale":"2023-09-30T22:53:28.521264+0000","last_undegraded":"2023-09-30T22:53:28.521264+0000","last_fullsized":"2023-09-30T22:53:28.521264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:17:54.299095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518003+0000","last_change":"2023-09-30T22:53:27.516312+0000","last_active":"2023-09-30T22:53:28.518003+0000","last_peered":"2023-09-30T22:53:28.518003+0000","last_clean":"2023-09-30T22:53:28.518003+0000","last_became_active":"2023-09-30T22:53:27.516077+0000","last_became_peered":"2023-09-30T22:53:27.516077+0000","last_unstale":"2023-09-30T22:53:28.518003+0000","last_undegraded":"2023-09-30T22:53:28.518003+0000","last_fullsized":"2023-09-30T22:53:28.518003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:23.956508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.514093+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:53:28.514093+0000","last_peered":"2023-09-30T22:53:28.514093+0000","last_clean":"2023-09-30T22:53:28.514093+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:53:28.514093+0000","last_undegraded":"2023-09-30T22:53:28.514093+0000","last_fullsized":"2023-09-30T22:53:28.514093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520799+0000","last_change":"2023-09-30T22:53:28.520729+0000","last_active":"2023-09-30T22:53:28.520799+0000","last_peered":"2023-09-30T22:53:28.520799+0000","last_clean":"2023-09-30T22:53:28.520799+0000","last_became_active":"2023-09-30T22:53:28.520513+0000","last_became_peered":"2023-09-30T22:53:28.520513+0000","last_unstale":"2023-09-30T22:53:28.520799+0000","last_undegraded":"2023-09-30T22:53:28.520799+0000","last_fullsized":"2023-09-30T22:53:28.520799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:16.391832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509593+0000","last_change":"2023-09-30T22:53:27.518551+0000","last_active":"2023-09-30T22:53:28.509593+0000","last_peered":"2023-09-30T22:53:28.509593+0000","last_clean":"2023-09-30T22:53:28.509593+0000","last_became_active":"2023-09-30T22:53:27.518302+0000","last_became_peered":"2023-09-30T22:53:27.518302+0000","last_unstale":"2023-09-30T22:53:28.509593+0000","last_undegraded":"2023-09-30T22:53:28.509593+0000","last_fullsized":"2023-09-30T22:53:28.509593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:47.454460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509969+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:53:28.509969+0000","last_peered":"2023-09-30T22:53:28.509969+0000","last_clean":"2023-09-30T22:53:28.509969+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:53:28.509969+0000","last_undegraded":"2023-09-30T22:53:28.509969+0000","last_fullsized":"2023-09-30T22:53:28.509969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.526279+0000","last_change":"2023-09-30T22:53:28.526154+0000","last_active":"2023-09-30T22:53:28.526279+0000","last_peered":"2023-09-30T22:53:28.526279+0000","last_clean":"2023-09-30T22:53:28.526279+0000","last_became_active":"2023-09-30T22:53:28.525783+0000","last_became_peered":"2023-09-30T22:53:28.525783+0000","last_unstale":"2023-09-30T22:53:28.526279+0000","last_undegraded":"2023-09-30T22:53:28.526279+0000","last_fullsized":"2023-09-30T22:53:28.526279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:17:23.357783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T22:53:29.514067+0000","last_change":"2023-09-30T22:53:27.518889+0000","last_active":"2023-09-30T22:53:29.514067+0000","last_peered":"2023-09-30T22:53:29.514067+0000","last_clean":"2023-09-30T22:53:29.514067+0000","last_became_active":"2023-09-30T22:53:27.518640+0000","last_became_peered":"2023-09-30T22:53:27.518640+0000","last_unstale":"2023-09-30T22:53:29.514067+0000","last_undegraded":"2023-09-30T22:53:29.514067+0000","last_fullsized":"2023-09-30T22:53:29.514067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:24.836699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508872+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:53:28.508872+0000","last_peered":"2023-09-30T22:53:28.508872+0000","last_clean":"2023-09-30T22:53:28.508872+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:53:28.508872+0000","last_undegraded":"2023-09-30T22:53:28.508872+0000","last_fullsized":"2023-09-30T22:53:28.508872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517975+0000","last_change":"2023-09-30T22:53:28.517844+0000","last_active":"2023-09-30T22:53:28.517975+0000","last_peered":"2023-09-30T22:53:28.517975+0000","last_clean":"2023-09-30T22:53:28.517975+0000","last_became_active":"2023-09-30T22:53:28.517579+0000","last_became_peered":"2023-09-30T22:53:28.517579+0000","last_unstale":"2023-09-30T22:53:28.517975+0000","last_undegraded":"2023-09-30T22:53:28.517975+0000","last_fullsized":"2023-09-30T22:53:28.517975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:56.402195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517216+0000","last_change":"2023-09-30T22:53:27.516488+0000","last_active":"2023-09-30T22:53:28.517216+0000","last_peered":"2023-09-30T22:53:28.517216+0000","last_clean":"2023-09-30T22:53:28.517216+0000","last_became_active":"2023-09-30T22:53:27.516261+0000","last_became_peered":"2023-09-30T22:53:27.516261+0000","last_unstale":"2023-09-30T22:53:28.517216+0000","last_undegraded":"2023-09-30T22:53:28.517216+0000","last_fullsized":"2023-09-30T22:53:28.517216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:22.220152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509715+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:53:28.509715+0000","last_peered":"2023-09-30T22:53:28.509715+0000","last_clean":"2023-09-30T22:53:28.509715+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:53:28.509715+0000","last_undegraded":"2023-09-30T22:53:28.509715+0000","last_fullsized":"2023-09-30T22:53:28.509715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.513331+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:53:28.513331+0000","last_peered":"2023-09-30T22:53:28.513331+0000","last_clean":"2023-09-30T22:53:28.513331+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:53:28.513331+0000","last_undegraded":"2023-09-30T22:53:28.513331+0000","last_fullsized":"2023-09-30T22:53:28.513331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521299+0000","last_change":"2023-09-30T22:53:28.521189+0000","last_active":"2023-09-30T22:53:28.521299+0000","last_peered":"2023-09-30T22:53:28.521299+0000","last_clean":"2023-09-30T22:53:28.521299+0000","last_became_active":"2023-09-30T22:53:28.520925+0000","last_became_peered":"2023-09-30T22:53:28.520925+0000","last_unstale":"2023-09-30T22:53:28.521299+0000","last_undegraded":"2023-09-30T22:53:28.521299+0000","last_fullsized":"2023-09-30T22:53:28.521299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:56.822169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.535759+0000","last_change":"2023-09-30T22:53:27.513347+0000","last_active":"2023-09-30T22:53:28.535759+0000","last_peered":"2023-09-30T22:53:28.535759+0000","last_clean":"2023-09-30T22:53:28.535759+0000","last_became_active":"2023-09-30T22:53:27.513127+0000","last_became_peered":"2023-09-30T22:53:27.513127+0000","last_unstale":"2023-09-30T22:53:28.535759+0000","last_undegraded":"2023-09-30T22:53:28.535759+0000","last_fullsized":"2023-09-30T22:53:28.535759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:06.535100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509399+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:53:28.509399+0000","last_peered":"2023-09-30T22:53:28.509399+0000","last_clean":"2023-09-30T22:53:28.509399+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:53:28.509399+0000","last_undegraded":"2023-09-30T22:53:28.509399+0000","last_fullsized":"2023-09-30T22:53:28.509399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521298+0000","last_change":"2023-09-30T22:53:28.521190+0000","last_active":"2023-09-30T22:53:28.521298+0000","last_peered":"2023-09-30T22:53:28.521298+0000","last_clean":"2023-09-30T22:53:28.521298+0000","last_became_active":"2023-09-30T22:53:28.520955+0000","last_became_peered":"2023-09-30T22:53:28.520955+0000","last_unstale":"2023-09-30T22:53:28.521298+0000","last_undegraded":"2023-09-30T22:53:28.521298+0000","last_fullsized":"2023-09-30T22:53:28.521298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:43.991664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.517510+0000","last_change":"2023-09-30T22:53:27.516490+0000","last_active":"2023-09-30T22:53:28.517510+0000","last_peered":"2023-09-30T22:53:28.517510+0000","last_clean":"2023-09-30T22:53:28.517510+0000","last_became_active":"2023-09-30T22:53:27.516254+0000","last_became_peered":"2023-09-30T22:53:27.516254+0000","last_unstale":"2023-09-30T22:53:28.517510+0000","last_undegraded":"2023-09-30T22:53:28.517510+0000","last_fullsized":"2023-09-30T22:53:28.517510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:33:29.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509312+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:53:28.509312+0000","last_peered":"2023-09-30T22:53:28.509312+0000","last_clean":"2023-09-30T22:53:28.509312+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:53:28.509312+0000","last_undegraded":"2023-09-30T22:53:28.509312+0000","last_fullsized":"2023-09-30T22:53:28.509312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.521668+0000","last_change":"2023-09-30T22:53:28.519726+0000","last_active":"2023-09-30T22:53:28.521668+0000","last_peered":"2023-09-30T22:53:28.521668+0000","last_clean":"2023-09-30T22:53:28.521668+0000","last_became_active":"2023-09-30T22:53:28.519499+0000","last_became_peered":"2023-09-30T22:53:28.519499+0000","last_unstale":"2023-09-30T22:53:28.521668+0000","last_undegraded":"2023-09-30T22:53:28.521668+0000","last_fullsized":"2023-09-30T22:53:28.521668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:26:12.180534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.508433+0000","last_change":"2023-09-30T22:53:27.514765+0000","last_active":"2023-09-30T22:53:28.508433+0000","last_peered":"2023-09-30T22:53:28.508433+0000","last_clean":"2023-09-30T22:53:28.508433+0000","last_became_active":"2023-09-30T22:53:27.514536+0000","last_became_peered":"2023-09-30T22:53:27.514536+0000","last_unstale":"2023-09-30T22:53:28.508433+0000","last_undegraded":"2023-09-30T22:53:28.508433+0000","last_fullsized":"2023-09-30T22:53:28.508433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:03.005413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.518201+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:53:28.518201+0000","last_peered":"2023-09-30T22:53:28.518201+0000","last_clean":"2023-09-30T22:53:28.518201+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:53:28.518201+0000","last_undegraded":"2023-09-30T22:53:28.518201+0000","last_fullsized":"2023-09-30T22:53:28.518201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.519732+0000","last_change":"2023-09-30T22:53:28.519554+0000","last_active":"2023-09-30T22:53:28.519732+0000","last_peered":"2023-09-30T22:53:28.519732+0000","last_clean":"2023-09-30T22:53:28.519732+0000","last_became_active":"2023-09-30T22:53:28.519318+0000","last_became_peered":"2023-09-30T22:53:28.519318+0000","last_unstale":"2023-09-30T22:53:28.519732+0000","last_undegraded":"2023-09-30T22:53:28.519732+0000","last_fullsized":"2023-09-30T22:53:28.519732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:27.501519+0000","last_clean_scrub_stamp":"2023-09-30T22:53:27.501519+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:52.356467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.520210+0000","last_change":"2023-09-30T22:53:27.520302+0000","last_active":"2023-09-30T22:53:28.520210+0000","last_peered":"2023-09-30T22:53:28.520210+0000","last_clean":"2023-09-30T22:53:28.520210+0000","last_became_active":"2023-09-30T22:53:27.518956+0000","last_became_peered":"2023-09-30T22:53:27.518956+0000","last_unstale":"2023-09-30T22:53:28.520210+0000","last_undegraded":"2023-09-30T22:53:28.520210+0000","last_fullsized":"2023-09-30T22:53:28.520210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:53:26.494834+0000","last_clean_scrub_stamp":"2023-09-30T22:53:26.494834+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:42.984978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T22:53:28.509889+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:53:28.509889+0000","last_peered":"2023-09-30T22:53:28.509889+0000","last_clean":"2023-09-30T22:53:28.509889+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:53:28.509889+0000","last_undegraded":"2023-09-30T22:53:28.509889+0000","last_fullsized":"2023-09-30T22:53:28.509889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.878},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.82099999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.83999999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.499}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838200,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.73599999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.748},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.85299999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.308},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.432}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.623}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67100000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":1.27},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.95899999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":1},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":1.0309999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":1.129}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":1.173},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":1.21}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":160,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.73399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.96299999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.86299999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.745}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.498}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.75800000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.82799999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.86299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":159,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195152,"statfs":{"total":200000000,"available":199836574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.623}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59899999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.749}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51800000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.502}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.871},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.90900000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.83899999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.95599999999999996}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.71199999999999997}]}]}],"pool_statfs":[]}} 2023-09-30T22:53:38.190 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:53:38.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T22:53:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.421+0000 7fabe8dff700 1 Processor -- start 2023-09-30T22:53:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.421+0000 7fabe8dff700 1 -- start start 2023-09-30T22:53:38.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe8dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabe4159ba0 0x7fabe406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe8dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 0x7fabe40681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe8dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe4067d10 con 0x7fabe40b0de0 2023-09-30T22:53:38.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe8dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe406af90 con 0x7fabe4159ba0 2023-09-30T22:53:38.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe8dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40676c0 con 0x7fabe40ca5e0 2023-09-30T22:53:38.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabe4159ba0 0x7fabe406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabe4159ba0 0x7fabe406a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47152/0 (socket says 172.21.15.142:47152) 2023-09-30T22:53:38.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe259c700 1 -- 172.21.15.142:0/4052674265 learned_addr learned my addr 172.21.15.142:0/4052674265 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:38.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.423+0000 7fabe1d9b700 1 --1- 172.21.15.142:0/4052674265 >> v1:172.21.15.142:6789/0 conn(0x7fabe40b0de0 0x7fabe40c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50992/0 (socket says 172.21.15.142:50992) 2023-09-30T22:53:38.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe259c700 1 -- 172.21.15.142:0/4052674265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 msgr2=0x7fabe40681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:38.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe259c700 1 --2- 172.21.15.142:0/4052674265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 0x7fabe40681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe259c700 1 -- 172.21.15.142:0/4052674265 >> v1:172.21.15.142:6789/0 conn(0x7fabe40b0de0 legacy=0x7fabe40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe259c700 1 -- 172.21.15.142:0/4052674265 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40679a0 con 0x7fabe4159ba0 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe259c700 1 --2- 172.21.15.142:0/4052674265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe4159ba0 0x7fabe406a8d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fabd40099b0 tx=0x7fabd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de81a5d0a96eedd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe159a700 1 -- 172.21.15.142:0/4052674265 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400b860 con 0x7fabe4159ba0 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe159a700 1 -- 172.21.15.142:0/4052674265 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd400b9c0 con 0x7fabe4159ba0 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.424+0000 7fabe159a700 1 -- 172.21.15.142:0/4052674265 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400bd60 con 0x7fabe4159ba0 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 -- 172.21.15.142:0/4052674265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe4159ba0 msgr2=0x7fabe406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 --2- 172.21.15.142:0/4052674265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe4159ba0 0x7fabe406a8d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fabd40099b0 tx=0x7fabd4009250 comp rx=0 tx=0).stop 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 -- 172.21.15.142:0/4052674265 shutdown_connections 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 --2- 172.21.15.142:0/4052674265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe4159ba0 0x7fabe406a8d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 --2- 172.21.15.142:0/4052674265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 0x7fabe40681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 -- 172.21.15.142:0/4052674265 >> 172.21.15.142:0/4052674265 conn(0x7fabe40cb2f0 msgr2=0x7fabe40cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:38.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 -- 172.21.15.142:0/4052674265 shutdown_connections 2023-09-30T22:53:38.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.425+0000 7fabe8dff700 1 -- 172.21.15.142:0/4052674265 wait complete. 2023-09-30T22:53:38.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.426+0000 7fabe8dff700 1 Processor -- start 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.426+0000 7fabe8dff700 1 -- start start 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe8dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe40b0de0 0x7fabe40b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe8dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 0x7fabe40c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe8dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabe4159ba0 0x7fabe415d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe8dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40b0750 con 0x7fabe40b0de0 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe8dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40c6d20 con 0x7fabe4159ba0 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe8dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40c5e70 con 0x7fabe40ca5e0 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe40b0de0 0x7fabe40b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe40b0de0 0x7fabe40b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47162/0 (socket says 172.21.15.142:47162) 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.427+0000 7fabe259c700 1 -- 172.21.15.142:0/907880147 learned_addr learned my addr 172.21.15.142:0/907880147 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:38.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe1d9b700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 0x7fabe40c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe2d9d700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabe4159ba0 0x7fabe415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe259c700 1 -- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 msgr2=0x7fabe40c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe259c700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 0x7fabe40c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe259c700 1 -- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabe4159ba0 msgr2=0x7fabe415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe259c700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabe4159ba0 0x7fabe415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe259c700 1 -- 172.21.15.142:0/907880147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40094f0 con 0x7fabe40b0de0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe259c700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe40b0de0 0x7fabe40b0210 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fabd40090b0 tx=0x7fabd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabd27fc700 1 -- 172.21.15.142:0/907880147 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4011ea0 con 0x7fabe40b0de0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabd27fc700 1 -- 172.21.15.142:0/907880147 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd401f070 con 0x7fabe40b0de0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabd27fc700 1 -- 172.21.15.142:0/907880147 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd401a870 con 0x7fabe40b0de0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe40c6110 con 0x7fabe40b0de0 2023-09-30T22:53:38.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.428+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe40c66d0 con 0x7fabe40b0de0 2023-09-30T22:53:38.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.429+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe406e4b0 con 0x7fabe40b0de0 2023-09-30T22:53:38.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.430+0000 7fabd27fc700 1 -- 172.21.15.142:0/907880147 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fabd401ac60 con 0x7fabe40b0de0 2023-09-30T22:53:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.431+0000 7fabd27fc700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc4067330 0x7fabc40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.431+0000 7fabd27fc700 1 -- 172.21.15.142:0/907880147 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fabd4021070 con 0x7fabe40b0de0 2023-09-30T22:53:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.432+0000 7fabe1d9b700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc4067330 0x7fabc40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.432+0000 7fabe1d9b700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc4067330 0x7fabc40697e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007fd0 tx=0x7fabd8007d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.436+0000 7fabd27fc700 1 -- 172.21.15.142:0/907880147 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fabd4053a40 con 0x7fabe40b0de0 2023-09-30T22:53:38.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.702+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fabe40cac40 con 0x7fabe40b0de0 2023-09-30T22:53:38.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.709+0000 7fabd27fc700 1 -- 172.21.15.142:0/907880147 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fabd402b020 con 0x7fabe40b0de0 2023-09-30T22:53:38.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc4067330 msgr2=0x7fabc40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc4067330 0x7fabc40697e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007fd0 tx=0x7fabd8007d70 comp rx=0 tx=0).stop 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe40b0de0 msgr2=0x7fabe40b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe40b0de0 0x7fabe40b0210 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fabd40090b0 tx=0x7fabd4017000 comp rx=0 tx=0).stop 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 shutdown_connections 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc4067330 0x7fabc40697e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabe4159ba0 0x7fabe415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabe40b0de0 0x7fabe40b0210 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 --2- 172.21.15.142:0/907880147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabe40ca5e0 0x7fabe40c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 >> 172.21.15.142:0/907880147 conn(0x7fabe40cb2f0 msgr2=0x7fabe4157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:38.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 shutdown_connections 2023-09-30T22:53:38.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.712+0000 7fabe8dff700 1 -- 172.21.15.142:0/907880147 wait complete. 2023-09-30T22:53:38.714 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T22:53:38.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.919+0000 7fc098fff700 1 Processor -- start 2023-09-30T22:53:38.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.919+0000 7fc098fff700 1 -- start start 2023-09-30T22:53:38.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc098fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0940af020 0x7fc094156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc098fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc0940b00d0 0x7fc09406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc098fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09406e650 0x7fc0940b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc098fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09406d3e0 con 0x7fc0940af020 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc098fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09406dc80 con 0x7fc0940b00d0 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc098fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09406b790 con 0x7fc09406e650 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc09259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0940af020 0x7fc094156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc09259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0940af020 0x7fc094156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47168/0 (socket says 172.21.15.142:47168) 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.920+0000 7fc09259c700 1 -- 172.21.15.142:0/1506496862 learned_addr learned my addr 172.21.15.142:0/1506496862 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc091d9b700 1 --2- 172.21.15.142:0/1506496862 >> v2:172.21.15.148:3300/0 conn(0x7fc0940b00d0 0x7fc09406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc092d9d700 1 --2- 172.21.15.142:0/1506496862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09406e650 0x7fc0940b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09259c700 1 -- 172.21.15.142:0/1506496862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09406e650 msgr2=0x7fc0940b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09259c700 1 --2- 172.21.15.142:0/1506496862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09406e650 0x7fc0940b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09259c700 1 -- 172.21.15.142:0/1506496862 >> v2:172.21.15.148:3300/0 conn(0x7fc0940b00d0 msgr2=0x7fc09406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09259c700 1 --2- 172.21.15.142:0/1506496862 >> v2:172.21.15.148:3300/0 conn(0x7fc0940b00d0 0x7fc09406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09259c700 1 -- 172.21.15.142:0/1506496862 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940b0650 con 0x7fc0940af020 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc092d9d700 1 --2- 172.21.15.142:0/1506496862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09406e650 0x7fc0940b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09259c700 1 --2- 172.21.15.142:0/1506496862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940af020 0x7fc094156d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0940c1950 tx=0x7fc084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdef1caec308ddd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09159a700 1 -- 172.21.15.142:0/1506496862 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084009e70 con 0x7fc0940af020 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09159a700 1 -- 172.21.15.142:0/1506496862 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400b860 con 0x7fc0940af020 2023-09-30T22:53:38.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.921+0000 7fc09159a700 1 -- 172.21.15.142:0/1506496862 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400bc00 con 0x7fc0940af020 2023-09-30T22:53:38.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 -- 172.21.15.142:0/1506496862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940af020 msgr2=0x7fc094156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 --2- 172.21.15.142:0/1506496862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940af020 0x7fc094156d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0940c1950 tx=0x7fc084009250 comp rx=0 tx=0).stop 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 -- 172.21.15.142:0/1506496862 shutdown_connections 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 --2- 172.21.15.142:0/1506496862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09406e650 0x7fc0940b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 --2- 172.21.15.142:0/1506496862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940af020 0x7fc094156d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 --2- 172.21.15.142:0/1506496862 >> v2:172.21.15.148:3300/0 conn(0x7fc0940b00d0 0x7fc09406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 -- 172.21.15.142:0/1506496862 >> 172.21.15.142:0/1506496862 conn(0x7fc0940680c0 msgr2=0x7fc0940c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 -- 172.21.15.142:0/1506496862 shutdown_connections 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.922+0000 7fc098fff700 1 -- 172.21.15.142:0/1506496862 wait complete. 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.924+0000 7fc098fff700 1 Processor -- start 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.924+0000 7fc098fff700 1 -- start start 2023-09-30T22:53:38.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc098fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09406e650 0x7fc09414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc098fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940af020 0x7fc094148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc098fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940b00d0 0x7fc094169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc098fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09414a5d0 con 0x7fc0940b00d0 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc098fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09416a710 con 0x7fc09406e650 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc098fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09416a9f0 con 0x7fc0940af020 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940b00d0 0x7fc094169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940b00d0 0x7fc094169c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47170/0 (socket says 172.21.15.142:47170) 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 -- 172.21.15.142:0/2188908390 learned_addr learned my addr 172.21.15.142:0/2188908390 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc09259c700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09406e650 0x7fc09414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc091d9b700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940af020 0x7fc094148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 -- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940af020 msgr2=0x7fc094148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940af020 0x7fc094148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 -- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09406e650 msgr2=0x7fc09414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09406e650 0x7fc09414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.925+0000 7fc092d9d700 1 -- 172.21.15.142:0/2188908390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0840094f0 con 0x7fc0940b00d0 2023-09-30T22:53:38.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.926+0000 7fc092d9d700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940b00d0 0x7fc094169c50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009fc0 tx=0x7fc08c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:38.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.926+0000 7fc0827fc700 1 -- 172.21.15.142:0/2188908390 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00dbe0 con 0x7fc0940b00d0 2023-09-30T22:53:38.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.926+0000 7fc0827fc700 1 -- 172.21.15.142:0/2188908390 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00f040 con 0x7fc0940b00d0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.926+0000 7fc0827fc700 1 -- 172.21.15.142:0/2188908390 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c015440 con 0x7fc0940b00d0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.926+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094147d90 con 0x7fc0940b00d0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.926+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940c78a0 con 0x7fc0940b00d0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.927+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094147bf0 con 0x7fc0940b00d0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.928+0000 7fc0827fc700 1 -- 172.21.15.142:0/2188908390 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc08c01e3b0 con 0x7fc0940b00d0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.929+0000 7fc0827fc700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.929+0000 7fc0827fc700 1 -- 172.21.15.142:0/2188908390 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc08c085060 con 0x7fc0940b00d0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.929+0000 7fc09259c700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:38.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.930+0000 7fc09259c700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc0940c1950 tx=0x7fc084017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:38.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:38.933+0000 7fc0827fc700 1 -- 172.21.15.142:0/2188908390 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc094147bf0 con 0x7fc0940b00d0 2023-09-30T22:53:39.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.164+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc094147bf0 con 0x7fc0940b00d0 2023-09-30T22:53:39.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.164+0000 7fc0827fc700 1 -- 172.21.15.142:0/2188908390 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fc094147bf0 con 0x7fc0940b00d0 2023-09-30T22:53:39.165 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:39.165 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:39.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 msgr2=0x7fc0740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc0940c1950 tx=0x7fc084017000 comp rx=0 tx=0).stop 2023-09-30T22:53:39.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940b00d0 msgr2=0x7fc094169c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940b00d0 0x7fc094169c50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009fc0 tx=0x7fc08c0099b0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 shutdown_connections 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0940b00d0 0x7fc094169c50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09406e650 0x7fc09414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 --2- 172.21.15.142:0/2188908390 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940af020 0x7fc094148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 >> 172.21.15.142:0/2188908390 conn(0x7fc0940680c0 msgr2=0x7fc09414d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 shutdown_connections 2023-09-30T22:53:39.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.167+0000 7fc098fff700 1 -- 172.21.15.142:0/2188908390 wait complete. 2023-09-30T22:53:39.169 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:39.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:53:27.981468+0000', 'modified': '2023-09-30T22:53:31.532704+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4983}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4983': {'gid': 4983, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.148:6835/2808848998', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6833', 'nonce': 2808848998}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 2808848998}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:53:39.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:53:39.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-30T22:53:39.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.779+0000 7fb26a1ff700 1 Processor -- start 2023-09-30T22:53:39.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.779+0000 7fb26a1ff700 1 -- start start 2023-09-30T22:53:39.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb26a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 0x7fb264159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb26a1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640b0ee0 con 0x7fb2640aebf0 2023-09-30T22:53:39.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb26a1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26415a520 con 0x7fb264069f10 2023-09-30T22:53:39.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb26a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640aefc0 con 0x7fb264159b90 2023-09-30T22:53:39.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb2637fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb2640aebf0 0x7fb26406ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50994/0 (socket says 172.21.15.142:50994) 2023-09-30T22:53:39.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb2637fe700 1 -- 172.21.15.142:0/741609816 learned_addr learned my addr 172.21.15.142:0/741609816 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:39.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb262ffd700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 0x7fb264159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.781+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232113187 0 0) 0x7fb2640b0ee0 con 0x7fb2640aebf0 2023-09-30T22:53:39.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb24c003570 con 0x7fb2640aebf0 2023-09-30T22:53:39.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3806884197 0 0) 0x7fb24c003570 con 0x7fb2640aebf0 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 msgr2=0x7fb264159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 0x7fb264159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 >> v1:172.21.15.148:6789/0 conn(0x7fb264069f10 legacy=0x7fb26406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26406f360 con 0x7fb2640aebf0 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fb254001470 con 0x7fb2640aebf0 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 >> v1:172.21.15.142:6789/0 conn(0x7fb2640aebf0 legacy=0x7fb26406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb24c003a90 0x7fb24c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c004810 0x7fb24c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 0x7fb24c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640aefc0 con 0x7fb24c003a90 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c00bb10 con 0x7fb24c004810 2023-09-30T22:53:39.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c00bcd0 con 0x7fb264159b90 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb2637fe700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb24c003a90 0x7fb24c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb262ffd700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c004810 0x7fb24c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.782+0000 7fb263fff700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 0x7fb24c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2637fe700 1 -- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 msgr2=0x7fb24c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2637fe700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264159b90 0x7fb24c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2637fe700 1 -- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c004810 msgr2=0x7fb24c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2637fe700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c004810 0x7fb24c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2637fe700 1 -- 172.21.15.142:0/741609816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26406f360 con 0x7fb24c003a90 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb262ffd700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c004810 0x7fb24c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2637fe700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb24c003a90 0x7fb24c003e60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb254007f30 tx=0x7fb254001e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e161a3f81d4828e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:39.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400cc80 con 0x7fb24c003a90 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25400cde0 con 0x7fb24c003a90 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.783+0000 7fb2627fc700 1 -- 172.21.15.142:0/741609816 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254005b70 con 0x7fb24c003a90 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.784+0000 7fb26a1ff700 1 -- 172.21.15.142:0/741609816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb24c003a90 msgr2=0x7fb24c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.784+0000 7fb26a1ff700 1 --2- 172.21.15.142:0/741609816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb24c003a90 0x7fb24c003e60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb254007f30 tx=0x7fb254001e20 comp rx=0 tx=0).stop 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.784+0000 7fb263fff700 1 -- 172.21.15.142:0/741609816 reap_dead start 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.784+0000 7fb26a1ff700 1 -- 172.21.15.142:0/741609816 shutdown_connections 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.784+0000 7fb26a1ff700 1 -- 172.21.15.142:0/741609816 >> 172.21.15.142:0/741609816 conn(0x7fb2640680c0 msgr2=0x7fb2640c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.784+0000 7fb26a1ff700 1 -- 172.21.15.142:0/741609816 shutdown_connections 2023-09-30T22:53:39.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.784+0000 7fb26a1ff700 1 -- 172.21.15.142:0/741609816 wait complete. 2023-09-30T22:53:39.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.785+0000 7fb26a1ff700 1 Processor -- start 2023-09-30T22:53:39.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.785+0000 7fb26a1ff700 1 -- start start 2023-09-30T22:53:39.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.786+0000 7fb26a1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c003a90 0x7fb26414d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.786+0000 7fb26a1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2641563f0 0x7fb2640cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.786+0000 7fb26a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264156860 0x7fb2640cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.786+0000 7fb26a1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26414d8e0 con 0x7fb2641563f0 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.786+0000 7fb26a1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264159240 con 0x7fb24c003a90 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.786+0000 7fb26a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26415b370 con 0x7fb264156860 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2641563f0 0x7fb2640cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2641563f0 0x7fb2640cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47188/0 (socket says 172.21.15.142:47188) 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 -- 172.21.15.142:0/3066708386 learned_addr learned my addr 172.21.15.142:0/3066708386 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb2637fe700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c003a90 0x7fb26414d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb263fff700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264156860 0x7fb2640cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 -- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264156860 msgr2=0x7fb2640cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264156860 0x7fb2640cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 -- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c003a90 msgr2=0x7fb26414d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c003a90 0x7fb26414d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 -- 172.21.15.142:0/3066708386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26415a760 con 0x7fb2641563f0 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb262ffd700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2641563f0 0x7fb2640cb9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb258011da0 tx=0x7fb2580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.787+0000 7fb24b7fe700 1 -- 172.21.15.142:0/3066708386 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800fbc0 con 0x7fb2641563f0 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.788+0000 7fb24b7fe700 1 -- 172.21.15.142:0/3066708386 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800fd20 con 0x7fb2641563f0 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.788+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26415aa40 con 0x7fb2641563f0 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.788+0000 7fb24b7fe700 1 -- 172.21.15.142:0/3066708386 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25801d6b0 con 0x7fb2641563f0 2023-09-30T22:53:39.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.788+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26415b000 con 0x7fb2641563f0 2023-09-30T22:53:39.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.791+0000 7fb24b7fe700 1 -- 172.21.15.142:0/3066708386 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb25801dae0 con 0x7fb2641563f0 2023-09-30T22:53:39.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.791+0000 7fb24b7fe700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb250067330 0x7fb2500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.791+0000 7fb24b7fe700 1 -- 172.21.15.142:0/3066708386 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb258018070 con 0x7fb2641563f0 2023-09-30T22:53:39.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.792+0000 7fb2637fe700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb250067330 0x7fb2500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.792+0000 7fb2637fe700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb250067330 0x7fb2500697e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb254007cd0 tx=0x7fb254017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:39.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.793+0000 7fb278832b80 1 Processor -- start 2023-09-30T22:53:39.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.793+0000 7fb278832b80 1 -- start start 2023-09-30T22:53:39.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb278832b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc1e450 0x55c45bc1e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bc26f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc274d0 0x55c45bc27940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb278832b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45baf1310 con 0x55c45bc1e450 2023-09-30T22:53:39.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45bb2e130 con 0x55c45bc274d0 2023-09-30T22:53:39.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c45bb2baf0 con 0x55c45bc03f40 2023-09-30T22:53:39.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb2637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc1e450 0x55c45bc1e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb2637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc1e450 0x55c45bc1e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47198/0 (socket says 172.21.15.142:47198) 2023-09-30T22:53:39.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.794+0000 7fb2637fe700 1 -- 172.21.15.142:0/1074254628 learned_addr learned my addr 172.21.15.142:0/1074254628 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb263fff700 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc274d0 0x55c45bc27940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb262ffd700 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bc26f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb2637fe700 1 -- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 msgr2=0x55c45bc26f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb2637fe700 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bc26f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb2637fe700 1 -- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc274d0 msgr2=0x55c45bc27940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb2637fe700 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc274d0 0x55c45bc27940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb2637fe700 1 -- 172.21.15.142:0/1074254628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c45b92d790 con 0x55c45bc1e450 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb262ffd700 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bc26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb263fff700 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc274d0 0x55c45bc27940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb2637fe700 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc1e450 0x55c45bc1e820 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c9a0 tx=0x7fb254022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce19be123fb78b19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb248ff9700 1 -- 172.21.15.142:0/1074254628 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254022070 con 0x55c45bc1e450 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb248ff9700 1 -- 172.21.15.142:0/1074254628 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254000c30 con 0x55c45bc1e450 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.795+0000 7fb248ff9700 1 -- 172.21.15.142:0/1074254628 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540070d0 con 0x55c45bc1e450 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 -- 172.21.15.142:0/1074254628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc1e450 msgr2=0x55c45bc1e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc1e450 0x55c45bc1e820 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c9a0 tx=0x7fb254022000 comp rx=0 tx=0).stop 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 -- 172.21.15.142:0/1074254628 shutdown_connections 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc274d0 0x55c45bc27940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc1e450 0x55c45bc1e820 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 --2- 172.21.15.142:0/1074254628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bc26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 -- 172.21.15.142:0/1074254628 >> 172.21.15.142:0/1074254628 conn(0x55c45bc21880 msgr2=0x55c45bc21c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 -- 172.21.15.142:0/1074254628 shutdown_connections 2023-09-30T22:53:39.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.796+0000 7fb278832b80 1 -- 172.21.15.142:0/1074254628 wait complete. 2023-09-30T22:53:39.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.797+0000 7fb278832b80 1 -- start start 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.797+0000 7fb278832b80 1 Processor -- start 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bbfb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbf96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb278832b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbf7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb278832b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45bb278e0 con 0x55c45bc274d0 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45bad3980 con 0x55c45bc03f40 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c45bad3620 con 0x55c45bc1e450 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb278832b80 10 client.0 _ll_register_callbacks cb 0x55c45b936a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbf7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbf7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47200/0 (socket says 172.21.15.142:47200) 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb263fff700 1 -- 172.21.15.142:0/1666047094 learned_addr learned my addr 172.21.15.142:0/1666047094 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.799+0000 7fb2637fe700 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bbfb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb262ffd700 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbf96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb263fff700 1 -- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 msgr2=0x55c45bbf96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb263fff700 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbf96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb263fff700 1 -- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 msgr2=0x55c45bbfb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb263fff700 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bbfb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb263fff700 1 -- 172.21.15.142:0/1666047094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26406f360 con 0x55c45bc274d0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb263fff700 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbf7e40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000f80 tx=0x7fb25c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0be71488b0f8e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb241ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb241ffb700 1 -- 172.21.15.142:0/1666047094 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c006db0 con 0x55c45bc274d0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb241ffb700 1 -- 172.21.15.142:0/1666047094 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb25c017ca0 con 0x55c45bc274d0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c45bbcbd60 con 0x55c45bc274d0 2023-09-30T22:53:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb241ffb700 1 -- 172.21.15.142:0/1666047094 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb25c017e60 con 0x55c45bc274d0 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb278832b80 10 client.5181 fetch_fsmap learned FSMap version 15 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.800+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c45ba1a0a0 con 0x55c45bc274d0 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb241ffb700 1 -- 172.21.15.142:0/1666047094 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c45bbcbd60 con 0x55c45bc274d0 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb241ffb700 1 -- 172.21.15.142:0/1666047094 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb25c01f070 con 0x55c45bc274d0 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb278832b80 10 client.5181 fetch_fsmap finished waiting for FSMap version 15 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb278832b80 10 client.5181 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb278832b80 20 client.5181 populate_metadata read hostname 'smithi142' 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb278832b80 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bbfe540 0x55c45bbfe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb278832b80 4 client.5181 mds_command: new command op to 4983 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 --> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c45bba8b30 con 0x55c45bbfe540 2023-09-30T22:53:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.801+0000 7fb2637fe700 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bbfe540 0x55c45bbfe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.802+0000 7fb2637fe700 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bbfe540 0x55c45bbfe910 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d168f8973fb46ec server_cookie=3fb663223f741420 in_seq=0 out_seq=0 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.802+0000 7fb241ffb700 10 client.5181 ms_handle_connect on v2:172.21.15.148:6833/2808848998 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb241ffb700 1 -- 172.21.15.142:0/1666047094 <== mds.0 v2:172.21.15.148:6833/2808848998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x55c45bba8b30 con 0x55c45bbfe540 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb241ffb700 10 client.5181 handle_command_reply: tid=0 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 client.5181 shutdown 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 msgr2=0x55c45bbf7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbf7e40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000f80 tx=0x7fb25c0016d0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 shutdown_connections 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bbfe540 0x55c45bbfe910 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbf7e40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bbfb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb241ffb700 0 client.5181 ms_handle_reset on v2:172.21.15.148:6833/2808848998 2023-09-30T22:53:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 --2- 172.21.15.142:0/1666047094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbf96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 >> 172.21.15.142:0/1666047094 conn(0x55c45bc21880 msgr2=0x55c45bbd3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 shutdown_connections 2023-09-30T22:53:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.803+0000 7fb278832b80 1 -- 172.21.15.142:0/1666047094 wait complete. 2023-09-30T22:53:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.804+0000 7fb278832b80 20 client.5181 trim_cache size 0 max 16384 2023-09-30T22:53:39.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.821+0000 7fb278832b80 1 Processor -- start 2023-09-30T22:53:39.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.821+0000 7fb278832b80 1 -- start start 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bbfa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc1e450 0x55c45bc06aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb278832b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbcda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb278832b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45b9bf1e0 con 0x55c45bc274d0 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45bc07460 con 0x55c45bc1e450 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c45bbd79f0 con 0x55c45bc03f40 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbcda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbcda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47202/0 (socket says 172.21.15.142:47202) 2023-09-30T22:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 -- 172.21.15.142:0/2023595888 learned_addr learned my addr 172.21.15.142:0/2023595888 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb2637fe700 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bbfa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb262ffd700 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc1e450 0x55c45bc06aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 -- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 msgr2=0x55c45bbfa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bbfa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 -- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc1e450 msgr2=0x55c45bc06aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc1e450 0x55c45bc06aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 -- 172.21.15.142:0/2023595888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c45baf63c0 con 0x55c45bc274d0 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.822+0000 7fb263fff700 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbcda40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb25c001710 tx=0x7fb25c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9202c0769d4aa711 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb2497fa700 1 -- 172.21.15.142:0/2023595888 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c007380 con 0x55c45bc274d0 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb2497fa700 1 -- 172.21.15.142:0/2023595888 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c000fb0 con 0x55c45bc274d0 2023-09-30T22:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb2497fa700 1 -- 172.21.15.142:0/2023595888 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c007670 con 0x55c45bc274d0 2023-09-30T22:53:39.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 -- 172.21.15.142:0/2023595888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 msgr2=0x55c45bbcda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbcda40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb25c001710 tx=0x7fb25c016000 comp rx=0 tx=0).stop 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 -- 172.21.15.142:0/2023595888 shutdown_connections 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bbcda40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc03f40 0x55c45bbfa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 --2- 172.21.15.142:0/2023595888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc1e450 0x55c45bc06aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 -- 172.21.15.142:0/2023595888 >> 172.21.15.142:0/2023595888 conn(0x55c45bc21880 msgr2=0x55c45bbd4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 -- 172.21.15.142:0/2023595888 shutdown_connections 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.823+0000 7fb278832b80 1 -- 172.21.15.142:0/2023595888 wait complete. 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.824+0000 7fb278832b80 1 -- start start 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.824+0000 7fb278832b80 1 Processor -- start 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bc7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb278832b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbfcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb278832b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bc36d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb278832b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45bbff960 con 0x55c45bc274d0 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c45bbfc7c0 con 0x55c45bc03f40 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb278832b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c45bbff490 con 0x55c45bc1e450 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb278832b80 10 client.0 _ll_register_callbacks cb 0x55c45b936a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bc36d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bc36d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47206/0 (socket says 172.21.15.142:47206) 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.825+0000 7fb263fff700 1 -- 172.21.15.142:0/3603409727 learned_addr learned my addr 172.21.15.142:0/3603409727 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb2637fe700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bc7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb263fff700 1 -- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 msgr2=0x55c45bbfcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb262ffd700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbfcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb263fff700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbfcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb263fff700 1 -- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 msgr2=0x55c45bc7d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb263fff700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bc7d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb263fff700 1 -- 172.21.15.142:0/3603409727 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c45ba1a0a0 con 0x55c45bc274d0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb262ffd700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbfcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb263fff700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bc36d10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0075f0 tx=0x7fb25c018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e2af15a92259a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb241ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb241ffb700 1 -- 172.21.15.142:0/3603409727 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0124c0 con 0x55c45bc274d0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb241ffb700 1 -- 172.21.15.142:0/3603409727 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb25c012d50 con 0x55c45bc274d0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.826+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb254000c30 con 0x55c45bc274d0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb241ffb700 1 -- 172.21.15.142:0/3603409727 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb25c012620 con 0x55c45bc274d0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 10 client.5187 fetch_fsmap learned FSMap version 15 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c45b98e1d0 con 0x55c45bc274d0 2023-09-30T22:53:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb241ffb700 1 -- 172.21.15.142:0/3603409727 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254000c30 con 0x55c45bc274d0 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb241ffb700 1 -- 172.21.15.142:0/3603409727 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb25c012790 con 0x55c45bc274d0 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 10 client.5187 fetch_fsmap finished waiting for FSMap version 15 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 10 client.5187 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 20 client.5187 populate_metadata read hostname 'smithi142' 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bc83600 0x55c45bc839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 4 client.5187 mds_command: new command op to 4983 tid=0[{"prefix": "status"}] 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 --> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c45baca8d0 con 0x55c45bc83600 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.827+0000 7fb2637fe700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bc83600 0x55c45bc839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.828+0000 7fb241ffb700 10 client.5187 ms_handle_connect on v2:172.21.15.148:6833/2808848998 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.828+0000 7fb2637fe700 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bc83600 0x55c45bc839d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=850fc08d061823ca server_cookie=eaba9a35d6ddf885 in_seq=0 out_seq=0 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.828+0000 7fb241ffb700 1 -- 172.21.15.142:0/3603409727 <== mds.0 v2:172.21.15.148:6833/2808848998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55c45baca8d0 con 0x55c45bc83600 2023-09-30T22:53:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.828+0000 7fb241ffb700 10 client.5187 handle_command_reply: tid=0 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.828+0000 7fb278832b80 1 client.5187 shutdown 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.828+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 msgr2=0x55c45bc36d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.828+0000 7fb278832b80 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bc36d10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0075f0 tx=0x7fb25c018040 comp rx=0 tx=0).stop 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 shutdown_connections 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:6833/2808848998,v1:172.21.15.148:6835/2808848998] conn(0x55c45bc83600 0x55c45bc839d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c45bc274d0 0x55c45bc36d10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c45bc03f40 0x55c45bc7d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb241ffb700 0 client.5187 ms_handle_reset on v2:172.21.15.148:6833/2808848998 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 --2- 172.21.15.142:0/3603409727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c45bc1e450 0x55c45bbfcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 >> 172.21.15.142:0/3603409727 conn(0x55c45bc21880 msgr2=0x55c45bc06aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 shutdown_connections 2023-09-30T22:53:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 1 -- 172.21.15.142:0/3603409727 wait complete. 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb278832b80 20 client.5187 trim_cache size 0 max 16384 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4983, 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:53:39.835 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 11.305773851, 2023-09-30T22:53:39.836 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 15, 2023-09-30T22:53:39.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 35, 2023-09-30T22:53:39.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 35, 2023-09-30T22:53:39.836 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 21.108889718 2023-09-30T22:53:39.836 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb250067330 msgr2=0x7fb2500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb26a1ff700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb250067330 0x7fb2500697e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb254007cd0 tx=0x7fb254017000 comp rx=0 tx=0).stop 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2641563f0 msgr2=0x7fb2640cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb26a1ff700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2641563f0 0x7fb2640cb9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb258011da0 tx=0x7fb2580091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.829+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 shutdown_connections 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.830+0000 7fb26a1ff700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb250067330 0x7fb2500697e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.830+0000 7fb26a1ff700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb264156860 0x7fb2640cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.830+0000 7fb26a1ff700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb24c003a90 0x7fb26414d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.830+0000 7fb26a1ff700 1 --2- 172.21.15.142:0/3066708386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2641563f0 0x7fb2640cb9c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:39.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.830+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 >> 172.21.15.142:0/3066708386 conn(0x7fb2640680c0 msgr2=0x7fb2641500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:39.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.830+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 shutdown_connections 2023-09-30T22:53:39.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:39.830+0000 7fb26a1ff700 1 -- 172.21.15.142:0/3066708386 wait complete. 2023-09-30T22:53:39.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:53:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.035+0000 7f78081ff700 1 Processor -- start 2023-09-30T22:53:40.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.035+0000 7f78081ff700 1 -- start start 2023-09-30T22:53:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f78081ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 0x7f78001628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f78081ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780006d470 con 0x7f780006b3d0 2023-09-30T22:53:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f78081ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7800157e60 con 0x7f7800157a90 2023-09-30T22:53:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f78081ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000ae880 con 0x7f78000b2110 2023-09-30T22:53:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f780579a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f780006b3d0 0x7f78000b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51010/0 (socket says 172.21.15.142:51010) 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f780579a700 1 -- 172.21.15.142:0/1668765150 learned_addr learned my addr 172.21.15.142:0/1668765150 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f780679c700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 0x7f78001628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731951303 0 0) 0x7f780006d470 con 0x7f780006b3d0 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.037+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ec003570 con 0x7f780006b3d0 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222443134 0 0) 0x7f7800157e60 con 0x7f7800157a90 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f780006d470 con 0x7f7800157a90 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718895676 0 0) 0x7f77ec003570 con 0x7f780006b3d0 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 msgr2=0x7f78001628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 0x7f78001628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 >> v1:172.21.15.148:6789/0 conn(0x7f7800157a90 legacy=0x7f780015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:40.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000aeb60 con 0x7f780006b3d0 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f77f0001470 con 0x7f780006b3d0 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f780679c700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 0x7f78001628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 >> v1:172.21.15.142:6789/0 conn(0x7f780006b3d0 legacy=0x7f78000b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 0x7f77ec003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ec0041b0 0x7f77ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77ec004d50 0x7f77ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000ae880 con 0x7f77ec0041b0 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec00bbf0 con 0x7f77ec004d50 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec00bdb0 con 0x7f78000b2110 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f780579a700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ec0041b0 0x7f77ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f7805f9b700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 0x7f77ec003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.038+0000 7f780679c700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77ec004d50 0x7f77ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f780579a700 1 -- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 msgr2=0x7f77ec003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f780579a700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78000b2110 0x7f77ec003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f780579a700 1 -- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77ec004d50 msgr2=0x7f77ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f780579a700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77ec004d50 0x7f77ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f780579a700 1 -- 172.21.15.142:0/1668765150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8009a20 con 0x7f77ec0041b0 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f780579a700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ec0041b0 0x7f77ec004810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c1e0 tx=0x7f77f0001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45e3be43be5b1b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000cbe0 con 0x7f77ec0041b0 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f000cd40 con 0x7f77ec0041b0 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f7804f99700 1 -- 172.21.15.142:0/1668765150 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0005b70 con 0x7f77ec0041b0 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f78081ff700 1 -- 172.21.15.142:0/1668765150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ec0041b0 msgr2=0x7f77ec004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.039+0000 7f78081ff700 1 --2- 172.21.15.142:0/1668765150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77ec0041b0 0x7f77ec004810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c1e0 tx=0x7f77f0001d40 comp rx=0 tx=0).stop 2023-09-30T22:53:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.040+0000 7f780679c700 1 -- 172.21.15.142:0/1668765150 reap_dead start 2023-09-30T22:53:40.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.040+0000 7f78081ff700 1 -- 172.21.15.142:0/1668765150 shutdown_connections 2023-09-30T22:53:40.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.040+0000 7f78081ff700 1 -- 172.21.15.142:0/1668765150 >> 172.21.15.142:0/1668765150 conn(0x7f78000680c0 msgr2=0x7f78000c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:40.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.040+0000 7f78081ff700 1 -- 172.21.15.142:0/1668765150 shutdown_connections 2023-09-30T22:53:40.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.040+0000 7f78081ff700 1 -- 172.21.15.142:0/1668765150 wait complete. 2023-09-30T22:53:40.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.041+0000 7f78081ff700 1 Processor -- start 2023-09-30T22:53:40.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.042+0000 7f78081ff700 1 -- start start 2023-09-30T22:53:40.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f78081ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77ec0041b0 0x7f7800154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f78081ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78000cbf40 0x7f780015e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f78081ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78000cc3b0 0x7f780015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f78081ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78001547f0 con 0x7f78000cc3b0 2023-09-30T22:53:40.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f78081ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780015e550 con 0x7f78000cbf40 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f78081ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780015f450 con 0x7f77ec0041b0 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78000cc3b0 0x7f780015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78000cc3b0 0x7f780015ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47214/0 (socket says 172.21.15.142:47214) 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 -- 172.21.15.142:0/1168994972 learned_addr learned my addr 172.21.15.142:0/1168994972 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780579a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78000cbf40 0x7f780015e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f7805f9b700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77ec0041b0 0x7f7800154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 -- 172.21.15.142:0/1168994972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77ec0041b0 msgr2=0x7f7800154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77ec0041b0 0x7f7800154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 -- 172.21.15.142:0/1168994972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78000cbf40 msgr2=0x7f780015e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78000cbf40 0x7f780015e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.043+0000 7f780679c700 1 -- 172.21.15.142:0/1168994972 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800153ec0 con 0x7f78000cc3b0 2023-09-30T22:53:40.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.044+0000 7f780679c700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78000cc3b0 0x7f780015ee00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78000c89e0 tx=0x7f77f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:40.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.044+0000 7f77f5ffb700 1 -- 172.21.15.142:0/1168994972 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800e040 con 0x7f78000cc3b0 2023-09-30T22:53:40.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.044+0000 7f77f5ffb700 1 -- 172.21.15.142:0/1168994972 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f800f040 con 0x7f78000cc3b0 2023-09-30T22:53:40.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.044+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78001541a0 con 0x7f78000cc3b0 2023-09-30T22:53:40.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.044+0000 7f77f5ffb700 1 -- 172.21.15.142:0/1168994972 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800fed0 con 0x7f78000cc3b0 2023-09-30T22:53:40.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.044+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780014a1a0 con 0x7f78000cc3b0 2023-09-30T22:53:40.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.045+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800154960 con 0x7f78000cc3b0 2023-09-30T22:53:40.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.046+0000 7f77f5ffb700 1 -- 172.21.15.142:0/1168994972 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f77f8015640 con 0x7f78000cc3b0 2023-09-30T22:53:40.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.047+0000 7f77f5ffb700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77e4067330 0x7f77e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:40.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.047+0000 7f77f5ffb700 1 -- 172.21.15.142:0/1168994972 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77f8084c40 con 0x7f78000cc3b0 2023-09-30T22:53:40.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.047+0000 7f7805f9b700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77e4067330 0x7f77e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:40.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.048+0000 7f7805f9b700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77e4067330 0x7f77e40697e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0010e0 tx=0x7f77fc007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:40.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.052+0000 7f77f5ffb700 1 -- 172.21.15.142:0/1168994972 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f77f8055530 con 0x7f78000cc3b0 2023-09-30T22:53:40.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.286+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f780006fc10 con 0x7f78000cc3b0 2023-09-30T22:53:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.287+0000 7f77f5ffb700 1 -- 172.21.15.142:0/1168994972 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77f801e020 con 0x7f78000cc3b0 2023-09-30T22:53:40.287 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:53:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77e4067330 msgr2=0x7f77e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77e4067330 0x7f77e40697e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0010e0 tx=0x7f77fc007d30 comp rx=0 tx=0).stop 2023-09-30T22:53:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78000cc3b0 msgr2=0x7f780015ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78000cc3b0 0x7f780015ee00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78000c89e0 tx=0x7f77f800b040 comp rx=0 tx=0).stop 2023-09-30T22:53:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 shutdown_connections 2023-09-30T22:53:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77e4067330 0x7f77e40697e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78000cc3b0 0x7f780015ee00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77ec0041b0 0x7f7800154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 --2- 172.21.15.142:0/1168994972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78000cbf40 0x7f780015e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 >> 172.21.15.142:0/1168994972 conn(0x7f78000680c0 msgr2=0x7f780006db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 shutdown_connections 2023-09-30T22:53:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:40.289+0000 7f78081ff700 1 -- 172.21.15.142:0/1168994972 wait complete. 2023-09-30T22:53:40.307 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:53:40.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:53:40.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:53:40.307 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:53:40.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:53:40.308 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:53:40.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:53:40.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:53:40.308 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:53:40.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:40.309 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:53:40.356 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:53:40.356 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:53:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:53:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:53:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:40.357 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:53:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:53:40.358 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:53:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:53:40.359 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:53:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:40.359 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:53:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:53:40.360 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42237sec preferred_lft 42237sec 2023-09-30T22:53:40.360 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:53:40.360 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:40.360 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:53:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:53:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:53:40.362 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:40.362 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:53:40.362 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:53:40.363 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T22:53:40.363 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:40.363 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:53:40.363 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:53:40.364 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T22:53:40.364 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:40.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:40.364 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:53:40.462 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:53:40.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:40.466 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:53:40.514 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:53:40.514 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:53:40.514 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:53:40.514 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:53:40.514 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:53:40.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:40.516 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:53:40.516 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:53:40.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:53:40.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:53:40.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:53:40.516 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:53:40.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:40.682 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:53:40.729 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T22:53:40.729 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:53:40.729 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:53:40.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:40.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:53:40.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:53:40.800 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:53:40.846 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:53:40.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:53:40.846 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:53:40.931 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:53:40.931 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:53:40.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:53:41.071 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:53:41.071 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:53:41.071 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:53:41.086 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:53:41.086 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:53:41.086 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:53:41.086 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:53:41.086 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:53:41.107 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:53:41.108 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:53:41.108 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:53:41.108 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:53:41.108 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:53:41.108 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:53:41.108 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:53:41.108 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:53:41.113 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:53:41.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:41.113 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:53:41.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:53:41.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.374+0000 7f380efff700 1 Processor -- start 2023-09-30T22:53:41.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.375+0000 7f380efff700 1 -- start start 2023-09-30T22:53:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f380efff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3808159b90 0x7f380815a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f380efff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38080b0ee0 con 0x7f38080aebf0 2023-09-30T22:53:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f380efff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380806f360 con 0x7f3808069f10 2023-09-30T22:53:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f380efff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080aefc0 con 0x7f3808159b90 2023-09-30T22:53:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f3807fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3808159b90 0x7f380815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f3807fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3808159b90 0x7f380815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54586/0 (socket says 172.21.15.142:54586) 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f380cd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f38080aebf0 0x7f380806ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50082/0 (socket says 172.21.15.142:50082) 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f3807fff700 1 -- 172.21.15.142:0/3110148835 learned_addr learned my addr 172.21.15.142:0/3110148835 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.376+0000 7f3807fff700 1 -- 172.21.15.142:0/3110148835 >> v1:172.21.15.148:6789/0 conn(0x7f3808069f10 legacy=0x7f380806a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.377+0000 7f3807fff700 1 -- 172.21.15.142:0/3110148835 >> v1:172.21.15.142:6789/0 conn(0x7f38080aebf0 legacy=0x7f380806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.377+0000 7f3807fff700 1 -- 172.21.15.142:0/3110148835 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080b02d0 con 0x7f3808159b90 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.377+0000 7f38077fe700 1 -- 172.21.15.142:0/3110148835 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764781283 0 0) 0x7f38080b0ee0 con 0x7f38080aebf0 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.377+0000 7f3807fff700 1 --2- 172.21.15.142:0/3110148835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3808159b90 0x7f380815a010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f37f400ab50 tx=0x7f37f400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e475e85c617dd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.377+0000 7f38077fe700 1 -- 172.21.15.142:0/3110148835 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400ca60 con 0x7f3808159b90 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.377+0000 7f38077fe700 1 -- 172.21.15.142:0/3110148835 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f400cbc0 con 0x7f3808159b90 2023-09-30T22:53:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.377+0000 7f38077fe700 1 -- 172.21.15.142:0/3110148835 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40183f0 con 0x7f3808159b90 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.378+0000 7f380efff700 1 -- 172.21.15.142:0/3110148835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3808159b90 msgr2=0x7f380815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.378+0000 7f380efff700 1 --2- 172.21.15.142:0/3110148835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3808159b90 0x7f380815a010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f37f400ab50 tx=0x7f37f400a3f0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.378+0000 7f380efff700 1 -- 172.21.15.142:0/3110148835 shutdown_connections 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.378+0000 7f380efff700 1 --2- 172.21.15.142:0/3110148835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3808159b90 0x7f380815a010 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.378+0000 7f380efff700 1 -- 172.21.15.142:0/3110148835 >> 172.21.15.142:0/3110148835 conn(0x7f38080680c0 msgr2=0x7f38080c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.378+0000 7f380efff700 1 -- 172.21.15.142:0/3110148835 shutdown_connections 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.378+0000 7f380efff700 1 -- 172.21.15.142:0/3110148835 wait complete. 2023-09-30T22:53:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.379+0000 7f380efff700 1 Processor -- start 2023-09-30T22:53:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.379+0000 7f380efff700 1 -- start start 2023-09-30T22:53:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f380efff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3808069f10 0x7f38080ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:41.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f380efff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38080aebf0 0x7f38080c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f380efff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3808159b90 0x7f38080c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f380efff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080c6850 con 0x7f38080aebf0 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f380efff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081461d0 con 0x7f3808069f10 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f380efff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38080c5c40 con 0x7f3808159b90 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f3807fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38080aebf0 0x7f38080c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f3807fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38080aebf0 0x7f38080c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54588/0 (socket says 172.21.15.142:54588) 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.380+0000 7f3807fff700 1 -- 172.21.15.142:0/3220881151 learned_addr learned my addr 172.21.15.142:0/3220881151 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f380cd9b700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3808069f10 0x7f38080ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f380d59c700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3808159b90 0x7f38080c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3807fff700 1 -- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3808159b90 msgr2=0x7f38080c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3807fff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3808159b90 0x7f38080c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3807fff700 1 -- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3808069f10 msgr2=0x7f38080ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3807fff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3808069f10 0x7f38080ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3807fff700 1 -- 172.21.15.142:0/3220881151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f400a690 con 0x7f38080aebf0 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f380cd9b700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3808069f10 0x7f38080ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f380d59c700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3808159b90 0x7f38080c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3807fff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38080aebf0 0x7f38080c4a60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f37f4003080 tx=0x7f37f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3804ff9700 1 -- 172.21.15.142:0/3220881151 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4022410 con 0x7f38080aebf0 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3804ff9700 1 -- 172.21.15.142:0/3220881151 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4022590 con 0x7f38080aebf0 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38080c5f20 con 0x7f38080aebf0 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.381+0000 7f3804ff9700 1 -- 172.21.15.142:0/3220881151 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4022950 con 0x7f38080aebf0 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.382+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38080c64e0 con 0x7f38080aebf0 2023-09-30T22:53:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.383+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38080695b0 con 0x7f38080aebf0 2023-09-30T22:53:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.383+0000 7f3804ff9700 1 -- 172.21.15.142:0/3220881151 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f37f4020070 con 0x7f38080aebf0 2023-09-30T22:53:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.384+0000 7f3804ff9700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37ec067330 0x7f37ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.384+0000 7f3804ff9700 1 -- 172.21.15.142:0/3220881151 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f37f4085ec0 con 0x7f38080aebf0 2023-09-30T22:53:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.384+0000 7f380cd9b700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37ec067330 0x7f37ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.385+0000 7f380cd9b700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37ec067330 0x7f37ec0697e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0018d0 tx=0x7f37fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:41.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.389+0000 7f3804ff9700 1 -- 172.21.15.142:0/3220881151 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f37f4052d20 con 0x7f38080aebf0 2023-09-30T22:53:41.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.621+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38080c6990 con 0x7f38080aebf0 2023-09-30T22:53:41.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.621+0000 7f3804ff9700 1 -- 172.21.15.142:0/3220881151 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37f4056340 con 0x7f38080aebf0 2023-09-30T22:53:41.622 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:53:41.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37ec067330 msgr2=0x7f37ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37ec067330 0x7f37ec0697e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0018d0 tx=0x7f37fc009040 comp rx=0 tx=0).stop 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38080aebf0 msgr2=0x7f38080c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38080aebf0 0x7f38080c4a60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f37f4003080 tx=0x7f37f4019000 comp rx=0 tx=0).stop 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 shutdown_connections 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37ec067330 0x7f37ec0697e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3808159b90 0x7f38080c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3808069f10 0x7f38080ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 --2- 172.21.15.142:0/3220881151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38080aebf0 0x7f38080c4a60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 >> 172.21.15.142:0/3220881151 conn(0x7f38080680c0 msgr2=0x7f38080cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:41.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 shutdown_connections 2023-09-30T22:53:41.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:41.624+0000 7f380efff700 1 -- 172.21.15.142:0/3220881151 wait complete. 2023-09-30T22:53:41.641 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:53:41.642 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:53:41.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:41.642 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:53:41.696 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:53:41.696 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:53:41.696 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:53:41.696 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:41.696 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:53:41.696 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:53:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42267sec preferred_lft 42267sec 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T22:53:41.698 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:41.699 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:53:41.699 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:53:41.699 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T22:53:41.699 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:53:41.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:41.699 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:53:41.772 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:53:41.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:41.775 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:53:41.824 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:53:41.824 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:53:41.824 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:53:41.824 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:53:41.824 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:53:41.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:41.825 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:53:41.826 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:53:41.826 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:53:41.826 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:53:41.826 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:53:41.826 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:53:41.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:41.995 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:53:42.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:42.021 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:42.044 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T22:53:42.044 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:53:42.045 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:53:42.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:42.045 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:53:42.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:53:42.157 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:53:42.243 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:53:42.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:53:42.244 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:53:42.291 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:53:42.291 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:53:42.291 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:53:42.392 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:53:42.392 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:53:42.392 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:53:42.406 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:53:42.406 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:53:42.406 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:53:42.406 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:53:42.406 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:53:42.426 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:53:42.426 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:53:42.427 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:53:42.427 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:53:42.427 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:53:42.427 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:53:42.427 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:53:42.427 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:53:42.430 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:53:42.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:42.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:53:42.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:42.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.692+0000 7f9be89ff700 1 Processor -- start 2023-09-30T22:53:42.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.692+0000 7f9be89ff700 1 -- start start 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.693+0000 7f9be89ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9be40af020 0x7f9be4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.693+0000 7f9be89ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.693+0000 7f9be89ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be406d3e0 con 0x7f9be406e650 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.693+0000 7f9be89ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be415b400 con 0x7f9be40af020 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.693+0000 7f9be89ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be406dc80 con 0x7f9be40b00d0 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be2d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9be406e650 0x7f9be40b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50086/0 (socket says 172.21.15.142:50086) 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be2d9d700 1 -- 172.21.15.142:0/2374252758 learned_addr learned my addr 172.21.15.142:0/2374252758 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:42.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be259c700 1 --2- 172.21.15.142:0/2374252758 >> v2:172.21.15.148:3300/0 conn(0x7f9be40af020 0x7f9be4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:42.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be1d9b700 1 --2- 172.21.15.142:0/2374252758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:42.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be159a700 1 -- 172.21.15.142:0/2374252758 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653807153 0 0) 0x7f9be406d3e0 con 0x7f9be406e650 2023-09-30T22:53:42.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be159a700 1 -- 172.21.15.142:0/2374252758 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bcc003570 con 0x7f9be406e650 2023-09-30T22:53:42.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be1d9b700 1 -- 172.21.15.142:0/2374252758 >> v2:172.21.15.148:3300/0 conn(0x7f9be40af020 msgr2=0x7f9be4156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:42.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be1d9b700 1 --2- 172.21.15.142:0/2374252758 >> v2:172.21.15.148:3300/0 conn(0x7f9be40af020 0x7f9be4156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be1d9b700 1 -- 172.21.15.142:0/2374252758 >> v1:172.21.15.142:6789/0 conn(0x7f9be406e650 legacy=0x7f9be40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be1d9b700 1 -- 172.21.15.142:0/2374252758 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be406b790 con 0x7f9be40b00d0 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.694+0000 7f9be259c700 1 --2- 172.21.15.142:0/2374252758 >> v2:172.21.15.148:3300/0 conn(0x7f9be40af020 0x7f9be4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be1d9b700 1 --2- 172.21.15.142:0/2374252758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406e110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80098e0 tx=0x7f9bd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=144c74167d81687a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be159a700 1 -- 172.21.15.142:0/2374252758 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8011630 con 0x7f9be40b00d0 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be159a700 1 -- 172.21.15.142:0/2374252758 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd8011790 con 0x7f9be40b00d0 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be159a700 1 -- 172.21.15.142:0/2374252758 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8011b30 con 0x7f9be40b00d0 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 -- 172.21.15.142:0/2374252758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 msgr2=0x7f9be406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 --2- 172.21.15.142:0/2374252758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406e110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80098e0 tx=0x7f9bd80091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 -- 172.21.15.142:0/2374252758 shutdown_connections 2023-09-30T22:53:42.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 --2- 172.21.15.142:0/2374252758 >> v2:172.21.15.148:3300/0 conn(0x7f9be40af020 0x7f9be4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 --2- 172.21.15.142:0/2374252758 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406e110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 -- 172.21.15.142:0/2374252758 >> 172.21.15.142:0/2374252758 conn(0x7f9be40680c0 msgr2=0x7f9be40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:42.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 -- 172.21.15.142:0/2374252758 shutdown_connections 2023-09-30T22:53:42.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.695+0000 7f9be89ff700 1 -- 172.21.15.142:0/2374252758 wait complete. 2023-09-30T22:53:42.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.697+0000 7f9be89ff700 1 Processor -- start 2023-09-30T22:53:42.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.697+0000 7f9be89ff700 1 -- start start 2023-09-30T22:53:42.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be89ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be406e650 0x7f9be413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:42.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be89ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be40af020 0x7f9be406a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:42.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be89ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be89ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4140370 con 0x7f9be40af020 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be89ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4141190 con 0x7f9be406e650 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be89ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4140580 con 0x7f9be40b00d0 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be40af020 0x7f9be406a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be40af020 0x7f9be406a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54596/0 (socket says 172.21.15.142:54596) 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be1d9b700 1 -- 172.21.15.142:0/1963273127 learned_addr learned my addr 172.21.15.142:0/1963273127 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be259c700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be406e650 0x7f9be413fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be2d9d700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.698+0000 7f9be1d9b700 1 -- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 msgr2=0x7f9be406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be1d9b700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be1d9b700 1 -- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be406e650 msgr2=0x7f9be413fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:42.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be1d9b700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be406e650 0x7f9be413fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be1d9b700 1 -- 172.21.15.142:0/1963273127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd4009420 con 0x7f9be40af020 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be259c700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be406e650 0x7f9be413fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be2d9d700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be1d9b700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be40af020 0x7f9be406a400 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9be406ddc0 tx=0x7f9bd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9bd27fc700 1 -- 172.21.15.142:0/1963273127 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd801f070 con 0x7f9be40af020 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9bd27fc700 1 -- 172.21.15.142:0/1963273127 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd8000bc0 con 0x7f9be40af020 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9bd27fc700 1 -- 172.21.15.142:0/1963273127 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8011b30 con 0x7f9be40af020 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd8009420 con 0x7f9be40af020 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.699+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be4140b40 con 0x7f9be40af020 2023-09-30T22:53:42.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.700+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be4141320 con 0x7f9be40af020 2023-09-30T22:53:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.701+0000 7f9bd27fc700 1 -- 172.21.15.142:0/1963273127 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9bd8023070 con 0x7f9be40af020 2023-09-30T22:53:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.703+0000 7f9bd27fc700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bc4067360 0x7f9bc4069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.703+0000 7f9bd27fc700 1 -- 172.21.15.142:0/1963273127 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9bd8085e90 con 0x7f9be40af020 2023-09-30T22:53:42.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.703+0000 7f9be259c700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bc4067360 0x7f9bc4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:42.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.704+0000 7f9be259c700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bc4067360 0x7f9bc4069810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40093f0 tx=0x7f9bd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:42.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.707+0000 7f9bd27fc700 1 -- 172.21.15.142:0/1963273127 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9bd8052da0 con 0x7f9be40af020 2023-09-30T22:53:42.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.940+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9be406fc10 con 0x7f9be40af020 2023-09-30T22:53:42.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.940+0000 7f9bd27fc700 1 -- 172.21.15.142:0/1963273127 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f9bd8087020 con 0x7f9be40af020 2023-09-30T22:53:42.941 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:42.941 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bc4067360 msgr2=0x7f9bc4069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bc4067360 0x7f9bc4069810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40093f0 tx=0x7f9bd4008040 comp rx=0 tx=0).stop 2023-09-30T22:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be40af020 msgr2=0x7f9be406a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be40af020 0x7f9be406a400 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9be406ddc0 tx=0x7f9bd8017000 comp rx=0 tx=0).stop 2023-09-30T22:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 shutdown_connections 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bc4067360 0x7f9bc4069810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9be40b00d0 0x7f9be406a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be406e650 0x7f9be413fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 --2- 172.21.15.142:0/1963273127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be40af020 0x7f9be406a400 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 >> 172.21.15.142:0/1963273127 conn(0x7f9be40680c0 msgr2=0x7f9be40ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 shutdown_connections 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:42.943+0000 7f9be89ff700 1 -- 172.21.15.142:0/1963273127 wait complete. 2023-09-30T22:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:42.961 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-30T22:53:43.174 INFO:teuthology.orchestra.run.smithi148.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":4983,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.636384249000001,"mdsmap_epoch":15,"osdmap_epoch":35,"osdmap_epoch_barrier":35,"uptime":24.439505431000001} 2023-09-30T22:53:43.174 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 4983, "mdsmap_epoch": 15, "osdmap_epoch": 35, "osdmap_epoch_barrier": 35, "rank_uptime": 14.636384249, "state": "up:active", "uptime": 24.439505431, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:53:43.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-09-30T22:53:43.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.363+0000 7f11f3fff700 1 Processor -- start 2023-09-30T22:53:43.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.363+0000 7f11f3fff700 1 -- start start 2023-09-30T22:53:43.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11ec0b00d0 0x7f11ec06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:43.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f3fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ec06d3e0 con 0x7f11ec0af020 2023-09-30T22:53:43.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f3fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ec06dc80 con 0x7f11ec06e650 2023-09-30T22:53:43.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f3fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec06b790 con 0x7f11ec0b00d0 2023-09-30T22:53:43.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f159a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11ec0b00d0 0x7f11ec06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:43.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f159a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11ec0b00d0 0x7f11ec06e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54606/0 (socket says 172.21.15.142:54606) 2023-09-30T22:53:43.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f159a700 1 -- 172.21.15.142:0/4163958999 learned_addr learned my addr 172.21.15.142:0/4163958999 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:43.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f1d9b700 1 --1- 172.21.15.142:0/4163958999 >> v1:172.21.15.142:6789/0 conn(0x7f11ec0af020 0x7f11ec156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50088/0 (socket says 172.21.15.142:50088) 2023-09-30T22:53:43.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f159a700 1 -- 172.21.15.142:0/4163958999 >> v1:172.21.15.148:6789/0 conn(0x7f11ec06e650 legacy=0x7f11ec15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:43.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f159a700 1 -- 172.21.15.142:0/4163958999 >> v1:172.21.15.142:6789/0 conn(0x7f11ec0af020 legacy=0x7f11ec156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:43.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.365+0000 7f11f159a700 1 -- 172.21.15.142:0/4163958999 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec0b0650 con 0x7f11ec0b00d0 2023-09-30T22:53:43.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.366+0000 7f11f159a700 1 --2- 172.21.15.142:0/4163958999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec0b00d0 0x7f11ec06e110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0099e0 tx=0x7f11dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d675735397fa7d1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.366+0000 7f11f0d99700 1 -- 172.21.15.142:0/4163958999 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00b820 con 0x7f11ec0b00d0 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.366+0000 7f11f0d99700 1 -- 172.21.15.142:0/4163958999 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc00b980 con 0x7f11ec0b00d0 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.366+0000 7f11f0d99700 1 -- 172.21.15.142:0/4163958999 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00bd20 con 0x7f11ec0b00d0 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.366+0000 7f11f3fff700 1 -- 172.21.15.142:0/4163958999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec0b00d0 msgr2=0x7f11ec06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.366+0000 7f11f3fff700 1 --2- 172.21.15.142:0/4163958999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec0b00d0 0x7f11ec06e110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0099e0 tx=0x7f11dc009250 comp rx=0 tx=0).stop 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.367+0000 7f11f3fff700 1 -- 172.21.15.142:0/4163958999 shutdown_connections 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.367+0000 7f11f3fff700 1 --2- 172.21.15.142:0/4163958999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec0b00d0 0x7f11ec06e110 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.367+0000 7f11f3fff700 1 -- 172.21.15.142:0/4163958999 >> 172.21.15.142:0/4163958999 conn(0x7f11ec0680c0 msgr2=0x7f11ec0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.367+0000 7f11f3fff700 1 -- 172.21.15.142:0/4163958999 shutdown_connections 2023-09-30T22:53:43.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.367+0000 7f11f3fff700 1 -- 172.21.15.142:0/4163958999 wait complete. 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.368+0000 7f11f3fff700 1 Processor -- start 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.368+0000 7f11f3fff700 1 -- start start 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec06e650 0x7f11ec140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ec0af020 0x7f11ec1457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f3fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ec0b00d0 0x7f11ec14ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f3fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec146290 con 0x7f11ec06e650 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f3fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec146570 con 0x7f11ec0af020 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f3fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec146850 con 0x7f11ec0b00d0 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec06e650 0x7f11ec140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec06e650 0x7f11ec140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54622/0 (socket says 172.21.15.142:54622) 2023-09-30T22:53:43.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f1d9b700 1 -- 172.21.15.142:0/3821419404 learned_addr learned my addr 172.21.15.142:0/3821419404 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f159a700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ec0af020 0x7f11ec1457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.369+0000 7f11f259c700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ec0b00d0 0x7f11ec14ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f1d9b700 1 -- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ec0b00d0 msgr2=0x7f11ec14ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f1d9b700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ec0b00d0 0x7f11ec14ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f1d9b700 1 -- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ec0af020 msgr2=0x7f11ec1457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f1d9b700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ec0af020 0x7f11ec1457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f1d9b700 1 -- 172.21.15.142:0/3821419404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0094f0 con 0x7f11ec06e650 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f1d9b700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec06e650 0x7f11ec140ee0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c7c0 tx=0x7f11e8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11e1ffb700 1 -- 172.21.15.142:0/3821419404 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8005a70 con 0x7f11ec06e650 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11e1ffb700 1 -- 172.21.15.142:0/3821419404 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8005bd0 con 0x7f11ec06e650 2023-09-30T22:53:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11e1ffb700 1 -- 172.21.15.142:0/3821419404 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80070d0 con 0x7f11ec06e650 2023-09-30T22:53:43.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec146b30 con 0x7f11ec06e650 2023-09-30T22:53:43.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.370+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec141420 con 0x7f11ec06e650 2023-09-30T22:53:43.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.371+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec0695b0 con 0x7f11ec06e650 2023-09-30T22:53:43.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.372+0000 7f11e1ffb700 1 -- 172.21.15.142:0/3821419404 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f11e8007480 con 0x7f11ec06e650 2023-09-30T22:53:43.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.373+0000 7f11e1ffb700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11d0067330 0x7f11d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:43.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.373+0000 7f11e1ffb700 1 -- 172.21.15.142:0/3821419404 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11e8084080 con 0x7f11ec06e650 2023-09-30T22:53:43.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.373+0000 7f11f159a700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11d0067330 0x7f11d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:43.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.374+0000 7f11f159a700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11d0067330 0x7f11d00697e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0099e0 tx=0x7f11dc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:43.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.377+0000 7f11e1ffb700 1 -- 172.21.15.142:0/3821419404 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f11e8050ee0 con 0x7f11ec06e650 2023-09-30T22:53:43.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.647+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f11ec06fc10 con 0x7f11ec06e650 2023-09-30T22:53:43.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.648+0000 7f11e1ffb700 1 -- 172.21.15.142:0/3821419404 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1921 (secure 0 0 0) 0x7f11e8017090 con 0x7f11ec06e650 2023-09-30T22:53:43.648 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:43.648 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:53:43.648 INFO:teuthology.orchestra.run.smithi142.stdout: "stats": { 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "total_bytes": 1600000000, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "total_avail_bytes": 1597520008, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "total_used_bytes": 2479992, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "total_used_raw_bytes": 2479992, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "total_used_raw_ratio": 0.0015499950386583805, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "num_osds": 8, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "num_per_pool_osds": 0, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "num_per_pool_omap_osds": 0 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "stats_by_class": { 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "hdd": { 2023-09-30T22:53:43.649 INFO:teuthology.orchestra.run.smithi142.stdout: "total_bytes": 1600000000, 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "total_avail_bytes": 1597520008, 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "total_used_bytes": 2479992, 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "total_used_raw_bytes": 2479992, 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "total_used_raw_ratio": 0.0015499950386583805 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "name": ".mgr", 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 1, 2023-09-30T22:53:43.650 INFO:teuthology.orchestra.run.smithi142.stdout: "stats": { 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "stored": 590368, 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "objects": 2, 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "kb_used": 577, 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "bytes_used": 590368, 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "percent_used": 0.0005296840681694448, 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "max_avail": 556987968 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd", 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 2, 2023-09-30T22:53:43.651 INFO:teuthology.orchestra.run.smithi142.stdout: "stats": { 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "stored": 0, 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "objects": 0, 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "kb_used": 0, 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "bytes_used": 0, 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "percent_used": 0, 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "max_avail": 556987968 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cephfs_metadata", 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 5, 2023-09-30T22:53:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: "stats": { 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "stored": 2564, 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "objects": 22, 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "kb_used": 3, 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "bytes_used": 2564, 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "percent_used": 2.3016602881398285e-06, 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "max_avail": 556987968 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cephfs_data", 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 6, 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "stats": { 2023-09-30T22:53:43.653 INFO:teuthology.orchestra.run.smithi142.stdout: "stored": 0, 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: "objects": 0, 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: "kb_used": 0, 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: "bytes_used": 0, 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: "percent_used": 0, 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: "max_avail": 556987968 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:53:43.654 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:53:43.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11d0067330 msgr2=0x7f11d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:43.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11d0067330 0x7f11d00697e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0099e0 tx=0x7f11dc017000 comp rx=0 tx=0).stop 2023-09-30T22:53:43.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec06e650 msgr2=0x7f11ec140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:43.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec06e650 0x7f11ec140ee0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c7c0 tx=0x7f11e8007f70 comp rx=0 tx=0).stop 2023-09-30T22:53:43.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 shutdown_connections 2023-09-30T22:53:43.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11d0067330 0x7f11d00697e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:43.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11ec0b00d0 0x7f11ec14ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:43.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11ec06e650 0x7f11ec140ee0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:43.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 --2- 172.21.15.142:0/3821419404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11ec0af020 0x7f11ec1457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:43.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 >> 172.21.15.142:0/3821419404 conn(0x7f11ec0680c0 msgr2=0x7f11ec0cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:43.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 shutdown_connections 2023-09-30T22:53:43.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:43.650+0000 7f11f3fff700 1 -- 172.21.15.142:0/3821419404 wait complete. 2023-09-30T22:53:43.668 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:53:43.668 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:53:43.668 DEBUG:teuthology.orchestra.run.smithi142:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-30T22:53:43.668 DEBUG:teuthology.orchestra.run.smithi142:> os.fchmod(fd, 0O666) 2023-09-30T22:53:43.668 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(fd) 2023-09-30T22:53:43.668 DEBUG:teuthology.orchestra.run.smithi142:> os.close(fd) 2023-09-30T22:53:43.668 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:53:43.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:43.966 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:53:44.107 INFO:teuthology.orchestra.run.smithi142.stdout:client4841 2023-09-30T22:53:44.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:44.108 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client4841/osdmap') 2023-09-30T22:53:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 barrier 35 flags 0x588000 2023-09-30T22:53:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:53:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:53:44.217 INFO:teuthology.orchestra.run.smithi142.stderr:904 bytes copied, 9.7894e-05 s, 9.2 MB/s 2023-09-30T22:53:44.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-09-30T22:53:44.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.409+0000 7fdbaabff700 1 Processor -- start 2023-09-30T22:53:44.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.409+0000 7fdbaabff700 1 -- start start 2023-09-30T22:53:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdbaabff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdba40af020 0x7fdba4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdbaabff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdba40b00d0 0x7fdba406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdbaabff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba406d3e0 con 0x7fdba406e650 2023-09-30T22:53:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdbaabff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba415b400 con 0x7fdba40b00d0 2023-09-30T22:53:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdbaabff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba406dc80 con 0x7fdba40af020 2023-09-30T22:53:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdba40b00d0 0x7fdba406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdba40b00d0 0x7fdba406e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54632/0 (socket says 172.21.15.142:54632) 2023-09-30T22:53:44.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba3fff700 1 -- 172.21.15.142:0/1644071605 learned_addr learned my addr 172.21.15.142:0/1644071605 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba899b700 1 --2- 172.21.15.142:0/1644071605 >> v2:172.21.15.148:3300/0 conn(0x7fdba40af020 0x7fdba4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba3fff700 1 -- 172.21.15.142:0/1644071605 >> v2:172.21.15.148:3300/0 conn(0x7fdba40af020 msgr2=0x7fdba4156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:44.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba3fff700 1 --2- 172.21.15.142:0/1644071605 >> v2:172.21.15.148:3300/0 conn(0x7fdba40af020 0x7fdba4156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba3fff700 1 -- 172.21.15.142:0/1644071605 >> v1:172.21.15.148:6789/0 conn(0x7fdba406e650 legacy=0x7fdba40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.411+0000 7fdba3fff700 1 -- 172.21.15.142:0/1644071605 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba406b790 con 0x7fdba40b00d0 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.412+0000 7fdba3fff700 1 --2- 172.21.15.142:0/1644071605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40b00d0 0x7fdba406e110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdb900099b0 tx=0x7fdb90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4ad9dd5120c72e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.412+0000 7fdba37fe700 1 -- 172.21.15.142:0/1644071605 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000b7e0 con 0x7fdba40b00d0 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.412+0000 7fdba37fe700 1 -- 172.21.15.142:0/1644071605 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9000b940 con 0x7fdba40b00d0 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.412+0000 7fdba37fe700 1 -- 172.21.15.142:0/1644071605 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000bce0 con 0x7fdba40b00d0 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.412+0000 7fdbaabff700 1 -- 172.21.15.142:0/1644071605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40b00d0 msgr2=0x7fdba406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.412+0000 7fdbaabff700 1 --2- 172.21.15.142:0/1644071605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40b00d0 0x7fdba406e110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdb900099b0 tx=0x7fdb90009250 comp rx=0 tx=0).stop 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.413+0000 7fdbaabff700 1 -- 172.21.15.142:0/1644071605 shutdown_connections 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.413+0000 7fdbaabff700 1 --2- 172.21.15.142:0/1644071605 >> v2:172.21.15.148:3300/0 conn(0x7fdba40af020 0x7fdba4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.413+0000 7fdbaabff700 1 --2- 172.21.15.142:0/1644071605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40b00d0 0x7fdba406e110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.413+0000 7fdbaabff700 1 -- 172.21.15.142:0/1644071605 >> 172.21.15.142:0/1644071605 conn(0x7fdba40680c0 msgr2=0x7fdba40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.413+0000 7fdbaabff700 1 -- 172.21.15.142:0/1644071605 shutdown_connections 2023-09-30T22:53:44.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.413+0000 7fdbaabff700 1 -- 172.21.15.142:0/1644071605 wait complete. 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.414+0000 7fdbaabff700 1 Processor -- start 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.414+0000 7fdbaabff700 1 -- start start 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdbaabff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdba406e650 0x7fdba40a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdbaabff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40af020 0x7fdba416a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdbaabff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdba40b00d0 0x7fdba4152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdbaabff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c4e30 con 0x7fdba40af020 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdbaabff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c5110 con 0x7fdba40b00d0 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdbaabff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c53f0 con 0x7fdba406e650 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdba3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40af020 0x7fdba416a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:44.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdba3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40af020 0x7fdba416a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54646/0 (socket says 172.21.15.142:54646) 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.415+0000 7fdba3fff700 1 -- 172.21.15.142:0/2687956288 learned_addr learned my addr 172.21.15.142:0/2687956288 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba899b700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdba406e650 0x7fdba40a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba919c700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdba40b00d0 0x7fdba4152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba3fff700 1 -- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdba406e650 msgr2=0x7fdba40a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba3fff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdba406e650 0x7fdba40a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba3fff700 1 -- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdba40b00d0 msgr2=0x7fdba4152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba3fff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdba40b00d0 0x7fdba4152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba3fff700 1 -- 172.21.15.142:0/2687956288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb900094f0 con 0x7fdba40af020 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba919c700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdba40b00d0 0x7fdba4152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba3fff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40af020 0x7fdba416a370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009290 tx=0x7fdb90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba0ff9700 1 -- 172.21.15.142:0/2687956288 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90006bc0 con 0x7fdba40af020 2023-09-30T22:53:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba0ff9700 1 -- 172.21.15.142:0/2687956288 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90020070 con 0x7fdba40af020 2023-09-30T22:53:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba40c56d0 con 0x7fdba40af020 2023-09-30T22:53:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.416+0000 7fdba0ff9700 1 -- 172.21.15.142:0/2687956288 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9001b450 con 0x7fdba40af020 2023-09-30T22:53:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.417+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba40a6880 con 0x7fdba40af020 2023-09-30T22:53:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.417+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba40c5250 con 0x7fdba40af020 2023-09-30T22:53:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.418+0000 7fdba0ff9700 1 -- 172.21.15.142:0/2687956288 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdb90022030 con 0x7fdba40af020 2023-09-30T22:53:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.419+0000 7fdba0ff9700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb88067330 0x7fdb880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.419+0000 7fdba0ff9700 1 -- 172.21.15.142:0/2687956288 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb90086a30 con 0x7fdba40af020 2023-09-30T22:53:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.419+0000 7fdba899b700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb88067330 0x7fdb880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.420+0000 7fdba899b700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb88067330 0x7fdb880697e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb98006fd0 tx=0x7fdb98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.424+0000 7fdba0ff9700 1 -- 172.21.15.142:0/2687956288 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdba40c5250 con 0x7fdba40af020 2023-09-30T22:53:44.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:44.631+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7fdba40c5250 con 0x7fdba40af020 2023-09-30T22:53:45.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.290+0000 7fdba0ff9700 1 -- 172.21.15.142:0/2687956288 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v36) v1 ==== 93+0+0 (secure 0 0 0) 0x7fdba40c5250 con 0x7fdba40af020 2023-09-30T22:53:45.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb88067330 msgr2=0x7fdb880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:45.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb88067330 0x7fdb880697e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb98006fd0 tx=0x7fdb98008040 comp rx=0 tx=0).stop 2023-09-30T22:53:45.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40af020 msgr2=0x7fdba416a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:45.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40af020 0x7fdba416a370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009290 tx=0x7fdb90016000 comp rx=0 tx=0).stop 2023-09-30T22:53:45.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 shutdown_connections 2023-09-30T22:53:45.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb88067330 0x7fdb880697e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdba40b00d0 0x7fdba4152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdba406e650 0x7fdba40a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 --2- 172.21.15.142:0/2687956288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba40af020 0x7fdba416a370 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 >> 172.21.15.142:0/2687956288 conn(0x7fdba40680c0 msgr2=0x7fdba40ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 shutdown_connections 2023-09-30T22:53:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.293+0000 7fdbaabff700 1 -- 172.21.15.142:0/2687956288 wait complete. 2023-09-30T22:53:45.294 INFO:teuthology.orchestra.run.smithi142.stderr:pauserd,pausewr is set 2023-09-30T22:53:45.312 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-09-30T22:53:45.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.505+0000 7ff2c61ff700 1 Processor -- start 2023-09-30T22:53:45.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.506+0000 7ff2c61ff700 1 -- start start 2023-09-30T22:53:45.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.507+0000 7ff2c61ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 0x7ff2c0159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.507+0000 7ff2c61ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c006b8d0 con 0x7ff2c00d03d0 2023-09-30T22:53:45.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.507+0000 7ff2c61ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c00cff40 con 0x7ff2c01598e0 2023-09-30T22:53:45.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.507+0000 7ff2c61ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00cf330 con 0x7ff2c00cee50 2023-09-30T22:53:45.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.507+0000 7ff2bffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff2c00d03d0 0x7ff2c015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50092/0 (socket says 172.21.15.142:50092) 2023-09-30T22:53:45.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.507+0000 7ff2bffff700 1 -- 172.21.15.142:0/1143292888 learned_addr learned my addr 172.21.15.142:0/1143292888 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.507+0000 7ff2beffd700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 0x7ff2c0159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798310057 0 0) 0x7ff2c006b8d0 con 0x7ff2c00d03d0 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a8003570 con 0x7ff2c00d03d0 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980152459 0 0) 0x7ff2c00cff40 con 0x7ff2c01598e0 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c006b8d0 con 0x7ff2c01598e0 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2151350258 0 0) 0x7ff2a8003570 con 0x7ff2c00d03d0 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 msgr2=0x7ff2c0159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 0x7ff2c0159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 >> v1:172.21.15.148:6789/0 conn(0x7ff2c01598e0 legacy=0x7ff2c006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:45.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00cf610 con 0x7ff2c00d03d0 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7ff2b80017f0 con 0x7ff2c00d03d0 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 >> v1:172.21.15.142:6789/0 conn(0x7ff2c00d03d0 legacy=0x7ff2c015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 0x7ff2a8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a8004180 0x7ff2a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004d50 0x7ff2a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00cf330 con 0x7ff2a8004180 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a800bba0 con 0x7ff2a8004d50 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a800bd60 con 0x7ff2c00cee50 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2beffd700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a8004180 0x7ff2a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2bf7fe700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 0x7ff2a8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.508+0000 7ff2bffff700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004d50 0x7ff2a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2beffd700 1 -- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 msgr2=0x7ff2a8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2beffd700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c00cee50 0x7ff2a8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2beffd700 1 -- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004d50 msgr2=0x7ff2a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2beffd700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004d50 0x7ff2a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2beffd700 1 -- 172.21.15.142:0/1143292888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8003570 con 0x7ff2a8004180 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2bffff700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004d50 0x7ff2a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2beffd700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a8004180 0x7ff2a8004810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00cf260 tx=0x7ff2b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfe575d5e3dddbc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400e710 con 0x7ff2a8004180 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b400e870 con 0x7ff2a8004180 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.509+0000 7ff2be7fc700 1 -- 172.21.15.142:0/1143292888 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400ec30 con 0x7ff2a8004180 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.510+0000 7ff2c61ff700 1 -- 172.21.15.142:0/1143292888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a8004180 msgr2=0x7ff2a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.510+0000 7ff2c61ff700 1 --2- 172.21.15.142:0/1143292888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a8004180 0x7ff2a8004810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00cf260 tx=0x7ff2b40091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.510+0000 7ff2bffff700 1 -- 172.21.15.142:0/1143292888 reap_dead start 2023-09-30T22:53:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.510+0000 7ff2c61ff700 1 -- 172.21.15.142:0/1143292888 shutdown_connections 2023-09-30T22:53:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.510+0000 7ff2c61ff700 1 -- 172.21.15.142:0/1143292888 >> 172.21.15.142:0/1143292888 conn(0x7ff2c00cd540 msgr2=0x7ff2c00cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.510+0000 7ff2c61ff700 1 -- 172.21.15.142:0/1143292888 shutdown_connections 2023-09-30T22:53:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.510+0000 7ff2c61ff700 1 -- 172.21.15.142:0/1143292888 wait complete. 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.512+0000 7ff2c61ff700 1 Processor -- start 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.512+0000 7ff2c61ff700 1 -- start start 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.513+0000 7ff2c61ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004180 0x7ff2c00c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.513+0000 7ff2c61ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c015a670 0x7ff2c015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.513+0000 7ff2c61ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c016da60 0x7ff2c0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.513+0000 7ff2c61ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c015db10 con 0x7ff2c016da60 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.513+0000 7ff2c61ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00ca290 con 0x7ff2a8004180 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.513+0000 7ff2c61ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c015aae0 con 0x7ff2c015a670 2023-09-30T22:53:45.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c016da60 0x7ff2c0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c016da60 0x7ff2c0156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54662/0 (socket says 172.21.15.142:54662) 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 -- 172.21.15.142:0/3053841001 learned_addr learned my addr 172.21.15.142:0/3053841001 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2beffd700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c015a670 0x7ff2c015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bf7fe700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004180 0x7ff2c00c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 -- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c015a670 msgr2=0x7ff2c015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c015a670 0x7ff2c015dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 -- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004180 msgr2=0x7ff2c00c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004180 0x7ff2c00c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 -- 172.21.15.142:0/3053841001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c015adc0 con 0x7ff2c016da60 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.514+0000 7ff2bffff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c016da60 0x7ff2c0156010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0064ea0 tx=0x7ff2b8001fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.515+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80012e0 con 0x7ff2c016da60 2023-09-30T22:53:45.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.515+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b8007b30 con 0x7ff2c016da60 2023-09-30T22:53:45.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.515+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c015b0a0 con 0x7ff2c016da60 2023-09-30T22:53:45.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.515+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800ed20 con 0x7ff2c016da60 2023-09-30T22:53:45.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.515+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c015e500 con 0x7ff2c016da60 2023-09-30T22:53:45.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.516+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c00ca400 con 0x7ff2c016da60 2023-09-30T22:53:45.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.517+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff2b8013630 con 0x7ff2c016da60 2023-09-30T22:53:45.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.518+0000 7ff2a77fe700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2ac067330 0x7ff2ac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:45.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.518+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff2b8084ff0 con 0x7ff2c016da60 2023-09-30T22:53:45.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.518+0000 7ff2bf7fe700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2ac067330 0x7ff2ac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:45.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.518+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=37+}) v3 -- 0x7ff2ac06f4f0 con 0x7ff2c016da60 2023-09-30T22:53:45.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.518+0000 7ff2bf7fe700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2ac067330 0x7ff2ac0697e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0003d00 tx=0x7ff2b0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:45.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.522+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff2b8055900 con 0x7ff2c016da60 2023-09-30T22:53:45.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:45.724+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7ff2c0159500 con 0x7ff2c016da60 2023-09-30T22:53:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.299+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(37..37 src has 1..37) v4 ==== 280+0+0 (secure 0 0 0) 0x7ff2b800ee80 con 0x7ff2c016da60 2023-09-30T22:53:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.299+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7ff2ac06fcd0 con 0x7ff2c016da60 2023-09-30T22:53:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.303+0000 7ff2a77fe700 1 -- 172.21.15.142:0/3053841001 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff2b8055490 con 0x7ff2c016da60 2023-09-30T22:53:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.305+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2ac067330 msgr2=0x7ff2ac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.305+0000 7ff2c61ff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2ac067330 0x7ff2ac0697e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0003d00 tx=0x7ff2b0007d30 comp rx=0 tx=0).stop 2023-09-30T22:53:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.305+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c016da60 msgr2=0x7ff2c0156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.305+0000 7ff2c61ff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c016da60 0x7ff2c0156010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0064ea0 tx=0x7ff2b8001fc0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.305+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 shutdown_connections 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.305+0000 7ff2c61ff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff2ac067330 0x7ff2ac0697e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.305+0000 7ff2c61ff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2c016da60 0x7ff2c0156010 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.306+0000 7ff2c61ff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2a8004180 0x7ff2c00c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.306+0000 7ff2c61ff700 1 --2- 172.21.15.142:0/3053841001 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2c015a670 0x7ff2c015dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.306+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 >> 172.21.15.142:0/3053841001 conn(0x7ff2c00cd540 msgr2=0x7ff2c00b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.306+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 shutdown_connections 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.306+0000 7ff2c61ff700 1 -- 172.21.15.142:0/3053841001 wait complete. 2023-09-30T22:53:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:pauserd,pausewr is unset 2023-09-30T22:53:46.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:46.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.514+0000 7fbb769ff700 1 Processor -- start 2023-09-30T22:53:46.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.514+0000 7fbb769ff700 1 -- start start 2023-09-30T22:53:46.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb769ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cbfe0 0x7fbb7015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:46.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb769ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb700d0550 con 0x7fbb70157ab0 2023-09-30T22:53:46.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb769ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb700cf940 con 0x7fbb700cc3b0 2023-09-30T22:53:46.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb769ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb700cfc20 con 0x7fbb700cbfe0 2023-09-30T22:53:46.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb74f9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbb70157ab0 0x7fbb7006a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50108/0 (socket says 172.21.15.142:50108) 2023-09-30T22:53:46.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb74f9c700 1 -- 172.21.15.142:0/1204393208 learned_addr learned my addr 172.21.15.142:0/1204393208 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:46.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb6ffff700 1 --2- 172.21.15.142:0/1204393208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cbfe0 0x7fbb7015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:46.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb6effd700 1 -- 172.21.15.142:0/1204393208 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117195056 0 0) 0x7fbb700d0550 con 0x7fbb70157ab0 2023-09-30T22:53:46.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.516+0000 7fbb6effd700 1 -- 172.21.15.142:0/1204393208 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb58003570 con 0x7fbb70157ab0 2023-09-30T22:53:46.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6effd700 1 -- 172.21.15.142:0/1204393208 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034246601 0 0) 0x7fbb700cf940 con 0x7fbb700cc3b0 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6ffff700 1 -- 172.21.15.142:0/1204393208 >> v1:172.21.15.148:6789/0 conn(0x7fbb700cc3b0 legacy=0x7fbb701573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6ffff700 1 -- 172.21.15.142:0/1204393208 >> v1:172.21.15.142:6789/0 conn(0x7fbb70157ab0 legacy=0x7fbb7006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6ffff700 1 -- 172.21.15.142:0/1204393208 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb700cff00 con 0x7fbb700cbfe0 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6ffff700 1 --2- 172.21.15.142:0/1204393208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cbfe0 0x7fbb7015a2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009940 tx=0x7fbb600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d8b64089e86cba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6effd700 1 -- 172.21.15.142:0/1204393208 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680017f0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6effd700 1 -- 172.21.15.142:0/1204393208 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb60011420 con 0x7fbb700cbfe0 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.517+0000 7fbb6effd700 1 -- 172.21.15.142:0/1204393208 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600117c0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.518+0000 7fbb769ff700 1 -- 172.21.15.142:0/1204393208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cbfe0 msgr2=0x7fbb7015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.518+0000 7fbb769ff700 1 --2- 172.21.15.142:0/1204393208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cbfe0 0x7fbb7015a2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009940 tx=0x7fbb600091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.518+0000 7fbb769ff700 1 -- 172.21.15.142:0/1204393208 shutdown_connections 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.518+0000 7fbb769ff700 1 --2- 172.21.15.142:0/1204393208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cbfe0 0x7fbb7015a2a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.518+0000 7fbb769ff700 1 -- 172.21.15.142:0/1204393208 >> 172.21.15.142:0/1204393208 conn(0x7fbb700d0a80 msgr2=0x7fbb700d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:46.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.518+0000 7fbb769ff700 1 -- 172.21.15.142:0/1204393208 shutdown_connections 2023-09-30T22:53:46.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.518+0000 7fbb769ff700 1 -- 172.21.15.142:0/1204393208 wait complete. 2023-09-30T22:53:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.519+0000 7fbb769ff700 1 Processor -- start 2023-09-30T22:53:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.519+0000 7fbb769ff700 1 -- start start 2023-09-30T22:53:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.520+0000 7fbb769ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb700cbfe0 0x7fbb7014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.520+0000 7fbb769ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cc3b0 0x7fbb700c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.520+0000 7fbb769ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb70157ab0 0x7fbb7015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.520+0000 7fbb769ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7014d9d0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.520+0000 7fbb769ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb701524d0 con 0x7fbb70157ab0 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.520+0000 7fbb769ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb701527b0 con 0x7fbb700cc3b0 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb700cbfe0 0x7fbb7014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb700cbfe0 0x7fbb7014cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54678/0 (socket says 172.21.15.142:54678) 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 -- 172.21.15.142:0/863020334 learned_addr learned my addr 172.21.15.142:0/863020334 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb74f9c700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb70157ab0 0x7fbb7015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6f7fe700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cc3b0 0x7fbb700c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 -- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cc3b0 msgr2=0x7fbb700c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cc3b0 0x7fbb700c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 -- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb70157ab0 msgr2=0x7fbb7015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb70157ab0 0x7fbb7015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 -- 172.21.15.142:0/863020334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60009420 con 0x7fbb700cbfe0 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb74f9c700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb70157ab0 0x7fbb7015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb6ffff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb700cbfe0 0x7fbb7014cb50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbb7006cf30 tx=0x7fbb60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb57fff700 1 -- 172.21.15.142:0/863020334 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60010be0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb57fff700 1 -- 172.21.15.142:0/863020334 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb60010d60 con 0x7fbb700cbfe0 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.521+0000 7fbb57fff700 1 -- 172.21.15.142:0/863020334 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6001d680 con 0x7fbb700cbfe0 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.522+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb70152a90 con 0x7fbb700cbfe0 2023-09-30T22:53:46.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.522+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb700ca450 con 0x7fbb700cbfe0 2023-09-30T22:53:46.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.523+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb70152fb0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.523+0000 7fbb57fff700 1 -- 172.21.15.142:0/863020334 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbb6001da70 con 0x7fbb700cbfe0 2023-09-30T22:53:46.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.525+0000 7fbb57fff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb5c067330 0x7fbb5c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:46.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.525+0000 7fbb57fff700 1 -- 172.21.15.142:0/863020334 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbb600866c0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.525+0000 7fbb6f7fe700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb5c067330 0x7fbb5c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:46.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.525+0000 7fbb6f7fe700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb5c067330 0x7fbb5c0697e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbb700cadd0 tx=0x7fbb64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.529+0000 7fbb57fff700 1 -- 172.21.15.142:0/863020334 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbb70152fb0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.718+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb70152fb0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.719+0000 7fbb57fff700 1 -- 172.21.15.142:0/863020334 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fbb70152fb0 con 0x7fbb700cbfe0 2023-09-30T22:53:46.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:46.720 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":37,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:46.292840+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:53:25.907895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T22:53:26.965039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb5c067330 msgr2=0x7fbb5c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb5c067330 0x7fbb5c0697e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbb700cadd0 tx=0x7fbb64009040 comp rx=0 tx=0).stop 2023-09-30T22:53:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb700cbfe0 msgr2=0x7fbb7014cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb700cbfe0 0x7fbb7014cb50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbb7006cf30 tx=0x7fbb60017000 comp rx=0 tx=0).stop 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 shutdown_connections 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbb5c067330 0x7fbb5c0697e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb70157ab0 0x7fbb7015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb700cbfe0 0x7fbb7014cb50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 --2- 172.21.15.142:0/863020334 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb700cc3b0 0x7fbb700c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 >> 172.21.15.142:0/863020334 conn(0x7fbb700d0a80 msgr2=0x7fbb701556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 shutdown_connections 2023-09-30T22:53:46.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:46.722+0000 7fbb769ff700 1 -- 172.21.15.142:0/863020334 wait complete. 2023-09-30T22:53:46.740 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:53:46.740 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:53:46.740 DEBUG:teuthology.orchestra.run.smithi142:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-30T22:53:46.740 DEBUG:teuthology.orchestra.run.smithi142:> os.fchmod(fd, 0O666) 2023-09-30T22:53:46.740 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(fd) 2023-09-30T22:53:46.740 DEBUG:teuthology.orchestra.run.smithi142:> os.close(fd) 2023-09-30T22:53:46.740 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:53:47.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:47.038 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:53:47.167 INFO:teuthology.orchestra.run.smithi142.stdout:client4841 2023-09-30T22:53:47.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:47.168 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client4841/osdmap') 2023-09-30T22:53:47.276 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 barrier 35 flags 0x588000 2023-09-30T22:53:47.276 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:47.276 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:47.276 INFO:teuthology.orchestra.run.smithi142.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:47.276 INFO:teuthology.orchestra.run.smithi142.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:47.276 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:53:47.277 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:53:47.277 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:53:47.277 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:53:47.277 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:53:47.278 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:53:47.278 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:53:47.278 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:53:47.278 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:53:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:53:47.279 INFO:teuthology.orchestra.run.smithi142.stderr:904 bytes copied, 7.8621e-05 s, 11.5 MB/s 2023-09-30T22:53:47.279 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.468+0000 7fe2855ff700 1 Processor -- start 2023-09-30T22:53:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.469+0000 7fe2855ff700 1 -- start start 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe2855ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe28006d3f0 0x7fe28006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe2855ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2800c6da0 0x7fe28015e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe2855ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28015dde0 con 0x7fe28006b130 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe2855ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28015d7d0 con 0x7fe28006d3f0 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe2855ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2800c7230 con 0x7fe2800c6da0 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe27effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe28006d3f0 0x7fe28006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe27effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe28006d3f0 0x7fe28006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54682/0 (socket says 172.21.15.142:54682) 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.470+0000 7fe27effd700 1 -- 172.21.15.142:0/1394946813 learned_addr learned my addr 172.21.15.142:0/1394946813 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27effd700 1 -- 172.21.15.142:0/1394946813 >> v2:172.21.15.148:3300/0 conn(0x7fe2800c6da0 msgr2=0x7fe28015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27effd700 1 --2- 172.21.15.142:0/1394946813 >> v2:172.21.15.148:3300/0 conn(0x7fe2800c6da0 0x7fe28015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27effd700 1 -- 172.21.15.142:0/1394946813 >> v1:172.21.15.148:6789/0 conn(0x7fe28006b130 legacy=0x7fe280069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27effd700 1 -- 172.21.15.142:0/1394946813 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28015da70 con 0x7fe28006d3f0 2023-09-30T22:53:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27effd700 1 --2- 172.21.15.142:0/1394946813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe28006d3f0 0x7fe28006d7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe2700099b0 tx=0x7fe270009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab7927a09061881 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27dffb700 1 -- 172.21.15.142:0/1394946813 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27000b7e0 con 0x7fe28006d3f0 2023-09-30T22:53:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27dffb700 1 -- 172.21.15.142:0/1394946813 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27000b940 con 0x7fe28006d3f0 2023-09-30T22:53:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.471+0000 7fe27dffb700 1 -- 172.21.15.142:0/1394946813 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27000bce0 con 0x7fe28006d3f0 2023-09-30T22:53:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 -- 172.21.15.142:0/1394946813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe28006d3f0 msgr2=0x7fe28006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 --2- 172.21.15.142:0/1394946813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe28006d3f0 0x7fe28006d7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe2700099b0 tx=0x7fe270009250 comp rx=0 tx=0).stop 2023-09-30T22:53:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 -- 172.21.15.142:0/1394946813 shutdown_connections 2023-09-30T22:53:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 --2- 172.21.15.142:0/1394946813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe28006d3f0 0x7fe28006d7c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 --2- 172.21.15.142:0/1394946813 >> v2:172.21.15.148:3300/0 conn(0x7fe2800c6da0 0x7fe28015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 -- 172.21.15.142:0/1394946813 >> 172.21.15.142:0/1394946813 conn(0x7fe280067e30 msgr2=0x7fe280068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 -- 172.21.15.142:0/1394946813 shutdown_connections 2023-09-30T22:53:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.472+0000 7fe2855ff700 1 -- 172.21.15.142:0/1394946813 wait complete. 2023-09-30T22:53:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.473+0000 7fe2855ff700 1 Processor -- start 2023-09-30T22:53:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.474+0000 7fe2855ff700 1 -- start start 2023-09-30T22:53:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe2855ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe28006b130 0x7fe2800cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe2855ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28006d3f0 0x7fe28016a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe2855ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2800c6da0 0x7fe28016ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe2855ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800cc380 con 0x7fe2800c6da0 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe2855ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800cb770 con 0x7fe28006d3f0 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe2855ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800cba50 con 0x7fe28006b130 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2800c6da0 0x7fe28016ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2800c6da0 0x7fe28016ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54688/0 (socket says 172.21.15.142:54688) 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27f7fe700 1 -- 172.21.15.142:0/3228366415 learned_addr learned my addr 172.21.15.142:0/3228366415 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27effd700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe28006b130 0x7fe2800cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27e7fc700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28006d3f0 0x7fe28016a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27f7fe700 1 -- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe28006b130 msgr2=0x7fe2800cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27f7fe700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe28006b130 0x7fe2800cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27f7fe700 1 -- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28006d3f0 msgr2=0x7fe28016a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.475+0000 7fe27f7fe700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28006d3f0 0x7fe28016a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.476+0000 7fe27f7fe700 1 -- 172.21.15.142:0/3228366415 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2700094f0 con 0x7fe2800c6da0 2023-09-30T22:53:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.476+0000 7fe27f7fe700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2800c6da0 0x7fe28016ab30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe27800bbb0 tx=0x7fe278009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.476+0000 7fe266ffd700 1 -- 172.21.15.142:0/3228366415 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2780092e0 con 0x7fe2800c6da0 2023-09-30T22:53:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.476+0000 7fe266ffd700 1 -- 172.21.15.142:0/3228366415 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800c630 con 0x7fe2800c6da0 2023-09-30T22:53:47.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.476+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2800cbd30 con 0x7fe2800c6da0 2023-09-30T22:53:47.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.476+0000 7fe266ffd700 1 -- 172.21.15.142:0/3228366415 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800c9f0 con 0x7fe2800c6da0 2023-09-30T22:53:47.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.476+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28011b1c0 con 0x7fe2800c6da0 2023-09-30T22:53:47.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.477+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2800cdd40 con 0x7fe2800c6da0 2023-09-30T22:53:47.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.478+0000 7fe266ffd700 1 -- 172.21.15.142:0/3228366415 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe278012070 con 0x7fe2800c6da0 2023-09-30T22:53:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.479+0000 7fe266ffd700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe26c067330 0x7fe26c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.480+0000 7fe266ffd700 1 -- 172.21.15.142:0/3228366415 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2780847b0 con 0x7fe2800c6da0 2023-09-30T22:53:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.480+0000 7fe27effd700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe26c067330 0x7fe26c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.480+0000 7fe27effd700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe26c067330 0x7fe26c0697e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe2700099b0 tx=0x7fe270016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.484+0000 7fe266ffd700 1 -- 172.21.15.142:0/3228366415 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe2800cdd40 con 0x7fe2800c6da0 2023-09-30T22:53:47.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.716+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2800cdd40 con 0x7fe2800c6da0 2023-09-30T22:53:47.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.717+0000 7fe266ffd700 1 -- 172.21.15.142:0/3228366415 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fe2800cdd40 con 0x7fe2800c6da0 2023-09-30T22:53:47.717 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:47.717 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:47.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe26c067330 msgr2=0x7fe26c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe26c067330 0x7fe26c0697e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe2700099b0 tx=0x7fe270016000 comp rx=0 tx=0).stop 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2800c6da0 msgr2=0x7fe28016ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2800c6da0 0x7fe28016ab30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe27800bbb0 tx=0x7fe278009840 comp rx=0 tx=0).stop 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 shutdown_connections 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe26c067330 0x7fe26c0697e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2800c6da0 0x7fe28016ab30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe28006b130 0x7fe2800cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 --2- 172.21.15.142:0/3228366415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28006d3f0 0x7fe28016a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 >> 172.21.15.142:0/3228366415 conn(0x7fe280067e30 msgr2=0x7fe280153be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.719+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 shutdown_connections 2023-09-30T22:53:47.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:47.720+0000 7fe2855ff700 1 -- 172.21.15.142:0/3228366415 wait complete. 2023-09-30T22:53:47.721 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:47.737 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json osdmap barrier 37 2023-09-30T22:53:47.955 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-09-30T22:53:47.956 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:53:47.956 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:53:47.956 DEBUG:teuthology.orchestra.run.smithi142:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-30T22:53:47.956 DEBUG:teuthology.orchestra.run.smithi142:> os.fchmod(fd, 0O666) 2023-09-30T22:53:47.956 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(fd) 2023-09-30T22:53:47.956 DEBUG:teuthology.orchestra.run.smithi142:> os.close(fd) 2023-09-30T22:53:47.956 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:53:48.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:48.254 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:53:48.384 INFO:teuthology.orchestra.run.smithi142.stdout:client4841 2023-09-30T22:53:48.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:48.384 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client4841/osdmap') 2023-09-30T22:53:48.491 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 37 barrier 37 flags 0x588000 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:53:48.492 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:53:48.493 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:53:48.493 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:53:48.493 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:53:48.493 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:53:48.493 INFO:teuthology.orchestra.run.smithi142.stderr:904 bytes copied, 6.1398e-05 s, 14.7 MB/s 2023-09-30T22:53:48.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:48.494 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:53:48.582 INFO:teuthology.orchestra.run.smithi142.stdout:client4841 2023-09-30T22:53:48.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:48.582 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client4841/osdmap') 2023-09-30T22:53:48.690 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 37 barrier 37 flags 0x588000 2023-09-30T22:53:48.690 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:53:48.691 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:53:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:53:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:53:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:904 bytes copied, 6.4711e-05 s, 14.0 MB/s 2023-09-30T22:53:48.693 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:53:48.693 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:53:48.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:53:48.789 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:53:48.895 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:53:48.895 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:53:48.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:48.896 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:53:49.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:53:49.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:49.007 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:53:49.053 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:53:49.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:53:49.054 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T22:53:49.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:53:49.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:53:49.139 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:53:49.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:49.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.377+0000 7f24f2bff700 1 Processor -- start 2023-09-30T22:53:49.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.378+0000 7f24f2bff700 1 -- start start 2023-09-30T22:53:49.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f2bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f2bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24ec06f190 0x7f24ec159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f2bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24ec15a0d0 0x7f24ec156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f2bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ec0aefc0 con 0x7f24ec06f190 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f2bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ec0b0ee0 con 0x7f24ec15a0d0 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f2bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec15a510 con 0x7f24ec0aebf0 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24ebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24ec06f190 0x7f24ec159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24ebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24ec06f190 0x7f24ec159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54694/0 (socket says 172.21.15.142:54694) 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24ebfff700 1 -- 172.21.15.142:0/1154293779 learned_addr learned my addr 172.21.15.142:0/1154293779 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f119c700 1 --2- 172.21.15.142:0/1154293779 >> v2:172.21.15.148:3300/0 conn(0x7f24ec15a0d0 0x7f24ec156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.379+0000 7f24f099b700 1 --2- 172.21.15.142:0/1154293779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24ebfff700 1 -- 172.21.15.142:0/1154293779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 msgr2=0x7f24ec06ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:49.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24ebfff700 1 --2- 172.21.15.142:0/1154293779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec06ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24ebfff700 1 -- 172.21.15.142:0/1154293779 >> v2:172.21.15.148:3300/0 conn(0x7f24ec15a0d0 msgr2=0x7f24ec156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:49.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24ebfff700 1 --2- 172.21.15.142:0/1154293779 >> v2:172.21.15.148:3300/0 conn(0x7f24ec15a0d0 0x7f24ec156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24ebfff700 1 -- 172.21.15.142:0/1154293779 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0b02d0 con 0x7f24ec06f190 2023-09-30T22:53:49.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24ebfff700 1 --2- 172.21.15.142:0/1154293779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0cc650 tx=0x7f24d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdeca0c37cd3ca5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:49.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24eb7fe700 1 -- 172.21.15.142:0/1154293779 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800b640 con 0x7f24ec06f190 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24eb7fe700 1 -- 172.21.15.142:0/1154293779 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800b7a0 con 0x7f24ec06f190 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.380+0000 7f24eb7fe700 1 -- 172.21.15.142:0/1154293779 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800bb40 con 0x7f24ec06f190 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 -- 172.21.15.142:0/1154293779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 msgr2=0x7f24ec159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 --2- 172.21.15.142:0/1154293779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0cc650 tx=0x7f24d8009250 comp rx=0 tx=0).stop 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 -- 172.21.15.142:0/1154293779 shutdown_connections 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 --2- 172.21.15.142:0/1154293779 >> v2:172.21.15.148:3300/0 conn(0x7f24ec15a0d0 0x7f24ec156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 --2- 172.21.15.142:0/1154293779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec06ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 --2- 172.21.15.142:0/1154293779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159b90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 -- 172.21.15.142:0/1154293779 >> 172.21.15.142:0/1154293779 conn(0x7f24ec0680c0 msgr2=0x7f24ec0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:49.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 -- 172.21.15.142:0/1154293779 shutdown_connections 2023-09-30T22:53:49.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.381+0000 7f24f2bff700 1 -- 172.21.15.142:0/1154293779 wait complete. 2023-09-30T22:53:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.383+0000 7f24f2bff700 1 Processor -- start 2023-09-30T22:53:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.383+0000 7f24f2bff700 1 -- start start 2023-09-30T22:53:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.384+0000 7f24f2bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.384+0000 7f24f2bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.384+0000 7f24f2bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ec15a0d0 0x7f24ec15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.384+0000 7f24f2bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec1575d0 con 0x7f24ec06f190 2023-09-30T22:53:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.384+0000 7f24f2bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec149990 con 0x7f24ec15a0d0 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.384+0000 7f24f2bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec149be0 con 0x7f24ec0aebf0 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.384+0000 7f24f099b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54696/0 (socket says 172.21.15.142:54696) 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 -- 172.21.15.142:0/3443016652 learned_addr learned my addr 172.21.15.142:0/3443016652 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f119c700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ec15a0d0 0x7f24ec15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24ebfff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 -- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 msgr2=0x7f24ec148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 -- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ec15a0d0 msgr2=0x7f24ec15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ec15a0d0 0x7f24ec15eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 -- 172.21.15.142:0/3443016652 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d80094f0 con 0x7f24ec06f190 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24ebfff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f099b700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159210 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f24e000ec80 tx=0x7f24e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24e8ff9700 1 -- 172.21.15.142:0/3443016652 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e000c850 con 0x7f24ec06f190 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24e8ff9700 1 -- 172.21.15.142:0/3443016652 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e000c9b0 con 0x7f24ec06f190 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ec149ec0 con 0x7f24ec06f190 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.385+0000 7f24e8ff9700 1 -- 172.21.15.142:0/3443016652 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e000cd50 con 0x7f24ec06f190 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.386+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec14b500 con 0x7f24ec06f190 2023-09-30T22:53:49.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.387+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ec14ba40 con 0x7f24ec06f190 2023-09-30T22:53:49.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.387+0000 7f24e8ff9700 1 -- 172.21.15.142:0/3443016652 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f24e0013680 con 0x7f24ec06f190 2023-09-30T22:53:49.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.389+0000 7f24e8ff9700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f24d0067330 0x7f24d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.389+0000 7f24e8ff9700 1 -- 172.21.15.142:0/3443016652 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f24e0084f20 con 0x7f24ec06f190 2023-09-30T22:53:49.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.389+0000 7f24ebfff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f24d0067330 0x7f24d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.389+0000 7f24ebfff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f24d0067330 0x7f24d00697e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0cc650 tx=0x7f24d8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:49.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.393+0000 7f24e8ff9700 1 -- 172.21.15.142:0/3443016652 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f24e0051d80 con 0x7f24ec06f190 2023-09-30T22:53:49.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.626+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24ec14bbf0 con 0x7f24ec06f190 2023-09-30T22:53:49.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.626+0000 7f24e8ff9700 1 -- 172.21.15.142:0/3443016652 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f24e0017090 con 0x7f24ec06f190 2023-09-30T22:53:49.628 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:49.628 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:49.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f24d0067330 msgr2=0x7f24d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f24d0067330 0x7f24d00697e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0cc650 tx=0x7f24d8017000 comp rx=0 tx=0).stop 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 msgr2=0x7f24ec159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159210 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f24e000ec80 tx=0x7f24e00091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 shutdown_connections 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f24d0067330 0x7f24d00697e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ec15a0d0 0x7f24ec15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24ec06f190 0x7f24ec159210 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 --2- 172.21.15.142:0/3443016652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24ec0aebf0 0x7f24ec148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 >> 172.21.15.142:0/3443016652 conn(0x7f24ec0680c0 msgr2=0x7f24ec154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:49.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 shutdown_connections 2023-09-30T22:53:49.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.629+0000 7f24f2bff700 1 -- 172.21.15.142:0/3443016652 wait complete. 2023-09-30T22:53:49.632 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:49.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:49.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.835+0000 7f92817ff700 1 Processor -- start 2023-09-30T22:53:49.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.835+0000 7f92817ff700 1 -- start start 2023-09-30T22:53:49.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f92817ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f927c0af020 0x7f927c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f92817ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f927c0b00d0 0x7f927c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f92817ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c06e650 0x7f927c0b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f92817ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c06d3e0 con 0x7f927c0af020 2023-09-30T22:53:49.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f92817ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c06dc80 con 0x7f927c0b00d0 2023-09-30T22:53:49.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f92817ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c06b790 con 0x7f927c06e650 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f927c0af020 0x7f927c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f927c0af020 0x7f927c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54706/0 (socket says 172.21.15.142:54706) 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 -- 172.21.15.142:0/4268257155 learned_addr learned my addr 172.21.15.142:0/4268257155 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927a7fc700 1 --2- 172.21.15.142:0/4268257155 >> v2:172.21.15.148:3300/0 conn(0x7f927c0b00d0 0x7f927c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927b7fe700 1 --2- 172.21.15.142:0/4268257155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c06e650 0x7f927c0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 -- 172.21.15.142:0/4268257155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c06e650 msgr2=0x7f927c0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 --2- 172.21.15.142:0/4268257155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c06e650 0x7f927c0b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 -- 172.21.15.142:0/4268257155 >> v2:172.21.15.148:3300/0 conn(0x7f927c0b00d0 msgr2=0x7f927c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 --2- 172.21.15.142:0/4268257155 >> v2:172.21.15.148:3300/0 conn(0x7f927c0b00d0 0x7f927c06e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.837+0000 7f927affd700 1 -- 172.21.15.142:0/4268257155 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0b0650 con 0x7f927c0af020 2023-09-30T22:53:49.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.838+0000 7f927affd700 1 --2- 172.21.15.142:0/4268257155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c156d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f927c0c1950 tx=0x7f926c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ecfdb11254a858 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:49.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.838+0000 7f9279ffb700 1 -- 172.21.15.142:0/4268257155 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00b640 con 0x7f927c0af020 2023-09-30T22:53:49.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.838+0000 7f9279ffb700 1 -- 172.21.15.142:0/4268257155 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c00b7a0 con 0x7f927c0af020 2023-09-30T22:53:49.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.838+0000 7f9279ffb700 1 -- 172.21.15.142:0/4268257155 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00bb60 con 0x7f927c0af020 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.838+0000 7f92817ff700 1 -- 172.21.15.142:0/4268257155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 msgr2=0x7f927c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 --2- 172.21.15.142:0/4268257155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c156d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f927c0c1950 tx=0x7f926c009250 comp rx=0 tx=0).stop 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 -- 172.21.15.142:0/4268257155 shutdown_connections 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 --2- 172.21.15.142:0/4268257155 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c06e650 0x7f927c0b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 --2- 172.21.15.142:0/4268257155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c156d80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 --2- 172.21.15.142:0/4268257155 >> v2:172.21.15.148:3300/0 conn(0x7f927c0b00d0 0x7f927c06e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 -- 172.21.15.142:0/4268257155 >> 172.21.15.142:0/4268257155 conn(0x7f927c0680c0 msgr2=0x7f927c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 -- 172.21.15.142:0/4268257155 shutdown_connections 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.839+0000 7f92817ff700 1 -- 172.21.15.142:0/4268257155 wait complete. 2023-09-30T22:53:49.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.840+0000 7f92817ff700 1 Processor -- start 2023-09-30T22:53:49.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.840+0000 7f92817ff700 1 -- start start 2023-09-30T22:53:49.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f92817ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c06e650 0x7f927c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f92817ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f92817ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c0b00d0 0x7f927c169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f92817ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c159170 con 0x7f927c0af020 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f92817ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c158670 con 0x7f927c06e650 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f92817ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c157af0 con 0x7f927c0b00d0 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f927a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f927a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54714/0 (socket says 172.21.15.142:54714) 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f927affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c06e650 0x7f927c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f927a7fc700 1 -- 172.21.15.142:0/3228467516 learned_addr learned my addr 172.21.15.142:0/3228467516 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.841+0000 7f927b7fe700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c0b00d0 0x7f927c169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f927a7fc700 1 -- 172.21.15.142:0/3228467516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c0b00d0 msgr2=0x7f927c169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f927a7fc700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c0b00d0 0x7f927c169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f927a7fc700 1 -- 172.21.15.142:0/3228467516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c06e650 msgr2=0x7f927c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f927a7fc700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c06e650 0x7f927c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f927a7fc700 1 -- 172.21.15.142:0/3228467516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0094f0 con 0x7f927c0af020 2023-09-30T22:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f927a7fc700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c157450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f927000ec80 tx=0x7f92700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f9262ffd700 1 -- 172.21.15.142:0/3228467516 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270009690 con 0x7f927c0af020 2023-09-30T22:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f9262ffd700 1 -- 172.21.15.142:0/3228467516 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000c850 con 0x7f927c0af020 2023-09-30T22:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.842+0000 7f9262ffd700 1 -- 172.21.15.142:0/3228467516 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000cc10 con 0x7f927c0af020 2023-09-30T22:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.843+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c157dd0 con 0x7f927c0af020 2023-09-30T22:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.843+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c158390 con 0x7f927c0af020 2023-09-30T22:53:49.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.844+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c0695b0 con 0x7f927c0af020 2023-09-30T22:53:49.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.844+0000 7f9262ffd700 1 -- 172.21.15.142:0/3228467516 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9270013470 con 0x7f927c0af020 2023-09-30T22:53:49.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.845+0000 7f9262ffd700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9268067330 0x7f92680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:49.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.846+0000 7f9262ffd700 1 -- 172.21.15.142:0/3228467516 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9270084e30 con 0x7f927c0af020 2023-09-30T22:53:49.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.846+0000 7f927affd700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9268067330 0x7f92680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:49.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.846+0000 7f927affd700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9268067330 0x7f92680697e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f927c0c1950 tx=0x7f926c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:49.849+0000 7f9262ffd700 1 -- 172.21.15.142:0/3228467516 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9270051c90 con 0x7f927c0af020 2023-09-30T22:53:50.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.038+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f927c06fc10 con 0x7f927c0af020 2023-09-30T22:53:50.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.039+0000 7f9262ffd700 1 -- 172.21.15.142:0/3228467516 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f92700552b0 con 0x7f927c0af020 2023-09-30T22:53:50.040 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:50.040 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":37,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:46.292840+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:53:25.907895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T22:53:26.965039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9268067330 msgr2=0x7f92680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9268067330 0x7f92680697e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f927c0c1950 tx=0x7f926c017000 comp rx=0 tx=0).stop 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 msgr2=0x7f927c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c157450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f927000ec80 tx=0x7f92700091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 shutdown_connections 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9268067330 0x7f92680697e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f927c0b00d0 0x7f927c169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f927c06e650 0x7f927c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 --2- 172.21.15.142:0/3228467516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f927c0af020 0x7f927c157450 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 >> 172.21.15.142:0/3228467516 conn(0x7f927c0680c0 msgr2=0x7f927c069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:50.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.041+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 shutdown_connections 2023-09-30T22:53:50.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.042+0000 7f92817ff700 1 -- 172.21.15.142:0/3228467516 wait complete. 2023-09-30T22:53:50.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:53:25.907895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:53:26.965039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:53:50.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:53:50.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.251+0000 7ff32cfff700 1 Processor -- start 2023-09-30T22:53:50.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.251+0000 7ff32cfff700 1 -- start start 2023-09-30T22:53:50.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.253+0000 7ff32cfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff328150600 0x7ff32806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.253+0000 7ff32cfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3281509d0 0x7ff32806ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.253+0000 7ff32cfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3281576e0 con 0x7ff32815a920 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.253+0000 7ff32cfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3280cc320 con 0x7ff328150600 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.253+0000 7ff32cfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32815a490 con 0x7ff3281509d0 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff328150600 0x7ff32806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff328150600 0x7ff32806a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54722/0 (socket says 172.21.15.142:54722) 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 -- 172.21.15.142:0/1641077866 learned_addr learned my addr 172.21.15.142:0/1641077866 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff325d9b700 1 --2- 172.21.15.142:0/1641077866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3281509d0 0x7ff32806ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 -- 172.21.15.142:0/1641077866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3281509d0 msgr2=0x7ff32806ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 --2- 172.21.15.142:0/1641077866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3281509d0 0x7ff32806ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 -- 172.21.15.142:0/1641077866 >> v1:172.21.15.148:6789/0 conn(0x7ff32815a920 legacy=0x7ff328156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32559a700 1 -- 172.21.15.142:0/1641077866 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844410288 0 0) 0x7ff3281576e0 con 0x7ff32815a920 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 -- 172.21.15.142:0/1641077866 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328157400 con 0x7ff328150600 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.254+0000 7ff32659c700 1 --2- 172.21.15.142:0/1641077866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff328150600 0x7ff32806a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff3180099b0 tx=0x7ff318009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1156660a396c2d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32559a700 1 -- 172.21.15.142:0/1641077866 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318009ea0 con 0x7ff328150600 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32559a700 1 -- 172.21.15.142:0/1641077866 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800b860 con 0x7ff328150600 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32559a700 1 -- 172.21.15.142:0/1641077866 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800bc00 con 0x7ff328150600 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 -- 172.21.15.142:0/1641077866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff328150600 msgr2=0x7ff32806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 --2- 172.21.15.142:0/1641077866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff328150600 0x7ff32806a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff3180099b0 tx=0x7ff318009250 comp rx=0 tx=0).stop 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 -- 172.21.15.142:0/1641077866 shutdown_connections 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 --2- 172.21.15.142:0/1641077866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff328150600 0x7ff32806a7a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 --2- 172.21.15.142:0/1641077866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3281509d0 0x7ff32806ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 -- 172.21.15.142:0/1641077866 >> 172.21.15.142:0/1641077866 conn(0x7ff3280cc670 msgr2=0x7ff3280cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 -- 172.21.15.142:0/1641077866 shutdown_connections 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.255+0000 7ff32cfff700 1 -- 172.21.15.142:0/1641077866 wait complete. 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.257+0000 7ff32cfff700 1 Processor -- start 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.257+0000 7ff32cfff700 1 -- start start 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff32cfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff328150600 0x7ff328144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff32cfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281509d0 0x7ff328147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff32cfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff32815a920 0x7ff328136c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff32cfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32814d8b0 con 0x7ff32815a920 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff32cfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3281460a0 con 0x7ff3281509d0 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff32cfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3280c5750 con 0x7ff328150600 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff32815a920 0x7ff328136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff32815a920 0x7ff328136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54736/0 (socket says 172.21.15.142:54736) 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 -- 172.21.15.142:0/2266818170 learned_addr learned my addr 172.21.15.142:0/2266818170 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff32659c700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff328150600 0x7ff328144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff325d9b700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281509d0 0x7ff328147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 -- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff328150600 msgr2=0x7ff328144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff328150600 0x7ff328144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 -- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281509d0 msgr2=0x7ff328147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281509d0 0x7ff328147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff326d9d700 1 -- 172.21.15.142:0/2266818170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180094f0 con 0x7ff32815a920 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.258+0000 7ff325d9b700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281509d0 0x7ff328147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.259+0000 7ff326d9d700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff32815a920 0x7ff328136c30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c890 tx=0x7ff320001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:50.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.259+0000 7ff3167fc700 1 -- 172.21.15.142:0/2266818170 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320017070 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.259+0000 7ff3167fc700 1 -- 172.21.15.142:0/2266818170 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff320006ba0 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.259+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3280c5a30 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.259+0000 7ff3167fc700 1 -- 172.21.15.142:0/2266818170 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320012630 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.259+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff328145c10 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.260+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32814da20 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.261+0000 7ff3167fc700 1 -- 172.21.15.142:0/2266818170 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff320012a60 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.262+0000 7ff3167fc700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff308067330 0x7ff3080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.262+0000 7ff3167fc700 1 -- 172.21.15.142:0/2266818170 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff320084ad0 con 0x7ff32815a920 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.262+0000 7ff32659c700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff308067330 0x7ff3080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.263+0000 7ff32659c700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff308067330 0x7ff3080697e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff3180099b0 tx=0x7ff318017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:50.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.266+0000 7ff3167fc700 1 -- 172.21.15.142:0/2266818170 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff320051930 con 0x7ff32815a920 2023-09-30T22:53:50.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.457+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff32806fc10 con 0x7ff32815a920 2023-09-30T22:53:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.458+0000 7ff3167fc700 1 -- 172.21.15.142:0/2266818170 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff320054f50 con 0x7ff32815a920 2023-09-30T22:53:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:53:50.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff308067330 msgr2=0x7ff3080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff308067330 0x7ff3080697e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff3180099b0 tx=0x7ff318017000 comp rx=0 tx=0).stop 2023-09-30T22:53:50.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff32815a920 msgr2=0x7ff328136c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff32815a920 0x7ff328136c30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c890 tx=0x7ff320001670 comp rx=0 tx=0).stop 2023-09-30T22:53:50.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 shutdown_connections 2023-09-30T22:53:50.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff308067330 0x7ff3080697e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff32815a920 0x7ff328136c30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff328150600 0x7ff328144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 --2- 172.21.15.142:0/2266818170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281509d0 0x7ff328147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.460+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 >> 172.21.15.142:0/2266818170 conn(0x7ff3280cc670 msgr2=0x7ff3281591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.461+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 shutdown_connections 2023-09-30T22:53:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.461+0000 7ff32cfff700 1 -- 172.21.15.142:0/2266818170 wait complete. 2023-09-30T22:53:50.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:53:50.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.981+0000 7f94225ff700 1 Processor -- start 2023-09-30T22:53:50.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.981+0000 7f94225ff700 1 -- start start 2023-09-30T22:53:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f94225ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f941c0c52a0 0x7f941c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f94225ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c069f10 0x7f941c0c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f94225ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f941c0c5bb0 0x7f941c0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f94225ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c1406a0 con 0x7f941c0c5bb0 2023-09-30T22:53:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f94225ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0c3a50 con 0x7f941c0c52a0 2023-09-30T22:53:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f94225ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c7690 con 0x7f941c069f10 2023-09-30T22:53:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f941c0c5bb0 0x7f941c0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f941c0c5bb0 0x7f941c0ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52836/0 (socket says 172.21.15.142:52836) 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 -- 172.21.15.142:0/2690550583 learned_addr learned my addr 172.21.15.142:0/2690550583 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f941b7fe700 1 --2- 172.21.15.142:0/2690550583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c069f10 0x7f941c0c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f941bfff700 1 --2- 172.21.15.142:0/2690550583 >> v2:172.21.15.148:3300/0 conn(0x7f941c0c52a0 0x7f941c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 -- 172.21.15.142:0/2690550583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c069f10 msgr2=0x7f941c0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 --2- 172.21.15.142:0/2690550583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c069f10 0x7f941c0c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 -- 172.21.15.142:0/2690550583 >> v2:172.21.15.148:3300/0 conn(0x7f941c0c52a0 msgr2=0x7f941c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 --2- 172.21.15.142:0/2690550583 >> v2:172.21.15.148:3300/0 conn(0x7f941c0c52a0 0x7f941c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.983+0000 7f9420b9c700 1 -- 172.21.15.142:0/2690550583 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0c7f20 con 0x7f941c0c5bb0 2023-09-30T22:53:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.984+0000 7f9420b9c700 1 --2- 172.21.15.142:0/2690550583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c0c5bb0 0x7f941c0ca340 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9414009f50 tx=0x7f9414009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3439805a8582b48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.984+0000 7f941affd700 1 -- 172.21.15.142:0/2690550583 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400e070 con 0x7f941c0c5bb0 2023-09-30T22:53:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.984+0000 7f941affd700 1 -- 172.21.15.142:0/2690550583 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400b8d0 con 0x7f941c0c5bb0 2023-09-30T22:53:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.984+0000 7f941affd700 1 -- 172.21.15.142:0/2690550583 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140092e0 con 0x7f941c0c5bb0 2023-09-30T22:53:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.984+0000 7f94225ff700 1 -- 172.21.15.142:0/2690550583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c0c5bb0 msgr2=0x7f941c0ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.984+0000 7f94225ff700 1 --2- 172.21.15.142:0/2690550583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c0c5bb0 0x7f941c0ca340 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9414009f50 tx=0x7f9414009840 comp rx=0 tx=0).stop 2023-09-30T22:53:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.985+0000 7f94225ff700 1 -- 172.21.15.142:0/2690550583 shutdown_connections 2023-09-30T22:53:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.985+0000 7f94225ff700 1 --2- 172.21.15.142:0/2690550583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c0c5bb0 0x7f941c0ca340 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.985+0000 7f94225ff700 1 --2- 172.21.15.142:0/2690550583 >> v2:172.21.15.148:3300/0 conn(0x7f941c0c52a0 0x7f941c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.985+0000 7f94225ff700 1 --2- 172.21.15.142:0/2690550583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c069f10 0x7f941c0c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.985+0000 7f94225ff700 1 -- 172.21.15.142:0/2690550583 >> 172.21.15.142:0/2690550583 conn(0x7f941c0cc670 msgr2=0x7f941c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.985+0000 7f94225ff700 1 -- 172.21.15.142:0/2690550583 shutdown_connections 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.985+0000 7f94225ff700 1 -- 172.21.15.142:0/2690550583 wait complete. 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.986+0000 7f94225ff700 1 Processor -- start 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.986+0000 7f94225ff700 1 -- start start 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f94225ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c069f10 0x7f941c16adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f94225ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f941c0c52a0 0x7f941c169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f94225ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c0c5bb0 0x7f941c15e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f94225ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c16b500 con 0x7f941c069f10 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f94225ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c16c360 con 0x7f941c0c52a0 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f94225ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c16b2f0 con 0x7f941c0c5bb0 2023-09-30T22:53:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f941bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c069f10 0x7f941c16adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f941bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c069f10 0x7f941c16adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52844/0 (socket says 172.21.15.142:52844) 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.987+0000 7f941bfff700 1 -- 172.21.15.142:0/3899120902 learned_addr learned my addr 172.21.15.142:0/3899120902 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f941b7fe700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f941c0c52a0 0x7f941c169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f9420b9c700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c0c5bb0 0x7f941c15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f941bfff700 1 -- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c0c5bb0 msgr2=0x7f941c15e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f941bfff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c0c5bb0 0x7f941c15e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f941bfff700 1 -- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f941c0c52a0 msgr2=0x7f941c169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f941bfff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f941c0c52a0 0x7f941c169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f941bfff700 1 -- 172.21.15.142:0/3899120902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009ae0 con 0x7f941c069f10 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f941bfff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c069f10 0x7f941c16adb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f940c00ec80 tx=0x7f940c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f9403fff700 1 -- 172.21.15.142:0/3899120902 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c00c850 con 0x7f941c069f10 2023-09-30T22:53:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f9403fff700 1 -- 172.21.15.142:0/3899120902 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c00c9b0 con 0x7f941c069f10 2023-09-30T22:53:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c16b750 con 0x7f941c069f10 2023-09-30T22:53:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.988+0000 7f9403fff700 1 -- 172.21.15.142:0/3899120902 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c00cd50 con 0x7f941c069f10 2023-09-30T22:53:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.989+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c16bd90 con 0x7f941c069f10 2023-09-30T22:53:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.990+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c16c110 con 0x7f941c069f10 2023-09-30T22:53:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.990+0000 7f9403fff700 1 -- 172.21.15.142:0/3899120902 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f940c013680 con 0x7f941c069f10 2023-09-30T22:53:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.991+0000 7f9403fff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9408067330 0x7f94080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.991+0000 7f9403fff700 1 -- 172.21.15.142:0/3899120902 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f940c084f20 con 0x7f941c069f10 2023-09-30T22:53:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.992+0000 7f941b7fe700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9408067330 0x7f94080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.992+0000 7f941b7fe700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9408067330 0x7f94080697e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f941c06a320 tx=0x7f94100091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:50.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:50.995+0000 7f9403fff700 1 -- 172.21.15.142:0/3899120902 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f940c051d80 con 0x7f941c069f10 2023-09-30T22:53:51.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.186+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f941c06fc10 con 0x7f941c069f10 2023-09-30T22:53:51.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.186+0000 7f9403fff700 1 -- 172.21.15.142:0/3899120902 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f940c0170a0 con 0x7f941c069f10 2023-09-30T22:53:51.188 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:53:51.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.188+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9408067330 msgr2=0x7f94080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9408067330 0x7f94080697e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f941c06a320 tx=0x7f94100091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c069f10 msgr2=0x7f941c16adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c069f10 0x7f941c16adb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f940c00ec80 tx=0x7f940c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 shutdown_connections 2023-09-30T22:53:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9408067330 0x7f94080697e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f941c0c5bb0 0x7f941c15e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f941c069f10 0x7f941c16adb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 --2- 172.21.15.142:0/3899120902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f941c0c52a0 0x7f941c169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 >> 172.21.15.142:0/3899120902 conn(0x7f941c0cc670 msgr2=0x7f941c0c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:51.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 shutdown_connections 2023-09-30T22:53:51.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.189+0000 7f94225ff700 1 -- 172.21.15.142:0/3899120902 wait complete. 2023-09-30T22:53:51.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:53:51.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.398+0000 7f7257fff700 1 Processor -- start 2023-09-30T22:53:51.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.399+0000 7f7257fff700 1 -- start start 2023-09-30T22:53:51.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.400+0000 7f7257fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7250157ab0 0x7f725015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.400+0000 7f7257fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500d0550 con 0x7f72500cbfe0 2023-09-30T22:53:51.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.400+0000 7f7257fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500cf940 con 0x7f72500cc3b0 2023-09-30T22:53:51.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.400+0000 7f7257fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500cfc20 con 0x7f7250157ab0 2023-09-30T22:53:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.400+0000 7f7255d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f72500cbfe0 0x7f72501573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52012/0 (socket says 172.21.15.142:52012) 2023-09-30T22:53:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.400+0000 7f7255d9b700 1 -- 172.21.15.142:0/733332397 learned_addr learned my addr 172.21.15.142:0/733332397 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:51.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.400+0000 7f725559a700 1 --2- 172.21.15.142:0/733332397 >> v2:172.21.15.148:3300/0 conn(0x7f7250157ab0 0x7f725015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064390674 0 0) 0x7f72500d0550 con 0x7f72500cbfe0 2023-09-30T22:53:51.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f723c003570 con 0x7f72500cbfe0 2023-09-30T22:53:51.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583854680 0 0) 0x7f72500cf940 con 0x7f72500cc3b0 2023-09-30T22:53:51.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72500d0550 con 0x7f72500cc3b0 2023-09-30T22:53:51.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327445258 0 0) 0x7f723c003570 con 0x7f72500cbfe0 2023-09-30T22:53:51.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 >> v2:172.21.15.148:3300/0 conn(0x7f7250157ab0 msgr2=0x7f725015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 --2- 172.21.15.142:0/733332397 >> v2:172.21.15.148:3300/0 conn(0x7f7250157ab0 0x7f725015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 >> v1:172.21.15.148:6789/0 conn(0x7f72500cc3b0 legacy=0x7f725006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500cff00 con 0x7f72500cbfe0 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f724c001470 con 0x7f72500cbfe0 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 >> v1:172.21.15.142:6789/0 conn(0x7f72500cbfe0 legacy=0x7f72501573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f723c003bf0 0x7f723c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c004810 0x7f723c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f723c0051c0 0x7f723c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500cfc20 con 0x7f723c0051c0 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c00c160 con 0x7f723c003bf0 2023-09-30T22:53:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c00c320 con 0x7f723c004810 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.401+0000 7f725659c700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f723c0051c0 0x7f723c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f7255d9b700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f723c003bf0 0x7f723c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725559a700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c004810 0x7f723c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725659c700 1 -- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c004810 msgr2=0x7f723c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725659c700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c004810 0x7f723c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725659c700 1 -- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f723c003bf0 msgr2=0x7f723c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725659c700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f723c003bf0 0x7f723c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725659c700 1 -- 172.21.15.142:0/733332397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c003570 con 0x7f723c0051c0 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725659c700 1 -- 172.21.15.142:0/733332397 reap_dead start 2023-09-30T22:53:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f725659c700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f723c0051c0 0x7f723c00ba60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f72480020f0 tx=0x7f72480017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63ec8b80edf9970 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248001ab0 con 0x7f723c0051c0 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800c8b0 con 0x7f723c0051c0 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.402+0000 7f7254d99700 1 -- 172.21.15.142:0/733332397 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800cc70 con 0x7f723c0051c0 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.403+0000 7f7257fff700 1 -- 172.21.15.142:0/733332397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f723c0051c0 msgr2=0x7f723c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.403+0000 7f7257fff700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f723c0051c0 0x7f723c00ba60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f72480020f0 tx=0x7f72480017a0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.403+0000 7f7257fff700 1 -- 172.21.15.142:0/733332397 shutdown_connections 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.403+0000 7f7257fff700 1 --2- 172.21.15.142:0/733332397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f723c0051c0 0x7f723c00ba60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.403+0000 7f7257fff700 1 -- 172.21.15.142:0/733332397 >> 172.21.15.142:0/733332397 conn(0x7f72500d0a80 msgr2=0x7f72500d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.403+0000 7f7257fff700 1 -- 172.21.15.142:0/733332397 shutdown_connections 2023-09-30T22:53:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.403+0000 7f7257fff700 1 -- 172.21.15.142:0/733332397 wait complete. 2023-09-30T22:53:51.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.404+0000 7f7257fff700 1 Processor -- start 2023-09-30T22:53:51.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.405+0000 7f7257fff700 1 -- start start 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.405+0000 7f7257fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c0051c0 0x7f72500c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.405+0000 7f7257fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7250157f10 0x7f7250146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.405+0000 7f7257fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f725015a020 0x7f725006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.405+0000 7f7257fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500ca160 con 0x7f725015a020 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.405+0000 7f7257fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250146c50 con 0x7f7250157f10 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.405+0000 7f7257fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7250158f90 con 0x7f723c0051c0 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f725015a020 0x7f725006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f725015a020 0x7f725006abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52864/0 (socket says 172.21.15.142:52864) 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 -- 172.21.15.142:0/1240406067 learned_addr learned my addr 172.21.15.142:0/1240406067 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f7255d9b700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c0051c0 0x7f72500c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725559a700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7250157f10 0x7f7250146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 -- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c0051c0 msgr2=0x7f72500c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c0051c0 0x7f72500c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 -- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7250157f10 msgr2=0x7f7250146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7250157f10 0x7f7250146710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 -- 172.21.15.142:0/1240406067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250158380 con 0x7f725015a020 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f725659c700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f725015a020 0x7f725006abe0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72480017e0 tx=0x7f7248016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.406+0000 7f7245ffb700 1 -- 172.21.15.142:0/1240406067 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800c6d0 con 0x7f725015a020 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.407+0000 7f7245ffb700 1 -- 172.21.15.142:0/1240406067 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248012c40 con 0x7f725015a020 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.407+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7250158660 con 0x7f725015a020 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.407+0000 7f7245ffb700 1 -- 172.21.15.142:0/1240406067 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724801e430 con 0x7f725015a020 2023-09-30T22:53:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.407+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250158c20 con 0x7f725015a020 2023-09-30T22:53:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.408+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250069770 con 0x7f725015a020 2023-09-30T22:53:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.409+0000 7f7245ffb700 1 -- 172.21.15.142:0/1240406067 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f724801e820 con 0x7f725015a020 2023-09-30T22:53:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.410+0000 7f7245ffb700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7234067330 0x7f72340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.410+0000 7f7245ffb700 1 -- 172.21.15.142:0/1240406067 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7248086cb0 con 0x7f725015a020 2023-09-30T22:53:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.410+0000 7f7255d9b700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7234067330 0x7f72340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.411+0000 7f7255d9b700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7234067330 0x7f72340697e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f724c001c80 tx=0x7f724c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.414+0000 7f7245ffb700 1 -- 172.21.15.142:0/1240406067 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7248053bb0 con 0x7f725015a020 2023-09-30T22:53:51.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.605+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f725006fc10 con 0x7f725015a020 2023-09-30T22:53:51.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.605+0000 7f7245ffb700 1 -- 172.21.15.142:0/1240406067 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f72480571d0 con 0x7f725015a020 2023-09-30T22:53:51.607 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:53:51.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7234067330 msgr2=0x7f72340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7234067330 0x7f72340697e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f724c001c80 tx=0x7f724c009040 comp rx=0 tx=0).stop 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f725015a020 msgr2=0x7f725006abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f725015a020 0x7f725006abe0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72480017e0 tx=0x7f7248016000 comp rx=0 tx=0).stop 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 shutdown_connections 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7234067330 0x7f72340697e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f725015a020 0x7f725006abe0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f723c0051c0 0x7f72500c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 --2- 172.21.15.142:0/1240406067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7250157f10 0x7f7250146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 >> 172.21.15.142:0/1240406067 conn(0x7f72500d0a80 msgr2=0x7f7250156800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 shutdown_connections 2023-09-30T22:53:51.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.608+0000 7f7257fff700 1 -- 172.21.15.142:0/1240406067 wait complete. 2023-09-30T22:53:51.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:53:51.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.817+0000 7f6f657ff700 1 Processor -- start 2023-09-30T22:53:51.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.817+0000 7f6f657ff700 1 -- start start 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.818+0000 7f6f657ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f60159ba0 0x7f6f6006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.818+0000 7f6f657ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f600ca5e0 0x7f6f600681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.818+0000 7f6f657ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f60067d10 con 0x7f6f600b0de0 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.818+0000 7f6f657ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6006af90 con 0x7f6f600ca5e0 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f657ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600676c0 con 0x7f6f60159ba0 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f600ca5e0 0x7f6f600681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5e7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6f600b0de0 0x7f6f600c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52026/0 (socket says 172.21.15.142:52026) 2023-09-30T22:53:51.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5e7fc700 1 -- 172.21.15.142:0/463897438 learned_addr learned my addr 172.21.15.142:0/463897438 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5effd700 1 --2- 172.21.15.142:0/463897438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f60159ba0 0x7f6f6006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5dffb700 1 -- 172.21.15.142:0/463897438 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616126373 0 0) 0x7f6f60067d10 con 0x7f6f600b0de0 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5dffb700 1 -- 172.21.15.142:0/463897438 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f48003570 con 0x7f6f600b0de0 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5f7fe700 1 -- 172.21.15.142:0/463897438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f60159ba0 msgr2=0x7f6f6006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5f7fe700 1 --2- 172.21.15.142:0/463897438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f60159ba0 0x7f6f6006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5f7fe700 1 -- 172.21.15.142:0/463897438 >> v1:172.21.15.142:6789/0 conn(0x7f6f600b0de0 legacy=0x7f6f600c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.819+0000 7f6f5f7fe700 1 -- 172.21.15.142:0/463897438 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600679a0 con 0x7f6f600ca5e0 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f5f7fe700 1 --2- 172.21.15.142:0/463897438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f600ca5e0 0x7f6f600681a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009e60 tx=0x7f6f58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dd2b0e46f95779 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f5dffb700 1 -- 172.21.15.142:0/463897438 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800e070 con 0x7f6f600ca5e0 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f5dffb700 1 -- 172.21.15.142:0/463897438 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5800bab0 con 0x7f6f600ca5e0 2023-09-30T22:53:51.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f5dffb700 1 -- 172.21.15.142:0/463897438 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800be70 con 0x7f6f600ca5e0 2023-09-30T22:53:51.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f657ff700 1 -- 172.21.15.142:0/463897438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f600ca5e0 msgr2=0x7f6f600681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f657ff700 1 --2- 172.21.15.142:0/463897438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f600ca5e0 0x7f6f600681a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009e60 tx=0x7f6f58009780 comp rx=0 tx=0).stop 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f657ff700 1 -- 172.21.15.142:0/463897438 shutdown_connections 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f657ff700 1 --2- 172.21.15.142:0/463897438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f600ca5e0 0x7f6f600681a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f657ff700 1 --2- 172.21.15.142:0/463897438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f60159ba0 0x7f6f6006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.820+0000 7f6f657ff700 1 -- 172.21.15.142:0/463897438 >> 172.21.15.142:0/463897438 conn(0x7f6f600cb2f0 msgr2=0x7f6f600cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.821+0000 7f6f657ff700 1 -- 172.21.15.142:0/463897438 shutdown_connections 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.821+0000 7f6f657ff700 1 -- 172.21.15.142:0/463897438 wait complete. 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.822+0000 7f6f657ff700 1 Processor -- start 2023-09-30T22:53:51.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.822+0000 7f6f657ff700 1 -- start start 2023-09-30T22:53:51.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f657ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f600b0de0 0x7f6f6015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f657ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f600ca5e0 0x7f6f60169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f657ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f60159ba0 0x7f6f60169f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f657ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6015bef0 con 0x7f6f60159ba0 2023-09-30T22:53:51.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f657ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6015cb70 con 0x7f6f600ca5e0 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f657ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6015b2e0 con 0x7f6f600b0de0 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f5f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f60159ba0 0x7f6f60169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f5f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f60159ba0 0x7f6f60169f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52884/0 (socket says 172.21.15.142:52884) 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.823+0000 7f6f5f7fe700 1 -- 172.21.15.142:0/1752783028 learned_addr learned my addr 172.21.15.142:0/1752783028 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5effd700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f600b0de0 0x7f6f6015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5e7fc700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f600ca5e0 0x7f6f60169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5f7fe700 1 -- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f600b0de0 msgr2=0x7f6f6015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5f7fe700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f600b0de0 0x7f6f6015a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5f7fe700 1 -- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f600ca5e0 msgr2=0x7f6f60169a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5f7fe700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f600ca5e0 0x7f6f60169a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5f7fe700 1 -- 172.21.15.142:0/1752783028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58009a20 con 0x7f6f60159ba0 2023-09-30T22:53:51.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f5f7fe700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f60159ba0 0x7f6f60169f80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f58013000 tx=0x7f6f58019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:51.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f46ffd700 1 -- 172.21.15.142:0/1752783028 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58012e10 con 0x7f6f60159ba0 2023-09-30T22:53:51.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f46ffd700 1 -- 172.21.15.142:0/1752783028 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58027470 con 0x7f6f60159ba0 2023-09-30T22:53:51.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6015b5c0 con 0x7f6f60159ba0 2023-09-30T22:53:51.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.824+0000 7f6f46ffd700 1 -- 172.21.15.142:0/1752783028 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58027830 con 0x7f6f60159ba0 2023-09-30T22:53:51.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.825+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6015bb80 con 0x7f6f60159ba0 2023-09-30T22:53:51.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.826+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6006e4b0 con 0x7f6f60159ba0 2023-09-30T22:53:51.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.826+0000 7f6f46ffd700 1 -- 172.21.15.142:0/1752783028 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6f58024070 con 0x7f6f60159ba0 2023-09-30T22:53:51.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.827+0000 7f6f46ffd700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f4c067330 0x7f6f4c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:51.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.828+0000 7f6f46ffd700 1 -- 172.21.15.142:0/1752783028 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f58087610 con 0x7f6f60159ba0 2023-09-30T22:53:51.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.828+0000 7f6f5effd700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f4c067330 0x7f6f4c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:51.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.828+0000 7f6f5effd700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f4c067330 0x7f6f4c0697e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009d10 tx=0x7f6f500091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:51.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:51.832+0000 7f6f46ffd700 1 -- 172.21.15.142:0/1752783028 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6f58054470 con 0x7f6f60159ba0 2023-09-30T22:53:52.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.021+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f6015c030 con 0x7f6f60159ba0 2023-09-30T22:53:52.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.021+0000 7f6f46ffd700 1 -- 172.21.15.142:0/1752783028 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f6015c030 con 0x7f6f60159ba0 2023-09-30T22:53:52.023 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:53:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f4c067330 msgr2=0x7f6f4c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f4c067330 0x7f6f4c0697e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009d10 tx=0x7f6f500091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f60159ba0 msgr2=0x7f6f60169f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f60159ba0 0x7f6f60169f80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f58013000 tx=0x7f6f58019000 comp rx=0 tx=0).stop 2023-09-30T22:53:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 shutdown_connections 2023-09-30T22:53:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f4c067330 0x7f6f4c0697e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f60159ba0 0x7f6f60169f80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f600b0de0 0x7f6f6015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 --2- 172.21.15.142:0/1752783028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f600ca5e0 0x7f6f60169a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 >> 172.21.15.142:0/1752783028 conn(0x7f6f600cb2f0 msgr2=0x7f6f600b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 shutdown_connections 2023-09-30T22:53:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.024+0000 7f6f657ff700 1 -- 172.21.15.142:0/1752783028 wait complete. 2023-09-30T22:53:52.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:52.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.233+0000 7fdbb1dff700 1 Processor -- start 2023-09-30T22:53:52.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.233+0000 7fdbb1dff700 1 -- start start 2023-09-30T22:53:52.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.234+0000 7fdbb1dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbac157a90 0x7fdbac15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.234+0000 7fdbb1dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac0b2110 0x7fdbac06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.234+0000 7fdbb1dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac06d470 con 0x7fdbac06b3d0 2023-09-30T22:53:52.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.234+0000 7fdbb1dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac157e60 con 0x7fdbac157a90 2023-09-30T22:53:52.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.234+0000 7fdbb1dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac15c430 con 0x7fdbac0b2110 2023-09-30T22:53:52.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbac157a90 0x7fdbac15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac0b2110 0x7fdbac06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbabfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac0b2110 0x7fdbac06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:35246/0 (socket says 172.21.15.142:35246) 2023-09-30T22:53:52.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbac157a90 0x7fdbac15bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:35066/0 (socket says 172.21.15.142:35066) 2023-09-30T22:53:52.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbabfff700 1 -- 172.21.15.142:0/834802146 learned_addr learned my addr 172.21.15.142:0/834802146 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:52.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbaaffd700 1 --1- 172.21.15.142:0/834802146 >> v1:172.21.15.148:6789/0 conn(0x7fdbac06b3d0 0x7fdbac0b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:54134/0 (socket says 172.21.15.142:54134) 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbabfff700 1 -- 172.21.15.142:0/834802146 >> v2:172.21.15.148:3300/0 conn(0x7fdbac157a90 msgr2=0x7fdbac15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbabfff700 1 --2- 172.21.15.142:0/834802146 >> v2:172.21.15.148:3300/0 conn(0x7fdbac157a90 0x7fdbac15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbabfff700 1 -- 172.21.15.142:0/834802146 >> v1:172.21.15.148:6789/0 conn(0x7fdbac06b3d0 legacy=0x7fdbac0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.235+0000 7fdbabfff700 1 -- 172.21.15.142:0/834802146 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0ae880 con 0x7fdbac0b2110 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbabfff700 1 --2- 172.21.15.142:0/834802146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac0b2110 0x7fdbac06d900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009f20 tx=0x7fdba4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c946fdce0269267f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbaa7fc700 1 -- 172.21.15.142:0/834802146 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400e070 con 0x7fdbac0b2110 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbaa7fc700 1 -- 172.21.15.142:0/834802146 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba400b9d0 con 0x7fdbac0b2110 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbaa7fc700 1 -- 172.21.15.142:0/834802146 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40092e0 con 0x7fdbac0b2110 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 -- 172.21.15.142:0/834802146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac0b2110 msgr2=0x7fdbac06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/834802146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac0b2110 0x7fdbac06d900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009f20 tx=0x7fdba4009840 comp rx=0 tx=0).stop 2023-09-30T22:53:52.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 -- 172.21.15.142:0/834802146 shutdown_connections 2023-09-30T22:53:52.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/834802146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac0b2110 0x7fdbac06d900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/834802146 >> v2:172.21.15.148:3300/0 conn(0x7fdbac157a90 0x7fdbac15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 -- 172.21.15.142:0/834802146 >> 172.21.15.142:0/834802146 conn(0x7fdbac0680c0 msgr2=0x7fdbac0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:52.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 -- 172.21.15.142:0/834802146 shutdown_connections 2023-09-30T22:53:52.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.236+0000 7fdbb1dff700 1 -- 172.21.15.142:0/834802146 wait complete. 2023-09-30T22:53:52.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.238+0000 7fdbb1dff700 1 Processor -- start 2023-09-30T22:53:52.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.238+0000 7fdbb1dff700 1 -- start start 2023-09-30T22:53:52.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbb1dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbac06b3d0 0x7fdbac1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbb1dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbac0b2110 0x7fdbac0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbb1dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac157a90 0x7fdbac0c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbb1dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac156d50 con 0x7fdbac06b3d0 2023-09-30T22:53:52.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbb1dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac150ef0 con 0x7fdbac0b2110 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbb1dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac156140 con 0x7fdbac157a90 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbab7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbac06b3d0 0x7fdbac1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbab7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbac06b3d0 0x7fdbac1509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52888/0 (socket says 172.21.15.142:52888) 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbab7fe700 1 -- 172.21.15.142:0/1544918115 learned_addr learned my addr 172.21.15.142:0/1544918115 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbaaffd700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbac0b2110 0x7fdbac0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.239+0000 7fdbabfff700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac157a90 0x7fdbac0c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbab7fe700 1 -- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac157a90 msgr2=0x7fdbac0c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbab7fe700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac157a90 0x7fdbac0c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbab7fe700 1 -- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbac0b2110 msgr2=0x7fdbac0c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbab7fe700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbac0b2110 0x7fdbac0c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbab7fe700 1 -- 172.21.15.142:0/1544918115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4009ae0 con 0x7fdbac06b3d0 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbab7fe700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbac06b3d0 0x7fdbac1509b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00e930 tx=0x7fdb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdb937fe700 1 -- 172.21.15.142:0/1544918115 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c013680 con 0x7fdbac06b3d0 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdb937fe700 1 -- 172.21.15.142:0/1544918115 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c0137e0 con 0x7fdbac06b3d0 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac156420 con 0x7fdbac06b3d0 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdb937fe700 1 -- 172.21.15.142:0/1544918115 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c013b80 con 0x7fdbac06b3d0 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.240+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac1569e0 con 0x7fdbac06b3d0 2023-09-30T22:53:52.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.241+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac0695b0 con 0x7fdbac06b3d0 2023-09-30T22:53:52.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.242+0000 7fdb937fe700 1 -- 172.21.15.142:0/1544918115 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdb9c00c3e0 con 0x7fdbac06b3d0 2023-09-30T22:53:52.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.243+0000 7fdb937fe700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb98067330 0x7fdb980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.243+0000 7fdb937fe700 1 -- 172.21.15.142:0/1544918115 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb9c084d10 con 0x7fdbac06b3d0 2023-09-30T22:53:52.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.243+0000 7fdbaaffd700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb98067330 0x7fdb980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.244+0000 7fdbaaffd700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb98067330 0x7fdb980697e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdbac151440 tx=0x7fdba0007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:52.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.247+0000 7fdb937fe700 1 -- 172.21.15.142:0/1544918115 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdb9c08a020 con 0x7fdbac06b3d0 2023-09-30T22:53:52.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.480+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbac156ba0 con 0x7fdbac06b3d0 2023-09-30T22:53:52.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.481+0000 7fdb937fe700 1 -- 172.21.15.142:0/1544918115 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fdb9c051b70 con 0x7fdbac06b3d0 2023-09-30T22:53:52.482 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:52.483 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb98067330 msgr2=0x7fdb980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb98067330 0x7fdb980697e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdbac151440 tx=0x7fdba0007eb0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbac06b3d0 msgr2=0x7fdbac1509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbac06b3d0 0x7fdbac1509b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00e930 tx=0x7fdb9c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 shutdown_connections 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb98067330 0x7fdb980697e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbac157a90 0x7fdbac0c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbac06b3d0 0x7fdbac1509b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 --2- 172.21.15.142:0/1544918115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbac0b2110 0x7fdbac0c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.483+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 >> 172.21.15.142:0/1544918115 conn(0x7fdbac0680c0 msgr2=0x7fdbac1522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:52.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.484+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 shutdown_connections 2023-09-30T22:53:52.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.484+0000 7fdbb1dff700 1 -- 172.21.15.142:0/1544918115 wait complete. 2023-09-30T22:53:52.486 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:52.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:52.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.693+0000 7f1b6e3ff700 1 Processor -- start 2023-09-30T22:53:52.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.693+0000 7f1b6e3ff700 1 -- start start 2023-09-30T22:53:52.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b6e3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1b680b00d0 0x7f1b6806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b6e3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b6806e650 0x7f1b6815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b6e3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6806d3e0 con 0x7f1b680af020 2023-09-30T22:53:52.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b6e3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6806dc80 con 0x7f1b680b00d0 2023-09-30T22:53:52.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b6e3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6806b790 con 0x7f1b6806e650 2023-09-30T22:53:52.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b677fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1b680b00d0 0x7f1b6806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b677fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1b680b00d0 0x7f1b6806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52894/0 (socket says 172.21.15.142:52894) 2023-09-30T22:53:52.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.694+0000 7f1b677fe700 1 -- 172.21.15.142:0/3748133292 learned_addr learned my addr 172.21.15.142:0/3748133292 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:52.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b6c99c700 1 --2- 172.21.15.142:0/3748133292 >> v2:172.21.15.148:3300/0 conn(0x7f1b6806e650 0x7f1b6815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b677fe700 1 -- 172.21.15.142:0/3748133292 >> v2:172.21.15.148:3300/0 conn(0x7f1b6806e650 msgr2=0x7f1b6815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b677fe700 1 --2- 172.21.15.142:0/3748133292 >> v2:172.21.15.148:3300/0 conn(0x7f1b6806e650 0x7f1b6815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b677fe700 1 -- 172.21.15.142:0/3748133292 >> v1:172.21.15.148:6789/0 conn(0x7f1b680af020 legacy=0x7f1b68156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b677fe700 1 -- 172.21.15.142:0/3748133292 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680b0650 con 0x7f1b680b00d0 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b6c99c700 1 --2- 172.21.15.142:0/3748133292 >> v2:172.21.15.148:3300/0 conn(0x7f1b6806e650 0x7f1b6815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b677fe700 1 --2- 172.21.15.142:0/3748133292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b680b00d0 0x7f1b6806e110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0a3a0c42a9897a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b66ffd700 1 -- 172.21.15.142:0/3748133292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00b820 con 0x7f1b680b00d0 2023-09-30T22:53:52.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b66ffd700 1 -- 172.21.15.142:0/3748133292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00b980 con 0x7f1b680b00d0 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.695+0000 7f1b66ffd700 1 -- 172.21.15.142:0/3748133292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00bd20 con 0x7f1b680b00d0 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/3748133292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b680b00d0 msgr2=0x7f1b6806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/3748133292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b680b00d0 0x7f1b6806e110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c009250 comp rx=0 tx=0).stop 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/3748133292 shutdown_connections 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/3748133292 >> v2:172.21.15.148:3300/0 conn(0x7f1b6806e650 0x7f1b6815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/3748133292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b680b00d0 0x7f1b6806e110 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/3748133292 >> 172.21.15.142:0/3748133292 conn(0x7f1b680680c0 msgr2=0x7f1b680c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/3748133292 shutdown_connections 2023-09-30T22:53:52.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.696+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/3748133292 wait complete. 2023-09-30T22:53:52.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.697+0000 7f1b6e3ff700 1 Processor -- start 2023-09-30T22:53:52.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.698+0000 7f1b6e3ff700 1 -- start start 2023-09-30T22:53:52.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.698+0000 7f1b6e3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b6806e650 0x7f1b680c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.698+0000 7f1b6e3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b680af020 0x7f1b681440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.698+0000 7f1b6e3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b680b00d0 0x7f1b6815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.698+0000 7f1b6e3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680c8140 con 0x7f1b6806e650 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.698+0000 7f1b6e3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b68157e30 con 0x7f1b680af020 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.698+0000 7f1b6e3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b68155050 con 0x7f1b680b00d0 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b6806e650 0x7f1b680c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b6806e650 0x7f1b680c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52896/0 (socket says 172.21.15.142:52896) 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 -- 172.21.15.142:0/853647783 learned_addr learned my addr 172.21.15.142:0/853647783 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b677fe700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b680af020 0x7f1b681440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b6c99c700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b680b00d0 0x7f1b6815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 -- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b680b00d0 msgr2=0x7f1b6815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b680b00d0 0x7f1b6815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 -- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b680af020 msgr2=0x7f1b681440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b680af020 0x7f1b681440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 -- 172.21.15.142:0/853647783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0094f0 con 0x7f1b6806e650 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.699+0000 7f1b67fff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b6806e650 0x7f1b680c71a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c590 tx=0x7f1b5800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.700+0000 7f1b4ffff700 1 -- 172.21.15.142:0/853647783 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011590 con 0x7f1b6806e650 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.700+0000 7f1b4ffff700 1 -- 172.21.15.142:0/853647783 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58011710 con 0x7f1b6806e650 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.700+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b680c78a0 con 0x7f1b6806e650 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.700+0000 7f1b4ffff700 1 -- 172.21.15.142:0/853647783 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011ad0 con 0x7f1b6806e650 2023-09-30T22:53:52.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.700+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b680c7e60 con 0x7f1b6806e650 2023-09-30T22:53:52.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.701+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b68157c00 con 0x7f1b6806e650 2023-09-30T22:53:52.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.702+0000 7f1b4ffff700 1 -- 172.21.15.142:0/853647783 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1b5801b3b0 con 0x7f1b6806e650 2023-09-30T22:53:52.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.703+0000 7f1b4ffff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b54067330 0x7f1b540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:52.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.703+0000 7f1b4ffff700 1 -- 172.21.15.142:0/853647783 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b58083ff0 con 0x7f1b6806e650 2023-09-30T22:53:52.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.703+0000 7f1b677fe700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b54067330 0x7f1b540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:52.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.703+0000 7f1b677fe700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b54067330 0x7f1b540697e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:52.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.707+0000 7f1b4ffff700 1 -- 172.21.15.142:0/853647783 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1b68157c00 con 0x7f1b6806e650 2023-09-30T22:53:52.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.896+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b68157c00 con 0x7f1b6806e650 2023-09-30T22:53:52.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.897+0000 7f1b4ffff700 1 -- 172.21.15.142:0/853647783 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f1b68157c00 con 0x7f1b6806e650 2023-09-30T22:53:52.899 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:52.899 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":37,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:46.292840+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:53:25.907895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T22:53:26.965039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:52.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.899+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b54067330 msgr2=0x7f1b540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.899+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b54067330 0x7f1b540697e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c017000 comp rx=0 tx=0).stop 2023-09-30T22:53:52.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.899+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b6806e650 msgr2=0x7f1b680c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:52.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.899+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b6806e650 0x7f1b680c71a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c590 tx=0x7f1b5800c8a0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 shutdown_connections 2023-09-30T22:53:52.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b54067330 0x7f1b540697e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b680b00d0 0x7f1b6815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b6806e650 0x7f1b680c71a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 --2- 172.21.15.142:0/853647783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b680af020 0x7f1b681440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:52.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 >> 172.21.15.142:0/853647783 conn(0x7f1b680680c0 msgr2=0x7f1b680ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:52.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 shutdown_connections 2023-09-30T22:53:52.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:52.900+0000 7f1b6e3ff700 1 -- 172.21.15.142:0/853647783 wait complete. 2023-09-30T22:53:52.918 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:53:52.920 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:53.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.107+0000 7fcd815ff700 1 Processor -- start 2023-09-30T22:53:53.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.108+0000 7fcd815ff700 1 -- start start 2023-09-30T22:53:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd815ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd7c06b3d0 0x7fcd7c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd815ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c06d470 con 0x7fcd7c0b1f40 2023-09-30T22:53:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd815ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c157e60 con 0x7fcd7c157a90 2023-09-30T22:53:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd815ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0b2380 con 0x7fcd7c06b3d0 2023-09-30T22:53:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd7a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd7c06b3d0 0x7fcd7c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd7b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcd7c0b1f40 0x7fcd7c06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52034/0 (socket says 172.21.15.142:52034) 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd7a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd7c06b3d0 0x7fcd7c0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52902/0 (socket says 172.21.15.142:52902) 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.109+0000 7fcd7b7fe700 1 -- 172.21.15.142:0/3581461552 learned_addr learned my addr 172.21.15.142:0/3581461552 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd7a7fc700 1 -- 172.21.15.142:0/3581461552 >> v1:172.21.15.148:6789/0 conn(0x7fcd7c157a90 legacy=0x7fcd7c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd7a7fc700 1 -- 172.21.15.142:0/3581461552 >> v1:172.21.15.142:6789/0 conn(0x7fcd7c0b1f40 legacy=0x7fcd7c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd7a7fc700 1 -- 172.21.15.142:0/3581461552 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0ae880 con 0x7fcd7c06b3d0 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd79ffb700 1 -- 172.21.15.142:0/3581461552 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549427159 0 0) 0x7fcd7c06d470 con 0x7fcd7c0b1f40 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd7a7fc700 1 --2- 172.21.15.142:0/3581461552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c0b1a00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcd700098e0 tx=0x7fcd700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ce5967a768829b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd79ffb700 1 -- 172.21.15.142:0/3581461552 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70009e80 con 0x7fcd7c06b3d0 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd79ffb700 1 -- 172.21.15.142:0/3581461552 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7000b820 con 0x7fcd7c06b3d0 2023-09-30T22:53:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.110+0000 7fcd79ffb700 1 -- 172.21.15.142:0/3581461552 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000bba0 con 0x7fcd7c06b3d0 2023-09-30T22:53:53.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.111+0000 7fcd815ff700 1 -- 172.21.15.142:0/3581461552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c06b3d0 msgr2=0x7fcd7c0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.111+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3581461552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c0b1a00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcd700098e0 tx=0x7fcd700091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.111+0000 7fcd815ff700 1 -- 172.21.15.142:0/3581461552 shutdown_connections 2023-09-30T22:53:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.111+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3581461552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c0b1a00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.111+0000 7fcd815ff700 1 -- 172.21.15.142:0/3581461552 >> 172.21.15.142:0/3581461552 conn(0x7fcd7c0680c0 msgr2=0x7fcd7c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.111+0000 7fcd815ff700 1 -- 172.21.15.142:0/3581461552 shutdown_connections 2023-09-30T22:53:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.111+0000 7fcd815ff700 1 -- 172.21.15.142:0/3581461552 wait complete. 2023-09-30T22:53:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.112+0000 7fcd815ff700 1 Processor -- start 2023-09-30T22:53:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.112+0000 7fcd815ff700 1 -- start start 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.113+0000 7fcd815ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.113+0000 7fcd815ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd7c0b1f40 0x7fcd7c14d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.113+0000 7fcd815ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c157a90 0x7fcd7c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.113+0000 7fcd815ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c159ec0 con 0x7fcd7c157a90 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.113+0000 7fcd815ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c14d5d0 con 0x7fcd7c06b3d0 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.113+0000 7fcd815ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c158ff0 con 0x7fcd7c0b1f40 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c157a90 0x7fcd7c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c157a90 0x7fcd7c15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52908/0 (socket says 172.21.15.142:52908) 2023-09-30T22:53:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 -- 172.21.15.142:0/3423097357 learned_addr learned my addr 172.21.15.142:0/3423097357 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7a7fc700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd7c0b1f40 0x7fcd7c14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7affd700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 -- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd7c0b1f40 msgr2=0x7fcd7c14d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd7c0b1f40 0x7fcd7c14d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 -- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd7c06b3d0 msgr2=0x7fcd7c147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 -- 172.21.15.142:0/3423097357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70009420 con 0x7fcd7c157a90 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7a7fc700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd7c0b1f40 0x7fcd7c14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7affd700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd7b7fe700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c157a90 0x7fcd7c15a720 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400cbf0 tx=0x7fcd740019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd62ffd700 1 -- 172.21.15.142:0/3423097357 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400a9c0 con 0x7fcd7c157a90 2023-09-30T22:53:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd62ffd700 1 -- 172.21.15.142:0/3423097357 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7400ab20 con 0x7fcd7c157a90 2023-09-30T22:53:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c1592b0 con 0x7fcd7c157a90 2023-09-30T22:53:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.114+0000 7fcd62ffd700 1 -- 172.21.15.142:0/3423097357 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740070f0 con 0x7fcd7c157a90 2023-09-30T22:53:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.115+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c159870 con 0x7fcd7c157a90 2023-09-30T22:53:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.115+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c169fd0 con 0x7fcd7c157a90 2023-09-30T22:53:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.116+0000 7fcd62ffd700 1 -- 172.21.15.142:0/3423097357 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcd74007520 con 0x7fcd7c157a90 2023-09-30T22:53:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.117+0000 7fcd62ffd700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd68067360 0x7fcd68069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.117+0000 7fcd62ffd700 1 -- 172.21.15.142:0/3423097357 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd74084fe0 con 0x7fcd7c157a90 2023-09-30T22:53:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.117+0000 7fcd7affd700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd68067360 0x7fcd68069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.118+0000 7fcd7affd700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd68067360 0x7fcd68069810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c006fd0 tx=0x7fcd6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:53.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.121+0000 7fcd62ffd700 1 -- 172.21.15.142:0/3423097357 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcd7c169fd0 con 0x7fcd7c157a90 2023-09-30T22:53:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.357+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd7c169fd0 con 0x7fcd7c157a90 2023-09-30T22:53:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.357+0000 7fcd62ffd700 1 -- 172.21.15.142:0/3423097357 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fcd7c169fd0 con 0x7fcd7c157a90 2023-09-30T22:53:53.359 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:53.359 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd68067360 msgr2=0x7fcd68069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd68067360 0x7fcd68069810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c006fd0 tx=0x7fcd6c008040 comp rx=0 tx=0).stop 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c157a90 msgr2=0x7fcd7c15a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c157a90 0x7fcd7c15a720 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400cbf0 tx=0x7fcd740019b0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 shutdown_connections 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd68067360 0x7fcd68069810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd7c157a90 0x7fcd7c15a720 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd7c06b3d0 0x7fcd7c147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 --2- 172.21.15.142:0/3423097357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd7c0b1f40 0x7fcd7c14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 >> 172.21.15.142:0/3423097357 conn(0x7fcd7c0680c0 msgr2=0x7fcd7c0cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 shutdown_connections 2023-09-30T22:53:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.360+0000 7fcd815ff700 1 -- 172.21.15.142:0/3423097357 wait complete. 2023-09-30T22:53:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:53.378 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:53:53.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.566+0000 7ff507fff700 1 Processor -- start 2023-09-30T22:53:53.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.567+0000 7ff507fff700 1 -- start start 2023-09-30T22:53:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff507fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5001598e0 0x7ff500159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff507fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff5000cee50 0x7ff5000d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff507fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000cff40 con 0x7ff50006b1c0 2023-09-30T22:53:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff507fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000d0910 con 0x7ff5001598e0 2023-09-30T22:53:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff507fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000cf330 con 0x7ff5000cee50 2023-09-30T22:53:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff505d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5001598e0 0x7ff500159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff505d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5001598e0 0x7ff500159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52916/0 (socket says 172.21.15.142:52916) 2023-09-30T22:53:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff505d9b700 1 -- 172.21.15.142:0/1614389454 learned_addr learned my addr 172.21.15.142:0/1614389454 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff50559a700 1 --2- 172.21.15.142:0/1614389454 >> v2:172.21.15.148:3300/0 conn(0x7ff5000cee50 0x7ff5000d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff505d9b700 1 -- 172.21.15.142:0/1614389454 >> v2:172.21.15.148:3300/0 conn(0x7ff5000cee50 msgr2=0x7ff5000d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff505d9b700 1 --2- 172.21.15.142:0/1614389454 >> v2:172.21.15.148:3300/0 conn(0x7ff5000cee50 0x7ff5000d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.568+0000 7ff505d9b700 1 -- 172.21.15.142:0/1614389454 >> v1:172.21.15.148:6789/0 conn(0x7ff50006b1c0 legacy=0x7ff50015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.569+0000 7ff505d9b700 1 -- 172.21.15.142:0/1614389454 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000cf610 con 0x7ff5001598e0 2023-09-30T22:53:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.569+0000 7ff505d9b700 1 --2- 172.21.15.142:0/1614389454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5001598e0 0x7ff500159cb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff5000b36f0 tx=0x7ff4fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79b8896a9dd8a2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.569+0000 7ff504d99700 1 -- 172.21.15.142:0/1614389454 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc009e70 con 0x7ff5001598e0 2023-09-30T22:53:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.569+0000 7ff504d99700 1 -- 172.21.15.142:0/1614389454 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00b860 con 0x7ff5001598e0 2023-09-30T22:53:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.569+0000 7ff504d99700 1 -- 172.21.15.142:0/1614389454 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00bc00 con 0x7ff5001598e0 2023-09-30T22:53:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.569+0000 7ff507fff700 1 -- 172.21.15.142:0/1614389454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5001598e0 msgr2=0x7ff500159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.569+0000 7ff507fff700 1 --2- 172.21.15.142:0/1614389454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5001598e0 0x7ff500159cb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff5000b36f0 tx=0x7ff4fc009250 comp rx=0 tx=0).stop 2023-09-30T22:53:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.570+0000 7ff507fff700 1 -- 172.21.15.142:0/1614389454 shutdown_connections 2023-09-30T22:53:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.570+0000 7ff507fff700 1 --2- 172.21.15.142:0/1614389454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5001598e0 0x7ff500159cb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.570+0000 7ff507fff700 1 --2- 172.21.15.142:0/1614389454 >> v2:172.21.15.148:3300/0 conn(0x7ff5000cee50 0x7ff5000d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.570+0000 7ff507fff700 1 -- 172.21.15.142:0/1614389454 >> 172.21.15.142:0/1614389454 conn(0x7ff5000cd540 msgr2=0x7ff5000cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.570+0000 7ff507fff700 1 -- 172.21.15.142:0/1614389454 shutdown_connections 2023-09-30T22:53:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.570+0000 7ff507fff700 1 -- 172.21.15.142:0/1614389454 wait complete. 2023-09-30T22:53:53.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.571+0000 7ff507fff700 1 Processor -- start 2023-09-30T22:53:53.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.571+0000 7ff507fff700 1 -- start start 2023-09-30T22:53:53.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff507fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50006b1c0 0x7ff50015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff507fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5000cee50 0x7ff500157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff507fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5001598e0 0x7ff5000c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff507fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000a9940 con 0x7ff5000cee50 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff507fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50015b030 con 0x7ff50006b1c0 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff507fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50015a420 con 0x7ff5001598e0 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff50559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5000cee50 0x7ff500157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff50559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5000cee50 0x7ff500157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52928/0 (socket says 172.21.15.142:52928) 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.572+0000 7ff50559a700 1 -- 172.21.15.142:0/534071718 learned_addr learned my addr 172.21.15.142:0/534071718 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff505d9b700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50006b1c0 0x7ff50015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50559a700 1 -- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5001598e0 msgr2=0x7ff5000c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50659c700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5001598e0 0x7ff5000c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50559a700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5001598e0 0x7ff5000c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50559a700 1 -- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50006b1c0 msgr2=0x7ff50015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50559a700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50006b1c0 0x7ff50015ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50559a700 1 -- 172.21.15.142:0/534071718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0094f0 con 0x7ff5000cee50 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff505d9b700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50006b1c0 0x7ff50015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50659c700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5001598e0 0x7ff5000c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff50559a700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5000cee50 0x7ff500157300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000ec80 tx=0x7ff4f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff4f5ffb700 1 -- 172.21.15.142:0/534071718 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000c9d0 con 0x7ff5000cee50 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff4f5ffb700 1 -- 172.21.15.142:0/534071718 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f000cb30 con 0x7ff5000cee50 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff4f5ffb700 1 -- 172.21.15.142:0/534071718 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0013470 con 0x7ff5000cee50 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50015a700 con 0x7ff5000cee50 2023-09-30T22:53:53.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.573+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50015acc0 con 0x7ff5000cee50 2023-09-30T22:53:53.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.574+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50015b1a0 con 0x7ff5000cee50 2023-09-30T22:53:53.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.575+0000 7ff4f5ffb700 1 -- 172.21.15.142:0/534071718 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff4f00137e0 con 0x7ff5000cee50 2023-09-30T22:53:53.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.576+0000 7ff4f5ffb700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4e4067330 0x7ff4e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:53.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.576+0000 7ff4f5ffb700 1 -- 172.21.15.142:0/534071718 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4f0084fb0 con 0x7ff5000cee50 2023-09-30T22:53:53.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.576+0000 7ff505d9b700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4e4067330 0x7ff4e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:53.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.577+0000 7ff505d9b700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4e4067330 0x7ff4e40697e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5000b36f0 tx=0x7ff4fc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:53.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.580+0000 7ff4f5ffb700 1 -- 172.21.15.142:0/534071718 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff4f0051e10 con 0x7ff5000cee50 2023-09-30T22:53:53.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.810+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff50015d2b0 con 0x7ff5000cee50 2023-09-30T22:53:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.811+0000 7ff4f5ffb700 1 -- 172.21.15.142:0/534071718 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4609 (secure 0 0 0) 0x7ff4f0017090 con 0x7ff5000cee50 2023-09-30T22:53:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:53.812 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:53:27.981468+0000","modified":"2023-09-30T22:53:31.532704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.148:6835/2808848998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2808848998},{"type":"v1","addr":"172.21.15.148:6835","nonce":2808848998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-09-30T22:53:53.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4e4067330 msgr2=0x7ff4e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4e4067330 0x7ff4e40697e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5000b36f0 tx=0x7ff4fc017000 comp rx=0 tx=0).stop 2023-09-30T22:53:53.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5000cee50 msgr2=0x7ff500157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:53.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5000cee50 0x7ff500157300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000ec80 tx=0x7ff4f00091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 shutdown_connections 2023-09-30T22:53:53.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4e4067330 0x7ff4e40697e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5001598e0 0x7ff5000c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50006b1c0 0x7ff50015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 --2- 172.21.15.142:0/534071718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5000cee50 0x7ff500157300 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:53.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.813+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 >> 172.21.15.142:0/534071718 conn(0x7ff5000cd540 msgr2=0x7ff50006d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:53.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.814+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 shutdown_connections 2023-09-30T22:53:53.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:53.814+0000 7ff507fff700 1 -- 172.21.15.142:0/534071718 wait complete. 2023-09-30T22:53:53.816 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2023-09-30T22:53:53.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:53:54.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.019+0000 7fd84b1ff700 1 Processor -- start 2023-09-30T22:53:54.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.020+0000 7fd84b1ff700 1 -- start start 2023-09-30T22:53:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd84b1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8441598e0 0x7fd844159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd84b1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 0x7fd8440d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd84b1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440cff40 con 0x7fd84406b1c0 2023-09-30T22:53:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd84b1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440d0910 con 0x7fd8441598e0 2023-09-30T22:53:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd84b1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440cf330 con 0x7fd8440cee50 2023-09-30T22:53:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd84979c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd84406b1c0 0x7fd84415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52036/0 (socket says 172.21.15.142:52036) 2023-09-30T22:53:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd84979c700 1 -- 172.21.15.142:0/3953726496 learned_addr learned my addr 172.21.15.142:0/3953726496 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd843fff700 1 --2- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 0x7fd8440d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.021+0000 7fd848f9b700 1 --2- 172.21.15.142:0/3953726496 >> v2:172.21.15.148:3300/0 conn(0x7fd8441598e0 0x7fd844159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd8437fe700 1 -- 172.21.15.142:0/3953726496 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375969399 0 0) 0x7fd8440cff40 con 0x7fd84406b1c0 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd8437fe700 1 -- 172.21.15.142:0/3953726496 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd834003570 con 0x7fd84406b1c0 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd848f9b700 1 -- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 msgr2=0x7fd8440d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd848f9b700 1 --2- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 0x7fd8440d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd848f9b700 1 -- 172.21.15.142:0/3953726496 >> v1:172.21.15.142:6789/0 conn(0x7fd84406b1c0 legacy=0x7fd84415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd848f9b700 1 -- 172.21.15.142:0/3953726496 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440cf610 con 0x7fd8441598e0 2023-09-30T22:53:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd848f9b700 1 --2- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 0x7fd844159cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd8380098e0 tx=0x7fd8380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1fd4a69704ef74b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd8437fe700 1 -- 172.21.15.142:0/3953726496 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838011630 con 0x7fd8441598e0 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd8437fe700 1 -- 172.21.15.142:0/3953726496 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838011790 con 0x7fd8441598e0 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.022+0000 7fd8437fe700 1 -- 172.21.15.142:0/3953726496 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838011b30 con 0x7fd8441598e0 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 -- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 msgr2=0x7fd844159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 0x7fd844159cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd8380098e0 tx=0x7fd8380091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 -- 172.21.15.142:0/3953726496 shutdown_connections 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 0x7fd844159cb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/3953726496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 0x7fd8440d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 -- 172.21.15.142:0/3953726496 >> 172.21.15.142:0/3953726496 conn(0x7fd8440cd540 msgr2=0x7fd8440cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:54.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 -- 172.21.15.142:0/3953726496 shutdown_connections 2023-09-30T22:53:54.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.023+0000 7fd84b1ff700 1 -- 172.21.15.142:0/3953726496 wait complete. 2023-09-30T22:53:54.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.024+0000 7fd84b1ff700 1 Processor -- start 2023-09-30T22:53:54.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.025+0000 7fd84b1ff700 1 -- start start 2023-09-30T22:53:54.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.025+0000 7fd84b1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84406b1c0 0x7fd8440c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd84b1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 0x7fd8441561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd84b1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 0x7fd84415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd84b1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440cb060 con 0x7fd84406b1c0 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd84b1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440ca4d0 con 0x7fd8441598e0 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd84b1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440ca750 con 0x7fd8440cee50 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84406b1c0 0x7fd8440c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84406b1c0 0x7fd8440c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52944/0 (socket says 172.21.15.142:52944) 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 -- 172.21.15.142:0/59797250 learned_addr learned my addr 172.21.15.142:0/59797250 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 -- 172.21.15.142:0/59797250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 msgr2=0x7fd8441561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 0x7fd8441561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 -- 172.21.15.142:0/59797250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 msgr2=0x7fd84415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 0x7fd84415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 -- 172.21.15.142:0/59797250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838009420 con 0x7fd84406b1c0 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.026+0000 7fd848f9b700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84406b1c0 0x7fd8440c8c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd8440ce0a0 tx=0x7fd838017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.027+0000 7fd840ff9700 1 -- 172.21.15.142:0/59797250 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838011900 con 0x7fd84406b1c0 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.027+0000 7fd840ff9700 1 -- 172.21.15.142:0/59797250 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838011a60 con 0x7fd84406b1c0 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.027+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440caa10 con 0x7fd84406b1c0 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.027+0000 7fd840ff9700 1 -- 172.21.15.142:0/59797250 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838025670 con 0x7fd84406b1c0 2023-09-30T22:53:54.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.027+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd844156730 con 0x7fd84406b1c0 2023-09-30T22:53:54.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.028+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd844068ff0 con 0x7fd84406b1c0 2023-09-30T22:53:54.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.029+0000 7fd840ff9700 1 -- 172.21.15.142:0/59797250 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd838023070 con 0x7fd84406b1c0 2023-09-30T22:53:54.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.029+0000 7fd840ff9700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd828067330 0x7fd8280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.029+0000 7fd840ff9700 1 -- 172.21.15.142:0/59797250 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd838086180 con 0x7fd84406b1c0 2023-09-30T22:53:54.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.030+0000 7fd843fff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd828067330 0x7fd8280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.030+0000 7fd843fff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd828067330 0x7fd8280697e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd84406ead0 tx=0x7fd8300091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.034+0000 7fd840ff9700 1 -- 172.21.15.142:0/59797250 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd838052fe0 con 0x7fd84406b1c0 2023-09-30T22:53:54.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.228+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd84406fc10 con 0x7fd84406b1c0 2023-09-30T22:53:54.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.229+0000 7fd840ff9700 1 -- 172.21.15.142:0/59797250 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fd838056600 con 0x7fd84406b1c0 2023-09-30T22:53:54.230 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:53:54.230 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":37,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:53:46.292840+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:53:25.907895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T22:53:26.965039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:53:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd828067330 msgr2=0x7fd8280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd828067330 0x7fd8280697e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd84406ead0 tx=0x7fd8300091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84406b1c0 msgr2=0x7fd8440c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84406b1c0 0x7fd8440c8c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd8440ce0a0 tx=0x7fd838017000 comp rx=0 tx=0).stop 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 shutdown_connections 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd828067330 0x7fd8280697e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8441598e0 0x7fd84415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84406b1c0 0x7fd8440c8c90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 --2- 172.21.15.142:0/59797250 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8440cee50 0x7fd8441561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 >> 172.21.15.142:0/59797250 conn(0x7fd8440cd540 msgr2=0x7fd84406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 shutdown_connections 2023-09-30T22:53:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.231+0000 7fd84b1ff700 1 -- 172.21.15.142:0/59797250 wait complete. 2023-09-30T22:53:54.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:53:54.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.439+0000 7ff5e23ff700 1 Processor -- start 2023-09-30T22:53:54.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.440+0000 7ff5e23ff700 1 -- start start 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.441+0000 7ff5e23ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5dc0b1e00 0x7ff5dc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.441+0000 7ff5e23ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff5dc06a450 0x7ff5dc06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.441+0000 7ff5e23ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc06e040 con 0x7ff5dc159b40 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.441+0000 7ff5e23ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0b09d0 con 0x7ff5dc0b1e00 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.441+0000 7ff5e23ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0b2450 con 0x7ff5dc06a450 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5dc0b1e00 0x7ff5dc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5dc0b1e00 0x7ff5dc069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52954/0 (socket says 172.21.15.142:52954) 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 -- 172.21.15.142:0/4011774627 learned_addr learned my addr 172.21.15.142:0/4011774627 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:54.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5e099c700 1 --2- 172.21.15.142:0/4011774627 >> v2:172.21.15.148:3300/0 conn(0x7ff5dc06a450 0x7ff5dc06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 -- 172.21.15.142:0/4011774627 >> v2:172.21.15.148:3300/0 conn(0x7ff5dc06a450 msgr2=0x7ff5dc06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 --2- 172.21.15.142:0/4011774627 >> v2:172.21.15.148:3300/0 conn(0x7ff5dc06a450 0x7ff5dc06e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 -- 172.21.15.142:0/4011774627 >> v1:172.21.15.148:6789/0 conn(0x7ff5dc159b40 legacy=0x7ff5dc0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 -- 172.21.15.142:0/4011774627 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0b2730 con 0x7ff5dc0b1e00 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.442+0000 7ff5db7fe700 1 --2- 172.21.15.142:0/4011774627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc0b1e00 0x7ff5dc069f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c9ac0 tx=0x7ff5d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c531e43688373604 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5daffd700 1 -- 172.21.15.142:0/4011774627 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0009e70 con 0x7ff5dc0b1e00 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5daffd700 1 -- 172.21.15.142:0/4011774627 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d000b860 con 0x7ff5dc0b1e00 2023-09-30T22:53:54.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5daffd700 1 -- 172.21.15.142:0/4011774627 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000bc00 con 0x7ff5dc0b1e00 2023-09-30T22:53:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 -- 172.21.15.142:0/4011774627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc0b1e00 msgr2=0x7ff5dc069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/4011774627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc0b1e00 0x7ff5dc069f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c9ac0 tx=0x7ff5d0009250 comp rx=0 tx=0).stop 2023-09-30T22:53:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 -- 172.21.15.142:0/4011774627 shutdown_connections 2023-09-30T22:53:54.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/4011774627 >> v2:172.21.15.148:3300/0 conn(0x7ff5dc06a450 0x7ff5dc06e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/4011774627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc0b1e00 0x7ff5dc069f10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 -- 172.21.15.142:0/4011774627 >> 172.21.15.142:0/4011774627 conn(0x7ff5dc0680c0 msgr2=0x7ff5dc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:54.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 -- 172.21.15.142:0/4011774627 shutdown_connections 2023-09-30T22:53:54.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.443+0000 7ff5e23ff700 1 -- 172.21.15.142:0/4011774627 wait complete. 2023-09-30T22:53:54.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.445+0000 7ff5e23ff700 1 Processor -- start 2023-09-30T22:53:54.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.445+0000 7ff5e23ff700 1 -- start start 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5e23ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc06a450 0x7ff5dc147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5e23ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5dc0b1e00 0x7ff5dc159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5e23ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc159b40 0x7ff5dc147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5e23ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15bb10 con 0x7ff5dc06a450 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5e23ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15a810 con 0x7ff5dc159b40 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5e23ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15aaf0 con 0x7ff5dc0b1e00 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5dbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc06a450 0x7ff5dc147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5dbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc06a450 0x7ff5dc147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52966/0 (socket says 172.21.15.142:52966) 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5dbfff700 1 -- 172.21.15.142:0/3325859273 learned_addr learned my addr 172.21.15.142:0/3325859273 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5e099c700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc159b40 0x7ff5dc147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5db7fe700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5dc0b1e00 0x7ff5dc159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5dbfff700 1 -- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5dc0b1e00 msgr2=0x7ff5dc159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.446+0000 7ff5dbfff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5dc0b1e00 0x7ff5dc159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5dbfff700 1 -- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc159b40 msgr2=0x7ff5dc147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5dbfff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc159b40 0x7ff5dc147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5dbfff700 1 -- 172.21.15.142:0/3325859273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00094f0 con 0x7ff5dc06a450 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5dbfff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc06a450 0x7ff5dc147ad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00c4e0 tx=0x7ff5cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5c3fff700 1 -- 172.21.15.142:0/3325859273 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc011590 con 0x7ff5dc06a450 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5c3fff700 1 -- 172.21.15.142:0/3325859273 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc011710 con 0x7ff5dc06a450 2023-09-30T22:53:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5c3fff700 1 -- 172.21.15.142:0/3325859273 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc011ad0 con 0x7ff5dc06a450 2023-09-30T22:53:54.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc15add0 con 0x7ff5dc06a450 2023-09-30T22:53:54.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.447+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc15a450 con 0x7ff5dc06a450 2023-09-30T22:53:54.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.448+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc0695b0 con 0x7ff5dc06a450 2023-09-30T22:53:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.449+0000 7ff5c3fff700 1 -- 172.21.15.142:0/3325859273 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff5cc01b3b0 con 0x7ff5dc06a450 2023-09-30T22:53:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.450+0000 7ff5c3fff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5c8067330 0x7ff5c80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.450+0000 7ff5c3fff700 1 -- 172.21.15.142:0/3325859273 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff5cc0840d0 con 0x7ff5dc06a450 2023-09-30T22:53:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.450+0000 7ff5db7fe700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5c8067330 0x7ff5c80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.451+0000 7ff5db7fe700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5c8067330 0x7ff5c80697e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c9ac0 tx=0x7ff5d0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.455+0000 7ff5c3fff700 1 -- 172.21.15.142:0/3325859273 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff5cc050fd0 con 0x7ff5dc06a450 2023-09-30T22:53:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.692+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff5dc06fc10 con 0x7ff5dc06a450 2023-09-30T22:53:54.694 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:53:54.693+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:53:54.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.698+0000 7ff5c3fff700 1 -- 172.21.15.142:0/3325859273 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff5cc0545f0 con 0x7ff5dc06a450 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5c8067330 msgr2=0x7ff5c80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5c8067330 0x7ff5c80697e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c9ac0 tx=0x7ff5d0017000 comp rx=0 tx=0).stop 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc06a450 msgr2=0x7ff5dc147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc06a450 0x7ff5dc147ad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00c4e0 tx=0x7ff5cc00c8a0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 shutdown_connections 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5c8067330 0x7ff5c80697e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc159b40 0x7ff5dc147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5dc06a450 0x7ff5dc147ad0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 --2- 172.21.15.142:0/3325859273 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5dc0b1e00 0x7ff5dc159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 >> 172.21.15.142:0/3325859273 conn(0x7ff5dc0680c0 msgr2=0x7ff5dc06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:54.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.701+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 shutdown_connections 2023-09-30T22:53:54.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.702+0000 7ff5e23ff700 1 -- 172.21.15.142:0/3325859273 wait complete. 2023-09-30T22:53:54.704 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:53:54.707 INFO:tasks.ceph.mds.d.smithi148.stderr: -3704> 2023-09-30T22:53:29.485+0000 7fb17e7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:53:54.721 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:53:54.755 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:53:54.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.910+0000 7fe6309ff700 1 Processor -- start 2023-09-30T22:53:54.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.910+0000 7fe6309ff700 1 -- start start 2023-09-30T22:53:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe6309ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe62c069f10 0x7fe62c0c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe6309ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe6309ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62c0c7690 con 0x7fe62c0c52a0 2023-09-30T22:53:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe6309ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62c1406a0 con 0x7fe62c069f10 2023-09-30T22:53:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe6309ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c3a50 con 0x7fe62c0cb350 2023-09-30T22:53:54.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe62a59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe62c0c52a0 0x7fe62c0c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52050/0 (socket says 172.21.15.142:52050) 2023-09-30T22:53:54.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe62a59c700 1 -- 172.21.15.142:0/3676242874 learned_addr learned my addr 172.21.15.142:0/3676242874 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:53:54.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe629d9b700 1 --2- 172.21.15.142:0/3676242874 >> v2:172.21.15.148:3300/0 conn(0x7fe62c069f10 0x7fe62c0c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe62ad9d700 1 --2- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.912+0000 7fe62959a700 1 -- 172.21.15.142:0/3676242874 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206795313 0 0) 0x7fe61c001110 con 0x7fe62c0c52a0 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe62959a700 1 -- 172.21.15.142:0/3676242874 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe614003570 con 0x7fe62c0c52a0 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe629d9b700 1 -- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 msgr2=0x7fe62c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe629d9b700 1 --2- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe629d9b700 1 -- 172.21.15.142:0/3676242874 >> v1:172.21.15.142:6789/0 conn(0x7fe62c0c52a0 legacy=0x7fe62c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe629d9b700 1 -- 172.21.15.142:0/3676242874 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c0c7f20 con 0x7fe62c069f10 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe62ad9d700 1 --2- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe629d9b700 1 --2- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c069f10 0x7fe62c0c5670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe620009910 tx=0x7fe6200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0300708a17eb795 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe62959a700 1 -- 172.21.15.142:0/3676242874 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620011630 con 0x7fe62c069f10 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe62959a700 1 -- 172.21.15.142:0/3676242874 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe620011790 con 0x7fe62c069f10 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.913+0000 7fe62959a700 1 -- 172.21.15.142:0/3676242874 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620011b30 con 0x7fe62c069f10 2023-09-30T22:53:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 -- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c069f10 msgr2=0x7fe62c0c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 --2- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c069f10 0x7fe62c0c5670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe620009910 tx=0x7fe6200091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 -- 172.21.15.142:0/3676242874 shutdown_connections 2023-09-30T22:53:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 --2- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 --2- 172.21.15.142:0/3676242874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c069f10 0x7fe62c0c5670 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 -- 172.21.15.142:0/3676242874 >> 172.21.15.142:0/3676242874 conn(0x7fe62c0cc670 msgr2=0x7fe62c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 -- 172.21.15.142:0/3676242874 shutdown_connections 2023-09-30T22:53:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.914+0000 7fe6309ff700 1 -- 172.21.15.142:0/3676242874 wait complete. 2023-09-30T22:53:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.915+0000 7fe6309ff700 1 Processor -- start 2023-09-30T22:53:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.915+0000 7fe6309ff700 1 -- start start 2023-09-30T22:53:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.916+0000 7fe6309ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62c069f10 0x7fe62c13acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.916+0000 7fe6309ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c0c52a0 0x7fe62c0baf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.916+0000 7fe6309ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0bb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.916+0000 7fe6309ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0b94b0 con 0x7fe62c069f10 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.916+0000 7fe6309ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c13b200 con 0x7fe62c0c52a0 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.916+0000 7fe6309ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c13ec70 con 0x7fe62c0cb350 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62c069f10 0x7fe62c13acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62c069f10 0x7fe62c13acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52980/0 (socket says 172.21.15.142:52980) 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 -- 172.21.15.142:0/4266465217 learned_addr learned my addr 172.21.15.142:0/4266465217 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62ad9d700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0bb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe629d9b700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c0c52a0 0x7fe62c0baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 -- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 msgr2=0x7fe62c0bb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0bb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 -- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c0c52a0 msgr2=0x7fe62c0baf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c0c52a0 0x7fe62c0baf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 -- 172.21.15.142:0/4266465217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624009a20 con 0x7fe62c069f10 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.917+0000 7fe62a59c700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62c069f10 0x7fe62c13acc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00c7f0 tx=0x7fe61c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.918+0000 7fe61a7fc700 1 -- 172.21.15.142:0/4266465217 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c005b30 con 0x7fe62c069f10 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.918+0000 7fe61a7fc700 1 -- 172.21.15.142:0/4266465217 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c005cb0 con 0x7fe62c069f10 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.918+0000 7fe61a7fc700 1 -- 172.21.15.142:0/4266465217 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c007320 con 0x7fe62c069f10 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.918+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe620009420 con 0x7fe62c069f10 2023-09-30T22:53:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.918+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c0b8e60 con 0x7fe62c069f10 2023-09-30T22:53:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.919+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c069a50 con 0x7fe62c069f10 2023-09-30T22:53:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.920+0000 7fe61a7fc700 1 -- 172.21.15.142:0/4266465217 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe61c01b3b0 con 0x7fe62c069f10 2023-09-30T22:53:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.921+0000 7fe61a7fc700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe60c067330 0x7fe60c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.921+0000 7fe61a7fc700 1 -- 172.21.15.142:0/4266465217 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe61c083f90 con 0x7fe62c069f10 2023-09-30T22:53:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.921+0000 7fe629d9b700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe60c067330 0x7fe60c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:54.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.922+0000 7fe629d9b700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe60c067330 0x7fe60c0697e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe62c06a320 tx=0x7fe620017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:54.925+0000 7fe61a7fc700 1 -- 172.21.15.142:0/4266465217 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe61c050e80 con 0x7fe62c069f10 2023-09-30T22:53:55.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.155+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe62c0cad80 con 0x7fe62c069f10 2023-09-30T22:53:55.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.699+0000 7fe61a7fc700 1 -- 172.21.15.142:0/4266465217 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe61c0170a0 con 0x7fe62c069f10 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe60c067330 msgr2=0x7fe60c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe60c067330 0x7fe60c0697e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe62c06a320 tx=0x7fe620017000 comp rx=0 tx=0).stop 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62c069f10 msgr2=0x7fe62c13acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62c069f10 0x7fe62c13acc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00c7f0 tx=0x7fe61c007c70 comp rx=0 tx=0).stop 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 shutdown_connections 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe60c067330 0x7fe60c0697e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe62c0cb350 0x7fe62c0bb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62c069f10 0x7fe62c13acc0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 --2- 172.21.15.142:0/4266465217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe62c0c52a0 0x7fe62c0baf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 >> 172.21.15.142:0/4266465217 conn(0x7fe62c0cc670 msgr2=0x7fe62c06eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 shutdown_connections 2023-09-30T22:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.701+0000 7fe6309ff700 1 -- 172.21.15.142:0/4266465217 wait complete. 2023-09-30T22:53:55.721 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:53:55.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.913+0000 7f9769bff700 1 Processor -- start 2023-09-30T22:53:55.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.913+0000 7f9769bff700 1 -- start start 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9769bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9764159a10 0x7f97640c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9769bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97640b1aa0 0x7f97640ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9769bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9764068230 con 0x7f9764159de0 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9769bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97640696d0 con 0x7f97640b1aa0 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9769bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9764067620 con 0x7f9764159a10 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9763fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97640b1aa0 0x7f97640ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9763fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97640b1aa0 0x7f97640ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52988/0 (socket says 172.21.15.142:52988) 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9763fff700 1 -- 172.21.15.142:0/2280982445 learned_addr learned my addr 172.21.15.142:0/2280982445 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f97637fe700 1 --2- 172.21.15.142:0/2280982445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9764159a10 0x7f97640c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9763fff700 1 -- 172.21.15.142:0/2280982445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9764159a10 msgr2=0x7f97640c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9763fff700 1 --2- 172.21.15.142:0/2280982445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9764159a10 0x7f97640c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.915+0000 7f9763fff700 1 -- 172.21.15.142:0/2280982445 >> v1:172.21.15.148:6789/0 conn(0x7f9764159de0 legacy=0x7f976415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.916+0000 7f9763fff700 1 -- 172.21.15.142:0/2280982445 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764067900 con 0x7f97640b1aa0 2023-09-30T22:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.916+0000 7f9763fff700 1 --2- 172.21.15.142:0/2280982445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97640b1aa0 0x7f97640ca410 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f975c009f20 tx=0x7f975c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595802425c9a10f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.916+0000 7f97627fc700 1 -- 172.21.15.142:0/2280982445 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00e070 con 0x7f97640b1aa0 2023-09-30T22:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.916+0000 7f97627fc700 1 -- 172.21.15.142:0/2280982445 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c00b9d0 con 0x7f97640b1aa0 2023-09-30T22:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.916+0000 7f97627fc700 1 -- 172.21.15.142:0/2280982445 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0092e0 con 0x7f97640b1aa0 2023-09-30T22:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.916+0000 7f9769bff700 1 -- 172.21.15.142:0/2280982445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97640b1aa0 msgr2=0x7f97640ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.916+0000 7f9769bff700 1 --2- 172.21.15.142:0/2280982445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97640b1aa0 0x7f97640ca410 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f975c009f20 tx=0x7f975c009840 comp rx=0 tx=0).stop 2023-09-30T22:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.917+0000 7f9769bff700 1 -- 172.21.15.142:0/2280982445 shutdown_connections 2023-09-30T22:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.917+0000 7f9769bff700 1 --2- 172.21.15.142:0/2280982445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97640b1aa0 0x7f97640ca410 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.917+0000 7f9769bff700 1 --2- 172.21.15.142:0/2280982445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9764159a10 0x7f97640c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.917+0000 7f9769bff700 1 -- 172.21.15.142:0/2280982445 >> 172.21.15.142:0/2280982445 conn(0x7f97640cb2f0 msgr2=0x7f97640cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.917+0000 7f9769bff700 1 -- 172.21.15.142:0/2280982445 shutdown_connections 2023-09-30T22:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.917+0000 7f9769bff700 1 -- 172.21.15.142:0/2280982445 wait complete. 2023-09-30T22:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.918+0000 7f9769bff700 1 Processor -- start 2023-09-30T22:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.918+0000 7f9769bff700 1 -- start start 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9769bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97640b1aa0 0x7f976416ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9769bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9764159a10 0x7f976416b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9769bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9764159de0 0x7f976416daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9769bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976416d8b0 con 0x7f9764159de0 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9769bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976415cc10 con 0x7f9764159a10 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9769bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976415c8e0 con 0x7f97640b1aa0 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9763fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9764159de0 0x7f976416daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:55.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9763fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9764159de0 0x7f976416daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52996/0 (socket says 172.21.15.142:52996) 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.919+0000 7f9763fff700 1 -- 172.21.15.142:0/1641169323 learned_addr learned my addr 172.21.15.142:0/1641169323 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f97637fe700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97640b1aa0 0x7f976416ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f9762ffd700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9764159a10 0x7f976416b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f9763fff700 1 -- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97640b1aa0 msgr2=0x7f976416ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f9763fff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97640b1aa0 0x7f976416ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f9763fff700 1 -- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9764159a10 msgr2=0x7f976416b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f9763fff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9764159a10 0x7f976416b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f9763fff700 1 -- 172.21.15.142:0/1641169323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009ae0 con 0x7f9764159de0 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f9763fff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9764159de0 0x7f976416daa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f975c00b610 tx=0x7f975c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f974b7fe700 1 -- 172.21.15.142:0/1641169323 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c008ae0 con 0x7f9764159de0 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f974b7fe700 1 -- 172.21.15.142:0/1641169323 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c008c40 con 0x7f9764159de0 2023-09-30T22:53:55.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.920+0000 7f974b7fe700 1 -- 172.21.15.142:0/1641169323 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c026460 con 0x7f9764159de0 2023-09-30T22:53:55.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.921+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976416e3a0 con 0x7f9764159de0 2023-09-30T22:53:55.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.921+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976416e960 con 0x7f9764159de0 2023-09-30T22:53:55.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.922+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976415c740 con 0x7f9764159de0 2023-09-30T22:53:55.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.922+0000 7f974b7fe700 1 -- 172.21.15.142:0/1641169323 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f975c003040 con 0x7f9764159de0 2023-09-30T22:53:55.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.923+0000 7f974b7fe700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9750067330 0x7f97500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:55.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.923+0000 7f974b7fe700 1 -- 172.21.15.142:0/1641169323 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f975c086b60 con 0x7f9764159de0 2023-09-30T22:53:55.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.924+0000 7f97637fe700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9750067330 0x7f97500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:55.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.924+0000 7f97637fe700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9750067330 0x7f97500697e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9754009db0 tx=0x7f97540091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:55.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:55.928+0000 7f974b7fe700 1 -- 172.21.15.142:0/1641169323 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f976415c740 con 0x7f9764159de0 2023-09-30T22:53:56.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.119+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f976415c740 con 0x7f9764159de0 2023-09-30T22:53:56.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.703+0000 7f974b7fe700 1 -- 172.21.15.142:0/1641169323 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f976415c740 con 0x7f9764159de0 2023-09-30T22:53:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9750067330 msgr2=0x7f97500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9750067330 0x7f97500697e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9754009db0 tx=0x7f97540091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9764159de0 msgr2=0x7f976416daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9764159de0 0x7f976416daa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f975c00b610 tx=0x7f975c018000 comp rx=0 tx=0).stop 2023-09-30T22:53:56.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 shutdown_connections 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9750067330 0x7f97500697e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9764159de0 0x7f976416daa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97640b1aa0 0x7f976416ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 --2- 172.21.15.142:0/1641169323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9764159a10 0x7f976416b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 >> 172.21.15.142:0/1641169323 conn(0x7f97640cb2f0 msgr2=0x7f97640b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 shutdown_connections 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.707+0000 7f9769bff700 1 -- 172.21.15.142:0/1641169323 wait complete. 2023-09-30T22:53:56.709 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:53:56.726 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:53:56.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.916+0000 7fcd941ff700 1 Processor -- start 2023-09-30T22:53:56.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.917+0000 7fcd941ff700 1 -- start start 2023-09-30T22:53:56.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd941ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c15ac40 0x7fcd8c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:56.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd941ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd8c0cf180 0x7fcd8c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:56.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd941ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd8c0cc0b0 0x7fcd8c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:56.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd941ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c0d04e0 con 0x7fcd8c0cf180 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd941ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c0cc4f0 con 0x7fcd8c0cc0b0 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd941ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0cc8f0 con 0x7fcd8c15ac40 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd9179a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd8c0cf180 0x7fcd8c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd9179a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd8c0cf180 0x7fcd8c0cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53006/0 (socket says 172.21.15.142:53006) 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd9179a700 1 -- 172.21.15.142:0/1467009184 learned_addr learned my addr 172.21.15.142:0/1467009184 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd9279c700 1 --2- 172.21.15.142:0/1467009184 >> v2:172.21.15.148:3300/0 conn(0x7fcd8c0cc0b0 0x7fcd8c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.918+0000 7fcd91f9b700 1 --2- 172.21.15.142:0/1467009184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c15ac40 0x7fcd8c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd9179a700 1 -- 172.21.15.142:0/1467009184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c15ac40 msgr2=0x7fcd8c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd9179a700 1 --2- 172.21.15.142:0/1467009184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c15ac40 0x7fcd8c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd9179a700 1 -- 172.21.15.142:0/1467009184 >> v2:172.21.15.148:3300/0 conn(0x7fcd8c0cc0b0 msgr2=0x7fcd8c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:56.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd9179a700 1 --2- 172.21.15.142:0/1467009184 >> v2:172.21.15.148:3300/0 conn(0x7fcd8c0cc0b0 0x7fcd8c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd9179a700 1 -- 172.21.15.142:0/1467009184 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0cf8d0 con 0x7fcd8c0cf180 2023-09-30T22:53:56.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd9179a700 1 --2- 172.21.15.142:0/1467009184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c0cbb70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c157da0 tx=0x7fcd7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d240cbb9ef1aaf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:56.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd90f99700 1 -- 172.21.15.142:0/1467009184 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00b640 con 0x7fcd8c0cf180 2023-09-30T22:53:56.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd90f99700 1 -- 172.21.15.142:0/1467009184 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c00b7a0 con 0x7fcd8c0cf180 2023-09-30T22:53:56.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.919+0000 7fcd90f99700 1 -- 172.21.15.142:0/1467009184 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00bb60 con 0x7fcd8c0cf180 2023-09-30T22:53:56.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 -- 172.21.15.142:0/1467009184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 msgr2=0x7fcd8c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:56.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1467009184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c0cbb70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c157da0 tx=0x7fcd7c009250 comp rx=0 tx=0).stop 2023-09-30T22:53:56.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 -- 172.21.15.142:0/1467009184 shutdown_connections 2023-09-30T22:53:56.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1467009184 >> v2:172.21.15.148:3300/0 conn(0x7fcd8c0cc0b0 0x7fcd8c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1467009184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c15ac40 0x7fcd8c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1467009184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c0cbb70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 -- 172.21.15.142:0/1467009184 >> 172.21.15.142:0/1467009184 conn(0x7fcd8c0d0a80 msgr2=0x7fcd8c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:56.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 -- 172.21.15.142:0/1467009184 shutdown_connections 2023-09-30T22:53:56.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.920+0000 7fcd941ff700 1 -- 172.21.15.142:0/1467009184 wait complete. 2023-09-30T22:53:56.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.922+0000 7fcd941ff700 1 Processor -- start 2023-09-30T22:53:56.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.922+0000 7fcd941ff700 1 -- start start 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.923+0000 7fcd941ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c0cc0b0 0x7fcd8c153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.923+0000 7fcd941ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c14fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd941ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd8c15ac40 0x7fcd8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd941ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c06e610 con 0x7fcd8c0cf180 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd941ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c15e2d0 con 0x7fcd8c15ac40 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd941ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c15d9a0 con 0x7fcd8c0cc0b0 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c14fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:56.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c14fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53022/0 (socket says 172.21.15.142:53022) 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 -- 172.21.15.142:0/1232570356 learned_addr learned my addr 172.21.15.142:0/1232570356 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 -- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c0cc0b0 msgr2=0x7fcd8c153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd91f9b700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c0cc0b0 0x7fcd8c153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9279c700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd8c15ac40 0x7fcd8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c0cc0b0 0x7fcd8c153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 -- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd8c15ac40 msgr2=0x7fcd8c06d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd8c15ac40 0x7fcd8c06d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 -- 172.21.15.142:0/1232570356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0094f0 con 0x7fcd8c0cf180 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd91f9b700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c0cc0b0 0x7fcd8c153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9279c700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd8c15ac40 0x7fcd8c06d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.924+0000 7fcd9179a700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c14fe70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c06cee0 tx=0x7fcd7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:56.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.925+0000 7fcd81ffb700 1 -- 172.21.15.142:0/1232570356 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c000d10 con 0x7fcd8c0cf180 2023-09-30T22:53:56.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.925+0000 7fcd81ffb700 1 -- 172.21.15.142:0/1232570356 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c00bb20 con 0x7fcd8c0cf180 2023-09-30T22:53:56.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.925+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c15dc80 con 0x7fcd8c0cf180 2023-09-30T22:53:56.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.925+0000 7fcd81ffb700 1 -- 172.21.15.142:0/1232570356 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c011670 con 0x7fcd8c0cf180 2023-09-30T22:53:56.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.925+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c153f50 con 0x7fcd8c0cf180 2023-09-30T22:53:56.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.926+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c154140 con 0x7fcd8c0cf180 2023-09-30T22:53:56.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.927+0000 7fcd81ffb700 1 -- 172.21.15.142:0/1232570356 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcd7c0119e0 con 0x7fcd8c0cf180 2023-09-30T22:53:56.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.928+0000 7fcd81ffb700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd70067330 0x7fcd700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:56.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.928+0000 7fcd81ffb700 1 -- 172.21.15.142:0/1232570356 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fcd7c0863c0 con 0x7fcd8c0cf180 2023-09-30T22:53:56.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.928+0000 7fcd91f9b700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd70067330 0x7fcd700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:56.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.928+0000 7fcd91f9b700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd70067330 0x7fcd700697e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006f00 tx=0x7fcd88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:56.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:56.932+0000 7fcd81ffb700 1 -- 172.21.15.142:0/1232570356 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcd7c053380 con 0x7fcd8c0cf180 2023-09-30T22:53:57.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.123+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcd8c15d6f0 con 0x7fcd8c0cf180 2023-09-30T22:53:57.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.706+0000 7fcd81ffb700 1 -- 172.21.15.142:0/1232570356 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcd7c0569a0 con 0x7fcd8c0cf180 2023-09-30T22:53:57.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd70067330 msgr2=0x7fcd700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd70067330 0x7fcd700697e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006f00 tx=0x7fcd88008040 comp rx=0 tx=0).stop 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 msgr2=0x7fcd8c14fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c14fe70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c06cee0 tx=0x7fcd7c017000 comp rx=0 tx=0).stop 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 shutdown_connections 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcd70067330 0x7fcd700697e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd8c15ac40 0x7fcd8c06d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd8c0cc0b0 0x7fcd8c153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 --2- 172.21.15.142:0/1232570356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd8c0cf180 0x7fcd8c14fe70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 >> 172.21.15.142:0/1232570356 conn(0x7fcd8c0d0a80 msgr2=0x7fcd8c15b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 shutdown_connections 2023-09-30T22:53:57.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.709+0000 7fcd941ff700 1 -- 172.21.15.142:0/1232570356 wait complete. 2023-09-30T22:53:57.712 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:53:57.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T22:53:57.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.921+0000 7f1dce5ff700 1 Processor -- start 2023-09-30T22:53:57.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.921+0000 7f1dce5ff700 1 -- start start 2023-09-30T22:53:57.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.922+0000 7f1dce5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cbfe0 0x7f1dc815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:57.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.922+0000 7f1dce5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1dc80cc3b0 0x7f1dc80cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.922+0000 7f1dce5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc80d0550 con 0x7f1dc81573a0 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.922+0000 7f1dce5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc80cf750 con 0x7f1dc80cc3b0 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.922+0000 7f1dce5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80cf940 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cbfe0 0x7f1dc815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1dc80cc3b0 0x7f1dc80cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cbfe0 0x7f1dc815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:35378/0 (socket says 172.21.15.142:35378) 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc7fff700 1 -- 172.21.15.142:0/310203850 learned_addr learned my addr 172.21.15.142:0/310203850 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc77fe700 1 -- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cbfe0 msgr2=0x7f1dc815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc77fe700 1 --2- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cbfe0 0x7f1dc815a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc77fe700 1 -- 172.21.15.142:0/310203850 >> v1:172.21.15.148:6789/0 conn(0x7f1dc81573a0 legacy=0x7f1dc815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:57.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc77fe700 1 -- 172.21.15.142:0/310203850 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80cfc20 con 0x7f1dc80cc3b0 2023-09-30T22:53:57.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc7fff700 1 --2- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cbfe0 0x7f1dc815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:57.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.923+0000 7f1dc77fe700 1 --2- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc80cc3b0 0x7f1dc80cf210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009910 tx=0x7f1dbc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf8873a5b0a231a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dc6ffd700 1 -- 172.21.15.142:0/310203850 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00b640 con 0x7f1dc80cc3b0 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dc6ffd700 1 -- 172.21.15.142:0/310203850 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00b7a0 con 0x7f1dc80cc3b0 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dc6ffd700 1 -- 172.21.15.142:0/310203850 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00bb60 con 0x7f1dc80cc3b0 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 -- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc80cc3b0 msgr2=0x7f1dc80cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc80cc3b0 0x7f1dc80cf210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009910 tx=0x7f1dbc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 -- 172.21.15.142:0/310203850 shutdown_connections 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cbfe0 0x7f1dc815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/310203850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc80cc3b0 0x7f1dc80cf210 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 -- 172.21.15.142:0/310203850 >> 172.21.15.142:0/310203850 conn(0x7f1dc80d0a80 msgr2=0x7f1dc80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:57.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 -- 172.21.15.142:0/310203850 shutdown_connections 2023-09-30T22:53:57.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.924+0000 7f1dce5ff700 1 -- 172.21.15.142:0/310203850 wait complete. 2023-09-30T22:53:57.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.926+0000 7f1dce5ff700 1 Processor -- start 2023-09-30T22:53:57.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.926+0000 7f1dce5ff700 1 -- start start 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dce5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dc80cbfe0 0x7f1dc80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dce5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cc3b0 0x7f1dc814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dce5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc81573a0 0x7f1dc8159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dce5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80c9e60 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dce5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8151d30 con 0x7f1dc81573a0 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dce5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80c8f50 con 0x7f1dc80cc3b0 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dc80cbfe0 0x7f1dc80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dc80cbfe0 0x7f1dc80c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53026/0 (socket says 172.21.15.142:53026) 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dc7fff700 1 -- 172.21.15.142:0/2630542621 learned_addr learned my addr 172.21.15.142:0/2630542621 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:57.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.927+0000 7f1dc77fe700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cc3b0 0x7f1dc814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dc7fff700 1 -- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cc3b0 msgr2=0x7f1dc814cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dccb9c700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc81573a0 0x7f1dc8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dc7fff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cc3b0 0x7f1dc814cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dc7fff700 1 -- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc81573a0 msgr2=0x7f1dc8159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dc7fff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc81573a0 0x7f1dc8159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dc7fff700 1 -- 172.21.15.142:0/2630542621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80094f0 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dc77fe700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cc3b0 0x7f1dc814cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dccb9c700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc81573a0 0x7f1dc8159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dc7fff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dc80cbfe0 0x7f1dc80c8700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ec80 tx=0x7f1db8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1daffff700 1 -- 172.21.15.142:0/2630542621 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800c9d0 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc009420 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1daffff700 1 -- 172.21.15.142:0/2630542621 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db800cb30 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1daffff700 1 -- 172.21.15.142:0/2630542621 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800ceb0 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.928+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc80c9510 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.929+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc80ca140 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.930+0000 7f1daffff700 1 -- 172.21.15.142:0/2630542621 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1db8013680 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.931+0000 7f1daffff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1db4067330 0x7f1db40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:57.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.931+0000 7f1daffff700 1 -- 172.21.15.142:0/2630542621 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1db8085140 con 0x7f1dc80cbfe0 2023-09-30T22:53:57.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.931+0000 7f1dc77fe700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1db4067330 0x7f1db40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:57.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.932+0000 7f1dc77fe700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1db4067330 0x7f1db40697e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8153ff0 tx=0x7f1dbc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:57.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:57.935+0000 7f1daffff700 1 -- 172.21.15.142:0/2630542621 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1db80522a0 con 0x7f1dc80cbfe0 2023-09-30T22:53:58.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.136+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1dc80cb980 con 0x7f1dc80cbfe0 2023-09-30T22:53:58.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.140+0000 7f1daffff700 1 -- 172.21.15.142:0/2630542621 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1db80558c0 con 0x7f1dc80cbfe0 2023-09-30T22:53:58.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.142+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1db4067330 msgr2=0x7f1db40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.142+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1db4067330 0x7f1db40697e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8153ff0 tx=0x7f1dbc017000 comp rx=0 tx=0).stop 2023-09-30T22:53:58.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.142+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dc80cbfe0 msgr2=0x7f1dc80c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.142+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dc80cbfe0 0x7f1dc80c8700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ec80 tx=0x7f1db8009250 comp rx=0 tx=0).stop 2023-09-30T22:53:58.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 shutdown_connections 2023-09-30T22:53:58.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1db4067330 0x7f1db40697e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dc81573a0 0x7f1dc8159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dc80cbfe0 0x7f1dc80c8700 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 --2- 172.21.15.142:0/2630542621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1dc80cc3b0 0x7f1dc814cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 >> 172.21.15.142:0/2630542621 conn(0x7f1dc80d0a80 msgr2=0x7f1dc806d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:58.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 shutdown_connections 2023-09-30T22:53:58.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.143+0000 7f1dce5ff700 1 -- 172.21.15.142:0/2630542621 wait complete. 2023-09-30T22:53:58.161 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-09-30T22:53:58.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.349+0000 7fa8871ff700 1 Processor -- start 2023-09-30T22:53:58.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.350+0000 7fa8871ff700 1 -- start start 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa8871ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8801598e0 0x7fa880159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa8871ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa8800d03d0 0x7fa88015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa8871ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88006b8d0 con 0x7fa8800cee50 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa8871ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800cff40 con 0x7fa8801598e0 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa8871ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800cf330 con 0x7fa8800d03d0 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa884f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8801598e0 0x7fa880159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa884f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8801598e0 0x7fa880159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53034/0 (socket says 172.21.15.142:53034) 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa884f9b700 1 -- 172.21.15.142:0/3715814473 learned_addr learned my addr 172.21.15.142:0/3715814473 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa87ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa8800cee50 0x7fa88006b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52060/0 (socket says 172.21.15.142:52060) 2023-09-30T22:53:58.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.351+0000 7fa88579c700 1 --2- 172.21.15.142:0/3715814473 >> v2:172.21.15.148:3300/0 conn(0x7fa8800d03d0 0x7fa88015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa884f9b700 1 -- 172.21.15.142:0/3715814473 >> v2:172.21.15.148:3300/0 conn(0x7fa8800d03d0 msgr2=0x7fa88015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:58.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa884f9b700 1 --2- 172.21.15.142:0/3715814473 >> v2:172.21.15.148:3300/0 conn(0x7fa8800d03d0 0x7fa88015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa884f9b700 1 -- 172.21.15.142:0/3715814473 >> v1:172.21.15.142:6789/0 conn(0x7fa8800cee50 legacy=0x7fa88006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa884f9b700 1 -- 172.21.15.142:0/3715814473 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800cf610 con 0x7fa8801598e0 2023-09-30T22:53:58.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa88579c700 1 --2- 172.21.15.142:0/3715814473 >> v2:172.21.15.148:3300/0 conn(0x7fa8800d03d0 0x7fa88015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:53:58.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa884f9b700 1 --2- 172.21.15.142:0/3715814473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8801598e0 0x7fa880159cb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa8800cfeb0 tx=0x7fa874009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52f33bc0720ef62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa87f7fe700 1 -- 172.21.15.142:0/3715814473 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400b860 con 0x7fa8801598e0 2023-09-30T22:53:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa87f7fe700 1 -- 172.21.15.142:0/3715814473 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400b9c0 con 0x7fa8801598e0 2023-09-30T22:53:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.352+0000 7fa87f7fe700 1 -- 172.21.15.142:0/3715814473 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400bd60 con 0x7fa8801598e0 2023-09-30T22:53:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 -- 172.21.15.142:0/3715814473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8801598e0 msgr2=0x7fa880159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 --2- 172.21.15.142:0/3715814473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8801598e0 0x7fa880159cb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa8800cfeb0 tx=0x7fa874009250 comp rx=0 tx=0).stop 2023-09-30T22:53:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 -- 172.21.15.142:0/3715814473 shutdown_connections 2023-09-30T22:53:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 --2- 172.21.15.142:0/3715814473 >> v2:172.21.15.148:3300/0 conn(0x7fa8800d03d0 0x7fa88015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 --2- 172.21.15.142:0/3715814473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8801598e0 0x7fa880159cb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 -- 172.21.15.142:0/3715814473 >> 172.21.15.142:0/3715814473 conn(0x7fa8800cd540 msgr2=0x7fa8800cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:58.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 -- 172.21.15.142:0/3715814473 shutdown_connections 2023-09-30T22:53:58.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.353+0000 7fa8871ff700 1 -- 172.21.15.142:0/3715814473 wait complete. 2023-09-30T22:53:58.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.354+0000 7fa8871ff700 1 Processor -- start 2023-09-30T22:53:58.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.354+0000 7fa8871ff700 1 -- start start 2023-09-30T22:53:58.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa8871ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8800cee50 0x7fa8800c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa8871ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8800d03d0 0x7fa8800c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa8871ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8801598e0 0x7fa8801560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa8871ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800c8130 con 0x7fa8800d03d0 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa8871ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800cb480 con 0x7fa8800cee50 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa8871ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800c8a70 con 0x7fa8801598e0 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa87ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8800d03d0 0x7fa8800c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa87ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8800d03d0 0x7fa8800c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53044/0 (socket says 172.21.15.142:53044) 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.355+0000 7fa87ffff700 1 -- 172.21.15.142:0/1667465335 learned_addr learned my addr 172.21.15.142:0/1667465335 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa88579c700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8801598e0 0x7fa8801560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa884f9b700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8800cee50 0x7fa8800c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87ffff700 1 -- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8801598e0 msgr2=0x7fa8801560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87ffff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8801598e0 0x7fa8801560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87ffff700 1 -- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8800cee50 msgr2=0x7fa8800c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87ffff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8800cee50 0x7fa8800c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87ffff700 1 -- 172.21.15.142:0/1667465335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740094f0 con 0x7fa8800d03d0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa884f9b700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8800cee50 0x7fa8800c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87ffff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8800d03d0 0x7fa8800c7bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c7c0 tx=0x7fa86c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87cff9700 1 -- 172.21.15.142:0/1667465335 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c005a70 con 0x7fa8800d03d0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87cff9700 1 -- 172.21.15.142:0/1667465335 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c005bf0 con 0x7fa8800d03d0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8800cabe0 con 0x7fa8800d03d0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa87cff9700 1 -- 172.21.15.142:0/1667465335 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0070f0 con 0x7fa8800d03d0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.356+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8800cb1a0 con 0x7fa8800d03d0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.357+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8800697b0 con 0x7fa8800d03d0 2023-09-30T22:53:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.358+0000 7fa87cff9700 1 -- 172.21.15.142:0/1667465335 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa86c007460 con 0x7fa8800d03d0 2023-09-30T22:53:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.360+0000 7fa87cff9700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa864067330 0x7fa8640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.360+0000 7fa87cff9700 1 -- 172.21.15.142:0/1667465335 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa86c0843b0 con 0x7fa8800d03d0 2023-09-30T22:53:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.360+0000 7fa884f9b700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa864067330 0x7fa8640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.360+0000 7fa884f9b700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa864067330 0x7fa8640697e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa8800cfeb0 tx=0x7fa874017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:58.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.364+0000 7fa87cff9700 1 -- 172.21.15.142:0/1667465335 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa86c051590 con 0x7fa8800d03d0 2023-09-30T22:53:58.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.630+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fa88006fc10 con 0x7fa8800d03d0 2023-09-30T22:53:58.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.711+0000 7fa87cff9700 1 -- 172.21.15.142:0/1667465335 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v103) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa86c054bb0 con 0x7fa8800d03d0 2023-09-30T22:53:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.713+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa864067330 msgr2=0x7fa8640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.713+0000 7fa8871ff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa864067330 0x7fa8640697e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa8800cfeb0 tx=0x7fa874017000 comp rx=0 tx=0).stop 2023-09-30T22:53:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.713+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8800d03d0 msgr2=0x7fa8800c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8800d03d0 0x7fa8800c7bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c7c0 tx=0x7fa86c007f70 comp rx=0 tx=0).stop 2023-09-30T22:53:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 shutdown_connections 2023-09-30T22:53:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa864067330 0x7fa8640697e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8801598e0 0x7fa8801560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8800cee50 0x7fa8800c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 --2- 172.21.15.142:0/1667465335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8800d03d0 0x7fa8800c7bf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 >> 172.21.15.142:0/1667465335 conn(0x7fa8800cd540 msgr2=0x7fa880067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 shutdown_connections 2023-09-30T22:53:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.714+0000 7fa8871ff700 1 -- 172.21.15.142:0/1667465335 wait complete. 2023-09-30T22:53:58.733 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-09-30T22:53:58.733 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-09-30T22:53:58.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-09-30T22:53:58.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.921+0000 7f70b69ff700 1 Processor -- start 2023-09-30T22:53:58.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.921+0000 7f70b69ff700 1 -- start start 2023-09-30T22:53:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.922+0000 7f70b69ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.922+0000 7f70b69ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f70b00b1180 0x7f70b00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.922+0000 7f70b69ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b015d910 con 0x7f70b0159eb0 2023-09-30T22:53:58.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.922+0000 7f70b69ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b015e920 con 0x7f70b00b1180 2023-09-30T22:53:58.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.922+0000 7f70b69ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b015e490 con 0x7f70b0159ae0 2023-09-30T22:53:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70af7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f70b00b1180 0x7f70b00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70affff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70affff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:35406/0 (socket says 172.21.15.142:35406) 2023-09-30T22:53:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70af7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f70b00b1180 0x7f70b00cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:35252/0 (socket says 172.21.15.142:35252) 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70affff700 1 -- 172.21.15.142:0/2535382629 learned_addr learned my addr 172.21.15.142:0/2535382629 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70af7fe700 1 -- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 msgr2=0x7f70b00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70af7fe700 1 --2- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70af7fe700 1 -- 172.21.15.142:0/2535382629 >> v1:172.21.15.148:6789/0 conn(0x7f70b0159eb0 legacy=0x7f70b0068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70af7fe700 1 -- 172.21.15.142:0/2535382629 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b015db60 con 0x7f70b00b1180 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70affff700 1 --2- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.923+0000 7f70aeffd700 1 -- 172.21.15.142:0/2535382629 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365079342 0 0) 0x7f70b015d910 con 0x7f70b0159eb0 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70af7fe700 1 --2- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 0x7f70b00cbe80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70a40098e0 tx=0x7f70a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa5a035e6df6781 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70aeffd700 1 -- 172.21.15.142:0/2535382629 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400b640 con 0x7f70b00b1180 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70aeffd700 1 -- 172.21.15.142:0/2535382629 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400b7a0 con 0x7f70b00b1180 2023-09-30T22:53:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70aeffd700 1 -- 172.21.15.142:0/2535382629 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400bb40 con 0x7f70b00b1180 2023-09-30T22:53:58.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70b69ff700 1 -- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 msgr2=0x7f70b00cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70b69ff700 1 --2- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 0x7f70b00cbe80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70a40098e0 tx=0x7f70a40091a0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70b69ff700 1 -- 172.21.15.142:0/2535382629 shutdown_connections 2023-09-30T22:53:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70b69ff700 1 --2- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70b69ff700 1 --2- 172.21.15.142:0/2535382629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 0x7f70b00cbe80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.924+0000 7f70b69ff700 1 -- 172.21.15.142:0/2535382629 >> 172.21.15.142:0/2535382629 conn(0x7f70b00ce8b0 msgr2=0x7f70b00cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.925+0000 7f70b69ff700 1 -- 172.21.15.142:0/2535382629 shutdown_connections 2023-09-30T22:53:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.925+0000 7f70b69ff700 1 -- 172.21.15.142:0/2535382629 wait complete. 2023-09-30T22:53:58.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.926+0000 7f70b69ff700 1 Processor -- start 2023-09-30T22:53:58.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.926+0000 7f70b69ff700 1 -- start start 2023-09-30T22:53:58.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b69ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 0x7f70b00afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b69ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b69ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b0159eb0 0x7f70b00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b69ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00c9500 con 0x7f70b0159eb0 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b69ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0155f10 con 0x7f70b00b1180 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b69ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00b02e0 con 0x7f70b0159ae0 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b4f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b0159eb0 0x7f70b00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70affff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 0x7f70b00afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b4f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b0159eb0 0x7f70b00ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53054/0 (socket says 172.21.15.142:53054) 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70b4f9c700 1 -- 172.21.15.142:0/1491987638 learned_addr learned my addr 172.21.15.142:0/1491987638 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.927+0000 7f70af7fe700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b4f9c700 1 -- 172.21.15.142:0/1491987638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 msgr2=0x7f70b00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b4f9c700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b4f9c700 1 -- 172.21.15.142:0/1491987638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 msgr2=0x7f70b00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b4f9c700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 0x7f70b00afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b4f9c700 1 -- 172.21.15.142:0/1491987638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00094f0 con 0x7f70b0159eb0 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b4f9c700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b0159eb0 0x7f70b00ca9b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c890 tx=0x7f70a8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f7097fff700 1 -- 172.21.15.142:0/1491987638 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8012630 con 0x7f70b0159eb0 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f7097fff700 1 -- 172.21.15.142:0/1491987638 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8012790 con 0x7f70b0159eb0 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f7097fff700 1 -- 172.21.15.142:0/1491987638 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8012b50 con 0x7f70b0159eb0 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a4009420 con 0x7f70b0159eb0 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.928+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b01558c0 con 0x7f70b0159eb0 2023-09-30T22:53:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.929+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b01560a0 con 0x7f70b0159eb0 2023-09-30T22:53:58.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.930+0000 7f7097fff700 1 -- 172.21.15.142:0/1491987638 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f70a801a3a0 con 0x7f70b0159eb0 2023-09-30T22:53:58.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.932+0000 7f7097fff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f709c067330 0x7f709c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:53:58.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.932+0000 7f7097fff700 1 -- 172.21.15.142:0/1491987638 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f70a8084b30 con 0x7f70b0159eb0 2023-09-30T22:53:58.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.932+0000 7f70affff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f709c067330 0x7f709c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:53:58.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.932+0000 7f70affff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f709c067330 0x7f709c0697e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70a0006d20 tx=0x7f70a0009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:53:58.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:58.936+0000 7f7097fff700 1 -- 172.21.15.142:0/1491987638 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f70a8051c90 con 0x7f70b0159eb0 2023-09-30T22:53:59.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.202+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f70b015de40 con 0x7f70b0159eb0 2023-09-30T22:53:59.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.713+0000 7f7097fff700 1 -- 172.21.15.142:0/1491987638 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v104) v1 ==== 145+0+0 (secure 0 0 0) 0x7f70a80552b0 con 0x7f70b0159eb0 2023-09-30T22:53:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f709c067330 msgr2=0x7f709c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f709c067330 0x7f709c0697e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70a0006d20 tx=0x7f70a0009250 comp rx=0 tx=0).stop 2023-09-30T22:53:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b0159eb0 msgr2=0x7f70b00ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b0159eb0 0x7f70b00ca9b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c890 tx=0x7f70a8001670 comp rx=0 tx=0).stop 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 shutdown_connections 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f709c067330 0x7f709c0697e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b0159eb0 0x7f70b00ca9b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70b00b1180 0x7f70b00afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 --2- 172.21.15.142:0/1491987638 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70b0159ae0 0x7f70b00ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 >> 172.21.15.142:0/1491987638 conn(0x7f70b00ce8b0 msgr2=0x7f70b00b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 shutdown_connections 2023-09-30T22:53:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:53:59.716+0000 7f70b69ff700 1 -- 172.21.15.142:0/1491987638 wait complete. 2023-09-30T22:53:59.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-30T22:53:59.942 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_objectstore":"memstore"} 2023-09-30T22:53:59.942 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-30T22:53:59.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:54:00.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.133+0000 7f63419ff700 1 Processor -- start 2023-09-30T22:54:00.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.133+0000 7f63419ff700 1 -- start start 2023-09-30T22:54:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.134+0000 7f63419ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c159ba0 0x7f633c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.134+0000 7f63419ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f633c0b0de0 0x7f633c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.134+0000 7f63419ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c067d10 con 0x7f633c0ca410 2023-09-30T22:54:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.134+0000 7f63419ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c0ca850 con 0x7f633c0b0de0 2023-09-30T22:54:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.134+0000 7f63419ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c06af90 con 0x7f633c159ba0 2023-09-30T22:54:00.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f6333fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f633c0b0de0 0x7f633c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f633affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c159ba0 0x7f633c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f633b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f633c0ca410 0x7f633c15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:54202/0 (socket says 172.21.15.142:54202) 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f633b7fe700 1 -- 172.21.15.142:0/3119085641 learned_addr learned my addr 172.21.15.142:0/3119085641 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f633a7fc700 1 -- 172.21.15.142:0/3119085641 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300842267 0 0) 0x7f633c067d10 con 0x7f633c0ca410 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f633a7fc700 1 -- 172.21.15.142:0/3119085641 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6328003570 con 0x7f633c0ca410 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f6333fff700 1 -- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c159ba0 msgr2=0x7f633c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f6333fff700 1 --2- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c159ba0 0x7f633c06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f6333fff700 1 -- 172.21.15.142:0/3119085641 >> v1:172.21.15.148:6789/0 conn(0x7f633c0ca410 legacy=0x7f633c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f6333fff700 1 -- 172.21.15.142:0/3119085641 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0676c0 con 0x7f633c0b0de0 2023-09-30T22:54:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f633affd700 1 --2- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c159ba0 0x7f633c06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.135+0000 7f6333fff700 1 --2- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c0b0de0 0x7f633c0c9ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63240098e0 tx=0x7f63240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=173bc6fdce1bd8e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f633a7fc700 1 -- 172.21.15.142:0/3119085641 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324011630 con 0x7f633c0b0de0 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f633a7fc700 1 -- 172.21.15.142:0/3119085641 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324011790 con 0x7f633c0b0de0 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f633a7fc700 1 -- 172.21.15.142:0/3119085641 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324011b30 con 0x7f633c0b0de0 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 -- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c0b0de0 msgr2=0x7f633c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 --2- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c0b0de0 0x7f633c0c9ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63240098e0 tx=0x7f63240091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 -- 172.21.15.142:0/3119085641 shutdown_connections 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 --2- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c159ba0 0x7f633c06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 --2- 172.21.15.142:0/3119085641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c0b0de0 0x7f633c0c9ed0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 -- 172.21.15.142:0/3119085641 >> 172.21.15.142:0/3119085641 conn(0x7f633c0cb2f0 msgr2=0x7f633c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:00.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 -- 172.21.15.142:0/3119085641 shutdown_connections 2023-09-30T22:54:00.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.136+0000 7f63419ff700 1 -- 172.21.15.142:0/3119085641 wait complete. 2023-09-30T22:54:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.138+0000 7f63419ff700 1 Processor -- start 2023-09-30T22:54:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.138+0000 7f63419ff700 1 -- start start 2023-09-30T22:54:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f63419ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c0b0de0 0x7f633c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f63419ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f633c0ca410 0x7f633c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f63419ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c159ba0 0x7f633c0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f63419ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c3370 con 0x7f633c0ca410 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f63419ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c2760 con 0x7f633c159ba0 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f63419ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c2a40 con 0x7f633c0b0de0 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f633c0ca410 0x7f633c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f633c0ca410 0x7f633c157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53066/0 (socket says 172.21.15.142:53066) 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 -- 172.21.15.142:0/4036974287 learned_addr learned my addr 172.21.15.142:0/4036974287 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f633b7fe700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c159ba0 0x7f633c0c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f633affd700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c0b0de0 0x7f633c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 -- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c0b0de0 msgr2=0x7f633c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c0b0de0 0x7f633c0c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 -- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c159ba0 msgr2=0x7f633c0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c159ba0 0x7f633c0c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.139+0000 7f6333fff700 1 -- 172.21.15.142:0/4036974287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009420 con 0x7f633c0ca410 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.140+0000 7f6333fff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f633c0ca410 0x7f633c157370 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f633c06c8d0 tx=0x7f6324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.140+0000 7f6332ffd700 1 -- 172.21.15.142:0/4036974287 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324011900 con 0x7f633c0ca410 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.140+0000 7f6332ffd700 1 -- 172.21.15.142:0/4036974287 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324011a60 con 0x7f633c0ca410 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.140+0000 7f6332ffd700 1 -- 172.21.15.142:0/4036974287 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324023620 con 0x7f633c0ca410 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.140+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6324009420 con 0x7f633c0ca410 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.140+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c0c3000 con 0x7f633c0ca410 2023-09-30T22:54:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.141+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c0c34e0 con 0x7f633c0ca410 2023-09-30T22:54:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.142+0000 7f6332ffd700 1 -- 172.21.15.142:0/4036974287 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f632402c3b0 con 0x7f633c0ca410 2023-09-30T22:54:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.143+0000 7f6332ffd700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f631c067330 0x7f631c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.143+0000 7f6332ffd700 1 -- 172.21.15.142:0/4036974287 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6324085cc0 con 0x7f633c0ca410 2023-09-30T22:54:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.143+0000 7f633affd700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f631c067330 0x7f631c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.144+0000 7f633affd700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f631c067330 0x7f631c0697e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f632c009e10 tx=0x7f632c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:00.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.147+0000 7f6332ffd700 1 -- 172.21.15.142:0/4036974287 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f632408c080 con 0x7f633c0ca410 2023-09-30T22:54:00.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.338+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f633c0679a0 con 0x7f633c0ca410 2023-09-30T22:54:00.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.342+0000 7f6332ffd700 1 -- 172.21.15.142:0/4036974287 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6324052ea0 con 0x7f633c0ca410 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.344+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f631c067330 msgr2=0x7f631c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.344+0000 7f63419ff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f631c067330 0x7f631c0697e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f632c009e10 tx=0x7f632c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.344+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f633c0ca410 msgr2=0x7f633c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.344+0000 7f63419ff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f633c0ca410 0x7f633c157370 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f633c06c8d0 tx=0x7f6324017000 comp rx=0 tx=0).stop 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 shutdown_connections 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f631c067330 0x7f631c0697e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f633c159ba0 0x7f633c0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f633c0b0de0 0x7f633c0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 --2- 172.21.15.142:0/4036974287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f633c0ca410 0x7f633c157370 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 >> 172.21.15.142:0/4036974287 conn(0x7f633c0cb2f0 msgr2=0x7f633c0ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:00.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 shutdown_connections 2023-09-30T22:54:00.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.345+0000 7f63419ff700 1 -- 172.21.15.142:0/4036974287 wait complete. 2023-09-30T22:54:00.363 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:54:00.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:54:00.460 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:54:00.570 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:54:00.570 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:54:00.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:00.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.758+0000 7faa9abff700 1 Processor -- start 2023-09-30T22:54:00.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.758+0000 7faa9abff700 1 -- start start 2023-09-30T22:54:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa9abff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa9415a010 0x7faa9406a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa9abff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa940b0ee0 con 0x7faa940aebf0 2023-09-30T22:54:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa9abff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9406f360 con 0x7faa94159b90 2023-09-30T22:54:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa9abff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa940aefc0 con 0x7faa9415a010 2023-09-30T22:54:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa9899b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faa940aebf0 0x7faa9406ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52076/0 (socket says 172.21.15.142:52076) 2023-09-30T22:54:00.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa9899b700 1 -- 172.21.15.142:0/4022392517 learned_addr learned my addr 172.21.15.142:0/4022392517 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:00.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa9919c700 1 --2- 172.21.15.142:0/4022392517 >> v2:172.21.15.148:3300/0 conn(0x7faa9415a010 0x7faa9406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463520088 0 0) 0x7faa940b0ee0 con 0x7faa940aebf0 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.760+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa84003570 con 0x7faa940aebf0 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805091416 0 0) 0x7faa9406f360 con 0x7faa94159b90 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa940b0ee0 con 0x7faa94159b90 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398724526 0 0) 0x7faa84003570 con 0x7faa940aebf0 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 >> v2:172.21.15.148:3300/0 conn(0x7faa9415a010 msgr2=0x7faa9406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 --2- 172.21.15.142:0/4022392517 >> v2:172.21.15.148:3300/0 conn(0x7faa9415a010 0x7faa9406a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 >> v1:172.21.15.148:6789/0 conn(0x7faa94159b90 legacy=0x7faa94069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940b02d0 con 0x7faa940aebf0 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7faa88001470 con 0x7faa940aebf0 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 >> v1:172.21.15.142:6789/0 conn(0x7faa940aebf0 legacy=0x7faa9406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa84003bf0 0x7faa84003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa840051c0 0x7faa8400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa940aefc0 con 0x7faa84004810 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8400e2c0 con 0x7faa840051c0 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8400e480 con 0x7faa84003bf0 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa93fff700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa9919c700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa840051c0 0x7faa8400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.761+0000 7faa9899b700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa84003bf0 0x7faa84003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa93fff700 1 -- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa84003bf0 msgr2=0x7faa84003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa93fff700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa84003bf0 0x7faa84003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa93fff700 1 -- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa840051c0 msgr2=0x7faa8400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa93fff700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa840051c0 0x7faa8400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa9919c700 1 -- 172.21.15.142:0/4022392517 reap_dead start 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa93fff700 1 -- 172.21.15.142:0/4022392517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84003570 con 0x7faa84004810 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa93fff700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa84004c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7faa80001a50 tx=0x7faa80007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdad210c6c239cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000c590 con 0x7faa84004810 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80001e90 con 0x7faa84004810 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa937fe700 1 -- 172.21.15.142:0/4022392517 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000c920 con 0x7faa84004810 2023-09-30T22:54:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa9abff700 1 -- 172.21.15.142:0/4022392517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 msgr2=0x7faa84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.762+0000 7faa9abff700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa84004c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7faa80001a50 tx=0x7faa80007d30 comp rx=0 tx=0).stop 2023-09-30T22:54:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.763+0000 7faa9abff700 1 -- 172.21.15.142:0/4022392517 shutdown_connections 2023-09-30T22:54:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.763+0000 7faa9abff700 1 --2- 172.21.15.142:0/4022392517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa84004c80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.763+0000 7faa9abff700 1 -- 172.21.15.142:0/4022392517 >> 172.21.15.142:0/4022392517 conn(0x7faa940680c0 msgr2=0x7faa940c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.763+0000 7faa9abff700 1 -- 172.21.15.142:0/4022392517 shutdown_connections 2023-09-30T22:54:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.763+0000 7faa9abff700 1 -- 172.21.15.142:0/4022392517 wait complete. 2023-09-30T22:54:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.765+0000 7faa9abff700 1 Processor -- start 2023-09-30T22:54:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.765+0000 7faa9abff700 1 -- start start 2023-09-30T22:54:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9abff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa940cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9abff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa9414e960 0x7faa94150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9abff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa94151050 0x7faa94158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9abff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa941583c0 con 0x7faa84004810 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9abff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa94157530 con 0x7faa94151050 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9abff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9414c330 con 0x7faa9414e960 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9899b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa940cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9899b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa940cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53084/0 (socket says 172.21.15.142:53084) 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9899b700 1 -- 172.21.15.142:0/3298233600 learned_addr learned my addr 172.21.15.142:0/3298233600 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa9919c700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa94151050 0x7faa94158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.766+0000 7faa93fff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa9414e960 0x7faa94150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9899b700 1 -- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa9414e960 msgr2=0x7faa94150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9899b700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa9414e960 0x7faa94150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9899b700 1 -- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa94151050 msgr2=0x7faa94158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9899b700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa94151050 0x7faa94158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9899b700 1 -- 172.21.15.142:0/3298233600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa941577b0 con 0x7faa84004810 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9899b700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa940cb7e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa88001ed0 tx=0x7faa88001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa90ff9700 1 -- 172.21.15.142:0/3298233600 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88018030 con 0x7faa84004810 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa90ff9700 1 -- 172.21.15.142:0/3298233600 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88001090 con 0x7faa84004810 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa94157a90 con 0x7faa84004810 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa90ff9700 1 -- 172.21.15.142:0/3298233600 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800f910 con 0x7faa84004810 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.767+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa94158050 con 0x7faa84004810 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.768+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa940af1a0 con 0x7faa84004810 2023-09-30T22:54:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.769+0000 7faa90ff9700 1 -- 172.21.15.142:0/3298233600 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7faa8801b070 con 0x7faa84004810 2023-09-30T22:54:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.770+0000 7faa90ff9700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faa78067330 0x7faa780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.770+0000 7faa90ff9700 1 -- 172.21.15.142:0/3298233600 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faa88019070 con 0x7faa84004810 2023-09-30T22:54:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.770+0000 7faa93fff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faa78067330 0x7faa780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.771+0000 7faa93fff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faa78067330 0x7faa780697e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa80015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:00.774+0000 7faa90ff9700 1 -- 172.21.15.142:0/3298233600 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faa88051730 con 0x7faa84004810 2023-09-30T22:54:01.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.003+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa9406fc10 con 0x7faa84004810 2023-09-30T22:54:01.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.004+0000 7faa90ff9700 1 -- 172.21.15.142:0/3298233600 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3541 (secure 0 0 0) 0x7faa88054d50 con 0x7faa84004810 2023-09-30T22:54:01.005 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:01.005 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1611227569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1611227569},{"type":"v1","addr":"172.21.15.142:6837","nonce":1611227569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3550501676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3550501676},{"type":"v1","addr":"172.21.15.148:6834","nonce":3550501676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1534149071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1534149071},{"type":"v1","addr":"172.21.15.142:6836","nonce":1534149071}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1904883815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1904883815},{"type":"v1","addr":"172.21.15.148:6835","nonce":1904883815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2023-09-30T22:54:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faa78067330 msgr2=0x7faa780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faa78067330 0x7faa780697e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa80015000 comp rx=0 tx=0).stop 2023-09-30T22:54:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 msgr2=0x7faa940cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa940cb7e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa88001ed0 tx=0x7faa88001df0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 shutdown_connections 2023-09-30T22:54:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faa78067330 0x7faa780697e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa94151050 0x7faa94158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa84004810 0x7faa940cb7e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 --2- 172.21.15.142:0/3298233600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa9414e960 0x7faa94150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.006+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 >> 172.21.15.142:0/3298233600 conn(0x7faa940680c0 msgr2=0x7faa9406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:01.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.007+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 shutdown_connections 2023-09-30T22:54:01.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.007+0000 7faa9abff700 1 -- 172.21.15.142:0/3298233600 wait complete. 2023-09-30T22:54:01.009 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 17 2023-09-30T22:54:01.025 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:54:01.025 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:54:01.025 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:54:01.026 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:01.026 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:54:01.026 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:54:01.026 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:54:01.026 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:01.026 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:54:01.027 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:54:01.027 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:54:01.027 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:01.027 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:54:01.027 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:54:01.027 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:54:01.027 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:01.042 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:54:01.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:54:01.043 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:54:01.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:54:01.044 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:54:01.044 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:54:01.045 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:54:01.045 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:54:01.087 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:54:01.087 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:01.088 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:54:01.088 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:01.090 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:54:01.090 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:01.091 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:54:01.091 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:01.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:54:01.234 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:54:01.234 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:54:01.235 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:54:01.235 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:54:01.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.295+0000 7f06521ff700 1 Processor -- start 2023-09-30T22:54:01.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.295+0000 7f06521ff700 1 -- start start 2023-09-30T22:54:01.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.296+0000 7f06521ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f064c0af020 0x7f064c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.296+0000 7f06521ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f064c06e820 0x7f064c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.296+0000 7f06521ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c06d3e0 con 0x7f064c0b00d0 2023-09-30T22:54:01.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.296+0000 7f06521ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c06dc80 con 0x7f064c0af020 2023-09-30T22:54:01.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.296+0000 7f06521ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c06eca0 con 0x7f064c06e820 2023-09-30T22:54:01.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f064c0af020 0x7f064c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f064c0af020 0x7f064c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56494/0 (socket says 172.21.15.142:56494) 2023-09-30T22:54:01.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 -- 172.21.15.142:0/1211838869 learned_addr learned my addr 172.21.15.142:0/1211838869 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:01.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064bfff700 1 --2- 172.21.15.142:0/1211838869 >> v2:172.21.15.148:3300/0 conn(0x7f064c06e820 0x7f064c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 -- 172.21.15.142:0/1211838869 >> v2:172.21.15.148:3300/0 conn(0x7f064c06e820 msgr2=0x7f064c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:01.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 --2- 172.21.15.142:0/1211838869 >> v2:172.21.15.148:3300/0 conn(0x7f064c06e820 0x7f064c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 -- 172.21.15.142:0/1211838869 >> v1:172.21.15.142:6789/0 conn(0x7f064c0b00d0 legacy=0x7f064c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 -- 172.21.15.142:0/1211838869 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c06b790 con 0x7f064c0af020 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064a7fc700 1 -- 172.21.15.142:0/1211838869 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309646364 0 0) 0x7f064c06d3e0 con 0x7f064c0b00d0 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.297+0000 7f064b7fe700 1 --2- 172.21.15.142:0/1211838869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c0af020 0x7f064c156d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f063c0099b0 tx=0x7f063c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c218e685592c0907 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f064a7fc700 1 -- 172.21.15.142:0/1211838869 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c009ea0 con 0x7f064c0af020 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f064a7fc700 1 -- 172.21.15.142:0/1211838869 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c00b820 con 0x7f064c0af020 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f064a7fc700 1 -- 172.21.15.142:0/1211838869 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00bbc0 con 0x7f064c0af020 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 -- 172.21.15.142:0/1211838869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c0af020 msgr2=0x7f064c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 --2- 172.21.15.142:0/1211838869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c0af020 0x7f064c156d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f063c0099b0 tx=0x7f063c009250 comp rx=0 tx=0).stop 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 -- 172.21.15.142:0/1211838869 shutdown_connections 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 --2- 172.21.15.142:0/1211838869 >> v2:172.21.15.148:3300/0 conn(0x7f064c06e820 0x7f064c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 --2- 172.21.15.142:0/1211838869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c0af020 0x7f064c156d80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 -- 172.21.15.142:0/1211838869 >> 172.21.15.142:0/1211838869 conn(0x7f064c0680c0 msgr2=0x7f064c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:01.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 -- 172.21.15.142:0/1211838869 shutdown_connections 2023-09-30T22:54:01.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.298+0000 7f06521ff700 1 -- 172.21.15.142:0/1211838869 wait complete. 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.300+0000 7f06521ff700 1 Processor -- start 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.300+0000 7f06521ff700 1 -- start start 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f06521ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c06e820 0x7f064c16d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f06521ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f064c0af020 0x7f064c0ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f06521ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c0b00d0 0x7f064c0adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f06521ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0c7cf0 con 0x7f064c06e820 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f06521ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0c70e0 con 0x7f064c0b00d0 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f06521ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0c73c0 con 0x7f064c0af020 2023-09-30T22:54:01.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c06e820 0x7f064c16d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c06e820 0x7f064c16d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56510/0 (socket says 172.21.15.142:56510) 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f064b7fe700 1 -- 172.21.15.142:0/1080520239 learned_addr learned my addr 172.21.15.142:0/1080520239 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f064bfff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c0b00d0 0x7f064c0adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.301+0000 7f064affd700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f064c0af020 0x7f064c0ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f064bfff700 1 -- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f064c0af020 msgr2=0x7f064c0ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f064bfff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f064c0af020 0x7f064c0ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f064bfff700 1 -- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c06e820 msgr2=0x7f064c16d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f064bfff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c06e820 0x7f064c16d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f064bfff700 1 -- 172.21.15.142:0/1080520239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0094f0 con 0x7f064c0b00d0 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f064b7fe700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c06e820 0x7f064c16d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:01.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f064bfff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c0b00d0 0x7f064c0adb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0644009e50 tx=0x7f064400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:01.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f06337fe700 1 -- 172.21.15.142:0/1080520239 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400caa0 con 0x7f064c0b00d0 2023-09-30T22:54:01.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f06337fe700 1 -- 172.21.15.142:0/1080520239 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064400f040 con 0x7f064c0b00d0 2023-09-30T22:54:01.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0c76a0 con 0x7f064c0b00d0 2023-09-30T22:54:01.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f06337fe700 1 -- 172.21.15.142:0/1080520239 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400ce50 con 0x7f064c0b00d0 2023-09-30T22:54:01.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.302+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c16d9b0 con 0x7f064c0b00d0 2023-09-30T22:54:01.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.303+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c0c7ea0 con 0x7f064c0b00d0 2023-09-30T22:54:01.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.304+0000 7f06337fe700 1 -- 172.21.15.142:0/1080520239 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0644014690 con 0x7f064c0b00d0 2023-09-30T22:54:01.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.305+0000 7f06337fe700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0638067330 0x7f06380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.305+0000 7f06337fe700 1 -- 172.21.15.142:0/1080520239 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f06440858a0 con 0x7f064c0b00d0 2023-09-30T22:54:01.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.305+0000 7f064b7fe700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0638067330 0x7f06380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.306+0000 7f064b7fe700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0638067330 0x7f06380697e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f063c003080 tx=0x7f063c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:01.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.309+0000 7f06337fe700 1 -- 172.21.15.142:0/1080520239 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0644056510 con 0x7f064c0b00d0 2023-09-30T22:54:01.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.515+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f064c0c7e60 con 0x7f064c0b00d0 2023-09-30T22:54:01.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.734+0000 7f06337fe700 1 -- 172.21.15.142:0/1080520239 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f06440560a0 con 0x7f064c0b00d0 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0638067330 msgr2=0x7f06380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0638067330 0x7f06380697e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f063c003080 tx=0x7f063c017000 comp rx=0 tx=0).stop 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c0b00d0 msgr2=0x7f064c0adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c0b00d0 0x7f064c0adb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0644009e50 tx=0x7f064400b040 comp rx=0 tx=0).stop 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 shutdown_connections 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0638067330 0x7f06380697e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c0b00d0 0x7f064c0adb90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f064c06e820 0x7f064c16d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 --2- 172.21.15.142:0/1080520239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f064c0af020 0x7f064c0ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 >> 172.21.15.142:0/1080520239 conn(0x7f064c0680c0 msgr2=0x7f064c0c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:01.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 shutdown_connections 2023-09-30T22:54:01.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.737+0000 7f06521ff700 1 -- 172.21.15.142:0/1080520239 wait complete. 2023-09-30T22:54:01.740 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:54:01.757 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:54:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.945+0000 7f279c3ff700 1 Processor -- start 2023-09-30T22:54:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.945+0000 7f279c3ff700 1 -- start start 2023-09-30T22:54:01.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794159b90 0x7f2794159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279c3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2794069f10 0x7f279406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279c3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27940b0ee0 con 0x7f27940aebf0 2023-09-30T22:54:01.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279c3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27940aefc0 con 0x7f2794069f10 2023-09-30T22:54:01.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279c3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279415a520 con 0x7f2794159b90 2023-09-30T22:54:01.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279a99c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2794069f10 0x7f279406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279999a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794159b90 0x7f2794159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279a99c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2794069f10 0x7f279406a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:45046/0 (socket says 172.21.15.142:45046) 2023-09-30T22:54:01.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.947+0000 7f279a99c700 1 -- 172.21.15.142:0/2743759280 learned_addr learned my addr 172.21.15.142:0/2743759280 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:01.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f279a99c700 1 -- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794159b90 msgr2=0x7f2794159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f279a99c700 1 --2- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794159b90 0x7f2794159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f279a99c700 1 -- 172.21.15.142:0/2743759280 >> v1:172.21.15.148:6789/0 conn(0x7f27940aebf0 legacy=0x7f279406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f279a99c700 1 -- 172.21.15.142:0/2743759280 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279406f360 con 0x7f2794069f10 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f2799199700 1 -- 172.21.15.142:0/2743759280 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87200797 0 0) 0x7f27940b0ee0 con 0x7f27940aebf0 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f279999a700 1 --2- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794159b90 0x7f2794159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f279a99c700 1 --2- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794069f10 0x7f279406a390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c0d0 tx=0x7f278c00a950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b9979f743d1ea7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f2799199700 1 -- 172.21.15.142:0/2743759280 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c00f070 con 0x7f2794069f10 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f2799199700 1 -- 172.21.15.142:0/2743759280 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c00a2e0 con 0x7f2794069f10 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.948+0000 7f2799199700 1 -- 172.21.15.142:0/2743759280 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c00cd80 con 0x7f2794069f10 2023-09-30T22:54:01.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 -- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794069f10 msgr2=0x7f279406a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 --2- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794069f10 0x7f279406a390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c0d0 tx=0x7f278c00a950 comp rx=0 tx=0).stop 2023-09-30T22:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 -- 172.21.15.142:0/2743759280 shutdown_connections 2023-09-30T22:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 --2- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794069f10 0x7f279406a390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 --2- 172.21.15.142:0/2743759280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794159b90 0x7f2794159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 -- 172.21.15.142:0/2743759280 >> 172.21.15.142:0/2743759280 conn(0x7f27940680c0 msgr2=0x7f27940c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 -- 172.21.15.142:0/2743759280 shutdown_connections 2023-09-30T22:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.949+0000 7f279c3ff700 1 -- 172.21.15.142:0/2743759280 wait complete. 2023-09-30T22:54:01.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.950+0000 7f279c3ff700 1 Processor -- start 2023-09-30T22:54:01.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.950+0000 7f279c3ff700 1 -- start start 2023-09-30T22:54:01.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.951+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794069f10 0x7f279415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.951+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27940aebf0 0x7f279415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.951+0000 7f279c3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794159b90 0x7f279415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.951+0000 7f279c3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279413cc70 con 0x7f27940aebf0 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.951+0000 7f279c3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279413d960 con 0x7f2794159b90 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.951+0000 7f279c3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279415c2f0 con 0x7f2794069f10 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27940aebf0 0x7f279415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27940aebf0 0x7f279415b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56512/0 (socket says 172.21.15.142:56512) 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 -- 172.21.15.142:0/1075406417 learned_addr learned my addr 172.21.15.142:0/1075406417 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279a19b700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794069f10 0x7f279415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279a99c700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794159b90 0x7f279415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 -- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794069f10 msgr2=0x7f279415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794069f10 0x7f279415af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 -- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794159b90 msgr2=0x7f279415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794159b90 0x7f279415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 -- 172.21.15.142:0/1075406417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784009420 con 0x7f27940aebf0 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279a99c700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794159b90 0x7f279415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279a19b700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794069f10 0x7f279415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.952+0000 7f279999a700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27940aebf0 0x7f279415b4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f278400ecb0 tx=0x7f27840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.953+0000 7f278a7fc700 1 -- 172.21.15.142:0/1075406417 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400c9d0 con 0x7f27940aebf0 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.953+0000 7f278a7fc700 1 -- 172.21.15.142:0/1075406417 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278400cb30 con 0x7f27940aebf0 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.953+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c00abf0 con 0x7f27940aebf0 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.953+0000 7f278a7fc700 1 -- 172.21.15.142:0/1075406417 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400ceb0 con 0x7f27940aebf0 2023-09-30T22:54:01.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.953+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279413d310 con 0x7f27940aebf0 2023-09-30T22:54:01.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.954+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279413dad0 con 0x7f27940aebf0 2023-09-30T22:54:01.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.955+0000 7f278a7fc700 1 -- 172.21.15.142:0/1075406417 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2784013680 con 0x7f27940aebf0 2023-09-30T22:54:01.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.956+0000 7f278a7fc700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2778067360 0x7f2778069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:01.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.956+0000 7f278a7fc700 1 -- 172.21.15.142:0/1075406417 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2784084bf0 con 0x7f27940aebf0 2023-09-30T22:54:01.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.956+0000 7f279a19b700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2778067360 0x7f2778069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:01.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.956+0000 7f279a19b700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2778067360 0x7f2778069810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f279406a7f0 tx=0x7f2790009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:01.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:01.960+0000 7f278a7fc700 1 -- 172.21.15.142:0/1075406417 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f27840558d0 con 0x7f27940aebf0 2023-09-30T22:54:02.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.225+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f279406fc10 con 0x7f27940aebf0 2023-09-30T22:54:02.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.226+0000 7f278a7fc700 1 -- 172.21.15.142:0/1075406417 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2784017090 con 0x7f27940aebf0 2023-09-30T22:54:02.227 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:02.227 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:02.227 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:54:02.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.227 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:54:02.227 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:54:02.228 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:54:02.230 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:54:02.232 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:54:02.235 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.237 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:54:02.238 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:54:02.239 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:54:02.240 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:02.241 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:02.242 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:02.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2778067360 msgr2=0x7f2778069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2778067360 0x7f2778069810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f279406a7f0 tx=0x7f2790009040 comp rx=0 tx=0).stop 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27940aebf0 msgr2=0x7f279415b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27940aebf0 0x7f279415b4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f278400ecb0 tx=0x7f27840091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 shutdown_connections 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2778067360 0x7f2778069810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2794159b90 0x7f279415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2794069f10 0x7f279415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 --2- 172.21.15.142:0/1075406417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27940aebf0 0x7f279415b4c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 >> 172.21.15.142:0/1075406417 conn(0x7f27940680c0 msgr2=0x7f27940ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 shutdown_connections 2023-09-30T22:54:02.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.228+0000 7f279c3ff700 1 -- 172.21.15.142:0/1075406417 wait complete. 2023-09-30T22:54:02.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:54:02.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.436+0000 7fbc265ff700 1 Processor -- start 2023-09-30T22:54:02.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.436+0000 7fbc265ff700 1 -- start start 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.437+0000 7fbc265ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc200b00d0 0x7fbc2006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.437+0000 7fbc265ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc2006e650 0x7fbc2015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.437+0000 7fbc265ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2006d3e0 con 0x7fbc200af020 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.437+0000 7fbc265ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2006dc80 con 0x7fbc200b00d0 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.437+0000 7fbc265ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2006b790 con 0x7fbc2006e650 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.437+0000 7fbc1ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbc200af020 0x7fbc20156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52566/0 (socket says 172.21.15.142:52566) 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc1ffff700 1 -- 172.21.15.142:0/3529710003 learned_addr learned my addr 172.21.15.142:0/3529710003 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc1f7fe700 1 --2- 172.21.15.142:0/3529710003 >> v2:172.21.15.148:3300/0 conn(0x7fbc200b00d0 0x7fbc2006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc24b9c700 1 --2- 172.21.15.142:0/3529710003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc2006e650 0x7fbc2015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc1effd700 1 -- 172.21.15.142:0/3529710003 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627628566 0 0) 0x7fbc2006d3e0 con 0x7fbc200af020 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc1effd700 1 -- 172.21.15.142:0/3529710003 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc08003570 con 0x7fbc200af020 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc24b9c700 1 -- 172.21.15.142:0/3529710003 >> v2:172.21.15.148:3300/0 conn(0x7fbc200b00d0 msgr2=0x7fbc2006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc24b9c700 1 --2- 172.21.15.142:0/3529710003 >> v2:172.21.15.148:3300/0 conn(0x7fbc200b00d0 0x7fbc2006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc24b9c700 1 -- 172.21.15.142:0/3529710003 >> v1:172.21.15.142:6789/0 conn(0x7fbc200af020 legacy=0x7fbc20156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc24b9c700 1 -- 172.21.15.142:0/3529710003 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200b0650 con 0x7fbc2006e650 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.438+0000 7fbc1f7fe700 1 --2- 172.21.15.142:0/3529710003 >> v2:172.21.15.148:3300/0 conn(0x7fbc200b00d0 0x7fbc2006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc24b9c700 1 --2- 172.21.15.142:0/3529710003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc2006e650 0x7fbc2015a3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009e60 tx=0x7fbc18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d6cecfb7ec2fc19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc1effd700 1 -- 172.21.15.142:0/3529710003 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800e070 con 0x7fbc2006e650 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc1effd700 1 -- 172.21.15.142:0/3529710003 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1800bab0 con 0x7fbc2006e650 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc1effd700 1 -- 172.21.15.142:0/3529710003 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800be70 con 0x7fbc2006e650 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 -- 172.21.15.142:0/3529710003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc2006e650 msgr2=0x7fbc2015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3529710003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc2006e650 0x7fbc2015a3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009e60 tx=0x7fbc18009780 comp rx=0 tx=0).stop 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 -- 172.21.15.142:0/3529710003 shutdown_connections 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3529710003 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc2006e650 0x7fbc2015a3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3529710003 >> v2:172.21.15.148:3300/0 conn(0x7fbc200b00d0 0x7fbc2006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 -- 172.21.15.142:0/3529710003 >> 172.21.15.142:0/3529710003 conn(0x7fbc200680c0 msgr2=0x7fbc200c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 -- 172.21.15.142:0/3529710003 shutdown_connections 2023-09-30T22:54:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.439+0000 7fbc265ff700 1 -- 172.21.15.142:0/3529710003 wait complete. 2023-09-30T22:54:02.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.441+0000 7fbc265ff700 1 Processor -- start 2023-09-30T22:54:02.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.442+0000 7fbc265ff700 1 -- start start 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc265ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc2006e650 0x7fbc200a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc265ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc200af020 0x7fbc20168b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc265ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc200b00d0 0x7fbc200ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc265ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200a7dd0 con 0x7fbc2006e650 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc265ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20169090 con 0x7fbc200af020 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc265ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200a67f0 con 0x7fbc200b00d0 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc1ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc2006e650 0x7fbc200a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc1ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc2006e650 0x7fbc200a7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56518/0 (socket says 172.21.15.142:56518) 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc1ffff700 1 -- 172.21.15.142:0/3522160381 learned_addr learned my addr 172.21.15.142:0/3522160381 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc1f7fe700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc200af020 0x7fbc20168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.443+0000 7fbc24b9c700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc200b00d0 0x7fbc200ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc1ffff700 1 -- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc200b00d0 msgr2=0x7fbc200ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc1ffff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc200b00d0 0x7fbc200ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc1ffff700 1 -- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc200af020 msgr2=0x7fbc20168b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc1ffff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc200af020 0x7fbc20168b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc1ffff700 1 -- 172.21.15.142:0/3522160381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14009420 con 0x7fbc2006e650 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc24b9c700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc200b00d0 0x7fbc200ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc1ffff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc2006e650 0x7fbc200a7890 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c7c0 tx=0x7fbc10007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc07fff700 1 -- 172.21.15.142:0/3522160381 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10005b30 con 0x7fbc2006e650 2023-09-30T22:54:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc07fff700 1 -- 172.21.15.142:0/3522160381 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10005cb0 con 0x7fbc2006e650 2023-09-30T22:54:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc18009a20 con 0x7fbc2006e650 2023-09-30T22:54:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc07fff700 1 -- 172.21.15.142:0/3522160381 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10007320 con 0x7fbc2006e650 2023-09-30T22:54:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.444+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc200a7090 con 0x7fbc2006e650 2023-09-30T22:54:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.445+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc200a6bc0 con 0x7fbc2006e650 2023-09-30T22:54:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.446+0000 7fbc07fff700 1 -- 172.21.15.142:0/3522160381 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbc10007690 con 0x7fbc2006e650 2023-09-30T22:54:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.447+0000 7fbc07fff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc0c067330 0x7fbc0c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.447+0000 7fbc07fff700 1 -- 172.21.15.142:0/3522160381 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbc10083e20 con 0x7fbc2006e650 2023-09-30T22:54:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.447+0000 7fbc1f7fe700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc0c067330 0x7fbc0c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.448+0000 7fbc1f7fe700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc0c067330 0x7fbc0c0697e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009ea0 tx=0x7fbc140091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.451+0000 7fbc07fff700 1 -- 172.21.15.142:0/3522160381 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbc10050fd0 con 0x7fbc2006e650 2023-09-30T22:54:02.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.645+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc2006fc10 con 0x7fbc2006e650 2023-09-30T22:54:02.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.646+0000 7fbc07fff700 1 -- 172.21.15.142:0/3522160381 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13794 (secure 0 0 0) 0x7fbc10017090 con 0x7fbc2006e650 2023-09-30T22:54:02.647 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:02.647 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":44,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:54:01.739539+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:54:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc0c067330 msgr2=0x7fbc0c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc0c067330 0x7fbc0c0697e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009ea0 tx=0x7fbc140091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc2006e650 msgr2=0x7fbc200a7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc2006e650 0x7fbc200a7890 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c7c0 tx=0x7fbc10007e00 comp rx=0 tx=0).stop 2023-09-30T22:54:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 shutdown_connections 2023-09-30T22:54:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc0c067330 0x7fbc0c0697e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc200b00d0 0x7fbc200ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc2006e650 0x7fbc200a7890 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 --2- 172.21.15.142:0/3522160381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc200af020 0x7fbc20168b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.648+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 >> 172.21.15.142:0/3522160381 conn(0x7fbc200680c0 msgr2=0x7fbc200cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.649+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 shutdown_connections 2023-09-30T22:54:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.649+0000 7fbc265ff700 1 -- 172.21.15.142:0/3522160381 wait complete. 2023-09-30T22:54:02.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:54:02.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:54:02.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.861+0000 7f2c799ff700 1 Processor -- start 2023-09-30T22:54:02.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.861+0000 7f2c799ff700 1 -- start start 2023-09-30T22:54:02.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.862+0000 7f2c799ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c74159ba0 0x7f2c7406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c799ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c74067d10 con 0x7f2c740b0de0 2023-09-30T22:54:02.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c799ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7406af90 con 0x7f2c740ca5e0 2023-09-30T22:54:02.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c799ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c740676c0 con 0x7f2c74159ba0 2023-09-30T22:54:02.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c727fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2c740b0de0 0x7f2c740c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52576/0 (socket says 172.21.15.142:52576) 2023-09-30T22:54:02.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c727fc700 1 -- 172.21.15.142:0/325706299 learned_addr learned my addr 172.21.15.142:0/325706299 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c72ffd700 1 --2- 172.21.15.142:0/325706299 >> v2:172.21.15.148:3300/0 conn(0x7f2c74159ba0 0x7f2c7406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c71ffb700 1 -- 172.21.15.142:0/325706299 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200522376 0 0) 0x7f2c74067d10 con 0x7f2c740b0de0 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.863+0000 7f2c71ffb700 1 -- 172.21.15.142:0/325706299 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c5c003570 con 0x7f2c740b0de0 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.864+0000 7f2c72ffd700 1 -- 172.21.15.142:0/325706299 >> v1:172.21.15.148:6789/0 conn(0x7f2c740ca5e0 legacy=0x7f2c740681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.864+0000 7f2c72ffd700 1 -- 172.21.15.142:0/325706299 >> v1:172.21.15.142:6789/0 conn(0x7f2c740b0de0 legacy=0x7f2c740c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.864+0000 7f2c72ffd700 1 -- 172.21.15.142:0/325706299 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c740679a0 con 0x7f2c74159ba0 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.864+0000 7f2c72ffd700 1 --2- 172.21.15.142:0/325706299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 0x7f2c7406a8d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c640098e0 tx=0x7f2c640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d442490146a4c02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:02.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.864+0000 7f2c71ffb700 1 -- 172.21.15.142:0/325706299 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400b640 con 0x7f2c74159ba0 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.864+0000 7f2c71ffb700 1 -- 172.21.15.142:0/325706299 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400b7a0 con 0x7f2c74159ba0 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.864+0000 7f2c71ffb700 1 -- 172.21.15.142:0/325706299 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400bb40 con 0x7f2c74159ba0 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.865+0000 7f2c799ff700 1 -- 172.21.15.142:0/325706299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 msgr2=0x7f2c7406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.865+0000 7f2c799ff700 1 --2- 172.21.15.142:0/325706299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 0x7f2c7406a8d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c640098e0 tx=0x7f2c640091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.865+0000 7f2c799ff700 1 -- 172.21.15.142:0/325706299 shutdown_connections 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.865+0000 7f2c799ff700 1 --2- 172.21.15.142:0/325706299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 0x7f2c7406a8d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.865+0000 7f2c799ff700 1 -- 172.21.15.142:0/325706299 >> 172.21.15.142:0/325706299 conn(0x7f2c740cb2f0 msgr2=0x7f2c740cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.865+0000 7f2c799ff700 1 -- 172.21.15.142:0/325706299 shutdown_connections 2023-09-30T22:54:02.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.865+0000 7f2c799ff700 1 -- 172.21.15.142:0/325706299 wait complete. 2023-09-30T22:54:02.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.866+0000 7f2c799ff700 1 Processor -- start 2023-09-30T22:54:02.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.866+0000 7f2c799ff700 1 -- start start 2023-09-30T22:54:02.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.867+0000 7f2c799ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c740b0de0 0x7f2c74157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.867+0000 7f2c799ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c740ca5e0 0x7f2c740c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.867+0000 7f2c799ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 0x7f2c7415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.867+0000 7f2c799ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740c5340 con 0x7f2c740ca5e0 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.867+0000 7f2c799ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740c20f0 con 0x7f2c74159ba0 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.867+0000 7f2c799ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740c23d0 con 0x7f2c740b0de0 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.867+0000 7f2c727fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c740ca5e0 0x7f2c740c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c740ca5e0 0x7f2c740c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56522/0 (socket says 172.21.15.142:56522) 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 -- 172.21.15.142:0/3142230075 learned_addr learned my addr 172.21.15.142:0/3142230075 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c72ffd700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c740b0de0 0x7f2c74157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c737fe700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 0x7f2c7415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 -- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c740b0de0 msgr2=0x7f2c74157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c740b0de0 0x7f2c74157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 -- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 msgr2=0x7f2c7415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 0x7f2c7415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:02.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 -- 172.21.15.142:0/3142230075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009420 con 0x7f2c740ca5e0 2023-09-30T22:54:02.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c727fc700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c740ca5e0 0x7f2c740c4760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c7f0 tx=0x7f2c68007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:02.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c5affd700 1 -- 172.21.15.142:0/3142230075 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68005b30 con 0x7f2c740ca5e0 2023-09-30T22:54:02.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c5affd700 1 -- 172.21.15.142:0/3142230075 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68005c90 con 0x7f2c740ca5e0 2023-09-30T22:54:02.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7415ad60 con 0x7f2c740ca5e0 2023-09-30T22:54:02.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.868+0000 7f2c5affd700 1 -- 172.21.15.142:0/3142230075 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68007340 con 0x7f2c740ca5e0 2023-09-30T22:54:02.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.869+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7415b320 con 0x7f2c740ca5e0 2023-09-30T22:54:02.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.870+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7406e4b0 con 0x7f2c740ca5e0 2023-09-30T22:54:02.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.870+0000 7f2c5affd700 1 -- 172.21.15.142:0/3142230075 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2c6801b400 con 0x7f2c740ca5e0 2023-09-30T22:54:02.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.871+0000 7f2c5affd700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c60067330 0x7f2c600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:02.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.871+0000 7f2c5affd700 1 -- 172.21.15.142:0/3142230075 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c680843f0 con 0x7f2c740ca5e0 2023-09-30T22:54:02.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.871+0000 7f2c72ffd700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c60067330 0x7f2c600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:02.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.872+0000 7f2c72ffd700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c60067330 0x7f2c600697e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c640093f0 tx=0x7f2c64017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:02.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:02.875+0000 7f2c5affd700 1 -- 172.21.15.142:0/3142230075 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2c680516d0 con 0x7f2c740ca5e0 2023-09-30T22:54:03.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.064+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c740cac40 con 0x7f2c740ca5e0 2023-09-30T22:54:03.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.065+0000 7f2c5affd700 1 -- 172.21.15.142:0/3142230075 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c680076f0 con 0x7f2c740ca5e0 2023-09-30T22:54:03.066 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:54:03.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c60067330 msgr2=0x7f2c600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c60067330 0x7f2c600697e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c640093f0 tx=0x7f2c64017000 comp rx=0 tx=0).stop 2023-09-30T22:54:03.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c740ca5e0 msgr2=0x7f2c740c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c740ca5e0 0x7f2c740c4760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c7f0 tx=0x7f2c68007e00 comp rx=0 tx=0).stop 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 shutdown_connections 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c60067330 0x7f2c600697e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c74159ba0 0x7f2c7415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c740b0de0 0x7f2c74157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 --2- 172.21.15.142:0/3142230075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c740ca5e0 0x7f2c740c4760 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 >> 172.21.15.142:0/3142230075 conn(0x7f2c740cb2f0 msgr2=0x7f2c740cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 shutdown_connections 2023-09-30T22:54:03.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.067+0000 7f2c799ff700 1 -- 172.21.15.142:0/3142230075 wait complete. 2023-09-30T22:54:03.085 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:54:03.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.275+0000 7f99b2fff700 1 Processor -- start 2023-09-30T22:54:03.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.276+0000 7f99b2fff700 1 -- start start 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b2fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f99ac0c52a0 0x7f99ac0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b2fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99ac0cb350 0x7f99ac1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b2fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0c7690 con 0x7f99ac069f10 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b2fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac1406a0 con 0x7f99ac0cb350 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b2fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0c3a50 con 0x7f99ac0c52a0 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b159c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99ac0cb350 0x7f99ac1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b159c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99ac0cb350 0x7f99ac1605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56534/0 (socket says 172.21.15.142:56534) 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.277+0000 7f99b159c700 1 -- 172.21.15.142:0/3538787134 learned_addr learned my addr 172.21.15.142:0/3538787134 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:03.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99b0d9b700 1 --2- 172.21.15.142:0/3538787134 >> v2:172.21.15.148:3300/0 conn(0x7f99ac0c52a0 0x7f99ac0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99b159c700 1 -- 172.21.15.142:0/3538787134 >> v2:172.21.15.148:3300/0 conn(0x7f99ac0c52a0 msgr2=0x7f99ac0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:03.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99b159c700 1 --2- 172.21.15.142:0/3538787134 >> v2:172.21.15.148:3300/0 conn(0x7f99ac0c52a0 0x7f99ac0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99b159c700 1 -- 172.21.15.142:0/3538787134 >> v1:172.21.15.148:6789/0 conn(0x7f99ac069f10 legacy=0x7f99ac0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:03.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99b159c700 1 -- 172.21.15.142:0/3538787134 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0c7f20 con 0x7f99ac0cb350 2023-09-30T22:54:03.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99b0d9b700 1 --2- 172.21.15.142:0/3538787134 >> v2:172.21.15.148:3300/0 conn(0x7f99ac0c52a0 0x7f99ac0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:03.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99b159c700 1 --2- 172.21.15.142:0/3538787134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0cb350 0x7f99ac1605e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0c9040 tx=0x7f99a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489b4febf6cc2f4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:03.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99ab7fe700 1 -- 172.21.15.142:0/3538787134 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400e070 con 0x7f99ac0cb350 2023-09-30T22:54:03.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99ab7fe700 1 -- 172.21.15.142:0/3538787134 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a400ba00 con 0x7f99ac0cb350 2023-09-30T22:54:03.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.278+0000 7f99ab7fe700 1 -- 172.21.15.142:0/3538787134 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40092e0 con 0x7f99ac0cb350 2023-09-30T22:54:03.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 -- 172.21.15.142:0/3538787134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0cb350 msgr2=0x7f99ac1605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 --2- 172.21.15.142:0/3538787134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0cb350 0x7f99ac1605e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0c9040 tx=0x7f99a4009840 comp rx=0 tx=0).stop 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 -- 172.21.15.142:0/3538787134 shutdown_connections 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 --2- 172.21.15.142:0/3538787134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0cb350 0x7f99ac1605e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 --2- 172.21.15.142:0/3538787134 >> v2:172.21.15.148:3300/0 conn(0x7f99ac0c52a0 0x7f99ac0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 -- 172.21.15.142:0/3538787134 >> 172.21.15.142:0/3538787134 conn(0x7f99ac0cc670 msgr2=0x7f99ac0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 -- 172.21.15.142:0/3538787134 shutdown_connections 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.279+0000 7f99b2fff700 1 -- 172.21.15.142:0/3538787134 wait complete. 2023-09-30T22:54:03.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.280+0000 7f99b2fff700 1 Processor -- start 2023-09-30T22:54:03.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.280+0000 7f99b2fff700 1 -- start start 2023-09-30T22:54:03.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.281+0000 7f99b2fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99ac069f10 0x7f99ac15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.281+0000 7f99b2fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0c52a0 0x7f99ac13f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.281+0000 7f99b2fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99ac0cb350 0x7f99ac158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.281+0000 7f99b2fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac15ea90 con 0x7f99ac0c52a0 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.281+0000 7f99b2fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac15ed70 con 0x7f99ac0cb350 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.281+0000 7f99b2fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac15f050 con 0x7f99ac069f10 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0c52a0 0x7f99ac13f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0c52a0 0x7f99ac13f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56536/0 (socket says 172.21.15.142:56536) 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 -- 172.21.15.142:0/2289862916 learned_addr learned my addr 172.21.15.142:0/2289862916 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99b0d9b700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99ac069f10 0x7f99ac15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99b159c700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99ac0cb350 0x7f99ac158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 -- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99ac069f10 msgr2=0x7f99ac15e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99ac069f10 0x7f99ac15e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 -- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99ac0cb350 msgr2=0x7f99ac158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99ac0cb350 0x7f99ac158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 -- 172.21.15.142:0/2289862916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4009ae0 con 0x7f99ac0c52a0 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.282+0000 7f99abfff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0c52a0 0x7f99ac13f850 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f999800c590 tx=0x7f9998007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.283+0000 7f99a8ff9700 1 -- 172.21.15.142:0/2289862916 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998011590 con 0x7f99ac0c52a0 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.283+0000 7f99a8ff9700 1 -- 172.21.15.142:0/2289862916 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99980116f0 con 0x7f99ac0c52a0 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.283+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac15f330 con 0x7f99ac0c52a0 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.283+0000 7f99a8ff9700 1 -- 172.21.15.142:0/2289862916 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998011ab0 con 0x7f99ac0c52a0 2023-09-30T22:54:03.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.283+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac15b500 con 0x7f99ac0c52a0 2023-09-30T22:54:03.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.284+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac069a50 con 0x7f99ac0c52a0 2023-09-30T22:54:03.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.285+0000 7f99a8ff9700 1 -- 172.21.15.142:0/2289862916 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f999801c460 con 0x7f99ac0c52a0 2023-09-30T22:54:03.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.285+0000 7f99a8ff9700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9990067330 0x7f99900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.286+0000 7f99a8ff9700 1 -- 172.21.15.142:0/2289862916 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9998084550 con 0x7f99ac0c52a0 2023-09-30T22:54:03.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.286+0000 7f99b0d9b700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9990067330 0x7f99900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.286+0000 7f99b0d9b700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9990067330 0x7f99900697e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99a000adc0 tx=0x7f99a0006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:03.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.290+0000 7f99a8ff9700 1 -- 172.21.15.142:0/2289862916 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9998051700 con 0x7f99ac0c52a0 2023-09-30T22:54:03.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.480+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99ac0ccc50 con 0x7f99ac0c52a0 2023-09-30T22:54:03.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.480+0000 7f99a8ff9700 1 -- 172.21.15.142:0/2289862916 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9998054d20 con 0x7f99ac0c52a0 2023-09-30T22:54:03.482 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:54:03.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9990067330 msgr2=0x7f99900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9990067330 0x7f99900697e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99a000adc0 tx=0x7f99a0006f90 comp rx=0 tx=0).stop 2023-09-30T22:54:03.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0c52a0 msgr2=0x7f99ac13f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0c52a0 0x7f99ac13f850 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f999800c590 tx=0x7f9998007f30 comp rx=0 tx=0).stop 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 shutdown_connections 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9990067330 0x7f99900697e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99ac0cb350 0x7f99ac158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99ac069f10 0x7f99ac15e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 --2- 172.21.15.142:0/2289862916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0c52a0 0x7f99ac13f850 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 >> 172.21.15.142:0/2289862916 conn(0x7f99ac0cc670 msgr2=0x7f99ac06db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 shutdown_connections 2023-09-30T22:54:03.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.483+0000 7f99b2fff700 1 -- 172.21.15.142:0/2289862916 wait complete. 2023-09-30T22:54:03.501 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:54:03.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.689+0000 7f08de7ff700 1 Processor -- start 2023-09-30T22:54:03.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.690+0000 7f08de7ff700 1 -- start start 2023-09-30T22:54:03.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08de7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08d8159ae0 0x7f08d80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08de7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80cc590 0x7f08d8069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08de7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d815d910 con 0x7f08d80b1180 2023-09-30T22:54:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08de7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d815e920 con 0x7f08d8159ae0 2023-09-30T22:54:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08de7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815e490 con 0x7f08d80cc590 2023-09-30T22:54:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08d77fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f08d80b1180 0x7f08d80cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52582/0 (socket says 172.21.15.142:52582) 2023-09-30T22:54:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08d77fe700 1 -- 172.21.15.142:0/494558062 learned_addr learned my addr 172.21.15.142:0/494558062 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08dcd9c700 1 --2- 172.21.15.142:0/494558062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80cc590 0x7f08d8069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.691+0000 7f08d7fff700 1 --2- 172.21.15.142:0/494558062 >> v2:172.21.15.142:3300/0 conn(0x7f08d8159ae0 0x7f08d80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08d6ffd700 1 -- 172.21.15.142:0/494558062 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416310249 0 0) 0x7f08d815d910 con 0x7f08d80b1180 2023-09-30T22:54:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08d6ffd700 1 -- 172.21.15.142:0/494558062 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c0003570 con 0x7f08d80b1180 2023-09-30T22:54:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08dcd9c700 1 -- 172.21.15.142:0/494558062 >> v2:172.21.15.142:3300/0 conn(0x7f08d8159ae0 msgr2=0x7f08d80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08dcd9c700 1 --2- 172.21.15.142:0/494558062 >> v2:172.21.15.142:3300/0 conn(0x7f08d8159ae0 0x7f08d80cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08dcd9c700 1 -- 172.21.15.142:0/494558062 >> v1:172.21.15.142:6789/0 conn(0x7f08d80b1180 legacy=0x7f08d80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08dcd9c700 1 -- 172.21.15.142:0/494558062 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d815db60 con 0x7f08d80cc590 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08dcd9c700 1 --2- 172.21.15.142:0/494558062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80cc590 0x7f08d8069f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009e60 tx=0x7f08d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a3b90c5f054a59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08d6ffd700 1 -- 172.21.15.142:0/494558062 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d000e070 con 0x7f08d80cc590 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.692+0000 7f08d6ffd700 1 -- 172.21.15.142:0/494558062 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d000bab0 con 0x7f08d80cc590 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08d6ffd700 1 -- 172.21.15.142:0/494558062 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d000be70 con 0x7f08d80cc590 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 -- 172.21.15.142:0/494558062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80cc590 msgr2=0x7f08d8069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 --2- 172.21.15.142:0/494558062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80cc590 0x7f08d8069f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009e60 tx=0x7f08d0009780 comp rx=0 tx=0).stop 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 -- 172.21.15.142:0/494558062 shutdown_connections 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 --2- 172.21.15.142:0/494558062 >> v2:172.21.15.142:3300/0 conn(0x7f08d8159ae0 0x7f08d80cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 --2- 172.21.15.142:0/494558062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80cc590 0x7f08d8069f10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 -- 172.21.15.142:0/494558062 >> 172.21.15.142:0/494558062 conn(0x7f08d80ce8b0 msgr2=0x7f08d80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 -- 172.21.15.142:0/494558062 shutdown_connections 2023-09-30T22:54:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.693+0000 7f08de7ff700 1 -- 172.21.15.142:0/494558062 wait complete. 2023-09-30T22:54:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.695+0000 7f08de7ff700 1 Processor -- start 2023-09-30T22:54:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.695+0000 7f08de7ff700 1 -- start start 2023-09-30T22:54:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08de7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80b1180 0x7f08d80a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08de7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d80cc590 0x7f08d815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08de7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d8159ae0 0x7f08d816a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08de7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815c030 con 0x7f08d8159ae0 2023-09-30T22:54:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08de7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815c2d0 con 0x7f08d80cc590 2023-09-30T22:54:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08de7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815c5b0 con 0x7f08d80b1180 2023-09-30T22:54:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d8159ae0 0x7f08d816a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d8159ae0 0x7f08d816a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56562/0 (socket says 172.21.15.142:56562) 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 -- 172.21.15.142:0/532638837 learned_addr learned my addr 172.21.15.142:0/532638837 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08d7fff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80b1180 0x7f08d80a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08d77fe700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d80cc590 0x7f08d815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 -- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80b1180 msgr2=0x7f08d80a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80b1180 0x7f08d80a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 -- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d80cc590 msgr2=0x7f08d815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d80cc590 0x7f08d815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08dcd9c700 1 -- 172.21.15.142:0/532638837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0009a20 con 0x7f08d8159ae0 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.696+0000 7f08d7fff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80b1180 0x7f08d80a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.697+0000 7f08dcd9c700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d8159ae0 0x7f08d816a100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f08d815e5d0 tx=0x7f08d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.697+0000 7f08bffff700 1 -- 172.21.15.142:0/532638837 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0027470 con 0x7f08d8159ae0 2023-09-30T22:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.697+0000 7f08bffff700 1 -- 172.21.15.142:0/532638837 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d00275f0 con 0x7f08d8159ae0 2023-09-30T22:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.697+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d815c890 con 0x7f08d8159ae0 2023-09-30T22:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.697+0000 7f08bffff700 1 -- 172.21.15.142:0/532638837 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00279b0 con 0x7f08d8159ae0 2023-09-30T22:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.697+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d815b130 con 0x7f08d8159ae0 2023-09-30T22:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.698+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d806ea70 con 0x7f08d8159ae0 2023-09-30T22:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.699+0000 7f08bffff700 1 -- 172.21.15.142:0/532638837 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f08d0024070 con 0x7f08d8159ae0 2023-09-30T22:54:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.700+0000 7f08bffff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08c4067330 0x7f08c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.700+0000 7f08bffff700 1 -- 172.21.15.142:0/532638837 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f08d0087240 con 0x7f08d8159ae0 2023-09-30T22:54:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.700+0000 7f08d7fff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08c4067330 0x7f08c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.701+0000 7f08d7fff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08c4067330 0x7f08c40697e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009ce0 tx=0x7f08c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.704+0000 7f08bffff700 1 -- 172.21.15.142:0/532638837 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f08d00543f0 con 0x7f08d8159ae0 2023-09-30T22:54:03.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.899+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f08d815de40 con 0x7f08d8159ae0 2023-09-30T22:54:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.899+0000 7f08bffff700 1 -- 172.21.15.142:0/532638837 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+126 (secure 0 0 0) 0x7f08d0057a10 con 0x7f08d8159ae0 2023-09-30T22:54:03.952 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:03.952 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:03.953 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08c4067330 msgr2=0x7f08c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08c4067330 0x7f08c40697e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009ce0 tx=0x7f08c8008040 comp rx=0 tx=0).stop 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d8159ae0 msgr2=0x7f08d816a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d8159ae0 0x7f08d816a100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f08d815e5d0 tx=0x7f08d0019000 comp rx=0 tx=0).stop 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 shutdown_connections 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08c4067330 0x7f08c40697e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d8159ae0 0x7f08d816a100 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d80b1180 0x7f08d80a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 --2- 172.21.15.142:0/532638837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d80cc590 0x7f08d815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 >> 172.21.15.142:0/532638837 conn(0x7f08d80ce8b0 msgr2=0x7f08d81556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.901+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 shutdown_connections 2023-09-30T22:54:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:03.902+0000 7f08de7ff700 1 -- 172.21.15.142:0/532638837 wait complete. 2023-09-30T22:54:03.956 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:54:03.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:54:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.148+0000 7f16023ff700 1 Processor -- start 2023-09-30T22:54:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.148+0000 7f16023ff700 1 -- start start 2023-09-30T22:54:04.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f16023ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:04.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f16023ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15fc0cbed0 con 0x7f15fc0b0e80 2023-09-30T22:54:04.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f16023ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15fc0cb2c0 con 0x7f15fc159d30 2023-09-30T22:54:04.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f16023ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc0cc7c0 con 0x7f15fc0cc360 2023-09-30T22:54:04.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f15fb7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f15fc0b0e80 0x7f15fc06afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52596/0 (socket says 172.21.15.142:52596) 2023-09-30T22:54:04.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f15fb7fe700 1 -- 172.21.15.142:0/568316307 learned_addr learned my addr 172.21.15.142:0/568316307 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:04.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f160099c700 1 --2- 172.21.15.142:0/568316307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:04.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.150+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737800074 0 0) 0x7f15fc0cbed0 con 0x7f15fc0b0e80 2023-09-30T22:54:04.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e4003570 con 0x7f15fc0b0e80 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624187297 0 0) 0x7f15fc0cb2c0 con 0x7f15fc159d30 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15fc0cbed0 con 0x7f15fc159d30 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f160099c700 1 -- 172.21.15.142:0/568316307 >> v1:172.21.15.148:6789/0 conn(0x7f15fc159d30 legacy=0x7f15fc0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f160099c700 1 -- 172.21.15.142:0/568316307 >> v1:172.21.15.142:6789/0 conn(0x7f15fc0b0e80 legacy=0x7f15fc06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3451516546 0 0) 0x7f15e4003570 con 0x7f15fc0b0e80 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f160099c700 1 -- 172.21.15.142:0/568316307 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0cb5a0 con 0x7f15fc0cc360 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f160099c700 1 --2- 172.21.15.142:0/568316307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc06b6c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009e90 tx=0x7f15f4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419ae26c38a4011c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400e070 con 0x7f15fc0cc360 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f400b870 con 0x7f15fc0cc360 2023-09-30T22:54:04.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.151+0000 7f15faffd700 1 -- 172.21.15.142:0/568316307 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0001470 con 0x7f15fc0cc360 2023-09-30T22:54:04.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.152+0000 7f16023ff700 1 -- 172.21.15.142:0/568316307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 msgr2=0x7f15fc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:04.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.152+0000 7f16023ff700 1 --2- 172.21.15.142:0/568316307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc06b6c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009e90 tx=0x7f15f4009780 comp rx=0 tx=0).stop 2023-09-30T22:54:04.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.152+0000 7f16023ff700 1 -- 172.21.15.142:0/568316307 shutdown_connections 2023-09-30T22:54:04.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.152+0000 7f16023ff700 1 --2- 172.21.15.142:0/568316307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc06b6c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:04.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.152+0000 7f16023ff700 1 -- 172.21.15.142:0/568316307 >> 172.21.15.142:0/568316307 conn(0x7f15fc0cf2e0 msgr2=0x7f15fc0b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:04.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.152+0000 7f16023ff700 1 -- 172.21.15.142:0/568316307 shutdown_connections 2023-09-30T22:54:04.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.152+0000 7f16023ff700 1 -- 172.21.15.142:0/568316307 wait complete. 2023-09-30T22:54:04.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.153+0000 7f16023ff700 1 Processor -- start 2023-09-30T22:54:04.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.154+0000 7f16023ff700 1 -- start start 2023-09-30T22:54:04.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.154+0000 7f16023ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15fc0b0e80 0x7f15fc0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:04.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.154+0000 7f16023ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.154+0000 7f16023ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15fc159d30 0x7f15fc1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.154+0000 7f16023ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc16ea40 con 0x7f15fc159d30 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.154+0000 7f16023ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc16dca0 con 0x7f15fc0b0e80 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.154+0000 7f16023ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc16df80 con 0x7f15fc0cc360 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15fc159d30 0x7f15fc1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15fc159d30 0x7f15fc1562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56570/0 (socket says 172.21.15.142:56570) 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 -- 172.21.15.142:0/2280136110 learned_addr learned my addr 172.21.15.142:0/2280136110 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f15fbfff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15fc0b0e80 0x7f15fc0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f15fb7fe700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 -- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 msgr2=0x7f15fc155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:04.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 -- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15fc0b0e80 msgr2=0x7f15fc0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15fc0b0e80 0x7f15fc0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 -- 172.21.15.142:0/2280136110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4009a20 con 0x7f15fc159d30 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.155+0000 7f160099c700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15fc159d30 0x7f15fc1562b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009de0 tx=0x7f15f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.156+0000 7f15e3fff700 1 -- 172.21.15.142:0/2280136110 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4012d80 con 0x7f15fc159d30 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.156+0000 7f15e3fff700 1 -- 172.21.15.142:0/2280136110 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f401e450 con 0x7f15fc159d30 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.156+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc16e260 con 0x7f15fc159d30 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.156+0000 7f15e3fff700 1 -- 172.21.15.142:0/2280136110 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f401e810 con 0x7f15fc159d30 2023-09-30T22:54:04.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.156+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc157df0 con 0x7f15fc159d30 2023-09-30T22:54:04.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.157+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc16e8b0 con 0x7f15fc159d30 2023-09-30T22:54:04.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.158+0000 7f15e3fff700 1 -- 172.21.15.142:0/2280136110 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f15f401ec40 con 0x7f15fc159d30 2023-09-30T22:54:04.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.158+0000 7f15e3fff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15e8067330 0x7f15e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:04.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.159+0000 7f15e3fff700 1 -- 172.21.15.142:0/2280136110 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f15f4086810 con 0x7f15fc159d30 2023-09-30T22:54:04.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.159+0000 7f15fbfff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15e8067330 0x7f15e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:04.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.159+0000 7f15fbfff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15e8067330 0x7f15e80697e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0037e0 tx=0x7f15ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:04.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.163+0000 7f15e3fff700 1 -- 172.21.15.142:0/2280136110 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f15f40539c0 con 0x7f15fc159d30 2023-09-30T22:54:04.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:04.356+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f15fc16dde0 con 0x7f15fc159d30 2023-09-30T22:54:05.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.263+0000 7f15e3fff700 1 -- 172.21.15.142:0/2280136110 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f15fc16dde0 con 0x7f15fc159d30 2023-09-30T22:54:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15e8067330 msgr2=0x7f15e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15e8067330 0x7f15e80697e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0037e0 tx=0x7f15ec009040 comp rx=0 tx=0).stop 2023-09-30T22:54:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15fc159d30 msgr2=0x7f15fc1562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15fc159d30 0x7f15fc1562b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009de0 tx=0x7f15f4017000 comp rx=0 tx=0).stop 2023-09-30T22:54:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 shutdown_connections 2023-09-30T22:54:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15e8067330 0x7f15e80697e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15fc159d30 0x7f15fc1562b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15fc0b0e80 0x7f15fc0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 --2- 172.21.15.142:0/2280136110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15fc0cc360 0x7f15fc155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 >> 172.21.15.142:0/2280136110 conn(0x7f15fc0cf2e0 msgr2=0x7f15fc154500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 shutdown_connections 2023-09-30T22:54:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.267+0000 7f16023ff700 1 -- 172.21.15.142:0/2280136110 wait complete. 2023-09-30T22:54:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:54:05.287 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:54:05.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.486+0000 7eff8abff700 1 Processor -- start 2023-09-30T22:54:05.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.487+0000 7eff8abff700 1 -- start start 2023-09-30T22:54:05.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff8abff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84159b40 0x7eff8406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:05.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff8abff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff84159f10 0x7eff840683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:05.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff8abff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8406b650 con 0x7eff84067620 2023-09-30T22:54:05.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff8abff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8406aa40 con 0x7eff84159f10 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff8abff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8406ad20 con 0x7eff84159b40 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff83fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff84159f10 0x7eff840683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff83fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff84159f10 0x7eff840683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56576/0 (socket says 172.21.15.142:56576) 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff83fff700 1 -- 172.21.15.142:0/4162770445 learned_addr learned my addr 172.21.15.142:0/4162770445 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff8919c700 1 --1- 172.21.15.142:0/4162770445 >> v1:172.21.15.142:6789/0 conn(0x7eff84067620 0x7eff8415d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52602/0 (socket says 172.21.15.142:52602) 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.488+0000 7eff8899b700 1 --2- 172.21.15.142:0/4162770445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84159b40 0x7eff8406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff83fff700 1 -- 172.21.15.142:0/4162770445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84159b40 msgr2=0x7eff8406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff83fff700 1 --2- 172.21.15.142:0/4162770445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84159b40 0x7eff8406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff83fff700 1 -- 172.21.15.142:0/4162770445 >> v1:172.21.15.142:6789/0 conn(0x7eff84067620 legacy=0x7eff8415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff83fff700 1 -- 172.21.15.142:0/4162770445 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8406b000 con 0x7eff84159f10 2023-09-30T22:54:05.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff8899b700 1 --2- 172.21.15.142:0/4162770445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84159b40 0x7eff8406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff83fff700 1 --2- 172.21.15.142:0/4162770445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159f10 0x7eff840683e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7eff700099b0 tx=0x7eff70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e4e5761399878c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff837fe700 1 -- 172.21.15.142:0/4162770445 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000b860 con 0x7eff84159f10 2023-09-30T22:54:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff837fe700 1 -- 172.21.15.142:0/4162770445 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7000b9c0 con 0x7eff84159f10 2023-09-30T22:54:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.489+0000 7eff837fe700 1 -- 172.21.15.142:0/4162770445 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000bd60 con 0x7eff84159f10 2023-09-30T22:54:05.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 -- 172.21.15.142:0/4162770445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159f10 msgr2=0x7eff840683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:05.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 --2- 172.21.15.142:0/4162770445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159f10 0x7eff840683e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7eff700099b0 tx=0x7eff70009250 comp rx=0 tx=0).stop 2023-09-30T22:54:05.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 -- 172.21.15.142:0/4162770445 shutdown_connections 2023-09-30T22:54:05.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 --2- 172.21.15.142:0/4162770445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84159b40 0x7eff8406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 --2- 172.21.15.142:0/4162770445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159f10 0x7eff840683e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 -- 172.21.15.142:0/4162770445 >> 172.21.15.142:0/4162770445 conn(0x7eff840c9950 msgr2=0x7eff840c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 -- 172.21.15.142:0/4162770445 shutdown_connections 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.490+0000 7eff8abff700 1 -- 172.21.15.142:0/4162770445 wait complete. 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.491+0000 7eff8abff700 1 Processor -- start 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.491+0000 7eff8abff700 1 -- start start 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.492+0000 7eff8abff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84067620 0x7eff8416ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.492+0000 7eff8abff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159b40 0x7eff840b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.492+0000 7eff8abff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff84159f10 0x7eff840b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:05.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.492+0000 7eff8abff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8416ea50 con 0x7eff84159b40 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.492+0000 7eff8abff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8416ddd0 con 0x7eff84159f10 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.492+0000 7eff8abff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8416e0b0 con 0x7eff84067620 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159b40 0x7eff840b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159b40 0x7eff840b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56586/0 (socket says 172.21.15.142:56586) 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 -- 172.21.15.142:0/2782635343 learned_addr learned my addr 172.21.15.142:0/2782635343 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff8899b700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84067620 0x7eff8416ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff8919c700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff84159f10 0x7eff840b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 -- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84067620 msgr2=0x7eff8416ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84067620 0x7eff8416ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 -- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff84159f10 msgr2=0x7eff840b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff84159f10 0x7eff840b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 -- 172.21.15.142:0/2782635343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700094f0 con 0x7eff84159b40 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff8919c700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff84159f10 0x7eff840b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff83fff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159b40 0x7eff840b23f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7eff70009290 tx=0x7eff70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.493+0000 7eff80ff9700 1 -- 172.21.15.142:0/2782635343 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70026480 con 0x7eff84159b40 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.494+0000 7eff80ff9700 1 -- 172.21.15.142:0/2782635343 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7001f070 con 0x7eff84159b40 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.494+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8416e390 con 0x7eff84159b40 2023-09-30T22:54:05.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.494+0000 7eff80ff9700 1 -- 172.21.15.142:0/2782635343 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70026830 con 0x7eff84159b40 2023-09-30T22:54:05.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.494+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8416b390 con 0x7eff84159b40 2023-09-30T22:54:05.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.495+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8416eb90 con 0x7eff84159b40 2023-09-30T22:54:05.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.496+0000 7eff80ff9700 1 -- 172.21.15.142:0/2782635343 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff70026ba0 con 0x7eff84159b40 2023-09-30T22:54:05.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.497+0000 7eff80ff9700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff68067330 0x7eff680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:05.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.497+0000 7eff80ff9700 1 -- 172.21.15.142:0/2782635343 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5576+0+0 (secure 0 0 0) 0x7eff70021070 con 0x7eff84159b40 2023-09-30T22:54:05.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.497+0000 7eff8899b700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff68067330 0x7eff680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:05.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.498+0000 7eff8899b700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff68067330 0x7eff680697e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff78006f00 tx=0x7eff78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:05.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.502+0000 7eff80ff9700 1 -- 172.21.15.142:0/2782635343 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff8416eb90 con 0x7eff84159b40 2023-09-30T22:54:05.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:05.691+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7eff8416eb90 con 0x7eff84159b40 2023-09-30T22:54:06.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.269+0000 7eff80ff9700 1 -- 172.21.15.142:0/2782635343 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7eff8416eb90 con 0x7eff84159b40 2023-09-30T22:54:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.277+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff68067330 msgr2=0x7eff680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.277+0000 7eff8abff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff68067330 0x7eff680697e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff78006f00 tx=0x7eff78008040 comp rx=0 tx=0).stop 2023-09-30T22:54:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.277+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159b40 msgr2=0x7eff840b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.277+0000 7eff8abff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159b40 0x7eff840b23f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7eff70009290 tx=0x7eff70017000 comp rx=0 tx=0).stop 2023-09-30T22:54:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.277+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 shutdown_connections 2023-09-30T22:54:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.278+0000 7eff8abff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff68067330 0x7eff680697e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.278+0000 7eff8abff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff84159f10 0x7eff840b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.278+0000 7eff8abff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff84067620 0x7eff8416ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.278+0000 7eff8abff700 1 --2- 172.21.15.142:0/2782635343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff84159b40 0x7eff840b23f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.278+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 >> 172.21.15.142:0/2782635343 conn(0x7eff840c9950 msgr2=0x7eff840c1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.279+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 shutdown_connections 2023-09-30T22:54:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.279+0000 7eff8abff700 1 -- 172.21.15.142:0/2782635343 wait complete. 2023-09-30T22:54:06.282 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:54:06.300 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:54:06.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.491+0000 7f186f5ff700 1 Processor -- start 2023-09-30T22:54:06.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.491+0000 7f186f5ff700 1 -- start start 2023-09-30T22:54:06.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.492+0000 7f186f5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18680b0cc0 0x7f18680c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186f5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f18680ca5e0 0x7f186806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186f5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186806a560 con 0x7f18680b1090 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186f5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18680b32b0 con 0x7f18680b0cc0 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186f5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18680cad30 con 0x7f18680ca5e0 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186d39b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18680b0cc0 0x7f18680c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186d39b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18680b0cc0 0x7f18680c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56598/0 (socket says 172.21.15.142:56598) 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186d39b700 1 -- 172.21.15.142:0/2212111869 learned_addr learned my addr 172.21.15.142:0/2212111869 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186db9c700 1 --2- 172.21.15.142:0/2212111869 >> v2:172.21.15.148:3300/0 conn(0x7f18680ca5e0 0x7f186806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186d39b700 1 -- 172.21.15.142:0/2212111869 >> v2:172.21.15.148:3300/0 conn(0x7f18680ca5e0 msgr2=0x7f186806a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186d39b700 1 --2- 172.21.15.142:0/2212111869 >> v2:172.21.15.148:3300/0 conn(0x7f18680ca5e0 0x7f186806a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186d39b700 1 -- 172.21.15.142:0/2212111869 >> v1:172.21.15.148:6789/0 conn(0x7f18680b1090 legacy=0x7f18680c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:06.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.493+0000 7f186d39b700 1 -- 172.21.15.142:0/2212111869 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680b2450 con 0x7f18680b0cc0 2023-09-30T22:54:06.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f186d39b700 1 --2- 172.21.15.142:0/2212111869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b0cc0 0x7f18680c8600 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f186815c760 tx=0x7f1864009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446f1e09247e9665 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f185ffff700 1 -- 172.21.15.142:0/2212111869 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864009e70 con 0x7f18680b0cc0 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f185ffff700 1 -- 172.21.15.142:0/2212111869 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400b860 con 0x7f18680b0cc0 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f185ffff700 1 -- 172.21.15.142:0/2212111869 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400bc00 con 0x7f18680b0cc0 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f186f5ff700 1 -- 172.21.15.142:0/2212111869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b0cc0 msgr2=0x7f18680c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2212111869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b0cc0 0x7f18680c8600 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f186815c760 tx=0x7f1864009250 comp rx=0 tx=0).stop 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f186f5ff700 1 -- 172.21.15.142:0/2212111869 shutdown_connections 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2212111869 >> v2:172.21.15.148:3300/0 conn(0x7f18680ca5e0 0x7f186806a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2212111869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b0cc0 0x7f18680c8600 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.494+0000 7f186f5ff700 1 -- 172.21.15.142:0/2212111869 >> 172.21.15.142:0/2212111869 conn(0x7f18680cb2f0 msgr2=0x7f18680cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.495+0000 7f186f5ff700 1 -- 172.21.15.142:0/2212111869 shutdown_connections 2023-09-30T22:54:06.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.495+0000 7f186f5ff700 1 -- 172.21.15.142:0/2212111869 wait complete. 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.496+0000 7f186f5ff700 1 Processor -- start 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.496+0000 7f186f5ff700 1 -- start start 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.497+0000 7f186f5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18680b0cc0 0x7f18681532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.497+0000 7f186f5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b1090 0x7f18680c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.497+0000 7f186f5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18680ca5e0 0x7f18681583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.497+0000 7f186f5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186814f680 con 0x7f18680b1090 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.497+0000 7f186f5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c61a0 con 0x7f18680b0cc0 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.497+0000 7f186f5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c6d20 con 0x7f18680ca5e0 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.497+0000 7f186cb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b1090 0x7f18680c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:06.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b1090 0x7f18680c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56604/0 (socket says 172.21.15.142:56604) 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 -- 172.21.15.142:0/2090726101 learned_addr learned my addr 172.21.15.142:0/2090726101 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186d39b700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18680b0cc0 0x7f18681532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186db9c700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18680ca5e0 0x7f18681583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 -- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18680ca5e0 msgr2=0x7f18681583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18680ca5e0 0x7f18681583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 -- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18680b0cc0 msgr2=0x7f18681532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18680b0cc0 0x7f18681532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 -- 172.21.15.142:0/2090726101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18640094f0 con 0x7f18680b1090 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186d39b700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18680b0cc0 0x7f18681532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186cb9a700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b1090 0x7f18680c5930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f185800c790 tx=0x7f1858007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:06.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f185d7fa700 1 -- 172.21.15.142:0/2090726101 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858011590 con 0x7f18680b1090 2023-09-30T22:54:06.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f185d7fa700 1 -- 172.21.15.142:0/2090726101 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18580116f0 con 0x7f18680b1090 2023-09-30T22:54:06.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18680c5e70 con 0x7f18680b1090 2023-09-30T22:54:06.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.498+0000 7f185d7fa700 1 -- 172.21.15.142:0/2090726101 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858011ab0 con 0x7f18680b1090 2023-09-30T22:54:06.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.499+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18680c66d0 con 0x7f18680b1090 2023-09-30T22:54:06.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.499+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18680c6ed0 con 0x7f18680b1090 2023-09-30T22:54:06.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.500+0000 7f185d7fa700 1 -- 172.21.15.142:0/2090726101 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f185801a360 con 0x7f18680b1090 2023-09-30T22:54:06.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.501+0000 7f185d7fa700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f184c067330 0x7f184c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:06.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.501+0000 7f185d7fa700 1 -- 172.21.15.142:0/2090726101 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f1858083bf0 con 0x7f18680b1090 2023-09-30T22:54:06.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.502+0000 7f186d39b700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f184c067330 0x7f184c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:06.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.502+0000 7f186d39b700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f184c067330 0x7f184c0697e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f186815c760 tx=0x7f1864017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:06.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.506+0000 7f185d7fa700 1 -- 172.21.15.142:0/2090726101 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f18680c6ed0 con 0x7f18680b1090 2023-09-30T22:54:06.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:06.740+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18680c6e90 con 0x7f18680b1090 2023-09-30T22:54:07.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.270+0000 7f185d7fa700 1 -- 172.21.15.142:0/2090726101 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f18580170c0 con 0x7f18680b1090 2023-09-30T22:54:07.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f184c067330 msgr2=0x7f184c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f184c067330 0x7f184c0697e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f186815c760 tx=0x7f1864017000 comp rx=0 tx=0).stop 2023-09-30T22:54:07.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b1090 msgr2=0x7f18680c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b1090 0x7f18680c5930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f185800c790 tx=0x7f1858007f20 comp rx=0 tx=0).stop 2023-09-30T22:54:07.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 shutdown_connections 2023-09-30T22:54:07.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f184c067330 0x7f184c0697e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f18680ca5e0 0x7f18681583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18680b0cc0 0x7f18681532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 --2- 172.21.15.142:0/2090726101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18680b1090 0x7f18680c5930 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f185800c790 tx=0x7f1858007f20 comp rx=0 tx=0).stop 2023-09-30T22:54:07.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.284+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 >> 172.21.15.142:0/2090726101 conn(0x7f18680cb2f0 msgr2=0x7f18680c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:07.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.286+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 shutdown_connections 2023-09-30T22:54:07.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.286+0000 7f186f5ff700 1 -- 172.21.15.142:0/2090726101 wait complete. 2023-09-30T22:54:07.293 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 7 and data pool 8 2023-09-30T22:54:07.312 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:54:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.503+0000 7fbef41ff700 1 Processor -- start 2023-09-30T22:54:07.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.503+0000 7fbef41ff700 1 -- start start 2023-09-30T22:54:07.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.504+0000 7fbef41ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbeec157ab0 0x7fbeec15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.504+0000 7fbef41ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0d0550 con 0x7fbeec0cc3b0 2023-09-30T22:54:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.504+0000 7fbef41ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0cf940 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.504+0000 7fbef41ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeec0cfc20 con 0x7fbeec157ab0 2023-09-30T22:54:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef279c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbeec0cc3b0 0x7fbeec06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52614/0 (socket says 172.21.15.142:52614) 2023-09-30T22:54:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef279c700 1 -- 172.21.15.142:0/2501623500 learned_addr learned my addr 172.21.15.142:0/2501623500 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:07.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef179a700 1 --2- 172.21.15.142:0/2501623500 >> v2:172.21.15.148:3300/0 conn(0x7fbeec157ab0 0x7fbeec15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef0f99700 1 -- 172.21.15.142:0/2501623500 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417557075 0 0) 0x7fbeec0d0550 con 0x7fbeec0cc3b0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef0f99700 1 -- 172.21.15.142:0/2501623500 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed8003570 con 0x7fbeec0cc3b0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef179a700 1 -- 172.21.15.142:0/2501623500 >> v1:172.21.15.148:6789/0 conn(0x7fbeec0cbfe0 legacy=0x7fbeec1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef179a700 1 -- 172.21.15.142:0/2501623500 >> v1:172.21.15.142:6789/0 conn(0x7fbeec0cc3b0 legacy=0x7fbeec06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef179a700 1 -- 172.21.15.142:0/2501623500 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0cff00 con 0x7fbeec157ab0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.505+0000 7fbef179a700 1 --2- 172.21.15.142:0/2501623500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec157ab0 0x7fbeec15a2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0098e0 tx=0x7fbedc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80198d4a1ab20455 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef0f99700 1 -- 172.21.15.142:0/2501623500 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00b640 con 0x7fbeec157ab0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef0f99700 1 -- 172.21.15.142:0/2501623500 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc00b7a0 con 0x7fbeec157ab0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef0f99700 1 -- 172.21.15.142:0/2501623500 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00bb40 con 0x7fbeec157ab0 2023-09-30T22:54:07.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef41ff700 1 -- 172.21.15.142:0/2501623500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec157ab0 msgr2=0x7fbeec15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef41ff700 1 --2- 172.21.15.142:0/2501623500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec157ab0 0x7fbeec15a2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0098e0 tx=0x7fbedc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef41ff700 1 -- 172.21.15.142:0/2501623500 shutdown_connections 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef41ff700 1 --2- 172.21.15.142:0/2501623500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec157ab0 0x7fbeec15a2a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef41ff700 1 -- 172.21.15.142:0/2501623500 >> 172.21.15.142:0/2501623500 conn(0x7fbeec0d0a80 msgr2=0x7fbeec0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef41ff700 1 -- 172.21.15.142:0/2501623500 shutdown_connections 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.506+0000 7fbef41ff700 1 -- 172.21.15.142:0/2501623500 wait complete. 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.508+0000 7fbef41ff700 1 Processor -- start 2023-09-30T22:54:07.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.508+0000 7fbef41ff700 1 -- start start 2023-09-30T22:54:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef41ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeec0cbfe0 0x7fbeec16b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef41ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec0cc3b0 0x7fbeec0b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef41ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeec157ab0 0x7fbeec0b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef41ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec16c530 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef41ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0b8e80 con 0x7fbeec0cc3b0 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef41ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec16bc00 con 0x7fbeec157ab0 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef1f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeec0cbfe0 0x7fbeec16b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef1f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeec0cbfe0 0x7fbeec16b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56606/0 (socket says 172.21.15.142:56606) 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef1f9b700 1 -- 172.21.15.142:0/894444473 learned_addr learned my addr 172.21.15.142:0/894444473 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef179a700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec0cc3b0 0x7fbeec0b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef279c700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeec157ab0 0x7fbeec0b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.509+0000 7fbef1f9b700 1 -- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeec157ab0 msgr2=0x7fbeec0b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef1f9b700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeec157ab0 0x7fbeec0b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef1f9b700 1 -- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec0cc3b0 msgr2=0x7fbeec0b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef1f9b700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec0cc3b0 0x7fbeec0b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef1f9b700 1 -- 172.21.15.142:0/894444473 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc009420 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef279c700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeec157ab0 0x7fbeec0b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef179a700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec0cc3b0 0x7fbeec0b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef1f9b700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeec0cbfe0 0x7fbeec16b250 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c590 tx=0x7fbee800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbee1ffb700 1 -- 172.21.15.142:0/894444473 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8011590 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbee1ffb700 1 -- 172.21.15.142:0/894444473 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee80116f0 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec16bee0 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbee1ffb700 1 -- 172.21.15.142:0/894444473 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8011ab0 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.510+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec16b790 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.511+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec16c380 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.512+0000 7fbee1ffb700 1 -- 172.21.15.142:0/894444473 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbee801b3b0 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.513+0000 7fbee1ffb700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbed0067330 0x7fbed00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.513+0000 7fbee1ffb700 1 -- 172.21.15.142:0/894444473 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbee8084150 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.513+0000 7fbef179a700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbed0067330 0x7fbed00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.514+0000 7fbef179a700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbed0067330 0x7fbed00697e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbeec157ee0 tx=0x7fbedc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:07.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.517+0000 7fbee1ffb700 1 -- 172.21.15.142:0/894444473 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbee8051050 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.707+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeec06fc10 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.708+0000 7fbee1ffb700 1 -- 172.21.15.142:0/894444473 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fbee8054670 con 0x7fbeec0cbfe0 2023-09-30T22:54:07.710 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:07.710 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":47,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:54:06.742063+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:54:04.395113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T22:54:05.729484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:54:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.710+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbed0067330 msgr2=0x7fbed00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbed0067330 0x7fbed00697e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbeec157ee0 tx=0x7fbedc017000 comp rx=0 tx=0).stop 2023-09-30T22:54:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeec0cbfe0 msgr2=0x7fbeec16b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeec0cbfe0 0x7fbeec16b250 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c590 tx=0x7fbee800c950 comp rx=0 tx=0).stop 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 shutdown_connections 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbed0067330 0x7fbed00697e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbeec157ab0 0x7fbeec0b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeec0cbfe0 0x7fbeec16b250 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 --2- 172.21.15.142:0/894444473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbeec0cc3b0 0x7fbeec0b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 >> 172.21.15.142:0/894444473 conn(0x7fbeec0d0a80 msgr2=0x7fbeec1567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 shutdown_connections 2023-09-30T22:54:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.711+0000 7fbef41ff700 1 -- 172.21.15.142:0/894444473 wait complete. 2023-09-30T22:54:07.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:54:07.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.919+0000 7f16addff700 1 Processor -- start 2023-09-30T22:54:07.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.919+0000 7f16addff700 1 -- start start 2023-09-30T22:54:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16addff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16a80aebf0 0x7f16a806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16addff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16a806f190 0x7f16a8159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16addff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a80b0ee0 con 0x7f16a815a0d0 2023-09-30T22:54:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16addff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80aefc0 con 0x7f16a80aebf0 2023-09-30T22:54:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16addff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a815a4d0 con 0x7f16a806f190 2023-09-30T22:54:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16a77fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16a80aebf0 0x7f16a806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16a77fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16a80aebf0 0x7f16a806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56612/0 (socket says 172.21.15.142:56612) 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16a77fe700 1 -- 172.21.15.142:0/2876414364 learned_addr learned my addr 172.21.15.142:0/2876414364 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.920+0000 7f16a7fff700 1 --1- 172.21.15.142:0/2876414364 >> v1:172.21.15.142:6789/0 conn(0x7f16a815a0d0 0x7f16a8156590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52628/0 (socket says 172.21.15.142:52628) 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a6ffd700 1 --2- 172.21.15.142:0/2876414364 >> v2:172.21.15.148:3300/0 conn(0x7f16a806f190 0x7f16a8159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a77fe700 1 -- 172.21.15.142:0/2876414364 >> v2:172.21.15.148:3300/0 conn(0x7f16a806f190 msgr2=0x7f16a8159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a77fe700 1 --2- 172.21.15.142:0/2876414364 >> v2:172.21.15.148:3300/0 conn(0x7f16a806f190 0x7f16a8159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a77fe700 1 -- 172.21.15.142:0/2876414364 >> v1:172.21.15.142:6789/0 conn(0x7f16a815a0d0 legacy=0x7f16a8156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a77fe700 1 -- 172.21.15.142:0/2876414364 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80b02d0 con 0x7f16a80aebf0 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a67fc700 1 -- 172.21.15.142:0/2876414364 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366699241 0 0) 0x7f16a80b0ee0 con 0x7f16a815a0d0 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a6ffd700 1 --2- 172.21.15.142:0/2876414364 >> v2:172.21.15.148:3300/0 conn(0x7f16a806f190 0x7f16a8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a77fe700 1 --2- 172.21.15.142:0/2876414364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a80aebf0 0x7f16a806ec50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f16a806ce90 tx=0x7f169800b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa86be095e72a6b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:07.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a67fc700 1 -- 172.21.15.142:0/2876414364 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800db10 con 0x7f16a80aebf0 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a67fc700 1 -- 172.21.15.142:0/2876414364 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169800dc70 con 0x7f16a80aebf0 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.921+0000 7f16a67fc700 1 -- 172.21.15.142:0/2876414364 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698017410 con 0x7f16a80aebf0 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 -- 172.21.15.142:0/2876414364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a80aebf0 msgr2=0x7f16a806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 --2- 172.21.15.142:0/2876414364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a80aebf0 0x7f16a806ec50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f16a806ce90 tx=0x7f169800b4e0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 -- 172.21.15.142:0/2876414364 shutdown_connections 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 --2- 172.21.15.142:0/2876414364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a80aebf0 0x7f16a806ec50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 --2- 172.21.15.142:0/2876414364 >> v2:172.21.15.148:3300/0 conn(0x7f16a806f190 0x7f16a8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 -- 172.21.15.142:0/2876414364 >> 172.21.15.142:0/2876414364 conn(0x7f16a80680c0 msgr2=0x7f16a80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 -- 172.21.15.142:0/2876414364 shutdown_connections 2023-09-30T22:54:07.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.922+0000 7f16addff700 1 -- 172.21.15.142:0/2876414364 wait complete. 2023-09-30T22:54:07.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.923+0000 7f16addff700 1 Processor -- start 2023-09-30T22:54:07.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.924+0000 7f16addff700 1 -- start start 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.924+0000 7f16addff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a806f190 0x7f16a8154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.924+0000 7f16addff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a80aebf0 0x7f16a8151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.924+0000 7f16addff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a815a0d0 0x7f16a8152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.924+0000 7f16addff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81589c0 con 0x7f16a815a0d0 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.924+0000 7f16addff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8166390 con 0x7f16a80aebf0 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.924+0000 7f16addff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8166670 con 0x7f16a806f190 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a815a0d0 0x7f16a8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a815a0d0 0x7f16a8152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56618/0 (socket says 172.21.15.142:56618) 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 -- 172.21.15.142:0/4171619602 learned_addr learned my addr 172.21.15.142:0/4171619602 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a77fe700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a806f190 0x7f16a8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a6ffd700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a80aebf0 0x7f16a8151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 -- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a806f190 msgr2=0x7f16a8154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a806f190 0x7f16a8154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 -- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a80aebf0 msgr2=0x7f16a8151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a80aebf0 0x7f16a8151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 -- 172.21.15.142:0/4171619602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169800b780 con 0x7f16a815a0d0 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.925+0000 7f16a7fff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a815a0d0 0x7f16a8152070 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f16a000ccc0 tx=0x7f16a0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.926+0000 7f168f7fe700 1 -- 172.21.15.142:0/4171619602 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0005df0 con 0x7f16a815a0d0 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.926+0000 7f168f7fe700 1 -- 172.21.15.142:0/4171619602 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a000a600 con 0x7f16a815a0d0 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.926+0000 7f168f7fe700 1 -- 172.21.15.142:0/4171619602 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000a9c0 con 0x7f16a815a0d0 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.926+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8150b90 con 0x7f16a815a0d0 2023-09-30T22:54:07.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.926+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a8151150 con 0x7f16a815a0d0 2023-09-30T22:54:07.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.927+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8154b40 con 0x7f16a815a0d0 2023-09-30T22:54:07.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.928+0000 7f168f7fe700 1 -- 172.21.15.142:0/4171619602 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f16a00070f0 con 0x7f16a815a0d0 2023-09-30T22:54:07.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.929+0000 7f168f7fe700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1694067330 0x7f16940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:07.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.929+0000 7f168f7fe700 1 -- 172.21.15.142:0/4171619602 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f16a0084c30 con 0x7f16a815a0d0 2023-09-30T22:54:07.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.929+0000 7f16a77fe700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1694067330 0x7f16940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:07.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.929+0000 7f16a77fe700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1694067330 0x7f16940697e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f16a8153860 tx=0x7f1698019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:07.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:07.933+0000 7f168f7fe700 1 -- 172.21.15.142:0/4171619602 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f16a0051bb0 con 0x7f16a815a0d0 2023-09-30T22:54:08.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.126+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16a8151340 con 0x7f16a815a0d0 2023-09-30T22:54:08.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.127+0000 7f168f7fe700 1 -- 172.21.15.142:0/4171619602 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17023 (secure 0 0 0) 0x7f16a00551d0 con 0x7f16a815a0d0 2023-09-30T22:54:08.129 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:08.129 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":47,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:54:06.742063+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:54:04.395113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T22:54:05.729484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:54:08.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.129+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1694067330 msgr2=0x7f16940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:08.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.129+0000 7f16addff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1694067330 0x7f16940697e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f16a8153860 tx=0x7f1698019000 comp rx=0 tx=0).stop 2023-09-30T22:54:08.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.129+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a815a0d0 msgr2=0x7f16a8152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:08.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.129+0000 7f16addff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a815a0d0 0x7f16a8152070 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f16a000ccc0 tx=0x7f16a0001a70 comp rx=0 tx=0).stop 2023-09-30T22:54:08.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 shutdown_connections 2023-09-30T22:54:08.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1694067330 0x7f16940697e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16a815a0d0 0x7f16a8152070 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a806f190 0x7f16a8154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 --2- 172.21.15.142:0/4171619602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a80aebf0 0x7f16a8151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 >> 172.21.15.142:0/4171619602 conn(0x7f16a80680c0 msgr2=0x7f16a80c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:08.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 shutdown_connections 2023-09-30T22:54:08.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.130+0000 7f16addff700 1 -- 172.21.15.142:0/4171619602 wait complete. 2023-09-30T22:54:08.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:54:08.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.344+0000 7eff205ff700 1 Processor -- start 2023-09-30T22:54:08.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.344+0000 7eff205ff700 1 -- start start 2023-09-30T22:54:08.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.345+0000 7eff205ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff18159f10 0x7eff1806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:08.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.345+0000 7eff205ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1806b650 con 0x7eff18159b40 2023-09-30T22:54:08.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.345+0000 7eff205ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1806aa40 con 0x7eff18067620 2023-09-30T22:54:08.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.345+0000 7eff205ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1806ad20 con 0x7eff18159f10 2023-09-30T22:54:08.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1db9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff18159f10 0x7eff1806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:08.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1e39b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7eff18159b40 0x7eff180683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52634/0 (socket says 172.21.15.142:52634) 2023-09-30T22:54:08.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1e39b700 1 -- 172.21.15.142:0/810706378 learned_addr learned my addr 172.21.15.142:0/810706378 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1db9a700 1 -- 172.21.15.142:0/810706378 >> v1:172.21.15.148:6789/0 conn(0x7eff18067620 legacy=0x7eff18067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1db9a700 1 -- 172.21.15.142:0/810706378 >> v1:172.21.15.142:6789/0 conn(0x7eff18159b40 legacy=0x7eff180683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1db9a700 1 -- 172.21.15.142:0/810706378 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1806b000 con 0x7eff18159f10 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1d399700 1 -- 172.21.15.142:0/810706378 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346169112 0 0) 0x7eff1806b650 con 0x7eff18159b40 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.346+0000 7eff1db9a700 1 --2- 172.21.15.142:0/810706378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff1806a360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7eff080098e0 tx=0x7eff080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6de66992ad9d01 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff1d399700 1 -- 172.21.15.142:0/810706378 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08009e80 con 0x7eff18159f10 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff1d399700 1 -- 172.21.15.142:0/810706378 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800b860 con 0x7eff18159f10 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff1d399700 1 -- 172.21.15.142:0/810706378 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800bbe0 con 0x7eff18159f10 2023-09-30T22:54:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff205ff700 1 -- 172.21.15.142:0/810706378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 msgr2=0x7eff1806a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff205ff700 1 --2- 172.21.15.142:0/810706378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff1806a360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7eff080098e0 tx=0x7eff080091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff205ff700 1 -- 172.21.15.142:0/810706378 shutdown_connections 2023-09-30T22:54:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff205ff700 1 --2- 172.21.15.142:0/810706378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff1806a360 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff205ff700 1 -- 172.21.15.142:0/810706378 >> 172.21.15.142:0/810706378 conn(0x7eff180c9950 msgr2=0x7eff180c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff205ff700 1 -- 172.21.15.142:0/810706378 shutdown_connections 2023-09-30T22:54:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.347+0000 7eff205ff700 1 -- 172.21.15.142:0/810706378 wait complete. 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.349+0000 7eff205ff700 1 Processor -- start 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.349+0000 7eff205ff700 1 -- start start 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff205ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff18067620 0x7eff1816bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff205ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff18159b40 0x7eff180c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff205ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff180c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff205ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff180b17d0 con 0x7eff18159f10 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff205ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1816c2f0 con 0x7eff18067620 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff205ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180c70c0 con 0x7eff18159b40 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff1eb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff180c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff1eb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff180c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56628/0 (socket says 172.21.15.142:56628) 2023-09-30T22:54:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff1eb9c700 1 -- 172.21.15.142:0/2778739330 learned_addr learned my addr 172.21.15.142:0/2778739330 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff1e39b700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff18067620 0x7eff1816bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff1db9a700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff18159b40 0x7eff180c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.350+0000 7eff1eb9c700 1 -- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff18159b40 msgr2=0x7eff180c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff1eb9c700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff18159b40 0x7eff180c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff1eb9c700 1 -- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff18067620 msgr2=0x7eff1816bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff1eb9c700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff18067620 0x7eff1816bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff1eb9c700 1 -- 172.21.15.142:0/2778739330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009420 con 0x7eff18159f10 2023-09-30T22:54:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff1eb9c700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff180c44d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7eff1000c8e0 tx=0x7eff10001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff0e7fc700 1 -- 172.21.15.142:0/2778739330 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10012630 con 0x7eff18159f10 2023-09-30T22:54:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff0e7fc700 1 -- 172.21.15.142:0/2778739330 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10012790 con 0x7eff18159f10 2023-09-30T22:54:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff180b0ea0 con 0x7eff18159f10 2023-09-30T22:54:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff0e7fc700 1 -- 172.21.15.142:0/2778739330 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10012b50 con 0x7eff18159f10 2023-09-30T22:54:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.351+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff180b1460 con 0x7eff18159f10 2023-09-30T22:54:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.352+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff180699b0 con 0x7eff18159f10 2023-09-30T22:54:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.353+0000 7eff0e7fc700 1 -- 172.21.15.142:0/2778739330 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff1001a3a0 con 0x7eff18159f10 2023-09-30T22:54:08.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.354+0000 7eff0e7fc700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:08.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.354+0000 7eff0e7fc700 1 -- 172.21.15.142:0/2778739330 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff10084e00 con 0x7eff18159f10 2023-09-30T22:54:08.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.354+0000 7eff1e39b700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:08.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.355+0000 7eff1e39b700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7eff180c5d30 tx=0x7eff14007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:08.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.359+0000 7eff0e7fc700 1 -- 172.21.15.142:0/2778739330 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff10051c60 con 0x7eff18159f10 2023-09-30T22:54:08.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:08.592+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff1806b2e0 con 0x7eff18159f10 2023-09-30T22:54:09.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.297+0000 7eff0e7fc700 1 -- 172.21.15.142:0/2778739330 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff10055280 con 0x7eff18159f10 2023-09-30T22:54:09.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 msgr2=0x7efefc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7eff180c5d30 tx=0x7eff14007d10 comp rx=0 tx=0).stop 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 msgr2=0x7eff180c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff180c44d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7eff1000c8e0 tx=0x7eff10001710 comp rx=0 tx=0).stop 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 shutdown_connections 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18159f10 0x7eff180c44d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff18067620 0x7eff1816bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 --2- 172.21.15.142:0/2778739330 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff18159b40 0x7eff180c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 >> 172.21.15.142:0/2778739330 conn(0x7eff180c9950 msgr2=0x7eff180c1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.299+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 shutdown_connections 2023-09-30T22:54:09.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.300+0000 7eff205ff700 1 -- 172.21.15.142:0/2778739330 wait complete. 2023-09-30T22:54:09.321 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:54:09.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.517+0000 7f51b29ff700 1 Processor -- start 2023-09-30T22:54:09.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.517+0000 7f51b29ff700 1 -- start start 2023-09-30T22:54:09.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.519+0000 7f51b29ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51ac0cbfe0 0x7f51ac15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:09.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.519+0000 7f51b29ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0d0550 con 0x7f51ac157ab0 2023-09-30T22:54:09.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.519+0000 7f51b29ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0cf940 con 0x7f51ac0cc3b0 2023-09-30T22:54:09.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.519+0000 7f51b29ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0cfc20 con 0x7f51ac0cbfe0 2023-09-30T22:54:09.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.519+0000 7f51b0f9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f51ac157ab0 0x7f51ac06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52646/0 (socket says 172.21.15.142:52646) 2023-09-30T22:54:09.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.519+0000 7f51b0f9c700 1 -- 172.21.15.142:0/3235673863 learned_addr learned my addr 172.21.15.142:0/3235673863 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.520+0000 7f51abfff700 1 --2- 172.21.15.142:0/3235673863 >> v2:172.21.15.148:3300/0 conn(0x7f51ac0cbfe0 0x7f51ac15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.520+0000 7f51aaffd700 1 -- 172.21.15.142:0/3235673863 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599437718 0 0) 0x7f51ac0d0550 con 0x7f51ac157ab0 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.520+0000 7f51aaffd700 1 -- 172.21.15.142:0/3235673863 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5194003570 con 0x7f51ac157ab0 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.520+0000 7f51abfff700 1 -- 172.21.15.142:0/3235673863 >> v1:172.21.15.148:6789/0 conn(0x7f51ac0cc3b0 legacy=0x7f51ac1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.520+0000 7f51abfff700 1 -- 172.21.15.142:0/3235673863 >> v1:172.21.15.142:6789/0 conn(0x7f51ac157ab0 legacy=0x7f51ac06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.520+0000 7f51abfff700 1 -- 172.21.15.142:0/3235673863 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0cff00 con 0x7f51ac0cbfe0 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.520+0000 7f51abfff700 1 --2- 172.21.15.142:0/3235673863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 0x7f51ac15a2a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f519c0098e0 tx=0x7f519c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e38ecc16d9ba3d8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51aaffd700 1 -- 172.21.15.142:0/3235673863 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00b640 con 0x7f51ac0cbfe0 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51aaffd700 1 -- 172.21.15.142:0/3235673863 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c00b7a0 con 0x7f51ac0cbfe0 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51aaffd700 1 -- 172.21.15.142:0/3235673863 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00bb40 con 0x7f51ac0cbfe0 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51b29ff700 1 -- 172.21.15.142:0/3235673863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 msgr2=0x7f51ac15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51b29ff700 1 --2- 172.21.15.142:0/3235673863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 0x7f51ac15a2a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f519c0098e0 tx=0x7f519c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51b29ff700 1 -- 172.21.15.142:0/3235673863 shutdown_connections 2023-09-30T22:54:09.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51b29ff700 1 --2- 172.21.15.142:0/3235673863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 0x7f51ac15a2a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51b29ff700 1 -- 172.21.15.142:0/3235673863 >> 172.21.15.142:0/3235673863 conn(0x7f51ac0d0a80 msgr2=0x7f51ac0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:09.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51b29ff700 1 -- 172.21.15.142:0/3235673863 shutdown_connections 2023-09-30T22:54:09.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.521+0000 7f51b29ff700 1 -- 172.21.15.142:0/3235673863 wait complete. 2023-09-30T22:54:09.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.523+0000 7f51b29ff700 1 Processor -- start 2023-09-30T22:54:09.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.523+0000 7f51b29ff700 1 -- start start 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b29ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 0x7f51ac16af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b29ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51ac0cc3b0 0x7f51ac0b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b29ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51ac157ab0 0x7f51ac0b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b29ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac16c2b0 con 0x7f51ac157ab0 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b29ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac16b9c0 con 0x7f51ac0cbfe0 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b29ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac16bc60 con 0x7f51ac0cc3b0 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51ac157ab0 0x7f51ac0b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51ac157ab0 0x7f51ac0b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56640/0 (socket says 172.21.15.142:56640) 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 -- 172.21.15.142:0/1605762684 learned_addr learned my addr 172.21.15.142:0/1605762684 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51ab7fe700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51ac0cc3b0 0x7f51ac0b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:09.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51abfff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 0x7f51ac16af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 -- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51ac0cc3b0 msgr2=0x7f51ac0b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51ac0cc3b0 0x7f51ac0b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 -- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 msgr2=0x7f51ac16af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 0x7f51ac16af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.524+0000 7f51b0f9c700 1 -- 172.21.15.142:0/1605762684 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c009420 con 0x7f51ac157ab0 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.525+0000 7f51b0f9c700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51ac157ab0 0x7f51ac0b8870 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f51a4001460 tx=0x7f51a4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.525+0000 7f5193fff700 1 -- 172.21.15.142:0/1605762684 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400a950 con 0x7f51ac157ab0 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.525+0000 7f5193fff700 1 -- 172.21.15.142:0/1605762684 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400aab0 con 0x7f51ac157ab0 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.525+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac16bf40 con 0x7f51ac157ab0 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.525+0000 7f5193fff700 1 -- 172.21.15.142:0/1605762684 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400ae30 con 0x7f51ac157ab0 2023-09-30T22:54:09.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.525+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac16b4b0 con 0x7f51ac157ab0 2023-09-30T22:54:09.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.526+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac0c7df0 con 0x7f51ac157ab0 2023-09-30T22:54:09.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.527+0000 7f5193fff700 1 -- 172.21.15.142:0/1605762684 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f51a4007300 con 0x7f51ac157ab0 2023-09-30T22:54:09.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.528+0000 7f5193fff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5198067330 0x7f51980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:09.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.528+0000 7f5193fff700 1 -- 172.21.15.142:0/1605762684 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51a40850f0 con 0x7f51ac157ab0 2023-09-30T22:54:09.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.528+0000 7f51abfff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5198067330 0x7f51980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:09.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.529+0000 7f51abfff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5198067330 0x7f51980697e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f519c0093f0 tx=0x7f519c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.533+0000 7f5193fff700 1 -- 172.21.15.142:0/1605762684 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f51a4051f40 con 0x7f51ac157ab0 2023-09-30T22:54:09.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:09.763+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f51ac16c3f0 con 0x7f51ac157ab0 2023-09-30T22:54:10.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.305+0000 7f5193fff700 1 -- 172.21.15.142:0/1605762684 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f51a4055560 con 0x7f51ac157ab0 2023-09-30T22:54:10.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5198067330 msgr2=0x7f51980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5198067330 0x7f51980697e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f519c0093f0 tx=0x7f519c017000 comp rx=0 tx=0).stop 2023-09-30T22:54:10.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51ac157ab0 msgr2=0x7f51ac0b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51ac157ab0 0x7f51ac0b8870 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f51a4001460 tx=0x7f51a4001a40 comp rx=0 tx=0).stop 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 shutdown_connections 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5198067330 0x7f51980697e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51ac157ab0 0x7f51ac0b8870 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51ac0cbfe0 0x7f51ac16af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 --2- 172.21.15.142:0/1605762684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51ac0cc3b0 0x7f51ac0b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 >> 172.21.15.142:0/1605762684 conn(0x7f51ac0d0a80 msgr2=0x7f51ac06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 shutdown_connections 2023-09-30T22:54:10.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.308+0000 7f51b29ff700 1 -- 172.21.15.142:0/1605762684 wait complete. 2023-09-30T22:54:10.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.517+0000 7f3f575ff700 1 Processor -- start 2023-09-30T22:54:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.517+0000 7f3f575ff700 1 -- start start 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.518+0000 7f3f575ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f50159b90 0x7f3f5015a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.518+0000 7f3f575ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f50069f10 0x7f3f5006a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.518+0000 7f3f575ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500b0ee0 con 0x7f3f500aebf0 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.518+0000 7f3f575ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500aefc0 con 0x7f3f50069f10 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.518+0000 7f3f575ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5015a550 con 0x7f3f50159b90 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f55b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f50069f10 0x7f3f5006a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f55b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f50069f10 0x7f3f5006a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56656/0 (socket says 172.21.15.142:56656) 2023-09-30T22:54:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f55b9c700 1 -- 172.21.15.142:0/608845143 learned_addr learned my addr 172.21.15.142:0/608845143 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:10.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f54b9a700 1 --2- 172.21.15.142:0/608845143 >> v2:172.21.15.148:3300/0 conn(0x7f3f50159b90 0x7f3f5015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f55b9c700 1 -- 172.21.15.142:0/608845143 >> v2:172.21.15.148:3300/0 conn(0x7f3f50159b90 msgr2=0x7f3f5015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f55b9c700 1 --2- 172.21.15.142:0/608845143 >> v2:172.21.15.148:3300/0 conn(0x7f3f50159b90 0x7f3f5015a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f55b9c700 1 -- 172.21.15.142:0/608845143 >> v1:172.21.15.148:6789/0 conn(0x7f3f500aebf0 legacy=0x7f3f5006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.519+0000 7f3f55b9c700 1 -- 172.21.15.142:0/608845143 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5006f360 con 0x7f3f50069f10 2023-09-30T22:54:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f55b9c700 1 --2- 172.21.15.142:0/608845143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f50069f10 0x7f3f5006a350 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3f5006ce90 tx=0x7f3f4800a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcf806ff8b6379e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f47fff700 1 -- 172.21.15.142:0/608845143 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800f070 con 0x7f3f50069f10 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f47fff700 1 -- 172.21.15.142:0/608845143 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4800a2e0 con 0x7f3f50069f10 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f47fff700 1 -- 172.21.15.142:0/608845143 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800cd10 con 0x7f3f50069f10 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f575ff700 1 -- 172.21.15.142:0/608845143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f50069f10 msgr2=0x7f3f5006a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f575ff700 1 --2- 172.21.15.142:0/608845143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f50069f10 0x7f3f5006a350 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3f5006ce90 tx=0x7f3f4800a950 comp rx=0 tx=0).stop 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f575ff700 1 -- 172.21.15.142:0/608845143 shutdown_connections 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f575ff700 1 --2- 172.21.15.142:0/608845143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f50069f10 0x7f3f5006a350 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f575ff700 1 --2- 172.21.15.142:0/608845143 >> v2:172.21.15.148:3300/0 conn(0x7f3f50159b90 0x7f3f5015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f575ff700 1 -- 172.21.15.142:0/608845143 >> 172.21.15.142:0/608845143 conn(0x7f3f500680c0 msgr2=0x7f3f500c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.520+0000 7f3f575ff700 1 -- 172.21.15.142:0/608845143 shutdown_connections 2023-09-30T22:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.521+0000 7f3f575ff700 1 -- 172.21.15.142:0/608845143 wait complete. 2023-09-30T22:54:10.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.522+0000 7f3f575ff700 1 Processor -- start 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.522+0000 7f3f575ff700 1 -- start start 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f575ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f50069f10 0x7f3f501574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f575ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f500aebf0 0x7f3f50147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f575ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f50159b90 0x7f3f50158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f575ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501570d0 con 0x7f3f500aebf0 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f575ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50156490 con 0x7f3f50069f10 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f575ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50156730 con 0x7f3f50159b90 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f54b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f500aebf0 0x7f3f50147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f54b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f500aebf0 0x7f3f50147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56664/0 (socket says 172.21.15.142:56664) 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f54b9a700 1 -- 172.21.15.142:0/4053037932 learned_addr learned my addr 172.21.15.142:0/4053037932 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:10.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f5539b700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f50069f10 0x7f3f501574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.523+0000 7f3f55b9c700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f50159b90 0x7f3f50158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f54b9a700 1 -- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f50159b90 msgr2=0x7f3f50158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f54b9a700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f50159b90 0x7f3f50158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f54b9a700 1 -- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f50069f10 msgr2=0x7f3f501574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f54b9a700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f50069f10 0x7f3f501574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f54b9a700 1 -- 172.21.15.142:0/4053037932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4800abf0 con 0x7f3f500aebf0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f54b9a700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f500aebf0 0x7f3f50147e70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e930 tx=0x7f3f400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f457fa700 1 -- 172.21.15.142:0/4053037932 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4000eed0 con 0x7f3f500aebf0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f457fa700 1 -- 172.21.15.142:0/4053037932 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4000c850 con 0x7f3f500aebf0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50156a10 con 0x7f3f500aebf0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f457fa700 1 -- 172.21.15.142:0/4053037932 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4000cbf0 con 0x7f3f500aebf0 2023-09-30T22:54:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.524+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f50157a30 con 0x7f3f500aebf0 2023-09-30T22:54:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.525+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500695b0 con 0x7f3f500aebf0 2023-09-30T22:54:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.526+0000 7f3f457fa700 1 -- 172.21.15.142:0/4053037932 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3f40013470 con 0x7f3f500aebf0 2023-09-30T22:54:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.527+0000 7f3f457fa700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f34067330 0x7f3f340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.528+0000 7f3f457fa700 1 -- 172.21.15.142:0/4053037932 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f40084e30 con 0x7f3f500aebf0 2023-09-30T22:54:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.528+0000 7f3f5539b700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f34067330 0x7f3f340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.528+0000 7f3f5539b700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f34067330 0x7f3f340697e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3f500c8c50 tx=0x7f3f4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:10.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.532+0000 7f3f457fa700 1 -- 172.21.15.142:0/4053037932 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3f40051c90 con 0x7f3f500aebf0 2023-09-30T22:54:10.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.762+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f5006fc10 con 0x7f3f500aebf0 2023-09-30T22:54:10.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.763+0000 7f3f457fa700 1 -- 172.21.15.142:0/4053037932 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f3f400552b0 con 0x7f3f500aebf0 2023-09-30T22:54:10.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:10.763 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f34067330 msgr2=0x7f3f340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f34067330 0x7f3f340697e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3f500c8c50 tx=0x7f3f4c009040 comp rx=0 tx=0).stop 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f500aebf0 msgr2=0x7f3f50147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f500aebf0 0x7f3f50147e70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e930 tx=0x7f3f400091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 shutdown_connections 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f34067330 0x7f3f340697e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f50159b90 0x7f3f50158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f50069f10 0x7f3f501574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 --2- 172.21.15.142:0/4053037932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f500aebf0 0x7f3f50147e70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 >> 172.21.15.142:0/4053037932 conn(0x7f3f500680c0 msgr2=0x7f3f50154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:10.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 shutdown_connections 2023-09-30T22:54:10.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.765+0000 7f3f575ff700 1 -- 172.21.15.142:0/4053037932 wait complete. 2023-09-30T22:54:10.767 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:10.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:54:10.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.973+0000 7fd5997ff700 1 Processor -- start 2023-09-30T22:54:10.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.973+0000 7fd5997ff700 1 -- start start 2023-09-30T22:54:10.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.974+0000 7fd5997ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1580 0x7fd5940adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd5997ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd5940b1950 0x7fd59415a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd5997ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940ad630 con 0x7fd5940ae000 2023-09-30T22:54:10.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd5997ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd594157c20 con 0x7fd5940b1950 2023-09-30T22:54:10.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd5997ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b3360 con 0x7fd5940b1580 2023-09-30T22:54:10.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd592ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1580 0x7fd5940adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd5927fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd5940b1950 0x7fd59415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd592ffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1580 0x7fd5940adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:51206/0 (socket says 172.21.15.142:51206) 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd5937fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd5940ae000 0x7fd59406a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:51022/0 (socket says 172.21.15.142:51022) 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd5927fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd5940b1950 0x7fd59415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:36426/0 (socket says 172.21.15.142:36426) 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.975+0000 7fd592ffd700 1 -- 172.21.15.142:0/1517210099 learned_addr learned my addr 172.21.15.142:0/1517210099 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd5927fc700 1 -- 172.21.15.142:0/1517210099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1580 msgr2=0x7fd5940adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd5927fc700 1 --2- 172.21.15.142:0/1517210099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1580 0x7fd5940adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd5927fc700 1 -- 172.21.15.142:0/1517210099 >> v1:172.21.15.148:6789/0 conn(0x7fd5940ae000 legacy=0x7fd59406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd5927fc700 1 -- 172.21.15.142:0/1517210099 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59415ad60 con 0x7fd5940b1950 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd591ffb700 1 -- 172.21.15.142:0/1517210099 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026518234 0 0) 0x7fd5940ad630 con 0x7fd5940ae000 2023-09-30T22:54:10.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd5927fc700 1 --2- 172.21.15.142:0/1517210099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1950 0x7fd59415a180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5880098e0 tx=0x7fd5880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9fd92fb6585eac2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:10.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd591ffb700 1 -- 172.21.15.142:0/1517210099 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800b640 con 0x7fd5940b1950 2023-09-30T22:54:10.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd591ffb700 1 -- 172.21.15.142:0/1517210099 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58800b7a0 con 0x7fd5940b1950 2023-09-30T22:54:10.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.976+0000 7fd591ffb700 1 -- 172.21.15.142:0/1517210099 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800bb40 con 0x7fd5940b1950 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 -- 172.21.15.142:0/1517210099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1950 msgr2=0x7fd59415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1517210099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1950 0x7fd59415a180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5880098e0 tx=0x7fd5880091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 -- 172.21.15.142:0/1517210099 shutdown_connections 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1517210099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1580 0x7fd5940adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1517210099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1950 0x7fd59415a180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 -- 172.21.15.142:0/1517210099 >> 172.21.15.142:0/1517210099 conn(0x7fd5940ce1f0 msgr2=0x7fd594069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 -- 172.21.15.142:0/1517210099 shutdown_connections 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.977+0000 7fd5997ff700 1 -- 172.21.15.142:0/1517210099 wait complete. 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.979+0000 7fd5997ff700 1 Processor -- start 2023-09-30T22:54:10.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.979+0000 7fd5997ff700 1 -- start start 2023-09-30T22:54:10.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5997ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5940ae000 0x7fd594146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5997ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1580 0x7fd5940a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5997ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1950 0x7fd5940a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5997ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940ac7b0 con 0x7fd5940ae000 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5997ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940ab200 con 0x7fd5940b1580 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5997ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940aa5f0 con 0x7fd5940b1950 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5940ae000 0x7fd594146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5940ae000 0x7fd594146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55442/0 (socket says 172.21.15.142:55442) 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 -- 172.21.15.142:0/1915566927 learned_addr learned my addr 172.21.15.142:0/1915566927 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5927fc700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1580 0x7fd5940a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd5937fe700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1950 0x7fd5940a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 -- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1950 msgr2=0x7fd5940a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1950 0x7fd5940a9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 -- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1580 msgr2=0x7fd5940a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1580 0x7fd5940a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.980+0000 7fd592ffd700 1 -- 172.21.15.142:0/1915566927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588009420 con 0x7fd5940ae000 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.981+0000 7fd592ffd700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5940ae000 0x7fd594146150 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd58400ea20 tx=0x7fd584009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.981+0000 7fd57affd700 1 -- 172.21.15.142:0/1915566927 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400c640 con 0x7fd5940ae000 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.981+0000 7fd57affd700 1 -- 172.21.15.142:0/1915566927 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58400c7e0 con 0x7fd5940ae000 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.981+0000 7fd57affd700 1 -- 172.21.15.142:0/1915566927 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400cba0 con 0x7fd5940ae000 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.981+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5940aa8d0 con 0x7fd5940ae000 2023-09-30T22:54:10.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.981+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940aae90 con 0x7fd5940ae000 2023-09-30T22:54:10.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.982+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59406d600 con 0x7fd5940ae000 2023-09-30T22:54:10.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.983+0000 7fd57affd700 1 -- 172.21.15.142:0/1915566927 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd584013470 con 0x7fd5940ae000 2023-09-30T22:54:10.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.984+0000 7fd57affd700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd580067330 0x7fd5800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:10.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.984+0000 7fd57affd700 1 -- 172.21.15.142:0/1915566927 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd584084e90 con 0x7fd5940ae000 2023-09-30T22:54:10.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.985+0000 7fd5927fc700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd580067330 0x7fd5800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:10.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.985+0000 7fd5927fc700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd580067330 0x7fd5800697e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5880093f0 tx=0x7fd588017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:10.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:10.988+0000 7fd57affd700 1 -- 172.21.15.142:0/1915566927 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd584051cf0 con 0x7fd5940ae000 2023-09-30T22:54:11.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.179+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd59415b040 con 0x7fd5940ae000 2023-09-30T22:54:11.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.180+0000 7fd57affd700 1 -- 172.21.15.142:0/1915566927 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fd584017090 con 0x7fd5940ae000 2023-09-30T22:54:11.181 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:11.181 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":48,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:54:08.268729+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:54:04.395113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T22:54:05.729484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:54:11.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd580067330 msgr2=0x7fd5800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd580067330 0x7fd5800697e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5880093f0 tx=0x7fd588017000 comp rx=0 tx=0).stop 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5940ae000 msgr2=0x7fd594146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5940ae000 0x7fd594146150 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd58400ea20 tx=0x7fd584009250 comp rx=0 tx=0).stop 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 shutdown_connections 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd580067330 0x7fd5800697e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd5940b1950 0x7fd5940a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5940ae000 0x7fd594146150 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 --2- 172.21.15.142:0/1915566927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5940b1580 0x7fd5940a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 >> 172.21.15.142:0/1915566927 conn(0x7fd5940ce1f0 msgr2=0x7fd59415b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 shutdown_connections 2023-09-30T22:54:11.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.183+0000 7fd5997ff700 1 -- 172.21.15.142:0/1915566927 wait complete. 2023-09-30T22:54:11.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:54:11.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:54:11.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.393+0000 7fe832fff700 1 Processor -- start 2023-09-30T22:54:11.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.393+0000 7fe832fff700 1 -- start start 2023-09-30T22:54:11.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.394+0000 7fe832fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe82c0692f0 0x7fe82c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.394+0000 7fe832fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 0x7fe82c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.394+0000 7fe832fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0cc6b0 con 0x7fe82c143350 2023-09-30T22:54:11.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.394+0000 7fe832fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82c15e090 con 0x7fe82c0692f0 2023-09-30T22:54:11.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.394+0000 7fe832fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0cbaa0 con 0x7fe82c15dc50 2023-09-30T22:54:11.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.394+0000 7fe830d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe82c143350 0x7fe82c0cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50452/0 (socket says 172.21.15.142:50452) 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.394+0000 7fe830d9b700 1 -- 172.21.15.142:0/2637514772 learned_addr learned my addr 172.21.15.142:0/2637514772 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82bfff700 1 --2- 172.21.15.142:0/2637514772 >> v2:172.21.15.148:3300/0 conn(0x7fe82c0692f0 0x7fe82c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe83159c700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 0x7fe82c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025193815 0 0) 0x7fe82c0cc6b0 con 0x7fe82c143350 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe81c003570 con 0x7fe82c143350 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 741807478 0 0) 0x7fe81c003570 con 0x7fe82c143350 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 msgr2=0x7fe82c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 0x7fe82c06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 >> v2:172.21.15.148:3300/0 conn(0x7fe82c0692f0 msgr2=0x7fe82c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 --2- 172.21.15.142:0/2637514772 >> v2:172.21.15.148:3300/0 conn(0x7fe82c0692f0 0x7fe82c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0cbd80 con 0x7fe82c143350 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fe820001470 con 0x7fe82c143350 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 >> v1:172.21.15.142:6789/0 conn(0x7fe82c143350 legacy=0x7fe82c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c003ae0 0x7fe81c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe81c004810 0x7fe81c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 0x7fe81c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c15e090 con 0x7fe81c004810 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0cbaa0 con 0x7fe81c003ae0 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.395+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c00bb10 con 0x7fe82c15dc50 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82bfff700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe81c004810 0x7fe81c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe830d9b700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c003ae0 0x7fe81c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe83159c700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 0x7fe81c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82bfff700 1 -- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 msgr2=0x7fe81c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:11.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82bfff700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 0x7fe81c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82bfff700 1 -- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c003ae0 msgr2=0x7fe81c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82bfff700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c003ae0 0x7fe81c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82bfff700 1 -- 172.21.15.142:0/2637514772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c003570 con 0x7fe81c004810 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe83159c700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15dc50 0x7fe81c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82bfff700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe81c004810 0x7fe81c004c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe818009c00 tx=0x7fe8180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4279260d392e21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800e710 con 0x7fe81c004810 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81800e870 con 0x7fe81c004810 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.396+0000 7fe82b7fe700 1 -- 172.21.15.142:0/2637514772 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800ec30 con 0x7fe81c004810 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.397+0000 7fe832fff700 1 -- 172.21.15.142:0/2637514772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe81c004810 msgr2=0x7fe81c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.397+0000 7fe832fff700 1 --2- 172.21.15.142:0/2637514772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe81c004810 0x7fe81c004c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe818009c00 tx=0x7fe8180091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.397+0000 7fe83159c700 1 -- 172.21.15.142:0/2637514772 reap_dead start 2023-09-30T22:54:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.397+0000 7fe832fff700 1 -- 172.21.15.142:0/2637514772 shutdown_connections 2023-09-30T22:54:11.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.397+0000 7fe832fff700 1 -- 172.21.15.142:0/2637514772 >> 172.21.15.142:0/2637514772 conn(0x7fe82c0ce8e0 msgr2=0x7fe82c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:11.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.397+0000 7fe832fff700 1 -- 172.21.15.142:0/2637514772 shutdown_connections 2023-09-30T22:54:11.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.397+0000 7fe832fff700 1 -- 172.21.15.142:0/2637514772 wait complete. 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.398+0000 7fe832fff700 1 Processor -- start 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.399+0000 7fe832fff700 1 -- start start 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.399+0000 7fe832fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c004810 0x7fe82c16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.399+0000 7fe832fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15a8d0 0x7fe82c16e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.399+0000 7fe832fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c13d2f0 0x7fe82c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe832fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0b1820 con 0x7fe82c13d2f0 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe832fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0b2080 con 0x7fe81c004810 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe832fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c16a880 con 0x7fe82c15a8d0 2023-09-30T22:54:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c13d2f0 0x7fe82c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c13d2f0 0x7fe82c15cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55456/0 (socket says 172.21.15.142:55456) 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 -- 172.21.15.142:0/99593907 learned_addr learned my addr 172.21.15.142:0/99593907 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 -- 172.21.15.142:0/99593907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15a8d0 msgr2=0x7fe82c16e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15a8d0 0x7fe82c16e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 -- 172.21.15.142:0/99593907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c004810 msgr2=0x7fe82c16a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c004810 0x7fe82c16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 -- 172.21.15.142:0/99593907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c16e810 con 0x7fe82c13d2f0 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.400+0000 7fe83159c700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c13d2f0 0x7fe82c15cac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0679e0 tx=0x7fe82400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.401+0000 7fe828ff9700 1 -- 172.21.15.142:0/99593907 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82401b070 con 0x7fe82c13d2f0 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.401+0000 7fe828ff9700 1 -- 172.21.15.142:0/99593907 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82400f040 con 0x7fe82c13d2f0 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.401+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c15ae90 con 0x7fe82c13d2f0 2023-09-30T22:54:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.401+0000 7fe828ff9700 1 -- 172.21.15.142:0/99593907 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82400e050 con 0x7fe82c13d2f0 2023-09-30T22:54:11.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.401+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c0b1d10 con 0x7fe82c13d2f0 2023-09-30T22:54:11.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.402+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c06ea70 con 0x7fe82c13d2f0 2023-09-30T22:54:11.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.403+0000 7fe828ff9700 1 -- 172.21.15.142:0/99593907 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe824003020 con 0x7fe82c13d2f0 2023-09-30T22:54:11.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.404+0000 7fe828ff9700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe810067330 0x7fe8100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.404+0000 7fe828ff9700 1 -- 172.21.15.142:0/99593907 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe824085000 con 0x7fe82c13d2f0 2023-09-30T22:54:11.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.404+0000 7fe830d9b700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe810067330 0x7fe8100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.405+0000 7fe830d9b700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe810067330 0x7fe8100697e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe820007ce0 tx=0x7fe820001dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:11.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.409+0000 7fe828ff9700 1 -- 172.21.15.142:0/99593907 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe824051f00 con 0x7fe82c13d2f0 2023-09-30T22:54:11.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.595+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe82c0cc060 con 0x7fe810067330 2023-09-30T22:54:11.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.604+0000 7fe828ff9700 1 -- 172.21.15.142:0/99593907 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300757 (secure 0 0 0) 0x7fe82c0cc060 con 0x7fe810067330 2023-09-30T22:54:11.609 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:11.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe810067330 msgr2=0x7fe8100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe810067330 0x7fe8100697e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe820007ce0 tx=0x7fe820001dc0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c13d2f0 msgr2=0x7fe82c15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c13d2f0 0x7fe82c15cac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0679e0 tx=0x7fe82400b040 comp rx=0 tx=0).stop 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 shutdown_connections 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe810067330 0x7fe8100697e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c13d2f0 0x7fe82c15cac0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe81c004810 0x7fe82c16a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 --2- 172.21.15.142:0/99593907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe82c15a8d0 0x7fe82c16e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 >> 172.21.15.142:0/99593907 conn(0x7fe82c0ce8e0 msgr2=0x7fe82c0b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 shutdown_connections 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.609+0000 7fe832fff700 1 -- 172.21.15.142:0/99593907 wait complete. 2023-09-30T22:54:11.612 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:54:11.626 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-09-30T22:54:10.122074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2917,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559582,"statfs":{"total":1600000000,"available":1597012816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.859271"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274245+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272527+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:02.796588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.284035+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:54.397192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270373+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:05:58.331567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271633+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:14.681908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271596+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272267+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271698+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.279196+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:15.566460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.275026+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273813+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271705+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271340+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272097+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:02.796588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269164+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:24:17.693837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271197+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272217+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:22.311313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269335+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:45:01.997559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.277305+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:32.136771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270812+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:55.387151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270664+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:24:10.780552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.276609+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:56.919870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.283664+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:13:01.671172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.276943+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:23.235849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272758+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.279983+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:23.984410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271273+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271006+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:31.722246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271079+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:23.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273157+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:23.235849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.279534+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:14:32.993938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272192+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:46.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274038+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:14:32.993938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.274358+0000","last_change":"2023-09-30T22:54:06.274358+0000","last_active":"2023-09-30T22:54:06.274358+0000","last_peered":"2023-09-30T22:54:06.274358+0000","last_clean":"2023-09-30T22:54:06.274358+0000","last_became_active":"2023-09-30T22:54:06.274137+0000","last_became_peered":"2023-09-30T22:54:06.274137+0000","last_unstale":"2023-09-30T22:54:06.274358+0000","last_undegraded":"2023-09-30T22:54:06.274358+0000","last_fullsized":"2023-09-30T22:54:06.274358+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.275181+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:58.841154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283446+0000","last_change":"2023-09-30T22:54:06.283446+0000","last_active":"2023-09-30T22:54:06.283446+0000","last_peered":"2023-09-30T22:54:06.283446+0000","last_clean":"2023-09-30T22:54:06.283446+0000","last_became_active":"2023-09-30T22:54:06.283085+0000","last_became_peered":"2023-09-30T22:54:06.283085+0000","last_unstale":"2023-09-30T22:54:06.283446+0000","last_undegraded":"2023-09-30T22:54:06.283446+0000","last_fullsized":"2023-09-30T22:54:06.283446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273925+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:15.566460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281913+0000","last_change":"2023-09-30T22:54:06.281913+0000","last_active":"2023-09-30T22:54:06.281913+0000","last_peered":"2023-09-30T22:54:06.281913+0000","last_clean":"2023-09-30T22:54:06.281913+0000","last_became_active":"2023-09-30T22:54:06.281648+0000","last_became_peered":"2023-09-30T22:54:06.281648+0000","last_unstale":"2023-09-30T22:54:06.281913+0000","last_undegraded":"2023-09-30T22:54:06.281913+0000","last_fullsized":"2023-09-30T22:54:06.281913+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:52.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274666+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.282802+0000","last_change":"2023-09-30T22:54:06.282802+0000","last_active":"2023-09-30T22:54:06.282802+0000","last_peered":"2023-09-30T22:54:06.282802+0000","last_clean":"2023-09-30T22:54:06.282802+0000","last_became_active":"2023-09-30T22:54:06.282576+0000","last_became_peered":"2023-09-30T22:54:06.282576+0000","last_unstale":"2023-09-30T22:54:06.282802+0000","last_undegraded":"2023-09-30T22:54:06.282802+0000","last_fullsized":"2023-09-30T22:54:06.282802+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271596+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:55.387151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.285268+0000","last_change":"2023-09-30T22:54:06.285268+0000","last_active":"2023-09-30T22:54:06.285268+0000","last_peered":"2023-09-30T22:54:06.285268+0000","last_clean":"2023-09-30T22:54:06.285268+0000","last_became_active":"2023-09-30T22:54:06.284975+0000","last_became_peered":"2023-09-30T22:54:06.284975+0000","last_unstale":"2023-09-30T22:54:06.285268+0000","last_undegraded":"2023-09-30T22:54:06.285268+0000","last_fullsized":"2023-09-30T22:54:06.285268+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273626+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:32.136771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.279537+0000","last_change":"2023-09-30T22:54:06.279537+0000","last_active":"2023-09-30T22:54:06.279537+0000","last_peered":"2023-09-30T22:54:06.279537+0000","last_clean":"2023-09-30T22:54:06.279537+0000","last_became_active":"2023-09-30T22:54:06.279241+0000","last_became_peered":"2023-09-30T22:54:06.279241+0000","last_unstale":"2023-09-30T22:54:06.279537+0000","last_undegraded":"2023-09-30T22:54:06.279537+0000","last_fullsized":"2023-09-30T22:54:06.279537+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:33:04.622185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272673+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280234+0000","last_change":"2023-09-30T22:54:06.280234+0000","last_active":"2023-09-30T22:54:06.280234+0000","last_peered":"2023-09-30T22:54:06.280234+0000","last_clean":"2023-09-30T22:54:06.280234+0000","last_became_active":"2023-09-30T22:54:06.279996+0000","last_became_peered":"2023-09-30T22:54:06.279996+0000","last_unstale":"2023-09-30T22:54:06.280234+0000","last_undegraded":"2023-09-30T22:54:06.280234+0000","last_fullsized":"2023-09-30T22:54:06.280234+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270324+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:48.447517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281185+0000","last_change":"2023-09-30T22:54:06.281185+0000","last_active":"2023-09-30T22:54:06.281185+0000","last_peered":"2023-09-30T22:54:06.281185+0000","last_clean":"2023-09-30T22:54:06.281185+0000","last_became_active":"2023-09-30T22:54:06.280705+0000","last_became_peered":"2023-09-30T22:54:06.280705+0000","last_unstale":"2023-09-30T22:54:06.281185+0000","last_undegraded":"2023-09-30T22:54:06.281185+0000","last_fullsized":"2023-09-30T22:54:06.281185+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:09.336177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272440+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:41.367382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.275367+0000","last_change":"2023-09-30T22:54:06.275367+0000","last_active":"2023-09-30T22:54:06.275367+0000","last_peered":"2023-09-30T22:54:06.275367+0000","last_clean":"2023-09-30T22:54:06.275367+0000","last_became_active":"2023-09-30T22:54:06.275116+0000","last_became_peered":"2023-09-30T22:54:06.275116+0000","last_unstale":"2023-09-30T22:54:06.275367+0000","last_undegraded":"2023-09-30T22:54:06.275367+0000","last_fullsized":"2023-09-30T22:54:06.275367+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:10.629629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269964+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:11:35.672780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.271026+0000","last_change":"2023-09-30T22:54:06.271026+0000","last_active":"2023-09-30T22:54:06.271026+0000","last_peered":"2023-09-30T22:54:06.271026+0000","last_clean":"2023-09-30T22:54:06.271026+0000","last_became_active":"2023-09-30T22:54:06.270808+0000","last_became_peered":"2023-09-30T22:54:06.270808+0000","last_unstale":"2023-09-30T22:54:06.271026+0000","last_undegraded":"2023-09-30T22:54:06.271026+0000","last_fullsized":"2023-09-30T22:54:06.271026+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:13.169498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271490+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:46.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281865+0000","last_change":"2023-09-30T22:54:06.281865+0000","last_active":"2023-09-30T22:54:06.281865+0000","last_peered":"2023-09-30T22:54:06.281865+0000","last_clean":"2023-09-30T22:54:06.281865+0000","last_became_active":"2023-09-30T22:54:06.281674+0000","last_became_peered":"2023-09-30T22:54:06.281674+0000","last_unstale":"2023-09-30T22:54:06.281865+0000","last_undegraded":"2023-09-30T22:54:06.281865+0000","last_fullsized":"2023-09-30T22:54:06.281865+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:23.908829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271814+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:53.410638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.286681+0000","last_change":"2023-09-30T22:54:06.286681+0000","last_active":"2023-09-30T22:54:06.286681+0000","last_peered":"2023-09-30T22:54:06.286681+0000","last_clean":"2023-09-30T22:54:06.286681+0000","last_became_active":"2023-09-30T22:54:06.286440+0000","last_became_peered":"2023-09-30T22:54:06.286440+0000","last_unstale":"2023-09-30T22:54:06.286681+0000","last_undegraded":"2023-09-30T22:54:06.286681+0000","last_fullsized":"2023-09-30T22:54:06.286681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274285+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:23.984410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.276631+0000","last_change":"2023-09-30T22:54:06.276631+0000","last_active":"2023-09-30T22:54:06.276631+0000","last_peered":"2023-09-30T22:54:06.276631+0000","last_clean":"2023-09-30T22:54:06.276631+0000","last_became_active":"2023-09-30T22:54:06.276205+0000","last_became_peered":"2023-09-30T22:54:06.276205+0000","last_unstale":"2023-09-30T22:54:06.276631+0000","last_undegraded":"2023-09-30T22:54:06.276631+0000","last_fullsized":"2023-09-30T22:54:06.276631+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270669+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:41.000107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.278684+0000","last_change":"2023-09-30T22:54:06.278684+0000","last_active":"2023-09-30T22:54:06.278684+0000","last_peered":"2023-09-30T22:54:06.278684+0000","last_clean":"2023-09-30T22:54:06.278684+0000","last_became_active":"2023-09-30T22:54:06.278481+0000","last_became_peered":"2023-09-30T22:54:06.278481+0000","last_unstale":"2023-09-30T22:54:06.278684+0000","last_undegraded":"2023-09-30T22:54:06.278684+0000","last_fullsized":"2023-09-30T22:54:06.278684+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:55.393916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270585+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:22.311313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.277690+0000","last_change":"2023-09-30T22:54:06.277690+0000","last_active":"2023-09-30T22:54:06.277690+0000","last_peered":"2023-09-30T22:54:06.277690+0000","last_clean":"2023-09-30T22:54:06.277690+0000","last_became_active":"2023-09-30T22:54:06.277355+0000","last_became_peered":"2023-09-30T22:54:06.277355+0000","last_unstale":"2023-09-30T22:54:06.277690+0000","last_undegraded":"2023-09-30T22:54:06.277690+0000","last_fullsized":"2023-09-30T22:54:06.277690+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:53.590302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.282604+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:04.259944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.286073+0000","last_change":"2023-09-30T22:54:06.286073+0000","last_active":"2023-09-30T22:54:06.286073+0000","last_peered":"2023-09-30T22:54:06.286073+0000","last_clean":"2023-09-30T22:54:06.286073+0000","last_became_active":"2023-09-30T22:54:06.285829+0000","last_became_peered":"2023-09-30T22:54:06.285829+0000","last_unstale":"2023-09-30T22:54:06.286073+0000","last_undegraded":"2023-09-30T22:54:06.286073+0000","last_fullsized":"2023-09-30T22:54:06.286073+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:39.997183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.276767+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283300+0000","last_change":"2023-09-30T22:54:06.283300+0000","last_active":"2023-09-30T22:54:06.283300+0000","last_peered":"2023-09-30T22:54:06.283300+0000","last_clean":"2023-09-30T22:54:06.283300+0000","last_became_active":"2023-09-30T22:54:06.282769+0000","last_became_peered":"2023-09-30T22:54:06.282769+0000","last_unstale":"2023-09-30T22:54:06.283300+0000","last_undegraded":"2023-09-30T22:54:06.283300+0000","last_fullsized":"2023-09-30T22:54:06.283300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270693+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:14.681908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.276472+0000","last_change":"2023-09-30T22:54:06.276472+0000","last_active":"2023-09-30T22:54:06.276472+0000","last_peered":"2023-09-30T22:54:06.276472+0000","last_clean":"2023-09-30T22:54:06.276472+0000","last_became_active":"2023-09-30T22:54:06.275828+0000","last_became_peered":"2023-09-30T22:54:06.275828+0000","last_unstale":"2023-09-30T22:54:06.276472+0000","last_undegraded":"2023-09-30T22:54:06.276472+0000","last_fullsized":"2023-09-30T22:54:06.276472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:54.384228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271416+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:41.000107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281858+0000","last_change":"2023-09-30T22:54:06.281858+0000","last_active":"2023-09-30T22:54:06.281858+0000","last_peered":"2023-09-30T22:54:06.281858+0000","last_clean":"2023-09-30T22:54:06.281858+0000","last_became_active":"2023-09-30T22:54:06.281635+0000","last_became_peered":"2023-09-30T22:54:06.281635+0000","last_unstale":"2023-09-30T22:54:06.281858+0000","last_undegraded":"2023-09-30T22:54:06.281858+0000","last_fullsized":"2023-09-30T22:54:06.281858+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:26.021090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270105+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:53.410638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283372+0000","last_change":"2023-09-30T22:54:06.283372+0000","last_active":"2023-09-30T22:54:06.283372+0000","last_peered":"2023-09-30T22:54:06.283372+0000","last_clean":"2023-09-30T22:54:06.283372+0000","last_became_active":"2023-09-30T22:54:06.283156+0000","last_became_peered":"2023-09-30T22:54:06.283156+0000","last_unstale":"2023-09-30T22:54:06.283372+0000","last_undegraded":"2023-09-30T22:54:06.283372+0000","last_fullsized":"2023-09-30T22:54:06.283372+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:24:10.857387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271237+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:41.367382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.278096+0000","last_change":"2023-09-30T22:54:06.278096+0000","last_active":"2023-09-30T22:54:06.278096+0000","last_peered":"2023-09-30T22:54:06.278096+0000","last_clean":"2023-09-30T22:54:06.278096+0000","last_became_active":"2023-09-30T22:54:06.274665+0000","last_became_peered":"2023-09-30T22:54:06.274665+0000","last_unstale":"2023-09-30T22:54:06.278096+0000","last_undegraded":"2023-09-30T22:54:06.278096+0000","last_fullsized":"2023-09-30T22:54:06.278096+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269545+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:29:59.319976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281951+0000","last_change":"2023-09-30T22:54:06.281951+0000","last_active":"2023-09-30T22:54:06.281951+0000","last_peered":"2023-09-30T22:54:06.281951+0000","last_clean":"2023-09-30T22:54:06.281951+0000","last_became_active":"2023-09-30T22:54:06.281513+0000","last_became_peered":"2023-09-30T22:54:06.281513+0000","last_unstale":"2023-09-30T22:54:06.281951+0000","last_undegraded":"2023-09-30T22:54:06.281951+0000","last_fullsized":"2023-09-30T22:54:06.281951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271119+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:53.410638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.284019+0000","last_change":"2023-09-30T22:54:06.284019+0000","last_active":"2023-09-30T22:54:06.284019+0000","last_peered":"2023-09-30T22:54:06.284019+0000","last_clean":"2023-09-30T22:54:06.284019+0000","last_became_active":"2023-09-30T22:54:06.283783+0000","last_became_peered":"2023-09-30T22:54:06.283783+0000","last_unstale":"2023-09-30T22:54:06.284019+0000","last_undegraded":"2023-09-30T22:54:06.284019+0000","last_fullsized":"2023-09-30T22:54:06.284019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:45.528979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270318+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:02.796588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280742+0000","last_change":"2023-09-30T22:54:06.280742+0000","last_active":"2023-09-30T22:54:06.280742+0000","last_peered":"2023-09-30T22:54:06.280742+0000","last_clean":"2023-09-30T22:54:06.280742+0000","last_became_active":"2023-09-30T22:54:06.280380+0000","last_became_peered":"2023-09-30T22:54:06.280380+0000","last_unstale":"2023-09-30T22:54:06.280742+0000","last_undegraded":"2023-09-30T22:54:06.280742+0000","last_fullsized":"2023-09-30T22:54:06.280742+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:01.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274286+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.277243+0000","last_change":"2023-09-30T22:54:06.277243+0000","last_active":"2023-09-30T22:54:06.277243+0000","last_peered":"2023-09-30T22:54:06.277243+0000","last_clean":"2023-09-30T22:54:06.277243+0000","last_became_active":"2023-09-30T22:54:06.276913+0000","last_became_peered":"2023-09-30T22:54:06.276913+0000","last_unstale":"2023-09-30T22:54:06.277243+0000","last_undegraded":"2023-09-30T22:54:06.277243+0000","last_fullsized":"2023-09-30T22:54:06.277243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:04.627516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.265146+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:54:05.265146+0000","last_peered":"2023-09-30T22:54:05.265146+0000","last_clean":"2023-09-30T22:54:05.265146+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:54:05.265146+0000","last_undegraded":"2023-09-30T22:54:05.265146+0000","last_fullsized":"2023-09-30T22:54:05.265146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269930+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:26:32.868932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280275+0000","last_change":"2023-09-30T22:54:06.280275+0000","last_active":"2023-09-30T22:54:06.280275+0000","last_peered":"2023-09-30T22:54:06.280275+0000","last_clean":"2023-09-30T22:54:06.280275+0000","last_became_active":"2023-09-30T22:54:06.280036+0000","last_became_peered":"2023-09-30T22:54:06.280036+0000","last_unstale":"2023-09-30T22:54:06.280275+0000","last_undegraded":"2023-09-30T22:54:06.280275+0000","last_fullsized":"2023-09-30T22:54:06.280275+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262964+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:54:05.262964+0000","last_peered":"2023-09-30T22:54:05.262964+0000","last_clean":"2023-09-30T22:54:05.262964+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:54:05.262964+0000","last_undegraded":"2023-09-30T22:54:05.262964+0000","last_fullsized":"2023-09-30T22:54:05.262964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.283274+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:04.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280988+0000","last_change":"2023-09-30T22:54:06.280988+0000","last_active":"2023-09-30T22:54:06.280988+0000","last_peered":"2023-09-30T22:54:06.280988+0000","last_clean":"2023-09-30T22:54:06.280988+0000","last_became_active":"2023-09-30T22:54:06.280317+0000","last_became_peered":"2023-09-30T22:54:06.280317+0000","last_unstale":"2023-09-30T22:54:06.280988+0000","last_undegraded":"2023-09-30T22:54:06.280988+0000","last_fullsized":"2023-09-30T22:54:06.280988+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:26.869196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.265960+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:54:05.265960+0000","last_peered":"2023-09-30T22:54:05.265960+0000","last_clean":"2023-09-30T22:54:05.265960+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:54:05.265960+0000","last_undegraded":"2023-09-30T22:54:05.265960+0000","last_fullsized":"2023-09-30T22:54:05.265960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272089+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:31.722246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281336+0000","last_change":"2023-09-30T22:54:06.281336+0000","last_active":"2023-09-30T22:54:06.281336+0000","last_peered":"2023-09-30T22:54:06.281336+0000","last_clean":"2023-09-30T22:54:06.281336+0000","last_became_active":"2023-09-30T22:54:06.281041+0000","last_became_peered":"2023-09-30T22:54:06.281041+0000","last_unstale":"2023-09-30T22:54:06.281336+0000","last_undegraded":"2023-09-30T22:54:06.281336+0000","last_fullsized":"2023-09-30T22:54:06.281336+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:22.348215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262558+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:54:05.262558+0000","last_peered":"2023-09-30T22:54:05.262558+0000","last_clean":"2023-09-30T22:54:05.262558+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:54:05.262558+0000","last_undegraded":"2023-09-30T22:54:05.262558+0000","last_fullsized":"2023-09-30T22:54:05.262558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.263726+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:54:05.263726+0000","last_peered":"2023-09-30T22:54:05.263726+0000","last_clean":"2023-09-30T22:54:05.263726+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:54:05.263726+0000","last_undegraded":"2023-09-30T22:54:05.263726+0000","last_fullsized":"2023-09-30T22:54:05.263726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.275988+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.284834+0000","last_change":"2023-09-30T22:54:06.284834+0000","last_active":"2023-09-30T22:54:06.284834+0000","last_peered":"2023-09-30T22:54:06.284834+0000","last_clean":"2023-09-30T22:54:06.284834+0000","last_became_active":"2023-09-30T22:54:06.284671+0000","last_became_peered":"2023-09-30T22:54:06.284671+0000","last_unstale":"2023-09-30T22:54:06.284834+0000","last_undegraded":"2023-09-30T22:54:06.284834+0000","last_fullsized":"2023-09-30T22:54:06.284834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262666+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:54:05.262666+0000","last_peered":"2023-09-30T22:54:05.262666+0000","last_clean":"2023-09-30T22:54:05.262666+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:54:05.262666+0000","last_undegraded":"2023-09-30T22:54:05.262666+0000","last_fullsized":"2023-09-30T22:54:05.262666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270117+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:46.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281184+0000","last_change":"2023-09-30T22:54:06.281184+0000","last_active":"2023-09-30T22:54:06.281184+0000","last_peered":"2023-09-30T22:54:06.281184+0000","last_clean":"2023-09-30T22:54:06.281184+0000","last_became_active":"2023-09-30T22:54:06.280960+0000","last_became_peered":"2023-09-30T22:54:06.280960+0000","last_unstale":"2023-09-30T22:54:06.281184+0000","last_undegraded":"2023-09-30T22:54:06.281184+0000","last_fullsized":"2023-09-30T22:54:06.281184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:45.532201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262559+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:54:05.262559+0000","last_peered":"2023-09-30T22:54:05.262559+0000","last_clean":"2023-09-30T22:54:05.262559+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:54:05.262559+0000","last_undegraded":"2023-09-30T22:54:05.262559+0000","last_fullsized":"2023-09-30T22:54:05.262559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271838+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280079+0000","last_change":"2023-09-30T22:54:06.280079+0000","last_active":"2023-09-30T22:54:06.280079+0000","last_peered":"2023-09-30T22:54:06.280079+0000","last_clean":"2023-09-30T22:54:06.280079+0000","last_became_active":"2023-09-30T22:54:06.279695+0000","last_became_peered":"2023-09-30T22:54:06.279695+0000","last_unstale":"2023-09-30T22:54:06.280079+0000","last_undegraded":"2023-09-30T22:54:06.280079+0000","last_fullsized":"2023-09-30T22:54:06.280079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.263119+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:54:05.263119+0000","last_peered":"2023-09-30T22:54:05.263119+0000","last_clean":"2023-09-30T22:54:05.263119+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:54:05.263119+0000","last_undegraded":"2023-09-30T22:54:05.263119+0000","last_fullsized":"2023-09-30T22:54:05.263119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271683+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:23.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283671+0000","last_change":"2023-09-30T22:54:06.283671+0000","last_active":"2023-09-30T22:54:06.283671+0000","last_peered":"2023-09-30T22:54:06.283671+0000","last_clean":"2023-09-30T22:54:06.283671+0000","last_became_active":"2023-09-30T22:54:06.283368+0000","last_became_peered":"2023-09-30T22:54:06.283368+0000","last_unstale":"2023-09-30T22:54:06.283671+0000","last_undegraded":"2023-09-30T22:54:06.283671+0000","last_fullsized":"2023-09-30T22:54:06.283671+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262871+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:54:05.262871+0000","last_peered":"2023-09-30T22:54:05.262871+0000","last_clean":"2023-09-30T22:54:05.262871+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:54:05.262871+0000","last_undegraded":"2023-09-30T22:54:05.262871+0000","last_fullsized":"2023-09-30T22:54:05.262871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195096,"statfs":{"total":200000000,"available":199779156,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.496}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.59899999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.77700000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":798,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194513,"statfs":{"total":200000000,"available":199182172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.435}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.78400000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67100000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.746},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.624},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.434},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.88400000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.65600000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.85499999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.91500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.626}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.81299999999999994}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.78400000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.755}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.496},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":792,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194520,"statfs":{"total":200000000,"available":199188788,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.81200000000000006}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.623},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.88800000000000001}]}]}],"pool_statfs":[]}} 2023-09-30T22:54:11.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:54:11.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.856+0000 7efe2f5ff700 1 Processor -- start 2023-09-30T22:54:11.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.856+0000 7efe2f5ff700 1 -- start start 2023-09-30T22:54:11.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2f5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe28157a90 0x7efe2815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2f5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe2806b3d0 0x7efe280b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2f5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efe280b1f40 0x7efe28069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2f5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280b23e0 con 0x7efe28157a90 2023-09-30T22:54:11.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2f5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2806d470 con 0x7efe280b1f40 2023-09-30T22:54:11.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2f5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe28157e60 con 0x7efe2806b3d0 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2d39b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe28157a90 0x7efe2815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2d39b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe28157a90 0x7efe2815bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55462/0 (socket says 172.21.15.142:55462) 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.857+0000 7efe2d39b700 1 -- 172.21.15.142:0/1693446339 learned_addr learned my addr 172.21.15.142:0/1693446339 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2cb9a700 1 --2- 172.21.15.142:0/1693446339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe2806b3d0 0x7efe280b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2db9c700 1 --2- 172.21.15.142:0/1693446339 >> v2:172.21.15.148:3300/0 conn(0x7efe280b1f40 0x7efe28069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2d39b700 1 -- 172.21.15.142:0/1693446339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe2806b3d0 msgr2=0x7efe280b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2d39b700 1 --2- 172.21.15.142:0/1693446339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe2806b3d0 0x7efe280b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2d39b700 1 -- 172.21.15.142:0/1693446339 >> v2:172.21.15.148:3300/0 conn(0x7efe280b1f40 msgr2=0x7efe28069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:11.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2d39b700 1 --2- 172.21.15.142:0/1693446339 >> v2:172.21.15.148:3300/0 conn(0x7efe280b1f40 0x7efe28069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2d39b700 1 -- 172.21.15.142:0/1693446339 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2815c430 con 0x7efe28157a90 2023-09-30T22:54:11.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe2d39b700 1 --2- 172.21.15.142:0/1693446339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe28157a90 0x7efe2815bef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efe280b2900 tx=0x7efe24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ae9f6f2c12982c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:11.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe1ffff700 1 -- 172.21.15.142:0/1693446339 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400b640 con 0x7efe28157a90 2023-09-30T22:54:11.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe1ffff700 1 -- 172.21.15.142:0/1693446339 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2400b7a0 con 0x7efe28157a90 2023-09-30T22:54:11.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.858+0000 7efe1ffff700 1 -- 172.21.15.142:0/1693446339 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400bb60 con 0x7efe28157a90 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1693446339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe28157a90 msgr2=0x7efe2815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1693446339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe28157a90 0x7efe2815bef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efe280b2900 tx=0x7efe24009250 comp rx=0 tx=0).stop 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1693446339 shutdown_connections 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1693446339 >> v2:172.21.15.148:3300/0 conn(0x7efe280b1f40 0x7efe28069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1693446339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe28157a90 0x7efe2815bef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1693446339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe2806b3d0 0x7efe280b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1693446339 >> 172.21.15.142:0/1693446339 conn(0x7efe280680c0 msgr2=0x7efe280c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1693446339 shutdown_connections 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.859+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1693446339 wait complete. 2023-09-30T22:54:11.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.861+0000 7efe2f5ff700 1 Processor -- start 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.861+0000 7efe2f5ff700 1 -- start start 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2f5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe2806b3d0 0x7efe280a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2f5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe280b1f40 0x7efe28159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2f5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe28157a90 0x7efe2816a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2f5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2815b1f0 con 0x7efe2806b3d0 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2f5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2815a950 con 0x7efe28157a90 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2f5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2815ac30 con 0x7efe280b1f40 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe2806b3d0 0x7efe280a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe2806b3d0 0x7efe280a58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55478/0 (socket says 172.21.15.142:55478) 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 -- 172.21.15.142:0/1877635555 learned_addr learned my addr 172.21.15.142:0/1877635555 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:11.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 -- 172.21.15.142:0/1877635555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe280b1f40 msgr2=0x7efe28159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe280b1f40 0x7efe28159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 -- 172.21.15.142:0/1877635555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe28157a90 msgr2=0x7efe2816a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe28157a90 0x7efe2816a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.862+0000 7efe2d39b700 1 -- 172.21.15.142:0/1877635555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240094f0 con 0x7efe2806b3d0 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.863+0000 7efe2d39b700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe2806b3d0 0x7efe280a58e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efe28068600 tx=0x7efe24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.863+0000 7efe1d7fa700 1 -- 172.21.15.142:0/1877635555 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24000d10 con 0x7efe2806b3d0 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.863+0000 7efe1d7fa700 1 -- 172.21.15.142:0/1877635555 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2400bb20 con 0x7efe2806b3d0 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.863+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2815af10 con 0x7efe2806b3d0 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.863+0000 7efe1d7fa700 1 -- 172.21.15.142:0/1877635555 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24011670 con 0x7efe2806b3d0 2023-09-30T22:54:11.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.863+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2815a470 con 0x7efe2806b3d0 2023-09-30T22:54:11.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.864+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2815a6c0 con 0x7efe2806b3d0 2023-09-30T22:54:11.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.865+0000 7efe1d7fa700 1 -- 172.21.15.142:0/1877635555 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efe240119e0 con 0x7efe2806b3d0 2023-09-30T22:54:11.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.866+0000 7efe1d7fa700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe0c067330 0x7efe0c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:11.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.866+0000 7efe1d7fa700 1 -- 172.21.15.142:0/1877635555 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efe24086400 con 0x7efe2806b3d0 2023-09-30T22:54:11.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.866+0000 7efe2cb9a700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe0c067330 0x7efe0c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:11.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.867+0000 7efe2cb9a700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe0c067330 0x7efe0c0697e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efe280ae400 tx=0x7efe180091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:11.870+0000 7efe1d7fa700 1 -- 172.21.15.142:0/1877635555 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efe24053260 con 0x7efe2806b3d0 2023-09-30T22:54:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.054+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe2806fc10 con 0x7efe0c067330 2023-09-30T22:54:12.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.063+0000 7efe1d7fa700 1 -- 172.21.15.142:0/1877635555 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300757 (secure 0 0 0) 0x7efe2806fc10 con 0x7efe0c067330 2023-09-30T22:54:12.067 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:12.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe0c067330 msgr2=0x7efe0c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe0c067330 0x7efe0c0697e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efe280ae400 tx=0x7efe180091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe2806b3d0 msgr2=0x7efe280a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe2806b3d0 0x7efe280a58e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efe28068600 tx=0x7efe24017000 comp rx=0 tx=0).stop 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 shutdown_connections 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe0c067330 0x7efe0c0697e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe28157a90 0x7efe2816a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe2806b3d0 0x7efe280a58e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 --2- 172.21.15.142:0/1877635555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe280b1f40 0x7efe28159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.067+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 >> 172.21.15.142:0/1877635555 conn(0x7efe280680c0 msgr2=0x7efe280cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.068+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 shutdown_connections 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.068+0000 7efe2f5ff700 1 -- 172.21.15.142:0/1877635555 wait complete. 2023-09-30T22:54:12.071 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:54:12.086 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-09-30T22:54:10.122074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2917,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559582,"statfs":{"total":1600000000,"available":1597012816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.859271"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274245+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272527+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:02.796588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.284035+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:54.397192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270373+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:05:58.331567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271633+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:14.681908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271596+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272267+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271698+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.279196+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:15.566460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.275026+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273813+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271705+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271340+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272097+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:02.796588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269164+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:24:17.693837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271197+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272217+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:22.311313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269335+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:45:01.997559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.277305+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:32.136771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270812+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:55.387151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270664+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:24:10.780552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.276609+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:56.919870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.283664+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:13:01.671172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.276943+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:23.235849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272758+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.279983+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:23.984410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271273+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271006+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:31.722246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271079+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:23.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273157+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:23.235849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.279534+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:14:32.993938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272192+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:46.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274038+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:14:32.993938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.274358+0000","last_change":"2023-09-30T22:54:06.274358+0000","last_active":"2023-09-30T22:54:06.274358+0000","last_peered":"2023-09-30T22:54:06.274358+0000","last_clean":"2023-09-30T22:54:06.274358+0000","last_became_active":"2023-09-30T22:54:06.274137+0000","last_became_peered":"2023-09-30T22:54:06.274137+0000","last_unstale":"2023-09-30T22:54:06.274358+0000","last_undegraded":"2023-09-30T22:54:06.274358+0000","last_fullsized":"2023-09-30T22:54:06.274358+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.275181+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:58.841154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283446+0000","last_change":"2023-09-30T22:54:06.283446+0000","last_active":"2023-09-30T22:54:06.283446+0000","last_peered":"2023-09-30T22:54:06.283446+0000","last_clean":"2023-09-30T22:54:06.283446+0000","last_became_active":"2023-09-30T22:54:06.283085+0000","last_became_peered":"2023-09-30T22:54:06.283085+0000","last_unstale":"2023-09-30T22:54:06.283446+0000","last_undegraded":"2023-09-30T22:54:06.283446+0000","last_fullsized":"2023-09-30T22:54:06.283446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273925+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:15.566460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281913+0000","last_change":"2023-09-30T22:54:06.281913+0000","last_active":"2023-09-30T22:54:06.281913+0000","last_peered":"2023-09-30T22:54:06.281913+0000","last_clean":"2023-09-30T22:54:06.281913+0000","last_became_active":"2023-09-30T22:54:06.281648+0000","last_became_peered":"2023-09-30T22:54:06.281648+0000","last_unstale":"2023-09-30T22:54:06.281913+0000","last_undegraded":"2023-09-30T22:54:06.281913+0000","last_fullsized":"2023-09-30T22:54:06.281913+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:52.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274666+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.282802+0000","last_change":"2023-09-30T22:54:06.282802+0000","last_active":"2023-09-30T22:54:06.282802+0000","last_peered":"2023-09-30T22:54:06.282802+0000","last_clean":"2023-09-30T22:54:06.282802+0000","last_became_active":"2023-09-30T22:54:06.282576+0000","last_became_peered":"2023-09-30T22:54:06.282576+0000","last_unstale":"2023-09-30T22:54:06.282802+0000","last_undegraded":"2023-09-30T22:54:06.282802+0000","last_fullsized":"2023-09-30T22:54:06.282802+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271596+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:55.387151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.285268+0000","last_change":"2023-09-30T22:54:06.285268+0000","last_active":"2023-09-30T22:54:06.285268+0000","last_peered":"2023-09-30T22:54:06.285268+0000","last_clean":"2023-09-30T22:54:06.285268+0000","last_became_active":"2023-09-30T22:54:06.284975+0000","last_became_peered":"2023-09-30T22:54:06.284975+0000","last_unstale":"2023-09-30T22:54:06.285268+0000","last_undegraded":"2023-09-30T22:54:06.285268+0000","last_fullsized":"2023-09-30T22:54:06.285268+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.273626+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:32.136771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.279537+0000","last_change":"2023-09-30T22:54:06.279537+0000","last_active":"2023-09-30T22:54:06.279537+0000","last_peered":"2023-09-30T22:54:06.279537+0000","last_clean":"2023-09-30T22:54:06.279537+0000","last_became_active":"2023-09-30T22:54:06.279241+0000","last_became_peered":"2023-09-30T22:54:06.279241+0000","last_unstale":"2023-09-30T22:54:06.279537+0000","last_undegraded":"2023-09-30T22:54:06.279537+0000","last_fullsized":"2023-09-30T22:54:06.279537+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:33:04.622185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272673+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280234+0000","last_change":"2023-09-30T22:54:06.280234+0000","last_active":"2023-09-30T22:54:06.280234+0000","last_peered":"2023-09-30T22:54:06.280234+0000","last_clean":"2023-09-30T22:54:06.280234+0000","last_became_active":"2023-09-30T22:54:06.279996+0000","last_became_peered":"2023-09-30T22:54:06.279996+0000","last_unstale":"2023-09-30T22:54:06.280234+0000","last_undegraded":"2023-09-30T22:54:06.280234+0000","last_fullsized":"2023-09-30T22:54:06.280234+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270324+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:48.447517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281185+0000","last_change":"2023-09-30T22:54:06.281185+0000","last_active":"2023-09-30T22:54:06.281185+0000","last_peered":"2023-09-30T22:54:06.281185+0000","last_clean":"2023-09-30T22:54:06.281185+0000","last_became_active":"2023-09-30T22:54:06.280705+0000","last_became_peered":"2023-09-30T22:54:06.280705+0000","last_unstale":"2023-09-30T22:54:06.281185+0000","last_undegraded":"2023-09-30T22:54:06.281185+0000","last_fullsized":"2023-09-30T22:54:06.281185+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:09.336177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272440+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:41.367382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.275367+0000","last_change":"2023-09-30T22:54:06.275367+0000","last_active":"2023-09-30T22:54:06.275367+0000","last_peered":"2023-09-30T22:54:06.275367+0000","last_clean":"2023-09-30T22:54:06.275367+0000","last_became_active":"2023-09-30T22:54:06.275116+0000","last_became_peered":"2023-09-30T22:54:06.275116+0000","last_unstale":"2023-09-30T22:54:06.275367+0000","last_undegraded":"2023-09-30T22:54:06.275367+0000","last_fullsized":"2023-09-30T22:54:06.275367+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:10.629629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269964+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:11:35.672780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.271026+0000","last_change":"2023-09-30T22:54:06.271026+0000","last_active":"2023-09-30T22:54:06.271026+0000","last_peered":"2023-09-30T22:54:06.271026+0000","last_clean":"2023-09-30T22:54:06.271026+0000","last_became_active":"2023-09-30T22:54:06.270808+0000","last_became_peered":"2023-09-30T22:54:06.270808+0000","last_unstale":"2023-09-30T22:54:06.271026+0000","last_undegraded":"2023-09-30T22:54:06.271026+0000","last_fullsized":"2023-09-30T22:54:06.271026+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:13.169498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271490+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:46.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281865+0000","last_change":"2023-09-30T22:54:06.281865+0000","last_active":"2023-09-30T22:54:06.281865+0000","last_peered":"2023-09-30T22:54:06.281865+0000","last_clean":"2023-09-30T22:54:06.281865+0000","last_became_active":"2023-09-30T22:54:06.281674+0000","last_became_peered":"2023-09-30T22:54:06.281674+0000","last_unstale":"2023-09-30T22:54:06.281865+0000","last_undegraded":"2023-09-30T22:54:06.281865+0000","last_fullsized":"2023-09-30T22:54:06.281865+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:23.908829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271814+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:53.410638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.286681+0000","last_change":"2023-09-30T22:54:06.286681+0000","last_active":"2023-09-30T22:54:06.286681+0000","last_peered":"2023-09-30T22:54:06.286681+0000","last_clean":"2023-09-30T22:54:06.286681+0000","last_became_active":"2023-09-30T22:54:06.286440+0000","last_became_peered":"2023-09-30T22:54:06.286440+0000","last_unstale":"2023-09-30T22:54:06.286681+0000","last_undegraded":"2023-09-30T22:54:06.286681+0000","last_fullsized":"2023-09-30T22:54:06.286681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274285+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:23.984410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.276631+0000","last_change":"2023-09-30T22:54:06.276631+0000","last_active":"2023-09-30T22:54:06.276631+0000","last_peered":"2023-09-30T22:54:06.276631+0000","last_clean":"2023-09-30T22:54:06.276631+0000","last_became_active":"2023-09-30T22:54:06.276205+0000","last_became_peered":"2023-09-30T22:54:06.276205+0000","last_unstale":"2023-09-30T22:54:06.276631+0000","last_undegraded":"2023-09-30T22:54:06.276631+0000","last_fullsized":"2023-09-30T22:54:06.276631+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270669+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:41.000107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.278684+0000","last_change":"2023-09-30T22:54:06.278684+0000","last_active":"2023-09-30T22:54:06.278684+0000","last_peered":"2023-09-30T22:54:06.278684+0000","last_clean":"2023-09-30T22:54:06.278684+0000","last_became_active":"2023-09-30T22:54:06.278481+0000","last_became_peered":"2023-09-30T22:54:06.278481+0000","last_unstale":"2023-09-30T22:54:06.278684+0000","last_undegraded":"2023-09-30T22:54:06.278684+0000","last_fullsized":"2023-09-30T22:54:06.278684+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:55.393916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270585+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:22.311313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.277690+0000","last_change":"2023-09-30T22:54:06.277690+0000","last_active":"2023-09-30T22:54:06.277690+0000","last_peered":"2023-09-30T22:54:06.277690+0000","last_clean":"2023-09-30T22:54:06.277690+0000","last_became_active":"2023-09-30T22:54:06.277355+0000","last_became_peered":"2023-09-30T22:54:06.277355+0000","last_unstale":"2023-09-30T22:54:06.277690+0000","last_undegraded":"2023-09-30T22:54:06.277690+0000","last_fullsized":"2023-09-30T22:54:06.277690+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:53.590302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.282604+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:04.259944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.286073+0000","last_change":"2023-09-30T22:54:06.286073+0000","last_active":"2023-09-30T22:54:06.286073+0000","last_peered":"2023-09-30T22:54:06.286073+0000","last_clean":"2023-09-30T22:54:06.286073+0000","last_became_active":"2023-09-30T22:54:06.285829+0000","last_became_peered":"2023-09-30T22:54:06.285829+0000","last_unstale":"2023-09-30T22:54:06.286073+0000","last_undegraded":"2023-09-30T22:54:06.286073+0000","last_fullsized":"2023-09-30T22:54:06.286073+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:39.997183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.276767+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283300+0000","last_change":"2023-09-30T22:54:06.283300+0000","last_active":"2023-09-30T22:54:06.283300+0000","last_peered":"2023-09-30T22:54:06.283300+0000","last_clean":"2023-09-30T22:54:06.283300+0000","last_became_active":"2023-09-30T22:54:06.282769+0000","last_became_peered":"2023-09-30T22:54:06.282769+0000","last_unstale":"2023-09-30T22:54:06.283300+0000","last_undegraded":"2023-09-30T22:54:06.283300+0000","last_fullsized":"2023-09-30T22:54:06.283300+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270693+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:14.681908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.276472+0000","last_change":"2023-09-30T22:54:06.276472+0000","last_active":"2023-09-30T22:54:06.276472+0000","last_peered":"2023-09-30T22:54:06.276472+0000","last_clean":"2023-09-30T22:54:06.276472+0000","last_became_active":"2023-09-30T22:54:06.275828+0000","last_became_peered":"2023-09-30T22:54:06.275828+0000","last_unstale":"2023-09-30T22:54:06.276472+0000","last_undegraded":"2023-09-30T22:54:06.276472+0000","last_fullsized":"2023-09-30T22:54:06.276472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:54.384228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271416+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:41.000107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281858+0000","last_change":"2023-09-30T22:54:06.281858+0000","last_active":"2023-09-30T22:54:06.281858+0000","last_peered":"2023-09-30T22:54:06.281858+0000","last_clean":"2023-09-30T22:54:06.281858+0000","last_became_active":"2023-09-30T22:54:06.281635+0000","last_became_peered":"2023-09-30T22:54:06.281635+0000","last_unstale":"2023-09-30T22:54:06.281858+0000","last_undegraded":"2023-09-30T22:54:06.281858+0000","last_fullsized":"2023-09-30T22:54:06.281858+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:26.021090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270105+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:53.410638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283372+0000","last_change":"2023-09-30T22:54:06.283372+0000","last_active":"2023-09-30T22:54:06.283372+0000","last_peered":"2023-09-30T22:54:06.283372+0000","last_clean":"2023-09-30T22:54:06.283372+0000","last_became_active":"2023-09-30T22:54:06.283156+0000","last_became_peered":"2023-09-30T22:54:06.283156+0000","last_unstale":"2023-09-30T22:54:06.283372+0000","last_undegraded":"2023-09-30T22:54:06.283372+0000","last_fullsized":"2023-09-30T22:54:06.283372+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:24:10.857387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271237+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:41.367382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.278096+0000","last_change":"2023-09-30T22:54:06.278096+0000","last_active":"2023-09-30T22:54:06.278096+0000","last_peered":"2023-09-30T22:54:06.278096+0000","last_clean":"2023-09-30T22:54:06.278096+0000","last_became_active":"2023-09-30T22:54:06.274665+0000","last_became_peered":"2023-09-30T22:54:06.274665+0000","last_unstale":"2023-09-30T22:54:06.278096+0000","last_undegraded":"2023-09-30T22:54:06.278096+0000","last_fullsized":"2023-09-30T22:54:06.278096+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269545+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:29:59.319976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281951+0000","last_change":"2023-09-30T22:54:06.281951+0000","last_active":"2023-09-30T22:54:06.281951+0000","last_peered":"2023-09-30T22:54:06.281951+0000","last_clean":"2023-09-30T22:54:06.281951+0000","last_became_active":"2023-09-30T22:54:06.281513+0000","last_became_peered":"2023-09-30T22:54:06.281513+0000","last_unstale":"2023-09-30T22:54:06.281951+0000","last_undegraded":"2023-09-30T22:54:06.281951+0000","last_fullsized":"2023-09-30T22:54:06.281951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271119+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:53.410638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.284019+0000","last_change":"2023-09-30T22:54:06.284019+0000","last_active":"2023-09-30T22:54:06.284019+0000","last_peered":"2023-09-30T22:54:06.284019+0000","last_clean":"2023-09-30T22:54:06.284019+0000","last_became_active":"2023-09-30T22:54:06.283783+0000","last_became_peered":"2023-09-30T22:54:06.283783+0000","last_unstale":"2023-09-30T22:54:06.284019+0000","last_undegraded":"2023-09-30T22:54:06.284019+0000","last_fullsized":"2023-09-30T22:54:06.284019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:45.528979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270318+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:02.796588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280742+0000","last_change":"2023-09-30T22:54:06.280742+0000","last_active":"2023-09-30T22:54:06.280742+0000","last_peered":"2023-09-30T22:54:06.280742+0000","last_clean":"2023-09-30T22:54:06.280742+0000","last_became_active":"2023-09-30T22:54:06.280380+0000","last_became_peered":"2023-09-30T22:54:06.280380+0000","last_unstale":"2023-09-30T22:54:06.280742+0000","last_undegraded":"2023-09-30T22:54:06.280742+0000","last_fullsized":"2023-09-30T22:54:06.280742+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:01.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.274286+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.277243+0000","last_change":"2023-09-30T22:54:06.277243+0000","last_active":"2023-09-30T22:54:06.277243+0000","last_peered":"2023-09-30T22:54:06.277243+0000","last_clean":"2023-09-30T22:54:06.277243+0000","last_became_active":"2023-09-30T22:54:06.276913+0000","last_became_peered":"2023-09-30T22:54:06.276913+0000","last_unstale":"2023-09-30T22:54:06.277243+0000","last_undegraded":"2023-09-30T22:54:06.277243+0000","last_fullsized":"2023-09-30T22:54:06.277243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:04.627516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.265146+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:54:05.265146+0000","last_peered":"2023-09-30T22:54:05.265146+0000","last_clean":"2023-09-30T22:54:05.265146+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:54:05.265146+0000","last_undegraded":"2023-09-30T22:54:05.265146+0000","last_fullsized":"2023-09-30T22:54:05.265146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.269930+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:26:32.868932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280275+0000","last_change":"2023-09-30T22:54:06.280275+0000","last_active":"2023-09-30T22:54:06.280275+0000","last_peered":"2023-09-30T22:54:06.280275+0000","last_clean":"2023-09-30T22:54:06.280275+0000","last_became_active":"2023-09-30T22:54:06.280036+0000","last_became_peered":"2023-09-30T22:54:06.280036+0000","last_unstale":"2023-09-30T22:54:06.280275+0000","last_undegraded":"2023-09-30T22:54:06.280275+0000","last_fullsized":"2023-09-30T22:54:06.280275+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262964+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:54:05.262964+0000","last_peered":"2023-09-30T22:54:05.262964+0000","last_clean":"2023-09-30T22:54:05.262964+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:54:05.262964+0000","last_undegraded":"2023-09-30T22:54:05.262964+0000","last_fullsized":"2023-09-30T22:54:05.262964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.283274+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:04.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280988+0000","last_change":"2023-09-30T22:54:06.280988+0000","last_active":"2023-09-30T22:54:06.280988+0000","last_peered":"2023-09-30T22:54:06.280988+0000","last_clean":"2023-09-30T22:54:06.280988+0000","last_became_active":"2023-09-30T22:54:06.280317+0000","last_became_peered":"2023-09-30T22:54:06.280317+0000","last_unstale":"2023-09-30T22:54:06.280988+0000","last_undegraded":"2023-09-30T22:54:06.280988+0000","last_fullsized":"2023-09-30T22:54:06.280988+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:26.869196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.265960+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:54:05.265960+0000","last_peered":"2023-09-30T22:54:05.265960+0000","last_clean":"2023-09-30T22:54:05.265960+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:54:05.265960+0000","last_undegraded":"2023-09-30T22:54:05.265960+0000","last_fullsized":"2023-09-30T22:54:05.265960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.272089+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:31.722246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281336+0000","last_change":"2023-09-30T22:54:06.281336+0000","last_active":"2023-09-30T22:54:06.281336+0000","last_peered":"2023-09-30T22:54:06.281336+0000","last_clean":"2023-09-30T22:54:06.281336+0000","last_became_active":"2023-09-30T22:54:06.281041+0000","last_became_peered":"2023-09-30T22:54:06.281041+0000","last_unstale":"2023-09-30T22:54:06.281336+0000","last_undegraded":"2023-09-30T22:54:06.281336+0000","last_fullsized":"2023-09-30T22:54:06.281336+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:22.348215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262558+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:54:05.262558+0000","last_peered":"2023-09-30T22:54:05.262558+0000","last_clean":"2023-09-30T22:54:05.262558+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:54:05.262558+0000","last_undegraded":"2023-09-30T22:54:05.262558+0000","last_fullsized":"2023-09-30T22:54:05.262558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.263726+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:54:05.263726+0000","last_peered":"2023-09-30T22:54:05.263726+0000","last_clean":"2023-09-30T22:54:05.263726+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:54:05.263726+0000","last_undegraded":"2023-09-30T22:54:05.263726+0000","last_fullsized":"2023-09-30T22:54:05.263726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.275988+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.284834+0000","last_change":"2023-09-30T22:54:06.284834+0000","last_active":"2023-09-30T22:54:06.284834+0000","last_peered":"2023-09-30T22:54:06.284834+0000","last_clean":"2023-09-30T22:54:06.284834+0000","last_became_active":"2023-09-30T22:54:06.284671+0000","last_became_peered":"2023-09-30T22:54:06.284671+0000","last_unstale":"2023-09-30T22:54:06.284834+0000","last_undegraded":"2023-09-30T22:54:06.284834+0000","last_fullsized":"2023-09-30T22:54:06.284834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262666+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:54:05.262666+0000","last_peered":"2023-09-30T22:54:05.262666+0000","last_clean":"2023-09-30T22:54:05.262666+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:54:05.262666+0000","last_undegraded":"2023-09-30T22:54:05.262666+0000","last_fullsized":"2023-09-30T22:54:05.262666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.270117+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:46.531902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.281184+0000","last_change":"2023-09-30T22:54:06.281184+0000","last_active":"2023-09-30T22:54:06.281184+0000","last_peered":"2023-09-30T22:54:06.281184+0000","last_clean":"2023-09-30T22:54:06.281184+0000","last_became_active":"2023-09-30T22:54:06.280960+0000","last_became_peered":"2023-09-30T22:54:06.280960+0000","last_unstale":"2023-09-30T22:54:06.281184+0000","last_undegraded":"2023-09-30T22:54:06.281184+0000","last_fullsized":"2023-09-30T22:54:06.281184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:45.532201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262559+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:54:05.262559+0000","last_peered":"2023-09-30T22:54:05.262559+0000","last_clean":"2023-09-30T22:54:05.262559+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:54:05.262559+0000","last_undegraded":"2023-09-30T22:54:05.262559+0000","last_fullsized":"2023-09-30T22:54:05.262559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271838+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.280079+0000","last_change":"2023-09-30T22:54:06.280079+0000","last_active":"2023-09-30T22:54:06.280079+0000","last_peered":"2023-09-30T22:54:06.280079+0000","last_clean":"2023-09-30T22:54:06.280079+0000","last_became_active":"2023-09-30T22:54:06.279695+0000","last_became_peered":"2023-09-30T22:54:06.279695+0000","last_unstale":"2023-09-30T22:54:06.280079+0000","last_undegraded":"2023-09-30T22:54:06.280079+0000","last_fullsized":"2023-09-30T22:54:06.280079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.263119+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:54:05.263119+0000","last_peered":"2023-09-30T22:54:05.263119+0000","last_clean":"2023-09-30T22:54:05.263119+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:54:05.263119+0000","last_undegraded":"2023-09-30T22:54:05.263119+0000","last_fullsized":"2023-09-30T22:54:05.263119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:54:06.259591+0000","last_change":"2023-09-30T22:54:06.271683+0000","last_active":"2023-09-30T22:54:06.259591+0000","last_peered":"2023-09-30T22:54:06.259591+0000","last_clean":"2023-09-30T22:54:06.259591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:54:06.259591+0000","last_undegraded":"2023-09-30T22:54:06.259591+0000","last_fullsized":"2023-09-30T22:54:06.259591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:23.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-09-30T22:54:06.283671+0000","last_change":"2023-09-30T22:54:06.283671+0000","last_active":"2023-09-30T22:54:06.283671+0000","last_peered":"2023-09-30T22:54:06.283671+0000","last_clean":"2023-09-30T22:54:06.283671+0000","last_became_active":"2023-09-30T22:54:06.283368+0000","last_became_peered":"2023-09-30T22:54:06.283368+0000","last_unstale":"2023-09-30T22:54:06.283671+0000","last_undegraded":"2023-09-30T22:54:06.283671+0000","last_fullsized":"2023-09-30T22:54:06.283671+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-30T22:54:05.262871+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:54:05.262871+0000","last_peered":"2023-09-30T22:54:05.262871+0000","last_clean":"2023-09-30T22:54:05.262871+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:54:05.262871+0000","last_undegraded":"2023-09-30T22:54:05.262871+0000","last_fullsized":"2023-09-30T22:54:05.262871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195096,"statfs":{"total":200000000,"available":199779156,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.496}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.59899999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.77700000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":798,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194513,"statfs":{"total":200000000,"available":199182172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.435}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.78400000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67100000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.746},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.29599999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.624},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.434},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.88400000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.65600000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.85499999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.91500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.626}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.81299999999999994}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.78400000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.755}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.496},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":792,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194520,"statfs":{"total":200000000,"available":199188788,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.81200000000000006}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.623},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.84299999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.88800000000000001}]}]}],"pool_statfs":[]}} 2023-09-30T22:54:12.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:54:12.130 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:12.134 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.321+0000 7eff421ff700 1 Processor -- start 2023-09-30T22:54:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.321+0000 7eff421ff700 1 -- start start 2023-09-30T22:54:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.322+0000 7eff421ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff3c0aebf0 0x7eff3c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.322+0000 7eff421ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c15a2a0 0x7eff3c160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.322+0000 7eff421ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c0b0ee0 con 0x7eff3c06ec50 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.322+0000 7eff421ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0aefc0 con 0x7eff3c0aebf0 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.322+0000 7eff421ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0b02d0 con 0x7eff3c15a2a0 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.322+0000 7eff3b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff3c0aebf0 0x7eff3c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff3c0aebf0 0x7eff3c0c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55480/0 (socket says 172.21.15.142:55480) 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3b7fe700 1 -- 172.21.15.142:0/485724393 learned_addr learned my addr 172.21.15.142:0/485724393 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3bfff700 1 --2- 172.21.15.142:0/485724393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c15a2a0 0x7eff3c160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3b7fe700 1 -- 172.21.15.142:0/485724393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c15a2a0 msgr2=0x7eff3c160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3b7fe700 1 --2- 172.21.15.142:0/485724393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c15a2a0 0x7eff3c160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3b7fe700 1 -- 172.21.15.142:0/485724393 >> v1:172.21.15.148:6789/0 conn(0x7eff3c06ec50 legacy=0x7eff3c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3b7fe700 1 -- 172.21.15.142:0/485724393 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0b05b0 con 0x7eff3c0aebf0 2023-09-30T22:54:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3b7fe700 1 --2- 172.21.15.142:0/485724393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c0aebf0 0x7eff3c0c9880 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0099b0 tx=0x7eff2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64f9f5f31955c6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.323+0000 7eff3a7fc700 1 -- 172.21.15.142:0/485724393 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00b860 con 0x7eff3c0aebf0 2023-09-30T22:54:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff3a7fc700 1 -- 172.21.15.142:0/485724393 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c00b9c0 con 0x7eff3c0aebf0 2023-09-30T22:54:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff3a7fc700 1 -- 172.21.15.142:0/485724393 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00bd60 con 0x7eff3c0aebf0 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 -- 172.21.15.142:0/485724393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c0aebf0 msgr2=0x7eff3c0c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 --2- 172.21.15.142:0/485724393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c0aebf0 0x7eff3c0c9880 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0099b0 tx=0x7eff2c009250 comp rx=0 tx=0).stop 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 -- 172.21.15.142:0/485724393 shutdown_connections 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 --2- 172.21.15.142:0/485724393 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c15a2a0 0x7eff3c160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 --2- 172.21.15.142:0/485724393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c0aebf0 0x7eff3c0c9880 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 -- 172.21.15.142:0/485724393 >> 172.21.15.142:0/485724393 conn(0x7eff3c0680c0 msgr2=0x7eff3c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 -- 172.21.15.142:0/485724393 shutdown_connections 2023-09-30T22:54:12.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.324+0000 7eff421ff700 1 -- 172.21.15.142:0/485724393 wait complete. 2023-09-30T22:54:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.326+0000 7eff421ff700 1 Processor -- start 2023-09-30T22:54:12.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.326+0000 7eff421ff700 1 -- start start 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff421ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c06ec50 0x7eff3c14b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff421ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c0aebf0 0x7eff3c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff421ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff3c15a2a0 0x7eff3c14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff421ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c14b7d0 con 0x7eff3c06ec50 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff421ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c152f80 con 0x7eff3c15a2a0 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff421ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c15aa00 con 0x7eff3c0aebf0 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c06ec50 0x7eff3c14b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c06ec50 0x7eff3c14b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55482/0 (socket says 172.21.15.142:55482) 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 -- 172.21.15.142:0/2012449909 learned_addr learned my addr 172.21.15.142:0/2012449909 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:12.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3affd700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c0aebf0 0x7eff3c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3bfff700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff3c15a2a0 0x7eff3c14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 -- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c0aebf0 msgr2=0x7eff3c152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c0aebf0 0x7eff3c152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 -- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff3c15a2a0 msgr2=0x7eff3c14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff3c15a2a0 0x7eff3c14a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.327+0000 7eff3b7fe700 1 -- 172.21.15.142:0/2012449909 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0094f0 con 0x7eff3c06ec50 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.328+0000 7eff3b7fe700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c06ec50 0x7eff3c14b290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0685b0 tx=0x7eff2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.328+0000 7eff237fe700 1 -- 172.21.15.142:0/2012449909 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c024440 con 0x7eff3c06ec50 2023-09-30T22:54:12.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.328+0000 7eff237fe700 1 -- 172.21.15.142:0/2012449909 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0245c0 con 0x7eff3c06ec50 2023-09-30T22:54:12.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.328+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c15ace0 con 0x7eff3c06ec50 2023-09-30T22:54:12.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.328+0000 7eff237fe700 1 -- 172.21.15.142:0/2012449909 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c024980 con 0x7eff3c06ec50 2023-09-30T22:54:12.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.328+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c15b2a0 con 0x7eff3c06ec50 2023-09-30T22:54:12.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.329+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c0695b0 con 0x7eff3c06ec50 2023-09-30T22:54:12.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.330+0000 7eff237fe700 1 -- 172.21.15.142:0/2012449909 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff2c01a420 con 0x7eff3c06ec50 2023-09-30T22:54:12.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.331+0000 7eff237fe700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff28067330 0x7eff280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.331+0000 7eff237fe700 1 -- 172.21.15.142:0/2012449909 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff2c086a10 con 0x7eff3c06ec50 2023-09-30T22:54:12.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.331+0000 7eff3affd700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff28067330 0x7eff280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.331+0000 7eff3affd700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff28067330 0x7eff280697e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ae970 tx=0x7eff30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:12.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.335+0000 7eff237fe700 1 -- 172.21.15.142:0/2012449909 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff2c053870 con 0x7eff3c06ec50 2023-09-30T22:54:12.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.523+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff3c06fc10 con 0x7eff28067330 2023-09-30T22:54:12.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.531+0000 7eff237fe700 1 -- 172.21.15.142:0/2012449909 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303625 (secure 0 0 0) 0x7eff3c06fc10 con 0x7eff28067330 2023-09-30T22:54:12.536 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:12.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff28067330 msgr2=0x7eff280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff28067330 0x7eff280697e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ae970 tx=0x7eff30009040 comp rx=0 tx=0).stop 2023-09-30T22:54:12.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c06ec50 msgr2=0x7eff3c14b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c06ec50 0x7eff3c14b290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0685b0 tx=0x7eff2c017000 comp rx=0 tx=0).stop 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 shutdown_connections 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff28067330 0x7eff280697e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff3c15a2a0 0x7eff3c14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3c06ec50 0x7eff3c14b290 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.535+0000 7eff421ff700 1 --2- 172.21.15.142:0/2012449909 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff3c0aebf0 0x7eff3c152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.536+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 >> 172.21.15.142:0/2012449909 conn(0x7eff3c0680c0 msgr2=0x7eff3c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.536+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 shutdown_connections 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.536+0000 7eff421ff700 1 -- 172.21.15.142:0/2012449909 wait complete. 2023-09-30T22:54:12.539 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:54:12.553 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-09-30T22:54:12.122550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559457,"statfs":{"total":1600000000,"available":1596884916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001167"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284476+0000","last_change":"2023-09-30T22:54:07.282459+0000","last_active":"2023-09-30T22:54:07.284476+0000","last_peered":"2023-09-30T22:54:07.284476+0000","last_clean":"2023-09-30T22:54:07.284476+0000","last_became_active":"2023-09-30T22:54:07.282015+0000","last_became_peered":"2023-09-30T22:54:07.282015+0000","last_unstale":"2023-09-30T22:54:07.284476+0000","last_undegraded":"2023-09-30T22:54:07.284476+0000","last_fullsized":"2023-09-30T22:54:07.284476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289501+0000","last_change":"2023-09-30T22:54:07.289263+0000","last_active":"2023-09-30T22:54:07.289501+0000","last_peered":"2023-09-30T22:54:07.289501+0000","last_clean":"2023-09-30T22:54:07.289501+0000","last_became_active":"2023-09-30T22:54:07.288712+0000","last_became_peered":"2023-09-30T22:54:07.288712+0000","last_unstale":"2023-09-30T22:54:07.289501+0000","last_undegraded":"2023-09-30T22:54:07.289501+0000","last_fullsized":"2023-09-30T22:54:07.289501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288954+0000","last_change":"2023-09-30T22:54:07.288841+0000","last_active":"2023-09-30T22:54:07.288954+0000","last_peered":"2023-09-30T22:54:07.288954+0000","last_clean":"2023-09-30T22:54:07.288954+0000","last_became_active":"2023-09-30T22:54:07.288122+0000","last_became_peered":"2023-09-30T22:54:07.288122+0000","last_unstale":"2023-09-30T22:54:07.288954+0000","last_undegraded":"2023-09-30T22:54:07.288954+0000","last_fullsized":"2023-09-30T22:54:07.288954+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:12:30.609061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281780+0000","last_change":"2023-09-30T22:54:07.281645+0000","last_active":"2023-09-30T22:54:07.281780+0000","last_peered":"2023-09-30T22:54:07.281780+0000","last_clean":"2023-09-30T22:54:07.281780+0000","last_became_active":"2023-09-30T22:54:07.281094+0000","last_became_peered":"2023-09-30T22:54:07.281094+0000","last_unstale":"2023-09-30T22:54:07.281780+0000","last_undegraded":"2023-09-30T22:54:07.281780+0000","last_fullsized":"2023-09-30T22:54:07.281780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:41:06.753884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287989+0000","last_change":"2023-09-30T22:54:07.287587+0000","last_active":"2023-09-30T22:54:07.287989+0000","last_peered":"2023-09-30T22:54:07.287989+0000","last_clean":"2023-09-30T22:54:07.287989+0000","last_became_active":"2023-09-30T22:54:07.286871+0000","last_became_peered":"2023-09-30T22:54:07.286871+0000","last_unstale":"2023-09-30T22:54:07.287989+0000","last_undegraded":"2023-09-30T22:54:07.287989+0000","last_fullsized":"2023-09-30T22:54:07.287989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283932+0000","last_change":"2023-09-30T22:54:07.283152+0000","last_active":"2023-09-30T22:54:07.283932+0000","last_peered":"2023-09-30T22:54:07.283932+0000","last_clean":"2023-09-30T22:54:07.283932+0000","last_became_active":"2023-09-30T22:54:07.282730+0000","last_became_peered":"2023-09-30T22:54:07.282730+0000","last_unstale":"2023-09-30T22:54:07.283932+0000","last_undegraded":"2023-09-30T22:54:07.283932+0000","last_fullsized":"2023-09-30T22:54:07.283932+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:56.396839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277267+0000","last_change":"2023-09-30T22:54:07.277170+0000","last_active":"2023-09-30T22:54:07.277267+0000","last_peered":"2023-09-30T22:54:07.277267+0000","last_clean":"2023-09-30T22:54:07.277267+0000","last_became_active":"2023-09-30T22:54:07.276895+0000","last_became_peered":"2023-09-30T22:54:07.276895+0000","last_unstale":"2023-09-30T22:54:07.277267+0000","last_undegraded":"2023-09-30T22:54:07.277267+0000","last_fullsized":"2023-09-30T22:54:07.277267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284345+0000","last_change":"2023-09-30T22:54:07.284266+0000","last_active":"2023-09-30T22:54:07.284345+0000","last_peered":"2023-09-30T22:54:07.284345+0000","last_clean":"2023-09-30T22:54:07.284345+0000","last_became_active":"2023-09-30T22:54:07.283659+0000","last_became_peered":"2023-09-30T22:54:07.283659+0000","last_unstale":"2023-09-30T22:54:07.284345+0000","last_undegraded":"2023-09-30T22:54:07.284345+0000","last_fullsized":"2023-09-30T22:54:07.284345+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289842+0000","last_change":"2023-09-30T22:54:07.289562+0000","last_active":"2023-09-30T22:54:07.289842+0000","last_peered":"2023-09-30T22:54:07.289842+0000","last_clean":"2023-09-30T22:54:07.289842+0000","last_became_active":"2023-09-30T22:54:07.288451+0000","last_became_peered":"2023-09-30T22:54:07.288451+0000","last_unstale":"2023-09-30T22:54:07.289842+0000","last_undegraded":"2023-09-30T22:54:07.289842+0000","last_fullsized":"2023-09-30T22:54:07.289842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:40.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291044+0000","last_change":"2023-09-30T22:54:07.290970+0000","last_active":"2023-09-30T22:54:07.291044+0000","last_peered":"2023-09-30T22:54:07.291044+0000","last_clean":"2023-09-30T22:54:07.291044+0000","last_became_active":"2023-09-30T22:54:07.290500+0000","last_became_peered":"2023-09-30T22:54:07.290500+0000","last_unstale":"2023-09-30T22:54:07.291044+0000","last_undegraded":"2023-09-30T22:54:07.291044+0000","last_fullsized":"2023-09-30T22:54:07.291044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284401+0000","last_change":"2023-09-30T22:54:07.282303+0000","last_active":"2023-09-30T22:54:07.284401+0000","last_peered":"2023-09-30T22:54:07.284401+0000","last_clean":"2023-09-30T22:54:07.284401+0000","last_became_active":"2023-09-30T22:54:07.281628+0000","last_became_peered":"2023-09-30T22:54:07.281628+0000","last_unstale":"2023-09-30T22:54:07.284401+0000","last_undegraded":"2023-09-30T22:54:07.284401+0000","last_fullsized":"2023-09-30T22:54:07.284401+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280940+0000","last_change":"2023-09-30T22:54:07.280635+0000","last_active":"2023-09-30T22:54:07.280940+0000","last_peered":"2023-09-30T22:54:07.280940+0000","last_clean":"2023-09-30T22:54:07.280940+0000","last_became_active":"2023-09-30T22:54:07.278955+0000","last_became_peered":"2023-09-30T22:54:07.278955+0000","last_unstale":"2023-09-30T22:54:07.280940+0000","last_undegraded":"2023-09-30T22:54:07.280940+0000","last_fullsized":"2023-09-30T22:54:07.280940+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285559+0000","last_change":"2023-09-30T22:54:07.284431+0000","last_active":"2023-09-30T22:54:07.285559+0000","last_peered":"2023-09-30T22:54:07.285559+0000","last_clean":"2023-09-30T22:54:07.285559+0000","last_became_active":"2023-09-30T22:54:07.284034+0000","last_became_peered":"2023-09-30T22:54:07.284034+0000","last_unstale":"2023-09-30T22:54:07.285559+0000","last_undegraded":"2023-09-30T22:54:07.285559+0000","last_fullsized":"2023-09-30T22:54:07.285559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:58:29.360202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284376+0000","last_change":"2023-09-30T22:54:07.281788+0000","last_active":"2023-09-30T22:54:07.284376+0000","last_peered":"2023-09-30T22:54:07.284376+0000","last_clean":"2023-09-30T22:54:07.284376+0000","last_became_active":"2023-09-30T22:54:07.280893+0000","last_became_peered":"2023-09-30T22:54:07.280893+0000","last_unstale":"2023-09-30T22:54:07.284376+0000","last_undegraded":"2023-09-30T22:54:07.284376+0000","last_fullsized":"2023-09-30T22:54:07.284376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288070+0000","last_change":"2023-09-30T22:54:07.287544+0000","last_active":"2023-09-30T22:54:07.288070+0000","last_peered":"2023-09-30T22:54:07.288070+0000","last_clean":"2023-09-30T22:54:07.288070+0000","last_became_active":"2023-09-30T22:54:07.287329+0000","last_became_peered":"2023-09-30T22:54:07.287329+0000","last_unstale":"2023-09-30T22:54:07.288070+0000","last_undegraded":"2023-09-30T22:54:07.288070+0000","last_fullsized":"2023-09-30T22:54:07.288070+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:47.026175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283952+0000","last_change":"2023-09-30T22:54:07.283851+0000","last_active":"2023-09-30T22:54:07.283952+0000","last_peered":"2023-09-30T22:54:07.283952+0000","last_clean":"2023-09-30T22:54:07.283952+0000","last_became_active":"2023-09-30T22:54:07.283376+0000","last_became_peered":"2023-09-30T22:54:07.283376+0000","last_unstale":"2023-09-30T22:54:07.283952+0000","last_undegraded":"2023-09-30T22:54:07.283952+0000","last_fullsized":"2023-09-30T22:54:07.283952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.278498+0000","last_change":"2023-09-30T22:54:07.278306+0000","last_active":"2023-09-30T22:54:07.278498+0000","last_peered":"2023-09-30T22:54:07.278498+0000","last_clean":"2023-09-30T22:54:07.278498+0000","last_became_active":"2023-09-30T22:54:07.278078+0000","last_became_peered":"2023-09-30T22:54:07.278078+0000","last_unstale":"2023-09-30T22:54:07.278498+0000","last_undegraded":"2023-09-30T22:54:07.278498+0000","last_fullsized":"2023-09-30T22:54:07.278498+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283192+0000","last_change":"2023-09-30T22:54:07.283092+0000","last_active":"2023-09-30T22:54:07.283192+0000","last_peered":"2023-09-30T22:54:07.283192+0000","last_clean":"2023-09-30T22:54:07.283192+0000","last_became_active":"2023-09-30T22:54:07.282732+0000","last_became_peered":"2023-09-30T22:54:07.282732+0000","last_unstale":"2023-09-30T22:54:07.283192+0000","last_undegraded":"2023-09-30T22:54:07.283192+0000","last_fullsized":"2023-09-30T22:54:07.283192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:10.339100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289824+0000","last_change":"2023-09-30T22:54:07.289420+0000","last_active":"2023-09-30T22:54:07.289824+0000","last_peered":"2023-09-30T22:54:07.289824+0000","last_clean":"2023-09-30T22:54:07.289824+0000","last_became_active":"2023-09-30T22:54:07.287804+0000","last_became_peered":"2023-09-30T22:54:07.287804+0000","last_unstale":"2023-09-30T22:54:07.289824+0000","last_undegraded":"2023-09-30T22:54:07.289824+0000","last_fullsized":"2023-09-30T22:54:07.289824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:58.841154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293662+0000","last_change":"2023-09-30T22:54:07.293573+0000","last_active":"2023-09-30T22:54:07.293662+0000","last_peered":"2023-09-30T22:54:07.293662+0000","last_clean":"2023-09-30T22:54:07.293662+0000","last_became_active":"2023-09-30T22:54:07.293351+0000","last_became_peered":"2023-09-30T22:54:07.293351+0000","last_unstale":"2023-09-30T22:54:07.293662+0000","last_undegraded":"2023-09-30T22:54:07.293662+0000","last_fullsized":"2023-09-30T22:54:07.293662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:22.311313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290814+0000","last_change":"2023-09-30T22:54:07.290744+0000","last_active":"2023-09-30T22:54:07.290814+0000","last_peered":"2023-09-30T22:54:07.290814+0000","last_clean":"2023-09-30T22:54:07.290814+0000","last_became_active":"2023-09-30T22:54:07.290452+0000","last_became_peered":"2023-09-30T22:54:07.290452+0000","last_unstale":"2023-09-30T22:54:07.290814+0000","last_undegraded":"2023-09-30T22:54:07.290814+0000","last_fullsized":"2023-09-30T22:54:07.290814+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:26.390802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285567+0000","last_change":"2023-09-30T22:54:07.285094+0000","last_active":"2023-09-30T22:54:07.285567+0000","last_peered":"2023-09-30T22:54:07.285567+0000","last_clean":"2023-09-30T22:54:07.285567+0000","last_became_active":"2023-09-30T22:54:07.284799+0000","last_became_peered":"2023-09-30T22:54:07.284799+0000","last_unstale":"2023-09-30T22:54:07.285567+0000","last_undegraded":"2023-09-30T22:54:07.285567+0000","last_fullsized":"2023-09-30T22:54:07.285567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:50.135141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293007+0000","last_change":"2023-09-30T22:54:07.292335+0000","last_active":"2023-09-30T22:54:07.293007+0000","last_peered":"2023-09-30T22:54:07.293007+0000","last_clean":"2023-09-30T22:54:07.293007+0000","last_became_active":"2023-09-30T22:54:07.291140+0000","last_became_peered":"2023-09-30T22:54:07.291140+0000","last_unstale":"2023-09-30T22:54:07.293007+0000","last_undegraded":"2023-09-30T22:54:07.293007+0000","last_fullsized":"2023-09-30T22:54:07.293007+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:39:08.162123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284565+0000","last_change":"2023-09-30T22:54:07.281031+0000","last_active":"2023-09-30T22:54:07.284565+0000","last_peered":"2023-09-30T22:54:07.284565+0000","last_clean":"2023-09-30T22:54:07.284565+0000","last_became_active":"2023-09-30T22:54:07.280787+0000","last_became_peered":"2023-09-30T22:54:07.280787+0000","last_unstale":"2023-09-30T22:54:07.284565+0000","last_undegraded":"2023-09-30T22:54:07.284565+0000","last_fullsized":"2023-09-30T22:54:07.284565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:16.744462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277149+0000","last_change":"2023-09-30T22:54:07.277070+0000","last_active":"2023-09-30T22:54:07.277149+0000","last_peered":"2023-09-30T22:54:07.277149+0000","last_clean":"2023-09-30T22:54:07.277149+0000","last_became_active":"2023-09-30T22:54:07.276819+0000","last_became_peered":"2023-09-30T22:54:07.276819+0000","last_unstale":"2023-09-30T22:54:07.277149+0000","last_undegraded":"2023-09-30T22:54:07.277149+0000","last_fullsized":"2023-09-30T22:54:07.277149+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287937+0000","last_change":"2023-09-30T22:54:07.287157+0000","last_active":"2023-09-30T22:54:07.287937+0000","last_peered":"2023-09-30T22:54:07.287937+0000","last_clean":"2023-09-30T22:54:07.287937+0000","last_became_active":"2023-09-30T22:54:07.286772+0000","last_became_peered":"2023-09-30T22:54:07.286772+0000","last_unstale":"2023-09-30T22:54:07.287937+0000","last_undegraded":"2023-09-30T22:54:07.287937+0000","last_fullsized":"2023-09-30T22:54:07.287937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:19:55.360729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288424+0000","last_change":"2023-09-30T22:54:07.286820+0000","last_active":"2023-09-30T22:54:07.288424+0000","last_peered":"2023-09-30T22:54:07.288424+0000","last_clean":"2023-09-30T22:54:07.288424+0000","last_became_active":"2023-09-30T22:54:07.286546+0000","last_became_peered":"2023-09-30T22:54:07.286546+0000","last_unstale":"2023-09-30T22:54:07.288424+0000","last_undegraded":"2023-09-30T22:54:07.288424+0000","last_fullsized":"2023-09-30T22:54:07.288424+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287972+0000","last_change":"2023-09-30T22:54:07.287275+0000","last_active":"2023-09-30T22:54:07.287972+0000","last_peered":"2023-09-30T22:54:07.287972+0000","last_clean":"2023-09-30T22:54:07.287972+0000","last_became_active":"2023-09-30T22:54:07.286742+0000","last_became_peered":"2023-09-30T22:54:07.286742+0000","last_unstale":"2023-09-30T22:54:07.287972+0000","last_undegraded":"2023-09-30T22:54:07.287972+0000","last_fullsized":"2023-09-30T22:54:07.287972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284532+0000","last_change":"2023-09-30T22:54:07.282640+0000","last_active":"2023-09-30T22:54:07.284532+0000","last_peered":"2023-09-30T22:54:07.284532+0000","last_clean":"2023-09-30T22:54:07.284532+0000","last_became_active":"2023-09-30T22:54:07.282407+0000","last_became_peered":"2023-09-30T22:54:07.282407+0000","last_unstale":"2023-09-30T22:54:07.284532+0000","last_undegraded":"2023-09-30T22:54:07.284532+0000","last_fullsized":"2023-09-30T22:54:07.284532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289997+0000","last_change":"2023-09-30T22:54:07.289529+0000","last_active":"2023-09-30T22:54:07.289997+0000","last_peered":"2023-09-30T22:54:07.289997+0000","last_clean":"2023-09-30T22:54:07.289997+0000","last_became_active":"2023-09-30T22:54:07.288847+0000","last_became_peered":"2023-09-30T22:54:07.288847+0000","last_unstale":"2023-09-30T22:54:07.289997+0000","last_undegraded":"2023-09-30T22:54:07.289997+0000","last_fullsized":"2023-09-30T22:54:07.289997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:27.314727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287911+0000","last_change":"2023-09-30T22:54:07.287004+0000","last_active":"2023-09-30T22:54:07.287911+0000","last_peered":"2023-09-30T22:54:07.287911+0000","last_clean":"2023-09-30T22:54:07.287911+0000","last_became_active":"2023-09-30T22:54:07.286466+0000","last_became_peered":"2023-09-30T22:54:07.286466+0000","last_unstale":"2023-09-30T22:54:07.287911+0000","last_undegraded":"2023-09-30T22:54:07.287911+0000","last_fullsized":"2023-09-30T22:54:07.287911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:38.748953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288051+0000","last_change":"2023-09-30T22:54:07.287889+0000","last_active":"2023-09-30T22:54:07.288051+0000","last_peered":"2023-09-30T22:54:07.288051+0000","last_clean":"2023-09-30T22:54:07.288051+0000","last_became_active":"2023-09-30T22:54:07.287632+0000","last_became_peered":"2023-09-30T22:54:07.287632+0000","last_unstale":"2023-09-30T22:54:07.288051+0000","last_undegraded":"2023-09-30T22:54:07.288051+0000","last_fullsized":"2023-09-30T22:54:07.288051+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284763+0000","last_change":"2023-09-30T22:54:07.284627+0000","last_active":"2023-09-30T22:54:07.284763+0000","last_peered":"2023-09-30T22:54:07.284763+0000","last_clean":"2023-09-30T22:54:07.284763+0000","last_became_active":"2023-09-30T22:54:07.284389+0000","last_became_peered":"2023-09-30T22:54:07.284389+0000","last_unstale":"2023-09-30T22:54:07.284763+0000","last_undegraded":"2023-09-30T22:54:07.284763+0000","last_fullsized":"2023-09-30T22:54:07.284763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:13:01.671172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286174+0000","last_change":"2023-09-30T22:54:06.274358+0000","last_active":"2023-09-30T22:54:07.286174+0000","last_peered":"2023-09-30T22:54:07.286174+0000","last_clean":"2023-09-30T22:54:07.286174+0000","last_became_active":"2023-09-30T22:54:06.274137+0000","last_became_peered":"2023-09-30T22:54:06.274137+0000","last_unstale":"2023-09-30T22:54:07.286174+0000","last_undegraded":"2023-09-30T22:54:07.286174+0000","last_fullsized":"2023-09-30T22:54:07.286174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285198+0000","last_change":"2023-09-30T22:54:07.285124+0000","last_active":"2023-09-30T22:54:07.285198+0000","last_peered":"2023-09-30T22:54:07.285198+0000","last_clean":"2023-09-30T22:54:07.285198+0000","last_became_active":"2023-09-30T22:54:07.284907+0000","last_became_peered":"2023-09-30T22:54:07.284907+0000","last_unstale":"2023-09-30T22:54:07.285198+0000","last_undegraded":"2023-09-30T22:54:07.285198+0000","last_fullsized":"2023-09-30T22:54:07.285198+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:54.397192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294231+0000","last_change":"2023-09-30T22:54:06.283446+0000","last_active":"2023-09-30T22:54:07.294231+0000","last_peered":"2023-09-30T22:54:07.294231+0000","last_clean":"2023-09-30T22:54:07.294231+0000","last_became_active":"2023-09-30T22:54:06.283085+0000","last_became_peered":"2023-09-30T22:54:06.283085+0000","last_unstale":"2023-09-30T22:54:07.294231+0000","last_undegraded":"2023-09-30T22:54:07.294231+0000","last_fullsized":"2023-09-30T22:54:07.294231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285704+0000","last_change":"2023-09-30T22:54:07.285545+0000","last_active":"2023-09-30T22:54:07.285704+0000","last_peered":"2023-09-30T22:54:07.285704+0000","last_clean":"2023-09-30T22:54:07.285704+0000","last_became_active":"2023-09-30T22:54:07.285330+0000","last_became_peered":"2023-09-30T22:54:07.285330+0000","last_unstale":"2023-09-30T22:54:07.285704+0000","last_undegraded":"2023-09-30T22:54:07.285704+0000","last_fullsized":"2023-09-30T22:54:07.285704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:04.259944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290820+0000","last_change":"2023-09-30T22:54:06.281913+0000","last_active":"2023-09-30T22:54:07.290820+0000","last_peered":"2023-09-30T22:54:07.290820+0000","last_clean":"2023-09-30T22:54:07.290820+0000","last_became_active":"2023-09-30T22:54:06.281648+0000","last_became_peered":"2023-09-30T22:54:06.281648+0000","last_unstale":"2023-09-30T22:54:07.290820+0000","last_undegraded":"2023-09-30T22:54:07.290820+0000","last_fullsized":"2023-09-30T22:54:07.290820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:52.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289610+0000","last_change":"2023-09-30T22:54:07.289396+0000","last_active":"2023-09-30T22:54:07.289610+0000","last_peered":"2023-09-30T22:54:07.289610+0000","last_clean":"2023-09-30T22:54:07.289610+0000","last_became_active":"2023-09-30T22:54:07.288864+0000","last_became_peered":"2023-09-30T22:54:07.288864+0000","last_unstale":"2023-09-30T22:54:07.289610+0000","last_undegraded":"2023-09-30T22:54:07.289610+0000","last_fullsized":"2023-09-30T22:54:07.289610+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:59.949127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293370+0000","last_change":"2023-09-30T22:54:06.282802+0000","last_active":"2023-09-30T22:54:07.293370+0000","last_peered":"2023-09-30T22:54:07.293370+0000","last_clean":"2023-09-30T22:54:07.293370+0000","last_became_active":"2023-09-30T22:54:06.282576+0000","last_became_peered":"2023-09-30T22:54:06.282576+0000","last_unstale":"2023-09-30T22:54:07.293370+0000","last_undegraded":"2023-09-30T22:54:07.293370+0000","last_fullsized":"2023-09-30T22:54:07.293370+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289816+0000","last_change":"2023-09-30T22:54:07.289495+0000","last_active":"2023-09-30T22:54:07.289816+0000","last_peered":"2023-09-30T22:54:07.289816+0000","last_clean":"2023-09-30T22:54:07.289816+0000","last_became_active":"2023-09-30T22:54:07.289283+0000","last_became_peered":"2023-09-30T22:54:07.289283+0000","last_unstale":"2023-09-30T22:54:07.289816+0000","last_undegraded":"2023-09-30T22:54:07.289816+0000","last_fullsized":"2023-09-30T22:54:07.289816+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:41.000107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294012+0000","last_change":"2023-09-30T22:54:06.285268+0000","last_active":"2023-09-30T22:54:07.294012+0000","last_peered":"2023-09-30T22:54:07.294012+0000","last_clean":"2023-09-30T22:54:07.294012+0000","last_became_active":"2023-09-30T22:54:06.284975+0000","last_became_peered":"2023-09-30T22:54:06.284975+0000","last_unstale":"2023-09-30T22:54:07.294012+0000","last_undegraded":"2023-09-30T22:54:07.294012+0000","last_fullsized":"2023-09-30T22:54:07.294012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288839+0000","last_change":"2023-09-30T22:54:07.288762+0000","last_active":"2023-09-30T22:54:07.288839+0000","last_peered":"2023-09-30T22:54:07.288839+0000","last_clean":"2023-09-30T22:54:07.288839+0000","last_became_active":"2023-09-30T22:54:07.288451+0000","last_became_peered":"2023-09-30T22:54:07.288451+0000","last_unstale":"2023-09-30T22:54:07.288839+0000","last_undegraded":"2023-09-30T22:54:07.288839+0000","last_fullsized":"2023-09-30T22:54:07.288839+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:04.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285519+0000","last_change":"2023-09-30T22:54:06.279537+0000","last_active":"2023-09-30T22:54:07.285519+0000","last_peered":"2023-09-30T22:54:07.285519+0000","last_clean":"2023-09-30T22:54:07.285519+0000","last_became_active":"2023-09-30T22:54:06.279241+0000","last_became_peered":"2023-09-30T22:54:06.279241+0000","last_unstale":"2023-09-30T22:54:07.285519+0000","last_undegraded":"2023-09-30T22:54:07.285519+0000","last_fullsized":"2023-09-30T22:54:07.285519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:33:04.622185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286844+0000","last_change":"2023-09-30T22:54:07.286569+0000","last_active":"2023-09-30T22:54:07.286844+0000","last_peered":"2023-09-30T22:54:07.286844+0000","last_clean":"2023-09-30T22:54:07.286844+0000","last_became_active":"2023-09-30T22:54:07.286198+0000","last_became_peered":"2023-09-30T22:54:07.286198+0000","last_unstale":"2023-09-30T22:54:07.286844+0000","last_undegraded":"2023-09-30T22:54:07.286844+0000","last_fullsized":"2023-09-30T22:54:07.286844+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276462+0000","last_change":"2023-09-30T22:54:06.280234+0000","last_active":"2023-09-30T22:54:07.276462+0000","last_peered":"2023-09-30T22:54:07.276462+0000","last_clean":"2023-09-30T22:54:07.276462+0000","last_became_active":"2023-09-30T22:54:06.279996+0000","last_became_peered":"2023-09-30T22:54:06.279996+0000","last_unstale":"2023-09-30T22:54:07.276462+0000","last_undegraded":"2023-09-30T22:54:07.276462+0000","last_fullsized":"2023-09-30T22:54:07.276462+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281797+0000","last_change":"2023-09-30T22:54:07.281697+0000","last_active":"2023-09-30T22:54:07.281797+0000","last_peered":"2023-09-30T22:54:07.281797+0000","last_clean":"2023-09-30T22:54:07.281797+0000","last_became_active":"2023-09-30T22:54:07.281257+0000","last_became_peered":"2023-09-30T22:54:07.281257+0000","last_unstale":"2023-09-30T22:54:07.281797+0000","last_undegraded":"2023-09-30T22:54:07.281797+0000","last_fullsized":"2023-09-30T22:54:07.281797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.409096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280608+0000","last_change":"2023-09-30T22:54:06.281185+0000","last_active":"2023-09-30T22:54:07.280608+0000","last_peered":"2023-09-30T22:54:07.280608+0000","last_clean":"2023-09-30T22:54:07.280608+0000","last_became_active":"2023-09-30T22:54:06.280705+0000","last_became_peered":"2023-09-30T22:54:06.280705+0000","last_unstale":"2023-09-30T22:54:07.280608+0000","last_undegraded":"2023-09-30T22:54:07.280608+0000","last_fullsized":"2023-09-30T22:54:07.280608+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:09.336177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292647+0000","last_change":"2023-09-30T22:54:07.292529+0000","last_active":"2023-09-30T22:54:07.292647+0000","last_peered":"2023-09-30T22:54:07.292647+0000","last_clean":"2023-09-30T22:54:07.292647+0000","last_became_active":"2023-09-30T22:54:07.291546+0000","last_became_peered":"2023-09-30T22:54:07.291546+0000","last_unstale":"2023-09-30T22:54:07.292647+0000","last_undegraded":"2023-09-30T22:54:07.292647+0000","last_fullsized":"2023-09-30T22:54:07.292647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:23.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.278998+0000","last_change":"2023-09-30T22:54:06.275367+0000","last_active":"2023-09-30T22:54:07.278998+0000","last_peered":"2023-09-30T22:54:07.278998+0000","last_clean":"2023-09-30T22:54:07.278998+0000","last_became_active":"2023-09-30T22:54:06.275116+0000","last_became_peered":"2023-09-30T22:54:06.275116+0000","last_unstale":"2023-09-30T22:54:07.278998+0000","last_undegraded":"2023-09-30T22:54:07.278998+0000","last_fullsized":"2023-09-30T22:54:07.278998+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:10.629629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281978+0000","last_change":"2023-09-30T22:54:07.281779+0000","last_active":"2023-09-30T22:54:07.281978+0000","last_peered":"2023-09-30T22:54:07.281978+0000","last_clean":"2023-09-30T22:54:07.281978+0000","last_became_active":"2023-09-30T22:54:07.281409+0000","last_became_peered":"2023-09-30T22:54:07.281409+0000","last_unstale":"2023-09-30T22:54:07.281978+0000","last_undegraded":"2023-09-30T22:54:07.281978+0000","last_fullsized":"2023-09-30T22:54:07.281978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:27:23.188033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275811+0000","last_change":"2023-09-30T22:54:06.271026+0000","last_active":"2023-09-30T22:54:07.275811+0000","last_peered":"2023-09-30T22:54:07.275811+0000","last_clean":"2023-09-30T22:54:07.275811+0000","last_became_active":"2023-09-30T22:54:06.270808+0000","last_became_peered":"2023-09-30T22:54:06.270808+0000","last_unstale":"2023-09-30T22:54:07.275811+0000","last_undegraded":"2023-09-30T22:54:07.275811+0000","last_fullsized":"2023-09-30T22:54:07.275811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:13.169498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291410+0000","last_change":"2023-09-30T22:54:07.289332+0000","last_active":"2023-09-30T22:54:07.291410+0000","last_peered":"2023-09-30T22:54:07.291410+0000","last_clean":"2023-09-30T22:54:07.291410+0000","last_became_active":"2023-09-30T22:54:07.288811+0000","last_became_peered":"2023-09-30T22:54:07.288811+0000","last_unstale":"2023-09-30T22:54:07.291410+0000","last_undegraded":"2023-09-30T22:54:07.291410+0000","last_fullsized":"2023-09-30T22:54:07.291410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284174+0000","last_change":"2023-09-30T22:54:06.281865+0000","last_active":"2023-09-30T22:54:07.284174+0000","last_peered":"2023-09-30T22:54:07.284174+0000","last_clean":"2023-09-30T22:54:07.284174+0000","last_became_active":"2023-09-30T22:54:06.281674+0000","last_became_peered":"2023-09-30T22:54:06.281674+0000","last_unstale":"2023-09-30T22:54:07.284174+0000","last_undegraded":"2023-09-30T22:54:07.284174+0000","last_fullsized":"2023-09-30T22:54:07.284174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:23.908829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289516+0000","last_change":"2023-09-30T22:54:07.289407+0000","last_active":"2023-09-30T22:54:07.289516+0000","last_peered":"2023-09-30T22:54:07.289516+0000","last_clean":"2023-09-30T22:54:07.289516+0000","last_became_active":"2023-09-30T22:54:07.289033+0000","last_became_peered":"2023-09-30T22:54:07.289033+0000","last_unstale":"2023-09-30T22:54:07.289516+0000","last_undegraded":"2023-09-30T22:54:07.289516+0000","last_fullsized":"2023-09-30T22:54:07.289516+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295932+0000","last_change":"2023-09-30T22:54:06.286681+0000","last_active":"2023-09-30T22:54:07.295932+0000","last_peered":"2023-09-30T22:54:07.295932+0000","last_clean":"2023-09-30T22:54:07.295932+0000","last_became_active":"2023-09-30T22:54:06.286440+0000","last_became_peered":"2023-09-30T22:54:06.286440+0000","last_unstale":"2023-09-30T22:54:07.295932+0000","last_undegraded":"2023-09-30T22:54:07.295932+0000","last_fullsized":"2023-09-30T22:54:07.295932+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291537+0000","last_change":"2023-09-30T22:54:07.291459+0000","last_active":"2023-09-30T22:54:07.291537+0000","last_peered":"2023-09-30T22:54:07.291537+0000","last_clean":"2023-09-30T22:54:07.291537+0000","last_became_active":"2023-09-30T22:54:07.291228+0000","last_became_peered":"2023-09-30T22:54:07.291228+0000","last_unstale":"2023-09-30T22:54:07.291537+0000","last_undegraded":"2023-09-30T22:54:07.291537+0000","last_fullsized":"2023-09-30T22:54:07.291537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:40.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294820+0000","last_change":"2023-09-30T22:54:06.276631+0000","last_active":"2023-09-30T22:54:07.294820+0000","last_peered":"2023-09-30T22:54:07.294820+0000","last_clean":"2023-09-30T22:54:07.294820+0000","last_became_active":"2023-09-30T22:54:06.276205+0000","last_became_peered":"2023-09-30T22:54:06.276205+0000","last_unstale":"2023-09-30T22:54:07.294820+0000","last_undegraded":"2023-09-30T22:54:07.294820+0000","last_fullsized":"2023-09-30T22:54:07.294820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276163+0000","last_change":"2023-09-30T22:54:07.276089+0000","last_active":"2023-09-30T22:54:07.276163+0000","last_peered":"2023-09-30T22:54:07.276163+0000","last_clean":"2023-09-30T22:54:07.276163+0000","last_became_active":"2023-09-30T22:54:07.275805+0000","last_became_peered":"2023-09-30T22:54:07.275805+0000","last_unstale":"2023-09-30T22:54:07.276163+0000","last_undegraded":"2023-09-30T22:54:07.276163+0000","last_fullsized":"2023-09-30T22:54:07.276163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279086+0000","last_change":"2023-09-30T22:54:06.278684+0000","last_active":"2023-09-30T22:54:07.279086+0000","last_peered":"2023-09-30T22:54:07.279086+0000","last_clean":"2023-09-30T22:54:07.279086+0000","last_became_active":"2023-09-30T22:54:06.278481+0000","last_became_peered":"2023-09-30T22:54:06.278481+0000","last_unstale":"2023-09-30T22:54:07.279086+0000","last_undegraded":"2023-09-30T22:54:07.279086+0000","last_fullsized":"2023-09-30T22:54:07.279086+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:55.393916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281373+0000","last_change":"2023-09-30T22:54:07.281290+0000","last_active":"2023-09-30T22:54:07.281373+0000","last_peered":"2023-09-30T22:54:07.281373+0000","last_clean":"2023-09-30T22:54:07.281373+0000","last_became_active":"2023-09-30T22:54:07.281060+0000","last_became_peered":"2023-09-30T22:54:07.281060+0000","last_unstale":"2023-09-30T22:54:07.281373+0000","last_undegraded":"2023-09-30T22:54:07.281373+0000","last_fullsized":"2023-09-30T22:54:07.281373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285915+0000","last_change":"2023-09-30T22:54:06.277690+0000","last_active":"2023-09-30T22:54:07.285915+0000","last_peered":"2023-09-30T22:54:07.285915+0000","last_clean":"2023-09-30T22:54:07.285915+0000","last_became_active":"2023-09-30T22:54:06.277355+0000","last_became_peered":"2023-09-30T22:54:06.277355+0000","last_unstale":"2023-09-30T22:54:07.285915+0000","last_undegraded":"2023-09-30T22:54:07.285915+0000","last_fullsized":"2023-09-30T22:54:07.285915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:53.590302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288633+0000","last_change":"2023-09-30T22:54:07.288573+0000","last_active":"2023-09-30T22:54:07.288633+0000","last_peered":"2023-09-30T22:54:07.288633+0000","last_clean":"2023-09-30T22:54:07.288633+0000","last_became_active":"2023-09-30T22:54:07.287765+0000","last_became_peered":"2023-09-30T22:54:07.287765+0000","last_unstale":"2023-09-30T22:54:07.288633+0000","last_undegraded":"2023-09-30T22:54:07.288633+0000","last_fullsized":"2023-09-30T22:54:07.288633+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:27.314727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295216+0000","last_change":"2023-09-30T22:54:06.286073+0000","last_active":"2023-09-30T22:54:07.295216+0000","last_peered":"2023-09-30T22:54:07.295216+0000","last_clean":"2023-09-30T22:54:07.295216+0000","last_became_active":"2023-09-30T22:54:06.285829+0000","last_became_peered":"2023-09-30T22:54:06.285829+0000","last_unstale":"2023-09-30T22:54:07.295216+0000","last_undegraded":"2023-09-30T22:54:07.295216+0000","last_fullsized":"2023-09-30T22:54:07.295216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:39.997183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277782+0000","last_change":"2023-09-30T22:54:07.277704+0000","last_active":"2023-09-30T22:54:07.277782+0000","last_peered":"2023-09-30T22:54:07.277782+0000","last_clean":"2023-09-30T22:54:07.277782+0000","last_became_active":"2023-09-30T22:54:07.277473+0000","last_became_peered":"2023-09-30T22:54:07.277473+0000","last_unstale":"2023-09-30T22:54:07.277782+0000","last_undegraded":"2023-09-30T22:54:07.277782+0000","last_fullsized":"2023-09-30T22:54:07.277782+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294141+0000","last_change":"2023-09-30T22:54:06.283300+0000","last_active":"2023-09-30T22:54:07.294141+0000","last_peered":"2023-09-30T22:54:07.294141+0000","last_clean":"2023-09-30T22:54:07.294141+0000","last_became_active":"2023-09-30T22:54:06.282769+0000","last_became_peered":"2023-09-30T22:54:06.282769+0000","last_unstale":"2023-09-30T22:54:07.294141+0000","last_undegraded":"2023-09-30T22:54:07.294141+0000","last_fullsized":"2023-09-30T22:54:07.294141+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291447+0000","last_change":"2023-09-30T22:54:07.290082+0000","last_active":"2023-09-30T22:54:07.291447+0000","last_peered":"2023-09-30T22:54:07.291447+0000","last_clean":"2023-09-30T22:54:07.291447+0000","last_became_active":"2023-09-30T22:54:07.289698+0000","last_became_peered":"2023-09-30T22:54:07.289698+0000","last_unstale":"2023-09-30T22:54:07.291447+0000","last_undegraded":"2023-09-30T22:54:07.291447+0000","last_fullsized":"2023-09-30T22:54:07.291447+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290647+0000","last_change":"2023-09-30T22:54:06.276472+0000","last_active":"2023-09-30T22:54:07.290647+0000","last_peered":"2023-09-30T22:54:07.290647+0000","last_clean":"2023-09-30T22:54:07.290647+0000","last_became_active":"2023-09-30T22:54:06.275828+0000","last_became_peered":"2023-09-30T22:54:06.275828+0000","last_unstale":"2023-09-30T22:54:07.290647+0000","last_undegraded":"2023-09-30T22:54:07.290647+0000","last_fullsized":"2023-09-30T22:54:07.290647+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:54.384228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292887+0000","last_change":"2023-09-30T22:54:07.292818+0000","last_active":"2023-09-30T22:54:07.292887+0000","last_peered":"2023-09-30T22:54:07.292887+0000","last_clean":"2023-09-30T22:54:07.292887+0000","last_became_active":"2023-09-30T22:54:07.292518+0000","last_became_peered":"2023-09-30T22:54:07.292518+0000","last_unstale":"2023-09-30T22:54:07.292887+0000","last_undegraded":"2023-09-30T22:54:07.292887+0000","last_fullsized":"2023-09-30T22:54:07.292887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292192+0000","last_change":"2023-09-30T22:54:06.281858+0000","last_active":"2023-09-30T22:54:07.292192+0000","last_peered":"2023-09-30T22:54:07.292192+0000","last_clean":"2023-09-30T22:54:07.292192+0000","last_became_active":"2023-09-30T22:54:06.281635+0000","last_became_peered":"2023-09-30T22:54:06.281635+0000","last_unstale":"2023-09-30T22:54:07.292192+0000","last_undegraded":"2023-09-30T22:54:07.292192+0000","last_fullsized":"2023-09-30T22:54:07.292192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:26.021090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279540+0000","last_change":"2023-09-30T22:54:07.279437+0000","last_active":"2023-09-30T22:54:07.279540+0000","last_peered":"2023-09-30T22:54:07.279540+0000","last_clean":"2023-09-30T22:54:07.279540+0000","last_became_active":"2023-09-30T22:54:07.278738+0000","last_became_peered":"2023-09-30T22:54:07.278738+0000","last_unstale":"2023-09-30T22:54:07.279540+0000","last_undegraded":"2023-09-30T22:54:07.279540+0000","last_fullsized":"2023-09-30T22:54:07.279540+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286027+0000","last_change":"2023-09-30T22:54:06.283372+0000","last_active":"2023-09-30T22:54:07.286027+0000","last_peered":"2023-09-30T22:54:07.286027+0000","last_clean":"2023-09-30T22:54:07.286027+0000","last_became_active":"2023-09-30T22:54:06.283156+0000","last_became_peered":"2023-09-30T22:54:06.283156+0000","last_unstale":"2023-09-30T22:54:07.286027+0000","last_undegraded":"2023-09-30T22:54:07.286027+0000","last_fullsized":"2023-09-30T22:54:07.286027+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:24:10.857387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288012+0000","last_change":"2023-09-30T22:54:07.287736+0000","last_active":"2023-09-30T22:54:07.288012+0000","last_peered":"2023-09-30T22:54:07.288012+0000","last_clean":"2023-09-30T22:54:07.288012+0000","last_became_active":"2023-09-30T22:54:07.287358+0000","last_became_peered":"2023-09-30T22:54:07.287358+0000","last_unstale":"2023-09-30T22:54:07.288012+0000","last_undegraded":"2023-09-30T22:54:07.288012+0000","last_fullsized":"2023-09-30T22:54:07.288012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295776+0000","last_change":"2023-09-30T22:54:06.278096+0000","last_active":"2023-09-30T22:54:07.295776+0000","last_peered":"2023-09-30T22:54:07.295776+0000","last_clean":"2023-09-30T22:54:07.295776+0000","last_became_active":"2023-09-30T22:54:06.274665+0000","last_became_peered":"2023-09-30T22:54:06.274665+0000","last_unstale":"2023-09-30T22:54:07.295776+0000","last_undegraded":"2023-09-30T22:54:07.295776+0000","last_fullsized":"2023-09-30T22:54:07.295776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290301+0000","last_change":"2023-09-30T22:54:07.290229+0000","last_active":"2023-09-30T22:54:07.290301+0000","last_peered":"2023-09-30T22:54:07.290301+0000","last_clean":"2023-09-30T22:54:07.290301+0000","last_became_active":"2023-09-30T22:54:07.290009+0000","last_became_peered":"2023-09-30T22:54:07.290009+0000","last_unstale":"2023-09-30T22:54:07.290301+0000","last_undegraded":"2023-09-30T22:54:07.290301+0000","last_fullsized":"2023-09-30T22:54:07.290301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:27.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280023+0000","last_change":"2023-09-30T22:54:06.281951+0000","last_active":"2023-09-30T22:54:07.280023+0000","last_peered":"2023-09-30T22:54:07.280023+0000","last_clean":"2023-09-30T22:54:07.280023+0000","last_became_active":"2023-09-30T22:54:06.281513+0000","last_became_peered":"2023-09-30T22:54:06.281513+0000","last_unstale":"2023-09-30T22:54:07.280023+0000","last_undegraded":"2023-09-30T22:54:07.280023+0000","last_fullsized":"2023-09-30T22:54:07.280023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291431+0000","last_change":"2023-09-30T22:54:07.289474+0000","last_active":"2023-09-30T22:54:07.291431+0000","last_peered":"2023-09-30T22:54:07.291431+0000","last_clean":"2023-09-30T22:54:07.291431+0000","last_became_active":"2023-09-30T22:54:07.289121+0000","last_became_peered":"2023-09-30T22:54:07.289121+0000","last_unstale":"2023-09-30T22:54:07.291431+0000","last_undegraded":"2023-09-30T22:54:07.291431+0000","last_fullsized":"2023-09-30T22:54:07.291431+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276066+0000","last_change":"2023-09-30T22:54:06.284019+0000","last_active":"2023-09-30T22:54:07.276066+0000","last_peered":"2023-09-30T22:54:07.276066+0000","last_clean":"2023-09-30T22:54:07.276066+0000","last_became_active":"2023-09-30T22:54:06.283783+0000","last_became_peered":"2023-09-30T22:54:06.283783+0000","last_unstale":"2023-09-30T22:54:07.276066+0000","last_undegraded":"2023-09-30T22:54:07.276066+0000","last_fullsized":"2023-09-30T22:54:07.276066+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:45.528979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280961+0000","last_change":"2023-09-30T22:54:07.280854+0000","last_active":"2023-09-30T22:54:07.280961+0000","last_peered":"2023-09-30T22:54:07.280961+0000","last_clean":"2023-09-30T22:54:07.280961+0000","last_became_active":"2023-09-30T22:54:07.280389+0000","last_became_peered":"2023-09-30T22:54:07.280389+0000","last_unstale":"2023-09-30T22:54:07.280961+0000","last_undegraded":"2023-09-30T22:54:07.280961+0000","last_fullsized":"2023-09-30T22:54:07.280961+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:59.949127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.273211+0000","last_change":"2023-09-30T22:54:06.280742+0000","last_active":"2023-09-30T22:54:07.273211+0000","last_peered":"2023-09-30T22:54:07.273211+0000","last_clean":"2023-09-30T22:54:07.273211+0000","last_became_active":"2023-09-30T22:54:06.280380+0000","last_became_peered":"2023-09-30T22:54:06.280380+0000","last_unstale":"2023-09-30T22:54:07.273211+0000","last_undegraded":"2023-09-30T22:54:07.273211+0000","last_fullsized":"2023-09-30T22:54:07.273211+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:01.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289627+0000","last_change":"2023-09-30T22:54:07.289546+0000","last_active":"2023-09-30T22:54:07.289627+0000","last_peered":"2023-09-30T22:54:07.289627+0000","last_clean":"2023-09-30T22:54:07.289627+0000","last_became_active":"2023-09-30T22:54:07.289175+0000","last_became_peered":"2023-09-30T22:54:07.289175+0000","last_unstale":"2023-09-30T22:54:07.289627+0000","last_undegraded":"2023-09-30T22:54:07.289627+0000","last_fullsized":"2023-09-30T22:54:07.289627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:58:29.360202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285151+0000","last_change":"2023-09-30T22:54:06.277243+0000","last_active":"2023-09-30T22:54:07.285151+0000","last_peered":"2023-09-30T22:54:07.285151+0000","last_clean":"2023-09-30T22:54:07.285151+0000","last_became_active":"2023-09-30T22:54:06.276913+0000","last_became_peered":"2023-09-30T22:54:06.276913+0000","last_unstale":"2023-09-30T22:54:07.285151+0000","last_undegraded":"2023-09-30T22:54:07.285151+0000","last_fullsized":"2023-09-30T22:54:07.285151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:04.627516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275923+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:54:07.275923+0000","last_peered":"2023-09-30T22:54:07.275923+0000","last_clean":"2023-09-30T22:54:07.275923+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:54:07.275923+0000","last_undegraded":"2023-09-30T22:54:07.275923+0000","last_fullsized":"2023-09-30T22:54:07.275923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281761+0000","last_change":"2023-09-30T22:54:07.281484+0000","last_active":"2023-09-30T22:54:07.281761+0000","last_peered":"2023-09-30T22:54:07.281761+0000","last_clean":"2023-09-30T22:54:07.281761+0000","last_became_active":"2023-09-30T22:54:07.280948+0000","last_became_peered":"2023-09-30T22:54:07.280948+0000","last_unstale":"2023-09-30T22:54:07.281761+0000","last_undegraded":"2023-09-30T22:54:07.281761+0000","last_fullsized":"2023-09-30T22:54:07.281761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:24.911752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285935+0000","last_change":"2023-09-30T22:54:06.280275+0000","last_active":"2023-09-30T22:54:07.285935+0000","last_peered":"2023-09-30T22:54:07.285935+0000","last_clean":"2023-09-30T22:54:07.285935+0000","last_became_active":"2023-09-30T22:54:06.280036+0000","last_became_peered":"2023-09-30T22:54:06.280036+0000","last_unstale":"2023-09-30T22:54:07.285935+0000","last_undegraded":"2023-09-30T22:54:07.285935+0000","last_fullsized":"2023-09-30T22:54:07.285935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277374+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:54:07.277374+0000","last_peered":"2023-09-30T22:54:07.277374+0000","last_clean":"2023-09-30T22:54:07.277374+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:54:07.277374+0000","last_undegraded":"2023-09-30T22:54:07.277374+0000","last_fullsized":"2023-09-30T22:54:07.277374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288611+0000","last_change":"2023-09-30T22:54:07.288374+0000","last_active":"2023-09-30T22:54:07.288611+0000","last_peered":"2023-09-30T22:54:07.288611+0000","last_clean":"2023-09-30T22:54:07.288611+0000","last_became_active":"2023-09-30T22:54:07.287298+0000","last_became_peered":"2023-09-30T22:54:07.287298+0000","last_unstale":"2023-09-30T22:54:07.288611+0000","last_undegraded":"2023-09-30T22:54:07.288611+0000","last_fullsized":"2023-09-30T22:54:07.288611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:48.421115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280430+0000","last_change":"2023-09-30T22:54:06.280988+0000","last_active":"2023-09-30T22:54:07.280430+0000","last_peered":"2023-09-30T22:54:07.280430+0000","last_clean":"2023-09-30T22:54:07.280430+0000","last_became_active":"2023-09-30T22:54:06.280317+0000","last_became_peered":"2023-09-30T22:54:06.280317+0000","last_unstale":"2023-09-30T22:54:07.280430+0000","last_undegraded":"2023-09-30T22:54:07.280430+0000","last_fullsized":"2023-09-30T22:54:07.280430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:26.869196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275293+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:54:07.275293+0000","last_peered":"2023-09-30T22:54:07.275293+0000","last_clean":"2023-09-30T22:54:07.275293+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:54:07.275293+0000","last_undegraded":"2023-09-30T22:54:07.275293+0000","last_fullsized":"2023-09-30T22:54:07.275293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292811+0000","last_change":"2023-09-30T22:54:07.292676+0000","last_active":"2023-09-30T22:54:07.292811+0000","last_peered":"2023-09-30T22:54:07.292811+0000","last_clean":"2023-09-30T22:54:07.292811+0000","last_became_active":"2023-09-30T22:54:07.292313+0000","last_became_peered":"2023-09-30T22:54:07.292313+0000","last_unstale":"2023-09-30T22:54:07.292811+0000","last_undegraded":"2023-09-30T22:54:07.292811+0000","last_fullsized":"2023-09-30T22:54:07.292811+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:14.681908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-09-30T22:54:10.265427+0000","last_change":"2023-09-30T22:54:06.281336+0000","last_active":"2023-09-30T22:54:10.265427+0000","last_peered":"2023-09-30T22:54:10.265427+0000","last_clean":"2023-09-30T22:54:10.265427+0000","last_became_active":"2023-09-30T22:54:06.281041+0000","last_became_peered":"2023-09-30T22:54:06.281041+0000","last_unstale":"2023-09-30T22:54:10.265427+0000","last_undegraded":"2023-09-30T22:54:10.265427+0000","last_fullsized":"2023-09-30T22:54:10.265427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:22.348215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279095+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:54:07.279095+0000","last_peered":"2023-09-30T22:54:07.279095+0000","last_clean":"2023-09-30T22:54:07.279095+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:54:07.279095+0000","last_undegraded":"2023-09-30T22:54:07.279095+0000","last_fullsized":"2023-09-30T22:54:07.279095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276149+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:54:07.276149+0000","last_peered":"2023-09-30T22:54:07.276149+0000","last_clean":"2023-09-30T22:54:07.276149+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:54:07.276149+0000","last_undegraded":"2023-09-30T22:54:07.276149+0000","last_fullsized":"2023-09-30T22:54:07.276149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288059+0000","last_change":"2023-09-30T22:54:07.287202+0000","last_active":"2023-09-30T22:54:07.288059+0000","last_peered":"2023-09-30T22:54:07.288059+0000","last_clean":"2023-09-30T22:54:07.288059+0000","last_became_active":"2023-09-30T22:54:07.286951+0000","last_became_peered":"2023-09-30T22:54:07.286951+0000","last_unstale":"2023-09-30T22:54:07.288059+0000","last_undegraded":"2023-09-30T22:54:07.288059+0000","last_fullsized":"2023-09-30T22:54:07.288059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:56.396839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276635+0000","last_change":"2023-09-30T22:54:06.284834+0000","last_active":"2023-09-30T22:54:07.276635+0000","last_peered":"2023-09-30T22:54:07.276635+0000","last_clean":"2023-09-30T22:54:07.276635+0000","last_became_active":"2023-09-30T22:54:06.284671+0000","last_became_peered":"2023-09-30T22:54:06.284671+0000","last_unstale":"2023-09-30T22:54:07.276635+0000","last_undegraded":"2023-09-30T22:54:07.276635+0000","last_fullsized":"2023-09-30T22:54:07.276635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276709+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:54:07.276709+0000","last_peered":"2023-09-30T22:54:07.276709+0000","last_clean":"2023-09-30T22:54:07.276709+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:54:07.276709+0000","last_undegraded":"2023-09-30T22:54:07.276709+0000","last_fullsized":"2023-09-30T22:54:07.276709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279508+0000","last_change":"2023-09-30T22:54:07.279081+0000","last_active":"2023-09-30T22:54:07.279508+0000","last_peered":"2023-09-30T22:54:07.279508+0000","last_clean":"2023-09-30T22:54:07.279508+0000","last_became_active":"2023-09-30T22:54:07.278827+0000","last_became_peered":"2023-09-30T22:54:07.278827+0000","last_unstale":"2023-09-30T22:54:07.279508+0000","last_undegraded":"2023-09-30T22:54:07.279508+0000","last_fullsized":"2023-09-30T22:54:07.279508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276045+0000","last_change":"2023-09-30T22:54:06.281184+0000","last_active":"2023-09-30T22:54:07.276045+0000","last_peered":"2023-09-30T22:54:07.276045+0000","last_clean":"2023-09-30T22:54:07.276045+0000","last_became_active":"2023-09-30T22:54:06.280960+0000","last_became_peered":"2023-09-30T22:54:06.280960+0000","last_unstale":"2023-09-30T22:54:07.276045+0000","last_undegraded":"2023-09-30T22:54:07.276045+0000","last_fullsized":"2023-09-30T22:54:07.276045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:45.532201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276538+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:54:07.276538+0000","last_peered":"2023-09-30T22:54:07.276538+0000","last_clean":"2023-09-30T22:54:07.276538+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:54:07.276538+0000","last_undegraded":"2023-09-30T22:54:07.276538+0000","last_fullsized":"2023-09-30T22:54:07.276538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.282469+0000","last_change":"2023-09-30T22:54:07.282400+0000","last_active":"2023-09-30T22:54:07.282469+0000","last_peered":"2023-09-30T22:54:07.282469+0000","last_clean":"2023-09-30T22:54:07.282469+0000","last_became_active":"2023-09-30T22:54:07.281984+0000","last_became_peered":"2023-09-30T22:54:07.281984+0000","last_unstale":"2023-09-30T22:54:07.282469+0000","last_undegraded":"2023-09-30T22:54:07.282469+0000","last_fullsized":"2023-09-30T22:54:07.282469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.273306+0000","last_change":"2023-09-30T22:54:06.280079+0000","last_active":"2023-09-30T22:54:07.273306+0000","last_peered":"2023-09-30T22:54:07.273306+0000","last_clean":"2023-09-30T22:54:07.273306+0000","last_became_active":"2023-09-30T22:54:06.279695+0000","last_became_peered":"2023-09-30T22:54:06.279695+0000","last_unstale":"2023-09-30T22:54:07.273306+0000","last_undegraded":"2023-09-30T22:54:07.273306+0000","last_fullsized":"2023-09-30T22:54:07.273306+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280345+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:54:07.280345+0000","last_peered":"2023-09-30T22:54:07.280345+0000","last_clean":"2023-09-30T22:54:07.280345+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:54:07.280345+0000","last_undegraded":"2023-09-30T22:54:07.280345+0000","last_fullsized":"2023-09-30T22:54:07.280345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289484+0000","last_change":"2023-09-30T22:54:07.288385+0000","last_active":"2023-09-30T22:54:07.289484+0000","last_peered":"2023-09-30T22:54:07.289484+0000","last_clean":"2023-09-30T22:54:07.289484+0000","last_became_active":"2023-09-30T22:54:07.288086+0000","last_became_peered":"2023-09-30T22:54:07.288086+0000","last_unstale":"2023-09-30T22:54:07.289484+0000","last_undegraded":"2023-09-30T22:54:07.289484+0000","last_fullsized":"2023-09-30T22:54:07.289484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284427+0000","last_change":"2023-09-30T22:54:06.283671+0000","last_active":"2023-09-30T22:54:07.284427+0000","last_peered":"2023-09-30T22:54:07.284427+0000","last_clean":"2023-09-30T22:54:07.284427+0000","last_became_active":"2023-09-30T22:54:06.283368+0000","last_became_peered":"2023-09-30T22:54:06.283368+0000","last_unstale":"2023-09-30T22:54:07.284427+0000","last_undegraded":"2023-09-30T22:54:07.284427+0000","last_fullsized":"2023-09-30T22:54:07.284427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277211+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:54:07.277211+0000","last_peered":"2023-09-30T22:54:07.277211+0000","last_clean":"2023-09-30T22:54:07.277211+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:54:07.277211+0000","last_undegraded":"2023-09-30T22:54:07.277211+0000","last_fullsized":"2023-09-30T22:54:07.277211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66100000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.745}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.78000000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.75}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.55500000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.80100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.437}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.91600000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.93500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.434},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.314},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758749,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.432},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.38700000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758693,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.98799999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.90300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757155,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.69899999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.624},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166789,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.78200000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.623}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.76500000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82199999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.83499999999999996}]}]}],"pool_statfs":[]}} 2023-09-30T22:54:12.561 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T22:54:12.739 INFO:tasks.ceph.mds.a.smithi142.stderr:2023-09-30T22:54:12.739+0000 7fb5da3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:54:12.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.782+0000 7ff892fff700 1 Processor -- start 2023-09-30T22:54:12.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.783+0000 7ff892fff700 1 -- start start 2023-09-30T22:54:12.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff892fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff88c159ae0 0x7ff88c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff892fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c0b1180 0x7ff88c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff892fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88c15d910 con 0x7ff88c159eb0 2023-09-30T22:54:12.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff892fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88c15e920 con 0x7ff88c159ae0 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff892fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c15e490 con 0x7ff88c0b1180 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff890d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff88c159ae0 0x7ff88c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff89159c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff88c159eb0 0x7ff88c068790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50456/0 (socket says 172.21.15.142:50456) 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff89159c700 1 -- 172.21.15.142:0/2320729958 learned_addr learned my addr 172.21.15.142:0/2320729958 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.784+0000 7ff88bfff700 1 --2- 172.21.15.142:0/2320729958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c0b1180 0x7ff88c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff890d9b700 1 -- 172.21.15.142:0/2320729958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c0b1180 msgr2=0x7ff88c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff890d9b700 1 --2- 172.21.15.142:0/2320729958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c0b1180 0x7ff88c0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff890d9b700 1 -- 172.21.15.142:0/2320729958 >> v1:172.21.15.142:6789/0 conn(0x7ff88c159eb0 legacy=0x7ff88c068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff890d9b700 1 -- 172.21.15.142:0/2320729958 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c15db60 con 0x7ff88c159ae0 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff88b7fe700 1 -- 172.21.15.142:0/2320729958 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389618630 0 0) 0x7ff88c15d910 con 0x7ff88c159eb0 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff890d9b700 1 --2- 172.21.15.142:0/2320729958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c159ae0 0x7ff88c0cdeb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8800098e0 tx=0x7ff8800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309ea1503a67464b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:12.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff88b7fe700 1 -- 172.21.15.142:0/2320729958 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880009e80 con 0x7ff88c159ae0 2023-09-30T22:54:12.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff88b7fe700 1 -- 172.21.15.142:0/2320729958 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000b860 con 0x7ff88c159ae0 2023-09-30T22:54:12.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.785+0000 7ff88b7fe700 1 -- 172.21.15.142:0/2320729958 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000bbe0 con 0x7ff88c159ae0 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 -- 172.21.15.142:0/2320729958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c159ae0 msgr2=0x7ff88c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 --2- 172.21.15.142:0/2320729958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c159ae0 0x7ff88c0cdeb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8800098e0 tx=0x7ff8800091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 -- 172.21.15.142:0/2320729958 shutdown_connections 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 --2- 172.21.15.142:0/2320729958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c159ae0 0x7ff88c0cdeb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 --2- 172.21.15.142:0/2320729958 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c0b1180 0x7ff88c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 -- 172.21.15.142:0/2320729958 >> 172.21.15.142:0/2320729958 conn(0x7ff88c0ce8b0 msgr2=0x7ff88c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 -- 172.21.15.142:0/2320729958 shutdown_connections 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.786+0000 7ff892fff700 1 -- 172.21.15.142:0/2320729958 wait complete. 2023-09-30T22:54:12.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.788+0000 7ff892fff700 1 Processor -- start 2023-09-30T22:54:12.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.788+0000 7ff892fff700 1 -- start start 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.789+0000 7ff892fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c0b1180 0x7ff88c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.789+0000 7ff892fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c159ae0 0x7ff88c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.789+0000 7ff892fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c159eb0 0x7ff88c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.789+0000 7ff892fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c15b780 con 0x7ff88c0b1180 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.789+0000 7ff892fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c152f20 con 0x7ff88c159eb0 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.789+0000 7ff892fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c15a8a0 con 0x7ff88c159ae0 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c0b1180 0x7ff88c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c0b1180 0x7ff88c0c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55510/0 (socket says 172.21.15.142:55510) 2023-09-30T22:54:12.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 -- 172.21.15.142:0/233268256 learned_addr learned my addr 172.21.15.142:0/233268256 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff88bfff700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c159ae0 0x7ff88c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff89159c700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c159eb0 0x7ff88c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 -- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c159ae0 msgr2=0x7ff88c1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c159ae0 0x7ff88c1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 -- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c159eb0 msgr2=0x7ff88c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c159eb0 0x7ff88c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 -- 172.21.15.142:0/233268256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009420 con 0x7ff88c0b1180 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff88bfff700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c159ae0 0x7ff88c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff89159c700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c159eb0 0x7ff88c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff890d9b700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c0b1180 0x7ff88c0c87f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff88c063f90 tx=0x7ff880017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.790+0000 7ff888ff9700 1 -- 172.21.15.142:0/233268256 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000b9d0 con 0x7ff88c0b1180 2023-09-30T22:54:12.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.791+0000 7ff888ff9700 1 -- 172.21.15.142:0/233268256 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000bb50 con 0x7ff88c0b1180 2023-09-30T22:54:12.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.791+0000 7ff892fff700 1 -- 172.21.15.142:0/233268256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c15ab70 con 0x7ff88c0b1180 2023-09-30T22:54:12.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.791+0000 7ff888ff9700 1 -- 172.21.15.142:0/233268256 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880025670 con 0x7ff88c0b1180 2023-09-30T22:54:12.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.791+0000 7ff892fff700 1 -- 172.21.15.142:0/233268256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c15b130 con 0x7ff88c0b1180 2023-09-30T22:54:12.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.792+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c06ea70 con 0x7ff88c0b1180 2023-09-30T22:54:12.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.792+0000 7ff888ff9700 1 -- 172.21.15.142:0/233268256 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff880023070 con 0x7ff88c0b1180 2023-09-30T22:54:12.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.793+0000 7ff888ff9700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff870067330 0x7ff8700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:12.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.793+0000 7ff888ff9700 1 -- 172.21.15.142:0/233268256 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff8800862e0 con 0x7ff88c0b1180 2023-09-30T22:54:12.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.794+0000 7ff88bfff700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff870067330 0x7ff8700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:12.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.794+0000 7ff88bfff700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff870067330 0x7ff8700697e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff88c159240 tx=0x7ff878008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:12.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:12.798+0000 7ff888ff9700 1 -- 172.21.15.142:0/233268256 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff880053140 con 0x7ff88c0b1180 2023-09-30T22:54:13.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.067+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff88c15de40 con 0x7ff88c0b1180 2023-09-30T22:54:13.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.068+0000 7ff888ff9700 1 -- 172.21.15.142:0/233268256 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1558 (secure 0 0 0) 0x7ff880056760 con 0x7ff88c0b1180 2023-09-30T22:54:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:13.068 INFO:teuthology.orchestra.run.smithi142.stdout:{"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":123,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1696114335,"num_in_osds":8,"osd_in_since":1696114332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592674,"bytes_used":3115084,"bytes_avail":1596884916,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5376}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-09-30T22:53:18.112881+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff870067330 msgr2=0x7ff8700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff870067330 0x7ff8700697e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff88c159240 tx=0x7ff878008040 comp rx=0 tx=0).stop 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c0b1180 msgr2=0x7ff88c0c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c0b1180 0x7ff88c0c87f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff88c063f90 tx=0x7ff880017000 comp rx=0 tx=0).stop 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 shutdown_connections 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff870067330 0x7ff8700697e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c159eb0 0x7ff88c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff88c0b1180 0x7ff88c0c87f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 --2- 172.21.15.142:0/233268256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff88c159ae0 0x7ff88c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 >> 172.21.15.142:0/233268256 conn(0x7ff88c0ce8b0 msgr2=0x7ff88c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:13.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 shutdown_connections 2023-09-30T22:54:13.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.070+0000 7ff8767fc700 1 -- 172.21.15.142:0/233268256 wait complete. 2023-09-30T22:54:13.088 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T22:54:13.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:54:13.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.277+0000 7f51a59ff700 1 Processor -- start 2023-09-30T22:54:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.277+0000 7f51a59ff700 1 -- start start 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f51a59ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f51a59ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51a006e820 0x7f51a015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f51a59ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a006d3e0 con 0x7f51a00b00d0 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f51a59ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a006dc80 con 0x7f51a006e820 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f51a59ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a006b790 con 0x7f51a00af020 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f5197fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f51a00b00d0 0x7f51a006e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50464/0 (socket says 172.21.15.142:50464) 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f5197fff700 1 -- 172.21.15.142:0/2195647318 learned_addr learned my addr 172.21.15.142:0/2195647318 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f519f7fe700 1 --2- 172.21.15.142:0/2195647318 >> v2:172.21.15.142:3300/0 conn(0x7f51a006e820 0x7f51a015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f519effd700 1 --2- 172.21.15.142:0/2195647318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.279+0000 7f519e7fc700 1 -- 172.21.15.142:0/2195647318 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480749701 0 0) 0x7f51a006d3e0 con 0x7f51a00b00d0 2023-09-30T22:54:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519f7fe700 1 -- 172.21.15.142:0/2195647318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 msgr2=0x7f51a0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519f7fe700 1 --2- 172.21.15.142:0/2195647318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519f7fe700 1 -- 172.21.15.142:0/2195647318 >> v1:172.21.15.142:6789/0 conn(0x7f51a00b00d0 legacy=0x7f51a006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519f7fe700 1 -- 172.21.15.142:0/2195647318 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00b0650 con 0x7f51a006e820 2023-09-30T22:54:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519effd700 1 --2- 172.21.15.142:0/2195647318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519f7fe700 1 --2- 172.21.15.142:0/2195647318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a015a3f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5198009e60 tx=0x7f5198009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fa05915f1f6ace server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519e7fc700 1 -- 172.21.15.142:0/2195647318 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519800bc30 con 0x7f51a006e820 2023-09-30T22:54:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519e7fc700 1 -- 172.21.15.142:0/2195647318 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519800bd90 con 0x7f51a006e820 2023-09-30T22:54:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.280+0000 7f519e7fc700 1 -- 172.21.15.142:0/2195647318 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51980116b0 con 0x7f51a006e820 2023-09-30T22:54:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 -- 172.21.15.142:0/2195647318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 msgr2=0x7f51a015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 --2- 172.21.15.142:0/2195647318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a015a3f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5198009e60 tx=0x7f5198009780 comp rx=0 tx=0).stop 2023-09-30T22:54:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 -- 172.21.15.142:0/2195647318 shutdown_connections 2023-09-30T22:54:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 --2- 172.21.15.142:0/2195647318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a015a3f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 --2- 172.21.15.142:0/2195647318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 -- 172.21.15.142:0/2195647318 >> 172.21.15.142:0/2195647318 conn(0x7f51a00680c0 msgr2=0x7f51a00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 -- 172.21.15.142:0/2195647318 shutdown_connections 2023-09-30T22:54:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.281+0000 7f51a59ff700 1 -- 172.21.15.142:0/2195647318 wait complete. 2023-09-30T22:54:13.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.282+0000 7f51a59ff700 1 Processor -- start 2023-09-30T22:54:13.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.282+0000 7f51a59ff700 1 -- start start 2023-09-30T22:54:13.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f51a59ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a00ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:13.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f51a59ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:13.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f51a59ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a00b00d0 0x7f51a0165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:13.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f51a59ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00ae350 con 0x7f51a006e820 2023-09-30T22:54:13.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f51a59ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00c3890 con 0x7f51a00b00d0 2023-09-30T22:54:13.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f51a59ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0166840 con 0x7f51a00af020 2023-09-30T22:54:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f519effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a00ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f519effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a00ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55536/0 (socket says 172.21.15.142:55536) 2023-09-30T22:54:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.283+0000 7f519effd700 1 -- 172.21.15.142:0/1310864069 learned_addr learned my addr 172.21.15.142:0/1310864069 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f5197fff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519f7fe700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a00b00d0 0x7f51a0165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519effd700 1 -- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 msgr2=0x7f51a0150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519effd700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519effd700 1 -- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a00b00d0 msgr2=0x7f51a0165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519effd700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a00b00d0 0x7f51a0165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519effd700 1 -- 172.21.15.142:0/1310864069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198009a20 con 0x7f51a006e820 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519f7fe700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a00b00d0 0x7f51a0165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f519effd700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a00ade10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f519000e8d0 tx=0x7f5190008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f5196ffd700 1 -- 172.21.15.142:0/1310864069 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000ee70 con 0x7f51a006e820 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f5196ffd700 1 -- 172.21.15.142:0/1310864069 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519000c5e0 con 0x7f51a006e820 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a0166b20 con 0x7f51a006e820 2023-09-30T22:54:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.284+0000 7f5196ffd700 1 -- 172.21.15.142:0/1310864069 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000c980 con 0x7f51a006e820 2023-09-30T22:54:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.285+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a00c3e10 con 0x7f51a006e820 2023-09-30T22:54:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.285+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a00695b0 con 0x7f51a006e820 2023-09-30T22:54:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.286+0000 7f5196ffd700 1 -- 172.21.15.142:0/1310864069 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5190013410 con 0x7f51a006e820 2023-09-30T22:54:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.287+0000 7f5196ffd700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5180067330 0x7f51800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.287+0000 7f5196ffd700 1 -- 172.21.15.142:0/1310864069 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5190084a50 con 0x7f51a006e820 2023-09-30T22:54:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.287+0000 7f5197fff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5180067330 0x7f51800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.288+0000 7f5197fff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5180067330 0x7f51800697e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51a0163880 tx=0x7f5188009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:13.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.292+0000 7f5196ffd700 1 -- 172.21.15.142:0/1310864069 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f51900518b0 con 0x7f51a006e820 2023-09-30T22:54:13.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.478+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51a006fc10 con 0x7f5180067330 2023-09-30T22:54:13.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.487+0000 7f5196ffd700 1 -- 172.21.15.142:0/1310864069 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303625 (secure 0 0 0) 0x7f51a006fc10 con 0x7f5180067330 2023-09-30T22:54:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:13.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5180067330 msgr2=0x7f51800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5180067330 0x7f51800697e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51a0163880 tx=0x7f5188009040 comp rx=0 tx=0).stop 2023-09-30T22:54:13.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 msgr2=0x7f51a00ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:13.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a00ade10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f519000e8d0 tx=0x7f5190008040 comp rx=0 tx=0).stop 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 shutdown_connections 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5180067330 0x7f51800697e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a00b00d0 0x7f51a0165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51a006e820 0x7f51a00ade10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 --2- 172.21.15.142:0/1310864069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51a00af020 0x7f51a0150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 >> 172.21.15.142:0/1310864069 conn(0x7f51a00680c0 msgr2=0x7f51a00c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 shutdown_connections 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:13.491+0000 7f51a59ff700 1 -- 172.21.15.142:0/1310864069 wait complete. 2023-09-30T22:54:13.494 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:54:13.509 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-09-30T22:54:12.122550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559457,"statfs":{"total":1600000000,"available":1596884916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001167"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284476+0000","last_change":"2023-09-30T22:54:07.282459+0000","last_active":"2023-09-30T22:54:07.284476+0000","last_peered":"2023-09-30T22:54:07.284476+0000","last_clean":"2023-09-30T22:54:07.284476+0000","last_became_active":"2023-09-30T22:54:07.282015+0000","last_became_peered":"2023-09-30T22:54:07.282015+0000","last_unstale":"2023-09-30T22:54:07.284476+0000","last_undegraded":"2023-09-30T22:54:07.284476+0000","last_fullsized":"2023-09-30T22:54:07.284476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289501+0000","last_change":"2023-09-30T22:54:07.289263+0000","last_active":"2023-09-30T22:54:07.289501+0000","last_peered":"2023-09-30T22:54:07.289501+0000","last_clean":"2023-09-30T22:54:07.289501+0000","last_became_active":"2023-09-30T22:54:07.288712+0000","last_became_peered":"2023-09-30T22:54:07.288712+0000","last_unstale":"2023-09-30T22:54:07.289501+0000","last_undegraded":"2023-09-30T22:54:07.289501+0000","last_fullsized":"2023-09-30T22:54:07.289501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288954+0000","last_change":"2023-09-30T22:54:07.288841+0000","last_active":"2023-09-30T22:54:07.288954+0000","last_peered":"2023-09-30T22:54:07.288954+0000","last_clean":"2023-09-30T22:54:07.288954+0000","last_became_active":"2023-09-30T22:54:07.288122+0000","last_became_peered":"2023-09-30T22:54:07.288122+0000","last_unstale":"2023-09-30T22:54:07.288954+0000","last_undegraded":"2023-09-30T22:54:07.288954+0000","last_fullsized":"2023-09-30T22:54:07.288954+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:12:30.609061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281780+0000","last_change":"2023-09-30T22:54:07.281645+0000","last_active":"2023-09-30T22:54:07.281780+0000","last_peered":"2023-09-30T22:54:07.281780+0000","last_clean":"2023-09-30T22:54:07.281780+0000","last_became_active":"2023-09-30T22:54:07.281094+0000","last_became_peered":"2023-09-30T22:54:07.281094+0000","last_unstale":"2023-09-30T22:54:07.281780+0000","last_undegraded":"2023-09-30T22:54:07.281780+0000","last_fullsized":"2023-09-30T22:54:07.281780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:41:06.753884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287989+0000","last_change":"2023-09-30T22:54:07.287587+0000","last_active":"2023-09-30T22:54:07.287989+0000","last_peered":"2023-09-30T22:54:07.287989+0000","last_clean":"2023-09-30T22:54:07.287989+0000","last_became_active":"2023-09-30T22:54:07.286871+0000","last_became_peered":"2023-09-30T22:54:07.286871+0000","last_unstale":"2023-09-30T22:54:07.287989+0000","last_undegraded":"2023-09-30T22:54:07.287989+0000","last_fullsized":"2023-09-30T22:54:07.287989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283932+0000","last_change":"2023-09-30T22:54:07.283152+0000","last_active":"2023-09-30T22:54:07.283932+0000","last_peered":"2023-09-30T22:54:07.283932+0000","last_clean":"2023-09-30T22:54:07.283932+0000","last_became_active":"2023-09-30T22:54:07.282730+0000","last_became_peered":"2023-09-30T22:54:07.282730+0000","last_unstale":"2023-09-30T22:54:07.283932+0000","last_undegraded":"2023-09-30T22:54:07.283932+0000","last_fullsized":"2023-09-30T22:54:07.283932+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:56.396839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277267+0000","last_change":"2023-09-30T22:54:07.277170+0000","last_active":"2023-09-30T22:54:07.277267+0000","last_peered":"2023-09-30T22:54:07.277267+0000","last_clean":"2023-09-30T22:54:07.277267+0000","last_became_active":"2023-09-30T22:54:07.276895+0000","last_became_peered":"2023-09-30T22:54:07.276895+0000","last_unstale":"2023-09-30T22:54:07.277267+0000","last_undegraded":"2023-09-30T22:54:07.277267+0000","last_fullsized":"2023-09-30T22:54:07.277267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284345+0000","last_change":"2023-09-30T22:54:07.284266+0000","last_active":"2023-09-30T22:54:07.284345+0000","last_peered":"2023-09-30T22:54:07.284345+0000","last_clean":"2023-09-30T22:54:07.284345+0000","last_became_active":"2023-09-30T22:54:07.283659+0000","last_became_peered":"2023-09-30T22:54:07.283659+0000","last_unstale":"2023-09-30T22:54:07.284345+0000","last_undegraded":"2023-09-30T22:54:07.284345+0000","last_fullsized":"2023-09-30T22:54:07.284345+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289842+0000","last_change":"2023-09-30T22:54:07.289562+0000","last_active":"2023-09-30T22:54:07.289842+0000","last_peered":"2023-09-30T22:54:07.289842+0000","last_clean":"2023-09-30T22:54:07.289842+0000","last_became_active":"2023-09-30T22:54:07.288451+0000","last_became_peered":"2023-09-30T22:54:07.288451+0000","last_unstale":"2023-09-30T22:54:07.289842+0000","last_undegraded":"2023-09-30T22:54:07.289842+0000","last_fullsized":"2023-09-30T22:54:07.289842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:40.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291044+0000","last_change":"2023-09-30T22:54:07.290970+0000","last_active":"2023-09-30T22:54:07.291044+0000","last_peered":"2023-09-30T22:54:07.291044+0000","last_clean":"2023-09-30T22:54:07.291044+0000","last_became_active":"2023-09-30T22:54:07.290500+0000","last_became_peered":"2023-09-30T22:54:07.290500+0000","last_unstale":"2023-09-30T22:54:07.291044+0000","last_undegraded":"2023-09-30T22:54:07.291044+0000","last_fullsized":"2023-09-30T22:54:07.291044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284401+0000","last_change":"2023-09-30T22:54:07.282303+0000","last_active":"2023-09-30T22:54:07.284401+0000","last_peered":"2023-09-30T22:54:07.284401+0000","last_clean":"2023-09-30T22:54:07.284401+0000","last_became_active":"2023-09-30T22:54:07.281628+0000","last_became_peered":"2023-09-30T22:54:07.281628+0000","last_unstale":"2023-09-30T22:54:07.284401+0000","last_undegraded":"2023-09-30T22:54:07.284401+0000","last_fullsized":"2023-09-30T22:54:07.284401+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280940+0000","last_change":"2023-09-30T22:54:07.280635+0000","last_active":"2023-09-30T22:54:07.280940+0000","last_peered":"2023-09-30T22:54:07.280940+0000","last_clean":"2023-09-30T22:54:07.280940+0000","last_became_active":"2023-09-30T22:54:07.278955+0000","last_became_peered":"2023-09-30T22:54:07.278955+0000","last_unstale":"2023-09-30T22:54:07.280940+0000","last_undegraded":"2023-09-30T22:54:07.280940+0000","last_fullsized":"2023-09-30T22:54:07.280940+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285559+0000","last_change":"2023-09-30T22:54:07.284431+0000","last_active":"2023-09-30T22:54:07.285559+0000","last_peered":"2023-09-30T22:54:07.285559+0000","last_clean":"2023-09-30T22:54:07.285559+0000","last_became_active":"2023-09-30T22:54:07.284034+0000","last_became_peered":"2023-09-30T22:54:07.284034+0000","last_unstale":"2023-09-30T22:54:07.285559+0000","last_undegraded":"2023-09-30T22:54:07.285559+0000","last_fullsized":"2023-09-30T22:54:07.285559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:58:29.360202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284376+0000","last_change":"2023-09-30T22:54:07.281788+0000","last_active":"2023-09-30T22:54:07.284376+0000","last_peered":"2023-09-30T22:54:07.284376+0000","last_clean":"2023-09-30T22:54:07.284376+0000","last_became_active":"2023-09-30T22:54:07.280893+0000","last_became_peered":"2023-09-30T22:54:07.280893+0000","last_unstale":"2023-09-30T22:54:07.284376+0000","last_undegraded":"2023-09-30T22:54:07.284376+0000","last_fullsized":"2023-09-30T22:54:07.284376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288070+0000","last_change":"2023-09-30T22:54:07.287544+0000","last_active":"2023-09-30T22:54:07.288070+0000","last_peered":"2023-09-30T22:54:07.288070+0000","last_clean":"2023-09-30T22:54:07.288070+0000","last_became_active":"2023-09-30T22:54:07.287329+0000","last_became_peered":"2023-09-30T22:54:07.287329+0000","last_unstale":"2023-09-30T22:54:07.288070+0000","last_undegraded":"2023-09-30T22:54:07.288070+0000","last_fullsized":"2023-09-30T22:54:07.288070+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:47.026175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283952+0000","last_change":"2023-09-30T22:54:07.283851+0000","last_active":"2023-09-30T22:54:07.283952+0000","last_peered":"2023-09-30T22:54:07.283952+0000","last_clean":"2023-09-30T22:54:07.283952+0000","last_became_active":"2023-09-30T22:54:07.283376+0000","last_became_peered":"2023-09-30T22:54:07.283376+0000","last_unstale":"2023-09-30T22:54:07.283952+0000","last_undegraded":"2023-09-30T22:54:07.283952+0000","last_fullsized":"2023-09-30T22:54:07.283952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.278498+0000","last_change":"2023-09-30T22:54:07.278306+0000","last_active":"2023-09-30T22:54:07.278498+0000","last_peered":"2023-09-30T22:54:07.278498+0000","last_clean":"2023-09-30T22:54:07.278498+0000","last_became_active":"2023-09-30T22:54:07.278078+0000","last_became_peered":"2023-09-30T22:54:07.278078+0000","last_unstale":"2023-09-30T22:54:07.278498+0000","last_undegraded":"2023-09-30T22:54:07.278498+0000","last_fullsized":"2023-09-30T22:54:07.278498+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283192+0000","last_change":"2023-09-30T22:54:07.283092+0000","last_active":"2023-09-30T22:54:07.283192+0000","last_peered":"2023-09-30T22:54:07.283192+0000","last_clean":"2023-09-30T22:54:07.283192+0000","last_became_active":"2023-09-30T22:54:07.282732+0000","last_became_peered":"2023-09-30T22:54:07.282732+0000","last_unstale":"2023-09-30T22:54:07.283192+0000","last_undegraded":"2023-09-30T22:54:07.283192+0000","last_fullsized":"2023-09-30T22:54:07.283192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:10.339100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289824+0000","last_change":"2023-09-30T22:54:07.289420+0000","last_active":"2023-09-30T22:54:07.289824+0000","last_peered":"2023-09-30T22:54:07.289824+0000","last_clean":"2023-09-30T22:54:07.289824+0000","last_became_active":"2023-09-30T22:54:07.287804+0000","last_became_peered":"2023-09-30T22:54:07.287804+0000","last_unstale":"2023-09-30T22:54:07.289824+0000","last_undegraded":"2023-09-30T22:54:07.289824+0000","last_fullsized":"2023-09-30T22:54:07.289824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:58.841154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293662+0000","last_change":"2023-09-30T22:54:07.293573+0000","last_active":"2023-09-30T22:54:07.293662+0000","last_peered":"2023-09-30T22:54:07.293662+0000","last_clean":"2023-09-30T22:54:07.293662+0000","last_became_active":"2023-09-30T22:54:07.293351+0000","last_became_peered":"2023-09-30T22:54:07.293351+0000","last_unstale":"2023-09-30T22:54:07.293662+0000","last_undegraded":"2023-09-30T22:54:07.293662+0000","last_fullsized":"2023-09-30T22:54:07.293662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:22.311313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290814+0000","last_change":"2023-09-30T22:54:07.290744+0000","last_active":"2023-09-30T22:54:07.290814+0000","last_peered":"2023-09-30T22:54:07.290814+0000","last_clean":"2023-09-30T22:54:07.290814+0000","last_became_active":"2023-09-30T22:54:07.290452+0000","last_became_peered":"2023-09-30T22:54:07.290452+0000","last_unstale":"2023-09-30T22:54:07.290814+0000","last_undegraded":"2023-09-30T22:54:07.290814+0000","last_fullsized":"2023-09-30T22:54:07.290814+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:26.390802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285567+0000","last_change":"2023-09-30T22:54:07.285094+0000","last_active":"2023-09-30T22:54:07.285567+0000","last_peered":"2023-09-30T22:54:07.285567+0000","last_clean":"2023-09-30T22:54:07.285567+0000","last_became_active":"2023-09-30T22:54:07.284799+0000","last_became_peered":"2023-09-30T22:54:07.284799+0000","last_unstale":"2023-09-30T22:54:07.285567+0000","last_undegraded":"2023-09-30T22:54:07.285567+0000","last_fullsized":"2023-09-30T22:54:07.285567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:50.135141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293007+0000","last_change":"2023-09-30T22:54:07.292335+0000","last_active":"2023-09-30T22:54:07.293007+0000","last_peered":"2023-09-30T22:54:07.293007+0000","last_clean":"2023-09-30T22:54:07.293007+0000","last_became_active":"2023-09-30T22:54:07.291140+0000","last_became_peered":"2023-09-30T22:54:07.291140+0000","last_unstale":"2023-09-30T22:54:07.293007+0000","last_undegraded":"2023-09-30T22:54:07.293007+0000","last_fullsized":"2023-09-30T22:54:07.293007+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:39:08.162123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284565+0000","last_change":"2023-09-30T22:54:07.281031+0000","last_active":"2023-09-30T22:54:07.284565+0000","last_peered":"2023-09-30T22:54:07.284565+0000","last_clean":"2023-09-30T22:54:07.284565+0000","last_became_active":"2023-09-30T22:54:07.280787+0000","last_became_peered":"2023-09-30T22:54:07.280787+0000","last_unstale":"2023-09-30T22:54:07.284565+0000","last_undegraded":"2023-09-30T22:54:07.284565+0000","last_fullsized":"2023-09-30T22:54:07.284565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:16.744462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277149+0000","last_change":"2023-09-30T22:54:07.277070+0000","last_active":"2023-09-30T22:54:07.277149+0000","last_peered":"2023-09-30T22:54:07.277149+0000","last_clean":"2023-09-30T22:54:07.277149+0000","last_became_active":"2023-09-30T22:54:07.276819+0000","last_became_peered":"2023-09-30T22:54:07.276819+0000","last_unstale":"2023-09-30T22:54:07.277149+0000","last_undegraded":"2023-09-30T22:54:07.277149+0000","last_fullsized":"2023-09-30T22:54:07.277149+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287937+0000","last_change":"2023-09-30T22:54:07.287157+0000","last_active":"2023-09-30T22:54:07.287937+0000","last_peered":"2023-09-30T22:54:07.287937+0000","last_clean":"2023-09-30T22:54:07.287937+0000","last_became_active":"2023-09-30T22:54:07.286772+0000","last_became_peered":"2023-09-30T22:54:07.286772+0000","last_unstale":"2023-09-30T22:54:07.287937+0000","last_undegraded":"2023-09-30T22:54:07.287937+0000","last_fullsized":"2023-09-30T22:54:07.287937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:19:55.360729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288424+0000","last_change":"2023-09-30T22:54:07.286820+0000","last_active":"2023-09-30T22:54:07.288424+0000","last_peered":"2023-09-30T22:54:07.288424+0000","last_clean":"2023-09-30T22:54:07.288424+0000","last_became_active":"2023-09-30T22:54:07.286546+0000","last_became_peered":"2023-09-30T22:54:07.286546+0000","last_unstale":"2023-09-30T22:54:07.288424+0000","last_undegraded":"2023-09-30T22:54:07.288424+0000","last_fullsized":"2023-09-30T22:54:07.288424+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287972+0000","last_change":"2023-09-30T22:54:07.287275+0000","last_active":"2023-09-30T22:54:07.287972+0000","last_peered":"2023-09-30T22:54:07.287972+0000","last_clean":"2023-09-30T22:54:07.287972+0000","last_became_active":"2023-09-30T22:54:07.286742+0000","last_became_peered":"2023-09-30T22:54:07.286742+0000","last_unstale":"2023-09-30T22:54:07.287972+0000","last_undegraded":"2023-09-30T22:54:07.287972+0000","last_fullsized":"2023-09-30T22:54:07.287972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284532+0000","last_change":"2023-09-30T22:54:07.282640+0000","last_active":"2023-09-30T22:54:07.284532+0000","last_peered":"2023-09-30T22:54:07.284532+0000","last_clean":"2023-09-30T22:54:07.284532+0000","last_became_active":"2023-09-30T22:54:07.282407+0000","last_became_peered":"2023-09-30T22:54:07.282407+0000","last_unstale":"2023-09-30T22:54:07.284532+0000","last_undegraded":"2023-09-30T22:54:07.284532+0000","last_fullsized":"2023-09-30T22:54:07.284532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289997+0000","last_change":"2023-09-30T22:54:07.289529+0000","last_active":"2023-09-30T22:54:07.289997+0000","last_peered":"2023-09-30T22:54:07.289997+0000","last_clean":"2023-09-30T22:54:07.289997+0000","last_became_active":"2023-09-30T22:54:07.288847+0000","last_became_peered":"2023-09-30T22:54:07.288847+0000","last_unstale":"2023-09-30T22:54:07.289997+0000","last_undegraded":"2023-09-30T22:54:07.289997+0000","last_fullsized":"2023-09-30T22:54:07.289997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:27.314727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287911+0000","last_change":"2023-09-30T22:54:07.287004+0000","last_active":"2023-09-30T22:54:07.287911+0000","last_peered":"2023-09-30T22:54:07.287911+0000","last_clean":"2023-09-30T22:54:07.287911+0000","last_became_active":"2023-09-30T22:54:07.286466+0000","last_became_peered":"2023-09-30T22:54:07.286466+0000","last_unstale":"2023-09-30T22:54:07.287911+0000","last_undegraded":"2023-09-30T22:54:07.287911+0000","last_fullsized":"2023-09-30T22:54:07.287911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:38.748953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288051+0000","last_change":"2023-09-30T22:54:07.287889+0000","last_active":"2023-09-30T22:54:07.288051+0000","last_peered":"2023-09-30T22:54:07.288051+0000","last_clean":"2023-09-30T22:54:07.288051+0000","last_became_active":"2023-09-30T22:54:07.287632+0000","last_became_peered":"2023-09-30T22:54:07.287632+0000","last_unstale":"2023-09-30T22:54:07.288051+0000","last_undegraded":"2023-09-30T22:54:07.288051+0000","last_fullsized":"2023-09-30T22:54:07.288051+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284763+0000","last_change":"2023-09-30T22:54:07.284627+0000","last_active":"2023-09-30T22:54:07.284763+0000","last_peered":"2023-09-30T22:54:07.284763+0000","last_clean":"2023-09-30T22:54:07.284763+0000","last_became_active":"2023-09-30T22:54:07.284389+0000","last_became_peered":"2023-09-30T22:54:07.284389+0000","last_unstale":"2023-09-30T22:54:07.284763+0000","last_undegraded":"2023-09-30T22:54:07.284763+0000","last_fullsized":"2023-09-30T22:54:07.284763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:13:01.671172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286174+0000","last_change":"2023-09-30T22:54:06.274358+0000","last_active":"2023-09-30T22:54:07.286174+0000","last_peered":"2023-09-30T22:54:07.286174+0000","last_clean":"2023-09-30T22:54:07.286174+0000","last_became_active":"2023-09-30T22:54:06.274137+0000","last_became_peered":"2023-09-30T22:54:06.274137+0000","last_unstale":"2023-09-30T22:54:07.286174+0000","last_undegraded":"2023-09-30T22:54:07.286174+0000","last_fullsized":"2023-09-30T22:54:07.286174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285198+0000","last_change":"2023-09-30T22:54:07.285124+0000","last_active":"2023-09-30T22:54:07.285198+0000","last_peered":"2023-09-30T22:54:07.285198+0000","last_clean":"2023-09-30T22:54:07.285198+0000","last_became_active":"2023-09-30T22:54:07.284907+0000","last_became_peered":"2023-09-30T22:54:07.284907+0000","last_unstale":"2023-09-30T22:54:07.285198+0000","last_undegraded":"2023-09-30T22:54:07.285198+0000","last_fullsized":"2023-09-30T22:54:07.285198+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:54.397192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294231+0000","last_change":"2023-09-30T22:54:06.283446+0000","last_active":"2023-09-30T22:54:07.294231+0000","last_peered":"2023-09-30T22:54:07.294231+0000","last_clean":"2023-09-30T22:54:07.294231+0000","last_became_active":"2023-09-30T22:54:06.283085+0000","last_became_peered":"2023-09-30T22:54:06.283085+0000","last_unstale":"2023-09-30T22:54:07.294231+0000","last_undegraded":"2023-09-30T22:54:07.294231+0000","last_fullsized":"2023-09-30T22:54:07.294231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285704+0000","last_change":"2023-09-30T22:54:07.285545+0000","last_active":"2023-09-30T22:54:07.285704+0000","last_peered":"2023-09-30T22:54:07.285704+0000","last_clean":"2023-09-30T22:54:07.285704+0000","last_became_active":"2023-09-30T22:54:07.285330+0000","last_became_peered":"2023-09-30T22:54:07.285330+0000","last_unstale":"2023-09-30T22:54:07.285704+0000","last_undegraded":"2023-09-30T22:54:07.285704+0000","last_fullsized":"2023-09-30T22:54:07.285704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:04.259944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290820+0000","last_change":"2023-09-30T22:54:06.281913+0000","last_active":"2023-09-30T22:54:07.290820+0000","last_peered":"2023-09-30T22:54:07.290820+0000","last_clean":"2023-09-30T22:54:07.290820+0000","last_became_active":"2023-09-30T22:54:06.281648+0000","last_became_peered":"2023-09-30T22:54:06.281648+0000","last_unstale":"2023-09-30T22:54:07.290820+0000","last_undegraded":"2023-09-30T22:54:07.290820+0000","last_fullsized":"2023-09-30T22:54:07.290820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:52.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289610+0000","last_change":"2023-09-30T22:54:07.289396+0000","last_active":"2023-09-30T22:54:07.289610+0000","last_peered":"2023-09-30T22:54:07.289610+0000","last_clean":"2023-09-30T22:54:07.289610+0000","last_became_active":"2023-09-30T22:54:07.288864+0000","last_became_peered":"2023-09-30T22:54:07.288864+0000","last_unstale":"2023-09-30T22:54:07.289610+0000","last_undegraded":"2023-09-30T22:54:07.289610+0000","last_fullsized":"2023-09-30T22:54:07.289610+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:59.949127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293370+0000","last_change":"2023-09-30T22:54:06.282802+0000","last_active":"2023-09-30T22:54:07.293370+0000","last_peered":"2023-09-30T22:54:07.293370+0000","last_clean":"2023-09-30T22:54:07.293370+0000","last_became_active":"2023-09-30T22:54:06.282576+0000","last_became_peered":"2023-09-30T22:54:06.282576+0000","last_unstale":"2023-09-30T22:54:07.293370+0000","last_undegraded":"2023-09-30T22:54:07.293370+0000","last_fullsized":"2023-09-30T22:54:07.293370+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289816+0000","last_change":"2023-09-30T22:54:07.289495+0000","last_active":"2023-09-30T22:54:07.289816+0000","last_peered":"2023-09-30T22:54:07.289816+0000","last_clean":"2023-09-30T22:54:07.289816+0000","last_became_active":"2023-09-30T22:54:07.289283+0000","last_became_peered":"2023-09-30T22:54:07.289283+0000","last_unstale":"2023-09-30T22:54:07.289816+0000","last_undegraded":"2023-09-30T22:54:07.289816+0000","last_fullsized":"2023-09-30T22:54:07.289816+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:41.000107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294012+0000","last_change":"2023-09-30T22:54:06.285268+0000","last_active":"2023-09-30T22:54:07.294012+0000","last_peered":"2023-09-30T22:54:07.294012+0000","last_clean":"2023-09-30T22:54:07.294012+0000","last_became_active":"2023-09-30T22:54:06.284975+0000","last_became_peered":"2023-09-30T22:54:06.284975+0000","last_unstale":"2023-09-30T22:54:07.294012+0000","last_undegraded":"2023-09-30T22:54:07.294012+0000","last_fullsized":"2023-09-30T22:54:07.294012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288839+0000","last_change":"2023-09-30T22:54:07.288762+0000","last_active":"2023-09-30T22:54:07.288839+0000","last_peered":"2023-09-30T22:54:07.288839+0000","last_clean":"2023-09-30T22:54:07.288839+0000","last_became_active":"2023-09-30T22:54:07.288451+0000","last_became_peered":"2023-09-30T22:54:07.288451+0000","last_unstale":"2023-09-30T22:54:07.288839+0000","last_undegraded":"2023-09-30T22:54:07.288839+0000","last_fullsized":"2023-09-30T22:54:07.288839+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:04.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285519+0000","last_change":"2023-09-30T22:54:06.279537+0000","last_active":"2023-09-30T22:54:07.285519+0000","last_peered":"2023-09-30T22:54:07.285519+0000","last_clean":"2023-09-30T22:54:07.285519+0000","last_became_active":"2023-09-30T22:54:06.279241+0000","last_became_peered":"2023-09-30T22:54:06.279241+0000","last_unstale":"2023-09-30T22:54:07.285519+0000","last_undegraded":"2023-09-30T22:54:07.285519+0000","last_fullsized":"2023-09-30T22:54:07.285519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:33:04.622185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286844+0000","last_change":"2023-09-30T22:54:07.286569+0000","last_active":"2023-09-30T22:54:07.286844+0000","last_peered":"2023-09-30T22:54:07.286844+0000","last_clean":"2023-09-30T22:54:07.286844+0000","last_became_active":"2023-09-30T22:54:07.286198+0000","last_became_peered":"2023-09-30T22:54:07.286198+0000","last_unstale":"2023-09-30T22:54:07.286844+0000","last_undegraded":"2023-09-30T22:54:07.286844+0000","last_fullsized":"2023-09-30T22:54:07.286844+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276462+0000","last_change":"2023-09-30T22:54:06.280234+0000","last_active":"2023-09-30T22:54:07.276462+0000","last_peered":"2023-09-30T22:54:07.276462+0000","last_clean":"2023-09-30T22:54:07.276462+0000","last_became_active":"2023-09-30T22:54:06.279996+0000","last_became_peered":"2023-09-30T22:54:06.279996+0000","last_unstale":"2023-09-30T22:54:07.276462+0000","last_undegraded":"2023-09-30T22:54:07.276462+0000","last_fullsized":"2023-09-30T22:54:07.276462+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281797+0000","last_change":"2023-09-30T22:54:07.281697+0000","last_active":"2023-09-30T22:54:07.281797+0000","last_peered":"2023-09-30T22:54:07.281797+0000","last_clean":"2023-09-30T22:54:07.281797+0000","last_became_active":"2023-09-30T22:54:07.281257+0000","last_became_peered":"2023-09-30T22:54:07.281257+0000","last_unstale":"2023-09-30T22:54:07.281797+0000","last_undegraded":"2023-09-30T22:54:07.281797+0000","last_fullsized":"2023-09-30T22:54:07.281797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.409096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280608+0000","last_change":"2023-09-30T22:54:06.281185+0000","last_active":"2023-09-30T22:54:07.280608+0000","last_peered":"2023-09-30T22:54:07.280608+0000","last_clean":"2023-09-30T22:54:07.280608+0000","last_became_active":"2023-09-30T22:54:06.280705+0000","last_became_peered":"2023-09-30T22:54:06.280705+0000","last_unstale":"2023-09-30T22:54:07.280608+0000","last_undegraded":"2023-09-30T22:54:07.280608+0000","last_fullsized":"2023-09-30T22:54:07.280608+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:09.336177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292647+0000","last_change":"2023-09-30T22:54:07.292529+0000","last_active":"2023-09-30T22:54:07.292647+0000","last_peered":"2023-09-30T22:54:07.292647+0000","last_clean":"2023-09-30T22:54:07.292647+0000","last_became_active":"2023-09-30T22:54:07.291546+0000","last_became_peered":"2023-09-30T22:54:07.291546+0000","last_unstale":"2023-09-30T22:54:07.292647+0000","last_undegraded":"2023-09-30T22:54:07.292647+0000","last_fullsized":"2023-09-30T22:54:07.292647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:23.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.278998+0000","last_change":"2023-09-30T22:54:06.275367+0000","last_active":"2023-09-30T22:54:07.278998+0000","last_peered":"2023-09-30T22:54:07.278998+0000","last_clean":"2023-09-30T22:54:07.278998+0000","last_became_active":"2023-09-30T22:54:06.275116+0000","last_became_peered":"2023-09-30T22:54:06.275116+0000","last_unstale":"2023-09-30T22:54:07.278998+0000","last_undegraded":"2023-09-30T22:54:07.278998+0000","last_fullsized":"2023-09-30T22:54:07.278998+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:10.629629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281978+0000","last_change":"2023-09-30T22:54:07.281779+0000","last_active":"2023-09-30T22:54:07.281978+0000","last_peered":"2023-09-30T22:54:07.281978+0000","last_clean":"2023-09-30T22:54:07.281978+0000","last_became_active":"2023-09-30T22:54:07.281409+0000","last_became_peered":"2023-09-30T22:54:07.281409+0000","last_unstale":"2023-09-30T22:54:07.281978+0000","last_undegraded":"2023-09-30T22:54:07.281978+0000","last_fullsized":"2023-09-30T22:54:07.281978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:27:23.188033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275811+0000","last_change":"2023-09-30T22:54:06.271026+0000","last_active":"2023-09-30T22:54:07.275811+0000","last_peered":"2023-09-30T22:54:07.275811+0000","last_clean":"2023-09-30T22:54:07.275811+0000","last_became_active":"2023-09-30T22:54:06.270808+0000","last_became_peered":"2023-09-30T22:54:06.270808+0000","last_unstale":"2023-09-30T22:54:07.275811+0000","last_undegraded":"2023-09-30T22:54:07.275811+0000","last_fullsized":"2023-09-30T22:54:07.275811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:13.169498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291410+0000","last_change":"2023-09-30T22:54:07.289332+0000","last_active":"2023-09-30T22:54:07.291410+0000","last_peered":"2023-09-30T22:54:07.291410+0000","last_clean":"2023-09-30T22:54:07.291410+0000","last_became_active":"2023-09-30T22:54:07.288811+0000","last_became_peered":"2023-09-30T22:54:07.288811+0000","last_unstale":"2023-09-30T22:54:07.291410+0000","last_undegraded":"2023-09-30T22:54:07.291410+0000","last_fullsized":"2023-09-30T22:54:07.291410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284174+0000","last_change":"2023-09-30T22:54:06.281865+0000","last_active":"2023-09-30T22:54:07.284174+0000","last_peered":"2023-09-30T22:54:07.284174+0000","last_clean":"2023-09-30T22:54:07.284174+0000","last_became_active":"2023-09-30T22:54:06.281674+0000","last_became_peered":"2023-09-30T22:54:06.281674+0000","last_unstale":"2023-09-30T22:54:07.284174+0000","last_undegraded":"2023-09-30T22:54:07.284174+0000","last_fullsized":"2023-09-30T22:54:07.284174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:23.908829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289516+0000","last_change":"2023-09-30T22:54:07.289407+0000","last_active":"2023-09-30T22:54:07.289516+0000","last_peered":"2023-09-30T22:54:07.289516+0000","last_clean":"2023-09-30T22:54:07.289516+0000","last_became_active":"2023-09-30T22:54:07.289033+0000","last_became_peered":"2023-09-30T22:54:07.289033+0000","last_unstale":"2023-09-30T22:54:07.289516+0000","last_undegraded":"2023-09-30T22:54:07.289516+0000","last_fullsized":"2023-09-30T22:54:07.289516+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295932+0000","last_change":"2023-09-30T22:54:06.286681+0000","last_active":"2023-09-30T22:54:07.295932+0000","last_peered":"2023-09-30T22:54:07.295932+0000","last_clean":"2023-09-30T22:54:07.295932+0000","last_became_active":"2023-09-30T22:54:06.286440+0000","last_became_peered":"2023-09-30T22:54:06.286440+0000","last_unstale":"2023-09-30T22:54:07.295932+0000","last_undegraded":"2023-09-30T22:54:07.295932+0000","last_fullsized":"2023-09-30T22:54:07.295932+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291537+0000","last_change":"2023-09-30T22:54:07.291459+0000","last_active":"2023-09-30T22:54:07.291537+0000","last_peered":"2023-09-30T22:54:07.291537+0000","last_clean":"2023-09-30T22:54:07.291537+0000","last_became_active":"2023-09-30T22:54:07.291228+0000","last_became_peered":"2023-09-30T22:54:07.291228+0000","last_unstale":"2023-09-30T22:54:07.291537+0000","last_undegraded":"2023-09-30T22:54:07.291537+0000","last_fullsized":"2023-09-30T22:54:07.291537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:40.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294820+0000","last_change":"2023-09-30T22:54:06.276631+0000","last_active":"2023-09-30T22:54:07.294820+0000","last_peered":"2023-09-30T22:54:07.294820+0000","last_clean":"2023-09-30T22:54:07.294820+0000","last_became_active":"2023-09-30T22:54:06.276205+0000","last_became_peered":"2023-09-30T22:54:06.276205+0000","last_unstale":"2023-09-30T22:54:07.294820+0000","last_undegraded":"2023-09-30T22:54:07.294820+0000","last_fullsized":"2023-09-30T22:54:07.294820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276163+0000","last_change":"2023-09-30T22:54:07.276089+0000","last_active":"2023-09-30T22:54:07.276163+0000","last_peered":"2023-09-30T22:54:07.276163+0000","last_clean":"2023-09-30T22:54:07.276163+0000","last_became_active":"2023-09-30T22:54:07.275805+0000","last_became_peered":"2023-09-30T22:54:07.275805+0000","last_unstale":"2023-09-30T22:54:07.276163+0000","last_undegraded":"2023-09-30T22:54:07.276163+0000","last_fullsized":"2023-09-30T22:54:07.276163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279086+0000","last_change":"2023-09-30T22:54:06.278684+0000","last_active":"2023-09-30T22:54:07.279086+0000","last_peered":"2023-09-30T22:54:07.279086+0000","last_clean":"2023-09-30T22:54:07.279086+0000","last_became_active":"2023-09-30T22:54:06.278481+0000","last_became_peered":"2023-09-30T22:54:06.278481+0000","last_unstale":"2023-09-30T22:54:07.279086+0000","last_undegraded":"2023-09-30T22:54:07.279086+0000","last_fullsized":"2023-09-30T22:54:07.279086+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:55.393916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281373+0000","last_change":"2023-09-30T22:54:07.281290+0000","last_active":"2023-09-30T22:54:07.281373+0000","last_peered":"2023-09-30T22:54:07.281373+0000","last_clean":"2023-09-30T22:54:07.281373+0000","last_became_active":"2023-09-30T22:54:07.281060+0000","last_became_peered":"2023-09-30T22:54:07.281060+0000","last_unstale":"2023-09-30T22:54:07.281373+0000","last_undegraded":"2023-09-30T22:54:07.281373+0000","last_fullsized":"2023-09-30T22:54:07.281373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285915+0000","last_change":"2023-09-30T22:54:06.277690+0000","last_active":"2023-09-30T22:54:07.285915+0000","last_peered":"2023-09-30T22:54:07.285915+0000","last_clean":"2023-09-30T22:54:07.285915+0000","last_became_active":"2023-09-30T22:54:06.277355+0000","last_became_peered":"2023-09-30T22:54:06.277355+0000","last_unstale":"2023-09-30T22:54:07.285915+0000","last_undegraded":"2023-09-30T22:54:07.285915+0000","last_fullsized":"2023-09-30T22:54:07.285915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:53.590302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288633+0000","last_change":"2023-09-30T22:54:07.288573+0000","last_active":"2023-09-30T22:54:07.288633+0000","last_peered":"2023-09-30T22:54:07.288633+0000","last_clean":"2023-09-30T22:54:07.288633+0000","last_became_active":"2023-09-30T22:54:07.287765+0000","last_became_peered":"2023-09-30T22:54:07.287765+0000","last_unstale":"2023-09-30T22:54:07.288633+0000","last_undegraded":"2023-09-30T22:54:07.288633+0000","last_fullsized":"2023-09-30T22:54:07.288633+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:27.314727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295216+0000","last_change":"2023-09-30T22:54:06.286073+0000","last_active":"2023-09-30T22:54:07.295216+0000","last_peered":"2023-09-30T22:54:07.295216+0000","last_clean":"2023-09-30T22:54:07.295216+0000","last_became_active":"2023-09-30T22:54:06.285829+0000","last_became_peered":"2023-09-30T22:54:06.285829+0000","last_unstale":"2023-09-30T22:54:07.295216+0000","last_undegraded":"2023-09-30T22:54:07.295216+0000","last_fullsized":"2023-09-30T22:54:07.295216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:39.997183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277782+0000","last_change":"2023-09-30T22:54:07.277704+0000","last_active":"2023-09-30T22:54:07.277782+0000","last_peered":"2023-09-30T22:54:07.277782+0000","last_clean":"2023-09-30T22:54:07.277782+0000","last_became_active":"2023-09-30T22:54:07.277473+0000","last_became_peered":"2023-09-30T22:54:07.277473+0000","last_unstale":"2023-09-30T22:54:07.277782+0000","last_undegraded":"2023-09-30T22:54:07.277782+0000","last_fullsized":"2023-09-30T22:54:07.277782+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294141+0000","last_change":"2023-09-30T22:54:06.283300+0000","last_active":"2023-09-30T22:54:07.294141+0000","last_peered":"2023-09-30T22:54:07.294141+0000","last_clean":"2023-09-30T22:54:07.294141+0000","last_became_active":"2023-09-30T22:54:06.282769+0000","last_became_peered":"2023-09-30T22:54:06.282769+0000","last_unstale":"2023-09-30T22:54:07.294141+0000","last_undegraded":"2023-09-30T22:54:07.294141+0000","last_fullsized":"2023-09-30T22:54:07.294141+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291447+0000","last_change":"2023-09-30T22:54:07.290082+0000","last_active":"2023-09-30T22:54:07.291447+0000","last_peered":"2023-09-30T22:54:07.291447+0000","last_clean":"2023-09-30T22:54:07.291447+0000","last_became_active":"2023-09-30T22:54:07.289698+0000","last_became_peered":"2023-09-30T22:54:07.289698+0000","last_unstale":"2023-09-30T22:54:07.291447+0000","last_undegraded":"2023-09-30T22:54:07.291447+0000","last_fullsized":"2023-09-30T22:54:07.291447+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290647+0000","last_change":"2023-09-30T22:54:06.276472+0000","last_active":"2023-09-30T22:54:07.290647+0000","last_peered":"2023-09-30T22:54:07.290647+0000","last_clean":"2023-09-30T22:54:07.290647+0000","last_became_active":"2023-09-30T22:54:06.275828+0000","last_became_peered":"2023-09-30T22:54:06.275828+0000","last_unstale":"2023-09-30T22:54:07.290647+0000","last_undegraded":"2023-09-30T22:54:07.290647+0000","last_fullsized":"2023-09-30T22:54:07.290647+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:54.384228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292887+0000","last_change":"2023-09-30T22:54:07.292818+0000","last_active":"2023-09-30T22:54:07.292887+0000","last_peered":"2023-09-30T22:54:07.292887+0000","last_clean":"2023-09-30T22:54:07.292887+0000","last_became_active":"2023-09-30T22:54:07.292518+0000","last_became_peered":"2023-09-30T22:54:07.292518+0000","last_unstale":"2023-09-30T22:54:07.292887+0000","last_undegraded":"2023-09-30T22:54:07.292887+0000","last_fullsized":"2023-09-30T22:54:07.292887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292192+0000","last_change":"2023-09-30T22:54:06.281858+0000","last_active":"2023-09-30T22:54:07.292192+0000","last_peered":"2023-09-30T22:54:07.292192+0000","last_clean":"2023-09-30T22:54:07.292192+0000","last_became_active":"2023-09-30T22:54:06.281635+0000","last_became_peered":"2023-09-30T22:54:06.281635+0000","last_unstale":"2023-09-30T22:54:07.292192+0000","last_undegraded":"2023-09-30T22:54:07.292192+0000","last_fullsized":"2023-09-30T22:54:07.292192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:26.021090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279540+0000","last_change":"2023-09-30T22:54:07.279437+0000","last_active":"2023-09-30T22:54:07.279540+0000","last_peered":"2023-09-30T22:54:07.279540+0000","last_clean":"2023-09-30T22:54:07.279540+0000","last_became_active":"2023-09-30T22:54:07.278738+0000","last_became_peered":"2023-09-30T22:54:07.278738+0000","last_unstale":"2023-09-30T22:54:07.279540+0000","last_undegraded":"2023-09-30T22:54:07.279540+0000","last_fullsized":"2023-09-30T22:54:07.279540+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286027+0000","last_change":"2023-09-30T22:54:06.283372+0000","last_active":"2023-09-30T22:54:07.286027+0000","last_peered":"2023-09-30T22:54:07.286027+0000","last_clean":"2023-09-30T22:54:07.286027+0000","last_became_active":"2023-09-30T22:54:06.283156+0000","last_became_peered":"2023-09-30T22:54:06.283156+0000","last_unstale":"2023-09-30T22:54:07.286027+0000","last_undegraded":"2023-09-30T22:54:07.286027+0000","last_fullsized":"2023-09-30T22:54:07.286027+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:24:10.857387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288012+0000","last_change":"2023-09-30T22:54:07.287736+0000","last_active":"2023-09-30T22:54:07.288012+0000","last_peered":"2023-09-30T22:54:07.288012+0000","last_clean":"2023-09-30T22:54:07.288012+0000","last_became_active":"2023-09-30T22:54:07.287358+0000","last_became_peered":"2023-09-30T22:54:07.287358+0000","last_unstale":"2023-09-30T22:54:07.288012+0000","last_undegraded":"2023-09-30T22:54:07.288012+0000","last_fullsized":"2023-09-30T22:54:07.288012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295776+0000","last_change":"2023-09-30T22:54:06.278096+0000","last_active":"2023-09-30T22:54:07.295776+0000","last_peered":"2023-09-30T22:54:07.295776+0000","last_clean":"2023-09-30T22:54:07.295776+0000","last_became_active":"2023-09-30T22:54:06.274665+0000","last_became_peered":"2023-09-30T22:54:06.274665+0000","last_unstale":"2023-09-30T22:54:07.295776+0000","last_undegraded":"2023-09-30T22:54:07.295776+0000","last_fullsized":"2023-09-30T22:54:07.295776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290301+0000","last_change":"2023-09-30T22:54:07.290229+0000","last_active":"2023-09-30T22:54:07.290301+0000","last_peered":"2023-09-30T22:54:07.290301+0000","last_clean":"2023-09-30T22:54:07.290301+0000","last_became_active":"2023-09-30T22:54:07.290009+0000","last_became_peered":"2023-09-30T22:54:07.290009+0000","last_unstale":"2023-09-30T22:54:07.290301+0000","last_undegraded":"2023-09-30T22:54:07.290301+0000","last_fullsized":"2023-09-30T22:54:07.290301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:27.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280023+0000","last_change":"2023-09-30T22:54:06.281951+0000","last_active":"2023-09-30T22:54:07.280023+0000","last_peered":"2023-09-30T22:54:07.280023+0000","last_clean":"2023-09-30T22:54:07.280023+0000","last_became_active":"2023-09-30T22:54:06.281513+0000","last_became_peered":"2023-09-30T22:54:06.281513+0000","last_unstale":"2023-09-30T22:54:07.280023+0000","last_undegraded":"2023-09-30T22:54:07.280023+0000","last_fullsized":"2023-09-30T22:54:07.280023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291431+0000","last_change":"2023-09-30T22:54:07.289474+0000","last_active":"2023-09-30T22:54:07.291431+0000","last_peered":"2023-09-30T22:54:07.291431+0000","last_clean":"2023-09-30T22:54:07.291431+0000","last_became_active":"2023-09-30T22:54:07.289121+0000","last_became_peered":"2023-09-30T22:54:07.289121+0000","last_unstale":"2023-09-30T22:54:07.291431+0000","last_undegraded":"2023-09-30T22:54:07.291431+0000","last_fullsized":"2023-09-30T22:54:07.291431+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276066+0000","last_change":"2023-09-30T22:54:06.284019+0000","last_active":"2023-09-30T22:54:07.276066+0000","last_peered":"2023-09-30T22:54:07.276066+0000","last_clean":"2023-09-30T22:54:07.276066+0000","last_became_active":"2023-09-30T22:54:06.283783+0000","last_became_peered":"2023-09-30T22:54:06.283783+0000","last_unstale":"2023-09-30T22:54:07.276066+0000","last_undegraded":"2023-09-30T22:54:07.276066+0000","last_fullsized":"2023-09-30T22:54:07.276066+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:45.528979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280961+0000","last_change":"2023-09-30T22:54:07.280854+0000","last_active":"2023-09-30T22:54:07.280961+0000","last_peered":"2023-09-30T22:54:07.280961+0000","last_clean":"2023-09-30T22:54:07.280961+0000","last_became_active":"2023-09-30T22:54:07.280389+0000","last_became_peered":"2023-09-30T22:54:07.280389+0000","last_unstale":"2023-09-30T22:54:07.280961+0000","last_undegraded":"2023-09-30T22:54:07.280961+0000","last_fullsized":"2023-09-30T22:54:07.280961+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:59.949127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.273211+0000","last_change":"2023-09-30T22:54:06.280742+0000","last_active":"2023-09-30T22:54:07.273211+0000","last_peered":"2023-09-30T22:54:07.273211+0000","last_clean":"2023-09-30T22:54:07.273211+0000","last_became_active":"2023-09-30T22:54:06.280380+0000","last_became_peered":"2023-09-30T22:54:06.280380+0000","last_unstale":"2023-09-30T22:54:07.273211+0000","last_undegraded":"2023-09-30T22:54:07.273211+0000","last_fullsized":"2023-09-30T22:54:07.273211+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:01.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289627+0000","last_change":"2023-09-30T22:54:07.289546+0000","last_active":"2023-09-30T22:54:07.289627+0000","last_peered":"2023-09-30T22:54:07.289627+0000","last_clean":"2023-09-30T22:54:07.289627+0000","last_became_active":"2023-09-30T22:54:07.289175+0000","last_became_peered":"2023-09-30T22:54:07.289175+0000","last_unstale":"2023-09-30T22:54:07.289627+0000","last_undegraded":"2023-09-30T22:54:07.289627+0000","last_fullsized":"2023-09-30T22:54:07.289627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:58:29.360202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285151+0000","last_change":"2023-09-30T22:54:06.277243+0000","last_active":"2023-09-30T22:54:07.285151+0000","last_peered":"2023-09-30T22:54:07.285151+0000","last_clean":"2023-09-30T22:54:07.285151+0000","last_became_active":"2023-09-30T22:54:06.276913+0000","last_became_peered":"2023-09-30T22:54:06.276913+0000","last_unstale":"2023-09-30T22:54:07.285151+0000","last_undegraded":"2023-09-30T22:54:07.285151+0000","last_fullsized":"2023-09-30T22:54:07.285151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:04.627516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275923+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:54:07.275923+0000","last_peered":"2023-09-30T22:54:07.275923+0000","last_clean":"2023-09-30T22:54:07.275923+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:54:07.275923+0000","last_undegraded":"2023-09-30T22:54:07.275923+0000","last_fullsized":"2023-09-30T22:54:07.275923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281761+0000","last_change":"2023-09-30T22:54:07.281484+0000","last_active":"2023-09-30T22:54:07.281761+0000","last_peered":"2023-09-30T22:54:07.281761+0000","last_clean":"2023-09-30T22:54:07.281761+0000","last_became_active":"2023-09-30T22:54:07.280948+0000","last_became_peered":"2023-09-30T22:54:07.280948+0000","last_unstale":"2023-09-30T22:54:07.281761+0000","last_undegraded":"2023-09-30T22:54:07.281761+0000","last_fullsized":"2023-09-30T22:54:07.281761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:24.911752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285935+0000","last_change":"2023-09-30T22:54:06.280275+0000","last_active":"2023-09-30T22:54:07.285935+0000","last_peered":"2023-09-30T22:54:07.285935+0000","last_clean":"2023-09-30T22:54:07.285935+0000","last_became_active":"2023-09-30T22:54:06.280036+0000","last_became_peered":"2023-09-30T22:54:06.280036+0000","last_unstale":"2023-09-30T22:54:07.285935+0000","last_undegraded":"2023-09-30T22:54:07.285935+0000","last_fullsized":"2023-09-30T22:54:07.285935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277374+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:54:07.277374+0000","last_peered":"2023-09-30T22:54:07.277374+0000","last_clean":"2023-09-30T22:54:07.277374+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:54:07.277374+0000","last_undegraded":"2023-09-30T22:54:07.277374+0000","last_fullsized":"2023-09-30T22:54:07.277374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288611+0000","last_change":"2023-09-30T22:54:07.288374+0000","last_active":"2023-09-30T22:54:07.288611+0000","last_peered":"2023-09-30T22:54:07.288611+0000","last_clean":"2023-09-30T22:54:07.288611+0000","last_became_active":"2023-09-30T22:54:07.287298+0000","last_became_peered":"2023-09-30T22:54:07.287298+0000","last_unstale":"2023-09-30T22:54:07.288611+0000","last_undegraded":"2023-09-30T22:54:07.288611+0000","last_fullsized":"2023-09-30T22:54:07.288611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:48.421115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280430+0000","last_change":"2023-09-30T22:54:06.280988+0000","last_active":"2023-09-30T22:54:07.280430+0000","last_peered":"2023-09-30T22:54:07.280430+0000","last_clean":"2023-09-30T22:54:07.280430+0000","last_became_active":"2023-09-30T22:54:06.280317+0000","last_became_peered":"2023-09-30T22:54:06.280317+0000","last_unstale":"2023-09-30T22:54:07.280430+0000","last_undegraded":"2023-09-30T22:54:07.280430+0000","last_fullsized":"2023-09-30T22:54:07.280430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:26.869196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275293+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:54:07.275293+0000","last_peered":"2023-09-30T22:54:07.275293+0000","last_clean":"2023-09-30T22:54:07.275293+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:54:07.275293+0000","last_undegraded":"2023-09-30T22:54:07.275293+0000","last_fullsized":"2023-09-30T22:54:07.275293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292811+0000","last_change":"2023-09-30T22:54:07.292676+0000","last_active":"2023-09-30T22:54:07.292811+0000","last_peered":"2023-09-30T22:54:07.292811+0000","last_clean":"2023-09-30T22:54:07.292811+0000","last_became_active":"2023-09-30T22:54:07.292313+0000","last_became_peered":"2023-09-30T22:54:07.292313+0000","last_unstale":"2023-09-30T22:54:07.292811+0000","last_undegraded":"2023-09-30T22:54:07.292811+0000","last_fullsized":"2023-09-30T22:54:07.292811+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:14.681908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-09-30T22:54:10.265427+0000","last_change":"2023-09-30T22:54:06.281336+0000","last_active":"2023-09-30T22:54:10.265427+0000","last_peered":"2023-09-30T22:54:10.265427+0000","last_clean":"2023-09-30T22:54:10.265427+0000","last_became_active":"2023-09-30T22:54:06.281041+0000","last_became_peered":"2023-09-30T22:54:06.281041+0000","last_unstale":"2023-09-30T22:54:10.265427+0000","last_undegraded":"2023-09-30T22:54:10.265427+0000","last_fullsized":"2023-09-30T22:54:10.265427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:22.348215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279095+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:54:07.279095+0000","last_peered":"2023-09-30T22:54:07.279095+0000","last_clean":"2023-09-30T22:54:07.279095+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:54:07.279095+0000","last_undegraded":"2023-09-30T22:54:07.279095+0000","last_fullsized":"2023-09-30T22:54:07.279095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276149+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:54:07.276149+0000","last_peered":"2023-09-30T22:54:07.276149+0000","last_clean":"2023-09-30T22:54:07.276149+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:54:07.276149+0000","last_undegraded":"2023-09-30T22:54:07.276149+0000","last_fullsized":"2023-09-30T22:54:07.276149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288059+0000","last_change":"2023-09-30T22:54:07.287202+0000","last_active":"2023-09-30T22:54:07.288059+0000","last_peered":"2023-09-30T22:54:07.288059+0000","last_clean":"2023-09-30T22:54:07.288059+0000","last_became_active":"2023-09-30T22:54:07.286951+0000","last_became_peered":"2023-09-30T22:54:07.286951+0000","last_unstale":"2023-09-30T22:54:07.288059+0000","last_undegraded":"2023-09-30T22:54:07.288059+0000","last_fullsized":"2023-09-30T22:54:07.288059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:56.396839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276635+0000","last_change":"2023-09-30T22:54:06.284834+0000","last_active":"2023-09-30T22:54:07.276635+0000","last_peered":"2023-09-30T22:54:07.276635+0000","last_clean":"2023-09-30T22:54:07.276635+0000","last_became_active":"2023-09-30T22:54:06.284671+0000","last_became_peered":"2023-09-30T22:54:06.284671+0000","last_unstale":"2023-09-30T22:54:07.276635+0000","last_undegraded":"2023-09-30T22:54:07.276635+0000","last_fullsized":"2023-09-30T22:54:07.276635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276709+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:54:07.276709+0000","last_peered":"2023-09-30T22:54:07.276709+0000","last_clean":"2023-09-30T22:54:07.276709+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:54:07.276709+0000","last_undegraded":"2023-09-30T22:54:07.276709+0000","last_fullsized":"2023-09-30T22:54:07.276709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279508+0000","last_change":"2023-09-30T22:54:07.279081+0000","last_active":"2023-09-30T22:54:07.279508+0000","last_peered":"2023-09-30T22:54:07.279508+0000","last_clean":"2023-09-30T22:54:07.279508+0000","last_became_active":"2023-09-30T22:54:07.278827+0000","last_became_peered":"2023-09-30T22:54:07.278827+0000","last_unstale":"2023-09-30T22:54:07.279508+0000","last_undegraded":"2023-09-30T22:54:07.279508+0000","last_fullsized":"2023-09-30T22:54:07.279508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276045+0000","last_change":"2023-09-30T22:54:06.281184+0000","last_active":"2023-09-30T22:54:07.276045+0000","last_peered":"2023-09-30T22:54:07.276045+0000","last_clean":"2023-09-30T22:54:07.276045+0000","last_became_active":"2023-09-30T22:54:06.280960+0000","last_became_peered":"2023-09-30T22:54:06.280960+0000","last_unstale":"2023-09-30T22:54:07.276045+0000","last_undegraded":"2023-09-30T22:54:07.276045+0000","last_fullsized":"2023-09-30T22:54:07.276045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:45.532201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276538+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:54:07.276538+0000","last_peered":"2023-09-30T22:54:07.276538+0000","last_clean":"2023-09-30T22:54:07.276538+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:54:07.276538+0000","last_undegraded":"2023-09-30T22:54:07.276538+0000","last_fullsized":"2023-09-30T22:54:07.276538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.282469+0000","last_change":"2023-09-30T22:54:07.282400+0000","last_active":"2023-09-30T22:54:07.282469+0000","last_peered":"2023-09-30T22:54:07.282469+0000","last_clean":"2023-09-30T22:54:07.282469+0000","last_became_active":"2023-09-30T22:54:07.281984+0000","last_became_peered":"2023-09-30T22:54:07.281984+0000","last_unstale":"2023-09-30T22:54:07.282469+0000","last_undegraded":"2023-09-30T22:54:07.282469+0000","last_fullsized":"2023-09-30T22:54:07.282469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.273306+0000","last_change":"2023-09-30T22:54:06.280079+0000","last_active":"2023-09-30T22:54:07.273306+0000","last_peered":"2023-09-30T22:54:07.273306+0000","last_clean":"2023-09-30T22:54:07.273306+0000","last_became_active":"2023-09-30T22:54:06.279695+0000","last_became_peered":"2023-09-30T22:54:06.279695+0000","last_unstale":"2023-09-30T22:54:07.273306+0000","last_undegraded":"2023-09-30T22:54:07.273306+0000","last_fullsized":"2023-09-30T22:54:07.273306+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280345+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:54:07.280345+0000","last_peered":"2023-09-30T22:54:07.280345+0000","last_clean":"2023-09-30T22:54:07.280345+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:54:07.280345+0000","last_undegraded":"2023-09-30T22:54:07.280345+0000","last_fullsized":"2023-09-30T22:54:07.280345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289484+0000","last_change":"2023-09-30T22:54:07.288385+0000","last_active":"2023-09-30T22:54:07.289484+0000","last_peered":"2023-09-30T22:54:07.289484+0000","last_clean":"2023-09-30T22:54:07.289484+0000","last_became_active":"2023-09-30T22:54:07.288086+0000","last_became_peered":"2023-09-30T22:54:07.288086+0000","last_unstale":"2023-09-30T22:54:07.289484+0000","last_undegraded":"2023-09-30T22:54:07.289484+0000","last_fullsized":"2023-09-30T22:54:07.289484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284427+0000","last_change":"2023-09-30T22:54:06.283671+0000","last_active":"2023-09-30T22:54:07.284427+0000","last_peered":"2023-09-30T22:54:07.284427+0000","last_clean":"2023-09-30T22:54:07.284427+0000","last_became_active":"2023-09-30T22:54:06.283368+0000","last_became_peered":"2023-09-30T22:54:06.283368+0000","last_unstale":"2023-09-30T22:54:07.284427+0000","last_undegraded":"2023-09-30T22:54:07.284427+0000","last_fullsized":"2023-09-30T22:54:07.284427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277211+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:54:07.277211+0000","last_peered":"2023-09-30T22:54:07.277211+0000","last_clean":"2023-09-30T22:54:07.277211+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:54:07.277211+0000","last_undegraded":"2023-09-30T22:54:07.277211+0000","last_fullsized":"2023-09-30T22:54:07.277211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66100000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.745}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.78000000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.75}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.55500000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.80100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.437}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.91600000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.93500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.434},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.314},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758749,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.432},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.38700000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758693,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.98799999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.90300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757155,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.69899999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.624},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166789,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.78200000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.623}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.76500000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82199999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.83499999999999996}]}]}],"pool_statfs":[]}} 2023-09-30T22:54:16.522 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:54:16.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.722+0000 7fabfcbff700 1 Processor -- start 2023-09-30T22:54:16.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.722+0000 7fabfcbff700 1 -- start start 2023-09-30T22:54:16.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.723+0000 7fabfcbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80af020 0x7fabf8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:16.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.723+0000 7fabfcbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabf80b00d0 0x7fabf806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:16.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.723+0000 7fabfcbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fabf806e650 0x7fabf80b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.723+0000 7fabfcbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf806d3e0 con 0x7fabf80b00d0 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.723+0000 7fabfcbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf806dc80 con 0x7fabf806e650 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.723+0000 7fabfcbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf806b790 con 0x7fabf80af020 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabf80b00d0 0x7fabf806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabf80b00d0 0x7fabf806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55540/0 (socket says 172.21.15.142:55540) 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 -- 172.21.15.142:0/50838971 learned_addr learned my addr 172.21.15.142:0/50838971 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf6d9d700 1 --2- 172.21.15.142:0/50838971 >> v2:172.21.15.148:3300/0 conn(0x7fabf806e650 0x7fabf80b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf659c700 1 --2- 172.21.15.142:0/50838971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80af020 0x7fabf8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 -- 172.21.15.142:0/50838971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80af020 msgr2=0x7fabf8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:16.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 --2- 172.21.15.142:0/50838971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80af020 0x7fabf8156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 -- 172.21.15.142:0/50838971 >> v2:172.21.15.148:3300/0 conn(0x7fabf806e650 msgr2=0x7fabf80b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 --2- 172.21.15.142:0/50838971 >> v2:172.21.15.148:3300/0 conn(0x7fabf806e650 0x7fabf80b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 -- 172.21.15.142:0/50838971 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80b0650 con 0x7fabf80b00d0 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf6d9d700 1 --2- 172.21.15.142:0/50838971 >> v2:172.21.15.148:3300/0 conn(0x7fabf806e650 0x7fabf80b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf5d9b700 1 --2- 172.21.15.142:0/50838971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80b00d0 0x7fabf806e110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fabf80c9c40 tx=0x7fabec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0303804daa13a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.724+0000 7fabf559a700 1 -- 172.21.15.142:0/50838971 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00b860 con 0x7fabf80b00d0 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabf559a700 1 -- 172.21.15.142:0/50838971 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec00b9c0 con 0x7fabf80b00d0 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabf559a700 1 -- 172.21.15.142:0/50838971 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00bd60 con 0x7fabf80b00d0 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 -- 172.21.15.142:0/50838971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80b00d0 msgr2=0x7fabf806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:16.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 --2- 172.21.15.142:0/50838971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80b00d0 0x7fabf806e110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fabf80c9c40 tx=0x7fabec009250 comp rx=0 tx=0).stop 2023-09-30T22:54:16.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 -- 172.21.15.142:0/50838971 shutdown_connections 2023-09-30T22:54:16.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 --2- 172.21.15.142:0/50838971 >> v2:172.21.15.148:3300/0 conn(0x7fabf806e650 0x7fabf80b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 --2- 172.21.15.142:0/50838971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80af020 0x7fabf8156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 --2- 172.21.15.142:0/50838971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80b00d0 0x7fabf806e110 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 -- 172.21.15.142:0/50838971 >> 172.21.15.142:0/50838971 conn(0x7fabf80680c0 msgr2=0x7fabf80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:16.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 -- 172.21.15.142:0/50838971 shutdown_connections 2023-09-30T22:54:16.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.725+0000 7fabfcbff700 1 -- 172.21.15.142:0/50838971 wait complete. 2023-09-30T22:54:16.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.727+0000 7fabfcbff700 1 Processor -- start 2023-09-30T22:54:16.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.727+0000 7fabfcbff700 1 -- start start 2023-09-30T22:54:16.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabfcbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf806e650 0x7fabf814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:16.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabfcbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80af020 0x7fabf81513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:16.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabfcbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80b00d0 0x7fabf81518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:16.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabfcbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf81663a0 con 0x7fabf80af020 2023-09-30T22:54:16.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabfcbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8157b60 con 0x7fabf806e650 2023-09-30T22:54:16.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabfcbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8157e40 con 0x7fabf80b00d0 2023-09-30T22:54:16.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80af020 0x7fabf81513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:16.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80af020 0x7fabf81513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55542/0 (socket says 172.21.15.142:55542) 2023-09-30T22:54:16.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 -- 172.21.15.142:0/3186961173 learned_addr learned my addr 172.21.15.142:0/3186961173 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf659c700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf806e650 0x7fabf814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf6d9d700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80b00d0 0x7fabf81518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 -- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80b00d0 msgr2=0x7fabf81518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80b00d0 0x7fabf81518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 -- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf806e650 msgr2=0x7fabf814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf806e650 0x7fabf814e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf5d9b700 1 -- 172.21.15.142:0/3186961173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0094f0 con 0x7fabf80af020 2023-09-30T22:54:16.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf659c700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf806e650 0x7fabf814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.729+0000 7fabf6d9d700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80b00d0 0x7fabf81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.730+0000 7fabf5d9b700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80af020 0x7fabf81513b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fabec009290 tx=0x7fabec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.730+0000 7fabe67fc700 1 -- 172.21.15.142:0/3186961173 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec026480 con 0x7fabf80af020 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.730+0000 7fabe67fc700 1 -- 172.21.15.142:0/3186961173 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec01f070 con 0x7fabf80af020 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.730+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf8158120 con 0x7fabf80af020 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.730+0000 7fabe67fc700 1 -- 172.21.15.142:0/3186961173 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec026830 con 0x7fabf80af020 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.730+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf814e6e0 con 0x7fabf80af020 2023-09-30T22:54:16.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.731+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf80695b0 con 0x7fabf80af020 2023-09-30T22:54:16.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.732+0000 7fabe67fc700 1 -- 172.21.15.142:0/3186961173 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fabec026ba0 con 0x7fabf80af020 2023-09-30T22:54:16.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.733+0000 7fabe67fc700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabd8067330 0x7fabd80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:16.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.733+0000 7fabe67fc700 1 -- 172.21.15.142:0/3186961173 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fabec021070 con 0x7fabf80af020 2023-09-30T22:54:16.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.733+0000 7fabf659c700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabd8067330 0x7fabd80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:16.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.734+0000 7fabf659c700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabd8067330 0x7fabd80697e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fabe8006fd0 tx=0x7fabe8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:16.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.737+0000 7fabe67fc700 1 -- 172.21.15.142:0/3186961173 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fabec053950 con 0x7fabf80af020 2023-09-30T22:54:16.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.922+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabf81664e0 con 0x7fabd8067330 2023-09-30T22:54:16.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.931+0000 7fabe67fc700 1 -- 172.21.15.142:0/3186961173 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303625 (secure 0 0 0) 0x7fabf81664e0 con 0x7fabd8067330 2023-09-30T22:54:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabd8067330 msgr2=0x7fabd80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabd8067330 0x7fabd80697e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fabe8006fd0 tx=0x7fabe8008040 comp rx=0 tx=0).stop 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80af020 msgr2=0x7fabf81513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80af020 0x7fabf81513b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fabec009290 tx=0x7fabec017000 comp rx=0 tx=0).stop 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 shutdown_connections 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabd8067330 0x7fabd80697e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf80b00d0 0x7fabf81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf806e650 0x7fabf814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 --2- 172.21.15.142:0/3186961173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf80af020 0x7fabf81513b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:16.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 >> 172.21.15.142:0/3186961173 conn(0x7fabf80680c0 msgr2=0x7fabf806a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:16.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 shutdown_connections 2023-09-30T22:54:16.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:16.936+0000 7fabfcbff700 1 -- 172.21.15.142:0/3186961173 wait complete. 2023-09-30T22:54:16.940 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:54:16.954 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-09-30T22:54:16.322036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559457,"statfs":{"total":1600000000,"available":1596884916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.200383"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284476+0000","last_change":"2023-09-30T22:54:07.282459+0000","last_active":"2023-09-30T22:54:07.284476+0000","last_peered":"2023-09-30T22:54:07.284476+0000","last_clean":"2023-09-30T22:54:07.284476+0000","last_became_active":"2023-09-30T22:54:07.282015+0000","last_became_peered":"2023-09-30T22:54:07.282015+0000","last_unstale":"2023-09-30T22:54:07.284476+0000","last_undegraded":"2023-09-30T22:54:07.284476+0000","last_fullsized":"2023-09-30T22:54:07.284476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289501+0000","last_change":"2023-09-30T22:54:07.289263+0000","last_active":"2023-09-30T22:54:07.289501+0000","last_peered":"2023-09-30T22:54:07.289501+0000","last_clean":"2023-09-30T22:54:07.289501+0000","last_became_active":"2023-09-30T22:54:07.288712+0000","last_became_peered":"2023-09-30T22:54:07.288712+0000","last_unstale":"2023-09-30T22:54:07.289501+0000","last_undegraded":"2023-09-30T22:54:07.289501+0000","last_fullsized":"2023-09-30T22:54:07.289501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288954+0000","last_change":"2023-09-30T22:54:07.288841+0000","last_active":"2023-09-30T22:54:07.288954+0000","last_peered":"2023-09-30T22:54:07.288954+0000","last_clean":"2023-09-30T22:54:07.288954+0000","last_became_active":"2023-09-30T22:54:07.288122+0000","last_became_peered":"2023-09-30T22:54:07.288122+0000","last_unstale":"2023-09-30T22:54:07.288954+0000","last_undegraded":"2023-09-30T22:54:07.288954+0000","last_fullsized":"2023-09-30T22:54:07.288954+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:12:30.609061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281780+0000","last_change":"2023-09-30T22:54:07.281645+0000","last_active":"2023-09-30T22:54:07.281780+0000","last_peered":"2023-09-30T22:54:07.281780+0000","last_clean":"2023-09-30T22:54:07.281780+0000","last_became_active":"2023-09-30T22:54:07.281094+0000","last_became_peered":"2023-09-30T22:54:07.281094+0000","last_unstale":"2023-09-30T22:54:07.281780+0000","last_undegraded":"2023-09-30T22:54:07.281780+0000","last_fullsized":"2023-09-30T22:54:07.281780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:41:06.753884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287989+0000","last_change":"2023-09-30T22:54:07.287587+0000","last_active":"2023-09-30T22:54:07.287989+0000","last_peered":"2023-09-30T22:54:07.287989+0000","last_clean":"2023-09-30T22:54:07.287989+0000","last_became_active":"2023-09-30T22:54:07.286871+0000","last_became_peered":"2023-09-30T22:54:07.286871+0000","last_unstale":"2023-09-30T22:54:07.287989+0000","last_undegraded":"2023-09-30T22:54:07.287989+0000","last_fullsized":"2023-09-30T22:54:07.287989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283932+0000","last_change":"2023-09-30T22:54:07.283152+0000","last_active":"2023-09-30T22:54:07.283932+0000","last_peered":"2023-09-30T22:54:07.283932+0000","last_clean":"2023-09-30T22:54:07.283932+0000","last_became_active":"2023-09-30T22:54:07.282730+0000","last_became_peered":"2023-09-30T22:54:07.282730+0000","last_unstale":"2023-09-30T22:54:07.283932+0000","last_undegraded":"2023-09-30T22:54:07.283932+0000","last_fullsized":"2023-09-30T22:54:07.283932+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:56.396839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277267+0000","last_change":"2023-09-30T22:54:07.277170+0000","last_active":"2023-09-30T22:54:07.277267+0000","last_peered":"2023-09-30T22:54:07.277267+0000","last_clean":"2023-09-30T22:54:07.277267+0000","last_became_active":"2023-09-30T22:54:07.276895+0000","last_became_peered":"2023-09-30T22:54:07.276895+0000","last_unstale":"2023-09-30T22:54:07.277267+0000","last_undegraded":"2023-09-30T22:54:07.277267+0000","last_fullsized":"2023-09-30T22:54:07.277267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284345+0000","last_change":"2023-09-30T22:54:07.284266+0000","last_active":"2023-09-30T22:54:07.284345+0000","last_peered":"2023-09-30T22:54:07.284345+0000","last_clean":"2023-09-30T22:54:07.284345+0000","last_became_active":"2023-09-30T22:54:07.283659+0000","last_became_peered":"2023-09-30T22:54:07.283659+0000","last_unstale":"2023-09-30T22:54:07.284345+0000","last_undegraded":"2023-09-30T22:54:07.284345+0000","last_fullsized":"2023-09-30T22:54:07.284345+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289842+0000","last_change":"2023-09-30T22:54:07.289562+0000","last_active":"2023-09-30T22:54:07.289842+0000","last_peered":"2023-09-30T22:54:07.289842+0000","last_clean":"2023-09-30T22:54:07.289842+0000","last_became_active":"2023-09-30T22:54:07.288451+0000","last_became_peered":"2023-09-30T22:54:07.288451+0000","last_unstale":"2023-09-30T22:54:07.289842+0000","last_undegraded":"2023-09-30T22:54:07.289842+0000","last_fullsized":"2023-09-30T22:54:07.289842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:40.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291044+0000","last_change":"2023-09-30T22:54:07.290970+0000","last_active":"2023-09-30T22:54:07.291044+0000","last_peered":"2023-09-30T22:54:07.291044+0000","last_clean":"2023-09-30T22:54:07.291044+0000","last_became_active":"2023-09-30T22:54:07.290500+0000","last_became_peered":"2023-09-30T22:54:07.290500+0000","last_unstale":"2023-09-30T22:54:07.291044+0000","last_undegraded":"2023-09-30T22:54:07.291044+0000","last_fullsized":"2023-09-30T22:54:07.291044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284401+0000","last_change":"2023-09-30T22:54:07.282303+0000","last_active":"2023-09-30T22:54:07.284401+0000","last_peered":"2023-09-30T22:54:07.284401+0000","last_clean":"2023-09-30T22:54:07.284401+0000","last_became_active":"2023-09-30T22:54:07.281628+0000","last_became_peered":"2023-09-30T22:54:07.281628+0000","last_unstale":"2023-09-30T22:54:07.284401+0000","last_undegraded":"2023-09-30T22:54:07.284401+0000","last_fullsized":"2023-09-30T22:54:07.284401+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280940+0000","last_change":"2023-09-30T22:54:07.280635+0000","last_active":"2023-09-30T22:54:07.280940+0000","last_peered":"2023-09-30T22:54:07.280940+0000","last_clean":"2023-09-30T22:54:07.280940+0000","last_became_active":"2023-09-30T22:54:07.278955+0000","last_became_peered":"2023-09-30T22:54:07.278955+0000","last_unstale":"2023-09-30T22:54:07.280940+0000","last_undegraded":"2023-09-30T22:54:07.280940+0000","last_fullsized":"2023-09-30T22:54:07.280940+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:46.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285559+0000","last_change":"2023-09-30T22:54:07.284431+0000","last_active":"2023-09-30T22:54:07.285559+0000","last_peered":"2023-09-30T22:54:07.285559+0000","last_clean":"2023-09-30T22:54:07.285559+0000","last_became_active":"2023-09-30T22:54:07.284034+0000","last_became_peered":"2023-09-30T22:54:07.284034+0000","last_unstale":"2023-09-30T22:54:07.285559+0000","last_undegraded":"2023-09-30T22:54:07.285559+0000","last_fullsized":"2023-09-30T22:54:07.285559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:58:29.360202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284376+0000","last_change":"2023-09-30T22:54:07.281788+0000","last_active":"2023-09-30T22:54:07.284376+0000","last_peered":"2023-09-30T22:54:07.284376+0000","last_clean":"2023-09-30T22:54:07.284376+0000","last_became_active":"2023-09-30T22:54:07.280893+0000","last_became_peered":"2023-09-30T22:54:07.280893+0000","last_unstale":"2023-09-30T22:54:07.284376+0000","last_undegraded":"2023-09-30T22:54:07.284376+0000","last_fullsized":"2023-09-30T22:54:07.284376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:06:47.475602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288070+0000","last_change":"2023-09-30T22:54:07.287544+0000","last_active":"2023-09-30T22:54:07.288070+0000","last_peered":"2023-09-30T22:54:07.288070+0000","last_clean":"2023-09-30T22:54:07.288070+0000","last_became_active":"2023-09-30T22:54:07.287329+0000","last_became_peered":"2023-09-30T22:54:07.287329+0000","last_unstale":"2023-09-30T22:54:07.288070+0000","last_undegraded":"2023-09-30T22:54:07.288070+0000","last_fullsized":"2023-09-30T22:54:07.288070+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:47.026175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283952+0000","last_change":"2023-09-30T22:54:07.283851+0000","last_active":"2023-09-30T22:54:07.283952+0000","last_peered":"2023-09-30T22:54:07.283952+0000","last_clean":"2023-09-30T22:54:07.283952+0000","last_became_active":"2023-09-30T22:54:07.283376+0000","last_became_peered":"2023-09-30T22:54:07.283376+0000","last_unstale":"2023-09-30T22:54:07.283952+0000","last_undegraded":"2023-09-30T22:54:07.283952+0000","last_fullsized":"2023-09-30T22:54:07.283952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.278498+0000","last_change":"2023-09-30T22:54:07.278306+0000","last_active":"2023-09-30T22:54:07.278498+0000","last_peered":"2023-09-30T22:54:07.278498+0000","last_clean":"2023-09-30T22:54:07.278498+0000","last_became_active":"2023-09-30T22:54:07.278078+0000","last_became_peered":"2023-09-30T22:54:07.278078+0000","last_unstale":"2023-09-30T22:54:07.278498+0000","last_undegraded":"2023-09-30T22:54:07.278498+0000","last_fullsized":"2023-09-30T22:54:07.278498+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:14:24.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.283192+0000","last_change":"2023-09-30T22:54:07.283092+0000","last_active":"2023-09-30T22:54:07.283192+0000","last_peered":"2023-09-30T22:54:07.283192+0000","last_clean":"2023-09-30T22:54:07.283192+0000","last_became_active":"2023-09-30T22:54:07.282732+0000","last_became_peered":"2023-09-30T22:54:07.282732+0000","last_unstale":"2023-09-30T22:54:07.283192+0000","last_undegraded":"2023-09-30T22:54:07.283192+0000","last_fullsized":"2023-09-30T22:54:07.283192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:10.339100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289824+0000","last_change":"2023-09-30T22:54:07.289420+0000","last_active":"2023-09-30T22:54:07.289824+0000","last_peered":"2023-09-30T22:54:07.289824+0000","last_clean":"2023-09-30T22:54:07.289824+0000","last_became_active":"2023-09-30T22:54:07.287804+0000","last_became_peered":"2023-09-30T22:54:07.287804+0000","last_unstale":"2023-09-30T22:54:07.289824+0000","last_undegraded":"2023-09-30T22:54:07.289824+0000","last_fullsized":"2023-09-30T22:54:07.289824+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:58.841154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293662+0000","last_change":"2023-09-30T22:54:07.293573+0000","last_active":"2023-09-30T22:54:07.293662+0000","last_peered":"2023-09-30T22:54:07.293662+0000","last_clean":"2023-09-30T22:54:07.293662+0000","last_became_active":"2023-09-30T22:54:07.293351+0000","last_became_peered":"2023-09-30T22:54:07.293351+0000","last_unstale":"2023-09-30T22:54:07.293662+0000","last_undegraded":"2023-09-30T22:54:07.293662+0000","last_fullsized":"2023-09-30T22:54:07.293662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:22.311313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290814+0000","last_change":"2023-09-30T22:54:07.290744+0000","last_active":"2023-09-30T22:54:07.290814+0000","last_peered":"2023-09-30T22:54:07.290814+0000","last_clean":"2023-09-30T22:54:07.290814+0000","last_became_active":"2023-09-30T22:54:07.290452+0000","last_became_peered":"2023-09-30T22:54:07.290452+0000","last_unstale":"2023-09-30T22:54:07.290814+0000","last_undegraded":"2023-09-30T22:54:07.290814+0000","last_fullsized":"2023-09-30T22:54:07.290814+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:26.390802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285567+0000","last_change":"2023-09-30T22:54:07.285094+0000","last_active":"2023-09-30T22:54:07.285567+0000","last_peered":"2023-09-30T22:54:07.285567+0000","last_clean":"2023-09-30T22:54:07.285567+0000","last_became_active":"2023-09-30T22:54:07.284799+0000","last_became_peered":"2023-09-30T22:54:07.284799+0000","last_unstale":"2023-09-30T22:54:07.285567+0000","last_undegraded":"2023-09-30T22:54:07.285567+0000","last_fullsized":"2023-09-30T22:54:07.285567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:50.135141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293007+0000","last_change":"2023-09-30T22:54:07.292335+0000","last_active":"2023-09-30T22:54:07.293007+0000","last_peered":"2023-09-30T22:54:07.293007+0000","last_clean":"2023-09-30T22:54:07.293007+0000","last_became_active":"2023-09-30T22:54:07.291140+0000","last_became_peered":"2023-09-30T22:54:07.291140+0000","last_unstale":"2023-09-30T22:54:07.293007+0000","last_undegraded":"2023-09-30T22:54:07.293007+0000","last_fullsized":"2023-09-30T22:54:07.293007+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:39:08.162123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284565+0000","last_change":"2023-09-30T22:54:07.281031+0000","last_active":"2023-09-30T22:54:07.284565+0000","last_peered":"2023-09-30T22:54:07.284565+0000","last_clean":"2023-09-30T22:54:07.284565+0000","last_became_active":"2023-09-30T22:54:07.280787+0000","last_became_peered":"2023-09-30T22:54:07.280787+0000","last_unstale":"2023-09-30T22:54:07.284565+0000","last_undegraded":"2023-09-30T22:54:07.284565+0000","last_fullsized":"2023-09-30T22:54:07.284565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:16.744462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277149+0000","last_change":"2023-09-30T22:54:07.277070+0000","last_active":"2023-09-30T22:54:07.277149+0000","last_peered":"2023-09-30T22:54:07.277149+0000","last_clean":"2023-09-30T22:54:07.277149+0000","last_became_active":"2023-09-30T22:54:07.276819+0000","last_became_peered":"2023-09-30T22:54:07.276819+0000","last_unstale":"2023-09-30T22:54:07.277149+0000","last_undegraded":"2023-09-30T22:54:07.277149+0000","last_fullsized":"2023-09-30T22:54:07.277149+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287937+0000","last_change":"2023-09-30T22:54:07.287157+0000","last_active":"2023-09-30T22:54:07.287937+0000","last_peered":"2023-09-30T22:54:07.287937+0000","last_clean":"2023-09-30T22:54:07.287937+0000","last_became_active":"2023-09-30T22:54:07.286772+0000","last_became_peered":"2023-09-30T22:54:07.286772+0000","last_unstale":"2023-09-30T22:54:07.287937+0000","last_undegraded":"2023-09-30T22:54:07.287937+0000","last_fullsized":"2023-09-30T22:54:07.287937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:19:55.360729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288424+0000","last_change":"2023-09-30T22:54:07.286820+0000","last_active":"2023-09-30T22:54:07.288424+0000","last_peered":"2023-09-30T22:54:07.288424+0000","last_clean":"2023-09-30T22:54:07.288424+0000","last_became_active":"2023-09-30T22:54:07.286546+0000","last_became_peered":"2023-09-30T22:54:07.286546+0000","last_unstale":"2023-09-30T22:54:07.288424+0000","last_undegraded":"2023-09-30T22:54:07.288424+0000","last_fullsized":"2023-09-30T22:54:07.288424+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:49.534284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287972+0000","last_change":"2023-09-30T22:54:07.287275+0000","last_active":"2023-09-30T22:54:07.287972+0000","last_peered":"2023-09-30T22:54:07.287972+0000","last_clean":"2023-09-30T22:54:07.287972+0000","last_became_active":"2023-09-30T22:54:07.286742+0000","last_became_peered":"2023-09-30T22:54:07.286742+0000","last_unstale":"2023-09-30T22:54:07.287972+0000","last_undegraded":"2023-09-30T22:54:07.287972+0000","last_fullsized":"2023-09-30T22:54:07.287972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284532+0000","last_change":"2023-09-30T22:54:07.282640+0000","last_active":"2023-09-30T22:54:07.284532+0000","last_peered":"2023-09-30T22:54:07.284532+0000","last_clean":"2023-09-30T22:54:07.284532+0000","last_became_active":"2023-09-30T22:54:07.282407+0000","last_became_peered":"2023-09-30T22:54:07.282407+0000","last_unstale":"2023-09-30T22:54:07.284532+0000","last_undegraded":"2023-09-30T22:54:07.284532+0000","last_fullsized":"2023-09-30T22:54:07.284532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289997+0000","last_change":"2023-09-30T22:54:07.289529+0000","last_active":"2023-09-30T22:54:07.289997+0000","last_peered":"2023-09-30T22:54:07.289997+0000","last_clean":"2023-09-30T22:54:07.289997+0000","last_became_active":"2023-09-30T22:54:07.288847+0000","last_became_peered":"2023-09-30T22:54:07.288847+0000","last_unstale":"2023-09-30T22:54:07.289997+0000","last_undegraded":"2023-09-30T22:54:07.289997+0000","last_fullsized":"2023-09-30T22:54:07.289997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:27.314727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.287911+0000","last_change":"2023-09-30T22:54:07.287004+0000","last_active":"2023-09-30T22:54:07.287911+0000","last_peered":"2023-09-30T22:54:07.287911+0000","last_clean":"2023-09-30T22:54:07.287911+0000","last_became_active":"2023-09-30T22:54:07.286466+0000","last_became_peered":"2023-09-30T22:54:07.286466+0000","last_unstale":"2023-09-30T22:54:07.287911+0000","last_undegraded":"2023-09-30T22:54:07.287911+0000","last_fullsized":"2023-09-30T22:54:07.287911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:38.748953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288051+0000","last_change":"2023-09-30T22:54:07.287889+0000","last_active":"2023-09-30T22:54:07.288051+0000","last_peered":"2023-09-30T22:54:07.288051+0000","last_clean":"2023-09-30T22:54:07.288051+0000","last_became_active":"2023-09-30T22:54:07.287632+0000","last_became_peered":"2023-09-30T22:54:07.287632+0000","last_unstale":"2023-09-30T22:54:07.288051+0000","last_undegraded":"2023-09-30T22:54:07.288051+0000","last_fullsized":"2023-09-30T22:54:07.288051+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:32.771273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284763+0000","last_change":"2023-09-30T22:54:07.284627+0000","last_active":"2023-09-30T22:54:07.284763+0000","last_peered":"2023-09-30T22:54:07.284763+0000","last_clean":"2023-09-30T22:54:07.284763+0000","last_became_active":"2023-09-30T22:54:07.284389+0000","last_became_peered":"2023-09-30T22:54:07.284389+0000","last_unstale":"2023-09-30T22:54:07.284763+0000","last_undegraded":"2023-09-30T22:54:07.284763+0000","last_fullsized":"2023-09-30T22:54:07.284763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:13:01.671172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286174+0000","last_change":"2023-09-30T22:54:06.274358+0000","last_active":"2023-09-30T22:54:07.286174+0000","last_peered":"2023-09-30T22:54:07.286174+0000","last_clean":"2023-09-30T22:54:07.286174+0000","last_became_active":"2023-09-30T22:54:06.274137+0000","last_became_peered":"2023-09-30T22:54:06.274137+0000","last_unstale":"2023-09-30T22:54:07.286174+0000","last_undegraded":"2023-09-30T22:54:07.286174+0000","last_fullsized":"2023-09-30T22:54:07.286174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285198+0000","last_change":"2023-09-30T22:54:07.285124+0000","last_active":"2023-09-30T22:54:07.285198+0000","last_peered":"2023-09-30T22:54:07.285198+0000","last_clean":"2023-09-30T22:54:07.285198+0000","last_became_active":"2023-09-30T22:54:07.284907+0000","last_became_peered":"2023-09-30T22:54:07.284907+0000","last_unstale":"2023-09-30T22:54:07.285198+0000","last_undegraded":"2023-09-30T22:54:07.285198+0000","last_fullsized":"2023-09-30T22:54:07.285198+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:54.397192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294231+0000","last_change":"2023-09-30T22:54:06.283446+0000","last_active":"2023-09-30T22:54:07.294231+0000","last_peered":"2023-09-30T22:54:07.294231+0000","last_clean":"2023-09-30T22:54:07.294231+0000","last_became_active":"2023-09-30T22:54:06.283085+0000","last_became_peered":"2023-09-30T22:54:06.283085+0000","last_unstale":"2023-09-30T22:54:07.294231+0000","last_undegraded":"2023-09-30T22:54:07.294231+0000","last_fullsized":"2023-09-30T22:54:07.294231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285704+0000","last_change":"2023-09-30T22:54:07.285545+0000","last_active":"2023-09-30T22:54:07.285704+0000","last_peered":"2023-09-30T22:54:07.285704+0000","last_clean":"2023-09-30T22:54:07.285704+0000","last_became_active":"2023-09-30T22:54:07.285330+0000","last_became_peered":"2023-09-30T22:54:07.285330+0000","last_unstale":"2023-09-30T22:54:07.285704+0000","last_undegraded":"2023-09-30T22:54:07.285704+0000","last_fullsized":"2023-09-30T22:54:07.285704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:04.259944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290820+0000","last_change":"2023-09-30T22:54:06.281913+0000","last_active":"2023-09-30T22:54:07.290820+0000","last_peered":"2023-09-30T22:54:07.290820+0000","last_clean":"2023-09-30T22:54:07.290820+0000","last_became_active":"2023-09-30T22:54:06.281648+0000","last_became_peered":"2023-09-30T22:54:06.281648+0000","last_unstale":"2023-09-30T22:54:07.290820+0000","last_undegraded":"2023-09-30T22:54:07.290820+0000","last_fullsized":"2023-09-30T22:54:07.290820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:52.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289610+0000","last_change":"2023-09-30T22:54:07.289396+0000","last_active":"2023-09-30T22:54:07.289610+0000","last_peered":"2023-09-30T22:54:07.289610+0000","last_clean":"2023-09-30T22:54:07.289610+0000","last_became_active":"2023-09-30T22:54:07.288864+0000","last_became_peered":"2023-09-30T22:54:07.288864+0000","last_unstale":"2023-09-30T22:54:07.289610+0000","last_undegraded":"2023-09-30T22:54:07.289610+0000","last_fullsized":"2023-09-30T22:54:07.289610+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:59.949127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.293370+0000","last_change":"2023-09-30T22:54:06.282802+0000","last_active":"2023-09-30T22:54:07.293370+0000","last_peered":"2023-09-30T22:54:07.293370+0000","last_clean":"2023-09-30T22:54:07.293370+0000","last_became_active":"2023-09-30T22:54:06.282576+0000","last_became_peered":"2023-09-30T22:54:06.282576+0000","last_unstale":"2023-09-30T22:54:07.293370+0000","last_undegraded":"2023-09-30T22:54:07.293370+0000","last_fullsized":"2023-09-30T22:54:07.293370+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:35:36.128040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289816+0000","last_change":"2023-09-30T22:54:07.289495+0000","last_active":"2023-09-30T22:54:07.289816+0000","last_peered":"2023-09-30T22:54:07.289816+0000","last_clean":"2023-09-30T22:54:07.289816+0000","last_became_active":"2023-09-30T22:54:07.289283+0000","last_became_peered":"2023-09-30T22:54:07.289283+0000","last_unstale":"2023-09-30T22:54:07.289816+0000","last_undegraded":"2023-09-30T22:54:07.289816+0000","last_fullsized":"2023-09-30T22:54:07.289816+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:41.000107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294012+0000","last_change":"2023-09-30T22:54:06.285268+0000","last_active":"2023-09-30T22:54:07.294012+0000","last_peered":"2023-09-30T22:54:07.294012+0000","last_clean":"2023-09-30T22:54:07.294012+0000","last_became_active":"2023-09-30T22:54:06.284975+0000","last_became_peered":"2023-09-30T22:54:06.284975+0000","last_unstale":"2023-09-30T22:54:07.294012+0000","last_undegraded":"2023-09-30T22:54:07.294012+0000","last_fullsized":"2023-09-30T22:54:07.294012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288839+0000","last_change":"2023-09-30T22:54:07.288762+0000","last_active":"2023-09-30T22:54:07.288839+0000","last_peered":"2023-09-30T22:54:07.288839+0000","last_clean":"2023-09-30T22:54:07.288839+0000","last_became_active":"2023-09-30T22:54:07.288451+0000","last_became_peered":"2023-09-30T22:54:07.288451+0000","last_unstale":"2023-09-30T22:54:07.288839+0000","last_undegraded":"2023-09-30T22:54:07.288839+0000","last_fullsized":"2023-09-30T22:54:07.288839+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:04.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285519+0000","last_change":"2023-09-30T22:54:06.279537+0000","last_active":"2023-09-30T22:54:07.285519+0000","last_peered":"2023-09-30T22:54:07.285519+0000","last_clean":"2023-09-30T22:54:07.285519+0000","last_became_active":"2023-09-30T22:54:06.279241+0000","last_became_peered":"2023-09-30T22:54:06.279241+0000","last_unstale":"2023-09-30T22:54:07.285519+0000","last_undegraded":"2023-09-30T22:54:07.285519+0000","last_fullsized":"2023-09-30T22:54:07.285519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:33:04.622185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286844+0000","last_change":"2023-09-30T22:54:07.286569+0000","last_active":"2023-09-30T22:54:07.286844+0000","last_peered":"2023-09-30T22:54:07.286844+0000","last_clean":"2023-09-30T22:54:07.286844+0000","last_became_active":"2023-09-30T22:54:07.286198+0000","last_became_peered":"2023-09-30T22:54:07.286198+0000","last_unstale":"2023-09-30T22:54:07.286844+0000","last_undegraded":"2023-09-30T22:54:07.286844+0000","last_fullsized":"2023-09-30T22:54:07.286844+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276462+0000","last_change":"2023-09-30T22:54:06.280234+0000","last_active":"2023-09-30T22:54:07.276462+0000","last_peered":"2023-09-30T22:54:07.276462+0000","last_clean":"2023-09-30T22:54:07.276462+0000","last_became_active":"2023-09-30T22:54:06.279996+0000","last_became_peered":"2023-09-30T22:54:06.279996+0000","last_unstale":"2023-09-30T22:54:07.276462+0000","last_undegraded":"2023-09-30T22:54:07.276462+0000","last_fullsized":"2023-09-30T22:54:07.276462+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281797+0000","last_change":"2023-09-30T22:54:07.281697+0000","last_active":"2023-09-30T22:54:07.281797+0000","last_peered":"2023-09-30T22:54:07.281797+0000","last_clean":"2023-09-30T22:54:07.281797+0000","last_became_active":"2023-09-30T22:54:07.281257+0000","last_became_peered":"2023-09-30T22:54:07.281257+0000","last_unstale":"2023-09-30T22:54:07.281797+0000","last_undegraded":"2023-09-30T22:54:07.281797+0000","last_fullsized":"2023-09-30T22:54:07.281797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.409096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280608+0000","last_change":"2023-09-30T22:54:06.281185+0000","last_active":"2023-09-30T22:54:07.280608+0000","last_peered":"2023-09-30T22:54:07.280608+0000","last_clean":"2023-09-30T22:54:07.280608+0000","last_became_active":"2023-09-30T22:54:06.280705+0000","last_became_peered":"2023-09-30T22:54:06.280705+0000","last_unstale":"2023-09-30T22:54:07.280608+0000","last_undegraded":"2023-09-30T22:54:07.280608+0000","last_fullsized":"2023-09-30T22:54:07.280608+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:09.336177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292647+0000","last_change":"2023-09-30T22:54:07.292529+0000","last_active":"2023-09-30T22:54:07.292647+0000","last_peered":"2023-09-30T22:54:07.292647+0000","last_clean":"2023-09-30T22:54:07.292647+0000","last_became_active":"2023-09-30T22:54:07.291546+0000","last_became_peered":"2023-09-30T22:54:07.291546+0000","last_unstale":"2023-09-30T22:54:07.292647+0000","last_undegraded":"2023-09-30T22:54:07.292647+0000","last_fullsized":"2023-09-30T22:54:07.292647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:23.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.278998+0000","last_change":"2023-09-30T22:54:06.275367+0000","last_active":"2023-09-30T22:54:07.278998+0000","last_peered":"2023-09-30T22:54:07.278998+0000","last_clean":"2023-09-30T22:54:07.278998+0000","last_became_active":"2023-09-30T22:54:06.275116+0000","last_became_peered":"2023-09-30T22:54:06.275116+0000","last_unstale":"2023-09-30T22:54:07.278998+0000","last_undegraded":"2023-09-30T22:54:07.278998+0000","last_fullsized":"2023-09-30T22:54:07.278998+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:10.629629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281978+0000","last_change":"2023-09-30T22:54:07.281779+0000","last_active":"2023-09-30T22:54:07.281978+0000","last_peered":"2023-09-30T22:54:07.281978+0000","last_clean":"2023-09-30T22:54:07.281978+0000","last_became_active":"2023-09-30T22:54:07.281409+0000","last_became_peered":"2023-09-30T22:54:07.281409+0000","last_unstale":"2023-09-30T22:54:07.281978+0000","last_undegraded":"2023-09-30T22:54:07.281978+0000","last_fullsized":"2023-09-30T22:54:07.281978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:27:23.188033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275811+0000","last_change":"2023-09-30T22:54:06.271026+0000","last_active":"2023-09-30T22:54:07.275811+0000","last_peered":"2023-09-30T22:54:07.275811+0000","last_clean":"2023-09-30T22:54:07.275811+0000","last_became_active":"2023-09-30T22:54:06.270808+0000","last_became_peered":"2023-09-30T22:54:06.270808+0000","last_unstale":"2023-09-30T22:54:07.275811+0000","last_undegraded":"2023-09-30T22:54:07.275811+0000","last_fullsized":"2023-09-30T22:54:07.275811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:13.169498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291410+0000","last_change":"2023-09-30T22:54:07.289332+0000","last_active":"2023-09-30T22:54:07.291410+0000","last_peered":"2023-09-30T22:54:07.291410+0000","last_clean":"2023-09-30T22:54:07.291410+0000","last_became_active":"2023-09-30T22:54:07.288811+0000","last_became_peered":"2023-09-30T22:54:07.288811+0000","last_unstale":"2023-09-30T22:54:07.291410+0000","last_undegraded":"2023-09-30T22:54:07.291410+0000","last_fullsized":"2023-09-30T22:54:07.291410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284174+0000","last_change":"2023-09-30T22:54:06.281865+0000","last_active":"2023-09-30T22:54:07.284174+0000","last_peered":"2023-09-30T22:54:07.284174+0000","last_clean":"2023-09-30T22:54:07.284174+0000","last_became_active":"2023-09-30T22:54:06.281674+0000","last_became_peered":"2023-09-30T22:54:06.281674+0000","last_unstale":"2023-09-30T22:54:07.284174+0000","last_undegraded":"2023-09-30T22:54:07.284174+0000","last_fullsized":"2023-09-30T22:54:07.284174+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:23.908829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289516+0000","last_change":"2023-09-30T22:54:07.289407+0000","last_active":"2023-09-30T22:54:07.289516+0000","last_peered":"2023-09-30T22:54:07.289516+0000","last_clean":"2023-09-30T22:54:07.289516+0000","last_became_active":"2023-09-30T22:54:07.289033+0000","last_became_peered":"2023-09-30T22:54:07.289033+0000","last_unstale":"2023-09-30T22:54:07.289516+0000","last_undegraded":"2023-09-30T22:54:07.289516+0000","last_fullsized":"2023-09-30T22:54:07.289516+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295932+0000","last_change":"2023-09-30T22:54:06.286681+0000","last_active":"2023-09-30T22:54:07.295932+0000","last_peered":"2023-09-30T22:54:07.295932+0000","last_clean":"2023-09-30T22:54:07.295932+0000","last_became_active":"2023-09-30T22:54:06.286440+0000","last_became_peered":"2023-09-30T22:54:06.286440+0000","last_unstale":"2023-09-30T22:54:07.295932+0000","last_undegraded":"2023-09-30T22:54:07.295932+0000","last_fullsized":"2023-09-30T22:54:07.295932+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:13.678984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291537+0000","last_change":"2023-09-30T22:54:07.291459+0000","last_active":"2023-09-30T22:54:07.291537+0000","last_peered":"2023-09-30T22:54:07.291537+0000","last_clean":"2023-09-30T22:54:07.291537+0000","last_became_active":"2023-09-30T22:54:07.291228+0000","last_became_peered":"2023-09-30T22:54:07.291228+0000","last_unstale":"2023-09-30T22:54:07.291537+0000","last_undegraded":"2023-09-30T22:54:07.291537+0000","last_fullsized":"2023-09-30T22:54:07.291537+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:40.906770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294820+0000","last_change":"2023-09-30T22:54:06.276631+0000","last_active":"2023-09-30T22:54:07.294820+0000","last_peered":"2023-09-30T22:54:07.294820+0000","last_clean":"2023-09-30T22:54:07.294820+0000","last_became_active":"2023-09-30T22:54:06.276205+0000","last_became_peered":"2023-09-30T22:54:06.276205+0000","last_unstale":"2023-09-30T22:54:07.294820+0000","last_undegraded":"2023-09-30T22:54:07.294820+0000","last_fullsized":"2023-09-30T22:54:07.294820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276163+0000","last_change":"2023-09-30T22:54:07.276089+0000","last_active":"2023-09-30T22:54:07.276163+0000","last_peered":"2023-09-30T22:54:07.276163+0000","last_clean":"2023-09-30T22:54:07.276163+0000","last_became_active":"2023-09-30T22:54:07.275805+0000","last_became_peered":"2023-09-30T22:54:07.275805+0000","last_unstale":"2023-09-30T22:54:07.276163+0000","last_undegraded":"2023-09-30T22:54:07.276163+0000","last_fullsized":"2023-09-30T22:54:07.276163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279086+0000","last_change":"2023-09-30T22:54:06.278684+0000","last_active":"2023-09-30T22:54:07.279086+0000","last_peered":"2023-09-30T22:54:07.279086+0000","last_clean":"2023-09-30T22:54:07.279086+0000","last_became_active":"2023-09-30T22:54:06.278481+0000","last_became_peered":"2023-09-30T22:54:06.278481+0000","last_unstale":"2023-09-30T22:54:07.279086+0000","last_undegraded":"2023-09-30T22:54:07.279086+0000","last_fullsized":"2023-09-30T22:54:07.279086+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:55.393916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281373+0000","last_change":"2023-09-30T22:54:07.281290+0000","last_active":"2023-09-30T22:54:07.281373+0000","last_peered":"2023-09-30T22:54:07.281373+0000","last_clean":"2023-09-30T22:54:07.281373+0000","last_became_active":"2023-09-30T22:54:07.281060+0000","last_became_peered":"2023-09-30T22:54:07.281060+0000","last_unstale":"2023-09-30T22:54:07.281373+0000","last_undegraded":"2023-09-30T22:54:07.281373+0000","last_fullsized":"2023-09-30T22:54:07.281373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285915+0000","last_change":"2023-09-30T22:54:06.277690+0000","last_active":"2023-09-30T22:54:07.285915+0000","last_peered":"2023-09-30T22:54:07.285915+0000","last_clean":"2023-09-30T22:54:07.285915+0000","last_became_active":"2023-09-30T22:54:06.277355+0000","last_became_peered":"2023-09-30T22:54:06.277355+0000","last_unstale":"2023-09-30T22:54:07.285915+0000","last_undegraded":"2023-09-30T22:54:07.285915+0000","last_fullsized":"2023-09-30T22:54:07.285915+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:19:53.590302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288633+0000","last_change":"2023-09-30T22:54:07.288573+0000","last_active":"2023-09-30T22:54:07.288633+0000","last_peered":"2023-09-30T22:54:07.288633+0000","last_clean":"2023-09-30T22:54:07.288633+0000","last_became_active":"2023-09-30T22:54:07.287765+0000","last_became_peered":"2023-09-30T22:54:07.287765+0000","last_unstale":"2023-09-30T22:54:07.288633+0000","last_undegraded":"2023-09-30T22:54:07.288633+0000","last_fullsized":"2023-09-30T22:54:07.288633+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:27.314727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295216+0000","last_change":"2023-09-30T22:54:06.286073+0000","last_active":"2023-09-30T22:54:07.295216+0000","last_peered":"2023-09-30T22:54:07.295216+0000","last_clean":"2023-09-30T22:54:07.295216+0000","last_became_active":"2023-09-30T22:54:06.285829+0000","last_became_peered":"2023-09-30T22:54:06.285829+0000","last_unstale":"2023-09-30T22:54:07.295216+0000","last_undegraded":"2023-09-30T22:54:07.295216+0000","last_fullsized":"2023-09-30T22:54:07.295216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:39.997183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277782+0000","last_change":"2023-09-30T22:54:07.277704+0000","last_active":"2023-09-30T22:54:07.277782+0000","last_peered":"2023-09-30T22:54:07.277782+0000","last_clean":"2023-09-30T22:54:07.277782+0000","last_became_active":"2023-09-30T22:54:07.277473+0000","last_became_peered":"2023-09-30T22:54:07.277473+0000","last_unstale":"2023-09-30T22:54:07.277782+0000","last_undegraded":"2023-09-30T22:54:07.277782+0000","last_fullsized":"2023-09-30T22:54:07.277782+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:11.632552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.294141+0000","last_change":"2023-09-30T22:54:06.283300+0000","last_active":"2023-09-30T22:54:07.294141+0000","last_peered":"2023-09-30T22:54:07.294141+0000","last_clean":"2023-09-30T22:54:07.294141+0000","last_became_active":"2023-09-30T22:54:06.282769+0000","last_became_peered":"2023-09-30T22:54:06.282769+0000","last_unstale":"2023-09-30T22:54:07.294141+0000","last_undegraded":"2023-09-30T22:54:07.294141+0000","last_fullsized":"2023-09-30T22:54:07.294141+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291447+0000","last_change":"2023-09-30T22:54:07.290082+0000","last_active":"2023-09-30T22:54:07.291447+0000","last_peered":"2023-09-30T22:54:07.291447+0000","last_clean":"2023-09-30T22:54:07.291447+0000","last_became_active":"2023-09-30T22:54:07.289698+0000","last_became_peered":"2023-09-30T22:54:07.289698+0000","last_unstale":"2023-09-30T22:54:07.291447+0000","last_undegraded":"2023-09-30T22:54:07.291447+0000","last_fullsized":"2023-09-30T22:54:07.291447+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:27.024013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290647+0000","last_change":"2023-09-30T22:54:06.276472+0000","last_active":"2023-09-30T22:54:07.290647+0000","last_peered":"2023-09-30T22:54:07.290647+0000","last_clean":"2023-09-30T22:54:07.290647+0000","last_became_active":"2023-09-30T22:54:06.275828+0000","last_became_peered":"2023-09-30T22:54:06.275828+0000","last_unstale":"2023-09-30T22:54:07.290647+0000","last_undegraded":"2023-09-30T22:54:07.290647+0000","last_fullsized":"2023-09-30T22:54:07.290647+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:34:54.384228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292887+0000","last_change":"2023-09-30T22:54:07.292818+0000","last_active":"2023-09-30T22:54:07.292887+0000","last_peered":"2023-09-30T22:54:07.292887+0000","last_clean":"2023-09-30T22:54:07.292887+0000","last_became_active":"2023-09-30T22:54:07.292518+0000","last_became_peered":"2023-09-30T22:54:07.292518+0000","last_unstale":"2023-09-30T22:54:07.292887+0000","last_undegraded":"2023-09-30T22:54:07.292887+0000","last_fullsized":"2023-09-30T22:54:07.292887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:36.788658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292192+0000","last_change":"2023-09-30T22:54:06.281858+0000","last_active":"2023-09-30T22:54:07.292192+0000","last_peered":"2023-09-30T22:54:07.292192+0000","last_clean":"2023-09-30T22:54:07.292192+0000","last_became_active":"2023-09-30T22:54:06.281635+0000","last_became_peered":"2023-09-30T22:54:06.281635+0000","last_unstale":"2023-09-30T22:54:07.292192+0000","last_undegraded":"2023-09-30T22:54:07.292192+0000","last_fullsized":"2023-09-30T22:54:07.292192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:26.021090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279540+0000","last_change":"2023-09-30T22:54:07.279437+0000","last_active":"2023-09-30T22:54:07.279540+0000","last_peered":"2023-09-30T22:54:07.279540+0000","last_clean":"2023-09-30T22:54:07.279540+0000","last_became_active":"2023-09-30T22:54:07.278738+0000","last_became_peered":"2023-09-30T22:54:07.278738+0000","last_unstale":"2023-09-30T22:54:07.279540+0000","last_undegraded":"2023-09-30T22:54:07.279540+0000","last_fullsized":"2023-09-30T22:54:07.279540+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.286027+0000","last_change":"2023-09-30T22:54:06.283372+0000","last_active":"2023-09-30T22:54:07.286027+0000","last_peered":"2023-09-30T22:54:07.286027+0000","last_clean":"2023-09-30T22:54:07.286027+0000","last_became_active":"2023-09-30T22:54:06.283156+0000","last_became_peered":"2023-09-30T22:54:06.283156+0000","last_unstale":"2023-09-30T22:54:07.286027+0000","last_undegraded":"2023-09-30T22:54:07.286027+0000","last_fullsized":"2023-09-30T22:54:07.286027+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:24:10.857387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288012+0000","last_change":"2023-09-30T22:54:07.287736+0000","last_active":"2023-09-30T22:54:07.288012+0000","last_peered":"2023-09-30T22:54:07.288012+0000","last_clean":"2023-09-30T22:54:07.288012+0000","last_became_active":"2023-09-30T22:54:07.287358+0000","last_became_peered":"2023-09-30T22:54:07.287358+0000","last_unstale":"2023-09-30T22:54:07.288012+0000","last_undegraded":"2023-09-30T22:54:07.288012+0000","last_fullsized":"2023-09-30T22:54:07.288012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:40:44.145167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.295776+0000","last_change":"2023-09-30T22:54:06.278096+0000","last_active":"2023-09-30T22:54:07.295776+0000","last_peered":"2023-09-30T22:54:07.295776+0000","last_clean":"2023-09-30T22:54:07.295776+0000","last_became_active":"2023-09-30T22:54:06.274665+0000","last_became_peered":"2023-09-30T22:54:06.274665+0000","last_unstale":"2023-09-30T22:54:07.295776+0000","last_undegraded":"2023-09-30T22:54:07.295776+0000","last_fullsized":"2023-09-30T22:54:07.295776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:33:30.719322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.290301+0000","last_change":"2023-09-30T22:54:07.290229+0000","last_active":"2023-09-30T22:54:07.290301+0000","last_peered":"2023-09-30T22:54:07.290301+0000","last_clean":"2023-09-30T22:54:07.290301+0000","last_became_active":"2023-09-30T22:54:07.290009+0000","last_became_peered":"2023-09-30T22:54:07.290009+0000","last_unstale":"2023-09-30T22:54:07.290301+0000","last_undegraded":"2023-09-30T22:54:07.290301+0000","last_fullsized":"2023-09-30T22:54:07.290301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:27.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280023+0000","last_change":"2023-09-30T22:54:06.281951+0000","last_active":"2023-09-30T22:54:07.280023+0000","last_peered":"2023-09-30T22:54:07.280023+0000","last_clean":"2023-09-30T22:54:07.280023+0000","last_became_active":"2023-09-30T22:54:06.281513+0000","last_became_peered":"2023-09-30T22:54:06.281513+0000","last_unstale":"2023-09-30T22:54:07.280023+0000","last_undegraded":"2023-09-30T22:54:07.280023+0000","last_fullsized":"2023-09-30T22:54:07.280023+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.291431+0000","last_change":"2023-09-30T22:54:07.289474+0000","last_active":"2023-09-30T22:54:07.291431+0000","last_peered":"2023-09-30T22:54:07.291431+0000","last_clean":"2023-09-30T22:54:07.291431+0000","last_became_active":"2023-09-30T22:54:07.289121+0000","last_became_peered":"2023-09-30T22:54:07.289121+0000","last_unstale":"2023-09-30T22:54:07.291431+0000","last_undegraded":"2023-09-30T22:54:07.291431+0000","last_fullsized":"2023-09-30T22:54:07.291431+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:16.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276066+0000","last_change":"2023-09-30T22:54:06.284019+0000","last_active":"2023-09-30T22:54:07.276066+0000","last_peered":"2023-09-30T22:54:07.276066+0000","last_clean":"2023-09-30T22:54:07.276066+0000","last_became_active":"2023-09-30T22:54:06.283783+0000","last_became_peered":"2023-09-30T22:54:06.283783+0000","last_unstale":"2023-09-30T22:54:07.276066+0000","last_undegraded":"2023-09-30T22:54:07.276066+0000","last_fullsized":"2023-09-30T22:54:07.276066+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:45.528979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280961+0000","last_change":"2023-09-30T22:54:07.280854+0000","last_active":"2023-09-30T22:54:07.280961+0000","last_peered":"2023-09-30T22:54:07.280961+0000","last_clean":"2023-09-30T22:54:07.280961+0000","last_became_active":"2023-09-30T22:54:07.280389+0000","last_became_peered":"2023-09-30T22:54:07.280389+0000","last_unstale":"2023-09-30T22:54:07.280961+0000","last_undegraded":"2023-09-30T22:54:07.280961+0000","last_fullsized":"2023-09-30T22:54:07.280961+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:59.949127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.273211+0000","last_change":"2023-09-30T22:54:06.280742+0000","last_active":"2023-09-30T22:54:07.273211+0000","last_peered":"2023-09-30T22:54:07.273211+0000","last_clean":"2023-09-30T22:54:07.273211+0000","last_became_active":"2023-09-30T22:54:06.280380+0000","last_became_peered":"2023-09-30T22:54:06.280380+0000","last_unstale":"2023-09-30T22:54:07.273211+0000","last_undegraded":"2023-09-30T22:54:07.273211+0000","last_fullsized":"2023-09-30T22:54:07.273211+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:01.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289627+0000","last_change":"2023-09-30T22:54:07.289546+0000","last_active":"2023-09-30T22:54:07.289627+0000","last_peered":"2023-09-30T22:54:07.289627+0000","last_clean":"2023-09-30T22:54:07.289627+0000","last_became_active":"2023-09-30T22:54:07.289175+0000","last_became_peered":"2023-09-30T22:54:07.289175+0000","last_unstale":"2023-09-30T22:54:07.289627+0000","last_undegraded":"2023-09-30T22:54:07.289627+0000","last_fullsized":"2023-09-30T22:54:07.289627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:58:29.360202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285151+0000","last_change":"2023-09-30T22:54:06.277243+0000","last_active":"2023-09-30T22:54:07.285151+0000","last_peered":"2023-09-30T22:54:07.285151+0000","last_clean":"2023-09-30T22:54:07.285151+0000","last_became_active":"2023-09-30T22:54:06.276913+0000","last_became_peered":"2023-09-30T22:54:06.276913+0000","last_unstale":"2023-09-30T22:54:07.285151+0000","last_undegraded":"2023-09-30T22:54:07.285151+0000","last_fullsized":"2023-09-30T22:54:07.285151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:04.627516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275923+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:54:07.275923+0000","last_peered":"2023-09-30T22:54:07.275923+0000","last_clean":"2023-09-30T22:54:07.275923+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:54:07.275923+0000","last_undegraded":"2023-09-30T22:54:07.275923+0000","last_fullsized":"2023-09-30T22:54:07.275923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.281761+0000","last_change":"2023-09-30T22:54:07.281484+0000","last_active":"2023-09-30T22:54:07.281761+0000","last_peered":"2023-09-30T22:54:07.281761+0000","last_clean":"2023-09-30T22:54:07.281761+0000","last_became_active":"2023-09-30T22:54:07.280948+0000","last_became_peered":"2023-09-30T22:54:07.280948+0000","last_unstale":"2023-09-30T22:54:07.281761+0000","last_undegraded":"2023-09-30T22:54:07.281761+0000","last_fullsized":"2023-09-30T22:54:07.281761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:24.911752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.285935+0000","last_change":"2023-09-30T22:54:06.280275+0000","last_active":"2023-09-30T22:54:07.285935+0000","last_peered":"2023-09-30T22:54:07.285935+0000","last_clean":"2023-09-30T22:54:07.285935+0000","last_became_active":"2023-09-30T22:54:06.280036+0000","last_became_peered":"2023-09-30T22:54:06.280036+0000","last_unstale":"2023-09-30T22:54:07.285935+0000","last_undegraded":"2023-09-30T22:54:07.285935+0000","last_fullsized":"2023-09-30T22:54:07.285935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:46.023252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277374+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:54:07.277374+0000","last_peered":"2023-09-30T22:54:07.277374+0000","last_clean":"2023-09-30T22:54:07.277374+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:54:07.277374+0000","last_undegraded":"2023-09-30T22:54:07.277374+0000","last_fullsized":"2023-09-30T22:54:07.277374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288611+0000","last_change":"2023-09-30T22:54:07.288374+0000","last_active":"2023-09-30T22:54:07.288611+0000","last_peered":"2023-09-30T22:54:07.288611+0000","last_clean":"2023-09-30T22:54:07.288611+0000","last_became_active":"2023-09-30T22:54:07.287298+0000","last_became_peered":"2023-09-30T22:54:07.287298+0000","last_unstale":"2023-09-30T22:54:07.288611+0000","last_undegraded":"2023-09-30T22:54:07.288611+0000","last_fullsized":"2023-09-30T22:54:07.288611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:48.421115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280430+0000","last_change":"2023-09-30T22:54:06.280988+0000","last_active":"2023-09-30T22:54:07.280430+0000","last_peered":"2023-09-30T22:54:07.280430+0000","last_clean":"2023-09-30T22:54:07.280430+0000","last_became_active":"2023-09-30T22:54:06.280317+0000","last_became_peered":"2023-09-30T22:54:06.280317+0000","last_unstale":"2023-09-30T22:54:07.280430+0000","last_undegraded":"2023-09-30T22:54:07.280430+0000","last_fullsized":"2023-09-30T22:54:07.280430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:40:26.869196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.275293+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:54:07.275293+0000","last_peered":"2023-09-30T22:54:07.275293+0000","last_clean":"2023-09-30T22:54:07.275293+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:54:07.275293+0000","last_undegraded":"2023-09-30T22:54:07.275293+0000","last_fullsized":"2023-09-30T22:54:07.275293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.292811+0000","last_change":"2023-09-30T22:54:07.292676+0000","last_active":"2023-09-30T22:54:07.292811+0000","last_peered":"2023-09-30T22:54:07.292811+0000","last_clean":"2023-09-30T22:54:07.292811+0000","last_became_active":"2023-09-30T22:54:07.292313+0000","last_became_peered":"2023-09-30T22:54:07.292313+0000","last_unstale":"2023-09-30T22:54:07.292811+0000","last_undegraded":"2023-09-30T22:54:07.292811+0000","last_fullsized":"2023-09-30T22:54:07.292811+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:14.681908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-09-30T22:54:10.265427+0000","last_change":"2023-09-30T22:54:06.281336+0000","last_active":"2023-09-30T22:54:10.265427+0000","last_peered":"2023-09-30T22:54:10.265427+0000","last_clean":"2023-09-30T22:54:10.265427+0000","last_became_active":"2023-09-30T22:54:06.281041+0000","last_became_peered":"2023-09-30T22:54:06.281041+0000","last_unstale":"2023-09-30T22:54:10.265427+0000","last_undegraded":"2023-09-30T22:54:10.265427+0000","last_fullsized":"2023-09-30T22:54:10.265427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:22.348215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279095+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:54:07.279095+0000","last_peered":"2023-09-30T22:54:07.279095+0000","last_clean":"2023-09-30T22:54:07.279095+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:54:07.279095+0000","last_undegraded":"2023-09-30T22:54:07.279095+0000","last_fullsized":"2023-09-30T22:54:07.279095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276149+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:54:07.276149+0000","last_peered":"2023-09-30T22:54:07.276149+0000","last_clean":"2023-09-30T22:54:07.276149+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:54:07.276149+0000","last_undegraded":"2023-09-30T22:54:07.276149+0000","last_fullsized":"2023-09-30T22:54:07.276149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.288059+0000","last_change":"2023-09-30T22:54:07.287202+0000","last_active":"2023-09-30T22:54:07.288059+0000","last_peered":"2023-09-30T22:54:07.288059+0000","last_clean":"2023-09-30T22:54:07.288059+0000","last_became_active":"2023-09-30T22:54:07.286951+0000","last_became_peered":"2023-09-30T22:54:07.286951+0000","last_unstale":"2023-09-30T22:54:07.288059+0000","last_undegraded":"2023-09-30T22:54:07.288059+0000","last_fullsized":"2023-09-30T22:54:07.288059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:14:56.396839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276635+0000","last_change":"2023-09-30T22:54:06.284834+0000","last_active":"2023-09-30T22:54:07.276635+0000","last_peered":"2023-09-30T22:54:07.276635+0000","last_clean":"2023-09-30T22:54:07.276635+0000","last_became_active":"2023-09-30T22:54:06.284671+0000","last_became_peered":"2023-09-30T22:54:06.284671+0000","last_unstale":"2023-09-30T22:54:07.276635+0000","last_undegraded":"2023-09-30T22:54:07.276635+0000","last_fullsized":"2023-09-30T22:54:07.276635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:25.387879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276709+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:54:07.276709+0000","last_peered":"2023-09-30T22:54:07.276709+0000","last_clean":"2023-09-30T22:54:07.276709+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:54:07.276709+0000","last_undegraded":"2023-09-30T22:54:07.276709+0000","last_fullsized":"2023-09-30T22:54:07.276709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.279508+0000","last_change":"2023-09-30T22:54:07.279081+0000","last_active":"2023-09-30T22:54:07.279508+0000","last_peered":"2023-09-30T22:54:07.279508+0000","last_clean":"2023-09-30T22:54:07.279508+0000","last_became_active":"2023-09-30T22:54:07.278827+0000","last_became_peered":"2023-09-30T22:54:07.278827+0000","last_unstale":"2023-09-30T22:54:07.279508+0000","last_undegraded":"2023-09-30T22:54:07.279508+0000","last_fullsized":"2023-09-30T22:54:07.279508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:55:58.107230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276045+0000","last_change":"2023-09-30T22:54:06.281184+0000","last_active":"2023-09-30T22:54:07.276045+0000","last_peered":"2023-09-30T22:54:07.276045+0000","last_clean":"2023-09-30T22:54:07.276045+0000","last_became_active":"2023-09-30T22:54:06.280960+0000","last_became_peered":"2023-09-30T22:54:06.280960+0000","last_unstale":"2023-09-30T22:54:07.276045+0000","last_undegraded":"2023-09-30T22:54:07.276045+0000","last_fullsized":"2023-09-30T22:54:07.276045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:07:45.532201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.276538+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:54:07.276538+0000","last_peered":"2023-09-30T22:54:07.276538+0000","last_clean":"2023-09-30T22:54:07.276538+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:54:07.276538+0000","last_undegraded":"2023-09-30T22:54:07.276538+0000","last_fullsized":"2023-09-30T22:54:07.276538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.282469+0000","last_change":"2023-09-30T22:54:07.282400+0000","last_active":"2023-09-30T22:54:07.282469+0000","last_peered":"2023-09-30T22:54:07.282469+0000","last_clean":"2023-09-30T22:54:07.282469+0000","last_became_active":"2023-09-30T22:54:07.281984+0000","last_became_peered":"2023-09-30T22:54:07.281984+0000","last_unstale":"2023-09-30T22:54:07.282469+0000","last_undegraded":"2023-09-30T22:54:07.282469+0000","last_fullsized":"2023-09-30T22:54:07.282469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:48:14.172422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.273306+0000","last_change":"2023-09-30T22:54:06.280079+0000","last_active":"2023-09-30T22:54:07.273306+0000","last_peered":"2023-09-30T22:54:07.273306+0000","last_clean":"2023-09-30T22:54:07.273306+0000","last_became_active":"2023-09-30T22:54:06.279695+0000","last_became_peered":"2023-09-30T22:54:06.279695+0000","last_unstale":"2023-09-30T22:54:07.273306+0000","last_undegraded":"2023-09-30T22:54:07.273306+0000","last_fullsized":"2023-09-30T22:54:07.273306+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:40.364459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.280345+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:54:07.280345+0000","last_peered":"2023-09-30T22:54:07.280345+0000","last_clean":"2023-09-30T22:54:07.280345+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:54:07.280345+0000","last_undegraded":"2023-09-30T22:54:07.280345+0000","last_fullsized":"2023-09-30T22:54:07.280345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.289484+0000","last_change":"2023-09-30T22:54:07.288385+0000","last_active":"2023-09-30T22:54:07.289484+0000","last_peered":"2023-09-30T22:54:07.289484+0000","last_clean":"2023-09-30T22:54:07.289484+0000","last_became_active":"2023-09-30T22:54:07.288086+0000","last_became_peered":"2023-09-30T22:54:07.288086+0000","last_unstale":"2023-09-30T22:54:07.289484+0000","last_undegraded":"2023-09-30T22:54:07.289484+0000","last_fullsized":"2023-09-30T22:54:07.289484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:06.259591+0000","last_clean_scrub_stamp":"2023-09-30T22:54:06.259591+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:04.583688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.284427+0000","last_change":"2023-09-30T22:54:06.283671+0000","last_active":"2023-09-30T22:54:07.284427+0000","last_peered":"2023-09-30T22:54:07.284427+0000","last_clean":"2023-09-30T22:54:07.284427+0000","last_became_active":"2023-09-30T22:54:06.283368+0000","last_became_peered":"2023-09-30T22:54:06.283368+0000","last_unstale":"2023-09-30T22:54:07.284427+0000","last_undegraded":"2023-09-30T22:54:07.284427+0000","last_fullsized":"2023-09-30T22:54:07.284427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:54:05.256667+0000","last_clean_scrub_stamp":"2023-09-30T22:54:05.256667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:23.406173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-09-30T22:54:07.277211+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:54:07.277211+0000","last_peered":"2023-09-30T22:54:07.277211+0000","last_clean":"2023-09-30T22:54:07.277211+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:54:07.277211+0000","last_undegraded":"2023-09-30T22:54:07.277211+0000","last_fullsized":"2023-09-30T22:54:07.277211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66100000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.745}]},{"osd":2,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.78000000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.75}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.4210000000000003,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.55500000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.80100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.437}]},{"osd":2,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.91600000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.93500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.434},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.314},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758749,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.432},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.38700000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:53:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758693,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.98799999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.90300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757155,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.69899999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.624},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50600000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166789,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.78200000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.623}]},{"osd":3,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.76500000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82199999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.83499999999999996}]}]}],"pool_statfs":[]}} 2023-09-30T22:54:16.961 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:54:16.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T22:54:17.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.191+0000 7f46b73ff700 1 Processor -- start 2023-09-30T22:54:17.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.191+0000 7f46b73ff700 1 -- start start 2023-09-30T22:54:17.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.192+0000 7f46b73ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b73ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46b00cc3b0 0x7f46b00cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b73ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00d0550 con 0x7f46b01573a0 2023-09-30T22:54:17.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b73ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b00cf750 con 0x7f46b00cc3b0 2023-09-30T22:54:17.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b73ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00cf940 con 0x7f46b00cbfe0 2023-09-30T22:54:17.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b499a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46b00cc3b0 0x7f46b00cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b499a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46b00cc3b0 0x7f46b00cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55544/0 (socket says 172.21.15.142:55544) 2023-09-30T22:54:17.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b499a700 1 -- 172.21.15.142:0/234628088 learned_addr learned my addr 172.21.15.142:0/234628088 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:17.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b519b700 1 --2- 172.21.15.142:0/234628088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b499a700 1 -- 172.21.15.142:0/234628088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 msgr2=0x7f46b015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:17.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b499a700 1 --2- 172.21.15.142:0/234628088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b499a700 1 -- 172.21.15.142:0/234628088 >> v1:172.21.15.148:6789/0 conn(0x7f46b01573a0 legacy=0x7f46b015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.193+0000 7f46b499a700 1 -- 172.21.15.142:0/234628088 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00cfc20 con 0x7f46b00cc3b0 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46b499a700 1 --2- 172.21.15.142:0/234628088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b00cc3b0 0x7f46b00cf210 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f46a00099e0 tx=0x7f46a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea47ee7207d30567 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46a7fff700 1 -- 172.21.15.142:0/234628088 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000b820 con 0x7f46b00cc3b0 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46a7fff700 1 -- 172.21.15.142:0/234628088 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000b980 con 0x7f46b00cc3b0 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46a7fff700 1 -- 172.21.15.142:0/234628088 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000bd20 con 0x7f46b00cc3b0 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46b73ff700 1 -- 172.21.15.142:0/234628088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b00cc3b0 msgr2=0x7f46b00cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46b73ff700 1 --2- 172.21.15.142:0/234628088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b00cc3b0 0x7f46b00cf210 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f46a00099e0 tx=0x7f46a0009250 comp rx=0 tx=0).stop 2023-09-30T22:54:17.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46b73ff700 1 -- 172.21.15.142:0/234628088 shutdown_connections 2023-09-30T22:54:17.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46b73ff700 1 --2- 172.21.15.142:0/234628088 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46b73ff700 1 --2- 172.21.15.142:0/234628088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b00cc3b0 0x7f46b00cf210 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.194+0000 7f46b73ff700 1 -- 172.21.15.142:0/234628088 >> 172.21.15.142:0/234628088 conn(0x7f46b00d0a80 msgr2=0x7f46b00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:17.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.195+0000 7f46b73ff700 1 -- 172.21.15.142:0/234628088 shutdown_connections 2023-09-30T22:54:17.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.195+0000 7f46b73ff700 1 -- 172.21.15.142:0/234628088 wait complete. 2023-09-30T22:54:17.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.196+0000 7f46b73ff700 1 Processor -- start 2023-09-30T22:54:17.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.196+0000 7f46b73ff700 1 -- start start 2023-09-30T22:54:17.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b73ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b0169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b73ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46b00cc3b0 0x7f46b00b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b73ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b01573a0 0x7f46b0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b73ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b016d920 con 0x7f46b01573a0 2023-09-30T22:54:17.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b73ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b016dc00 con 0x7f46b00cc3b0 2023-09-30T22:54:17.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b73ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b016dee0 con 0x7f46b00cbfe0 2023-09-30T22:54:17.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b599c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b01573a0 0x7f46b0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b519b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b0169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b499a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46b00cc3b0 0x7f46b00b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b599c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b01573a0 0x7f46b0159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55558/0 (socket says 172.21.15.142:55558) 2023-09-30T22:54:17.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.197+0000 7f46b599c700 1 -- 172.21.15.142:0/491337199 learned_addr learned my addr 172.21.15.142:0/491337199 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:17.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b599c700 1 -- 172.21.15.142:0/491337199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 msgr2=0x7f46b0169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b599c700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b0169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b599c700 1 -- 172.21.15.142:0/491337199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46b00cc3b0 msgr2=0x7f46b00b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b599c700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46b00cc3b0 0x7f46b00b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b599c700 1 -- 172.21.15.142:0/491337199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00094f0 con 0x7f46b01573a0 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b599c700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b01573a0 0x7f46b0159a80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c840 tx=0x7f46a8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46a57fa700 1 -- 172.21.15.142:0/491337199 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8012630 con 0x7f46b01573a0 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46a57fa700 1 -- 172.21.15.142:0/491337199 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a80127b0 con 0x7f46b01573a0 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46a57fa700 1 -- 172.21.15.142:0/491337199 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8012b70 con 0x7f46b01573a0 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b016e1c0 con 0x7f46b01573a0 2023-09-30T22:54:17.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.198+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b016d560 con 0x7f46b01573a0 2023-09-30T22:54:17.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.199+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b00c52e0 con 0x7f46b01573a0 2023-09-30T22:54:17.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.200+0000 7f46a57fa700 1 -- 172.21.15.142:0/491337199 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f46a801a3a0 con 0x7f46b01573a0 2023-09-30T22:54:17.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.201+0000 7f46a57fa700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4694067330 0x7f46940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.201+0000 7f46a57fa700 1 -- 172.21.15.142:0/491337199 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f46a8084da0 con 0x7f46b01573a0 2023-09-30T22:54:17.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.201+0000 7f46b519b700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4694067330 0x7f46940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.202+0000 7f46b519b700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4694067330 0x7f46940697e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46ac006fd0 tx=0x7f46ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:17.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.205+0000 7f46a57fa700 1 -- 172.21.15.142:0/491337199 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f46b00c52e0 con 0x7f46b01573a0 2023-09-30T22:54:17.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.473+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f46b00c52e0 con 0x7f46b01573a0 2023-09-30T22:54:17.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.477+0000 7f46a57fa700 1 -- 172.21.15.142:0/491337199 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f46b00c52e0 con 0x7f46b01573a0 2023-09-30T22:54:17.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4694067330 msgr2=0x7f46940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4694067330 0x7f46940697e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46ac006fd0 tx=0x7f46ac008040 comp rx=0 tx=0).stop 2023-09-30T22:54:17.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b01573a0 msgr2=0x7f46b0159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b01573a0 0x7f46b0159a80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c840 tx=0x7f46a8001670 comp rx=0 tx=0).stop 2023-09-30T22:54:17.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 shutdown_connections 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4694067330 0x7f46940697e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b01573a0 0x7f46b0159a80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f46b00cbfe0 0x7f46b0169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 --2- 172.21.15.142:0/491337199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46b00cc3b0 0x7f46b00b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 >> 172.21.15.142:0/491337199 conn(0x7f46b00d0a80 msgr2=0x7f46b015cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 shutdown_connections 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.480+0000 7f46b73ff700 1 -- 172.21.15.142:0/491337199 wait complete. 2023-09-30T22:54:17.481 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T22:54:17.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:17.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.688+0000 7f866e5ff700 1 Processor -- start 2023-09-30T22:54:17.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.688+0000 7f866e5ff700 1 -- start start 2023-09-30T22:54:17.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f866e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f8668156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f866e5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86680b00d0 0x7f866806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f866e5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866806d3e0 con 0x7f866806e650 2023-09-30T22:54:17.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f866e5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866815b400 con 0x7f86680b00d0 2023-09-30T22:54:17.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f866e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866806dc80 con 0x7f86680af020 2023-09-30T22:54:17.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f86677fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86680b00d0 0x7f866806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f86677fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86680b00d0 0x7f866806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55562/0 (socket says 172.21.15.142:55562) 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f86677fe700 1 -- 172.21.15.142:0/780570691 learned_addr learned my addr 172.21.15.142:0/780570691 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f8667fff700 1 --2- 172.21.15.142:0/780570691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f8668156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f86677fe700 1 -- 172.21.15.142:0/780570691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 msgr2=0x7f8668156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f86677fe700 1 --2- 172.21.15.142:0/780570691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f8668156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f86677fe700 1 -- 172.21.15.142:0/780570691 >> v1:172.21.15.148:6789/0 conn(0x7f866806e650 legacy=0x7f86680b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.690+0000 7f86677fe700 1 -- 172.21.15.142:0/780570691 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866806b790 con 0x7f86680b00d0 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.691+0000 7f86677fe700 1 --2- 172.21.15.142:0/780570691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f866806e110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f865c0099b0 tx=0x7f865c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db099a04ba9a859d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.691+0000 7f8666ffd700 1 -- 172.21.15.142:0/780570691 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00b860 con 0x7f86680b00d0 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.691+0000 7f8666ffd700 1 -- 172.21.15.142:0/780570691 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00b9c0 con 0x7f86680b00d0 2023-09-30T22:54:17.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.691+0000 7f8666ffd700 1 -- 172.21.15.142:0/780570691 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00bd60 con 0x7f86680b00d0 2023-09-30T22:54:17.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.691+0000 7f866e5ff700 1 -- 172.21.15.142:0/780570691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 msgr2=0x7f866806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.691+0000 7f866e5ff700 1 --2- 172.21.15.142:0/780570691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f866806e110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f865c0099b0 tx=0x7f865c009250 comp rx=0 tx=0).stop 2023-09-30T22:54:17.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.692+0000 7f866e5ff700 1 -- 172.21.15.142:0/780570691 shutdown_connections 2023-09-30T22:54:17.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.692+0000 7f866e5ff700 1 --2- 172.21.15.142:0/780570691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f8668156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.692+0000 7f866e5ff700 1 --2- 172.21.15.142:0/780570691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f866806e110 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.692+0000 7f866e5ff700 1 -- 172.21.15.142:0/780570691 >> 172.21.15.142:0/780570691 conn(0x7f86680680c0 msgr2=0x7f86680c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:17.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.692+0000 7f866e5ff700 1 -- 172.21.15.142:0/780570691 shutdown_connections 2023-09-30T22:54:17.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.692+0000 7f866e5ff700 1 -- 172.21.15.142:0/780570691 wait complete. 2023-09-30T22:54:17.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.693+0000 7f866e5ff700 1 Processor -- start 2023-09-30T22:54:17.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.693+0000 7f866e5ff700 1 -- start start 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866e5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f866806e650 0x7f866814ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f866813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866e5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f86680c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866e5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681510f0 con 0x7f86680b00d0 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866e5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866813ffd0 con 0x7f866806e650 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86681504e0 con 0x7f86680af020 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866cb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f86680c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866cb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f86680c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55570/0 (socket says 172.21.15.142:55570) 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f866cb9c700 1 -- 172.21.15.142:0/2008805146 learned_addr learned my addr 172.21.15.142:0/2008805146 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.694+0000 7f8667fff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f866806e650 0x7f866814ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f86677fe700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f866813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866cb9c700 1 -- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 msgr2=0x7f866813fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866cb9c700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f866813fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866cb9c700 1 -- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f866806e650 msgr2=0x7f866814ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866cb9c700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f866806e650 0x7f866814ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866cb9c700 1 -- 172.21.15.142:0/2008805146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0094f0 con 0x7f86680b00d0 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866cb9c700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f86680c7ef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f866000c840 tx=0x7f8660001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f864ffff700 1 -- 172.21.15.142:0/2008805146 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660012630 con 0x7f86680b00d0 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f864ffff700 1 -- 172.21.15.142:0/2008805146 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600127b0 con 0x7f86680b00d0 2023-09-30T22:54:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f864ffff700 1 -- 172.21.15.142:0/2008805146 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660012b70 con 0x7f86680b00d0 2023-09-30T22:54:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86681507c0 con 0x7f86680b00d0 2023-09-30T22:54:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.695+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8668150d80 con 0x7f86680b00d0 2023-09-30T22:54:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.696+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86680695b0 con 0x7f86680b00d0 2023-09-30T22:54:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.697+0000 7f864ffff700 1 -- 172.21.15.142:0/2008805146 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f866001a3a0 con 0x7f86680b00d0 2023-09-30T22:54:17.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.698+0000 7f864ffff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8654067330 0x7f86540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:17.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.698+0000 7f864ffff700 1 -- 172.21.15.142:0/2008805146 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f8660084da0 con 0x7f86680b00d0 2023-09-30T22:54:17.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.698+0000 7f8667fff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8654067330 0x7f86540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:17.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.699+0000 7f8667fff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8654067330 0x7f86540697e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8658006fd0 tx=0x7f8658008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:17.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.702+0000 7f864ffff700 1 -- 172.21.15.142:0/2008805146 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8660051be0 con 0x7f86680b00d0 2023-09-30T22:54:17.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.932+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f866806fc10 con 0x7f86680b00d0 2023-09-30T22:54:17.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.932+0000 7f864ffff700 1 -- 172.21.15.142:0/2008805146 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8660055200 con 0x7f86680b00d0 2023-09-30T22:54:17.933 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:17.933 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:17.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8654067330 msgr2=0x7f86540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8654067330 0x7f86540697e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8658006fd0 tx=0x7f8658008040 comp rx=0 tx=0).stop 2023-09-30T22:54:17.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 msgr2=0x7f86680c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:17.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f86680c7ef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f866000c840 tx=0x7f8660001670 comp rx=0 tx=0).stop 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 shutdown_connections 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8654067330 0x7f86540697e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86680b00d0 0x7f86680c7ef0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f866806e650 0x7f866814ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 --2- 172.21.15.142:0/2008805146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f86680af020 0x7f866813fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 >> 172.21.15.142:0/2008805146 conn(0x7f86680680c0 msgr2=0x7f8668069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 shutdown_connections 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:17.935+0000 7f866e5ff700 1 -- 172.21.15.142:0/2008805146 wait complete. 2023-09-30T22:54:17.936 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:18.355 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:54:06.742392+0000', 'modified': '2023-09-30T22:54:10.296515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5376}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5376': {'gid': 5376, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/2473569695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6836', 'nonce': 2473569695}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2473569695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:54:18.356 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:54:18.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:54:18.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.548+0000 7f5f56fff700 1 Processor -- start 2023-09-30T22:54:18.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.548+0000 7f5f56fff700 1 -- start start 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.549+0000 7f5f56fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f50157a90 0x7f5f5015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.549+0000 7f5f56fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f500b2110 0x7f5f5006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.549+0000 7f5f56fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5006d470 con 0x7f5f5006b3d0 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.549+0000 7f5f56fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f50157e60 con 0x7f5f500b2110 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.549+0000 7f5f56fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5015c430 con 0x7f5f50157a90 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f5559c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f500b2110 0x7f5f5006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f4ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5f5006b3d0 0x7f5f500b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50468/0 (socket says 172.21.15.142:50468) 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f5559c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f500b2110 0x7f5f5006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55578/0 (socket says 172.21.15.142:55578) 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f4ffff700 1 -- 172.21.15.142:0/962682852 learned_addr learned my addr 172.21.15.142:0/962682852 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/962682852 >> v2:172.21.15.148:3300/0 conn(0x7f5f50157a90 0x7f5f5015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f5559c700 1 -- 172.21.15.142:0/962682852 >> v2:172.21.15.148:3300/0 conn(0x7f5f50157a90 msgr2=0x7f5f5015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f5559c700 1 --2- 172.21.15.142:0/962682852 >> v2:172.21.15.148:3300/0 conn(0x7f5f50157a90 0x7f5f5015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f5559c700 1 -- 172.21.15.142:0/962682852 >> v1:172.21.15.142:6789/0 conn(0x7f5f5006b3d0 legacy=0x7f5f500b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f5559c700 1 -- 172.21.15.142:0/962682852 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500ae880 con 0x7f5f500b2110 2023-09-30T22:54:18.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f4f7fe700 1 -- 172.21.15.142:0/962682852 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652348790 0 0) 0x7f5f5006d470 con 0x7f5f5006b3d0 2023-09-30T22:54:18.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.550+0000 7f5f5559c700 1 --2- 172.21.15.142:0/962682852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f500b2110 0x7f5f5006d900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5f5006d1e0 tx=0x7f5f48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb42e56edcc1f2f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f4f7fe700 1 -- 172.21.15.142:0/962682852 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800e070 con 0x7f5f500b2110 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f4f7fe700 1 -- 172.21.15.142:0/962682852 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800bb60 con 0x7f5f500b2110 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f4f7fe700 1 -- 172.21.15.142:0/962682852 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48012430 con 0x7f5f500b2110 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 -- 172.21.15.142:0/962682852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f500b2110 msgr2=0x7f5f5006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 --2- 172.21.15.142:0/962682852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f500b2110 0x7f5f5006d900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5f5006d1e0 tx=0x7f5f48009780 comp rx=0 tx=0).stop 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 -- 172.21.15.142:0/962682852 shutdown_connections 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 --2- 172.21.15.142:0/962682852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f500b2110 0x7f5f5006d900 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 --2- 172.21.15.142:0/962682852 >> v2:172.21.15.148:3300/0 conn(0x7f5f50157a90 0x7f5f5015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 -- 172.21.15.142:0/962682852 >> 172.21.15.142:0/962682852 conn(0x7f5f500680c0 msgr2=0x7f5f500c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 -- 172.21.15.142:0/962682852 shutdown_connections 2023-09-30T22:54:18.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.551+0000 7f5f56fff700 1 -- 172.21.15.142:0/962682852 wait complete. 2023-09-30T22:54:18.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.553+0000 7f5f56fff700 1 Processor -- start 2023-09-30T22:54:18.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.553+0000 7f5f56fff700 1 -- start start 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.554+0000 7f5f56fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f5006b3d0 0x7f5f5014a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.554+0000 7f5f56fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f500b2110 0x7f5f5015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.554+0000 7f5f56fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f50157a90 0x7f5f5015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.554+0000 7f5f56fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5014c5d0 con 0x7f5f50157a90 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.554+0000 7f5f56fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5014a9c0 con 0x7f5f5006b3d0 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.554+0000 7f5f56fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5014b9c0 con 0x7f5f500b2110 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f50157a90 0x7f5f5015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f50157a90 0x7f5f5015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55584/0 (socket says 172.21.15.142:55584) 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 -- 172.21.15.142:0/1651850935 learned_addr learned my addr 172.21.15.142:0/1651850935 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f5006b3d0 0x7f5f5014a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f500b2110 0x7f5f5015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 -- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f500b2110 msgr2=0x7f5f5015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f500b2110 0x7f5f5015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 -- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f5006b3d0 msgr2=0x7f5f5014a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f5006b3d0 0x7f5f5014a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 -- 172.21.15.142:0/1651850935 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009a20 con 0x7f5f50157a90 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.555+0000 7f5f5559c700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f50157a90 0x7f5f5015e870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5f48013000 tx=0x7f5f48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.556+0000 7f5f4cff9700 1 -- 172.21.15.142:0/1651850935 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48027470 con 0x7f5f50157a90 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.556+0000 7f5f4cff9700 1 -- 172.21.15.142:0/1651850935 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480275d0 con 0x7f5f50157a90 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.556+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5014bca0 con 0x7f5f50157a90 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.556+0000 7f5f4cff9700 1 -- 172.21.15.142:0/1651850935 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48027990 con 0x7f5f50157a90 2023-09-30T22:54:18.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.556+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5014c260 con 0x7f5f50157a90 2023-09-30T22:54:18.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.558+0000 7f5f4cff9700 1 -- 172.21.15.142:0/1651850935 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5f48024070 con 0x7f5f50157a90 2023-09-30T22:54:18.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.558+0000 7f5f4cff9700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f34067330 0x7f5f340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.558+0000 7f5f4cff9700 1 -- 172.21.15.142:0/1651850935 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f5f480874e0 con 0x7f5f50157a90 2023-09-30T22:54:18.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.559+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f34067330 0x7f5f340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.559+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f34067330 0x7f5f340697e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009db0 tx=0x7f5f440091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.561+0000 7f5f65625b80 1 Processor -- start 2023-09-30T22:54:18.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.561+0000 7f5f65625b80 1 -- start start 2023-09-30T22:54:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.562+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c3a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.562+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7c6a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.562+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.562+0000 7f5f65625b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7b57310 con 0x564be7c69540 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.562+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7b94130 con 0x564be7c39cc0 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.562+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be7b91af0 con 0x564be7c6ab80 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7c6a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7c6a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55600/0 (socket says 172.21.15.142:55600) 2023-09-30T22:54:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 -- 172.21.15.142:0/4276294227 learned_addr learned my addr 172.21.15.142:0/4276294227 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:18.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f5559c700 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c3a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 -- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 msgr2=0x564be7c3f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 -- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 msgr2=0x564be7c3a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c3a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 -- 172.21.15.142:0/4276294227 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564be7993790 con 0x564be7c69540 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f5559c700 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c3a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7c6a640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0070f0 tx=0x7f5f3c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6233be48dd8fbc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f39ffb700 1 -- 172.21.15.142:0/4276294227 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c006a80 con 0x564be7c69540 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f39ffb700 1 -- 172.21.15.142:0/4276294227 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c001650 con 0x564be7c69540 2023-09-30T22:54:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.563+0000 7f5f39ffb700 1 -- 172.21.15.142:0/4276294227 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c001a10 con 0x564be7c69540 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 -- 172.21.15.142:0/4276294227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 msgr2=0x564be7c6a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7c6a640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0070f0 tx=0x7f5f3c007f50 comp rx=0 tx=0).stop 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 -- 172.21.15.142:0/4276294227 shutdown_connections 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c3a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 --2- 172.21.15.142:0/4276294227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7c6a640 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 -- 172.21.15.142:0/4276294227 >> 172.21.15.142:0/4276294227 conn(0x564be7c87880 msgr2=0x564be7c87c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 -- 172.21.15.142:0/4276294227 shutdown_connections 2023-09-30T22:54:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.564+0000 7f5f65625b80 1 -- 172.21.15.142:0/4276294227 wait complete. 2023-09-30T22:54:18.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.565+0000 7f5f65625b80 1 -- start start 2023-09-30T22:54:18.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.565+0000 7f5f65625b80 1 Processor -- start 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c69540 0x564be7c65830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c6ab80 0x564be7c65d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f65625b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7b8d8e0 con 0x564be7c39cc0 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7b39980 con 0x564be7c6ab80 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be7b39620 con 0x564be7c69540 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f65625b80 10 client.0 _ll_register_callbacks cb 0x564be799ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f54d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f54d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55602/0 (socket says 172.21.15.142:55602) 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f54d9b700 1 -- 172.21.15.142:0/270221509 learned_addr learned my addr 172.21.15.142:0/270221509 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.567+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c69540 0x564be7c65830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f5559c700 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c6ab80 0x564be7c65d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f54d9b700 1 -- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c69540 msgr2=0x564be7c65830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c69540 0x564be7c65830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f54d9b700 1 -- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c6ab80 msgr2=0x564be7c65d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c6ab80 0x564be7c65d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f54d9b700 1 -- 172.21.15.142:0/270221509 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c006c70 con 0x564be7c39cc0 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5f44014ac0 tx=0x7f5f44019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9352151a96890bd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f2effd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f2effd700 1 -- 172.21.15.142:0/270221509 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44011a50 con 0x564be7c39cc0 2023-09-30T22:54:18.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f2effd700 1 -- 172.21.15.142:0/270221509 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f5f4401a040 con 0x564be7c39cc0 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564be7c31d60 con 0x564be7c39cc0 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f2effd700 1 -- 172.21.15.142:0/270221509 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f44013c50 con 0x564be7c39cc0 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f65625b80 10 client.5544 fetch_fsmap learned FSMap version 24 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.568+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x564be7a800a0 con 0x564be7c39cc0 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f2effd700 1 -- 172.21.15.142:0/270221509 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564be7c31d60 con 0x564be7c39cc0 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f2effd700 1 -- 172.21.15.142:0/270221509 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5f4402a440 con 0x564be7c39cc0 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f65625b80 10 client.5544 fetch_fsmap finished waiting for FSMap version 24 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f65625b80 10 client.5544 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f65625b80 20 client.5544 populate_metadata read hostname 'smithi142' 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f65625b80 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c93800 0x564be7c9d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f65625b80 4 client.5544 mds_command: new command op to 5376 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 --> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564be7c0eb30 con 0x564be7c93800 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c93800 0x564be7c9d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f2effd700 10 client.5544 ms_handle_connect on v2:172.21.15.142:6836/2473569695 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.569+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c93800 0x564be7c9d690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e81ece0f5c5cfd91 server_cookie=c0db461ef44736a0 in_seq=0 out_seq=0 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.570+0000 7f5f2effd700 1 -- 172.21.15.142:0/270221509 <== mds.0 v2:172.21.15.142:6836/2473569695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x564be7c0eb30 con 0x564be7c93800 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.570+0000 7f5f2effd700 10 client.5544 handle_command_reply: tid=0 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.570+0000 7f5f65625b80 1 client.5544 shutdown 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.570+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 msgr2=0x564be7c9eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.570+0000 7f5f65625b80 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5f44014ac0 tx=0x7f5f44019000 comp rx=0 tx=0).stop 2023-09-30T22:54:18.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.570+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 shutdown_connections 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.570+0000 7f5f65625b80 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c93800 0x564be7c9d690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f65625b80 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c6ab80 0x564be7c65d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f65625b80 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f2effd700 0 client.5544 ms_handle_reset on v2:172.21.15.142:6836/2473569695 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f65625b80 1 --2- 172.21.15.142:0/270221509 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c69540 0x564be7c65830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 >> 172.21.15.142:0/270221509 conn(0x564be7c87880 msgr2=0x564be7c69aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 shutdown_connections 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f65625b80 1 -- 172.21.15.142:0/270221509 wait complete. 2023-09-30T22:54:18.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.571+0000 7f5f65625b80 20 client.5544 trim_cache size 0 max 16384 2023-09-30T22:54:18.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.588+0000 7f5f65625b80 1 Processor -- start 2023-09-30T22:54:18.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.588+0000 7f5f65625b80 1 -- start start 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c69540 0x564be7c63b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f65625b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7a251e0 con 0x564be7c39cc0 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7c64070 con 0x564be7c69540 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be7c34280 con 0x564be7c6ab80 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55616/0 (socket says 172.21.15.142:55616) 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 -- 172.21.15.142:0/3899658196 learned_addr learned my addr 172.21.15.142:0/3899658196 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:18.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f5559c700 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c69540 0x564be7c63b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 -- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 msgr2=0x564be7c3e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 -- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c69540 msgr2=0x564be7c63b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c69540 0x564be7c63b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f54d9b700 1 -- 172.21.15.142:0/3899658196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564be7b5c3c0 con 0x564be7c39cc0 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.589+0000 7f5f5559c700 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009b70 tx=0x7f5f44023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6511e3b2deb1d903 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f3a7fc700 1 -- 172.21.15.142:0/3899658196 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44006d90 con 0x564be7c39cc0 2023-09-30T22:54:18.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f3a7fc700 1 -- 172.21.15.142:0/3899658196 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44013680 con 0x564be7c39cc0 2023-09-30T22:54:18.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f3a7fc700 1 -- 172.21.15.142:0/3899658196 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44013c50 con 0x564be7c39cc0 2023-09-30T22:54:18.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f65625b80 1 -- 172.21.15.142:0/3899658196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 msgr2=0x564be7c9eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f65625b80 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009b70 tx=0x7f5f44023000 comp rx=0 tx=0).stop 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f65625b80 1 -- 172.21.15.142:0/3899658196 shutdown_connections 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f65625b80 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c3e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f65625b80 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c39cc0 0x564be7c9eb10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f65625b80 1 --2- 172.21.15.142:0/3899658196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c69540 0x564be7c63b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.590+0000 7f5f65625b80 1 -- 172.21.15.142:0/3899658196 >> 172.21.15.142:0/3899658196 conn(0x564be7c87880 msgr2=0x564be7c3b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.591+0000 7f5f65625b80 1 -- 172.21.15.142:0/3899658196 shutdown_connections 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.591+0000 7f5f65625b80 1 -- 172.21.15.142:0/3899658196 wait complete. 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.591+0000 7f5f65625b80 1 -- start start 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.591+0000 7f5f65625b80 1 Processor -- start 2023-09-30T22:54:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.592+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.592+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7cf15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.592+0000 7f5f65625b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c91400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.592+0000 7f5f65625b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7c64ab0 con 0x564be7c69540 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.592+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be7c9cd10 con 0x564be7c39cc0 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.592+0000 7f5f65625b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be7ca5ac0 con 0x564be7c6ab80 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.592+0000 7f5f65625b80 10 client.0 _ll_register_callbacks cb 0x564be799ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7cf15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7cf15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55630/0 (socket says 172.21.15.142:55630) 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 -- 172.21.15.142:0/1179820821 learned_addr learned my addr 172.21.15.142:0/1179820821 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 -- 172.21.15.142:0/1179820821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 msgr2=0x564be7c91400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c91400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 -- 172.21.15.142:0/1179820821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 msgr2=0x564be7c870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 -- 172.21.15.142:0/1179820821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564be7a800a0 con 0x564be7c69540 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f4ffff700 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7cf15a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c015040 tx=0x7f5f3c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ee4d0d5c539c62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f2effd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f2effd700 1 -- 172.21.15.142:0/1179820821 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c024040 con 0x564be7c69540 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f2effd700 1 -- 172.21.15.142:0/1179820821 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f5f3c0294e0 con 0x564be7c69540 2023-09-30T22:54:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.593+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f3c001650 con 0x564be7c69540 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f2effd700 1 -- 172.21.15.142:0/1179820821 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f3c0298b0 con 0x564be7c69540 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 10 client.5550 fetch_fsmap learned FSMap version 24 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x564be79f41d0 con 0x564be7c69540 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f2effd700 1 -- 172.21.15.142:0/1179820821 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c001650 con 0x564be7c69540 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f2effd700 1 -- 172.21.15.142:0/1179820821 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5f3c012070 con 0x564be7c69540 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 10 client.5550 fetch_fsmap finished waiting for FSMap version 24 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 10 client.5550 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 20 client.5550 populate_metadata read hostname 'smithi142' 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c3e380 0x564be7c3e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 4 client.5550 mds_command: new command op to 5376 tid=0[{"prefix": "status"}] 2023-09-30T22:54:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 --> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564be7b308d0 con 0x564be7c3e380 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.594+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c3e380 0x564be7c3e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f54d9b700 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c3e380 0x564be7c3e750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3e9133d263b828c server_cookie=d218009883419d93 in_seq=0 out_seq=0 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f2effd700 10 client.5550 ms_handle_connect on v2:172.21.15.142:6836/2473569695 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f2effd700 1 -- 172.21.15.142:0/1179820821 <== mds.0 v2:172.21.15.142:6836/2473569695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564be7b308d0 con 0x564be7c3e380 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f2effd700 10 client.5550 handle_command_reply: tid=0 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 client.5550 shutdown 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 msgr2=0x564be7cf15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7cf15a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c015040 tx=0x7f5f3c013000 comp rx=0 tx=0).stop 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 shutdown_connections 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:6836/2473569695,v1:172.21.15.142:6837/2473569695] conn(0x564be7c3e380 0x564be7c3e750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564be7c6ab80 0x564be7c91400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564be7c39cc0 0x564be7c870c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f2effd700 0 client.5550 ms_handle_reset on v2:172.21.15.142:6836/2473569695 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 --2- 172.21.15.142:0/1179820821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564be7c69540 0x564be7cf15a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 >> 172.21.15.142:0/1179820821 conn(0x564be7c87880 msgr2=0x564be7c63230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 shutdown_connections 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.595+0000 7f5f65625b80 1 -- 172.21.15.142:0/1179820821 wait complete. 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f65625b80 20 client.5550 trim_cache size 0 max 16384 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 5376, 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 11.326470156999999, 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 24, 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 50, 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 48, 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 17.353445899 2023-09-30T22:54:18.603 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:18.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f34067330 msgr2=0x7f5f340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f34067330 0x7f5f340697e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009db0 tx=0x7f5f440091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f50157a90 msgr2=0x7f5f5015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f50157a90 0x7f5f5015e870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5f48013000 tx=0x7f5f48019000 comp rx=0 tx=0).stop 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 shutdown_connections 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f34067330 0x7f5f340697e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f50157a90 0x7f5f5015e870 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f5006b3d0 0x7f5f5014a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 --2- 172.21.15.142:0/1651850935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f500b2110 0x7f5f5015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 >> 172.21.15.142:0/1651850935 conn(0x7f5f500680c0 msgr2=0x7f5f5006d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 shutdown_connections 2023-09-30T22:54:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.596+0000 7f5f56fff700 1 -- 172.21.15.142:0/1651850935 wait complete. 2023-09-30T22:54:18.613 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:54:18.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.801+0000 7fdfc6fff700 1 Processor -- start 2023-09-30T22:54:18.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.801+0000 7fdfc6fff700 1 -- start start 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc6fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc6fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfc00b1950 0x7fdfc015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc6fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdfc00ae000 0x7fdfc015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc6fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc0157c20 con 0x7fdfc00ae000 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc6fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc00ad630 con 0x7fdfc00b1950 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc6fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00b3360 con 0x7fdfc00b1580 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc559c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdfc00ae000 0x7fdfc015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc559c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdfc00ae000 0x7fdfc015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55640/0 (socket says 172.21.15.142:55640) 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc559c700 1 -- 172.21.15.142:0/3671876505 learned_addr learned my addr 172.21.15.142:0/3671876505 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfbffff700 1 --2- 172.21.15.142:0/3671876505 >> v2:172.21.15.148:3300/0 conn(0x7fdfc00b1950 0x7fdfc015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc4d9b700 1 --2- 172.21.15.142:0/3671876505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc559c700 1 -- 172.21.15.142:0/3671876505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 msgr2=0x7fdfc00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.803+0000 7fdfc559c700 1 --2- 172.21.15.142:0/3671876505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfc559c700 1 -- 172.21.15.142:0/3671876505 >> v2:172.21.15.148:3300/0 conn(0x7fdfc00b1950 msgr2=0x7fdfc015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfc559c700 1 --2- 172.21.15.142:0/3671876505 >> v2:172.21.15.148:3300/0 conn(0x7fdfc00b1950 0x7fdfc015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfc559c700 1 -- 172.21.15.142:0/3671876505 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc015ad60 con 0x7fdfc00ae000 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfc559c700 1 --2- 172.21.15.142:0/3671876505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015a6c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0069d40 tx=0x7fdfb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e93dce460c92558 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfbf7fe700 1 -- 172.21.15.142:0/3671876505 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800e070 con 0x7fdfc00ae000 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfbf7fe700 1 -- 172.21.15.142:0/3671876505 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800ba50 con 0x7fdfc00ae000 2023-09-30T22:54:18.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfbf7fe700 1 -- 172.21.15.142:0/3671876505 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80092e0 con 0x7fdfc00ae000 2023-09-30T22:54:18.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfc6fff700 1 -- 172.21.15.142:0/3671876505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 msgr2=0x7fdfc015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.804+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/3671876505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015a6c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0069d40 tx=0x7fdfb8009840 comp rx=0 tx=0).stop 2023-09-30T22:54:18.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.805+0000 7fdfc6fff700 1 -- 172.21.15.142:0/3671876505 shutdown_connections 2023-09-30T22:54:18.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.805+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/3671876505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015a6c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.805+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/3671876505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.805+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/3671876505 >> v2:172.21.15.148:3300/0 conn(0x7fdfc00b1950 0x7fdfc015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.805+0000 7fdfc6fff700 1 -- 172.21.15.142:0/3671876505 >> 172.21.15.142:0/3671876505 conn(0x7fdfc00ce1f0 msgr2=0x7fdfc0069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:18.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.805+0000 7fdfc6fff700 1 -- 172.21.15.142:0/3671876505 shutdown_connections 2023-09-30T22:54:18.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.805+0000 7fdfc6fff700 1 -- 172.21.15.142:0/3671876505 wait complete. 2023-09-30T22:54:18.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.806+0000 7fdfc6fff700 1 Processor -- start 2023-09-30T22:54:18.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.806+0000 7fdfc6fff700 1 -- start start 2023-09-30T22:54:18.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc6fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc6fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc6fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfc00b1950 0x7fdfc01491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc6fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc015ce40 con 0x7fdfc00ae000 2023-09-30T22:54:18.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc6fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00aa0a0 con 0x7fdfc00b1950 2023-09-30T22:54:18.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc6fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00ca740 con 0x7fdfc00b1580 2023-09-30T22:54:18.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc4d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc4d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55652/0 (socket says 172.21.15.142:55652) 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.807+0000 7fdfc4d9b700 1 -- 172.21.15.142:0/2811569337 learned_addr learned my addr 172.21.15.142:0/2811569337 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfbffff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc559c700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfc00b1950 0x7fdfc01491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc4d9b700 1 -- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 msgr2=0x7fdfc00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc4d9b700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc4d9b700 1 -- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfc00b1950 msgr2=0x7fdfc01491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc4d9b700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfc00b1950 0x7fdfc01491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc4d9b700 1 -- 172.21.15.142:0/2811569337 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8009ae0 con 0x7fdfc00ae000 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc559c700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfc00b1950 0x7fdfc01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc4d9b700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015c900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d890 tx=0x7fdfb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfbcff9700 1 -- 172.21.15.142:0/2811569337 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400b600 con 0x7fdfc00ae000 2023-09-30T22:54:18.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfbcff9700 1 -- 172.21.15.142:0/2811569337 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb400b760 con 0x7fdfc00ae000 2023-09-30T22:54:18.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfbcff9700 1 -- 172.21.15.142:0/2811569337 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400bae0 con 0x7fdfc00ae000 2023-09-30T22:54:18.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.808+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc015d030 con 0x7fdfc00ae000 2023-09-30T22:54:18.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.809+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc00ca0f0 con 0x7fdfc00ae000 2023-09-30T22:54:18.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.809+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc00caa20 con 0x7fdfc00ae000 2023-09-30T22:54:18.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.810+0000 7fdfbcff9700 1 -- 172.21.15.142:0/2811569337 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdfb401e460 con 0x7fdfc00ae000 2023-09-30T22:54:18.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.811+0000 7fdfbcff9700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdfa4067330 0x7fdfa40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:18.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.811+0000 7fdfbcff9700 1 -- 172.21.15.142:0/2811569337 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fdfb4085260 con 0x7fdfc00ae000 2023-09-30T22:54:18.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.811+0000 7fdfbffff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdfa4067330 0x7fdfa40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:18.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.812+0000 7fdfbffff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdfa4067330 0x7fdfa40697e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00c97d0 tx=0x7fdfac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:18.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:18.815+0000 7fdfbcff9700 1 -- 172.21.15.142:0/2811569337 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdfb4052140 con 0x7fdfc00ae000 2023-09-30T22:54:19.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.046+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfc006d630 con 0x7fdfc00ae000 2023-09-30T22:54:19.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.046+0000 7fdfbcff9700 1 -- 172.21.15.142:0/2811569337 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdfb4055760 con 0x7fdfc00ae000 2023-09-30T22:54:19.047 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:54:19.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdfa4067330 msgr2=0x7fdfa40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdfa4067330 0x7fdfa40697e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00c97d0 tx=0x7fdfac008040 comp rx=0 tx=0).stop 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 msgr2=0x7fdfc015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015c900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d890 tx=0x7fdfb4008040 comp rx=0 tx=0).stop 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 shutdown_connections 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdfa4067330 0x7fdfa40697e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfc00b1950 0x7fdfc01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc00ae000 0x7fdfc015c900 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 --2- 172.21.15.142:0/2811569337 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfc00b1580 0x7fdfc00a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 >> 172.21.15.142:0/2811569337 conn(0x7fdfc00ce1f0 msgr2=0x7fdfc0155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 shutdown_connections 2023-09-30T22:54:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:19.049+0000 7fdfc6fff700 1 -- 172.21.15.142:0/2811569337 wait complete. 2023-09-30T22:54:19.066 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:54:19.067 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:54:19.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:19.068 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:54:19.115 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:54:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:54:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:19.116 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42199sec preferred_lft 42199sec 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:19.117 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:19.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:19.119 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:54:19.185 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:54:19.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:19.189 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:54:19.237 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:54:19.237 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:54:19.237 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:54:19.238 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:54:19.238 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:54:19.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:19.238 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:54:19.238 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:54:19.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:54:19.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:54:19.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:54:19.239 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:54:19.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:19.408 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:54:19.453 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T22:54:19.454 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:54:19.455 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:54:19.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:19.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:54:19.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:54:19.567 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:54:19.613 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:54:19.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:54:19.614 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:54:19.659 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:54:19.659 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:54:19.659 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:54:19.798 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:54:19.798 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:54:19.798 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:54:19.813 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:54:19.813 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:54:19.813 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:54:19.813 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:54:19.813 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:54:19.833 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:54:19.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:54:19.833 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:54:19.834 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:54:19.834 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:54:19.834 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:54:19.834 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:54:19.834 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:54:19.837 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:54:19.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:19.838 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:54:19.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:54:20.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.096+0000 7f65581ff700 1 Processor -- start 2023-09-30T22:54:20.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.096+0000 7f65581ff700 1 -- start start 2023-09-30T22:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f65581ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f65500b00d0 0x7f655006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f65581ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f655006e650 0x7f655015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f65581ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655006d3e0 con 0x7f65500af020 2023-09-30T22:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f65581ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655006dc80 con 0x7f655006e650 2023-09-30T22:54:20.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f65581ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655006b790 con 0x7f65500b00d0 2023-09-30T22:54:20.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f655679c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f655006e650 0x7f655015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:20.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f655679c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f655006e650 0x7f655015a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55668/0 (socket says 172.21.15.142:55668) 2023-09-30T22:54:20.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f655679c700 1 -- 172.21.15.142:0/1708460852 learned_addr learned my addr 172.21.15.142:0/1708460852 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:20.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.098+0000 7f655579a700 1 --2- 172.21.15.142:0/1708460852 >> v2:172.21.15.148:3300/0 conn(0x7f65500b00d0 0x7f655006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:20.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f655679c700 1 -- 172.21.15.142:0/1708460852 >> v2:172.21.15.148:3300/0 conn(0x7f65500b00d0 msgr2=0x7f655006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:20.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f655679c700 1 --2- 172.21.15.142:0/1708460852 >> v2:172.21.15.148:3300/0 conn(0x7f65500b00d0 0x7f655006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f655679c700 1 -- 172.21.15.142:0/1708460852 >> v1:172.21.15.148:6789/0 conn(0x7f65500af020 legacy=0x7f6550156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f655679c700 1 -- 172.21.15.142:0/1708460852 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500b0650 con 0x7f655006e650 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f655679c700 1 --2- 172.21.15.142:0/1708460852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655006e650 0x7f655015a3f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6548009f20 tx=0x7f6548009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b4ad5664ef7293 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f6554f99700 1 -- 172.21.15.142:0/1708460852 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654800e070 con 0x7f655006e650 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f6554f99700 1 -- 172.21.15.142:0/1708460852 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654800b990 con 0x7f655006e650 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.099+0000 7f6554f99700 1 -- 172.21.15.142:0/1708460852 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480092e0 con 0x7f655006e650 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 -- 172.21.15.142:0/1708460852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655006e650 msgr2=0x7f655015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 --2- 172.21.15.142:0/1708460852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655006e650 0x7f655015a3f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6548009f20 tx=0x7f6548009840 comp rx=0 tx=0).stop 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 -- 172.21.15.142:0/1708460852 shutdown_connections 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 --2- 172.21.15.142:0/1708460852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655006e650 0x7f655015a3f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 --2- 172.21.15.142:0/1708460852 >> v2:172.21.15.148:3300/0 conn(0x7f65500b00d0 0x7f655006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 -- 172.21.15.142:0/1708460852 >> 172.21.15.142:0/1708460852 conn(0x7f65500680c0 msgr2=0x7f65500c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 -- 172.21.15.142:0/1708460852 shutdown_connections 2023-09-30T22:54:20.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.100+0000 7f65581ff700 1 -- 172.21.15.142:0/1708460852 wait complete. 2023-09-30T22:54:20.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.101+0000 7f65581ff700 1 Processor -- start 2023-09-30T22:54:20.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.101+0000 7f65581ff700 1 -- start start 2023-09-30T22:54:20.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.102+0000 7f65581ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655006e650 0x7f655016ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:20.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.102+0000 7f65581ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65500af020 0x7f655015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.102+0000 7f65581ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65500b00d0 0x7f6550152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.102+0000 7f65581ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550153920 con 0x7f65500b00d0 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.102+0000 7f65581ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550158960 con 0x7f655006e650 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.102+0000 7f65581ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655016b080 con 0x7f65500af020 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65500b00d0 0x7f6550152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65500b00d0 0x7f6550152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55682/0 (socket says 172.21.15.142:55682) 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 -- 172.21.15.142:0/2194406890 learned_addr learned my addr 172.21.15.142:0/2194406890 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f6555f9b700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655006e650 0x7f655016ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655579a700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65500af020 0x7f655015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 -- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65500af020 msgr2=0x7f655015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65500af020 0x7f655015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 -- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655006e650 msgr2=0x7f655016ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655006e650 0x7f655016ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 -- 172.21.15.142:0/2194406890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548009ae0 con 0x7f65500b00d0 2023-09-30T22:54:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.103+0000 7f655679c700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65500b00d0 0x7f6550152c90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6548009880 tx=0x7f6548018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.104+0000 7f6545ffb700 1 -- 172.21.15.142:0/2194406890 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548008d00 con 0x7f65500b00d0 2023-09-30T22:54:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.104+0000 7f6545ffb700 1 -- 172.21.15.142:0/2194406890 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548008e60 con 0x7f65500b00d0 2023-09-30T22:54:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.104+0000 7f6545ffb700 1 -- 172.21.15.142:0/2194406890 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654801c660 con 0x7f65500b00d0 2023-09-30T22:54:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.104+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65500cc0f0 con 0x7f65500b00d0 2023-09-30T22:54:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.104+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6550158ee0 con 0x7f65500b00d0 2023-09-30T22:54:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.105+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65501587c0 con 0x7f65500b00d0 2023-09-30T22:54:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.106+0000 7f6545ffb700 1 -- 172.21.15.142:0/2194406890 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6548003040 con 0x7f65500b00d0 2023-09-30T22:54:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.106+0000 7f6545ffb700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6534067330 0x7f65340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.106+0000 7f6545ffb700 1 -- 172.21.15.142:0/2194406890 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f6548086960 con 0x7f65500b00d0 2023-09-30T22:54:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.107+0000 7f6555f9b700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6534067330 0x7f65340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.107+0000 7f6555f9b700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6534067330 0x7f65340697e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65500c8b40 tx=0x7f654c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:20.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.111+0000 7f6545ffb700 1 -- 172.21.15.142:0/2194406890 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f65501587c0 con 0x7f65500b00d0 2023-09-30T22:54:20.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.346+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f65501587c0 con 0x7f65500b00d0 2023-09-30T22:54:20.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.347+0000 7f6545ffb700 1 -- 172.21.15.142:0/2194406890 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f65501587c0 con 0x7f65500b00d0 2023-09-30T22:54:20.347 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:54:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6534067330 msgr2=0x7f65340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6534067330 0x7f65340697e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65500c8b40 tx=0x7f654c009040 comp rx=0 tx=0).stop 2023-09-30T22:54:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65500b00d0 msgr2=0x7f6550152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65500b00d0 0x7f6550152c90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6548009880 tx=0x7f6548018000 comp rx=0 tx=0).stop 2023-09-30T22:54:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 shutdown_connections 2023-09-30T22:54:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6534067330 0x7f65340697e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65500b00d0 0x7f6550152c90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655006e650 0x7f655016ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 --2- 172.21.15.142:0/2194406890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65500af020 0x7f655015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:20.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 >> 172.21.15.142:0/2194406890 conn(0x7f65500680c0 msgr2=0x7f65501561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:20.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 shutdown_connections 2023-09-30T22:54:20.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:20.349+0000 7f65581ff700 1 -- 172.21.15.142:0/2194406890 wait complete. 2023-09-30T22:54:20.366 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:54:20.367 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:54:20.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:20.368 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:54:20.420 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:54:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:54:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:54:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:54:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:54:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42228sec preferred_lft 42228sec 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:20.422 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:54:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:54:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T22:54:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:20.423 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:54:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:54:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T22:54:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:54:20.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:20.424 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:54:20.497 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:54:20.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:20.500 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:54:20.550 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:54:20.550 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:54:20.550 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:54:20.550 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:54:20.550 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:54:20.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:20.551 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:54:20.551 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:54:20.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:54:20.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:54:20.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:54:20.551 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:54:20.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:20.720 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:54:20.767 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T22:54:20.767 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:54:20.767 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:54:20.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:20.768 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:54:20.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:54:20.838 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:54:20.884 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:54:20.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:54:20.884 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:54:20.969 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:54:20.970 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:54:20.970 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:54:21.109 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:54:21.110 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:54:21.110 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:54:21.124 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:54:21.124 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:54:21.124 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:54:21.124 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:54:21.124 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:54:21.144 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:54:21.144 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:54:21.144 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:54:21.144 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:54:21.144 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:54:21.145 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:54:21.145 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:54:21.145 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:54:21.148 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:54:21.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:21.148 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:54:21.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:21.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.415+0000 7fbc467ff700 1 Processor -- start 2023-09-30T22:54:21.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.415+0000 7fbc467ff700 1 -- start start 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.416+0000 7fbc467ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc400c6da0 0x7fbc4006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.416+0000 7fbc467ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.416+0000 7fbc467ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4015dde0 con 0x7fbc4006d3f0 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.416+0000 7fbc467ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4015e710 con 0x7fbc400c6da0 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc467ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4006b840 con 0x7fbc4015e270 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc400c6da0 0x7fbc4006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc400c6da0 0x7fbc4006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36832/0 (socket says 172.21.15.142:36832) 2023-09-30T22:54:21.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbc4006d3f0 0x7fbc4006b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37604/0 (socket says 172.21.15.142:37604) 2023-09-30T22:54:21.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/268430271 learned_addr learned my addr 172.21.15.142:0/268430271 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:21.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc44d9c700 1 --2- 172.21.15.142:0/268430271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:21.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/268430271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 msgr2=0x7fbc40159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:21.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3f7fe700 1 --2- 172.21.15.142:0/268430271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/268430271 >> v1:172.21.15.142:6789/0 conn(0x7fbc4006d3f0 legacy=0x7fbc4006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:21.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/268430271 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4015d7d0 con 0x7fbc400c6da0 2023-09-30T22:54:21.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc44d9c700 1 --2- 172.21.15.142:0/268430271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.417+0000 7fbc3effd700 1 -- 172.21.15.142:0/268430271 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327338561 0 0) 0x7fbc4015dde0 con 0x7fbc4006d3f0 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc3f7fe700 1 --2- 172.21.15.142:0/268430271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4006d7c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbc340099b0 tx=0x7fbc34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2d52e2ec857254 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc3effd700 1 -- 172.21.15.142:0/268430271 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400b860 con 0x7fbc400c6da0 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc3effd700 1 -- 172.21.15.142:0/268430271 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400b9c0 con 0x7fbc400c6da0 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc3effd700 1 -- 172.21.15.142:0/268430271 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400bd60 con 0x7fbc400c6da0 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 -- 172.21.15.142:0/268430271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 msgr2=0x7fbc4006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 --2- 172.21.15.142:0/268430271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4006d7c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbc340099b0 tx=0x7fbc34009250 comp rx=0 tx=0).stop 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 -- 172.21.15.142:0/268430271 shutdown_connections 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 --2- 172.21.15.142:0/268430271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 --2- 172.21.15.142:0/268430271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4006d7c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 -- 172.21.15.142:0/268430271 >> 172.21.15.142:0/268430271 conn(0x7fbc40067e30 msgr2=0x7fbc40068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:21.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 -- 172.21.15.142:0/268430271 shutdown_connections 2023-09-30T22:54:21.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.418+0000 7fbc467ff700 1 -- 172.21.15.142:0/268430271 wait complete. 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.420+0000 7fbc467ff700 1 Processor -- start 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.420+0000 7fbc467ff700 1 -- start start 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc467ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc4006d3f0 0x7fbc40155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc467ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4016d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc467ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc467ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40154fe0 con 0x7fbc400c6da0 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc467ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4016e320 con 0x7fbc4006d3f0 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc467ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4016e600 con 0x7fbc4015e270 2023-09-30T22:54:21.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc3f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4016d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc3f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4016d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36848/0 (socket says 172.21.15.142:36848) 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/4020568611 learned_addr learned my addr 172.21.15.142:0/4020568611 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc3ffff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc4006d3f0 0x7fbc40155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.421+0000 7fbc44d9c700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 msgr2=0x7fbc40157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc3f7fe700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc4006d3f0 msgr2=0x7fbc40155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc3f7fe700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc4006d3f0 0x7fbc40155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc3f7fe700 1 -- 172.21.15.142:0/4020568611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340094f0 con 0x7fbc400c6da0 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc3f7fe700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4016d880 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbc340090b0 tx=0x7fbc34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:21.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc27fff700 1 -- 172.21.15.142:0/4020568611 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34011d70 con 0x7fbc400c6da0 2023-09-30T22:54:21.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc27fff700 1 -- 172.21.15.142:0/4020568611 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3401f070 con 0x7fbc400c6da0 2023-09-30T22:54:21.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc27fff700 1 -- 172.21.15.142:0/4020568611 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340266d0 con 0x7fbc400c6da0 2023-09-30T22:54:21.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc40155230 con 0x7fbc400c6da0 2023-09-30T22:54:21.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.422+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc40155f70 con 0x7fbc400c6da0 2023-09-30T22:54:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.423+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc40155750 con 0x7fbc400c6da0 2023-09-30T22:54:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.424+0000 7fbc27fff700 1 -- 172.21.15.142:0/4020568611 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbc34026ac0 con 0x7fbc400c6da0 2023-09-30T22:54:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.425+0000 7fbc27fff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc2c067330 0x7fbc2c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.425+0000 7fbc27fff700 1 -- 172.21.15.142:0/4020568611 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fbc34021070 con 0x7fbc400c6da0 2023-09-30T22:54:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.425+0000 7fbc3ffff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc2c067330 0x7fbc2c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.426+0000 7fbc3ffff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc2c067330 0x7fbc2c0697e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc30007fd0 tx=0x7fbc30007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:21.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.429+0000 7fbc27fff700 1 -- 172.21.15.142:0/4020568611 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbc40155750 con 0x7fbc400c6da0 2023-09-30T22:54:21.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.664+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc40155750 con 0x7fbc400c6da0 2023-09-30T22:54:21.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.665+0000 7fbc27fff700 1 -- 172.21.15.142:0/4020568611 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fbc40155750 con 0x7fbc400c6da0 2023-09-30T22:54:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:21.665 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.667+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc2c067330 msgr2=0x7fbc2c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.667+0000 7fbc467ff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc2c067330 0x7fbc2c0697e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc30007fd0 tx=0x7fbc30007d50 comp rx=0 tx=0).stop 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.667+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 msgr2=0x7fbc4016d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.667+0000 7fbc467ff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4016d880 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbc340090b0 tx=0x7fbc34017000 comp rx=0 tx=0).stop 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 shutdown_connections 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc2c067330 0x7fbc2c0697e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc4015e270 0x7fbc40157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc4006d3f0 0x7fbc40155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 --2- 172.21.15.142:0/4020568611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc400c6da0 0x7fbc4016d880 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:21.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 >> 172.21.15.142:0/4020568611 conn(0x7fbc40067e30 msgr2=0x7fbc40158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:21.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 shutdown_connections 2023-09-30T22:54:21.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:21.668+0000 7fbc467ff700 1 -- 172.21.15.142:0/4020568611 wait complete. 2023-09-30T22:54:21.669 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:21.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:54:21.896 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":5376,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.613811223000001,"mdsmap_epoch":24,"osdmap_epoch":50,"osdmap_epoch_barrier":48,"uptime":20.640787303} 2023-09-30T22:54:21.897 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 5376, "mdsmap_epoch": 24, "osdmap_epoch": 50, "osdmap_epoch_barrier": 48, "rank_uptime": 14.613811223, "state": "up:active", "uptime": 20.640787303, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:54:21.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T22:54:22.105 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T22:54:22.105 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T22:54:22.105 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-09-30T22:54:22.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:22.105 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-09-30T22:54:24.124 INFO:teuthology.orchestra.run.smithi142.stderr:265+0 records in 2023-09-30T22:54:24.124 INFO:teuthology.orchestra.run.smithi142.stderr:265+0 records out 2023-09-30T22:54:24.124 INFO:teuthology.orchestra.run.smithi142.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.9689 s, 141 MB/s 2023-09-30T22:54:24.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:24.125 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-09-30T22:54:26.357 INFO:teuthology.orchestra.run.smithi142.stderr:292+0 records in 2023-09-30T22:54:26.358 INFO:teuthology.orchestra.run.smithi142.stderr:292+0 records out 2023-09-30T22:54:26.358 INFO:teuthology.orchestra.run.smithi142.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.18498 s, 140 MB/s 2023-09-30T22:54:26.359 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-30T22:54:26.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:54:26.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.549+0000 7f53fcbff700 1 Processor -- start 2023-09-30T22:54:26.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.549+0000 7f53fcbff700 1 -- start start 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.550+0000 7f53fcbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53f8143350 0x7f53f80cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.550+0000 7f53fcbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53f80692f0 0x7f53f815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53fcbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f80cc6b0 con 0x7f53f815dc50 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53fcbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f815e050 con 0x7f53f80692f0 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53fcbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f80cb7d0 con 0x7f53f8143350 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53f80692f0 0x7f53f815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53f80692f0 0x7f53f815d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36862/0 (socket says 172.21.15.142:36862) 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f5d9b700 1 -- 172.21.15.142:0/3086883392 learned_addr learned my addr 172.21.15.142:0/3086883392 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:26.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f659c700 1 --2- 172.21.15.142:0/3086883392 >> v2:172.21.15.148:3300/0 conn(0x7f53f8143350 0x7f53f80cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f659c700 1 -- 172.21.15.142:0/3086883392 >> v2:172.21.15.142:3300/0 conn(0x7f53f80692f0 msgr2=0x7f53f815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f659c700 1 --2- 172.21.15.142:0/3086883392 >> v2:172.21.15.142:3300/0 conn(0x7f53f80692f0 0x7f53f815d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f659c700 1 -- 172.21.15.142:0/3086883392 >> v1:172.21.15.148:6789/0 conn(0x7f53f815dc50 legacy=0x7f53f8068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f659c700 1 -- 172.21.15.142:0/3086883392 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80cbaa0 con 0x7f53f8143350 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f5d9b700 1 --2- 172.21.15.142:0/3086883392 >> v2:172.21.15.142:3300/0 conn(0x7f53f80692f0 0x7f53f815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.551+0000 7f53f559a700 1 -- 172.21.15.142:0/3086883392 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904786340 0 0) 0x7f53f80cc6b0 con 0x7f53f815dc50 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53f659c700 1 --2- 172.21.15.142:0/3086883392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f8143350 0x7f53f80cb290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53f8069cc0 tx=0x7f53e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6edb9f56ee074e1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53f559a700 1 -- 172.21.15.142:0/3086883392 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8011630 con 0x7f53f8143350 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53f559a700 1 -- 172.21.15.142:0/3086883392 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e8011790 con 0x7f53f8143350 2023-09-30T22:54:26.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53f559a700 1 -- 172.21.15.142:0/3086883392 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8011b30 con 0x7f53f8143350 2023-09-30T22:54:26.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53fcbff700 1 -- 172.21.15.142:0/3086883392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f8143350 msgr2=0x7f53f80cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:26.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53fcbff700 1 --2- 172.21.15.142:0/3086883392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f8143350 0x7f53f80cb290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53f8069cc0 tx=0x7f53e80091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53fcbff700 1 -- 172.21.15.142:0/3086883392 shutdown_connections 2023-09-30T22:54:26.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.552+0000 7f53fcbff700 1 --2- 172.21.15.142:0/3086883392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f8143350 0x7f53f80cb290 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.553+0000 7f53fcbff700 1 --2- 172.21.15.142:0/3086883392 >> v2:172.21.15.142:3300/0 conn(0x7f53f80692f0 0x7f53f815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.553+0000 7f53fcbff700 1 -- 172.21.15.142:0/3086883392 >> 172.21.15.142:0/3086883392 conn(0x7f53f80ce8e0 msgr2=0x7f53f80cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:26.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.553+0000 7f53fcbff700 1 -- 172.21.15.142:0/3086883392 shutdown_connections 2023-09-30T22:54:26.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.553+0000 7f53fcbff700 1 -- 172.21.15.142:0/3086883392 wait complete. 2023-09-30T22:54:26.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.555+0000 7f53fcbff700 1 Processor -- start 2023-09-30T22:54:26.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.555+0000 7f53fcbff700 1 -- start start 2023-09-30T22:54:26.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53fcbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f80692f0 0x7f53f80a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:26.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53fcbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f8143350 0x7f53f80b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:26.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53fcbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f815dc50 0x7f53f80b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:26.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53fcbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80b1300 con 0x7f53f80692f0 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53fcbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80a54b0 con 0x7f53f815dc50 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53fcbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80a5700 con 0x7f53f8143350 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53f659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f80692f0 0x7f53f80a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53f659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f80692f0 0x7f53f80a7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36876/0 (socket says 172.21.15.142:36876) 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53f659c700 1 -- 172.21.15.142:0/2031121135 learned_addr learned my addr 172.21.15.142:0/2031121135 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53f5d9b700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f8143350 0x7f53f80b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.556+0000 7f53f6d9d700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f815dc50 0x7f53f80b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53f659c700 1 -- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f8143350 msgr2=0x7f53f80b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53f659c700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f8143350 0x7f53f80b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53f659c700 1 -- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f815dc50 msgr2=0x7f53f80b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:26.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53f659c700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f815dc50 0x7f53f80b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53f659c700 1 -- 172.21.15.142:0/2031121135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0094f0 con 0x7f53f80692f0 2023-09-30T22:54:26.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53f659c700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f80692f0 0x7f53f80a7250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f53f80cb910 tx=0x7f53e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:26.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53e67fc700 1 -- 172.21.15.142:0/2031121135 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8000d10 con 0x7f53f80692f0 2023-09-30T22:54:26.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53e67fc700 1 -- 172.21.15.142:0/2031121135 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e8011b10 con 0x7f53f80692f0 2023-09-30T22:54:26.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e8009420 con 0x7f53f80692f0 2023-09-30T22:54:26.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53e67fc700 1 -- 172.21.15.142:0/2031121135 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8025640 con 0x7f53f80692f0 2023-09-30T22:54:26.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.557+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f80a5d40 con 0x7f53f80692f0 2023-09-30T22:54:26.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.558+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f806ea70 con 0x7f53f80692f0 2023-09-30T22:54:26.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.559+0000 7f53e67fc700 1 -- 172.21.15.142:0/2031121135 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f53e8025a30 con 0x7f53f80692f0 2023-09-30T22:54:26.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.560+0000 7f53e67fc700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53d8067330 0x7f53d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:26.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.561+0000 7f53e67fc700 1 -- 172.21.15.142:0/2031121135 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f53e8086420 con 0x7f53f80692f0 2023-09-30T22:54:26.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.561+0000 7f53f5d9b700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53d8067330 0x7f53d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:26.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.561+0000 7f53f5d9b700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53d8067330 0x7f53d80697e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53f80c8ec0 tx=0x7f53ec009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:26.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.565+0000 7f53e67fc700 1 -- 172.21.15.142:0/2031121135 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f53e8053260 con 0x7f53f80692f0 2023-09-30T22:54:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.757+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f53f806fc10 con 0x7f53f80692f0 2023-09-30T22:54:26.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.759+0000 7f53e67fc700 1 -- 172.21.15.142:0/2031121135 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+35152 (secure 0 0 0) 0x7f53e8056880 con 0x7f53f80692f0 2023-09-30T22:54:26.759 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:26.759 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:26.759 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 50, 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:54:17.321550+0000", 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:54:26.760 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 8, 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:54:26.761 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:26.762 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:54:26.763 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:26.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "16", 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:26.765 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:26.766 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:26.767 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:26.769 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:26.770 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "19", 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:26.771 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 7, 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:04.395113+0000", 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:54:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "47", 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:54:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 8, 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:05.729484+0000", 2023-09-30T22:54:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "48", 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:54:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:54:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 49, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:54:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:54:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:54:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:54:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:54:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:54:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "8.2b", 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 2, 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:54:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:54:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:54:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:54:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:54:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:54:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:54:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:26.852 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53d8067330 msgr2=0x7f53d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53d8067330 0x7f53d80697e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53f80c8ec0 tx=0x7f53ec009250 comp rx=0 tx=0).stop 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f80692f0 msgr2=0x7f53f80a7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f80692f0 0x7f53f80a7250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f53f80cb910 tx=0x7f53e8017000 comp rx=0 tx=0).stop 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 shutdown_connections 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53d8067330 0x7f53d80697e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f815dc50 0x7f53f80b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f80692f0 0x7f53f80a7250 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 --2- 172.21.15.142:0/2031121135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f8143350 0x7f53f80b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 >> 172.21.15.142:0/2031121135 conn(0x7f53f80ce8e0 msgr2=0x7f53f80c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 shutdown_connections 2023-09-30T22:54:26.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:26.761+0000 7f53fcbff700 1 -- 172.21.15.142:0/2031121135 wait complete. 2023-09-30T22:54:26.855 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:54:27.501 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:54:27.501+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-09-30T22:54:31.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:54:32.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.057+0000 7fa7befff700 1 Processor -- start 2023-09-30T22:54:32.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.057+0000 7fa7befff700 1 -- start start 2023-09-30T22:54:32.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.058+0000 7fa7befff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 0x7fa7b8159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.058+0000 7fa7befff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa7b8069f10 0x7fa7b806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.058+0000 7fa7befff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b80b0ee0 con 0x7fa7b80aebf0 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.058+0000 7fa7befff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b80aefc0 con 0x7fa7b8069f10 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.058+0000 7fa7befff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b815a520 con 0x7fa7b8159b90 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.058+0000 7fa7bcd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa7b80aebf0 0x7fa7b806ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46268/0 (socket says 172.21.15.142:46268) 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.058+0000 7fa7bcd9b700 1 -- 172.21.15.142:0/3509993992 learned_addr learned my addr 172.21.15.142:0/3509993992 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b7fff700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 0x7fa7b8159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7bd59c700 1 --2- 172.21.15.142:0/3509993992 >> v2:172.21.15.148:3300/0 conn(0x7fa7b8069f10 0x7fa7b806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849445621 0 0) 0x7fa7b80b0ee0 con 0x7fa7b80aebf0 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a8003570 con 0x7fa7b80aebf0 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2262059378 0 0) 0x7fa7a8003570 con 0x7fa7b80aebf0 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 msgr2=0x7fa7b8159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 0x7fa7b8159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 >> v2:172.21.15.148:3300/0 conn(0x7fa7b8069f10 msgr2=0x7fa7b806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 --2- 172.21.15.142:0/3509993992 >> v2:172.21.15.148:3300/0 conn(0x7fa7b8069f10 0x7fa7b806a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b806f360 con 0x7fa7b80aebf0 2023-09-30T22:54:32.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fa7ac001470 con 0x7fa7b80aebf0 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 >> v1:172.21.15.142:6789/0 conn(0x7fa7b80aebf0 legacy=0x7fa7b806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 0x7fa7a8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80aefc0 con 0x7fa7a8003fe0 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b815a520 con 0x7fa7a8004d50 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.059+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a800ba90 con 0x7fa7b8159b90 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b7fff700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7bcd9b700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 0x7fa7a8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7bd59c700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b7fff700 1 -- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 msgr2=0x7fa7a8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b7fff700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b8159b90 0x7fa7a8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b7fff700 1 -- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7a8004d50 msgr2=0x7fa7a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b7fff700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b7fff700 1 -- 172.21.15.142:0/3509993992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8003570 con 0x7fa7a8003fe0 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b7fff700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400adb0 tx=0x7fa7a400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc265d3a04d59d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.060+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a400a760 con 0x7fa7a8003fe0 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a400f9d0 con 0x7fa7a8003fe0 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7b77fe700 1 -- 172.21.15.142:0/3509993992 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a400fb40 con 0x7fa7a8003fe0 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7befff700 1 -- 172.21.15.142:0/3509993992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 msgr2=0x7fa7a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7befff700 1 --2- 172.21.15.142:0/3509993992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7a8004810 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400adb0 tx=0x7fa7a400a330 comp rx=0 tx=0).stop 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7bd59c700 1 -- 172.21.15.142:0/3509993992 reap_dead start 2023-09-30T22:54:32.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7befff700 1 -- 172.21.15.142:0/3509993992 shutdown_connections 2023-09-30T22:54:32.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7befff700 1 -- 172.21.15.142:0/3509993992 >> 172.21.15.142:0/3509993992 conn(0x7fa7b80680c0 msgr2=0x7fa7b80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:32.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7befff700 1 -- 172.21.15.142:0/3509993992 shutdown_connections 2023-09-30T22:54:32.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.061+0000 7fa7befff700 1 -- 172.21.15.142:0/3509993992 wait complete. 2023-09-30T22:54:32.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.063+0000 7fa7befff700 1 Processor -- start 2023-09-30T22:54:32.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.063+0000 7fa7befff700 1 -- start start 2023-09-30T22:54:32.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7befff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7b81522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7befff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b80c16e0 0x7fa7b81539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7befff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b8150110 0x7fa7b81578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7befff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8153560 con 0x7fa7a8003fe0 2023-09-30T22:54:32.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7befff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8153f30 con 0x7fa7b8150110 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7befff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8152950 con 0x7fa7b80c16e0 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7b81522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7b81522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45088/0 (socket says 172.21.15.142:45088) 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 -- 172.21.15.142:0/1967379215 learned_addr learned my addr 172.21.15.142:0/1967379215 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 -- 172.21.15.142:0/1967379215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b80c16e0 msgr2=0x7fa7b81539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b80c16e0 0x7fa7b81539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 -- 172.21.15.142:0/1967379215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b8150110 msgr2=0x7fa7b81578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b8150110 0x7fa7b81578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 -- 172.21.15.142:0/1967379215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8152c30 con 0x7fa7a8003fe0 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.064+0000 7fa7bcd9b700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7b81522c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac007390 tx=0x7fa7ac001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.065+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac018030 con 0x7fa7a8003fe0 2023-09-30T22:54:32.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.065+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac00fa30 con 0x7fa7a8003fe0 2023-09-30T22:54:32.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.065+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00fdf0 con 0x7fa7a8003fe0 2023-09-30T22:54:32.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.065+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b8152f10 con 0x7fa7a8003fe0 2023-09-30T22:54:32.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.065+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b80c1b50 con 0x7fa7a8003fe0 2023-09-30T22:54:32.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.066+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b8153840 con 0x7fa7a8003fe0 2023-09-30T22:54:32.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.067+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa7ac01b070 con 0x7fa7a8003fe0 2023-09-30T22:54:32.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.067+0000 7fa7b4ff9700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa79c067330 0x7fa79c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.068+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fa7ac019070 con 0x7fa7a8003fe0 2023-09-30T22:54:32.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.068+0000 7fa7b7fff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa79c067330 0x7fa79c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.068+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7fa79c06f550 con 0x7fa7a8003fe0 2023-09-30T22:54:32.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.068+0000 7fa7b7fff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa79c067330 0x7fa79c0697e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80c1de0 tx=0x7fa7a401d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:32.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.072+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa7ac051ad0 con 0x7fa7a8003fe0 2023-09-30T22:54:32.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.269+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa7b806fc10 con 0x7fa7a8003fe0 2023-09-30T22:54:32.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.270+0000 7fa7b4ff9700 1 -- 172.21.15.142:0/1967379215 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+35356 (secure 0 0 0) 0x7fa7ac0550f0 con 0x7fa7a8003fe0 2023-09-30T22:54:32.270 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 55, 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:54:31.534679+0000", 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:54:32.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:54:32.272 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 8, 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:54:32.273 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:32.274 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:32.275 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:32.276 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:32.277 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:32.278 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:32.278 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:32.278 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:32.278 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:32.278 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:32.279 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:32.280 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:32.280 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:32.280 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:32.280 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:32.280 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:32.280 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:32.281 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:32.281 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:32.281 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:54:32.281 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:54:32.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.282 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:32.282 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:54:32.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.283 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:54:32.283 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:54:32.283 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:54:32.283 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:32.283 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:32.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:32.284 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:32.284 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:32.284 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:32.284 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:32.285 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:32.285 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:32.285 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:32.285 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:32.286 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:32.288 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.289 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:32.290 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 7, 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:04.395113+0000", 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:32.291 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:54:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:32.293 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:32.294 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:32.296 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:32.297 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:54:32.298 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 8, 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:05.729484+0000", 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:32.299 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:32.300 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:32.301 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:32.302 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:32.303 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:32.304 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:32.305 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.306 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.307 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:54:32.308 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.309 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.310 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.311 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.312 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.314 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 49, 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:54:32.316 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.317 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.319 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.320 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.321 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.322 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.323 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:54:32.324 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.326 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:54:32.327 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.328 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.329 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.330 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.332 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:54:32.334 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.335 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:54:32.336 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.338 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.340 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:32.341 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.342 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:54:32.343 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.344 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.345 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.346 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.347 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:32.348 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.349 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.351 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.352 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.353 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.355 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:32.356 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:54:32.358 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:32.360 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:54:32.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.363 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.364 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.365 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.366 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:54:32.367 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.368 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:54:32.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "8.2b", 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 2, 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:54:32.370 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:54:32.372 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:54:32.373 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:54:32.373 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:32.373 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:32.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa79c067330 msgr2=0x7fa79c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa79c067330 0x7fa79c0697e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80c1de0 tx=0x7fa7a401d000 comp rx=0 tx=0).stop 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 msgr2=0x7fa7b81522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7b81522c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac007390 tx=0x7fa7ac001e90 comp rx=0 tx=0).stop 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 shutdown_connections 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa79c067330 0x7fa79c0697e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b8150110 0x7fa7b81578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7a8003fe0 0x7fa7b81522c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 --2- 172.21.15.142:0/1967379215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa7b80c16e0 0x7fa7b81539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.272+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 >> 172.21.15.142:0/1967379215 conn(0x7fa7b80680c0 msgr2=0x7fa7b81541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:32.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.273+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 shutdown_connections 2023-09-30T22:54:32.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.273+0000 7fa7befff700 1 -- 172.21.15.142:0/1967379215 wait complete. 2023-09-30T22:54:32.376 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-30T22:54:32.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:32.377 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-09-30T22:54:32.728 INFO:teuthology.orchestra.run.smithi142.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-30T22:54:32.728 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T22:54:32.728 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T22:54:32.728 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.295063 s, 178 MB/s 2023-09-30T22:54:32.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:54:32.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:54:32.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.924+0000 7f6291bff700 1 Processor -- start 2023-09-30T22:54:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.924+0000 7f6291bff700 1 -- start start 2023-09-30T22:54:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f6291bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1580 0x7f628c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f6291bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f628c0b1950 0x7f628c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f6291bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c0ad630 con 0x7f628c0ae000 2023-09-30T22:54:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f6291bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c157c20 con 0x7f628c0b1950 2023-09-30T22:54:32.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f6291bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0b3360 con 0x7f628c0b1580 2023-09-30T22:54:32.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f628affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f628c0b1950 0x7f628c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f628affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f628c0b1950 0x7f628c15a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45094/0 (socket says 172.21.15.142:45094) 2023-09-30T22:54:32.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f628affd700 1 -- 172.21.15.142:0/3504265382 learned_addr learned my addr 172.21.15.142:0/3504265382 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:32.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.926+0000 7f628b7fe700 1 --2- 172.21.15.142:0/3504265382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1580 0x7f628c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628affd700 1 -- 172.21.15.142:0/3504265382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1580 msgr2=0x7f628c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:32.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628affd700 1 --2- 172.21.15.142:0/3504265382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1580 0x7f628c0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628affd700 1 -- 172.21.15.142:0/3504265382 >> v1:172.21.15.148:6789/0 conn(0x7f628c0ae000 legacy=0x7f628c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628affd700 1 -- 172.21.15.142:0/3504265382 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c15ad60 con 0x7f628c0b1950 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628affd700 1 --2- 172.21.15.142:0/3504265382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0b1950 0x7f628c15a180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bafbd192e927cfd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628a7fc700 1 -- 172.21.15.142:0/3504265382 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280009ea0 con 0x7f628c0b1950 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628a7fc700 1 -- 172.21.15.142:0/3504265382 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000b860 con 0x7f628c0b1950 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.927+0000 7f628a7fc700 1 -- 172.21.15.142:0/3504265382 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000bc00 con 0x7f628c0b1950 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 -- 172.21.15.142:0/3504265382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0b1950 msgr2=0x7f628c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 --2- 172.21.15.142:0/3504265382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0b1950 0x7f628c15a180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280009250 comp rx=0 tx=0).stop 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 -- 172.21.15.142:0/3504265382 shutdown_connections 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 --2- 172.21.15.142:0/3504265382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1580 0x7f628c0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 --2- 172.21.15.142:0/3504265382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0b1950 0x7f628c15a180 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 -- 172.21.15.142:0/3504265382 >> 172.21.15.142:0/3504265382 conn(0x7f628c0ce1f0 msgr2=0x7f628c069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 -- 172.21.15.142:0/3504265382 shutdown_connections 2023-09-30T22:54:32.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.928+0000 7f6291bff700 1 -- 172.21.15.142:0/3504265382 wait complete. 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.929+0000 7f6291bff700 1 Processor -- start 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.930+0000 7f6291bff700 1 -- start start 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.930+0000 7f6291bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0ae000 0x7f628c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.930+0000 7f6291bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f628c0b1580 0x7f628c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.930+0000 7f6291bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1950 0x7f628c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.930+0000 7f6291bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0a98c0 con 0x7f628c0ae000 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.930+0000 7f6291bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c16ab40 con 0x7f628c0b1580 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.930+0000 7f6291bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c16ae20 con 0x7f628c0b1950 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0ae000 0x7f628c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0ae000 0x7f628c1507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45110/0 (socket says 172.21.15.142:45110) 2023-09-30T22:54:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 -- 172.21.15.142:0/1575767536 learned_addr learned my addr 172.21.15.142:0/1575767536 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628affd700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f628c0b1580 0x7f628c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628bfff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1950 0x7f628c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 -- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1950 msgr2=0x7f628c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1950 0x7f628c154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 -- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f628c0b1580 msgr2=0x7f628c14f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f628c0b1580 0x7f628c14f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 -- 172.21.15.142:0/1575767536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800094f0 con 0x7f628c0ae000 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628bfff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1950 0x7f628c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.931+0000 7f628b7fe700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0ae000 0x7f628c1507b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f627c00ec80 tx=0x7f627c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.932+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c00c850 con 0x7f628c0ae000 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.932+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c00c9b0 con 0x7f628c0ae000 2023-09-30T22:54:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.932+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c00cd50 con 0x7f628c0ae000 2023-09-30T22:54:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.932+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c16b100 con 0x7f628c0ae000 2023-09-30T22:54:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.932+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c14fb10 con 0x7f628c0ae000 2023-09-30T22:54:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.933+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c06d600 con 0x7f628c0ae000 2023-09-30T22:54:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.934+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f627c013680 con 0x7f628c0ae000 2023-09-30T22:54:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.934+0000 7f62737fe700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6278067330 0x7f62780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.934+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f627c084f40 con 0x7f628c0ae000 2023-09-30T22:54:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.935+0000 7f628affd700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6278067330 0x7f62780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.935+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f627806f550 con 0x7f628c0ae000 2023-09-30T22:54:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.935+0000 7f628affd700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6278067330 0x7f62780697e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:32.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:32.939+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f627c017060 con 0x7f628c0ae000 2023-09-30T22:54:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.133+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f628c0a9ba0 con 0x7f628c0ae000 2023-09-30T22:54:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.134+0000 7f62737fe700 1 -- 172.21.15.142:0/1575767536 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+35356 (secure 0 0 0) 0x7f627c021090 con 0x7f628c0ae000 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 55, 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:54:31.534679+0000", 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:54:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:54:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 8, 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:54:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:54:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 7, 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:04.395113+0000", 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:54:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 8, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:05.729484+0000", 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 49, 2023-09-30T22:54:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:54:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:54:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:54:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:54:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:54:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:54:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:54:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "8.2b", 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 2, 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:54:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:54:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:54:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:33.231 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:33.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.136+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6278067330 msgr2=0x7f62780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:33.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.136+0000 7f6291bff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6278067330 0x7f62780697e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280017000 comp rx=0 tx=0).stop 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.136+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0ae000 msgr2=0x7f628c1507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.136+0000 7f6291bff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0ae000 0x7f628c1507b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f627c00ec80 tx=0x7f627c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 shutdown_connections 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6278067330 0x7f62780697e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f628c0b1950 0x7f628c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f628c0ae000 0x7f628c1507b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 --2- 172.21.15.142:0/1575767536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f628c0b1580 0x7f628c14f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 >> 172.21.15.142:0/1575767536 conn(0x7f628c0ce1f0 msgr2=0x7f628c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 shutdown_connections 2023-09-30T22:54:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.137+0000 7f6291bff700 1 -- 172.21.15.142:0/1575767536 wait complete. 2023-09-30T22:54:33.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:33.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.427+0000 7f6f2b1ff700 1 Processor -- start 2023-09-30T22:54:33.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.427+0000 7f6f2b1ff700 1 -- start start 2023-09-30T22:54:33.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.428+0000 7f6f2b1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f24159ae0 0x7f6f240cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:33.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.428+0000 7f6f2b1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f240b1180 0x7f6f240cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:33.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.428+0000 7f6f2b1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f24159eb0 0x7f6f240cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.428+0000 7f6f2b1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2415e920 con 0x7f6f24159ae0 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.428+0000 7f6f2b1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2415d910 con 0x7f6f24159eb0 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.428+0000 7f6f2b1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2415e490 con 0x7f6f240b1180 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f24159ae0 0x7f6f240cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f24159ae0 0x7f6f240cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45114/0 (socket says 172.21.15.142:45114) 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 -- 172.21.15.142:0/2697368928 learned_addr learned my addr 172.21.15.142:0/2697368928 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f23fff700 1 --2- 172.21.15.142:0/2697368928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f240b1180 0x7f6f240cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f2979c700 1 --2- 172.21.15.142:0/2697368928 >> v2:172.21.15.148:3300/0 conn(0x7f6f24159eb0 0x7f6f240cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 -- 172.21.15.142:0/2697368928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f240b1180 msgr2=0x7f6f240cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:33.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 --2- 172.21.15.142:0/2697368928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f240b1180 0x7f6f240cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 -- 172.21.15.142:0/2697368928 >> v2:172.21.15.148:3300/0 conn(0x7f6f24159eb0 msgr2=0x7f6f240cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:33.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 --2- 172.21.15.142:0/2697368928 >> v2:172.21.15.148:3300/0 conn(0x7f6f24159eb0 0x7f6f240cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 -- 172.21.15.142:0/2697368928 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2415db60 con 0x7f6f24159ae0 2023-09-30T22:54:33.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.429+0000 7f6f28f9b700 1 --2- 172.21.15.142:0/2697368928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159ae0 0x7f6f240cdeb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6f2406c680 tx=0x7f6f18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e876268ba7e9ebb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f237fe700 1 -- 172.21.15.142:0/2697368928 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800b640 con 0x7f6f24159ae0 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f237fe700 1 -- 172.21.15.142:0/2697368928 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800b7a0 con 0x7f6f24159ae0 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f237fe700 1 -- 172.21.15.142:0/2697368928 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800bb60 con 0x7f6f24159ae0 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/2697368928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159ae0 msgr2=0x7f6f240cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/2697368928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159ae0 0x7f6f240cdeb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6f2406c680 tx=0x7f6f18009250 comp rx=0 tx=0).stop 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/2697368928 shutdown_connections 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/2697368928 >> v2:172.21.15.148:3300/0 conn(0x7f6f24159eb0 0x7f6f240cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/2697368928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159ae0 0x7f6f240cdeb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/2697368928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f240b1180 0x7f6f240cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/2697368928 >> 172.21.15.142:0/2697368928 conn(0x7f6f240ce8b0 msgr2=0x7f6f240cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:33.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/2697368928 shutdown_connections 2023-09-30T22:54:33.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.430+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/2697368928 wait complete. 2023-09-30T22:54:33.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.432+0000 7f6f2b1ff700 1 Processor -- start 2023-09-30T22:54:33.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.432+0000 7f6f2b1ff700 1 -- start start 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2b1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f240b1180 0x7f6f24145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2b1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f24159ae0 0x7f6f240ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2b1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159eb0 0x7f6f240cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2b1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2415b700 con 0x7f6f24159eb0 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2b1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240c8ba0 con 0x7f6f240b1180 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2b1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240c7f90 con 0x7f6f24159ae0 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2979c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159eb0 0x7f6f240cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2979c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159eb0 0x7f6f240cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45126/0 (socket says 172.21.15.142:45126) 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f2979c700 1 -- 172.21.15.142:0/734089094 learned_addr learned my addr 172.21.15.142:0/734089094 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:33.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f28f9b700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f240b1180 0x7f6f24145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.433+0000 7f6f23fff700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f24159ae0 0x7f6f240ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2979c700 1 -- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f24159ae0 msgr2=0x7f6f240ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2979c700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f24159ae0 0x7f6f240ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2979c700 1 -- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f240b1180 msgr2=0x7f6f24145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2979c700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f240b1180 0x7f6f24145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2979c700 1 -- 172.21.15.142:0/734089094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180094f0 con 0x7f6f24159eb0 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f28f9b700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f240b1180 0x7f6f24145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2979c700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159eb0 0x7f6f240cad40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009df0 tx=0x7f6f1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00cb50 con 0x7f6f24159eb0 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00f040 con 0x7f6f24159eb0 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f240c8270 con 0x7f6f24159eb0 2023-09-30T22:54:33.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c014480 con 0x7f6f24159eb0 2023-09-30T22:54:33.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.434+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f240c8830 con 0x7f6f24159eb0 2023-09-30T22:54:33.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.435+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f240c8d50 con 0x7f6f24159eb0 2023-09-30T22:54:33.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.436+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6f1c014830 con 0x7f6f24159eb0 2023-09-30T22:54:33.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.437+0000 7f6f20ff9700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f08067330 0x7f6f080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:33.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.437+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f6f1c0858a0 con 0x7f6f24159eb0 2023-09-30T22:54:33.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.437+0000 7f6f28f9b700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f08067330 0x7f6f080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:33.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.437+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f6f0806f550 con 0x7f6f24159eb0 2023-09-30T22:54:33.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.438+0000 7f6f28f9b700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f08067330 0x7f6f080697e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f2406c680 tx=0x7f6f18017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:33.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.441+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6f240c8d50 con 0x7f6f24159eb0 2023-09-30T22:54:33.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.675+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f240c8d10 con 0x7f6f24159eb0 2023-09-30T22:54:33.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.676+0000 7f6f20ff9700 1 -- 172.21.15.142:0/734089094 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f6f1c018020 con 0x7f6f24159eb0 2023-09-30T22:54:33.676 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:33.676 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.678+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f08067330 msgr2=0x7f6f080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f08067330 0x7f6f080697e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f2406c680 tx=0x7f6f18017000 comp rx=0 tx=0).stop 2023-09-30T22:54:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159eb0 msgr2=0x7f6f240cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159eb0 0x7f6f240cad40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009df0 tx=0x7f6f1c00b040 comp rx=0 tx=0).stop 2023-09-30T22:54:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 shutdown_connections 2023-09-30T22:54:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6f08067330 0x7f6f080697e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f24159eb0 0x7f6f240cad40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f240b1180 0x7f6f24145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 --2- 172.21.15.142:0/734089094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f24159ae0 0x7f6f240ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 >> 172.21.15.142:0/734089094 conn(0x7f6f240ce8b0 msgr2=0x7f6f24158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 shutdown_connections 2023-09-30T22:54:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:33.679+0000 7f6f2b1ff700 1 -- 172.21.15.142:0/734089094 wait complete. 2023-09-30T22:54:33.681 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:33.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:54:33.907 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":5376,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.624873871999998,"mdsmap_epoch":24,"osdmap_epoch":55,"osdmap_epoch_barrier":55,"uptime":32.651852085999998} 2023-09-30T22:54:33.908 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 5376, "mdsmap_epoch": 24, "osdmap_epoch": 55, "osdmap_epoch_barrier": 55, "rank_uptime": 26.624873872, "state": "up:active", "uptime": 32.651852086, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:54:33.908 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:54:33.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:33.908 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-09-30T22:54:33.955 INFO:teuthology.orchestra.run.smithi142.stderr:dd: failed to open 'small_file_1': Permission denied 2023-09-30T22:54:33.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:54:33.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:33.956 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-30T22:54:34.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:34.044 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-30T22:54:34.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:54:34.261 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:54:34.260+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-09-30T22:54:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.286+0000 7f4d8e9ff700 1 Processor -- start 2023-09-30T22:54:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.286+0000 7f4d8e9ff700 1 -- start start 2023-09-30T22:54:34.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.287+0000 7f4d8e9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d880b00d0 0x7f4d8806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:34.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.287+0000 7f4d8e9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d8806e650 0x7f4d8815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:34.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.287+0000 7f4d8e9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8806d3e0 con 0x7f4d880af020 2023-09-30T22:54:34.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.287+0000 7f4d8e9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8806dc80 con 0x7f4d880b00d0 2023-09-30T22:54:34.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.287+0000 7f4d8e9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8806b790 con 0x7f4d8806e650 2023-09-30T22:54:34.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.287+0000 7f4d877fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d880b00d0 0x7f4d8806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:34.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.287+0000 7f4d877fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d880b00d0 0x7f4d8806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45128/0 (socket says 172.21.15.142:45128) 2023-09-30T22:54:34.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d877fe700 1 -- 172.21.15.142:0/320651095 learned_addr learned my addr 172.21.15.142:0/320651095 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:34.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d8cf9c700 1 --2- 172.21.15.142:0/320651095 >> v2:172.21.15.148:3300/0 conn(0x7f4d8806e650 0x7f4d8815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:34.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d877fe700 1 -- 172.21.15.142:0/320651095 >> v2:172.21.15.148:3300/0 conn(0x7f4d8806e650 msgr2=0x7f4d8815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:34.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d877fe700 1 --2- 172.21.15.142:0/320651095 >> v2:172.21.15.148:3300/0 conn(0x7f4d8806e650 0x7f4d8815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d877fe700 1 -- 172.21.15.142:0/320651095 >> v1:172.21.15.148:6789/0 conn(0x7f4d880af020 legacy=0x7f4d88156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:34.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d877fe700 1 -- 172.21.15.142:0/320651095 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d880b0650 con 0x7f4d880b00d0 2023-09-30T22:54:34.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d877fe700 1 --2- 172.21.15.142:0/320651095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880b00d0 0x7f4d8806e110 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0099b0 tx=0x7f4d7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a4e65ce38ce835 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:34.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d86ffd700 1 -- 172.21.15.142:0/320651095 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c009ea0 con 0x7f4d880b00d0 2023-09-30T22:54:34.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d86ffd700 1 -- 172.21.15.142:0/320651095 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00b820 con 0x7f4d880b00d0 2023-09-30T22:54:34.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.288+0000 7f4d86ffd700 1 -- 172.21.15.142:0/320651095 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00bbc0 con 0x7f4d880b00d0 2023-09-30T22:54:34.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/320651095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880b00d0 msgr2=0x7f4d8806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:34.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/320651095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880b00d0 0x7f4d8806e110 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0099b0 tx=0x7f4d7c009250 comp rx=0 tx=0).stop 2023-09-30T22:54:34.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/320651095 shutdown_connections 2023-09-30T22:54:34.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/320651095 >> v2:172.21.15.148:3300/0 conn(0x7f4d8806e650 0x7f4d8815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/320651095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880b00d0 0x7f4d8806e110 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/320651095 >> 172.21.15.142:0/320651095 conn(0x7f4d880680c0 msgr2=0x7f4d880c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:34.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/320651095 shutdown_connections 2023-09-30T22:54:34.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.289+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/320651095 wait complete. 2023-09-30T22:54:34.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.291+0000 7f4d8e9ff700 1 Processor -- start 2023-09-30T22:54:34.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.291+0000 7f4d8e9ff700 1 -- start start 2023-09-30T22:54:34.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d8e9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8806e650 0x7f4d8815de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:34.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d8e9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880af020 0x7f4d881407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:34.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d8e9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d880b00d0 0x7f4d88140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:34.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d8e9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8815be60 con 0x7f4d880af020 2023-09-30T22:54:34.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d8e9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8815b290 con 0x7f4d8806e650 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d8e9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8815b530 con 0x7f4d880b00d0 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d877fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880af020 0x7f4d881407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d877fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880af020 0x7f4d881407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45142/0 (socket says 172.21.15.142:45142) 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d877fe700 1 -- 172.21.15.142:0/272292387 learned_addr learned my addr 172.21.15.142:0/272292387 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d8cf9c700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d880b00d0 0x7f4d88140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.292+0000 7f4d87fff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8806e650 0x7f4d8815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d877fe700 1 -- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d880b00d0 msgr2=0x7f4d88140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d877fe700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d880b00d0 0x7f4d88140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d877fe700 1 -- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8806e650 msgr2=0x7f4d8815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:34.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d877fe700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8806e650 0x7f4d8815de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d877fe700 1 -- 172.21.15.142:0/272292387 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0094f0 con 0x7f4d880af020 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d8cf9c700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d880b00d0 0x7f4d88140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d87fff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8806e650 0x7f4d8815de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d877fe700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880af020 0x7f4d881407d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0094c0 tx=0x7f4d7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00bba0 con 0x7f4d880af020 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c011420 con 0x7f4d880af020 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8815b810 con 0x7f4d880af020 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0117e0 con 0x7f4d880af020 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.293+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8815e3a0 con 0x7f4d880af020 2023-09-30T22:54:34.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.294+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8815e5c0 con 0x7f4d880af020 2023-09-30T22:54:34.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.295+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4d7c011b90 con 0x7f4d880af020 2023-09-30T22:54:34.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.296+0000 7f4d6ffff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4d74067330 0x7f4d740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:34.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.297+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f4d7c0864a0 con 0x7f4d880af020 2023-09-30T22:54:34.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.297+0000 7f4d87fff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4d74067330 0x7f4d740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:34.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.297+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f4d7406f550 con 0x7f4d880af020 2023-09-30T22:54:34.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.297+0000 7f4d87fff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4d74067330 0x7f4d740697e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d78007fd0 tx=0x7f4d78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:34.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.301+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4d7c053360 con 0x7f4d880af020 2023-09-30T22:54:34.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.495+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4d8815bfa0 con 0x7f4d880af020 2023-09-30T22:54:34.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.496+0000 7f4d6ffff700 1 -- 172.21.15.142:0/272292387 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+35356 (secure 0 0 0) 0x7f4d7c015020 con 0x7f4d880af020 2023-09-30T22:54:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:34.496 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 55, 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:54:31.534679+0000", 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:54:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 8, 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:54:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:54:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:54:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 7, 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:04.395113+0000", 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:54:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 8, 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:05.729484+0000", 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:54:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:54:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:54:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 49, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:54:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:54:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:54:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:54:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:54:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:54:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:54:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:54:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:54:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "8.2b", 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 2, 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:54:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:54:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:34.593 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:34.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4d74067330 msgr2=0x7f4d740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:34.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4d74067330 0x7f4d740697e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d78007fd0 tx=0x7f4d78009040 comp rx=0 tx=0).stop 2023-09-30T22:54:34.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880af020 msgr2=0x7f4d881407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:34.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880af020 0x7f4d881407d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0094c0 tx=0x7f4d7c017000 comp rx=0 tx=0).stop 2023-09-30T22:54:34.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 shutdown_connections 2023-09-30T22:54:34.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4d74067330 0x7f4d740697e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d880b00d0 0x7f4d88140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8806e650 0x7f4d8815de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 --2- 172.21.15.142:0/272292387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d880af020 0x7f4d881407d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:34.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 >> 172.21.15.142:0/272292387 conn(0x7f4d880680c0 msgr2=0x7f4d880cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:34.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 shutdown_connections 2023-09-30T22:54:34.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:34.498+0000 7f4d8e9ff700 1 -- 172.21.15.142:0/272292387 wait complete. 2023-09-30T22:54:34.598 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:54:39.262 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:54:39.261+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-09-30T22:54:39.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:54:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.797+0000 7fcae93ff700 1 Processor -- start 2023-09-30T22:54:39.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.797+0000 7fcae93ff700 1 -- start start 2023-09-30T22:54:39.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.798+0000 7fcae93ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 0x7fcae40cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae93ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae415d910 con 0x7fcae4159ae0 2023-09-30T22:54:39.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae93ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae415e490 con 0x7fcae4159eb0 2023-09-30T22:54:39.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae93ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae415e920 con 0x7fcae40b1180 2023-09-30T22:54:39.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae2ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcae4159ae0 0x7fcae40cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46276/0 (socket says 172.21.15.142:46276) 2023-09-30T22:54:39.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae2ffd700 1 -- 172.21.15.142:0/1005253880 learned_addr learned my addr 172.21.15.142:0/1005253880 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae27fc700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 0x7fcae40cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315916175 0 0) 0x7fcae415d910 con 0x7fcae4159ae0 2023-09-30T22:54:39.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.799+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcacc003570 con 0x7fcae4159ae0 2023-09-30T22:54:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975119532 0 0) 0x7fcae415e490 con 0x7fcae4159eb0 2023-09-30T22:54:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae415d910 con 0x7fcae4159eb0 2023-09-30T22:54:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572949134 0 0) 0x7fcacc003570 con 0x7fcae4159ae0 2023-09-30T22:54:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 msgr2=0x7fcae40cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 0x7fcae40cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 >> v1:172.21.15.148:6789/0 conn(0x7fcae4159eb0 legacy=0x7fcae4069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40ce5c0 con 0x7fcae4159ae0 2023-09-30T22:54:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fcad4001470 con 0x7fcae4159ae0 2023-09-30T22:54:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 >> v1:172.21.15.142:6789/0 conn(0x7fcae4159ae0 legacy=0x7fcae40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcacc003c20 0x7fcacc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcacc004810 0x7fcacc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 0x7fcacc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc00bb40 con 0x7fcacc003c20 2023-09-30T22:54:39.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc00bcb0 con 0x7fcacc004810 2023-09-30T22:54:39.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc00be70 con 0x7fcae40b1180 2023-09-30T22:54:39.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae2ffd700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcacc003c20 0x7fcacc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae27fc700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcacc004810 0x7fcacc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae37fe700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 0x7fcacc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae2ffd700 1 -- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 msgr2=0x7fcacc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae2ffd700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae40b1180 0x7fcacc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae2ffd700 1 -- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcacc004810 msgr2=0x7fcacc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae2ffd700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcacc004810 0x7fcacc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.800+0000 7fcae2ffd700 1 -- 172.21.15.142:0/1005253880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc003570 con 0x7fcacc003c20 2023-09-30T22:54:39.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.801+0000 7fcae2ffd700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcacc003c20 0x7fcacc004010 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c2d0 tx=0x7fcad4001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4c8af0a33be98f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.801+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400cbc0 con 0x7fcacc003c20 2023-09-30T22:54:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.801+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400cd20 con 0x7fcacc003c20 2023-09-30T22:54:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.801+0000 7fcae1ffb700 1 -- 172.21.15.142:0/1005253880 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4005b70 con 0x7fcacc003c20 2023-09-30T22:54:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.801+0000 7fcae93ff700 1 -- 172.21.15.142:0/1005253880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcacc003c20 msgr2=0x7fcacc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.801+0000 7fcae93ff700 1 --2- 172.21.15.142:0/1005253880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcacc003c20 0x7fcacc004010 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c2d0 tx=0x7fcad4001e10 comp rx=0 tx=0).stop 2023-09-30T22:54:39.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.801+0000 7fcae37fe700 1 -- 172.21.15.142:0/1005253880 reap_dead start 2023-09-30T22:54:39.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.802+0000 7fcae93ff700 1 -- 172.21.15.142:0/1005253880 shutdown_connections 2023-09-30T22:54:39.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.802+0000 7fcae93ff700 1 -- 172.21.15.142:0/1005253880 >> 172.21.15.142:0/1005253880 conn(0x7fcae40ce8b0 msgr2=0x7fcae40cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:39.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.802+0000 7fcae93ff700 1 -- 172.21.15.142:0/1005253880 shutdown_connections 2023-09-30T22:54:39.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.802+0000 7fcae93ff700 1 -- 172.21.15.142:0/1005253880 wait complete. 2023-09-30T22:54:39.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.804+0000 7fcae93ff700 1 Processor -- start 2023-09-30T22:54:39.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.804+0000 7fcae93ff700 1 -- start start 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae93ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcacc003c20 0x7fcae41454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae93ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae40b38b0 0x7fcae40b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae93ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae416a5c0 0x7fcae416aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae93ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40c7e80 con 0x7fcae416a5c0 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae93ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40b4260 con 0x7fcae40b38b0 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae93ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40c8930 con 0x7fcacc003c20 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae416a5c0 0x7fcae416aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae416a5c0 0x7fcae416aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45146/0 (socket says 172.21.15.142:45146) 2023-09-30T22:54:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae37fe700 1 -- 172.21.15.142:0/1183537156 learned_addr learned my addr 172.21.15.142:0/1183537156 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae2ffd700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcacc003c20 0x7fcae41454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.805+0000 7fcae27fc700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae40b38b0 0x7fcae40b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae37fe700 1 -- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcacc003c20 msgr2=0x7fcae41454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae37fe700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcacc003c20 0x7fcae41454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae37fe700 1 -- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae40b38b0 msgr2=0x7fcae40b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae37fe700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae40b38b0 0x7fcae40b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae37fe700 1 -- 172.21.15.142:0/1183537156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40c8320 con 0x7fcae416a5c0 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae37fe700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae416a5c0 0x7fcae416aa30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcae415a280 tx=0x7fcadc0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc018070 con 0x7fcae416a5c0 2023-09-30T22:54:39.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc006ba0 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae416af70 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00c7b0 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.806+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae40c85c0 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.807+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae40c8ae0 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.808+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcadc00cb20 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.809+0000 7fcacaffd700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcad0067330 0x7fcad00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.809+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fcadc084930 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.809+0000 7fcae2ffd700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcad0067330 0x7fcad00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.809+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=58}) v3 -- 0x7fcad006f550 con 0x7fcae416a5c0 2023-09-30T22:54:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.810+0000 7fcae2ffd700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcad0067330 0x7fcad00697e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcad4008fd0 tx=0x7fcad4015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:39.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:39.813+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcae40c8ae0 con 0x7fcae416a5c0 2023-09-30T22:54:40.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.006+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcae40c9e40 con 0x7fcae416a5c0 2023-09-30T22:54:40.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.008+0000 7fcacaffd700 1 -- 172.21.15.142:0/1183537156 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) v1 ==== 81+0+35332 (secure 0 0 0) 0x7fcae40c9e40 con 0x7fcae416a5c0 2023-09-30T22:54:40.008 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:40.008 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 57, 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:54:35.561004+0000", 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:54:40.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:54:40.010 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 8, 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:54:40.011 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:40.012 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:40.013 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:40.013 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:54:40.013 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:54:40.013 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:54:40.013 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:54:40.013 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:54:40.013 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:40.014 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:40.014 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:40.014 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:40.014 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:40.014 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:40.014 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:40.015 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:40.016 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:40.017 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:40.019 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:40.020 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:40.021 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:40.022 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:40.023 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.024 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 7, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:04.395113+0000", 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:40.025 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:40.026 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:40.027 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:40.028 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:40.029 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:40.030 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 8, 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:05.729484+0000", 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:40.031 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:54:40.032 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "51", 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:40.036 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:54:40.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.038 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.040 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:54:40.042 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:54:40.043 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.044 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 49, 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:54:40.045 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.046 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.048 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.050 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.054 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.056 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.057 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:54:40.060 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.061 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:54:40.062 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.063 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:54:40.064 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.067 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:40.069 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.070 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.072 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:54:40.073 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.075 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.076 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.079 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.081 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:54:40.082 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:40.083 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:40.085 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.087 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:54:40.088 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:54:40.091 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:54:40.092 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:40.096 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "8.2b", 2023-09-30T22:54:40.097 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 2, 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:54:40.098 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:54:40.099 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:40.100 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:40.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcad0067330 msgr2=0x7fcad00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:40.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcad0067330 0x7fcad00697e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcad4008fd0 tx=0x7fcad4015000 comp rx=0 tx=0).stop 2023-09-30T22:54:40.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae416a5c0 msgr2=0x7fcae416aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:40.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae416a5c0 0x7fcae416aa30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcae415a280 tx=0x7fcadc0017a0 comp rx=0 tx=0).stop 2023-09-30T22:54:40.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 shutdown_connections 2023-09-30T22:54:40.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcad0067330 0x7fcad00697e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:40.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae416a5c0 0x7fcae416aa30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:40.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcacc003c20 0x7fcae41454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:40.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 --2- 172.21.15.142:0/1183537156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae40b38b0 0x7fcae40b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:40.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.010+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 >> 172.21.15.142:0/1183537156 conn(0x7fcae40ce8b0 msgr2=0x7fcae40b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:40.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.011+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 shutdown_connections 2023-09-30T22:54:40.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:40.011+0000 7fcae93ff700 1 -- 172.21.15.142:0/1183537156 wait complete. 2023-09-30T22:54:40.103 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:54:42.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:42.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:45.104 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:54:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.303+0000 7f3ed6bff700 1 Processor -- start 2023-09-30T22:54:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.303+0000 7f3ed6bff700 1 -- start start 2023-09-30T22:54:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.304+0000 7f3ed6bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ed00b1580 0x7f3ed00adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.304+0000 7f3ed6bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3ed00ae000 0x7f3ed006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.304+0000 7f3ed6bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00ad630 con 0x7f3ed00b1950 2023-09-30T22:54:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.304+0000 7f3ed6bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed0157c20 con 0x7f3ed00b1580 2023-09-30T22:54:45.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.304+0000 7f3ed6bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00b3360 con 0x7f3ed00ae000 2023-09-30T22:54:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ecffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3ed00b1950 0x7f3ed015a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41264/0 (socket says 172.21.15.142:41264) 2023-09-30T22:54:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ecffff700 1 -- 172.21.15.142:0/1156334576 learned_addr learned my addr 172.21.15.142:0/1156334576 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed499b700 1 --2- 172.21.15.142:0/1156334576 >> v2:172.21.15.142:3300/0 conn(0x7f3ed00b1580 0x7f3ed00adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed519c700 1 --2- 172.21.15.142:0/1156334576 >> v2:172.21.15.148:3300/0 conn(0x7f3ed00ae000 0x7f3ed006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed499b700 1 -- 172.21.15.142:0/1156334576 >> v2:172.21.15.148:3300/0 conn(0x7f3ed00ae000 msgr2=0x7f3ed006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ecf7fe700 1 -- 172.21.15.142:0/1156334576 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283049165 0 0) 0x7f3ed00ad630 con 0x7f3ed00b1950 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed499b700 1 --2- 172.21.15.142:0/1156334576 >> v2:172.21.15.148:3300/0 conn(0x7f3ed00ae000 0x7f3ed006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed499b700 1 -- 172.21.15.142:0/1156334576 >> v1:172.21.15.142:6789/0 conn(0x7f3ed00b1950 legacy=0x7f3ed015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed499b700 1 -- 172.21.15.142:0/1156334576 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed015ad60 con 0x7f3ed00b1580 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed519c700 1 --2- 172.21.15.142:0/1156334576 >> v2:172.21.15.148:3300/0 conn(0x7f3ed00ae000 0x7f3ed006a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ed499b700 1 --2- 172.21.15.142:0/1156334576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed00adac0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00b0270 tx=0x7f3ec40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdc8a8ac8a63ff2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.305+0000 7f3ecf7fe700 1 -- 172.21.15.142:0/1156334576 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400b6b0 con 0x7f3ed00b1580 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ecf7fe700 1 -- 172.21.15.142:0/1156334576 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec400b810 con 0x7f3ed00b1580 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ecf7fe700 1 -- 172.21.15.142:0/1156334576 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400bbb0 con 0x7f3ed00b1580 2023-09-30T22:54:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 -- 172.21.15.142:0/1156334576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 msgr2=0x7f3ed00adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/1156334576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed00adac0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00b0270 tx=0x7f3ec40091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 -- 172.21.15.142:0/1156334576 shutdown_connections 2023-09-30T22:54:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/1156334576 >> v2:172.21.15.148:3300/0 conn(0x7f3ed00ae000 0x7f3ed006a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/1156334576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed00adac0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 -- 172.21.15.142:0/1156334576 >> 172.21.15.142:0/1156334576 conn(0x7f3ed00ce1f0 msgr2=0x7f3ed0069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 -- 172.21.15.142:0/1156334576 shutdown_connections 2023-09-30T22:54:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.306+0000 7f3ed6bff700 1 -- 172.21.15.142:0/1156334576 wait complete. 2023-09-30T22:54:45.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.308+0000 7f3ed6bff700 1 Processor -- start 2023-09-30T22:54:45.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.308+0000 7f3ed6bff700 1 -- start start 2023-09-30T22:54:45.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed6bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ed00ae000 0x7f3ed014ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed6bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed6bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed00b1950 0x7f3ed0159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed6bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0150d80 con 0x7f3ed00b1580 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed6bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00aa720 con 0x7f3ed00b1950 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed6bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00a98c0 con 0x7f3ed00ae000 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed014d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34862/0 (socket says 172.21.15.142:34862) 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ecffff700 1 -- 172.21.15.142:0/232211312 learned_addr learned my addr 172.21.15.142:0/232211312 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed499b700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ed00ae000 0x7f3ed014ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.309+0000 7f3ed519c700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed00b1950 0x7f3ed0159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ecffff700 1 -- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ed00ae000 msgr2=0x7f3ed014ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ecffff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ed00ae000 0x7f3ed014ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ecffff700 1 -- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed00b1950 msgr2=0x7f3ed0159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ecffff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed00b1950 0x7f3ed0159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ecffff700 1 -- 172.21.15.142:0/232211312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009420 con 0x7f3ed00b1580 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ecffff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed014d370 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c5b0 tx=0x7f3ebc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3eccff9700 1 -- 172.21.15.142:0/232211312 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc005b30 con 0x7f3ed00b1580 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3eccff9700 1 -- 172.21.15.142:0/232211312 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc005c90 con 0x7f3ed00b1580 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3eccff9700 1 -- 172.21.15.142:0/232211312 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc007300 con 0x7f3ed00b1580 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed00a9ba0 con 0x7f3ed00b1580 2023-09-30T22:54:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.310+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00aa160 con 0x7f3ed00b1580 2023-09-30T22:54:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.311+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed006d600 con 0x7f3ed00b1580 2023-09-30T22:54:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.312+0000 7f3eccff9700 1 -- 172.21.15.142:0/232211312 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3ebc01b3b0 con 0x7f3ed00b1580 2023-09-30T22:54:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.313+0000 7f3eccff9700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3eb4067330 0x7f3eb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.313+0000 7f3eccff9700 1 -- 172.21.15.142:0/232211312 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f3ebc0840c0 con 0x7f3ed00b1580 2023-09-30T22:54:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.313+0000 7f3ed499b700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3eb4067330 0x7f3eb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.314+0000 7f3ed499b700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3eb4067330 0x7f3eb40697e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40093f0 tx=0x7f3ec4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:45.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.318+0000 7f3eccff9700 1 -- 172.21.15.142:0/232211312 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3ebc050f00 con 0x7f3ed00b1580 2023-09-30T22:54:45.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.507+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3ed015b040 con 0x7f3ed00b1580 2023-09-30T22:54:45.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.509+0000 7f3eccff9700 1 -- 172.21.15.142:0/232211312 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v61) v1 ==== 81+0+35152 (secure 0 0 0) 0x7f3ebc054520 con 0x7f3ed00b1580 2023-09-30T22:54:45.510 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:45.510 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 61, 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:54:43.277751+0000", 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:54:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 8, 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:54:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:54:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:54:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 7, 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:04.395113+0000", 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:54:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 8, 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:05.729484+0000", 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:54:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:45.539 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:45.540 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.541 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.542 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 49, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.551 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:54:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:54:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:54:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:45.593 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:54:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "8.2b", 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 2, 2023-09-30T22:54:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:54:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:54:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:54:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:54:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:54:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:54:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:54:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:45.607 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3eb4067330 msgr2=0x7f3eb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3eb4067330 0x7f3eb40697e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40093f0 tx=0x7f3ec4017000 comp rx=0 tx=0).stop 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 msgr2=0x7f3ed014d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed014d370 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c5b0 tx=0x7f3ebc001070 comp rx=0 tx=0).stop 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 shutdown_connections 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3eb4067330 0x7f3eb40697e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed00b1950 0x7f3ed0159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ed00ae000 0x7f3ed014ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 --2- 172.21.15.142:0/232211312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed00b1580 0x7f3ed014d370 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 >> 172.21.15.142:0/232211312 conn(0x7f3ed00ce1f0 msgr2=0x7f3ed0067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.511+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 shutdown_connections 2023-09-30T22:54:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.512+0000 7f3ed6bff700 1 -- 172.21.15.142:0/232211312 wait complete. 2023-09-30T22:54:45.610 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-09-30T22:54:45.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:54:45.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.798+0000 7fcb501ff700 1 Processor -- start 2023-09-30T22:54:45.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.799+0000 7fcb501ff700 1 -- start start 2023-09-30T22:54:45.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.800+0000 7fcb501ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcb480b00d0 0x7fcb4806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.800+0000 7fcb501ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4806d3e0 con 0x7fcb4806e650 2023-09-30T22:54:45.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.800+0000 7fcb501ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4806dc80 con 0x7fcb480af020 2023-09-30T22:54:45.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.800+0000 7fcb501ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4806b790 con 0x7fcb480b00d0 2023-09-30T22:54:45.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.800+0000 7fcb4e79c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcb4806e650 0x7fcb4815a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41268/0 (socket says 172.21.15.142:41268) 2023-09-30T22:54:45.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.800+0000 7fcb4e79c700 1 -- 172.21.15.142:0/1435611640 learned_addr learned my addr 172.21.15.142:0/1435611640 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:45.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.800+0000 7fcb4d79a700 1 --2- 172.21.15.142:0/1435611640 >> v2:172.21.15.148:3300/0 conn(0x7fcb480b00d0 0x7fcb4806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4cf99700 1 -- 172.21.15.142:0/1435611640 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173277197 0 0) 0x7fcb4806d3e0 con 0x7fcb4806e650 2023-09-30T22:54:45.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4cf99700 1 -- 172.21.15.142:0/1435611640 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb34003570 con 0x7fcb4806e650 2023-09-30T22:54:45.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4cf99700 1 -- 172.21.15.142:0/1435611640 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326569969 0 0) 0x7fcb4806dc80 con 0x7fcb480af020 2023-09-30T22:54:45.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4cf99700 1 -- 172.21.15.142:0/1435611640 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb4806d3e0 con 0x7fcb480af020 2023-09-30T22:54:45.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4d79a700 1 -- 172.21.15.142:0/1435611640 >> v1:172.21.15.148:6789/0 conn(0x7fcb480af020 legacy=0x7fcb48156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4d79a700 1 -- 172.21.15.142:0/1435611640 >> v1:172.21.15.142:6789/0 conn(0x7fcb4806e650 legacy=0x7fcb4815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4d79a700 1 -- 172.21.15.142:0/1435611640 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480b0650 con 0x7fcb480b00d0 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.801+0000 7fcb4d79a700 1 --2- 172.21.15.142:0/1435611640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 0x7fcb4806e110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009910 tx=0x7fcb380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75c0c11f2c8cb2a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb4cf99700 1 -- 172.21.15.142:0/1435611640 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38011630 con 0x7fcb480b00d0 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb4cf99700 1 -- 172.21.15.142:0/1435611640 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38011790 con 0x7fcb480b00d0 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb4cf99700 1 -- 172.21.15.142:0/1435611640 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38011b30 con 0x7fcb480b00d0 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb501ff700 1 -- 172.21.15.142:0/1435611640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 msgr2=0x7fcb4806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb501ff700 1 --2- 172.21.15.142:0/1435611640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 0x7fcb4806e110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009910 tx=0x7fcb380091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb501ff700 1 -- 172.21.15.142:0/1435611640 shutdown_connections 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb501ff700 1 --2- 172.21.15.142:0/1435611640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 0x7fcb4806e110 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb501ff700 1 -- 172.21.15.142:0/1435611640 >> 172.21.15.142:0/1435611640 conn(0x7fcb480680c0 msgr2=0x7fcb480c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb501ff700 1 -- 172.21.15.142:0/1435611640 shutdown_connections 2023-09-30T22:54:45.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.802+0000 7fcb501ff700 1 -- 172.21.15.142:0/1435611640 wait complete. 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.804+0000 7fcb501ff700 1 Processor -- start 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.804+0000 7fcb501ff700 1 -- start start 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb501ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb4806e650 0x7fcb48166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb501ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb480af020 0x7fcb4815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb501ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 0x7fcb4814cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb501ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48169a30 con 0x7fcb480af020 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb501ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48169c40 con 0x7fcb480b00d0 2023-09-30T22:54:45.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb501ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48169f20 con 0x7fcb4806e650 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb4d79a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb480af020 0x7fcb4815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb4d79a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb480af020 0x7fcb4815adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34868/0 (socket says 172.21.15.142:34868) 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb4d79a700 1 -- 172.21.15.142:0/4222534526 learned_addr learned my addr 172.21.15.142:0/4222534526 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb4e79c700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 0x7fcb4814cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.805+0000 7fcb4df9b700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb4806e650 0x7fcb48166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb4d79a700 1 -- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb4806e650 msgr2=0x7fcb48166e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb4d79a700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb4806e650 0x7fcb48166e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb4d79a700 1 -- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 msgr2=0x7fcb4814cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb4d79a700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 0x7fcb4814cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb4d79a700 1 -- 172.21.15.142:0/4222534526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38009420 con 0x7fcb480af020 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb4d79a700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb480af020 0x7fcb4815adc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb48068600 tx=0x7fcb38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:45.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb3dffb700 1 -- 172.21.15.142:0/4222534526 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3801f070 con 0x7fcb480af020 2023-09-30T22:54:45.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4816a200 con 0x7fcb480af020 2023-09-30T22:54:45.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb3dffb700 1 -- 172.21.15.142:0/4222534526 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38000bc0 con 0x7fcb480af020 2023-09-30T22:54:45.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb3dffb700 1 -- 172.21.15.142:0/4222534526 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38025420 con 0x7fcb480af020 2023-09-30T22:54:45.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.806+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4814d500 con 0x7fcb480af020 2023-09-30T22:54:45.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.807+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4816a720 con 0x7fcb480af020 2023-09-30T22:54:45.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.808+0000 7fcb3dffb700 1 -- 172.21.15.142:0/4222534526 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcb38023070 con 0x7fcb480af020 2023-09-30T22:54:45.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.809+0000 7fcb3dffb700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:45.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.809+0000 7fcb3dffb700 1 -- 172.21.15.142:0/4222534526 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fcb38085f30 con 0x7fcb480af020 2023-09-30T22:54:45.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.809+0000 7fcb4df9b700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:45.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.810+0000 7fcb4df9b700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcb48151500 tx=0x7fcb44007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:45.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:45.814+0000 7fcb3dffb700 1 -- 172.21.15.142:0/4222534526 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcb4816a720 con 0x7fcb480af020 2023-09-30T22:54:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.004+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcb4816a720 con 0x7fcb480af020 2023-09-30T22:54:46.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.005+0000 7fcb3dffb700 1 -- 172.21.15.142:0/4222534526 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v61) v1 ==== 81+0+35152 (secure 0 0 0) 0x7fcb4816a720 con 0x7fcb480af020 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 61, 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:54:43.277751+0000", 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:54:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:54:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 8, 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:54:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:54:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 7, 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:04.395113+0000", 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 8, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:54:05.729484+0000", 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:54:46.029 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:54:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "61", 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:54:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:54:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:54:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:54:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:54:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 49, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:54:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:54:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:54:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:54:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:54:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:54:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:54:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:54:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 46, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:54:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:54:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:54:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:54:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:54:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:54:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "8.2b", 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 2, 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:54:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:54:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:54:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:54:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:54:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:54:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:54:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:54:46.100 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:54:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 msgr2=0x7fcb2c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcb48151500 tx=0x7fcb44007d50 comp rx=0 tx=0).stop 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb480af020 msgr2=0x7fcb4815adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb480af020 0x7fcb4815adc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb48068600 tx=0x7fcb38017000 comp rx=0 tx=0).stop 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 shutdown_connections 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb2c067330 0x7fcb2c0697e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb480b00d0 0x7fcb4814cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb4806e650 0x7fcb48166e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.007+0000 7fcb501ff700 1 --2- 172.21.15.142:0/4222534526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb480af020 0x7fcb4815adc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.008+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 >> 172.21.15.142:0/4222534526 conn(0x7fcb480680c0 msgr2=0x7fcb4815b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.008+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 shutdown_connections 2023-09-30T22:54:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.008+0000 7fcb501ff700 1 -- 172.21.15.142:0/4222534526 wait complete. 2023-09-30T22:54:46.103 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.293+0000 7f32f53ff700 1 Processor -- start 2023-09-30T22:54:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.293+0000 7f32f53ff700 1 -- start start 2023-09-30T22:54:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32f53ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f32f015dea0 0x7f32f00b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32f53ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32f53ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32f0069f10 0x7f32f006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32f53ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f006ef60 con 0x7f32f0069f10 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32f53ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f015f250 con 0x7f32f015dea0 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32f53ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f015e680 con 0x7f32f00b24a0 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32ef7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32f0069f10 0x7f32f006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32ef7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32f0069f10 0x7f32f006d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34884/0 (socket says 172.21.15.142:34884) 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.295+0000 7f32ef7fe700 1 -- 172.21.15.142:0/3197990229 learned_addr learned my addr 172.21.15.142:0/3197990229 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32eeffd700 1 --2- 172.21.15.142:0/3197990229 >> v2:172.21.15.148:3300/0 conn(0x7f32f015dea0 0x7f32f00b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32ee7fc700 1 --2- 172.21.15.142:0/3197990229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:46.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32ef7fe700 1 -- 172.21.15.142:0/3197990229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 msgr2=0x7f32f006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32ef7fe700 1 --2- 172.21.15.142:0/3197990229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f006d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32ef7fe700 1 -- 172.21.15.142:0/3197990229 >> v2:172.21.15.148:3300/0 conn(0x7f32f015dea0 msgr2=0x7f32f00b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32ef7fe700 1 --2- 172.21.15.142:0/3197990229 >> v2:172.21.15.148:3300/0 conn(0x7f32f015dea0 0x7f32f00b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32ef7fe700 1 -- 172.21.15.142:0/3197990229 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f015e920 con 0x7f32f0069f10 2023-09-30T22:54:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.296+0000 7f32ef7fe700 1 --2- 172.21.15.142:0/3197990229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f006d920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f32f006ce90 tx=0x7f32e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3432eda226534fab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.297+0000 7f32edffb700 1 -- 172.21.15.142:0/3197990229 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800e070 con 0x7f32f0069f10 2023-09-30T22:54:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32edffb700 1 -- 172.21.15.142:0/3197990229 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800ba50 con 0x7f32f0069f10 2023-09-30T22:54:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32edffb700 1 -- 172.21.15.142:0/3197990229 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e80092e0 con 0x7f32f0069f10 2023-09-30T22:54:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 -- 172.21.15.142:0/3197990229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 msgr2=0x7f32f006d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 --2- 172.21.15.142:0/3197990229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f006d920 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f32f006ce90 tx=0x7f32e8009840 comp rx=0 tx=0).stop 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 -- 172.21.15.142:0/3197990229 shutdown_connections 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 --2- 172.21.15.142:0/3197990229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f006d920 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 --2- 172.21.15.142:0/3197990229 >> v2:172.21.15.148:3300/0 conn(0x7f32f015dea0 0x7f32f00b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 --2- 172.21.15.142:0/3197990229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f006d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 -- 172.21.15.142:0/3197990229 >> 172.21.15.142:0/3197990229 conn(0x7f32f00680c0 msgr2=0x7f32f00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 -- 172.21.15.142:0/3197990229 shutdown_connections 2023-09-30T22:54:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.298+0000 7f32f53ff700 1 -- 172.21.15.142:0/3197990229 wait complete. 2023-09-30T22:54:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.300+0000 7f32f53ff700 1 Processor -- start 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.300+0000 7f32f53ff700 1 -- start start 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32f53ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f00c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32f53ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f00c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32f53ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32f015dea0 0x7f32f00cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32f53ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00c3460 con 0x7f32f0069f10 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32f53ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00c2850 con 0x7f32f015dea0 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32f53ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00c2b30 con 0x7f32f00b24a0 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32eeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f00c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32eeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f00c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34890/0 (socket says 172.21.15.142:34890) 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.301+0000 7f32eeffd700 1 -- 172.21.15.142:0/2098389391 learned_addr learned my addr 172.21.15.142:0/2098389391 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32ee7fc700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f00c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32eeffd700 1 -- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 msgr2=0x7f32f00c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32eeffd700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f00c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32eeffd700 1 -- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32f015dea0 msgr2=0x7f32f00cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32ef7fe700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32f015dea0 0x7f32f00cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32eeffd700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32f015dea0 0x7f32f00cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32eeffd700 1 -- 172.21.15.142:0/2098389391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8009ae0 con 0x7f32f0069f10 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32ee7fc700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f00c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:46.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32ef7fe700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32f015dea0 0x7f32f00cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32eeffd700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f00c38f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f32e000d860 tx=0x7f32e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32d6ffd700 1 -- 172.21.15.142:0/2098389391 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0009610 con 0x7f32f0069f10 2023-09-30T22:54:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32d6ffd700 1 -- 172.21.15.142:0/2098389391 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0009770 con 0x7f32f0069f10 2023-09-30T22:54:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f00c2e10 con 0x7f32f0069f10 2023-09-30T22:54:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32d6ffd700 1 -- 172.21.15.142:0/2098389391 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0009b30 con 0x7f32f0069f10 2023-09-30T22:54:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.302+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f00c2420 con 0x7f32f0069f10 2023-09-30T22:54:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.304+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f00695b0 con 0x7f32f0069f10 2023-09-30T22:54:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.304+0000 7f32d6ffd700 1 -- 172.21.15.142:0/2098389391 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f32e001e460 con 0x7f32f0069f10 2023-09-30T22:54:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.305+0000 7f32d6ffd700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f32dc067330 0x7f32dc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.305+0000 7f32d6ffd700 1 -- 172.21.15.142:0/2098389391 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f32e0085230 con 0x7f32f0069f10 2023-09-30T22:54:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.305+0000 7f32ee7fc700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f32dc067330 0x7f32dc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.306+0000 7f32ee7fc700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f32dc067330 0x7f32dc0697e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f015a670 tx=0x7f32e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.309+0000 7f32d6ffd700 1 -- 172.21.15.142:0/2098389391 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f32e0052110 con 0x7f32f0069f10 2023-09-30T22:54:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.545+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32f006fc10 con 0x7f32f0069f10 2023-09-30T22:54:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.546+0000 7f32d6ffd700 1 -- 172.21.15.142:0/2098389391 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f32e0055730 con 0x7f32f0069f10 2023-09-30T22:54:46.547 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:46.547 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f32dc067330 msgr2=0x7f32dc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f32dc067330 0x7f32dc0697e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f015a670 tx=0x7f32e4008040 comp rx=0 tx=0).stop 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 msgr2=0x7f32f00c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f00c38f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f32e000d860 tx=0x7f32e0008040 comp rx=0 tx=0).stop 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 shutdown_connections 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f32dc067330 0x7f32dc0697e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32f015dea0 0x7f32f00cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0069f10 0x7f32f00c38f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 --2- 172.21.15.142:0/2098389391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32f00b24a0 0x7f32f00c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 >> 172.21.15.142:0/2098389391 conn(0x7f32f00680c0 msgr2=0x7f32f015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:46.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 shutdown_connections 2023-09-30T22:54:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:46.548+0000 7f32f53ff700 1 -- 172.21.15.142:0/2098389391 wait complete. 2023-09-30T22:54:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:46.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:54:46.778 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":5376,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":39.495836267000001,"mdsmap_epoch":24,"osdmap_epoch":61,"osdmap_epoch_barrier":55,"uptime":45.522814767} 2023-09-30T22:54:46.779 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 5376, "mdsmap_epoch": 24, "osdmap_epoch": 61, "osdmap_epoch_barrier": 55, "rank_uptime": 39.495836267, "state": "up:active", "uptime": 45.522814767, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:54:46.779 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:54:46.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:46.779 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-30T22:54:47.265 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T22:54:47.265 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T22:54:47.265 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.438062 s, 120 MB/s 2023-09-30T22:54:47.266 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:54:47.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:54:47.375 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:54:47.477 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:54:47.478 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:54:47.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:47.478 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:54:47.595 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:54:47.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:47.596 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:54:47.643 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:54:47.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:54:47.643 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T22:54:47.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:54:47.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:54:47.733 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:54:47.782 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.970+0000 7fb5457ff700 1 Processor -- start 2023-09-30T22:54:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.970+0000 7fb5457ff700 1 -- start start 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.971+0000 7fb5457ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5400af020 0x7fb540156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb5457ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb54006e820 0x7fb54015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb5457ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54006d3e0 con 0x7fb5400b00d0 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb5457ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54006dc80 con 0x7fb54006e820 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb5457ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54006eca0 con 0x7fb5400af020 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb54006e820 0x7fb54015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb54006e820 0x7fb54015a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34900/0 (socket says 172.21.15.142:34900) 2023-09-30T22:54:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3571275179 learned_addr learned my addr 172.21.15.142:0/3571275179 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:47.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53effd700 1 --2- 172.21.15.142:0/3571275179 >> v2:172.21.15.148:3300/0 conn(0x7fb5400af020 0x7fb540156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:47.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3571275179 >> v2:172.21.15.148:3300/0 conn(0x7fb5400af020 msgr2=0x7fb540156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:47.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 --2- 172.21.15.142:0/3571275179 >> v2:172.21.15.148:3300/0 conn(0x7fb5400af020 0x7fb540156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:47.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3571275179 >> v1:172.21.15.148:6789/0 conn(0x7fb5400b00d0 legacy=0x7fb54006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3571275179 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54006b790 con 0x7fb54006e820 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53effd700 1 --2- 172.21.15.142:0/3571275179 >> v2:172.21.15.148:3300/0 conn(0x7fb5400af020 0x7fb540156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.972+0000 7fb53f7fe700 1 --2- 172.21.15.142:0/3571275179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54006e820 0x7fb54015a3f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb538009f20 tx=0x7fb538009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5aac230e4f7f14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb53dffb700 1 -- 172.21.15.142:0/3571275179 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800e070 con 0x7fb54006e820 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb53dffb700 1 -- 172.21.15.142:0/3571275179 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53800ba00 con 0x7fb54006e820 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb53dffb700 1 -- 172.21.15.142:0/3571275179 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5380092e0 con 0x7fb54006e820 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 -- 172.21.15.142:0/3571275179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54006e820 msgr2=0x7fb54015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3571275179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54006e820 0x7fb54015a3f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb538009f20 tx=0x7fb538009840 comp rx=0 tx=0).stop 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 -- 172.21.15.142:0/3571275179 shutdown_connections 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3571275179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb54006e820 0x7fb54015a3f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3571275179 >> v2:172.21.15.148:3300/0 conn(0x7fb5400af020 0x7fb540156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:47.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 -- 172.21.15.142:0/3571275179 >> 172.21.15.142:0/3571275179 conn(0x7fb5400680c0 msgr2=0x7fb5400c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:47.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 -- 172.21.15.142:0/3571275179 shutdown_connections 2023-09-30T22:54:47.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.973+0000 7fb5457ff700 1 -- 172.21.15.142:0/3571275179 wait complete. 2023-09-30T22:54:47.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.975+0000 7fb5457ff700 1 Processor -- start 2023-09-30T22:54:47.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.976+0000 7fb5457ff700 1 -- start start 2023-09-30T22:54:47.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb5457ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb54006e820 0x7fb540154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb5457ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5400af020 0x7fb5400c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb5457ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5400b00d0 0x7fb5400c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb5457ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54015ae40 con 0x7fb5400b00d0 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb5457ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54015a230 con 0x7fb5400af020 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb5457ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54015a510 con 0x7fb54006e820 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5400b00d0 0x7fb5400c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53effd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb54006e820 0x7fb540154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5400b00d0 0x7fb5400c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34908/0 (socket says 172.21.15.142:34908) 2023-09-30T22:54:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3788610662 learned_addr learned my addr 172.21.15.142:0/3788610662 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53e7fc700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5400af020 0x7fb5400c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3788610662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb54006e820 msgr2=0x7fb540154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53f7fe700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb54006e820 0x7fb540154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3788610662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5400af020 msgr2=0x7fb5400c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.977+0000 7fb53f7fe700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5400af020 0x7fb5400c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.978+0000 7fb53f7fe700 1 -- 172.21.15.142:0/3788610662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538009ae0 con 0x7fb5400b00d0 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.978+0000 7fb53f7fe700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5400b00d0 0x7fb5400c7320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb540068600 tx=0x7fb538017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.978+0000 7fb526ffd700 1 -- 172.21.15.142:0/3788610662 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53801f070 con 0x7fb5400b00d0 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.978+0000 7fb526ffd700 1 -- 172.21.15.142:0/3788610662 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5380032f0 con 0x7fb5400b00d0 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.978+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54015a7f0 con 0x7fb5400b00d0 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.978+0000 7fb526ffd700 1 -- 172.21.15.142:0/3788610662 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538024460 con 0x7fb5400b00d0 2023-09-30T22:54:47.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.978+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5401594c0 con 0x7fb5400b00d0 2023-09-30T22:54:47.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.979+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54015aff0 con 0x7fb5400b00d0 2023-09-30T22:54:47.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.980+0000 7fb526ffd700 1 -- 172.21.15.142:0/3788610662 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb538024850 con 0x7fb5400b00d0 2023-09-30T22:54:47.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.981+0000 7fb526ffd700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb52c067330 0x7fb52c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:47.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.981+0000 7fb526ffd700 1 -- 172.21.15.142:0/3788610662 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb538087ac0 con 0x7fb5400b00d0 2023-09-30T22:54:47.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.981+0000 7fb53effd700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb52c067330 0x7fb52c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:47.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.982+0000 7fb53effd700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb52c067330 0x7fb52c0697e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb53000adc0 tx=0x7fb530006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:47.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:47.985+0000 7fb526ffd700 1 -- 172.21.15.142:0/3788610662 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb54015aff0 con 0x7fb5400b00d0 2023-09-30T22:54:48.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.220+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb54015af80 con 0x7fb5400b00d0 2023-09-30T22:54:48.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.221+0000 7fb526ffd700 1 -- 172.21.15.142:0/3788610662 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fb538054900 con 0x7fb5400b00d0 2023-09-30T22:54:48.222 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:48.222 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb52c067330 msgr2=0x7fb52c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb52c067330 0x7fb52c0697e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb53000adc0 tx=0x7fb530006f90 comp rx=0 tx=0).stop 2023-09-30T22:54:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5400b00d0 msgr2=0x7fb5400c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5400b00d0 0x7fb5400c7320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb540068600 tx=0x7fb538017000 comp rx=0 tx=0).stop 2023-09-30T22:54:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 shutdown_connections 2023-09-30T22:54:48.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb52c067330 0x7fb52c0697e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5400b00d0 0x7fb5400c7320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb54006e820 0x7fb540154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 --2- 172.21.15.142:0/3788610662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5400af020 0x7fb5400c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 >> 172.21.15.142:0/3788610662 conn(0x7fb5400680c0 msgr2=0x7fb5400cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:48.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 shutdown_connections 2023-09-30T22:54:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.223+0000 7fb5457ff700 1 -- 172.21.15.142:0/3788610662 wait complete. 2023-09-30T22:54:48.227 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:48.242 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:54:48.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.432+0000 7fcf68fff700 1 Processor -- start 2023-09-30T22:54:48.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.432+0000 7fcf68fff700 1 -- start start 2023-09-30T22:54:48.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf68fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf6406e820 0x7fcf64161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf68fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6406d3e0 con 0x7fcf640b00d0 2023-09-30T22:54:48.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf68fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6406dc80 con 0x7fcf640af020 2023-09-30T22:54:48.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf68fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6415b400 con 0x7fcf6406e820 2023-09-30T22:54:48.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf61d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcf640b00d0 0x7fcf6406e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41282/0 (socket says 172.21.15.142:41282) 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf61d9b700 1 -- 172.21.15.142:0/2745237161 learned_addr learned my addr 172.21.15.142:0/2745237161 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf62d9d700 1 --2- 172.21.15.142:0/2745237161 >> v2:172.21.15.142:3300/0 conn(0x7fcf6406e820 0x7fcf64161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.434+0000 7fcf6159a700 1 -- 172.21.15.142:0/2745237161 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462157660 0 0) 0x7fcf6406d3e0 con 0x7fcf640b00d0 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf6159a700 1 -- 172.21.15.142:0/2745237161 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf4c003570 con 0x7fcf640b00d0 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf62d9d700 1 -- 172.21.15.142:0/2745237161 >> v1:172.21.15.148:6789/0 conn(0x7fcf640af020 legacy=0x7fcf64156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf6159a700 1 -- 172.21.15.142:0/2745237161 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944295763 0 0) 0x7fcf6406dc80 con 0x7fcf640af020 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf62d9d700 1 -- 172.21.15.142:0/2745237161 >> v1:172.21.15.142:6789/0 conn(0x7fcf640b00d0 legacy=0x7fcf6406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf62d9d700 1 -- 172.21.15.142:0/2745237161 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6406eca0 con 0x7fcf6406e820 2023-09-30T22:54:48.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf62d9d700 1 --2- 172.21.15.142:0/2745237161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf64161790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009e90 tx=0x7fcf5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7d4e96997219bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf6159a700 1 -- 172.21.15.142:0/2745237161 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00e070 con 0x7fcf6406e820 2023-09-30T22:54:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf6159a700 1 -- 172.21.15.142:0/2745237161 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00bc40 con 0x7fcf6406e820 2023-09-30T22:54:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.435+0000 7fcf6159a700 1 -- 172.21.15.142:0/2745237161 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c012430 con 0x7fcf6406e820 2023-09-30T22:54:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.436+0000 7fcf68fff700 1 -- 172.21.15.142:0/2745237161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 msgr2=0x7fcf64161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.436+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2745237161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf64161790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009e90 tx=0x7fcf5c009780 comp rx=0 tx=0).stop 2023-09-30T22:54:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.436+0000 7fcf68fff700 1 -- 172.21.15.142:0/2745237161 shutdown_connections 2023-09-30T22:54:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.436+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2745237161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf64161790 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.436+0000 7fcf68fff700 1 -- 172.21.15.142:0/2745237161 >> 172.21.15.142:0/2745237161 conn(0x7fcf640680c0 msgr2=0x7fcf640c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.436+0000 7fcf68fff700 1 -- 172.21.15.142:0/2745237161 shutdown_connections 2023-09-30T22:54:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.436+0000 7fcf68fff700 1 -- 172.21.15.142:0/2745237161 wait complete. 2023-09-30T22:54:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.437+0000 7fcf68fff700 1 Processor -- start 2023-09-30T22:54:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.437+0000 7fcf68fff700 1 -- start start 2023-09-30T22:54:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.438+0000 7fcf68fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf640adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.438+0000 7fcf68fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640af020 0x7fcf64158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.438+0000 7fcf68fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf640b00d0 0x7fcf64169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.438+0000 7fcf68fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640ae460 con 0x7fcf6406e820 2023-09-30T22:54:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.438+0000 7fcf68fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf641575c0 con 0x7fcf640af020 2023-09-30T22:54:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.438+0000 7fcf68fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64157860 con 0x7fcf640b00d0 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.438+0000 7fcf6259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf640adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf640adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34920/0 (socket says 172.21.15.142:34920) 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 -- 172.21.15.142:0/2684238704 learned_addr learned my addr 172.21.15.142:0/2684238704 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf61d9b700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640af020 0x7fcf64158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf62d9d700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf640b00d0 0x7fcf64169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 -- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf640b00d0 msgr2=0x7fcf64169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf640b00d0 0x7fcf64169cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 -- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640af020 msgr2=0x7fcf64158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640af020 0x7fcf64158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 -- 172.21.15.142:0/2684238704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c009a20 con 0x7fcf6406e820 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf62d9d700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf640b00d0 0x7fcf64169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf6259c700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf640adf20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c7e0 tx=0x7fcf54007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf527fc700 1 -- 172.21.15.142:0/2684238704 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54011590 con 0x7fcf6406e820 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf527fc700 1 -- 172.21.15.142:0/2684238704 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54011710 con 0x7fcf6406e820 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf64157b40 con 0x7fcf6406e820 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.439+0000 7fcf527fc700 1 -- 172.21.15.142:0/2684238704 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54011ad0 con 0x7fcf6406e820 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.440+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf64158100 con 0x7fcf6406e820 2023-09-30T22:54:48.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.441+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf640c6370 con 0x7fcf6406e820 2023-09-30T22:54:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.442+0000 7fcf527fc700 1 -- 172.21.15.142:0/2684238704 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcf5401b3b0 con 0x7fcf6406e820 2023-09-30T22:54:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.443+0000 7fcf527fc700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf44067330 0x7fcf440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.443+0000 7fcf527fc700 1 -- 172.21.15.142:0/2684238704 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fcf54084150 con 0x7fcf6406e820 2023-09-30T22:54:48.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.443+0000 7fcf61d9b700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf44067330 0x7fcf440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.443+0000 7fcf61d9b700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf44067330 0x7fcf440697e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf6406abb0 tx=0x7fcf58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:48.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.447+0000 7fcf527fc700 1 -- 172.21.15.142:0/2684238704 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcf640c6370 con 0x7fcf6406e820 2023-09-30T22:54:48.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.639+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf640c6370 con 0x7fcf6406e820 2023-09-30T22:54:48.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.640+0000 7fcf527fc700 1 -- 172.21.15.142:0/2684238704 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17059 (secure 0 0 0) 0x7fcf640c6370 con 0x7fcf6406e820 2023-09-30T22:54:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:48.642 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":61,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:54:43.277751+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:54:04.395113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T22:54:05.729484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2b","mappings":[{"from":2,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:54:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf44067330 msgr2=0x7fcf440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf44067330 0x7fcf440697e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf6406abb0 tx=0x7fcf58009040 comp rx=0 tx=0).stop 2023-09-30T22:54:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 msgr2=0x7fcf640adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf640adf20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c7e0 tx=0x7fcf54007df0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 shutdown_connections 2023-09-30T22:54:48.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf44067330 0x7fcf440697e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf640b00d0 0x7fcf64169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf6406e820 0x7fcf640adf20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 --2- 172.21.15.142:0/2684238704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640af020 0x7fcf64158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 >> 172.21.15.142:0/2684238704 conn(0x7fcf640680c0 msgr2=0x7fcf6415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 shutdown_connections 2023-09-30T22:54:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.643+0000 7fcf68fff700 1 -- 172.21.15.142:0/2684238704 wait complete. 2023-09-30T22:54:48.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:54:04.395113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:54:05.729484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:54:48.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:54:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.851+0000 7f3b5d9ff700 1 Processor -- start 2023-09-30T22:54:48.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.851+0000 7f3b5d9ff700 1 -- start start 2023-09-30T22:54:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.852+0000 7f3b5d9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3b58159ba0 0x7f3b5806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.852+0000 7f3b5d9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3b580ca5e0 0x7f3b580681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b5d9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b58067d10 con 0x7f3b580b0de0 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b5d9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5806af90 con 0x7f3b58159ba0 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b5d9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580676c0 con 0x7f3b580ca5e0 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b56ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3b58159ba0 0x7f3b5806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b56ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3b58159ba0 0x7f3b5806a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34930/0 (socket says 172.21.15.142:34930) 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b56ffd700 1 -- 172.21.15.142:0/1427530565 learned_addr learned my addr 172.21.15.142:0/1427530565 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b567fc700 1 --1- 172.21.15.142:0/1427530565 >> v1:172.21.15.142:6789/0 conn(0x7f3b580b0de0 0x7f3b580c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41288/0 (socket says 172.21.15.142:41288) 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b577fe700 1 --2- 172.21.15.142:0/1427530565 >> v2:172.21.15.148:3300/0 conn(0x7f3b580ca5e0 0x7f3b580681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b56ffd700 1 -- 172.21.15.142:0/1427530565 >> v2:172.21.15.148:3300/0 conn(0x7f3b580ca5e0 msgr2=0x7f3b580681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b56ffd700 1 --2- 172.21.15.142:0/1427530565 >> v2:172.21.15.148:3300/0 conn(0x7f3b580ca5e0 0x7f3b580681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b56ffd700 1 -- 172.21.15.142:0/1427530565 >> v1:172.21.15.142:6789/0 conn(0x7f3b580b0de0 legacy=0x7f3b580c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b56ffd700 1 -- 172.21.15.142:0/1427530565 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580679a0 con 0x7f3b58159ba0 2023-09-30T22:54:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.853+0000 7f3b55ffb700 1 -- 172.21.15.142:0/1427530565 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041494365 0 0) 0x7f3b58067d10 con 0x7f3b580b0de0 2023-09-30T22:54:48.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b56ffd700 1 --2- 172.21.15.142:0/1427530565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5806a8d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b580c5890 tx=0x7f3b48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7a356922a9d588 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b55ffb700 1 -- 172.21.15.142:0/1427530565 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48009e70 con 0x7f3b58159ba0 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b55ffb700 1 -- 172.21.15.142:0/1427530565 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800b860 con 0x7f3b58159ba0 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b55ffb700 1 -- 172.21.15.142:0/1427530565 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800bc00 con 0x7f3b58159ba0 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/1427530565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 msgr2=0x7f3b5806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/1427530565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5806a8d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b580c5890 tx=0x7f3b48009250 comp rx=0 tx=0).stop 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/1427530565 shutdown_connections 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/1427530565 >> v2:172.21.15.148:3300/0 conn(0x7f3b580ca5e0 0x7f3b580681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/1427530565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5806a8d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/1427530565 >> 172.21.15.142:0/1427530565 conn(0x7f3b580cb2f0 msgr2=0x7f3b580cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:48.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.854+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/1427530565 shutdown_connections 2023-09-30T22:54:48.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.855+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/1427530565 wait complete. 2023-09-30T22:54:48.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.856+0000 7f3b5d9ff700 1 Processor -- start 2023-09-30T22:54:48.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.856+0000 7f3b5d9ff700 1 -- start start 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b5d9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b580b0de0 0x7f3b58156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b5d9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b580ca5e0 0x7f3b5806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b5d9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b5d9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5815c0b0 con 0x7f3b58159ba0 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b5d9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5815a350 con 0x7f3b580ca5e0 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b5d9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5815a630 con 0x7f3b580b0de0 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5815c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34940/0 (socket says 172.21.15.142:34940) 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b577fe700 1 -- 172.21.15.142:0/377963557 learned_addr learned my addr 172.21.15.142:0/377963557 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b56ffd700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b580b0de0 0x7f3b58156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.857+0000 7f3b567fc700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b580ca5e0 0x7f3b5806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b577fe700 1 -- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b580b0de0 msgr2=0x7f3b58156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b577fe700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b580b0de0 0x7f3b58156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b577fe700 1 -- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b580ca5e0 msgr2=0x7f3b5806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b577fe700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b580ca5e0 0x7f3b5806a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b577fe700 1 -- 172.21.15.142:0/377963557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b480094f0 con 0x7f3b58159ba0 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b577fe700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5815c850 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009e90 tx=0x7f3b5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b3effd700 1 -- 172.21.15.142:0/377963557 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000cb70 con 0x7f3b58159ba0 2023-09-30T22:54:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b3effd700 1 -- 172.21.15.142:0/377963557 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000f040 con 0x7f3b58159ba0 2023-09-30T22:54:48.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b3effd700 1 -- 172.21.15.142:0/377963557 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50014480 con 0x7f3b58159ba0 2023-09-30T22:54:48.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5815a910 con 0x7f3b58159ba0 2023-09-30T22:54:48.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.858+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5815c330 con 0x7f3b58159ba0 2023-09-30T22:54:48.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.859+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5815c550 con 0x7f3b58159ba0 2023-09-30T22:54:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.860+0000 7f3b3effd700 1 -- 172.21.15.142:0/377963557 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3b50014830 con 0x7f3b58159ba0 2023-09-30T22:54:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.861+0000 7f3b3effd700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b44067330 0x7f3b440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.861+0000 7f3b3effd700 1 -- 172.21.15.142:0/377963557 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f3b500856e0 con 0x7f3b58159ba0 2023-09-30T22:54:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.862+0000 7f3b56ffd700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b44067330 0x7f3b440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.862+0000 7f3b56ffd700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b44067330 0x7f3b440697e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3b580c5890 tx=0x7f3b48017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:48.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:48.866+0000 7f3b3effd700 1 -- 172.21.15.142:0/377963557 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3b50052520 con 0x7f3b58159ba0 2023-09-30T22:54:49.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.053+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b580cac40 con 0x7f3b58159ba0 2023-09-30T22:54:49.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.053+0000 7f3b3effd700 1 -- 172.21.15.142:0/377963557 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b5005b020 con 0x7f3b58159ba0 2023-09-30T22:54:49.055 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b44067330 msgr2=0x7f3b440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b44067330 0x7f3b440697e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3b580c5890 tx=0x7f3b48017000 comp rx=0 tx=0).stop 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 msgr2=0x7f3b5815c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5815c850 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009e90 tx=0x7f3b5000b040 comp rx=0 tx=0).stop 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 shutdown_connections 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b44067330 0x7f3b440697e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b58159ba0 0x7f3b5815c850 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b580b0de0 0x7f3b58156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 --2- 172.21.15.142:0/377963557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b580ca5e0 0x7f3b5806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 >> 172.21.15.142:0/377963557 conn(0x7f3b580cb2f0 msgr2=0x7f3b58158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:49.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.055+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 shutdown_connections 2023-09-30T22:54:49.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.056+0000 7f3b5d9ff700 1 -- 172.21.15.142:0/377963557 wait complete. 2023-09-30T22:54:49.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:54:49.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.265+0000 7f1feb3ff700 1 Processor -- start 2023-09-30T22:54:49.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.265+0000 7f1feb3ff700 1 -- start start 2023-09-30T22:54:49.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1feb3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1fe4067d30 0x7f1fe406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1feb3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe406b650 con 0x7f1fe4159f10 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1feb3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe406aa40 con 0x7f1fe4159b40 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1feb3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe406ad20 con 0x7f1fe4067d30 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1fe999c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1fe4067d30 0x7f1fe406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1fe899a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1fe4159f10 0x7f1fe4067620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41302/0 (socket says 172.21.15.142:41302) 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1fe899a700 1 -- 172.21.15.142:0/85155600 learned_addr learned my addr 172.21.15.142:0/85155600 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1fdbfff700 1 -- 172.21.15.142:0/85155600 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509179234 0 0) 0x7f1fe406b650 con 0x7f1fe4159f10 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.267+0000 7f1fdbfff700 1 -- 172.21.15.142:0/85155600 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd0003570 con 0x7f1fe4159f10 2023-09-30T22:54:49.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.268+0000 7f1fe999c700 1 -- 172.21.15.142:0/85155600 >> v1:172.21.15.148:6789/0 conn(0x7f1fe4159b40 legacy=0x7f1fe40683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.268+0000 7f1fe999c700 1 -- 172.21.15.142:0/85155600 >> v1:172.21.15.142:6789/0 conn(0x7f1fe4159f10 legacy=0x7f1fe4067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.268+0000 7f1fe999c700 1 -- 172.21.15.142:0/85155600 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe406b000 con 0x7f1fe4067d30 2023-09-30T22:54:49.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.268+0000 7f1fe999c700 1 --2- 172.21.15.142:0/85155600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4067d30 0x7f1fe406a360 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e60 tx=0x7f1fdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0bd7a336c88053 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:49.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.268+0000 7f1fdbfff700 1 -- 172.21.15.142:0/85155600 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00e070 con 0x7f1fe4067d30 2023-09-30T22:54:49.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.268+0000 7f1fdbfff700 1 -- 172.21.15.142:0/85155600 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00bb60 con 0x7f1fe4067d30 2023-09-30T22:54:49.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.268+0000 7f1fdbfff700 1 -- 172.21.15.142:0/85155600 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc012430 con 0x7f1fe4067d30 2023-09-30T22:54:49.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.269+0000 7f1feb3ff700 1 -- 172.21.15.142:0/85155600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4067d30 msgr2=0x7f1fe406a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.269+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/85155600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4067d30 0x7f1fe406a360 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e60 tx=0x7f1fdc009780 comp rx=0 tx=0).stop 2023-09-30T22:54:49.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.269+0000 7f1feb3ff700 1 -- 172.21.15.142:0/85155600 shutdown_connections 2023-09-30T22:54:49.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.269+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/85155600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4067d30 0x7f1fe406a360 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.269+0000 7f1feb3ff700 1 -- 172.21.15.142:0/85155600 >> 172.21.15.142:0/85155600 conn(0x7f1fe40c9950 msgr2=0x7f1fe40c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:49.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.269+0000 7f1feb3ff700 1 -- 172.21.15.142:0/85155600 shutdown_connections 2023-09-30T22:54:49.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.269+0000 7f1feb3ff700 1 -- 172.21.15.142:0/85155600 wait complete. 2023-09-30T22:54:49.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.270+0000 7f1feb3ff700 1 Processor -- start 2023-09-30T22:54:49.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.270+0000 7f1feb3ff700 1 -- start start 2023-09-30T22:54:49.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.271+0000 7f1feb3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fe4067d30 0x7f1fe40afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.271+0000 7f1feb3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4159b40 0x7f1fe41505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.271+0000 7f1feb3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe4159f10 0x7f1fe40c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.271+0000 7f1feb3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe415cee0 con 0x7f1fe4159b40 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.271+0000 7f1feb3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c6250 con 0x7f1fe4159f10 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.271+0000 7f1feb3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe415a5b0 con 0x7f1fe4067d30 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.271+0000 7f1fe899a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4159b40 0x7f1fe41505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4159b40 0x7f1fe41505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34958/0 (socket says 172.21.15.142:34958) 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 -- 172.21.15.142:0/2283850434 learned_addr learned my addr 172.21.15.142:0/2283850434 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe999c700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe4159f10 0x7f1fe40c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe919b700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fe4067d30 0x7f1fe40afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 -- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fe4067d30 msgr2=0x7f1fe40afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fe4067d30 0x7f1fe40afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 -- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe4159f10 msgr2=0x7f1fe40c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe4159f10 0x7f1fe40c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 -- 172.21.15.142:0/2283850434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009a20 con 0x7f1fe4159b40 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe919b700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fe4067d30 0x7f1fe40afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fe899a700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4159b40 0x7f1fe41505e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c5f0 tx=0x7f1fd4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fd97fa700 1 -- 172.21.15.142:0/2283850434 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4005b30 con 0x7f1fe4159b40 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fd97fa700 1 -- 172.21.15.142:0/2283850434 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4005cb0 con 0x7f1fe4159b40 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe40c59b0 con 0x7f1fe4159b40 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.272+0000 7f1fd97fa700 1 -- 172.21.15.142:0/2283850434 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4007320 con 0x7f1fe4159b40 2023-09-30T22:54:49.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.273+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe40c5f70 con 0x7f1fe4159b40 2023-09-30T22:54:49.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.274+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe40699b0 con 0x7f1fe4159b40 2023-09-30T22:54:49.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.274+0000 7f1fd97fa700 1 -- 172.21.15.142:0/2283850434 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1fd401b3b0 con 0x7f1fe4159b40 2023-09-30T22:54:49.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.275+0000 7f1fd97fa700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1fc8067330 0x7f1fc80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.275+0000 7f1fd97fa700 1 -- 172.21.15.142:0/2283850434 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f1fd40841e0 con 0x7f1fe4159b40 2023-09-30T22:54:49.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.275+0000 7f1fe919b700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1fc8067330 0x7f1fc80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.276+0000 7f1fe919b700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1fc8067330 0x7f1fc80697e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0001840 tx=0x7f1fe0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:49.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.280+0000 7f1fd97fa700 1 -- 172.21.15.142:0/2283850434 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1fd4051020 con 0x7f1fe4159b40 2023-09-30T22:54:49.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.473+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1fe4063860 con 0x7f1fe4159b40 2023-09-30T22:54:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.473+0000 7f1fd97fa700 1 -- 172.21.15.142:0/2283850434 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1fd4054640 con 0x7f1fe4159b40 2023-09-30T22:54:49.475 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:54:49.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1fc8067330 msgr2=0x7f1fc80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1fc8067330 0x7f1fc80697e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0001840 tx=0x7f1fe0009040 comp rx=0 tx=0).stop 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4159b40 msgr2=0x7f1fe41505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4159b40 0x7f1fe41505e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c5f0 tx=0x7f1fd4007e00 comp rx=0 tx=0).stop 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 shutdown_connections 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1fc8067330 0x7f1fc80697e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe4159f10 0x7f1fe40c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fe4067d30 0x7f1fe40afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 --2- 172.21.15.142:0/2283850434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fe4159b40 0x7f1fe41505e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 >> 172.21.15.142:0/2283850434 conn(0x7f1fe40c9950 msgr2=0x7f1fe40c1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 shutdown_connections 2023-09-30T22:54:49.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.476+0000 7f1feb3ff700 1 -- 172.21.15.142:0/2283850434 wait complete. 2023-09-30T22:54:49.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:54:49.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.685+0000 7f7544fff700 1 Processor -- start 2023-09-30T22:54:49.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.685+0000 7f7544fff700 1 -- start start 2023-09-30T22:54:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f7544fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 0x7f754006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f7544fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7540067d10 con 0x7f75400b0de0 2023-09-30T22:54:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f7544fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754006af90 con 0x7f75400ca5e0 2023-09-30T22:54:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f7544fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75400676c0 con 0x7f7540159ba0 2023-09-30T22:54:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f7537fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f75400b0de0 0x7f75400c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41314/0 (socket says 172.21.15.142:41314) 2023-09-30T22:54:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f7537fff700 1 -- 172.21.15.142:0/405187293 learned_addr learned my addr 172.21.15.142:0/405187293 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f753e59c700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 0x7f754006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549371933 0 0) 0x7f7540067d10 con 0x7f75400b0de0 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.687+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f752c003570 con 0x7f75400b0de0 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891040872 0 0) 0x7f754006af90 con 0x7f75400ca5e0 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7540067d10 con 0x7f75400ca5e0 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534535882 0 0) 0x7f752c003570 con 0x7f75400b0de0 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 msgr2=0x7f754006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 0x7f754006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 >> v1:172.21.15.148:6789/0 conn(0x7f75400ca5e0 legacy=0x7f75400681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400679a0 con 0x7f75400b0de0 2023-09-30T22:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f7528001470 con 0x7f75400b0de0 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 >> v1:172.21.15.142:6789/0 conn(0x7f75400b0de0 legacy=0x7f75400c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c003c20 0x7f752c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c004810 0x7f752c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 0x7f752c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400676c0 con 0x7f752c004810 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c00bbf0 con 0x7f752c003c20 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c00bdb0 con 0x7f7540159ba0 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f7537fff700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c004810 0x7f752c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753e59c700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c003c20 0x7f752c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.688+0000 7f753ed9d700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 0x7f752c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f7537fff700 1 -- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 msgr2=0x7f752c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f7537fff700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 0x7f752c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f7537fff700 1 -- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c003c20 msgr2=0x7f752c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f7537fff700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c003c20 0x7f752c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f7537fff700 1 -- 172.21.15.142:0/405187293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c003570 con 0x7f752c004810 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f753ed9d700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7540159ba0 0x7f752c005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f7537fff700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c004810 0x7f752c004c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f752800c1e0 tx=0x7f7528001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122b292156865c79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800cb10 con 0x7f752c004810 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800cc90 con 0x7f752c004810 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.689+0000 7f753dd9b700 1 -- 172.21.15.142:0/405187293 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528005b70 con 0x7f752c004810 2023-09-30T22:54:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.690+0000 7f7544fff700 1 -- 172.21.15.142:0/405187293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c004810 msgr2=0x7f752c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.690+0000 7f7544fff700 1 --2- 172.21.15.142:0/405187293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c004810 0x7f752c004c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f752800c1e0 tx=0x7f7528001d40 comp rx=0 tx=0).stop 2023-09-30T22:54:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.690+0000 7f753ed9d700 1 -- 172.21.15.142:0/405187293 reap_dead start 2023-09-30T22:54:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.690+0000 7f7544fff700 1 -- 172.21.15.142:0/405187293 shutdown_connections 2023-09-30T22:54:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.690+0000 7f7544fff700 1 -- 172.21.15.142:0/405187293 >> 172.21.15.142:0/405187293 conn(0x7f75400cb2f0 msgr2=0x7f75400cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.690+0000 7f7544fff700 1 -- 172.21.15.142:0/405187293 shutdown_connections 2023-09-30T22:54:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.690+0000 7f7544fff700 1 -- 172.21.15.142:0/405187293 wait complete. 2023-09-30T22:54:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.692+0000 7f7544fff700 1 Processor -- start 2023-09-30T22:54:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.692+0000 7f7544fff700 1 -- start start 2023-09-30T22:54:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.693+0000 7f7544fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c004810 0x7f754016a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.693+0000 7f7544fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754015c6f0 0x7f75400afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.693+0000 7f7544fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75400c7f00 0x7f75400c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.693+0000 7f7544fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754015c2d0 con 0x7f754015c6f0 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.693+0000 7f7544fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400c88e0 con 0x7f752c004810 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.693+0000 7f7544fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754015b650 con 0x7f75400c7f00 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.693+0000 7f7537fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754015c6f0 0x7f75400afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754015c6f0 0x7f75400afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34982/0 (socket says 172.21.15.142:34982) 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 -- 172.21.15.142:0/1999779804 learned_addr learned my addr 172.21.15.142:0/1999779804 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f753e59c700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c004810 0x7f754016a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f753ed9d700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75400c7f00 0x7f75400c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 -- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75400c7f00 msgr2=0x7f75400c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75400c7f00 0x7f75400c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 -- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c004810 msgr2=0x7f754016a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c004810 0x7f754016a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 -- 172.21.15.142:0/1999779804 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754015b930 con 0x7f754015c6f0 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f7537fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754015c6f0 0x7f75400afee0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f752c0057f0 tx=0x7f7528015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f75367fc700 1 -- 172.21.15.142:0/1999779804 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528001370 con 0x7f754015c6f0 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f75367fc700 1 -- 172.21.15.142:0/1999779804 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75280014d0 con 0x7f754015c6f0 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.694+0000 7f75367fc700 1 -- 172.21.15.142:0/1999779804 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528007320 con 0x7f754015c6f0 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.695+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754015bc10 con 0x7f754015c6f0 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.695+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75400b0420 con 0x7f754015c6f0 2023-09-30T22:54:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.696+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754006e4b0 con 0x7f754015c6f0 2023-09-30T22:54:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.696+0000 7f75367fc700 1 -- 172.21.15.142:0/1999779804 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7528028450 con 0x7f754015c6f0 2023-09-30T22:54:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.697+0000 7f75367fc700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7520067330 0x7f75200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:49.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.697+0000 7f75367fc700 1 -- 172.21.15.142:0/1999779804 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f7528086250 con 0x7f754015c6f0 2023-09-30T22:54:49.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.697+0000 7f753e59c700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7520067330 0x7f75200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:49.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.698+0000 7f753e59c700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7520067330 0x7f75200697e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7530006f00 tx=0x7f75300091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:49.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.701+0000 7f75367fc700 1 -- 172.21.15.142:0/1999779804 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7528053150 con 0x7f754015c6f0 2023-09-30T22:54:49.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.889+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75400cac40 con 0x7f754015c6f0 2023-09-30T22:54:49.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.889+0000 7f75367fc700 1 -- 172.21.15.142:0/1999779804 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7528056770 con 0x7f754015c6f0 2023-09-30T22:54:49.891 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:54:49.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7520067330 msgr2=0x7f75200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7520067330 0x7f75200697e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7530006f00 tx=0x7f75300091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754015c6f0 msgr2=0x7f75400afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:49.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754015c6f0 0x7f75400afee0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f752c0057f0 tx=0x7f7528015000 comp rx=0 tx=0).stop 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 shutdown_connections 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7520067330 0x7f75200697e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75400c7f00 0x7f75400c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f752c004810 0x7f754016a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 --2- 172.21.15.142:0/1999779804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754015c6f0 0x7f75400afee0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.891+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 >> 172.21.15.142:0/1999779804 conn(0x7f75400cb2f0 msgr2=0x7f75400cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.892+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 shutdown_connections 2023-09-30T22:54:49.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:49.892+0000 7f7544fff700 1 -- 172.21.15.142:0/1999779804 wait complete. 2023-09-30T22:54:49.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:54:50.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.101+0000 7fe4415ff700 1 Processor -- start 2023-09-30T22:54:50.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.102+0000 7fe4415ff700 1 -- start start 2023-09-30T22:54:50.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe4415ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe43c0cbfe0 0x7fe43c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe4415ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe43c0cc3b0 0x7fe43c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe4415ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c1573a0 0x7fe43c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe4415ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c0cf750 con 0x7fe43c0cc3b0 2023-09-30T22:54:50.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe4415ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c0d0550 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe4415ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c157d60 con 0x7fe43c1573a0 2023-09-30T22:54:50.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe43c0cc3b0 0x7fe43c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe43c0cc3b0 0x7fe43c0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34998/0 (socket says 172.21.15.142:34998) 2023-09-30T22:54:50.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 -- 172.21.15.142:0/2984019301 learned_addr learned my addr 172.21.15.142:0/2984019301 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:50.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43affd700 1 --2- 172.21.15.142:0/2984019301 >> v2:172.21.15.148:3300/0 conn(0x7fe43c0cbfe0 0x7fe43c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43b7fe700 1 --2- 172.21.15.142:0/2984019301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c1573a0 0x7fe43c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 -- 172.21.15.142:0/2984019301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c1573a0 msgr2=0x7fe43c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:50.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 --2- 172.21.15.142:0/2984019301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c1573a0 0x7fe43c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 -- 172.21.15.142:0/2984019301 >> v2:172.21.15.148:3300/0 conn(0x7fe43c0cbfe0 msgr2=0x7fe43c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:50.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 --2- 172.21.15.142:0/2984019301 >> v2:172.21.15.148:3300/0 conn(0x7fe43c0cbfe0 0x7fe43c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43a7fc700 1 -- 172.21.15.142:0/2984019301 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c0cf940 con 0x7fe43c0cc3b0 2023-09-30T22:54:50.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43affd700 1 --2- 172.21.15.142:0/2984019301 >> v2:172.21.15.148:3300/0 conn(0x7fe43c0cbfe0 0x7fe43c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:50.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.103+0000 7fe43b7fe700 1 --2- 172.21.15.142:0/2984019301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c1573a0 0x7fe43c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:50.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.104+0000 7fe43a7fc700 1 --2- 172.21.15.142:0/2984019301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cc3b0 0x7fe43c0cf210 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe43c06cf00 tx=0x7fe430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6481d4b07d5f7bdc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.104+0000 7fe439ffb700 1 -- 172.21.15.142:0/2984019301 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000b860 con 0x7fe43c0cc3b0 2023-09-30T22:54:50.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.104+0000 7fe439ffb700 1 -- 172.21.15.142:0/2984019301 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000b9c0 con 0x7fe43c0cc3b0 2023-09-30T22:54:50.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.104+0000 7fe439ffb700 1 -- 172.21.15.142:0/2984019301 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000bd60 con 0x7fe43c0cc3b0 2023-09-30T22:54:50.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.104+0000 7fe4415ff700 1 -- 172.21.15.142:0/2984019301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cc3b0 msgr2=0x7fe43c0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.104+0000 7fe4415ff700 1 --2- 172.21.15.142:0/2984019301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cc3b0 0x7fe43c0cf210 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe43c06cf00 tx=0x7fe430009250 comp rx=0 tx=0).stop 2023-09-30T22:54:50.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.105+0000 7fe4415ff700 1 -- 172.21.15.142:0/2984019301 shutdown_connections 2023-09-30T22:54:50.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.105+0000 7fe4415ff700 1 --2- 172.21.15.142:0/2984019301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c1573a0 0x7fe43c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.105+0000 7fe4415ff700 1 --2- 172.21.15.142:0/2984019301 >> v2:172.21.15.148:3300/0 conn(0x7fe43c0cbfe0 0x7fe43c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.105+0000 7fe4415ff700 1 --2- 172.21.15.142:0/2984019301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cc3b0 0x7fe43c0cf210 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.105+0000 7fe4415ff700 1 -- 172.21.15.142:0/2984019301 >> 172.21.15.142:0/2984019301 conn(0x7fe43c0d0a80 msgr2=0x7fe43c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:50.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.105+0000 7fe4415ff700 1 -- 172.21.15.142:0/2984019301 shutdown_connections 2023-09-30T22:54:50.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.105+0000 7fe4415ff700 1 -- 172.21.15.142:0/2984019301 wait complete. 2023-09-30T22:54:50.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.106+0000 7fe4415ff700 1 Processor -- start 2023-09-30T22:54:50.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.106+0000 7fe4415ff700 1 -- start start 2023-09-30T22:54:50.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe4415ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cbfe0 0x7fe43c0b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe4415ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c0cc3b0 0x7fe43c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe4415ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe43c1573a0 0x7fe43c147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe4415ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0ba910 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe4415ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0b9d00 con 0x7fe43c1573a0 2023-09-30T22:54:50.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe4415ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0b9fe0 con 0x7fe43c0cc3b0 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe43affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cbfe0 0x7fe43c0b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe43affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cbfe0 0x7fe43c0b9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35004/0 (socket says 172.21.15.142:35004) 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.107+0000 7fe43affd700 1 -- 172.21.15.142:0/646476271 learned_addr learned my addr 172.21.15.142:0/646476271 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe43affd700 1 -- 172.21.15.142:0/646476271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c0cc3b0 msgr2=0x7fe43c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe43affd700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c0cc3b0 0x7fe43c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe43affd700 1 -- 172.21.15.142:0/646476271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe43c1573a0 msgr2=0x7fe43c147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe43affd700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe43c1573a0 0x7fe43c147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe43affd700 1 -- 172.21.15.142:0/646476271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300094f0 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe43affd700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cbfe0 0x7fe43c0b9320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00e8d0 tx=0x7fe42c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe422ffd700 1 -- 172.21.15.142:0/646476271 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00ee70 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe422ffd700 1 -- 172.21.15.142:0/646476271 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c00c5e0 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c0ba2c0 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe422ffd700 1 -- 172.21.15.142:0/646476271 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00c980 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.108+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c0bada0 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.109+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c069770 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.110+0000 7fe422ffd700 1 -- 172.21.15.142:0/646476271 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe42c013410 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.111+0000 7fe422ffd700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe428067330 0x7fe4280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.111+0000 7fe422ffd700 1 -- 172.21.15.142:0/646476271 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fe42c084d90 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.111+0000 7fe43a7fc700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe428067330 0x7fe4280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.112+0000 7fe43a7fc700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe428067330 0x7fe4280697e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe43c06cf00 tx=0x7fe430017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.115+0000 7fe422ffd700 1 -- 172.21.15.142:0/646476271 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe42c051bd0 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.306+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe43c0babf0 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.308+0000 7fe422ffd700 1 -- 172.21.15.142:0/646476271 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe42c0200a0 con 0x7fe43c0cbfe0 2023-09-30T22:54:50.309 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:54:50.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe428067330 msgr2=0x7fe4280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe428067330 0x7fe4280697e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe43c06cf00 tx=0x7fe430017000 comp rx=0 tx=0).stop 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cbfe0 msgr2=0x7fe43c0b9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cbfe0 0x7fe43c0b9320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00e8d0 tx=0x7fe42c008040 comp rx=0 tx=0).stop 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 shutdown_connections 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe428067330 0x7fe4280697e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe43c1573a0 0x7fe43c147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe43c0cbfe0 0x7fe43c0b9320 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 --2- 172.21.15.142:0/646476271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe43c0cc3b0 0x7fe43c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 >> 172.21.15.142:0/646476271 conn(0x7fe43c0d0a80 msgr2=0x7fe43c1567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 shutdown_connections 2023-09-30T22:54:50.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.311+0000 7fe4415ff700 1 -- 172.21.15.142:0/646476271 wait complete. 2023-09-30T22:54:50.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:50.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.519+0000 7f7280fff700 1 Processor -- start 2023-09-30T22:54:50.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.519+0000 7f7280fff700 1 -- start start 2023-09-30T22:54:50.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.520+0000 7f7280fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f727c0af020 0x7f727c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.520+0000 7f7280fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f727c0b00d0 0x7f727c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.520+0000 7f7280fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c06d3e0 con 0x7f727c06e650 2023-09-30T22:54:50.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.520+0000 7f7280fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c15b400 con 0x7f727c0b00d0 2023-09-30T22:54:50.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.520+0000 7f7280fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c06dc80 con 0x7f727c0af020 2023-09-30T22:54:50.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f7279d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f727c0b00d0 0x7f727c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f727ad9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f727c06e650 0x7f727c0b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41320/0 (socket says 172.21.15.142:41320) 2023-09-30T22:54:50.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f727ad9d700 1 -- 172.21.15.142:0/924080630 learned_addr learned my addr 172.21.15.142:0/924080630 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:50.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f727a59c700 1 --2- 172.21.15.142:0/924080630 >> v2:172.21.15.148:3300/0 conn(0x7f727c0af020 0x7f727c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f727959a700 1 -- 172.21.15.142:0/924080630 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593443115 0 0) 0x7f727c06d3e0 con 0x7f727c06e650 2023-09-30T22:54:50.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f727959a700 1 -- 172.21.15.142:0/924080630 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7264003570 con 0x7f727c06e650 2023-09-30T22:54:50.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f7279d9b700 1 -- 172.21.15.142:0/924080630 >> v2:172.21.15.148:3300/0 conn(0x7f727c0af020 msgr2=0x7f727c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:50.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f7279d9b700 1 --2- 172.21.15.142:0/924080630 >> v2:172.21.15.148:3300/0 conn(0x7f727c0af020 0x7f727c156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f7279d9b700 1 -- 172.21.15.142:0/924080630 >> v1:172.21.15.142:6789/0 conn(0x7f727c06e650 legacy=0x7f727c0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f7279d9b700 1 -- 172.21.15.142:0/924080630 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c06b790 con 0x7f727c0b00d0 2023-09-30T22:54:50.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.521+0000 7f7279d9b700 1 --2- 172.21.15.142:0/924080630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c0b00d0 0x7f727c06e110 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f72700098e0 tx=0x7f72700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8ddc7a96d5c31c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f727959a700 1 -- 172.21.15.142:0/924080630 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270011630 con 0x7f727c0b00d0 2023-09-30T22:54:50.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f727959a700 1 -- 172.21.15.142:0/924080630 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7270011790 con 0x7f727c0b00d0 2023-09-30T22:54:50.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f727959a700 1 -- 172.21.15.142:0/924080630 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270011b30 con 0x7f727c0b00d0 2023-09-30T22:54:50.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 -- 172.21.15.142:0/924080630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c0b00d0 msgr2=0x7f727c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 --2- 172.21.15.142:0/924080630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c0b00d0 0x7f727c06e110 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f72700098e0 tx=0x7f72700091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 -- 172.21.15.142:0/924080630 shutdown_connections 2023-09-30T22:54:50.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 --2- 172.21.15.142:0/924080630 >> v2:172.21.15.148:3300/0 conn(0x7f727c0af020 0x7f727c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 --2- 172.21.15.142:0/924080630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c0b00d0 0x7f727c06e110 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 -- 172.21.15.142:0/924080630 >> 172.21.15.142:0/924080630 conn(0x7f727c0680c0 msgr2=0x7f727c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:50.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 -- 172.21.15.142:0/924080630 shutdown_connections 2023-09-30T22:54:50.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.522+0000 7f7280fff700 1 -- 172.21.15.142:0/924080630 wait complete. 2023-09-30T22:54:50.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.524+0000 7f7280fff700 1 Processor -- start 2023-09-30T22:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.524+0000 7f7280fff700 1 -- start start 2023-09-30T22:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f7280fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c06e650 0x7f727c0a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f7280fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f727c0af020 0x7f727c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f7280fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f727c0b00d0 0x7f727c06a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f7280fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c16e720 con 0x7f727c06e650 2023-09-30T22:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f7280fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c146ef0 con 0x7f727c0b00d0 2023-09-30T22:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f7280fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0a6930 con 0x7f727c0af020 2023-09-30T22:54:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c06e650 0x7f727c0a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c06e650 0x7f727c0a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35020/0 (socket says 172.21.15.142:35020) 2023-09-30T22:54:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727a59c700 1 -- 172.21.15.142:0/1404730570 learned_addr learned my addr 172.21.15.142:0/1404730570 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f7279d9b700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f727c0af020 0x7f727c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727ad9d700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f727c0b00d0 0x7f727c06a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727a59c700 1 -- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f727c0af020 msgr2=0x7f727c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727a59c700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f727c0af020 0x7f727c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727a59c700 1 -- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f727c0b00d0 msgr2=0x7f727c06a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.525+0000 7f727a59c700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f727c0b00d0 0x7f727c06a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.526+0000 7f727a59c700 1 -- 172.21.15.142:0/1404730570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270009420 con 0x7f727c06e650 2023-09-30T22:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.526+0000 7f727a59c700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c06e650 0x7f727c0a8cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ec80 tx=0x7f726c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.526+0000 7f726a7fc700 1 -- 172.21.15.142:0/1404730570 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00c850 con 0x7f727c06e650 2023-09-30T22:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.526+0000 7f726a7fc700 1 -- 172.21.15.142:0/1404730570 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00c9b0 con 0x7f727c06e650 2023-09-30T22:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.526+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0a6c10 con 0x7f727c06e650 2023-09-30T22:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.526+0000 7f726a7fc700 1 -- 172.21.15.142:0/1404730570 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00cd50 con 0x7f727c06e650 2023-09-30T22:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.526+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0a71d0 con 0x7f727c06e650 2023-09-30T22:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.527+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c0695b0 con 0x7f727c06e650 2023-09-30T22:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.528+0000 7f726a7fc700 1 -- 172.21.15.142:0/1404730570 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f726c013680 con 0x7f727c06e650 2023-09-30T22:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.530+0000 7f726a7fc700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f725c067330 0x7f725c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.530+0000 7f726a7fc700 1 -- 172.21.15.142:0/1404730570 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f726c084e90 con 0x7f727c06e650 2023-09-30T22:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.530+0000 7f7279d9b700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f725c067330 0x7f725c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.531+0000 7f7279d9b700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f725c067330 0x7f725c0697e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f72700093f0 tx=0x7f7270017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.534+0000 7f726a7fc700 1 -- 172.21.15.142:0/1404730570 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f726c051cd0 con 0x7f727c06e650 2023-09-30T22:54:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.768+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f727c0a7540 con 0x7f727c06e650 2023-09-30T22:54:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.768+0000 7f726a7fc700 1 -- 172.21.15.142:0/1404730570 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f726c0552f0 con 0x7f727c06e650 2023-09-30T22:54:50.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:50.770 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:50.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.770+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f725c067330 msgr2=0x7f725c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.770+0000 7f7280fff700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f725c067330 0x7f725c0697e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f72700093f0 tx=0x7f7270017000 comp rx=0 tx=0).stop 2023-09-30T22:54:50.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.770+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c06e650 msgr2=0x7f727c0a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c06e650 0x7f727c0a8cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ec80 tx=0x7f726c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 shutdown_connections 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f725c067330 0x7f725c0697e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f727c0b00d0 0x7f727c06a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f727c06e650 0x7f727c0a8cb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 --2- 172.21.15.142:0/1404730570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f727c0af020 0x7f727c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 >> 172.21.15.142:0/1404730570 conn(0x7f727c0680c0 msgr2=0x7f727c0cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 shutdown_connections 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.771+0000 7f7280fff700 1 -- 172.21.15.142:0/1404730570 wait complete. 2023-09-30T22:54:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:50.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:54:50.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.976+0000 7fad09dff700 1 Processor -- start 2023-09-30T22:54:50.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.977+0000 7fad09dff700 1 -- start start 2023-09-30T22:54:50.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad09dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad04143350 0x7fad040cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad09dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad0415de20 0x7fad0406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad09dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040cc6b0 con 0x7fad040692f0 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad09dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040cb7d0 con 0x7fad0415de20 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad09dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040cbaa0 con 0x7fad04143350 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad03fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad0415de20 0x7fad0406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad03fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad0415de20 0x7fad0406a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59112/0 (socket says 172.21.15.142:59112) 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad03fff700 1 -- 172.21.15.142:0/4114565203 learned_addr learned my addr 172.21.15.142:0/4114565203 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad02ffd700 1 --1- 172.21.15.142:0/4114565203 >> v1:172.21.15.142:6789/0 conn(0x7fad040692f0 0x7fad0415d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36872/0 (socket says 172.21.15.142:36872) 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.978+0000 7fad037fe700 1 --2- 172.21.15.142:0/4114565203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad04143350 0x7fad040cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad03fff700 1 -- 172.21.15.142:0/4114565203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad04143350 msgr2=0x7fad040cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad03fff700 1 --2- 172.21.15.142:0/4114565203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad04143350 0x7fad040cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad03fff700 1 -- 172.21.15.142:0/4114565203 >> v1:172.21.15.142:6789/0 conn(0x7fad040692f0 legacy=0x7fad0415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad03fff700 1 -- 172.21.15.142:0/4114565203 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040cbd80 con 0x7fad0415de20 2023-09-30T22:54:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad027fc700 1 -- 172.21.15.142:0/4114565203 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548148468 0 0) 0x7fad040cc6b0 con 0x7fad040692f0 2023-09-30T22:54:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad03fff700 1 --2- 172.21.15.142:0/4114565203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0406a0c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7facfc009f20 tx=0x7facfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7656bfa19924cad0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad027fc700 1 -- 172.21.15.142:0/4114565203 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00e070 con 0x7fad0415de20 2023-09-30T22:54:50.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad027fc700 1 -- 172.21.15.142:0/4114565203 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00b9d0 con 0x7fad0415de20 2023-09-30T22:54:50.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.979+0000 7fad027fc700 1 -- 172.21.15.142:0/4114565203 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0092e0 con 0x7fad0415de20 2023-09-30T22:54:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 -- 172.21.15.142:0/4114565203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 msgr2=0x7fad0406a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 --2- 172.21.15.142:0/4114565203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0406a0c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7facfc009f20 tx=0x7facfc009840 comp rx=0 tx=0).stop 2023-09-30T22:54:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 -- 172.21.15.142:0/4114565203 shutdown_connections 2023-09-30T22:54:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 --2- 172.21.15.142:0/4114565203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0406a0c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 --2- 172.21.15.142:0/4114565203 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad04143350 0x7fad040cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 -- 172.21.15.142:0/4114565203 >> 172.21.15.142:0/4114565203 conn(0x7fad040ce8e0 msgr2=0x7fad040cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 -- 172.21.15.142:0/4114565203 shutdown_connections 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.980+0000 7fad09dff700 1 -- 172.21.15.142:0/4114565203 wait complete. 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.982+0000 7fad09dff700 1 Processor -- start 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.982+0000 7fad09dff700 1 -- start start 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.983+0000 7fad09dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad040692f0 0x7fad040b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.983+0000 7fad09dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad04143350 0x7fad0406a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.983+0000 7fad09dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0416d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.983+0000 7fad09dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415a330 con 0x7fad0415de20 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.983+0000 7fad09dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415a610 con 0x7fad04143350 2023-09-30T22:54:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.983+0000 7fad09dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415a8f0 con 0x7fad040692f0 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0416d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0416d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59128/0 (socket says 172.21.15.142:59128) 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 -- 172.21.15.142:0/1799641621 learned_addr learned my addr 172.21.15.142:0/1799641621 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad037fe700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad040692f0 0x7fad040b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad02ffd700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad04143350 0x7fad0406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 -- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad040692f0 msgr2=0x7fad040b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad040692f0 0x7fad040b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 -- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad04143350 msgr2=0x7fad0406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad04143350 0x7fad0406a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 -- 172.21.15.142:0/1799641621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009ae0 con 0x7fad0415de20 2023-09-30T22:54:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7fad03fff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0416d6e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7facfc012000 tx=0x7facfc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.984+0000 7faceb7fe700 1 -- 172.21.15.142:0/1799641621 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc008b10 con 0x7fad0415de20 2023-09-30T22:54:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.985+0000 7faceb7fe700 1 -- 172.21.15.142:0/1799641621 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc008c70 con 0x7fad0415de20 2023-09-30T22:54:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.985+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0415abd0 con 0x7fad0415de20 2023-09-30T22:54:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.985+0000 7faceb7fe700 1 -- 172.21.15.142:0/1799641621 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc025460 con 0x7fad0415de20 2023-09-30T22:54:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.985+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0406a850 con 0x7fad0415de20 2023-09-30T22:54:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.986+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0415b070 con 0x7fad0415de20 2023-09-30T22:54:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.987+0000 7faceb7fe700 1 -- 172.21.15.142:0/1799641621 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7facfc003040 con 0x7fad0415de20 2023-09-30T22:54:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.987+0000 7faceb7fe700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facf0067330 0x7facf00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.987+0000 7faceb7fe700 1 -- 172.21.15.142:0/1799641621 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7facfc0866c0 con 0x7fad0415de20 2023-09-30T22:54:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.988+0000 7fad037fe700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facf0067330 0x7facf00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.988+0000 7fad037fe700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facf0067330 0x7facf00697e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facf4009db0 tx=0x7facf40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:50.992+0000 7faceb7fe700 1 -- 172.21.15.142:0/1799641621 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7facfc0535b0 con 0x7fad0415de20 2023-09-30T22:54:51.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.185+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad0415b220 con 0x7fad0415de20 2023-09-30T22:54:51.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.186+0000 7faceb7fe700 1 -- 172.21.15.142:0/1799641621 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17059 (secure 0 0 0) 0x7facfc056bd0 con 0x7fad0415de20 2023-09-30T22:54:51.187 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:51.187 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":61,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:54:43.277751+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:54:04.395113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T22:54:05.729484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2b","mappings":[{"from":2,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:54:51.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facf0067330 msgr2=0x7facf00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facf0067330 0x7facf00697e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facf4009db0 tx=0x7facf40091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 msgr2=0x7fad0416d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0416d6e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7facfc012000 tx=0x7facfc018000 comp rx=0 tx=0).stop 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 shutdown_connections 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7facf0067330 0x7facf00697e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad0415de20 0x7fad0416d6e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad040692f0 0x7fad040b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 --2- 172.21.15.142:0/1799641621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad04143350 0x7fad0406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 >> 172.21.15.142:0/1799641621 conn(0x7fad040ce8e0 msgr2=0x7fad040c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 shutdown_connections 2023-09-30T22:54:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.188+0000 7fad09dff700 1 -- 172.21.15.142:0/1799641621 wait complete. 2023-09-30T22:54:51.207 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:54:51.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:51.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.396+0000 7f0d651ff700 1 Processor -- start 2023-09-30T22:54:51.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.396+0000 7f0d651ff700 1 -- start start 2023-09-30T22:54:51.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.398+0000 7f0d651ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d6006e820 0x7f0d60161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.398+0000 7f0d651ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6006d3e0 con 0x7f0d600af020 2023-09-30T22:54:51.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.398+0000 7f0d651ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6006dc80 con 0x7f0d600b00d0 2023-09-30T22:54:51.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.398+0000 7f0d651ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6015b400 con 0x7f0d6006e820 2023-09-30T22:54:51.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.398+0000 7f0d5ed9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0d600af020 0x7f0d60156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36878/0 (socket says 172.21.15.142:36878) 2023-09-30T22:54:51.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.398+0000 7f0d5ed9d700 1 -- 172.21.15.142:0/157419015 learned_addr learned my addr 172.21.15.142:0/157419015 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:51.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.398+0000 7f0d5f59e700 1 --2- 172.21.15.142:0/157419015 >> v2:172.21.15.142:3300/0 conn(0x7f0d6006e820 0x7f0d60161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5dd9b700 1 -- 172.21.15.142:0/157419015 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990847638 0 0) 0x7f0d6006d3e0 con 0x7f0d600af020 2023-09-30T22:54:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5dd9b700 1 -- 172.21.15.142:0/157419015 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d48003570 con 0x7f0d600af020 2023-09-30T22:54:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5f59e700 1 -- 172.21.15.142:0/157419015 >> v1:172.21.15.148:6789/0 conn(0x7f0d600b00d0 legacy=0x7f0d6006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5f59e700 1 -- 172.21.15.142:0/157419015 >> v1:172.21.15.142:6789/0 conn(0x7f0d600af020 legacy=0x7f0d60156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5f59e700 1 -- 172.21.15.142:0/157419015 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6006eca0 con 0x7f0d6006e820 2023-09-30T22:54:51.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5f59e700 1 --2- 172.21.15.142:0/157419015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d60161790 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009e90 tx=0x7f0d58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fbc0a9445e7fcd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:51.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5dd9b700 1 -- 172.21.15.142:0/157419015 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800e070 con 0x7f0d6006e820 2023-09-30T22:54:51.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5dd9b700 1 -- 172.21.15.142:0/157419015 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5800bc40 con 0x7f0d6006e820 2023-09-30T22:54:51.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.399+0000 7f0d5dd9b700 1 -- 172.21.15.142:0/157419015 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58012430 con 0x7f0d6006e820 2023-09-30T22:54:51.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.400+0000 7f0d651ff700 1 -- 172.21.15.142:0/157419015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 msgr2=0x7f0d60161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.400+0000 7f0d651ff700 1 --2- 172.21.15.142:0/157419015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d60161790 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009e90 tx=0x7f0d58009780 comp rx=0 tx=0).stop 2023-09-30T22:54:51.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.400+0000 7f0d651ff700 1 -- 172.21.15.142:0/157419015 shutdown_connections 2023-09-30T22:54:51.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.400+0000 7f0d651ff700 1 --2- 172.21.15.142:0/157419015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d60161790 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.400+0000 7f0d651ff700 1 -- 172.21.15.142:0/157419015 >> 172.21.15.142:0/157419015 conn(0x7f0d600680c0 msgr2=0x7f0d600c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:51.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.400+0000 7f0d651ff700 1 -- 172.21.15.142:0/157419015 shutdown_connections 2023-09-30T22:54:51.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.400+0000 7f0d651ff700 1 -- 172.21.15.142:0/157419015 wait complete. 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.402+0000 7f0d651ff700 1 Processor -- start 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.402+0000 7f0d651ff700 1 -- start start 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d651ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d600c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d651ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d600af020 0x7f0d600a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d651ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d600b00d0 0x7f0d601546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d651ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600a6630 con 0x7f0d6006e820 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d651ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600c77a0 con 0x7f0d600af020 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d651ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600c7a80 con 0x7f0d600b00d0 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d600c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d600c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59146/0 (socket says 172.21.15.142:59146) 2023-09-30T22:54:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 -- 172.21.15.142:0/2179841584 learned_addr learned my addr 172.21.15.142:0/2179841584 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5f59e700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d600b00d0 0x7f0d601546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5e59c700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d600af020 0x7f0d600a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 -- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d600b00d0 msgr2=0x7f0d601546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d600b00d0 0x7f0d601546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 -- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d600af020 msgr2=0x7f0d600a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d600af020 0x7f0d600a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5ed9d700 1 -- 172.21.15.142:0/2179841584 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009a20 con 0x7f0d6006e820 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.403+0000 7f0d5f59e700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d600b00d0 0x7f0d601546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.404+0000 7f0d5ed9d700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d600c7110 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c7c0 tx=0x7f0d50007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.404+0000 7f0d46ffd700 1 -- 172.21.15.142:0/2179841584 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50005b30 con 0x7f0d6006e820 2023-09-30T22:54:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.404+0000 7f0d46ffd700 1 -- 172.21.15.142:0/2179841584 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50005c90 con 0x7f0d6006e820 2023-09-30T22:54:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.404+0000 7f0d46ffd700 1 -- 172.21.15.142:0/2179841584 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50007340 con 0x7f0d6006e820 2023-09-30T22:54:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.404+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600c7d60 con 0x7f0d6006e820 2023-09-30T22:54:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.404+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60154c00 con 0x7f0d6006e820 2023-09-30T22:54:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.405+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d600695b0 con 0x7f0d6006e820 2023-09-30T22:54:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.406+0000 7f0d46ffd700 1 -- 172.21.15.142:0/2179841584 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0d5001b400 con 0x7f0d6006e820 2023-09-30T22:54:51.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.407+0000 7f0d46ffd700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d4c067330 0x7f0d4c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.407+0000 7f0d46ffd700 1 -- 172.21.15.142:0/2179841584 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f0d500846d0 con 0x7f0d6006e820 2023-09-30T22:54:51.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.407+0000 7f0d5e59c700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d4c067330 0x7f0d4c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.408+0000 7f0d5e59c700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d4c067330 0x7f0d4c0697e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d601554b0 tx=0x7f0d54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.411+0000 7f0d46ffd700 1 -- 172.21.15.142:0/2179841584 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0d50051630 con 0x7f0d6006e820 2023-09-30T22:54:51.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.645+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d6006fc10 con 0x7f0d6006e820 2023-09-30T22:54:51.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.645+0000 7f0d46ffd700 1 -- 172.21.15.142:0/2179841584 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f0d50054c50 con 0x7f0d6006e820 2023-09-30T22:54:51.647 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:51.647 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:51.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.647+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d4c067330 msgr2=0x7f0d4c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.647+0000 7f0d651ff700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d4c067330 0x7f0d4c0697e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d601554b0 tx=0x7f0d54009040 comp rx=0 tx=0).stop 2023-09-30T22:54:51.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.647+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 msgr2=0x7f0d600c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.647+0000 7f0d651ff700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d600c7110 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c7c0 tx=0x7f0d50007e00 comp rx=0 tx=0).stop 2023-09-30T22:54:51.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 shutdown_connections 2023-09-30T22:54:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d4c067330 0x7f0d4c0697e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d600b00d0 0x7f0d601546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6006e820 0x7f0d600c7110 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 --2- 172.21.15.142:0/2179841584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d600af020 0x7f0d600a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 >> 172.21.15.142:0/2179841584 conn(0x7f0d600680c0 msgr2=0x7f0d60156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 shutdown_connections 2023-09-30T22:54:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.648+0000 7f0d651ff700 1 -- 172.21.15.142:0/2179841584 wait complete. 2023-09-30T22:54:51.651 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:51.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.857+0000 7f8ab59ff700 1 Processor -- start 2023-09-30T22:54:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.857+0000 7f8ab59ff700 1 -- start start 2023-09-30T22:54:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8ab59ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 0x7f8ab00adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8ab59ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00ad630 con 0x7f8ab00b1950 2023-09-30T22:54:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8ab59ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00b3360 con 0x7f8ab00ae000 2023-09-30T22:54:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8ab59ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0157c20 con 0x7f8ab00b1580 2023-09-30T22:54:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8aae7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8ab00b1950 0x7f8ab015a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36882/0 (socket says 172.21.15.142:36882) 2023-09-30T22:54:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8aae7fc700 1 -- 172.21.15.142:0/3581763741 learned_addr learned my addr 172.21.15.142:0/3581763741 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:51.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8aaeffd700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 0x7f8ab00adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238220671 0 0) 0x7f8ab00ad630 con 0x7f8ab00b1950 2023-09-30T22:54:51.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.859+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a98003570 con 0x7f8ab00b1950 2023-09-30T22:54:51.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377776785 0 0) 0x7f8ab00b3360 con 0x7f8ab00ae000 2023-09-30T22:54:51.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab00ad630 con 0x7f8ab00ae000 2023-09-30T22:54:51.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2758147281 0 0) 0x7f8a98003570 con 0x7f8ab00b1950 2023-09-30T22:54:51.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 msgr2=0x7f8ab00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 0x7f8ab00adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 >> v1:172.21.15.148:6789/0 conn(0x7f8ab00ae000 legacy=0x7f8ab006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab015ad60 con 0x7f8ab00b1950 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f8aa4001470 con 0x7f8ab00b1950 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 >> v1:172.21.15.142:6789/0 conn(0x7f8ab00b1950 legacy=0x7f8ab015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 0x7f8a98003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98004180 0x7f8a98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a98004d50 0x7f8a980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0157c20 con 0x7f8a98004d50 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9800bba0 con 0x7f8a98004180 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9800bd60 con 0x7f8ab00b1580 2023-09-30T22:54:51.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aaeffd700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 0x7f8a98003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aae7fc700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98004180 0x7f8a98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.860+0000 7f8aaf7fe700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a98004d50 0x7f8a980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aaeffd700 1 -- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98004180 msgr2=0x7f8a98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aaeffd700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98004180 0x7f8a98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aaeffd700 1 -- 172.21.15.142:0/3581763741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a98004d50 msgr2=0x7f8a980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aaeffd700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a98004d50 0x7f8a980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aaeffd700 1 -- 172.21.15.142:0/3581763741 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a98003570 con 0x7f8ab00b1580 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aaf7fe700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a98004d50 0x7f8a980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aaeffd700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 0x7f8a98003c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009c00 tx=0x7f8aa00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42bf07368bea4451 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000e710 con 0x7f8ab00b1580 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa000e870 con 0x7f8ab00b1580 2023-09-30T22:54:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.861+0000 7f8aadffb700 1 -- 172.21.15.142:0/3581763741 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000ec30 con 0x7f8ab00b1580 2023-09-30T22:54:51.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.862+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 msgr2=0x7f8a98003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.862+0000 7f8ab59ff700 1 --2- 172.21.15.142:0/3581763741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00b1580 0x7f8a98003c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009c00 tx=0x7f8aa00091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.862+0000 7f8aaf7fe700 1 -- 172.21.15.142:0/3581763741 reap_dead start 2023-09-30T22:54:51.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.862+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3581763741 shutdown_connections 2023-09-30T22:54:51.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.862+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3581763741 >> 172.21.15.142:0/3581763741 conn(0x7f8ab00ce1f0 msgr2=0x7f8ab0069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:51.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.862+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3581763741 shutdown_connections 2023-09-30T22:54:51.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.862+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3581763741 wait complete. 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.863+0000 7f8ab59ff700 1 Processor -- start 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.863+0000 7f8ab59ff700 1 -- start start 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.864+0000 7f8ab59ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ab00b1580 0x7f8ab015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.864+0000 7f8ab59ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00ccd20 0x7f8ab0067620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.864+0000 7f8ab59ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab00cd190 0x7f8ab0067b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.864+0000 7f8ab59ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab016a730 con 0x7f8ab00cd190 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.864+0000 7f8ab59ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab016aa10 con 0x7f8ab00b1580 2023-09-30T22:54:51.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.864+0000 7f8ab59ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab016acf0 con 0x7f8ab00ccd20 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab00cd190 0x7f8ab0067b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab00cd190 0x7f8ab0067b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59168/0 (socket says 172.21.15.142:59168) 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 -- 172.21.15.142:0/3269267381 learned_addr learned my addr 172.21.15.142:0/3269267381 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 -- 172.21.15.142:0/3269267381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00ccd20 msgr2=0x7f8ab0067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00ccd20 0x7f8ab0067620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 -- 172.21.15.142:0/3269267381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ab00b1580 msgr2=0x7f8ab015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ab00b1580 0x7f8ab015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 -- 172.21.15.142:0/3269267381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab016afd0 con 0x7f8ab00cd190 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8aaf7fe700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab00cd190 0x7f8ab0067b60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00aeb00 tx=0x7f8aa80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8a96ffd700 1 -- 172.21.15.142:0/3269267381 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800cc10 con 0x7f8ab00cd190 2023-09-30T22:54:51.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8a96ffd700 1 -- 172.21.15.142:0/3269267381 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa800cd90 con 0x7f8ab00cd190 2023-09-30T22:54:51.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab015a9e0 con 0x7f8ab00cd190 2023-09-30T22:54:51.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8a96ffd700 1 -- 172.21.15.142:0/3269267381 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8006df0 con 0x7f8ab00cd190 2023-09-30T22:54:51.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.865+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab016d8e0 con 0x7f8ab00cd190 2023-09-30T22:54:51.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.867+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab006d600 con 0x7f8ab00cd190 2023-09-30T22:54:51.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.867+0000 7f8a96ffd700 1 -- 172.21.15.142:0/3269267381 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8aa8015640 con 0x7f8ab00cd190 2023-09-30T22:54:51.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.869+0000 7f8a96ffd700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8a9c067330 0x7f8a9c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:51.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.869+0000 7f8a96ffd700 1 -- 172.21.15.142:0/3269267381 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f8aa8084cf0 con 0x7f8ab00cd190 2023-09-30T22:54:51.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.869+0000 7f8aaeffd700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8a9c067330 0x7f8a9c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:51.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.869+0000 7f8aaeffd700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8a9c067330 0x7f8a9c0697e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009c00 tx=0x7f8aa001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:51.873+0000 7f8a96ffd700 1 -- 172.21.15.142:0/3269267381 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8aa8089070 con 0x7f8ab00cd190 2023-09-30T22:54:52.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.101+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ab016b160 con 0x7f8ab00cd190 2023-09-30T22:54:52.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.102+0000 7f8a96ffd700 1 -- 172.21.15.142:0/3269267381 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8aa801b070 con 0x7f8ab00cd190 2023-09-30T22:54:52.103 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:52.104 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:54:06.742392+0000","modified":"2023-09-30T22:54:10.296515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2473569695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2473569695},{"type":"v1","addr":"172.21.15.142:6837","nonce":2473569695}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8a9c067330 msgr2=0x7f8a9c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8a9c067330 0x7f8a9c0697e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009c00 tx=0x7f8aa001a000 comp rx=0 tx=0).stop 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab00cd190 msgr2=0x7f8ab0067b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab00cd190 0x7f8ab0067b60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00aeb00 tx=0x7f8aa80017a0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 shutdown_connections 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8a9c067330 0x7f8a9c0697e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ab00cd190 0x7f8ab0067b60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ab00b1580 0x7f8ab015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 --2- 172.21.15.142:0/3269267381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ab00ccd20 0x7f8ab0067620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.104+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 >> 172.21.15.142:0/3269267381 conn(0x7f8ab00ce1f0 msgr2=0x7f8ab00687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:52.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.105+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 shutdown_connections 2023-09-30T22:54:52.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.105+0000 7f8ab59ff700 1 -- 172.21.15.142:0/3269267381 wait complete. 2023-09-30T22:54:52.107 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-30T22:54:52.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:54:52.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.312+0000 7f43befff700 1 Processor -- start 2023-09-30T22:54:52.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.313+0000 7f43befff700 1 -- start start 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43befff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43b81598e0 0x7f43b8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43befff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b80cee50 0x7f43b80d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43befff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80cff40 con 0x7f43b806b1c0 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43befff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80d0910 con 0x7f43b81598e0 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43befff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80cf330 con 0x7f43b80cee50 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43bcd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43b81598e0 0x7f43b8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43bcd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43b81598e0 0x7f43b8159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59176/0 (socket says 172.21.15.142:59176) 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43bcd9b700 1 -- 172.21.15.142:0/52876952 learned_addr learned my addr 172.21.15.142:0/52876952 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43bd59c700 1 --1- 172.21.15.142:0/52876952 >> v1:172.21.15.142:6789/0 conn(0x7f43b806b1c0 0x7f43b815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36886/0 (socket says 172.21.15.142:36886) 2023-09-30T22:54:52.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.314+0000 7f43b7fff700 1 --2- 172.21.15.142:0/52876952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b80cee50 0x7f43b80d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43bcd9b700 1 -- 172.21.15.142:0/52876952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b80cee50 msgr2=0x7f43b80d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:52.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43bcd9b700 1 --2- 172.21.15.142:0/52876952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b80cee50 0x7f43b80d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43bcd9b700 1 -- 172.21.15.142:0/52876952 >> v1:172.21.15.142:6789/0 conn(0x7f43b806b1c0 legacy=0x7f43b815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43bcd9b700 1 -- 172.21.15.142:0/52876952 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80cf610 con 0x7f43b81598e0 2023-09-30T22:54:52.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43bcd9b700 1 --2- 172.21.15.142:0/52876952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b81598e0 0x7f43b8159cb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0099b0 tx=0x7f43ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c98257ebf3bee5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43b77fe700 1 -- 172.21.15.142:0/52876952 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac009ea0 con 0x7f43b81598e0 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43b77fe700 1 -- 172.21.15.142:0/52876952 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00b860 con 0x7f43b81598e0 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.315+0000 7f43b77fe700 1 -- 172.21.15.142:0/52876952 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00bc00 con 0x7f43b81598e0 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 -- 172.21.15.142:0/52876952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b81598e0 msgr2=0x7f43b8159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 --2- 172.21.15.142:0/52876952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b81598e0 0x7f43b8159cb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0099b0 tx=0x7f43ac009250 comp rx=0 tx=0).stop 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 -- 172.21.15.142:0/52876952 shutdown_connections 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 --2- 172.21.15.142:0/52876952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b81598e0 0x7f43b8159cb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 --2- 172.21.15.142:0/52876952 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b80cee50 0x7f43b80d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 -- 172.21.15.142:0/52876952 >> 172.21.15.142:0/52876952 conn(0x7f43b80cd540 msgr2=0x7f43b80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:52.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 -- 172.21.15.142:0/52876952 shutdown_connections 2023-09-30T22:54:52.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.316+0000 7f43befff700 1 -- 172.21.15.142:0/52876952 wait complete. 2023-09-30T22:54:52.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.317+0000 7f43befff700 1 Processor -- start 2023-09-30T22:54:52.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.318+0000 7f43befff700 1 -- start start 2023-09-30T22:54:52.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43befff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b806b1c0 0x7f43b80c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43befff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b80cee50 0x7f43b8147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43befff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b81598e0 0x7f43b81480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43befff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b815b470 con 0x7f43b806b1c0 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43befff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b816e700 con 0x7f43b80cee50 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43befff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b815b6c0 con 0x7f43b81598e0 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b806b1c0 0x7f43b80c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b806b1c0 0x7f43b80c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59182/0 (socket says 172.21.15.142:59182) 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 -- 172.21.15.142:0/1662532016 learned_addr learned my addr 172.21.15.142:0/1662532016 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:52.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43b7fff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b80cee50 0x7f43b8147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bd59c700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b81598e0 0x7f43b81480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 -- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b81598e0 msgr2=0x7f43b81480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b81598e0 0x7f43b81480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 -- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b80cee50 msgr2=0x7f43b8147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b80cee50 0x7f43b8147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.319+0000 7f43bcd9b700 1 -- 172.21.15.142:0/1662532016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0094f0 con 0x7f43b806b1c0 2023-09-30T22:54:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.320+0000 7f43bcd9b700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b806b1c0 0x7f43b80c7dd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f43b80ce0a0 tx=0x7f43ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:52.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.320+0000 7f43b4ff9700 1 -- 172.21.15.142:0/1662532016 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac000d10 con 0x7f43b806b1c0 2023-09-30T22:54:52.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.320+0000 7f43b4ff9700 1 -- 172.21.15.142:0/1662532016 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00bbe0 con 0x7f43b806b1c0 2023-09-30T22:54:52.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.320+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b815b9a0 con 0x7f43b806b1c0 2023-09-30T22:54:52.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.320+0000 7f43b4ff9700 1 -- 172.21.15.142:0/1662532016 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac011670 con 0x7f43b806b1c0 2023-09-30T22:54:52.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.320+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b80c8310 con 0x7f43b806b1c0 2023-09-30T22:54:52.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.321+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b80697b0 con 0x7f43b806b1c0 2023-09-30T22:54:52.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.322+0000 7f43b4ff9700 1 -- 172.21.15.142:0/1662532016 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f43ac011aa0 con 0x7f43b806b1c0 2023-09-30T22:54:52.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.323+0000 7f43b4ff9700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f439c067330 0x7f439c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.323+0000 7f43b4ff9700 1 -- 172.21.15.142:0/1662532016 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f43ac086410 con 0x7f43b806b1c0 2023-09-30T22:54:52.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.323+0000 7f43b7fff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f439c067330 0x7f439c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.324+0000 7f43b7fff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f439c067330 0x7f439c0697e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f43b81588d0 tx=0x7f43a40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:52.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.327+0000 7f43b4ff9700 1 -- 172.21.15.142:0/1662532016 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f43ac053250 con 0x7f43b806b1c0 2023-09-30T22:54:52.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.518+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43b806fc10 con 0x7f43b806b1c0 2023-09-30T22:54:52.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.519+0000 7f43b4ff9700 1 -- 172.21.15.142:0/1662532016 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17059 (secure 0 0 0) 0x7f43ac056870 con 0x7f43b806b1c0 2023-09-30T22:54:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:52.521 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":61,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:54:43.277751+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:54:04.395113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T22:54:05.729484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2b","mappings":[{"from":2,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:54:52.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.521+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f439c067330 msgr2=0x7f439c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.521+0000 7f43befff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f439c067330 0x7f439c0697e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f43b81588d0 tx=0x7f43a40091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.521+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b806b1c0 msgr2=0x7f43b80c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.521+0000 7f43befff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b806b1c0 0x7f43b80c7dd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f43b80ce0a0 tx=0x7f43ac017000 comp rx=0 tx=0).stop 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 shutdown_connections 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f439c067330 0x7f439c0697e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43b81598e0 0x7f43b81480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43b806b1c0 0x7f43b80c7dd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 --2- 172.21.15.142:0/1662532016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43b80cee50 0x7f43b8147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 >> 172.21.15.142:0/1662532016 conn(0x7f43b80cd540 msgr2=0x7f43b806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 shutdown_connections 2023-09-30T22:54:52.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.522+0000 7f43befff700 1 -- 172.21.15.142:0/1662532016 wait complete. 2023-09-30T22:54:52.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:54:52.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.729+0000 7f84605ff700 1 Processor -- start 2023-09-30T22:54:52.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.730+0000 7f84605ff700 1 -- start start 2023-09-30T22:54:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.731+0000 7f84605ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f845815a010 0x7f845806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.731+0000 7f84605ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84580b0ee0 con 0x7f8458159b90 2023-09-30T22:54:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.731+0000 7f84605ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845806f360 con 0x7f84580aebf0 2023-09-30T22:54:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.731+0000 7f84605ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84580aefc0 con 0x7f845815a010 2023-09-30T22:54:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.731+0000 7f845db9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8458159b90 0x7f8458069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36890/0 (socket says 172.21.15.142:36890) 2023-09-30T22:54:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.731+0000 7f845db9a700 1 -- 172.21.15.142:0/354415660 learned_addr learned my addr 172.21.15.142:0/354415660 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845eb9c700 1 --2- 172.21.15.142:0/354415660 >> v2:172.21.15.148:3300/0 conn(0x7f845815a010 0x7f845806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524626073 0 0) 0x7f84580b0ee0 con 0x7f8458159b90 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8444003570 con 0x7f8458159b90 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939907854 0 0) 0x7f8444003570 con 0x7f8458159b90 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 >> v2:172.21.15.148:3300/0 conn(0x7f845815a010 msgr2=0x7f845806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 --2- 172.21.15.142:0/354415660 >> v2:172.21.15.148:3300/0 conn(0x7f845815a010 0x7f845806a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 >> v1:172.21.15.148:6789/0 conn(0x7f84580aebf0 legacy=0x7f845806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580b02d0 con 0x7f8458159b90 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f8448001470 con 0x7f8458159b90 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845eb9c700 1 --2- 172.21.15.142:0/354415660 >> v2:172.21.15.148:3300/0 conn(0x7f845815a010 0x7f845806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 >> v1:172.21.15.142:6789/0 conn(0x7f8458159b90 legacy=0x7f8458069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8444003ab0 0x7f8444003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444004810 0x7f8444004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8444005210 0x7f844400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84580aefc0 con 0x7f8444005210 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844400c130 con 0x7f8444003ab0 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.732+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844400c2f0 con 0x7f8444004810 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8444005210 0x7f844400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845e39b700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8444003ab0 0x7f8444003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845db9a700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444004810 0x7f8444004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 -- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444004810 msgr2=0x7f8444004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444004810 0x7f8444004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 -- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8444003ab0 msgr2=0x7f8444003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8444003ab0 0x7f8444003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 -- 172.21.15.142:0/354415660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444003570 con 0x7f8444005210 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 -- 172.21.15.142:0/354415660 reap_dead start 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845eb9c700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8444005210 0x7f844400ba60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f845000f570 tx=0x7f845000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67676521cca5127e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000ad60 con 0x7f8444005210 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450010040 con 0x7f8444005210 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.733+0000 7f845d399700 1 -- 172.21.15.142:0/354415660 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000a0d0 con 0x7f8444005210 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.734+0000 7f84605ff700 1 -- 172.21.15.142:0/354415660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8444005210 msgr2=0x7f844400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.734+0000 7f84605ff700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8444005210 0x7f844400ba60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f845000f570 tx=0x7f845000c040 comp rx=0 tx=0).stop 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.734+0000 7f84605ff700 1 -- 172.21.15.142:0/354415660 shutdown_connections 2023-09-30T22:54:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.734+0000 7f84605ff700 1 --2- 172.21.15.142:0/354415660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8444005210 0x7f844400ba60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.734+0000 7f84605ff700 1 -- 172.21.15.142:0/354415660 >> 172.21.15.142:0/354415660 conn(0x7f84580680c0 msgr2=0x7f84580c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:52.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.734+0000 7f84605ff700 1 -- 172.21.15.142:0/354415660 shutdown_connections 2023-09-30T22:54:52.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.734+0000 7f84605ff700 1 -- 172.21.15.142:0/354415660 wait complete. 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.735+0000 7f84605ff700 1 Processor -- start 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.736+0000 7f84605ff700 1 -- start start 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.736+0000 7f84605ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444005210 0x7f8458158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.736+0000 7f84605ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84581578d0 0x7f845816a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.736+0000 7f84605ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8458150190 0x7f84580c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.736+0000 7f84605ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458159340 con 0x7f8458150190 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.736+0000 7f84605ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845816aed0 con 0x7f84581578d0 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.736+0000 7f84605ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8458158970 con 0x7f8444005210 2023-09-30T22:54:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8458150190 0x7f84580c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8458150190 0x7f84580c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59190/0 (socket says 172.21.15.142:59190) 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 -- 172.21.15.142:0/402092135 learned_addr learned my addr 172.21.15.142:0/402092135 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845db9a700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84581578d0 0x7f845816a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845e39b700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444005210 0x7f8458158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 -- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444005210 msgr2=0x7f8458158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444005210 0x7f8458158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 -- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84581578d0 msgr2=0x7f845816a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84581578d0 0x7f845816a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 -- 172.21.15.142:0/402092135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845815e9f0 con 0x7f8458150190 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845db9a700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84581578d0 0x7f845816a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.737+0000 7f845eb9c700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8458150190 0x7f84580c5d90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f845000a460 tx=0x7f8450018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.738+0000 7f844e7fc700 1 -- 172.21.15.142:0/402092135 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000ad60 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.738+0000 7f844e7fc700 1 -- 172.21.15.142:0/402092135 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845001e480 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.738+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8458157d60 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.738+0000 7f844e7fc700 1 -- 172.21.15.142:0/402092135 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845001e840 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.738+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8458158320 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.739+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8458158b00 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.740+0000 7f844e7fc700 1 -- 172.21.15.142:0/402092135 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f845001ec30 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.740+0000 7f844e7fc700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f843c067330 0x7f843c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.741+0000 7f844e7fc700 1 -- 172.21.15.142:0/402092135 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f84500865a0 con 0x7f8458150190 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.741+0000 7f845e39b700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f843c067330 0x7f843c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.741+0000 7f845e39b700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f843c067330 0x7f843c0697e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8454003b10 tx=0x7f8454009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:52.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.745+0000 7f844e7fc700 1 -- 172.21.15.142:0/402092135 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f84500533e0 con 0x7f8458150190 2023-09-30T22:54:52.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.978+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f845806fc10 con 0x7f8458150190 2023-09-30T22:54:52.980 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:54:52.979+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:54:52.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.985+0000 7f844e7fc700 1 -- 172.21.15.142:0/402092135 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8450056a00 con 0x7f8458150190 2023-09-30T22:54:52.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.987+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f843c067330 msgr2=0x7f843c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.987+0000 7f84605ff700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f843c067330 0x7f843c0697e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8454003b10 tx=0x7f8454009040 comp rx=0 tx=0).stop 2023-09-30T22:54:52.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.987+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8458150190 msgr2=0x7f84580c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:52.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.987+0000 7f84605ff700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8458150190 0x7f84580c5d90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f845000a460 tx=0x7f8450018000 comp rx=0 tx=0).stop 2023-09-30T22:54:52.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 shutdown_connections 2023-09-30T22:54:52.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f843c067330 0x7f843c0697e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8458150190 0x7f84580c5d90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8444005210 0x7f8458158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 --2- 172.21.15.142:0/402092135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84581578d0 0x7f845816a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:52.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 >> 172.21.15.142:0/402092135 conn(0x7f84580680c0 msgr2=0x7f84580cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:52.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 shutdown_connections 2023-09-30T22:54:52.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:52.988+0000 7f84605ff700 1 -- 172.21.15.142:0/402092135 wait complete. 2023-09-30T22:54:52.991 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:54:52.996 INFO:tasks.ceph.mds.a.smithi142.stderr: -9363> 2023-09-30T22:54:12.739+0000 7fb5da3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:54:53.007 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:54:53.047 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:54:53.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.199+0000 7f89e7fff700 1 Processor -- start 2023-09-30T22:54:53.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.199+0000 7f89e7fff700 1 -- start start 2023-09-30T22:54:53.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89e0159ba0 0x7f89e006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:53.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89e00b0de0 0x7f89e00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:53.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e7fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e0067d10 con 0x7f89e00ca410 2023-09-30T22:54:53.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e7fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e00ca820 con 0x7f89e0159ba0 2023-09-30T22:54:53.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e7fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e006af90 con 0x7f89e00b0de0 2023-09-30T22:54:53.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89e0159ba0 0x7f89e006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89e0159ba0 0x7f89e006a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59224/0 (socket says 172.21.15.142:59224) 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e5d9b700 1 -- 172.21.15.142:0/2497038913 learned_addr learned my addr 172.21.15.142:0/2497038913 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e559a700 1 --2- 172.21.15.142:0/2497038913 >> v2:172.21.15.148:3300/0 conn(0x7f89e00b0de0 0x7f89e00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e5d9b700 1 -- 172.21.15.142:0/2497038913 >> v2:172.21.15.148:3300/0 conn(0x7f89e00b0de0 msgr2=0x7f89e00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e5d9b700 1 --2- 172.21.15.142:0/2497038913 >> v2:172.21.15.148:3300/0 conn(0x7f89e00b0de0 0x7f89e00c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e5d9b700 1 -- 172.21.15.142:0/2497038913 >> v1:172.21.15.148:6789/0 conn(0x7f89e00ca410 legacy=0x7f89e015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.201+0000 7f89e5d9b700 1 -- 172.21.15.142:0/2497038913 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00676c0 con 0x7f89e0159ba0 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.202+0000 7f89e5d9b700 1 --2- 172.21.15.142:0/2497038913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e0159ba0 0x7f89e006a8d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f89e006efd0 tx=0x7f89dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9633abcfdbdfcea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.202+0000 7f89e4d99700 1 -- 172.21.15.142:0/2497038913 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc009e70 con 0x7f89e0159ba0 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.202+0000 7f89e4d99700 1 -- 172.21.15.142:0/2497038913 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc00b860 con 0x7f89e0159ba0 2023-09-30T22:54:53.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.202+0000 7f89e4d99700 1 -- 172.21.15.142:0/2497038913 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00bc00 con 0x7f89e0159ba0 2023-09-30T22:54:53.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.202+0000 7f89e7fff700 1 -- 172.21.15.142:0/2497038913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e0159ba0 msgr2=0x7f89e006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:53.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.202+0000 7f89e7fff700 1 --2- 172.21.15.142:0/2497038913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e0159ba0 0x7f89e006a8d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f89e006efd0 tx=0x7f89dc009250 comp rx=0 tx=0).stop 2023-09-30T22:54:53.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.203+0000 7f89e7fff700 1 -- 172.21.15.142:0/2497038913 shutdown_connections 2023-09-30T22:54:53.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.203+0000 7f89e7fff700 1 --2- 172.21.15.142:0/2497038913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e0159ba0 0x7f89e006a8d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.203+0000 7f89e7fff700 1 --2- 172.21.15.142:0/2497038913 >> v2:172.21.15.148:3300/0 conn(0x7f89e00b0de0 0x7f89e00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.203+0000 7f89e7fff700 1 -- 172.21.15.142:0/2497038913 >> 172.21.15.142:0/2497038913 conn(0x7f89e00cb2f0 msgr2=0x7f89e00cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:53.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.203+0000 7f89e7fff700 1 -- 172.21.15.142:0/2497038913 shutdown_connections 2023-09-30T22:54:53.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.203+0000 7f89e7fff700 1 -- 172.21.15.142:0/2497038913 wait complete. 2023-09-30T22:54:53.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.205+0000 7f89e7fff700 1 Processor -- start 2023-09-30T22:54:53.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.205+0000 7f89e7fff700 1 -- start start 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89e00b0de0 0x7f89e0149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e00ca410 0x7f89e015b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e0159ba0 0x7f89e015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00c20d0 con 0x7f89e00ca410 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e7fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e015ae30 con 0x7f89e0159ba0 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e7fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e015b110 con 0x7f89e00b0de0 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e00ca410 0x7f89e015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e00ca410 0x7f89e015b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59234/0 (socket says 172.21.15.142:59234) 2023-09-30T22:54:53.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e559a700 1 -- 172.21.15.142:0/170170911 learned_addr learned my addr 172.21.15.142:0/170170911 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.206+0000 7f89e5d9b700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89e00b0de0 0x7f89e0149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e659c700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e0159ba0 0x7f89e015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e559a700 1 -- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89e00b0de0 msgr2=0x7f89e0149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e559a700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89e00b0de0 0x7f89e0149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e559a700 1 -- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e0159ba0 msgr2=0x7f89e015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e559a700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e0159ba0 0x7f89e015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e559a700 1 -- 172.21.15.142:0/170170911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0094f0 con 0x7f89e00ca410 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e659c700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e0159ba0 0x7f89e015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e559a700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e00ca410 0x7f89e015b570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f89d000ec80 tx=0x7f89d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89d5ffb700 1 -- 172.21.15.142:0/170170911 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000c850 con 0x7f89e00ca410 2023-09-30T22:54:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89d5ffb700 1 -- 172.21.15.142:0/170170911 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d000c9b0 con 0x7f89e00ca410 2023-09-30T22:54:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e00c2320 con 0x7f89e00ca410 2023-09-30T22:54:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89d5ffb700 1 -- 172.21.15.142:0/170170911 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000cd50 con 0x7f89e00ca410 2023-09-30T22:54:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.207+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e014a070 con 0x7f89e00ca410 2023-09-30T22:54:53.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.208+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e006e4b0 con 0x7f89e00ca410 2023-09-30T22:54:53.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.209+0000 7f89d5ffb700 1 -- 172.21.15.142:0/170170911 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f89d0013680 con 0x7f89e00ca410 2023-09-30T22:54:53.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.210+0000 7f89d5ffb700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89c4067330 0x7f89c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:53.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.211+0000 7f89d5ffb700 1 -- 172.21.15.142:0/170170911 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f89d0084ea0 con 0x7f89e00ca410 2023-09-30T22:54:53.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.211+0000 7f89e5d9b700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89c4067330 0x7f89c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:53.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.211+0000 7f89e5d9b700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89c4067330 0x7f89c40697e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89e006efd0 tx=0x7f89dc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:53.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.215+0000 7f89d5ffb700 1 -- 172.21.15.142:0/170170911 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f89d0051d30 con 0x7f89e00ca410 2023-09-30T22:54:53.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.447+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f89e00679a0 con 0x7f89e00ca410 2023-09-30T22:54:53.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.985+0000 7f89d5ffb700 1 -- 172.21.15.142:0/170170911 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f89d0055350 con 0x7f89e00ca410 2023-09-30T22:54:53.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89c4067330 msgr2=0x7f89c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:53.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89c4067330 0x7f89c40697e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89e006efd0 tx=0x7f89dc017000 comp rx=0 tx=0).stop 2023-09-30T22:54:53.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e00ca410 msgr2=0x7f89e015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:53.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e00ca410 0x7f89e015b570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f89d000ec80 tx=0x7f89d00091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 shutdown_connections 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89c4067330 0x7f89c40697e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e0159ba0 0x7f89e015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89e00b0de0 0x7f89e0149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 --2- 172.21.15.142:0/170170911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89e00ca410 0x7f89e015b570 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 >> 172.21.15.142:0/170170911 conn(0x7f89e00cb2f0 msgr2=0x7f89e00cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 shutdown_connections 2023-09-30T22:54:53.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:53.988+0000 7f89e7fff700 1 -- 172.21.15.142:0/170170911 wait complete. 2023-09-30T22:54:54.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:54:54.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.242+0000 7fa1149ff700 1 Processor -- start 2023-09-30T22:54:54.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.242+0000 7fa1149ff700 1 -- start start 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.243+0000 7fa1149ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa1100ca240 0x7fa1100c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.243+0000 7fa1149ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa110157830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.243+0000 7fa1149ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100c5970 con 0x7fa110157000 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.243+0000 7fa1149ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1100c7d60 con 0x7fa1100ca240 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.243+0000 7fa1149ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100c5320 con 0x7fa1101573d0 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa110157000 0x7fa1100c3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36898/0 (socket says 172.21.15.142:36898) 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10e59c700 1 -- 172.21.15.142:0/2166919401 learned_addr learned my addr 172.21.15.142:0/2166919401 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10dd9b700 1 --2- 172.21.15.142:0/2166919401 >> v2:172.21.15.142:3300/0 conn(0x7fa1100ca240 0x7fa1100c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10d59a700 1 -- 172.21.15.142:0/2166919401 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966180042 0 0) 0x7fa1100c5970 con 0x7fa110157000 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10ed9d700 1 --2- 172.21.15.142:0/2166919401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa110157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10d59a700 1 -- 172.21.15.142:0/2166919401 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f8003570 con 0x7fa110157000 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10dd9b700 1 -- 172.21.15.142:0/2166919401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 msgr2=0x7fa110157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10dd9b700 1 --2- 172.21.15.142:0/2166919401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa110157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10dd9b700 1 -- 172.21.15.142:0/2166919401 >> v1:172.21.15.142:6789/0 conn(0x7fa110157000 legacy=0x7fa1100c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.244+0000 7fa10dd9b700 1 -- 172.21.15.142:0/2166919401 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100c5600 con 0x7fa1100ca240 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa10dd9b700 1 --2- 172.21.15.142:0/2166919401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa1100c76c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa1040098e0 tx=0x7fa1040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac3e882bc9cfe72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa10d59a700 1 -- 172.21.15.142:0/2166919401 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10400b640 con 0x7fa1100ca240 2023-09-30T22:54:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa10d59a700 1 -- 172.21.15.142:0/2166919401 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10400b7a0 con 0x7fa1100ca240 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa10d59a700 1 -- 172.21.15.142:0/2166919401 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10400bb40 con 0x7fa1100ca240 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa1149ff700 1 -- 172.21.15.142:0/2166919401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 msgr2=0x7fa1100c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa1149ff700 1 --2- 172.21.15.142:0/2166919401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa1100c76c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa1040098e0 tx=0x7fa1040091a0 comp rx=0 tx=0).stop 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa1149ff700 1 -- 172.21.15.142:0/2166919401 shutdown_connections 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa1149ff700 1 --2- 172.21.15.142:0/2166919401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa110157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa1149ff700 1 --2- 172.21.15.142:0/2166919401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa1100c76c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa1149ff700 1 -- 172.21.15.142:0/2166919401 >> 172.21.15.142:0/2166919401 conn(0x7fa1100cc670 msgr2=0x7fa1100cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.245+0000 7fa1149ff700 1 -- 172.21.15.142:0/2166919401 shutdown_connections 2023-09-30T22:54:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.246+0000 7fa1149ff700 1 -- 172.21.15.142:0/2166919401 wait complete. 2023-09-30T22:54:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.247+0000 7fa1149ff700 1 Processor -- start 2023-09-30T22:54:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.247+0000 7fa1149ff700 1 -- start start 2023-09-30T22:54:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa1149ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa110159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa1149ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa110157000 0x7fa110166a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa1149ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa1100c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa1149ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100c16c0 con 0x7fa1100ca240 2023-09-30T22:54:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa1149ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110166fb0 con 0x7fa110157000 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa1149ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11013ffc0 con 0x7fa1101573d0 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa10e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa110159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa10e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa110159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59244/0 (socket says 172.21.15.142:59244) 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa10e59c700 1 -- 172.21.15.142:0/3235959783 learned_addr learned my addr 172.21.15.142:0/3235959783 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa10ed9d700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa1100c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.248+0000 7fa10dd9b700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa110157000 0x7fa110166a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa10e59c700 1 -- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 msgr2=0x7fa1100c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa10e59c700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa1100c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa10e59c700 1 -- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa110157000 msgr2=0x7fa110166a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa10e59c700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa110157000 0x7fa110166a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa10e59c700 1 -- 172.21.15.142:0/3235959783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104009420 con 0x7fa1100ca240 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa10e59c700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa110159650 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c7c0 tx=0x7fa100007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa0fe7fc700 1 -- 172.21.15.142:0/3235959783 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100005b30 con 0x7fa1100ca240 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa0fe7fc700 1 -- 172.21.15.142:0/3235959783 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa100005c90 con 0x7fa1100ca240 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1100c3460 con 0x7fa1100ca240 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa0fe7fc700 1 -- 172.21.15.142:0/3235959783 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100007320 con 0x7fa1100ca240 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.249+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1100c18f0 con 0x7fa1100ca240 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.250+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa110069a50 con 0x7fa1100ca240 2023-09-30T22:54:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.251+0000 7fa0fe7fc700 1 -- 172.21.15.142:0/3235959783 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa100007690 con 0x7fa1100ca240 2023-09-30T22:54:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.252+0000 7fa0fe7fc700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa0f0067330 0x7fa0f00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.252+0000 7fa0fe7fc700 1 -- 172.21.15.142:0/3235959783 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6173+0+0 (secure 0 0 0) 0x7fa1000842a0 con 0x7fa1100ca240 2023-09-30T22:54:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.252+0000 7fa10dd9b700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa0f0067330 0x7fa0f00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.253+0000 7fa10dd9b700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa0f0067330 0x7fa0f00697e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa1040093f0 tx=0x7fa104017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.256+0000 7fa0fe7fc700 1 -- 172.21.15.142:0/3235959783 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa100051090 con 0x7fa1100ca240 2023-09-30T22:54:54.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:54.452+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1101399d0 con 0x7fa1100ca240 2023-09-30T22:54:55.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.332+0000 7fa0fe7fc700 1 -- 172.21.15.142:0/3235959783 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa1000546b0 con 0x7fa1100ca240 2023-09-30T22:54:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.335+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa0f0067330 msgr2=0x7fa0f00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.335+0000 7fa1149ff700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa0f0067330 0x7fa0f00697e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa1040093f0 tx=0x7fa104017000 comp rx=0 tx=0).stop 2023-09-30T22:54:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.335+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 msgr2=0x7fa110159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.335+0000 7fa1149ff700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa110159650 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c7c0 tx=0x7fa100007e00 comp rx=0 tx=0).stop 2023-09-30T22:54:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.335+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 shutdown_connections 2023-09-30T22:54:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.336+0000 7fa1149ff700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa0f0067330 0x7fa0f00697e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.336+0000 7fa1149ff700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1101573d0 0x7fa1100c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.336+0000 7fa1149ff700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100ca240 0x7fa110159650 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.336+0000 7fa1149ff700 1 --2- 172.21.15.142:0/3235959783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa110157000 0x7fa110166a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.336+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 >> 172.21.15.142:0/3235959783 conn(0x7fa1100cc670 msgr2=0x7fa1100cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.336+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 shutdown_connections 2023-09-30T22:54:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.336+0000 7fa1149ff700 1 -- 172.21.15.142:0/3235959783 wait complete. 2023-09-30T22:54:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:54:55.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:54:55.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.553+0000 7f3ded9ff700 1 Processor -- start 2023-09-30T22:54:55.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.553+0000 7f3ded9ff700 1 -- start start 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.554+0000 7f3ded9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3de80c6240 0x7f3de80c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.554+0000 7f3ded9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3de80c40e0 0x7f3de80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3ded9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80c6a80 con 0x7f3de8141310 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3ded9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de81416e0 con 0x7f3de80c6240 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3ded9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80c4a60 con 0x7f3de80c40e0 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3de80c6240 0x7f3de80c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3de80c6240 0x7f3de80c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59256/0 (socket says 172.21.15.142:59256) 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 -- 172.21.15.142:0/3862565719 learned_addr learned my addr 172.21.15.142:0/3862565719 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de77fe700 1 --2- 172.21.15.142:0/3862565719 >> v2:172.21.15.148:3300/0 conn(0x7f3de80c40e0 0x7f3de80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:55.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 -- 172.21.15.142:0/3862565719 >> v2:172.21.15.148:3300/0 conn(0x7f3de80c40e0 msgr2=0x7f3de80c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 --2- 172.21.15.142:0/3862565719 >> v2:172.21.15.148:3300/0 conn(0x7f3de80c40e0 0x7f3de80c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 -- 172.21.15.142:0/3862565719 >> v1:172.21.15.142:6789/0 conn(0x7f3de8141310 legacy=0x7f3de8158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 -- 172.21.15.142:0/3862565719 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80c3250 con 0x7f3de80c6240 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de77fe700 1 --2- 172.21.15.142:0/3862565719 >> v2:172.21.15.148:3300/0 conn(0x7f3de80c40e0 0x7f3de80c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.555+0000 7f3de67fc700 1 --2- 172.21.15.142:0/3862565719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80c6240 0x7f3de80c7450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3de80c6df0 tx=0x7f3ddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38087bf989e53f65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3de5ffb700 1 -- 172.21.15.142:0/3862565719 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00b860 con 0x7f3de80c6240 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3de5ffb700 1 -- 172.21.15.142:0/3862565719 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc00b9c0 con 0x7f3de80c6240 2023-09-30T22:54:55.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3de5ffb700 1 -- 172.21.15.142:0/3862565719 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00bd60 con 0x7f3de80c6240 2023-09-30T22:54:55.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3862565719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80c6240 msgr2=0x7f3de80c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:55.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3862565719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80c6240 0x7f3de80c7450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3de80c6df0 tx=0x7f3ddc009250 comp rx=0 tx=0).stop 2023-09-30T22:54:55.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3862565719 shutdown_connections 2023-09-30T22:54:55.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3862565719 >> v2:172.21.15.148:3300/0 conn(0x7f3de80c40e0 0x7f3de80c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3862565719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80c6240 0x7f3de80c7450 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3862565719 >> 172.21.15.142:0/3862565719 conn(0x7f3de80cc670 msgr2=0x7f3de80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:55.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3862565719 shutdown_connections 2023-09-30T22:54:55.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.556+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3862565719 wait complete. 2023-09-30T22:54:55.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.558+0000 7f3ded9ff700 1 Processor -- start 2023-09-30T22:54:55.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.558+0000 7f3ded9ff700 1 -- start start 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3ded9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de80c40e0 0x7f3de8155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3ded9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3de80c6240 0x7f3de8156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3ded9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de8141310 0x7f3de816a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3ded9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81576a0 con 0x7f3de8141310 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3ded9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8156a90 con 0x7f3de80c40e0 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3ded9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8156d70 con 0x7f3de80c6240 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3de77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de8141310 0x7f3de816a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3de77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de8141310 0x7f3de816a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59266/0 (socket says 172.21.15.142:59266) 2023-09-30T22:54:55.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3de77fe700 1 -- 172.21.15.142:0/3349306977 learned_addr learned my addr 172.21.15.142:0/3349306977 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3de6ffd700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de80c40e0 0x7f3de8155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.559+0000 7f3de67fc700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3de80c6240 0x7f3de8156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3de77fe700 1 -- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3de80c6240 msgr2=0x7f3de8156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3de77fe700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3de80c6240 0x7f3de8156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3de77fe700 1 -- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de80c40e0 msgr2=0x7f3de8155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3de77fe700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de80c40e0 0x7f3de8155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3de77fe700 1 -- 172.21.15.142:0/3349306977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0094f0 con 0x7f3de8141310 2023-09-30T22:54:55.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3de77fe700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de8141310 0x7f3de816a4c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3de000d180 tx=0x7f3de0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:55.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3dceffd700 1 -- 172.21.15.142:0/3349306977 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000dd70 con 0x7f3de8141310 2023-09-30T22:54:55.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3dceffd700 1 -- 172.21.15.142:0/3349306977 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000f040 con 0x7f3de8141310 2023-09-30T22:54:55.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3dceffd700 1 -- 172.21.15.142:0/3349306977 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0015690 con 0x7f3de8141310 2023-09-30T22:54:55.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de8157050 con 0x7f3de8141310 2023-09-30T22:54:55.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.560+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de81567a0 con 0x7f3de8141310 2023-09-30T22:54:55.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.561+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de8069a50 con 0x7f3de8141310 2023-09-30T22:54:55.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.562+0000 7f3dceffd700 1 -- 172.21.15.142:0/3349306977 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3de001e3b0 con 0x7f3de8141310 2023-09-30T22:54:55.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.563+0000 7f3dceffd700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3dd4067330 0x7f3dd40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:55.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.563+0000 7f3dceffd700 1 -- 172.21.15.142:0/3349306977 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5735+0+0 (secure 0 0 0) 0x7f3de0084ff0 con 0x7f3de8141310 2023-09-30T22:54:55.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.563+0000 7f3de6ffd700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3dd4067330 0x7f3dd40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:55.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.564+0000 7f3de6ffd700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3dd4067330 0x7f3dd40697e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80039e0 tx=0x7f3dd8007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:55.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.568+0000 7f3dceffd700 1 -- 172.21.15.142:0/3349306977 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3de0051ff0 con 0x7f3de8141310 2023-09-30T22:54:55.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:55.757+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3de806fc10 con 0x7f3de8141310 2023-09-30T22:54:56.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.338+0000 7f3dceffd700 1 -- 172.21.15.142:0/3349306977 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3de0055610 con 0x7f3de8141310 2023-09-30T22:54:56.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3dd4067330 msgr2=0x7f3dd40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3dd4067330 0x7f3dd40697e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80039e0 tx=0x7f3dd8007ec0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de8141310 msgr2=0x7f3de816a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de8141310 0x7f3de816a4c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3de000d180 tx=0x7f3de0009a50 comp rx=0 tx=0).stop 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 shutdown_connections 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3dd4067330 0x7f3dd40697e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de8141310 0x7f3de816a4c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de80c40e0 0x7f3de8155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 --2- 172.21.15.142:0/3349306977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3de80c6240 0x7f3de8156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 >> 172.21.15.142:0/3349306977 conn(0x7f3de80cc670 msgr2=0x7f3de815a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 shutdown_connections 2023-09-30T22:54:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.342+0000 7f3ded9ff700 1 -- 172.21.15.142:0/3349306977 wait complete. 2023-09-30T22:54:56.345 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:54:56.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T22:54:56.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.559+0000 7f28fdbff700 1 Processor -- start 2023-09-30T22:54:56.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.559+0000 7f28fdbff700 1 -- start start 2023-09-30T22:54:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28fdbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 0x7f28f806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28fdbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f8067d10 con 0x7f28f80b0de0 2023-09-30T22:54:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28fdbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f806af90 con 0x7f28f80ca5e0 2023-09-30T22:54:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28fdbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80676c0 con 0x7f28f8159ba0 2023-09-30T22:54:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28f6ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f28f80b0de0 0x7f28f80c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36908/0 (socket says 172.21.15.142:36908) 2023-09-30T22:54:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28f6ffd700 1 -- 172.21.15.142:0/2041007730 learned_addr learned my addr 172.21.15.142:0/2041007730 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28f77fe700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 0x7f28f806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991541495 0 0) 0x7f28f8067d10 con 0x7f28f80b0de0 2023-09-30T22:54:56.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.561+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e0003570 con 0x7f28f80b0de0 2023-09-30T22:54:56.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 399928472 0 0) 0x7f28e0003570 con 0x7f28f80b0de0 2023-09-30T22:54:56.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 msgr2=0x7f28f806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 0x7f28f806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 >> v1:172.21.15.148:6789/0 conn(0x7f28f80ca5e0 legacy=0x7f28f80681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80679a0 con 0x7f28f80b0de0 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f28ec001470 con 0x7f28f80b0de0 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 >> v1:172.21.15.142:6789/0 conn(0x7f28f80b0de0 legacy=0x7f28f80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003a90 0x7f28e0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 0x7f28e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e0004d50 0x7f28e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80676c0 con 0x7f28e0004d50 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e000bb40 con 0x7f28e0003a90 2023-09-30T22:54:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e000bd00 con 0x7f28f8159ba0 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f77fe700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003a90 0x7f28e0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f7fff700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e0004d50 0x7f28e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.562+0000 7f28f6ffd700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 0x7f28e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f7fff700 1 -- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 msgr2=0x7f28e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f7fff700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8159ba0 0x7f28e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f7fff700 1 -- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003a90 msgr2=0x7f28e0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f7fff700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003a90 0x7f28e0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f7fff700 1 -- 172.21.15.142:0/2041007730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0003570 con 0x7f28e0004d50 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f77fe700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003a90 0x7f28e0003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f7fff700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e0004d50 0x7f28e00051c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f28f0002070 tx=0x7f28f00016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3be8165b14c032c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00019e0 con 0x7f28e0004d50 2023-09-30T22:54:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000c8b0 con 0x7f28e0004d50 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f67fc700 1 -- 172.21.15.142:0/2041007730 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000cc50 con 0x7f28e0004d50 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28fdbff700 1 -- 172.21.15.142:0/2041007730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e0004d50 msgr2=0x7f28e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28fdbff700 1 --2- 172.21.15.142:0/2041007730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e0004d50 0x7f28e00051c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f28f0002070 tx=0x7f28f00016d0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.563+0000 7f28f7fff700 1 -- 172.21.15.142:0/2041007730 reap_dead start 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.564+0000 7f28fdbff700 1 -- 172.21.15.142:0/2041007730 shutdown_connections 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.564+0000 7f28fdbff700 1 -- 172.21.15.142:0/2041007730 >> 172.21.15.142:0/2041007730 conn(0x7f28f80cb2f0 msgr2=0x7f28f80cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.564+0000 7f28fdbff700 1 -- 172.21.15.142:0/2041007730 shutdown_connections 2023-09-30T22:54:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.564+0000 7f28fdbff700 1 -- 172.21.15.142:0/2041007730 wait complete. 2023-09-30T22:54:56.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.565+0000 7f28fdbff700 1 Processor -- start 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.565+0000 7f28fdbff700 1 -- start start 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28fdbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28e0004d50 0x7f28f815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28fdbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8145940 0x7f28f80c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28fdbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f8159f70 0x7f28f816d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28fdbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80c2a20 con 0x7f28f8145940 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28fdbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80c5210 con 0x7f28f8159f70 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28fdbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80c5490 con 0x7f28e0004d50 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28f6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8145940 0x7f28f80c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28f6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8145940 0x7f28f80c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59286/0 (socket says 172.21.15.142:59286) 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.566+0000 7f28f6ffd700 1 -- 172.21.15.142:0/3545875133 learned_addr learned my addr 172.21.15.142:0/3545875133 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f7fff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f8159f70 0x7f28f816d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f77fe700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28e0004d50 0x7f28f815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f6ffd700 1 -- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28e0004d50 msgr2=0x7f28f815e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f6ffd700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28e0004d50 0x7f28f815e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f6ffd700 1 -- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f8159f70 msgr2=0x7f28f816d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f6ffd700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f8159f70 0x7f28f816d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f6ffd700 1 -- 172.21.15.142:0/3545875133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80c20f0 con 0x7f28f8145940 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f77fe700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28e0004d50 0x7f28f815e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f7fff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f8159f70 0x7f28f816d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28f6ffd700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8145940 0x7f28f80c4cd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f28ec001c30 tx=0x7f28ec001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28df7fe700 1 -- 172.21.15.142:0/3545875133 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec0077d0 con 0x7f28f8145940 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28df7fe700 1 -- 172.21.15.142:0/3545875133 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec00f8a0 con 0x7f28f8145940 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f80c23d0 con 0x7f28f8145940 2023-09-30T22:54:56.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28df7fe700 1 -- 172.21.15.142:0/3545875133 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00fca0 con 0x7f28f8145940 2023-09-30T22:54:56.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.567+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f816daf0 con 0x7f28f8145940 2023-09-30T22:54:56.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.568+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f806e4b0 con 0x7f28f8145940 2023-09-30T22:54:56.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.569+0000 7f28df7fe700 1 -- 172.21.15.142:0/3545875133 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f28ec013600 con 0x7f28f8145940 2023-09-30T22:54:56.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.570+0000 7f28df7fe700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f28e4067330 0x7f28e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.570+0000 7f28df7fe700 1 -- 172.21.15.142:0/3545875133 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f28ec084a30 con 0x7f28f8145940 2023-09-30T22:54:56.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.570+0000 7f28f77fe700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f28e4067330 0x7f28e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.571+0000 7f28f77fe700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f28e4067330 0x7f28e40697e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f28e80093f0 tx=0x7f28e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:56.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.574+0000 7f28df7fe700 1 -- 172.21.15.142:0/3545875133 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f28ec051b90 con 0x7f28f8145940 2023-09-30T22:54:56.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.764+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f28f80c2b60 con 0x7f28f8145940 2023-09-30T22:54:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.768+0000 7f28df7fe700 1 -- 172.21.15.142:0/3545875133 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f28ec0551b0 con 0x7f28f8145940 2023-09-30T22:54:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f28e4067330 msgr2=0x7f28e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f28e4067330 0x7f28e40697e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f28e80093f0 tx=0x7f28e8008040 comp rx=0 tx=0).stop 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8145940 msgr2=0x7f28f80c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8145940 0x7f28f80c4cd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f28ec001c30 tx=0x7f28ec001da0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 shutdown_connections 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f28e4067330 0x7f28e40697e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f8159f70 0x7f28f816d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28e0004d50 0x7f28f815e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 --2- 172.21.15.142:0/3545875133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8145940 0x7f28f80c4cd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 >> 172.21.15.142:0/3545875133 conn(0x7f28f80cb2f0 msgr2=0x7f28f80cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 shutdown_connections 2023-09-30T22:54:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.771+0000 7f28fdbff700 1 -- 172.21.15.142:0/3545875133 wait complete. 2023-09-30T22:54:56.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-09-30T22:54:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.979+0000 7f00937ff700 1 Processor -- start 2023-09-30T22:54:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.979+0000 7f00937ff700 1 -- start start 2023-09-30T22:54:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.980+0000 7f00937ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f008c0b2110 0x7f008c1628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.980+0000 7f00937ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c06d470 con 0x7f008c157a90 2023-09-30T22:54:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.980+0000 7f00937ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c157e60 con 0x7f008c06b3d0 2023-09-30T22:54:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.980+0000 7f00937ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c0ae880 con 0x7f008c0b2110 2023-09-30T22:54:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.980+0000 7f009159b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f008c157a90 0x7f008c15bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36922/0 (socket says 172.21.15.142:36922) 2023-09-30T22:54:56.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.980+0000 7f009159b700 1 -- 172.21.15.142:0/2565404943 learned_addr learned my addr 172.21.15.142:0/2565404943 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:56.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0091d9c700 1 --2- 172.21.15.142:0/2565404943 >> v2:172.21.15.148:3300/0 conn(0x7f008c0b2110 0x7f008c1628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308661765 0 0) 0x7f008c06d470 con 0x7f008c157a90 2023-09-30T22:54:56.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0078003570 con 0x7f008c157a90 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3574186076 0 0) 0x7f0078003570 con 0x7f008c157a90 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 >> v2:172.21.15.148:3300/0 conn(0x7f008c0b2110 msgr2=0x7f008c1628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 --2- 172.21.15.142:0/2565404943 >> v2:172.21.15.148:3300/0 conn(0x7f008c0b2110 0x7f008c1628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 >> v1:172.21.15.148:6789/0 conn(0x7f008c06b3d0 legacy=0x7f008c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0aeb60 con 0x7f008c157a90 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f0088001470 con 0x7f008c157a90 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 >> v1:172.21.15.142:6789/0 conn(0x7f008c157a90 legacy=0x7f008c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078003a60 0x7f0078003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f0078004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00780051c0 0x7f007800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0ae880 con 0x7f0078004810 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007800c0e0 con 0x7f0078003a60 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007800c2a0 con 0x7f00780051c0 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.981+0000 7f0090d9a700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f0078004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f009159b700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078003a60 0x7f0078003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0091d9c700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00780051c0 0x7f007800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0090d9a700 1 -- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00780051c0 msgr2=0x7f007800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0090d9a700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00780051c0 0x7f007800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0090d9a700 1 -- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078003a60 msgr2=0x7f0078003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0090d9a700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078003a60 0x7f0078003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0090d9a700 1 -- 172.21.15.142:0/2565404943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078003570 con 0x7f0078004810 2023-09-30T22:54:56.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0091d9c700 1 -- 172.21.15.142:0/2565404943 reap_dead start 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0090d9a700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f0078004c80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f008c06b7c0 tx=0x7f007c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4aa04207956ef5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c00c590 con 0x7f0078004810 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c00c710 con 0x7f0078004810 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.982+0000 7f0083fff700 1 -- 172.21.15.142:0/2565404943 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c00cad0 con 0x7f0078004810 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.983+0000 7f00937ff700 1 -- 172.21.15.142:0/2565404943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 msgr2=0x7f0078004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.983+0000 7f00937ff700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f0078004c80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f008c06b7c0 tx=0x7f007c007d30 comp rx=0 tx=0).stop 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.983+0000 7f00937ff700 1 -- 172.21.15.142:0/2565404943 shutdown_connections 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.983+0000 7f00937ff700 1 --2- 172.21.15.142:0/2565404943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f0078004c80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.983+0000 7f00937ff700 1 -- 172.21.15.142:0/2565404943 >> 172.21.15.142:0/2565404943 conn(0x7f008c0680c0 msgr2=0x7f008c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.983+0000 7f00937ff700 1 -- 172.21.15.142:0/2565404943 shutdown_connections 2023-09-30T22:54:56.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.983+0000 7f00937ff700 1 -- 172.21.15.142:0/2565404943 wait complete. 2023-09-30T22:54:56.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.984+0000 7f00937ff700 1 Processor -- start 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.985+0000 7f00937ff700 1 -- start start 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f00937ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f008c158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f00937ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c15f2d0 0x7f008c06e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f00937ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f008c16de50 0x7f008c16e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f00937ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c159ab0 con 0x7f0078004810 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f00937ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c16d720 con 0x7f008c15f2d0 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f00937ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c16d9c0 con 0x7f008c16de50 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f008c158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f008c158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59296/0 (socket says 172.21.15.142:59296) 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 -- 172.21.15.142:0/4257630975 learned_addr learned my addr 172.21.15.142:0/4257630975 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:56.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f0090d9a700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c15f2d0 0x7f008c06e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f0091d9c700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f008c16de50 0x7f008c16e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 -- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f008c16de50 msgr2=0x7f008c16e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f008c16de50 0x7f008c16e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 -- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c15f2d0 msgr2=0x7f008c06e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c15f2d0 0x7f008c06e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 -- 172.21.15.142:0/4257630975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c156c00 con 0x7f0078004810 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f0091d9c700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f008c16de50 0x7f008c16e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f0090d9a700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c15f2d0 0x7f008c06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.986+0000 7f009159b700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f008c158800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0088007390 tx=0x7f0088001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.987+0000 7f00817fa700 1 -- 172.21.15.142:0/4257630975 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088018030 con 0x7f0078004810 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.987+0000 7f00817fa700 1 -- 172.21.15.142:0/4257630975 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0088001040 con 0x7f0078004810 2023-09-30T22:54:56.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.987+0000 7f00817fa700 1 -- 172.21.15.142:0/4257630975 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800fb20 con 0x7f0078004810 2023-09-30T22:54:56.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.987+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c156ee0 con 0x7f0078004810 2023-09-30T22:54:56.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.987+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c158d40 con 0x7f0078004810 2023-09-30T22:54:56.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.988+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c0695b0 con 0x7f0078004810 2023-09-30T22:54:56.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.989+0000 7f00817fa700 1 -- 172.21.15.142:0/4257630975 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f008801b070 con 0x7f0078004810 2023-09-30T22:54:56.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.990+0000 7f00817fa700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0070067330 0x7f00700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:56.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.990+0000 7f00817fa700 1 -- 172.21.15.142:0/4257630975 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0088019070 con 0x7f0078004810 2023-09-30T22:54:56.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.990+0000 7f0090d9a700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0070067330 0x7f00700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:56.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.990+0000 7f0090d9a700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0070067330 0x7f00700697e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f008c0c82c0 tx=0x7f007c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:56.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:56.994+0000 7f00817fa700 1 -- 172.21.15.142:0/4257630975 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0088051950 con 0x7f0078004810 2023-09-30T22:54:57.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.262+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f008c153cc0 con 0x7f0078004810 2023-09-30T22:54:57.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.340+0000 7f00817fa700 1 -- 172.21.15.142:0/4257630975 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v156) v1 ==== 142+0+0 (secure 0 0 0) 0x7f0088054f70 con 0x7f0078004810 2023-09-30T22:54:57.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.342+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0070067330 msgr2=0x7f00700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:57.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.342+0000 7f00937ff700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0070067330 0x7f00700697e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f008c0c82c0 tx=0x7f007c015000 comp rx=0 tx=0).stop 2023-09-30T22:54:57.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.342+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 msgr2=0x7f008c158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:57.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.342+0000 7f00937ff700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f008c158800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0088007390 tx=0x7f0088001df0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 shutdown_connections 2023-09-30T22:54:57.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0070067330 0x7f00700697e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f008c16de50 0x7f008c16e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0078004810 0x7f008c158800 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 --2- 172.21.15.142:0/4257630975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c15f2d0 0x7f008c06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 >> 172.21.15.142:0/4257630975 conn(0x7f008c0680c0 msgr2=0x7f008c0ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:57.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 shutdown_connections 2023-09-30T22:54:57.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.343+0000 7f00937ff700 1 -- 172.21.15.142:0/4257630975 wait complete. 2023-09-30T22:54:57.361 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-09-30T22:54:57.361 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-09-30T22:54:57.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-09-30T22:54:57.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.550+0000 7f3c489ff700 1 Processor -- start 2023-09-30T22:54:57.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.551+0000 7f3c489ff700 1 -- start start 2023-09-30T22:54:57.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.552+0000 7f3c489ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c4406e820 0x7f3c44161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:57.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.552+0000 7f3c489ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4406d3e0 con 0x7f3c440af020 2023-09-30T22:54:57.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.552+0000 7f3c489ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4406dc80 con 0x7f3c440b00d0 2023-09-30T22:54:57.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.552+0000 7f3c489ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4415b400 con 0x7f3c4406e820 2023-09-30T22:54:57.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.552+0000 7f3c4259c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3c440af020 0x7f3c44156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36930/0 (socket says 172.21.15.142:36930) 2023-09-30T22:54:57.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.552+0000 7f3c4259c700 1 -- 172.21.15.142:0/1309806722 learned_addr learned my addr 172.21.15.142:0/1309806722 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:57.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c42d9d700 1 --2- 172.21.15.142:0/1309806722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c4406e820 0x7f3c44161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c4159a700 1 -- 172.21.15.142:0/1309806722 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42073155 0 0) 0x7f3c4406d3e0 con 0x7f3c440af020 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c4159a700 1 -- 172.21.15.142:0/1309806722 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c2c003570 con 0x7f3c440af020 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c4159a700 1 -- 172.21.15.142:0/1309806722 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999067580 0 0) 0x7f3c4406dc80 con 0x7f3c440b00d0 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c4159a700 1 -- 172.21.15.142:0/1309806722 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c4406d3e0 con 0x7f3c440b00d0 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c42d9d700 1 -- 172.21.15.142:0/1309806722 >> v1:172.21.15.148:6789/0 conn(0x7f3c440b00d0 legacy=0x7f3c4406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c42d9d700 1 -- 172.21.15.142:0/1309806722 >> v1:172.21.15.142:6789/0 conn(0x7f3c440af020 legacy=0x7f3c44156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c42d9d700 1 -- 172.21.15.142:0/1309806722 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4406eca0 con 0x7f3c4406e820 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.553+0000 7f3c42d9d700 1 --2- 172.21.15.142:0/1309806722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c4406e820 0x7f3c44161790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e90 tx=0x7f3c3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb86f683c52b9bb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:57.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c4159a700 1 -- 172.21.15.142:0/1309806722 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00e070 con 0x7f3c4406e820 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c4159a700 1 -- 172.21.15.142:0/1309806722 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00bb80 con 0x7f3c4406e820 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c4159a700 1 -- 172.21.15.142:0/1309806722 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c012430 con 0x7f3c4406e820 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c489ff700 1 -- 172.21.15.142:0/1309806722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c4406e820 msgr2=0x7f3c44161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1309806722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c4406e820 0x7f3c44161790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e90 tx=0x7f3c3c009780 comp rx=0 tx=0).stop 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c489ff700 1 -- 172.21.15.142:0/1309806722 shutdown_connections 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1309806722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c4406e820 0x7f3c44161790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c489ff700 1 -- 172.21.15.142:0/1309806722 >> 172.21.15.142:0/1309806722 conn(0x7f3c440680c0 msgr2=0x7f3c440c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c489ff700 1 -- 172.21.15.142:0/1309806722 shutdown_connections 2023-09-30T22:54:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.554+0000 7f3c489ff700 1 -- 172.21.15.142:0/1309806722 wait complete. 2023-09-30T22:54:57.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.556+0000 7f3c489ff700 1 Processor -- start 2023-09-30T22:54:57.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.556+0000 7f3c489ff700 1 -- start start 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c489ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c4406e820 0x7f3c440c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c489ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c440af020 0x7f3c440c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c489ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c440b00d0 0x7f3c440c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c489ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440c3350 con 0x7f3c440af020 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c489ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441682b0 con 0x7f3c4406e820 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c489ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440c2740 con 0x7f3c440b00d0 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c440af020 0x7f3c440c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c440af020 0x7f3c440c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59298/0 (socket says 172.21.15.142:59298) 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 -- 172.21.15.142:0/1313306105 learned_addr learned my addr 172.21.15.142:0/1313306105 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c42d9d700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c440b00d0 0x7f3c440c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c4259c700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c4406e820 0x7f3c440c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 -- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c440b00d0 msgr2=0x7f3c440c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c440b00d0 0x7f3c440c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 -- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c4406e820 msgr2=0x7f3c440c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c4406e820 0x7f3c440c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c41d9b700 1 -- 172.21.15.142:0/1313306105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009a20 con 0x7f3c440af020 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c42d9d700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c440b00d0 0x7f3c440c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.557+0000 7f3c4259c700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c4406e820 0x7f3c440c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.558+0000 7f3c41d9b700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c440af020 0x7f3c440c1bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c590 tx=0x7f3c38007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.558+0000 7f3c327fc700 1 -- 172.21.15.142:0/1313306105 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38010510 con 0x7f3c440af020 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.558+0000 7f3c327fc700 1 -- 172.21.15.142:0/1313306105 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c38010690 con 0x7f3c440af020 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.558+0000 7f3c327fc700 1 -- 172.21.15.142:0/1313306105 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38010a50 con 0x7f3c440af020 2023-09-30T22:54:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.558+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c440c2a20 con 0x7f3c440af020 2023-09-30T22:54:57.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.558+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c440c2fe0 con 0x7f3c440af020 2023-09-30T22:54:57.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.559+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c440c3500 con 0x7f3c440af020 2023-09-30T22:54:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.560+0000 7f3c327fc700 1 -- 172.21.15.142:0/1313306105 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3c3801b400 con 0x7f3c440af020 2023-09-30T22:54:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.561+0000 7f3c327fc700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c24067330 0x7f3c240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.561+0000 7f3c327fc700 1 -- 172.21.15.142:0/1313306105 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3c380845b0 con 0x7f3c440af020 2023-09-30T22:54:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.561+0000 7f3c4259c700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c24067330 0x7f3c240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.562+0000 7f3c4259c700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c24067330 0x7f3c240697e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c34007fd0 tx=0x7f3c34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:57.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.565+0000 7f3c327fc700 1 -- 172.21.15.142:0/1313306105 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3c440c3500 con 0x7f3c440af020 2023-09-30T22:54:57.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:57.827+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f3c440c3490 con 0x7f3c440af020 2023-09-30T22:54:58.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.344+0000 7f3c327fc700 1 -- 172.21.15.142:0/1313306105 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v157) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3c380517b0 con 0x7f3c440af020 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c24067330 msgr2=0x7f3c240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c24067330 0x7f3c240697e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c34007fd0 tx=0x7f3c34009040 comp rx=0 tx=0).stop 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c440af020 msgr2=0x7f3c440c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c440af020 0x7f3c440c1bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c590 tx=0x7f3c38007dd0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 shutdown_connections 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c24067330 0x7f3c240697e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c440b00d0 0x7f3c440c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c4406e820 0x7f3c440c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 --2- 172.21.15.142:0/1313306105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c440af020 0x7f3c440c1bf0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 >> 172.21.15.142:0/1313306105 conn(0x7f3c440680c0 msgr2=0x7f3c4415a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:58.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 shutdown_connections 2023-09-30T22:54:58.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.347+0000 7f3c489ff700 1 -- 172.21.15.142:0/1313306105 wait complete. 2023-09-30T22:54:58.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-30T22:54:58.576 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_objectstore":"memstore"} 2023-09-30T22:54:58.576 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-30T22:54:58.577 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:54:58.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.768+0000 7f173d9ff700 1 Processor -- start 2023-09-30T22:54:58.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.768+0000 7f173d9ff700 1 -- start start 2023-09-30T22:54:58.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.769+0000 7f173d9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1738159bc0 0x7f17380cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:58.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.769+0000 7f173d9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f17380cc070 0x7f1738067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.769+0000 7f173d9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17380cc470 con 0x7f17380cb210 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.769+0000 7f173d9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17380cabd0 con 0x7f1738159bc0 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.769+0000 7f173d9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17380caeb0 con 0x7f17380cc070 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.769+0000 7f1736ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1738159bc0 0x7f17380cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1736ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1738159bc0 0x7f17380cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59308/0 (socket says 172.21.15.142:59308) 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1736ffd700 1 -- 172.21.15.142:0/4075355452 learned_addr learned my addr 172.21.15.142:0/4075355452 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f17377fe700 1 --2- 172.21.15.142:0/4075355452 >> v2:172.21.15.148:3300/0 conn(0x7f17380cc070 0x7f1738067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1736ffd700 1 -- 172.21.15.142:0/4075355452 >> v2:172.21.15.148:3300/0 conn(0x7f17380cc070 msgr2=0x7f1738067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1736ffd700 1 --2- 172.21.15.142:0/4075355452 >> v2:172.21.15.148:3300/0 conn(0x7f17380cc070 0x7f1738067d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1736ffd700 1 -- 172.21.15.142:0/4075355452 >> v1:172.21.15.148:6789/0 conn(0x7f17380cb210 legacy=0x7f1738067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1736ffd700 1 -- 172.21.15.142:0/4075355452 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738068910 con 0x7f1738159bc0 2023-09-30T22:54:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f17377fe700 1 --2- 172.21.15.142:0/4075355452 >> v2:172.21.15.148:3300/0 conn(0x7f17380cc070 0x7f1738067d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:54:58.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1736ffd700 1 --2- 172.21.15.142:0/4075355452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1738159bc0 0x7f17380cbb30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1738064690 tx=0x7f1728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c060c9f3236a999 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:58.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1735ffb700 1 -- 172.21.15.142:0/4075355452 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800b820 con 0x7f1738159bc0 2023-09-30T22:54:58.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1735ffb700 1 -- 172.21.15.142:0/4075355452 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172800b980 con 0x7f1738159bc0 2023-09-30T22:54:58.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.770+0000 7f1735ffb700 1 -- 172.21.15.142:0/4075355452 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800bd20 con 0x7f1738159bc0 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 -- 172.21.15.142:0/4075355452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1738159bc0 msgr2=0x7f17380cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 --2- 172.21.15.142:0/4075355452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1738159bc0 0x7f17380cbb30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1738064690 tx=0x7f1728009250 comp rx=0 tx=0).stop 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 -- 172.21.15.142:0/4075355452 shutdown_connections 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 --2- 172.21.15.142:0/4075355452 >> v2:172.21.15.148:3300/0 conn(0x7f17380cc070 0x7f1738067d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 --2- 172.21.15.142:0/4075355452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1738159bc0 0x7f17380cbb30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 -- 172.21.15.142:0/4075355452 >> 172.21.15.142:0/4075355452 conn(0x7f17380ce170 msgr2=0x7f17380ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 -- 172.21.15.142:0/4075355452 shutdown_connections 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.771+0000 7f173d9ff700 1 -- 172.21.15.142:0/4075355452 wait complete. 2023-09-30T22:54:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.773+0000 7f173d9ff700 1 Processor -- start 2023-09-30T22:54:58.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.773+0000 7f173d9ff700 1 -- start start 2023-09-30T22:54:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f173d9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17380cb210 0x7f17380b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f173d9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17380cc070 0x7f17380b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f173d9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738159bc0 0x7f173816cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f173d9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380b30b0 con 0x7f17380cc070 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f173d9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380b35b0 con 0x7f1738159bc0 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f173d9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173815dee0 con 0x7f17380cb210 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17380cc070 0x7f17380b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17380cc070 0x7f17380b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59310/0 (socket says 172.21.15.142:59310) 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 -- 172.21.15.142:0/741577615 learned_addr learned my addr 172.21.15.142:0/741577615 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f1736ffd700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17380cb210 0x7f17380b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17377fe700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738159bc0 0x7f173816cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 -- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17380cb210 msgr2=0x7f17380b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17380cb210 0x7f17380b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 -- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738159bc0 msgr2=0x7f173816cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738159bc0 0x7f173816cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.774+0000 7f17367fc700 1 -- 172.21.15.142:0/741577615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280094f0 con 0x7f17380cc070 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.775+0000 7f17367fc700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17380cc070 0x7f17380b2b70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f172c00b5e0 tx=0x7f172c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.775+0000 7f171effd700 1 -- 172.21.15.142:0/741577615 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c00f510 con 0x7f17380cc070 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.775+0000 7f171effd700 1 -- 172.21.15.142:0/741577615 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c00f690 con 0x7f17380cc070 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.775+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17380b32d0 con 0x7f17380cc070 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.775+0000 7f171effd700 1 -- 172.21.15.142:0/741577615 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c00fa50 con 0x7f17380cc070 2023-09-30T22:54:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.775+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173815db70 con 0x7f17380cc070 2023-09-30T22:54:58.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.776+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17380ce570 con 0x7f17380cc070 2023-09-30T22:54:58.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.777+0000 7f171effd700 1 -- 172.21.15.142:0/741577615 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f172c01a400 con 0x7f17380cc070 2023-09-30T22:54:58.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.778+0000 7f171effd700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1724067330 0x7f17240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:58.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.778+0000 7f171effd700 1 -- 172.21.15.142:0/741577615 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f172c084340 con 0x7f17380cc070 2023-09-30T22:54:58.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.778+0000 7f1736ffd700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1724067330 0x7f17240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:58.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.778+0000 7f1736ffd700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1724067330 0x7f17240697e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1738064690 tx=0x7f1728016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:58.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.782+0000 7f171effd700 1 -- 172.21.15.142:0/741577615 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f172c051520 con 0x7f17380cc070 2023-09-30T22:54:58.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.968+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f173806fc10 con 0x7f17380cc070 2023-09-30T22:54:58.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.972+0000 7f171effd700 1 -- 172.21.15.142:0/741577615 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f172c05a020 con 0x7f17380cc070 2023-09-30T22:54:58.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1724067330 msgr2=0x7f17240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:58.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1724067330 0x7f17240697e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1738064690 tx=0x7f1728016000 comp rx=0 tx=0).stop 2023-09-30T22:54:58.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17380cc070 msgr2=0x7f17380b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:58.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17380cc070 0x7f17380b2b70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f172c00b5e0 tx=0x7f172c0090f0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 shutdown_connections 2023-09-30T22:54:58.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1724067330 0x7f17240697e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1738159bc0 0x7f173816cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17380cb210 0x7f17380b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 --2- 172.21.15.142:0/741577615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17380cc070 0x7f17380b2b70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:58.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 >> 172.21.15.142:0/741577615 conn(0x7f17380ce170 msgr2=0x7f17380c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:58.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 shutdown_connections 2023-09-30T22:54:58.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:58.975+0000 7f173d9ff700 1 -- 172.21.15.142:0/741577615 wait complete. 2023-09-30T22:54:58.993 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:54:58.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:54:59.097 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:54:59.207 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:54:59.208 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:54:59.208 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:54:59.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.397+0000 7f60b8dff700 1 Processor -- start 2023-09-30T22:54:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.397+0000 7f60b8dff700 1 -- start start 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b8dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60b415a010 0x7f60b406a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b8dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b40b0ee0 con 0x7f60b4159b90 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b8dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b406f360 con 0x7f60b40aebf0 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b8dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b40aefc0 con 0x7f60b415a010 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b1d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f60b4159b90 0x7f60b4069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36946/0 (socket says 172.21.15.142:36946) 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b1d9b700 1 -- 172.21.15.142:0/1149285059 learned_addr learned my addr 172.21.15.142:0/1149285059 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b2d9d700 1 --2- 172.21.15.142:0/1149285059 >> v2:172.21.15.142:3300/0 conn(0x7f60b415a010 0x7f60b406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b159a700 1 -- 172.21.15.142:0/1149285059 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461301416 0 0) 0x7f60b40b0ee0 con 0x7f60b4159b90 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b159a700 1 -- 172.21.15.142:0/1149285059 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f609c004680 con 0x7f60b4159b90 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b2d9d700 1 -- 172.21.15.142:0/1149285059 >> v1:172.21.15.148:6789/0 conn(0x7f60b40aebf0 legacy=0x7f60b406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b2d9d700 1 -- 172.21.15.142:0/1149285059 >> v1:172.21.15.142:6789/0 conn(0x7f60b4159b90 legacy=0x7f60b4069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.399+0000 7f60b2d9d700 1 -- 172.21.15.142:0/1149285059 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40b02d0 con 0x7f60b415a010 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.400+0000 7f60b2d9d700 1 --2- 172.21.15.142:0/1149285059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b415a010 0x7f60b406a620 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009e60 tx=0x7f60ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39016e4eb5dd0d9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.400+0000 7f60b159a700 1 -- 172.21.15.142:0/1149285059 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00bb60 con 0x7f60b415a010 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.400+0000 7f60b159a700 1 -- 172.21.15.142:0/1149285059 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00bcc0 con 0x7f60b415a010 2023-09-30T22:54:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.400+0000 7f60b159a700 1 -- 172.21.15.142:0/1149285059 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0116b0 con 0x7f60b415a010 2023-09-30T22:54:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.400+0000 7f60b8dff700 1 -- 172.21.15.142:0/1149285059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b415a010 msgr2=0x7f60b406a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.400+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1149285059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b415a010 0x7f60b406a620 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009e60 tx=0x7f60ac009780 comp rx=0 tx=0).stop 2023-09-30T22:54:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.401+0000 7f60b8dff700 1 -- 172.21.15.142:0/1149285059 shutdown_connections 2023-09-30T22:54:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.401+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1149285059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b415a010 0x7f60b406a620 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.401+0000 7f60b8dff700 1 -- 172.21.15.142:0/1149285059 >> 172.21.15.142:0/1149285059 conn(0x7f60b40680c0 msgr2=0x7f60b40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.401+0000 7f60b8dff700 1 -- 172.21.15.142:0/1149285059 shutdown_connections 2023-09-30T22:54:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.401+0000 7f60b8dff700 1 -- 172.21.15.142:0/1149285059 wait complete. 2023-09-30T22:54:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.403+0000 7f60b8dff700 1 Processor -- start 2023-09-30T22:54:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.403+0000 7f60b8dff700 1 -- start start 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b8dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60b40aebf0 0x7f60b416b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b8dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4159b90 0x7f60b40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b8dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60b415a010 0x7f60b40ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b8dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40c8a80 con 0x7f60b4159b90 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b8dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40c8d60 con 0x7f60b40aebf0 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b8dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4151c00 con 0x7f60b415a010 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4159b90 0x7f60b40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4159b90 0x7f60b40c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59322/0 (socket says 172.21.15.142:59322) 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b1d9b700 1 -- 172.21.15.142:0/1548675579 learned_addr learned my addr 172.21.15.142:0/1548675579 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.404+0000 7f60b259c700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60b40aebf0 0x7f60b416b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b2d9d700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60b415a010 0x7f60b40ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b1d9b700 1 -- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60b415a010 msgr2=0x7f60b40ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b1d9b700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60b415a010 0x7f60b40ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b1d9b700 1 -- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60b40aebf0 msgr2=0x7f60b416b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b1d9b700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60b40aebf0 0x7f60b416b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b1d9b700 1 -- 172.21.15.142:0/1548675579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac009a20 con 0x7f60b4159b90 2023-09-30T22:54:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b1d9b700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4159b90 0x7f60b40c5cd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f60a800c7c0 tx=0x7f60a8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60a27fc700 1 -- 172.21.15.142:0/1548675579 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8005cd0 con 0x7f60b4159b90 2023-09-30T22:54:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60a27fc700 1 -- 172.21.15.142:0/1548675579 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a8005e30 con 0x7f60b4159b90 2023-09-30T22:54:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b4151ee0 con 0x7f60b4159b90 2023-09-30T22:54:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.405+0000 7f60a27fc700 1 -- 172.21.15.142:0/1548675579 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8007320 con 0x7f60b4159b90 2023-09-30T22:54:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.406+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b40c6210 con 0x7f60b4159b90 2023-09-30T22:54:59.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.406+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b40c6400 con 0x7f60b4159b90 2023-09-30T22:54:59.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.407+0000 7f60a27fc700 1 -- 172.21.15.142:0/1548675579 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f60a801b3b0 con 0x7f60b4159b90 2023-09-30T22:54:59.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.409+0000 7f60a27fc700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6094067330 0x7f60940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.409+0000 7f60a27fc700 1 -- 172.21.15.142:0/1548675579 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f60a8083fc0 con 0x7f60b4159b90 2023-09-30T22:54:59.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.409+0000 7f60b259c700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6094067330 0x7f60940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.410+0000 7f60b259c700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6094067330 0x7f60940697e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f60a4003ac0 tx=0x7f60a4007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:59.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.413+0000 7f60a27fc700 1 -- 172.21.15.142:0/1548675579 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f60a8051120 con 0x7f60b4159b90 2023-09-30T22:54:59.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.644+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60b40ca5c0 con 0x7f60b4159b90 2023-09-30T22:54:59.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.644+0000 7f60a27fc700 1 -- 172.21.15.142:0/1548675579 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f60a8017090 con 0x7f60b4159b90 2023-09-30T22:54:59.646 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:54:59.646 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/605020070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":605020070},{"type":"v1","addr":"172.21.15.142:6835","nonce":605020070}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5236,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/55959713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":55959713},{"type":"v1","addr":"172.21.15.148:6833","nonce":55959713}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2241273819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2241273819},{"type":"v1","addr":"172.21.15.148:6835","nonce":2241273819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3152399583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3152399583},{"type":"v1","addr":"172.21.15.142:6837","nonce":3152399583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-09-30T22:54:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6094067330 msgr2=0x7f60940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6094067330 0x7f60940697e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f60a4003ac0 tx=0x7f60a4007ea0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4159b90 msgr2=0x7f60b40c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4159b90 0x7f60b40c5cd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f60a800c7c0 tx=0x7f60a8007e00 comp rx=0 tx=0).stop 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 shutdown_connections 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6094067330 0x7f60940697e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60b415a010 0x7f60b40ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60b40aebf0 0x7f60b416b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 --2- 172.21.15.142:0/1548675579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4159b90 0x7f60b40c5cd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 >> 172.21.15.142:0/1548675579 conn(0x7f60b40680c0 msgr2=0x7f60b414de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 shutdown_connections 2023-09-30T22:54:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.647+0000 7f60b8dff700 1 -- 172.21.15.142:0/1548675579 wait complete. 2023-09-30T22:54:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 26 2023-09-30T22:54:59.665 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:54:59.666 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:54:59.666 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:54:59.666 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:59.666 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:54:59.666 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:54:59.667 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:54:59.667 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:59.667 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:54:59.667 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:54:59.667 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:54:59.667 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:59.667 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:54:59.668 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:54:59.668 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:54:59.668 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:54:59.679 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:54:59.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:54:59.681 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:54:59.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:54:59.683 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:54:59.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:54:59.684 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:54:59.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:54:59.724 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:54:59.725 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:59.727 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:54:59.727 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:59.728 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:54:59.728 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:59.730 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:54:59.731 DEBUG:teuthology.parallel:result is None 2023-09-30T22:54:59.731 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:54:59.869 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:54:59.870 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:54:59.876 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:54:59.876 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:54:59.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.929+0000 7f69b37ff700 1 Processor -- start 2023-09-30T22:54:59.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.930+0000 7f69b37ff700 1 -- start start 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.931+0000 7f69b37ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f69ac0b1580 0x7f69ac0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b37ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69ac0ae000 0x7f69ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b37ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ac0ad630 con 0x7f69ac0b1950 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b37ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac157c20 con 0x7f69ac0ae000 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b37ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac0b3360 con 0x7f69ac0b1580 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b1d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69ac0ae000 0x7f69ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b1d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69ac0ae000 0x7f69ac06a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59354/0 (socket says 172.21.15.142:59354) 2023-09-30T22:54:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b1d9c700 1 -- 172.21.15.142:0/1061742724 learned_addr learned my addr 172.21.15.142:0/1061742724 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:59.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b159b700 1 --2- 172.21.15.142:0/1061742724 >> v2:172.21.15.148:3300/0 conn(0x7f69ac0b1580 0x7f69ac0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b1d9c700 1 -- 172.21.15.142:0/1061742724 >> v2:172.21.15.148:3300/0 conn(0x7f69ac0b1580 msgr2=0x7f69ac0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:54:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b1d9c700 1 --2- 172.21.15.142:0/1061742724 >> v2:172.21.15.148:3300/0 conn(0x7f69ac0b1580 0x7f69ac0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b1d9c700 1 -- 172.21.15.142:0/1061742724 >> v1:172.21.15.148:6789/0 conn(0x7f69ac0b1950 legacy=0x7f69ac15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.932+0000 7f69b1d9c700 1 -- 172.21.15.142:0/1061742724 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac15ad60 con 0x7f69ac0ae000 2023-09-30T22:54:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69b1d9c700 1 --2- 172.21.15.142:0/1061742724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0ae000 0x7f69ac06a7a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06c8a0 tx=0x7f69a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50feea685ba49563 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69a3fff700 1 -- 172.21.15.142:0/1061742724 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a400e070 con 0x7f69ac0ae000 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69a3fff700 1 -- 172.21.15.142:0/1061742724 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a400ba20 con 0x7f69ac0ae000 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69a3fff700 1 -- 172.21.15.142:0/1061742724 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40092e0 con 0x7f69ac0ae000 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69b37ff700 1 -- 172.21.15.142:0/1061742724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0ae000 msgr2=0x7f69ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1061742724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0ae000 0x7f69ac06a7a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06c8a0 tx=0x7f69a4009840 comp rx=0 tx=0).stop 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69b37ff700 1 -- 172.21.15.142:0/1061742724 shutdown_connections 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1061742724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0ae000 0x7f69ac06a7a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1061742724 >> v2:172.21.15.148:3300/0 conn(0x7f69ac0b1580 0x7f69ac0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.933+0000 7f69b37ff700 1 -- 172.21.15.142:0/1061742724 >> 172.21.15.142:0/1061742724 conn(0x7f69ac0ce1f0 msgr2=0x7f69ac069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.934+0000 7f69b37ff700 1 -- 172.21.15.142:0/1061742724 shutdown_connections 2023-09-30T22:54:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.934+0000 7f69b37ff700 1 -- 172.21.15.142:0/1061742724 wait complete. 2023-09-30T22:54:59.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.935+0000 7f69b37ff700 1 Processor -- start 2023-09-30T22:54:59.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.935+0000 7f69b37ff700 1 -- start start 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b37ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69ac0ae000 0x7f69ac158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b37ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69ac0b1580 0x7f69ac147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b37ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0b1950 0x7f69ac0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b37ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac15bc20 con 0x7f69ac0b1950 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b37ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac158dc0 con 0x7f69ac0ae000 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b37ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac15b330 con 0x7f69ac0b1580 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b1d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0b1950 0x7f69ac0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b159b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69ac0ae000 0x7f69ac158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b159b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69ac0ae000 0x7f69ac158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:59276/0 (socket says 172.21.15.142:59276) 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b159b700 1 -- 172.21.15.142:0/1074169222 learned_addr learned my addr 172.21.15.142:0/1074169222 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b1d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0b1950 0x7f69ac0cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59356/0 (socket says 172.21.15.142:59356) 2023-09-30T22:54:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.936+0000 7f69b0d9a700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69ac0b1580 0x7f69ac147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b159b700 1 -- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69ac0b1580 msgr2=0x7f69ac147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b159b700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69ac0b1580 0x7f69ac147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b159b700 1 -- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0b1950 msgr2=0x7f69ac0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b159b700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0b1950 0x7f69ac0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b159b700 1 -- 172.21.15.142:0/1074169222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a4009ae0 con 0x7f69ac0ae000 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b1d9c700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0b1950 0x7f69ac0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b159b700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69ac0ae000 0x7f69ac158880 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f69a800ec80 tx=0x7f69a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69a17fa700 1 -- 172.21.15.142:0/1074169222 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a800c850 con 0x7f69ac0ae000 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69a17fa700 1 -- 172.21.15.142:0/1074169222 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a800c9b0 con 0x7f69ac0ae000 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac16af90 con 0x7f69ac0ae000 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69a17fa700 1 -- 172.21.15.142:0/1074169222 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a800cd50 con 0x7f69ac0ae000 2023-09-30T22:54:59.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.937+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac15b8b0 con 0x7f69ac0ae000 2023-09-30T22:54:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.938+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ac15bf00 con 0x7f69ac0ae000 2023-09-30T22:54:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.939+0000 7f69a17fa700 1 -- 172.21.15.142:0/1074169222 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f69a8013680 con 0x7f69ac0ae000 2023-09-30T22:54:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.940+0000 7f69a17fa700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6990067330 0x7f69900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:54:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.940+0000 7f69a17fa700 1 -- 172.21.15.142:0/1074169222 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f69a8084b50 con 0x7f69ac0ae000 2023-09-30T22:54:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.940+0000 7f69b0d9a700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6990067330 0x7f69900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:54:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.941+0000 7f69b0d9a700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6990067330 0x7f69900697e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f699c0039e0 tx=0x7f699c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:54:59.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:54:59.945+0000 7f69a17fa700 1 -- 172.21.15.142:0/1074169222 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f69a8051cb0 con 0x7f69ac0ae000 2023-09-30T22:55:00.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.152+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f69ac15b040 con 0x7f69ac0ae000 2023-09-30T22:55:00.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.367+0000 7f69a17fa700 1 -- 172.21.15.142:0/1074169222 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) v1 ==== 97+0+0 (secure 0 0 0) 0x7f69a80552d0 con 0x7f69ac0ae000 2023-09-30T22:55:00.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6990067330 msgr2=0x7f69900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6990067330 0x7f69900697e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f699c0039e0 tx=0x7f699c007ec0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69ac0ae000 msgr2=0x7f69ac158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69ac0ae000 0x7f69ac158880 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f69a800ec80 tx=0x7f69a80091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 shutdown_connections 2023-09-30T22:55:00.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6990067330 0x7f69900697e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ac0b1950 0x7f69ac0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69ac0ae000 0x7f69ac158880 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 --2- 172.21.15.142:0/1074169222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69ac0b1580 0x7f69ac147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 >> 172.21.15.142:0/1074169222 conn(0x7f69ac0ce1f0 msgr2=0x7f69ac155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:00.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 shutdown_connections 2023-09-30T22:55:00.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.370+0000 7f69b37ff700 1 -- 172.21.15.142:0/1074169222 wait complete. 2023-09-30T22:55:00.374 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:55:00.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:55:00.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.580+0000 7f5cd73ff700 1 Processor -- start 2023-09-30T22:55:00.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.580+0000 7f5cd73ff700 1 -- start start 2023-09-30T22:55:00.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.581+0000 7f5cd73ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5cd015de20 0x7f5cd0164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.581+0000 7f5cd73ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd00cc6b0 con 0x7f5cd00692f0 2023-09-30T22:55:00.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.581+0000 7f5cd73ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd00cbaa0 con 0x7f5cd0143350 2023-09-30T22:55:00.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.581+0000 7f5cd73ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd00cbd80 con 0x7f5cd015de20 2023-09-30T22:55:00.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.581+0000 7f5cd499a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5cd00692f0 0x7f5cd015d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:36950/0 (socket says 172.21.15.142:36950) 2023-09-30T22:55:00.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.581+0000 7f5cd499a700 1 -- 172.21.15.142:0/885613175 learned_addr learned my addr 172.21.15.142:0/885613175 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cd599c700 1 --2- 172.21.15.142:0/885613175 >> v2:172.21.15.148:3300/0 conn(0x7f5cd015de20 0x7f5cd0164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921030428 0 0) 0x7f5cd00cc6b0 con 0x7f5cd00692f0 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cbc003570 con 0x7f5cd00692f0 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096071314 0 0) 0x7f5cd00cbaa0 con 0x7f5cd0143350 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd00cc6b0 con 0x7f5cd0143350 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1860204263 0 0) 0x7f5cbc003570 con 0x7f5cd00692f0 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 >> v2:172.21.15.148:3300/0 conn(0x7f5cd015de20 msgr2=0x7f5cd0164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 --2- 172.21.15.142:0/885613175 >> v2:172.21.15.148:3300/0 conn(0x7f5cd015de20 0x7f5cd0164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 >> v1:172.21.15.148:6789/0 conn(0x7f5cd0143350 legacy=0x7f5cd00cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd00cc060 con 0x7f5cd00692f0 2023-09-30T22:55:00.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f5cc0001470 con 0x7f5cd00692f0 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 >> v1:172.21.15.142:6789/0 conn(0x7f5cd00692f0 legacy=0x7f5cd015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc003c40 0x7f5cbc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc004810 0x7f5cbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00cbd80 con 0x7f5cbc005210 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc00c1b0 con 0x7f5cbc004810 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc00c370 con 0x7f5cbc003c40 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.582+0000 7f5cd599c700 1 --2- 172.21.15.142:0/885613175 >> v2:172.21.15.148:3300/0 conn(0x7f5cd015de20 0x7f5cd0164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd519b700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc003c40 0x7f5cbc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd499a700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc004810 0x7f5cbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 -- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc003c40 msgr2=0x7f5cbc004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cbc003c40 0x7f5cbc004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 -- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc004810 msgr2=0x7f5cbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cbc004810 0x7f5cbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 -- 172.21.15.142:0/885613175 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc003570 con 0x7f5cbc005210 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 -- 172.21.15.142:0/885613175 reap_dead start 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cd599c700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cbc00ba60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80094d0 tx=0x7f5cc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaadc128c0320ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8009cf0 con 0x7f5cbc005210 2023-09-30T22:55:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800f040 con 0x7f5cbc005210 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.583+0000 7f5cc7fff700 1 -- 172.21.15.142:0/885613175 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800ee40 con 0x7f5cbc005210 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.584+0000 7f5cd73ff700 1 -- 172.21.15.142:0/885613175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 msgr2=0x7f5cbc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.584+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cbc00ba60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80094d0 tx=0x7f5cc800b040 comp rx=0 tx=0).stop 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.584+0000 7f5cd73ff700 1 -- 172.21.15.142:0/885613175 shutdown_connections 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.584+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/885613175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cbc00ba60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.584+0000 7f5cd73ff700 1 -- 172.21.15.142:0/885613175 >> 172.21.15.142:0/885613175 conn(0x7f5cd00ce8e0 msgr2=0x7f5cd00cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.584+0000 7f5cd73ff700 1 -- 172.21.15.142:0/885613175 shutdown_connections 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.584+0000 7f5cd73ff700 1 -- 172.21.15.142:0/885613175 wait complete. 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.586+0000 7f5cd73ff700 1 Processor -- start 2023-09-30T22:55:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.586+0000 7f5cd73ff700 1 -- start start 2023-09-30T22:55:00.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.587+0000 7f5cd73ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cd013ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd73ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cd015aef0 0x7f5cd00b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd73ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cd013b0f0 0x7f5cd00b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd73ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd015a1c0 con 0x7f5cbc005210 2023-09-30T22:55:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd73ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd015aa60 con 0x7f5cd013b0f0 2023-09-30T22:55:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd73ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd013c390 con 0x7f5cd015aef0 2023-09-30T22:55:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cd013ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cd013ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59382/0 (socket says 172.21.15.142:59382) 2023-09-30T22:55:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 -- 172.21.15.142:0/1937909471 learned_addr learned my addr 172.21.15.142:0/1937909471 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd499a700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cd015aef0 0x7f5cd00b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd599c700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cd013b0f0 0x7f5cd00b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 -- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cd015aef0 msgr2=0x7f5cd00b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cd015aef0 0x7f5cd00b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 -- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cd013b0f0 msgr2=0x7f5cd00b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cd013b0f0 0x7f5cd00b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 -- 172.21.15.142:0/1937909471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd015a410 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.588+0000 7f5cd519b700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cd013ba90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc002b60 tx=0x7f5ccc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.589+0000 7f5cc57fa700 1 -- 172.21.15.142:0/1937909471 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00f870 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.589+0000 7f5cc57fa700 1 -- 172.21.15.142:0/1937909471 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00f9d0 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.589+0000 7f5cc57fa700 1 -- 172.21.15.142:0/1937909471 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00fd90 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.589+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd015a6f0 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.589+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd0159160 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.590+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd006ea70 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.591+0000 7f5cc57fa700 1 -- 172.21.15.142:0/1937909471 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5ccc006a30 con 0x7f5cbc005210 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.592+0000 7f5cc57fa700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5cb4067330 0x7f5cb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.592+0000 7f5cc57fa700 1 -- 172.21.15.142:0/1937909471 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5ccc084b50 con 0x7f5cbc005210 2023-09-30T22:55:00.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.592+0000 7f5cd499a700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5cb4067330 0x7f5cb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:00.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.592+0000 7f5cd499a700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5cb4067330 0x7f5cb40697e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0001120 tx=0x7f5cc0001d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:00.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.596+0000 7f5cc57fa700 1 -- 172.21.15.142:0/1937909471 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5ccc051d00 con 0x7f5cbc005210 2023-09-30T22:55:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.861+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5cd015ad40 con 0x7f5cbc005210 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.862+0000 7f5cc57fa700 1 -- 172.21.15.142:0/1937909471 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5ccc055320 con 0x7f5cbc005210 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:55:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:55:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.868 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.871 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.872 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T22:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:55:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:55:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:55:00.879 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:55:00.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5cb4067330 msgr2=0x7f5cb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5cb4067330 0x7f5cb40697e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0001120 tx=0x7f5cc0001d20 comp rx=0 tx=0).stop 2023-09-30T22:55:00.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 msgr2=0x7f5cd013ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:00.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cd013ba90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc002b60 tx=0x7f5ccc007d30 comp rx=0 tx=0).stop 2023-09-30T22:55:00.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 shutdown_connections 2023-09-30T22:55:00.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5cb4067330 0x7f5cb40697e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cd013b0f0 0x7f5cd00b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cbc005210 0x7f5cd013ba90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 --2- 172.21.15.142:0/1937909471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cd015aef0 0x7f5cd00b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:00.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 >> 172.21.15.142:0/1937909471 conn(0x7f5cd00ce8e0 msgr2=0x7f5cd00cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:00.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 shutdown_connections 2023-09-30T22:55:00.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:00.864+0000 7f5cd73ff700 1 -- 172.21.15.142:0/1937909471 wait complete. 2023-09-30T22:55:00.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:55:01.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.070+0000 7eff9b3ff700 1 Processor -- start 2023-09-30T22:55:01.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.070+0000 7eff9b3ff700 1 -- start start 2023-09-30T22:55:01.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff9b3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff941598e0 0x7eff94159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff9b3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9406b8d0 con 0x7eff940cee50 2023-09-30T22:55:01.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff9b3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff940cff40 con 0x7eff940d03d0 2023-09-30T22:55:01.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff9b3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940cf330 con 0x7eff941598e0 2023-09-30T22:55:01.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff9899a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7eff940cee50 0x7eff9406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56856/0 (socket says 172.21.15.142:56856) 2023-09-30T22:55:01.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff9899a700 1 -- 172.21.15.142:0/198159498 learned_addr learned my addr 172.21.15.142:0/198159498 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:01.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff9919b700 1 --2- 172.21.15.142:0/198159498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff941598e0 0x7eff94159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff8bfff700 1 -- 172.21.15.142:0/198159498 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745991732 0 0) 0x7eff9406b8d0 con 0x7eff940cee50 2023-09-30T22:55:01.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.072+0000 7eff8bfff700 1 -- 172.21.15.142:0/198159498 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff80003570 con 0x7eff940cee50 2023-09-30T22:55:01.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff8bfff700 1 -- 172.21.15.142:0/198159498 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934364669 0 0) 0x7eff940cff40 con 0x7eff940d03d0 2023-09-30T22:55:01.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff8bfff700 1 -- 172.21.15.142:0/198159498 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff9406b8d0 con 0x7eff940d03d0 2023-09-30T22:55:01.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff9919b700 1 -- 172.21.15.142:0/198159498 >> v1:172.21.15.148:6789/0 conn(0x7eff940d03d0 legacy=0x7eff9415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff9919b700 1 -- 172.21.15.142:0/198159498 >> v1:172.21.15.142:6789/0 conn(0x7eff940cee50 legacy=0x7eff9406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff9919b700 1 -- 172.21.15.142:0/198159498 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940cf610 con 0x7eff941598e0 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff9919b700 1 --2- 172.21.15.142:0/198159498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff941598e0 0x7eff94159cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff90009910 tx=0x7eff900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf2199c81173e8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff8bfff700 1 -- 172.21.15.142:0/198159498 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90011630 con 0x7eff941598e0 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff8bfff700 1 -- 172.21.15.142:0/198159498 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90011790 con 0x7eff941598e0 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.073+0000 7eff8bfff700 1 -- 172.21.15.142:0/198159498 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90011b30 con 0x7eff941598e0 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.074+0000 7eff9b3ff700 1 -- 172.21.15.142:0/198159498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff941598e0 msgr2=0x7eff94159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.074+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/198159498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff941598e0 0x7eff94159cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff90009910 tx=0x7eff900091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.074+0000 7eff9b3ff700 1 -- 172.21.15.142:0/198159498 shutdown_connections 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.074+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/198159498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff941598e0 0x7eff94159cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.074+0000 7eff9b3ff700 1 -- 172.21.15.142:0/198159498 >> 172.21.15.142:0/198159498 conn(0x7eff940cd540 msgr2=0x7eff940cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:01.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.074+0000 7eff9b3ff700 1 -- 172.21.15.142:0/198159498 shutdown_connections 2023-09-30T22:55:01.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.074+0000 7eff9b3ff700 1 -- 172.21.15.142:0/198159498 wait complete. 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.075+0000 7eff9b3ff700 1 Processor -- start 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.076+0000 7eff9b3ff700 1 -- start start 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.076+0000 7eff9b3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff940cee50 0x7eff940c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9b3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940d03d0 0x7eff9415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9b3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff941598e0 0x7eff9415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9b3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff94151280 con 0x7eff941598e0 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9b3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff94169f40 con 0x7eff940cee50 2023-09-30T22:55:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9b3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9416a200 con 0x7eff940d03d0 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff941598e0 0x7eff9415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff941598e0 0x7eff9415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39682/0 (socket says 172.21.15.142:39682) 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 -- 172.21.15.142:0/3814452417 learned_addr learned my addr 172.21.15.142:0/3814452417 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9919b700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff940cee50 0x7eff940c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9899a700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940d03d0 0x7eff9415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 -- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940d03d0 msgr2=0x7eff9415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940d03d0 0x7eff9415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 -- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff940cee50 msgr2=0x7eff940c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff940cee50 0x7eff940c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9999c700 1 -- 172.21.15.142:0/3814452417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009420 con 0x7eff941598e0 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.077+0000 7eff9919b700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff940cee50 0x7eff940c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:55:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.078+0000 7eff9999c700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff941598e0 0x7eff9415c660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c910 tx=0x7eff8c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.078+0000 7eff897fa700 1 -- 172.21.15.142:0/3814452417 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00a7e0 con 0x7eff941598e0 2023-09-30T22:55:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.078+0000 7eff897fa700 1 -- 172.21.15.142:0/3814452417 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00a960 con 0x7eff941598e0 2023-09-30T22:55:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.078+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9416a4e0 con 0x7eff941598e0 2023-09-30T22:55:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.078+0000 7eff897fa700 1 -- 172.21.15.142:0/3814452417 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00ad20 con 0x7eff941598e0 2023-09-30T22:55:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.078+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9416aaa0 con 0x7eff941598e0 2023-09-30T22:55:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.079+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff940697b0 con 0x7eff941598e0 2023-09-30T22:55:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.080+0000 7eff897fa700 1 -- 172.21.15.142:0/3814452417 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff8c012630 con 0x7eff941598e0 2023-09-30T22:55:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.081+0000 7eff897fa700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff78067330 0x7eff780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.081+0000 7eff897fa700 1 -- 172.21.15.142:0/3814452417 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7eff8c084d60 con 0x7eff941598e0 2023-09-30T22:55:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.081+0000 7eff9919b700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff78067330 0x7eff780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.082+0000 7eff9919b700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff78067330 0x7eff780697e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7eff900091e0 tx=0x7eff90017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.086+0000 7eff897fa700 1 -- 172.21.15.142:0/3814452417 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff8c052000 con 0x7eff941598e0 2023-09-30T22:55:01.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.280+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff9406fc10 con 0x7eff941598e0 2023-09-30T22:55:01.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.281+0000 7eff897fa700 1 -- 172.21.15.142:0/3814452417 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+13794 (secure 0 0 0) 0x7eff8c016090 con 0x7eff941598e0 2023-09-30T22:55:01.283 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:01.283 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":68,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:55:00.372276+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:55:01.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff78067330 msgr2=0x7eff780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff78067330 0x7eff780697e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7eff900091e0 tx=0x7eff90017000 comp rx=0 tx=0).stop 2023-09-30T22:55:01.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff941598e0 msgr2=0x7eff9415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff941598e0 0x7eff9415c660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c910 tx=0x7eff8c0027a0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 shutdown_connections 2023-09-30T22:55:01.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff78067330 0x7eff780697e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff941598e0 0x7eff9415c660 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff940cee50 0x7eff940c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 --2- 172.21.15.142:0/3814452417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940d03d0 0x7eff9415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 >> 172.21.15.142:0/3814452417 conn(0x7eff940cd540 msgr2=0x7eff9406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:01.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 shutdown_connections 2023-09-30T22:55:01.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.284+0000 7eff9b3ff700 1 -- 172.21.15.142:0/3814452417 wait complete. 2023-09-30T22:55:01.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:55:01.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:55:01.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.497+0000 7f3f9cbff700 1 Processor -- start 2023-09-30T22:55:01.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.497+0000 7f3f9cbff700 1 -- start start 2023-09-30T22:55:01.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.498+0000 7f3f9cbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f98157ab0 0x7f3f9815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.498+0000 7f3f9cbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f980cc3b0 0x7f3f980cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.498+0000 7f3f9cbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980d0550 con 0x7f3f980cbfe0 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.498+0000 7f3f9cbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980cf750 con 0x7f3f980cc3b0 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.498+0000 7f3f9cbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980cf940 con 0x7f3f98157ab0 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f96d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f980cc3b0 0x7f3f980cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f96d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f980cc3b0 0x7f3f980cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39684/0 (socket says 172.21.15.142:39684) 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f96d9d700 1 -- 172.21.15.142:0/1542845673 learned_addr learned my addr 172.21.15.142:0/1542845673 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f95d9b700 1 --2- 172.21.15.142:0/1542845673 >> v2:172.21.15.148:3300/0 conn(0x7f3f98157ab0 0x7f3f9815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f96d9d700 1 -- 172.21.15.142:0/1542845673 >> v2:172.21.15.148:3300/0 conn(0x7f3f98157ab0 msgr2=0x7f3f9815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f96d9d700 1 --2- 172.21.15.142:0/1542845673 >> v2:172.21.15.148:3300/0 conn(0x7f3f98157ab0 0x7f3f9815a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f96d9d700 1 -- 172.21.15.142:0/1542845673 >> v1:172.21.15.148:6789/0 conn(0x7f3f980cbfe0 legacy=0x7f3f981573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.499+0000 7f3f96d9d700 1 -- 172.21.15.142:0/1542845673 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980cfc20 con 0x7f3f980cc3b0 2023-09-30T22:55:01.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f96d9d700 1 --2- 172.21.15.142:0/1542845673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980cc3b0 0x7f3f980cf210 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3f980ced20 tx=0x7f3f90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97481e43a2844f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9559a700 1 -- 172.21.15.142:0/1542845673 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000e070 con 0x7f3f980cc3b0 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9559a700 1 -- 172.21.15.142:0/1542845673 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000ba50 con 0x7f3f980cc3b0 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9559a700 1 -- 172.21.15.142:0/1542845673 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900092e0 con 0x7f3f980cc3b0 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1542845673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980cc3b0 msgr2=0x7f3f980cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1542845673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980cc3b0 0x7f3f980cf210 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3f980ced20 tx=0x7f3f90009840 comp rx=0 tx=0).stop 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1542845673 shutdown_connections 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1542845673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980cc3b0 0x7f3f980cf210 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1542845673 >> v2:172.21.15.148:3300/0 conn(0x7f3f98157ab0 0x7f3f9815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1542845673 >> 172.21.15.142:0/1542845673 conn(0x7f3f980d0a80 msgr2=0x7f3f980d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:01.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1542845673 shutdown_connections 2023-09-30T22:55:01.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.500+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1542845673 wait complete. 2023-09-30T22:55:01.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.502+0000 7f3f9cbff700 1 Processor -- start 2023-09-30T22:55:01.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.503+0000 7f3f9cbff700 1 -- start start 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9cbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f980cbfe0 0x7f3f9816e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9cbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f980cc3b0 0x7f3f9816d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9cbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f98157ab0 0x7f3f9815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9cbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9816ea90 con 0x7f3f98157ab0 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9cbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9816a590 con 0x7f3f980cbfe0 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9cbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9816a850 con 0x7f3f980cc3b0 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f96d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f98157ab0 0x7f3f9815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f980cbfe0 0x7f3f9816e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f980cbfe0 0x7f3f9816e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:35398/0 (socket says 172.21.15.142:35398) 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f96d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f98157ab0 0x7f3f9815c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39700/0 (socket says 172.21.15.142:39700) 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f9659c700 1 -- 172.21.15.142:0/1071138378 learned_addr learned my addr 172.21.15.142:0/1071138378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.504+0000 7f3f95d9b700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f980cc3b0 0x7f3f9816d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f96d9d700 1 -- 172.21.15.142:0/1071138378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f980cc3b0 msgr2=0x7f3f9816d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f96d9d700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f980cc3b0 0x7f3f9816d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f96d9d700 1 -- 172.21.15.142:0/1071138378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f980cbfe0 msgr2=0x7f3f9816e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f96d9d700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f980cbfe0 0x7f3f9816e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f96d9d700 1 -- 172.21.15.142:0/1071138378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009ae0 con 0x7f3f98157ab0 2023-09-30T22:55:01.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f96d9d700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f98157ab0 0x7f3f9815c520 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3f90015000 tx=0x7f3f90018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f867fc700 1 -- 172.21.15.142:0/1071138378 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000be60 con 0x7f3f98157ab0 2023-09-30T22:55:01.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f867fc700 1 -- 172.21.15.142:0/1071138378 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90008d20 con 0x7f3f98157ab0 2023-09-30T22:55:01.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9816ab30 con 0x7f3f98157ab0 2023-09-30T22:55:01.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f867fc700 1 -- 172.21.15.142:0/1071138378 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900266b0 con 0x7f3f98157ab0 2023-09-30T22:55:01.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.505+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9816b0f0 con 0x7f3f98157ab0 2023-09-30T22:55:01.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.506+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9816b6c0 con 0x7f3f98157ab0 2023-09-30T22:55:01.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.507+0000 7f3f867fc700 1 -- 172.21.15.142:0/1071138378 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3f90003040 con 0x7f3f98157ab0 2023-09-30T22:55:01.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.508+0000 7f3f867fc700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f78067330 0x7f3f780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.508+0000 7f3f867fc700 1 -- 172.21.15.142:0/1071138378 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3f900867b0 con 0x7f3f98157ab0 2023-09-30T22:55:01.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.508+0000 7f3f9659c700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f78067330 0x7f3f780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.509+0000 7f3f9659c700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f78067330 0x7f3f780697e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f880078a0 tx=0x7f3f88007830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.512+0000 7f3f867fc700 1 -- 172.21.15.142:0/1071138378 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3f9816b6c0 con 0x7f3f98157ab0 2023-09-30T22:55:01.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.699+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f9816b6a0 con 0x7f3f98157ab0 2023-09-30T22:55:01.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.699+0000 7f3f867fc700 1 -- 172.21.15.142:0/1071138378 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f90053a10 con 0x7f3f98157ab0 2023-09-30T22:55:01.701 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:55:01.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.701+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f78067330 msgr2=0x7f3f780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.701+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f78067330 0x7f3f780697e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f880078a0 tx=0x7f3f88007830 comp rx=0 tx=0).stop 2023-09-30T22:55:01.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f98157ab0 msgr2=0x7f3f9815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f98157ab0 0x7f3f9815c520 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3f90015000 tx=0x7f3f90018000 comp rx=0 tx=0).stop 2023-09-30T22:55:01.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 shutdown_connections 2023-09-30T22:55:01.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f78067330 0x7f3f780697e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f98157ab0 0x7f3f9815c520 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f980cbfe0 0x7f3f9816e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 --2- 172.21.15.142:0/1071138378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f980cc3b0 0x7f3f9816d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 >> 172.21.15.142:0/1071138378 conn(0x7f3f980d0a80 msgr2=0x7f3f98156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:01.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 shutdown_connections 2023-09-30T22:55:01.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.702+0000 7f3f9cbff700 1 -- 172.21.15.142:0/1071138378 wait complete. 2023-09-30T22:55:01.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:55:01.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.911+0000 7f97599ff700 1 Processor -- start 2023-09-30T22:55:01.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.911+0000 7f97599ff700 1 -- start start 2023-09-30T22:55:01.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f97599ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97540c47f0 0x7f97541580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f97599ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540c38d0 con 0x7f9754141150 2023-09-30T22:55:01.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f97599ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540c6aa0 con 0x7f97540c6270 2023-09-30T22:55:01.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f97599ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975406a040 con 0x7f97540c47f0 2023-09-30T22:55:01.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f97537fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97540c47f0 0x7f97541580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f9752ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9754141150 0x7f975415c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56858/0 (socket says 172.21.15.142:56858) 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f9752ffd700 1 -- 172.21.15.142:0/1053319855 learned_addr learned my addr 172.21.15.142:0/1053319855 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f97537fe700 1 -- 172.21.15.142:0/1053319855 >> v1:172.21.15.148:6789/0 conn(0x7f97540c6270 legacy=0x7f97540c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f97537fe700 1 -- 172.21.15.142:0/1053319855 >> v1:172.21.15.142:6789/0 conn(0x7f9754141150 legacy=0x7f975415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.914+0000 7f97537fe700 1 -- 172.21.15.142:0/1053319855 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540c67c0 con 0x7f97540c47f0 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.913+0000 7f9751ffb700 1 -- 172.21.15.142:0/1053319855 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992191262 0 0) 0x7f97540c38d0 con 0x7f9754141150 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.914+0000 7f97537fe700 1 --2- 172.21.15.142:0/1053319855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97540c47f0 0x7f97541580c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f974c009e60 tx=0x7f974c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713d55e79eb207d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.914+0000 7f9751ffb700 1 -- 172.21.15.142:0/1053319855 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c00e070 con 0x7f97540c47f0 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.914+0000 7f9751ffb700 1 -- 172.21.15.142:0/1053319855 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c00bc30 con 0x7f97540c47f0 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.914+0000 7f9751ffb700 1 -- 172.21.15.142:0/1053319855 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c012430 con 0x7f97540c47f0 2023-09-30T22:55:01.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.914+0000 7f97599ff700 1 -- 172.21.15.142:0/1053319855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97540c47f0 msgr2=0x7f97541580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.914+0000 7f97599ff700 1 --2- 172.21.15.142:0/1053319855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97540c47f0 0x7f97541580c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f974c009e60 tx=0x7f974c009780 comp rx=0 tx=0).stop 2023-09-30T22:55:01.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.915+0000 7f97599ff700 1 -- 172.21.15.142:0/1053319855 shutdown_connections 2023-09-30T22:55:01.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.915+0000 7f97599ff700 1 --2- 172.21.15.142:0/1053319855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97540c47f0 0x7f97541580c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.915+0000 7f97599ff700 1 -- 172.21.15.142:0/1053319855 >> 172.21.15.142:0/1053319855 conn(0x7f97540cc670 msgr2=0x7f97540cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:01.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.915+0000 7f97599ff700 1 -- 172.21.15.142:0/1053319855 shutdown_connections 2023-09-30T22:55:01.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.915+0000 7f97599ff700 1 -- 172.21.15.142:0/1053319855 wait complete. 2023-09-30T22:55:01.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.917+0000 7f97599ff700 1 Processor -- start 2023-09-30T22:55:01.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.917+0000 7f97599ff700 1 -- start start 2023-09-30T22:55:01.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97599ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97540c47f0 0x7f975415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97599ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97540c6270 0x7f975413c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97599ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9754141150 0x7f975413b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97599ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540b8330 con 0x7f9754141150 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97599ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975415c460 con 0x7f97540c6270 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97599ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975413cac0 con 0x7f97540c47f0 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97537fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9754141150 0x7f975413b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97537fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9754141150 0x7f975413b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39718/0 (socket says 172.21.15.142:39718) 2023-09-30T22:55:01.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f97537fe700 1 -- 172.21.15.142:0/1279686520 learned_addr learned my addr 172.21.15.142:0/1279686520 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.918+0000 7f9752ffd700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97540c47f0 0x7f975415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97527fc700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97540c6270 0x7f975413c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97537fe700 1 -- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97540c47f0 msgr2=0x7f975415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97537fe700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97540c47f0 0x7f975415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97537fe700 1 -- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97540c6270 msgr2=0x7f975413c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97537fe700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97540c6270 0x7f975413c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97537fe700 1 -- 172.21.15.142:0/1279686520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c009a20 con 0x7f9754141150 2023-09-30T22:55:01.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97537fe700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9754141150 0x7f975413b9e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f97540c3a80 tx=0x7f974c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f973affd700 1 -- 172.21.15.142:0/1279686520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c01b420 con 0x7f9754141150 2023-09-30T22:55:01.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f973affd700 1 -- 172.21.15.142:0/1279686520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c01b580 con 0x7f9754141150 2023-09-30T22:55:01.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975416e600 con 0x7f9754141150 2023-09-30T22:55:01.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.919+0000 7f973affd700 1 -- 172.21.15.142:0/1279686520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c01b940 con 0x7f9754141150 2023-09-30T22:55:01.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.920+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975413c290 con 0x7f9754141150 2023-09-30T22:55:01.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.920+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975415c5f0 con 0x7f9754141150 2023-09-30T22:55:01.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.921+0000 7f973affd700 1 -- 172.21.15.142:0/1279686520 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f974c01bcb0 con 0x7f9754141150 2023-09-30T22:55:01.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.922+0000 7f973affd700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9740067330 0x7f97400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:01.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.922+0000 7f973affd700 1 -- 172.21.15.142:0/1279686520 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f974c086840 con 0x7f9754141150 2023-09-30T22:55:01.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.922+0000 7f9752ffd700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9740067330 0x7f97400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:01.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.923+0000 7f9752ffd700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9740067330 0x7f97400697e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9744007160 tx=0x7f9744007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:01.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:01.927+0000 7f973affd700 1 -- 172.21.15.142:0/1279686520 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f974c0539f0 con 0x7f9754141150 2023-09-30T22:55:02.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.115+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9754158420 con 0x7f9754141150 2023-09-30T22:55:02.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.115+0000 7f973affd700 1 -- 172.21.15.142:0/1279686520 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f974c057010 con 0x7f9754141150 2023-09-30T22:55:02.116 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:55:02.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9740067330 msgr2=0x7f97400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9740067330 0x7f97400697e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9744007160 tx=0x7f9744007f50 comp rx=0 tx=0).stop 2023-09-30T22:55:02.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9754141150 msgr2=0x7f975413b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9754141150 0x7f975413b9e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f97540c3a80 tx=0x7f974c019000 comp rx=0 tx=0).stop 2023-09-30T22:55:02.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 shutdown_connections 2023-09-30T22:55:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9740067330 0x7f97400697e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9754141150 0x7f975413b9e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f97540c47f0 0x7f975415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 --2- 172.21.15.142:0/1279686520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97540c6270 0x7f975413c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 >> 172.21.15.142:0/1279686520 conn(0x7f97540cc670 msgr2=0x7f9754160860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 shutdown_connections 2023-09-30T22:55:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.118+0000 7f97599ff700 1 -- 172.21.15.142:0/1279686520 wait complete. 2023-09-30T22:55:02.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:55:02.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.326+0000 7f96d3bff700 1 Processor -- start 2023-09-30T22:55:02.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.326+0000 7f96d3bff700 1 -- start start 2023-09-30T22:55:02.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d3bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96cc0b1180 0x7f96cc0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d3bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d3bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc15d910 con 0x7f96cc159ae0 2023-09-30T22:55:02.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d3bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc15e920 con 0x7f96cc0b1180 2023-09-30T22:55:02.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d3bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc15e490 con 0x7f96cc159eb0 2023-09-30T22:55:02.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d119a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96cc0b1180 0x7f96cc0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d119a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96cc0b1180 0x7f96cc0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39734/0 (socket says 172.21.15.142:39734) 2023-09-30T22:55:02.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.327+0000 7f96d119a700 1 -- 172.21.15.142:0/2220050183 learned_addr learned my addr 172.21.15.142:0/2220050183 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:02.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d219c700 1 --2- 172.21.15.142:0/2220050183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d119a700 1 -- 172.21.15.142:0/2220050183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 msgr2=0x7f96cc0cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:02.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d119a700 1 --2- 172.21.15.142:0/2220050183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc0cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d119a700 1 -- 172.21.15.142:0/2220050183 >> v1:172.21.15.148:6789/0 conn(0x7f96cc159ae0 legacy=0x7f96cc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d119a700 1 -- 172.21.15.142:0/2220050183 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0ce5c0 con 0x7f96cc0b1180 2023-09-30T22:55:02.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d119a700 1 --2- 172.21.15.142:0/2220050183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc0b1180 0x7f96cc0cbe80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0099b0 tx=0x7f96bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513bd8d81b44905c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:02.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d0999700 1 -- 172.21.15.142:0/2220050183 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00b860 con 0x7f96cc0b1180 2023-09-30T22:55:02.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d0999700 1 -- 172.21.15.142:0/2220050183 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00b9c0 con 0x7f96cc0b1180 2023-09-30T22:55:02.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.328+0000 7f96d0999700 1 -- 172.21.15.142:0/2220050183 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00bd60 con 0x7f96cc0b1180 2023-09-30T22:55:02.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 -- 172.21.15.142:0/2220050183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc0b1180 msgr2=0x7f96cc0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 --2- 172.21.15.142:0/2220050183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc0b1180 0x7f96cc0cbe80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0099b0 tx=0x7f96bc009250 comp rx=0 tx=0).stop 2023-09-30T22:55:02.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 -- 172.21.15.142:0/2220050183 shutdown_connections 2023-09-30T22:55:02.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 --2- 172.21.15.142:0/2220050183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc0cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 --2- 172.21.15.142:0/2220050183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc0b1180 0x7f96cc0cbe80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 -- 172.21.15.142:0/2220050183 >> 172.21.15.142:0/2220050183 conn(0x7f96cc0ce8b0 msgr2=0x7f96cc0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:02.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 -- 172.21.15.142:0/2220050183 shutdown_connections 2023-09-30T22:55:02.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.329+0000 7f96d3bff700 1 -- 172.21.15.142:0/2220050183 wait complete. 2023-09-30T22:55:02.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.330+0000 7f96d3bff700 1 Processor -- start 2023-09-30T22:55:02.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.331+0000 7f96d3bff700 1 -- start start 2023-09-30T22:55:02.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.331+0000 7f96d3bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96cc0b1180 0x7f96cc14bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.331+0000 7f96d3bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc159ae0 0x7f96cc14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d3bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc16a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d3bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc14d250 con 0x7f96cc159ae0 2023-09-30T22:55:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d3bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc14c700 con 0x7f96cc0b1180 2023-09-30T22:55:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d3bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc14c9b0 con 0x7f96cc159eb0 2023-09-30T22:55:02.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc159ae0 0x7f96cc14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc159ae0 0x7f96cc14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39736/0 (socket says 172.21.15.142:39736) 2023-09-30T22:55:02.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 -- 172.21.15.142:0/507628566 learned_addr learned my addr 172.21.15.142:0/507628566 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:02.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d219c700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc16a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d199b700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96cc0b1180 0x7f96cc14bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 -- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 msgr2=0x7f96cc16a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc16a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 -- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96cc0b1180 msgr2=0x7f96cc14bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96cc0b1180 0x7f96cc14bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 -- 172.21.15.142:0/507628566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0094f0 con 0x7f96cc159ae0 2023-09-30T22:55:02.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.332+0000 7f96d119a700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc159ae0 0x7f96cc14c1c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f96cc063f90 tx=0x7f96bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:02.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.333+0000 7f96c1ffb700 1 -- 172.21.15.142:0/507628566 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc024440 con 0x7f96cc159ae0 2023-09-30T22:55:02.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.333+0000 7f96c1ffb700 1 -- 172.21.15.142:0/507628566 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc0245c0 con 0x7f96cc159ae0 2023-09-30T22:55:02.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.333+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc14cc90 con 0x7f96cc159ae0 2023-09-30T22:55:02.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.333+0000 7f96c1ffb700 1 -- 172.21.15.142:0/507628566 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc024980 con 0x7f96cc159ae0 2023-09-30T22:55:02.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.333+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc0c8be0 con 0x7f96cc159ae0 2023-09-30T22:55:02.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.334+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc06ea70 con 0x7f96cc159ae0 2023-09-30T22:55:02.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.335+0000 7f96c1ffb700 1 -- 172.21.15.142:0/507628566 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f96bc01a420 con 0x7f96cc159ae0 2023-09-30T22:55:02.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.336+0000 7f96c1ffb700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96b0067330 0x7f96b00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.336+0000 7f96c1ffb700 1 -- 172.21.15.142:0/507628566 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f96bc086730 con 0x7f96cc159ae0 2023-09-30T22:55:02.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.336+0000 7f96d199b700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96b0067330 0x7f96b00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.337+0000 7f96d199b700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96b0067330 0x7f96b00697e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f96cc06b230 tx=0x7f96c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.340+0000 7f96c1ffb700 1 -- 172.21.15.142:0/507628566 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f96bc0538e0 con 0x7f96cc159ae0 2023-09-30T22:55:02.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.535+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f96cc15db60 con 0x7f96cc159ae0 2023-09-30T22:55:02.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.536+0000 7f96c1ffb700 1 -- 172.21.15.142:0/507628566 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+126 (secure 0 0 0) 0x7f96bc056f00 con 0x7f96cc159ae0 2023-09-30T22:55:02.537 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:02.537 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:55:02.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:02.537 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:55:02.538 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:55:02.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:55:02.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:55:02.538 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:55:02.538 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:55:02.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:55:02.538 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:55:02.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96b0067330 msgr2=0x7f96b00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96b0067330 0x7f96b00697e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f96cc06b230 tx=0x7f96c8009040 comp rx=0 tx=0).stop 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc159ae0 msgr2=0x7f96cc14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc159ae0 0x7f96cc14c1c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f96cc063f90 tx=0x7f96bc017000 comp rx=0 tx=0).stop 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 shutdown_connections 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96b0067330 0x7f96b00697e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96cc159eb0 0x7f96cc16a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96cc0b1180 0x7f96cc14bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 --2- 172.21.15.142:0/507628566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96cc159ae0 0x7f96cc14c1c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 >> 172.21.15.142:0/507628566 conn(0x7f96cc0ce8b0 msgr2=0x7f96cc153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:02.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 shutdown_connections 2023-09-30T22:55:02.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.538+0000 7f96d3bff700 1 -- 172.21.15.142:0/507628566 wait complete. 2023-09-30T22:55:02.557 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:55:02.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:55:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.750+0000 7f3bc67ff700 1 Processor -- start 2023-09-30T22:55:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.750+0000 7f3bc67ff700 1 -- start start 2023-09-30T22:55:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc67ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3bc00cc280 0x7f3bc015a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc67ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bc00cf180 0x7f3bc006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc67ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00d04e0 con 0x7f3bc015ac40 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc67ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00cc8f0 con 0x7f3bc00cf180 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc67ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00cf8d0 con 0x7f3bc00cc280 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc4d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bc00cf180 0x7f3bc006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc4d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bc00cf180 0x7f3bc006a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39744/0 (socket says 172.21.15.142:39744) 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc4d9c700 1 -- 172.21.15.142:0/3055758671 learned_addr learned my addr 172.21.15.142:0/3055758671 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc4d9c700 1 -- 172.21.15.142:0/3055758671 >> v2:172.21.15.148:3300/0 conn(0x7f3bc00cc280 msgr2=0x7f3bc015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc4d9c700 1 --2- 172.21.15.142:0/3055758671 >> v2:172.21.15.148:3300/0 conn(0x7f3bc00cc280 0x7f3bc015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc4d9c700 1 -- 172.21.15.142:0/3055758671 >> v1:172.21.15.148:6789/0 conn(0x7f3bc015ac40 legacy=0x7f3bc00cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.752+0000 7f3bc4d9c700 1 -- 172.21.15.142:0/3055758671 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00cfbb0 con 0x7f3bc00cf180 2023-09-30T22:55:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bc4d9c700 1 --2- 172.21.15.142:0/3055758671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cf180 0x7f3bc006a1f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00cd4c0 tx=0x7f3bb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69b7654b681309b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bbf7fe700 1 -- 172.21.15.142:0/3055758671 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800e070 con 0x7f3bc00cf180 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bbf7fe700 1 -- 172.21.15.142:0/3055758671 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800ba10 con 0x7f3bc00cf180 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bbf7fe700 1 -- 172.21.15.142:0/3055758671 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80092e0 con 0x7f3bc00cf180 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bc67ff700 1 -- 172.21.15.142:0/3055758671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cf180 msgr2=0x7f3bc006a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/3055758671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cf180 0x7f3bc006a1f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00cd4c0 tx=0x7f3bb8009840 comp rx=0 tx=0).stop 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bc67ff700 1 -- 172.21.15.142:0/3055758671 shutdown_connections 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/3055758671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cf180 0x7f3bc006a1f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/3055758671 >> v2:172.21.15.148:3300/0 conn(0x7f3bc00cc280 0x7f3bc015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.753+0000 7f3bc67ff700 1 -- 172.21.15.142:0/3055758671 >> 172.21.15.142:0/3055758671 conn(0x7f3bc00d0a80 msgr2=0x7f3bc00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.754+0000 7f3bc67ff700 1 -- 172.21.15.142:0/3055758671 shutdown_connections 2023-09-30T22:55:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.754+0000 7f3bc67ff700 1 -- 172.21.15.142:0/3055758671 wait complete. 2023-09-30T22:55:02.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.755+0000 7f3bc67ff700 1 Processor -- start 2023-09-30T22:55:02.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.755+0000 7f3bc67ff700 1 -- start start 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bc67ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cc280 0x7f3bc0153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bc67ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bc00cf180 0x7f3bc0153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bc67ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bc015ac40 0x7f3bc016c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bc67ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0140880 con 0x7f3bc00cc280 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bc67ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc016d720 con 0x7f3bc015ac40 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bc67ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc016da00 con 0x7f3bc00cf180 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bbffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cc280 0x7f3bc0153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bbffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cc280 0x7f3bc0153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39750/0 (socket says 172.21.15.142:39750) 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.756+0000 7f3bbffff700 1 -- 172.21.15.142:0/1802947808 learned_addr learned my addr 172.21.15.142:0/1802947808 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bc4d9c700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bc015ac40 0x7f3bc016c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bb7fff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bc00cf180 0x7f3bc0153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbffff700 1 -- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bc00cf180 msgr2=0x7f3bc0153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbffff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bc00cf180 0x7f3bc0153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbffff700 1 -- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bc015ac40 msgr2=0x7f3bc016c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbffff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bc015ac40 0x7f3bc016c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbffff700 1 -- 172.21.15.142:0/1802947808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009ae0 con 0x7f3bc00cc280 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bc4d9c700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bc015ac40 0x7f3bc016c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bb7fff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bc00cf180 0x7f3bc0153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbffff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cc280 0x7f3bc0153420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b5e0 tx=0x7f3bb00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbcff9700 1 -- 172.21.15.142:0/1802947808 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000f510 con 0x7f3bc00cc280 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbcff9700 1 -- 172.21.15.142:0/1802947808 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000f690 con 0x7f3bc00cc280 2023-09-30T22:55:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc0140230 con 0x7f3bc00cc280 2023-09-30T22:55:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bbcff9700 1 -- 172.21.15.142:0/1802947808 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000fa50 con 0x7f3bc00cc280 2023-09-30T22:55:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.757+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc016cec0 con 0x7f3bc00cc280 2023-09-30T22:55:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.758+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc0069770 con 0x7f3bc00cc280 2023-09-30T22:55:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.759+0000 7f3bbcff9700 1 -- 172.21.15.142:0/1802947808 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3bb001a400 con 0x7f3bc00cc280 2023-09-30T22:55:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.760+0000 7f3bbcff9700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ba0067330 0x7f3ba00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.760+0000 7f3bbcff9700 1 -- 172.21.15.142:0/1802947808 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3bb0084400 con 0x7f3bc00cc280 2023-09-30T22:55:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.760+0000 7f3bb7fff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ba0067330 0x7f3ba00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.761+0000 7f3bb7fff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ba0067330 0x7f3ba00697e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8006fd0 tx=0x7f3ba8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:02.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.764+0000 7f3bbcff9700 1 -- 172.21.15.142:0/1802947808 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3bb0051630 con 0x7f3bc00cc280 2023-09-30T22:55:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:02.955+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3bc006fc10 con 0x7f3bc00cc280 2023-09-30T22:55:03.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.375+0000 7f3bbcff9700 1 -- 172.21.15.142:0/1802947808 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3bb0054c50 con 0x7f3bc00cc280 2023-09-30T22:55:03.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.379+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ba0067330 msgr2=0x7f3ba00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:03.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.379+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ba0067330 0x7f3ba00697e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8006fd0 tx=0x7f3ba8008040 comp rx=0 tx=0).stop 2023-09-30T22:55:03.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.379+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cc280 msgr2=0x7f3bc0153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:03.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.379+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cc280 0x7f3bc0153420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b5e0 tx=0x7f3bb00090f0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 shutdown_connections 2023-09-30T22:55:03.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ba0067330 0x7f3ba00697e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bc015ac40 0x7f3bc016c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc00cc280 0x7f3bc0153420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 --2- 172.21.15.142:0/1802947808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3bc00cf180 0x7f3bc0153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 >> 172.21.15.142:0/1802947808 conn(0x7f3bc00d0a80 msgr2=0x7f3bc0159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:03.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 shutdown_connections 2023-09-30T22:55:03.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.380+0000 7f3bc67ff700 1 -- 172.21.15.142:0/1802947808 wait complete. 2023-09-30T22:55:03.382 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:55:03.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:55:03.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.594+0000 7f1cdefff700 1 Processor -- start 2023-09-30T22:55:03.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.594+0000 7f1cdefff700 1 -- start start 2023-09-30T22:55:03.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cdefff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 0x7f1cd806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cdefff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd81576e0 con 0x7f1cd81509d0 2023-09-30T22:55:03.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cdefff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd815a490 con 0x7f1cd815a920 2023-09-30T22:55:03.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cdefff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80cc320 con 0x7f1cd8150600 2023-09-30T22:55:03.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cd7fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1cd81509d0 0x7f1cd8156710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56872/0 (socket says 172.21.15.142:56872) 2023-09-30T22:55:03.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cd7fff700 1 -- 172.21.15.142:0/2742886095 learned_addr learned my addr 172.21.15.142:0/2742886095 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cdcd9b700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 0x7f1cd806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149096098 0 0) 0x7f1cd81576e0 con 0x7f1cd81509d0 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.596+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc8003570 con 0x7f1cd81509d0 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738734726 0 0) 0x7f1cd815a490 con 0x7f1cd815a920 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd81576e0 con 0x7f1cd815a920 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823689728 0 0) 0x7f1cc8003570 con 0x7f1cd81509d0 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 msgr2=0x7f1cd806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 0x7f1cd806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 >> v1:172.21.15.148:6789/0 conn(0x7f1cd815a920 legacy=0x7f1cd80ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8157400 con 0x7f1cd81509d0 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f1cc4001470 con 0x7f1cd81509d0 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 >> v1:172.21.15.142:6789/0 conn(0x7f1cd81509d0 legacy=0x7f1cd8156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8003c20 0x7f1cc8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 0x7f1cc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc8004d50 0x7f1cc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80cc320 con 0x7f1cc8004d50 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc800bb40 con 0x7f1cc8003c20 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc800bd00 con 0x7f1cd8150600 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cdd59c700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc8004d50 0x7f1cc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cd7fff700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 0x7f1cc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.597+0000 7f1cdcd9b700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8003c20 0x7f1cc8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cdd59c700 1 -- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 msgr2=0x7f1cc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cdd59c700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 0x7f1cc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cdd59c700 1 -- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8003c20 msgr2=0x7f1cc8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cdd59c700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8003c20 0x7f1cc8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cdd59c700 1 -- 172.21.15.142:0/2742886095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc8003570 con 0x7f1cc8004d50 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cd7fff700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd8150600 0x7f1cc8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cdd59c700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc8004d50 0x7f1cc80051c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0002120 tx=0x7f1cd00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a764d4bcfc0a92d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0001ab0 con 0x7f1cc8004d50 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000c980 con 0x7f1cc8004d50 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.598+0000 7f1cd77fe700 1 -- 172.21.15.142:0/2742886095 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000cd20 con 0x7f1cc8004d50 2023-09-30T22:55:03.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.599+0000 7f1cdefff700 1 -- 172.21.15.142:0/2742886095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc8004d50 msgr2=0x7f1cc80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:03.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.599+0000 7f1cdefff700 1 --2- 172.21.15.142:0/2742886095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc8004d50 0x7f1cc80051c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0002120 tx=0x7f1cd00017a0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.599+0000 7f1cdd59c700 1 -- 172.21.15.142:0/2742886095 reap_dead start 2023-09-30T22:55:03.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.599+0000 7f1cdefff700 1 -- 172.21.15.142:0/2742886095 shutdown_connections 2023-09-30T22:55:03.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.599+0000 7f1cdefff700 1 -- 172.21.15.142:0/2742886095 >> 172.21.15.142:0/2742886095 conn(0x7f1cd80cc670 msgr2=0x7f1cd80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:03.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.599+0000 7f1cdefff700 1 -- 172.21.15.142:0/2742886095 shutdown_connections 2023-09-30T22:55:03.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.599+0000 7f1cdefff700 1 -- 172.21.15.142:0/2742886095 wait complete. 2023-09-30T22:55:03.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.600+0000 7f1cdefff700 1 Processor -- start 2023-09-30T22:55:03.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.600+0000 7f1cdefff700 1 -- start start 2023-09-30T22:55:03.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.601+0000 7f1cdefff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8004d50 0x7f1cd81401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.601+0000 7f1cdefff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd814c620 0x7f1cd814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.601+0000 7f1cdefff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cd8158860 0x7f1cd8158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.601+0000 7f1cdefff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8140730 con 0x7f1cd8158860 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.601+0000 7f1cdefff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8159210 con 0x7f1cc8004d50 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.601+0000 7f1cdefff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd81417b0 con 0x7f1cd814c620 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.601+0000 7f1cdd59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cd8158860 0x7f1cd8158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cd8158860 0x7f1cd8158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39774/0 (socket says 172.21.15.142:39774) 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 -- 172.21.15.142:0/478183806 learned_addr learned my addr 172.21.15.142:0/478183806 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdcd9b700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8004d50 0x7f1cd81401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cd7fff700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd814c620 0x7f1cd814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 -- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd814c620 msgr2=0x7f1cd814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd814c620 0x7f1cd814ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 -- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8004d50 msgr2=0x7f1cd81401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:03.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8004d50 0x7f1cd81401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 -- 172.21.15.142:0/478183806 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8141480 con 0x7f1cd8158860 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdcd9b700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8004d50 0x7f1cd81401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cdd59c700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cd8158860 0x7f1cd8158cd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c6a0 tx=0x7f1cd0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cd4ff9700 1 -- 172.21.15.142:0/478183806 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0001ab0 con 0x7f1cd8158860 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cd4ff9700 1 -- 172.21.15.142:0/478183806 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000c6d0 con 0x7f1cd8158860 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.602+0000 7f1cd4ff9700 1 -- 172.21.15.142:0/478183806 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0012d20 con 0x7f1cd8158860 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.603+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd814d0e0 con 0x7f1cd8158860 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.603+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd814d6a0 con 0x7f1cd8158860 2023-09-30T22:55:03.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.604+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd8141960 con 0x7f1cd8158860 2023-09-30T22:55:03.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.605+0000 7f1cd4ff9700 1 -- 172.21.15.142:0/478183806 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1cd0025030 con 0x7f1cd8158860 2023-09-30T22:55:03.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.606+0000 7f1cd4ff9700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1cbc067330 0x7f1cbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:03.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.606+0000 7f1cd4ff9700 1 -- 172.21.15.142:0/478183806 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f1cd00867f0 con 0x7f1cd8158860 2023-09-30T22:55:03.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.606+0000 7f1cdcd9b700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1cbc067330 0x7f1cbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:03.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.606+0000 7f1cdcd9b700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1cbc067330 0x7f1cbc0697e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006f00 tx=0x7f1ccc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:03.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.610+0000 7f1cd4ff9700 1 -- 172.21.15.142:0/478183806 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1cd8141960 con 0x7f1cd8158860 2023-09-30T22:55:03.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:03.801+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1cd814fe90 con 0x7f1cd8158860 2023-09-30T22:55:04.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.384+0000 7f1cd4ff9700 1 -- 172.21.15.142:0/478183806 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1cd002d070 con 0x7f1cd8158860 2023-09-30T22:55:04.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.392+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1cbc067330 msgr2=0x7f1cbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:04.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.392+0000 7f1cdefff700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1cbc067330 0x7f1cbc0697e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006f00 tx=0x7f1ccc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.392+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cd8158860 msgr2=0x7f1cd8158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:04.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.392+0000 7f1cdefff700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cd8158860 0x7f1cd8158cd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c6a0 tx=0x7f1cd0016000 comp rx=0 tx=0).stop 2023-09-30T22:55:04.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.394+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 shutdown_connections 2023-09-30T22:55:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.394+0000 7f1cdefff700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1cbc067330 0x7f1cbc0697e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.394+0000 7f1cdefff700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cd8158860 0x7f1cd8158cd0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.394+0000 7f1cdefff700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8004d50 0x7f1cd81401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.394+0000 7f1cdefff700 1 --2- 172.21.15.142:0/478183806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cd814c620 0x7f1cd814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.394+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 >> 172.21.15.142:0/478183806 conn(0x7f1cd80cc670 msgr2=0x7f1cd814a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:04.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.394+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 shutdown_connections 2023-09-30T22:55:04.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.395+0000 7f1cdefff700 1 -- 172.21.15.142:0/478183806 wait complete. 2023-09-30T22:55:04.397 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:55:04.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:55:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.607+0000 7fb8057ff700 1 Processor -- start 2023-09-30T22:55:04.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.607+0000 7fb8057ff700 1 -- start start 2023-09-30T22:55:04.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.608+0000 7fb8057ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb800069f10 0x7fb8000c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:04.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.608+0000 7fb8057ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000c7690 con 0x7fb8000cb350 2023-09-30T22:55:04.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.608+0000 7fb8057ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000c7f20 con 0x7fb8000c52a0 2023-09-30T22:55:04.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.608+0000 7fb8057ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8001406a0 con 0x7fb800069f10 2023-09-30T22:55:04.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7ff7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb8000cb350 0x7fb8001605e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56876/0 (socket says 172.21.15.142:56876) 2023-09-30T22:55:04.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7ff7fe700 1 -- 172.21.15.142:0/761863034 learned_addr learned my addr 172.21.15.142:0/761863034 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:04.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fe7fc700 1 --2- 172.21.15.142:0/761863034 >> v2:172.21.15.148:3300/0 conn(0x7fb800069f10 0x7fb8000c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057470192 0 0) 0x7fb7f8001490 con 0x7fb8000cb350 2023-09-30T22:55:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e8003570 con 0x7fb8000cb350 2023-09-30T22:55:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734622655 0 0) 0x7fb8000c7f20 con 0x7fb8000c52a0 2023-09-30T22:55:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f8001490 con 0x7fb8000c52a0 2023-09-30T22:55:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 568032923 0 0) 0x7fb7e8003570 con 0x7fb8000cb350 2023-09-30T22:55:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fe7fc700 1 -- 172.21.15.142:0/761863034 >> v1:172.21.15.148:6789/0 conn(0x7fb8000c52a0 legacy=0x7fb8000c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:04.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fe7fc700 1 -- 172.21.15.142:0/761863034 >> v1:172.21.15.142:6789/0 conn(0x7fb8000cb350 legacy=0x7fb8001605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.609+0000 7fb7fe7fc700 1 -- 172.21.15.142:0/761863034 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80006a3f0 con 0x7fb800069f10 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.610+0000 7fb7fe7fc700 1 --2- 172.21.15.142:0/761863034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb800069f10 0x7fb8000c5670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098e0 tx=0x7fb7f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b4fb2700d5a3839 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.610+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8001980 con 0x7fb800069f10 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.610+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4011420 con 0x7fb800069f10 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.610+0000 7fb7fdffb700 1 -- 172.21.15.142:0/761863034 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40117c0 con 0x7fb800069f10 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.610+0000 7fb8057ff700 1 -- 172.21.15.142:0/761863034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb800069f10 msgr2=0x7fb8000c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.610+0000 7fb8057ff700 1 --2- 172.21.15.142:0/761863034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb800069f10 0x7fb8000c5670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098e0 tx=0x7fb7f40091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.611+0000 7fb8057ff700 1 -- 172.21.15.142:0/761863034 shutdown_connections 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.611+0000 7fb8057ff700 1 --2- 172.21.15.142:0/761863034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb800069f10 0x7fb8000c5670 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.611+0000 7fb8057ff700 1 -- 172.21.15.142:0/761863034 >> 172.21.15.142:0/761863034 conn(0x7fb8000cc670 msgr2=0x7fb8000cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.611+0000 7fb8057ff700 1 -- 172.21.15.142:0/761863034 shutdown_connections 2023-09-30T22:55:04.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.611+0000 7fb8057ff700 1 -- 172.21.15.142:0/761863034 wait complete. 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.612+0000 7fb8057ff700 1 Processor -- start 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.612+0000 7fb8057ff700 1 -- start start 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.613+0000 7fb8057ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb800069f10 0x7fb8000c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.613+0000 7fb8057ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8000c52a0 0x7fb8000c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.613+0000 7fb8057ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000cb350 0x7fb80013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.613+0000 7fb8057ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c23d0 con 0x7fb8000cb350 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.613+0000 7fb8057ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c0ed0 con 0x7fb8000c52a0 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.613+0000 7fb8057ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c0bf0 con 0x7fb800069f10 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000cb350 0x7fb80013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:04.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000cb350 0x7fb80013f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39788/0 (socket says 172.21.15.142:39788) 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 -- 172.21.15.142:0/2066731844 learned_addr learned my addr 172.21.15.142:0/2066731844 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7fe7fc700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8000c52a0 0x7fb8000c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7feffd700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb800069f10 0x7fb8000c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 -- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb800069f10 msgr2=0x7fb8000c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb800069f10 0x7fb8000c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 -- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8000c52a0 msgr2=0x7fb8000c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8000c52a0 0x7fb8000c03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 -- 172.21.15.142:0/2066731844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009420 con 0x7fb8000cb350 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7ff7fe700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000cb350 0x7fb80013f1d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800cd60 tx=0x7fb7f8007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7e6ffd700 1 -- 172.21.15.142:0/2066731844 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8004dc0 con 0x7fb8000cb350 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7e6ffd700 1 -- 172.21.15.142:0/2066731844 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f800a830 con 0x7fb8000cb350 2023-09-30T22:55:04.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.614+0000 7fb7e6ffd700 1 -- 172.21.15.142:0/2066731844 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800abf0 con 0x7fb8000cb350 2023-09-30T22:55:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.615+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000c2600 con 0x7fb8000cb350 2023-09-30T22:55:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.615+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000c2bc0 con 0x7fb8000cb350 2023-09-30T22:55:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.616+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8000c2de0 con 0x7fb8000cb350 2023-09-30T22:55:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.616+0000 7fb7e6ffd700 1 -- 172.21.15.142:0/2066731844 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb7f8007150 con 0x7fb8000cb350 2023-09-30T22:55:04.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.618+0000 7fb7e6ffd700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb7ec067330 0x7fb7ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.618+0000 7fb7e6ffd700 1 -- 172.21.15.142:0/2066731844 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fb7f8084120 con 0x7fb8000cb350 2023-09-30T22:55:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.618+0000 7fb7feffd700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb7ec067330 0x7fb7ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:04.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.618+0000 7fb7feffd700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb7ec067330 0x7fb7ec0697e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0007fd0 tx=0x7fb7f0007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:04.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.622+0000 7fb7e6ffd700 1 -- 172.21.15.142:0/2066731844 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb7f8051060 con 0x7fb8000cb350 2023-09-30T22:55:04.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:04.853+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb8000c7690 con 0x7fb8000cb350 2023-09-30T22:55:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.383+0000 7fb7e6ffd700 1 -- 172.21.15.142:0/2066731844 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v29) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb8000c7690 con 0x7fb8000cb350 2023-09-30T22:55:05.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.403+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb7ec067330 msgr2=0x7fb7ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.403+0000 7fb8057ff700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb7ec067330 0x7fb7ec0697e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0007fd0 tx=0x7fb7f0007d10 comp rx=0 tx=0).stop 2023-09-30T22:55:05.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.403+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000cb350 msgr2=0x7fb80013f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.403+0000 7fb8057ff700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000cb350 0x7fb80013f1d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800cd60 tx=0x7fb7f8007d20 comp rx=0 tx=0).stop 2023-09-30T22:55:05.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.403+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 shutdown_connections 2023-09-30T22:55:05.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.404+0000 7fb8057ff700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb7ec067330 0x7fb7ec0697e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.404+0000 7fb8057ff700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000cb350 0x7fb80013f1d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.404+0000 7fb8057ff700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb800069f10 0x7fb8000c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.404+0000 7fb8057ff700 1 --2- 172.21.15.142:0/2066731844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8000c52a0 0x7fb8000c03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.404+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 >> 172.21.15.142:0/2066731844 conn(0x7fb8000cc670 msgr2=0x7fb80006eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:05.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.404+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 shutdown_connections 2023-09-30T22:55:05.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.405+0000 7fb8057ff700 1 -- 172.21.15.142:0/2066731844 wait complete. 2023-09-30T22:55:05.411 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 9 and data pool 10 2023-09-30T22:55:05.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:55:05.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.617+0000 7fce697ff700 1 Processor -- start 2023-09-30T22:55:05.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.617+0000 7fce697ff700 1 -- start start 2023-09-30T22:55:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.618+0000 7fce697ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fce640692f0 0x7fce6415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.618+0000 7fce697ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fce6415dc50 0x7fce6406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce697ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce640cc6b0 con 0x7fce64143350 2023-09-30T22:55:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce697ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6415e050 con 0x7fce6415dc50 2023-09-30T22:55:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce697ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce640cbaa0 con 0x7fce640692f0 2023-09-30T22:55:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce62ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fce64143350 0x7fce640cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56878/0 (socket says 172.21.15.142:56878) 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce62ffd700 1 -- 172.21.15.142:0/1470801937 learned_addr learned my addr 172.21.15.142:0/1470801937 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce637fe700 1 --2- 172.21.15.142:0/1470801937 >> v2:172.21.15.142:3300/0 conn(0x7fce6415dc50 0x7fce6406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce627fc700 1 --2- 172.21.15.142:0/1470801937 >> v2:172.21.15.148:3300/0 conn(0x7fce640692f0 0x7fce6415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce61ffb700 1 -- 172.21.15.142:0/1470801937 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697874533 0 0) 0x7fce640cc6b0 con 0x7fce64143350 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce61ffb700 1 -- 172.21.15.142:0/1470801937 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce4c003570 con 0x7fce64143350 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce637fe700 1 -- 172.21.15.142:0/1470801937 >> v2:172.21.15.148:3300/0 conn(0x7fce640692f0 msgr2=0x7fce6415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce637fe700 1 --2- 172.21.15.142:0/1470801937 >> v2:172.21.15.148:3300/0 conn(0x7fce640692f0 0x7fce6415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce637fe700 1 -- 172.21.15.142:0/1470801937 >> v1:172.21.15.142:6789/0 conn(0x7fce64143350 legacy=0x7fce640cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.619+0000 7fce637fe700 1 -- 172.21.15.142:0/1470801937 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640cbd80 con 0x7fce6415dc50 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce637fe700 1 --2- 172.21.15.142:0/1470801937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6406a0c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fce64069c90 tx=0x7fce5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef8e6de5216f93d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce61ffb700 1 -- 172.21.15.142:0/1470801937 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00e070 con 0x7fce6415dc50 2023-09-30T22:55:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce61ffb700 1 -- 172.21.15.142:0/1470801937 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00bb60 con 0x7fce6415dc50 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce61ffb700 1 -- 172.21.15.142:0/1470801937 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c012430 con 0x7fce6415dc50 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce697ff700 1 -- 172.21.15.142:0/1470801937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 msgr2=0x7fce6406a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce697ff700 1 --2- 172.21.15.142:0/1470801937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6406a0c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fce64069c90 tx=0x7fce5c009780 comp rx=0 tx=0).stop 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce697ff700 1 -- 172.21.15.142:0/1470801937 shutdown_connections 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce697ff700 1 --2- 172.21.15.142:0/1470801937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6406a0c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce697ff700 1 --2- 172.21.15.142:0/1470801937 >> v2:172.21.15.148:3300/0 conn(0x7fce640692f0 0x7fce6415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.620+0000 7fce697ff700 1 -- 172.21.15.142:0/1470801937 >> 172.21.15.142:0/1470801937 conn(0x7fce640ce8e0 msgr2=0x7fce640cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.621+0000 7fce697ff700 1 -- 172.21.15.142:0/1470801937 shutdown_connections 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.621+0000 7fce697ff700 1 -- 172.21.15.142:0/1470801937 wait complete. 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.622+0000 7fce697ff700 1 Processor -- start 2023-09-30T22:55:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.622+0000 7fce697ff700 1 -- start start 2023-09-30T22:55:05.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce697ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce640692f0 0x7fce640c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce697ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce64143350 0x7fce6416dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce697ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce697ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640c9680 con 0x7fce6415dc50 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce697ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640c8a70 con 0x7fce640692f0 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce697ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce640c8d50 con 0x7fce64143350 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6415b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39810/0 (socket says 172.21.15.142:39810) 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.623+0000 7fce637fe700 1 -- 172.21.15.142:0/4157336660 learned_addr learned my addr 172.21.15.142:0/4157336660 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce627fc700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce64143350 0x7fce6416dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce62ffd700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce640692f0 0x7fce640c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce637fe700 1 -- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce64143350 msgr2=0x7fce6416dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce637fe700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce64143350 0x7fce6416dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce637fe700 1 -- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce640692f0 msgr2=0x7fce640c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce637fe700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce640692f0 0x7fce640c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce637fe700 1 -- 172.21.15.142:0/4157336660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c009a20 con 0x7fce6415dc50 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce637fe700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6415b2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009fd0 tx=0x7fce5c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce4affd700 1 -- 172.21.15.142:0/4157336660 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c027470 con 0x7fce6415dc50 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce4affd700 1 -- 172.21.15.142:0/4157336660 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c0275f0 con 0x7fce6415dc50 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce4affd700 1 -- 172.21.15.142:0/4157336660 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0279b0 con 0x7fce6415dc50 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.624+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce640c9030 con 0x7fce6415dc50 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.625+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce640c86d0 con 0x7fce6415dc50 2023-09-30T22:55:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.626+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640c9830 con 0x7fce6415dc50 2023-09-30T22:55:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.627+0000 7fce4affd700 1 -- 172.21.15.142:0/4157336660 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fce5c024070 con 0x7fce6415dc50 2023-09-30T22:55:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.628+0000 7fce4affd700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce50067330 0x7fce500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.628+0000 7fce4affd700 1 -- 172.21.15.142:0/4157336660 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce5c087550 con 0x7fce6415dc50 2023-09-30T22:55:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.628+0000 7fce62ffd700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce50067330 0x7fce500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.628+0000 7fce62ffd700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce50067330 0x7fce500697e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fce54007fd0 tx=0x7fce54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.633+0000 7fce4affd700 1 -- 172.21.15.142:0/4157336660 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fce5c0543b0 con 0x7fce6415dc50 2023-09-30T22:55:05.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.823+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce640cc060 con 0x7fce6415dc50 2023-09-30T22:55:05.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.824+0000 7fce4affd700 1 -- 172.21.15.142:0/4157336660 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+17025 (secure 0 0 0) 0x7fce5c0579d0 con 0x7fce6415dc50 2023-09-30T22:55:05.826 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:05.826 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":71,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:55:04.855541+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:55:02.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-09-30T22:55:03.839904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:55:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce50067330 msgr2=0x7fce500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce50067330 0x7fce500697e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fce54007fd0 tx=0x7fce54009040 comp rx=0 tx=0).stop 2023-09-30T22:55:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 msgr2=0x7fce6415b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6415b2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009fd0 tx=0x7fce5c019000 comp rx=0 tx=0).stop 2023-09-30T22:55:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 shutdown_connections 2023-09-30T22:55:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce50067330 0x7fce500697e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6415dc50 0x7fce6415b2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce640692f0 0x7fce640c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 --2- 172.21.15.142:0/4157336660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce64143350 0x7fce6416dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 >> 172.21.15.142:0/4157336660 conn(0x7fce640ce8e0 msgr2=0x7fce640b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 shutdown_connections 2023-09-30T22:55:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:05.827+0000 7fce697ff700 1 -- 172.21.15.142:0/4157336660 wait complete. 2023-09-30T22:55:05.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:55:06.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.034+0000 7f0b7f3ff700 1 Processor -- start 2023-09-30T22:55:06.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.034+0000 7f0b7f3ff700 1 -- start start 2023-09-30T22:55:06.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7f3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0b780cc590 0x7f0b78164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7f3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7815d910 con 0x7f0b78159ae0 2023-09-30T22:55:06.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7f3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7815e490 con 0x7f0b780b1180 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7f3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7815e920 con 0x7f0b780cc590 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7d19b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0b78159ae0 0x7f0b780cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56886/0 (socket says 172.21.15.142:56886) 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7d19b700 1 -- 172.21.15.142:0/1928416476 learned_addr learned my addr 172.21.15.142:0/1928416476 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7d99c700 1 --2- 172.21.15.142:0/1928416476 >> v2:172.21.15.148:3300/0 conn(0x7f0b780cc590 0x7f0b78164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51615958 0 0) 0x7f0b7815d910 con 0x7f0b78159ae0 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b64003570 con 0x7f0b78159ae0 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929371736 0 0) 0x7f0b7815e490 con 0x7f0b780b1180 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7815d910 con 0x7f0b780b1180 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7d99c700 1 -- 172.21.15.142:0/1928416476 >> v1:172.21.15.148:6789/0 conn(0x7f0b780b1180 legacy=0x7f0b780cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3027254556 0 0) 0x7f0b64003570 con 0x7f0b78159ae0 2023-09-30T22:55:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7d99c700 1 -- 172.21.15.142:0/1928416476 >> v1:172.21.15.142:6789/0 conn(0x7f0b78159ae0 legacy=0x7f0b780cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.036+0000 7f0b7d99c700 1 -- 172.21.15.142:0/1928416476 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780ce5c0 con 0x7f0b780cc590 2023-09-30T22:55:06.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b7d99c700 1 --2- 172.21.15.142:0/1928416476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780cc590 0x7f0b78164cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009e60 tx=0x7f0b70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b56ffa64bf82d77f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000e070 con 0x7f0b780cc590 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000b7a0 con 0x7f0b780cc590 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b6ffff700 1 -- 172.21.15.142:0/1928416476 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74001470 con 0x7f0b780cc590 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/1928416476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780cc590 msgr2=0x7f0b78164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/1928416476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780cc590 0x7f0b78164cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009e60 tx=0x7f0b70009780 comp rx=0 tx=0).stop 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/1928416476 shutdown_connections 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/1928416476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780cc590 0x7f0b78164cb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/1928416476 >> 172.21.15.142:0/1928416476 conn(0x7f0b780ce8b0 msgr2=0x7f0b780cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:06.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.037+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/1928416476 shutdown_connections 2023-09-30T22:55:06.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.038+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/1928416476 wait complete. 2023-09-30T22:55:06.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.039+0000 7f0b7f3ff700 1 Processor -- start 2023-09-30T22:55:06.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.039+0000 7f0b7f3ff700 1 -- start start 2023-09-30T22:55:06.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7f3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780b1180 0x7f0b7816a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7f3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b780cc590 0x7f0b78153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7f3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b78159ae0 0x7f0b780c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7f3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780c9560 con 0x7f0b780cc590 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7f3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7815b890 con 0x7f0b780b1180 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7f3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780c8c70 con 0x7f0b78159ae0 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7c99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b780cc590 0x7f0b78153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7c99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b780cc590 0x7f0b78153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39812/0 (socket says 172.21.15.142:39812) 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7c99a700 1 -- 172.21.15.142:0/2796082357 learned_addr learned my addr 172.21.15.142:0/2796082357 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7d19b700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780b1180 0x7f0b7816a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.040+0000 7f0b7d99c700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b78159ae0 0x7f0b780c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7c99a700 1 -- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b78159ae0 msgr2=0x7f0b780c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7c99a700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b78159ae0 0x7f0b780c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7c99a700 1 -- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780b1180 msgr2=0x7f0b7816a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7c99a700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780b1180 0x7f0b7816a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7c99a700 1 -- 172.21.15.142:0/2796082357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70009a20 con 0x7f0b780cc590 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7c99a700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b780cc590 0x7f0b78153490 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c7c0 tx=0x7f0b68007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b6d7fa700 1 -- 172.21.15.142:0/2796082357 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68010510 con 0x7f0b780cc590 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b6d7fa700 1 -- 172.21.15.142:0/2796082357 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b680106b0 con 0x7f0b780cc590 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b780c8f10 con 0x7f0b780cc590 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b6d7fa700 1 -- 172.21.15.142:0/2796082357 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68010a70 con 0x7f0b780cc590 2023-09-30T22:55:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.041+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7816a540 con 0x7f0b780cc590 2023-09-30T22:55:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.042+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b780c96d0 con 0x7f0b780cc590 2023-09-30T22:55:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.043+0000 7f0b6d7fa700 1 -- 172.21.15.142:0/2796082357 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0b68012440 con 0x7f0b780cc590 2023-09-30T22:55:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.044+0000 7f0b6d7fa700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0b5c067330 0x7f0b5c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.044+0000 7f0b6d7fa700 1 -- 172.21.15.142:0/2796082357 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0b680842e0 con 0x7f0b780cc590 2023-09-30T22:55:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.044+0000 7f0b7d19b700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0b5c067330 0x7f0b5c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.045+0000 7f0b7d19b700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0b5c067330 0x7f0b5c0697e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b740011e0 tx=0x7f0b74000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:06.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.048+0000 7f0b6d7fa700 1 -- 172.21.15.142:0/2796082357 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0b680511f0 con 0x7f0b780cc590 2023-09-30T22:55:06.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.243+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b780c93b0 con 0x7f0b780cc590 2023-09-30T22:55:06.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.245+0000 7f0b6d7fa700 1 -- 172.21.15.142:0/2796082357 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+17025 (secure 0 0 0) 0x7f0b68054810 con 0x7f0b780cc590 2023-09-30T22:55:06.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:06.245 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":71,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:55:04.855541+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:55:02.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-09-30T22:55:03.839904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0b5c067330 msgr2=0x7f0b5c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0b5c067330 0x7f0b5c0697e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b740011e0 tx=0x7f0b74000bc0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b780cc590 msgr2=0x7f0b78153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b780cc590 0x7f0b78153490 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c7c0 tx=0x7f0b68007de0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 shutdown_connections 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0b5c067330 0x7f0b5c0697e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0b78159ae0 0x7f0b780c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b780b1180 0x7f0b7816a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 --2- 172.21.15.142:0/2796082357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b780cc590 0x7f0b78153490 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 >> 172.21.15.142:0/2796082357 conn(0x7f0b780ce8b0 msgr2=0x7f0b781543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 shutdown_connections 2023-09-30T22:55:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.246+0000 7f0b7f3ff700 1 -- 172.21.15.142:0/2796082357 wait complete. 2023-09-30T22:55:06.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:55:06.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.464+0000 7f142f7ff700 1 Processor -- start 2023-09-30T22:55:06.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.464+0000 7f142f7ff700 1 -- start start 2023-09-30T22:55:06.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.465+0000 7f142f7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.465+0000 7f142f7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142806b650 con 0x7f1428159f10 2023-09-30T22:55:06.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.465+0000 7f142f7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142806aa40 con 0x7f1428159b40 2023-09-30T22:55:06.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.465+0000 7f142f7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142806ad20 con 0x7f1428067d30 2023-09-30T22:55:06.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f142cd9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1428159f10 0x7f1428067620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56890/0 (socket says 172.21.15.142:56890) 2023-09-30T22:55:06.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f142cd9a700 1 -- 172.21.15.142:0/4093960544 learned_addr learned my addr 172.21.15.142:0/4093960544 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:06.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f142dd9c700 1 --2- 172.21.15.142:0/4093960544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f141ffff700 1 -- 172.21.15.142:0/4093960544 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724333660 0 0) 0x7f142806b650 con 0x7f1428159f10 2023-09-30T22:55:06.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f141ffff700 1 -- 172.21.15.142:0/4093960544 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1414003570 con 0x7f1428159f10 2023-09-30T22:55:06.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f141ffff700 1 -- 172.21.15.142:0/4093960544 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928981799 0 0) 0x7f142806aa40 con 0x7f1428159b40 2023-09-30T22:55:06.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f141ffff700 1 -- 172.21.15.142:0/4093960544 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f142806b650 con 0x7f1428159b40 2023-09-30T22:55:06.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f142dd9c700 1 -- 172.21.15.142:0/4093960544 >> v1:172.21.15.148:6789/0 conn(0x7f1428159b40 legacy=0x7f14280683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f142dd9c700 1 -- 172.21.15.142:0/4093960544 >> v1:172.21.15.142:6789/0 conn(0x7f1428159f10 legacy=0x7f1428067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.466+0000 7f142dd9c700 1 -- 172.21.15.142:0/4093960544 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142806b000 con 0x7f1428067d30 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.467+0000 7f142dd9c700 1 --2- 172.21.15.142:0/4093960544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142806a360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1420009e90 tx=0x7f1420009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5cdb8ef732658d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.467+0000 7f141ffff700 1 -- 172.21.15.142:0/4093960544 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000e070 con 0x7f1428067d30 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.467+0000 7f141ffff700 1 -- 172.21.15.142:0/4093960544 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000bb80 con 0x7f1428067d30 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.467+0000 7f141ffff700 1 -- 172.21.15.142:0/4093960544 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420012430 con 0x7f1428067d30 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.467+0000 7f142f7ff700 1 -- 172.21.15.142:0/4093960544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 msgr2=0x7f142806a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.467+0000 7f142f7ff700 1 --2- 172.21.15.142:0/4093960544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142806a360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1420009e90 tx=0x7f1420009780 comp rx=0 tx=0).stop 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.468+0000 7f142f7ff700 1 -- 172.21.15.142:0/4093960544 shutdown_connections 2023-09-30T22:55:06.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.468+0000 7f142f7ff700 1 --2- 172.21.15.142:0/4093960544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142806a360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.468+0000 7f142f7ff700 1 -- 172.21.15.142:0/4093960544 >> 172.21.15.142:0/4093960544 conn(0x7f14280c9950 msgr2=0x7f14280c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:06.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.468+0000 7f142f7ff700 1 -- 172.21.15.142:0/4093960544 shutdown_connections 2023-09-30T22:55:06.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.468+0000 7f142f7ff700 1 -- 172.21.15.142:0/4093960544 wait complete. 2023-09-30T22:55:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.469+0000 7f142f7ff700 1 Processor -- start 2023-09-30T22:55:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.469+0000 7f142f7ff700 1 -- start start 2023-09-30T22:55:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142f7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142f7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1428159b40 0x7f142815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142f7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1428159f10 0x7f142815a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142f7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280b1520 con 0x7f1428159f10 2023-09-30T22:55:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142f7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142815bc00 con 0x7f1428159b40 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142f7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142815aff0 con 0x7f1428067d30 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142dd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1428159f10 0x7f142815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142dd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1428159f10 0x7f142815a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39826/0 (socket says 172.21.15.142:39826) 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142dd9c700 1 -- 172.21.15.142:0/2383262104 learned_addr learned my addr 172.21.15.142:0/2383262104 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142cd9a700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1428159b40 0x7f142815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.470+0000 7f142d59b700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f142dd9c700 1 -- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 msgr2=0x7f142814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f142dd9c700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f142dd9c700 1 -- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1428159b40 msgr2=0x7f142815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f142dd9c700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1428159b40 0x7f142815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f142dd9c700 1 -- 172.21.15.142:0/2383262104 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009a20 con 0x7f1428159f10 2023-09-30T22:55:06.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f142dd9c700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1428159f10 0x7f142815a950 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1420013000 tx=0x7f1420019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:06.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f141d7fa700 1 -- 172.21.15.142:0/2383262104 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142001b420 con 0x7f1428159f10 2023-09-30T22:55:06.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f141d7fa700 1 -- 172.21.15.142:0/2383262104 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142001b5a0 con 0x7f1428159f10 2023-09-30T22:55:06.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f141d7fa700 1 -- 172.21.15.142:0/2383262104 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142001b960 con 0x7f1428159f10 2023-09-30T22:55:06.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.471+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142815b2d0 con 0x7f1428159f10 2023-09-30T22:55:06.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.472+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142815b890 con 0x7f1428159f10 2023-09-30T22:55:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.472+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14280699b0 con 0x7f1428159f10 2023-09-30T22:55:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.473+0000 7f141d7fa700 1 -- 172.21.15.142:0/2383262104 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f142001bd50 con 0x7f1428159f10 2023-09-30T22:55:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.474+0000 7f141d7fa700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f140c067330 0x7f140c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.474+0000 7f141d7fa700 1 -- 172.21.15.142:0/2383262104 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14200865a0 con 0x7f1428159f10 2023-09-30T22:55:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.474+0000 7f142d59b700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f140c067330 0x7f140c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.475+0000 7f142d59b700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f140c067330 0x7f140c0697e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1424007fd0 tx=0x7f1424007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:06.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.479+0000 7f141d7fa700 1 -- 172.21.15.142:0/2383262104 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f14200534f0 con 0x7f1428159f10 2023-09-30T22:55:06.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:06.715+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f142806b2e0 con 0x7f1428159f10 2023-09-30T22:55:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.415+0000 7f141d7fa700 1 -- 172.21.15.142:0/2383262104 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1420056ad0 con 0x7f1428159f10 2023-09-30T22:55:07.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.417+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f140c067330 msgr2=0x7f140c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:07.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.417+0000 7f142f7ff700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f140c067330 0x7f140c0697e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1424007fd0 tx=0x7f1424007d50 comp rx=0 tx=0).stop 2023-09-30T22:55:07.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.417+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1428159f10 msgr2=0x7f142815a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:07.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.417+0000 7f142f7ff700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1428159f10 0x7f142815a950 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1420013000 tx=0x7f1420019000 comp rx=0 tx=0).stop 2023-09-30T22:55:07.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 shutdown_connections 2023-09-30T22:55:07.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f140c067330 0x7f140c0697e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1428159f10 0x7f142815a950 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1428067d30 0x7f142814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 --2- 172.21.15.142:0/2383262104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1428159b40 0x7f142815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 >> 172.21.15.142:0/2383262104 conn(0x7f14280c9950 msgr2=0x7f14280c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 shutdown_connections 2023-09-30T22:55:07.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.418+0000 7f142f7ff700 1 -- 172.21.15.142:0/2383262104 wait complete. 2023-09-30T22:55:07.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:55:07.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.632+0000 7fae0d1ff700 1 Processor -- start 2023-09-30T22:55:07.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.632+0000 7fae0d1ff700 1 -- start start 2023-09-30T22:55:07.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.633+0000 7fae0d1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 0x7fae0815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.633+0000 7fae0d1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae080d0550 con 0x7fae08157ab0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.633+0000 7fae0d1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae080cf940 con 0x7fae080cc3b0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.633+0000 7fae0d1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080cfc20 con 0x7fae080cbfe0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.633+0000 7fae0759e700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fae08157ab0 0x7fae0806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56906/0 (socket says 172.21.15.142:56906) 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.633+0000 7fae0759e700 1 -- 172.21.15.142:0/3691660994 learned_addr learned my addr 172.21.15.142:0/3691660994 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae06d9d700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 0x7fae0815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453508041 0 0) 0x7fae080d0550 con 0x7fae08157ab0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf0003570 con 0x7fae08157ab0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343150770 0 0) 0x7fae080cf940 con 0x7fae080cc3b0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae080d0550 con 0x7fae080cc3b0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 418932460 0 0) 0x7fadf0003570 con 0x7fae08157ab0 2023-09-30T22:55:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 msgr2=0x7fae0815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 0x7fae0815a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 >> v1:172.21.15.148:6789/0 conn(0x7fae080cc3b0 legacy=0x7fae081573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080cff00 con 0x7fae08157ab0 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fae000017f0 con 0x7fae08157ab0 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 >> v1:172.21.15.142:6789/0 conn(0x7fae08157ab0 legacy=0x7fae0806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf0003c20 0x7fadf0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 0x7fadf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadf0004d50 0x7fadf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080cfc20 con 0x7fadf0004d50 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf000bbf0 con 0x7fadf0003c20 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.634+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf000bd60 con 0x7fae080cbfe0 2023-09-30T22:55:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0759e700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadf0004d50 0x7fadf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae06d9d700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf0003c20 0x7fadf0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0659c700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 0x7fadf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0759e700 1 -- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 msgr2=0x7fadf0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0759e700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080cbfe0 0x7fadf0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0759e700 1 -- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf0003c20 msgr2=0x7fadf0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0759e700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf0003c20 0x7fadf0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0759e700 1 -- 172.21.15.142:0/3691660994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0003570 con 0x7fadf0004d50 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae0759e700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadf0004d50 0x7fadf00051c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fae0000a7d0 tx=0x7fae000020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c559cf1200f6170 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000070d0 con 0x7fadf0004d50 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00007230 con 0x7fadf0004d50 2023-09-30T22:55:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.635+0000 7fae05d9b700 1 -- 172.21.15.142:0/3691660994 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000075d0 con 0x7fadf0004d50 2023-09-30T22:55:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.636+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3691660994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadf0004d50 msgr2=0x7fadf00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.636+0000 7fae0d1ff700 1 --2- 172.21.15.142:0/3691660994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadf0004d50 0x7fadf00051c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fae0000a7d0 tx=0x7fae000020c0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.636+0000 7fae0759e700 1 -- 172.21.15.142:0/3691660994 reap_dead start 2023-09-30T22:55:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.636+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3691660994 shutdown_connections 2023-09-30T22:55:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.636+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3691660994 >> 172.21.15.142:0/3691660994 conn(0x7fae080d0a80 msgr2=0x7fae080d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.636+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3691660994 shutdown_connections 2023-09-30T22:55:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.636+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3691660994 wait complete. 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.638+0000 7fae0d1ff700 1 Processor -- start 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.638+0000 7fae0d1ff700 1 -- start start 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0d1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080c8830 0x7fae080cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0d1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae080c8c00 0x7fae080c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0d1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae080c5620 0x7fae08140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0d1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae081588e0 con 0x7fae080c5620 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0d1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080cb730 con 0x7fae080c8c00 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0d1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae08157fb0 con 0x7fae080c8830 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae080c5620 0x7fae08140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae080c5620 0x7fae08140e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39846/0 (socket says 172.21.15.142:39846) 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 -- 172.21.15.142:0/3734351149 learned_addr learned my addr 172.21.15.142:0/3734351149 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:07.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae06d9d700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080c8830 0x7fae080cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0659c700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae080c8c00 0x7fae080c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 -- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080c8830 msgr2=0x7fae080cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080c8830 0x7fae080cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 -- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae080c8c00 msgr2=0x7fae080c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae080c8c00 0x7fae080c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.639+0000 7fae0759e700 1 -- 172.21.15.142:0/3734351149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08158290 con 0x7fae080c5620 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.640+0000 7fae0759e700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae080c5620 0x7fae08140e00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fae00000f80 tx=0x7fae00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.640+0000 7fadeeffd700 1 -- 172.21.15.142:0/3734351149 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000070d0 con 0x7fae080c5620 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.640+0000 7fadeeffd700 1 -- 172.21.15.142:0/3734351149 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0000adf0 con 0x7fae080c5620 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.640+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08158570 con 0x7fae080c5620 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.640+0000 7fadeeffd700 1 -- 172.21.15.142:0/3734351149 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00013e60 con 0x7fae080c5620 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.640+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae08141340 con 0x7fae080c5620 2023-09-30T22:55:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.641+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae08158a90 con 0x7fae080c5620 2023-09-30T22:55:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.642+0000 7fadeeffd700 1 -- 172.21.15.142:0/3734351149 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fae000073a0 con 0x7fae080c5620 2023-09-30T22:55:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.643+0000 7fadeeffd700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadf4067330 0x7fadf40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.643+0000 7fadeeffd700 1 -- 172.21.15.142:0/3734351149 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae00086e40 con 0x7fae080c5620 2023-09-30T22:55:07.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.643+0000 7fae06d9d700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadf4067330 0x7fadf40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:07.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.644+0000 7fae06d9d700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadf4067330 0x7fadf40697e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fadf8006f00 tx=0x7fadf80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:07.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.648+0000 7fadeeffd700 1 -- 172.21.15.142:0/3734351149 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fae08158a90 con 0x7fae080c5620 2023-09-30T22:55:07.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:07.878+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fae08158a90 con 0x7fae080c5620 2023-09-30T22:55:08.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.417+0000 7fadeeffd700 1 -- 172.21.15.142:0/3734351149 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7fae08158a90 con 0x7fae080c5620 2023-09-30T22:55:08.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadf4067330 msgr2=0x7fadf40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadf4067330 0x7fadf40697e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fadf8006f00 tx=0x7fadf80091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae080c5620 msgr2=0x7fae08140e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae080c5620 0x7fae08140e00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fae00000f80 tx=0x7fae00016000 comp rx=0 tx=0).stop 2023-09-30T22:55:08.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 shutdown_connections 2023-09-30T22:55:08.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadf4067330 0x7fadf40697e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae080c5620 0x7fae08140e00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fae080c8830 0x7fae080cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 --2- 172.21.15.142:0/3734351149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae080c8c00 0x7fae080c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 >> 172.21.15.142:0/3734351149 conn(0x7fae080d0a80 msgr2=0x7fae080d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:08.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 shutdown_connections 2023-09-30T22:55:08.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.420+0000 7fae0d1ff700 1 -- 172.21.15.142:0/3734351149 wait complete. 2023-09-30T22:55:08.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:55:08.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.629+0000 7f8cadfff700 1 Processor -- start 2023-09-30T22:55:08.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.630+0000 7f8cadfff700 1 -- start start 2023-09-30T22:55:08.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.631+0000 7f8cadfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca80692f0 0x7f8ca815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.631+0000 7f8cadfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ca815dc50 0x7f8ca806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.631+0000 7f8cadfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca815e0b0 con 0x7f8ca8143350 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.631+0000 7f8cadfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca80cc6b0 con 0x7f8ca815dc50 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.631+0000 7f8cadfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80cbaa0 con 0x7f8ca80692f0 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ca815dc50 0x7f8ca806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ca815dc50 0x7f8ca806a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39852/0 (socket says 172.21.15.142:39852) 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 -- 172.21.15.142:0/2113604903 learned_addr learned my addr 172.21.15.142:0/2113604903 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca6ffd700 1 --2- 172.21.15.142:0/2113604903 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca80692f0 0x7f8ca815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 -- 172.21.15.142:0/2113604903 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca80692f0 msgr2=0x7f8ca815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 --2- 172.21.15.142:0/2113604903 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca80692f0 0x7f8ca815d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 -- 172.21.15.142:0/2113604903 >> v1:172.21.15.148:6789/0 conn(0x7f8ca8143350 legacy=0x7f8ca80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 -- 172.21.15.142:0/2113604903 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca80cbd80 con 0x7f8ca815dc50 2023-09-30T22:55:08.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.632+0000 7f8ca7fff700 1 --2- 172.21.15.142:0/2113604903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca815dc50 0x7f8ca806a0c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009f20 tx=0x7f8ca0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600507b05464f39c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:08.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8ca67fc700 1 -- 172.21.15.142:0/2113604903 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000e070 con 0x7f8ca815dc50 2023-09-30T22:55:08.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8ca67fc700 1 -- 172.21.15.142:0/2113604903 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca000ba80 con 0x7f8ca815dc50 2023-09-30T22:55:08.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8ca67fc700 1 -- 172.21.15.142:0/2113604903 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00092e0 con 0x7f8ca815dc50 2023-09-30T22:55:08.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 -- 172.21.15.142:0/2113604903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca815dc50 msgr2=0x7f8ca806a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 --2- 172.21.15.142:0/2113604903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca815dc50 0x7f8ca806a0c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009f20 tx=0x7f8ca0009840 comp rx=0 tx=0).stop 2023-09-30T22:55:08.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 -- 172.21.15.142:0/2113604903 shutdown_connections 2023-09-30T22:55:08.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 --2- 172.21.15.142:0/2113604903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca815dc50 0x7f8ca806a0c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 --2- 172.21.15.142:0/2113604903 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca80692f0 0x7f8ca815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 -- 172.21.15.142:0/2113604903 >> 172.21.15.142:0/2113604903 conn(0x7f8ca80ce8e0 msgr2=0x7f8ca80cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:08.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 -- 172.21.15.142:0/2113604903 shutdown_connections 2023-09-30T22:55:08.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.633+0000 7f8cadfff700 1 -- 172.21.15.142:0/2113604903 wait complete. 2023-09-30T22:55:08.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.635+0000 7f8cadfff700 1 Processor -- start 2023-09-30T22:55:08.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.635+0000 7f8cadfff700 1 -- start start 2023-09-30T22:55:08.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8cadfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca80692f0 0x7f8ca815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:08.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8cadfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca8143350 0x7f8ca815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:08.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8cadfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ca815dc50 0x7f8ca816e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:08.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8cadfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80b3100 con 0x7f8ca80692f0 2023-09-30T22:55:08.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8cadfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80b2e20 con 0x7f8ca815dc50 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8cadfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca815a740 con 0x7f8ca8143350 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8ca77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca80692f0 0x7f8ca815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8ca77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca80692f0 0x7f8ca815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39866/0 (socket says 172.21.15.142:39866) 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8ca77fe700 1 -- 172.21.15.142:0/838027836 learned_addr learned my addr 172.21.15.142:0/838027836 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8ca7fff700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ca815dc50 0x7f8ca816e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8ca6ffd700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca8143350 0x7f8ca815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.636+0000 7f8ca77fe700 1 -- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca8143350 msgr2=0x7f8ca815cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8ca77fe700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca8143350 0x7f8ca815cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8ca77fe700 1 -- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ca815dc50 msgr2=0x7f8ca816e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8ca77fe700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ca815dc50 0x7f8ca816e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8ca77fe700 1 -- 172.21.15.142:0/838027836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0009ae0 con 0x7f8ca80692f0 2023-09-30T22:55:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8ca77fe700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca80692f0 0x7f8ca815b200 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800c590 tx=0x7f8c9800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8c8f7fe700 1 -- 172.21.15.142:0/838027836 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011590 con 0x7f8ca80692f0 2023-09-30T22:55:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8c8f7fe700 1 -- 172.21.15.142:0/838027836 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98011710 con 0x7f8ca80692f0 2023-09-30T22:55:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8c8f7fe700 1 -- 172.21.15.142:0/838027836 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011ad0 con 0x7f8ca80692f0 2023-09-30T22:55:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca815aa20 con 0x7f8ca80692f0 2023-09-30T22:55:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.637+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca80b2a60 con 0x7f8ca80692f0 2023-09-30T22:55:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.638+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca815b070 con 0x7f8ca80692f0 2023-09-30T22:55:08.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.639+0000 7f8c8f7fe700 1 -- 172.21.15.142:0/838027836 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8c9801b3b0 con 0x7f8ca80692f0 2023-09-30T22:55:08.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.640+0000 7f8c8f7fe700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c94067330 0x7f8c940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:08.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.640+0000 7f8c8f7fe700 1 -- 172.21.15.142:0/838027836 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c98083f10 con 0x7f8ca80692f0 2023-09-30T22:55:08.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.640+0000 7f8ca6ffd700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c94067330 0x7f8c940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:08.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.641+0000 7f8ca6ffd700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c94067330 0x7f8c940697e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8ca806b270 tx=0x7f8c9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:08.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.644+0000 7f8c8f7fe700 1 -- 172.21.15.142:0/838027836 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8c98050d70 con 0x7f8ca80692f0 2023-09-30T22:55:08.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.874+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ca815e0b0 con 0x7f8ca80692f0 2023-09-30T22:55:08.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.875+0000 7f8c8f7fe700 1 -- 172.21.15.142:0/838027836 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f8ca815e0b0 con 0x7f8ca80692f0 2023-09-30T22:55:08.875 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:08.875 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:55:04.855906+0000","modified":"2023-09-30T22:55:08.414251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3864514907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3864514907},{"type":"v1","addr":"172.21.15.142:6837","nonce":3864514907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-09-30T22:55:08.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c94067330 msgr2=0x7f8c940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c94067330 0x7f8c940697e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8ca806b270 tx=0x7f8c9c008040 comp rx=0 tx=0).stop 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca80692f0 msgr2=0x7f8ca815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca80692f0 0x7f8ca815b200 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800c590 tx=0x7f8c9800c8a0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 shutdown_connections 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c94067330 0x7f8c940697e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ca815dc50 0x7f8ca816e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca80692f0 0x7f8ca815b200 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 --2- 172.21.15.142:0/838027836 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ca8143350 0x7f8ca815cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 >> 172.21.15.142:0/838027836 conn(0x7f8ca80ce8e0 msgr2=0x7f8ca80c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 shutdown_connections 2023-09-30T22:55:08.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:08.877+0000 7f8cadfff700 1 -- 172.21.15.142:0/838027836 wait complete. 2023-09-30T22:55:08.879 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2023-09-30T22:55:08.895 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:55:09.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.084+0000 7ff581fff700 1 Processor -- start 2023-09-30T22:55:09.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.084+0000 7ff581fff700 1 -- start start 2023-09-30T22:55:09.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff581fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff57c06d3f0 0x7ff57c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff581fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff581fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c15dde0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff581fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c15e710 con 0x7ff57c06d3f0 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff581fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c06b840 con 0x7ff57c15e270 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff57b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff57c06d3f0 0x7ff57c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff57b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff57c06d3f0 0x7ff57c06d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39876/0 (socket says 172.21.15.142:39876) 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff57b7fe700 1 -- 172.21.15.142:0/1228892167 learned_addr learned my addr 172.21.15.142:0/1228892167 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.085+0000 7ff57affd700 1 --1- 172.21.15.142:0/1228892167 >> v1:172.21.15.142:6789/0 conn(0x7ff57c0c6da0 0x7ff57c06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56912/0 (socket says 172.21.15.142:56912) 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57bfff700 1 --2- 172.21.15.142:0/1228892167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57b7fe700 1 -- 172.21.15.142:0/1228892167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 msgr2=0x7ff57c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57b7fe700 1 --2- 172.21.15.142:0/1228892167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57b7fe700 1 -- 172.21.15.142:0/1228892167 >> v1:172.21.15.142:6789/0 conn(0x7ff57c0c6da0 legacy=0x7ff57c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57b7fe700 1 -- 172.21.15.142:0/1228892167 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c15d7d0 con 0x7ff57c06d3f0 2023-09-30T22:55:09.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57b7fe700 1 --2- 172.21.15.142:0/1228892167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c06d3f0 0x7ff57c06d7c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0099b0 tx=0x7ff56c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4d80908d3178ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57a7fc700 1 -- 172.21.15.142:0/1228892167 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00b860 con 0x7ff57c06d3f0 2023-09-30T22:55:09.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57a7fc700 1 -- 172.21.15.142:0/1228892167 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c00b9c0 con 0x7ff57c06d3f0 2023-09-30T22:55:09.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.086+0000 7ff57a7fc700 1 -- 172.21.15.142:0/1228892167 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00bd60 con 0x7ff57c06d3f0 2023-09-30T22:55:09.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 -- 172.21.15.142:0/1228892167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c06d3f0 msgr2=0x7ff57c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 --2- 172.21.15.142:0/1228892167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c06d3f0 0x7ff57c06d7c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0099b0 tx=0x7ff56c009250 comp rx=0 tx=0).stop 2023-09-30T22:55:09.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 -- 172.21.15.142:0/1228892167 shutdown_connections 2023-09-30T22:55:09.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 --2- 172.21.15.142:0/1228892167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c06d3f0 0x7ff57c06d7c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 --2- 172.21.15.142:0/1228892167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 -- 172.21.15.142:0/1228892167 >> 172.21.15.142:0/1228892167 conn(0x7ff57c067e30 msgr2=0x7ff57c068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:09.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 -- 172.21.15.142:0/1228892167 shutdown_connections 2023-09-30T22:55:09.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.087+0000 7ff581fff700 1 -- 172.21.15.142:0/1228892167 wait complete. 2023-09-30T22:55:09.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.088+0000 7ff581fff700 1 Processor -- start 2023-09-30T22:55:09.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.089+0000 7ff581fff700 1 -- start start 2023-09-30T22:55:09.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff581fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff57c06d3f0 0x7ff57c16b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff581fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0c6da0 0x7ff57c16de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff581fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff581fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c16edf0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff581fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c16e340 con 0x7ff57c06d3f0 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff581fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c16e550 con 0x7ff57c15e270 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0c6da0 0x7ff57c16de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0c6da0 0x7ff57c16de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39886/0 (socket says 172.21.15.142:39886) 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 -- 172.21.15.142:0/3172539959 learned_addr learned my addr 172.21.15.142:0/3172539959 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57b7fe700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff57c06d3f0 0x7ff57c16b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57bfff700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 -- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 msgr2=0x7ff57c14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c14c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 -- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff57c06d3f0 msgr2=0x7ff57c16b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff57c06d3f0 0x7ff57c16b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.090+0000 7ff57affd700 1 -- 172.21.15.142:0/3172539959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0094f0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.091+0000 7ff57affd700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0c6da0 0x7ff57c16de00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff57000c7c0 tx=0x7ff570007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.091+0000 7ff5637fe700 1 -- 172.21.15.142:0/3172539959 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570005a70 con 0x7ff57c0c6da0 2023-09-30T22:55:09.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.091+0000 7ff5637fe700 1 -- 172.21.15.142:0/3172539959 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff570005bd0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.091+0000 7ff5637fe700 1 -- 172.21.15.142:0/3172539959 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700070d0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.091+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c16e830 con 0x7ff57c0c6da0 2023-09-30T22:55:09.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.091+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c14e840 con 0x7ff57c0c6da0 2023-09-30T22:55:09.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.092+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c14e6a0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.093+0000 7ff5637fe700 1 -- 172.21.15.142:0/3172539959 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff570007480 con 0x7ff57c0c6da0 2023-09-30T22:55:09.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.094+0000 7ff5637fe700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff568067330 0x7ff5680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.094+0000 7ff5637fe700 1 -- 172.21.15.142:0/3172539959 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff570084060 con 0x7ff57c0c6da0 2023-09-30T22:55:09.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.094+0000 7ff57b7fe700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff568067330 0x7ff5680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.095+0000 7ff57b7fe700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff568067330 0x7ff5680697e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0099b0 tx=0x7ff56c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.098+0000 7ff5637fe700 1 -- 172.21.15.142:0/3172539959 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff57c14e6a0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.293+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff57c14e6a0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.294+0000 7ff5637fe700 1 -- 172.21.15.142:0/3172539959 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+17012 (secure 0 0 0) 0x7ff57c14e6a0 con 0x7ff57c0c6da0 2023-09-30T22:55:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:09.295 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":72,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:55:06.398441+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:55:02.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-09-30T22:55:03.839904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:55:09.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff568067330 msgr2=0x7ff5680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff568067330 0x7ff5680697e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0099b0 tx=0x7ff56c017000 comp rx=0 tx=0).stop 2023-09-30T22:55:09.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0c6da0 msgr2=0x7ff57c16de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0c6da0 0x7ff57c16de00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff57000c7c0 tx=0x7ff570007f70 comp rx=0 tx=0).stop 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 shutdown_connections 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff568067330 0x7ff5680697e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff57c15e270 0x7ff57c14c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff57c06d3f0 0x7ff57c16b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 --2- 172.21.15.142:0/3172539959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff57c0c6da0 0x7ff57c16de00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 >> 172.21.15.142:0/3172539959 conn(0x7ff57c067e30 msgr2=0x7ff57c15c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 shutdown_connections 2023-09-30T22:55:09.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.297+0000 7ff581fff700 1 -- 172.21.15.142:0/3172539959 wait complete. 2023-09-30T22:55:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:55:09.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:55:09.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.506+0000 7f888a9ff700 1 Processor -- start 2023-09-30T22:55:09.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.506+0000 7f888a9ff700 1 -- start start 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.507+0000 7f888a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88840cee50 0x7f8884159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.507+0000 7f888a9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88840d03d0 0x7f888415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.507+0000 7f888a9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888406b8d0 con 0x7f88841598e0 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.507+0000 7f888a9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88840cff40 con 0x7f88840d03d0 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.507+0000 7f888a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88840cf330 con 0x7f88840cee50 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88840d03d0 0x7f888415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88840d03d0 0x7f888415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39898/0 (socket says 172.21.15.142:39898) 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 -- 172.21.15.142:0/1061599395 learned_addr learned my addr 172.21.15.142:0/1061599395 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f88837fe700 1 --2- 172.21.15.142:0/1061599395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88840cee50 0x7f8884159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 -- 172.21.15.142:0/1061599395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88840cee50 msgr2=0x7f8884159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 --2- 172.21.15.142:0/1061599395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88840cee50 0x7f8884159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 -- 172.21.15.142:0/1061599395 >> v1:172.21.15.148:6789/0 conn(0x7f88841598e0 legacy=0x7f888406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 -- 172.21.15.142:0/1061599395 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840cf610 con 0x7f88840d03d0 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.508+0000 7f8888f9c700 1 --2- 172.21.15.142:0/1061599395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f888415d7d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f887c009f20 tx=0x7f887c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c288a4a027d8e94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f8882ffd700 1 -- 172.21.15.142:0/1061599395 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c00e070 con 0x7f88840d03d0 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f8882ffd700 1 -- 172.21.15.142:0/1061599395 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c00b9d0 con 0x7f88840d03d0 2023-09-30T22:55:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f8882ffd700 1 -- 172.21.15.142:0/1061599395 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c0092e0 con 0x7f88840d03d0 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 -- 172.21.15.142:0/1061599395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 msgr2=0x7f888415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 --2- 172.21.15.142:0/1061599395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f888415d7d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f887c009f20 tx=0x7f887c009840 comp rx=0 tx=0).stop 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 -- 172.21.15.142:0/1061599395 shutdown_connections 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 --2- 172.21.15.142:0/1061599395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f888415d7d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 --2- 172.21.15.142:0/1061599395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88840cee50 0x7f8884159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 -- 172.21.15.142:0/1061599395 >> 172.21.15.142:0/1061599395 conn(0x7f88840cd540 msgr2=0x7f88840cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 -- 172.21.15.142:0/1061599395 shutdown_connections 2023-09-30T22:55:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.509+0000 7f888a9ff700 1 -- 172.21.15.142:0/1061599395 wait complete. 2023-09-30T22:55:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.511+0000 7f888a9ff700 1 Processor -- start 2023-09-30T22:55:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.511+0000 7f888a9ff700 1 -- start start 2023-09-30T22:55:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f888a9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88840cee50 0x7f88841562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f888a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f88840c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f888a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88841598e0 0x7f88840b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f888a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840caaa0 con 0x7f88840d03d0 2023-09-30T22:55:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f888a9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840cad80 con 0x7f88840cee50 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f888a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88840cb060 con 0x7f88841598e0 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f88837fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f88840c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f88837fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f88840c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39914/0 (socket says 172.21.15.142:39914) 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f88837fe700 1 -- 172.21.15.142:0/312291424 learned_addr learned my addr 172.21.15.142:0/312291424 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f8888f9c700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88841598e0 0x7f88840b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.512+0000 7f8883fff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88840cee50 0x7f88841562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f88837fe700 1 -- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88841598e0 msgr2=0x7f88840b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f88837fe700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88841598e0 0x7f88840b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f88837fe700 1 -- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88840cee50 msgr2=0x7f88841562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f88837fe700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88840cee50 0x7f88841562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f88837fe700 1 -- 172.21.15.142:0/312291424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c009ae0 con 0x7f88840d03d0 2023-09-30T22:55:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f8883fff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88840cee50 0x7f88841562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:55:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f88837fe700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f88840c88f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f887800e900 tx=0x7f88780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f886bfff700 1 -- 172.21.15.142:0/312291424 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878013680 con 0x7f88840d03d0 2023-09-30T22:55:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f886bfff700 1 -- 172.21.15.142:0/312291424 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88780137e0 con 0x7f88840d03d0 2023-09-30T22:55:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f886bfff700 1 -- 172.21.15.142:0/312291424 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878013ba0 con 0x7f88840d03d0 2023-09-30T22:55:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88840cb340 con 0x7f88840d03d0 2023-09-30T22:55:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.513+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8884156830 con 0x7f88840d03d0 2023-09-30T22:55:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.514+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88840cb7e0 con 0x7f88840d03d0 2023-09-30T22:55:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.515+0000 7f886bfff700 1 -- 172.21.15.142:0/312291424 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f887800c460 con 0x7f88840d03d0 2023-09-30T22:55:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.516+0000 7f886bfff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8870067330 0x7f88700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.516+0000 7f886bfff700 1 -- 172.21.15.142:0/312291424 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8878084d70 con 0x7f88840d03d0 2023-09-30T22:55:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.516+0000 7f8883fff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8870067330 0x7f88700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.517+0000 7f8883fff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8870067330 0x7f88700697e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8874007fd0 tx=0x7f8874009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.521+0000 7f886bfff700 1 -- 172.21.15.142:0/312291424 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8878051bd0 con 0x7f88840d03d0 2023-09-30T22:55:09.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.707+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f888406fc10 con 0x7f8870067330 2023-09-30T22:55:09.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.716+0000 7f886bfff700 1 -- 172.21.15.142:0/312291424 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303090 (secure 0 0 0) 0x7f888406fc10 con 0x7f8870067330 2023-09-30T22:55:09.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:09.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8870067330 msgr2=0x7f88700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8870067330 0x7f88700697e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8874007fd0 tx=0x7f8874009040 comp rx=0 tx=0).stop 2023-09-30T22:55:09.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 msgr2=0x7f88840c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f88840c88f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f887800e900 tx=0x7f88780091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 shutdown_connections 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8870067330 0x7f88700697e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88841598e0 0x7f88840b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88840cee50 0x7f88841562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 --2- 172.21.15.142:0/312291424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88840d03d0 0x7f88840c88f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 >> 172.21.15.142:0/312291424 conn(0x7f88840cd540 msgr2=0x7f8884156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 shutdown_connections 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.720+0000 7f888a9ff700 1 -- 172.21.15.142:0/312291424 wait complete. 2023-09-30T22:55:09.723 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:55:09.737 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-09-30T22:55:08.134937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558304,"statfs":{"total":1600000000,"available":1595703417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.759841"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397065+0000","last_change":"2023-09-30T22:55:05.396946+0000","last_active":"2023-09-30T22:55:05.397065+0000","last_peered":"2023-09-30T22:55:05.397065+0000","last_clean":"2023-09-30T22:55:05.397065+0000","last_became_active":"2023-09-30T22:55:05.396648+0000","last_became_peered":"2023-09-30T22:55:05.396648+0000","last_unstale":"2023-09-30T22:55:05.397065+0000","last_undegraded":"2023-09-30T22:55:05.397065+0000","last_fullsized":"2023-09-30T22:55:05.397065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:32.376249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397477+0000","last_change":"2023-09-30T22:55:05.397400+0000","last_active":"2023-09-30T22:55:05.397477+0000","last_peered":"2023-09-30T22:55:05.397477+0000","last_clean":"2023-09-30T22:55:05.397477+0000","last_became_active":"2023-09-30T22:55:05.397172+0000","last_became_peered":"2023-09-30T22:55:05.397172+0000","last_unstale":"2023-09-30T22:55:05.397477+0000","last_undegraded":"2023-09-30T22:55:05.397477+0000","last_fullsized":"2023-09-30T22:55:05.397477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:24.924960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393746+0000","last_change":"2023-09-30T22:55:05.392399+0000","last_active":"2023-09-30T22:55:05.393746+0000","last_peered":"2023-09-30T22:55:05.393746+0000","last_clean":"2023-09-30T22:55:05.393746+0000","last_became_active":"2023-09-30T22:55:05.391963+0000","last_became_peered":"2023-09-30T22:55:05.391963+0000","last_unstale":"2023-09-30T22:55:05.393746+0000","last_undegraded":"2023-09-30T22:55:05.393746+0000","last_fullsized":"2023-09-30T22:55:05.393746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:18.310209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398236+0000","last_change":"2023-09-30T22:55:05.398039+0000","last_active":"2023-09-30T22:55:05.398236+0000","last_peered":"2023-09-30T22:55:05.398236+0000","last_clean":"2023-09-30T22:55:05.398236+0000","last_became_active":"2023-09-30T22:55:05.397499+0000","last_became_peered":"2023-09-30T22:55:05.397499+0000","last_unstale":"2023-09-30T22:55:05.398236+0000","last_undegraded":"2023-09-30T22:55:05.398236+0000","last_fullsized":"2023-09-30T22:55:05.398236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:42.006206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397494+0000","last_change":"2023-09-30T22:55:05.397254+0000","last_active":"2023-09-30T22:55:05.397494+0000","last_peered":"2023-09-30T22:55:05.397494+0000","last_clean":"2023-09-30T22:55:05.397494+0000","last_became_active":"2023-09-30T22:55:05.396700+0000","last_became_peered":"2023-09-30T22:55:05.396700+0000","last_unstale":"2023-09-30T22:55:05.397494+0000","last_undegraded":"2023-09-30T22:55:05.397494+0000","last_fullsized":"2023-09-30T22:55:05.397494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:38:55.195540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401859+0000","last_change":"2023-09-30T22:55:05.401822+0000","last_active":"2023-09-30T22:55:05.401859+0000","last_peered":"2023-09-30T22:55:05.401859+0000","last_clean":"2023-09-30T22:55:05.401859+0000","last_became_active":"2023-09-30T22:55:05.401333+0000","last_became_peered":"2023-09-30T22:55:05.401333+0000","last_unstale":"2023-09-30T22:55:05.401859+0000","last_undegraded":"2023-09-30T22:55:05.401859+0000","last_fullsized":"2023-09-30T22:55:05.401859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:39.868543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.391885+0000","last_change":"2023-09-30T22:55:05.391792+0000","last_active":"2023-09-30T22:55:05.391885+0000","last_peered":"2023-09-30T22:55:05.391885+0000","last_clean":"2023-09-30T22:55:05.391885+0000","last_became_active":"2023-09-30T22:55:05.391561+0000","last_became_peered":"2023-09-30T22:55:05.391561+0000","last_unstale":"2023-09-30T22:55:05.391885+0000","last_undegraded":"2023-09-30T22:55:05.391885+0000","last_fullsized":"2023-09-30T22:55:05.391885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:28:24.201892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396388+0000","last_change":"2023-09-30T22:55:05.396107+0000","last_active":"2023-09-30T22:55:05.396388+0000","last_peered":"2023-09-30T22:55:05.396388+0000","last_clean":"2023-09-30T22:55:05.396388+0000","last_became_active":"2023-09-30T22:55:05.395870+0000","last_became_peered":"2023-09-30T22:55:05.395870+0000","last_unstale":"2023-09-30T22:55:05.396388+0000","last_undegraded":"2023-09-30T22:55:05.396388+0000","last_fullsized":"2023-09-30T22:55:05.396388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:00.564241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400940+0000","last_change":"2023-09-30T22:55:05.400859+0000","last_active":"2023-09-30T22:55:05.400940+0000","last_peered":"2023-09-30T22:55:05.400940+0000","last_clean":"2023-09-30T22:55:05.400940+0000","last_became_active":"2023-09-30T22:55:05.400582+0000","last_became_peered":"2023-09-30T22:55:05.400582+0000","last_unstale":"2023-09-30T22:55:05.400940+0000","last_undegraded":"2023-09-30T22:55:05.400940+0000","last_fullsized":"2023-09-30T22:55:05.400940+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:53.309079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396008+0000","last_change":"2023-09-30T22:55:05.395924+0000","last_active":"2023-09-30T22:55:05.396008+0000","last_peered":"2023-09-30T22:55:05.396008+0000","last_clean":"2023-09-30T22:55:05.396008+0000","last_became_active":"2023-09-30T22:55:05.395113+0000","last_became_peered":"2023-09-30T22:55:05.395113+0000","last_unstale":"2023-09-30T22:55:05.396008+0000","last_undegraded":"2023-09-30T22:55:05.396008+0000","last_fullsized":"2023-09-30T22:55:05.396008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:22.938119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393042+0000","last_change":"2023-09-30T22:55:05.391266+0000","last_active":"2023-09-30T22:55:05.393042+0000","last_peered":"2023-09-30T22:55:05.393042+0000","last_clean":"2023-09-30T22:55:05.393042+0000","last_became_active":"2023-09-30T22:55:05.390685+0000","last_became_peered":"2023-09-30T22:55:05.390685+0000","last_unstale":"2023-09-30T22:55:05.393042+0000","last_undegraded":"2023-09-30T22:55:05.393042+0000","last_fullsized":"2023-09-30T22:55:05.393042+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:39.868543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392963+0000","last_change":"2023-09-30T22:55:05.389968+0000","last_active":"2023-09-30T22:55:05.392963+0000","last_peered":"2023-09-30T22:55:05.392963+0000","last_clean":"2023-09-30T22:55:05.392963+0000","last_became_active":"2023-09-30T22:55:05.389374+0000","last_became_peered":"2023-09-30T22:55:05.389374+0000","last_unstale":"2023-09-30T22:55:05.392963+0000","last_undegraded":"2023-09-30T22:55:05.392963+0000","last_fullsized":"2023-09-30T22:55:05.392963+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:15:00.398009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.402018+0000","last_change":"2023-09-30T22:55:05.401948+0000","last_active":"2023-09-30T22:55:05.402018+0000","last_peered":"2023-09-30T22:55:05.402018+0000","last_clean":"2023-09-30T22:55:05.402018+0000","last_became_active":"2023-09-30T22:55:05.401574+0000","last_became_peered":"2023-09-30T22:55:05.401574+0000","last_unstale":"2023-09-30T22:55:05.402018+0000","last_undegraded":"2023-09-30T22:55:05.402018+0000","last_fullsized":"2023-09-30T22:55:05.402018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:29:02.009870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.402718+0000","last_change":"2023-09-30T22:55:05.402657+0000","last_active":"2023-09-30T22:55:05.402718+0000","last_peered":"2023-09-30T22:55:05.402718+0000","last_clean":"2023-09-30T22:55:05.402718+0000","last_became_active":"2023-09-30T22:55:05.402363+0000","last_became_peered":"2023-09-30T22:55:05.402363+0000","last_unstale":"2023-09-30T22:55:05.402718+0000","last_undegraded":"2023-09-30T22:55:05.402718+0000","last_fullsized":"2023-09-30T22:55:05.402718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:22:16.458844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395991+0000","last_change":"2023-09-30T22:55:05.395790+0000","last_active":"2023-09-30T22:55:05.395991+0000","last_peered":"2023-09-30T22:55:05.395991+0000","last_clean":"2023-09-30T22:55:05.395991+0000","last_became_active":"2023-09-30T22:55:05.394829+0000","last_became_peered":"2023-09-30T22:55:05.394829+0000","last_unstale":"2023-09-30T22:55:05.395991+0000","last_undegraded":"2023-09-30T22:55:05.395991+0000","last_fullsized":"2023-09-30T22:55:05.395991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:15.485522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395716+0000","last_change":"2023-09-30T22:55:05.395644+0000","last_active":"2023-09-30T22:55:05.395716+0000","last_peered":"2023-09-30T22:55:05.395716+0000","last_clean":"2023-09-30T22:55:05.395716+0000","last_became_active":"2023-09-30T22:55:05.395399+0000","last_became_peered":"2023-09-30T22:55:05.395399+0000","last_unstale":"2023-09-30T22:55:05.395716+0000","last_undegraded":"2023-09-30T22:55:05.395716+0000","last_fullsized":"2023-09-30T22:55:05.395716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:32.376249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398909+0000","last_change":"2023-09-30T22:55:05.398564+0000","last_active":"2023-09-30T22:55:05.398909+0000","last_peered":"2023-09-30T22:55:05.398909+0000","last_clean":"2023-09-30T22:55:05.398909+0000","last_became_active":"2023-09-30T22:55:05.398308+0000","last_became_peered":"2023-09-30T22:55:05.398308+0000","last_unstale":"2023-09-30T22:55:05.398909+0000","last_undegraded":"2023-09-30T22:55:05.398909+0000","last_fullsized":"2023-09-30T22:55:05.398909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:59.786016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395492+0000","last_change":"2023-09-30T22:55:05.395340+0000","last_active":"2023-09-30T22:55:05.395492+0000","last_peered":"2023-09-30T22:55:05.395492+0000","last_clean":"2023-09-30T22:55:05.395492+0000","last_became_active":"2023-09-30T22:55:05.395103+0000","last_became_peered":"2023-09-30T22:55:05.395103+0000","last_unstale":"2023-09-30T22:55:05.395492+0000","last_undegraded":"2023-09-30T22:55:05.395492+0000","last_fullsized":"2023-09-30T22:55:05.395492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:50.567383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393462+0000","last_change":"2023-09-30T22:55:05.393395+0000","last_active":"2023-09-30T22:55:05.393462+0000","last_peered":"2023-09-30T22:55:05.393462+0000","last_clean":"2023-09-30T22:55:05.393462+0000","last_became_active":"2023-09-30T22:55:05.393173+0000","last_became_peered":"2023-09-30T22:55:05.393173+0000","last_unstale":"2023-09-30T22:55:05.393462+0000","last_undegraded":"2023-09-30T22:55:05.393462+0000","last_fullsized":"2023-09-30T22:55:05.393462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:55:46.438319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395996+0000","last_change":"2023-09-30T22:55:05.395926+0000","last_active":"2023-09-30T22:55:05.395996+0000","last_peered":"2023-09-30T22:55:05.395996+0000","last_clean":"2023-09-30T22:55:05.395996+0000","last_became_active":"2023-09-30T22:55:05.395698+0000","last_became_peered":"2023-09-30T22:55:05.395698+0000","last_unstale":"2023-09-30T22:55:05.395996+0000","last_undegraded":"2023-09-30T22:55:05.395996+0000","last_fullsized":"2023-09-30T22:55:05.395996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:44:40.678999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400864+0000","last_change":"2023-09-30T22:55:05.400795+0000","last_active":"2023-09-30T22:55:05.400864+0000","last_peered":"2023-09-30T22:55:05.400864+0000","last_clean":"2023-09-30T22:55:05.400864+0000","last_became_active":"2023-09-30T22:55:05.400567+0000","last_became_peered":"2023-09-30T22:55:05.400567+0000","last_unstale":"2023-09-30T22:55:05.400864+0000","last_undegraded":"2023-09-30T22:55:05.400864+0000","last_fullsized":"2023-09-30T22:55:05.400864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:50:49.954947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401618+0000","last_change":"2023-09-30T22:55:05.401552+0000","last_active":"2023-09-30T22:55:05.401618+0000","last_peered":"2023-09-30T22:55:05.401618+0000","last_clean":"2023-09-30T22:55:05.401618+0000","last_became_active":"2023-09-30T22:55:05.401357+0000","last_became_peered":"2023-09-30T22:55:05.401357+0000","last_unstale":"2023-09-30T22:55:05.401618+0000","last_undegraded":"2023-09-30T22:55:05.401618+0000","last_fullsized":"2023-09-30T22:55:05.401618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:05.766842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398468+0000","last_change":"2023-09-30T22:55:05.398395+0000","last_active":"2023-09-30T22:55:05.398468+0000","last_peered":"2023-09-30T22:55:05.398468+0000","last_clean":"2023-09-30T22:55:05.398468+0000","last_became_active":"2023-09-30T22:55:05.398169+0000","last_became_peered":"2023-09-30T22:55:05.398169+0000","last_unstale":"2023-09-30T22:55:05.398468+0000","last_undegraded":"2023-09-30T22:55:05.398468+0000","last_fullsized":"2023-09-30T22:55:05.398468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:30:47.992273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.391818+0000","last_change":"2023-09-30T22:55:05.391758+0000","last_active":"2023-09-30T22:55:05.391818+0000","last_peered":"2023-09-30T22:55:05.391818+0000","last_clean":"2023-09-30T22:55:05.391818+0000","last_became_active":"2023-09-30T22:55:05.391522+0000","last_became_peered":"2023-09-30T22:55:05.391522+0000","last_unstale":"2023-09-30T22:55:05.391818+0000","last_undegraded":"2023-09-30T22:55:05.391818+0000","last_fullsized":"2023-09-30T22:55:05.391818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:18.099509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.403583+0000","last_change":"2023-09-30T22:55:05.403511+0000","last_active":"2023-09-30T22:55:05.403583+0000","last_peered":"2023-09-30T22:55:05.403583+0000","last_clean":"2023-09-30T22:55:05.403583+0000","last_became_active":"2023-09-30T22:55:05.403174+0000","last_became_peered":"2023-09-30T22:55:05.403174+0000","last_unstale":"2023-09-30T22:55:05.403583+0000","last_undegraded":"2023-09-30T22:55:05.403583+0000","last_fullsized":"2023-09-30T22:55:05.403583+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:43:13.438076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394672+0000","last_change":"2023-09-30T22:55:05.394588+0000","last_active":"2023-09-30T22:55:05.394672+0000","last_peered":"2023-09-30T22:55:05.394672+0000","last_clean":"2023-09-30T22:55:05.394672+0000","last_became_active":"2023-09-30T22:55:05.394374+0000","last_became_peered":"2023-09-30T22:55:05.394374+0000","last_unstale":"2023-09-30T22:55:05.394672+0000","last_undegraded":"2023-09-30T22:55:05.394672+0000","last_fullsized":"2023-09-30T22:55:05.394672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:57.950995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400166+0000","last_change":"2023-09-30T22:55:05.399767+0000","last_active":"2023-09-30T22:55:05.400166+0000","last_peered":"2023-09-30T22:55:05.400166+0000","last_clean":"2023-09-30T22:55:05.400166+0000","last_became_active":"2023-09-30T22:55:05.399548+0000","last_became_peered":"2023-09-30T22:55:05.399548+0000","last_unstale":"2023-09-30T22:55:05.400166+0000","last_undegraded":"2023-09-30T22:55:05.400166+0000","last_fullsized":"2023-09-30T22:55:05.400166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:30.273336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397014+0000","last_change":"2023-09-30T22:55:05.394994+0000","last_active":"2023-09-30T22:55:05.397014+0000","last_peered":"2023-09-30T22:55:05.397014+0000","last_clean":"2023-09-30T22:55:05.397014+0000","last_became_active":"2023-09-30T22:55:05.394711+0000","last_became_peered":"2023-09-30T22:55:05.394711+0000","last_unstale":"2023-09-30T22:55:05.397014+0000","last_undegraded":"2023-09-30T22:55:05.397014+0000","last_fullsized":"2023-09-30T22:55:05.397014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:25.035382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.403864+0000","last_change":"2023-09-30T22:55:05.403712+0000","last_active":"2023-09-30T22:55:05.403864+0000","last_peered":"2023-09-30T22:55:05.403864+0000","last_clean":"2023-09-30T22:55:05.403864+0000","last_became_active":"2023-09-30T22:55:05.403478+0000","last_became_peered":"2023-09-30T22:55:05.403478+0000","last_unstale":"2023-09-30T22:55:05.403864+0000","last_undegraded":"2023-09-30T22:55:05.403864+0000","last_fullsized":"2023-09-30T22:55:05.403864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:01.320914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393023+0000","last_change":"2023-09-30T22:55:05.391193+0000","last_active":"2023-09-30T22:55:05.393023+0000","last_peered":"2023-09-30T22:55:05.393023+0000","last_clean":"2023-09-30T22:55:05.393023+0000","last_became_active":"2023-09-30T22:55:05.390970+0000","last_became_peered":"2023-09-30T22:55:05.390970+0000","last_unstale":"2023-09-30T22:55:05.393023+0000","last_undegraded":"2023-09-30T22:55:05.393023+0000","last_fullsized":"2023-09-30T22:55:05.393023+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:01.031072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393712+0000","last_change":"2023-09-30T22:55:05.392175+0000","last_active":"2023-09-30T22:55:05.393712+0000","last_peered":"2023-09-30T22:55:05.393712+0000","last_clean":"2023-09-30T22:55:05.393712+0000","last_became_active":"2023-09-30T22:55:05.391558+0000","last_became_peered":"2023-09-30T22:55:05.391558+0000","last_unstale":"2023-09-30T22:55:05.393712+0000","last_undegraded":"2023-09-30T22:55:05.393712+0000","last_fullsized":"2023-09-30T22:55:05.393712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:56.731913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397033+0000","last_change":"2023-09-30T22:55:05.395463+0000","last_active":"2023-09-30T22:55:05.397033+0000","last_peered":"2023-09-30T22:55:05.397033+0000","last_clean":"2023-09-30T22:55:05.397033+0000","last_became_active":"2023-09-30T22:55:05.395240+0000","last_became_peered":"2023-09-30T22:55:05.395240+0000","last_unstale":"2023-09-30T22:55:05.397033+0000","last_undegraded":"2023-09-30T22:55:05.397033+0000","last_fullsized":"2023-09-30T22:55:05.397033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:01.031072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393059+0000","last_change":"2023-09-30T22:55:05.391465+0000","last_active":"2023-09-30T22:55:05.393059+0000","last_peered":"2023-09-30T22:55:05.393059+0000","last_clean":"2023-09-30T22:55:05.393059+0000","last_became_active":"2023-09-30T22:55:05.391039+0000","last_became_peered":"2023-09-30T22:55:05.391039+0000","last_unstale":"2023-09-30T22:55:05.393059+0000","last_undegraded":"2023-09-30T22:55:05.393059+0000","last_fullsized":"2023-09-30T22:55:05.393059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:46.061524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"71'4","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.409970+0000","last_change":"2023-09-30T22:55:04.384604+0000","last_active":"2023-09-30T22:55:05.409970+0000","last_peered":"2023-09-30T22:55:05.409970+0000","last_clean":"2023-09-30T22:55:05.409970+0000","last_became_active":"2023-09-30T22:55:04.384344+0000","last_became_peered":"2023-09-30T22:55:04.384344+0000","last_unstale":"2023-09-30T22:55:05.409970+0000","last_undegraded":"2023-09-30T22:55:05.409970+0000","last_fullsized":"2023-09-30T22:55:05.409970+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:47.343798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397511+0000","last_change":"2023-09-30T22:55:05.397435+0000","last_active":"2023-09-30T22:55:05.397511+0000","last_peered":"2023-09-30T22:55:05.397511+0000","last_clean":"2023-09-30T22:55:05.397511+0000","last_became_active":"2023-09-30T22:55:05.397042+0000","last_became_peered":"2023-09-30T22:55:05.397042+0000","last_unstale":"2023-09-30T22:55:05.397511+0000","last_undegraded":"2023-09-30T22:55:05.397511+0000","last_fullsized":"2023-09-30T22:55:05.397511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:40.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411237+0000","last_change":"2023-09-30T22:55:04.390755+0000","last_active":"2023-09-30T22:55:05.411237+0000","last_peered":"2023-09-30T22:55:05.411237+0000","last_clean":"2023-09-30T22:55:05.411237+0000","last_became_active":"2023-09-30T22:55:04.389724+0000","last_became_peered":"2023-09-30T22:55:04.389724+0000","last_unstale":"2023-09-30T22:55:05.411237+0000","last_undegraded":"2023-09-30T22:55:05.411237+0000","last_fullsized":"2023-09-30T22:55:05.411237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:29:01.003396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395408+0000","last_change":"2023-09-30T22:55:05.395339+0000","last_active":"2023-09-30T22:55:05.395408+0000","last_peered":"2023-09-30T22:55:05.395408+0000","last_clean":"2023-09-30T22:55:05.395408+0000","last_became_active":"2023-09-30T22:55:05.395123+0000","last_became_peered":"2023-09-30T22:55:05.395123+0000","last_unstale":"2023-09-30T22:55:05.395408+0000","last_undegraded":"2023-09-30T22:55:05.395408+0000","last_fullsized":"2023-09-30T22:55:05.395408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:55:46.438319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.410105+0000","last_change":"2023-09-30T22:55:04.387487+0000","last_active":"2023-09-30T22:55:05.410105+0000","last_peered":"2023-09-30T22:55:05.410105+0000","last_clean":"2023-09-30T22:55:05.410105+0000","last_became_active":"2023-09-30T22:55:04.387253+0000","last_became_peered":"2023-09-30T22:55:04.387253+0000","last_unstale":"2023-09-30T22:55:05.410105+0000","last_undegraded":"2023-09-30T22:55:05.410105+0000","last_fullsized":"2023-09-30T22:55:05.410105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:25:43.492691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.399499+0000","last_change":"2023-09-30T22:55:05.399331+0000","last_active":"2023-09-30T22:55:05.399499+0000","last_peered":"2023-09-30T22:55:05.399499+0000","last_clean":"2023-09-30T22:55:05.399499+0000","last_became_active":"2023-09-30T22:55:05.397981+0000","last_became_peered":"2023-09-30T22:55:05.397981+0000","last_unstale":"2023-09-30T22:55:05.399499+0000","last_undegraded":"2023-09-30T22:55:05.399499+0000","last_fullsized":"2023-09-30T22:55:05.399499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:35:41.457732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.409876+0000","last_change":"2023-09-30T22:55:04.393053+0000","last_active":"2023-09-30T22:55:05.409876+0000","last_peered":"2023-09-30T22:55:05.409876+0000","last_clean":"2023-09-30T22:55:05.409876+0000","last_became_active":"2023-09-30T22:55:04.392585+0000","last_became_peered":"2023-09-30T22:55:04.392585+0000","last_unstale":"2023-09-30T22:55:05.409876+0000","last_undegraded":"2023-09-30T22:55:05.409876+0000","last_fullsized":"2023-09-30T22:55:05.409876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:31.369776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394198+0000","last_change":"2023-09-30T22:55:05.393976+0000","last_active":"2023-09-30T22:55:05.394198+0000","last_peered":"2023-09-30T22:55:05.394198+0000","last_clean":"2023-09-30T22:55:05.394198+0000","last_became_active":"2023-09-30T22:55:05.393415+0000","last_became_peered":"2023-09-30T22:55:05.393415+0000","last_unstale":"2023-09-30T22:55:05.394198+0000","last_undegraded":"2023-09-30T22:55:05.394198+0000","last_fullsized":"2023-09-30T22:55:05.394198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:48.621251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.407660+0000","last_change":"2023-09-30T22:55:04.394644+0000","last_active":"2023-09-30T22:55:05.407660+0000","last_peered":"2023-09-30T22:55:05.407660+0000","last_clean":"2023-09-30T22:55:05.407660+0000","last_became_active":"2023-09-30T22:55:04.393562+0000","last_became_peered":"2023-09-30T22:55:04.393562+0000","last_unstale":"2023-09-30T22:55:05.407660+0000","last_undegraded":"2023-09-30T22:55:05.407660+0000","last_fullsized":"2023-09-30T22:55:05.407660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:23.542088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393041+0000","last_change":"2023-09-30T22:55:05.392875+0000","last_active":"2023-09-30T22:55:05.393041+0000","last_peered":"2023-09-30T22:55:05.393041+0000","last_clean":"2023-09-30T22:55:05.393041+0000","last_became_active":"2023-09-30T22:55:05.392658+0000","last_became_peered":"2023-09-30T22:55:05.392658+0000","last_unstale":"2023-09-30T22:55:05.393041+0000","last_undegraded":"2023-09-30T22:55:05.393041+0000","last_fullsized":"2023-09-30T22:55:05.393041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:50.567383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.408665+0000","last_change":"2023-09-30T22:55:04.391970+0000","last_active":"2023-09-30T22:55:05.408665+0000","last_peered":"2023-09-30T22:55:05.408665+0000","last_clean":"2023-09-30T22:55:05.408665+0000","last_became_active":"2023-09-30T22:55:04.391652+0000","last_became_peered":"2023-09-30T22:55:04.391652+0000","last_unstale":"2023-09-30T22:55:05.408665+0000","last_undegraded":"2023-09-30T22:55:05.408665+0000","last_fullsized":"2023-09-30T22:55:05.408665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:53:08.737967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397435+0000","last_change":"2023-09-30T22:55:05.397337+0000","last_active":"2023-09-30T22:55:05.397435+0000","last_peered":"2023-09-30T22:55:05.397435+0000","last_clean":"2023-09-30T22:55:05.397435+0000","last_became_active":"2023-09-30T22:55:05.396562+0000","last_became_peered":"2023-09-30T22:55:05.396562+0000","last_unstale":"2023-09-30T22:55:05.397435+0000","last_undegraded":"2023-09-30T22:55:05.397435+0000","last_fullsized":"2023-09-30T22:55:05.397435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:44:34.604294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.384457+0000","last_change":"2023-09-30T22:55:04.390920+0000","last_active":"2023-09-30T22:55:05.384457+0000","last_peered":"2023-09-30T22:55:05.384457+0000","last_clean":"2023-09-30T22:55:05.384457+0000","last_became_active":"2023-09-30T22:55:04.390532+0000","last_became_peered":"2023-09-30T22:55:04.390532+0000","last_unstale":"2023-09-30T22:55:05.384457+0000","last_undegraded":"2023-09-30T22:55:05.384457+0000","last_fullsized":"2023-09-30T22:55:05.384457+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:04.915525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398870+0000","last_change":"2023-09-30T22:55:05.398033+0000","last_active":"2023-09-30T22:55:05.398870+0000","last_peered":"2023-09-30T22:55:05.398870+0000","last_clean":"2023-09-30T22:55:05.398870+0000","last_became_active":"2023-09-30T22:55:05.397250+0000","last_became_peered":"2023-09-30T22:55:05.397250+0000","last_unstale":"2023-09-30T22:55:05.398870+0000","last_undegraded":"2023-09-30T22:55:05.398870+0000","last_fullsized":"2023-09-30T22:55:05.398870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:57.950995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.385876+0000","last_change":"2023-09-30T22:55:04.394076+0000","last_active":"2023-09-30T22:55:05.385876+0000","last_peered":"2023-09-30T22:55:05.385876+0000","last_clean":"2023-09-30T22:55:05.385876+0000","last_became_active":"2023-09-30T22:55:04.393845+0000","last_became_peered":"2023-09-30T22:55:04.393845+0000","last_unstale":"2023-09-30T22:55:05.385876+0000","last_undegraded":"2023-09-30T22:55:05.385876+0000","last_fullsized":"2023-09-30T22:55:05.385876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:12:41.855205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392895+0000","last_change":"2023-09-30T22:55:05.392317+0000","last_active":"2023-09-30T22:55:05.392895+0000","last_peered":"2023-09-30T22:55:05.392895+0000","last_clean":"2023-09-30T22:55:05.392895+0000","last_became_active":"2023-09-30T22:55:05.391589+0000","last_became_peered":"2023-09-30T22:55:05.391589+0000","last_unstale":"2023-09-30T22:55:05.392895+0000","last_undegraded":"2023-09-30T22:55:05.392895+0000","last_fullsized":"2023-09-30T22:55:05.392895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:53.955855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.386492+0000","last_change":"2023-09-30T22:55:04.392831+0000","last_active":"2023-09-30T22:55:05.386492+0000","last_peered":"2023-09-30T22:55:05.386492+0000","last_clean":"2023-09-30T22:55:05.386492+0000","last_became_active":"2023-09-30T22:55:04.392211+0000","last_became_peered":"2023-09-30T22:55:04.392211+0000","last_unstale":"2023-09-30T22:55:05.386492+0000","last_undegraded":"2023-09-30T22:55:05.386492+0000","last_fullsized":"2023-09-30T22:55:05.386492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:47.343798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394216+0000","last_change":"2023-09-30T22:55:05.394063+0000","last_active":"2023-09-30T22:55:05.394216+0000","last_peered":"2023-09-30T22:55:05.394216+0000","last_clean":"2023-09-30T22:55:05.394216+0000","last_became_active":"2023-09-30T22:55:05.393822+0000","last_became_peered":"2023-09-30T22:55:05.393822+0000","last_unstale":"2023-09-30T22:55:05.394216+0000","last_undegraded":"2023-09-30T22:55:05.394216+0000","last_fullsized":"2023-09-30T22:55:05.394216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:09.016933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390559+0000","last_change":"2023-09-30T22:55:04.395381+0000","last_active":"2023-09-30T22:55:05.390559+0000","last_peered":"2023-09-30T22:55:05.390559+0000","last_clean":"2023-09-30T22:55:05.390559+0000","last_became_active":"2023-09-30T22:55:04.395169+0000","last_became_peered":"2023-09-30T22:55:04.395169+0000","last_unstale":"2023-09-30T22:55:05.390559+0000","last_undegraded":"2023-09-30T22:55:05.390559+0000","last_fullsized":"2023-09-30T22:55:05.390559+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:18.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401057+0000","last_change":"2023-09-30T22:55:05.400965+0000","last_active":"2023-09-30T22:55:05.401057+0000","last_peered":"2023-09-30T22:55:05.401057+0000","last_clean":"2023-09-30T22:55:05.401057+0000","last_became_active":"2023-09-30T22:55:05.400732+0000","last_became_peered":"2023-09-30T22:55:05.400732+0000","last_unstale":"2023-09-30T22:55:05.401057+0000","last_undegraded":"2023-09-30T22:55:05.401057+0000","last_fullsized":"2023-09-30T22:55:05.401057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:48.350272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"71'3","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.408741+0000","last_change":"2023-09-30T22:55:04.393065+0000","last_active":"2023-09-30T22:55:05.408741+0000","last_peered":"2023-09-30T22:55:05.408741+0000","last_clean":"2023-09-30T22:55:05.408741+0000","last_became_active":"2023-09-30T22:55:04.392601+0000","last_became_peered":"2023-09-30T22:55:04.392601+0000","last_unstale":"2023-09-30T22:55:05.408741+0000","last_undegraded":"2023-09-30T22:55:05.408741+0000","last_fullsized":"2023-09-30T22:55:05.408741+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:21.931645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393760+0000","last_change":"2023-09-30T22:55:05.392487+0000","last_active":"2023-09-30T22:55:05.393760+0000","last_peered":"2023-09-30T22:55:05.393760+0000","last_clean":"2023-09-30T22:55:05.393760+0000","last_became_active":"2023-09-30T22:55:05.391907+0000","last_became_peered":"2023-09-30T22:55:05.391907+0000","last_unstale":"2023-09-30T22:55:05.393760+0000","last_undegraded":"2023-09-30T22:55:05.393760+0000","last_fullsized":"2023-09-30T22:55:05.393760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:21:53.803715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"71'6","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.412739+0000","last_change":"2023-09-30T22:55:04.395161+0000","last_active":"2023-09-30T22:55:05.412739+0000","last_peered":"2023-09-30T22:55:05.412739+0000","last_clean":"2023-09-30T22:55:05.412739+0000","last_became_active":"2023-09-30T22:55:04.393731+0000","last_became_peered":"2023-09-30T22:55:04.393731+0000","last_unstale":"2023-09-30T22:55:05.412739+0000","last_undegraded":"2023-09-30T22:55:05.412739+0000","last_fullsized":"2023-09-30T22:55:05.412739+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:24.028908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397417+0000","last_change":"2023-09-30T22:55:05.397185+0000","last_active":"2023-09-30T22:55:05.397417+0000","last_peered":"2023-09-30T22:55:05.397417+0000","last_clean":"2023-09-30T22:55:05.397417+0000","last_became_active":"2023-09-30T22:55:05.396287+0000","last_became_peered":"2023-09-30T22:55:05.396287+0000","last_unstale":"2023-09-30T22:55:05.397417+0000","last_undegraded":"2023-09-30T22:55:05.397417+0000","last_fullsized":"2023-09-30T22:55:05.397417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:01.945012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411577+0000","last_change":"2023-09-30T22:55:04.387615+0000","last_active":"2023-09-30T22:55:05.411577+0000","last_peered":"2023-09-30T22:55:05.411577+0000","last_clean":"2023-09-30T22:55:05.411577+0000","last_became_active":"2023-09-30T22:55:04.387363+0000","last_became_peered":"2023-09-30T22:55:04.387363+0000","last_unstale":"2023-09-30T22:55:05.411577+0000","last_undegraded":"2023-09-30T22:55:05.411577+0000","last_fullsized":"2023-09-30T22:55:05.411577+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:32:18.627933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394371+0000","last_change":"2023-09-30T22:55:05.394308+0000","last_active":"2023-09-30T22:55:05.394371+0000","last_peered":"2023-09-30T22:55:05.394371+0000","last_clean":"2023-09-30T22:55:05.394371+0000","last_became_active":"2023-09-30T22:55:05.394087+0000","last_became_peered":"2023-09-30T22:55:05.394087+0000","last_unstale":"2023-09-30T22:55:05.394371+0000","last_undegraded":"2023-09-30T22:55:05.394371+0000","last_fullsized":"2023-09-30T22:55:05.394371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:30.111720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390281+0000","last_change":"2023-09-30T22:55:04.391431+0000","last_active":"2023-09-30T22:55:05.390281+0000","last_peered":"2023-09-30T22:55:05.390281+0000","last_clean":"2023-09-30T22:55:05.390281+0000","last_became_active":"2023-09-30T22:55:04.391212+0000","last_became_peered":"2023-09-30T22:55:04.391212+0000","last_unstale":"2023-09-30T22:55:05.390281+0000","last_undegraded":"2023-09-30T22:55:05.390281+0000","last_fullsized":"2023-09-30T22:55:05.390281+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:45.055050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395486+0000","last_change":"2023-09-30T22:55:05.395413+0000","last_active":"2023-09-30T22:55:05.395486+0000","last_peered":"2023-09-30T22:55:05.395486+0000","last_clean":"2023-09-30T22:55:05.395486+0000","last_became_active":"2023-09-30T22:55:05.395193+0000","last_became_peered":"2023-09-30T22:55:05.395193+0000","last_unstale":"2023-09-30T22:55:05.395486+0000","last_undegraded":"2023-09-30T22:55:05.395486+0000","last_fullsized":"2023-09-30T22:55:05.395486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:24.548562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.387380+0000","last_change":"2023-09-30T22:55:04.394212+0000","last_active":"2023-09-30T22:55:05.387380+0000","last_peered":"2023-09-30T22:55:05.387380+0000","last_clean":"2023-09-30T22:55:05.387380+0000","last_became_active":"2023-09-30T22:55:04.393490+0000","last_became_peered":"2023-09-30T22:55:04.393490+0000","last_unstale":"2023-09-30T22:55:05.387380+0000","last_undegraded":"2023-09-30T22:55:05.387380+0000","last_fullsized":"2023-09-30T22:55:05.387380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:23.542088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.389124+0000","last_change":"2023-09-30T22:55:05.388850+0000","last_active":"2023-09-30T22:55:05.389124+0000","last_peered":"2023-09-30T22:55:05.389124+0000","last_clean":"2023-09-30T22:55:05.389124+0000","last_became_active":"2023-09-30T22:55:05.388613+0000","last_became_peered":"2023-09-30T22:55:05.388613+0000","last_unstale":"2023-09-30T22:55:05.389124+0000","last_undegraded":"2023-09-30T22:55:05.389124+0000","last_fullsized":"2023-09-30T22:55:05.389124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:45:48.615483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"71'8","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411286+0000","last_change":"2023-09-30T22:55:04.392424+0000","last_active":"2023-09-30T22:55:05.411286+0000","last_peered":"2023-09-30T22:55:05.411286+0000","last_clean":"2023-09-30T22:55:05.411286+0000","last_became_active":"2023-09-30T22:55:04.391993+0000","last_became_peered":"2023-09-30T22:55:04.391993+0000","last_unstale":"2023-09-30T22:55:05.411286+0000","last_undegraded":"2023-09-30T22:55:05.411286+0000","last_fullsized":"2023-09-30T22:55:05.411286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:52.302605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394232+0000","last_change":"2023-09-30T22:55:05.394120+0000","last_active":"2023-09-30T22:55:05.394232+0000","last_peered":"2023-09-30T22:55:05.394232+0000","last_clean":"2023-09-30T22:55:05.394232+0000","last_became_active":"2023-09-30T22:55:05.393733+0000","last_became_peered":"2023-09-30T22:55:05.393733+0000","last_unstale":"2023-09-30T22:55:05.394232+0000","last_undegraded":"2023-09-30T22:55:05.394232+0000","last_fullsized":"2023-09-30T22:55:05.394232+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:18.099509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411064+0000","last_change":"2023-09-30T22:55:04.396447+0000","last_active":"2023-09-30T22:55:05.411064+0000","last_peered":"2023-09-30T22:55:05.411064+0000","last_clean":"2023-09-30T22:55:05.411064+0000","last_became_active":"2023-09-30T22:55:04.396209+0000","last_became_peered":"2023-09-30T22:55:04.396209+0000","last_unstale":"2023-09-30T22:55:05.411064+0000","last_undegraded":"2023-09-30T22:55:05.411064+0000","last_fullsized":"2023-09-30T22:55:05.411064+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:02.445658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395499+0000","last_change":"2023-09-30T22:55:05.395416+0000","last_active":"2023-09-30T22:55:05.395499+0000","last_peered":"2023-09-30T22:55:05.395499+0000","last_clean":"2023-09-30T22:55:05.395499+0000","last_became_active":"2023-09-30T22:55:05.395203+0000","last_became_peered":"2023-09-30T22:55:05.395203+0000","last_unstale":"2023-09-30T22:55:05.395499+0000","last_undegraded":"2023-09-30T22:55:05.395499+0000","last_fullsized":"2023-09-30T22:55:05.395499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:31.934217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390793+0000","last_change":"2023-09-30T22:55:04.391739+0000","last_active":"2023-09-30T22:55:05.390793+0000","last_peered":"2023-09-30T22:55:05.390793+0000","last_clean":"2023-09-30T22:55:05.390793+0000","last_became_active":"2023-09-30T22:55:04.391478+0000","last_became_peered":"2023-09-30T22:55:04.391478+0000","last_unstale":"2023-09-30T22:55:05.390793+0000","last_undegraded":"2023-09-30T22:55:05.390793+0000","last_fullsized":"2023-09-30T22:55:05.390793+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:22:15.452370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393730+0000","last_change":"2023-09-30T22:55:05.392220+0000","last_active":"2023-09-30T22:55:05.393730+0000","last_peered":"2023-09-30T22:55:05.393730+0000","last_clean":"2023-09-30T22:55:05.393730+0000","last_became_active":"2023-09-30T22:55:05.391627+0000","last_became_peered":"2023-09-30T22:55:05.391627+0000","last_unstale":"2023-09-30T22:55:05.393730+0000","last_undegraded":"2023-09-30T22:55:05.393730+0000","last_fullsized":"2023-09-30T22:55:05.393730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:59.786016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392567+0000","last_change":"2023-09-30T22:55:04.395324+0000","last_active":"2023-09-30T22:55:05.392567+0000","last_peered":"2023-09-30T22:55:05.392567+0000","last_clean":"2023-09-30T22:55:05.392567+0000","last_became_active":"2023-09-30T22:55:04.394860+0000","last_became_peered":"2023-09-30T22:55:04.394860+0000","last_unstale":"2023-09-30T22:55:05.392567+0000","last_undegraded":"2023-09-30T22:55:05.392567+0000","last_fullsized":"2023-09-30T22:55:05.392567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:00.024599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394656+0000","last_change":"2023-09-30T22:55:05.394304+0000","last_active":"2023-09-30T22:55:05.394656+0000","last_peered":"2023-09-30T22:55:05.394656+0000","last_clean":"2023-09-30T22:55:05.394656+0000","last_became_active":"2023-09-30T22:55:05.394087+0000","last_became_peered":"2023-09-30T22:55:05.394087+0000","last_unstale":"2023-09-30T22:55:05.394656+0000","last_undegraded":"2023-09-30T22:55:05.394656+0000","last_fullsized":"2023-09-30T22:55:05.394656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:44:40.678999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388319+0000","last_change":"2023-09-30T22:55:04.391439+0000","last_active":"2023-09-30T22:55:05.388319+0000","last_peered":"2023-09-30T22:55:05.388319+0000","last_clean":"2023-09-30T22:55:05.388319+0000","last_became_active":"2023-09-30T22:55:04.391210+0000","last_became_peered":"2023-09-30T22:55:04.391210+0000","last_unstale":"2023-09-30T22:55:05.388319+0000","last_undegraded":"2023-09-30T22:55:05.388319+0000","last_fullsized":"2023-09-30T22:55:05.388319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:43:12.431602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395409+0000","last_change":"2023-09-30T22:55:05.395343+0000","last_active":"2023-09-30T22:55:05.395409+0000","last_peered":"2023-09-30T22:55:05.395409+0000","last_clean":"2023-09-30T22:55:05.395409+0000","last_became_active":"2023-09-30T22:55:05.395118+0000","last_became_peered":"2023-09-30T22:55:05.395118+0000","last_unstale":"2023-09-30T22:55:05.395409+0000","last_undegraded":"2023-09-30T22:55:05.395409+0000","last_fullsized":"2023-09-30T22:55:05.395409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:05.766842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392552+0000","last_change":"2023-09-30T22:55:04.393644+0000","last_active":"2023-09-30T22:55:05.392552+0000","last_peered":"2023-09-30T22:55:05.392552+0000","last_clean":"2023-09-30T22:55:05.392552+0000","last_became_active":"2023-09-30T22:55:04.393364+0000","last_became_peered":"2023-09-30T22:55:04.393364+0000","last_unstale":"2023-09-30T22:55:05.392552+0000","last_undegraded":"2023-09-30T22:55:05.392552+0000","last_fullsized":"2023-09-30T22:55:05.392552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:20.415511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401864+0000","last_change":"2023-09-30T22:55:05.401801+0000","last_active":"2023-09-30T22:55:05.401864+0000","last_peered":"2023-09-30T22:55:05.401864+0000","last_clean":"2023-09-30T22:55:05.401864+0000","last_became_active":"2023-09-30T22:55:05.401294+0000","last_became_peered":"2023-09-30T22:55:05.401294+0000","last_unstale":"2023-09-30T22:55:05.401864+0000","last_undegraded":"2023-09-30T22:55:05.401864+0000","last_fullsized":"2023-09-30T22:55:05.401864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:05.921999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.384745+0000","last_change":"2023-09-30T22:55:04.388260+0000","last_active":"2023-09-30T22:55:05.384745+0000","last_peered":"2023-09-30T22:55:05.384745+0000","last_clean":"2023-09-30T22:55:05.384745+0000","last_became_active":"2023-09-30T22:55:04.388012+0000","last_became_peered":"2023-09-30T22:55:04.388012+0000","last_unstale":"2023-09-30T22:55:05.384745+0000","last_undegraded":"2023-09-30T22:55:05.384745+0000","last_fullsized":"2023-09-30T22:55:05.384745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:22:15.452370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.399610+0000","last_change":"2023-09-30T22:55:05.399479+0000","last_active":"2023-09-30T22:55:05.399610+0000","last_peered":"2023-09-30T22:55:05.399610+0000","last_clean":"2023-09-30T22:55:05.399610+0000","last_became_active":"2023-09-30T22:55:05.399251+0000","last_became_peered":"2023-09-30T22:55:05.399251+0000","last_unstale":"2023-09-30T22:55:05.399610+0000","last_undegraded":"2023-09-30T22:55:05.399610+0000","last_fullsized":"2023-09-30T22:55:05.399610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:01.320914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388715+0000","last_change":"2023-09-30T22:55:04.390931+0000","last_active":"2023-09-30T22:55:05.388715+0000","last_peered":"2023-09-30T22:55:05.388715+0000","last_clean":"2023-09-30T22:55:05.388715+0000","last_became_active":"2023-09-30T22:55:04.390438+0000","last_became_peered":"2023-09-30T22:55:04.390438+0000","last_unstale":"2023-09-30T22:55:05.388715+0000","last_undegraded":"2023-09-30T22:55:05.388715+0000","last_fullsized":"2023-09-30T22:55:05.388715+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:24.361671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396497+0000","last_change":"2023-09-30T22:55:05.396412+0000","last_active":"2023-09-30T22:55:05.396497+0000","last_peered":"2023-09-30T22:55:05.396497+0000","last_clean":"2023-09-30T22:55:05.396497+0000","last_became_active":"2023-09-30T22:55:05.396191+0000","last_became_peered":"2023-09-30T22:55:05.396191+0000","last_unstale":"2023-09-30T22:55:05.396497+0000","last_undegraded":"2023-09-30T22:55:05.396497+0000","last_fullsized":"2023-09-30T22:55:05.396497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:18.310209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392661+0000","last_change":"2023-09-30T22:55:04.394639+0000","last_active":"2023-09-30T22:55:05.392661+0000","last_peered":"2023-09-30T22:55:05.392661+0000","last_clean":"2023-09-30T22:55:05.392661+0000","last_became_active":"2023-09-30T22:55:04.393152+0000","last_became_peered":"2023-09-30T22:55:04.393152+0000","last_unstale":"2023-09-30T22:55:05.392661+0000","last_undegraded":"2023-09-30T22:55:05.392661+0000","last_fullsized":"2023-09-30T22:55:05.392661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:45:47.609009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392993+0000","last_change":"2023-09-30T22:55:05.390130+0000","last_active":"2023-09-30T22:55:05.392993+0000","last_peered":"2023-09-30T22:55:05.392993+0000","last_clean":"2023-09-30T22:55:05.392993+0000","last_became_active":"2023-09-30T22:55:05.389698+0000","last_became_peered":"2023-09-30T22:55:05.389698+0000","last_unstale":"2023-09-30T22:55:05.392993+0000","last_undegraded":"2023-09-30T22:55:05.392993+0000","last_fullsized":"2023-09-30T22:55:05.392993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:24.924960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411284+0000","last_change":"2023-09-30T22:55:04.396390+0000","last_active":"2023-09-30T22:55:05.411284+0000","last_peered":"2023-09-30T22:55:05.411284+0000","last_clean":"2023-09-30T22:55:05.411284+0000","last_became_active":"2023-09-30T22:55:04.396123+0000","last_became_peered":"2023-09-30T22:55:04.396123+0000","last_unstale":"2023-09-30T22:55:05.411284+0000","last_undegraded":"2023-09-30T22:55:05.411284+0000","last_fullsized":"2023-09-30T22:55:05.411284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:04.915525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390803+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:55:05.390803+0000","last_peered":"2023-09-30T22:55:05.390803+0000","last_clean":"2023-09-30T22:55:05.390803+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:55:05.390803+0000","last_undegraded":"2023-09-30T22:55:05.390803+0000","last_fullsized":"2023-09-30T22:55:05.390803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398252+0000","last_change":"2023-09-30T22:55:05.398177+0000","last_active":"2023-09-30T22:55:05.398252+0000","last_peered":"2023-09-30T22:55:05.398252+0000","last_clean":"2023-09-30T22:55:05.398252+0000","last_became_active":"2023-09-30T22:55:05.397818+0000","last_became_peered":"2023-09-30T22:55:05.397818+0000","last_unstale":"2023-09-30T22:55:05.398252+0000","last_undegraded":"2023-09-30T22:55:05.398252+0000","last_fullsized":"2023-09-30T22:55:05.398252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:40:33.853274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390718+0000","last_change":"2023-09-30T22:55:04.394888+0000","last_active":"2023-09-30T22:55:05.390718+0000","last_peered":"2023-09-30T22:55:05.390718+0000","last_clean":"2023-09-30T22:55:05.390718+0000","last_became_active":"2023-09-30T22:55:04.394639+0000","last_became_peered":"2023-09-30T22:55:04.394639+0000","last_unstale":"2023-09-30T22:55:05.390718+0000","last_undegraded":"2023-09-30T22:55:05.390718+0000","last_fullsized":"2023-09-30T22:55:05.390718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:30:46.985799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.387539+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:55:05.387539+0000","last_peered":"2023-09-30T22:55:05.387539+0000","last_clean":"2023-09-30T22:55:05.387539+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:55:05.387539+0000","last_undegraded":"2023-09-30T22:55:05.387539+0000","last_fullsized":"2023-09-30T22:55:05.387539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.403566+0000","last_change":"2023-09-30T22:55:05.403376+0000","last_active":"2023-09-30T22:55:05.403566+0000","last_peered":"2023-09-30T22:55:05.403566+0000","last_clean":"2023-09-30T22:55:05.403566+0000","last_became_active":"2023-09-30T22:55:05.402884+0000","last_became_peered":"2023-09-30T22:55:05.402884+0000","last_unstale":"2023-09-30T22:55:05.403566+0000","last_undegraded":"2023-09-30T22:55:05.403566+0000","last_fullsized":"2023-09-30T22:55:05.403566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:25.368144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396313+0000","last_change":"2023-09-30T22:55:04.393016+0000","last_active":"2023-09-30T22:55:05.396313+0000","last_peered":"2023-09-30T22:55:05.396313+0000","last_clean":"2023-09-30T22:55:05.396313+0000","last_became_active":"2023-09-30T22:55:04.392752+0000","last_became_peered":"2023-09-30T22:55:04.392752+0000","last_unstale":"2023-09-30T22:55:05.396313+0000","last_undegraded":"2023-09-30T22:55:05.396313+0000","last_fullsized":"2023-09-30T22:55:05.396313+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:40.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388801+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:55:05.388801+0000","last_peered":"2023-09-30T22:55:05.388801+0000","last_clean":"2023-09-30T22:55:05.388801+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:55:05.388801+0000","last_undegraded":"2023-09-30T22:55:05.388801+0000","last_fullsized":"2023-09-30T22:55:05.388801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394228+0000","last_change":"2023-09-30T22:55:05.394160+0000","last_active":"2023-09-30T22:55:05.394228+0000","last_peered":"2023-09-30T22:55:05.394228+0000","last_clean":"2023-09-30T22:55:05.394228+0000","last_became_active":"2023-09-30T22:55:05.393922+0000","last_became_peered":"2023-09-30T22:55:05.393922+0000","last_unstale":"2023-09-30T22:55:05.394228+0000","last_undegraded":"2023-09-30T22:55:05.394228+0000","last_fullsized":"2023-09-30T22:55:05.394228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:49.024363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390895+0000","last_change":"2023-09-30T22:55:04.392882+0000","last_active":"2023-09-30T22:55:05.390895+0000","last_peered":"2023-09-30T22:55:05.390895+0000","last_clean":"2023-09-30T22:55:05.390895+0000","last_became_active":"2023-09-30T22:55:04.392267+0000","last_became_peered":"2023-09-30T22:55:04.392267+0000","last_unstale":"2023-09-30T22:55:05.390895+0000","last_undegraded":"2023-09-30T22:55:05.390895+0000","last_fullsized":"2023-09-30T22:55:05.390895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:42.977631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.386526+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:55:05.386526+0000","last_peered":"2023-09-30T22:55:05.386526+0000","last_clean":"2023-09-30T22:55:05.386526+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:55:05.386526+0000","last_undegraded":"2023-09-30T22:55:05.386526+0000","last_fullsized":"2023-09-30T22:55:05.386526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":210,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396455+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:55:05.396455+0000","last_peered":"2023-09-30T22:55:05.396455+0000","last_clean":"2023-09-30T22:55:05.396455+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:55:05.396455+0000","last_undegraded":"2023-09-30T22:55:05.396455+0000","last_fullsized":"2023-09-30T22:55:05.396455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401995+0000","last_change":"2023-09-30T22:55:05.401951+0000","last_active":"2023-09-30T22:55:05.401995+0000","last_peered":"2023-09-30T22:55:05.401995+0000","last_clean":"2023-09-30T22:55:05.401995+0000","last_became_active":"2023-09-30T22:55:05.401674+0000","last_became_peered":"2023-09-30T22:55:05.401674+0000","last_unstale":"2023-09-30T22:55:05.401995+0000","last_undegraded":"2023-09-30T22:55:05.401995+0000","last_fullsized":"2023-09-30T22:55:05.401995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:46.061524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.408437+0000","last_change":"2023-09-30T22:55:04.394417+0000","last_active":"2023-09-30T22:55:05.408437+0000","last_peered":"2023-09-30T22:55:05.408437+0000","last_clean":"2023-09-30T22:55:05.408437+0000","last_became_active":"2023-09-30T22:55:04.394026+0000","last_became_peered":"2023-09-30T22:55:04.394026+0000","last_unstale":"2023-09-30T22:55:05.408437+0000","last_undegraded":"2023-09-30T22:55:05.408437+0000","last_fullsized":"2023-09-30T22:55:05.408437+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:08:10.542144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390582+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:55:05.390582+0000","last_peered":"2023-09-30T22:55:05.390582+0000","last_clean":"2023-09-30T22:55:05.390582+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:55:05.390582+0000","last_undegraded":"2023-09-30T22:55:05.390582+0000","last_fullsized":"2023-09-30T22:55:05.390582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400131+0000","last_change":"2023-09-30T22:55:05.399245+0000","last_active":"2023-09-30T22:55:05.400131+0000","last_peered":"2023-09-30T22:55:05.400131+0000","last_clean":"2023-09-30T22:55:05.400131+0000","last_became_active":"2023-09-30T22:55:05.399024+0000","last_became_peered":"2023-09-30T22:55:05.399024+0000","last_unstale":"2023-09-30T22:55:05.400131+0000","last_undegraded":"2023-09-30T22:55:05.400131+0000","last_fullsized":"2023-09-30T22:55:05.400131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:25:44.499164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.409305+0000","last_change":"2023-09-30T22:55:04.390412+0000","last_active":"2023-09-30T22:55:05.409305+0000","last_peered":"2023-09-30T22:55:05.409305+0000","last_clean":"2023-09-30T22:55:05.409305+0000","last_became_active":"2023-09-30T22:55:04.390202+0000","last_became_peered":"2023-09-30T22:55:04.390202+0000","last_unstale":"2023-09-30T22:55:05.409305+0000","last_undegraded":"2023-09-30T22:55:05.409305+0000","last_fullsized":"2023-09-30T22:55:05.409305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:29.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390507+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:55:05.390507+0000","last_peered":"2023-09-30T22:55:05.390507+0000","last_clean":"2023-09-30T22:55:05.390507+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:55:05.390507+0000","last_undegraded":"2023-09-30T22:55:05.390507+0000","last_fullsized":"2023-09-30T22:55:05.390507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400150+0000","last_change":"2023-09-30T22:55:05.399261+0000","last_active":"2023-09-30T22:55:05.400150+0000","last_peered":"2023-09-30T22:55:05.400150+0000","last_clean":"2023-09-30T22:55:05.400150+0000","last_became_active":"2023-09-30T22:55:05.399051+0000","last_became_peered":"2023-09-30T22:55:05.399051+0000","last_unstale":"2023-09-30T22:55:05.400150+0000","last_undegraded":"2023-09-30T22:55:05.400150+0000","last_fullsized":"2023-09-30T22:55:05.400150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:03.452132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.410212+0000","last_change":"2023-09-30T22:55:04.390324+0000","last_active":"2023-09-30T22:55:05.410212+0000","last_peered":"2023-09-30T22:55:05.410212+0000","last_clean":"2023-09-30T22:55:05.410212+0000","last_became_active":"2023-09-30T22:55:04.389758+0000","last_became_peered":"2023-09-30T22:55:04.389758+0000","last_unstale":"2023-09-30T22:55:05.410212+0000","last_undegraded":"2023-09-30T22:55:05.410212+0000","last_fullsized":"2023-09-30T22:55:05.410212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:48.017890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.389599+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:55:05.389599+0000","last_peered":"2023-09-30T22:55:05.389599+0000","last_clean":"2023-09-30T22:55:05.389599+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:55:05.389599+0000","last_undegraded":"2023-09-30T22:55:05.389599+0000","last_fullsized":"2023-09-30T22:55:05.389599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394287+0000","last_change":"2023-09-30T22:55:05.394223+0000","last_active":"2023-09-30T22:55:05.394287+0000","last_peered":"2023-09-30T22:55:05.394287+0000","last_clean":"2023-09-30T22:55:05.394287+0000","last_became_active":"2023-09-30T22:55:05.394002+0000","last_became_peered":"2023-09-30T22:55:05.394002+0000","last_unstale":"2023-09-30T22:55:05.394287+0000","last_undegraded":"2023-09-30T22:55:05.394287+0000","last_fullsized":"2023-09-30T22:55:05.394287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:09.016933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388678+0000","last_change":"2023-09-30T22:55:04.392127+0000","last_active":"2023-09-30T22:55:05.388678+0000","last_peered":"2023-09-30T22:55:05.388678+0000","last_clean":"2023-09-30T22:55:05.388678+0000","last_became_active":"2023-09-30T22:55:04.391894+0000","last_became_peered":"2023-09-30T22:55:04.391894+0000","last_unstale":"2023-09-30T22:55:05.388678+0000","last_undegraded":"2023-09-30T22:55:05.388678+0000","last_fullsized":"2023-09-30T22:55:05.388678+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:25:43.492691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.387461+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:55:05.387461+0000","last_peered":"2023-09-30T22:55:05.387461+0000","last_clean":"2023-09-30T22:55:05.387461+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:55:05.387461+0000","last_undegraded":"2023-09-30T22:55:05.387461+0000","last_fullsized":"2023-09-30T22:55:05.387461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194935,"statfs":{"total":200000000,"available":199613586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.5},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.84999999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.747},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.55900000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88400000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66600000000000004}]},{"osd":3,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76600000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55300000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90800000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":1.135},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92700000000000005,"5min":1.004,"15min":1.004},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.59099999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.86299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194926,"statfs":{"total":200000000,"available":199604785,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.016,"15min":1.0660000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90000000000000002,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":3.399,"15min":3.399},"last":0.72699999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.55900000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0109999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":1.0269999999999999,"15min":1.0840000000000001},"min":{"1min":0.52900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88300000000000001,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.66800000000000004}]},{"osd":2,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.745,"5min":1.0600000000000001,"15min":1.1120000000000001},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":0.997},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96499999999999997,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.879,"5min":1.46,"15min":1.46},"last":0.70099999999999996}]},{"osd":4,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.627,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71299999999999997,"15min":0.70099999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0509999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":953,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194358,"statfs":{"total":200000000,"available":199023184,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.504,"15min":0.502},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.378,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.58899999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.53200000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.621},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71999999999999997,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.754,"15min":0.751},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.755,"15min":0.747},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194928,"statfs":{"total":200000000,"available":199606945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.441,"15min":0.44},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.441}]},{"osd":3,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.76700000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.54100000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.70699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194928,"statfs":{"total":200000000,"available":199606889,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.28000000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.55600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96299999999999997,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.84199999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.51700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":1.615,"15min":1.615},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86299999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.879}]},{"osd":7,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.93999999999999995,"5min":1.663,"15min":1.663},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194934,"statfs":{"total":200000000,"available":199613426,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.504,"5min":1.919,"15min":1.919},"last":0.377}]},{"osd":1,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":1.254,"15min":1.254},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.60999999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72299999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88300000000000001,"5min":1.401,"15min":1.401},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.747},"min":{"1min":0.58399999999999996,"5min":0.496,"15min":0.496},"max":{"1min":0.98799999999999999,"5min":1.544,"15min":1.544},"last":0.623}]},{"osd":5,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.75},"min":{"1min":0.64900000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94599999999999995,"5min":1.508,"15min":1.508},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.58199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0489999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94299999999999995,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.52900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93100000000000005,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.52500000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0269999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92200000000000004,"5min":1.573,"15min":1.573},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194934,"statfs":{"total":200000000,"available":199613032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56399999999999995,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.85199999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.747}]},{"osd":2,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.67400000000000004,"15min":0.66300000000000003},"min":{"1min":0.58299999999999996,"5min":0.442,"15min":0.442},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.871}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":955,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194357,"statfs":{"total":200000000,"available":199021570,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.45000000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.75900000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65500000000000003,"15min":0.64200000000000002},"min":{"1min":0.59999999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.52600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.62},"min":{"1min":0.58099999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.54000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69399999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.751,"5min":0.874,"15min":0.874},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.628,"15min":0.621},"min":{"1min":0.46999999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.83499999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.621},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.625},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.54100000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.70799999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.37},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57799999999999996}]}]}],"pool_statfs":[]}} 2023-09-30T22:55:09.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:55:09.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.967+0000 7f60651ff700 1 Processor -- start 2023-09-30T22:55:09.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.967+0000 7f60651ff700 1 -- start start 2023-09-30T22:55:09.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f60651ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60600b00d0 0x7f606006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f60651ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f606006e650 0x7f606015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f60651ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606006d3e0 con 0x7f60600af020 2023-09-30T22:55:09.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f60651ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606006dc80 con 0x7f60600b00d0 2023-09-30T22:55:09.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f60651ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606006b790 con 0x7f606006e650 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f605e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60600b00d0 0x7f606006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f605ed9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f60600af020 0x7f6060156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56916/0 (socket says 172.21.15.142:56916) 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f605e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60600b00d0 0x7f606006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39918/0 (socket says 172.21.15.142:39918) 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f605ed9d700 1 -- 172.21.15.142:0/3732274053 learned_addr learned my addr 172.21.15.142:0/3732274053 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.969+0000 7f605f59e700 1 --2- 172.21.15.142:0/3732274053 >> v2:172.21.15.148:3300/0 conn(0x7f606006e650 0x7f606015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605e59c700 1 -- 172.21.15.142:0/3732274053 >> v2:172.21.15.148:3300/0 conn(0x7f606006e650 msgr2=0x7f606015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605e59c700 1 --2- 172.21.15.142:0/3732274053 >> v2:172.21.15.148:3300/0 conn(0x7f606006e650 0x7f606015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605e59c700 1 -- 172.21.15.142:0/3732274053 >> v1:172.21.15.142:6789/0 conn(0x7f60600af020 legacy=0x7f6060156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605e59c700 1 -- 172.21.15.142:0/3732274053 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600b0650 con 0x7f60600b00d0 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605dd9b700 1 -- 172.21.15.142:0/3732274053 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304700432 0 0) 0x7f606006d3e0 con 0x7f60600af020 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605e59c700 1 --2- 172.21.15.142:0/3732274053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f606006e110 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f60540098e0 tx=0x7f60540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a37ccf62205cc7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605dd9b700 1 -- 172.21.15.142:0/3732274053 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054009e80 con 0x7f60600b00d0 2023-09-30T22:55:09.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605dd9b700 1 -- 172.21.15.142:0/3732274053 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605400b820 con 0x7f60600b00d0 2023-09-30T22:55:09.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.970+0000 7f605dd9b700 1 -- 172.21.15.142:0/3732274053 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605400bba0 con 0x7f60600b00d0 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 -- 172.21.15.142:0/3732274053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 msgr2=0x7f606006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 --2- 172.21.15.142:0/3732274053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f606006e110 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f60540098e0 tx=0x7f60540091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 -- 172.21.15.142:0/3732274053 shutdown_connections 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 --2- 172.21.15.142:0/3732274053 >> v2:172.21.15.148:3300/0 conn(0x7f606006e650 0x7f606015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 --2- 172.21.15.142:0/3732274053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f606006e110 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 -- 172.21.15.142:0/3732274053 >> 172.21.15.142:0/3732274053 conn(0x7f60600680c0 msgr2=0x7f60600c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 -- 172.21.15.142:0/3732274053 shutdown_connections 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.971+0000 7f60651ff700 1 -- 172.21.15.142:0/3732274053 wait complete. 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.972+0000 7f60651ff700 1 Processor -- start 2023-09-30T22:55:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.972+0000 7f60651ff700 1 -- start start 2023-09-30T22:55:09.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.973+0000 7f60651ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f606006e650 0x7f6060165e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.973+0000 7f60651ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60600af020 0x7f606015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.973+0000 7f60651ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f60601586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.973+0000 7f60651ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606015b2d0 con 0x7f60600b00d0 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.973+0000 7f60651ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60600c6550 con 0x7f60600af020 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.973+0000 7f60651ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60600c6760 con 0x7f606006e650 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.973+0000 7f605f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f60601586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605ed9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f606006e650 0x7f6060165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60600af020 0x7f606015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f60601586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39920/0 (socket says 172.21.15.142:39920) 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 -- 172.21.15.142:0/579742541 learned_addr learned my addr 172.21.15.142:0/579742541 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 -- 172.21.15.142:0/579742541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f606006e650 msgr2=0x7f6060165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f606006e650 0x7f6060165e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 -- 172.21.15.142:0/579742541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60600af020 msgr2=0x7f606015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60600af020 0x7f606015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 -- 172.21.15.142:0/579742541 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054009420 con 0x7f60600b00d0 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605ed9d700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f606006e650 0x7f6060165e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f605f59e700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f60601586b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6058007f20 tx=0x7f6058009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f6046ffd700 1 -- 172.21.15.142:0/579742541 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800eb90 con 0x7f60600b00d0 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f6046ffd700 1 -- 172.21.15.142:0/579742541 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800ed10 con 0x7f60600b00d0 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.974+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60600c6a40 con 0x7f60600b00d0 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.975+0000 7f6046ffd700 1 -- 172.21.15.142:0/579742541 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058014670 con 0x7f60600b00d0 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.975+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60601593b0 con 0x7f60600b00d0 2023-09-30T22:55:09.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.976+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60600c6e30 con 0x7f60600b00d0 2023-09-30T22:55:09.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.976+0000 7f6046ffd700 1 -- 172.21.15.142:0/579742541 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f60580149e0 con 0x7f60600b00d0 2023-09-30T22:55:09.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.978+0000 7f6046ffd700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f604c067330 0x7f604c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:09.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.978+0000 7f6046ffd700 1 -- 172.21.15.142:0/579742541 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6058085260 con 0x7f60600b00d0 2023-09-30T22:55:09.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.978+0000 7f605ed9d700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f604c067330 0x7f604c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:09.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.979+0000 7f605ed9d700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f604c067330 0x7f604c0697e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6050007fd0 tx=0x7f6050007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:09.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:09.982+0000 7f6046ffd700 1 -- 172.21.15.142:0/579742541 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f60580520c0 con 0x7f60600b00d0 2023-09-30T22:55:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.168+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60600c6c30 con 0x7f604c067330 2023-09-30T22:55:10.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.176+0000 7f6046ffd700 1 -- 172.21.15.142:0/579742541 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303090 (secure 0 0 0) 0x7f60600c6c30 con 0x7f604c067330 2023-09-30T22:55:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f604c067330 msgr2=0x7f604c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f604c067330 0x7f604c0697e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6050007fd0 tx=0x7f6050007d30 comp rx=0 tx=0).stop 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 msgr2=0x7f60601586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f60601586b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6058007f20 tx=0x7f6058009860 comp rx=0 tx=0).stop 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 shutdown_connections 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f604c067330 0x7f604c0697e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60600b00d0 0x7f60601586b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f606006e650 0x7f6060165e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 --2- 172.21.15.142:0/579742541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60600af020 0x7f606015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 >> 172.21.15.142:0/579742541 conn(0x7f60600680c0 msgr2=0x7f60600ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:10.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 shutdown_connections 2023-09-30T22:55:10.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.181+0000 7f60651ff700 1 -- 172.21.15.142:0/579742541 wait complete. 2023-09-30T22:55:10.184 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:55:10.199 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-09-30T22:55:10.135472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4195,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558304,"statfs":{"total":1600000000,"available":1595703417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001276"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397065+0000","last_change":"2023-09-30T22:55:05.396946+0000","last_active":"2023-09-30T22:55:05.397065+0000","last_peered":"2023-09-30T22:55:05.397065+0000","last_clean":"2023-09-30T22:55:05.397065+0000","last_became_active":"2023-09-30T22:55:05.396648+0000","last_became_peered":"2023-09-30T22:55:05.396648+0000","last_unstale":"2023-09-30T22:55:05.397065+0000","last_undegraded":"2023-09-30T22:55:05.397065+0000","last_fullsized":"2023-09-30T22:55:05.397065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:32.376249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397477+0000","last_change":"2023-09-30T22:55:05.397400+0000","last_active":"2023-09-30T22:55:05.397477+0000","last_peered":"2023-09-30T22:55:05.397477+0000","last_clean":"2023-09-30T22:55:05.397477+0000","last_became_active":"2023-09-30T22:55:05.397172+0000","last_became_peered":"2023-09-30T22:55:05.397172+0000","last_unstale":"2023-09-30T22:55:05.397477+0000","last_undegraded":"2023-09-30T22:55:05.397477+0000","last_fullsized":"2023-09-30T22:55:05.397477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:24.924960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393746+0000","last_change":"2023-09-30T22:55:05.392399+0000","last_active":"2023-09-30T22:55:05.393746+0000","last_peered":"2023-09-30T22:55:05.393746+0000","last_clean":"2023-09-30T22:55:05.393746+0000","last_became_active":"2023-09-30T22:55:05.391963+0000","last_became_peered":"2023-09-30T22:55:05.391963+0000","last_unstale":"2023-09-30T22:55:05.393746+0000","last_undegraded":"2023-09-30T22:55:05.393746+0000","last_fullsized":"2023-09-30T22:55:05.393746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:18.310209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398236+0000","last_change":"2023-09-30T22:55:05.398039+0000","last_active":"2023-09-30T22:55:05.398236+0000","last_peered":"2023-09-30T22:55:05.398236+0000","last_clean":"2023-09-30T22:55:05.398236+0000","last_became_active":"2023-09-30T22:55:05.397499+0000","last_became_peered":"2023-09-30T22:55:05.397499+0000","last_unstale":"2023-09-30T22:55:05.398236+0000","last_undegraded":"2023-09-30T22:55:05.398236+0000","last_fullsized":"2023-09-30T22:55:05.398236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:42.006206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397494+0000","last_change":"2023-09-30T22:55:05.397254+0000","last_active":"2023-09-30T22:55:05.397494+0000","last_peered":"2023-09-30T22:55:05.397494+0000","last_clean":"2023-09-30T22:55:05.397494+0000","last_became_active":"2023-09-30T22:55:05.396700+0000","last_became_peered":"2023-09-30T22:55:05.396700+0000","last_unstale":"2023-09-30T22:55:05.397494+0000","last_undegraded":"2023-09-30T22:55:05.397494+0000","last_fullsized":"2023-09-30T22:55:05.397494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:38:55.195540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401859+0000","last_change":"2023-09-30T22:55:05.401822+0000","last_active":"2023-09-30T22:55:05.401859+0000","last_peered":"2023-09-30T22:55:05.401859+0000","last_clean":"2023-09-30T22:55:05.401859+0000","last_became_active":"2023-09-30T22:55:05.401333+0000","last_became_peered":"2023-09-30T22:55:05.401333+0000","last_unstale":"2023-09-30T22:55:05.401859+0000","last_undegraded":"2023-09-30T22:55:05.401859+0000","last_fullsized":"2023-09-30T22:55:05.401859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:39.868543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.391885+0000","last_change":"2023-09-30T22:55:05.391792+0000","last_active":"2023-09-30T22:55:05.391885+0000","last_peered":"2023-09-30T22:55:05.391885+0000","last_clean":"2023-09-30T22:55:05.391885+0000","last_became_active":"2023-09-30T22:55:05.391561+0000","last_became_peered":"2023-09-30T22:55:05.391561+0000","last_unstale":"2023-09-30T22:55:05.391885+0000","last_undegraded":"2023-09-30T22:55:05.391885+0000","last_fullsized":"2023-09-30T22:55:05.391885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:28:24.201892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396388+0000","last_change":"2023-09-30T22:55:05.396107+0000","last_active":"2023-09-30T22:55:05.396388+0000","last_peered":"2023-09-30T22:55:05.396388+0000","last_clean":"2023-09-30T22:55:05.396388+0000","last_became_active":"2023-09-30T22:55:05.395870+0000","last_became_peered":"2023-09-30T22:55:05.395870+0000","last_unstale":"2023-09-30T22:55:05.396388+0000","last_undegraded":"2023-09-30T22:55:05.396388+0000","last_fullsized":"2023-09-30T22:55:05.396388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:00.564241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400940+0000","last_change":"2023-09-30T22:55:05.400859+0000","last_active":"2023-09-30T22:55:05.400940+0000","last_peered":"2023-09-30T22:55:05.400940+0000","last_clean":"2023-09-30T22:55:05.400940+0000","last_became_active":"2023-09-30T22:55:05.400582+0000","last_became_peered":"2023-09-30T22:55:05.400582+0000","last_unstale":"2023-09-30T22:55:05.400940+0000","last_undegraded":"2023-09-30T22:55:05.400940+0000","last_fullsized":"2023-09-30T22:55:05.400940+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:53.309079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396008+0000","last_change":"2023-09-30T22:55:05.395924+0000","last_active":"2023-09-30T22:55:05.396008+0000","last_peered":"2023-09-30T22:55:05.396008+0000","last_clean":"2023-09-30T22:55:05.396008+0000","last_became_active":"2023-09-30T22:55:05.395113+0000","last_became_peered":"2023-09-30T22:55:05.395113+0000","last_unstale":"2023-09-30T22:55:05.396008+0000","last_undegraded":"2023-09-30T22:55:05.396008+0000","last_fullsized":"2023-09-30T22:55:05.396008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:22.938119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393042+0000","last_change":"2023-09-30T22:55:05.391266+0000","last_active":"2023-09-30T22:55:05.393042+0000","last_peered":"2023-09-30T22:55:05.393042+0000","last_clean":"2023-09-30T22:55:05.393042+0000","last_became_active":"2023-09-30T22:55:05.390685+0000","last_became_peered":"2023-09-30T22:55:05.390685+0000","last_unstale":"2023-09-30T22:55:05.393042+0000","last_undegraded":"2023-09-30T22:55:05.393042+0000","last_fullsized":"2023-09-30T22:55:05.393042+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:39.868543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392963+0000","last_change":"2023-09-30T22:55:05.389968+0000","last_active":"2023-09-30T22:55:05.392963+0000","last_peered":"2023-09-30T22:55:05.392963+0000","last_clean":"2023-09-30T22:55:05.392963+0000","last_became_active":"2023-09-30T22:55:05.389374+0000","last_became_peered":"2023-09-30T22:55:05.389374+0000","last_unstale":"2023-09-30T22:55:05.392963+0000","last_undegraded":"2023-09-30T22:55:05.392963+0000","last_fullsized":"2023-09-30T22:55:05.392963+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:15:00.398009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.402018+0000","last_change":"2023-09-30T22:55:05.401948+0000","last_active":"2023-09-30T22:55:05.402018+0000","last_peered":"2023-09-30T22:55:05.402018+0000","last_clean":"2023-09-30T22:55:05.402018+0000","last_became_active":"2023-09-30T22:55:05.401574+0000","last_became_peered":"2023-09-30T22:55:05.401574+0000","last_unstale":"2023-09-30T22:55:05.402018+0000","last_undegraded":"2023-09-30T22:55:05.402018+0000","last_fullsized":"2023-09-30T22:55:05.402018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:29:02.009870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.402718+0000","last_change":"2023-09-30T22:55:05.402657+0000","last_active":"2023-09-30T22:55:05.402718+0000","last_peered":"2023-09-30T22:55:05.402718+0000","last_clean":"2023-09-30T22:55:05.402718+0000","last_became_active":"2023-09-30T22:55:05.402363+0000","last_became_peered":"2023-09-30T22:55:05.402363+0000","last_unstale":"2023-09-30T22:55:05.402718+0000","last_undegraded":"2023-09-30T22:55:05.402718+0000","last_fullsized":"2023-09-30T22:55:05.402718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:22:16.458844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395991+0000","last_change":"2023-09-30T22:55:05.395790+0000","last_active":"2023-09-30T22:55:05.395991+0000","last_peered":"2023-09-30T22:55:05.395991+0000","last_clean":"2023-09-30T22:55:05.395991+0000","last_became_active":"2023-09-30T22:55:05.394829+0000","last_became_peered":"2023-09-30T22:55:05.394829+0000","last_unstale":"2023-09-30T22:55:05.395991+0000","last_undegraded":"2023-09-30T22:55:05.395991+0000","last_fullsized":"2023-09-30T22:55:05.395991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:15.485522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395716+0000","last_change":"2023-09-30T22:55:05.395644+0000","last_active":"2023-09-30T22:55:05.395716+0000","last_peered":"2023-09-30T22:55:05.395716+0000","last_clean":"2023-09-30T22:55:05.395716+0000","last_became_active":"2023-09-30T22:55:05.395399+0000","last_became_peered":"2023-09-30T22:55:05.395399+0000","last_unstale":"2023-09-30T22:55:05.395716+0000","last_undegraded":"2023-09-30T22:55:05.395716+0000","last_fullsized":"2023-09-30T22:55:05.395716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:32.376249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398909+0000","last_change":"2023-09-30T22:55:05.398564+0000","last_active":"2023-09-30T22:55:05.398909+0000","last_peered":"2023-09-30T22:55:05.398909+0000","last_clean":"2023-09-30T22:55:05.398909+0000","last_became_active":"2023-09-30T22:55:05.398308+0000","last_became_peered":"2023-09-30T22:55:05.398308+0000","last_unstale":"2023-09-30T22:55:05.398909+0000","last_undegraded":"2023-09-30T22:55:05.398909+0000","last_fullsized":"2023-09-30T22:55:05.398909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:59.786016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395492+0000","last_change":"2023-09-30T22:55:05.395340+0000","last_active":"2023-09-30T22:55:05.395492+0000","last_peered":"2023-09-30T22:55:05.395492+0000","last_clean":"2023-09-30T22:55:05.395492+0000","last_became_active":"2023-09-30T22:55:05.395103+0000","last_became_peered":"2023-09-30T22:55:05.395103+0000","last_unstale":"2023-09-30T22:55:05.395492+0000","last_undegraded":"2023-09-30T22:55:05.395492+0000","last_fullsized":"2023-09-30T22:55:05.395492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:50.567383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393462+0000","last_change":"2023-09-30T22:55:05.393395+0000","last_active":"2023-09-30T22:55:05.393462+0000","last_peered":"2023-09-30T22:55:05.393462+0000","last_clean":"2023-09-30T22:55:05.393462+0000","last_became_active":"2023-09-30T22:55:05.393173+0000","last_became_peered":"2023-09-30T22:55:05.393173+0000","last_unstale":"2023-09-30T22:55:05.393462+0000","last_undegraded":"2023-09-30T22:55:05.393462+0000","last_fullsized":"2023-09-30T22:55:05.393462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:55:46.438319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395996+0000","last_change":"2023-09-30T22:55:05.395926+0000","last_active":"2023-09-30T22:55:05.395996+0000","last_peered":"2023-09-30T22:55:05.395996+0000","last_clean":"2023-09-30T22:55:05.395996+0000","last_became_active":"2023-09-30T22:55:05.395698+0000","last_became_peered":"2023-09-30T22:55:05.395698+0000","last_unstale":"2023-09-30T22:55:05.395996+0000","last_undegraded":"2023-09-30T22:55:05.395996+0000","last_fullsized":"2023-09-30T22:55:05.395996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:44:40.678999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400864+0000","last_change":"2023-09-30T22:55:05.400795+0000","last_active":"2023-09-30T22:55:05.400864+0000","last_peered":"2023-09-30T22:55:05.400864+0000","last_clean":"2023-09-30T22:55:05.400864+0000","last_became_active":"2023-09-30T22:55:05.400567+0000","last_became_peered":"2023-09-30T22:55:05.400567+0000","last_unstale":"2023-09-30T22:55:05.400864+0000","last_undegraded":"2023-09-30T22:55:05.400864+0000","last_fullsized":"2023-09-30T22:55:05.400864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:50:49.954947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401618+0000","last_change":"2023-09-30T22:55:05.401552+0000","last_active":"2023-09-30T22:55:05.401618+0000","last_peered":"2023-09-30T22:55:05.401618+0000","last_clean":"2023-09-30T22:55:05.401618+0000","last_became_active":"2023-09-30T22:55:05.401357+0000","last_became_peered":"2023-09-30T22:55:05.401357+0000","last_unstale":"2023-09-30T22:55:05.401618+0000","last_undegraded":"2023-09-30T22:55:05.401618+0000","last_fullsized":"2023-09-30T22:55:05.401618+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:05.766842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398468+0000","last_change":"2023-09-30T22:55:05.398395+0000","last_active":"2023-09-30T22:55:05.398468+0000","last_peered":"2023-09-30T22:55:05.398468+0000","last_clean":"2023-09-30T22:55:05.398468+0000","last_became_active":"2023-09-30T22:55:05.398169+0000","last_became_peered":"2023-09-30T22:55:05.398169+0000","last_unstale":"2023-09-30T22:55:05.398468+0000","last_undegraded":"2023-09-30T22:55:05.398468+0000","last_fullsized":"2023-09-30T22:55:05.398468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:30:47.992273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.391818+0000","last_change":"2023-09-30T22:55:05.391758+0000","last_active":"2023-09-30T22:55:05.391818+0000","last_peered":"2023-09-30T22:55:05.391818+0000","last_clean":"2023-09-30T22:55:05.391818+0000","last_became_active":"2023-09-30T22:55:05.391522+0000","last_became_peered":"2023-09-30T22:55:05.391522+0000","last_unstale":"2023-09-30T22:55:05.391818+0000","last_undegraded":"2023-09-30T22:55:05.391818+0000","last_fullsized":"2023-09-30T22:55:05.391818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:18.099509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.403583+0000","last_change":"2023-09-30T22:55:05.403511+0000","last_active":"2023-09-30T22:55:05.403583+0000","last_peered":"2023-09-30T22:55:05.403583+0000","last_clean":"2023-09-30T22:55:05.403583+0000","last_became_active":"2023-09-30T22:55:05.403174+0000","last_became_peered":"2023-09-30T22:55:05.403174+0000","last_unstale":"2023-09-30T22:55:05.403583+0000","last_undegraded":"2023-09-30T22:55:05.403583+0000","last_fullsized":"2023-09-30T22:55:05.403583+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:43:13.438076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394672+0000","last_change":"2023-09-30T22:55:05.394588+0000","last_active":"2023-09-30T22:55:05.394672+0000","last_peered":"2023-09-30T22:55:05.394672+0000","last_clean":"2023-09-30T22:55:05.394672+0000","last_became_active":"2023-09-30T22:55:05.394374+0000","last_became_peered":"2023-09-30T22:55:05.394374+0000","last_unstale":"2023-09-30T22:55:05.394672+0000","last_undegraded":"2023-09-30T22:55:05.394672+0000","last_fullsized":"2023-09-30T22:55:05.394672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:57.950995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400166+0000","last_change":"2023-09-30T22:55:05.399767+0000","last_active":"2023-09-30T22:55:05.400166+0000","last_peered":"2023-09-30T22:55:05.400166+0000","last_clean":"2023-09-30T22:55:05.400166+0000","last_became_active":"2023-09-30T22:55:05.399548+0000","last_became_peered":"2023-09-30T22:55:05.399548+0000","last_unstale":"2023-09-30T22:55:05.400166+0000","last_undegraded":"2023-09-30T22:55:05.400166+0000","last_fullsized":"2023-09-30T22:55:05.400166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:30.273336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397014+0000","last_change":"2023-09-30T22:55:05.394994+0000","last_active":"2023-09-30T22:55:05.397014+0000","last_peered":"2023-09-30T22:55:05.397014+0000","last_clean":"2023-09-30T22:55:05.397014+0000","last_became_active":"2023-09-30T22:55:05.394711+0000","last_became_peered":"2023-09-30T22:55:05.394711+0000","last_unstale":"2023-09-30T22:55:05.397014+0000","last_undegraded":"2023-09-30T22:55:05.397014+0000","last_fullsized":"2023-09-30T22:55:05.397014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:25.035382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.403864+0000","last_change":"2023-09-30T22:55:05.403712+0000","last_active":"2023-09-30T22:55:05.403864+0000","last_peered":"2023-09-30T22:55:05.403864+0000","last_clean":"2023-09-30T22:55:05.403864+0000","last_became_active":"2023-09-30T22:55:05.403478+0000","last_became_peered":"2023-09-30T22:55:05.403478+0000","last_unstale":"2023-09-30T22:55:05.403864+0000","last_undegraded":"2023-09-30T22:55:05.403864+0000","last_fullsized":"2023-09-30T22:55:05.403864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:01.320914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393023+0000","last_change":"2023-09-30T22:55:05.391193+0000","last_active":"2023-09-30T22:55:05.393023+0000","last_peered":"2023-09-30T22:55:05.393023+0000","last_clean":"2023-09-30T22:55:05.393023+0000","last_became_active":"2023-09-30T22:55:05.390970+0000","last_became_peered":"2023-09-30T22:55:05.390970+0000","last_unstale":"2023-09-30T22:55:05.393023+0000","last_undegraded":"2023-09-30T22:55:05.393023+0000","last_fullsized":"2023-09-30T22:55:05.393023+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:01.031072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393712+0000","last_change":"2023-09-30T22:55:05.392175+0000","last_active":"2023-09-30T22:55:05.393712+0000","last_peered":"2023-09-30T22:55:05.393712+0000","last_clean":"2023-09-30T22:55:05.393712+0000","last_became_active":"2023-09-30T22:55:05.391558+0000","last_became_peered":"2023-09-30T22:55:05.391558+0000","last_unstale":"2023-09-30T22:55:05.393712+0000","last_undegraded":"2023-09-30T22:55:05.393712+0000","last_fullsized":"2023-09-30T22:55:05.393712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:56.731913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397033+0000","last_change":"2023-09-30T22:55:05.395463+0000","last_active":"2023-09-30T22:55:05.397033+0000","last_peered":"2023-09-30T22:55:05.397033+0000","last_clean":"2023-09-30T22:55:05.397033+0000","last_became_active":"2023-09-30T22:55:05.395240+0000","last_became_peered":"2023-09-30T22:55:05.395240+0000","last_unstale":"2023-09-30T22:55:05.397033+0000","last_undegraded":"2023-09-30T22:55:05.397033+0000","last_fullsized":"2023-09-30T22:55:05.397033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:01.031072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393059+0000","last_change":"2023-09-30T22:55:05.391465+0000","last_active":"2023-09-30T22:55:05.393059+0000","last_peered":"2023-09-30T22:55:05.393059+0000","last_clean":"2023-09-30T22:55:05.393059+0000","last_became_active":"2023-09-30T22:55:05.391039+0000","last_became_peered":"2023-09-30T22:55:05.391039+0000","last_unstale":"2023-09-30T22:55:05.393059+0000","last_undegraded":"2023-09-30T22:55:05.393059+0000","last_fullsized":"2023-09-30T22:55:05.393059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:46.061524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"71'4","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.409970+0000","last_change":"2023-09-30T22:55:04.384604+0000","last_active":"2023-09-30T22:55:05.409970+0000","last_peered":"2023-09-30T22:55:05.409970+0000","last_clean":"2023-09-30T22:55:05.409970+0000","last_became_active":"2023-09-30T22:55:04.384344+0000","last_became_peered":"2023-09-30T22:55:04.384344+0000","last_unstale":"2023-09-30T22:55:05.409970+0000","last_undegraded":"2023-09-30T22:55:05.409970+0000","last_fullsized":"2023-09-30T22:55:05.409970+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:47.343798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397511+0000","last_change":"2023-09-30T22:55:05.397435+0000","last_active":"2023-09-30T22:55:05.397511+0000","last_peered":"2023-09-30T22:55:05.397511+0000","last_clean":"2023-09-30T22:55:05.397511+0000","last_became_active":"2023-09-30T22:55:05.397042+0000","last_became_peered":"2023-09-30T22:55:05.397042+0000","last_unstale":"2023-09-30T22:55:05.397511+0000","last_undegraded":"2023-09-30T22:55:05.397511+0000","last_fullsized":"2023-09-30T22:55:05.397511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:40.014297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411237+0000","last_change":"2023-09-30T22:55:04.390755+0000","last_active":"2023-09-30T22:55:05.411237+0000","last_peered":"2023-09-30T22:55:05.411237+0000","last_clean":"2023-09-30T22:55:05.411237+0000","last_became_active":"2023-09-30T22:55:04.389724+0000","last_became_peered":"2023-09-30T22:55:04.389724+0000","last_unstale":"2023-09-30T22:55:05.411237+0000","last_undegraded":"2023-09-30T22:55:05.411237+0000","last_fullsized":"2023-09-30T22:55:05.411237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:29:01.003396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395408+0000","last_change":"2023-09-30T22:55:05.395339+0000","last_active":"2023-09-30T22:55:05.395408+0000","last_peered":"2023-09-30T22:55:05.395408+0000","last_clean":"2023-09-30T22:55:05.395408+0000","last_became_active":"2023-09-30T22:55:05.395123+0000","last_became_peered":"2023-09-30T22:55:05.395123+0000","last_unstale":"2023-09-30T22:55:05.395408+0000","last_undegraded":"2023-09-30T22:55:05.395408+0000","last_fullsized":"2023-09-30T22:55:05.395408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:55:46.438319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.410105+0000","last_change":"2023-09-30T22:55:04.387487+0000","last_active":"2023-09-30T22:55:05.410105+0000","last_peered":"2023-09-30T22:55:05.410105+0000","last_clean":"2023-09-30T22:55:05.410105+0000","last_became_active":"2023-09-30T22:55:04.387253+0000","last_became_peered":"2023-09-30T22:55:04.387253+0000","last_unstale":"2023-09-30T22:55:05.410105+0000","last_undegraded":"2023-09-30T22:55:05.410105+0000","last_fullsized":"2023-09-30T22:55:05.410105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:25:43.492691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.399499+0000","last_change":"2023-09-30T22:55:05.399331+0000","last_active":"2023-09-30T22:55:05.399499+0000","last_peered":"2023-09-30T22:55:05.399499+0000","last_clean":"2023-09-30T22:55:05.399499+0000","last_became_active":"2023-09-30T22:55:05.397981+0000","last_became_peered":"2023-09-30T22:55:05.397981+0000","last_unstale":"2023-09-30T22:55:05.399499+0000","last_undegraded":"2023-09-30T22:55:05.399499+0000","last_fullsized":"2023-09-30T22:55:05.399499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:35:41.457732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.409876+0000","last_change":"2023-09-30T22:55:04.393053+0000","last_active":"2023-09-30T22:55:05.409876+0000","last_peered":"2023-09-30T22:55:05.409876+0000","last_clean":"2023-09-30T22:55:05.409876+0000","last_became_active":"2023-09-30T22:55:04.392585+0000","last_became_peered":"2023-09-30T22:55:04.392585+0000","last_unstale":"2023-09-30T22:55:05.409876+0000","last_undegraded":"2023-09-30T22:55:05.409876+0000","last_fullsized":"2023-09-30T22:55:05.409876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:31.369776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394198+0000","last_change":"2023-09-30T22:55:05.393976+0000","last_active":"2023-09-30T22:55:05.394198+0000","last_peered":"2023-09-30T22:55:05.394198+0000","last_clean":"2023-09-30T22:55:05.394198+0000","last_became_active":"2023-09-30T22:55:05.393415+0000","last_became_peered":"2023-09-30T22:55:05.393415+0000","last_unstale":"2023-09-30T22:55:05.394198+0000","last_undegraded":"2023-09-30T22:55:05.394198+0000","last_fullsized":"2023-09-30T22:55:05.394198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:48.621251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.407660+0000","last_change":"2023-09-30T22:55:04.394644+0000","last_active":"2023-09-30T22:55:05.407660+0000","last_peered":"2023-09-30T22:55:05.407660+0000","last_clean":"2023-09-30T22:55:05.407660+0000","last_became_active":"2023-09-30T22:55:04.393562+0000","last_became_peered":"2023-09-30T22:55:04.393562+0000","last_unstale":"2023-09-30T22:55:05.407660+0000","last_undegraded":"2023-09-30T22:55:05.407660+0000","last_fullsized":"2023-09-30T22:55:05.407660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:23.542088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393041+0000","last_change":"2023-09-30T22:55:05.392875+0000","last_active":"2023-09-30T22:55:05.393041+0000","last_peered":"2023-09-30T22:55:05.393041+0000","last_clean":"2023-09-30T22:55:05.393041+0000","last_became_active":"2023-09-30T22:55:05.392658+0000","last_became_peered":"2023-09-30T22:55:05.392658+0000","last_unstale":"2023-09-30T22:55:05.393041+0000","last_undegraded":"2023-09-30T22:55:05.393041+0000","last_fullsized":"2023-09-30T22:55:05.393041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:50.567383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.408665+0000","last_change":"2023-09-30T22:55:04.391970+0000","last_active":"2023-09-30T22:55:05.408665+0000","last_peered":"2023-09-30T22:55:05.408665+0000","last_clean":"2023-09-30T22:55:05.408665+0000","last_became_active":"2023-09-30T22:55:04.391652+0000","last_became_peered":"2023-09-30T22:55:04.391652+0000","last_unstale":"2023-09-30T22:55:05.408665+0000","last_undegraded":"2023-09-30T22:55:05.408665+0000","last_fullsized":"2023-09-30T22:55:05.408665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:53:08.737967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397435+0000","last_change":"2023-09-30T22:55:05.397337+0000","last_active":"2023-09-30T22:55:05.397435+0000","last_peered":"2023-09-30T22:55:05.397435+0000","last_clean":"2023-09-30T22:55:05.397435+0000","last_became_active":"2023-09-30T22:55:05.396562+0000","last_became_peered":"2023-09-30T22:55:05.396562+0000","last_unstale":"2023-09-30T22:55:05.397435+0000","last_undegraded":"2023-09-30T22:55:05.397435+0000","last_fullsized":"2023-09-30T22:55:05.397435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:44:34.604294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.384457+0000","last_change":"2023-09-30T22:55:04.390920+0000","last_active":"2023-09-30T22:55:05.384457+0000","last_peered":"2023-09-30T22:55:05.384457+0000","last_clean":"2023-09-30T22:55:05.384457+0000","last_became_active":"2023-09-30T22:55:04.390532+0000","last_became_peered":"2023-09-30T22:55:04.390532+0000","last_unstale":"2023-09-30T22:55:05.384457+0000","last_undegraded":"2023-09-30T22:55:05.384457+0000","last_fullsized":"2023-09-30T22:55:05.384457+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:04.915525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398870+0000","last_change":"2023-09-30T22:55:05.398033+0000","last_active":"2023-09-30T22:55:05.398870+0000","last_peered":"2023-09-30T22:55:05.398870+0000","last_clean":"2023-09-30T22:55:05.398870+0000","last_became_active":"2023-09-30T22:55:05.397250+0000","last_became_peered":"2023-09-30T22:55:05.397250+0000","last_unstale":"2023-09-30T22:55:05.398870+0000","last_undegraded":"2023-09-30T22:55:05.398870+0000","last_fullsized":"2023-09-30T22:55:05.398870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:57.950995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.385876+0000","last_change":"2023-09-30T22:55:04.394076+0000","last_active":"2023-09-30T22:55:05.385876+0000","last_peered":"2023-09-30T22:55:05.385876+0000","last_clean":"2023-09-30T22:55:05.385876+0000","last_became_active":"2023-09-30T22:55:04.393845+0000","last_became_peered":"2023-09-30T22:55:04.393845+0000","last_unstale":"2023-09-30T22:55:05.385876+0000","last_undegraded":"2023-09-30T22:55:05.385876+0000","last_fullsized":"2023-09-30T22:55:05.385876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:12:41.855205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392895+0000","last_change":"2023-09-30T22:55:05.392317+0000","last_active":"2023-09-30T22:55:05.392895+0000","last_peered":"2023-09-30T22:55:05.392895+0000","last_clean":"2023-09-30T22:55:05.392895+0000","last_became_active":"2023-09-30T22:55:05.391589+0000","last_became_peered":"2023-09-30T22:55:05.391589+0000","last_unstale":"2023-09-30T22:55:05.392895+0000","last_undegraded":"2023-09-30T22:55:05.392895+0000","last_fullsized":"2023-09-30T22:55:05.392895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:53.955855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.386492+0000","last_change":"2023-09-30T22:55:04.392831+0000","last_active":"2023-09-30T22:55:05.386492+0000","last_peered":"2023-09-30T22:55:05.386492+0000","last_clean":"2023-09-30T22:55:05.386492+0000","last_became_active":"2023-09-30T22:55:04.392211+0000","last_became_peered":"2023-09-30T22:55:04.392211+0000","last_unstale":"2023-09-30T22:55:05.386492+0000","last_undegraded":"2023-09-30T22:55:05.386492+0000","last_fullsized":"2023-09-30T22:55:05.386492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:47.343798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394216+0000","last_change":"2023-09-30T22:55:05.394063+0000","last_active":"2023-09-30T22:55:05.394216+0000","last_peered":"2023-09-30T22:55:05.394216+0000","last_clean":"2023-09-30T22:55:05.394216+0000","last_became_active":"2023-09-30T22:55:05.393822+0000","last_became_peered":"2023-09-30T22:55:05.393822+0000","last_unstale":"2023-09-30T22:55:05.394216+0000","last_undegraded":"2023-09-30T22:55:05.394216+0000","last_fullsized":"2023-09-30T22:55:05.394216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:09.016933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390559+0000","last_change":"2023-09-30T22:55:04.395381+0000","last_active":"2023-09-30T22:55:05.390559+0000","last_peered":"2023-09-30T22:55:05.390559+0000","last_clean":"2023-09-30T22:55:05.390559+0000","last_became_active":"2023-09-30T22:55:04.395169+0000","last_became_peered":"2023-09-30T22:55:04.395169+0000","last_unstale":"2023-09-30T22:55:05.390559+0000","last_undegraded":"2023-09-30T22:55:05.390559+0000","last_fullsized":"2023-09-30T22:55:05.390559+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:18.659504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401057+0000","last_change":"2023-09-30T22:55:05.400965+0000","last_active":"2023-09-30T22:55:05.401057+0000","last_peered":"2023-09-30T22:55:05.401057+0000","last_clean":"2023-09-30T22:55:05.401057+0000","last_became_active":"2023-09-30T22:55:05.400732+0000","last_became_peered":"2023-09-30T22:55:05.400732+0000","last_unstale":"2023-09-30T22:55:05.401057+0000","last_undegraded":"2023-09-30T22:55:05.401057+0000","last_fullsized":"2023-09-30T22:55:05.401057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:48.350272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"71'3","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.408741+0000","last_change":"2023-09-30T22:55:04.393065+0000","last_active":"2023-09-30T22:55:05.408741+0000","last_peered":"2023-09-30T22:55:05.408741+0000","last_clean":"2023-09-30T22:55:05.408741+0000","last_became_active":"2023-09-30T22:55:04.392601+0000","last_became_peered":"2023-09-30T22:55:04.392601+0000","last_unstale":"2023-09-30T22:55:05.408741+0000","last_undegraded":"2023-09-30T22:55:05.408741+0000","last_fullsized":"2023-09-30T22:55:05.408741+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:47:21.931645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393760+0000","last_change":"2023-09-30T22:55:05.392487+0000","last_active":"2023-09-30T22:55:05.393760+0000","last_peered":"2023-09-30T22:55:05.393760+0000","last_clean":"2023-09-30T22:55:05.393760+0000","last_became_active":"2023-09-30T22:55:05.391907+0000","last_became_peered":"2023-09-30T22:55:05.391907+0000","last_unstale":"2023-09-30T22:55:05.393760+0000","last_undegraded":"2023-09-30T22:55:05.393760+0000","last_fullsized":"2023-09-30T22:55:05.393760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:21:53.803715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"71'6","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.412739+0000","last_change":"2023-09-30T22:55:04.395161+0000","last_active":"2023-09-30T22:55:05.412739+0000","last_peered":"2023-09-30T22:55:05.412739+0000","last_clean":"2023-09-30T22:55:05.412739+0000","last_became_active":"2023-09-30T22:55:04.393731+0000","last_became_peered":"2023-09-30T22:55:04.393731+0000","last_unstale":"2023-09-30T22:55:05.412739+0000","last_undegraded":"2023-09-30T22:55:05.412739+0000","last_fullsized":"2023-09-30T22:55:05.412739+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:24.028908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.397417+0000","last_change":"2023-09-30T22:55:05.397185+0000","last_active":"2023-09-30T22:55:05.397417+0000","last_peered":"2023-09-30T22:55:05.397417+0000","last_clean":"2023-09-30T22:55:05.397417+0000","last_became_active":"2023-09-30T22:55:05.396287+0000","last_became_peered":"2023-09-30T22:55:05.396287+0000","last_unstale":"2023-09-30T22:55:05.397417+0000","last_undegraded":"2023-09-30T22:55:05.397417+0000","last_fullsized":"2023-09-30T22:55:05.397417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:01.945012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411577+0000","last_change":"2023-09-30T22:55:04.387615+0000","last_active":"2023-09-30T22:55:05.411577+0000","last_peered":"2023-09-30T22:55:05.411577+0000","last_clean":"2023-09-30T22:55:05.411577+0000","last_became_active":"2023-09-30T22:55:04.387363+0000","last_became_peered":"2023-09-30T22:55:04.387363+0000","last_unstale":"2023-09-30T22:55:05.411577+0000","last_undegraded":"2023-09-30T22:55:05.411577+0000","last_fullsized":"2023-09-30T22:55:05.411577+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:32:18.627933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394371+0000","last_change":"2023-09-30T22:55:05.394308+0000","last_active":"2023-09-30T22:55:05.394371+0000","last_peered":"2023-09-30T22:55:05.394371+0000","last_clean":"2023-09-30T22:55:05.394371+0000","last_became_active":"2023-09-30T22:55:05.394087+0000","last_became_peered":"2023-09-30T22:55:05.394087+0000","last_unstale":"2023-09-30T22:55:05.394371+0000","last_undegraded":"2023-09-30T22:55:05.394371+0000","last_fullsized":"2023-09-30T22:55:05.394371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:30.111720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390281+0000","last_change":"2023-09-30T22:55:04.391431+0000","last_active":"2023-09-30T22:55:05.390281+0000","last_peered":"2023-09-30T22:55:05.390281+0000","last_clean":"2023-09-30T22:55:05.390281+0000","last_became_active":"2023-09-30T22:55:04.391212+0000","last_became_peered":"2023-09-30T22:55:04.391212+0000","last_unstale":"2023-09-30T22:55:05.390281+0000","last_undegraded":"2023-09-30T22:55:05.390281+0000","last_fullsized":"2023-09-30T22:55:05.390281+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:45.055050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395486+0000","last_change":"2023-09-30T22:55:05.395413+0000","last_active":"2023-09-30T22:55:05.395486+0000","last_peered":"2023-09-30T22:55:05.395486+0000","last_clean":"2023-09-30T22:55:05.395486+0000","last_became_active":"2023-09-30T22:55:05.395193+0000","last_became_peered":"2023-09-30T22:55:05.395193+0000","last_unstale":"2023-09-30T22:55:05.395486+0000","last_undegraded":"2023-09-30T22:55:05.395486+0000","last_fullsized":"2023-09-30T22:55:05.395486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:24.548562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.387380+0000","last_change":"2023-09-30T22:55:04.394212+0000","last_active":"2023-09-30T22:55:05.387380+0000","last_peered":"2023-09-30T22:55:05.387380+0000","last_clean":"2023-09-30T22:55:05.387380+0000","last_became_active":"2023-09-30T22:55:04.393490+0000","last_became_peered":"2023-09-30T22:55:04.393490+0000","last_unstale":"2023-09-30T22:55:05.387380+0000","last_undegraded":"2023-09-30T22:55:05.387380+0000","last_fullsized":"2023-09-30T22:55:05.387380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:23.542088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.389124+0000","last_change":"2023-09-30T22:55:05.388850+0000","last_active":"2023-09-30T22:55:05.389124+0000","last_peered":"2023-09-30T22:55:05.389124+0000","last_clean":"2023-09-30T22:55:05.389124+0000","last_became_active":"2023-09-30T22:55:05.388613+0000","last_became_peered":"2023-09-30T22:55:05.388613+0000","last_unstale":"2023-09-30T22:55:05.389124+0000","last_undegraded":"2023-09-30T22:55:05.389124+0000","last_fullsized":"2023-09-30T22:55:05.389124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:45:48.615483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"71'8","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411286+0000","last_change":"2023-09-30T22:55:04.392424+0000","last_active":"2023-09-30T22:55:05.411286+0000","last_peered":"2023-09-30T22:55:05.411286+0000","last_clean":"2023-09-30T22:55:05.411286+0000","last_became_active":"2023-09-30T22:55:04.391993+0000","last_became_peered":"2023-09-30T22:55:04.391993+0000","last_unstale":"2023-09-30T22:55:05.411286+0000","last_undegraded":"2023-09-30T22:55:05.411286+0000","last_fullsized":"2023-09-30T22:55:05.411286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:52.302605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394232+0000","last_change":"2023-09-30T22:55:05.394120+0000","last_active":"2023-09-30T22:55:05.394232+0000","last_peered":"2023-09-30T22:55:05.394232+0000","last_clean":"2023-09-30T22:55:05.394232+0000","last_became_active":"2023-09-30T22:55:05.393733+0000","last_became_peered":"2023-09-30T22:55:05.393733+0000","last_unstale":"2023-09-30T22:55:05.394232+0000","last_undegraded":"2023-09-30T22:55:05.394232+0000","last_fullsized":"2023-09-30T22:55:05.394232+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:58:18.099509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411064+0000","last_change":"2023-09-30T22:55:04.396447+0000","last_active":"2023-09-30T22:55:05.411064+0000","last_peered":"2023-09-30T22:55:05.411064+0000","last_clean":"2023-09-30T22:55:05.411064+0000","last_became_active":"2023-09-30T22:55:04.396209+0000","last_became_peered":"2023-09-30T22:55:04.396209+0000","last_unstale":"2023-09-30T22:55:05.411064+0000","last_undegraded":"2023-09-30T22:55:05.411064+0000","last_fullsized":"2023-09-30T22:55:05.411064+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:02.445658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395499+0000","last_change":"2023-09-30T22:55:05.395416+0000","last_active":"2023-09-30T22:55:05.395499+0000","last_peered":"2023-09-30T22:55:05.395499+0000","last_clean":"2023-09-30T22:55:05.395499+0000","last_became_active":"2023-09-30T22:55:05.395203+0000","last_became_peered":"2023-09-30T22:55:05.395203+0000","last_unstale":"2023-09-30T22:55:05.395499+0000","last_undegraded":"2023-09-30T22:55:05.395499+0000","last_fullsized":"2023-09-30T22:55:05.395499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:31.934217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390793+0000","last_change":"2023-09-30T22:55:04.391739+0000","last_active":"2023-09-30T22:55:05.390793+0000","last_peered":"2023-09-30T22:55:05.390793+0000","last_clean":"2023-09-30T22:55:05.390793+0000","last_became_active":"2023-09-30T22:55:04.391478+0000","last_became_peered":"2023-09-30T22:55:04.391478+0000","last_unstale":"2023-09-30T22:55:05.390793+0000","last_undegraded":"2023-09-30T22:55:05.390793+0000","last_fullsized":"2023-09-30T22:55:05.390793+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:22:15.452370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.393730+0000","last_change":"2023-09-30T22:55:05.392220+0000","last_active":"2023-09-30T22:55:05.393730+0000","last_peered":"2023-09-30T22:55:05.393730+0000","last_clean":"2023-09-30T22:55:05.393730+0000","last_became_active":"2023-09-30T22:55:05.391627+0000","last_became_peered":"2023-09-30T22:55:05.391627+0000","last_unstale":"2023-09-30T22:55:05.393730+0000","last_undegraded":"2023-09-30T22:55:05.393730+0000","last_fullsized":"2023-09-30T22:55:05.393730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:59.786016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392567+0000","last_change":"2023-09-30T22:55:04.395324+0000","last_active":"2023-09-30T22:55:05.392567+0000","last_peered":"2023-09-30T22:55:05.392567+0000","last_clean":"2023-09-30T22:55:05.392567+0000","last_became_active":"2023-09-30T22:55:04.394860+0000","last_became_peered":"2023-09-30T22:55:04.394860+0000","last_unstale":"2023-09-30T22:55:05.392567+0000","last_undegraded":"2023-09-30T22:55:05.392567+0000","last_fullsized":"2023-09-30T22:55:05.392567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:00.024599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394656+0000","last_change":"2023-09-30T22:55:05.394304+0000","last_active":"2023-09-30T22:55:05.394656+0000","last_peered":"2023-09-30T22:55:05.394656+0000","last_clean":"2023-09-30T22:55:05.394656+0000","last_became_active":"2023-09-30T22:55:05.394087+0000","last_became_peered":"2023-09-30T22:55:05.394087+0000","last_unstale":"2023-09-30T22:55:05.394656+0000","last_undegraded":"2023-09-30T22:55:05.394656+0000","last_fullsized":"2023-09-30T22:55:05.394656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:44:40.678999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388319+0000","last_change":"2023-09-30T22:55:04.391439+0000","last_active":"2023-09-30T22:55:05.388319+0000","last_peered":"2023-09-30T22:55:05.388319+0000","last_clean":"2023-09-30T22:55:05.388319+0000","last_became_active":"2023-09-30T22:55:04.391210+0000","last_became_peered":"2023-09-30T22:55:04.391210+0000","last_unstale":"2023-09-30T22:55:05.388319+0000","last_undegraded":"2023-09-30T22:55:05.388319+0000","last_fullsized":"2023-09-30T22:55:05.388319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:43:12.431602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.395409+0000","last_change":"2023-09-30T22:55:05.395343+0000","last_active":"2023-09-30T22:55:05.395409+0000","last_peered":"2023-09-30T22:55:05.395409+0000","last_clean":"2023-09-30T22:55:05.395409+0000","last_became_active":"2023-09-30T22:55:05.395118+0000","last_became_peered":"2023-09-30T22:55:05.395118+0000","last_unstale":"2023-09-30T22:55:05.395409+0000","last_undegraded":"2023-09-30T22:55:05.395409+0000","last_fullsized":"2023-09-30T22:55:05.395409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:05.766842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392552+0000","last_change":"2023-09-30T22:55:04.393644+0000","last_active":"2023-09-30T22:55:05.392552+0000","last_peered":"2023-09-30T22:55:05.392552+0000","last_clean":"2023-09-30T22:55:05.392552+0000","last_became_active":"2023-09-30T22:55:04.393364+0000","last_became_peered":"2023-09-30T22:55:04.393364+0000","last_unstale":"2023-09-30T22:55:05.392552+0000","last_undegraded":"2023-09-30T22:55:05.392552+0000","last_fullsized":"2023-09-30T22:55:05.392552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:20.415511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401864+0000","last_change":"2023-09-30T22:55:05.401801+0000","last_active":"2023-09-30T22:55:05.401864+0000","last_peered":"2023-09-30T22:55:05.401864+0000","last_clean":"2023-09-30T22:55:05.401864+0000","last_became_active":"2023-09-30T22:55:05.401294+0000","last_became_peered":"2023-09-30T22:55:05.401294+0000","last_unstale":"2023-09-30T22:55:05.401864+0000","last_undegraded":"2023-09-30T22:55:05.401864+0000","last_fullsized":"2023-09-30T22:55:05.401864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:05.921999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.384745+0000","last_change":"2023-09-30T22:55:04.388260+0000","last_active":"2023-09-30T22:55:05.384745+0000","last_peered":"2023-09-30T22:55:05.384745+0000","last_clean":"2023-09-30T22:55:05.384745+0000","last_became_active":"2023-09-30T22:55:04.388012+0000","last_became_peered":"2023-09-30T22:55:04.388012+0000","last_unstale":"2023-09-30T22:55:05.384745+0000","last_undegraded":"2023-09-30T22:55:05.384745+0000","last_fullsized":"2023-09-30T22:55:05.384745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:22:15.452370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.399610+0000","last_change":"2023-09-30T22:55:05.399479+0000","last_active":"2023-09-30T22:55:05.399610+0000","last_peered":"2023-09-30T22:55:05.399610+0000","last_clean":"2023-09-30T22:55:05.399610+0000","last_became_active":"2023-09-30T22:55:05.399251+0000","last_became_peered":"2023-09-30T22:55:05.399251+0000","last_unstale":"2023-09-30T22:55:05.399610+0000","last_undegraded":"2023-09-30T22:55:05.399610+0000","last_fullsized":"2023-09-30T22:55:05.399610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:01.320914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388715+0000","last_change":"2023-09-30T22:55:04.390931+0000","last_active":"2023-09-30T22:55:05.388715+0000","last_peered":"2023-09-30T22:55:05.388715+0000","last_clean":"2023-09-30T22:55:05.388715+0000","last_became_active":"2023-09-30T22:55:04.390438+0000","last_became_peered":"2023-09-30T22:55:04.390438+0000","last_unstale":"2023-09-30T22:55:05.388715+0000","last_undegraded":"2023-09-30T22:55:05.388715+0000","last_fullsized":"2023-09-30T22:55:05.388715+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:24.361671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396497+0000","last_change":"2023-09-30T22:55:05.396412+0000","last_active":"2023-09-30T22:55:05.396497+0000","last_peered":"2023-09-30T22:55:05.396497+0000","last_clean":"2023-09-30T22:55:05.396497+0000","last_became_active":"2023-09-30T22:55:05.396191+0000","last_became_peered":"2023-09-30T22:55:05.396191+0000","last_unstale":"2023-09-30T22:55:05.396497+0000","last_undegraded":"2023-09-30T22:55:05.396497+0000","last_fullsized":"2023-09-30T22:55:05.396497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:18.310209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392661+0000","last_change":"2023-09-30T22:55:04.394639+0000","last_active":"2023-09-30T22:55:05.392661+0000","last_peered":"2023-09-30T22:55:05.392661+0000","last_clean":"2023-09-30T22:55:05.392661+0000","last_became_active":"2023-09-30T22:55:04.393152+0000","last_became_peered":"2023-09-30T22:55:04.393152+0000","last_unstale":"2023-09-30T22:55:05.392661+0000","last_undegraded":"2023-09-30T22:55:05.392661+0000","last_fullsized":"2023-09-30T22:55:05.392661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:45:47.609009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.392993+0000","last_change":"2023-09-30T22:55:05.390130+0000","last_active":"2023-09-30T22:55:05.392993+0000","last_peered":"2023-09-30T22:55:05.392993+0000","last_clean":"2023-09-30T22:55:05.392993+0000","last_became_active":"2023-09-30T22:55:05.389698+0000","last_became_peered":"2023-09-30T22:55:05.389698+0000","last_unstale":"2023-09-30T22:55:05.392993+0000","last_undegraded":"2023-09-30T22:55:05.392993+0000","last_fullsized":"2023-09-30T22:55:05.392993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:24.924960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.411284+0000","last_change":"2023-09-30T22:55:04.396390+0000","last_active":"2023-09-30T22:55:05.411284+0000","last_peered":"2023-09-30T22:55:05.411284+0000","last_clean":"2023-09-30T22:55:05.411284+0000","last_became_active":"2023-09-30T22:55:04.396123+0000","last_became_peered":"2023-09-30T22:55:04.396123+0000","last_unstale":"2023-09-30T22:55:05.411284+0000","last_undegraded":"2023-09-30T22:55:05.411284+0000","last_fullsized":"2023-09-30T22:55:05.411284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:04.915525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390803+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:55:05.390803+0000","last_peered":"2023-09-30T22:55:05.390803+0000","last_clean":"2023-09-30T22:55:05.390803+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:55:05.390803+0000","last_undegraded":"2023-09-30T22:55:05.390803+0000","last_fullsized":"2023-09-30T22:55:05.390803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.398252+0000","last_change":"2023-09-30T22:55:05.398177+0000","last_active":"2023-09-30T22:55:05.398252+0000","last_peered":"2023-09-30T22:55:05.398252+0000","last_clean":"2023-09-30T22:55:05.398252+0000","last_became_active":"2023-09-30T22:55:05.397818+0000","last_became_peered":"2023-09-30T22:55:05.397818+0000","last_unstale":"2023-09-30T22:55:05.398252+0000","last_undegraded":"2023-09-30T22:55:05.398252+0000","last_fullsized":"2023-09-30T22:55:05.398252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:40:33.853274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390718+0000","last_change":"2023-09-30T22:55:04.394888+0000","last_active":"2023-09-30T22:55:05.390718+0000","last_peered":"2023-09-30T22:55:05.390718+0000","last_clean":"2023-09-30T22:55:05.390718+0000","last_became_active":"2023-09-30T22:55:04.394639+0000","last_became_peered":"2023-09-30T22:55:04.394639+0000","last_unstale":"2023-09-30T22:55:05.390718+0000","last_undegraded":"2023-09-30T22:55:05.390718+0000","last_fullsized":"2023-09-30T22:55:05.390718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:30:46.985799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.387539+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:55:05.387539+0000","last_peered":"2023-09-30T22:55:05.387539+0000","last_clean":"2023-09-30T22:55:05.387539+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:55:05.387539+0000","last_undegraded":"2023-09-30T22:55:05.387539+0000","last_fullsized":"2023-09-30T22:55:05.387539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.403566+0000","last_change":"2023-09-30T22:55:05.403376+0000","last_active":"2023-09-30T22:55:05.403566+0000","last_peered":"2023-09-30T22:55:05.403566+0000","last_clean":"2023-09-30T22:55:05.403566+0000","last_became_active":"2023-09-30T22:55:05.402884+0000","last_became_peered":"2023-09-30T22:55:05.402884+0000","last_unstale":"2023-09-30T22:55:05.403566+0000","last_undegraded":"2023-09-30T22:55:05.403566+0000","last_fullsized":"2023-09-30T22:55:05.403566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:25.368144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396313+0000","last_change":"2023-09-30T22:55:04.393016+0000","last_active":"2023-09-30T22:55:05.396313+0000","last_peered":"2023-09-30T22:55:05.396313+0000","last_clean":"2023-09-30T22:55:05.396313+0000","last_became_active":"2023-09-30T22:55:04.392752+0000","last_became_peered":"2023-09-30T22:55:04.392752+0000","last_unstale":"2023-09-30T22:55:05.396313+0000","last_undegraded":"2023-09-30T22:55:05.396313+0000","last_fullsized":"2023-09-30T22:55:05.396313+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:40.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388801+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:55:05.388801+0000","last_peered":"2023-09-30T22:55:05.388801+0000","last_clean":"2023-09-30T22:55:05.388801+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:55:05.388801+0000","last_undegraded":"2023-09-30T22:55:05.388801+0000","last_fullsized":"2023-09-30T22:55:05.388801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394228+0000","last_change":"2023-09-30T22:55:05.394160+0000","last_active":"2023-09-30T22:55:05.394228+0000","last_peered":"2023-09-30T22:55:05.394228+0000","last_clean":"2023-09-30T22:55:05.394228+0000","last_became_active":"2023-09-30T22:55:05.393922+0000","last_became_peered":"2023-09-30T22:55:05.393922+0000","last_unstale":"2023-09-30T22:55:05.394228+0000","last_undegraded":"2023-09-30T22:55:05.394228+0000","last_fullsized":"2023-09-30T22:55:05.394228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:49.024363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390895+0000","last_change":"2023-09-30T22:55:04.392882+0000","last_active":"2023-09-30T22:55:05.390895+0000","last_peered":"2023-09-30T22:55:05.390895+0000","last_clean":"2023-09-30T22:55:05.390895+0000","last_became_active":"2023-09-30T22:55:04.392267+0000","last_became_peered":"2023-09-30T22:55:04.392267+0000","last_unstale":"2023-09-30T22:55:05.390895+0000","last_undegraded":"2023-09-30T22:55:05.390895+0000","last_fullsized":"2023-09-30T22:55:05.390895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:42.977631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.386526+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:55:05.386526+0000","last_peered":"2023-09-30T22:55:05.386526+0000","last_clean":"2023-09-30T22:55:05.386526+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:55:05.386526+0000","last_undegraded":"2023-09-30T22:55:05.386526+0000","last_fullsized":"2023-09-30T22:55:05.386526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":210,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.396455+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:55:05.396455+0000","last_peered":"2023-09-30T22:55:05.396455+0000","last_clean":"2023-09-30T22:55:05.396455+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:55:05.396455+0000","last_undegraded":"2023-09-30T22:55:05.396455+0000","last_fullsized":"2023-09-30T22:55:05.396455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.401995+0000","last_change":"2023-09-30T22:55:05.401951+0000","last_active":"2023-09-30T22:55:05.401995+0000","last_peered":"2023-09-30T22:55:05.401995+0000","last_clean":"2023-09-30T22:55:05.401995+0000","last_became_active":"2023-09-30T22:55:05.401674+0000","last_became_peered":"2023-09-30T22:55:05.401674+0000","last_unstale":"2023-09-30T22:55:05.401995+0000","last_undegraded":"2023-09-30T22:55:05.401995+0000","last_fullsized":"2023-09-30T22:55:05.401995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:46.061524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.408437+0000","last_change":"2023-09-30T22:55:04.394417+0000","last_active":"2023-09-30T22:55:05.408437+0000","last_peered":"2023-09-30T22:55:05.408437+0000","last_clean":"2023-09-30T22:55:05.408437+0000","last_became_active":"2023-09-30T22:55:04.394026+0000","last_became_peered":"2023-09-30T22:55:04.394026+0000","last_unstale":"2023-09-30T22:55:05.408437+0000","last_undegraded":"2023-09-30T22:55:05.408437+0000","last_fullsized":"2023-09-30T22:55:05.408437+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:08:10.542144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390582+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:55:05.390582+0000","last_peered":"2023-09-30T22:55:05.390582+0000","last_clean":"2023-09-30T22:55:05.390582+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:55:05.390582+0000","last_undegraded":"2023-09-30T22:55:05.390582+0000","last_fullsized":"2023-09-30T22:55:05.390582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400131+0000","last_change":"2023-09-30T22:55:05.399245+0000","last_active":"2023-09-30T22:55:05.400131+0000","last_peered":"2023-09-30T22:55:05.400131+0000","last_clean":"2023-09-30T22:55:05.400131+0000","last_became_active":"2023-09-30T22:55:05.399024+0000","last_became_peered":"2023-09-30T22:55:05.399024+0000","last_unstale":"2023-09-30T22:55:05.400131+0000","last_undegraded":"2023-09-30T22:55:05.400131+0000","last_fullsized":"2023-09-30T22:55:05.400131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:25:44.499164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.409305+0000","last_change":"2023-09-30T22:55:04.390412+0000","last_active":"2023-09-30T22:55:05.409305+0000","last_peered":"2023-09-30T22:55:05.409305+0000","last_clean":"2023-09-30T22:55:05.409305+0000","last_became_active":"2023-09-30T22:55:04.390202+0000","last_became_peered":"2023-09-30T22:55:04.390202+0000","last_unstale":"2023-09-30T22:55:05.409305+0000","last_undegraded":"2023-09-30T22:55:05.409305+0000","last_fullsized":"2023-09-30T22:55:05.409305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:29.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.390507+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:55:05.390507+0000","last_peered":"2023-09-30T22:55:05.390507+0000","last_clean":"2023-09-30T22:55:05.390507+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:55:05.390507+0000","last_undegraded":"2023-09-30T22:55:05.390507+0000","last_fullsized":"2023-09-30T22:55:05.390507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.400150+0000","last_change":"2023-09-30T22:55:05.399261+0000","last_active":"2023-09-30T22:55:05.400150+0000","last_peered":"2023-09-30T22:55:05.400150+0000","last_clean":"2023-09-30T22:55:05.400150+0000","last_became_active":"2023-09-30T22:55:05.399051+0000","last_became_peered":"2023-09-30T22:55:05.399051+0000","last_unstale":"2023-09-30T22:55:05.400150+0000","last_undegraded":"2023-09-30T22:55:05.400150+0000","last_fullsized":"2023-09-30T22:55:05.400150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:03.452132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.410212+0000","last_change":"2023-09-30T22:55:04.390324+0000","last_active":"2023-09-30T22:55:05.410212+0000","last_peered":"2023-09-30T22:55:05.410212+0000","last_clean":"2023-09-30T22:55:05.410212+0000","last_became_active":"2023-09-30T22:55:04.389758+0000","last_became_peered":"2023-09-30T22:55:04.389758+0000","last_unstale":"2023-09-30T22:55:05.410212+0000","last_undegraded":"2023-09-30T22:55:05.410212+0000","last_fullsized":"2023-09-30T22:55:05.410212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:48.017890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.389599+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:55:05.389599+0000","last_peered":"2023-09-30T22:55:05.389599+0000","last_clean":"2023-09-30T22:55:05.389599+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:55:05.389599+0000","last_undegraded":"2023-09-30T22:55:05.389599+0000","last_fullsized":"2023-09-30T22:55:05.389599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.394287+0000","last_change":"2023-09-30T22:55:05.394223+0000","last_active":"2023-09-30T22:55:05.394287+0000","last_peered":"2023-09-30T22:55:05.394287+0000","last_clean":"2023-09-30T22:55:05.394287+0000","last_became_active":"2023-09-30T22:55:05.394002+0000","last_became_peered":"2023-09-30T22:55:05.394002+0000","last_unstale":"2023-09-30T22:55:05.394287+0000","last_undegraded":"2023-09-30T22:55:05.394287+0000","last_fullsized":"2023-09-30T22:55:05.394287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:04.375017+0000","last_clean_scrub_stamp":"2023-09-30T22:55:04.375017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:39:09.016933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.388678+0000","last_change":"2023-09-30T22:55:04.392127+0000","last_active":"2023-09-30T22:55:05.388678+0000","last_peered":"2023-09-30T22:55:05.388678+0000","last_clean":"2023-09-30T22:55:05.388678+0000","last_became_active":"2023-09-30T22:55:04.391894+0000","last_became_peered":"2023-09-30T22:55:04.391894+0000","last_unstale":"2023-09-30T22:55:05.388678+0000","last_undegraded":"2023-09-30T22:55:05.388678+0000","last_fullsized":"2023-09-30T22:55:05.388678+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:55:03.368543+0000","last_clean_scrub_stamp":"2023-09-30T22:55:03.368543+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:25:43.492691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-09-30T22:55:05.387461+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:55:05.387461+0000","last_peered":"2023-09-30T22:55:05.387461+0000","last_clean":"2023-09-30T22:55:05.387461+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:55:05.387461+0000","last_undegraded":"2023-09-30T22:55:05.387461+0000","last_fullsized":"2023-09-30T22:55:05.387461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194935,"statfs":{"total":200000000,"available":199613586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.5},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.84999999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.747},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.55900000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88400000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66600000000000004}]},{"osd":3,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76600000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55300000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90800000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":1.135},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92700000000000005,"5min":1.004,"15min":1.004},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.59099999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.86299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":385,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194926,"statfs":{"total":200000000,"available":199604785,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.016,"15min":1.0660000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90000000000000002,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":3.399,"15min":3.399},"last":0.72699999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.55900000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0109999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":1.0269999999999999,"15min":1.0840000000000001},"min":{"1min":0.52900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88300000000000001,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.66800000000000004}]},{"osd":2,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.745,"5min":1.0600000000000001,"15min":1.1120000000000001},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":0.997},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96499999999999997,"5min":5.4210000000000003,"15min":5.4210000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.879,"5min":1.46,"15min":1.46},"last":0.70099999999999996}]},{"osd":4,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.627,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.71299999999999997,"15min":0.70099999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0509999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":953,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194358,"statfs":{"total":200000000,"available":199023184,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.504,"15min":0.502},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.378,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.58899999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.53200000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.621},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71999999999999997,"15min":0.71299999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.754,"15min":0.751},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.755,"15min":0.747},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194928,"statfs":{"total":200000000,"available":199606945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.441,"15min":0.44},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.441}]},{"osd":3,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.76700000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.54100000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.70699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":383,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194928,"statfs":{"total":200000000,"available":199606889,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.28000000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64500000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.55600000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96299999999999997,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.84199999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.51700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":1.615,"15min":1.615},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86299999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.879}]},{"osd":7,"last update":"Sat Sep 30 22:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.93999999999999995,"5min":1.663,"15min":1.663},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194934,"statfs":{"total":200000000,"available":199613426,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.504,"5min":1.919,"15min":1.919},"last":0.377}]},{"osd":1,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":1.254,"15min":1.254},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.60999999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72299999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88300000000000001,"5min":1.401,"15min":1.401},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.747},"min":{"1min":0.58399999999999996,"5min":0.496,"15min":0.496},"max":{"1min":0.98799999999999999,"5min":1.544,"15min":1.544},"last":0.623}]},{"osd":5,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.75},"min":{"1min":0.64900000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94599999999999995,"5min":1.508,"15min":1.508},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.58199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0489999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94299999999999995,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.52900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93100000000000005,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Sep 30 22:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.52500000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0269999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92200000000000004,"5min":1.573,"15min":1.573},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194934,"statfs":{"total":200000000,"available":199613032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.56399999999999995,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.85199999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.49199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.747}]},{"osd":2,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.67400000000000004,"15min":0.66300000000000003},"min":{"1min":0.58299999999999996,"5min":0.442,"15min":0.442},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.53100000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86799999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.871}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":955,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194357,"statfs":{"total":200000000,"available":199021570,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.45000000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.75900000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65500000000000003,"15min":0.64200000000000002},"min":{"1min":0.59999999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65700000000000003,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.52600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.62},"min":{"1min":0.58099999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.54000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69399999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.751,"5min":0.874,"15min":0.874},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.628,"15min":0.621},"min":{"1min":0.46999999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.83499999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.621},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.625},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.54100000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.70799999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.37,"15min":0.37},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57799999999999996}]}]}],"pool_statfs":[]}} 2023-09-30T22:55:10.205 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:55:10.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T22:55:10.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.436+0000 7f1bd87ff700 1 Processor -- start 2023-09-30T22:55:10.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.437+0000 7f1bd87ff700 1 -- start start 2023-09-30T22:55:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd87ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd00c52a0 0x7f1bd00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd87ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bd00cb350 0x7f1bd01605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd87ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd00c7690 con 0x7f1bd0069f10 2023-09-30T22:55:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd87ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd01406a0 con 0x7f1bd00cb350 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd87ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00c3a50 con 0x7f1bd00c52a0 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd6d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bd00cb350 0x7f1bd01605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd6d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bd00cb350 0x7f1bd01605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39936/0 (socket says 172.21.15.142:39936) 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.438+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/2923220408 learned_addr learned my addr 172.21.15.142:0/2923220408 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd659b700 1 --2- 172.21.15.142:0/2923220408 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd00c52a0 0x7f1bd00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/2923220408 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd00c52a0 msgr2=0x7f1bd00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd6d9c700 1 --2- 172.21.15.142:0/2923220408 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd00c52a0 0x7f1bd00c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/2923220408 >> v1:172.21.15.148:6789/0 conn(0x7f1bd0069f10 legacy=0x7f1bd00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/2923220408 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00c7f20 con 0x7f1bd00cb350 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd659b700 1 --2- 172.21.15.142:0/2923220408 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd00c52a0 0x7f1bd00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd6d9c700 1 --2- 172.21.15.142:0/2923220408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd01605e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009f50 tx=0x7f1bc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9374461c1f7efae3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd5599700 1 -- 172.21.15.142:0/2923220408 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800e070 con 0x7f1bd00cb350 2023-09-30T22:55:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd5599700 1 -- 172.21.15.142:0/2923220408 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800ba70 con 0x7f1bd00cb350 2023-09-30T22:55:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.439+0000 7f1bd5599700 1 -- 172.21.15.142:0/2923220408 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80092e0 con 0x7f1bd00cb350 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 -- 172.21.15.142:0/2923220408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 msgr2=0x7f1bd01605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/2923220408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd01605e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009f50 tx=0x7f1bc8009840 comp rx=0 tx=0).stop 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 -- 172.21.15.142:0/2923220408 shutdown_connections 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/2923220408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd01605e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/2923220408 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd00c52a0 0x7f1bd00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 -- 172.21.15.142:0/2923220408 >> 172.21.15.142:0/2923220408 conn(0x7f1bd00cc670 msgr2=0x7f1bd00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 -- 172.21.15.142:0/2923220408 shutdown_connections 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.440+0000 7f1bd87ff700 1 -- 172.21.15.142:0/2923220408 wait complete. 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.441+0000 7f1bd87ff700 1 Processor -- start 2023-09-30T22:55:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.442+0000 7f1bd87ff700 1 -- start start 2023-09-30T22:55:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.442+0000 7f1bd87ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd0069f10 0x7f1bd0156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.442+0000 7f1bd87ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bd00c52a0 0x7f1bd00c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.442+0000 7f1bd87ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd0158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.442+0000 7f1bd87ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00c2470 con 0x7f1bd00cb350 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.442+0000 7f1bd87ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd013d770 con 0x7f1bd00c52a0 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.442+0000 7f1bd87ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00c1e60 con 0x7f1bd0069f10 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd0158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd0158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39940/0 (socket says 172.21.15.142:39940) 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/4224359150 learned_addr learned my addr 172.21.15.142:0/4224359150 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd659b700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd0069f10 0x7f1bd0156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd5d9a700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bd00c52a0 0x7f1bd00c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd0069f10 msgr2=0x7f1bd0156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd0069f10 0x7f1bd0156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bd00c52a0 msgr2=0x7f1bd00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bd00c52a0 0x7f1bd00c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 -- 172.21.15.142:0/4224359150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8009ae0 con 0x7f1bd00cb350 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.443+0000 7f1bd6d9c700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd0158000 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bd006c260 tx=0x7f1bc8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.444+0000 7f1bc67fc700 1 -- 172.21.15.142:0/4224359150 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80032f0 con 0x7f1bd00cb350 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.444+0000 7f1bc67fc700 1 -- 172.21.15.142:0/4224359150 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8008e40 con 0x7f1bd00cb350 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.444+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd016b150 con 0x7f1bd00cb350 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.444+0000 7f1bc67fc700 1 -- 172.21.15.142:0/4224359150 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc801c660 con 0x7f1bd00cb350 2023-09-30T22:55:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.444+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd01566d0 con 0x7f1bd00cb350 2023-09-30T22:55:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.445+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd0069a50 con 0x7f1bd00cb350 2023-09-30T22:55:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.446+0000 7f1bc67fc700 1 -- 172.21.15.142:0/4224359150 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1bc8003040 con 0x7f1bd00cb350 2023-09-30T22:55:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.446+0000 7f1bc67fc700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bb4067330 0x7f1bb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.447+0000 7f1bc67fc700 1 -- 172.21.15.142:0/4224359150 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bc8086590 con 0x7f1bd00cb350 2023-09-30T22:55:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.447+0000 7f1bd659b700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bb4067330 0x7f1bb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.447+0000 7f1bd659b700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bb4067330 0x7f1bb40697e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006f00 tx=0x7f1bcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.451+0000 7f1bc67fc700 1 -- 172.21.15.142:0/4224359150 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1bc80533f0 con 0x7f1bd00cb350 2023-09-30T22:55:10.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.715+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1bd006fc10 con 0x7f1bd00cb350 2023-09-30T22:55:10.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.719+0000 7f1bc67fc700 1 -- 172.21.15.142:0/4224359150 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1bc8056a10 con 0x7f1bd00cb350 2023-09-30T22:55:10.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.721+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bb4067330 msgr2=0x7f1bb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.721+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bb4067330 0x7f1bb40697e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006f00 tx=0x7f1bcc008040 comp rx=0 tx=0).stop 2023-09-30T22:55:10.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.721+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 msgr2=0x7f1bd0158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.721+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd0158000 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bd006c260 tx=0x7f1bc8018000 comp rx=0 tx=0).stop 2023-09-30T22:55:10.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 shutdown_connections 2023-09-30T22:55:10.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1bb4067330 0x7f1bb40697e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bd00cb350 0x7f1bd0158000 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bd0069f10 0x7f1bd0156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 --2- 172.21.15.142:0/4224359150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bd00c52a0 0x7f1bd00c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 >> 172.21.15.142:0/4224359150 conn(0x7f1bd00cc670 msgr2=0x7f1bd006e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:10.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 shutdown_connections 2023-09-30T22:55:10.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.722+0000 7f1bd87ff700 1 -- 172.21.15.142:0/4224359150 wait complete. 2023-09-30T22:55:10.723 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T22:55:10.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:55:10.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.928+0000 7faf5a7ff700 1 Processor -- start 2023-09-30T22:55:10.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.929+0000 7faf5a7ff700 1 -- start start 2023-09-30T22:55:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.930+0000 7faf5a7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 0x7faf5415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.930+0000 7faf5a7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faf5415dc50 0x7faf5406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.930+0000 7faf5a7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5415e0b0 con 0x7faf54143350 2023-09-30T22:55:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.930+0000 7faf5a7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540cc6b0 con 0x7faf5415dc50 2023-09-30T22:55:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.930+0000 7faf5a7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf540cbaa0 con 0x7faf540692f0 2023-09-30T22:55:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.930+0000 7faf53fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faf54143350 0x7faf540cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48854/0 (socket says 172.21.15.142:48854) 2023-09-30T22:55:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.930+0000 7faf53fff700 1 -- 172.21.15.142:0/239826201 learned_addr learned my addr 172.21.15.142:0/239826201 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:10.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf58d9c700 1 --2- 172.21.15.142:0/239826201 >> v2:172.21.15.148:3300/0 conn(0x7faf5415dc50 0x7faf5406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf4bfff700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 0x7faf5415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900497978 0 0) 0x7faf44001110 con 0x7faf54143350 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf40003570 con 0x7faf54143350 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3380343331 0 0) 0x7faf40003570 con 0x7faf54143350 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 msgr2=0x7faf5415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 0x7faf5415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 >> v2:172.21.15.148:3300/0 conn(0x7faf5415dc50 msgr2=0x7faf5406a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 --2- 172.21.15.142:0/239826201 >> v2:172.21.15.148:3300/0 conn(0x7faf5415dc50 0x7faf5406a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540cbd80 con 0x7faf54143350 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7faf44001600 con 0x7faf54143350 2023-09-30T22:55:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 >> v1:172.21.15.142:6789/0 conn(0x7faf54143350 legacy=0x7faf540cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 0x7faf40003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf40003fe0 0x7faf40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf40004d50 0x7faf400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540cc6b0 con 0x7faf40003fe0 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540cbaa0 con 0x7faf40004d50 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4000ba90 con 0x7faf540692f0 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.931+0000 7faf58d9c700 1 --2- 172.21.15.142:0/239826201 >> v2:172.21.15.148:3300/0 conn(0x7faf5415dc50 0x7faf5406a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf4bfff700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf40003fe0 0x7faf40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf53fff700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 0x7faf40003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf58d9c700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf40004d50 0x7faf400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf4bfff700 1 -- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 msgr2=0x7faf40003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf4bfff700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf540692f0 0x7faf40003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf4bfff700 1 -- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf40004d50 msgr2=0x7faf400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf4bfff700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf40004d50 0x7faf400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf4bfff700 1 -- 172.21.15.142:0/239826201 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40003570 con 0x7faf40003fe0 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf58d9c700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf40004d50 0x7faf400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf4bfff700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf40003fe0 0x7faf40004810 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009c00 tx=0x7faf3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f173ada87d513603 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c00e6b0 con 0x7faf40003fe0 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c00e810 con 0x7faf40003fe0 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.932+0000 7faf537fe700 1 -- 172.21.15.142:0/239826201 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c00ebd0 con 0x7faf40003fe0 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.933+0000 7faf5a7ff700 1 -- 172.21.15.142:0/239826201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf40003fe0 msgr2=0x7faf40004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.933+0000 7faf5a7ff700 1 --2- 172.21.15.142:0/239826201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf40003fe0 0x7faf40004810 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009c00 tx=0x7faf3c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.933+0000 7faf58d9c700 1 -- 172.21.15.142:0/239826201 reap_dead start 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.933+0000 7faf5a7ff700 1 -- 172.21.15.142:0/239826201 shutdown_connections 2023-09-30T22:55:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.933+0000 7faf5a7ff700 1 -- 172.21.15.142:0/239826201 >> 172.21.15.142:0/239826201 conn(0x7faf540ce8e0 msgr2=0x7faf540cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.933+0000 7faf5a7ff700 1 -- 172.21.15.142:0/239826201 shutdown_connections 2023-09-30T22:55:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.933+0000 7faf5a7ff700 1 -- 172.21.15.142:0/239826201 wait complete. 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.934+0000 7faf5a7ff700 1 Processor -- start 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.935+0000 7faf5a7ff700 1 -- start start 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf5a7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf40003fe0 0x7faf5416a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf5a7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf5416e910 0x7faf54159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf5a7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5415a8a0 0x7faf5415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf5a7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5416b920 con 0x7faf5415a8a0 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf5a7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5416ae70 con 0x7faf5416e910 2023-09-30T22:55:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf5a7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5415a410 con 0x7faf40003fe0 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5415a8a0 0x7faf5415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5415a8a0 0x7faf5415ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42962/0 (socket says 172.21.15.142:42962) 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 -- 172.21.15.142:0/641971544 learned_addr learned my addr 172.21.15.142:0/641971544 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf53fff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf40003fe0 0x7faf5416a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf4bfff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf5416e910 0x7faf54159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 -- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf40003fe0 msgr2=0x7faf5416a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf40003fe0 0x7faf5416a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 -- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf5416e910 msgr2=0x7faf54159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf5416e910 0x7faf54159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.936+0000 7faf58d9c700 1 -- 172.21.15.142:0/641971544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5416b080 con 0x7faf5415a8a0 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.937+0000 7faf58d9c700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5415a8a0 0x7faf5415ad20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faf5415e020 tx=0x7faf4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.937+0000 7faf50ff9700 1 -- 172.21.15.142:0/641971544 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00e070 con 0x7faf5415a8a0 2023-09-30T22:55:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.937+0000 7faf50ff9700 1 -- 172.21.15.142:0/641971544 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c011c50 con 0x7faf5415a8a0 2023-09-30T22:55:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.937+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5416b360 con 0x7faf5415a8a0 2023-09-30T22:55:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.937+0000 7faf50ff9700 1 -- 172.21.15.142:0/641971544 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c016470 con 0x7faf5415a8a0 2023-09-30T22:55:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.937+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5416ed80 con 0x7faf5415a8a0 2023-09-30T22:55:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.938+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5415a5c0 con 0x7faf5415a8a0 2023-09-30T22:55:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.939+0000 7faf50ff9700 1 -- 172.21.15.142:0/641971544 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7faf4c016800 con 0x7faf5415a8a0 2023-09-30T22:55:10.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.940+0000 7faf50ff9700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf34067330 0x7faf340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:10.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.940+0000 7faf50ff9700 1 -- 172.21.15.142:0/641971544 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf4c085760 con 0x7faf5415a8a0 2023-09-30T22:55:10.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.940+0000 7faf53fff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf34067330 0x7faf340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:10.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.941+0000 7faf53fff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf34067330 0x7faf340697e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faf440017b0 tx=0x7faf44007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:10.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:10.944+0000 7faf50ff9700 1 -- 172.21.15.142:0/641971544 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faf5415a5c0 con 0x7faf5415a8a0 2023-09-30T22:55:11.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.177+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf5415a1c0 con 0x7faf5415a8a0 2023-09-30T22:55:11.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.178+0000 7faf50ff9700 1 -- 172.21.15.142:0/641971544 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4607 (secure 0 0 0) 0x7faf4c052660 con 0x7faf5415a8a0 2023-09-30T22:55:11.178 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:11.178 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:55:04.855906+0000","modified":"2023-09-30T22:55:08.414251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3864514907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3864514907},{"type":"v1","addr":"172.21.15.142:6837","nonce":3864514907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-09-30T22:55:11.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf34067330 msgr2=0x7faf340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf34067330 0x7faf340697e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faf440017b0 tx=0x7faf44007a80 comp rx=0 tx=0).stop 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5415a8a0 msgr2=0x7faf5415ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5415a8a0 0x7faf5415ad20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faf5415e020 tx=0x7faf4c00b040 comp rx=0 tx=0).stop 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 shutdown_connections 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf34067330 0x7faf340697e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5415a8a0 0x7faf5415ad20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf40003fe0 0x7faf5416a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 --2- 172.21.15.142:0/641971544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf5416e910 0x7faf54159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 >> 172.21.15.142:0/641971544 conn(0x7faf540ce8e0 msgr2=0x7faf540c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 shutdown_connections 2023-09-30T22:55:11.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.180+0000 7faf5a7ff700 1 -- 172.21.15.142:0/641971544 wait complete. 2023-09-30T22:55:11.182 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2023-09-30T22:55:11.370 INFO:tasks.ceph.mds.a.smithi142.stderr:2023-09-30T22:55:11.370+0000 7fab701f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:55:11.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:55:04.855906+0000', 'modified': '2023-09-30T22:55:08.414251+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5802}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5802': {'gid': 5802, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/3864514907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 3864514907}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 3864514907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:55:11.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:55:11.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:55:11.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.792+0000 7f56cb9ff700 1 Processor -- start 2023-09-30T22:55:11.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.792+0000 7f56cb9ff700 1 -- start start 2023-09-30T22:55:11.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.793+0000 7f56cb9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c40adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.793+0000 7f56cb9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c40ad630 con 0x7f56c40ae000 2023-09-30T22:55:11.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.793+0000 7f56cb9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c40b3360 con 0x7f56c40b1950 2023-09-30T22:55:11.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.793+0000 7f56cb9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c4157c20 con 0x7f56c40b1580 2023-09-30T22:55:11.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56c9f9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f56c40ae000 0x7f56c406a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48866/0 (socket says 172.21.15.142:48866) 2023-09-30T22:55:11.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56c9f9c700 1 -- 172.21.15.142:0/1071039327 learned_addr learned my addr 172.21.15.142:0/1071039327 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56c979b700 1 --2- 172.21.15.142:0/1071039327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c40adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615498539 0 0) 0x7f56c40ad630 con 0x7f56c40ae000 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b0003570 con 0x7f56c40ae000 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425255312 0 0) 0x7f56c40b3360 con 0x7f56c40b1950 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c40ad630 con 0x7f56c40b1950 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.794+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80112278 0 0) 0x7f56b0003570 con 0x7f56c40ae000 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.795+0000 7f56c979b700 1 -- 172.21.15.142:0/1071039327 >> v1:172.21.15.148:6789/0 conn(0x7f56c40b1950 legacy=0x7f56c415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.795+0000 7f56c979b700 1 -- 172.21.15.142:0/1071039327 >> v1:172.21.15.142:6789/0 conn(0x7f56c40ae000 legacy=0x7f56c406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.795+0000 7f56c979b700 1 -- 172.21.15.142:0/1071039327 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c415ad60 con 0x7f56c40b1580 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.795+0000 7f56c979b700 1 --2- 172.21.15.142:0/1071039327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c40adac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009910 tx=0x7f56c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631c35a4159ce05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.795+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0017f0 con 0x7f56c40b1580 2023-09-30T22:55:11.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.795+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0011420 con 0x7f56c40b1580 2023-09-30T22:55:11.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.795+0000 7f56bbfff700 1 -- 172.21.15.142:0/1071039327 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c00117c0 con 0x7f56c40b1580 2023-09-30T22:55:11.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.796+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1071039327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 msgr2=0x7f56c40adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.796+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1071039327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c40adac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009910 tx=0x7f56c00091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.796+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1071039327 shutdown_connections 2023-09-30T22:55:11.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.796+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1071039327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c40adac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.796+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1071039327 >> 172.21.15.142:0/1071039327 conn(0x7f56c40ce1f0 msgr2=0x7f56c4069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:11.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.796+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1071039327 shutdown_connections 2023-09-30T22:55:11.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.796+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1071039327 wait complete. 2023-09-30T22:55:11.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.797+0000 7f56cb9ff700 1 Processor -- start 2023-09-30T22:55:11.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.797+0000 7f56cb9ff700 1 -- start start 2023-09-30T22:55:11.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.798+0000 7f56cb9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c40ae000 0x7f56c40c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.798+0000 7f56cb9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c4159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.798+0000 7f56cb9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56c40b1950 0x7f56c415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.798+0000 7f56cb9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c416ceb0 con 0x7f56c40ae000 2023-09-30T22:55:11.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.798+0000 7f56cb9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c40ac310 con 0x7f56c40b1950 2023-09-30T22:55:11.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.798+0000 7f56cb9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c416e0f0 con 0x7f56c40b1580 2023-09-30T22:55:11.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.798+0000 7f56c979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c40ae000 0x7f56c40c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c40ae000 0x7f56c40c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42968/0 (socket says 172.21.15.142:42968) 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 -- 172.21.15.142:0/1013932904 learned_addr learned my addr 172.21.15.142:0/1013932904 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 -- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 msgr2=0x7f56c4159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c4159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 -- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56c40b1950 msgr2=0x7f56c415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56c40b1950 0x7f56c415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56c40b1950 0x7f56c415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 -- 172.21.15.142:0/1013932904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0009420 con 0x7f56c40ae000 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56c40b1950 0x7f56c415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56c979b700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c40ae000 0x7f56c40c8e20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f56c00091e0 tx=0x7f56c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:11.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56b97fa700 1 -- 172.21.15.142:0/1013932904 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c001cc90 con 0x7f56c40ae000 2023-09-30T22:55:11.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56b97fa700 1 -- 172.21.15.142:0/1013932904 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c001cdf0 con 0x7f56c40ae000 2023-09-30T22:55:11.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c416e3d0 con 0x7f56c40ae000 2023-09-30T22:55:11.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.799+0000 7f56b97fa700 1 -- 172.21.15.142:0/1013932904 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c001a6a0 con 0x7f56c40ae000 2023-09-30T22:55:11.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.800+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c416e990 con 0x7f56c40ae000 2023-09-30T22:55:11.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.802+0000 7f56b97fa700 1 -- 172.21.15.142:0/1013932904 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f56c001aad0 con 0x7f56c40ae000 2023-09-30T22:55:11.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.803+0000 7f56b97fa700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f56a8067330 0x7f56a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.803+0000 7f56b97fa700 1 -- 172.21.15.142:0/1013932904 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f56c0086af0 con 0x7f56c40ae000 2023-09-30T22:55:11.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.804+0000 7f56c8f9a700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f56a8067330 0x7f56a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.804+0000 7f56c8f9a700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f56a8067330 0x7f56a80697e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56c4155ea0 tx=0x7f56b40079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:11.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.805+0000 7f56da0a9b80 1 Processor -- start 2023-09-30T22:55:11.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.805+0000 7f56da0a9b80 1 -- start start 2023-09-30T22:55:11.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3df450 0x56117a3df820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a3e7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3e84d0 0x56117a3e8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a2b2310 con 0x56117a3df450 2023-09-30T22:55:11.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a2ef130 con 0x56117a3e84d0 2023-09-30T22:55:11.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117a2ecaf0 con 0x56117a3c4f40 2023-09-30T22:55:11.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56c979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3df450 0x56117a3df820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56c979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3df450 0x56117a3df820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42974/0 (socket says 172.21.15.142:42974) 2023-09-30T22:55:11.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56c979b700 1 -- 172.21.15.142:0/647730347 learned_addr learned my addr 172.21.15.142:0/647730347 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:11.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3e84d0 0x56117a3e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.806+0000 7f56c8f9a700 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a3e7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56c979b700 1 -- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 msgr2=0x56117a3e7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56c979b700 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a3e7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56c979b700 1 -- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3e84d0 msgr2=0x56117a3e8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56c979b700 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3e84d0 0x56117a3e8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56c979b700 1 -- 172.21.15.142:0/647730347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56117a0ee790 con 0x56117a3df450 2023-09-30T22:55:11.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56c979b700 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3df450 0x56117a3df820 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f56c00030c0 tx=0x7f56c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c00722fd290f6d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:11.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56ae7fc700 1 -- 172.21.15.142:0/647730347 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0057e10 con 0x56117a3df450 2023-09-30T22:55:11.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56ae7fc700 1 -- 172.21.15.142:0/647730347 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c00576b0 con 0x56117a3df450 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.807+0000 7f56ae7fc700 1 -- 172.21.15.142:0/647730347 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c005a900 con 0x56117a3df450 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 -- 172.21.15.142:0/647730347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3df450 msgr2=0x56117a3df820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3df450 0x56117a3df820 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f56c00030c0 tx=0x7f56c0008040 comp rx=0 tx=0).stop 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 -- 172.21.15.142:0/647730347 shutdown_connections 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3e84d0 0x56117a3e8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3df450 0x56117a3df820 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/647730347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a3e7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 -- 172.21.15.142:0/647730347 >> 172.21.15.142:0/647730347 conn(0x56117a3e2880 msgr2=0x56117a3e2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:11.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 -- 172.21.15.142:0/647730347 shutdown_connections 2023-09-30T22:55:11.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.808+0000 7f56da0a9b80 1 -- 172.21.15.142:0/647730347 wait complete. 2023-09-30T22:55:11.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.809+0000 7f56da0a9b80 1 -- start start 2023-09-30T22:55:11.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.809+0000 7f56da0a9b80 1 Processor -- start 2023-09-30T22:55:11.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.810+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3c4f40 0x56117a3b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3df450 0x56117a3e1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a399d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a2e88e0 con 0x56117a3e84d0 2023-09-30T22:55:11.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a294980 con 0x56117a3c4f40 2023-09-30T22:55:11.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117a294620 con 0x56117a3df450 2023-09-30T22:55:11.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56da0a9b80 10 client.0 _ll_register_callbacks cb 0x56117a0f7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a399d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a399d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42982/0 (socket says 172.21.15.142:42982) 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 -- 172.21.15.142:0/3832893996 learned_addr learned my addr 172.21.15.142:0/3832893996 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c8f9a700 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3df450 0x56117a3e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c979b700 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3c4f40 0x56117a3b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 -- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3df450 msgr2=0x56117a3e1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3df450 0x56117a3e1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 -- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3c4f40 msgr2=0x56117a3b8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3c4f40 0x56117a3b8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 -- 172.21.15.142:0/3832893996 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c416e990 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a399d20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f56bc007750 tx=0x7f56bc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f55908237afa38d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.811+0000 7f56a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56a37fe700 1 -- 172.21.15.142:0/3832893996 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc00f5e0 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56a37fe700 1 -- 172.21.15.142:0/3832893996 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f56bc00f740 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56117a38cd60 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56a37fe700 1 -- 172.21.15.142:0/3832893996 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56bc00fb10 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 10 client.5946 fetch_fsmap learned FSMap version 33 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x56117a1db0a0 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56a37fe700 1 -- 172.21.15.142:0/3832893996 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56117a38cd60 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56a37fe700 1 -- 172.21.15.142:0/3832893996 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f56bc012070 con 0x56117a3e84d0 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 10 client.5946 fetch_fsmap finished waiting for FSMap version 33 2023-09-30T22:55:11.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 10 client.5946 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 20 client.5946 populate_metadata read hostname 'smithi142' 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3be510 0x56117a3be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 4 client.5946 mds_command: new command op to 5802 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.812+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 --> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56117a369b30 con 0x56117a3be510 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.813+0000 7f56c979b700 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3be510 0x56117a3be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.813+0000 7f56c979b700 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3be510 0x56117a3be8e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bae8d14b2a68ef3d server_cookie=e313c50b418f513d in_seq=0 out_seq=0 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.813+0000 7f56a37fe700 10 client.5946 ms_handle_connect on v2:172.21.15.142:6835/3864514907 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56a37fe700 1 -- 172.21.15.142:0/3832893996 <== mds.0 v2:172.21.15.142:6835/3864514907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x56117a369b30 con 0x56117a3be510 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56a37fe700 10 client.5946 handle_command_reply: tid=0 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 client.5946 shutdown 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 msgr2=0x56117a399d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a399d20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f56bc007750 tx=0x7f56bc009040 comp rx=0 tx=0).stop 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 shutdown_connections 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3be510 0x56117a3be8e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a399d20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3c4f40 0x56117a3b8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56a37fe700 0 client.5946 ms_handle_reset on v2:172.21.15.142:6835/3864514907 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3832893996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3df450 0x56117a3e1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 >> 172.21.15.142:0/3832893996 conn(0x56117a3e2880 msgr2=0x56117a39b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 shutdown_connections 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3832893996 wait complete. 2023-09-30T22:55:11.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.814+0000 7f56da0a9b80 20 client.5946 trim_cache size 0 max 16384 2023-09-30T22:55:11.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.831+0000 7f56da0a9b80 1 Processor -- start 2023-09-30T22:55:11.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.831+0000 7f56da0a9b80 1 -- start start 2023-09-30T22:55:11.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.832+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3c4f40 0x56117a3e2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.832+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a3e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.832+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3e84d0 0x56117a3c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.832+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a1801e0 con 0x56117a3c4f40 2023-09-30T22:55:11.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.832+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a3b9500 con 0x56117a3df450 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.832+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117a3ba210 con 0x56117a3e84d0 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.832+0000 7f56c979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3c4f40 0x56117a3e2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3c4f40 0x56117a3e2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42988/0 (socket says 172.21.15.142:42988) 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 -- 172.21.15.142:0/3264545446 learned_addr learned my addr 172.21.15.142:0/3264545446 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c8f9a700 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a3e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3e84d0 0x56117a3c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 -- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3e84d0 msgr2=0x56117a3c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3e84d0 0x56117a3c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 -- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 msgr2=0x56117a3e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a3e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 -- 172.21.15.142:0/3264545446 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56117a2b73c0 con 0x56117a3c4f40 2023-09-30T22:55:11.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56c979b700 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3c4f40 0x56117a3e2c50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f56c0006d80 tx=0x7f56c001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525bd81e4e256f65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:11.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56aeffd700 1 -- 172.21.15.142:0/3264545446 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c005e650 con 0x56117a3c4f40 2023-09-30T22:55:11.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56aeffd700 1 -- 172.21.15.142:0/3264545446 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c005a900 con 0x56117a3c4f40 2023-09-30T22:55:11.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.833+0000 7f56aeffd700 1 -- 172.21.15.142:0/3264545446 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c001ca80 con 0x56117a3c4f40 2023-09-30T22:55:11.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3264545446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3c4f40 msgr2=0x56117a3e2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3c4f40 0x56117a3e2c50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f56c0006d80 tx=0x7f56c001f040 comp rx=0 tx=0).stop 2023-09-30T22:55:11.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3264545446 shutdown_connections 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3e84d0 0x56117a3c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3c4f40 0x56117a3e2c50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/3264545446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a3e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3264545446 >> 172.21.15.142:0/3264545446 conn(0x56117a3e2880 msgr2=0x56117a38e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3264545446 shutdown_connections 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.834+0000 7f56da0a9b80 1 -- 172.21.15.142:0/3264545446 wait complete. 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.835+0000 7f56da0a9b80 1 -- start start 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.835+0000 7f56da0a9b80 1 Processor -- start 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a43a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a443e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56da0a9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a3e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a3b2c60 con 0x56117a3e84d0 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117a43a570 con 0x56117a3df450 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56da0a9b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117a3e6450 con 0x56117a3c4f40 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56da0a9b80 10 client.0 _ll_register_callbacks cb 0x56117a0f7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a3e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a3e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42998/0 (socket says 172.21.15.142:42998) 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 -- 172.21.15.142:0/2886702243 learned_addr learned my addr 172.21.15.142:0/2886702243 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c979b700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a43a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c8f9a700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a443e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 -- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 msgr2=0x56117a43a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a43a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 -- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 msgr2=0x56117a443e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a443e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c9f9c700 1 -- 172.21.15.142:0/2886702243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56117a0ee790 con 0x56117a3e84d0 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.836+0000 7f56c979b700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a43a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56c9f9c700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a3e59f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0015a0 tx=0x7f56bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c604655b7d41eaf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56a37fe700 1 -- 172.21.15.142:0/2886702243 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc02a070 con 0x56117a3e84d0 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f56c00576b0 con 0x56117a3e84d0 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56a37fe700 1 -- 172.21.15.142:0/2886702243 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f56bc007330 con 0x56117a3e84d0 2023-09-30T22:55:11.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56a37fe700 1 -- 172.21.15.142:0/2886702243 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56bc00fb10 con 0x56117a3e84d0 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56da0a9b80 10 client.5952 fetch_fsmap learned FSMap version 33 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x56117a14f1d0 con 0x56117a3e84d0 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56a37fe700 1 -- 172.21.15.142:0/2886702243 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c00576b0 con 0x56117a3e84d0 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.837+0000 7f56a37fe700 1 -- 172.21.15.142:0/2886702243 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f56bc01c6d0 con 0x56117a3e84d0 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56da0a9b80 10 client.5952 fetch_fsmap finished waiting for FSMap version 33 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56da0a9b80 10 client.5952 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56da0a9b80 20 client.5952 populate_metadata read hostname 'smithi142' 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3e2c50 0x56117a3e3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56da0a9b80 4 client.5952 mds_command: new command op to 5802 tid=0[{"prefix": "status"}] 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 --> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56117a28b8d0 con 0x56117a3e2c50 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56c979b700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3e2c50 0x56117a3e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:11.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56a37fe700 10 client.5952 ms_handle_connect on v2:172.21.15.142:6835/3864514907 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56c979b700 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3e2c50 0x56117a3e3020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9806b8e3656d2b server_cookie=be894dabd672485a in_seq=0 out_seq=0 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56a37fe700 1 -- 172.21.15.142:0/2886702243 <== mds.0 v2:172.21.15.142:6835/3864514907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x56117a28b8d0 con 0x56117a3e2c50 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56a37fe700 10 client.5952 handle_command_reply: tid=0 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.838+0000 7f56da0a9b80 1 client.5952 shutdown 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 msgr2=0x56117a3e59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a3e59f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0015a0 tx=0x7f56bc019000 comp rx=0 tx=0).stop 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 shutdown_connections 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:6835/3864514907,v1:172.21.15.142:6837/3864514907] conn(0x56117a3e2c50 0x56117a3e3020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56117a3e84d0 0x56117a3e59f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56117a3c4f40 0x56117a43a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56a37fe700 0 client.5952 ms_handle_reset on v2:172.21.15.142:6835/3864514907 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 --2- 172.21.15.142:0/2886702243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56117a3df450 0x56117a443e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 >> 172.21.15.142:0/2886702243 conn(0x56117a3e2880 msgr2=0x56117a38e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 shutdown_connections 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 1 -- 172.21.15.142:0/2886702243 wait complete. 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56da0a9b80 20 client.5952 trim_cache size 0 max 16384 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:55:11.845 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 5802, 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 6.45660934, 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 33, 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 72, 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 72, 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 11.963545581 2023-09-30T22:55:11.846 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:55:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f56a8067330 msgr2=0x7f56a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f56a8067330 0x7f56a80697e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56c4155ea0 tx=0x7f56b40079d0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c40ae000 msgr2=0x7f56c40c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.839+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c40ae000 0x7f56c40c8e20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f56c00091e0 tx=0x7f56c0016000 comp rx=0 tx=0).stop 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 shutdown_connections 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f56a8067330 0x7f56a80697e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56c40b1950 0x7f56c415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c40ae000 0x7f56c40c8e20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 --2- 172.21.15.142:0/1013932904 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f56c40b1580 0x7f56c4159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 >> 172.21.15.142:0/1013932904 conn(0x7f56c40ce1f0 msgr2=0x7f56c415b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 shutdown_connections 2023-09-30T22:55:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:11.840+0000 7f56cb9ff700 1 -- 172.21.15.142:0/1013932904 wait complete. 2023-09-30T22:55:11.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:55:12.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.047+0000 7fcf6dfff700 1 Processor -- start 2023-09-30T22:55:12.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.047+0000 7fcf6dfff700 1 -- start start 2023-09-30T22:55:12.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.048+0000 7fcf6dfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf68159ae0 0x7fcf680cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:12.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.048+0000 7fcf6dfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf680cc590 0x7fcf68069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:12.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.048+0000 7fcf6dfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6815d910 con 0x7fcf680b1180 2023-09-30T22:55:12.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.048+0000 7fcf6dfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6815e920 con 0x7fcf680cc590 2023-09-30T22:55:12.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.048+0000 7fcf6dfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6815e490 con 0x7fcf68159ae0 2023-09-30T22:55:12.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.048+0000 7fcf67fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf680cc590 0x7fcf68069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:12.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf677fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf68159ae0 0x7fcf680cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:12.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf67fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf680cc590 0x7fcf68069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43008/0 (socket says 172.21.15.142:43008) 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf66ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcf680b1180 0x7fcf680cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:54656/0 (socket says 172.21.15.142:54656) 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf67fff700 1 -- 172.21.15.142:0/3706244601 learned_addr learned my addr 172.21.15.142:0/3706244601 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf67fff700 1 -- 172.21.15.142:0/3706244601 >> v2:172.21.15.148:3300/0 conn(0x7fcf68159ae0 msgr2=0x7fcf680cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf67fff700 1 --2- 172.21.15.142:0/3706244601 >> v2:172.21.15.148:3300/0 conn(0x7fcf68159ae0 0x7fcf680cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf67fff700 1 -- 172.21.15.142:0/3706244601 >> v1:172.21.15.148:6789/0 conn(0x7fcf680b1180 legacy=0x7fcf680cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf67fff700 1 -- 172.21.15.142:0/3706244601 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6815db60 con 0x7fcf680cc590 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf67fff700 1 --2- 172.21.15.142:0/3706244601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf680cc590 0x7fcf68069f10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cb650 tx=0x7fcf60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8117fe43180e1854 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.049+0000 7fcf667fc700 1 -- 172.21.15.142:0/3706244601 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000e070 con 0x7fcf680cc590 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf667fc700 1 -- 172.21.15.142:0/3706244601 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6000ba20 con 0x7fcf680cc590 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf667fc700 1 -- 172.21.15.142:0/3706244601 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600092e0 con 0x7fcf680cc590 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3706244601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf680cc590 msgr2=0x7fcf68069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:12.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3706244601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf680cc590 0x7fcf68069f10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cb650 tx=0x7fcf60009840 comp rx=0 tx=0).stop 2023-09-30T22:55:12.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3706244601 shutdown_connections 2023-09-30T22:55:12.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3706244601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf680cc590 0x7fcf68069f10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3706244601 >> v2:172.21.15.148:3300/0 conn(0x7fcf68159ae0 0x7fcf680cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3706244601 >> 172.21.15.142:0/3706244601 conn(0x7fcf680ce8b0 msgr2=0x7fcf680cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:12.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3706244601 shutdown_connections 2023-09-30T22:55:12.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.050+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3706244601 wait complete. 2023-09-30T22:55:12.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.052+0000 7fcf6dfff700 1 Processor -- start 2023-09-30T22:55:12.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.052+0000 7fcf6dfff700 1 -- start start 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf6dfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf680b1180 0x7fcf68147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf6dfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf680cc590 0x7fcf680b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf6dfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf68159ae0 0x7fcf680b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf6dfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6816ae90 con 0x7fcf68159ae0 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf6dfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6816a000 con 0x7fcf680b1180 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf6dfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf681478a0 con 0x7fcf680cc590 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf68159ae0 0x7fcf680b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf68159ae0 0x7fcf680b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43012/0 (socket says 172.21.15.142:43012) 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 -- 172.21.15.142:0/3827937316 learned_addr learned my addr 172.21.15.142:0/3827937316 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:12.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 -- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf680cc590 msgr2=0x7fcf680b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf680cc590 0x7fcf680b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 -- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf680b1180 msgr2=0x7fcf68147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf677fe700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf680b1180 0x7fcf68147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf680b1180 0x7fcf68147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf67fff700 1 -- 172.21.15.142:0/3827937316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60009ae0 con 0x7fcf68159ae0 2023-09-30T22:55:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.053+0000 7fcf677fe700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf680b1180 0x7fcf68147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:55:12.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.054+0000 7fcf67fff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf68159ae0 0x7fcf680b1da0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009880 tx=0x7fcf60018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:12.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.054+0000 7fcf4f7fe700 1 -- 172.21.15.142:0/3827937316 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60008be0 con 0x7fcf68159ae0 2023-09-30T22:55:12.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.054+0000 7fcf4f7fe700 1 -- 172.21.15.142:0/3827937316 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60008d40 con 0x7fcf68159ae0 2023-09-30T22:55:12.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.054+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6816a280 con 0x7fcf68159ae0 2023-09-30T22:55:12.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.054+0000 7fcf4f7fe700 1 -- 172.21.15.142:0/3827937316 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600266b0 con 0x7fcf68159ae0 2023-09-30T22:55:12.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.054+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6816a840 con 0x7fcf68159ae0 2023-09-30T22:55:12.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.055+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6816afd0 con 0x7fcf68159ae0 2023-09-30T22:55:12.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.056+0000 7fcf4f7fe700 1 -- 172.21.15.142:0/3827937316 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcf60003040 con 0x7fcf68159ae0 2023-09-30T22:55:12.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.057+0000 7fcf4f7fe700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf54067330 0x7fcf540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:12.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.057+0000 7fcf4f7fe700 1 -- 172.21.15.142:0/3827937316 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf60086c40 con 0x7fcf68159ae0 2023-09-30T22:55:12.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.057+0000 7fcf677fe700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf54067330 0x7fcf540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:12.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.058+0000 7fcf677fe700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf54067330 0x7fcf540697e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006f00 tx=0x7fcf58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:12.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.062+0000 7fcf4f7fe700 1 -- 172.21.15.142:0/3827937316 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcf6816afd0 con 0x7fcf68159ae0 2023-09-30T22:55:12.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.296+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf6816afd0 con 0x7fcf68159ae0 2023-09-30T22:55:12.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.296+0000 7fcf4f7fe700 1 -- 172.21.15.142:0/3827937316 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcf60021060 con 0x7fcf68159ae0 2023-09-30T22:55:12.296 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.298+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf54067330 msgr2=0x7fcf540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.298+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf54067330 0x7fcf540697e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006f00 tx=0x7fcf58008040 comp rx=0 tx=0).stop 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.298+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf68159ae0 msgr2=0x7fcf680b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.298+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf68159ae0 0x7fcf680b1da0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009880 tx=0x7fcf60018000 comp rx=0 tx=0).stop 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 shutdown_connections 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcf54067330 0x7fcf540697e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf68159ae0 0x7fcf680b1da0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf680b1180 0x7fcf68147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 --2- 172.21.15.142:0/3827937316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf680cc590 0x7fcf680b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:12.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 >> 172.21.15.142:0/3827937316 conn(0x7fcf680ce8b0 msgr2=0x7fcf681532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:12.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 shutdown_connections 2023-09-30T22:55:12.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:12.299+0000 7fcf6dfff700 1 -- 172.21.15.142:0/3827937316 wait complete. 2023-09-30T22:55:12.316 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:55:12.316 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:55:12.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:55:12.317 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:55:12.317 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:55:12.317 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:55:12.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:55:12.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:55:12.317 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:55:12.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:12.317 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:55:12.364 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:55:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:55:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:55:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42145sec preferred_lft 42145sec 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T22:55:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:12.368 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:55:12.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:12.369 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:55:12.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:55:12.481 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:55:12.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:12.484 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:55:12.601 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:55:12.601 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:55:12.601 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:55:12.602 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:55:12.602 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:55:12.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:12.603 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:55:12.603 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:55:12.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:55:12.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:55:12.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:55:12.603 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:55:12.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:12.772 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:55:12.818 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T22:55:12.818 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:55:12.819 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:55:12.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:12.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:55:12.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:55:12.890 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:55:12.936 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:55:12.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:55:12.936 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:55:13.021 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:55:13.021 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:55:13.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:55:13.161 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:55:13.161 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:55:13.161 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:55:13.176 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:55:13.176 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:55:13.176 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:55:13.176 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:55:13.176 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:55:13.197 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:55:13.197 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:55:13.197 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:55:13.197 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:55:13.198 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:55:13.198 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:55:13.198 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:55:13.198 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:55:13.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:55:13.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:13.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:55:13.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:55:13.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.466+0000 7fc6a1dff700 1 Processor -- start 2023-09-30T22:55:13.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.466+0000 7fc6a1dff700 1 -- start start 2023-09-30T22:55:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc6a1dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc69c0af020 0x7fc69c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc6a1dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c06e820 0x7fc69c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc6a1dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c06d3e0 con 0x7fc69c0b00d0 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc6a1dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c06dc80 con 0x7fc69c0af020 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc6a1dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c06eca0 con 0x7fc69c06e820 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc69b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc69c0af020 0x7fc69c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc69b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc69c0af020 0x7fc69c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43024/0 (socket says 172.21.15.142:43024) 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc69b7fe700 1 -- 172.21.15.142:0/4148564236 learned_addr learned my addr 172.21.15.142:0/4148564236 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.468+0000 7fc69bfff700 1 --2- 172.21.15.142:0/4148564236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c06e820 0x7fc69c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69b7fe700 1 -- 172.21.15.142:0/4148564236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c06e820 msgr2=0x7fc69c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69b7fe700 1 --2- 172.21.15.142:0/4148564236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c06e820 0x7fc69c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69b7fe700 1 -- 172.21.15.142:0/4148564236 >> v1:172.21.15.148:6789/0 conn(0x7fc69c0b00d0 legacy=0x7fc69c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69b7fe700 1 -- 172.21.15.142:0/4148564236 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c06b790 con 0x7fc69c0af020 2023-09-30T22:55:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69bfff700 1 --2- 172.21.15.142:0/4148564236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c06e820 0x7fc69c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:55:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69b7fe700 1 --2- 172.21.15.142:0/4148564236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0af020 0x7fc69c156d80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593ad92f6827785b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69a7fc700 1 -- 172.21.15.142:0/4148564236 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00b860 con 0x7fc69c0af020 2023-09-30T22:55:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69a7fc700 1 -- 172.21.15.142:0/4148564236 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c00b9c0 con 0x7fc69c0af020 2023-09-30T22:55:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.469+0000 7fc69a7fc700 1 -- 172.21.15.142:0/4148564236 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00bd60 con 0x7fc69c0af020 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 -- 172.21.15.142:0/4148564236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0af020 msgr2=0x7fc69c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/4148564236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0af020 0x7fc69c156d80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c009250 comp rx=0 tx=0).stop 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 -- 172.21.15.142:0/4148564236 shutdown_connections 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/4148564236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c06e820 0x7fc69c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/4148564236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0af020 0x7fc69c156d80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 -- 172.21.15.142:0/4148564236 >> 172.21.15.142:0/4148564236 conn(0x7fc69c0680c0 msgr2=0x7fc69c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 -- 172.21.15.142:0/4148564236 shutdown_connections 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.470+0000 7fc6a1dff700 1 -- 172.21.15.142:0/4148564236 wait complete. 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.471+0000 7fc6a1dff700 1 Processor -- start 2023-09-30T22:55:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.471+0000 7fc6a1dff700 1 -- start start 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.472+0000 7fc6a1dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc69c06e820 0x7fc69c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.472+0000 7fc6a1dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c0af020 0x7fc69c16ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.472+0000 7fc6a1dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0b00d0 0x7fc69c16be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.472+0000 7fc6a1dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c16bbf0 con 0x7fc69c0b00d0 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.472+0000 7fc6a1dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c151950 con 0x7fc69c06e820 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.472+0000 7fc6a1dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c16b630 con 0x7fc69c0af020 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0b00d0 0x7fc69c16be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0b00d0 0x7fc69c16be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43030/0 (socket says 172.21.15.142:43030) 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 -- 172.21.15.142:0/2458287436 learned_addr learned my addr 172.21.15.142:0/2458287436 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69affd700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c0af020 0x7fc69c16ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69b7fe700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc69c06e820 0x7fc69c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 -- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c0af020 msgr2=0x7fc69c16ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c0af020 0x7fc69c16ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 -- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc69c06e820 msgr2=0x7fc69c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc69c06e820 0x7fc69c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 -- 172.21.15.142:0/2458287436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0094f0 con 0x7fc69c0b00d0 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69affd700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c0af020 0x7fc69c16ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69b7fe700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc69c06e820 0x7fc69c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc69bfff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0b00d0 0x7fc69c16be20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc69400d1b0 tx=0x7fc694009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.473+0000 7fc6837fe700 1 -- 172.21.15.142:0/2458287436 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400de50 con 0x7fc69c0b00d0 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.474+0000 7fc6837fe700 1 -- 172.21.15.142:0/2458287436 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400f040 con 0x7fc69c0b00d0 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.474+0000 7fc6837fe700 1 -- 172.21.15.142:0/2458287436 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694015690 con 0x7fc69c0b00d0 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.474+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c16b910 con 0x7fc69c0b00d0 2023-09-30T22:55:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.474+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c153dc0 con 0x7fc69c0b00d0 2023-09-30T22:55:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.475+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c0aff10 con 0x7fc69c0b00d0 2023-09-30T22:55:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.475+0000 7fc6837fe700 1 -- 172.21.15.142:0/2458287436 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc69401e3b0 con 0x7fc69c0b00d0 2023-09-30T22:55:13.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.476+0000 7fc6837fe700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc688067330 0x7fc6880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:13.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.476+0000 7fc6837fe700 1 -- 172.21.15.142:0/2458287436 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc694085270 con 0x7fc69c0b00d0 2023-09-30T22:55:13.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.477+0000 7fc69b7fe700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc688067330 0x7fc6880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:13.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.477+0000 7fc69b7fe700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc688067330 0x7fc6880697e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:13.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.481+0000 7fc6837fe700 1 -- 172.21.15.142:0/2458287436 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc6940520d0 con 0x7fc69c0b00d0 2023-09-30T22:55:13.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.718+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc69c151a90 con 0x7fc69c0b00d0 2023-09-30T22:55:13.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.718+0000 7fc6837fe700 1 -- 172.21.15.142:0/2458287436 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc6940556f0 con 0x7fc69c0b00d0 2023-09-30T22:55:13.718 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.720+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc688067330 msgr2=0x7fc6880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.720+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc688067330 0x7fc6880697e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099b0 tx=0x7fc68c017000 comp rx=0 tx=0).stop 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.720+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0b00d0 msgr2=0x7fc69c16be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.720+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0b00d0 0x7fc69c16be20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc69400d1b0 tx=0x7fc694009a50 comp rx=0 tx=0).stop 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 shutdown_connections 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc688067330 0x7fc6880697e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69c0b00d0 0x7fc69c16be20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc69c06e820 0x7fc69c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 --2- 172.21.15.142:0/2458287436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc69c0af020 0x7fc69c16ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 >> 172.21.15.142:0/2458287436 conn(0x7fc69c0680c0 msgr2=0x7fc69c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 shutdown_connections 2023-09-30T22:55:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:13.721+0000 7fc6a1dff700 1 -- 172.21.15.142:0/2458287436 wait complete. 2023-09-30T22:55:13.738 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:55:13.738 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:55:13.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:55:13.738 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:55:13.738 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:55:13.738 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:55:13.738 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:55:13.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:55:13.739 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:55:13.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:13.739 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:55:13.792 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42175sec preferred_lft 42175sec 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:55:13.793 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:55:13.794 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:55:13.795 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T22:55:13.795 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:55:13.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:13.795 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:55:13.865 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:55:13.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:13.868 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:55:13.918 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:55:13.918 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:55:13.918 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:55:13.918 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:55:13.918 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:55:13.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:13.919 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:55:13.919 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:55:13.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:55:13.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:55:13.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:55:13.919 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:55:14.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:14.089 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:55:14.136 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T22:55:14.136 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:55:14.136 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:55:14.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:14.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:55:14.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:55:14.247 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:55:14.293 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:55:14.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:55:14.294 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:55:14.379 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:55:14.379 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:55:14.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:55:14.519 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:55:14.519 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:55:14.520 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:55:14.534 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:55:14.534 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:55:14.534 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:55:14.534 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:55:14.534 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:55:14.553 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:55:14.554 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:55:14.554 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:55:14.554 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:55:14.554 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:55:14.554 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:55:14.554 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:55:14.554 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:55:14.558 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:55:14.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:55:14.558 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:55:14.628 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:55:14.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.824+0000 7f53995ff700 1 Processor -- start 2023-09-30T22:55:14.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.825+0000 7f53995ff700 1 -- start start 2023-09-30T22:55:14.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53995ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 0x7f539415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:14.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53995ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f539406b3d0 0x7f53940b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:14.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53995ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53940b1f40 0x7f5394069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:14.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53995ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940b23e0 con 0x7f53940b1f40 2023-09-30T22:55:14.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53995ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539406d470 con 0x7f539406b3d0 2023-09-30T22:55:14.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53995ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5394157e60 con 0x7f5394157a90 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53937fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53940b1f40 0x7f5394069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53937fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53940b1f40 0x7f5394069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43040/0 (socket says 172.21.15.142:43040) 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53937fe700 1 -- 172.21.15.142:0/1018635989 learned_addr learned my addr 172.21.15.142:0/1018635989 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f53927fc700 1 --2- 172.21.15.142:0/1018635989 >> v2:172.21.15.148:3300/0 conn(0x7f539406b3d0 0x7f53940b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.826+0000 7f5392ffd700 1 --2- 172.21.15.142:0/1018635989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 0x7f539415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f53937fe700 1 -- 172.21.15.142:0/1018635989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 msgr2=0x7f539415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f53937fe700 1 --2- 172.21.15.142:0/1018635989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 0x7f539415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f53937fe700 1 -- 172.21.15.142:0/1018635989 >> v2:172.21.15.148:3300/0 conn(0x7f539406b3d0 msgr2=0x7f53940b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f53937fe700 1 --2- 172.21.15.142:0/1018635989 >> v2:172.21.15.148:3300/0 conn(0x7f539406b3d0 0x7f53940b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f53937fe700 1 -- 172.21.15.142:0/1018635989 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539415c430 con 0x7f53940b1f40 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f53937fe700 1 --2- 172.21.15.142:0/1018635989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394069f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f53940684e0 tx=0x7f538c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31beb5cd78296c3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:14.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f5391ffb700 1 -- 172.21.15.142:0/1018635989 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c00e070 con 0x7f53940b1f40 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f5391ffb700 1 -- 172.21.15.142:0/1018635989 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c00b970 con 0x7f53940b1f40 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.827+0000 7f5391ffb700 1 -- 172.21.15.142:0/1018635989 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0092e0 con 0x7f53940b1f40 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 -- 172.21.15.142:0/1018635989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 msgr2=0x7f5394069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 --2- 172.21.15.142:0/1018635989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394069f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f53940684e0 tx=0x7f538c009840 comp rx=0 tx=0).stop 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 -- 172.21.15.142:0/1018635989 shutdown_connections 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 --2- 172.21.15.142:0/1018635989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394069f10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 --2- 172.21.15.142:0/1018635989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 0x7f539415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 --2- 172.21.15.142:0/1018635989 >> v2:172.21.15.148:3300/0 conn(0x7f539406b3d0 0x7f53940b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 -- 172.21.15.142:0/1018635989 >> 172.21.15.142:0/1018635989 conn(0x7f53940680c0 msgr2=0x7f53940c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 -- 172.21.15.142:0/1018635989 shutdown_connections 2023-09-30T22:55:14.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.828+0000 7f53995ff700 1 -- 172.21.15.142:0/1018635989 wait complete. 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.829+0000 7f53995ff700 1 Processor -- start 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.829+0000 7f53995ff700 1 -- start start 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.830+0000 7f53995ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539406b3d0 0x7f539415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.830+0000 7f53995ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.830+0000 7f53995ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 0x7f539416b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.830+0000 7f53995ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539416a530 con 0x7f53940b1f40 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.830+0000 7f53995ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539416b5d0 con 0x7f539406b3d0 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.830+0000 7f53995ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539415cff0 con 0x7f5394157a90 2023-09-30T22:55:14.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394169ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43056/0 (socket says 172.21.15.142:43056) 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 -- 172.21.15.142:0/2435610226 learned_addr learned my addr 172.21.15.142:0/2435610226 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 -- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 msgr2=0x7f539416b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 0x7f539416b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f5392ffd700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539406b3d0 0x7f539415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 -- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539406b3d0 msgr2=0x7f539415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539406b3d0 0x7f539415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 -- 172.21.15.142:0/2435610226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009ae0 con 0x7f53940b1f40 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f5392ffd700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539406b3d0 0x7f539415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53927fc700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394169ff0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f538800e900 tx=0x7f53880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f537affd700 1 -- 172.21.15.142:0/2435610226 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800eea0 con 0x7f53940b1f40 2023-09-30T22:55:14.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f537affd700 1 -- 172.21.15.142:0/2435610226 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800c850 con 0x7f53940b1f40 2023-09-30T22:55:14.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f537affd700 1 -- 172.21.15.142:0/2435610226 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800cc10 con 0x7f53940b1f40 2023-09-30T22:55:14.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.831+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539415f6e0 con 0x7f53940b1f40 2023-09-30T22:55:14.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.832+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539415c9a0 con 0x7f53940b1f40 2023-09-30T22:55:14.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.832+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539415d160 con 0x7f53940b1f40 2023-09-30T22:55:14.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.834+0000 7f537affd700 1 -- 172.21.15.142:0/2435610226 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5388013470 con 0x7f53940b1f40 2023-09-30T22:55:14.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.835+0000 7f537affd700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5380067330 0x7f53800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:55:14.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.835+0000 7f537affd700 1 -- 172.21.15.142:0/2435610226 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5388084db0 con 0x7f53940b1f40 2023-09-30T22:55:14.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.835+0000 7f5392ffd700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5380067330 0x7f53800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:55:14.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.835+0000 7f5392ffd700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5380067330 0x7f53800697e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5384006f00 tx=0x7f5384008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:55:14.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:14.839+0000 7f537affd700 1 -- 172.21.15.142:0/2435610226 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5388089070 con 0x7f53940b1f40 2023-09-30T22:55:15.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.072+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53940aec20 con 0x7f53940b1f40 2023-09-30T22:55:15.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.073+0000 7f537affd700 1 -- 172.21.15.142:0/2435610226 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f5388051c10 con 0x7f53940b1f40 2023-09-30T22:55:15.073 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:55:15.073 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:55:04.855906+0000","modified":"2023-09-30T22:55:08.414251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3864514907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3864514907},{"type":"v1","addr":"172.21.15.142:6837","nonce":3864514907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-09-30T22:55:15.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5380067330 msgr2=0x7f53800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5380067330 0x7f53800697e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5384006f00 tx=0x7f5384008040 comp rx=0 tx=0).stop 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 msgr2=0x7f5394169ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394169ff0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f538800e900 tx=0x7f53880091a0 comp rx=0 tx=0).stop 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 shutdown_connections 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5380067330 0x7f53800697e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5394157a90 0x7f539416b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539406b3d0 0x7f539415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 --2- 172.21.15.142:0/2435610226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53940b1f40 0x7f5394169ff0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 >> 172.21.15.142:0/2435610226 conn(0x7f53940680c0 msgr2=0x7f53940c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 shutdown_connections 2023-09-30T22:55:15.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:55:15.075+0000 7f53995ff700 1 -- 172.21.15.142:0/2435610226 wait complete. 2023-09-30T22:55:15.077 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2023-09-30T22:55:15.094 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:55:15.303 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":5802,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.9076629090000008,"mdsmap_epoch":33,"osdmap_epoch":72,"osdmap_epoch_barrier":72,"uptime":15.414603195} 2023-09-30T22:55:15.304 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 5802, "mdsmap_epoch": 33, "osdmap_epoch": 72, "osdmap_epoch_barrier": 72, "rank_uptime": 9.907662909, "state": "up:active", "uptime": 15.414603195, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:55:15.304 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T22:55:15.515 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T22:55:15.515 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T22:55:15.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-30T22:55:15.716 INFO:teuthology.orchestra.run.smithi142.stdout:{"mon_tick_interval":"5"} 2023-09-30T22:55:15.716 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-30T22:55:15.717 INFO:tasks.cephfs.test_full:pool capacity 556987968, 531MB should be enough to fill it 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> import time 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> import datetime 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> # Write some buffered data through before going full, all should be well 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> print("writing some data through which we expect to succeed") 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> bytes = 0 2023-09-30T22:55:15.717 DEBUG:teuthology.orchestra.run.smithi142:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> # buffered IO, the error should always only appear from fsync and not 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> # from write 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> full = False 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.718 DEBUG:teuthology.orchestra.run.smithi142:> for n in range(0, int(531 * 0.9)): 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> print("done writing {0} bytes".format(bytes)) 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> # OK, now we should sneak in under the full condition 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> # due to the time it takes the OSDs to report to the 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> # mons, and get a successful fsync on our full-making data 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> # buffered write, add more dirty data to the buffer 2023-09-30T22:55:15.719 DEBUG:teuthology.orchestra.run.smithi142:> print("starting buffered write") 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> for n in range(0, int(531 * 0.2)): 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> time.sleep(15.0) 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> except OSError: 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> pass; 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> # Wait long enough for a background flush that should fail 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> time.sleep(30) 2023-09-30T22:55:15.720 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> if False: 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> # ...and check that the failed background flush is reflected in fclose 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> os.close(f) 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> except OSError: 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> print("close() returned an error as expected") 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("close() failed to raise error") 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> # The kernel cephfs client does not raise errors on fclose 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> os.close(f) 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:55:15.721 DEBUG:teuthology.orchestra.run.smithi142:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-30T22:55:15.722 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:55:20.074 INFO:teuthology.orchestra.run.smithi142.stdout:writing some data through which we expect to succeed 2023-09-30T22:55:20.074 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-30T22:55:20.074 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-09-30T22:55:20.074 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-09-30T22:55:20.074 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-09-30T22:55:20.074 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-09-30T22:55:20.074 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-09-30T22:55:20.075 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-09-30T22:55:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-09-30T22:55:20.077 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-09-30T22:55:20.078 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-09-30T22:55:20.079 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-09-30T22:55:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-09-30T22:55:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-09-30T22:55:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-09-30T22:55:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-09-30T22:55:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-09-30T22:55:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-09-30T22:55:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-09-30T22:55:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-09-30T22:55:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-09-30T22:55:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-09-30T22:55:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-09-30T22:55:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-09-30T22:55:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-09-30T22:55:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-09-30T22:55:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-09-30T22:55:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-09-30T22:55:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-09-30T22:55:20.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-09-30T22:55:20.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-09-30T22:55:20.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-09-30T22:55:20.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-09-30T22:55:20.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-09-30T22:55:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-09-30T22:55:20.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-09-30T22:55:20.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-09-30T22:55:20.252 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-09-30T22:55:20.253 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-09-30T22:55:20.254 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-09-30T22:55:20.255 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-09-30T22:55:20.256 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-09-30T22:55:20.257 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-09-30T22:55:20.257 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-09-30T22:55:20.257 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-09-30T22:55:20.257 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-09-30T22:55:20.257 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-09-30T22:55:20.257 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-09-30T22:55:20.412 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-09-30T22:55:20.413 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-09-30T22:55:20.413 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-09-30T22:55:20.413 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-09-30T22:55:20.413 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-09-30T22:55:20.414 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-09-30T22:55:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-09-30T22:55:20.416 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-09-30T22:55:20.417 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-09-30T22:55:20.418 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-09-30T22:55:20.419 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-09-30T22:55:20.420 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-09-30T22:55:20.421 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-09-30T22:55:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-09-30T22:55:20.423 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-09-30T22:55:20.424 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-09-30T22:55:20.425 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-09-30T22:55:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-09-30T22:55:20.427 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-09-30T22:55:20.428 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-09-30T22:55:20.429 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-09-30T22:55:25.476 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:55:25.476+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-09-30T22:55:34.274 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:55:34.274+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-09-30T22:55:42.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:55:42.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:12.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:12.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-09-30T22:56:22.084 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:done writing 500695040 bytes 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:successfully fsync'ed prior to getting full state reported 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:starting buffered write 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T22:56:22.085 INFO:teuthology.orchestra.run.smithi142.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-09-30T22:56:22.118 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:56:22.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:56:22.217 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:56:22.322 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:56:22.322 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:56:22.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:56:22.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:56:22.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:56:22.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:22.409 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:56:22.471 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:56:22.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:56:22.472 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T22:56:22.594 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:56:22.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:22.594 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:56:22.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:22.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.830+0000 7f370a9ff700 1 Processor -- start 2023-09-30T22:56:22.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.830+0000 7f370a9ff700 1 -- start start 2023-09-30T22:56:22.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.832+0000 7f370a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f370406deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:22.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.832+0000 7f370a9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37040c7e40 0x7f3704069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.832+0000 7f370a9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37040c8390 con 0x7f370415a000 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.832+0000 7f370a9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37040c8670 con 0x7f37040c7e40 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.832+0000 7f370a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370406b8b0 con 0x7f3704159c30 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.832+0000 7f3708f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37040c7e40 0x7f3704069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3708f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37040c7e40 0x7f3704069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51512/0 (socket says 172.21.15.142:51512) 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3708f9c700 1 -- 172.21.15.142:0/3490922140 learned_addr learned my addr 172.21.15.142:0/3490922140 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3703fff700 1 --2- 172.21.15.142:0/3490922140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f370406deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:22.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f37037fe700 1 --1- 172.21.15.142:0/3490922140 >> v1:172.21.15.148:6789/0 conn(0x7f370415a000 0x7f370406b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:51106/0 (socket says 172.21.15.142:51106) 2023-09-30T22:56:22.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3708f9c700 1 -- 172.21.15.142:0/3490922140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 msgr2=0x7f370406deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3708f9c700 1 --2- 172.21.15.142:0/3490922140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f370406deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3708f9c700 1 -- 172.21.15.142:0/3490922140 >> v1:172.21.15.148:6789/0 conn(0x7f370415a000 legacy=0x7f370406b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3708f9c700 1 -- 172.21.15.142:0/3490922140 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370406d3d0 con 0x7f37040c7e40 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3708f9c700 1 --2- 172.21.15.142:0/3490922140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c7e40 0x7f3704069f10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009f50 tx=0x7f36fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404345517fec0693 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3702ffd700 1 -- 172.21.15.142:0/3490922140 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00e070 con 0x7f37040c7e40 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3702ffd700 1 -- 172.21.15.142:0/3490922140 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc00b9c0 con 0x7f37040c7e40 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.833+0000 7f3702ffd700 1 -- 172.21.15.142:0/3490922140 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0092e0 con 0x7f37040c7e40 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 -- 172.21.15.142:0/3490922140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c7e40 msgr2=0x7f3704069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 --2- 172.21.15.142:0/3490922140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c7e40 0x7f3704069f10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009f50 tx=0x7f36fc009840 comp rx=0 tx=0).stop 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 -- 172.21.15.142:0/3490922140 shutdown_connections 2023-09-30T22:56:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 --2- 172.21.15.142:0/3490922140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c7e40 0x7f3704069f10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 --2- 172.21.15.142:0/3490922140 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f370406deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 -- 172.21.15.142:0/3490922140 >> 172.21.15.142:0/3490922140 conn(0x7f37040d0aa0 msgr2=0x7f37040d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 -- 172.21.15.142:0/3490922140 shutdown_connections 2023-09-30T22:56:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.834+0000 7f370a9ff700 1 -- 172.21.15.142:0/3490922140 wait complete. 2023-09-30T22:56:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.836+0000 7f370a9ff700 1 Processor -- start 2023-09-30T22:56:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.836+0000 7f370a9ff700 1 -- start start 2023-09-30T22:56:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f370a9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37040c7e40 0x7f370413fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f370a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f3704155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f370a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370415a000 0x7f3704155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f370a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370416e570 con 0x7f370415a000 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f370a9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370416d960 con 0x7f37040c7e40 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f370a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370416dc40 con 0x7f3704159c30 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370415a000 0x7f3704155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370415a000 0x7f3704155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51514/0 (socket says 172.21.15.142:51514) 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 -- 172.21.15.142:0/183951149 learned_addr learned my addr 172.21.15.142:0/183951149 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3703fff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37040c7e40 0x7f370413fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 -- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 msgr2=0x7f3704155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f37037fe700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f3704155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f3704155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 -- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37040c7e40 msgr2=0x7f370413fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37040c7e40 0x7f370413fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3708f9c700 1 -- 172.21.15.142:0/183951149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009ae0 con 0x7f370415a000 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f3703fff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37040c7e40 0x7f370413fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.837+0000 7f37037fe700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f3704155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.838+0000 7f3708f9c700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370415a000 0x7f3704155880 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009880 tx=0x7f36fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.838+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc008d00 con 0x7f370415a000 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.838+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc008e60 con 0x7f370415a000 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.838+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370416df20 con 0x7f370415a000 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.838+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc025690 con 0x7f370415a000 2023-09-30T22:56:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.838+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37041400e0 con 0x7f370415a000 2023-09-30T22:56:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.839+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370416e720 con 0x7f370415a000 2023-09-30T22:56:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.840+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f36fc003040 con 0x7f370415a000 2023-09-30T22:56:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.841+0000 7f36ebfff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f36f0067330 0x7f36f00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.841+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f36fc086920 con 0x7f370415a000 2023-09-30T22:56:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.841+0000 7f3703fff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f36f0067330 0x7f36f00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.841+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f36f006f7d0 con 0x7f370415a000 2023-09-30T22:56:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.842+0000 7f3703fff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f36f0067330 0x7f36f00697e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006f00 tx=0x7f36f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:22.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:22.845+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f370416e720 con 0x7f370415a000 2023-09-30T22:56:23.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.078+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f370416e6b0 con 0x7f370415a000 2023-09-30T22:56:23.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.079+0000 7f36ebfff700 1 -- 172.21.15.142:0/183951149 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f36fc020070 con 0x7f370415a000 2023-09-30T22:56:23.079 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:23.079 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:55:04.855906+0000","modified":"2023-09-30T22:55:08.414251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3864514907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3864514907},{"type":"v1","addr":"172.21.15.142:6837","nonce":3864514907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-09-30T22:56:23.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f36f0067330 msgr2=0x7f36f00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f36f0067330 0x7f36f00697e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006f00 tx=0x7f36f4008040 comp rx=0 tx=0).stop 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370415a000 msgr2=0x7f3704155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370415a000 0x7f3704155880 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009880 tx=0x7f36fc018000 comp rx=0 tx=0).stop 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 shutdown_connections 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f36f0067330 0x7f36f00697e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f370415a000 0x7f3704155880 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37040c7e40 0x7f370413fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 --2- 172.21.15.142:0/183951149 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3704159c30 0x7f3704155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 >> 172.21.15.142:0/183951149 conn(0x7f37040d0aa0 msgr2=0x7f370414f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:23.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 shutdown_connections 2023-09-30T22:56:23.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.081+0000 7f370a9ff700 1 -- 172.21.15.142:0/183951149 wait complete. 2023-09-30T22:56:23.083 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2023-09-30T22:56:23.101 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:56:23.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.291+0000 7fe4a71ff700 1 Processor -- start 2023-09-30T22:56:23.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.291+0000 7fe4a71ff700 1 -- start start 2023-09-30T22:56:23.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.292+0000 7fe4a71ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4a00af020 0x7fe4a0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.292+0000 7fe4a71ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a006d3e0 con 0x7fe4a00b00d0 2023-09-30T22:56:23.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.292+0000 7fe4a71ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a006dc80 con 0x7fe4a006e820 2023-09-30T22:56:23.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.292+0000 7fe4a71ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a006eca0 con 0x7fe4a00af020 2023-09-30T22:56:23.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.292+0000 7fe4a4f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4a00af020 0x7fe4a0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.292+0000 7fe49ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe4a00b00d0 0x7fe4a006e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40476/0 (socket says 172.21.15.142:40476) 2023-09-30T22:56:23.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.292+0000 7fe49ffff700 1 -- 172.21.15.142:0/3324949129 learned_addr learned my addr 172.21.15.142:0/3324949129 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:23.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe49f7fe700 1 -- 172.21.15.142:0/3324949129 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251156621 0 0) 0x7fe4a006d3e0 con 0x7fe4a00b00d0 2023-09-30T22:56:23.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe4a4f9b700 1 -- 172.21.15.142:0/3324949129 >> v1:172.21.15.148:6789/0 conn(0x7fe4a006e820 legacy=0x7fe4a015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe4a4f9b700 1 -- 172.21.15.142:0/3324949129 >> v1:172.21.15.142:6789/0 conn(0x7fe4a00b00d0 legacy=0x7fe4a006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe4a4f9b700 1 -- 172.21.15.142:0/3324949129 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a006b790 con 0x7fe4a00af020 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe4a4f9b700 1 --2- 172.21.15.142:0/3324949129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a0156d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe494009910 tx=0x7fe4940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b5772f04744516 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe49f7fe700 1 -- 172.21.15.142:0/3324949129 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400b820 con 0x7fe4a00af020 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe49f7fe700 1 -- 172.21.15.142:0/3324949129 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400b980 con 0x7fe4a00af020 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.293+0000 7fe49f7fe700 1 -- 172.21.15.142:0/3324949129 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400bd20 con 0x7fe4a00af020 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.294+0000 7fe4a71ff700 1 -- 172.21.15.142:0/3324949129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 msgr2=0x7fe4a0156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.294+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/3324949129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a0156d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe494009910 tx=0x7fe4940091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.294+0000 7fe4a71ff700 1 -- 172.21.15.142:0/3324949129 shutdown_connections 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.294+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/3324949129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a0156d80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.294+0000 7fe4a71ff700 1 -- 172.21.15.142:0/3324949129 >> 172.21.15.142:0/3324949129 conn(0x7fe4a00680c0 msgr2=0x7fe4a00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.294+0000 7fe4a71ff700 1 -- 172.21.15.142:0/3324949129 shutdown_connections 2023-09-30T22:56:23.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.294+0000 7fe4a71ff700 1 -- 172.21.15.142:0/3324949129 wait complete. 2023-09-30T22:56:23.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.296+0000 7fe4a71ff700 1 Processor -- start 2023-09-30T22:56:23.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.296+0000 7fe4a71ff700 1 -- start start 2023-09-30T22:56:23.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.297+0000 7fe4a71ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4a006e820 0x7fe4a016a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.297+0000 7fe4a71ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.297+0000 7fe4a71ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4a00b00d0 0x7fe4a00c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.297+0000 7fe4a71ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00c6860 con 0x7fe4a00af020 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.297+0000 7fe4a71ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00c34f0 con 0x7fe4a006e820 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe4a71ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00c5f30 con 0x7fe4a00b00d0 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a014ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51538/0 (socket says 172.21.15.142:51538) 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 -- 172.21.15.142:0/1311903876 learned_addr learned my addr 172.21.15.142:0/1311903876 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe4a4f9b700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4a006e820 0x7fe4a016a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe4a579c700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4a00b00d0 0x7fe4a00c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 -- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4a00b00d0 msgr2=0x7fe4a00c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4a00b00d0 0x7fe4a00c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 -- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4a006e820 msgr2=0x7fe4a016a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4a006e820 0x7fe4a016a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 -- 172.21.15.142:0/1311903876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494009420 con 0x7fe4a00af020 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.298+0000 7fe49ffff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a014ab20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00c560 tx=0x7fe48c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.299+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c005b30 con 0x7fe4a00af020 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.299+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c005c90 con 0x7fe4a00af020 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.299+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c007320 con 0x7fe4a00af020 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.299+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a00c6210 con 0x7fe4a00af020 2023-09-30T22:56:23.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.299+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a00c1d40 con 0x7fe4a00af020 2023-09-30T22:56:23.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.300+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a00c69d0 con 0x7fe4a00af020 2023-09-30T22:56:23.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.301+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe48c01b3b0 con 0x7fe4a00af020 2023-09-30T22:56:23.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.301+0000 7fe49cff9700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe484067330 0x7fe4840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.302+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fe48c084060 con 0x7fe4a00af020 2023-09-30T22:56:23.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.302+0000 7fe4a4f9b700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe484067330 0x7fe4840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.302+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7fe48406f7d0 con 0x7fe4a00af020 2023-09-30T22:56:23.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.302+0000 7fe4a4f9b700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe484067330 0x7fe4840697e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe4940093f0 tx=0x7fe494017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:23.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.306+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe48c017060 con 0x7fe4a00af020 2023-09-30T22:56:23.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.497+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4a006fc10 con 0x7fe4a00af020 2023-09-30T22:56:23.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.498+0000 7fe49cff9700 1 -- 172.21.15.142:0/1311903876 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+17399 (secure 0 0 0) 0x7fe48c050df0 con 0x7fe4a00af020 2023-09-30T22:56:23.499 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":77,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:55:27.492373+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:55:02.993656+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-09-30T22:55:03.839904+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.19","mappings":[{"from":2,"to":7}]},{"pgid":"10.1d","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.33","mappings":[{"from":2,"to":5}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3c","mappings":[{"from":2,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:56:23.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe484067330 msgr2=0x7fe4840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe484067330 0x7fe4840697e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe4940093f0 tx=0x7fe494017000 comp rx=0 tx=0).stop 2023-09-30T22:56:23.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 msgr2=0x7fe4a014ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a014ab20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00c560 tx=0x7fe48c000fe0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 shutdown_connections 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe484067330 0x7fe4840697e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4a00b00d0 0x7fe4a00c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4a006e820 0x7fe4a016a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 --2- 172.21.15.142:0/1311903876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a00af020 0x7fe4a014ab20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 >> 172.21.15.142:0/1311903876 conn(0x7fe4a00680c0 msgr2=0x7fe4a00cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 shutdown_connections 2023-09-30T22:56:23.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.501+0000 7fe4a71ff700 1 -- 172.21.15.142:0/1311903876 wait complete. 2023-09-30T22:56:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:55:02.993656+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:55:03.839904+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:56:23.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:56:23.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.710+0000 7f21a79ff700 1 Processor -- start 2023-09-30T22:56:23.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.710+0000 7f21a79ff700 1 -- start start 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a79ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21a00c52a0 0x7f21a00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a79ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f21a00cb350 0x7f21a01605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a79ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a00c7690 con 0x7f21a0069f10 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a79ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a01406a0 con 0x7f21a00c52a0 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a79ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a00c3a50 con 0x7f21a00cb350 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a579b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21a00c52a0 0x7f21a00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a4f9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f21a0069f10 0x7f21a00c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40486/0 (socket says 172.21.15.142:40486) 2023-09-30T22:56:23.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a4f9a700 1 -- 172.21.15.142:0/163781288 learned_addr learned my addr 172.21.15.142:0/163781288 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:23.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a5f9c700 1 --2- 172.21.15.142:0/163781288 >> v2:172.21.15.148:3300/0 conn(0x7f21a00cb350 0x7f21a01605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a579b700 1 -- 172.21.15.142:0/163781288 >> v2:172.21.15.148:3300/0 conn(0x7f21a00cb350 msgr2=0x7f21a01605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:23.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a579b700 1 --2- 172.21.15.142:0/163781288 >> v2:172.21.15.148:3300/0 conn(0x7f21a00cb350 0x7f21a01605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f21a579b700 1 -- 172.21.15.142:0/163781288 >> v1:172.21.15.142:6789/0 conn(0x7f21a0069f10 legacy=0x7f21a00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f21a579b700 1 -- 172.21.15.142:0/163781288 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00c7f20 con 0x7f21a00c52a0 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f21a5f9c700 1 --2- 172.21.15.142:0/163781288 >> v2:172.21.15.148:3300/0 conn(0x7f21a00cb350 0x7f21a01605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.712+0000 7f2197fff700 1 -- 172.21.15.142:0/163781288 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277908584 0 0) 0x7f2190001110 con 0x7f21a0069f10 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f21a579b700 1 --2- 172.21.15.142:0/163781288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a00c88d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f21a00c0120 tx=0x7f219c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882af9bfda3b8712 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f2197fff700 1 -- 172.21.15.142:0/163781288 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c009e80 con 0x7f21a00c52a0 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f2197fff700 1 -- 172.21.15.142:0/163781288 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00b820 con 0x7f21a00c52a0 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f2197fff700 1 -- 172.21.15.142:0/163781288 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00bba0 con 0x7f21a00c52a0 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f21a79ff700 1 -- 172.21.15.142:0/163781288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 msgr2=0x7f21a00c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.713+0000 7f21a79ff700 1 --2- 172.21.15.142:0/163781288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a00c88d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f21a00c0120 tx=0x7f219c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.714+0000 7f21a79ff700 1 -- 172.21.15.142:0/163781288 shutdown_connections 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.714+0000 7f21a79ff700 1 --2- 172.21.15.142:0/163781288 >> v2:172.21.15.148:3300/0 conn(0x7f21a00cb350 0x7f21a01605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.714+0000 7f21a79ff700 1 --2- 172.21.15.142:0/163781288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a00c88d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.714+0000 7f21a79ff700 1 -- 172.21.15.142:0/163781288 >> 172.21.15.142:0/163781288 conn(0x7f21a00cc670 msgr2=0x7f21a00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:23.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.714+0000 7f21a79ff700 1 -- 172.21.15.142:0/163781288 shutdown_connections 2023-09-30T22:56:23.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.714+0000 7f21a79ff700 1 -- 172.21.15.142:0/163781288 wait complete. 2023-09-30T22:56:23.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.715+0000 7f21a79ff700 1 Processor -- start 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.715+0000 7f21a79ff700 1 -- start start 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a79ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a0069f10 0x7f21a0168360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a79ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a016bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a79ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00cb350 0x7f21a016e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a79ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a013fbf0 con 0x7f21a00c52a0 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a79ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0136b10 con 0x7f21a0069f10 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a79ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a01361e0 con 0x7f21a00cb350 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a4f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a016bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a4f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a016bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51550/0 (socket says 172.21.15.142:51550) 2023-09-30T22:56:23.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.716+0000 7f21a4f9a700 1 -- 172.21.15.142:0/762626420 learned_addr learned my addr 172.21.15.142:0/762626420 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a4f9a700 1 -- 172.21.15.142:0/762626420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00cb350 msgr2=0x7f21a016e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a4f9a700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00cb350 0x7f21a016e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a4f9a700 1 -- 172.21.15.142:0/762626420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a0069f10 msgr2=0x7f21a0168360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a4f9a700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a0069f10 0x7f21a0168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a4f9a700 1 -- 172.21.15.142:0/762626420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c009420 con 0x7f21a00c52a0 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a4f9a700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a016bf70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f219000c810 tx=0x7f2190007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190005b30 con 0x7f21a00c52a0 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2190005c90 con 0x7f21a00c52a0 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a01364c0 con 0x7f21a00c52a0 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190007300 con 0x7f21a00c52a0 2023-09-30T22:56:23.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.717+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a016c4b0 con 0x7f21a00c52a0 2023-09-30T22:56:23.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.718+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a00cc450 con 0x7f21a00c52a0 2023-09-30T22:56:23.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.719+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f219001b400 con 0x7f21a00c52a0 2023-09-30T22:56:23.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.720+0000 7f21957fa700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2184067330 0x7f21840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:23.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.720+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f21900845f0 con 0x7f21a00c52a0 2023-09-30T22:56:23.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.720+0000 7f21a579b700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2184067330 0x7f21840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:23.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.720+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f218406f7d0 con 0x7f21a00c52a0 2023-09-30T22:56:23.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.721+0000 7f21a579b700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2184067330 0x7f21840697e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f219c0091e0 tx=0x7f219c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:23.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.724+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2190051530 con 0x7f21a00c52a0 2023-09-30T22:56:23.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.914+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21a00c7690 con 0x7f21a00c52a0 2023-09-30T22:56:23.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.915+0000 7f21957fa700 1 -- 172.21.15.142:0/762626420 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21a00c7690 con 0x7f21a00c52a0 2023-09-30T22:56:23.915 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:56:23.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2184067330 msgr2=0x7f21840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2184067330 0x7f21840697e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f219c0091e0 tx=0x7f219c017000 comp rx=0 tx=0).stop 2023-09-30T22:56:23.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 msgr2=0x7f21a016bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:23.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a016bf70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f219000c810 tx=0x7f2190007c30 comp rx=0 tx=0).stop 2023-09-30T22:56:23.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 shutdown_connections 2023-09-30T22:56:23.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2184067330 0x7f21840697e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00cb350 0x7f21a016e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a0069f10 0x7f21a0168360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 --2- 172.21.15.142:0/762626420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00c52a0 0x7f21a016bf70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:23.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 >> 172.21.15.142:0/762626420 conn(0x7f21a00cc670 msgr2=0x7f21a00bf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:23.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 shutdown_connections 2023-09-30T22:56:23.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:23.917+0000 7f21a79ff700 1 -- 172.21.15.142:0/762626420 wait complete. 2023-09-30T22:56:23.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:56:24.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.126+0000 7f34c35ff700 1 Processor -- start 2023-09-30T22:56:24.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.126+0000 7f34c35ff700 1 -- start start 2023-09-30T22:56:24.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.127+0000 7f34c35ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc150600 0x7f34bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.127+0000 7f34c35ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34bc1509d0 0x7f34bc06ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.127+0000 7f34c35ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc1576e0 con 0x7f34bc15a920 2023-09-30T22:56:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.127+0000 7f34c35ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc0cc320 con 0x7f34bc1509d0 2023-09-30T22:56:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.127+0000 7f34c35ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc15a490 con 0x7f34bc150600 2023-09-30T22:56:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34bc1509d0 0x7f34bc06ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34bc1509d0 0x7f34bc06ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51558/0 (socket says 172.21.15.142:51558) 2023-09-30T22:56:24.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 -- 172.21.15.142:0/3726372640 learned_addr learned my addr 172.21.15.142:0/3726372640 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c139b700 1 --2- 172.21.15.142:0/3726372640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc150600 0x7f34bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 -- 172.21.15.142:0/3726372640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc150600 msgr2=0x7f34bc06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 --2- 172.21.15.142:0/3726372640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc150600 0x7f34bc06a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 -- 172.21.15.142:0/3726372640 >> v1:172.21.15.148:6789/0 conn(0x7f34bc15a920 legacy=0x7f34bc156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 -- 172.21.15.142:0/3726372640 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc157400 con 0x7f34bc1509d0 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c139b700 1 --2- 172.21.15.142:0/3726372640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc150600 0x7f34bc06a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.128+0000 7f34c0b9a700 1 --2- 172.21.15.142:0/3726372640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc1509d0 0x7f34bc06ace0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0099b0 tx=0x7f34ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e6eba5b7581f21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34b3fff700 1 -- 172.21.15.142:0/3726372640 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00b820 con 0x7f34bc1509d0 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34b3fff700 1 -- 172.21.15.142:0/3726372640 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac00b980 con 0x7f34bc1509d0 2023-09-30T22:56:24.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34b3fff700 1 -- 172.21.15.142:0/3726372640 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00bd20 con 0x7f34bc1509d0 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 -- 172.21.15.142:0/3726372640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc1509d0 msgr2=0x7f34bc06ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 --2- 172.21.15.142:0/3726372640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc1509d0 0x7f34bc06ace0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0099b0 tx=0x7f34ac009250 comp rx=0 tx=0).stop 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 -- 172.21.15.142:0/3726372640 shutdown_connections 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 --2- 172.21.15.142:0/3726372640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc150600 0x7f34bc06a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 --2- 172.21.15.142:0/3726372640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc1509d0 0x7f34bc06ace0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 -- 172.21.15.142:0/3726372640 >> 172.21.15.142:0/3726372640 conn(0x7f34bc0cc670 msgr2=0x7f34bc0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 -- 172.21.15.142:0/3726372640 shutdown_connections 2023-09-30T22:56:24.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.129+0000 7f34c35ff700 1 -- 172.21.15.142:0/3726372640 wait complete. 2023-09-30T22:56:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.131+0000 7f34c35ff700 1 Processor -- start 2023-09-30T22:56:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.131+0000 7f34c35ff700 1 -- start start 2023-09-30T22:56:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c35ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34bc150600 0x7f34bc15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c35ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc1509d0 0x7f34bc0c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c35ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc15a920 0x7f34bc13e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c35ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc15c410 con 0x7f34bc15a920 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c35ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc15be50 con 0x7f34bc150600 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c35ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc15c130 con 0x7f34bc1509d0 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c1b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc15a920 0x7f34bc13e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c139b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34bc150600 0x7f34bc15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c1b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc15a920 0x7f34bc13e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51572/0 (socket says 172.21.15.142:51572) 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c1b9c700 1 -- 172.21.15.142:0/2097488749 learned_addr learned my addr 172.21.15.142:0/2097488749 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.132+0000 7f34c0b9a700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc1509d0 0x7f34bc0c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c1b9c700 1 -- 172.21.15.142:0/2097488749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc1509d0 msgr2=0x7f34bc0c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c1b9c700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc1509d0 0x7f34bc0c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c1b9c700 1 -- 172.21.15.142:0/2097488749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34bc150600 msgr2=0x7f34bc15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c1b9c700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34bc150600 0x7f34bc15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c1b9c700 1 -- 172.21.15.142:0/2097488749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac0094f0 con 0x7f34bc15a920 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c1b9c700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc15a920 0x7f34bc13e2c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f34b400bc30 tx=0x7f34b4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b400c840 con 0x7f34bc15a920 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b400c9e0 con 0x7f34bc15a920 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b400cda0 con 0x7f34bc15a920 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc0c0230 con 0x7f34bc15a920 2023-09-30T22:56:24.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.133+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc13b9c0 con 0x7f34bc15a920 2023-09-30T22:56:24.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.134+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc069a50 con 0x7f34bc15a920 2023-09-30T22:56:24.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.135+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f34b4014620 con 0x7f34bc15a920 2023-09-30T22:56:24.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.136+0000 7f34b17fa700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f34a0067330 0x7f34a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.136+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f34b4084c80 con 0x7f34bc15a920 2023-09-30T22:56:24.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.136+0000 7f34c139b700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f34a0067330 0x7f34a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.136+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f34a006f7d0 con 0x7f34bc15a920 2023-09-30T22:56:24.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.137+0000 7f34c139b700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f34a0067330 0x7f34a00697e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f34b800adc0 tx=0x7f34b8006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.140+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f34b4051a10 con 0x7f34bc15a920 2023-09-30T22:56:24.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.329+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34bc06fc10 con 0x7f34bc15a920 2023-09-30T22:56:24.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.330+0000 7f34b17fa700 1 -- 172.21.15.142:0/2097488749 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34b4055030 con 0x7f34bc15a920 2023-09-30T22:56:24.330 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:56:24.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f34a0067330 msgr2=0x7f34a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f34a0067330 0x7f34a00697e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f34b800adc0 tx=0x7f34b8006f90 comp rx=0 tx=0).stop 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc15a920 msgr2=0x7f34bc13e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc15a920 0x7f34bc13e2c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f34b400bc30 tx=0x7f34b4009820 comp rx=0 tx=0).stop 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 shutdown_connections 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f34a0067330 0x7f34a00697e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34bc15a920 0x7f34bc13e2c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34bc150600 0x7f34bc15b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 --2- 172.21.15.142:0/2097488749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f34bc1509d0 0x7f34bc0c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 >> 172.21.15.142:0/2097488749 conn(0x7f34bc0cc670 msgr2=0x7f34bc0c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:24.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 shutdown_connections 2023-09-30T22:56:24.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.332+0000 7f34c35ff700 1 -- 172.21.15.142:0/2097488749 wait complete. 2023-09-30T22:56:24.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:56:24.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.546+0000 7f3b5a9ff700 1 Processor -- start 2023-09-30T22:56:24.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.546+0000 7f3b5a9ff700 1 -- start start 2023-09-30T22:56:24.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b5a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540ca5e0 0x7f3b5406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b5a9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3b540b0de0 0x7f3b540681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b5a9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b54067d10 con 0x7f3b54159ba0 2023-09-30T22:56:24.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b5a9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5406af90 con 0x7f3b540b0de0 2023-09-30T22:56:24.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b5a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540676c0 con 0x7f3b540ca5e0 2023-09-30T22:56:24.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b4bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540ca5e0 0x7f3b5406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b4bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540ca5e0 0x7f3b5406a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:55706/0 (socket says 172.21.15.142:55706) 2023-09-30T22:56:24.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b4bfff700 1 -- 172.21.15.142:0/2517434632 learned_addr learned my addr 172.21.15.142:0/2517434632 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:24.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b58f9c700 1 --2- 172.21.15.142:0/2517434632 >> v2:172.21.15.148:3300/0 conn(0x7f3b540b0de0 0x7f3b540681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.548+0000 7f3b53fff700 1 --1- 172.21.15.142:0/2517434632 >> v1:172.21.15.148:6789/0 conn(0x7f3b54159ba0 0x7f3b540c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:51138/0 (socket says 172.21.15.142:51138) 2023-09-30T22:56:24.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b4bfff700 1 -- 172.21.15.142:0/2517434632 >> v2:172.21.15.148:3300/0 conn(0x7f3b540b0de0 msgr2=0x7f3b540681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:24.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b4bfff700 1 --2- 172.21.15.142:0/2517434632 >> v2:172.21.15.148:3300/0 conn(0x7f3b540b0de0 0x7f3b540681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b4bfff700 1 -- 172.21.15.142:0/2517434632 >> v1:172.21.15.148:6789/0 conn(0x7f3b54159ba0 legacy=0x7f3b540c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b4bfff700 1 -- 172.21.15.142:0/2517434632 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540679a0 con 0x7f3b540ca5e0 2023-09-30T22:56:24.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b4bfff700 1 --2- 172.21.15.142:0/2517434632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540ca5e0 0x7f3b5406a8d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0099b0 tx=0x7f3b3c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d2f293df1ee74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b537fe700 1 -- 172.21.15.142:0/2517434632 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c009ea0 con 0x7f3b540ca5e0 2023-09-30T22:56:24.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b537fe700 1 -- 172.21.15.142:0/2517434632 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c00b860 con 0x7f3b540ca5e0 2023-09-30T22:56:24.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.549+0000 7f3b537fe700 1 -- 172.21.15.142:0/2517434632 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00bc00 con 0x7f3b540ca5e0 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/2517434632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540ca5e0 msgr2=0x7f3b5406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/2517434632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540ca5e0 0x7f3b5406a8d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0099b0 tx=0x7f3b3c009250 comp rx=0 tx=0).stop 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/2517434632 shutdown_connections 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/2517434632 >> v2:172.21.15.148:3300/0 conn(0x7f3b540b0de0 0x7f3b540681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/2517434632 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540ca5e0 0x7f3b5406a8d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/2517434632 >> 172.21.15.142:0/2517434632 conn(0x7f3b540cb2f0 msgr2=0x7f3b540cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/2517434632 shutdown_connections 2023-09-30T22:56:24.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.550+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/2517434632 wait complete. 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.551+0000 7f3b5a9ff700 1 Processor -- start 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.552+0000 7f3b5a9ff700 1 -- start start 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.552+0000 7f3b5a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540b0de0 0x7f3b540c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.552+0000 7f3b5a9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b540ca5e0 0x7f3b5415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.552+0000 7f3b5a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b54159ba0 0x7f3b540c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.552+0000 7f3b5a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5415c800 con 0x7f3b54159ba0 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.552+0000 7f3b5a9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5415bbf0 con 0x7f3b540ca5e0 2023-09-30T22:56:24.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.552+0000 7f3b5a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5415bed0 con 0x7f3b540b0de0 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b54159ba0 0x7f3b540c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b4bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b540ca5e0 0x7f3b5415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540b0de0 0x7f3b540c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b54159ba0 0x7f3b540c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51574/0 (socket says 172.21.15.142:51574) 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 -- 172.21.15.142:0/1944839288 learned_addr learned my addr 172.21.15.142:0/1944839288 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 -- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540b0de0 msgr2=0x7f3b540c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540b0de0 0x7f3b540c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 -- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b540ca5e0 msgr2=0x7f3b5415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b540ca5e0 0x7f3b5415b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b58f9c700 1 -- 172.21.15.142:0/1944839288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0094f0 con 0x7f3b54159ba0 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b53fff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540b0de0 0x7f3b540c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.553+0000 7f3b4bfff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b540ca5e0 0x7f3b5415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.554+0000 7f3b58f9c700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b54159ba0 0x7f3b540c7ee0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009df0 tx=0x7f3b4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.554+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00caa0 con 0x7f3b54159ba0 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.554+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c00f040 con 0x7f3b54159ba0 2023-09-30T22:56:24.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.554+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5415c1b0 con 0x7f3b54159ba0 2023-09-30T22:56:24.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.554+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00ce70 con 0x7f3b54159ba0 2023-09-30T22:56:24.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.554+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540b0760 con 0x7f3b54159ba0 2023-09-30T22:56:24.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.555+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5415c970 con 0x7f3b54159ba0 2023-09-30T22:56:24.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.556+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3b4c014690 con 0x7f3b54159ba0 2023-09-30T22:56:24.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.557+0000 7f3b50ff9700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b34067330 0x7f3b340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.557+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f3b4c085520 con 0x7f3b54159ba0 2023-09-30T22:56:24.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.557+0000 7f3b53fff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b34067330 0x7f3b340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.557+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f3b3406f7d0 con 0x7f3b54159ba0 2023-09-30T22:56:24.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.558+0000 7f3b53fff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b34067330 0x7f3b340697e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3b44004f60 tx=0x7f3b44007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.561+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3b4c055d40 con 0x7f3b54159ba0 2023-09-30T22:56:24.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.750+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b540cac40 con 0x7f3b54159ba0 2023-09-30T22:56:24.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.750+0000 7f3b50ff9700 1 -- 172.21.15.142:0/1944839288 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b4c018020 con 0x7f3b54159ba0 2023-09-30T22:56:24.751 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:56:24.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b34067330 msgr2=0x7f3b340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b34067330 0x7f3b340697e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3b44004f60 tx=0x7f3b44007eb0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b54159ba0 msgr2=0x7f3b540c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b54159ba0 0x7f3b540c7ee0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009df0 tx=0x7f3b4c00b040 comp rx=0 tx=0).stop 2023-09-30T22:56:24.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 shutdown_connections 2023-09-30T22:56:24.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3b34067330 0x7f3b340697e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b54159ba0 0x7f3b540c7ee0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b540b0de0 0x7f3b540c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 --2- 172.21.15.142:0/1944839288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b540ca5e0 0x7f3b5415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 >> 172.21.15.142:0/1944839288 conn(0x7f3b540cb2f0 msgr2=0x7f3b540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:24.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 shutdown_connections 2023-09-30T22:56:24.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.753+0000 7f3b5a9ff700 1 -- 172.21.15.142:0/1944839288 wait complete. 2023-09-30T22:56:24.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:56:24.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.964+0000 7f9b4b9ff700 1 Processor -- start 2023-09-30T22:56:24.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.964+0000 7f9b4b9ff700 1 -- start start 2023-09-30T22:56:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b4b9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b4b9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b440b0de0 0x7f9b440c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b4b9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b44067d10 con 0x7f9b440ca410 2023-09-30T22:56:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b4b9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b440ca850 con 0x7f9b440b0de0 2023-09-30T22:56:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b4b9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4406af90 con 0x7f9b44159ba0 2023-09-30T22:56:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b48f9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b440b0de0 0x7f9b440c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b48f9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b440b0de0 0x7f9b440c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51580/0 (socket says 172.21.15.142:51580) 2023-09-30T22:56:24.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b48f9a700 1 -- 172.21.15.142:0/3509981446 learned_addr learned my addr 172.21.15.142:0/3509981446 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:24.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b4979b700 1 --2- 172.21.15.142:0/3509981446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b48f9a700 1 -- 172.21.15.142:0/3509981446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 msgr2=0x7f9b4406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:24.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b48f9a700 1 --2- 172.21.15.142:0/3509981446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.966+0000 7f9b48f9a700 1 -- 172.21.15.142:0/3509981446 >> v1:172.21.15.148:6789/0 conn(0x7f9b440ca410 legacy=0x7f9b4415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.967+0000 7f9b48f9a700 1 -- 172.21.15.142:0/3509981446 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440676c0 con 0x7f9b440b0de0 2023-09-30T22:56:24.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.967+0000 7f9b48f9a700 1 --2- 172.21.15.142:0/3509981446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440b0de0 0x7f9b440c9ed0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9b340099b0 tx=0x7f9b34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741595119986cae0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.967+0000 7f9b3bfff700 1 -- 172.21.15.142:0/3509981446 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400b860 con 0x7f9b440b0de0 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.967+0000 7f9b3bfff700 1 -- 172.21.15.142:0/3509981446 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3400b9c0 con 0x7f9b440b0de0 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.967+0000 7f9b3bfff700 1 -- 172.21.15.142:0/3509981446 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400bd60 con 0x7f9b440b0de0 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/3509981446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440b0de0 msgr2=0x7f9b440c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/3509981446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440b0de0 0x7f9b440c9ed0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9b340099b0 tx=0x7f9b34009250 comp rx=0 tx=0).stop 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/3509981446 shutdown_connections 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/3509981446 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/3509981446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440b0de0 0x7f9b440c9ed0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/3509981446 >> 172.21.15.142:0/3509981446 conn(0x7f9b440cb2f0 msgr2=0x7f9b440cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/3509981446 shutdown_connections 2023-09-30T22:56:24.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.968+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/3509981446 wait complete. 2023-09-30T22:56:24.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.969+0000 7f9b4b9ff700 1 Processor -- start 2023-09-30T22:56:24.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.969+0000 7f9b4b9ff700 1 -- start start 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b4b9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b440b0de0 0x7f9b4415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b4b9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440ca410 0x7f9b4415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b4b9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b4b9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440c3be0 con 0x7f9b440ca410 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b4b9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4415dde0 con 0x7f9b440b0de0 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b4b9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4415d820 con 0x7f9b44159ba0 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b48f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440ca410 0x7f9b4415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.970+0000 7f9b48f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440ca410 0x7f9b4415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51594/0 (socket says 172.21.15.142:51594) 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b48f9a700 1 -- 172.21.15.142:0/777136662 learned_addr learned my addr 172.21.15.142:0/777136662 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b4979b700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b440b0de0 0x7f9b4415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b49f9c700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b48f9a700 1 -- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 msgr2=0x7f9b4415d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b48f9a700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4415d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b48f9a700 1 -- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b440b0de0 msgr2=0x7f9b4415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b48f9a700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b440b0de0 0x7f9b4415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b48f9a700 1 -- 172.21.15.142:0/777136662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340094f0 con 0x7f9b440ca410 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b4979b700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b440b0de0 0x7f9b4415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b48f9a700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440ca410 0x7f9b4415cac0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b4406c8d0 tx=0x7f9b34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34024440 con 0x7f9b440ca410 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b340245c0 con 0x7f9b440ca410 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4415db00 con 0x7f9b440ca410 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.971+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34024980 con 0x7f9b440ca410 2023-09-30T22:56:24.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.972+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4415d540 con 0x7f9b440ca410 2023-09-30T22:56:24.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.973+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b440c3d50 con 0x7f9b440ca410 2023-09-30T22:56:24.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.973+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9b3401a420 con 0x7f9b440ca410 2023-09-30T22:56:24.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.974+0000 7f9b397fa700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b28067330 0x7f9b280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:24.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.974+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f9b34086be0 con 0x7f9b440ca410 2023-09-30T22:56:24.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.974+0000 7f9b4979b700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b28067330 0x7f9b280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:24.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.975+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f9b2806f7d0 con 0x7f9b440ca410 2023-09-30T22:56:24.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.975+0000 7f9b4979b700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b28067330 0x7f9b280697e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b40006fd0 tx=0x7f9b40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:24.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:24.978+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9b34053970 con 0x7f9b440ca410 2023-09-30T22:56:25.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.169+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b440679a0 con 0x7f9b440ca410 2023-09-30T22:56:25.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.169+0000 7f9b397fa700 1 -- 172.21.15.142:0/777136662 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b34015030 con 0x7f9b440ca410 2023-09-30T22:56:25.169 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:56:25.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.171+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b28067330 msgr2=0x7f9b280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.171+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b28067330 0x7f9b280697e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b40006fd0 tx=0x7f9b40008040 comp rx=0 tx=0).stop 2023-09-30T22:56:25.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.171+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440ca410 msgr2=0x7f9b4415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.171+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440ca410 0x7f9b4415cac0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b4406c8d0 tx=0x7f9b34017000 comp rx=0 tx=0).stop 2023-09-30T22:56:25.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 shutdown_connections 2023-09-30T22:56:25.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b28067330 0x7f9b280697e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b44159ba0 0x7f9b4415d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b440b0de0 0x7f9b4415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 --2- 172.21.15.142:0/777136662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b440ca410 0x7f9b4415cac0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 >> 172.21.15.142:0/777136662 conn(0x7f9b440cb2f0 msgr2=0x7f9b4406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:25.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 shutdown_connections 2023-09-30T22:56:25.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.172+0000 7f9b4b9ff700 1 -- 172.21.15.142:0/777136662 wait complete. 2023-09-30T22:56:25.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:25.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.378+0000 7f8f32fff700 1 Processor -- start 2023-09-30T22:56:25.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.378+0000 7f8f32fff700 1 -- start start 2023-09-30T22:56:25.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f32fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8f2c1598e0 0x7f8f2c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f32fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0cee50 0x7f8f2c0d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f32fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0cff40 con 0x7f8f2c06b1c0 2023-09-30T22:56:25.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f32fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c0d0910 con 0x7f8f2c0cee50 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f32fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c0cf330 con 0x7f8f2c1598e0 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f2bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0cee50 0x7f8f2c0d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f3159c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8f2c06b1c0 0x7f8f2c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40490/0 (socket says 172.21.15.142:40490) 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f2bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f2c0cee50 0x7f8f2c0d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51598/0 (socket says 172.21.15.142:51598) 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.379+0000 7f8f3159c700 1 -- 172.21.15.142:0/3771335037 learned_addr learned my addr 172.21.15.142:0/3771335037 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f30d9b700 1 --2- 172.21.15.142:0/3771335037 >> v2:172.21.15.148:3300/0 conn(0x7f8f2c1598e0 0x7f8f2c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2bfff700 1 -- 172.21.15.142:0/3771335037 >> v2:172.21.15.148:3300/0 conn(0x7f8f2c1598e0 msgr2=0x7f8f2c159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2bfff700 1 --2- 172.21.15.142:0/3771335037 >> v2:172.21.15.148:3300/0 conn(0x7f8f2c1598e0 0x7f8f2c159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2bfff700 1 -- 172.21.15.142:0/3771335037 >> v1:172.21.15.142:6789/0 conn(0x7f8f2c06b1c0 legacy=0x7f8f2c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2bfff700 1 -- 172.21.15.142:0/3771335037 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0cf610 con 0x7f8f2c0cee50 2023-09-30T22:56:25.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2b7fe700 1 -- 172.21.15.142:0/3771335037 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950550479 0 0) 0x7f8f2c0cff40 con 0x7f8f2c06b1c0 2023-09-30T22:56:25.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2bfff700 1 --2- 172.21.15.142:0/3771335037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0cee50 0x7f8f2c0d03d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0ce070 tx=0x7f8f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1863a8090bcb8845 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:25.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2b7fe700 1 -- 172.21.15.142:0/3771335037 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800b6b0 con 0x7f8f2c0cee50 2023-09-30T22:56:25.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2b7fe700 1 -- 172.21.15.142:0/3771335037 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1800b810 con 0x7f8f2c0cee50 2023-09-30T22:56:25.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.380+0000 7f8f2b7fe700 1 -- 172.21.15.142:0/3771335037 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800bbb0 con 0x7f8f2c0cee50 2023-09-30T22:56:25.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 -- 172.21.15.142:0/3771335037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0cee50 msgr2=0x7f8f2c0d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3771335037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0cee50 0x7f8f2c0d03d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0ce070 tx=0x7f8f180091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 -- 172.21.15.142:0/3771335037 shutdown_connections 2023-09-30T22:56:25.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3771335037 >> v2:172.21.15.148:3300/0 conn(0x7f8f2c1598e0 0x7f8f2c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3771335037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c0cee50 0x7f8f2c0d03d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 -- 172.21.15.142:0/3771335037 >> 172.21.15.142:0/3771335037 conn(0x7f8f2c0cd540 msgr2=0x7f8f2c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:25.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 -- 172.21.15.142:0/3771335037 shutdown_connections 2023-09-30T22:56:25.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.381+0000 7f8f32fff700 1 -- 172.21.15.142:0/3771335037 wait complete. 2023-09-30T22:56:25.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.383+0000 7f8f32fff700 1 Processor -- start 2023-09-30T22:56:25.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.383+0000 7f8f32fff700 1 -- start start 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f32fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f2c06b1c0 0x7f8f2c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f32fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c0cee50 0x7f8f2c16a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f32fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c1598e0 0x7f8f2c16b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f32fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0ca220 con 0x7f8f2c1598e0 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f32fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c16ad80 con 0x7f8f2c0cee50 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f32fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c16b060 con 0x7f8f2c06b1c0 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c1598e0 0x7f8f2c16b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c1598e0 0x7f8f2c16b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51610/0 (socket says 172.21.15.142:51610) 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 -- 172.21.15.142:0/3158919659 learned_addr learned my addr 172.21.15.142:0/3158919659 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f30d9b700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f2c06b1c0 0x7f8f2c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 -- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f2c06b1c0 msgr2=0x7f8f2c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f2bfff700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c0cee50 0x7f8f2c16a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f2c06b1c0 0x7f8f2c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 -- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c0cee50 msgr2=0x7f8f2c16a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c0cee50 0x7f8f2c16a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f3159c700 1 -- 172.21.15.142:0/3158919659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18009420 con 0x7f8f2c1598e0 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.384+0000 7f8f30d9b700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f2c06b1c0 0x7f8f2c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.385+0000 7f8f3159c700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c1598e0 0x7f8f2c16b5d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400cc90 tx=0x7f8f24001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.385+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400cea0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.385+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2400ab70 con 0x7f8f2c1598e0 2023-09-30T22:56:25.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.385+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c16b340 con 0x7f8f2c1598e0 2023-09-30T22:56:25.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.385+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240070f0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.385+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c16aa00 con 0x7f8f2c1598e0 2023-09-30T22:56:25.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.386+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0697b0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.387+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8f240074a0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.388+0000 7f8f28ff9700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8f10067330 0x7f8f100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.388+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f8f240851b0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.388+0000 7f8f30d9b700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8f10067330 0x7f8f100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.389+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f8f1006f7d0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.389+0000 7f8f30d9b700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8f10067330 0x7f8f100697e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0d0730 tx=0x7f8f20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:25.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.393+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8f24051fc0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.629+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f2c0cc050 con 0x7f8f2c1598e0 2023-09-30T22:56:25.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.629+0000 7f8f28ff9700 1 -- 172.21.15.142:0/3158919659 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f8f240555e0 con 0x7f8f2c1598e0 2023-09-30T22:56:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:25.630 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:55:04.855906+0000","modified":"2023-09-30T22:55:08.414251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3864514907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3864514907},{"type":"v1","addr":"172.21.15.142:6837","nonce":3864514907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-09-30T22:56:25.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8f10067330 msgr2=0x7f8f100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8f10067330 0x7f8f100697e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0d0730 tx=0x7f8f20008040 comp rx=0 tx=0).stop 2023-09-30T22:56:25.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c1598e0 msgr2=0x7f8f2c16b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c1598e0 0x7f8f2c16b5d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400cc90 tx=0x7f8f24001a80 comp rx=0 tx=0).stop 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 shutdown_connections 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8f10067330 0x7f8f100697e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f2c1598e0 0x7f8f2c16b5d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f2c06b1c0 0x7f8f2c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 --2- 172.21.15.142:0/3158919659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c0cee50 0x7f8f2c16a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 >> 172.21.15.142:0/3158919659 conn(0x7f8f2c0cd540 msgr2=0x7f8f2c158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 shutdown_connections 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.632+0000 7f8f32fff700 1 -- 172.21.15.142:0/3158919659 wait complete. 2023-09-30T22:56:25.633 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2023-09-30T22:56:25.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:56:25.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.838+0000 7f36239ff700 1 Processor -- start 2023-09-30T22:56:25.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.839+0000 7f36239ff700 1 -- start start 2023-09-30T22:56:25.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f36239ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f361c0c8e10 0x7f361c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f36239ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f361c0c9890 0x7f361c06af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f36239ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c068c10 con 0x7f361c159a70 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f36239ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c0c9690 con 0x7f361c0c9890 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f36239ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c0683d0 con 0x7f361c0c8e10 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f3621f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f361c0c9890 0x7f361c06af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f362179b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f361c159a70 0x7f361c0690a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40494/0 (socket says 172.21.15.142:40494) 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f362179b700 1 -- 172.21.15.142:0/4142955406 learned_addr learned my addr 172.21.15.142:0/4142955406 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f3620f9a700 1 --2- 172.21.15.142:0/4142955406 >> v2:172.21.15.148:3300/0 conn(0x7f361c0c8e10 0x7f361c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f3621f9c700 1 -- 172.21.15.142:0/4142955406 >> v2:172.21.15.148:3300/0 conn(0x7f361c0c8e10 msgr2=0x7f361c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f3621f9c700 1 --2- 172.21.15.142:0/4142955406 >> v2:172.21.15.148:3300/0 conn(0x7f361c0c8e10 0x7f361c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.840+0000 7f3621f9c700 1 -- 172.21.15.142:0/4142955406 >> v1:172.21.15.142:6789/0 conn(0x7f361c159a70 legacy=0x7f361c0690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.841+0000 7f3621f9c700 1 -- 172.21.15.142:0/4142955406 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0c93b0 con 0x7f361c0c9890 2023-09-30T22:56:25.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.841+0000 7f3621f9c700 1 --2- 172.21.15.142:0/4142955406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c0c9890 0x7f361c06af20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f361c0cc030 tx=0x7f3614009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e13a53e9f64cf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.841+0000 7f3613fff700 1 -- 172.21.15.142:0/4142955406 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361400e070 con 0x7f361c0c9890 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.841+0000 7f3613fff700 1 -- 172.21.15.142:0/4142955406 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361400bb60 con 0x7f361c0c9890 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.841+0000 7f3613fff700 1 -- 172.21.15.142:0/4142955406 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614012430 con 0x7f361c0c9890 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.841+0000 7f36239ff700 1 -- 172.21.15.142:0/4142955406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c0c9890 msgr2=0x7f361c06af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.842+0000 7f36239ff700 1 --2- 172.21.15.142:0/4142955406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c0c9890 0x7f361c06af20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f361c0cc030 tx=0x7f3614009780 comp rx=0 tx=0).stop 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.842+0000 7f36239ff700 1 -- 172.21.15.142:0/4142955406 shutdown_connections 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.842+0000 7f36239ff700 1 --2- 172.21.15.142:0/4142955406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c0c9890 0x7f361c06af20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.842+0000 7f36239ff700 1 --2- 172.21.15.142:0/4142955406 >> v2:172.21.15.148:3300/0 conn(0x7f361c0c8e10 0x7f361c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.842+0000 7f36239ff700 1 -- 172.21.15.142:0/4142955406 >> 172.21.15.142:0/4142955406 conn(0x7f361c0cb2e0 msgr2=0x7f361c0cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:25.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.842+0000 7f36239ff700 1 -- 172.21.15.142:0/4142955406 shutdown_connections 2023-09-30T22:56:25.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.842+0000 7f36239ff700 1 -- 172.21.15.142:0/4142955406 wait complete. 2023-09-30T22:56:25.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.843+0000 7f36239ff700 1 Processor -- start 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.843+0000 7f36239ff700 1 -- start start 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.844+0000 7f36239ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f361c0c8e10 0x7f361c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.844+0000 7f36239ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f361c0c9890 0x7f361c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.844+0000 7f36239ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c159a70 0x7f361c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.844+0000 7f36239ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c153c10 con 0x7f361c159a70 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.844+0000 7f36239ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c16dca0 con 0x7f361c0c9890 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.844+0000 7f36239ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c16df80 con 0x7f361c0c8e10 2023-09-30T22:56:25.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.844+0000 7f3621f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c159a70 0x7f361c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c159a70 0x7f361c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51636/0 (socket says 172.21.15.142:51636) 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 -- 172.21.15.142:0/168848379 learned_addr learned my addr 172.21.15.142:0/168848379 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3620f9a700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f361c0c9890 0x7f361c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f362179b700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f361c0c8e10 0x7f361c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 -- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f361c0c8e10 msgr2=0x7f361c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f361c0c8e10 0x7f361c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 -- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f361c0c9890 msgr2=0x7f361c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f361c0c9890 0x7f361c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 -- 172.21.15.142:0/168848379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614009a20 con 0x7f361c159a70 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3620f9a700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f361c0c9890 0x7f361c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f362179b700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f361c0c8e10 0x7f361c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:25.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f3621f9c700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c159a70 0x7f361c0c5ca0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f36140097c0 tx=0x7f3614019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:25.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614012e50 con 0x7f361c159a70 2023-09-30T22:56:25.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361401d630 con 0x7f361c159a70 2023-09-30T22:56:25.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c16e260 con 0x7f361c159a70 2023-09-30T22:56:25.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.845+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361401d9f0 con 0x7f361c159a70 2023-09-30T22:56:25.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.846+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c155430 con 0x7f361c159a70 2023-09-30T22:56:25.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.847+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c153d80 con 0x7f361c159a70 2023-09-30T22:56:25.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.848+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3614024070 con 0x7f361c159a70 2023-09-30T22:56:25.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.849+0000 7f36117fa700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3600067330 0x7f36000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:25.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.849+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f3614087430 con 0x7f361c159a70 2023-09-30T22:56:25.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.849+0000 7f362179b700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3600067330 0x7f36000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:25.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.850+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f360006f7d0 con 0x7f361c159a70 2023-09-30T22:56:25.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.850+0000 7f362179b700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3600067330 0x7f36000697e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3618001780 tx=0x7f3618009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:25.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:25.854+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3614054260 con 0x7f361c159a70 2023-09-30T22:56:26.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.043+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f361c06e790 con 0x7f361c159a70 2023-09-30T22:56:26.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.044+0000 7f36117fa700 1 -- 172.21.15.142:0/168848379 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17384 (secure 0 0 0) 0x7f361407fe60 con 0x7f361c159a70 2023-09-30T22:56:26.044 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:26.045 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":78,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:56:24.361139+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:55:02.993656+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-09-30T22:55:03.839904+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.19","mappings":[{"from":2,"to":7}]},{"pgid":"10.1d","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.33","mappings":[{"from":2,"to":5}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3c","mappings":[{"from":2,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3600067330 msgr2=0x7f36000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3600067330 0x7f36000697e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3618001780 tx=0x7f3618009040 comp rx=0 tx=0).stop 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c159a70 msgr2=0x7f361c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c159a70 0x7f361c0c5ca0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f36140097c0 tx=0x7f3614019000 comp rx=0 tx=0).stop 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 shutdown_connections 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3600067330 0x7f36000697e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f361c159a70 0x7f361c0c5ca0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f361c0c8e10 0x7f361c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 --2- 172.21.15.142:0/168848379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f361c0c9890 0x7f361c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.046+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 >> 172.21.15.142:0/168848379 conn(0x7f361c0cb2e0 msgr2=0x7f361c0690a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:26.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.047+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 shutdown_connections 2023-09-30T22:56:26.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.047+0000 7f36239ff700 1 -- 172.21.15.142:0/168848379 wait complete. 2023-09-30T22:56:26.064 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:56:26.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:26.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.255+0000 7f3475fff700 1 Processor -- start 2023-09-30T22:56:26.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.255+0000 7f3475fff700 1 -- start start 2023-09-30T22:56:26.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f3475fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34700c6da0 0x7f347006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f3475fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f3470159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f3475fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347015dde0 con 0x7f347006d3f0 2023-09-30T22:56:26.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f3475fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347015e710 con 0x7f34700c6da0 2023-09-30T22:56:26.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f3475fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347006b840 con 0x7f347015e270 2023-09-30T22:56:26.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f346ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f3470159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f346effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34700c6da0 0x7f347006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f346f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f347006d3f0 0x7f347006b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:51166/0 (socket says 172.21.15.142:51166) 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.257+0000 7f346f7fe700 1 -- 172.21.15.142:0/519978627 learned_addr learned my addr 172.21.15.142:0/519978627 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346ffff700 1 -- 172.21.15.142:0/519978627 >> v2:172.21.15.148:3300/0 conn(0x7f34700c6da0 msgr2=0x7f347006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346ffff700 1 --2- 172.21.15.142:0/519978627 >> v2:172.21.15.148:3300/0 conn(0x7f34700c6da0 0x7f347006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346ffff700 1 -- 172.21.15.142:0/519978627 >> v1:172.21.15.148:6789/0 conn(0x7f347006d3f0 legacy=0x7f347006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346e7fc700 1 -- 172.21.15.142:0/519978627 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134289987 0 0) 0x7f347015dde0 con 0x7f347006d3f0 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346ffff700 1 -- 172.21.15.142:0/519978627 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347015d7d0 con 0x7f347015e270 2023-09-30T22:56:26.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346effd700 1 --2- 172.21.15.142:0/519978627 >> v2:172.21.15.148:3300/0 conn(0x7f34700c6da0 0x7f347006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346ffff700 1 --2- 172.21.15.142:0/519978627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f3470159550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3468009e60 tx=0x7f3468009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68feaa9aaaec141a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346e7fc700 1 -- 172.21.15.142:0/519978627 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800e070 con 0x7f347015e270 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346e7fc700 1 -- 172.21.15.142:0/519978627 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346800bb60 con 0x7f347015e270 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.258+0000 7f346e7fc700 1 -- 172.21.15.142:0/519978627 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468012430 con 0x7f347015e270 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 -- 172.21.15.142:0/519978627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 msgr2=0x7f3470159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 --2- 172.21.15.142:0/519978627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f3470159550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3468009e60 tx=0x7f3468009780 comp rx=0 tx=0).stop 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 -- 172.21.15.142:0/519978627 shutdown_connections 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 --2- 172.21.15.142:0/519978627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f3470159550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 --2- 172.21.15.142:0/519978627 >> v2:172.21.15.148:3300/0 conn(0x7f34700c6da0 0x7f347006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 -- 172.21.15.142:0/519978627 >> 172.21.15.142:0/519978627 conn(0x7f3470067e30 msgr2=0x7f3470068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:26.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 -- 172.21.15.142:0/519978627 shutdown_connections 2023-09-30T22:56:26.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.259+0000 7f3475fff700 1 -- 172.21.15.142:0/519978627 wait complete. 2023-09-30T22:56:26.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.260+0000 7f3475fff700 1 Processor -- start 2023-09-30T22:56:26.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.261+0000 7f3475fff700 1 -- start start 2023-09-30T22:56:26.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f3475fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347006d3f0 0x7f34700ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f3475fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34700c6da0 0x7f3470140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f3475fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f34700cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f3475fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700ce330 con 0x7f347006d3f0 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f3475fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700cd720 con 0x7f34700c6da0 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f3475fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34700cda00 con 0x7f347015e270 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347006d3f0 0x7f34700ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347006d3f0 0x7f34700ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51640/0 (socket says 172.21.15.142:51640) 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 -- 172.21.15.142:0/1912961527 learned_addr learned my addr 172.21.15.142:0/1912961527 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:26.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346effd700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34700c6da0 0x7f3470140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346ffff700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f34700cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 -- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 msgr2=0x7f34700cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f34700cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 -- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34700c6da0 msgr2=0x7f3470140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34700c6da0 0x7f3470140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.262+0000 7f346f7fe700 1 -- 172.21.15.142:0/1912961527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009420 con 0x7f347006d3f0 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.263+0000 7f346f7fe700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347006d3f0 0x7f34700ce7c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f346000c7e0 tx=0x7f3460007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.263+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460005b30 con 0x7f347006d3f0 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.263+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460005c90 con 0x7f347006d3f0 2023-09-30T22:56:26.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.263+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3468009a20 con 0x7f347006d3f0 2023-09-30T22:56:26.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.263+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460007300 con 0x7f347006d3f0 2023-09-30T22:56:26.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.263+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34700cdfc0 con 0x7f347006d3f0 2023-09-30T22:56:26.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.264+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3470069420 con 0x7f347006d3f0 2023-09-30T22:56:26.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.265+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f346001b3b0 con 0x7f347006d3f0 2023-09-30T22:56:26.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.266+0000 7f34577fe700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f345c067330 0x7f345c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.266+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f3460084210 con 0x7f347006d3f0 2023-09-30T22:56:26.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.266+0000 7f346effd700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f345c067330 0x7f345c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.266+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f345c06f7d0 con 0x7f347006d3f0 2023-09-30T22:56:26.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.266+0000 7f346effd700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f345c067330 0x7f345c0697e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f34700684e0 tx=0x7f34640091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:26.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.270+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3460050fa0 con 0x7f347006d3f0 2023-09-30T22:56:26.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.504+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34700c7230 con 0x7f347006d3f0 2023-09-30T22:56:26.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.505+0000 7f34577fe700 1 -- 172.21.15.142:0/1912961527 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f3460017020 con 0x7f347006d3f0 2023-09-30T22:56:26.505 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:26.505 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:55:04.855906+0000","modified":"2023-09-30T22:55:08.414251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3864514907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3864514907},{"type":"v1","addr":"172.21.15.142:6837","nonce":3864514907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-09-30T22:56:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f345c067330 msgr2=0x7f345c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f345c067330 0x7f345c0697e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f34700684e0 tx=0x7f34640091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347006d3f0 msgr2=0x7f34700ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347006d3f0 0x7f34700ce7c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f346000c7e0 tx=0x7f3460007df0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 shutdown_connections 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f345c067330 0x7f345c0697e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f347015e270 0x7f34700cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347006d3f0 0x7f34700ce7c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 --2- 172.21.15.142:0/1912961527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34700c6da0 0x7f3470140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 >> 172.21.15.142:0/1912961527 conn(0x7f3470067e30 msgr2=0x7f3470152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 shutdown_connections 2023-09-30T22:56:26.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.507+0000 7f3475fff700 1 -- 172.21.15.142:0/1912961527 wait complete. 2023-09-30T22:56:26.509 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2023-09-30T22:56:26.524 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:26.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.715+0000 7f1e1ddff700 1 Processor -- start 2023-09-30T22:56:26.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.716+0000 7f1e1ddff700 1 -- start start 2023-09-30T22:56:26.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e1ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e1ddff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e180b1180 0x7f1e180cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e1ddff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e18159eb0 0x7f1e180cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e1ddff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1815e920 con 0x7f1e180b1180 2023-09-30T22:56:26.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e1ddff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1815d910 con 0x7f1e18159eb0 2023-09-30T22:56:26.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e1ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1815e490 con 0x7f1e18159ae0 2023-09-30T22:56:26.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e16ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e180b1180 0x7f1e180cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e16ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e180b1180 0x7f1e180cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51650/0 (socket says 172.21.15.142:51650) 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e16ffd700 1 -- 172.21.15.142:0/113511830 learned_addr learned my addr 172.21.15.142:0/113511830 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e17fff700 1 --2- 172.21.15.142:0/113511830 >> v2:172.21.15.148:3300/0 conn(0x7f1e18159eb0 0x7f1e180cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.717+0000 7f1e177fe700 1 --2- 172.21.15.142:0/113511830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e16ffd700 1 -- 172.21.15.142:0/113511830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 msgr2=0x7f1e180cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e16ffd700 1 --2- 172.21.15.142:0/113511830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e16ffd700 1 -- 172.21.15.142:0/113511830 >> v2:172.21.15.148:3300/0 conn(0x7f1e18159eb0 msgr2=0x7f1e180cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e16ffd700 1 --2- 172.21.15.142:0/113511830 >> v2:172.21.15.148:3300/0 conn(0x7f1e18159eb0 0x7f1e180cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e16ffd700 1 -- 172.21.15.142:0/113511830 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1815db60 con 0x7f1e180b1180 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e16ffd700 1 --2- 172.21.15.142:0/113511830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e180cbe80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806c680 tx=0x7f1e0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8f68fb0e308f5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:26.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e167fc700 1 -- 172.21.15.142:0/113511830 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00b860 con 0x7f1e180b1180 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e167fc700 1 -- 172.21.15.142:0/113511830 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00b9c0 con 0x7f1e180b1180 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.718+0000 7f1e167fc700 1 -- 172.21.15.142:0/113511830 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00bd60 con 0x7f1e180b1180 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 -- 172.21.15.142:0/113511830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 msgr2=0x7f1e180cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/113511830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e180cbe80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806c680 tx=0x7f1e0c009250 comp rx=0 tx=0).stop 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 -- 172.21.15.142:0/113511830 shutdown_connections 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/113511830 >> v2:172.21.15.148:3300/0 conn(0x7f1e18159eb0 0x7f1e180cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/113511830 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/113511830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e180cbe80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 -- 172.21.15.142:0/113511830 >> 172.21.15.142:0/113511830 conn(0x7f1e180ce8b0 msgr2=0x7f1e180cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 -- 172.21.15.142:0/113511830 shutdown_connections 2023-09-30T22:56:26.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.719+0000 7f1e1ddff700 1 -- 172.21.15.142:0/113511830 wait complete. 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.720+0000 7f1e1ddff700 1 Processor -- start 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.720+0000 7f1e1ddff700 1 -- start start 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.721+0000 7f1e1ddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e181423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.721+0000 7f1e1ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.721+0000 7f1e1ddff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e18159eb0 0x7f1e180b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.721+0000 7f1e1ddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181428e0 con 0x7f1e180b1180 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.721+0000 7f1e1ddff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180c9b50 con 0x7f1e18159eb0 2023-09-30T22:56:26.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.721+0000 7f1e1ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180c8fd0 con 0x7f1e18159ae0 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e181423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e181423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51652/0 (socket says 172.21.15.142:51652) 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 -- 172.21.15.142:0/2891513521 learned_addr learned my addr 172.21.15.142:0/2891513521 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e17fff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e18159eb0 0x7f1e180b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e16ffd700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 -- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 msgr2=0x7f1e180ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 -- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e18159eb0 msgr2=0x7f1e180b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e18159eb0 0x7f1e180b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 -- 172.21.15.142:0/2891513521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c0094f0 con 0x7f1e180b1180 2023-09-30T22:56:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e17fff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e18159eb0 0x7f1e180b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e16ffd700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1e177fe700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e181423a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d890 tx=0x7f1e08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800b600 con 0x7f1e180b1180 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.722+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800b760 con 0x7f1e180b1180 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.723+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e180c92b0 con 0x7f1e180b1180 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.723+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800bae0 con 0x7f1e180b1180 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.723+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e180c9870 con 0x7f1e180b1180 2023-09-30T22:56:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.724+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e181564b0 con 0x7f1e180b1180 2023-09-30T22:56:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.724+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1e0801e460 con 0x7f1e180b1180 2023-09-30T22:56:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.725+0000 7f1dff7fe700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e04067330 0x7f1e040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.725+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f1e080853c0 con 0x7f1e180b1180 2023-09-30T22:56:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.725+0000 7f1e16ffd700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e04067330 0x7f1e040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.726+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f1e0406f7d0 con 0x7f1e180b1180 2023-09-30T22:56:26.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.726+0000 7f1e16ffd700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e04067330 0x7f1e040697e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806c680 tx=0x7f1e0c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:26.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.729+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1e08052150 con 0x7f1e180b1180 2023-09-30T22:56:26.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.963+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e1815de40 con 0x7f1e180b1180 2023-09-30T22:56:26.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.964+0000 7f1dff7fe700 1 -- 172.21.15.142:0/2891513521 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f1e08055770 con 0x7f1e180b1180 2023-09-30T22:56:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:26.964 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:55:04.855906+0000","modified":"2023-09-30T22:55:08.414251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3864514907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3864514907},{"type":"v1","addr":"172.21.15.142:6837","nonce":3864514907}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-09-30T22:56:26.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.966+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e04067330 msgr2=0x7f1e040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.966+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e04067330 0x7f1e040697e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806c680 tx=0x7f1e0c017000 comp rx=0 tx=0).stop 2023-09-30T22:56:26.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.966+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 msgr2=0x7f1e181423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:26.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.966+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e181423a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d890 tx=0x7f1e08008040 comp rx=0 tx=0).stop 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.966+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 shutdown_connections 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.966+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e04067330 0x7f1e040697e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.966+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e18159eb0 0x7f1e180b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.967+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e180b1180 0x7f1e181423a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.967+0000 7f1e1ddff700 1 --2- 172.21.15.142:0/2891513521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e18159ae0 0x7f1e180ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.967+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 >> 172.21.15.142:0/2891513521 conn(0x7f1e180ce8b0 msgr2=0x7f1e180b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.967+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 shutdown_connections 2023-09-30T22:56:26.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:26.967+0000 7f1e1ddff700 1 -- 172.21.15.142:0/2891513521 wait complete. 2023-09-30T22:56:26.969 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2023-09-30T22:56:26.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:56:27.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.175+0000 7f3f233ff700 1 Processor -- start 2023-09-30T22:56:27.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.176+0000 7f3f233ff700 1 -- start start 2023-09-30T22:56:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f233ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f1c0b00d0 0x7f3f1c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f233ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c06d3e0 con 0x7f3f1c0af020 2023-09-30T22:56:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f233ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c06dc80 con 0x7f3f1c06e650 2023-09-30T22:56:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f233ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c06b790 con 0x7f3f1c0b00d0 2023-09-30T22:56:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f2119b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3f1c0af020 0x7f3f1c156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40496/0 (socket says 172.21.15.142:40496) 2023-09-30T22:56:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f2119b700 1 -- 172.21.15.142:0/2073839623 learned_addr learned my addr 172.21.15.142:0/2073839623 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:27.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f2099a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f1c0b00d0 0x7f3f1c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.177+0000 7f3f13fff700 1 -- 172.21.15.142:0/2073839623 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835298912 0 0) 0x7f3f1c06d3e0 con 0x7f3f1c0af020 2023-09-30T22:56:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f13fff700 1 -- 172.21.15.142:0/2073839623 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f08003570 con 0x7f3f1c0af020 2023-09-30T22:56:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f2099a700 1 -- 172.21.15.142:0/2073839623 >> v1:172.21.15.148:6789/0 conn(0x7f3f1c06e650 legacy=0x7f3f1c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f2099a700 1 -- 172.21.15.142:0/2073839623 >> v1:172.21.15.142:6789/0 conn(0x7f3f1c0af020 legacy=0x7f3f1c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f2099a700 1 -- 172.21.15.142:0/2073839623 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0b0650 con 0x7f3f1c0b00d0 2023-09-30T22:56:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f2099a700 1 --2- 172.21.15.142:0/2073839623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c06e110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009910 tx=0x7f3f0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64b294287dab315 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:27.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f13fff700 1 -- 172.21.15.142:0/2073839623 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00b640 con 0x7f3f1c0b00d0 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f13fff700 1 -- 172.21.15.142:0/2073839623 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c00b7a0 con 0x7f3f1c0b00d0 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.178+0000 7f3f13fff700 1 -- 172.21.15.142:0/2073839623 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00bb60 con 0x7f3f1c0b00d0 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.179+0000 7f3f233ff700 1 -- 172.21.15.142:0/2073839623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c0b00d0 msgr2=0x7f3f1c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.179+0000 7f3f233ff700 1 --2- 172.21.15.142:0/2073839623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c06e110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009910 tx=0x7f3f0c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.179+0000 7f3f233ff700 1 -- 172.21.15.142:0/2073839623 shutdown_connections 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.179+0000 7f3f233ff700 1 --2- 172.21.15.142:0/2073839623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c06e110 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.179+0000 7f3f233ff700 1 -- 172.21.15.142:0/2073839623 >> 172.21.15.142:0/2073839623 conn(0x7f3f1c0680c0 msgr2=0x7f3f1c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.179+0000 7f3f233ff700 1 -- 172.21.15.142:0/2073839623 shutdown_connections 2023-09-30T22:56:27.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.179+0000 7f3f233ff700 1 -- 172.21.15.142:0/2073839623 wait complete. 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.180+0000 7f3f233ff700 1 Processor -- start 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.180+0000 7f3f233ff700 1 -- start start 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.181+0000 7f3f233ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c06e650 0x7f3f1c146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.181+0000 7f3f233ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f1c0af020 0x7f3f1c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.181+0000 7f3f233ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.181+0000 7f3f233ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c151380 con 0x7f3f1c06e650 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.181+0000 7f3f233ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1515b0 con 0x7f3f1c0b00d0 2023-09-30T22:56:27.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.181+0000 7f3f233ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c151890 con 0x7f3f1c0af020 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.181+0000 7f3f2119b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c06e650 0x7f3f1c146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c06e650 0x7f3f1c146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51678/0 (socket says 172.21.15.142:51678) 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 -- 172.21.15.142:0/3736008728 learned_addr learned my addr 172.21.15.142:0/3736008728 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2099a700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f1c0af020 0x7f3f1c150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 -- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f1c0af020 msgr2=0x7f3f1c150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2199c700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f1c0af020 0x7f3f1c150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 -- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f1c0b00d0 msgr2=0x7f3f1c1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 -- 172.21.15.142:0/3736008728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c009420 con 0x7f3f1c06e650 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2099a700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f1c0af020 0x7f3f1c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:27.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2199c700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:27.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f2119b700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c06e650 0x7f3f1c146b20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800c7c0 tx=0x7f3f18007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:27.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18005b30 con 0x7f3f1c06e650 2023-09-30T22:56:27.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18005c90 con 0x7f3f1c06e650 2023-09-30T22:56:27.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18007320 con 0x7f3f1c06e650 2023-09-30T22:56:27.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.182+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c151b70 con 0x7f3f1c06e650 2023-09-30T22:56:27.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.183+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c152130 con 0x7f3f1c06e650 2023-09-30T22:56:27.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.184+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c0695b0 con 0x7f3f1c06e650 2023-09-30T22:56:27.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.184+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3f1801b400 con 0x7f3f1c06e650 2023-09-30T22:56:27.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.185+0000 7f3f117fa700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f00067330 0x7f3f000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.185+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f3f180846a0 con 0x7f3f1c06e650 2023-09-30T22:56:27.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.186+0000 7f3f2099a700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f00067330 0x7f3f000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.186+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f3f0006f7d0 con 0x7f3f1c06e650 2023-09-30T22:56:27.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.186+0000 7f3f2099a700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f00067330 0x7f3f000697e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0098e0 tx=0x7f3f0c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:27.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.189+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3f18051550 con 0x7f3f1c06e650 2023-09-30T22:56:27.369 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:56:27.369+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-09-30T22:56:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.371+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(79..79 src has 1..79) v4 ==== 288+0+0 (secure 0 0 0) 0x7f3f180182b0 con 0x7f3f1c06e650 2023-09-30T22:56:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.371+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f3f00070140 con 0x7f3f1c06e650 2023-09-30T22:56:27.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.383+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f1c06fc10 con 0x7f3f1c06e650 2023-09-30T22:56:27.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.384+0000 7f3f117fa700 1 -- 172.21.15.142:0/3736008728 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17377 (secure 0 0 0) 0x7f3f18054b70 con 0x7f3f1c06e650 2023-09-30T22:56:27.385 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:27.385 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":79,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:56:27.369639+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:55:02.993656+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-09-30T22:55:03.839904+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.19","mappings":[{"from":2,"to":7}]},{"pgid":"10.1d","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.33","mappings":[{"from":2,"to":5}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3c","mappings":[{"from":2,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:56:27.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f00067330 msgr2=0x7f3f000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f00067330 0x7f3f000697e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0098e0 tx=0x7f3f0c017000 comp rx=0 tx=0).stop 2023-09-30T22:56:27.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c06e650 msgr2=0x7f3f1c146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c06e650 0x7f3f1c146b20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800c7c0 tx=0x7f3f18007e00 comp rx=0 tx=0).stop 2023-09-30T22:56:27.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 shutdown_connections 2023-09-30T22:56:27.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f00067330 0x7f3f000697e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f1c0b00d0 0x7f3f1c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1c06e650 0x7f3f1c146b20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 --2- 172.21.15.142:0/3736008728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3f1c0af020 0x7f3f1c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 >> 172.21.15.142:0/3736008728 conn(0x7f3f1c0680c0 msgr2=0x7f3f1c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:27.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 shutdown_connections 2023-09-30T22:56:27.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.387+0000 7f3f233ff700 1 -- 172.21.15.142:0/3736008728 wait complete. 2023-09-30T22:56:27.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:56:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.597+0000 7fb3e37ff700 1 Processor -- start 2023-09-30T22:56:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.597+0000 7fb3e37ff700 1 -- start start 2023-09-30T22:56:27.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.598+0000 7fb3e37ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3dc150e70 0x7fb3dc0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.598+0000 7fb3e37ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0cc310 con 0x7fb3dc151240 2023-09-30T22:56:27.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.598+0000 7fb3e37ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc154cd0 con 0x7fb3dc06af20 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.598+0000 7fb3e37ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0cba70 con 0x7fb3dc150e70 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.598+0000 7fb3e159b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3dc150e70 0x7fb3dc0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3e0d9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb3dc151240 0x7fb3dc157980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40500/0 (socket says 172.21.15.142:40500) 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3e0d9a700 1 -- 172.21.15.142:0/3928457323 learned_addr learned my addr 172.21.15.142:0/3928457323 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3e159b700 1 -- 172.21.15.142:0/3928457323 >> v1:172.21.15.148:6789/0 conn(0x7fb3dc06af20 legacy=0x7fb3dc06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3e159b700 1 -- 172.21.15.142:0/3928457323 >> v1:172.21.15.142:6789/0 conn(0x7fb3dc151240 legacy=0x7fb3dc157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3e159b700 1 -- 172.21.15.142:0/3928457323 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0cbd50 con 0x7fb3dc150e70 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3d3fff700 1 -- 172.21.15.142:0/3928457323 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816079451 0 0) 0x7fb3dc0cc310 con 0x7fb3dc151240 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3e159b700 1 --2- 172.21.15.142:0/3928457323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc150e70 0x7fb3dc0cb370 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80098e0 tx=0x7fb3d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e74ba3ce93945 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.599+0000 7fb3d3fff700 1 -- 172.21.15.142:0/3928457323 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8009e80 con 0x7fb3dc150e70 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3d3fff700 1 -- 172.21.15.142:0/3928457323 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d800b820 con 0x7fb3dc150e70 2023-09-30T22:56:27.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3d3fff700 1 -- 172.21.15.142:0/3928457323 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800bba0 con 0x7fb3dc150e70 2023-09-30T22:56:27.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3e37ff700 1 -- 172.21.15.142:0/3928457323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc150e70 msgr2=0x7fb3dc0cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/3928457323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc150e70 0x7fb3dc0cb370 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80098e0 tx=0x7fb3d80091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3e37ff700 1 -- 172.21.15.142:0/3928457323 shutdown_connections 2023-09-30T22:56:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/3928457323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc150e70 0x7fb3dc0cb370 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3e37ff700 1 -- 172.21.15.142:0/3928457323 >> 172.21.15.142:0/3928457323 conn(0x7fb3dc0cd160 msgr2=0x7fb3dc0c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3e37ff700 1 -- 172.21.15.142:0/3928457323 shutdown_connections 2023-09-30T22:56:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.600+0000 7fb3e37ff700 1 -- 172.21.15.142:0/3928457323 wait complete. 2023-09-30T22:56:27.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.602+0000 7fb3e37ff700 1 Processor -- start 2023-09-30T22:56:27.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.602+0000 7fb3e37ff700 1 -- start start 2023-09-30T22:56:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e37ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc06af20 0x7fb3dc154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e37ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3dc150e70 0x7fb3dc137800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e37ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3dc151240 0x7fb3dc137d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e37ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc13a510 con 0x7fb3dc06af20 2023-09-30T22:56:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e37ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc13b090 con 0x7fb3dc150e70 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e37ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc13a760 con 0x7fb3dc151240 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc06af20 0x7fb3dc154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc06af20 0x7fb3dc154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51696/0 (socket says 172.21.15.142:51696) 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 -- 172.21.15.142:0/542092371 learned_addr learned my addr 172.21.15.142:0/542092371 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e1d9c700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3dc151240 0x7fb3dc137d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e0d9a700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3dc150e70 0x7fb3dc137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 -- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3dc151240 msgr2=0x7fb3dc137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3dc151240 0x7fb3dc137d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 -- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3dc150e70 msgr2=0x7fb3dc137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3dc150e70 0x7fb3dc137800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e159b700 1 -- 172.21.15.142:0/542092371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8009420 con 0x7fb3dc06af20 2023-09-30T22:56:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.603+0000 7fb3e0d9a700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3dc150e70 0x7fb3dc137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.604+0000 7fb3e159b700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc06af20 0x7fb3dc154400 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc069d60 tx=0x7fb3d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.604+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d801b470 con 0x7fb3dc06af20 2023-09-30T22:56:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.604+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d801b5d0 con 0x7fb3dc06af20 2023-09-30T22:56:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.604+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d801b990 con 0x7fb3dc06af20 2023-09-30T22:56:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.604+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc13aa40 con 0x7fb3dc06af20 2023-09-30T22:56:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.604+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc13b520 con 0x7fb3dc06af20 2023-09-30T22:56:27.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.605+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc13b370 con 0x7fb3dc06af20 2023-09-30T22:56:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.606+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb3d801bd40 con 0x7fb3dc06af20 2023-09-30T22:56:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.606+0000 7fb3d17fa700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb3c0067330 0x7fb3c00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.607+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fb3d8086a50 con 0x7fb3dc06af20 2023-09-30T22:56:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.607+0000 7fb3e0d9a700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb3c0067330 0x7fb3c00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.607+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7fb3c006f7d0 con 0x7fb3dc06af20 2023-09-30T22:56:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.607+0000 7fb3e0d9a700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb3c0067330 0x7fb3c00697e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc156a60 tx=0x7fb3cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:27.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.611+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb3d802a070 con 0x7fb3dc06af20 2023-09-30T22:56:27.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.843+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3dc0707d0 con 0x7fb3dc06af20 2023-09-30T22:56:27.844 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:56:27.844+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:56:27.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.846+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(80..80 src has 1..80) v4 ==== 366+0+0 (secure 0 0 0) 0x7fb3d8057ba0 con 0x7fb3dc06af20 2023-09-30T22:56:27.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.846+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=81}) v3 -- 0x7fb3c006ffd0 con 0x7fb3dc06af20 2023-09-30T22:56:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.848+0000 7fb3d17fa700 1 -- 172.21.15.142:0/542092371 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb3d80537e0 con 0x7fb3dc06af20 2023-09-30T22:56:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.852+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb3c0067330 msgr2=0x7fb3c00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.852+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb3c0067330 0x7fb3c00697e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc156a60 tx=0x7fb3cc009040 comp rx=0 tx=0).stop 2023-09-30T22:56:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.852+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc06af20 msgr2=0x7fb3dc154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.852+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc06af20 0x7fb3dc154400 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc069d60 tx=0x7fb3d8016000 comp rx=0 tx=0).stop 2023-09-30T22:56:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 shutdown_connections 2023-09-30T22:56:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb3c0067330 0x7fb3c00697e0 secure :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc156a60 tx=0x7fb3cc009040 comp rx=0 tx=0).stop 2023-09-30T22:56:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3dc151240 0x7fb3dc137d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3dc06af20 0x7fb3dc154400 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 --2- 172.21.15.142:0/542092371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3dc150e70 0x7fb3dc137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 >> 172.21.15.142:0/542092371 conn(0x7fb3dc0cd160 msgr2=0x7fb3dc06e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 shutdown_connections 2023-09-30T22:56:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:27.853+0000 7fb3e37ff700 1 -- 172.21.15.142:0/542092371 wait complete. 2023-09-30T22:56:27.855 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:56:27.861 INFO:tasks.ceph.mds.a.smithi142.stderr: -8624> 2023-09-30T22:55:11.370+0000 7fab701f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:56:27.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:56:27.911 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:56:28.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.066+0000 7f92853ff700 1 Processor -- start 2023-09-30T22:56:28.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.066+0000 7f92853ff700 1 -- start start 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f92853ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f92853ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92801509d0 0x7f928006ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f92853ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92801576e0 con 0x7f928015a920 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f92853ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92800cc320 con 0x7f92801509d0 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f92853ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928015a490 con 0x7f9280150600 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f927e7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92801509d0 0x7f928006ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f927e7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92801509d0 0x7f928006ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51734/0 (socket says 172.21.15.142:51734) 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.067+0000 7f927e7fc700 1 -- 172.21.15.142:0/2995238587 learned_addr learned my addr 172.21.15.142:0/2995238587 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:28.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927effd700 1 --2- 172.21.15.142:0/2995238587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927e7fc700 1 -- 172.21.15.142:0/2995238587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 msgr2=0x7f928006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927e7fc700 1 --2- 172.21.15.142:0/2995238587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927e7fc700 1 -- 172.21.15.142:0/2995238587 >> v1:172.21.15.148:6789/0 conn(0x7f928015a920 legacy=0x7f9280156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927e7fc700 1 -- 172.21.15.142:0/2995238587 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280157400 con 0x7f92801509d0 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927e7fc700 1 --2- 172.21.15.142:0/2995238587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92801509d0 0x7f928006ace0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f92740099b0 tx=0x7f9274009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537b68374801e2c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927dffb700 1 -- 172.21.15.142:0/2995238587 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400b820 con 0x7f92801509d0 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927dffb700 1 -- 172.21.15.142:0/2995238587 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927400b980 con 0x7f92801509d0 2023-09-30T22:56:28.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.068+0000 7f927dffb700 1 -- 172.21.15.142:0/2995238587 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400bd20 con 0x7f92801509d0 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 -- 172.21.15.142:0/2995238587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92801509d0 msgr2=0x7f928006ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 --2- 172.21.15.142:0/2995238587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92801509d0 0x7f928006ace0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f92740099b0 tx=0x7f9274009250 comp rx=0 tx=0).stop 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 -- 172.21.15.142:0/2995238587 shutdown_connections 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 --2- 172.21.15.142:0/2995238587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928006a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 --2- 172.21.15.142:0/2995238587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92801509d0 0x7f928006ace0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 -- 172.21.15.142:0/2995238587 >> 172.21.15.142:0/2995238587 conn(0x7f92800cc670 msgr2=0x7f92800cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 -- 172.21.15.142:0/2995238587 shutdown_connections 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.069+0000 7f92853ff700 1 -- 172.21.15.142:0/2995238587 wait complete. 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.070+0000 7f92853ff700 1 Processor -- start 2023-09-30T22:56:28.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.071+0000 7f92853ff700 1 -- start start 2023-09-30T22:56:28.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.071+0000 7f92853ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:28.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.071+0000 7f92853ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92801509d0 0x7f92800c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:28.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.071+0000 7f92853ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928015a920 0x7f928014def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:28.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.071+0000 7f92853ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92800c5830 con 0x7f928015a920 2023-09-30T22:56:28.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.071+0000 7f92853ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928014bec0 con 0x7f92801509d0 2023-09-30T22:56:28.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.071+0000 7f92853ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92800c4c20 con 0x7f9280150600 2023-09-30T22:56:28.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928015a920 0x7f928014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928015a920 0x7f928014def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51746/0 (socket says 172.21.15.142:51746) 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 -- 172.21.15.142:0/150152967 learned_addr learned my addr 172.21.15.142:0/150152967 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927effd700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927e7fc700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92801509d0 0x7f92800c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 -- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 msgr2=0x7f928014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928014b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 -- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92801509d0 msgr2=0x7f92800c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92801509d0 0x7f92800c0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 -- 172.21.15.142:0/150152967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740094f0 con 0x7f928015a920 2023-09-30T22:56:28.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927e7fc700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92801509d0 0x7f92800c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:28.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.072+0000 7f927f7fe700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928015a920 0x7f928014def0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f927800bc30 tx=0x7f9278009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:28.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.073+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800c9b0 con 0x7f928015a920 2023-09-30T22:56:28.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.073+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927800cb50 con 0x7f928015a920 2023-09-30T22:56:28.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.073+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92800c4f00 con 0x7f928015a920 2023-09-30T22:56:28.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.073+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278014410 con 0x7f928015a920 2023-09-30T22:56:28.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.073+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92800c54c0 con 0x7f928015a920 2023-09-30T22:56:28.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.074+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9280069a50 con 0x7f928015a920 2023-09-30T22:56:28.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.075+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9278014800 con 0x7f928015a920 2023-09-30T22:56:28.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.076+0000 7f9266ffd700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f926c067330 0x7f926c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:28.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.076+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f9278084d70 con 0x7f928015a920 2023-09-30T22:56:28.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.076+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=81}) v3 -- 0x7f926c06f890 con 0x7f928015a920 2023-09-30T22:56:28.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.076+0000 7f927effd700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f926c067330 0x7f926c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:28.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.076+0000 7f927effd700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f926c067330 0x7f926c0697e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9270006fd0 tx=0x7f9270008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:28.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.080+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9278051b50 con 0x7f928015a920 2023-09-30T22:56:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.313+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f928006fc10 con 0x7f928015a920 2023-09-30T22:56:28.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.853+0000 7f9266ffd700 1 -- 172.21.15.142:0/150152967 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9278055170 con 0x7f928015a920 2023-09-30T22:56:28.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f926c067330 msgr2=0x7f926c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f926c067330 0x7f926c0697e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9270006fd0 tx=0x7f9270008040 comp rx=0 tx=0).stop 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928015a920 msgr2=0x7f928014def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928015a920 0x7f928014def0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f927800bc30 tx=0x7f9278009820 comp rx=0 tx=0).stop 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 shutdown_connections 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f926c067330 0x7f926c0697e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f928015a920 0x7f928014def0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9280150600 0x7f928014b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 --2- 172.21.15.142:0/150152967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92801509d0 0x7f92800c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.856+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 >> 172.21.15.142:0/150152967 conn(0x7f92800cc670 msgr2=0x7f92800c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.857+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 shutdown_connections 2023-09-30T22:56:28.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:28.857+0000 7f92853ff700 1 -- 172.21.15.142:0/150152967 wait complete. 2023-09-30T22:56:28.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:56:29.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.110+0000 7f2a56dff700 1 Processor -- start 2023-09-30T22:56:29.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.110+0000 7f2a56dff700 1 -- start start 2023-09-30T22:56:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.111+0000 7f2a56dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a50159a10 0x7f2a500c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a56dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a500b1aa0 0x7f2a500ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a56dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a50068230 con 0x7f2a50159de0 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a56dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a500696d0 con 0x7f2a50159a10 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a56dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a50067620 con 0x7f2a500b1aa0 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a50159a10 0x7f2a500c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a50159a10 0x7f2a500c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51762/0 (socket says 172.21.15.142:51762) 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 -- 172.21.15.142:0/516387854 learned_addr learned my addr 172.21.15.142:0/516387854 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 -- 172.21.15.142:0/516387854 >> v2:172.21.15.148:3300/0 conn(0x7f2a500b1aa0 msgr2=0x7f2a500ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 --2- 172.21.15.142:0/516387854 >> v2:172.21.15.148:3300/0 conn(0x7f2a500b1aa0 0x7f2a500ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 -- 172.21.15.142:0/516387854 >> v1:172.21.15.148:6789/0 conn(0x7f2a50159de0 legacy=0x7f2a5015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 -- 172.21.15.142:0/516387854 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50067900 con 0x7f2a50159a10 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.112+0000 7f2a54b9b700 1 --2- 172.21.15.142:0/516387854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50159a10 0x7f2a500c9ed0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2a500c8e30 tx=0x7f2a44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c83be40489b012 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a4f7fe700 1 -- 172.21.15.142:0/516387854 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400b820 con 0x7f2a50159a10 2023-09-30T22:56:29.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a4f7fe700 1 -- 172.21.15.142:0/516387854 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4400b980 con 0x7f2a50159a10 2023-09-30T22:56:29.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a4f7fe700 1 -- 172.21.15.142:0/516387854 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400bd20 con 0x7f2a50159a10 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 -- 172.21.15.142:0/516387854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50159a10 msgr2=0x7f2a500c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 --2- 172.21.15.142:0/516387854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50159a10 0x7f2a500c9ed0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2a500c8e30 tx=0x7f2a44009250 comp rx=0 tx=0).stop 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 -- 172.21.15.142:0/516387854 shutdown_connections 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 --2- 172.21.15.142:0/516387854 >> v2:172.21.15.148:3300/0 conn(0x7f2a500b1aa0 0x7f2a500ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 --2- 172.21.15.142:0/516387854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50159a10 0x7f2a500c9ed0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 -- 172.21.15.142:0/516387854 >> 172.21.15.142:0/516387854 conn(0x7f2a500cb2f0 msgr2=0x7f2a500cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 -- 172.21.15.142:0/516387854 shutdown_connections 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.113+0000 7f2a56dff700 1 -- 172.21.15.142:0/516387854 wait complete. 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.115+0000 7f2a56dff700 1 Processor -- start 2023-09-30T22:56:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.115+0000 7f2a56dff700 1 -- start start 2023-09-30T22:56:29.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a56dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b1aa0 0x7f2a50154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:29.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a56dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a50159a10 0x7f2a500c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a56dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50159de0 0x7f2a500c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a56dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5015bbe0 con 0x7f2a500b1aa0 2023-09-30T22:56:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a56dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501568a0 con 0x7f2a50159de0 2023-09-30T22:56:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a56dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50156b80 con 0x7f2a50159a10 2023-09-30T22:56:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a54b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b1aa0 0x7f2a50154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a54b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b1aa0 0x7f2a50154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51774/0 (socket says 172.21.15.142:51774) 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a54b9b700 1 -- 172.21.15.142:0/2766090232 learned_addr learned my addr 172.21.15.142:0/2766090232 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a4ffff700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a50159a10 0x7f2a500c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a5539c700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50159de0 0x7f2a500c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.116+0000 7f2a54b9b700 1 -- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a50159a10 msgr2=0x7f2a500c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a54b9b700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a50159a10 0x7f2a500c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a54b9b700 1 -- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50159de0 msgr2=0x7f2a500c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a54b9b700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50159de0 0x7f2a500c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a54b9b700 1 -- 172.21.15.142:0/2766090232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440094f0 con 0x7f2a500b1aa0 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a5539c700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50159de0 0x7f2a500c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a54b9b700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b1aa0 0x7f2a50154470 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2a44003080 tx=0x7f2a44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44011e20 con 0x7f2a500b1aa0 2023-09-30T22:56:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4401f070 con 0x7f2a500b1aa0 2023-09-30T22:56:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a56dff700 1 -- 172.21.15.142:0/2766090232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5015b590 con 0x7f2a500b1aa0 2023-09-30T22:56:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4401a8a0 con 0x7f2a500b1aa0 2023-09-30T22:56:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.117+0000 7f2a56dff700 1 -- 172.21.15.142:0/2766090232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5016a4f0 con 0x7f2a500b1aa0 2023-09-30T22:56:29.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.118+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a280052b0 con 0x7f2a500b1aa0 2023-09-30T22:56:29.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.119+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2a4401ac90 con 0x7f2a500b1aa0 2023-09-30T22:56:29.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.120+0000 7f2a4cff9700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a34067330 0x7f2a340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:29.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.120+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f2a44021070 con 0x7f2a500b1aa0 2023-09-30T22:56:29.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.120+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=81}) v3 -- 0x7f2a3406f890 con 0x7f2a500b1aa0 2023-09-30T22:56:29.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.120+0000 7f2a4ffff700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a34067330 0x7f2a340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:29.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.121+0000 7f2a4ffff700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a34067330 0x7f2a340697e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c006fd0 tx=0x7f2a3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:29.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.124+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2a4402b020 con 0x7f2a500b1aa0 2023-09-30T22:56:29.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.316+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a28005560 con 0x7f2a500b1aa0 2023-09-30T22:56:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.865+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(81..81 src has 1..81) v4 ==== 1395+0+0 (secure 0 0 0) 0x7f2a4402e350 con 0x7f2a500b1aa0 2023-09-30T22:56:29.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.865+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=82}) v3 -- 0x7f2a3406dcc0 con 0x7f2a500b1aa0 2023-09-30T22:56:29.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.867+0000 7f2a4cff9700 1 -- 172.21.15.142:0/2766090232 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2a44053dd0 con 0x7f2a500b1aa0 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a34067330 msgr2=0x7f2a340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a34067330 0x7f2a340697e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c006fd0 tx=0x7f2a3c008040 comp rx=0 tx=0).stop 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b1aa0 msgr2=0x7f2a50154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b1aa0 0x7f2a50154470 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2a44003080 tx=0x7f2a44016000 comp rx=0 tx=0).stop 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 shutdown_connections 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a34067330 0x7f2a340697e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50159de0 0x7f2a500c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b1aa0 0x7f2a50154470 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 --2- 172.21.15.142:0/2766090232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a50159a10 0x7f2a500c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:29.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 >> 172.21.15.142:0/2766090232 conn(0x7f2a500cb2f0 msgr2=0x7f2a500c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:29.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 shutdown_connections 2023-09-30T22:56:29.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:29.870+0000 7f2a3a7fc700 1 -- 172.21.15.142:0/2766090232 wait complete. 2023-09-30T22:56:29.871 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:56:29.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:56:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.082+0000 7fd64a3ff700 1 Processor -- start 2023-09-30T22:56:30.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.082+0000 7fd64a3ff700 1 -- start start 2023-09-30T22:56:30.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.083+0000 7fd64a3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd64415a220 0x7fd6440cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:30.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.083+0000 7fd64a3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440d04e0 con 0x7fd6440cc280 2023-09-30T22:56:30.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.083+0000 7fd64a3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440cc8f0 con 0x7fd64415ac40 2023-09-30T22:56:30.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.083+0000 7fd64a3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64415a680 con 0x7fd64415a220 2023-09-30T22:56:30.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.083+0000 7fd6437fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd6440cc280 0x7fd64406a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40528/0 (socket says 172.21.15.142:40528) 2023-09-30T22:56:30.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd6437fe700 1 -- 172.21.15.142:0/3247774797 learned_addr learned my addr 172.21.15.142:0/3247774797 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:30.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd64899c700 1 --2- 172.21.15.142:0/3247774797 >> v2:172.21.15.142:3300/0 conn(0x7fd64415a220 0x7fd6440cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:30.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd642ffd700 1 -- 172.21.15.142:0/3247774797 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983624670 0 0) 0x7fd6440d04e0 con 0x7fd6440cc280 2023-09-30T22:56:30.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd64899c700 1 -- 172.21.15.142:0/3247774797 >> v1:172.21.15.148:6789/0 conn(0x7fd64415ac40 legacy=0x7fd6440cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:30.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd64899c700 1 -- 172.21.15.142:0/3247774797 >> v1:172.21.15.142:6789/0 conn(0x7fd6440cc280 legacy=0x7fd64406a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd64899c700 1 -- 172.21.15.142:0/3247774797 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440cf8d0 con 0x7fd64415a220 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd64899c700 1 --2- 172.21.15.142:0/3247774797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd6440cf180 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009e60 tx=0x7fd63c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba09db49d2130d69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd642ffd700 1 -- 172.21.15.142:0/3247774797 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00e070 con 0x7fd64415a220 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd642ffd700 1 -- 172.21.15.142:0/3247774797 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c00bc30 con 0x7fd64415a220 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.084+0000 7fd642ffd700 1 -- 172.21.15.142:0/3247774797 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c012430 con 0x7fd64415a220 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.085+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3247774797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 msgr2=0x7fd6440cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.085+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3247774797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd6440cf180 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009e60 tx=0x7fd63c009780 comp rx=0 tx=0).stop 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.085+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3247774797 shutdown_connections 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.085+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3247774797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd6440cf180 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.085+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3247774797 >> 172.21.15.142:0/3247774797 conn(0x7fd6440d0a80 msgr2=0x7fd6440d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:30.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.085+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3247774797 shutdown_connections 2023-09-30T22:56:30.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.085+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3247774797 wait complete. 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.087+0000 7fd64a3ff700 1 Processor -- start 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.087+0000 7fd64a3ff700 1 -- start start 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64a3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6440cc280 0x7fd64414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64a3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd64416def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64a3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd64415ac40 0x7fd644152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64a3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd644151d90 con 0x7fd64415a220 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64a3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64416ee20 con 0x7fd64415ac40 2023-09-30T22:56:30.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64a3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd644151a60 con 0x7fd6440cc280 2023-09-30T22:56:30.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd64416def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:30.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd64416def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51800/0 (socket says 172.21.15.142:51800) 2023-09-30T22:56:30.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 -- 172.21.15.142:0/3992711255 learned_addr learned my addr 172.21.15.142:0/3992711255 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64899c700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd64415ac40 0x7fd644152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd643fff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6440cc280 0x7fd64414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 -- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6440cc280 msgr2=0x7fd64414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6440cc280 0x7fd64414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 -- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd64415ac40 msgr2=0x7fd644152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd64415ac40 0x7fd644152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd6437fe700 1 -- 172.21.15.142:0/3992711255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c009a20 con 0x7fd64415a220 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd64899c700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd64415ac40 0x7fd644152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.088+0000 7fd643fff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6440cc280 0x7fd64414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.089+0000 7fd6437fe700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd64416def0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c7e0 tx=0x7fd638007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.089+0000 7fd62bfff700 1 -- 172.21.15.142:0/3992711255 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638005b30 con 0x7fd64415a220 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.089+0000 7fd62bfff700 1 -- 172.21.15.142:0/3992711255 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd638005c90 con 0x7fd64415a220 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.089+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64416e860 con 0x7fd64415a220 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.089+0000 7fd62bfff700 1 -- 172.21.15.142:0/3992711255 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638007300 con 0x7fd64415a220 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.089+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64414dde0 con 0x7fd64415a220 2023-09-30T22:56:30.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.090+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd644151f40 con 0x7fd64415a220 2023-09-30T22:56:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.091+0000 7fd62bfff700 1 -- 172.21.15.142:0/3992711255 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd63801b400 con 0x7fd64415a220 2023-09-30T22:56:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.092+0000 7fd62bfff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd630067330 0x7fd6300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.092+0000 7fd62bfff700 1 -- 172.21.15.142:0/3992711255 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5909+0+0 (secure 0 0 0) 0x7fd6380846e0 con 0x7fd64415a220 2023-09-30T22:56:30.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.092+0000 7fd643fff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd630067330 0x7fd6300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:30.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.093+0000 7fd643fff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd630067330 0x7fd6300697e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd644150c70 tx=0x7fd634009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:30.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.097+0000 7fd62bfff700 1 -- 172.21.15.142:0/3992711255 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd644151f40 con 0x7fd64415a220 2023-09-30T22:56:30.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.288+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd644151ed0 con 0x7fd64415a220 2023-09-30T22:56:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.877+0000 7fd62bfff700 1 -- 172.21.15.142:0/3992711255 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd6380550e0 con 0x7fd64415a220 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.880+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd630067330 msgr2=0x7fd6300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.880+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd630067330 0x7fd6300697e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd644150c70 tx=0x7fd634009040 comp rx=0 tx=0).stop 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.880+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 msgr2=0x7fd64416def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.880+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd64416def0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c7e0 tx=0x7fd638007df0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 shutdown_connections 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd630067330 0x7fd6300697e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd64415ac40 0x7fd644152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6440cc280 0x7fd64414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 --2- 172.21.15.142:0/3992711255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd64415a220 0x7fd64416def0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:30.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 >> 172.21.15.142:0/3992711255 conn(0x7fd6440d0a80 msgr2=0x7fd64414f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:30.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 shutdown_connections 2023-09-30T22:56:30.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:30.881+0000 7fd64a3ff700 1 -- 172.21.15.142:0/3992711255 wait complete. 2023-09-30T22:56:30.882 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:56:30.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T22:56:31.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.090+0000 7fb42e7ff700 1 Processor -- start 2023-09-30T22:56:31.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.091+0000 7fb42e7ff700 1 -- start start 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb42e7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb4280c6270 0x7fb4281580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb42e7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4280c40e0 0x7fb4280c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb42e7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4280c38d0 con 0x7fb428141150 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb42e7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4280c6aa0 con 0x7fb4280c40e0 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb42e7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4280c4a30 con 0x7fb4280c6270 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb427fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb428141150 0x7fb42815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34996/0 (socket says 172.21.15.142:34996) 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb42cd9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4280c40e0 0x7fb4280c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.092+0000 7fb427fff700 1 -- 172.21.15.142:0/1524792297 learned_addr learned my addr 172.21.15.142:0/1524792297 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb4277fe700 1 --2- 172.21.15.142:0/1524792297 >> v2:172.21.15.148:3300/0 conn(0x7fb4280c6270 0x7fb4281580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb42cd9c700 1 -- 172.21.15.142:0/1524792297 >> v2:172.21.15.148:3300/0 conn(0x7fb4280c6270 msgr2=0x7fb4281580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb42cd9c700 1 --2- 172.21.15.142:0/1524792297 >> v2:172.21.15.148:3300/0 conn(0x7fb4280c6270 0x7fb4281580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb42cd9c700 1 -- 172.21.15.142:0/1524792297 >> v1:172.21.15.142:6789/0 conn(0x7fb428141150 legacy=0x7fb42815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb42cd9c700 1 -- 172.21.15.142:0/1524792297 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42806a040 con 0x7fb4280c40e0 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb4277fe700 1 --2- 172.21.15.142:0/1524792297 >> v2:172.21.15.148:3300/0 conn(0x7fb4280c6270 0x7fb4281580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb426ffd700 1 -- 172.21.15.142:0/1524792297 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675539497 0 0) 0x7fb4280c38d0 con 0x7fb428141150 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb42cd9c700 1 --2- 172.21.15.142:0/1524792297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4280c44f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb4280c6d80 tx=0x7fb420009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db6b2f214643eeb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb426ffd700 1 -- 172.21.15.142:0/1524792297 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42000e070 con 0x7fb4280c40e0 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb426ffd700 1 -- 172.21.15.142:0/1524792297 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42000bc30 con 0x7fb4280c40e0 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.093+0000 7fb426ffd700 1 -- 172.21.15.142:0/1524792297 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420012430 con 0x7fb4280c40e0 2023-09-30T22:56:31.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 -- 172.21.15.142:0/1524792297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 msgr2=0x7fb4280c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/1524792297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4280c44f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb4280c6d80 tx=0x7fb420009780 comp rx=0 tx=0).stop 2023-09-30T22:56:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 -- 172.21.15.142:0/1524792297 shutdown_connections 2023-09-30T22:56:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/1524792297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4280c44f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/1524792297 >> v2:172.21.15.148:3300/0 conn(0x7fb4280c6270 0x7fb4281580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 -- 172.21.15.142:0/1524792297 >> 172.21.15.142:0/1524792297 conn(0x7fb4280cc670 msgr2=0x7fb4280cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 -- 172.21.15.142:0/1524792297 shutdown_connections 2023-09-30T22:56:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.094+0000 7fb42e7ff700 1 -- 172.21.15.142:0/1524792297 wait complete. 2023-09-30T22:56:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.096+0000 7fb42e7ff700 1 Processor -- start 2023-09-30T22:56:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.096+0000 7fb42e7ff700 1 -- start start 2023-09-30T22:56:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.097+0000 7fb42e7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4281361b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.097+0000 7fb42e7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4280c6270 0x7fb42813aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.097+0000 7fb42e7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb428141150 0x7fb42813b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.097+0000 7fb42e7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281376c0 con 0x7fb4280c40e0 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.097+0000 7fb42e7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281379a0 con 0x7fb4280c6270 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.097+0000 7fb42e7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb428137c80 con 0x7fb428141150 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4281361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4281361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47324/0 (socket says 172.21.15.142:47324) 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 -- 172.21.15.142:0/594241565 learned_addr learned my addr 172.21.15.142:0/594241565 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 -- 172.21.15.142:0/594241565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb428141150 msgr2=0x7fb42813b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb428141150 0x7fb42813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 -- 172.21.15.142:0/594241565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4280c6270 msgr2=0x7fb42813aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4280c6270 0x7fb42813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 -- 172.21.15.142:0/594241565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009a20 con 0x7fb4280c40e0 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb427fff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4281361b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c5b0 tx=0x7fb418001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb40ffff700 1 -- 172.21.15.142:0/594241565 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418005b30 con 0x7fb4280c40e0 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.098+0000 7fb40ffff700 1 -- 172.21.15.142:0/594241565 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418005c90 con 0x7fb4280c40e0 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.099+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb428137f60 con 0x7fb4280c40e0 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.099+0000 7fb40ffff700 1 -- 172.21.15.142:0/594241565 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418007300 con 0x7fb4280c40e0 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.099+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4281366f0 con 0x7fb4280c40e0 2023-09-30T22:56:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.100+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb428069a50 con 0x7fb4280c40e0 2023-09-30T22:56:31.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.100+0000 7fb40ffff700 1 -- 172.21.15.142:0/594241565 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb41801b3b0 con 0x7fb4280c40e0 2023-09-30T22:56:31.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.101+0000 7fb40ffff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb414067330 0x7fb4140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.101+0000 7fb40ffff700 1 -- 172.21.15.142:0/594241565 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb418083e90 con 0x7fb4280c40e0 2023-09-30T22:56:31.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.102+0000 7fb4277fe700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb414067330 0x7fb4140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.102+0000 7fb4277fe700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb414067330 0x7fb4140697e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb42813bc40 tx=0x7fb41c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:31.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.105+0000 7fb40ffff700 1 -- 172.21.15.142:0/594241565 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb418050ff0 con 0x7fb4280c40e0 2023-09-30T22:56:31.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.294+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb428157ea0 con 0x7fb4280c40e0 2023-09-30T22:56:31.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.300+0000 7fb40ffff700 1 -- 172.21.15.142:0/594241565 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb418054610 con 0x7fb4280c40e0 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb414067330 msgr2=0x7fb4140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb414067330 0x7fb4140697e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb42813bc40 tx=0x7fb41c008040 comp rx=0 tx=0).stop 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 msgr2=0x7fb4281361b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4281361b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c5b0 tx=0x7fb418001070 comp rx=0 tx=0).stop 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 shutdown_connections 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb414067330 0x7fb4140697e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb428141150 0x7fb42813b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4280c40e0 0x7fb4281361b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 --2- 172.21.15.142:0/594241565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4280c6270 0x7fb42813aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.302+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 >> 172.21.15.142:0/594241565 conn(0x7fb4280cc670 msgr2=0x7fb4280cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:31.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.303+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 shutdown_connections 2023-09-30T22:56:31.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.303+0000 7fb42e7ff700 1 -- 172.21.15.142:0/594241565 wait complete. 2023-09-30T22:56:31.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-09-30T22:56:31.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.511+0000 7f21983ff700 1 Processor -- start 2023-09-30T22:56:31.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.511+0000 7f21983ff700 1 -- start start 2023-09-30T22:56:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.512+0000 7f21983ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f219015de20 0x7f2190164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.512+0000 7f21983ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900cc6b0 con 0x7f21900692f0 2023-09-30T22:56:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f21983ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900cbaa0 con 0x7f2190143350 2023-09-30T22:56:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f21983ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900cbd80 con 0x7f219015de20 2023-09-30T22:56:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f219599a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f21900692f0 0x7f219015d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35012/0 (socket says 172.21.15.142:35012) 2023-09-30T22:56:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f219599a700 1 -- 172.21.15.142:0/1138651300 learned_addr learned my addr 172.21.15.142:0/1138651300 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:31.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f219699c700 1 --2- 172.21.15.142:0/1138651300 >> v2:172.21.15.148:3300/0 conn(0x7f219015de20 0x7f2190164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732683376 0 0) 0x7f21900cc6b0 con 0x7f21900692f0 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f217c003570 con 0x7f21900692f0 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2739988836 0 0) 0x7f217c003570 con 0x7f21900692f0 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 >> v2:172.21.15.148:3300/0 conn(0x7f219015de20 msgr2=0x7f2190164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f2195199700 1 --2- 172.21.15.142:0/1138651300 >> v2:172.21.15.148:3300/0 conn(0x7f219015de20 0x7f2190164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 >> v1:172.21.15.148:6789/0 conn(0x7f2190143350 legacy=0x7f21900cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.513+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900cc060 con 0x7f21900692f0 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f2180001470 con 0x7f21900692f0 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 >> v1:172.21.15.142:6789/0 conn(0x7f21900692f0 legacy=0x7f219015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f217c003a60 0x7f217c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c004810 0x7f217c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0051c0 0x7f217c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21900cbd80 con 0x7f217c003a60 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c00c0e0 con 0x7f217c0051c0 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c00c2a0 con 0x7f217c004810 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219619b700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f217c003a60 0x7f217c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219599a700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c004810 0x7f217c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219699c700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0051c0 0x7f217c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219619b700 1 -- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c004810 msgr2=0x7f217c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219619b700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c004810 0x7f217c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219619b700 1 -- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0051c0 msgr2=0x7f217c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219619b700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0051c0 0x7f217c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219619b700 1 -- 172.21.15.142:0/1138651300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c003570 con 0x7f217c003a60 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.514+0000 7f219699c700 1 -- 172.21.15.142:0/1138651300 reap_dead start 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f219619b700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f217c003a60 0x7f217c003e30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f218c0019a0 tx=0x7f218c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a557314ce9711c66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00c5d0 con 0x7f217c003a60 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00c750 con 0x7f217c003a60 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f2195199700 1 -- 172.21.15.142:0/1138651300 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00cb10 con 0x7f217c003a60 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f21983ff700 1 -- 172.21.15.142:0/1138651300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f217c003a60 msgr2=0x7f217c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f21983ff700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f217c003a60 0x7f217c003e30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f218c0019a0 tx=0x7f218c007d10 comp rx=0 tx=0).stop 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f21983ff700 1 -- 172.21.15.142:0/1138651300 shutdown_connections 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f21983ff700 1 --2- 172.21.15.142:0/1138651300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f217c003a60 0x7f217c003e30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f21983ff700 1 -- 172.21.15.142:0/1138651300 >> 172.21.15.142:0/1138651300 conn(0x7f21900ce8e0 msgr2=0x7f21900cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.515+0000 7f21983ff700 1 -- 172.21.15.142:0/1138651300 shutdown_connections 2023-09-30T22:56:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.516+0000 7f21983ff700 1 -- 172.21.15.142:0/1138651300 wait complete. 2023-09-30T22:56:31.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.517+0000 7f21983ff700 1 Processor -- start 2023-09-30T22:56:31.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.518+0000 7f21983ff700 1 -- start start 2023-09-30T22:56:31.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f21983ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c003a60 0x7f219015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f21983ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f219013d850 0x7f21900b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f21983ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190157b30 0x7f2190157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f21983ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21901569f0 con 0x7f2190157b30 2023-09-30T22:56:31.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f21983ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21901584e0 con 0x7f219013d850 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f21983ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21900b2820 con 0x7f217c003a60 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f219699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190157b30 0x7f2190157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f219699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190157b30 0x7f2190157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47340/0 (socket says 172.21.15.142:47340) 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f219699c700 1 -- 172.21.15.142:0/1773432644 learned_addr learned my addr 172.21.15.142:0/1773432644 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f219619b700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c003a60 0x7f219015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.519+0000 7f219599a700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f219013d850 0x7f21900b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f219699c700 1 -- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c003a60 msgr2=0x7f219015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f219699c700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c003a60 0x7f219015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f219699c700 1 -- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f219013d850 msgr2=0x7f21900b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f219699c700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f219013d850 0x7f21900b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f219699c700 1 -- 172.21.15.142:0/1773432644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900b2ce0 con 0x7f2190157b30 2023-09-30T22:56:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f219599a700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f219013d850 0x7f21900b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:31.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f219699c700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190157b30 0x7f2190157fa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f219015e220 tx=0x7f218800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:31.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f21867fc700 1 -- 172.21.15.142:0/1773432644 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800e040 con 0x7f2190157b30 2023-09-30T22:56:31.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f21867fc700 1 -- 172.21.15.142:0/1773432644 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800f040 con 0x7f2190157b30 2023-09-30T22:56:31.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f21867fc700 1 -- 172.21.15.142:0/1773432644 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800fd30 con 0x7f2190157b30 2023-09-30T22:56:31.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219015b030 con 0x7f2190157b30 2023-09-30T22:56:31.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.520+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219015b5f0 con 0x7f2190157b30 2023-09-30T22:56:31.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.521+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21900b2e70 con 0x7f2190157b30 2023-09-30T22:56:31.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.522+0000 7f21867fc700 1 -- 172.21.15.142:0/1773432644 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2188015640 con 0x7f2190157b30 2023-09-30T22:56:31.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.523+0000 7f21867fc700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2174067330 0x7f21740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:31.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.523+0000 7f21867fc700 1 -- 172.21.15.142:0/1773432644 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2188085380 con 0x7f2190157b30 2023-09-30T22:56:31.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.523+0000 7f219619b700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2174067330 0x7f21740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:31.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.524+0000 7f219619b700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2174067330 0x7f21740697e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f218c000ff0 tx=0x7f218c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:31.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.527+0000 7f21867fc700 1 -- 172.21.15.142:0/1773432644 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f21880524e0 con 0x7f2190157b30 2023-09-30T22:56:31.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:31.792+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f219006eae0 con 0x7f2190157b30 2023-09-30T22:56:32.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.393+0000 7f21867fc700 1 -- 172.21.15.142:0/1773432644 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v221) v1 ==== 134+0+0 (secure 0 0 0) 0x7f2188055b00 con 0x7f2190157b30 2023-09-30T22:56:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2174067330 msgr2=0x7f21740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2174067330 0x7f21740697e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f218c000ff0 tx=0x7f218c015000 comp rx=0 tx=0).stop 2023-09-30T22:56:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190157b30 msgr2=0x7f2190157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190157b30 0x7f2190157fa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f219015e220 tx=0x7f218800b040 comp rx=0 tx=0).stop 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 shutdown_connections 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2174067330 0x7f21740697e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190157b30 0x7f2190157fa0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f217c003a60 0x7f219015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 --2- 172.21.15.142:0/1773432644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f219013d850 0x7f21900b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 >> 172.21.15.142:0/1773432644 conn(0x7f21900ce8e0 msgr2=0x7f21900ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.396+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 shutdown_connections 2023-09-30T22:56:32.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.397+0000 7f21983ff700 1 -- 172.21.15.142:0/1773432644 wait complete. 2023-09-30T22:56:32.416 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-09-30T22:56:32.416 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-09-30T22:56:32.416 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-09-30T22:56:32.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-09-30T22:56:32.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.608+0000 7f00259ff700 1 Processor -- start 2023-09-30T22:56:32.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.608+0000 7f00259ff700 1 -- start start 2023-09-30T22:56:32.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.609+0000 7f00259ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00200692f0 0x7f002015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f00259ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200cc6b0 con 0x7f0020143350 2023-09-30T22:56:32.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f00259ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002015e050 con 0x7f002015dc50 2023-09-30T22:56:32.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f00259ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00200cbaa0 con 0x7f00200692f0 2023-09-30T22:56:32.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f001effd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0020143350 0x7f00200cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35028/0 (socket says 172.21.15.142:35028) 2023-09-30T22:56:32.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f001effd700 1 -- 172.21.15.142:0/3714539246 learned_addr learned my addr 172.21.15.142:0/3714539246 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:32.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555201212 0 0) 0x7f00200cc6b0 con 0x7f0020143350 2023-09-30T22:56:32.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0008003570 con 0x7f0020143350 2023-09-30T22:56:32.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.610+0000 7f001e7fc700 1 --2- 172.21.15.142:0/3714539246 >> v2:172.21.15.148:3300/0 conn(0x7f00200692f0 0x7f002015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2749425505 0 0) 0x7f0008003570 con 0x7f0020143350 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 >> v2:172.21.15.148:3300/0 conn(0x7f00200692f0 msgr2=0x7f002015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 --2- 172.21.15.142:0/3714539246 >> v2:172.21.15.148:3300/0 conn(0x7f00200692f0 0x7f002015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 >> v1:172.21.15.148:6789/0 conn(0x7f002015dc50 legacy=0x7f002006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200cbd80 con 0x7f0020143350 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f0010001470 con 0x7f0020143350 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 >> v1:172.21.15.142:6789/0 conn(0x7f0020143350 legacy=0x7f00200cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008003a60 0x7f0008003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0008004810 0x7f0008004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f000800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200cbaa0 con 0x7f00080051c0 2023-09-30T22:56:32.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000800c160 con 0x7f0008004810 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000800c320 con 0x7f0008003a60 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001f7fe700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f000800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001e7fc700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0008004810 0x7f0008004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001effd700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008003a60 0x7f0008003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001f7fe700 1 -- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008003a60 msgr2=0x7f0008003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001f7fe700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008003a60 0x7f0008003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001f7fe700 1 -- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0008004810 msgr2=0x7f0008004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.611+0000 7f001f7fe700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0008004810 0x7f0008004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f001f7fe700 1 -- 172.21.15.142:0/3714539246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008003570 con 0x7f00080051c0 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f001f7fe700 1 -- 172.21.15.142:0/3714539246 reap_dead start 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f001f7fe700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f000800ba60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0018001fc0 tx=0x7f0018001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf3917521dd823 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:32.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018001950 con 0x7f00080051c0 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800c8b0 con 0x7f00080051c0 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f001dffb700 1 -- 172.21.15.142:0/3714539246 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800cc50 con 0x7f00080051c0 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f00259ff700 1 -- 172.21.15.142:0/3714539246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 msgr2=0x7f000800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.612+0000 7f00259ff700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f000800ba60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0018001fc0 tx=0x7f0018001640 comp rx=0 tx=0).stop 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.613+0000 7f00259ff700 1 -- 172.21.15.142:0/3714539246 shutdown_connections 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.613+0000 7f00259ff700 1 --2- 172.21.15.142:0/3714539246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f000800ba60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.613+0000 7f00259ff700 1 -- 172.21.15.142:0/3714539246 >> 172.21.15.142:0/3714539246 conn(0x7f00200ce8e0 msgr2=0x7f00200cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.613+0000 7f00259ff700 1 -- 172.21.15.142:0/3714539246 shutdown_connections 2023-09-30T22:56:32.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.613+0000 7f00259ff700 1 -- 172.21.15.142:0/3714539246 wait complete. 2023-09-30T22:56:32.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.614+0000 7f00259ff700 1 Processor -- start 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.614+0000 7f00259ff700 1 -- start start 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f00259ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f002016a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f00259ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f002015a1c0 0x7f002015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f00259ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00200b10e0 0x7f002013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f00259ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200a5550 con 0x7f00080051c0 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f00259ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002016abd0 con 0x7f00200b10e0 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f00259ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002016aeb0 con 0x7f002015a1c0 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f001effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f002016a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f001effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f002016a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47368/0 (socket says 172.21.15.142:47368) 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.615+0000 7f001effd700 1 -- 172.21.15.142:0/1101894966 learned_addr learned my addr 172.21.15.142:0/1101894966 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001effd700 1 -- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f002015a1c0 msgr2=0x7f002015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001e7fc700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f002015a1c0 0x7f002015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001f7fe700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00200b10e0 0x7f002013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001effd700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f002015a1c0 0x7f002015d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001effd700 1 -- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00200b10e0 msgr2=0x7f002013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001effd700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00200b10e0 0x7f002013ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001effd700 1 -- 172.21.15.142:0/1101894966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200a57c0 con 0x7f00080051c0 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001e7fc700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f002015a1c0 0x7f002015d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001f7fe700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00200b10e0 0x7f002013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f001effd700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f002016a330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0010007390 tx=0x7f0010001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f0006ffd700 1 -- 172.21.15.142:0/1101894966 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010018030 con 0x7f00080051c0 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f0006ffd700 1 -- 172.21.15.142:0/1101894966 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0010007800 con 0x7f00080051c0 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002016a870 con 0x7f00080051c0 2023-09-30T22:56:32.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f0006ffd700 1 -- 172.21.15.142:0/1101894966 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000fb00 con 0x7f00080051c0 2023-09-30T22:56:32.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.616+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002015d630 con 0x7f00080051c0 2023-09-30T22:56:32.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.617+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002015d820 con 0x7f00080051c0 2023-09-30T22:56:32.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.618+0000 7f0006ffd700 1 -- 172.21.15.142:0/1101894966 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f001001b070 con 0x7f00080051c0 2023-09-30T22:56:32.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.619+0000 7f0006ffd700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f000c067330 0x7f000c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:32.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.619+0000 7f0006ffd700 1 -- 172.21.15.142:0/1101894966 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0010019070 con 0x7f00080051c0 2023-09-30T22:56:32.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.619+0000 7f001e7fc700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f000c067330 0x7f000c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:32.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.620+0000 7f001e7fc700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f000c067330 0x7f000c0697e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f002006b980 tx=0x7f0014008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:32.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.623+0000 7f0006ffd700 1 -- 172.21.15.142:0/1101894966 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0010051920 con 0x7f00080051c0 2023-09-30T22:56:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:32.886+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f00200cc060 con 0x7f00080051c0 2023-09-30T22:56:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.396+0000 7f0006ffd700 1 -- 172.21.15.142:0/1101894966 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v222) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0010054f40 con 0x7f00080051c0 2023-09-30T22:56:33.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f000c067330 msgr2=0x7f000c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:33.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f000c067330 0x7f000c0697e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f002006b980 tx=0x7f0014008040 comp rx=0 tx=0).stop 2023-09-30T22:56:33.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 msgr2=0x7f002016a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f002016a330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0010007390 tx=0x7f0010001e50 comp rx=0 tx=0).stop 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 shutdown_connections 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f000c067330 0x7f000c0697e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00200b10e0 0x7f002013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00080051c0 0x7f002016a330 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 --2- 172.21.15.142:0/1101894966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f002015a1c0 0x7f002015d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 >> 172.21.15.142:0/1101894966 conn(0x7f00200ce8e0 msgr2=0x7f0020140390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 shutdown_connections 2023-09-30T22:56:33.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.398+0000 7f00259ff700 1 -- 172.21.15.142:0/1101894966 wait complete. 2023-09-30T22:56:33.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-30T22:56:33.625 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_objectstore":"memstore"} 2023-09-30T22:56:33.625 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-30T22:56:33.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:56:33.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.818+0000 7fa3ab1ff700 1 Processor -- start 2023-09-30T22:56:33.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.818+0000 7fa3ab1ff700 1 -- start start 2023-09-30T22:56:33.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.819+0000 7fa3ab1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3a4159ba0 0x7fa3a406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:33.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.819+0000 7fa3ab1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40b0de0 0x7fa3a40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:33.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.819+0000 7fa3ab1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a4067d10 con 0x7fa3a40ca410 2023-09-30T22:56:33.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.819+0000 7fa3ab1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40ca850 con 0x7fa3a4159ba0 2023-09-30T22:56:33.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.819+0000 7fa3ab1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a406af90 con 0x7fa3a40b0de0 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a3fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40b0de0 0x7fa3a40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a3fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40b0de0 0x7fa3a40c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:54742/0 (socket says 172.21.15.142:54742) 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a8f9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3a4159ba0 0x7fa3a406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a3fff700 1 -- 172.21.15.142:0/2022971963 learned_addr learned my addr 172.21.15.142:0/2022971963 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a8f9b700 1 -- 172.21.15.142:0/2022971963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40b0de0 msgr2=0x7fa3a40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a8f9b700 1 --2- 172.21.15.142:0/2022971963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40b0de0 0x7fa3a40c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a8f9b700 1 -- 172.21.15.142:0/2022971963 >> v1:172.21.15.148:6789/0 conn(0x7fa3a40ca410 legacy=0x7fa3a415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.820+0000 7fa3a8f9b700 1 -- 172.21.15.142:0/2022971963 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40676c0 con 0x7fa3a4159ba0 2023-09-30T22:56:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.821+0000 7fa3a8f9b700 1 --2- 172.21.15.142:0/2022971963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 0x7fa3a406a8d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3980098e0 tx=0x7fa3980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc0254f68a2a8763 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:33.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.821+0000 7fa3a37fe700 1 -- 172.21.15.142:0/2022971963 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39800b640 con 0x7fa3a4159ba0 2023-09-30T22:56:33.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.821+0000 7fa3a37fe700 1 -- 172.21.15.142:0/2022971963 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39800b7a0 con 0x7fa3a4159ba0 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.821+0000 7fa3a37fe700 1 -- 172.21.15.142:0/2022971963 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39800bb40 con 0x7fa3a4159ba0 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/2022971963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 msgr2=0x7fa3a406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/2022971963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 0x7fa3a406a8d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3980098e0 tx=0x7fa3980091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/2022971963 shutdown_connections 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/2022971963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 0x7fa3a406a8d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/2022971963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40b0de0 0x7fa3a40c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/2022971963 >> 172.21.15.142:0/2022971963 conn(0x7fa3a40cb2f0 msgr2=0x7fa3a40cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/2022971963 shutdown_connections 2023-09-30T22:56:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.822+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/2022971963 wait complete. 2023-09-30T22:56:33.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.823+0000 7fa3ab1ff700 1 Processor -- start 2023-09-30T22:56:33.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.824+0000 7fa3ab1ff700 1 -- start start 2023-09-30T22:56:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.824+0000 7fa3ab1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a40b0de0 0x7fa3a415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.824+0000 7fa3ab1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40ca410 0x7fa3a416e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3ab1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 0x7fa3a4158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3ab1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415c790 con 0x7fa3a40b0de0 2023-09-30T22:56:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3ab1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40c8560 con 0x7fa3a4159ba0 2023-09-30T22:56:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3ab1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415b770 con 0x7fa3a40ca410 2023-09-30T22:56:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a40b0de0 0x7fa3a415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a40b0de0 0x7fa3a415c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47376/0 (socket says 172.21.15.142:47376) 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 -- 172.21.15.142:0/3446489167 learned_addr learned my addr 172.21.15.142:0/3446489167 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a3fff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40ca410 0x7fa3a416e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a979c700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 0x7fa3a4158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 -- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40ca410 msgr2=0x7fa3a416e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40ca410 0x7fa3a416e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 -- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 msgr2=0x7fa3a4158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 0x7fa3a4158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 -- 172.21.15.142:0/3446489167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398009420 con 0x7fa3a40b0de0 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.825+0000 7fa3a8f9b700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a40b0de0 0x7fa3a415c250 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa3a406c8d0 tx=0x7fa398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.826+0000 7fa3a0ff9700 1 -- 172.21.15.142:0/3446489167 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39801bda0 con 0x7fa3a40b0de0 2023-09-30T22:56:33.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.826+0000 7fa3a0ff9700 1 -- 172.21.15.142:0/3446489167 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398011420 con 0x7fa3a40b0de0 2023-09-30T22:56:33.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.826+0000 7fa3a0ff9700 1 -- 172.21.15.142:0/3446489167 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980117e0 con 0x7fa3a40b0de0 2023-09-30T22:56:33.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.826+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a415ba50 con 0x7fa3a40b0de0 2023-09-30T22:56:33.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.826+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a416e870 con 0x7fa3a40b0de0 2023-09-30T22:56:33.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.827+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a406e4b0 con 0x7fa3a40b0de0 2023-09-30T22:56:33.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.828+0000 7fa3a0ff9700 1 -- 172.21.15.142:0/3446489167 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa398011b90 con 0x7fa3a40b0de0 2023-09-30T22:56:33.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.829+0000 7fa3a0ff9700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa388067330 0x7fa3880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:33.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.829+0000 7fa3a0ff9700 1 -- 172.21.15.142:0/3446489167 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa398085f00 con 0x7fa3a40b0de0 2023-09-30T22:56:33.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.829+0000 7fa3a3fff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa388067330 0x7fa3880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:33.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.829+0000 7fa3a3fff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa388067330 0x7fa3880697e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40c7f50 tx=0x7fa390008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:33.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:33.833+0000 7fa3a0ff9700 1 -- 172.21.15.142:0/3446489167 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa3980531b0 con 0x7fa3a40b0de0 2023-09-30T22:56:34.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.021+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa3a40679a0 con 0x7fa3a40b0de0 2023-09-30T22:56:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.025+0000 7fa3a0ff9700 1 -- 172.21.15.142:0/3446489167 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa3980567d0 con 0x7fa3a40b0de0 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa388067330 msgr2=0x7fa3880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa388067330 0x7fa3880697e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40c7f50 tx=0x7fa390008040 comp rx=0 tx=0).stop 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a40b0de0 msgr2=0x7fa3a415c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a40b0de0 0x7fa3a415c250 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa3a406c8d0 tx=0x7fa398017000 comp rx=0 tx=0).stop 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 shutdown_connections 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa388067330 0x7fa3880697e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4159ba0 0x7fa3a4158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a40b0de0 0x7fa3a415c250 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 --2- 172.21.15.142:0/3446489167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3a40ca410 0x7fa3a416e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.027+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 >> 172.21.15.142:0/3446489167 conn(0x7fa3a40cb2f0 msgr2=0x7fa3a40ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.028+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 shutdown_connections 2023-09-30T22:56:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.028+0000 7fa3ab1ff700 1 -- 172.21.15.142:0/3446489167 wait complete. 2023-09-30T22:56:34.045 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:56:34.045 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:56:34.146 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:56:34.250 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:56:34.250 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:56:34.251 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:34.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.442+0000 7f961a1ff700 1 Processor -- start 2023-09-30T22:56:34.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.442+0000 7f961a1ff700 1 -- start start 2023-09-30T22:56:34.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.443+0000 7f961a1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96140b1580 0x7f96140adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.443+0000 7f961a1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140ad630 con 0x7f96140ae000 2023-09-30T22:56:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.443+0000 7f961a1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140b3360 con 0x7f96140b1950 2023-09-30T22:56:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.443+0000 7f961a1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9614157c20 con 0x7f96140b1580 2023-09-30T22:56:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f9613fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f96140ae000 0x7f961406a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35034/0 (socket says 172.21.15.142:35034) 2023-09-30T22:56:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f9613fff700 1 -- 172.21.15.142:0/2652170626 learned_addr learned my addr 172.21.15.142:0/2652170626 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96137fe700 1 --2- 172.21.15.142:0/2652170626 >> v2:172.21.15.148:3300/0 conn(0x7f96140b1580 0x7f96140adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96127fc700 1 -- 172.21.15.142:0/2652170626 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988125284 0 0) 0x7f96140ad630 con 0x7f96140ae000 2023-09-30T22:56:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96127fc700 1 -- 172.21.15.142:0/2652170626 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95fc003570 con 0x7f96140ae000 2023-09-30T22:56:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96127fc700 1 -- 172.21.15.142:0/2652170626 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063863537 0 0) 0x7f96140b3360 con 0x7f96140b1950 2023-09-30T22:56:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96127fc700 1 -- 172.21.15.142:0/2652170626 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96140ad630 con 0x7f96140b1950 2023-09-30T22:56:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96137fe700 1 -- 172.21.15.142:0/2652170626 >> v1:172.21.15.148:6789/0 conn(0x7f96140b1950 legacy=0x7f961415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96137fe700 1 -- 172.21.15.142:0/2652170626 >> v1:172.21.15.142:6789/0 conn(0x7f96140ae000 legacy=0x7f961406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.444+0000 7f96137fe700 1 -- 172.21.15.142:0/2652170626 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961415ad60 con 0x7f96140b1580 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.445+0000 7f96137fe700 1 --2- 172.21.15.142:0/2652170626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f96140adac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f96040098e0 tx=0x7f96040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa8df3a110b7a2ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.445+0000 7f96127fc700 1 -- 172.21.15.142:0/2652170626 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604011630 con 0x7f96140b1580 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.445+0000 7f96127fc700 1 -- 172.21.15.142:0/2652170626 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604011790 con 0x7f96140b1580 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.445+0000 7f96127fc700 1 -- 172.21.15.142:0/2652170626 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604011b30 con 0x7f96140b1580 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.445+0000 7f961a1ff700 1 -- 172.21.15.142:0/2652170626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 msgr2=0x7f96140adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.445+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2652170626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f96140adac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f96040098e0 tx=0x7f96040091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.446+0000 7f961a1ff700 1 -- 172.21.15.142:0/2652170626 shutdown_connections 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.446+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2652170626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f96140adac0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.446+0000 7f961a1ff700 1 -- 172.21.15.142:0/2652170626 >> 172.21.15.142:0/2652170626 conn(0x7f96140ce1f0 msgr2=0x7f9614069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:34.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.446+0000 7f961a1ff700 1 -- 172.21.15.142:0/2652170626 shutdown_connections 2023-09-30T22:56:34.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.446+0000 7f961a1ff700 1 -- 172.21.15.142:0/2652170626 wait complete. 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.447+0000 7f961a1ff700 1 Processor -- start 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.447+0000 7f961a1ff700 1 -- start start 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f961a1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96140ae000 0x7f961414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f961a1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f961416a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f961a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96140b1950 0x7f9614067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f961a1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140cc090 con 0x7f96140ae000 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f961a1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140a98c0 con 0x7f96140b1580 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f961a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140a9ba0 con 0x7f96140b1950 2023-09-30T22:56:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f96137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96140ae000 0x7f961414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f96137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96140ae000 0x7f961414c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47386/0 (socket says 172.21.15.142:47386) 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f96137fe700 1 -- 172.21.15.142:0/2283364445 learned_addr learned my addr 172.21.15.142:0/2283364445 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.448+0000 7f9612ffd700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f961416a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f9613fff700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96140b1950 0x7f9614067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f96137fe700 1 -- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96140b1950 msgr2=0x7f9614067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f96137fe700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96140b1950 0x7f9614067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f96137fe700 1 -- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 msgr2=0x7f961416a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f96137fe700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f961416a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f96137fe700 1 -- 172.21.15.142:0/2283364445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604009420 con 0x7f96140ae000 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f9612ffd700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f961416a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:34.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f96137fe700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96140ae000 0x7f961414c1f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f96140706b0 tx=0x7f9604017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:34.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f95fb7fe700 1 -- 172.21.15.142:0/2283364445 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960401f070 con 0x7f96140ae000 2023-09-30T22:56:34.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f95fb7fe700 1 -- 172.21.15.142:0/2283364445 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604000c90 con 0x7f96140ae000 2023-09-30T22:56:34.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96140a9e80 con 0x7f96140ae000 2023-09-30T22:56:34.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f95fb7fe700 1 -- 172.21.15.142:0/2283364445 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604025420 con 0x7f96140ae000 2023-09-30T22:56:34.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.449+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961414c730 con 0x7f96140ae000 2023-09-30T22:56:34.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.450+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961406d600 con 0x7f96140ae000 2023-09-30T22:56:34.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.451+0000 7f95fb7fe700 1 -- 172.21.15.142:0/2283364445 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9604023070 con 0x7f96140ae000 2023-09-30T22:56:34.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.452+0000 7f95fb7fe700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9600067330 0x7f96000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.452+0000 7f95fb7fe700 1 -- 172.21.15.142:0/2283364445 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9604085d00 con 0x7f96140ae000 2023-09-30T22:56:34.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.452+0000 7f9612ffd700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9600067330 0x7f96000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.453+0000 7f9612ffd700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9600067330 0x7f96000697e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f96140cccb0 tx=0x7f9608009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:34.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.457+0000 7f95fb7fe700 1 -- 172.21.15.142:0/2283364445 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9604052e60 con 0x7f96140ae000 2023-09-30T22:56:34.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.688+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f961415b040 con 0x7f96140ae000 2023-09-30T22:56:34.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.688+0000 7f95fb7fe700 1 -- 172.21.15.142:0/2283364445 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f960402a090 con 0x7f96140ae000 2023-09-30T22:56:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:34.689 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/990087431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":990087431},{"type":"v1","addr":"172.21.15.148:6835","nonce":990087431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2397688505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2397688505},{"type":"v1","addr":"172.21.15.148:6834","nonce":2397688505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2069009816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2069009816},{"type":"v1","addr":"172.21.15.142:6836","nonce":2069009816}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3407680186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3407680186},{"type":"v1","addr":"172.21.15.142:6837","nonce":3407680186}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-09-30T22:56:34.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9600067330 msgr2=0x7f96000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9600067330 0x7f96000697e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f96140cccb0 tx=0x7f9608009040 comp rx=0 tx=0).stop 2023-09-30T22:56:34.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96140ae000 msgr2=0x7f961414c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96140ae000 0x7f961414c1f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f96140706b0 tx=0x7f9604017000 comp rx=0 tx=0).stop 2023-09-30T22:56:34.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 shutdown_connections 2023-09-30T22:56:34.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9600067330 0x7f96000697e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96140b1950 0x7f9614067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96140ae000 0x7f961414c1f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 --2- 172.21.15.142:0/2283364445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140b1580 0x7f961416a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 >> 172.21.15.142:0/2283364445 conn(0x7f96140ce1f0 msgr2=0x7f96140c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:34.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 shutdown_connections 2023-09-30T22:56:34.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.691+0000 7f961a1ff700 1 -- 172.21.15.142:0/2283364445 wait complete. 2023-09-30T22:56:34.692 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2023-09-30T22:56:34.708 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:56:34.709 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:56:34.709 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:56:34.709 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:56:34.709 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:56:34.709 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:56:34.709 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:56:34.710 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:56:34.710 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:56:34.710 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:56:34.710 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:56:34.710 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:56:34.710 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:56:34.710 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:56:34.711 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:56:34.711 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:56:34.723 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:56:34.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:56:34.725 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:56:34.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:56:34.726 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:56:34.726 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:56:34.727 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:56:34.727 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:56:34.768 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:56:34.768 DEBUG:teuthology.parallel:result is None 2023-09-30T22:56:34.770 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:56:34.771 DEBUG:teuthology.parallel:result is None 2023-09-30T22:56:34.771 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:56:34.771 DEBUG:teuthology.parallel:result is None 2023-09-30T22:56:34.773 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:56:34.773 DEBUG:teuthology.parallel:result is None 2023-09-30T22:56:34.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:56:34.913 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:56:34.914 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:56:34.919 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:56:34.919 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:56:34.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.976+0000 7fbfbf5ff700 1 Processor -- start 2023-09-30T22:56:34.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.976+0000 7fbfbf5ff700 1 -- start start 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.977+0000 7fbfbf5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbfb815ac70 0x7fbfb806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.977+0000 7fbfbf5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb815dde0 con 0x7fbfb80c6da0 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.977+0000 7fbfbf5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb806b840 con 0x7fbfb806d3f0 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.977+0000 7fbfbf5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb815d7d0 con 0x7fbfb815ac70 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfbcb9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbfb80c6da0 0x7fbfb8159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35056/0 (socket says 172.21.15.142:35056) 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfbcb9a700 1 -- 172.21.15.142:0/3624090947 learned_addr learned my addr 172.21.15.142:0/3624090947 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfbdb9c700 1 --2- 172.21.15.142:0/3624090947 >> v2:172.21.15.148:3300/0 conn(0x7fbfb815ac70 0x7fbfb806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfaffff700 1 -- 172.21.15.142:0/3624090947 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734161293 0 0) 0x7fbfb815dde0 con 0x7fbfb80c6da0 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfaffff700 1 -- 172.21.15.142:0/3624090947 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa4003570 con 0x7fbfb80c6da0 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfbdb9c700 1 -- 172.21.15.142:0/3624090947 >> v1:172.21.15.148:6789/0 conn(0x7fbfb806d3f0 legacy=0x7fbfb806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfbdb9c700 1 -- 172.21.15.142:0/3624090947 >> v1:172.21.15.142:6789/0 conn(0x7fbfb80c6da0 legacy=0x7fbfb8159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.978+0000 7fbfbdb9c700 1 -- 172.21.15.142:0/3624090947 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb80c7230 con 0x7fbfb815ac70 2023-09-30T22:56:34.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfbdb9c700 1 --2- 172.21.15.142:0/3624090947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb815ac70 0x7fbfb806d7c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009e60 tx=0x7fbfb0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5650f793e219abeb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:34.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfaffff700 1 -- 172.21.15.142:0/3624090947 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000e070 con 0x7fbfb815ac70 2023-09-30T22:56:34.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfaffff700 1 -- 172.21.15.142:0/3624090947 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb000bb60 con 0x7fbfb815ac70 2023-09-30T22:56:34.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfaffff700 1 -- 172.21.15.142:0/3624090947 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0012430 con 0x7fbfb815ac70 2023-09-30T22:56:34.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/3624090947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb815ac70 msgr2=0x7fbfb806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/3624090947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb815ac70 0x7fbfb806d7c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009e60 tx=0x7fbfb0009780 comp rx=0 tx=0).stop 2023-09-30T22:56:34.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/3624090947 shutdown_connections 2023-09-30T22:56:34.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/3624090947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb815ac70 0x7fbfb806d7c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.979+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/3624090947 >> 172.21.15.142:0/3624090947 conn(0x7fbfb8067e30 msgr2=0x7fbfb8068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:34.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.980+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/3624090947 shutdown_connections 2023-09-30T22:56:34.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.980+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/3624090947 wait complete. 2023-09-30T22:56:34.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.981+0000 7fbfbf5ff700 1 Processor -- start 2023-09-30T22:56:34.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.981+0000 7fbfbf5ff700 1 -- start start 2023-09-30T22:56:34.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbf5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb806d3f0 0x7fbfb80cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbf5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb80c6da0 0x7fbfb816cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbf5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb816ae40 0x7fbfb811afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbf5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb816b370 con 0x7fbfb80c6da0 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbf5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80cbd70 con 0x7fbfb816ae40 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbf5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80cc050 con 0x7fbfb806d3f0 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbcb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb80c6da0 0x7fbfb816cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbcb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb80c6da0 0x7fbfb816cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47436/0 (socket says 172.21.15.142:47436) 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbcb9a700 1 -- 172.21.15.142:0/249075602 learned_addr learned my addr 172.21.15.142:0/249075602 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbdb9c700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb816ae40 0x7fbfb811afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.982+0000 7fbfbd39b700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb806d3f0 0x7fbfb80cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbcb9a700 1 -- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb806d3f0 msgr2=0x7fbfb80cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbcb9a700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb806d3f0 0x7fbfb80cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbcb9a700 1 -- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb816ae40 msgr2=0x7fbfb811afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbcb9a700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb816ae40 0x7fbfb811afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbcb9a700 1 -- 172.21.15.142:0/249075602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0009a20 con 0x7fbfb80c6da0 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbcb9a700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb80c6da0 0x7fbfb816cf00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800c7c0 tx=0x7fbfa8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfad7fa700 1 -- 172.21.15.142:0/249075602 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8005cd0 con 0x7fbfb80c6da0 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfad7fa700 1 -- 172.21.15.142:0/249075602 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa8005e30 con 0x7fbfb80c6da0 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb80cc330 con 0x7fbfb80c6da0 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfad7fa700 1 -- 172.21.15.142:0/249075602 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8007320 con 0x7fbfb80c6da0 2023-09-30T22:56:34.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.983+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb80cba00 con 0x7fbfb80c6da0 2023-09-30T22:56:34.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.984+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb80cc7d0 con 0x7fbfb80c6da0 2023-09-30T22:56:34.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.985+0000 7fbfad7fa700 1 -- 172.21.15.142:0/249075602 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbfa801b3b0 con 0x7fbfb80c6da0 2023-09-30T22:56:34.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.986+0000 7fbfad7fa700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf9c067330 0x7fbf9c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:34.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.986+0000 7fbfad7fa700 1 -- 172.21.15.142:0/249075602 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbfa8083f20 con 0x7fbfb80c6da0 2023-09-30T22:56:34.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.986+0000 7fbfbd39b700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf9c067330 0x7fbf9c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:34.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.987+0000 7fbfbd39b700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf9c067330 0x7fbf9c0697e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8153740 tx=0x7fbfb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:34.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:34.990+0000 7fbfad7fa700 1 -- 172.21.15.142:0/249075602 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbfb80cc7d0 con 0x7fbfb80c6da0 2023-09-30T22:56:35.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:35.206+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbfb80cc7d0 con 0x7fbfb80c6da0 2023-09-30T22:56:36.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.051+0000 7fbfad7fa700 1 -- 172.21.15.142:0/249075602 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbfb80cc7d0 con 0x7fbfb80c6da0 2023-09-30T22:56:36.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf9c067330 msgr2=0x7fbf9c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf9c067330 0x7fbf9c0697e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8153740 tx=0x7fbfb4009040 comp rx=0 tx=0).stop 2023-09-30T22:56:36.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb80c6da0 msgr2=0x7fbfb816cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb80c6da0 0x7fbfb816cf00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800c7c0 tx=0x7fbfa8007e00 comp rx=0 tx=0).stop 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 shutdown_connections 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf9c067330 0x7fbf9c0697e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb816ae40 0x7fbfb811afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbfb806d3f0 0x7fbfb80cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 --2- 172.21.15.142:0/249075602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb80c6da0 0x7fbfb816cf00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 >> 172.21.15.142:0/249075602 conn(0x7fbfb8067e30 msgr2=0x7fbfb80cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 shutdown_connections 2023-09-30T22:56:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.054+0000 7fbfbf5ff700 1 -- 172.21.15.142:0/249075602 wait complete. 2023-09-30T22:56:36.056 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:56:36.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:56:36.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.264+0000 7f424c9ff700 1 Processor -- start 2023-09-30T22:56:36.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.264+0000 7f424c9ff700 1 -- start start 2023-09-30T22:56:36.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.265+0000 7f424c9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f424815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.265+0000 7f424c9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f424815dc50 0x7f424806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.265+0000 7f424c9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424815e0b0 con 0x7f4248143350 2023-09-30T22:56:36.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.265+0000 7f424c9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480cc6b0 con 0x7f424815dc50 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.265+0000 7f424c9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42480cbaa0 con 0x7f42480692f0 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f424659c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4248143350 0x7f42480cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35064/0 (socket says 172.21.15.142:35064) 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f424659c700 1 -- 172.21.15.142:0/3422378102 learned_addr learned my addr 172.21.15.142:0/3422378102 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f4245d9b700 1 --2- 172.21.15.142:0/3422378102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f424815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f4246d9d700 1 --2- 172.21.15.142:0/3422378102 >> v2:172.21.15.148:3300/0 conn(0x7f424815dc50 0x7f424806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f424559a700 1 -- 172.21.15.142:0/3422378102 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999398952 0 0) 0x7f4238001110 con 0x7f4248143350 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f424559a700 1 -- 172.21.15.142:0/3422378102 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4230003570 con 0x7f4248143350 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f4245d9b700 1 -- 172.21.15.142:0/3422378102 >> v2:172.21.15.148:3300/0 conn(0x7f424815dc50 msgr2=0x7f424806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f4245d9b700 1 --2- 172.21.15.142:0/3422378102 >> v2:172.21.15.148:3300/0 conn(0x7f424815dc50 0x7f424806a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f4245d9b700 1 -- 172.21.15.142:0/3422378102 >> v1:172.21.15.142:6789/0 conn(0x7f4248143350 legacy=0x7f42480cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f4245d9b700 1 -- 172.21.15.142:0/3422378102 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480cbd80 con 0x7f42480692f0 2023-09-30T22:56:36.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.266+0000 7f4246d9d700 1 --2- 172.21.15.142:0/3422378102 >> v2:172.21.15.148:3300/0 conn(0x7f424815dc50 0x7f424806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.267+0000 7f4245d9b700 1 --2- 172.21.15.142:0/3422378102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f424815d710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f423c0098e0 tx=0x7f423c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c1ef5e2f8c7a1b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.267+0000 7f424559a700 1 -- 172.21.15.142:0/3422378102 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c011630 con 0x7f42480692f0 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.267+0000 7f424559a700 1 -- 172.21.15.142:0/3422378102 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c011790 con 0x7f42480692f0 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.267+0000 7f424559a700 1 -- 172.21.15.142:0/3422378102 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c011b30 con 0x7f42480692f0 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 -- 172.21.15.142:0/3422378102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 msgr2=0x7f424815d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 --2- 172.21.15.142:0/3422378102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f424815d710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f423c0098e0 tx=0x7f423c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 -- 172.21.15.142:0/3422378102 shutdown_connections 2023-09-30T22:56:36.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 --2- 172.21.15.142:0/3422378102 >> v2:172.21.15.148:3300/0 conn(0x7f424815dc50 0x7f424806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 --2- 172.21.15.142:0/3422378102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f424815d710 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 -- 172.21.15.142:0/3422378102 >> 172.21.15.142:0/3422378102 conn(0x7f42480ce8e0 msgr2=0x7f42480cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:36.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 -- 172.21.15.142:0/3422378102 shutdown_connections 2023-09-30T22:56:36.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.268+0000 7f424c9ff700 1 -- 172.21.15.142:0/3422378102 wait complete. 2023-09-30T22:56:36.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.269+0000 7f424c9ff700 1 Processor -- start 2023-09-30T22:56:36.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.269+0000 7f424c9ff700 1 -- start start 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f424c9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f42480b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f424c9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4248143350 0x7f424816a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f424c9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f424815dc50 0x7f42480a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f424c9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424813fe10 con 0x7f424815dc50 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f424c9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424815b0d0 con 0x7f4248143350 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f424c9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424815a1e0 con 0x7f42480692f0 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f4246d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f424815dc50 0x7f42480a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.270+0000 7f4246d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f424815dc50 0x7f42480a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47444/0 (socket says 172.21.15.142:47444) 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4246d9d700 1 -- 172.21.15.142:0/312886304 learned_addr learned my addr 172.21.15.142:0/312886304 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f424659c700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f42480b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4245d9b700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4248143350 0x7f424816a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4246d9d700 1 -- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 msgr2=0x7f42480b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4246d9d700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f42480b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4246d9d700 1 -- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4248143350 msgr2=0x7f424816a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4246d9d700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4248143350 0x7f424816a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4246d9d700 1 -- 172.21.15.142:0/312886304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009a20 con 0x7f424815dc50 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f4246d9d700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f424815dc50 0x7f42480a5ed0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4240009f20 tx=0x7f424000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f42367fc700 1 -- 172.21.15.142:0/312886304 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000cc80 con 0x7f424815dc50 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f42367fc700 1 -- 172.21.15.142:0/312886304 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000f040 con 0x7f424815dc50 2023-09-30T22:56:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c009420 con 0x7f424815dc50 2023-09-30T22:56:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f42367fc700 1 -- 172.21.15.142:0/312886304 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240014480 con 0x7f424815dc50 2023-09-30T22:56:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.271+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424815a7a0 con 0x7f424815dc50 2023-09-30T22:56:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.272+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424815b260 con 0x7f424815dc50 2023-09-30T22:56:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.273+0000 7f42367fc700 1 -- 172.21.15.142:0/312886304 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4240003020 con 0x7f424815dc50 2023-09-30T22:56:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.275+0000 7f42367fc700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4228067330 0x7f42280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.275+0000 7f42367fc700 1 -- 172.21.15.142:0/312886304 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4240085330 con 0x7f424815dc50 2023-09-30T22:56:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.275+0000 7f424659c700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4228067330 0x7f42280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.275+0000 7f424659c700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4228067330 0x7f42280697e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4238001270 tx=0x7f4238009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:36.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.279+0000 7f42367fc700 1 -- 172.21.15.142:0/312886304 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f42400524e0 con 0x7f424815dc50 2023-09-30T22:56:36.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.545+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f424806fc10 con 0x7f424815dc50 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.545+0000 7f42367fc700 1 -- 172.21.15.142:0/312886304 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4240055b00 con 0x7f424815dc50 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.546 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:56:36.547 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.548 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.549 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.550 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:56:36.552 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.553 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:56:36.555 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.556 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:56:36.557 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:56:36.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:56:36.560 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:56:36.561 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:56:36.561 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:56:36.561 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:56:36.561 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.561 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:36.561 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:56:36.561 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:56:36.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4228067330 msgr2=0x7f42280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4228067330 0x7f42280697e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4238001270 tx=0x7f4238009040 comp rx=0 tx=0).stop 2023-09-30T22:56:36.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f424815dc50 msgr2=0x7f42480a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f424815dc50 0x7f42480a5ed0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4240009f20 tx=0x7f424000b040 comp rx=0 tx=0).stop 2023-09-30T22:56:36.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 shutdown_connections 2023-09-30T22:56:36.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4228067330 0x7f42280697e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f424815dc50 0x7f42480a5ed0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f42480692f0 0x7f42480b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 --2- 172.21.15.142:0/312886304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4248143350 0x7f424816a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 >> 172.21.15.142:0/312886304 conn(0x7f42480ce8e0 msgr2=0x7f42480c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:36.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 shutdown_connections 2023-09-30T22:56:36.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.548+0000 7f424c9ff700 1 -- 172.21.15.142:0/312886304 wait complete. 2023-09-30T22:56:36.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:56:36.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.755+0000 7f08d4dff700 1 Processor -- start 2023-09-30T22:56:36.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.755+0000 7f08d4dff700 1 -- start start 2023-09-30T22:56:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08d4dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08d00ac3a0 0x7f08d00aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08d4dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f08d006b930 0x7f08d00aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08d4dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d0068000 con 0x7f08d0159b50 2023-09-30T22:56:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08d4dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d0069f10 con 0x7f08d00ac3a0 2023-09-30T22:56:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08d4dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d0068240 con 0x7f08d006b930 2023-09-30T22:56:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08cdd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08d00ac3a0 0x7f08d00aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08ce59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f08d0159b50 0x7f08d00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35076/0 (socket says 172.21.15.142:35076) 2023-09-30T22:56:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.756+0000 7f08ce59c700 1 -- 172.21.15.142:0/704316907 learned_addr learned my addr 172.21.15.142:0/704316907 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:36.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08ced9d700 1 --2- 172.21.15.142:0/704316907 >> v2:172.21.15.148:3300/0 conn(0x7f08d006b930 0x7f08d00aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08cdd9b700 1 -- 172.21.15.142:0/704316907 >> v2:172.21.15.148:3300/0 conn(0x7f08d006b930 msgr2=0x7f08d00aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08cdd9b700 1 --2- 172.21.15.142:0/704316907 >> v2:172.21.15.148:3300/0 conn(0x7f08d006b930 0x7f08d00aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08cdd9b700 1 -- 172.21.15.142:0/704316907 >> v1:172.21.15.142:6789/0 conn(0x7f08d0159b50 legacy=0x7f08d00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08cdd9b700 1 -- 172.21.15.142:0/704316907 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0068520 con 0x7f08d00ac3a0 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08cd59a700 1 -- 172.21.15.142:0/704316907 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845039367 0 0) 0x7f08c0001110 con 0x7f08d0159b50 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08cdd9b700 1 --2- 172.21.15.142:0/704316907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d00aa2a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f08d006c300 tx=0x7f08c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3e0427320f819e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.757+0000 7f08cd59a700 1 -- 172.21.15.142:0/704316907 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4011630 con 0x7f08d00ac3a0 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08cd59a700 1 -- 172.21.15.142:0/704316907 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4011790 con 0x7f08d00ac3a0 2023-09-30T22:56:36.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08cd59a700 1 -- 172.21.15.142:0/704316907 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4011b30 con 0x7f08d00ac3a0 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 -- 172.21.15.142:0/704316907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 msgr2=0x7f08d00aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 --2- 172.21.15.142:0/704316907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d00aa2a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f08d006c300 tx=0x7f08c40091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 -- 172.21.15.142:0/704316907 shutdown_connections 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 --2- 172.21.15.142:0/704316907 >> v2:172.21.15.148:3300/0 conn(0x7f08d006b930 0x7f08d00aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 --2- 172.21.15.142:0/704316907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d00aa2a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 -- 172.21.15.142:0/704316907 >> 172.21.15.142:0/704316907 conn(0x7f08d006dab0 msgr2=0x7f08d00aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 -- 172.21.15.142:0/704316907 shutdown_connections 2023-09-30T22:56:36.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.758+0000 7f08d4dff700 1 -- 172.21.15.142:0/704316907 wait complete. 2023-09-30T22:56:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.760+0000 7f08d4dff700 1 Processor -- start 2023-09-30T22:56:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.760+0000 7f08d4dff700 1 -- start start 2023-09-30T22:56:36.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08d4dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d006b930 0x7f08d015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08d4dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08d4dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d0159b50 0x7f08d014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08d4dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00ca5a0 con 0x7f08d00ac3a0 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08d4dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d015af10 con 0x7f08d006b930 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08d4dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d015b1f0 con 0x7f08d0159b50 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d015c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47448/0 (socket says 172.21.15.142:47448) 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 -- 172.21.15.142:0/1327735593 learned_addr learned my addr 172.21.15.142:0/1327735593 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08ce59c700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d006b930 0x7f08d015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08ced9d700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d0159b50 0x7f08d014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 -- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d0159b50 msgr2=0x7f08d014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d0159b50 0x7f08d014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 -- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d006b930 msgr2=0x7f08d015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d006b930 0x7f08d015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08cdd9b700 1 -- 172.21.15.142:0/1327735593 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4009420 con 0x7f08d00ac3a0 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.761+0000 7f08ced9d700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d0159b50 0x7f08d014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.762+0000 7f08cdd9b700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d015c7e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f08c4013000 tx=0x7f08c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.762+0000 7f08be7fc700 1 -- 172.21.15.142:0/1327735593 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4011b10 con 0x7f08d00ac3a0 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.762+0000 7f08be7fc700 1 -- 172.21.15.142:0/1327735593 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c40253f0 con 0x7f08d00ac3a0 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.762+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d015b4d0 con 0x7f08d00ac3a0 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.762+0000 7f08be7fc700 1 -- 172.21.15.142:0/1327735593 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4025790 con 0x7f08d00ac3a0 2023-09-30T22:56:36.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.762+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d015cd20 con 0x7f08d00ac3a0 2023-09-30T22:56:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.763+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d00ca710 con 0x7f08d00ac3a0 2023-09-30T22:56:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.764+0000 7f08be7fc700 1 -- 172.21.15.142:0/1327735593 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f08c4025b80 con 0x7f08d00ac3a0 2023-09-30T22:56:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.765+0000 7f08be7fc700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08b0067330 0x7f08b00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.765+0000 7f08be7fc700 1 -- 172.21.15.142:0/1327735593 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f08c40861d0 con 0x7f08d00ac3a0 2023-09-30T22:56:36.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.765+0000 7f08ce59c700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08b0067330 0x7f08b00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:36.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.766+0000 7f08ce59c700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08b0067330 0x7f08b00697e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f08c0007160 tx=0x7f08c0007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:36.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.770+0000 7f08be7fc700 1 -- 172.21.15.142:0/1327735593 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f08c4053380 con 0x7f08d00ac3a0 2023-09-30T22:56:36.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.960+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08d006fc10 con 0x7f08d00ac3a0 2023-09-30T22:56:36.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.961+0000 7f08be7fc700 1 -- 172.21.15.142:0/1327735593 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+13795 (secure 0 0 0) 0x7f08c40569a0 con 0x7f08d00ac3a0 2023-09-30T22:56:36.962 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:36.962 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":87,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:56:36.047783+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:56:36.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08b0067330 msgr2=0x7f08b00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08b0067330 0x7f08b00697e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f08c0007160 tx=0x7f08c0007f50 comp rx=0 tx=0).stop 2023-09-30T22:56:36.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 msgr2=0x7f08d015c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d015c7e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f08c4013000 tx=0x7f08c4017000 comp rx=0 tx=0).stop 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 shutdown_connections 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f08b0067330 0x7f08b00697e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08d0159b50 0x7f08d014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d006b930 0x7f08d015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 --2- 172.21.15.142:0/1327735593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08d00ac3a0 0x7f08d015c7e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 >> 172.21.15.142:0/1327735593 conn(0x7f08d006dab0 msgr2=0x7f08d00aa000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 shutdown_connections 2023-09-30T22:56:36.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:36.963+0000 7f08d4dff700 1 -- 172.21.15.142:0/1327735593 wait complete. 2023-09-30T22:56:36.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:56:36.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:56:37.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.174+0000 7fad57fff700 1 Processor -- start 2023-09-30T22:56:37.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.174+0000 7fad57fff700 1 -- start start 2023-09-30T22:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.175+0000 7fad57fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad50141150 0x7fad501580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.175+0000 7fad57fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad500c40e0 0x7fad500c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.175+0000 7fad57fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad500c4a80 con 0x7fad500c6270 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.175+0000 7fad57fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad500c38d0 con 0x7fad50141150 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.175+0000 7fad57fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500c6aa0 con 0x7fad500c40e0 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.175+0000 7fad55d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad50141150 0x7fad501580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad55d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad50141150 0x7fad501580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47452/0 (socket says 172.21.15.142:47452) 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad55d9b700 1 -- 172.21.15.142:0/127478067 learned_addr learned my addr 172.21.15.142:0/127478067 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad5659c700 1 --2- 172.21.15.142:0/127478067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad500c40e0 0x7fad500c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad55d9b700 1 -- 172.21.15.142:0/127478067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad500c40e0 msgr2=0x7fad500c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad55d9b700 1 --2- 172.21.15.142:0/127478067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad500c40e0 0x7fad500c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad55d9b700 1 -- 172.21.15.142:0/127478067 >> v1:172.21.15.148:6789/0 conn(0x7fad500c6270 legacy=0x7fad5015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad55d9b700 1 -- 172.21.15.142:0/127478067 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5006a040 con 0x7fad50141150 2023-09-30T22:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad5659c700 1 --2- 172.21.15.142:0/127478067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad500c40e0 0x7fad500c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad55d9b700 1 --2- 172.21.15.142:0/127478067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad50141150 0x7fad501580c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0099b0 tx=0x7fad4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2506db35b628673e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad54d99700 1 -- 172.21.15.142:0/127478067 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00b860 con 0x7fad50141150 2023-09-30T22:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad54d99700 1 -- 172.21.15.142:0/127478067 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c00b9c0 con 0x7fad50141150 2023-09-30T22:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.176+0000 7fad54d99700 1 -- 172.21.15.142:0/127478067 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00bd60 con 0x7fad50141150 2023-09-30T22:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 -- 172.21.15.142:0/127478067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad50141150 msgr2=0x7fad501580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 --2- 172.21.15.142:0/127478067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad50141150 0x7fad501580c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0099b0 tx=0x7fad4c009250 comp rx=0 tx=0).stop 2023-09-30T22:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 -- 172.21.15.142:0/127478067 shutdown_connections 2023-09-30T22:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 --2- 172.21.15.142:0/127478067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad500c40e0 0x7fad500c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 --2- 172.21.15.142:0/127478067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad50141150 0x7fad501580c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 -- 172.21.15.142:0/127478067 >> 172.21.15.142:0/127478067 conn(0x7fad500cc670 msgr2=0x7fad500cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 -- 172.21.15.142:0/127478067 shutdown_connections 2023-09-30T22:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.177+0000 7fad57fff700 1 -- 172.21.15.142:0/127478067 wait complete. 2023-09-30T22:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.179+0000 7fad57fff700 1 Processor -- start 2023-09-30T22:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.179+0000 7fad57fff700 1 -- start start 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad57fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad500c40e0 0x7fad500b9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad57fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c6270 0x7fad5013cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad57fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad50141150 0x7fad500b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad57fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5013d0f0 con 0x7fad500c6270 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad57fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500b9f90 con 0x7fad500c40e0 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad57fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500ba270 con 0x7fad50141150 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c6270 0x7fad5013cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c6270 0x7fad5013cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47454/0 (socket says 172.21.15.142:47454) 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 -- 172.21.15.142:0/2909202760 learned_addr learned my addr 172.21.15.142:0/2909202760 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad55d9b700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad500c40e0 0x7fad500b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5659c700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad50141150 0x7fad500b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 -- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad50141150 msgr2=0x7fad500b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad50141150 0x7fad500b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 -- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad500c40e0 msgr2=0x7fad500b9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad500c40e0 0x7fad500b9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.180+0000 7fad5559a700 1 -- 172.21.15.142:0/2909202760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c0094f0 con 0x7fad500c6270 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.181+0000 7fad5559a700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c6270 0x7fad5013cbb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c7c0 tx=0x7fad40007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.181+0000 7fad45ffb700 1 -- 172.21.15.142:0/2909202760 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40011590 con 0x7fad500c6270 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.181+0000 7fad45ffb700 1 -- 172.21.15.142:0/2909202760 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad400116f0 con 0x7fad500c6270 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.181+0000 7fad45ffb700 1 -- 172.21.15.142:0/2909202760 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40011ab0 con 0x7fad500c6270 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.181+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500ba550 con 0x7fad500c6270 2023-09-30T22:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.181+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad500b79a0 con 0x7fad500c6270 2023-09-30T22:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.182+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad500b4ef0 con 0x7fad500c6270 2023-09-30T22:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.183+0000 7fad45ffb700 1 -- 172.21.15.142:0/2909202760 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad4001b3b0 con 0x7fad500c6270 2023-09-30T22:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.184+0000 7fad45ffb700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad34067330 0x7fad340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.184+0000 7fad45ffb700 1 -- 172.21.15.142:0/2909202760 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fad40083b30 con 0x7fad500c6270 2023-09-30T22:56:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.184+0000 7fad55d9b700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad34067330 0x7fad340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.185+0000 7fad55d9b700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad34067330 0x7fad340697e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0099b0 tx=0x7fad4c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.188+0000 7fad45ffb700 1 -- 172.21.15.142:0/2909202760 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad500b4ef0 con 0x7fad500c6270 2023-09-30T22:56:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.376+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad500c4a80 con 0x7fad500c6270 2023-09-30T22:56:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.377+0000 7fad45ffb700 1 -- 172.21.15.142:0/2909202760 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad500c4a80 con 0x7fad500c6270 2023-09-30T22:56:37.378 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad34067330 msgr2=0x7fad340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad34067330 0x7fad340697e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0099b0 tx=0x7fad4c017000 comp rx=0 tx=0).stop 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c6270 msgr2=0x7fad5013cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c6270 0x7fad5013cbb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c7c0 tx=0x7fad40007f50 comp rx=0 tx=0).stop 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 shutdown_connections 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad34067330 0x7fad340697e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad50141150 0x7fad500b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad500c40e0 0x7fad500b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 --2- 172.21.15.142:0/2909202760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c6270 0x7fad5013cbb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.379+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 >> 172.21.15.142:0/2909202760 conn(0x7fad500cc670 msgr2=0x7fad500cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.380+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 shutdown_connections 2023-09-30T22:56:37.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.380+0000 7fad57fff700 1 -- 172.21.15.142:0/2909202760 wait complete. 2023-09-30T22:56:37.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:56:37.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.589+0000 7f77e7bff700 1 Processor -- start 2023-09-30T22:56:37.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.589+0000 7f77e7bff700 1 -- start start 2023-09-30T22:56:37.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e7bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77e0150600 0x7f77e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e7bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77e015a920 0x7f77e0156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e7bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e01576e0 con 0x7f77e01509d0 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e7bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00cc320 con 0x7f77e0150600 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e7bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e015a490 con 0x7f77e015a920 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e599b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77e0150600 0x7f77e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e599b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77e0150600 0x7f77e006a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47462/0 (socket says 172.21.15.142:47462) 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e599b700 1 -- 172.21.15.142:0/704899115 learned_addr learned my addr 172.21.15.142:0/704899115 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.591+0000 7f77e619c700 1 --2- 172.21.15.142:0/704899115 >> v2:172.21.15.148:3300/0 conn(0x7f77e015a920 0x7f77e0156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e599b700 1 -- 172.21.15.142:0/704899115 >> v2:172.21.15.148:3300/0 conn(0x7f77e015a920 msgr2=0x7f77e0156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e599b700 1 --2- 172.21.15.142:0/704899115 >> v2:172.21.15.148:3300/0 conn(0x7f77e015a920 0x7f77e0156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e599b700 1 -- 172.21.15.142:0/704899115 >> v1:172.21.15.148:6789/0 conn(0x7f77e01509d0 legacy=0x7f77e0156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e599b700 1 -- 172.21.15.142:0/704899115 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0157400 con 0x7f77e0150600 2023-09-30T22:56:37.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e599b700 1 --2- 172.21.15.142:0/704899115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e0150600 0x7f77e006a7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f77e0159c70 tx=0x7f77dc00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313bab1943ce37ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:37.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e4999700 1 -- 172.21.15.142:0/704899115 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00dad0 con 0x7f77e0150600 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e4999700 1 -- 172.21.15.142:0/704899115 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00dc30 con 0x7f77e0150600 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.592+0000 7f77e4999700 1 -- 172.21.15.142:0/704899115 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc017410 con 0x7f77e0150600 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 -- 172.21.15.142:0/704899115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e0150600 msgr2=0x7f77e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 --2- 172.21.15.142:0/704899115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e0150600 0x7f77e006a7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f77e0159c70 tx=0x7f77dc00b4e0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 -- 172.21.15.142:0/704899115 shutdown_connections 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 --2- 172.21.15.142:0/704899115 >> v2:172.21.15.148:3300/0 conn(0x7f77e015a920 0x7f77e0156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 --2- 172.21.15.142:0/704899115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e0150600 0x7f77e006a7a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 -- 172.21.15.142:0/704899115 >> 172.21.15.142:0/704899115 conn(0x7f77e00cc670 msgr2=0x7f77e00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 -- 172.21.15.142:0/704899115 shutdown_connections 2023-09-30T22:56:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.593+0000 7f77e7bff700 1 -- 172.21.15.142:0/704899115 wait complete. 2023-09-30T22:56:37.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.595+0000 7f77e7bff700 1 Processor -- start 2023-09-30T22:56:37.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.595+0000 7f77e7bff700 1 -- start start 2023-09-30T22:56:37.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.596+0000 7f77e7bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77e0150600 0x7f77e0140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.596+0000 7f77e7bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e01509d0 0x7f77e013ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.596+0000 7f77e7bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77e015a920 0x7f77e00ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.596+0000 7f77e7bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c9760 con 0x7f77e01509d0 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.596+0000 7f77e7bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01412e0 con 0x7f77e0150600 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.596+0000 7f77e7bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c7510 con 0x7f77e015a920 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.596+0000 7f77e519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e01509d0 0x7f77e013ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e01509d0 0x7f77e013ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47470/0 (socket says 172.21.15.142:47470) 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 -- 172.21.15.142:0/748431466 learned_addr learned my addr 172.21.15.142:0/748431466 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e599b700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77e0150600 0x7f77e0140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e619c700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77e015a920 0x7f77e00ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 -- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77e015a920 msgr2=0x7f77e00ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77e015a920 0x7f77e00ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 -- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77e0150600 msgr2=0x7f77e0140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77e0150600 0x7f77e0140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 -- 172.21.15.142:0/748431466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc00b780 con 0x7f77e01509d0 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e519a700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e01509d0 0x7f77e013ffa0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f77d0002ee0 tx=0x7f77d0007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77d5ffb700 1 -- 172.21.15.142:0/748431466 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0016070 con 0x7f77e01509d0 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77d5ffb700 1 -- 172.21.15.142:0/748431466 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0006820 con 0x7f77e01509d0 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e00c77f0 con 0x7f77e01509d0 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.597+0000 7f77d5ffb700 1 -- 172.21.15.142:0/748431466 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0006bc0 con 0x7f77e01509d0 2023-09-30T22:56:37.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.598+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e00c93f0 con 0x7f77e01509d0 2023-09-30T22:56:37.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.599+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e00c9910 con 0x7f77e01509d0 2023-09-30T22:56:37.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.599+0000 7f77d5ffb700 1 -- 172.21.15.142:0/748431466 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f77d0007020 con 0x7f77e01509d0 2023-09-30T22:56:37.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.600+0000 7f77d5ffb700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77c4067360 0x7f77c4069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:37.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.600+0000 7f77d5ffb700 1 -- 172.21.15.142:0/748431466 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f77d0083ff0 con 0x7f77e01509d0 2023-09-30T22:56:37.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.600+0000 7f77e599b700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77c4067360 0x7f77c4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:37.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.601+0000 7f77e599b700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77c4067360 0x7f77c4069810 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f77e0159c70 tx=0x7f77dc019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:37.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.604+0000 7f77d5ffb700 1 -- 172.21.15.142:0/748431466 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f77e00c9910 con 0x7f77e01509d0 2023-09-30T22:56:37.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.789+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f77e00c98a0 con 0x7f77e01509d0 2023-09-30T22:56:37.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.789+0000 7f77d5ffb700 1 -- 172.21.15.142:0/748431466 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f77d00511a0 con 0x7f77e01509d0 2023-09-30T22:56:37.790 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.791+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77c4067360 msgr2=0x7f77c4069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.791+0000 7f77e7bff700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77c4067360 0x7f77c4069810 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f77e0159c70 tx=0x7f77dc019000 comp rx=0 tx=0).stop 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.791+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e01509d0 msgr2=0x7f77e013ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.791+0000 7f77e7bff700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e01509d0 0x7f77e013ffa0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f77d0002ee0 tx=0x7f77d0007f20 comp rx=0 tx=0).stop 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 shutdown_connections 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f77c4067360 0x7f77c4069810 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77e015a920 0x7f77e00ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77e0150600 0x7f77e0140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 --2- 172.21.15.142:0/748431466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77e01509d0 0x7f77e013ffa0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:37.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 >> 172.21.15.142:0/748431466 conn(0x7f77e00cc670 msgr2=0x7f77e014a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:37.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 shutdown_connections 2023-09-30T22:56:37.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.792+0000 7f77e7bff700 1 -- 172.21.15.142:0/748431466 wait complete. 2023-09-30T22:56:37.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:56:37.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.998+0000 7fd7903ff700 1 Processor -- start 2023-09-30T22:56:37.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.998+0000 7fd7903ff700 1 -- start start 2023-09-30T22:56:38.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.999+0000 7fd7903ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd788157a90 0x7fd78815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.999+0000 7fd7903ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd78806b3d0 0x7fd7880b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.999+0000 7fd7903ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7880b1f40 0x7fd788069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.999+0000 7fd7903ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880b23c0 con 0x7fd78806b3d0 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.999+0000 7fd7903ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78806d470 con 0x7fd788157a90 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:37.999+0000 7fd7903ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd788157e60 con 0x7fd7880b1f40 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd78806b3d0 0x7fd7880b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd78806b3d0 0x7fd7880b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47474/0 (socket says 172.21.15.142:47474) 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 -- 172.21.15.142:0/2929026004 learned_addr learned my addr 172.21.15.142:0/2929026004 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78e19b700 1 --2- 172.21.15.142:0/2929026004 >> v2:172.21.15.148:3300/0 conn(0x7fd788157a90 0x7fd78815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78e99c700 1 --2- 172.21.15.142:0/2929026004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7880b1f40 0x7fd788069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 -- 172.21.15.142:0/2929026004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7880b1f40 msgr2=0x7fd788069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:38.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 --2- 172.21.15.142:0/2929026004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7880b1f40 0x7fd788069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 -- 172.21.15.142:0/2929026004 >> v2:172.21.15.148:3300/0 conn(0x7fd788157a90 msgr2=0x7fd78815bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:38.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 --2- 172.21.15.142:0/2929026004 >> v2:172.21.15.148:3300/0 conn(0x7fd788157a90 0x7fd78815bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 -- 172.21.15.142:0/2929026004 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78815c430 con 0x7fd78806b3d0 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78e99c700 1 --2- 172.21.15.142:0/2929026004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7880b1f40 0x7fd788069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.000+0000 7fd78d99a700 1 --2- 172.21.15.142:0/2929026004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd78806b3d0 0x7fd7880b1a00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd78806d1e0 tx=0x7fd778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea62524e108d771a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd78d199700 1 -- 172.21.15.142:0/2929026004 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778009e70 con 0x7fd78806b3d0 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd78d199700 1 -- 172.21.15.142:0/2929026004 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77800b860 con 0x7fd78806b3d0 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd78d199700 1 -- 172.21.15.142:0/2929026004 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800bc00 con 0x7fd78806b3d0 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 -- 172.21.15.142:0/2929026004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd78806b3d0 msgr2=0x7fd7880b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2929026004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd78806b3d0 0x7fd7880b1a00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd78806d1e0 tx=0x7fd778009250 comp rx=0 tx=0).stop 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 -- 172.21.15.142:0/2929026004 shutdown_connections 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2929026004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7880b1f40 0x7fd788069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2929026004 >> v2:172.21.15.148:3300/0 conn(0x7fd788157a90 0x7fd78815bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2929026004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd78806b3d0 0x7fd7880b1a00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 -- 172.21.15.142:0/2929026004 >> 172.21.15.142:0/2929026004 conn(0x7fd7880680c0 msgr2=0x7fd7880c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:38.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.001+0000 7fd7903ff700 1 -- 172.21.15.142:0/2929026004 shutdown_connections 2023-09-30T22:56:38.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.002+0000 7fd7903ff700 1 -- 172.21.15.142:0/2929026004 wait complete. 2023-09-30T22:56:38.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.003+0000 7fd7903ff700 1 Processor -- start 2023-09-30T22:56:38.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.003+0000 7fd7903ff700 1 -- start start 2023-09-30T22:56:38.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd7903ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd78806b3d0 0x7fd7881547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd7903ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7880b1f40 0x7fd78816ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd7903ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd788157a90 0x7fd7881567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd7903ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881559c0 con 0x7fd7880b1f40 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd7903ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78816b290 con 0x7fd78806b3d0 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd7903ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd788154db0 con 0x7fd788157a90 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd78d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7880b1f40 0x7fd78816ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd78d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7880b1f40 0x7fd78816ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47480/0 (socket says 172.21.15.142:47480) 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.004+0000 7fd78d99a700 1 -- 172.21.15.142:0/2964312411 learned_addr learned my addr 172.21.15.142:0/2964312411 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78e19b700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd78806b3d0 0x7fd7881547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78e99c700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd788157a90 0x7fd7881567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78d99a700 1 -- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd788157a90 msgr2=0x7fd7881567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78d99a700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd788157a90 0x7fd7881567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78d99a700 1 -- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd78806b3d0 msgr2=0x7fd7881547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78d99a700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd78806b3d0 0x7fd7881547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78d99a700 1 -- 172.21.15.142:0/2964312411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780094f0 con 0x7fd7880b1f40 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78e19b700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd78806b3d0 0x7fd7881547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78e99c700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd788157a90 0x7fd7881567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd78d99a700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7880b1f40 0x7fd78816ad50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd7780090b0 tx=0x7fd778017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd77e7fc700 1 -- 172.21.15.142:0/2964312411 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800bbe0 con 0x7fd7880b1f40 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd77e7fc700 1 -- 172.21.15.142:0/2964312411 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77801a450 con 0x7fd7880b1f40 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd77e7fc700 1 -- 172.21.15.142:0/2964312411 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77801a810 con 0x7fd7880b1f40 2023-09-30T22:56:38.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd788155090 con 0x7fd7880b1f40 2023-09-30T22:56:38.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.005+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd788155650 con 0x7fd7880b1f40 2023-09-30T22:56:38.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.006+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7880695b0 con 0x7fd7880b1f40 2023-09-30T22:56:38.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.007+0000 7fd77e7fc700 1 -- 172.21.15.142:0/2964312411 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd77801abc0 con 0x7fd7880b1f40 2023-09-30T22:56:38.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.008+0000 7fd77e7fc700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd76c067330 0x7fd76c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.008+0000 7fd77e7fc700 1 -- 172.21.15.142:0/2964312411 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd778085e10 con 0x7fd7880b1f40 2023-09-30T22:56:38.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.008+0000 7fd78e19b700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd76c067330 0x7fd76c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.009+0000 7fd78e19b700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd76c067330 0x7fd76c0697e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd784006f00 tx=0x7fd784008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:38.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.012+0000 7fd77e7fc700 1 -- 172.21.15.142:0/2964312411 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd778089030 con 0x7fd7880b1f40 2023-09-30T22:56:38.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.207+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd788155b00 con 0x7fd7880b1f40 2023-09-30T22:56:38.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.208+0000 7fd77e7fc700 1 -- 172.21.15.142:0/2964312411 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd778015090 con 0x7fd7880b1f40 2023-09-30T22:56:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:38.209 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:56:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:56:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:56:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:56:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:56:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:56:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:56:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:56:38.210 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:56:38.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd76c067330 msgr2=0x7fd76c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd76c067330 0x7fd76c0697e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd784006f00 tx=0x7fd784008040 comp rx=0 tx=0).stop 2023-09-30T22:56:38.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7880b1f40 msgr2=0x7fd78816ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7880b1f40 0x7fd78816ad50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd7780090b0 tx=0x7fd778017000 comp rx=0 tx=0).stop 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 shutdown_connections 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd76c067330 0x7fd76c0697e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd788157a90 0x7fd7881567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd78806b3d0 0x7fd7881547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 --2- 172.21.15.142:0/2964312411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7880b1f40 0x7fd78816ad50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 >> 172.21.15.142:0/2964312411 conn(0x7fd7880680c0 msgr2=0x7fd788069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 shutdown_connections 2023-09-30T22:56:38.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.210+0000 7fd7903ff700 1 -- 172.21.15.142:0/2964312411 wait complete. 2023-09-30T22:56:38.228 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:56:38.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:56:38.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.421+0000 7f8c043ff700 1 Processor -- start 2023-09-30T22:56:38.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.421+0000 7f8c043ff700 1 -- start start 2023-09-30T22:56:38.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c043ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8bfc15ac40 0x7f8bfc15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c043ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8bfc0cf180 0x7f8bfc0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c043ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc0d04e0 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c043ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0cc4d0 con 0x7f8bfc15ac40 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c043ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0cc8f0 con 0x7f8bfc0cf180 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0219b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8bfc15ac40 0x7f8bfc15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0219b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8bfc15ac40 0x7f8bfc15a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47492/0 (socket says 172.21.15.142:47492) 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0219b700 1 -- 172.21.15.142:0/3558575684 learned_addr learned my addr 172.21.15.142:0/3558575684 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0199a700 1 --2- 172.21.15.142:0/3558575684 >> v2:172.21.15.148:3300/0 conn(0x7f8bfc0cf180 0x7f8bfc0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0219b700 1 -- 172.21.15.142:0/3558575684 >> v2:172.21.15.148:3300/0 conn(0x7f8bfc0cf180 msgr2=0x7f8bfc0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:38.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0219b700 1 --2- 172.21.15.142:0/3558575684 >> v2:172.21.15.148:3300/0 conn(0x7f8bfc0cf180 0x7f8bfc0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0219b700 1 -- 172.21.15.142:0/3558575684 >> v1:172.21.15.148:6789/0 conn(0x7f8bfc0cc0b0 legacy=0x7f8bfc15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.423+0000 7f8c0219b700 1 -- 172.21.15.142:0/3558575684 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0cf8d0 con 0x7f8bfc15ac40 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.424+0000 7f8c0199a700 1 --2- 172.21.15.142:0/3558575684 >> v2:172.21.15.148:3300/0 conn(0x7f8bfc0cf180 0x7f8bfc0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.424+0000 7f8c0219b700 1 --2- 172.21.15.142:0/3558575684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15ac40 0x7f8bfc15a220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0cd4c0 tx=0x7f8bf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7467511e848c5fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.424+0000 7f8c01199700 1 -- 172.21.15.142:0/3558575684 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800b820 con 0x7f8bfc15ac40 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.424+0000 7f8c01199700 1 -- 172.21.15.142:0/3558575684 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf800b980 con 0x7f8bfc15ac40 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.424+0000 7f8c01199700 1 -- 172.21.15.142:0/3558575684 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800bd20 con 0x7f8bfc15ac40 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.424+0000 7f8c043ff700 1 -- 172.21.15.142:0/3558575684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15ac40 msgr2=0x7f8bfc15a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.424+0000 7f8c043ff700 1 --2- 172.21.15.142:0/3558575684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15ac40 0x7f8bfc15a220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0cd4c0 tx=0x7f8bf8009250 comp rx=0 tx=0).stop 2023-09-30T22:56:38.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.425+0000 7f8c043ff700 1 -- 172.21.15.142:0/3558575684 shutdown_connections 2023-09-30T22:56:38.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.425+0000 7f8c043ff700 1 --2- 172.21.15.142:0/3558575684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc15ac40 0x7f8bfc15a220 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.425+0000 7f8c043ff700 1 --2- 172.21.15.142:0/3558575684 >> v2:172.21.15.148:3300/0 conn(0x7f8bfc0cf180 0x7f8bfc0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.425+0000 7f8c043ff700 1 -- 172.21.15.142:0/3558575684 >> 172.21.15.142:0/3558575684 conn(0x7f8bfc0d0a80 msgr2=0x7f8bfc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:38.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.425+0000 7f8c043ff700 1 -- 172.21.15.142:0/3558575684 shutdown_connections 2023-09-30T22:56:38.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.425+0000 7f8c043ff700 1 -- 172.21.15.142:0/3558575684 wait complete. 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.426+0000 7f8c043ff700 1 Processor -- start 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.426+0000 7f8c043ff700 1 -- start start 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c043ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc0cc0b0 0x7f8bfc156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c043ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc0cf180 0x7f8bfc16bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c043ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bfc15ac40 0x7f8bfc16b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c043ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc16b960 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c043ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc16b6c0 con 0x7f8bfc0cf180 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c043ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc151470 con 0x7f8bfc15ac40 2023-09-30T22:56:38.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c0219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc0cc0b0 0x7f8bfc156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c0219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc0cc0b0 0x7f8bfc156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47494/0 (socket says 172.21.15.142:47494) 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c0219b700 1 -- 172.21.15.142:0/1520799670 learned_addr learned my addr 172.21.15.142:0/1520799670 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.427+0000 7f8c0199a700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc0cf180 0x7f8bfc16bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c0299c700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bfc15ac40 0x7f8bfc16b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c0219b700 1 -- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bfc15ac40 msgr2=0x7f8bfc16b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c0219b700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bfc15ac40 0x7f8bfc16b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c0219b700 1 -- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc0cf180 msgr2=0x7f8bfc16bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c0219b700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc0cf180 0x7f8bfc16bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c0219b700 1 -- 172.21.15.142:0/1520799670 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80094f0 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c0219b700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc0cc0b0 0x7f8bfc156580 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80030c0 tx=0x7f8bf8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:38.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8bf27fc700 1 -- 172.21.15.142:0/1520799670 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011d00 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8bf27fc700 1 -- 172.21.15.142:0/1520799670 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8020070 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc151750 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.428+0000 7f8bf27fc700 1 -- 172.21.15.142:0/1520799670 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf801b6a0 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.429+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc151d10 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.429+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc151f00 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.430+0000 7f8bf27fc700 1 -- 172.21.15.142:0/1520799670 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8bf8022030 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.432+0000 7f8bf27fc700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8be0067330 0x7f8be00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:38.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.432+0000 7f8bf27fc700 1 -- 172.21.15.142:0/1520799670 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8bf80866a0 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.432+0000 7f8c0199a700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8be0067330 0x7f8be00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:38.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.432+0000 7f8c0199a700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8be0067330 0x7f8be00697e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc156f90 tx=0x7f8bec006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:38.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.436+0000 7f8bf27fc700 1 -- 172.21.15.142:0/1520799670 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8bf8053850 con 0x7f8bfc0cc0b0 2023-09-30T22:56:38.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:38.625+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8bfc151f00 con 0x7f8bfc0cc0b0 2023-09-30T22:56:39.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.416+0000 7f8bf27fc700 1 -- 172.21.15.142:0/1520799670 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v88) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8bf8056e70 con 0x7f8bfc0cc0b0 2023-09-30T22:56:39.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8be0067330 msgr2=0x7f8be00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:39.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8be0067330 0x7f8be00697e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc156f90 tx=0x7f8bec006f90 comp rx=0 tx=0).stop 2023-09-30T22:56:39.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc0cc0b0 msgr2=0x7f8bfc156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:39.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc0cc0b0 0x7f8bfc156580 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80030c0 tx=0x7f8bf8016000 comp rx=0 tx=0).stop 2023-09-30T22:56:39.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 shutdown_connections 2023-09-30T22:56:39.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8be0067330 0x7f8be00697e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bfc15ac40 0x7f8bfc16b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bfc0cc0b0 0x7f8bfc156580 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 --2- 172.21.15.142:0/1520799670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bfc0cf180 0x7f8bfc16bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 >> 172.21.15.142:0/1520799670 conn(0x7f8bfc0d0a80 msgr2=0x7f8bfc159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:39.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 shutdown_connections 2023-09-30T22:56:39.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.422+0000 7f8c043ff700 1 -- 172.21.15.142:0/1520799670 wait complete. 2023-09-30T22:56:39.424 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:56:39.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:56:39.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.644+0000 7f5fb55ff700 1 Processor -- start 2023-09-30T22:56:39.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.644+0000 7f5fb55ff700 1 -- start start 2023-09-30T22:56:39.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.645+0000 7f5fb55ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5fb00ca5e0 0x7f5fb006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.645+0000 7f5fb55ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fb00b0de0 0x7f5fb00681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.645+0000 7f5fb55ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb0067d10 con 0x7f5fb0159ba0 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.645+0000 7f5fb55ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb006af90 con 0x7f5fb00b0de0 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.645+0000 7f5fb55ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00676c0 con 0x7f5fb00ca5e0 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5faeffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5fb0159ba0 0x7f5fb00c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35080/0 (socket says 172.21.15.142:35080) 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5faeffd700 1 -- 172.21.15.142:0/3550345908 learned_addr learned my addr 172.21.15.142:0/3550345908 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5faf7fe700 1 --2- 172.21.15.142:0/3550345908 >> v2:172.21.15.142:3300/0 conn(0x7f5fb00b0de0 0x7f5fb00681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5fae7fc700 1 --2- 172.21.15.142:0/3550345908 >> v2:172.21.15.148:3300/0 conn(0x7f5fb00ca5e0 0x7f5fb006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5fadffb700 1 -- 172.21.15.142:0/3550345908 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999205627 0 0) 0x7f5fb0067d10 con 0x7f5fb0159ba0 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5fadffb700 1 -- 172.21.15.142:0/3550345908 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f98003570 con 0x7f5fb0159ba0 2023-09-30T22:56:39.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5faf7fe700 1 -- 172.21.15.142:0/3550345908 >> v2:172.21.15.148:3300/0 conn(0x7f5fb00ca5e0 msgr2=0x7f5fb006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:39.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5faf7fe700 1 --2- 172.21.15.142:0/3550345908 >> v2:172.21.15.148:3300/0 conn(0x7f5fb00ca5e0 0x7f5fb006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5faf7fe700 1 -- 172.21.15.142:0/3550345908 >> v1:172.21.15.142:6789/0 conn(0x7f5fb0159ba0 legacy=0x7f5fb00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:39.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.646+0000 7f5faf7fe700 1 -- 172.21.15.142:0/3550345908 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00679a0 con 0x7f5fb00b0de0 2023-09-30T22:56:39.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5faf7fe700 1 --2- 172.21.15.142:0/3550345908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb00b0de0 0x7f5fb00681a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5fb006f000 tx=0x7f5fa8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d99590e8723d3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:39.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fadffb700 1 -- 172.21.15.142:0/3550345908 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800e070 con 0x7f5fb00b0de0 2023-09-30T22:56:39.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fadffb700 1 -- 172.21.15.142:0/3550345908 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800bab0 con 0x7f5fb00b0de0 2023-09-30T22:56:39.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fadffb700 1 -- 172.21.15.142:0/3550345908 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800be30 con 0x7f5fb00b0de0 2023-09-30T22:56:39.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3550345908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb00b0de0 msgr2=0x7f5fb00681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:39.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3550345908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb00b0de0 0x7f5fb00681a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5fb006f000 tx=0x7f5fa8009780 comp rx=0 tx=0).stop 2023-09-30T22:56:39.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3550345908 shutdown_connections 2023-09-30T22:56:39.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3550345908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb00b0de0 0x7f5fb00681a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3550345908 >> v2:172.21.15.148:3300/0 conn(0x7f5fb00ca5e0 0x7f5fb006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3550345908 >> 172.21.15.142:0/3550345908 conn(0x7f5fb00cb2f0 msgr2=0x7f5fb00cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:39.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.647+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3550345908 shutdown_connections 2023-09-30T22:56:39.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.648+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3550345908 wait complete. 2023-09-30T22:56:39.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.649+0000 7f5fb55ff700 1 Processor -- start 2023-09-30T22:56:39.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.649+0000 7f5fb55ff700 1 -- start start 2023-09-30T22:56:39.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5fb55ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fb00b0de0 0x7f5fb00683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:39.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5fb55ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fb00ca5e0 0x7f5fb00c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5fb55ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0159ba0 0x7f5fb00c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5fb55ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c5060 con 0x7f5fb0159ba0 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5fb55ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c8ab0 con 0x7f5fb00ca5e0 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5fb55ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c7ea0 con 0x7f5fb00b0de0 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0159ba0 0x7f5fb00c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0159ba0 0x7f5fb00c4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47514/0 (socket says 172.21.15.142:47514) 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5faf7fe700 1 -- 172.21.15.142:0/3545267728 learned_addr learned my addr 172.21.15.142:0/3545267728 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5faeffd700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fb00b0de0 0x7f5fb00683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.650+0000 7f5fae7fc700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fb00ca5e0 0x7f5fb00c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5faf7fe700 1 -- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fb00b0de0 msgr2=0x7f5fb00683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5faf7fe700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fb00b0de0 0x7f5fb00683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5faf7fe700 1 -- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fb00ca5e0 msgr2=0x7f5fb00c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5faf7fe700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fb00ca5e0 0x7f5fb00c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5faf7fe700 1 -- 172.21.15.142:0/3545267728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8009a20 con 0x7f5fb0159ba0 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5faf7fe700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0159ba0 0x7f5fb00c4b20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5fb006c8d0 tx=0x7f5fa8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5f96ffd700 1 -- 172.21.15.142:0/3545267728 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8012dd0 con 0x7f5fb0159ba0 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5f96ffd700 1 -- 172.21.15.142:0/3545267728 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8027470 con 0x7f5fb0159ba0 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5f96ffd700 1 -- 172.21.15.142:0/3545267728 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8027830 con 0x7f5fb0159ba0 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00c8180 con 0x7f5fb0159ba0 2023-09-30T22:56:39.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.651+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00c8510 con 0x7f5fb0159ba0 2023-09-30T22:56:39.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.652+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb006e4b0 con 0x7f5fb0159ba0 2023-09-30T22:56:39.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.654+0000 7f5f96ffd700 1 -- 172.21.15.142:0/3545267728 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5fa8024070 con 0x7f5fb0159ba0 2023-09-30T22:56:39.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.655+0000 7f5f96ffd700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f9c067330 0x7f5f9c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:39.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.655+0000 7f5f96ffd700 1 -- 172.21.15.142:0/3545267728 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f5fa8087490 con 0x7f5fb0159ba0 2023-09-30T22:56:39.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.655+0000 7f5faeffd700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f9c067330 0x7f5f9c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:39.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.655+0000 7f5faeffd700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f9c067330 0x7f5f9c0697e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0007fd0 tx=0x7f5fa0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:39.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.660+0000 7f5f96ffd700 1 -- 172.21.15.142:0/3545267728 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5fa80544d0 con 0x7f5fb0159ba0 2023-09-30T22:56:39.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:39.850+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5fb00c8bf0 con 0x7f5fb0159ba0 2023-09-30T22:56:40.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.423+0000 7f5f96ffd700 1 -- 172.21.15.142:0/3545267728 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v89) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5fa8057af0 con 0x7f5fb0159ba0 2023-09-30T22:56:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.435+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f9c067330 msgr2=0x7f5f9c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.435+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f9c067330 0x7f5f9c0697e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0007fd0 tx=0x7f5fa0009040 comp rx=0 tx=0).stop 2023-09-30T22:56:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.435+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0159ba0 msgr2=0x7f5fb00c4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.435+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0159ba0 0x7f5fb00c4b20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5fb006c8d0 tx=0x7f5fa8019000 comp rx=0 tx=0).stop 2023-09-30T22:56:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.436+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 shutdown_connections 2023-09-30T22:56:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.436+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f9c067330 0x7f5f9c0697e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.436+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0159ba0 0x7f5fb00c4b20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.436+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5fb00b0de0 0x7f5fb00683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.436+0000 7f5fb55ff700 1 --2- 172.21.15.142:0/3545267728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fb00ca5e0 0x7f5fb00c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.436+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 >> 172.21.15.142:0/3545267728 conn(0x7f5fb00cb2f0 msgr2=0x7f5fb00b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:40.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.437+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 shutdown_connections 2023-09-30T22:56:40.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.437+0000 7f5fb55ff700 1 -- 172.21.15.142:0/3545267728 wait complete. 2023-09-30T22:56:40.441 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:56:40.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:56:40.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.651+0000 7fee285ff700 1 Processor -- start 2023-09-30T22:56:40.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.652+0000 7fee285ff700 1 -- start start 2023-09-30T22:56:40.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee285ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee200c6270 0x7fee201580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:40.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee285ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200c40e0 0x7fee200c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:40.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee285ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee200c4a80 con 0x7fee20141150 2023-09-30T22:56:40.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee285ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200c38d0 con 0x7fee200c6270 2023-09-30T22:56:40.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee285ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200c6aa0 con 0x7fee200c40e0 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee25b9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee200c6270 0x7fee201580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee25b9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee200c6270 0x7fee201580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47526/0 (socket says 172.21.15.142:47526) 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee25b9a700 1 -- 172.21.15.142:0/3018116498 learned_addr learned my addr 172.21.15.142:0/3018116498 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.653+0000 7fee26b9c700 1 --2- 172.21.15.142:0/3018116498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200c40e0 0x7fee200c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25b9a700 1 -- 172.21.15.142:0/3018116498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200c40e0 msgr2=0x7fee200c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25b9a700 1 --2- 172.21.15.142:0/3018116498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200c40e0 0x7fee200c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25b9a700 1 -- 172.21.15.142:0/3018116498 >> v1:172.21.15.148:6789/0 conn(0x7fee20141150 legacy=0x7fee2015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25b9a700 1 -- 172.21.15.142:0/3018116498 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2006a040 con 0x7fee200c6270 2023-09-30T22:56:40.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25b9a700 1 --2- 172.21.15.142:0/3018116498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee201580c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fee100099b0 tx=0x7fee10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cf346175b6c68c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:40.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25399700 1 -- 172.21.15.142:0/3018116498 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000b860 con 0x7fee200c6270 2023-09-30T22:56:40.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25399700 1 -- 172.21.15.142:0/3018116498 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000b9c0 con 0x7fee200c6270 2023-09-30T22:56:40.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.654+0000 7fee25399700 1 -- 172.21.15.142:0/3018116498 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000bd60 con 0x7fee200c6270 2023-09-30T22:56:40.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 -- 172.21.15.142:0/3018116498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 msgr2=0x7fee201580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:40.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 --2- 172.21.15.142:0/3018116498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee201580c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fee100099b0 tx=0x7fee10009250 comp rx=0 tx=0).stop 2023-09-30T22:56:40.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 -- 172.21.15.142:0/3018116498 shutdown_connections 2023-09-30T22:56:40.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 --2- 172.21.15.142:0/3018116498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee200c40e0 0x7fee200c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 --2- 172.21.15.142:0/3018116498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee201580c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 -- 172.21.15.142:0/3018116498 >> 172.21.15.142:0/3018116498 conn(0x7fee200cc670 msgr2=0x7fee200cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 -- 172.21.15.142:0/3018116498 shutdown_connections 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.655+0000 7fee285ff700 1 -- 172.21.15.142:0/3018116498 wait complete. 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.656+0000 7fee285ff700 1 Processor -- start 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.657+0000 7fee285ff700 1 -- start start 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.657+0000 7fee285ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee200c40e0 0x7fee20140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.657+0000 7fee285ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee2016a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.657+0000 7fee285ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20141150 0x7fee2015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.657+0000 7fee285ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2016eb80 con 0x7fee200c6270 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.657+0000 7fee285ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2015e580 con 0x7fee200c40e0 2023-09-30T22:56:40.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.657+0000 7fee285ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2015e860 con 0x7fee20141150 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee2016a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee2016a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47528/0 (socket says 172.21.15.142:47528) 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 -- 172.21.15.142:0/2920155631 learned_addr learned my addr 172.21.15.142:0/2920155631 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee2639b700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee200c40e0 0x7fee20140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 -- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20141150 msgr2=0x7fee2015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20141150 0x7fee2015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 -- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee200c40e0 msgr2=0x7fee20140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee200c40e0 0x7fee20140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:40.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 -- 172.21.15.142:0/2920155631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100094f0 con 0x7fee200c6270 2023-09-30T22:56:40.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee2639b700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee200c40e0 0x7fee20140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:40.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.658+0000 7fee25b9a700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee2016a680 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fee200c7990 tx=0x7fee10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:40.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.659+0000 7fee167fc700 1 -- 172.21.15.142:0/2920155631 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10024440 con 0x7fee200c6270 2023-09-30T22:56:40.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.659+0000 7fee167fc700 1 -- 172.21.15.142:0/2920155631 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee100245a0 con 0x7fee200c6270 2023-09-30T22:56:40.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.659+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2015eb40 con 0x7fee200c6270 2023-09-30T22:56:40.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.659+0000 7fee167fc700 1 -- 172.21.15.142:0/2920155631 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10024940 con 0x7fee200c6270 2023-09-30T22:56:40.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.659+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2015a780 con 0x7fee200c6270 2023-09-30T22:56:40.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.660+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee20069a50 con 0x7fee200c6270 2023-09-30T22:56:40.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.661+0000 7fee167fc700 1 -- 172.21.15.142:0/2920155631 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fee1001a420 con 0x7fee200c6270 2023-09-30T22:56:40.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.662+0000 7fee167fc700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fee04067330 0x7fee040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:40.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.662+0000 7fee167fc700 1 -- 172.21.15.142:0/2920155631 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fee100868f0 con 0x7fee200c6270 2023-09-30T22:56:40.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.662+0000 7fee2639b700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fee04067330 0x7fee040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:40.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.663+0000 7fee2639b700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fee04067330 0x7fee040697e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0017a0 tx=0x7fee1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:40.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.667+0000 7fee167fc700 1 -- 172.21.15.142:0/2920155631 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fee100538d0 con 0x7fee200c6270 2023-09-30T22:56:40.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:40.899+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fee20157ea0 con 0x7fee200c6270 2023-09-30T22:56:41.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.425+0000 7fee167fc700 1 -- 172.21.15.142:0/2920155631 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7fee100150c0 con 0x7fee200c6270 2023-09-30T22:56:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.428+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fee04067330 msgr2=0x7fee040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.428+0000 7fee285ff700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fee04067330 0x7fee040697e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0017a0 tx=0x7fee1c009040 comp rx=0 tx=0).stop 2023-09-30T22:56:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.428+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 msgr2=0x7fee2016a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.428+0000 7fee285ff700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee2016a680 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fee200c7990 tx=0x7fee10017000 comp rx=0 tx=0).stop 2023-09-30T22:56:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 shutdown_connections 2023-09-30T22:56:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fee04067330 0x7fee040697e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20141150 0x7fee2015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee200c40e0 0x7fee20140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 --2- 172.21.15.142:0/2920155631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee200c6270 0x7fee2016a680 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 >> 172.21.15.142:0/2920155631 conn(0x7fee200cc670 msgr2=0x7fee20158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 shutdown_connections 2023-09-30T22:56:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.429+0000 7fee285ff700 1 -- 172.21.15.142:0/2920155631 wait complete. 2023-09-30T22:56:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 11 and data pool 12 2023-09-30T22:56:41.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:56:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.652+0000 7f2e513ff700 1 Processor -- start 2023-09-30T22:56:41.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.652+0000 7f2e513ff700 1 -- start start 2023-09-30T22:56:41.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e513ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e4c157a90 0x7f2e4c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:41.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e513ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e4c06b3d0 0x7f2e4c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:41.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e513ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c06d470 con 0x7f2e4c0b1f40 2023-09-30T22:56:41.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e513ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c157e60 con 0x7f2e4c157a90 2023-09-30T22:56:41.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e513ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0b2380 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e4affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e4c157a90 0x7f2e4c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:41.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e4affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e4c157a90 0x7f2e4c15bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42764/0 (socket says 172.21.15.142:42764) 2023-09-30T22:56:41.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e4affd700 1 -- 172.21.15.142:0/3995274578 learned_addr learned my addr 172.21.15.142:0/3995274578 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:41.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.653+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/3995274578 >> v2:172.21.15.148:3300/0 conn(0x7f2e4c06b3d0 0x7f2e4c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e4affd700 1 -- 172.21.15.142:0/3995274578 >> v2:172.21.15.148:3300/0 conn(0x7f2e4c06b3d0 msgr2=0x7f2e4c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:41.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e4affd700 1 --2- 172.21.15.142:0/3995274578 >> v2:172.21.15.148:3300/0 conn(0x7f2e4c06b3d0 0x7f2e4c0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e4affd700 1 -- 172.21.15.142:0/3995274578 >> v1:172.21.15.148:6789/0 conn(0x7f2e4c0b1f40 legacy=0x7f2e4c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e4affd700 1 -- 172.21.15.142:0/3995274578 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c15c430 con 0x7f2e4c157a90 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e4affd700 1 --2- 172.21.15.142:0/3995274578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c157a90 0x7f2e4c15bef0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c06bac0 tx=0x7f2e3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febeeeb9575dc590 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e49ffb700 1 -- 172.21.15.142:0/3995274578 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c009e70 con 0x7f2e4c157a90 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e49ffb700 1 -- 172.21.15.142:0/3995274578 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00b860 con 0x7f2e4c157a90 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.654+0000 7f2e49ffb700 1 -- 172.21.15.142:0/3995274578 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00bc00 con 0x7f2e4c157a90 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 -- 172.21.15.142:0/3995274578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c157a90 msgr2=0x7f2e4c15bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3995274578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c157a90 0x7f2e4c15bef0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c06bac0 tx=0x7f2e3c009250 comp rx=0 tx=0).stop 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 -- 172.21.15.142:0/3995274578 shutdown_connections 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3995274578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c157a90 0x7f2e4c15bef0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3995274578 >> v2:172.21.15.148:3300/0 conn(0x7f2e4c06b3d0 0x7f2e4c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 -- 172.21.15.142:0/3995274578 >> 172.21.15.142:0/3995274578 conn(0x7f2e4c0680c0 msgr2=0x7f2e4c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 -- 172.21.15.142:0/3995274578 shutdown_connections 2023-09-30T22:56:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.655+0000 7f2e513ff700 1 -- 172.21.15.142:0/3995274578 wait complete. 2023-09-30T22:56:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.657+0000 7f2e513ff700 1 Processor -- start 2023-09-30T22:56:41.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.657+0000 7f2e513ff700 1 -- start start 2023-09-30T22:56:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.658+0000 7f2e513ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c06b3d0 0x7f2e4c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.658+0000 7f2e513ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b1f40 0x7f2e4c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:41.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e513ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c157a90 0x7f2e4c16bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e513ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c153d00 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e513ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c153fe0 con 0x7f2e4c0b1f40 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e513ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1542c0 con 0x7f2e4c157a90 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c06b3d0 0x7f2e4c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c06b3d0 0x7f2e4c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42778/0 (socket says 172.21.15.142:42778) 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 -- 172.21.15.142:0/3077849967 learned_addr learned my addr 172.21.15.142:0/3077849967 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b1f40 0x7f2e4c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4b7fe700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c157a90 0x7f2e4c16bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 -- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c157a90 msgr2=0x7f2e4c16bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c157a90 0x7f2e4c16bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 -- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b1f40 msgr2=0x7f2e4c153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b1f40 0x7f2e4c153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.659+0000 7f2e4affd700 1 -- 172.21.15.142:0/3077849967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0094f0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.660+0000 7f2e4affd700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c06b3d0 0x7f2e4c154da0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c068600 tx=0x7f2e3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:41.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.660+0000 7f2e32ffd700 1 -- 172.21.15.142:0/3077849967 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00bbe0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.660+0000 7f2e32ffd700 1 -- 172.21.15.142:0/3077849967 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c011420 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.660+0000 7f2e32ffd700 1 -- 172.21.15.142:0/3077849967 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0117a0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.660+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c1545a0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.660+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c155f00 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.661+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0695b0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.662+0000 7f2e32ffd700 1 -- 172.21.15.142:0/3077849967 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2e3c011b90 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.663+0000 7f2e32ffd700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:41.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.663+0000 7f2e32ffd700 1 -- 172.21.15.142:0/3077849967 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e3c0864c0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.663+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:41.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.664+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0af3d0 tx=0x7f2e400091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:41.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.667+0000 7f2e32ffd700 1 -- 172.21.15.142:0/3077849967 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2e3c0533c0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.858+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4c0c85f0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.859+0000 7f2e32ffd700 1 -- 172.21.15.142:0/3077849967 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f2e3c0569e0 con 0x7f2e4c06b3d0 2023-09-30T22:56:41.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:41.861 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":90,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:56:40.901959+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:56:38.664603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-09-30T22:56:39.889523+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:56:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 msgr2=0x7f2e380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0af3d0 tx=0x7f2e400091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c06b3d0 msgr2=0x7f2e4c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:41.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c06b3d0 0x7f2e4c154da0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c068600 tx=0x7f2e3c017000 comp rx=0 tx=0).stop 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 shutdown_connections 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c157a90 0x7f2e4c16bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c06b3d0 0x7f2e4c154da0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 --2- 172.21.15.142:0/3077849967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b1f40 0x7f2e4c153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 >> 172.21.15.142:0/3077849967 conn(0x7f2e4c0680c0 msgr2=0x7f2e4c069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 shutdown_connections 2023-09-30T22:56:41.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:41.862+0000 7f2e513ff700 1 -- 172.21.15.142:0/3077849967 wait complete. 2023-09-30T22:56:41.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:56:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.070+0000 7fdcdfbff700 1 Processor -- start 2023-09-30T22:56:42.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.070+0000 7fdcdfbff700 1 -- start start 2023-09-30T22:56:42.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.071+0000 7fdcdfbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdcd8159a40 0x7fdcd80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.071+0000 7fdcdfbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.071+0000 7fdcdfbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd815e510 con 0x7fdcd80ac040 2023-09-30T22:56:42.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.071+0000 7fdcdfbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd815e7f0 con 0x7fdcd8159a40 2023-09-30T22:56:42.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.071+0000 7fdcdfbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd80aa430 con 0x7fdcd806b7e0 2023-09-30T22:56:42.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.071+0000 7fdcdd99b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdcd8159a40 0x7fdcd80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdd99b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdcd8159a40 0x7fdcd80a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42786/0 (socket says 172.21.15.142:42786) 2023-09-30T22:56:42.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdd99b700 1 -- 172.21.15.142:0/3350073915 learned_addr learned my addr 172.21.15.142:0/3350073915 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:42.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcde19c700 1 --2- 172.21.15.142:0/3350073915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdd99b700 1 -- 172.21.15.142:0/3350073915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 msgr2=0x7fdcd806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:42.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdd99b700 1 --2- 172.21.15.142:0/3350073915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd806d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdd99b700 1 -- 172.21.15.142:0/3350073915 >> v1:172.21.15.148:6789/0 conn(0x7fdcd80ac040 legacy=0x7fdcd806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdd99b700 1 -- 172.21.15.142:0/3350073915 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd80aa710 con 0x7fdcd8159a40 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdd99b700 1 --2- 172.21.15.142:0/3350073915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80a98c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40099b0 tx=0x7fdcd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb726adb9bca9de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.072+0000 7fdcdc999700 1 -- 172.21.15.142:0/3350073915 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4009ea0 con 0x7fdcd8159a40 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdc999700 1 -- 172.21.15.142:0/3350073915 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400b860 con 0x7fdcd8159a40 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdc999700 1 -- 172.21.15.142:0/3350073915 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400bc00 con 0x7fdcd8159a40 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3350073915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 msgr2=0x7fdcd80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3350073915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80a98c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40099b0 tx=0x7fdcd4009250 comp rx=0 tx=0).stop 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3350073915 shutdown_connections 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3350073915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd806d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3350073915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80a98c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3350073915 >> 172.21.15.142:0/3350073915 conn(0x7fdcd80680a0 msgr2=0x7fdcd80ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3350073915 shutdown_connections 2023-09-30T22:56:42.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.073+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3350073915 wait complete. 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.075+0000 7fdcdfbff700 1 Processor -- start 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.075+0000 7fdcdfbff700 1 -- start start 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdfbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdfbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd80ac040 0x7fdcd814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdfbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdfbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd814de30 con 0x7fdcd8159a40 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdfbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd814d220 con 0x7fdcd80ac040 2023-09-30T22:56:42.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdfbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd814d500 con 0x7fdcd806b7e0 2023-09-30T22:56:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80afaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42792/0 (socket says 172.21.15.142:42792) 2023-09-30T22:56:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 -- 172.21.15.142:0/3455500505 learned_addr learned my addr 172.21.15.142:0/3455500505 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdd99b700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd814c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdd19a700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd80ac040 0x7fdcd814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 -- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 msgr2=0x7fdcd814c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd814c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 -- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd80ac040 msgr2=0x7fdcd814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd80ac040 0x7fdcd814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcde19c700 1 -- 172.21.15.142:0/3455500505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40094f0 con 0x7fdcd8159a40 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.076+0000 7fdcdd19a700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd80ac040 0x7fdcd814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.077+0000 7fdcde19c700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80afaa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009ec0 tx=0x7fdcd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.077+0000 7fdccdffb700 1 -- 172.21.15.142:0/3455500505 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000cc20 con 0x7fdcd8159a40 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.077+0000 7fdccdffb700 1 -- 172.21.15.142:0/3455500505 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdcd8159a40 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.077+0000 7fdccdffb700 1 -- 172.21.15.142:0/3455500505 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0014480 con 0x7fdcd8159a40 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.077+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd814d7e0 con 0x7fdcd8159a40 2023-09-30T22:56:42.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.077+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd814cf40 con 0x7fdcd8159a40 2023-09-30T22:56:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.078+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd814dfa0 con 0x7fdcd8159a40 2023-09-30T22:56:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.079+0000 7fdccdffb700 1 -- 172.21.15.142:0/3455500505 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdcd0014810 con 0x7fdcd8159a40 2023-09-30T22:56:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.080+0000 7fdccdffb700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcbc067330 0x7fdcbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.080+0000 7fdccdffb700 1 -- 172.21.15.142:0/3455500505 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdcd0085930 con 0x7fdcd8159a40 2023-09-30T22:56:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.080+0000 7fdcdd99b700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcbc067330 0x7fdcbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.080+0000 7fdcdd99b700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcbc067330 0x7fdcbc0697e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40099b0 tx=0x7fdcd4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:42.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.084+0000 7fdccdffb700 1 -- 172.21.15.142:0/3455500505 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdcd0052790 con 0x7fdcd8159a40 2023-09-30T22:56:42.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.277+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcd8063a80 con 0x7fdcd8159a40 2023-09-30T22:56:42.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.278+0000 7fdccdffb700 1 -- 172.21.15.142:0/3455500505 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+17026 (secure 0 0 0) 0x7fdcd0055db0 con 0x7fdcd8159a40 2023-09-30T22:56:42.279 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:42.279 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":90,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:56:40.901959+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:56:38.664603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-09-30T22:56:39.889523+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcbc067330 msgr2=0x7fdcbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcbc067330 0x7fdcbc0697e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40099b0 tx=0x7fdcd4017000 comp rx=0 tx=0).stop 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 msgr2=0x7fdcd80afaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80afaa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009ec0 tx=0x7fdcd000b040 comp rx=0 tx=0).stop 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 shutdown_connections 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcbc067330 0x7fdcbc0697e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd8159a40 0x7fdcd80afaa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcd806b7e0 0x7fdcd814c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 --2- 172.21.15.142:0/3455500505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd80ac040 0x7fdcd814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.280+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 >> 172.21.15.142:0/3455500505 conn(0x7fdcd80680a0 msgr2=0x7fdcd80caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.281+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 shutdown_connections 2023-09-30T22:56:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.281+0000 7fdcdfbff700 1 -- 172.21.15.142:0/3455500505 wait complete. 2023-09-30T22:56:42.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:56:42.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.493+0000 7fb0ed3ff700 1 Processor -- start 2023-09-30T22:56:42.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.494+0000 7fb0ed3ff700 1 -- start start 2023-09-30T22:56:42.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0ed3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb0e8159b40 0x7fb0e806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0ed3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8067620 0x7fb0e8067a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0ed3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e8067fc0 con 0x7fb0e8159f10 2023-09-30T22:56:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0ed3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e806b650 con 0x7fb0e8159b40 2023-09-30T22:56:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0ed3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e806aa40 con 0x7fb0e8067620 2023-09-30T22:56:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0e67fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb0e8159f10 0x7fb0e80683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55856/0 (socket says 172.21.15.142:55856) 2023-09-30T22:56:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0e67fc700 1 -- 172.21.15.142:0/3033021548 learned_addr learned my addr 172.21.15.142:0/3033021548 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0e6ffd700 1 --2- 172.21.15.142:0/3033021548 >> v2:172.21.15.148:3300/0 conn(0x7fb0e8159b40 0x7fb0e806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0e77fe700 1 --2- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8067620 0x7fb0e8067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.495+0000 7fb0e5ffb700 1 -- 172.21.15.142:0/3033021548 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364324271 0 0) 0x7fb0dc001110 con 0x7fb0e8159f10 2023-09-30T22:56:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e5ffb700 1 -- 172.21.15.142:0/3033021548 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d0003570 con 0x7fb0e8159f10 2023-09-30T22:56:42.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e5ffb700 1 -- 172.21.15.142:0/3033021548 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4138439767 0 0) 0x7fb0d0003570 con 0x7fb0e8159f10 2023-09-30T22:56:42.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e6ffd700 1 -- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8067620 msgr2=0x7fb0e8067a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:42.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e6ffd700 1 --2- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8067620 0x7fb0e8067a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e6ffd700 1 -- 172.21.15.142:0/3033021548 >> v1:172.21.15.142:6789/0 conn(0x7fb0e8159f10 legacy=0x7fb0e80683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e6ffd700 1 -- 172.21.15.142:0/3033021548 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e806ad20 con 0x7fb0e8159b40 2023-09-30T22:56:42.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e77fe700 1 --2- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8067620 0x7fb0e8067a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:42.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e6ffd700 1 --2- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 0x7fb0e806a360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80098e0 tx=0x7fb0d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba4b542a660ce19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:42.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e5ffb700 1 -- 172.21.15.142:0/3033021548 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc001600 con 0x7fb0e8159b40 2023-09-30T22:56:42.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e5ffb700 1 -- 172.21.15.142:0/3033021548 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8011420 con 0x7fb0e8159b40 2023-09-30T22:56:42.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.496+0000 7fb0e5ffb700 1 -- 172.21.15.142:0/3033021548 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80117c0 con 0x7fb0e8159b40 2023-09-30T22:56:42.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 msgr2=0x7fb0e806a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 0x7fb0e806a360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80098e0 tx=0x7fb0d80091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3033021548 shutdown_connections 2023-09-30T22:56:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 0x7fb0e806a360 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3033021548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8067620 0x7fb0e8067a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3033021548 >> 172.21.15.142:0/3033021548 conn(0x7fb0e80c9950 msgr2=0x7fb0e80c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:42.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3033021548 shutdown_connections 2023-09-30T22:56:42.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.497+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3033021548 wait complete. 2023-09-30T22:56:42.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.498+0000 7fb0ed3ff700 1 Processor -- start 2023-09-30T22:56:42.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.499+0000 7fb0ed3ff700 1 -- start start 2023-09-30T22:56:42.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.499+0000 7fb0ed3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8067620 0x7fb0e816a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0ed3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 0x7fb0e81561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0ed3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8159f10 0x7fb0e80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0ed3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80afdc0 con 0x7fb0e8067620 2023-09-30T22:56:42.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0ed3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80b0060 con 0x7fb0e8159b40 2023-09-30T22:56:42.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0ed3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80b0340 con 0x7fb0e8159f10 2023-09-30T22:56:42.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8067620 0x7fb0e816a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8067620 0x7fb0e816a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42804/0 (socket says 172.21.15.142:42804) 2023-09-30T22:56:42.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 -- 172.21.15.142:0/3054889820 learned_addr learned my addr 172.21.15.142:0/3054889820 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e67fc700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 0x7fb0e81561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e77fe700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8159f10 0x7fb0e80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 -- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8159f10 msgr2=0x7fb0e80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8159f10 0x7fb0e80c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 -- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 msgr2=0x7fb0e81561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 0x7fb0e81561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 -- 172.21.15.142:0/3054889820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0009a20 con 0x7fb0e8067620 2023-09-30T22:56:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.500+0000 7fb0e6ffd700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8067620 0x7fb0e816a5c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80030c0 tx=0x7fb0d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.501+0000 7fb0ceffd700 1 -- 172.21.15.142:0/3054889820 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d801cbe0 con 0x7fb0e8067620 2023-09-30T22:56:42.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.501+0000 7fb0ceffd700 1 -- 172.21.15.142:0/3054889820 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d801cd40 con 0x7fb0e8067620 2023-09-30T22:56:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.501+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d8009420 con 0x7fb0e8067620 2023-09-30T22:56:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.501+0000 7fb0ceffd700 1 -- 172.21.15.142:0/3054889820 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d801a6a0 con 0x7fb0e8067620 2023-09-30T22:56:42.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.501+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e80c52a0 con 0x7fb0e8067620 2023-09-30T22:56:42.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.502+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80699b0 con 0x7fb0e8067620 2023-09-30T22:56:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.503+0000 7fb0ceffd700 1 -- 172.21.15.142:0/3054889820 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb0d801aad0 con 0x7fb0e8067620 2023-09-30T22:56:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.504+0000 7fb0ceffd700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0d4067330 0x7fb0d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.504+0000 7fb0ceffd700 1 -- 172.21.15.142:0/3054889820 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0d80865b0 con 0x7fb0e8067620 2023-09-30T22:56:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.504+0000 7fb0e67fc700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0d4067330 0x7fb0d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.504+0000 7fb0e67fc700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0d4067330 0x7fb0d40697e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0017b0 tx=0x7fb0dc001dd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:42.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.508+0000 7fb0ceffd700 1 -- 172.21.15.142:0/3054889820 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb0d8053410 con 0x7fb0e8067620 2023-09-30T22:56:42.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:42.740+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb0e806b000 con 0x7fb0e8067620 2023-09-30T22:56:42.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:42.801 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:43.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.449+0000 7fb0ceffd700 1 -- 172.21.15.142:0/3054889820 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb0d8056a30 con 0x7fb0e8067620 2023-09-30T22:56:43.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0d4067330 msgr2=0x7fb0d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:43.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0d4067330 0x7fb0d40697e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0017b0 tx=0x7fb0dc001dd0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8067620 msgr2=0x7fb0e816a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:43.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8067620 0x7fb0e816a5c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80030c0 tx=0x7fb0d8016000 comp rx=0 tx=0).stop 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 shutdown_connections 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb0d4067330 0x7fb0d40697e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0e8159f10 0x7fb0e80c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8067620 0x7fb0e816a5c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 --2- 172.21.15.142:0/3054889820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0e8159b40 0x7fb0e81561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.451+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 >> 172.21.15.142:0/3054889820 conn(0x7fb0e80c9950 msgr2=0x7fb0e815d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.452+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 shutdown_connections 2023-09-30T22:56:43.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.452+0000 7fb0ed3ff700 1 -- 172.21.15.142:0/3054889820 wait complete. 2023-09-30T22:56:43.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:56:43.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.667+0000 7fa024fff700 1 Processor -- start 2023-09-30T22:56:43.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.667+0000 7fa024fff700 1 -- start start 2023-09-30T22:56:43.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.668+0000 7fa024fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa020069f10 0x7fa0200c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:43.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.668+0000 7fa024fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa0200cb350 0x7fa0200c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:43.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.668+0000 7fa024fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0200c7690 con 0x7fa0200c52a0 2023-09-30T22:56:43.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.668+0000 7fa024fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0201406a0 con 0x7fa020069f10 2023-09-30T22:56:43.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.668+0000 7fa024fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0200c3a50 con 0x7fa0200cb350 2023-09-30T22:56:43.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa0200c52a0 0x7fa0200c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55864/0 (socket says 172.21.15.142:55864) 2023-09-30T22:56:43.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01dd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa020069f10 0x7fa0200c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:43.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01e59c700 1 -- 172.21.15.142:0/913727568 learned_addr learned my addr 172.21.15.142:0/913727568 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:43.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01ed9d700 1 --2- 172.21.15.142:0/913727568 >> v2:172.21.15.148:3300/0 conn(0x7fa0200cb350 0x7fa0200c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:43.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01dd9b700 1 -- 172.21.15.142:0/913727568 >> v2:172.21.15.148:3300/0 conn(0x7fa0200cb350 msgr2=0x7fa0200c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:43.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01dd9b700 1 --2- 172.21.15.142:0/913727568 >> v2:172.21.15.148:3300/0 conn(0x7fa0200cb350 0x7fa0200c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01dd9b700 1 -- 172.21.15.142:0/913727568 >> v1:172.21.15.142:6789/0 conn(0x7fa0200c52a0 legacy=0x7fa0200c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:43.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01dd9b700 1 -- 172.21.15.142:0/913727568 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0200c7f20 con 0x7fa020069f10 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.669+0000 7fa01dd9b700 1 --2- 172.21.15.142:0/913727568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa020069f10 0x7fa0200c5670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa0200c0120 tx=0x7fa0140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9080fbe4c6315ef7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa01d59a700 1 -- 172.21.15.142:0/913727568 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014011630 con 0x7fa020069f10 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa01d59a700 1 -- 172.21.15.142:0/913727568 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014011790 con 0x7fa020069f10 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa01d59a700 1 -- 172.21.15.142:0/913727568 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014011b30 con 0x7fa020069f10 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 -- 172.21.15.142:0/913727568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa020069f10 msgr2=0x7fa0200c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 --2- 172.21.15.142:0/913727568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa020069f10 0x7fa0200c5670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa0200c0120 tx=0x7fa0140091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 -- 172.21.15.142:0/913727568 shutdown_connections 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 --2- 172.21.15.142:0/913727568 >> v2:172.21.15.148:3300/0 conn(0x7fa0200cb350 0x7fa0200c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 --2- 172.21.15.142:0/913727568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa020069f10 0x7fa0200c5670 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 -- 172.21.15.142:0/913727568 >> 172.21.15.142:0/913727568 conn(0x7fa0200cc670 msgr2=0x7fa0200cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:43.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 -- 172.21.15.142:0/913727568 shutdown_connections 2023-09-30T22:56:43.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.670+0000 7fa024fff700 1 -- 172.21.15.142:0/913727568 wait complete. 2023-09-30T22:56:43.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.672+0000 7fa024fff700 1 Processor -- start 2023-09-30T22:56:43.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.672+0000 7fa024fff700 1 -- start start 2023-09-30T22:56:43.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa024fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa020069f10 0x7fa0200b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:43.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa024fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0200c52a0 0x7fa0200b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa024fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0200cb350 0x7fa02016a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa024fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0200b4a80 con 0x7fa0200cb350 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa024fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0200b4d30 con 0x7fa020069f10 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa024fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0200b5010 con 0x7fa0200c52a0 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0200cb350 0x7fa02016a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0200cb350 0x7fa02016a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42820/0 (socket says 172.21.15.142:42820) 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 -- 172.21.15.142:0/1276152779 learned_addr learned my addr 172.21.15.142:0/1276152779 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01e59c700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa020069f10 0x7fa0200b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01dd9b700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0200c52a0 0x7fa0200b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:43.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 -- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0200c52a0 msgr2=0x7fa0200b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0200c52a0 0x7fa0200b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 -- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa020069f10 msgr2=0x7fa0200b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa020069f10 0x7fa0200b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01ed9d700 1 -- 172.21.15.142:0/1276152779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009420 con 0x7fa0200cb350 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01e59c700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa020069f10 0x7fa0200b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.673+0000 7fa01dd9b700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0200c52a0 0x7fa0200b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.674+0000 7fa01ed9d700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0200cb350 0x7fa02016a330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa018009df0 tx=0x7fa01800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.674+0000 7fa00e7fc700 1 -- 172.21.15.142:0/1276152779 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01800cb50 con 0x7fa0200cb350 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.674+0000 7fa00e7fc700 1 -- 172.21.15.142:0/1276152779 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01800f040 con 0x7fa0200cb350 2023-09-30T22:56:43.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.674+0000 7fa00e7fc700 1 -- 172.21.15.142:0/1276152779 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018014480 con 0x7fa0200cb350 2023-09-30T22:56:43.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.674+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0200b52f0 con 0x7fa0200cb350 2023-09-30T22:56:43.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.674+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02013d350 con 0x7fa0200cb350 2023-09-30T22:56:43.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.675+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02013d540 con 0x7fa0200cb350 2023-09-30T22:56:43.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.676+0000 7fa00e7fc700 1 -- 172.21.15.142:0/1276152779 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa018014830 con 0x7fa0200cb350 2023-09-30T22:56:43.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.678+0000 7fa00e7fc700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa000067330 0x7fa0000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:43.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.678+0000 7fa00e7fc700 1 -- 172.21.15.142:0/1276152779 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa0180855b0 con 0x7fa0200cb350 2023-09-30T22:56:43.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.678+0000 7fa01e59c700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa000067330 0x7fa0000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:43.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.679+0000 7fa01e59c700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa000067330 0x7fa0000697e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa010001820 tx=0x7fa010009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:43.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.682+0000 7fa00e7fc700 1 -- 172.21.15.142:0/1276152779 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa018052410 con 0x7fa0200cb350 2023-09-30T22:56:43.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:43.915+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa02006fc10 con 0x7fa0200cb350 2023-09-30T22:56:44.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.461+0000 7fa00e7fc700 1 -- 172.21.15.142:0/1276152779 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa018055a30 con 0x7fa0200cb350 2023-09-30T22:56:44.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa000067330 msgr2=0x7fa0000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:44.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa000067330 0x7fa0000697e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa010001820 tx=0x7fa010009040 comp rx=0 tx=0).stop 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0200cb350 msgr2=0x7fa02016a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0200cb350 0x7fa02016a330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa018009df0 tx=0x7fa01800b040 comp rx=0 tx=0).stop 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 shutdown_connections 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa000067330 0x7fa0000697e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0200cb350 0x7fa02016a330 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa020069f10 0x7fa0200b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 --2- 172.21.15.142:0/1276152779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0200c52a0 0x7fa0200b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 >> 172.21.15.142:0/1276152779 conn(0x7fa0200cc670 msgr2=0x7fa02006df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 shutdown_connections 2023-09-30T22:56:44.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.463+0000 7fa024fff700 1 -- 172.21.15.142:0/1276152779 wait complete. 2023-09-30T22:56:44.483 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.674+0000 7f4cc17ff700 1 Processor -- start 2023-09-30T22:56:44.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.674+0000 7f4cc17ff700 1 -- start start 2023-09-30T22:56:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.675+0000 7f4cc17ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4cbc15dea0 0x7f4cbc0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:44.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.675+0000 7f4cc17ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cbc0b24a0 0x7f4cbc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.675+0000 7f4cc17ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc069f10 0x7f4cbc06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.675+0000 7f4cc17ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cbc06ef60 con 0x7f4cbc0b24a0 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.675+0000 7f4cc17ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cbc15f250 con 0x7f4cbc15dea0 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.675+0000 7f4cc17ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc15e680 con 0x7f4cbc069f10 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cbc0b24a0 0x7f4cbc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cbc0b24a0 0x7f4cbc06d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42834/0 (socket says 172.21.15.142:42834) 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 -- 172.21.15.142:0/3063202763 learned_addr learned my addr 172.21.15.142:0/3063202763 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 -- 172.21.15.142:0/3063202763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc069f10 msgr2=0x7f4cbc06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 --2- 172.21.15.142:0/3063202763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc069f10 0x7f4cbc06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 -- 172.21.15.142:0/3063202763 >> v2:172.21.15.148:3300/0 conn(0x7f4cbc15dea0 msgr2=0x7f4cbc0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:44.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cbaffd700 1 --2- 172.21.15.142:0/3063202763 >> v2:172.21.15.148:3300/0 conn(0x7f4cbc15dea0 0x7f4cbc0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 --2- 172.21.15.142:0/3063202763 >> v2:172.21.15.148:3300/0 conn(0x7f4cbc15dea0 0x7f4cbc0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 -- 172.21.15.142:0/3063202763 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc15e920 con 0x7f4cbc0b24a0 2023-09-30T22:56:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cbaffd700 1 --2- 172.21.15.142:0/3063202763 >> v2:172.21.15.148:3300/0 conn(0x7f4cbc15dea0 0x7f4cbc0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cba7fc700 1 --2- 172.21.15.142:0/3063202763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc0b24a0 0x7f4cbc06d3e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc06ce90 tx=0x7f4cb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31c7f5e1b6d5435 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.676+0000 7f4cb9ffb700 1 -- 172.21.15.142:0/3063202763 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000b860 con 0x7f4cbc0b24a0 2023-09-30T22:56:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cb9ffb700 1 -- 172.21.15.142:0/3063202763 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb000b9c0 con 0x7f4cbc0b24a0 2023-09-30T22:56:44.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cb9ffb700 1 -- 172.21.15.142:0/3063202763 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000bd60 con 0x7f4cbc0b24a0 2023-09-30T22:56:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3063202763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc0b24a0 msgr2=0x7f4cbc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3063202763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc0b24a0 0x7f4cbc06d3e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc06ce90 tx=0x7f4cb0009250 comp rx=0 tx=0).stop 2023-09-30T22:56:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3063202763 shutdown_connections 2023-09-30T22:56:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3063202763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc069f10 0x7f4cbc06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3063202763 >> v2:172.21.15.148:3300/0 conn(0x7f4cbc15dea0 0x7f4cbc0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3063202763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc0b24a0 0x7f4cbc06d3e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3063202763 >> 172.21.15.142:0/3063202763 conn(0x7f4cbc0680c0 msgr2=0x7f4cbc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3063202763 shutdown_connections 2023-09-30T22:56:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.677+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3063202763 wait complete. 2023-09-30T22:56:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.679+0000 7f4cc17ff700 1 Processor -- start 2023-09-30T22:56:44.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.679+0000 7f4cc17ff700 1 -- start start 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cc17ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cbc069f10 0x7f4cbc1606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cc17ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc0b24a0 0x7f4cbc1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cc17ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc15dea0 0x7f4cbc171f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cc17ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc160240 con 0x7f4cbc15dea0 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cc17ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc156c40 con 0x7f4cbc069f10 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cc17ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc172db0 con 0x7f4cbc0b24a0 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cbc069f10 0x7f4cbc1606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc15dea0 0x7f4cbc171f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:44.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cbc069f10 0x7f4cbc1606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:37332/0 (socket says 172.21.15.142:37332) 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbaffd700 1 -- 172.21.15.142:0/3046237857 learned_addr learned my addr 172.21.15.142:0/3046237857 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cba7fc700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc0b24a0 0x7f4cbc1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbb7fe700 1 -- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc0b24a0 msgr2=0x7f4cbc1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbb7fe700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc0b24a0 0x7f4cbc1533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbb7fe700 1 -- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cbc069f10 msgr2=0x7f4cbc1606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.680+0000 7f4cbb7fe700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cbc069f10 0x7f4cbc1606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4cbb7fe700 1 -- 172.21.15.142:0/3046237857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb00094f0 con 0x7f4cbc15dea0 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4cba7fc700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc0b24a0 0x7f4cbc1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:44.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4cbb7fe700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc15dea0 0x7f4cbc171f60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400bad0 tx=0x7f4cb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:44.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4ca2ffd700 1 -- 172.21.15.142:0/3046237857 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400c840 con 0x7f4cbc15dea0 2023-09-30T22:56:44.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4ca2ffd700 1 -- 172.21.15.142:0/3046237857 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb400c9c0 con 0x7f4cbc15dea0 2023-09-30T22:56:44.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4ca2ffd700 1 -- 172.21.15.142:0/3046237857 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400cd80 con 0x7f4cbc15dea0 2023-09-30T22:56:44.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cbc172ad0 con 0x7f4cbc15dea0 2023-09-30T22:56:44.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.681+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cbc15fed0 con 0x7f4cbc15dea0 2023-09-30T22:56:44.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.682+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cbc0695b0 con 0x7f4cbc15dea0 2023-09-30T22:56:44.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.683+0000 7f4ca2ffd700 1 -- 172.21.15.142:0/3046237857 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4cb4014620 con 0x7f4cbc15dea0 2023-09-30T22:56:44.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.684+0000 7f4ca2ffd700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4ca8067330 0x7f4ca80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:44.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.684+0000 7f4ca2ffd700 1 -- 172.21.15.142:0/3046237857 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4cb4084b50 con 0x7f4cbc15dea0 2023-09-30T22:56:44.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.684+0000 7f4cbaffd700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4ca8067330 0x7f4ca80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:44.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.685+0000 7f4cbaffd700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4ca8067330 0x7f4ca80697e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4cac006fd0 tx=0x7f4cac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:44.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.688+0000 7f4ca2ffd700 1 -- 172.21.15.142:0/3046237857 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4cb404c570 con 0x7f4cbc15dea0 2023-09-30T22:56:44.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.920+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cbc15da30 con 0x7f4cbc15dea0 2023-09-30T22:56:44.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.920+0000 7f4ca2ffd700 1 -- 172.21.15.142:0/3046237857 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f4cb40519b0 con 0x7f4cbc15dea0 2023-09-30T22:56:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:44.922 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:56:40.902309+0000","modified":"2023-09-30T22:56:44.449514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3908259553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3908259553},{"type":"v1","addr":"172.21.15.148:6835","nonce":3908259553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4ca8067330 msgr2=0x7f4ca80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4ca8067330 0x7f4ca80697e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4cac006fd0 tx=0x7f4cac008040 comp rx=0 tx=0).stop 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc15dea0 msgr2=0x7f4cbc171f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc15dea0 0x7f4cbc171f60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400bad0 tx=0x7f4cb4009780 comp rx=0 tx=0).stop 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 shutdown_connections 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4ca8067330 0x7f4ca80697e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cbc15dea0 0x7f4cbc171f60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cbc069f10 0x7f4cbc1606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 --2- 172.21.15.142:0/3046237857 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cbc0b24a0 0x7f4cbc1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:44.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.922+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 >> 172.21.15.142:0/3046237857 conn(0x7f4cbc0680c0 msgr2=0x7f4cbc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:44.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.923+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 shutdown_connections 2023-09-30T22:56:44.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:44.923+0000 7f4cc17ff700 1 -- 172.21.15.142:0/3046237857 wait complete. 2023-09-30T22:56:44.925 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 41 2023-09-30T22:56:44.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:56:45.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.128+0000 7f2dbf7ff700 1 Processor -- start 2023-09-30T22:56:45.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.128+0000 7f2dbf7ff700 1 -- start start 2023-09-30T22:56:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2dbf7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 0x7f2db8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2dbf7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db806d3e0 con 0x7f2db806e820 2023-09-30T22:56:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2dbf7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db806dc80 con 0x7f2db80b00d0 2023-09-30T22:56:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2dbf7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db806b790 con 0x7f2db80af020 2023-09-30T22:56:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2dbdd9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2db806e820 0x7f2db815a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55880/0 (socket says 172.21.15.142:55880) 2023-09-30T22:56:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2dbdd9c700 1 -- 172.21.15.142:0/1901130309 learned_addr learned my addr 172.21.15.142:0/1901130309 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2dbd59b700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 0x7f2db8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726175396 0 0) 0x7f2db806d3e0 con 0x7f2db806e820 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.130+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da4003570 con 0x7f2db806e820 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692561397 0 0) 0x7f2db806dc80 con 0x7f2db80b00d0 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db806d3e0 con 0x7f2db80b00d0 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2808357977 0 0) 0x7f2da4003570 con 0x7f2db806e820 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 msgr2=0x7f2db8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 0x7f2db8156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 >> v1:172.21.15.148:6789/0 conn(0x7f2db80b00d0 legacy=0x7f2db806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80b0650 con 0x7f2db806e820 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f2db00017f0 con 0x7f2db806e820 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 >> v1:172.21.15.142:6789/0 conn(0x7f2db806e820 legacy=0x7f2db815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4003c20 0x7f2da4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da4004810 0x7f2da4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 0x7f2da4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db806b790 con 0x7f2da4004810 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da400de00 con 0x7f2da4003c20 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da400dfc0 con 0x7f2db80af020 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbcd9a700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da4004810 0x7f2da4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbd59b700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4003c20 0x7f2da4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbdd9c700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 0x7f2da4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbcd9a700 1 -- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 msgr2=0x7f2da4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbcd9a700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db80af020 0x7f2da4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbcd9a700 1 -- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4003c20 msgr2=0x7f2da4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbcd9a700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4003c20 0x7f2da4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.131+0000 7f2dbcd9a700 1 -- 172.21.15.142:0/1901130309 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4003570 con 0x7f2da4004810 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.132+0000 7f2dbcd9a700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da4004810 0x7f2da4004c80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2da8001a10 tx=0x7f2da8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68a2e48d9a33279 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.132+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800c5d0 con 0x7f2da4004810 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.132+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800c730 con 0x7f2da4004810 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.132+0000 7f2daffff700 1 -- 172.21.15.142:0/1901130309 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800cad0 con 0x7f2da4004810 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.132+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/1901130309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da4004810 msgr2=0x7f2da4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.132+0000 7f2dbf7ff700 1 --2- 172.21.15.142:0/1901130309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da4004810 0x7f2da4004c80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2da8001a10 tx=0x7f2da8007d30 comp rx=0 tx=0).stop 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.132+0000 7f2dbdd9c700 1 -- 172.21.15.142:0/1901130309 reap_dead start 2023-09-30T22:56:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.133+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/1901130309 shutdown_connections 2023-09-30T22:56:45.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.133+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/1901130309 >> 172.21.15.142:0/1901130309 conn(0x7f2db80680c0 msgr2=0x7f2db80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:45.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.133+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/1901130309 shutdown_connections 2023-09-30T22:56:45.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.133+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/1901130309 wait complete. 2023-09-30T22:56:45.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.134+0000 7f2dbf7ff700 1 Processor -- start 2023-09-30T22:56:45.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.134+0000 7f2dbf7ff700 1 -- start start 2023-09-30T22:56:45.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbf7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4004810 0x7f2db816a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbf7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db8163bb0 0x7f2db80c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbf7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2db80c6c70 0x7f2db80a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbf7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80c70f0 con 0x7f2db80c6c70 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbf7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db816ace0 con 0x7f2da4004810 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbf7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db815b000 con 0x7f2db8163bb0 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbdd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2db80c6c70 0x7f2db80a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbdd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2db80c6c70 0x7f2db80a5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42862/0 (socket says 172.21.15.142:42862) 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.135+0000 7f2dbdd9c700 1 -- 172.21.15.142:0/2636535063 learned_addr learned my addr 172.21.15.142:0/2636535063 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbd59b700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4004810 0x7f2db816a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbcd9a700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db8163bb0 0x7f2db80c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbdd9c700 1 -- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db8163bb0 msgr2=0x7f2db80c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbdd9c700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db8163bb0 0x7f2db80c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbdd9c700 1 -- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4004810 msgr2=0x7f2db816a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbdd9c700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4004810 0x7f2db816a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbdd9c700 1 -- 172.21.15.142:0/2636535063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db815b2e0 con 0x7f2db80c6c70 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbcd9a700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db8163bb0 0x7f2db80c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbd59b700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4004810 0x7f2db816a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbdd9c700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2db80c6c70 0x7f2db80a5660 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2db8068ae0 tx=0x7f2db80b0540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dad7fa700 1 -- 172.21.15.142:0/2636535063 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000ebc0 con 0x7f2db80c6c70 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dad7fa700 1 -- 172.21.15.142:0/2636535063 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000ed20 con 0x7f2db80c6c70 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dad7fa700 1 -- 172.21.15.142:0/2636535063 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0013650 con 0x7f2db80c6c70 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db815b5c0 con 0x7f2db80c6c70 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.136+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db815bb80 con 0x7f2db80c6c70 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.137+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db8063490 con 0x7f2db80c6c70 2023-09-30T22:56:45.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.138+0000 7f2dad7fa700 1 -- 172.21.15.142:0/2636535063 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2db00139c0 con 0x7f2db80c6c70 2023-09-30T22:56:45.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.139+0000 7f2dad7fa700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d9c067330 0x7f2d9c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.139+0000 7f2dad7fa700 1 -- 172.21.15.142:0/2636535063 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2db00850e0 con 0x7f2db80c6c70 2023-09-30T22:56:45.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.139+0000 7f2dbd59b700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d9c067330 0x7f2d9c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.140+0000 7f2dbd59b700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d9c067330 0x7f2d9c0697e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2db4006dc0 tx=0x7f2db4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:45.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.143+0000 7f2dad7fa700 1 -- 172.21.15.142:0/2636535063 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2db0051f40 con 0x7f2db80c6c70 2023-09-30T22:56:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.334+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2db806fc10 con 0x7f2db80c6c70 2023-09-30T22:56:45.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.335+0000 7f2dad7fa700 1 -- 172.21.15.142:0/2636535063 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17013 (secure 0 0 0) 0x7f2db0055560 con 0x7f2db80c6c70 2023-09-30T22:56:45.336 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:45.336 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:56:42.424379+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:56:38.664603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-09-30T22:56:39.889523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:56:45.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d9c067330 msgr2=0x7f2d9c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d9c067330 0x7f2d9c0697e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2db4006dc0 tx=0x7f2db4008040 comp rx=0 tx=0).stop 2023-09-30T22:56:45.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2db80c6c70 msgr2=0x7f2db80a5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2db80c6c70 0x7f2db80a5660 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2db8068ae0 tx=0x7f2db80b0540 comp rx=0 tx=0).stop 2023-09-30T22:56:45.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 shutdown_connections 2023-09-30T22:56:45.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d9c067330 0x7f2d9c0697e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2db80c6c70 0x7f2db80a5660 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2da4004810 0x7f2db816a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 --2- 172.21.15.142:0/2636535063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2db8163bb0 0x7f2db80c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 >> 172.21.15.142:0/2636535063 conn(0x7f2db80680c0 msgr2=0x7f2db80cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:45.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 shutdown_connections 2023-09-30T22:56:45.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.338+0000 7f2dbf7ff700 1 -- 172.21.15.142:0/2636535063 wait complete. 2023-09-30T22:56:45.356 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:56:45.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:56:45.407 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-09-30T22:56:45.407+0000 7fc6317f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:56:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.547+0000 7ff666dff700 1 Processor -- start 2023-09-30T22:56:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.547+0000 7ff666dff700 1 -- start start 2023-09-30T22:56:45.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.548+0000 7ff666dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff66006d3f0 0x7ff66006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.548+0000 7ff666dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66015dde0 con 0x7ff66015e270 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.548+0000 7ff666dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66006b840 con 0x7ff6600c6da0 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.548+0000 7ff666dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66015e710 con 0x7ff66006d3f0 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.548+0000 7ff66539c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff66015e270 0x7ff660159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55882/0 (socket says 172.21.15.142:55882) 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff66539c700 1 -- 172.21.15.142:0/3814916106 learned_addr learned my addr 172.21.15.142:0/3814916106 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff664b9b700 1 --2- 172.21.15.142:0/3814916106 >> v2:172.21.15.148:3300/0 conn(0x7ff66006d3f0 0x7ff66006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895914646 0 0) 0x7ff66015dde0 con 0x7ff66015e270 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff650003570 con 0x7ff66015e270 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220154363 0 0) 0x7ff66006b840 con 0x7ff6600c6da0 2023-09-30T22:56:45.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66015dde0 con 0x7ff6600c6da0 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238364474 0 0) 0x7ff650003570 con 0x7ff66015e270 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 >> v2:172.21.15.148:3300/0 conn(0x7ff66006d3f0 msgr2=0x7ff66006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 --2- 172.21.15.142:0/3814916106 >> v2:172.21.15.148:3300/0 conn(0x7ff66006d3f0 0x7ff66006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 >> v1:172.21.15.148:6789/0 conn(0x7ff6600c6da0 legacy=0x7ff66006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66015d7d0 con 0x7ff66015e270 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7ff6580017f0 con 0x7ff66015e270 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff664b9b700 1 --2- 172.21.15.142:0/3814916106 >> v2:172.21.15.148:3300/0 conn(0x7ff66006d3f0 0x7ff66006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 >> v1:172.21.15.142:6789/0 conn(0x7ff66015e270 legacy=0x7ff660159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff650003bf0 0x7ff650003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.549+0000 7ff65f7fe700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff650004810 0x7ff650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff65f7fe700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500051c0 0x7ff65000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66015e710 con 0x7ff650003bf0 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65000c0b0 con 0x7ff650004810 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65000c270 con 0x7ff6500051c0 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff664b9b700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff650003bf0 0x7ff650003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff65ffff700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff650004810 0x7ff650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff66539c700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500051c0 0x7ff65000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff664b9b700 1 -- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500051c0 msgr2=0x7ff65000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff664b9b700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6500051c0 0x7ff65000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff664b9b700 1 -- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff650004810 msgr2=0x7ff650004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff664b9b700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff650004810 0x7ff650004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff664b9b700 1 -- 172.21.15.142:0/3814916106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650003570 con 0x7ff650003bf0 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff65ffff700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff650004810 0x7ff650004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff66539c700 1 -- 172.21.15.142:0/3814916106 reap_dead start 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.550+0000 7ff664b9b700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff650003bf0 0x7ff650003fe0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff654009df0 tx=0x7ff6540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ebb85a037cbece server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654009740 con 0x7ff650003bf0 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400e920 con 0x7ff650003bf0 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff65f7fe700 1 -- 172.21.15.142:0/3814916106 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400ece0 con 0x7ff650003bf0 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff666dff700 1 -- 172.21.15.142:0/3814916106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff650003bf0 msgr2=0x7ff650003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff666dff700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff650003bf0 0x7ff650003fe0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff654009df0 tx=0x7ff6540091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff666dff700 1 -- 172.21.15.142:0/3814916106 shutdown_connections 2023-09-30T22:56:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff666dff700 1 --2- 172.21.15.142:0/3814916106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff650003bf0 0x7ff650003fe0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff666dff700 1 -- 172.21.15.142:0/3814916106 >> 172.21.15.142:0/3814916106 conn(0x7ff660067e30 msgr2=0x7ff660068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff666dff700 1 -- 172.21.15.142:0/3814916106 shutdown_connections 2023-09-30T22:56:45.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.551+0000 7ff666dff700 1 -- 172.21.15.142:0/3814916106 wait complete. 2023-09-30T22:56:45.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.553+0000 7ff666dff700 1 Processor -- start 2023-09-30T22:56:45.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.554+0000 7ff666dff700 1 -- start start 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff666dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650003bf0 0x7ff6600cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff666dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff660130d40 0x7ff6600cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff666dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660156fb0 0x7ff660157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff666dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660157960 con 0x7ff660130d40 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff666dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600cd930 con 0x7ff660156fb0 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff666dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600ccaa0 con 0x7ff650003bf0 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff660130d40 0x7ff6600cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff660130d40 0x7ff6600cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42884/0 (socket says 172.21.15.142:42884) 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 -- 172.21.15.142:0/186985063 learned_addr learned my addr 172.21.15.142:0/186985063 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:45.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff664b9b700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650003bf0 0x7ff6600cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff66539c700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660156fb0 0x7ff660157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 -- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650003bf0 msgr2=0x7ff6600cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650003bf0 0x7ff6600cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 -- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660156fb0 msgr2=0x7ff660157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660156fb0 0x7ff660157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.555+0000 7ff65ffff700 1 -- 172.21.15.142:0/186985063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600ccd20 con 0x7ff660130d40 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.556+0000 7ff65ffff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff660130d40 0x7ff6600cc560 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00e840 tx=0x7ff64c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:45.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.556+0000 7ff65cff9700 1 -- 172.21.15.142:0/186985063 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0105f0 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.556+0000 7ff65cff9700 1 -- 172.21.15.142:0/186985063 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c010750 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.556+0000 7ff65cff9700 1 -- 172.21.15.142:0/186985063 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c010af0 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.556+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6600cd000 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.556+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6600cd5c0 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.557+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff660069420 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.558+0000 7ff65cff9700 1 -- 172.21.15.142:0/186985063 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff64c014480 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.559+0000 7ff65cff9700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff644067330 0x7ff6440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.559+0000 7ff65cff9700 1 -- 172.21.15.142:0/186985063 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff64c0846b0 con 0x7ff660130d40 2023-09-30T22:56:45.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.559+0000 7ff664b9b700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff644067330 0x7ff6440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:45.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.559+0000 7ff664b9b700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff644067330 0x7ff6440697e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff6540093f0 tx=0x7ff65401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:45.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.563+0000 7ff65cff9700 1 -- 172.21.15.142:0/186985063 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff64c0515c0 con 0x7ff660130d40 2023-09-30T22:56:45.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.749+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6600cda70 con 0x7ff644067330 2023-09-30T22:56:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.758+0000 7ff65cff9700 1 -- 172.21.15.142:0/186985063 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303147 (secure 0 0 0) 0x7ff6600cda70 con 0x7ff644067330 2023-09-30T22:56:45.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:45.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff644067330 msgr2=0x7ff6440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff644067330 0x7ff6440697e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff6540093f0 tx=0x7ff65401a000 comp rx=0 tx=0).stop 2023-09-30T22:56:45.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff660130d40 msgr2=0x7ff6600cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:45.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff660130d40 0x7ff6600cc560 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00e840 tx=0x7ff64c009040 comp rx=0 tx=0).stop 2023-09-30T22:56:45.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 shutdown_connections 2023-09-30T22:56:45.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff644067330 0x7ff6440697e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff660156fb0 0x7ff660157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff650003bf0 0x7ff6600cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 --2- 172.21.15.142:0/186985063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff660130d40 0x7ff6600cc560 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:45.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 >> 172.21.15.142:0/186985063 conn(0x7ff660067e30 msgr2=0x7ff66013ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:45.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 shutdown_connections 2023-09-30T22:56:45.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:45.763+0000 7ff666dff700 1 -- 172.21.15.142:0/186985063 wait complete. 2023-09-30T22:56:45.767 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:56:45.781 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2023-09-30T22:56:44.158904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557371,"statfs":{"total":1600000000,"available":1594748774,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.742812"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.436399+0000","last_change":"2023-09-30T22:56:41.436399+0000","last_active":"2023-09-30T22:56:41.436399+0000","last_peered":"2023-09-30T22:56:41.436399+0000","last_clean":"2023-09-30T22:56:41.436399+0000","last_became_active":"2023-09-30T22:56:41.436171+0000","last_became_peered":"2023-09-30T22:56:41.436171+0000","last_unstale":"2023-09-30T22:56:41.436399+0000","last_undegraded":"2023-09-30T22:56:41.436399+0000","last_fullsized":"2023-09-30T22:56:41.436399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:26:48.564747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.434007+0000","last_change":"2023-09-30T22:56:41.434007+0000","last_active":"2023-09-30T22:56:41.434007+0000","last_peered":"2023-09-30T22:56:41.434007+0000","last_clean":"2023-09-30T22:56:41.434007+0000","last_became_active":"2023-09-30T22:56:41.433722+0000","last_became_peered":"2023-09-30T22:56:41.433722+0000","last_unstale":"2023-09-30T22:56:41.434007+0000","last_undegraded":"2023-09-30T22:56:41.434007+0000","last_fullsized":"2023-09-30T22:56:41.434007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:28:32.254484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437961+0000","last_change":"2023-09-30T22:56:41.437961+0000","last_active":"2023-09-30T22:56:41.437961+0000","last_peered":"2023-09-30T22:56:41.437961+0000","last_clean":"2023-09-30T22:56:41.437961+0000","last_became_active":"2023-09-30T22:56:41.437577+0000","last_became_peered":"2023-09-30T22:56:41.437577+0000","last_unstale":"2023-09-30T22:56:41.437961+0000","last_undegraded":"2023-09-30T22:56:41.437961+0000","last_fullsized":"2023-09-30T22:56:41.437961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437545+0000","last_change":"2023-09-30T22:56:41.437545+0000","last_active":"2023-09-30T22:56:41.437545+0000","last_peered":"2023-09-30T22:56:41.437545+0000","last_clean":"2023-09-30T22:56:41.437545+0000","last_became_active":"2023-09-30T22:56:41.437316+0000","last_became_peered":"2023-09-30T22:56:41.437316+0000","last_unstale":"2023-09-30T22:56:41.437545+0000","last_undegraded":"2023-09-30T22:56:41.437545+0000","last_fullsized":"2023-09-30T22:56:41.437545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:55.547680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442823+0000","last_change":"2023-09-30T22:56:41.442823+0000","last_active":"2023-09-30T22:56:41.442823+0000","last_peered":"2023-09-30T22:56:41.442823+0000","last_clean":"2023-09-30T22:56:41.442823+0000","last_became_active":"2023-09-30T22:56:41.442272+0000","last_became_peered":"2023-09-30T22:56:41.442272+0000","last_unstale":"2023-09-30T22:56:41.442823+0000","last_undegraded":"2023-09-30T22:56:41.442823+0000","last_fullsized":"2023-09-30T22:56:41.442823+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:45:23.460768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449424+0000","last_change":"2023-09-30T22:56:41.449424+0000","last_active":"2023-09-30T22:56:41.449424+0000","last_peered":"2023-09-30T22:56:41.449424+0000","last_clean":"2023-09-30T22:56:41.449424+0000","last_became_active":"2023-09-30T22:56:41.449032+0000","last_became_peered":"2023-09-30T22:56:41.449032+0000","last_unstale":"2023-09-30T22:56:41.449424+0000","last_undegraded":"2023-09-30T22:56:41.449424+0000","last_fullsized":"2023-09-30T22:56:41.449424+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:32.294167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448338+0000","last_change":"2023-09-30T22:56:41.448338+0000","last_active":"2023-09-30T22:56:41.448338+0000","last_peered":"2023-09-30T22:56:41.448338+0000","last_clean":"2023-09-30T22:56:41.448338+0000","last_became_active":"2023-09-30T22:56:41.448064+0000","last_became_peered":"2023-09-30T22:56:41.448064+0000","last_unstale":"2023-09-30T22:56:41.448338+0000","last_undegraded":"2023-09-30T22:56:41.448338+0000","last_fullsized":"2023-09-30T22:56:41.448338+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:44:04.353795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442951+0000","last_change":"2023-09-30T22:56:41.442951+0000","last_active":"2023-09-30T22:56:41.442951+0000","last_peered":"2023-09-30T22:56:41.442951+0000","last_clean":"2023-09-30T22:56:41.442951+0000","last_became_active":"2023-09-30T22:56:41.442720+0000","last_became_peered":"2023-09-30T22:56:41.442720+0000","last_unstale":"2023-09-30T22:56:41.442951+0000","last_undegraded":"2023-09-30T22:56:41.442951+0000","last_fullsized":"2023-09-30T22:56:41.442951+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:16:26.756115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.447934+0000","last_change":"2023-09-30T22:56:41.447934+0000","last_active":"2023-09-30T22:56:41.447934+0000","last_peered":"2023-09-30T22:56:41.447934+0000","last_clean":"2023-09-30T22:56:41.447934+0000","last_became_active":"2023-09-30T22:56:41.447246+0000","last_became_peered":"2023-09-30T22:56:41.447246+0000","last_unstale":"2023-09-30T22:56:41.447934+0000","last_undegraded":"2023-09-30T22:56:41.447934+0000","last_fullsized":"2023-09-30T22:56:41.447934+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:42.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440272+0000","last_change":"2023-09-30T22:56:41.440272+0000","last_active":"2023-09-30T22:56:41.440272+0000","last_peered":"2023-09-30T22:56:41.440272+0000","last_clean":"2023-09-30T22:56:41.440272+0000","last_became_active":"2023-09-30T22:56:41.440055+0000","last_became_peered":"2023-09-30T22:56:41.440055+0000","last_unstale":"2023-09-30T22:56:41.440272+0000","last_undegraded":"2023-09-30T22:56:41.440272+0000","last_fullsized":"2023-09-30T22:56:41.440272+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:03.696796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.431636+0000","last_change":"2023-09-30T22:56:41.431636+0000","last_active":"2023-09-30T22:56:41.431636+0000","last_peered":"2023-09-30T22:56:41.431636+0000","last_clean":"2023-09-30T22:56:41.431636+0000","last_became_active":"2023-09-30T22:56:41.431419+0000","last_became_peered":"2023-09-30T22:56:41.431419+0000","last_unstale":"2023-09-30T22:56:41.431636+0000","last_undegraded":"2023-09-30T22:56:41.431636+0000","last_fullsized":"2023-09-30T22:56:41.431636+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:26:48.564747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448104+0000","last_change":"2023-09-30T22:56:41.448104+0000","last_active":"2023-09-30T22:56:41.448104+0000","last_peered":"2023-09-30T22:56:41.448104+0000","last_clean":"2023-09-30T22:56:41.448104+0000","last_became_active":"2023-09-30T22:56:41.447581+0000","last_became_peered":"2023-09-30T22:56:41.447581+0000","last_unstale":"2023-09-30T22:56:41.448104+0000","last_undegraded":"2023-09-30T22:56:41.448104+0000","last_fullsized":"2023-09-30T22:56:41.448104+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:22.239572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440523+0000","last_change":"2023-09-30T22:56:41.440523+0000","last_active":"2023-09-30T22:56:41.440523+0000","last_peered":"2023-09-30T22:56:41.440523+0000","last_clean":"2023-09-30T22:56:41.440523+0000","last_became_active":"2023-09-30T22:56:41.440290+0000","last_became_peered":"2023-09-30T22:56:41.440290+0000","last_unstale":"2023-09-30T22:56:41.440523+0000","last_undegraded":"2023-09-30T22:56:41.440523+0000","last_fullsized":"2023-09-30T22:56:41.440523+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:31.408254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435745+0000","last_change":"2023-09-30T22:56:41.435745+0000","last_active":"2023-09-30T22:56:41.435745+0000","last_peered":"2023-09-30T22:56:41.435745+0000","last_clean":"2023-09-30T22:56:41.435745+0000","last_became_active":"2023-09-30T22:56:41.435514+0000","last_became_peered":"2023-09-30T22:56:41.435514+0000","last_unstale":"2023-09-30T22:56:41.435745+0000","last_undegraded":"2023-09-30T22:56:41.435745+0000","last_fullsized":"2023-09-30T22:56:41.435745+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:10.953631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440681+0000","last_change":"2023-09-30T22:56:41.440681+0000","last_active":"2023-09-30T22:56:41.440681+0000","last_peered":"2023-09-30T22:56:41.440681+0000","last_clean":"2023-09-30T22:56:41.440681+0000","last_became_active":"2023-09-30T22:56:41.440398+0000","last_became_peered":"2023-09-30T22:56:41.440398+0000","last_unstale":"2023-09-30T22:56:41.440681+0000","last_undegraded":"2023-09-30T22:56:41.440681+0000","last_fullsized":"2023-09-30T22:56:41.440681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:44.565003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442756+0000","last_change":"2023-09-30T22:56:41.442756+0000","last_active":"2023-09-30T22:56:41.442756+0000","last_peered":"2023-09-30T22:56:41.442756+0000","last_clean":"2023-09-30T22:56:41.442756+0000","last_became_active":"2023-09-30T22:56:41.442525+0000","last_became_peered":"2023-09-30T22:56:41.442525+0000","last_unstale":"2023-09-30T22:56:41.442756+0000","last_undegraded":"2023-09-30T22:56:41.442756+0000","last_fullsized":"2023-09-30T22:56:41.442756+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:16.585991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440950+0000","last_change":"2023-09-30T22:56:41.440950+0000","last_active":"2023-09-30T22:56:41.440950+0000","last_peered":"2023-09-30T22:56:41.440950+0000","last_clean":"2023-09-30T22:56:41.440950+0000","last_became_active":"2023-09-30T22:56:41.440664+0000","last_became_peered":"2023-09-30T22:56:41.440664+0000","last_unstale":"2023-09-30T22:56:41.440950+0000","last_undegraded":"2023-09-30T22:56:41.440950+0000","last_fullsized":"2023-09-30T22:56:41.440950+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:44.474609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437806+0000","last_change":"2023-09-30T22:56:41.437806+0000","last_active":"2023-09-30T22:56:41.437806+0000","last_peered":"2023-09-30T22:56:41.437806+0000","last_clean":"2023-09-30T22:56:41.437806+0000","last_became_active":"2023-09-30T22:56:41.437234+0000","last_became_peered":"2023-09-30T22:56:41.437234+0000","last_unstale":"2023-09-30T22:56:41.437806+0000","last_undegraded":"2023-09-30T22:56:41.437806+0000","last_fullsized":"2023-09-30T22:56:41.437806+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:32.294167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439178+0000","last_change":"2023-09-30T22:56:41.439178+0000","last_active":"2023-09-30T22:56:41.439178+0000","last_peered":"2023-09-30T22:56:41.439178+0000","last_clean":"2023-09-30T22:56:41.439178+0000","last_became_active":"2023-09-30T22:56:41.438927+0000","last_became_peered":"2023-09-30T22:56:41.438927+0000","last_unstale":"2023-09-30T22:56:41.439178+0000","last_undegraded":"2023-09-30T22:56:41.439178+0000","last_fullsized":"2023-09-30T22:56:41.439178+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:26.889179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.453435+0000","last_change":"2023-09-30T22:56:41.453435+0000","last_active":"2023-09-30T22:56:41.453435+0000","last_peered":"2023-09-30T22:56:41.453435+0000","last_clean":"2023-09-30T22:56:41.453435+0000","last_became_active":"2023-09-30T22:56:41.453193+0000","last_became_peered":"2023-09-30T22:56:41.453193+0000","last_unstale":"2023-09-30T22:56:41.453435+0000","last_undegraded":"2023-09-30T22:56:41.453435+0000","last_fullsized":"2023-09-30T22:56:41.453435+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.443941+0000","last_change":"2023-09-30T22:56:41.443941+0000","last_active":"2023-09-30T22:56:41.443941+0000","last_peered":"2023-09-30T22:56:41.443941+0000","last_clean":"2023-09-30T22:56:41.443941+0000","last_became_active":"2023-09-30T22:56:41.443695+0000","last_became_peered":"2023-09-30T22:56:41.443695+0000","last_unstale":"2023-09-30T22:56:41.443941+0000","last_undegraded":"2023-09-30T22:56:41.443941+0000","last_fullsized":"2023-09-30T22:56:41.443941+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:43.860840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.453971+0000","last_change":"2023-09-30T22:56:41.453971+0000","last_active":"2023-09-30T22:56:41.453971+0000","last_peered":"2023-09-30T22:56:41.453971+0000","last_clean":"2023-09-30T22:56:41.453971+0000","last_became_active":"2023-09-30T22:56:41.453709+0000","last_became_peered":"2023-09-30T22:56:41.453709+0000","last_unstale":"2023-09-30T22:56:41.453971+0000","last_undegraded":"2023-09-30T22:56:41.453971+0000","last_fullsized":"2023-09-30T22:56:41.453971+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:33.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.441308+0000","last_change":"2023-09-30T22:56:41.441308+0000","last_active":"2023-09-30T22:56:41.441308+0000","last_peered":"2023-09-30T22:56:41.441308+0000","last_clean":"2023-09-30T22:56:41.441308+0000","last_became_active":"2023-09-30T22:56:41.441058+0000","last_became_peered":"2023-09-30T22:56:41.441058+0000","last_unstale":"2023-09-30T22:56:41.441308+0000","last_undegraded":"2023-09-30T22:56:41.441308+0000","last_fullsized":"2023-09-30T22:56:41.441308+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:31.408254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.438184+0000","last_change":"2023-09-30T22:56:41.438184+0000","last_active":"2023-09-30T22:56:41.438184+0000","last_peered":"2023-09-30T22:56:41.438184+0000","last_clean":"2023-09-30T22:56:41.438184+0000","last_became_active":"2023-09-30T22:56:41.437910+0000","last_became_peered":"2023-09-30T22:56:41.437910+0000","last_unstale":"2023-09-30T22:56:41.438184+0000","last_undegraded":"2023-09-30T22:56:41.438184+0000","last_fullsized":"2023-09-30T22:56:41.438184+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:23.565763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450123+0000","last_change":"2023-09-30T22:56:41.450123+0000","last_active":"2023-09-30T22:56:41.450123+0000","last_peered":"2023-09-30T22:56:41.450123+0000","last_clean":"2023-09-30T22:56:41.450123+0000","last_became_active":"2023-09-30T22:56:41.449869+0000","last_became_peered":"2023-09-30T22:56:41.449869+0000","last_unstale":"2023-09-30T22:56:41.450123+0000","last_undegraded":"2023-09-30T22:56:41.450123+0000","last_fullsized":"2023-09-30T22:56:41.450123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:33.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.438432+0000","last_change":"2023-09-30T22:56:41.438432+0000","last_active":"2023-09-30T22:56:41.438432+0000","last_peered":"2023-09-30T22:56:41.438432+0000","last_clean":"2023-09-30T22:56:41.438432+0000","last_became_active":"2023-09-30T22:56:41.438226+0000","last_became_peered":"2023-09-30T22:56:41.438226+0000","last_unstale":"2023-09-30T22:56:41.438432+0000","last_undegraded":"2023-09-30T22:56:41.438432+0000","last_fullsized":"2023-09-30T22:56:41.438432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:13:17.585048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442388+0000","last_change":"2023-09-30T22:56:41.442388+0000","last_active":"2023-09-30T22:56:41.442388+0000","last_peered":"2023-09-30T22:56:41.442388+0000","last_clean":"2023-09-30T22:56:41.442388+0000","last_became_active":"2023-09-30T22:56:41.442136+0000","last_became_peered":"2023-09-30T22:56:41.442136+0000","last_unstale":"2023-09-30T22:56:41.442388+0000","last_undegraded":"2023-09-30T22:56:41.442388+0000","last_fullsized":"2023-09-30T22:56:41.442388+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:41.025882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.443506+0000","last_change":"2023-09-30T22:56:41.443506+0000","last_active":"2023-09-30T22:56:41.443506+0000","last_peered":"2023-09-30T22:56:41.443506+0000","last_clean":"2023-09-30T22:56:41.443506+0000","last_became_active":"2023-09-30T22:56:41.442997+0000","last_became_peered":"2023-09-30T22:56:41.442997+0000","last_unstale":"2023-09-30T22:56:41.443506+0000","last_undegraded":"2023-09-30T22:56:41.443506+0000","last_fullsized":"2023-09-30T22:56:41.443506+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:23:06.894673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.446221+0000","last_change":"2023-09-30T22:56:41.446221+0000","last_active":"2023-09-30T22:56:41.446221+0000","last_peered":"2023-09-30T22:56:41.446221+0000","last_clean":"2023-09-30T22:56:41.446221+0000","last_became_active":"2023-09-30T22:56:41.445924+0000","last_became_peered":"2023-09-30T22:56:41.445924+0000","last_unstale":"2023-09-30T22:56:41.446221+0000","last_undegraded":"2023-09-30T22:56:41.446221+0000","last_fullsized":"2023-09-30T22:56:41.446221+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:44.565003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451261+0000","last_change":"2023-09-30T22:56:41.451261+0000","last_active":"2023-09-30T22:56:41.451261+0000","last_peered":"2023-09-30T22:56:41.451261+0000","last_clean":"2023-09-30T22:56:41.451261+0000","last_became_active":"2023-09-30T22:56:41.451046+0000","last_became_peered":"2023-09-30T22:56:41.451046+0000","last_unstale":"2023-09-30T22:56:41.451261+0000","last_undegraded":"2023-09-30T22:56:41.451261+0000","last_fullsized":"2023-09-30T22:56:41.451261+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:23.565763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.434196+0000","last_change":"2023-09-30T22:56:41.434196+0000","last_active":"2023-09-30T22:56:41.434196+0000","last_peered":"2023-09-30T22:56:41.434196+0000","last_clean":"2023-09-30T22:56:41.434196+0000","last_became_active":"2023-09-30T22:56:41.433909+0000","last_became_peered":"2023-09-30T22:56:41.433909+0000","last_unstale":"2023-09-30T22:56:41.434196+0000","last_undegraded":"2023-09-30T22:56:41.434196+0000","last_fullsized":"2023-09-30T22:56:41.434196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:10:54.238836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451451+0000","last_change":"2023-09-30T22:56:41.451451+0000","last_active":"2023-09-30T22:56:41.451451+0000","last_peered":"2023-09-30T22:56:41.451451+0000","last_clean":"2023-09-30T22:56:41.451451+0000","last_became_active":"2023-09-30T22:56:41.451216+0000","last_became_peered":"2023-09-30T22:56:41.451216+0000","last_unstale":"2023-09-30T22:56:41.451451+0000","last_undegraded":"2023-09-30T22:56:41.451451+0000","last_fullsized":"2023-09-30T22:56:41.451451+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:30:58.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442675+0000","last_change":"2023-09-30T22:56:41.442675+0000","last_active":"2023-09-30T22:56:41.442675+0000","last_peered":"2023-09-30T22:56:41.442675+0000","last_clean":"2023-09-30T22:56:41.442675+0000","last_became_active":"2023-09-30T22:56:41.441958+0000","last_became_peered":"2023-09-30T22:56:41.441958+0000","last_unstale":"2023-09-30T22:56:41.442675+0000","last_undegraded":"2023-09-30T22:56:41.442675+0000","last_fullsized":"2023-09-30T22:56:41.442675+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:43:30.231668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"90'4","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448337+0000","last_change":"2023-09-30T22:56:40.439428+0000","last_active":"2023-09-30T22:56:41.448337+0000","last_peered":"2023-09-30T22:56:41.448337+0000","last_clean":"2023-09-30T22:56:41.448337+0000","last_became_active":"2023-09-30T22:56:40.437620+0000","last_became_peered":"2023-09-30T22:56:40.437620+0000","last_unstale":"2023-09-30T22:56:41.448337+0000","last_undegraded":"2023-09-30T22:56:41.448337+0000","last_fullsized":"2023-09-30T22:56:41.448337+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:51:41.606853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.444119+0000","last_change":"2023-09-30T22:56:41.444119+0000","last_active":"2023-09-30T22:56:41.444119+0000","last_peered":"2023-09-30T22:56:41.444119+0000","last_clean":"2023-09-30T22:56:41.444119+0000","last_became_active":"2023-09-30T22:56:41.443858+0000","last_became_peered":"2023-09-30T22:56:41.443858+0000","last_unstale":"2023-09-30T22:56:41.444119+0000","last_undegraded":"2023-09-30T22:56:41.444119+0000","last_fullsized":"2023-09-30T22:56:41.444119+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:37:58.134144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439248+0000","last_change":"2023-09-30T22:56:40.434878+0000","last_active":"2023-09-30T22:56:41.439248+0000","last_peered":"2023-09-30T22:56:41.439248+0000","last_clean":"2023-09-30T22:56:41.439248+0000","last_became_active":"2023-09-30T22:56:40.434141+0000","last_became_peered":"2023-09-30T22:56:40.434141+0000","last_unstale":"2023-09-30T22:56:41.439248+0000","last_undegraded":"2023-09-30T22:56:41.439248+0000","last_fullsized":"2023-09-30T22:56:41.439248+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:25.883407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.455167+0000","last_change":"2023-09-30T22:56:41.455167+0000","last_active":"2023-09-30T22:56:41.455167+0000","last_peered":"2023-09-30T22:56:41.455167+0000","last_clean":"2023-09-30T22:56:41.455167+0000","last_became_active":"2023-09-30T22:56:41.454954+0000","last_became_peered":"2023-09-30T22:56:41.454954+0000","last_unstale":"2023-09-30T22:56:41.455167+0000","last_undegraded":"2023-09-30T22:56:41.455167+0000","last_fullsized":"2023-09-30T22:56:41.455167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.455269+0000","last_change":"2023-09-30T22:56:40.434699+0000","last_active":"2023-09-30T22:56:41.455269+0000","last_peered":"2023-09-30T22:56:41.455269+0000","last_clean":"2023-09-30T22:56:41.455269+0000","last_became_active":"2023-09-30T22:56:40.434222+0000","last_became_peered":"2023-09-30T22:56:40.434222+0000","last_unstale":"2023-09-30T22:56:41.455269+0000","last_undegraded":"2023-09-30T22:56:41.455269+0000","last_fullsized":"2023-09-30T22:56:41.455269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:21.233799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437892+0000","last_change":"2023-09-30T22:56:41.437892+0000","last_active":"2023-09-30T22:56:41.437892+0000","last_peered":"2023-09-30T22:56:41.437892+0000","last_clean":"2023-09-30T22:56:41.437892+0000","last_became_active":"2023-09-30T22:56:41.437261+0000","last_became_peered":"2023-09-30T22:56:41.437261+0000","last_unstale":"2023-09-30T22:56:41.437892+0000","last_undegraded":"2023-09-30T22:56:41.437892+0000","last_fullsized":"2023-09-30T22:56:41.437892+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:07.326259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448662+0000","last_change":"2023-09-30T22:56:40.432525+0000","last_active":"2023-09-30T22:56:41.448662+0000","last_peered":"2023-09-30T22:56:41.448662+0000","last_clean":"2023-09-30T22:56:41.448662+0000","last_became_active":"2023-09-30T22:56:40.432290+0000","last_became_peered":"2023-09-30T22:56:40.432290+0000","last_unstale":"2023-09-30T22:56:41.448662+0000","last_undegraded":"2023-09-30T22:56:41.448662+0000","last_fullsized":"2023-09-30T22:56:41.448662+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:30:57.444869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450216+0000","last_change":"2023-09-30T22:56:41.450216+0000","last_active":"2023-09-30T22:56:41.450216+0000","last_peered":"2023-09-30T22:56:41.450216+0000","last_clean":"2023-09-30T22:56:41.450216+0000","last_became_active":"2023-09-30T22:56:41.449986+0000","last_became_peered":"2023-09-30T22:56:41.449986+0000","last_unstale":"2023-09-30T22:56:41.450216+0000","last_undegraded":"2023-09-30T22:56:41.450216+0000","last_fullsized":"2023-09-30T22:56:41.450216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:19:38.499344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.436027+0000","last_change":"2023-09-30T22:56:40.431836+0000","last_active":"2023-09-30T22:56:41.436027+0000","last_peered":"2023-09-30T22:56:41.436027+0000","last_clean":"2023-09-30T22:56:41.436027+0000","last_became_active":"2023-09-30T22:56:40.431623+0000","last_became_peered":"2023-09-30T22:56:40.431623+0000","last_unstale":"2023-09-30T22:56:41.436027+0000","last_undegraded":"2023-09-30T22:56:41.436027+0000","last_fullsized":"2023-09-30T22:56:41.436027+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:15.580218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.433608+0000","last_change":"2023-09-30T22:56:41.433608+0000","last_active":"2023-09-30T22:56:41.433608+0000","last_peered":"2023-09-30T22:56:41.433608+0000","last_clean":"2023-09-30T22:56:41.433608+0000","last_became_active":"2023-09-30T22:56:41.433352+0000","last_became_peered":"2023-09-30T22:56:41.433352+0000","last_unstale":"2023-09-30T22:56:41.433608+0000","last_undegraded":"2023-09-30T22:56:41.433608+0000","last_fullsized":"2023-09-30T22:56:41.433608+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:46.057835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439327+0000","last_change":"2023-09-30T22:56:40.426702+0000","last_active":"2023-09-30T22:56:41.439327+0000","last_peered":"2023-09-30T22:56:41.439327+0000","last_clean":"2023-09-30T22:56:41.439327+0000","last_became_active":"2023-09-30T22:56:40.426468+0000","last_became_peered":"2023-09-30T22:56:40.426468+0000","last_unstale":"2023-09-30T22:56:41.439327+0000","last_undegraded":"2023-09-30T22:56:41.439327+0000","last_fullsized":"2023-09-30T22:56:41.439327+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:43.468836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442854+0000","last_change":"2023-09-30T22:56:41.442854+0000","last_active":"2023-09-30T22:56:41.442854+0000","last_peered":"2023-09-30T22:56:41.442854+0000","last_clean":"2023-09-30T22:56:41.442854+0000","last_became_active":"2023-09-30T22:56:41.442634+0000","last_became_peered":"2023-09-30T22:56:41.442634+0000","last_unstale":"2023-09-30T22:56:41.442854+0000","last_undegraded":"2023-09-30T22:56:41.442854+0000","last_fullsized":"2023-09-30T22:56:41.442854+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:39.464161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.435381+0000","last_change":"2023-09-30T22:56:40.435284+0000","last_active":"2023-09-30T22:56:40.435381+0000","last_peered":"2023-09-30T22:56:40.435381+0000","last_clean":"2023-09-30T22:56:40.435381+0000","last_became_active":"2023-09-30T22:56:40.434997+0000","last_became_peered":"2023-09-30T22:56:40.434997+0000","last_unstale":"2023-09-30T22:56:40.435381+0000","last_undegraded":"2023-09-30T22:56:40.435381+0000","last_fullsized":"2023-09-30T22:56:40.435381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:22.559990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.445020+0000","last_change":"2023-09-30T22:56:41.445020+0000","last_active":"2023-09-30T22:56:41.445020+0000","last_peered":"2023-09-30T22:56:41.445020+0000","last_clean":"2023-09-30T22:56:41.445020+0000","last_became_active":"2023-09-30T22:56:41.444800+0000","last_became_peered":"2023-09-30T22:56:41.444800+0000","last_unstale":"2023-09-30T22:56:41.445020+0000","last_undegraded":"2023-09-30T22:56:41.445020+0000","last_fullsized":"2023-09-30T22:56:41.445020+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:49.057095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.433311+0000","last_change":"2023-09-30T22:56:40.433212+0000","last_active":"2023-09-30T22:56:40.433311+0000","last_peered":"2023-09-30T22:56:40.433311+0000","last_clean":"2023-09-30T22:56:40.433311+0000","last_became_active":"2023-09-30T22:56:40.433021+0000","last_became_peered":"2023-09-30T22:56:40.433021+0000","last_unstale":"2023-09-30T22:56:40.433311+0000","last_undegraded":"2023-09-30T22:56:40.433311+0000","last_fullsized":"2023-09-30T22:56:40.433311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:06.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448562+0000","last_change":"2023-09-30T22:56:41.448562+0000","last_active":"2023-09-30T22:56:41.448562+0000","last_peered":"2023-09-30T22:56:41.448562+0000","last_clean":"2023-09-30T22:56:41.448562+0000","last_became_active":"2023-09-30T22:56:41.447863+0000","last_became_peered":"2023-09-30T22:56:41.447863+0000","last_unstale":"2023-09-30T22:56:41.448562+0000","last_undegraded":"2023-09-30T22:56:41.448562+0000","last_fullsized":"2023-09-30T22:56:41.448562+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:19:38.499344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.433934+0000","last_change":"2023-09-30T22:56:40.433525+0000","last_active":"2023-09-30T22:56:40.433934+0000","last_peered":"2023-09-30T22:56:40.433934+0000","last_clean":"2023-09-30T22:56:40.433934+0000","last_became_active":"2023-09-30T22:56:40.433126+0000","last_became_peered":"2023-09-30T22:56:40.433126+0000","last_unstale":"2023-09-30T22:56:40.433934+0000","last_undegraded":"2023-09-30T22:56:40.433934+0000","last_fullsized":"2023-09-30T22:56:40.433934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:41:48.170406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448246+0000","last_change":"2023-09-30T22:56:41.448246+0000","last_active":"2023-09-30T22:56:41.448246+0000","last_peered":"2023-09-30T22:56:41.448246+0000","last_clean":"2023-09-30T22:56:41.448246+0000","last_became_active":"2023-09-30T22:56:41.447891+0000","last_became_peered":"2023-09-30T22:56:41.447891+0000","last_unstale":"2023-09-30T22:56:41.448246+0000","last_undegraded":"2023-09-30T22:56:41.448246+0000","last_fullsized":"2023-09-30T22:56:41.448246+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:44.565003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.438698+0000","last_change":"2023-09-30T22:56:40.438558+0000","last_active":"2023-09-30T22:56:40.438698+0000","last_peered":"2023-09-30T22:56:40.438698+0000","last_clean":"2023-09-30T22:56:40.438698+0000","last_became_active":"2023-09-30T22:56:40.438336+0000","last_became_peered":"2023-09-30T22:56:40.438336+0000","last_unstale":"2023-09-30T22:56:40.438698+0000","last_undegraded":"2023-09-30T22:56:40.438698+0000","last_fullsized":"2023-09-30T22:56:40.438698+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:45:22.454995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439101+0000","last_change":"2023-09-30T22:56:41.439101+0000","last_active":"2023-09-30T22:56:41.439101+0000","last_peered":"2023-09-30T22:56:41.439101+0000","last_clean":"2023-09-30T22:56:41.439101+0000","last_became_active":"2023-09-30T22:56:41.438375+0000","last_became_peered":"2023-09-30T22:56:41.438375+0000","last_unstale":"2023-09-30T22:56:41.439101+0000","last_undegraded":"2023-09-30T22:56:41.439101+0000","last_fullsized":"2023-09-30T22:56:41.439101+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:55:12.891965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"90'3","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.454941+0000","last_change":"2023-09-30T22:56:40.436330+0000","last_active":"2023-09-30T22:56:41.454941+0000","last_peered":"2023-09-30T22:56:41.454941+0000","last_clean":"2023-09-30T22:56:41.454941+0000","last_became_active":"2023-09-30T22:56:40.435926+0000","last_became_peered":"2023-09-30T22:56:40.435926+0000","last_unstale":"2023-09-30T22:56:41.454941+0000","last_undegraded":"2023-09-30T22:56:41.454941+0000","last_fullsized":"2023-09-30T22:56:41.454941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:41.945395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449597+0000","last_change":"2023-09-30T22:56:41.449597+0000","last_active":"2023-09-30T22:56:41.449597+0000","last_peered":"2023-09-30T22:56:41.449597+0000","last_clean":"2023-09-30T22:56:41.449597+0000","last_became_active":"2023-09-30T22:56:41.448944+0000","last_became_peered":"2023-09-30T22:56:41.448944+0000","last_unstale":"2023-09-30T22:56:41.449597+0000","last_undegraded":"2023-09-30T22:56:41.449597+0000","last_fullsized":"2023-09-30T22:56:41.449597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:22.239572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"90'6","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450845+0000","last_change":"2023-09-30T22:56:40.434739+0000","last_active":"2023-09-30T22:56:41.450845+0000","last_peered":"2023-09-30T22:56:41.450845+0000","last_clean":"2023-09-30T22:56:41.450845+0000","last_became_active":"2023-09-30T22:56:40.433836+0000","last_became_peered":"2023-09-30T22:56:40.433836+0000","last_unstale":"2023-09-30T22:56:41.450845+0000","last_undegraded":"2023-09-30T22:56:41.450845+0000","last_fullsized":"2023-09-30T22:56:41.450845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:09.947858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.447800+0000","last_change":"2023-09-30T22:56:41.447800+0000","last_active":"2023-09-30T22:56:41.447800+0000","last_peered":"2023-09-30T22:56:41.447800+0000","last_clean":"2023-09-30T22:56:41.447800+0000","last_became_active":"2023-09-30T22:56:41.446959+0000","last_became_peered":"2023-09-30T22:56:41.446959+0000","last_unstale":"2023-09-30T22:56:41.447800+0000","last_undegraded":"2023-09-30T22:56:41.447800+0000","last_fullsized":"2023-09-30T22:56:41.447800+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:12.404915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450784+0000","last_change":"2023-09-30T22:56:40.435443+0000","last_active":"2023-09-30T22:56:41.450784+0000","last_peered":"2023-09-30T22:56:41.450784+0000","last_clean":"2023-09-30T22:56:41.450784+0000","last_became_active":"2023-09-30T22:56:40.434913+0000","last_became_peered":"2023-09-30T22:56:40.434913+0000","last_unstale":"2023-09-30T22:56:41.450784+0000","last_undegraded":"2023-09-30T22:56:41.450784+0000","last_fullsized":"2023-09-30T22:56:41.450784+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:43.559230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442631+0000","last_change":"2023-09-30T22:56:41.442631+0000","last_active":"2023-09-30T22:56:41.442631+0000","last_peered":"2023-09-30T22:56:41.442631+0000","last_clean":"2023-09-30T22:56:41.442631+0000","last_became_active":"2023-09-30T22:56:41.442200+0000","last_became_peered":"2023-09-30T22:56:41.442200+0000","last_unstale":"2023-09-30T22:56:41.442631+0000","last_undegraded":"2023-09-30T22:56:41.442631+0000","last_fullsized":"2023-09-30T22:56:41.442631+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:07:06.185547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.438468+0000","last_change":"2023-09-30T22:56:40.438345+0000","last_active":"2023-09-30T22:56:40.438468+0000","last_peered":"2023-09-30T22:56:40.438468+0000","last_clean":"2023-09-30T22:56:40.438468+0000","last_became_active":"2023-09-30T22:56:40.438089+0000","last_became_peered":"2023-09-30T22:56:40.438089+0000","last_unstale":"2023-09-30T22:56:40.438468+0000","last_undegraded":"2023-09-30T22:56:40.438468+0000","last_fullsized":"2023-09-30T22:56:40.438468+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:06.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.446621+0000","last_change":"2023-09-30T22:56:41.446621+0000","last_active":"2023-09-30T22:56:41.446621+0000","last_peered":"2023-09-30T22:56:41.446621+0000","last_clean":"2023-09-30T22:56:41.446621+0000","last_became_active":"2023-09-30T22:56:41.446342+0000","last_became_peered":"2023-09-30T22:56:41.446342+0000","last_unstale":"2023-09-30T22:56:41.446621+0000","last_undegraded":"2023-09-30T22:56:41.446621+0000","last_fullsized":"2023-09-30T22:56:41.446621+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:19:38.499344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.440190+0000","last_change":"2023-09-30T22:56:40.440121+0000","last_active":"2023-09-30T22:56:40.440190+0000","last_peered":"2023-09-30T22:56:40.440190+0000","last_clean":"2023-09-30T22:56:40.440190+0000","last_became_active":"2023-09-30T22:56:40.439870+0000","last_became_peered":"2023-09-30T22:56:40.439870+0000","last_unstale":"2023-09-30T22:56:40.440190+0000","last_undegraded":"2023-09-30T22:56:40.440190+0000","last_fullsized":"2023-09-30T22:56:40.440190+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:55.720121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451741+0000","last_change":"2023-09-30T22:56:41.451741+0000","last_active":"2023-09-30T22:56:41.451741+0000","last_peered":"2023-09-30T22:56:41.451741+0000","last_clean":"2023-09-30T22:56:41.451741+0000","last_became_active":"2023-09-30T22:56:41.451495+0000","last_became_peered":"2023-09-30T22:56:41.451495+0000","last_unstale":"2023-09-30T22:56:41.451741+0000","last_undegraded":"2023-09-30T22:56:41.451741+0000","last_fullsized":"2023-09-30T22:56:41.451741+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:46.057835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"90'8","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.452568+0000","last_change":"2023-09-30T22:56:40.436775+0000","last_active":"2023-09-30T22:56:41.452568+0000","last_peered":"2023-09-30T22:56:41.452568+0000","last_clean":"2023-09-30T22:56:41.452568+0000","last_became_active":"2023-09-30T22:56:40.436554+0000","last_became_peered":"2023-09-30T22:56:40.436554+0000","last_unstale":"2023-09-30T22:56:41.452568+0000","last_undegraded":"2023-09-30T22:56:41.452568+0000","last_fullsized":"2023-09-30T22:56:41.452568+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:48.094949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.447657+0000","last_change":"2023-09-30T22:56:41.447657+0000","last_active":"2023-09-30T22:56:41.447657+0000","last_peered":"2023-09-30T22:56:41.447657+0000","last_clean":"2023-09-30T22:56:41.447657+0000","last_became_active":"2023-09-30T22:56:41.446423+0000","last_became_peered":"2023-09-30T22:56:41.446423+0000","last_unstale":"2023-09-30T22:56:41.447657+0000","last_undegraded":"2023-09-30T22:56:41.447657+0000","last_fullsized":"2023-09-30T22:56:41.447657+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:15.192944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449279+0000","last_change":"2023-09-30T22:56:40.436331+0000","last_active":"2023-09-30T22:56:41.449279+0000","last_peered":"2023-09-30T22:56:41.449279+0000","last_clean":"2023-09-30T22:56:41.449279+0000","last_became_active":"2023-09-30T22:56:40.436116+0000","last_became_peered":"2023-09-30T22:56:40.436116+0000","last_unstale":"2023-09-30T22:56:41.449279+0000","last_undegraded":"2023-09-30T22:56:41.449279+0000","last_fullsized":"2023-09-30T22:56:41.449279+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:38.458388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442757+0000","last_change":"2023-09-30T22:56:41.442757+0000","last_active":"2023-09-30T22:56:41.442757+0000","last_peered":"2023-09-30T22:56:41.442757+0000","last_clean":"2023-09-30T22:56:41.442757+0000","last_became_active":"2023-09-30T22:56:41.442445+0000","last_became_peered":"2023-09-30T22:56:41.442445+0000","last_unstale":"2023-09-30T22:56:41.442757+0000","last_undegraded":"2023-09-30T22:56:41.442757+0000","last_fullsized":"2023-09-30T22:56:41.442757+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:31:24.176015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.436841+0000","last_change":"2023-09-30T22:56:40.436191+0000","last_active":"2023-09-30T22:56:40.436841+0000","last_peered":"2023-09-30T22:56:40.436841+0000","last_clean":"2023-09-30T22:56:40.436841+0000","last_became_active":"2023-09-30T22:56:40.435633+0000","last_became_peered":"2023-09-30T22:56:40.435633+0000","last_unstale":"2023-09-30T22:56:40.436841+0000","last_undegraded":"2023-09-30T22:56:40.436841+0000","last_fullsized":"2023-09-30T22:56:40.436841+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:11.399142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.454053+0000","last_change":"2023-09-30T22:56:41.454053+0000","last_active":"2023-09-30T22:56:41.454053+0000","last_peered":"2023-09-30T22:56:41.454053+0000","last_clean":"2023-09-30T22:56:41.454053+0000","last_became_active":"2023-09-30T22:56:41.453567+0000","last_became_peered":"2023-09-30T22:56:41.453567+0000","last_unstale":"2023-09-30T22:56:41.454053+0000","last_undegraded":"2023-09-30T22:56:41.454053+0000","last_fullsized":"2023-09-30T22:56:41.454053+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:32.294167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.435923+0000","last_change":"2023-09-30T22:56:40.435468+0000","last_active":"2023-09-30T22:56:40.435923+0000","last_peered":"2023-09-30T22:56:40.435923+0000","last_clean":"2023-09-30T22:56:40.435923+0000","last_became_active":"2023-09-30T22:56:40.435255+0000","last_became_peered":"2023-09-30T22:56:40.435255+0000","last_unstale":"2023-09-30T22:56:40.435923+0000","last_undegraded":"2023-09-30T22:56:40.435923+0000","last_fullsized":"2023-09-30T22:56:40.435923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:23:05.888900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439592+0000","last_change":"2023-09-30T22:56:41.439592+0000","last_active":"2023-09-30T22:56:41.439592+0000","last_peered":"2023-09-30T22:56:41.439592+0000","last_clean":"2023-09-30T22:56:41.439592+0000","last_became_active":"2023-09-30T22:56:41.439361+0000","last_became_peered":"2023-09-30T22:56:41.439361+0000","last_unstale":"2023-09-30T22:56:41.439592+0000","last_undegraded":"2023-09-30T22:56:41.439592+0000","last_fullsized":"2023-09-30T22:56:41.439592+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:12.490413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.431130+0000","last_change":"2023-09-30T22:56:40.431051+0000","last_active":"2023-09-30T22:56:40.431130+0000","last_peered":"2023-09-30T22:56:40.431130+0000","last_clean":"2023-09-30T22:56:40.431130+0000","last_became_active":"2023-09-30T22:56:40.430816+0000","last_became_peered":"2023-09-30T22:56:40.430816+0000","last_unstale":"2023-09-30T22:56:40.431130+0000","last_undegraded":"2023-09-30T22:56:40.431130+0000","last_fullsized":"2023-09-30T22:56:40.431130+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:08.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440109+0000","last_change":"2023-09-30T22:56:41.440109+0000","last_active":"2023-09-30T22:56:41.440109+0000","last_peered":"2023-09-30T22:56:41.440109+0000","last_clean":"2023-09-30T22:56:41.440109+0000","last_became_active":"2023-09-30T22:56:41.439897+0000","last_became_peered":"2023-09-30T22:56:41.439897+0000","last_unstale":"2023-09-30T22:56:41.440109+0000","last_undegraded":"2023-09-30T22:56:41.440109+0000","last_fullsized":"2023-09-30T22:56:41.440109+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:33.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.434078+0000","last_change":"2023-09-30T22:56:40.433983+0000","last_active":"2023-09-30T22:56:40.434078+0000","last_peered":"2023-09-30T22:56:40.434078+0000","last_clean":"2023-09-30T22:56:40.434078+0000","last_became_active":"2023-09-30T22:56:40.433730+0000","last_became_peered":"2023-09-30T22:56:40.433730+0000","last_unstale":"2023-09-30T22:56:40.434078+0000","last_undegraded":"2023-09-30T22:56:40.434078+0000","last_fullsized":"2023-09-30T22:56:40.434078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:10.005908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435533+0000","last_change":"2023-09-30T22:56:41.435533+0000","last_active":"2023-09-30T22:56:41.435533+0000","last_peered":"2023-09-30T22:56:41.435533+0000","last_clean":"2023-09-30T22:56:41.435533+0000","last_became_active":"2023-09-30T22:56:41.435272+0000","last_became_peered":"2023-09-30T22:56:41.435272+0000","last_unstale":"2023-09-30T22:56:41.435533+0000","last_undegraded":"2023-09-30T22:56:41.435533+0000","last_fullsized":"2023-09-30T22:56:41.435533+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:49.100722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.433999+0000","last_change":"2023-09-30T22:56:40.433926+0000","last_active":"2023-09-30T22:56:40.433999+0000","last_peered":"2023-09-30T22:56:40.433999+0000","last_clean":"2023-09-30T22:56:40.433999+0000","last_became_active":"2023-09-30T22:56:40.433667+0000","last_became_peered":"2023-09-30T22:56:40.433667+0000","last_unstale":"2023-09-30T22:56:40.433999+0000","last_undegraded":"2023-09-30T22:56:40.433999+0000","last_fullsized":"2023-09-30T22:56:40.433999+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:44:03.348022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.432345+0000","last_change":"2023-09-30T22:56:41.432345+0000","last_active":"2023-09-30T22:56:41.432345+0000","last_peered":"2023-09-30T22:56:41.432345+0000","last_clean":"2023-09-30T22:56:41.432345+0000","last_became_active":"2023-09-30T22:56:41.432017+0000","last_became_peered":"2023-09-30T22:56:41.432017+0000","last_unstale":"2023-09-30T22:56:41.432345+0000","last_undegraded":"2023-09-30T22:56:41.432345+0000","last_fullsized":"2023-09-30T22:56:41.432345+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:43.860840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.437634+0000","last_change":"2023-09-30T22:56:40.437538+0000","last_active":"2023-09-30T22:56:40.437634+0000","last_peered":"2023-09-30T22:56:40.437634+0000","last_clean":"2023-09-30T22:56:40.437634+0000","last_became_active":"2023-09-30T22:56:40.437309+0000","last_became_peered":"2023-09-30T22:56:40.437309+0000","last_unstale":"2023-09-30T22:56:40.437634+0000","last_undegraded":"2023-09-30T22:56:40.437634+0000","last_fullsized":"2023-09-30T22:56:40.437634+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:47.713557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.453473+0000","last_change":"2023-09-30T22:56:41.453473+0000","last_active":"2023-09-30T22:56:41.453473+0000","last_peered":"2023-09-30T22:56:41.453473+0000","last_clean":"2023-09-30T22:56:41.453473+0000","last_became_active":"2023-09-30T22:56:41.453226+0000","last_became_peered":"2023-09-30T22:56:41.453226+0000","last_unstale":"2023-09-30T22:56:41.453473+0000","last_undegraded":"2023-09-30T22:56:41.453473+0000","last_fullsized":"2023-09-30T22:56:41.453473+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:22.239572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.439243+0000","last_change":"2023-09-30T22:56:40.438158+0000","last_active":"2023-09-30T22:56:40.439243+0000","last_peered":"2023-09-30T22:56:40.439243+0000","last_clean":"2023-09-30T22:56:40.439243+0000","last_became_active":"2023-09-30T22:56:40.437942+0000","last_became_peered":"2023-09-30T22:56:40.437942+0000","last_unstale":"2023-09-30T22:56:40.439243+0000","last_undegraded":"2023-09-30T22:56:40.439243+0000","last_fullsized":"2023-09-30T22:56:40.439243+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:15.580218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.445557+0000","last_change":"2023-09-30T22:56:41.445557+0000","last_active":"2023-09-30T22:56:41.445557+0000","last_peered":"2023-09-30T22:56:41.445557+0000","last_clean":"2023-09-30T22:56:41.445557+0000","last_became_active":"2023-09-30T22:56:41.445343+0000","last_became_peered":"2023-09-30T22:56:41.445343+0000","last_unstale":"2023-09-30T22:56:41.445557+0000","last_undegraded":"2023-09-30T22:56:41.445557+0000","last_fullsized":"2023-09-30T22:56:41.445557+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:11.011681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435380+0000","last_change":"2023-09-30T22:56:40.437869+0000","last_active":"2023-09-30T22:56:41.435380+0000","last_peered":"2023-09-30T22:56:41.435380+0000","last_clean":"2023-09-30T22:56:41.435380+0000","last_became_active":"2023-09-30T22:56:40.437370+0000","last_became_peered":"2023-09-30T22:56:40.437370+0000","last_unstale":"2023-09-30T22:56:41.435380+0000","last_undegraded":"2023-09-30T22:56:41.435380+0000","last_fullsized":"2023-09-30T22:56:41.435380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:45:16.917806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.430025+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:56:40.430025+0000","last_peered":"2023-09-30T22:56:40.430025+0000","last_clean":"2023-09-30T22:56:40.430025+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:56:40.430025+0000","last_undegraded":"2023-09-30T22:56:40.430025+0000","last_fullsized":"2023-09-30T22:56:40.430025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451028+0000","last_change":"2023-09-30T22:56:41.451028+0000","last_active":"2023-09-30T22:56:41.451028+0000","last_peered":"2023-09-30T22:56:41.451028+0000","last_clean":"2023-09-30T22:56:41.451028+0000","last_became_active":"2023-09-30T22:56:41.450783+0000","last_became_peered":"2023-09-30T22:56:41.450783+0000","last_unstale":"2023-09-30T22:56:41.451028+0000","last_undegraded":"2023-09-30T22:56:41.451028+0000","last_fullsized":"2023-09-30T22:56:41.451028+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:54.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.445304+0000","last_change":"2023-09-30T22:56:40.437406+0000","last_active":"2023-09-30T22:56:41.445304+0000","last_peered":"2023-09-30T22:56:41.445304+0000","last_clean":"2023-09-30T22:56:41.445304+0000","last_became_active":"2023-09-30T22:56:40.436671+0000","last_became_peered":"2023-09-30T22:56:40.436671+0000","last_unstale":"2023-09-30T22:56:41.445304+0000","last_undegraded":"2023-09-30T22:56:41.445304+0000","last_fullsized":"2023-09-30T22:56:41.445304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:14.187171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.423764+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:56:40.423764+0000","last_peered":"2023-09-30T22:56:40.423764+0000","last_clean":"2023-09-30T22:56:40.423764+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:56:40.423764+0000","last_undegraded":"2023-09-30T22:56:40.423764+0000","last_fullsized":"2023-09-30T22:56:40.423764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449333+0000","last_change":"2023-09-30T22:56:41.449333+0000","last_active":"2023-09-30T22:56:41.449333+0000","last_peered":"2023-09-30T22:56:41.449333+0000","last_clean":"2023-09-30T22:56:41.449333+0000","last_became_active":"2023-09-30T22:56:41.449069+0000","last_became_peered":"2023-09-30T22:56:41.449069+0000","last_unstale":"2023-09-30T22:56:41.449333+0000","last_undegraded":"2023-09-30T22:56:41.449333+0000","last_fullsized":"2023-09-30T22:56:41.449333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:48:45.841565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.427325+0000","last_change":"2023-09-30T22:56:40.426699+0000","last_active":"2023-09-30T22:56:40.427325+0000","last_peered":"2023-09-30T22:56:40.427325+0000","last_clean":"2023-09-30T22:56:40.427325+0000","last_became_active":"2023-09-30T22:56:40.426461+0000","last_became_peered":"2023-09-30T22:56:40.426461+0000","last_unstale":"2023-09-30T22:56:40.427325+0000","last_undegraded":"2023-09-30T22:56:40.427325+0000","last_fullsized":"2023-09-30T22:56:40.427325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:40.020109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.428916+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:56:40.428916+0000","last_peered":"2023-09-30T22:56:40.428916+0000","last_clean":"2023-09-30T22:56:40.428916+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:56:40.428916+0000","last_undegraded":"2023-09-30T22:56:40.428916+0000","last_fullsized":"2023-09-30T22:56:40.428916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.444249+0000","last_change":"2023-09-30T22:56:41.444249+0000","last_active":"2023-09-30T22:56:41.444249+0000","last_peered":"2023-09-30T22:56:41.444249+0000","last_clean":"2023-09-30T22:56:41.444249+0000","last_became_active":"2023-09-30T22:56:41.444030+0000","last_became_peered":"2023-09-30T22:56:41.444030+0000","last_unstale":"2023-09-30T22:56:41.444249+0000","last_undegraded":"2023-09-30T22:56:41.444249+0000","last_fullsized":"2023-09-30T22:56:41.444249+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:22:05.962225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.439101+0000","last_change":"2023-09-30T22:56:40.439000+0000","last_active":"2023-09-30T22:56:40.439101+0000","last_peered":"2023-09-30T22:56:40.439101+0000","last_clean":"2023-09-30T22:56:40.439101+0000","last_became_active":"2023-09-30T22:56:40.438724+0000","last_became_peered":"2023-09-30T22:56:40.438724+0000","last_unstale":"2023-09-30T22:56:40.439101+0000","last_undegraded":"2023-09-30T22:56:40.439101+0000","last_fullsized":"2023-09-30T22:56:40.439101+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:06.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424067+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:56:40.424067+0000","last_peered":"2023-09-30T22:56:40.424067+0000","last_clean":"2023-09-30T22:56:40.424067+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:56:40.424067+0000","last_undegraded":"2023-09-30T22:56:40.424067+0000","last_fullsized":"2023-09-30T22:56:40.424067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.431420+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:56:40.431420+0000","last_peered":"2023-09-30T22:56:40.431420+0000","last_clean":"2023-09-30T22:56:40.431420+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:56:40.431420+0000","last_undegraded":"2023-09-30T22:56:40.431420+0000","last_fullsized":"2023-09-30T22:56:40.431420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439430+0000","last_change":"2023-09-30T22:56:41.439430+0000","last_active":"2023-09-30T22:56:41.439430+0000","last_peered":"2023-09-30T22:56:41.439430+0000","last_clean":"2023-09-30T22:56:41.439430+0000","last_became_active":"2023-09-30T22:56:41.439203+0000","last_became_peered":"2023-09-30T22:56:41.439203+0000","last_unstale":"2023-09-30T22:56:41.439430+0000","last_undegraded":"2023-09-30T22:56:41.439430+0000","last_fullsized":"2023-09-30T22:56:41.439430+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:39.464161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.432029+0000","last_change":"2023-09-30T22:56:40.431939+0000","last_active":"2023-09-30T22:56:40.432029+0000","last_peered":"2023-09-30T22:56:40.432029+0000","last_clean":"2023-09-30T22:56:40.432029+0000","last_became_active":"2023-09-30T22:56:40.431188+0000","last_became_peered":"2023-09-30T22:56:40.431188+0000","last_unstale":"2023-09-30T22:56:40.432029+0000","last_undegraded":"2023-09-30T22:56:40.432029+0000","last_fullsized":"2023-09-30T22:56:40.432029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:26:47.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424273+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:56:40.424273+0000","last_peered":"2023-09-30T22:56:40.424273+0000","last_clean":"2023-09-30T22:56:40.424273+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:56:40.424273+0000","last_undegraded":"2023-09-30T22:56:40.424273+0000","last_fullsized":"2023-09-30T22:56:40.424273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.443877+0000","last_change":"2023-09-30T22:56:41.443877+0000","last_active":"2023-09-30T22:56:41.443877+0000","last_peered":"2023-09-30T22:56:41.443877+0000","last_clean":"2023-09-30T22:56:41.443877+0000","last_became_active":"2023-09-30T22:56:41.443285+0000","last_became_peered":"2023-09-30T22:56:41.443285+0000","last_unstale":"2023-09-30T22:56:41.443877+0000","last_undegraded":"2023-09-30T22:56:41.443877+0000","last_fullsized":"2023-09-30T22:56:41.443877+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:06:38.535366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.435749+0000","last_change":"2023-09-30T22:56:40.435669+0000","last_active":"2023-09-30T22:56:40.435749+0000","last_peered":"2023-09-30T22:56:40.435749+0000","last_clean":"2023-09-30T22:56:40.435749+0000","last_became_active":"2023-09-30T22:56:40.435431+0000","last_became_peered":"2023-09-30T22:56:40.435431+0000","last_unstale":"2023-09-30T22:56:40.435749+0000","last_undegraded":"2023-09-30T22:56:40.435749+0000","last_fullsized":"2023-09-30T22:56:40.435749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:19.257371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424199+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:56:40.424199+0000","last_peered":"2023-09-30T22:56:40.424199+0000","last_clean":"2023-09-30T22:56:40.424199+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:56:40.424199+0000","last_undegraded":"2023-09-30T22:56:40.424199+0000","last_fullsized":"2023-09-30T22:56:40.424199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.441548+0000","last_change":"2023-09-30T22:56:41.441548+0000","last_active":"2023-09-30T22:56:41.441548+0000","last_peered":"2023-09-30T22:56:41.441548+0000","last_clean":"2023-09-30T22:56:41.441548+0000","last_became_active":"2023-09-30T22:56:41.440916+0000","last_became_peered":"2023-09-30T22:56:41.440916+0000","last_unstale":"2023-09-30T22:56:41.441548+0000","last_undegraded":"2023-09-30T22:56:41.441548+0000","last_fullsized":"2023-09-30T22:56:41.441548+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.434454+0000","last_change":"2023-09-30T22:56:40.436118+0000","last_active":"2023-09-30T22:56:41.434454+0000","last_peered":"2023-09-30T22:56:41.434454+0000","last_clean":"2023-09-30T22:56:41.434454+0000","last_became_active":"2023-09-30T22:56:40.435906+0000","last_became_peered":"2023-09-30T22:56:40.435906+0000","last_unstale":"2023-09-30T22:56:41.434454+0000","last_undegraded":"2023-09-30T22:56:41.434454+0000","last_fullsized":"2023-09-30T22:56:41.434454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:49:45.123533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424543+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:56:40.424543+0000","last_peered":"2023-09-30T22:56:40.424543+0000","last_clean":"2023-09-30T22:56:40.424543+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:56:40.424543+0000","last_undegraded":"2023-09-30T22:56:40.424543+0000","last_fullsized":"2023-09-30T22:56:40.424543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435199+0000","last_change":"2023-09-30T22:56:41.435199+0000","last_active":"2023-09-30T22:56:41.435199+0000","last_peered":"2023-09-30T22:56:41.435199+0000","last_clean":"2023-09-30T22:56:41.435199+0000","last_became_active":"2023-09-30T22:56:41.434877+0000","last_became_peered":"2023-09-30T22:56:41.434877+0000","last_unstale":"2023-09-30T22:56:41.435199+0000","last_undegraded":"2023-09-30T22:56:41.435199+0000","last_fullsized":"2023-09-30T22:56:41.435199+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:14.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451109+0000","last_change":"2023-09-30T22:56:40.435362+0000","last_active":"2023-09-30T22:56:41.451109+0000","last_peered":"2023-09-30T22:56:41.451109+0000","last_clean":"2023-09-30T22:56:41.451109+0000","last_became_active":"2023-09-30T22:56:40.435132+0000","last_became_peered":"2023-09-30T22:56:40.435132+0000","last_unstale":"2023-09-30T22:56:41.451109+0000","last_undegraded":"2023-09-30T22:56:41.451109+0000","last_fullsized":"2023-09-30T22:56:41.451109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:40.338672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.423697+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:56:40.423697+0000","last_peered":"2023-09-30T22:56:40.423697+0000","last_clean":"2023-09-30T22:56:40.423697+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:56:40.423697+0000","last_undegraded":"2023-09-30T22:56:40.423697+0000","last_fullsized":"2023-09-30T22:56:40.423697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194814,"statfs":{"total":200000000,"available":199490249,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96599999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65900000000000003,"15min":0.64500000000000002},"min":{"1min":0.52800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65200000000000002,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66100000000000003},"min":{"1min":0.61899999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.91300000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71599999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.68999999999999995,"15min":0.67300000000000004},"min":{"1min":0.57899999999999996,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95399999999999996,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.55500000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.70299999999999996,"15min":0.67600000000000005},"min":{"1min":0.61599999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0049999999999999,"5min":1.056,"15min":1.056},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76100000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.59299999999999997},"min":{"1min":0.42199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82899999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.46000000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":1.135,"15min":1.135},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89500000000000002,"5min":1.004,"15min":1.004},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.55200000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.871,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.071},"last":0.73799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194814,"statfs":{"total":200000000,"available":199490229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":1.014},"min":{"1min":0.44,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.93999999999999995,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.80700000000000005},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84599999999999997,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.83999999999999997},"min":{"1min":0.48199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.96599999999999997,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.92100000000000004,"15min":1.0489999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96599999999999997,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.67100000000000004}]},{"osd":2,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78900000000000003,"15min":0.82199999999999995},"min":{"1min":0.503,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.88600000000000001,"15min":1.054},"min":{"1min":0.52000000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0389999999999999,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.873}]},{"osd":3,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.89100000000000001,"15min":0.97499999999999998},"min":{"1min":0.53500000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91400000000000003,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93300000000000005,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.89300000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66000000000000003,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1399999999999999,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.5},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71099999999999997,"15min":0.66700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.65200000000000002},"min":{"1min":0.50900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83899999999999997,"5min":1.321,"15min":1.321},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.70099999999999996},"min":{"1min":0.48199999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1579999999999999,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.624},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92100000000000004,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1075,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194237,"statfs":{"total":200000000,"available":198898935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.40100000000000002},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46999999999999997,"15min":0.45100000000000001},"min":{"1min":0.39200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.432},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.61899999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.46500000000000002},"min":{"1min":0.438,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53800000000000003,"15min":0.51300000000000001},"min":{"1min":0.49099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.5,"15min":0.46999999999999997},"min":{"1min":0.45100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.442}]},{"osd":4,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.50800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":0.995,"15min":0.995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.66200000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.0429999999999999,"5min":1.097,"15min":1.097},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.095,"5min":1.22,"15min":1.22},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.60199999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97799999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.61799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99399999999999999,"5min":1.21,"15min":1.21},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78500000000000003,"15min":0.75700000000000001},"min":{"1min":0.67500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.022,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199490851,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.41699999999999998},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61499999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.35999999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.52800000000000002,"15min":0.50800000000000001},"min":{"1min":0.49299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.879,"15min":0.879},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.42599999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61899999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.374},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.47599999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.72399999999999998,"15min":0.69999999999999996},"min":{"1min":0.66800000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0209999999999999,"5min":1.27,"15min":1.27},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58099999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.73899999999999999,"15min":0.71799999999999997},"min":{"1min":0.68100000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.72699999999999998,"15min":0.70699999999999996},"min":{"1min":0.67700000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92500000000000004,"5min":1.119,"15min":1.119},"last":0.755}]},{"osd":6,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.69399999999999995,"5min":0.434,"15min":0.434},"max":{"1min":0.98599999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.748,"15min":0.72399999999999998},"min":{"1min":0.70799999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0449999999999999,"5min":1.129,"15min":1.129},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.75900000000000001,"15min":0.72499999999999998},"min":{"1min":0.73699999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.125,"5min":1.173,"15min":1.173},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.628,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0780000000000001,"5min":1.21,"15min":1.21},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199490873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.438,"15min":0.41899999999999998},"min":{"1min":0.34000000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69499999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.313}]},{"osd":1,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.372},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.51200000000000001,"15min":0.49199999999999999},"min":{"1min":0.499,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74299999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.46000000000000002,"15min":0.44400000000000001},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.748,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51000000000000001,"15min":0.497},"min":{"1min":0.434,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76200000000000001,"15min":0.748},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.006,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93799999999999994,"5min":1.179,"15min":1.179},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.63800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90800000000000003,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.60599999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.77400000000000002},"min":{"1min":0.60799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99399999999999999,"5min":1.615,"15min":1.615},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89700000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.57299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":498,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194813,"statfs":{"total":200000000,"available":199489233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.39700000000000002},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.61699999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.309},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.49099999999999999,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":1.919,"15min":1.919},"last":0.36099999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70999999999999996,"5min":1.254,"15min":1.254},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.48699999999999999,"15min":0.46700000000000003},"min":{"1min":0.42399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52900000000000003,"15min":0.53600000000000003},"min":{"1min":0.45100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80400000000000005,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.60299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0249999999999999,"5min":1.401,"15min":1.401},"last":0.623},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78600000000000003,"15min":0.75800000000000001},"min":{"1min":0.65000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0620000000000001,"5min":3.306,"15min":3.306},"last":0.66200000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.755,"15min":0.751},"min":{"1min":0.61399999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95399999999999996,"5min":1.508,"15min":1.508},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.129,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0800000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.60499999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0960000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.72999999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.145,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1970000000000001,"5min":1.573,"15min":1.573},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194822,"statfs":{"total":200000000,"available":199497989,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.61399999999999999,"15min":0.56799999999999995},"min":{"1min":0.496,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.87,"5min":1.022,"15min":1.022},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.626,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64100000000000001,"15min":0.60099999999999998},"min":{"1min":0.53000000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.49099999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.502}]},{"osd":2,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.5,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":1.006,"15min":1.006},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.67300000000000004},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.97899999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.58599999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71699999999999997,"15min":0.68799999999999994},"min":{"1min":0.53800000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63300000000000001,"15min":0.65700000000000003},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.52100000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.626}]},{"osd":6,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89400000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.874,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46999999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92100000000000004,"5min":1.044,"15min":1.044},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1073,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.624,"15min":0.59299999999999997},"min":{"1min":0.48099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.65500000000000003,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.69099999999999995,"15min":0.65400000000000003},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68700000000000006,"15min":0.65600000000000003},"min":{"1min":0.55900000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91400000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.628},"min":{"1min":0.56000000000000005,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.66700000000000004,"15min":0.64500000000000002},"min":{"1min":0.51600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66100000000000003,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96199999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.68000000000000005,"15min":0.64400000000000002},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.94699999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69899999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.629,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81200000000000006,"5min":0.878,"15min":0.878},"last":0.71499999999999997}]},{"osd":6,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.66900000000000004},"min":{"1min":0.50600000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78400000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.55100000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.92700000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0129999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79900000000000004}]}]}],"pool_statfs":[]}} 2023-09-30T22:56:45.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:56:46.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.010+0000 7f98d31ff700 1 Processor -- start 2023-09-30T22:56:46.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.010+0000 7f98d31ff700 1 -- start start 2023-09-30T22:56:46.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.011+0000 7f98d31ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.011+0000 7f98d31ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f98cc15a2a0 0x7f98cc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.011+0000 7f98d31ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc0b0ee0 con 0x7f98cc06f190 2023-09-30T22:56:46.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.011+0000 7f98d31ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0aefc0 con 0x7f98cc15a2a0 2023-09-30T22:56:46.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.011+0000 7f98d31ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0b02d0 con 0x7f98cc0aebf0 2023-09-30T22:56:46.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.011+0000 7f98cbfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f98cc06f190 0x7f98cc159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55894/0 (socket says 172.21.15.142:55894) 2023-09-30T22:56:46.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.011+0000 7f98cbfff700 1 -- 172.21.15.142:0/2311388757 learned_addr learned my addr 172.21.15.142:0/2311388757 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:46.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d0f9b700 1 --2- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d179c700 1 --2- 172.21.15.142:0/2311388757 >> v2:172.21.15.148:3300/0 conn(0x7f98cc15a2a0 0x7f98cc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98cb7fe700 1 -- 172.21.15.142:0/2311388757 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124856305 0 0) 0x7f98cc0b0ee0 con 0x7f98cc06f190 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98cb7fe700 1 -- 172.21.15.142:0/2311388757 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98bc003570 con 0x7f98cc06f190 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d179c700 1 -- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 msgr2=0x7f98cc06ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d179c700 1 --2- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc06ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d179c700 1 -- 172.21.15.142:0/2311388757 >> v1:172.21.15.142:6789/0 conn(0x7f98cc06f190 legacy=0x7f98cc159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d179c700 1 -- 172.21.15.142:0/2311388757 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0b05b0 con 0x7f98cc15a2a0 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d0f9b700 1 --2- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc06ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.012+0000 7f98d179c700 1 --2- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc069f10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f98c400af70 tx=0x7f98c400a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e2dc16563319aeb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98cb7fe700 1 -- 172.21.15.142:0/2311388757 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400f070 con 0x7f98cc15a2a0 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98cb7fe700 1 -- 172.21.15.142:0/2311388757 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c400a2e0 con 0x7f98cc15a2a0 2023-09-30T22:56:46.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98cb7fe700 1 -- 172.21.15.142:0/2311388757 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400cbc0 con 0x7f98cc15a2a0 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 -- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 msgr2=0x7f98cc069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 --2- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc069f10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f98c400af70 tx=0x7f98c400a890 comp rx=0 tx=0).stop 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 -- 172.21.15.142:0/2311388757 shutdown_connections 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 --2- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc069f10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 --2- 172.21.15.142:0/2311388757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc06ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 -- 172.21.15.142:0/2311388757 >> 172.21.15.142:0/2311388757 conn(0x7f98cc0680c0 msgr2=0x7f98cc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 -- 172.21.15.142:0/2311388757 shutdown_connections 2023-09-30T22:56:46.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.013+0000 7f98d31ff700 1 -- 172.21.15.142:0/2311388757 wait complete. 2023-09-30T22:56:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.015+0000 7f98d31ff700 1 Processor -- start 2023-09-30T22:56:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.015+0000 7f98d31ff700 1 -- start start 2023-09-30T22:56:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d31ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc06f190 0x7f98cc142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d31ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc0c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d31ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d31ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1567c0 con 0x7f98cc06f190 2023-09-30T22:56:46.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d31ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc14f970 con 0x7f98cc15a2a0 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d31ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc156490 con 0x7f98cc0aebf0 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d0f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc06f190 0x7f98cc142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d0f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc06f190 0x7f98cc142010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42896/0 (socket says 172.21.15.142:42896) 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.016+0000 7f98d0f9b700 1 -- 172.21.15.142:0/1873653400 learned_addr learned my addr 172.21.15.142:0/1873653400 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98cbfff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc0c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d0f9b700 1 -- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 msgr2=0x7f98cc0c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d0f9b700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc0c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d179c700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d0f9b700 1 -- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 msgr2=0x7f98cc0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d0f9b700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d0f9b700 1 -- 172.21.15.142:0/1873653400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c0009420 con 0x7f98cc06f190 2023-09-30T22:56:46.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98cbfff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc0c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d179c700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:56:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d0f9b700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc06f190 0x7f98cc142010 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f98c000ecb0 tx=0x7f98c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98c8ff9700 1 -- 172.21.15.142:0/1873653400 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000ee60 con 0x7f98cc06f190 2023-09-30T22:56:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98c8ff9700 1 -- 172.21.15.142:0/1873653400 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c000cbe0 con 0x7f98cc06f190 2023-09-30T22:56:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c400ab30 con 0x7f98cc06f190 2023-09-30T22:56:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98c8ff9700 1 -- 172.21.15.142:0/1873653400 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0013470 con 0x7f98cc06f190 2023-09-30T22:56:46.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.017+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc0c6940 con 0x7f98cc06f190 2023-09-30T22:56:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.018+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc156aa0 con 0x7f98cc06f190 2023-09-30T22:56:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.019+0000 7f98c8ff9700 1 -- 172.21.15.142:0/1873653400 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f98c0013820 con 0x7f98cc06f190 2023-09-30T22:56:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.020+0000 7f98c8ff9700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98b0067330 0x7f98b00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.020+0000 7f98c8ff9700 1 -- 172.21.15.142:0/1873653400 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98c0084fe0 con 0x7f98cc06f190 2023-09-30T22:56:46.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.020+0000 7f98cbfff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98b0067330 0x7f98b00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.021+0000 7f98cbfff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98b0067330 0x7f98b00697e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007fd0 tx=0x7f98b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.024+0000 7f98c8ff9700 1 -- 172.21.15.142:0/1873653400 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f98c0051ea0 con 0x7f98cc06f190 2023-09-30T22:56:46.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.213+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98cc0c6c80 con 0x7f98b0067330 2023-09-30T22:56:46.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.222+0000 7f98c8ff9700 1 -- 172.21.15.142:0/1873653400 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303147 (secure 0 0 0) 0x7f98cc0c6c80 con 0x7f98b0067330 2023-09-30T22:56:46.227 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:46.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98b0067330 msgr2=0x7f98b00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98b0067330 0x7f98b00697e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007fd0 tx=0x7f98b8009040 comp rx=0 tx=0).stop 2023-09-30T22:56:46.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc06f190 msgr2=0x7f98cc142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc06f190 0x7f98cc142010 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f98c000ecb0 tx=0x7f98c00091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 shutdown_connections 2023-09-30T22:56:46.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98b0067330 0x7f98b00697e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98cc15a2a0 0x7f98cc0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98cc06f190 0x7f98cc142010 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 --2- 172.21.15.142:0/1873653400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98cc0aebf0 0x7f98cc0c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 >> 172.21.15.142:0/1873653400 conn(0x7f98cc0680c0 msgr2=0x7f98cc152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:46.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 shutdown_connections 2023-09-30T22:56:46.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.226+0000 7f98d31ff700 1 -- 172.21.15.142:0/1873653400 wait complete. 2023-09-30T22:56:46.230 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:56:46.245 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2023-09-30T22:56:46.159258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557371,"statfs":{"total":1600000000,"available":1594748774,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001224"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.436399+0000","last_change":"2023-09-30T22:56:41.436399+0000","last_active":"2023-09-30T22:56:41.436399+0000","last_peered":"2023-09-30T22:56:41.436399+0000","last_clean":"2023-09-30T22:56:41.436399+0000","last_became_active":"2023-09-30T22:56:41.436171+0000","last_became_peered":"2023-09-30T22:56:41.436171+0000","last_unstale":"2023-09-30T22:56:41.436399+0000","last_undegraded":"2023-09-30T22:56:41.436399+0000","last_fullsized":"2023-09-30T22:56:41.436399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:26:48.564747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.434007+0000","last_change":"2023-09-30T22:56:41.434007+0000","last_active":"2023-09-30T22:56:41.434007+0000","last_peered":"2023-09-30T22:56:41.434007+0000","last_clean":"2023-09-30T22:56:41.434007+0000","last_became_active":"2023-09-30T22:56:41.433722+0000","last_became_peered":"2023-09-30T22:56:41.433722+0000","last_unstale":"2023-09-30T22:56:41.434007+0000","last_undegraded":"2023-09-30T22:56:41.434007+0000","last_fullsized":"2023-09-30T22:56:41.434007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:28:32.254484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437961+0000","last_change":"2023-09-30T22:56:41.437961+0000","last_active":"2023-09-30T22:56:41.437961+0000","last_peered":"2023-09-30T22:56:41.437961+0000","last_clean":"2023-09-30T22:56:41.437961+0000","last_became_active":"2023-09-30T22:56:41.437577+0000","last_became_peered":"2023-09-30T22:56:41.437577+0000","last_unstale":"2023-09-30T22:56:41.437961+0000","last_undegraded":"2023-09-30T22:56:41.437961+0000","last_fullsized":"2023-09-30T22:56:41.437961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437545+0000","last_change":"2023-09-30T22:56:41.437545+0000","last_active":"2023-09-30T22:56:41.437545+0000","last_peered":"2023-09-30T22:56:41.437545+0000","last_clean":"2023-09-30T22:56:41.437545+0000","last_became_active":"2023-09-30T22:56:41.437316+0000","last_became_peered":"2023-09-30T22:56:41.437316+0000","last_unstale":"2023-09-30T22:56:41.437545+0000","last_undegraded":"2023-09-30T22:56:41.437545+0000","last_fullsized":"2023-09-30T22:56:41.437545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:55.547680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442823+0000","last_change":"2023-09-30T22:56:41.442823+0000","last_active":"2023-09-30T22:56:41.442823+0000","last_peered":"2023-09-30T22:56:41.442823+0000","last_clean":"2023-09-30T22:56:41.442823+0000","last_became_active":"2023-09-30T22:56:41.442272+0000","last_became_peered":"2023-09-30T22:56:41.442272+0000","last_unstale":"2023-09-30T22:56:41.442823+0000","last_undegraded":"2023-09-30T22:56:41.442823+0000","last_fullsized":"2023-09-30T22:56:41.442823+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:45:23.460768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449424+0000","last_change":"2023-09-30T22:56:41.449424+0000","last_active":"2023-09-30T22:56:41.449424+0000","last_peered":"2023-09-30T22:56:41.449424+0000","last_clean":"2023-09-30T22:56:41.449424+0000","last_became_active":"2023-09-30T22:56:41.449032+0000","last_became_peered":"2023-09-30T22:56:41.449032+0000","last_unstale":"2023-09-30T22:56:41.449424+0000","last_undegraded":"2023-09-30T22:56:41.449424+0000","last_fullsized":"2023-09-30T22:56:41.449424+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:32.294167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448338+0000","last_change":"2023-09-30T22:56:41.448338+0000","last_active":"2023-09-30T22:56:41.448338+0000","last_peered":"2023-09-30T22:56:41.448338+0000","last_clean":"2023-09-30T22:56:41.448338+0000","last_became_active":"2023-09-30T22:56:41.448064+0000","last_became_peered":"2023-09-30T22:56:41.448064+0000","last_unstale":"2023-09-30T22:56:41.448338+0000","last_undegraded":"2023-09-30T22:56:41.448338+0000","last_fullsized":"2023-09-30T22:56:41.448338+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:44:04.353795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442951+0000","last_change":"2023-09-30T22:56:41.442951+0000","last_active":"2023-09-30T22:56:41.442951+0000","last_peered":"2023-09-30T22:56:41.442951+0000","last_clean":"2023-09-30T22:56:41.442951+0000","last_became_active":"2023-09-30T22:56:41.442720+0000","last_became_peered":"2023-09-30T22:56:41.442720+0000","last_unstale":"2023-09-30T22:56:41.442951+0000","last_undegraded":"2023-09-30T22:56:41.442951+0000","last_fullsized":"2023-09-30T22:56:41.442951+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:16:26.756115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.447934+0000","last_change":"2023-09-30T22:56:41.447934+0000","last_active":"2023-09-30T22:56:41.447934+0000","last_peered":"2023-09-30T22:56:41.447934+0000","last_clean":"2023-09-30T22:56:41.447934+0000","last_became_active":"2023-09-30T22:56:41.447246+0000","last_became_peered":"2023-09-30T22:56:41.447246+0000","last_unstale":"2023-09-30T22:56:41.447934+0000","last_undegraded":"2023-09-30T22:56:41.447934+0000","last_fullsized":"2023-09-30T22:56:41.447934+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:42.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440272+0000","last_change":"2023-09-30T22:56:41.440272+0000","last_active":"2023-09-30T22:56:41.440272+0000","last_peered":"2023-09-30T22:56:41.440272+0000","last_clean":"2023-09-30T22:56:41.440272+0000","last_became_active":"2023-09-30T22:56:41.440055+0000","last_became_peered":"2023-09-30T22:56:41.440055+0000","last_unstale":"2023-09-30T22:56:41.440272+0000","last_undegraded":"2023-09-30T22:56:41.440272+0000","last_fullsized":"2023-09-30T22:56:41.440272+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:03.696796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.431636+0000","last_change":"2023-09-30T22:56:41.431636+0000","last_active":"2023-09-30T22:56:41.431636+0000","last_peered":"2023-09-30T22:56:41.431636+0000","last_clean":"2023-09-30T22:56:41.431636+0000","last_became_active":"2023-09-30T22:56:41.431419+0000","last_became_peered":"2023-09-30T22:56:41.431419+0000","last_unstale":"2023-09-30T22:56:41.431636+0000","last_undegraded":"2023-09-30T22:56:41.431636+0000","last_fullsized":"2023-09-30T22:56:41.431636+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:26:48.564747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448104+0000","last_change":"2023-09-30T22:56:41.448104+0000","last_active":"2023-09-30T22:56:41.448104+0000","last_peered":"2023-09-30T22:56:41.448104+0000","last_clean":"2023-09-30T22:56:41.448104+0000","last_became_active":"2023-09-30T22:56:41.447581+0000","last_became_peered":"2023-09-30T22:56:41.447581+0000","last_unstale":"2023-09-30T22:56:41.448104+0000","last_undegraded":"2023-09-30T22:56:41.448104+0000","last_fullsized":"2023-09-30T22:56:41.448104+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:22.239572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440523+0000","last_change":"2023-09-30T22:56:41.440523+0000","last_active":"2023-09-30T22:56:41.440523+0000","last_peered":"2023-09-30T22:56:41.440523+0000","last_clean":"2023-09-30T22:56:41.440523+0000","last_became_active":"2023-09-30T22:56:41.440290+0000","last_became_peered":"2023-09-30T22:56:41.440290+0000","last_unstale":"2023-09-30T22:56:41.440523+0000","last_undegraded":"2023-09-30T22:56:41.440523+0000","last_fullsized":"2023-09-30T22:56:41.440523+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:31.408254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435745+0000","last_change":"2023-09-30T22:56:41.435745+0000","last_active":"2023-09-30T22:56:41.435745+0000","last_peered":"2023-09-30T22:56:41.435745+0000","last_clean":"2023-09-30T22:56:41.435745+0000","last_became_active":"2023-09-30T22:56:41.435514+0000","last_became_peered":"2023-09-30T22:56:41.435514+0000","last_unstale":"2023-09-30T22:56:41.435745+0000","last_undegraded":"2023-09-30T22:56:41.435745+0000","last_fullsized":"2023-09-30T22:56:41.435745+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:10.953631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440681+0000","last_change":"2023-09-30T22:56:41.440681+0000","last_active":"2023-09-30T22:56:41.440681+0000","last_peered":"2023-09-30T22:56:41.440681+0000","last_clean":"2023-09-30T22:56:41.440681+0000","last_became_active":"2023-09-30T22:56:41.440398+0000","last_became_peered":"2023-09-30T22:56:41.440398+0000","last_unstale":"2023-09-30T22:56:41.440681+0000","last_undegraded":"2023-09-30T22:56:41.440681+0000","last_fullsized":"2023-09-30T22:56:41.440681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:44.565003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442756+0000","last_change":"2023-09-30T22:56:41.442756+0000","last_active":"2023-09-30T22:56:41.442756+0000","last_peered":"2023-09-30T22:56:41.442756+0000","last_clean":"2023-09-30T22:56:41.442756+0000","last_became_active":"2023-09-30T22:56:41.442525+0000","last_became_peered":"2023-09-30T22:56:41.442525+0000","last_unstale":"2023-09-30T22:56:41.442756+0000","last_undegraded":"2023-09-30T22:56:41.442756+0000","last_fullsized":"2023-09-30T22:56:41.442756+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:16.585991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440950+0000","last_change":"2023-09-30T22:56:41.440950+0000","last_active":"2023-09-30T22:56:41.440950+0000","last_peered":"2023-09-30T22:56:41.440950+0000","last_clean":"2023-09-30T22:56:41.440950+0000","last_became_active":"2023-09-30T22:56:41.440664+0000","last_became_peered":"2023-09-30T22:56:41.440664+0000","last_unstale":"2023-09-30T22:56:41.440950+0000","last_undegraded":"2023-09-30T22:56:41.440950+0000","last_fullsized":"2023-09-30T22:56:41.440950+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:44.474609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437806+0000","last_change":"2023-09-30T22:56:41.437806+0000","last_active":"2023-09-30T22:56:41.437806+0000","last_peered":"2023-09-30T22:56:41.437806+0000","last_clean":"2023-09-30T22:56:41.437806+0000","last_became_active":"2023-09-30T22:56:41.437234+0000","last_became_peered":"2023-09-30T22:56:41.437234+0000","last_unstale":"2023-09-30T22:56:41.437806+0000","last_undegraded":"2023-09-30T22:56:41.437806+0000","last_fullsized":"2023-09-30T22:56:41.437806+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:32.294167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439178+0000","last_change":"2023-09-30T22:56:41.439178+0000","last_active":"2023-09-30T22:56:41.439178+0000","last_peered":"2023-09-30T22:56:41.439178+0000","last_clean":"2023-09-30T22:56:41.439178+0000","last_became_active":"2023-09-30T22:56:41.438927+0000","last_became_peered":"2023-09-30T22:56:41.438927+0000","last_unstale":"2023-09-30T22:56:41.439178+0000","last_undegraded":"2023-09-30T22:56:41.439178+0000","last_fullsized":"2023-09-30T22:56:41.439178+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:26.889179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.453435+0000","last_change":"2023-09-30T22:56:41.453435+0000","last_active":"2023-09-30T22:56:41.453435+0000","last_peered":"2023-09-30T22:56:41.453435+0000","last_clean":"2023-09-30T22:56:41.453435+0000","last_became_active":"2023-09-30T22:56:41.453193+0000","last_became_peered":"2023-09-30T22:56:41.453193+0000","last_unstale":"2023-09-30T22:56:41.453435+0000","last_undegraded":"2023-09-30T22:56:41.453435+0000","last_fullsized":"2023-09-30T22:56:41.453435+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.443941+0000","last_change":"2023-09-30T22:56:41.443941+0000","last_active":"2023-09-30T22:56:41.443941+0000","last_peered":"2023-09-30T22:56:41.443941+0000","last_clean":"2023-09-30T22:56:41.443941+0000","last_became_active":"2023-09-30T22:56:41.443695+0000","last_became_peered":"2023-09-30T22:56:41.443695+0000","last_unstale":"2023-09-30T22:56:41.443941+0000","last_undegraded":"2023-09-30T22:56:41.443941+0000","last_fullsized":"2023-09-30T22:56:41.443941+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:43.860840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.453971+0000","last_change":"2023-09-30T22:56:41.453971+0000","last_active":"2023-09-30T22:56:41.453971+0000","last_peered":"2023-09-30T22:56:41.453971+0000","last_clean":"2023-09-30T22:56:41.453971+0000","last_became_active":"2023-09-30T22:56:41.453709+0000","last_became_peered":"2023-09-30T22:56:41.453709+0000","last_unstale":"2023-09-30T22:56:41.453971+0000","last_undegraded":"2023-09-30T22:56:41.453971+0000","last_fullsized":"2023-09-30T22:56:41.453971+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:33.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.441308+0000","last_change":"2023-09-30T22:56:41.441308+0000","last_active":"2023-09-30T22:56:41.441308+0000","last_peered":"2023-09-30T22:56:41.441308+0000","last_clean":"2023-09-30T22:56:41.441308+0000","last_became_active":"2023-09-30T22:56:41.441058+0000","last_became_peered":"2023-09-30T22:56:41.441058+0000","last_unstale":"2023-09-30T22:56:41.441308+0000","last_undegraded":"2023-09-30T22:56:41.441308+0000","last_fullsized":"2023-09-30T22:56:41.441308+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:31.408254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.438184+0000","last_change":"2023-09-30T22:56:41.438184+0000","last_active":"2023-09-30T22:56:41.438184+0000","last_peered":"2023-09-30T22:56:41.438184+0000","last_clean":"2023-09-30T22:56:41.438184+0000","last_became_active":"2023-09-30T22:56:41.437910+0000","last_became_peered":"2023-09-30T22:56:41.437910+0000","last_unstale":"2023-09-30T22:56:41.438184+0000","last_undegraded":"2023-09-30T22:56:41.438184+0000","last_fullsized":"2023-09-30T22:56:41.438184+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:23.565763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450123+0000","last_change":"2023-09-30T22:56:41.450123+0000","last_active":"2023-09-30T22:56:41.450123+0000","last_peered":"2023-09-30T22:56:41.450123+0000","last_clean":"2023-09-30T22:56:41.450123+0000","last_became_active":"2023-09-30T22:56:41.449869+0000","last_became_peered":"2023-09-30T22:56:41.449869+0000","last_unstale":"2023-09-30T22:56:41.450123+0000","last_undegraded":"2023-09-30T22:56:41.450123+0000","last_fullsized":"2023-09-30T22:56:41.450123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:33.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.438432+0000","last_change":"2023-09-30T22:56:41.438432+0000","last_active":"2023-09-30T22:56:41.438432+0000","last_peered":"2023-09-30T22:56:41.438432+0000","last_clean":"2023-09-30T22:56:41.438432+0000","last_became_active":"2023-09-30T22:56:41.438226+0000","last_became_peered":"2023-09-30T22:56:41.438226+0000","last_unstale":"2023-09-30T22:56:41.438432+0000","last_undegraded":"2023-09-30T22:56:41.438432+0000","last_fullsized":"2023-09-30T22:56:41.438432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:13:17.585048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442388+0000","last_change":"2023-09-30T22:56:41.442388+0000","last_active":"2023-09-30T22:56:41.442388+0000","last_peered":"2023-09-30T22:56:41.442388+0000","last_clean":"2023-09-30T22:56:41.442388+0000","last_became_active":"2023-09-30T22:56:41.442136+0000","last_became_peered":"2023-09-30T22:56:41.442136+0000","last_unstale":"2023-09-30T22:56:41.442388+0000","last_undegraded":"2023-09-30T22:56:41.442388+0000","last_fullsized":"2023-09-30T22:56:41.442388+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:41.025882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.443506+0000","last_change":"2023-09-30T22:56:41.443506+0000","last_active":"2023-09-30T22:56:41.443506+0000","last_peered":"2023-09-30T22:56:41.443506+0000","last_clean":"2023-09-30T22:56:41.443506+0000","last_became_active":"2023-09-30T22:56:41.442997+0000","last_became_peered":"2023-09-30T22:56:41.442997+0000","last_unstale":"2023-09-30T22:56:41.443506+0000","last_undegraded":"2023-09-30T22:56:41.443506+0000","last_fullsized":"2023-09-30T22:56:41.443506+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:23:06.894673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.446221+0000","last_change":"2023-09-30T22:56:41.446221+0000","last_active":"2023-09-30T22:56:41.446221+0000","last_peered":"2023-09-30T22:56:41.446221+0000","last_clean":"2023-09-30T22:56:41.446221+0000","last_became_active":"2023-09-30T22:56:41.445924+0000","last_became_peered":"2023-09-30T22:56:41.445924+0000","last_unstale":"2023-09-30T22:56:41.446221+0000","last_undegraded":"2023-09-30T22:56:41.446221+0000","last_fullsized":"2023-09-30T22:56:41.446221+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:44.565003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451261+0000","last_change":"2023-09-30T22:56:41.451261+0000","last_active":"2023-09-30T22:56:41.451261+0000","last_peered":"2023-09-30T22:56:41.451261+0000","last_clean":"2023-09-30T22:56:41.451261+0000","last_became_active":"2023-09-30T22:56:41.451046+0000","last_became_peered":"2023-09-30T22:56:41.451046+0000","last_unstale":"2023-09-30T22:56:41.451261+0000","last_undegraded":"2023-09-30T22:56:41.451261+0000","last_fullsized":"2023-09-30T22:56:41.451261+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:23.565763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.434196+0000","last_change":"2023-09-30T22:56:41.434196+0000","last_active":"2023-09-30T22:56:41.434196+0000","last_peered":"2023-09-30T22:56:41.434196+0000","last_clean":"2023-09-30T22:56:41.434196+0000","last_became_active":"2023-09-30T22:56:41.433909+0000","last_became_peered":"2023-09-30T22:56:41.433909+0000","last_unstale":"2023-09-30T22:56:41.434196+0000","last_undegraded":"2023-09-30T22:56:41.434196+0000","last_fullsized":"2023-09-30T22:56:41.434196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:10:54.238836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451451+0000","last_change":"2023-09-30T22:56:41.451451+0000","last_active":"2023-09-30T22:56:41.451451+0000","last_peered":"2023-09-30T22:56:41.451451+0000","last_clean":"2023-09-30T22:56:41.451451+0000","last_became_active":"2023-09-30T22:56:41.451216+0000","last_became_peered":"2023-09-30T22:56:41.451216+0000","last_unstale":"2023-09-30T22:56:41.451451+0000","last_undegraded":"2023-09-30T22:56:41.451451+0000","last_fullsized":"2023-09-30T22:56:41.451451+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:30:58.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442675+0000","last_change":"2023-09-30T22:56:41.442675+0000","last_active":"2023-09-30T22:56:41.442675+0000","last_peered":"2023-09-30T22:56:41.442675+0000","last_clean":"2023-09-30T22:56:41.442675+0000","last_became_active":"2023-09-30T22:56:41.441958+0000","last_became_peered":"2023-09-30T22:56:41.441958+0000","last_unstale":"2023-09-30T22:56:41.442675+0000","last_undegraded":"2023-09-30T22:56:41.442675+0000","last_fullsized":"2023-09-30T22:56:41.442675+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:43:30.231668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"90'4","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448337+0000","last_change":"2023-09-30T22:56:40.439428+0000","last_active":"2023-09-30T22:56:41.448337+0000","last_peered":"2023-09-30T22:56:41.448337+0000","last_clean":"2023-09-30T22:56:41.448337+0000","last_became_active":"2023-09-30T22:56:40.437620+0000","last_became_peered":"2023-09-30T22:56:40.437620+0000","last_unstale":"2023-09-30T22:56:41.448337+0000","last_undegraded":"2023-09-30T22:56:41.448337+0000","last_fullsized":"2023-09-30T22:56:41.448337+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:51:41.606853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.444119+0000","last_change":"2023-09-30T22:56:41.444119+0000","last_active":"2023-09-30T22:56:41.444119+0000","last_peered":"2023-09-30T22:56:41.444119+0000","last_clean":"2023-09-30T22:56:41.444119+0000","last_became_active":"2023-09-30T22:56:41.443858+0000","last_became_peered":"2023-09-30T22:56:41.443858+0000","last_unstale":"2023-09-30T22:56:41.444119+0000","last_undegraded":"2023-09-30T22:56:41.444119+0000","last_fullsized":"2023-09-30T22:56:41.444119+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:37:58.134144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439248+0000","last_change":"2023-09-30T22:56:40.434878+0000","last_active":"2023-09-30T22:56:41.439248+0000","last_peered":"2023-09-30T22:56:41.439248+0000","last_clean":"2023-09-30T22:56:41.439248+0000","last_became_active":"2023-09-30T22:56:40.434141+0000","last_became_peered":"2023-09-30T22:56:40.434141+0000","last_unstale":"2023-09-30T22:56:41.439248+0000","last_undegraded":"2023-09-30T22:56:41.439248+0000","last_fullsized":"2023-09-30T22:56:41.439248+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:25.883407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.455167+0000","last_change":"2023-09-30T22:56:41.455167+0000","last_active":"2023-09-30T22:56:41.455167+0000","last_peered":"2023-09-30T22:56:41.455167+0000","last_clean":"2023-09-30T22:56:41.455167+0000","last_became_active":"2023-09-30T22:56:41.454954+0000","last_became_peered":"2023-09-30T22:56:41.454954+0000","last_unstale":"2023-09-30T22:56:41.455167+0000","last_undegraded":"2023-09-30T22:56:41.455167+0000","last_fullsized":"2023-09-30T22:56:41.455167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.455269+0000","last_change":"2023-09-30T22:56:40.434699+0000","last_active":"2023-09-30T22:56:41.455269+0000","last_peered":"2023-09-30T22:56:41.455269+0000","last_clean":"2023-09-30T22:56:41.455269+0000","last_became_active":"2023-09-30T22:56:40.434222+0000","last_became_peered":"2023-09-30T22:56:40.434222+0000","last_unstale":"2023-09-30T22:56:41.455269+0000","last_undegraded":"2023-09-30T22:56:41.455269+0000","last_fullsized":"2023-09-30T22:56:41.455269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:21.233799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.437892+0000","last_change":"2023-09-30T22:56:41.437892+0000","last_active":"2023-09-30T22:56:41.437892+0000","last_peered":"2023-09-30T22:56:41.437892+0000","last_clean":"2023-09-30T22:56:41.437892+0000","last_became_active":"2023-09-30T22:56:41.437261+0000","last_became_peered":"2023-09-30T22:56:41.437261+0000","last_unstale":"2023-09-30T22:56:41.437892+0000","last_undegraded":"2023-09-30T22:56:41.437892+0000","last_fullsized":"2023-09-30T22:56:41.437892+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:07.326259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448662+0000","last_change":"2023-09-30T22:56:40.432525+0000","last_active":"2023-09-30T22:56:41.448662+0000","last_peered":"2023-09-30T22:56:41.448662+0000","last_clean":"2023-09-30T22:56:41.448662+0000","last_became_active":"2023-09-30T22:56:40.432290+0000","last_became_peered":"2023-09-30T22:56:40.432290+0000","last_unstale":"2023-09-30T22:56:41.448662+0000","last_undegraded":"2023-09-30T22:56:41.448662+0000","last_fullsized":"2023-09-30T22:56:41.448662+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:30:57.444869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450216+0000","last_change":"2023-09-30T22:56:41.450216+0000","last_active":"2023-09-30T22:56:41.450216+0000","last_peered":"2023-09-30T22:56:41.450216+0000","last_clean":"2023-09-30T22:56:41.450216+0000","last_became_active":"2023-09-30T22:56:41.449986+0000","last_became_peered":"2023-09-30T22:56:41.449986+0000","last_unstale":"2023-09-30T22:56:41.450216+0000","last_undegraded":"2023-09-30T22:56:41.450216+0000","last_fullsized":"2023-09-30T22:56:41.450216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:19:38.499344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.436027+0000","last_change":"2023-09-30T22:56:40.431836+0000","last_active":"2023-09-30T22:56:41.436027+0000","last_peered":"2023-09-30T22:56:41.436027+0000","last_clean":"2023-09-30T22:56:41.436027+0000","last_became_active":"2023-09-30T22:56:40.431623+0000","last_became_peered":"2023-09-30T22:56:40.431623+0000","last_unstale":"2023-09-30T22:56:41.436027+0000","last_undegraded":"2023-09-30T22:56:41.436027+0000","last_fullsized":"2023-09-30T22:56:41.436027+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:15.580218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.433608+0000","last_change":"2023-09-30T22:56:41.433608+0000","last_active":"2023-09-30T22:56:41.433608+0000","last_peered":"2023-09-30T22:56:41.433608+0000","last_clean":"2023-09-30T22:56:41.433608+0000","last_became_active":"2023-09-30T22:56:41.433352+0000","last_became_peered":"2023-09-30T22:56:41.433352+0000","last_unstale":"2023-09-30T22:56:41.433608+0000","last_undegraded":"2023-09-30T22:56:41.433608+0000","last_fullsized":"2023-09-30T22:56:41.433608+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:46.057835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439327+0000","last_change":"2023-09-30T22:56:40.426702+0000","last_active":"2023-09-30T22:56:41.439327+0000","last_peered":"2023-09-30T22:56:41.439327+0000","last_clean":"2023-09-30T22:56:41.439327+0000","last_became_active":"2023-09-30T22:56:40.426468+0000","last_became_peered":"2023-09-30T22:56:40.426468+0000","last_unstale":"2023-09-30T22:56:41.439327+0000","last_undegraded":"2023-09-30T22:56:41.439327+0000","last_fullsized":"2023-09-30T22:56:41.439327+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:43.468836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442854+0000","last_change":"2023-09-30T22:56:41.442854+0000","last_active":"2023-09-30T22:56:41.442854+0000","last_peered":"2023-09-30T22:56:41.442854+0000","last_clean":"2023-09-30T22:56:41.442854+0000","last_became_active":"2023-09-30T22:56:41.442634+0000","last_became_peered":"2023-09-30T22:56:41.442634+0000","last_unstale":"2023-09-30T22:56:41.442854+0000","last_undegraded":"2023-09-30T22:56:41.442854+0000","last_fullsized":"2023-09-30T22:56:41.442854+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:39.464161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.435381+0000","last_change":"2023-09-30T22:56:40.435284+0000","last_active":"2023-09-30T22:56:40.435381+0000","last_peered":"2023-09-30T22:56:40.435381+0000","last_clean":"2023-09-30T22:56:40.435381+0000","last_became_active":"2023-09-30T22:56:40.434997+0000","last_became_peered":"2023-09-30T22:56:40.434997+0000","last_unstale":"2023-09-30T22:56:40.435381+0000","last_undegraded":"2023-09-30T22:56:40.435381+0000","last_fullsized":"2023-09-30T22:56:40.435381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:22.559990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.445020+0000","last_change":"2023-09-30T22:56:41.445020+0000","last_active":"2023-09-30T22:56:41.445020+0000","last_peered":"2023-09-30T22:56:41.445020+0000","last_clean":"2023-09-30T22:56:41.445020+0000","last_became_active":"2023-09-30T22:56:41.444800+0000","last_became_peered":"2023-09-30T22:56:41.444800+0000","last_unstale":"2023-09-30T22:56:41.445020+0000","last_undegraded":"2023-09-30T22:56:41.445020+0000","last_fullsized":"2023-09-30T22:56:41.445020+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:49.057095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.433311+0000","last_change":"2023-09-30T22:56:40.433212+0000","last_active":"2023-09-30T22:56:40.433311+0000","last_peered":"2023-09-30T22:56:40.433311+0000","last_clean":"2023-09-30T22:56:40.433311+0000","last_became_active":"2023-09-30T22:56:40.433021+0000","last_became_peered":"2023-09-30T22:56:40.433021+0000","last_unstale":"2023-09-30T22:56:40.433311+0000","last_undegraded":"2023-09-30T22:56:40.433311+0000","last_fullsized":"2023-09-30T22:56:40.433311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:06.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448562+0000","last_change":"2023-09-30T22:56:41.448562+0000","last_active":"2023-09-30T22:56:41.448562+0000","last_peered":"2023-09-30T22:56:41.448562+0000","last_clean":"2023-09-30T22:56:41.448562+0000","last_became_active":"2023-09-30T22:56:41.447863+0000","last_became_peered":"2023-09-30T22:56:41.447863+0000","last_unstale":"2023-09-30T22:56:41.448562+0000","last_undegraded":"2023-09-30T22:56:41.448562+0000","last_fullsized":"2023-09-30T22:56:41.448562+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:19:38.499344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.433934+0000","last_change":"2023-09-30T22:56:40.433525+0000","last_active":"2023-09-30T22:56:40.433934+0000","last_peered":"2023-09-30T22:56:40.433934+0000","last_clean":"2023-09-30T22:56:40.433934+0000","last_became_active":"2023-09-30T22:56:40.433126+0000","last_became_peered":"2023-09-30T22:56:40.433126+0000","last_unstale":"2023-09-30T22:56:40.433934+0000","last_undegraded":"2023-09-30T22:56:40.433934+0000","last_fullsized":"2023-09-30T22:56:40.433934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:41:48.170406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.448246+0000","last_change":"2023-09-30T22:56:41.448246+0000","last_active":"2023-09-30T22:56:41.448246+0000","last_peered":"2023-09-30T22:56:41.448246+0000","last_clean":"2023-09-30T22:56:41.448246+0000","last_became_active":"2023-09-30T22:56:41.447891+0000","last_became_peered":"2023-09-30T22:56:41.447891+0000","last_unstale":"2023-09-30T22:56:41.448246+0000","last_undegraded":"2023-09-30T22:56:41.448246+0000","last_fullsized":"2023-09-30T22:56:41.448246+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:44.565003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.438698+0000","last_change":"2023-09-30T22:56:40.438558+0000","last_active":"2023-09-30T22:56:40.438698+0000","last_peered":"2023-09-30T22:56:40.438698+0000","last_clean":"2023-09-30T22:56:40.438698+0000","last_became_active":"2023-09-30T22:56:40.438336+0000","last_became_peered":"2023-09-30T22:56:40.438336+0000","last_unstale":"2023-09-30T22:56:40.438698+0000","last_undegraded":"2023-09-30T22:56:40.438698+0000","last_fullsized":"2023-09-30T22:56:40.438698+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:45:22.454995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439101+0000","last_change":"2023-09-30T22:56:41.439101+0000","last_active":"2023-09-30T22:56:41.439101+0000","last_peered":"2023-09-30T22:56:41.439101+0000","last_clean":"2023-09-30T22:56:41.439101+0000","last_became_active":"2023-09-30T22:56:41.438375+0000","last_became_peered":"2023-09-30T22:56:41.438375+0000","last_unstale":"2023-09-30T22:56:41.439101+0000","last_undegraded":"2023-09-30T22:56:41.439101+0000","last_fullsized":"2023-09-30T22:56:41.439101+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:55:12.891965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"90'3","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.454941+0000","last_change":"2023-09-30T22:56:40.436330+0000","last_active":"2023-09-30T22:56:41.454941+0000","last_peered":"2023-09-30T22:56:41.454941+0000","last_clean":"2023-09-30T22:56:41.454941+0000","last_became_active":"2023-09-30T22:56:40.435926+0000","last_became_peered":"2023-09-30T22:56:40.435926+0000","last_unstale":"2023-09-30T22:56:41.454941+0000","last_undegraded":"2023-09-30T22:56:41.454941+0000","last_fullsized":"2023-09-30T22:56:41.454941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:41.945395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449597+0000","last_change":"2023-09-30T22:56:41.449597+0000","last_active":"2023-09-30T22:56:41.449597+0000","last_peered":"2023-09-30T22:56:41.449597+0000","last_clean":"2023-09-30T22:56:41.449597+0000","last_became_active":"2023-09-30T22:56:41.448944+0000","last_became_peered":"2023-09-30T22:56:41.448944+0000","last_unstale":"2023-09-30T22:56:41.449597+0000","last_undegraded":"2023-09-30T22:56:41.449597+0000","last_fullsized":"2023-09-30T22:56:41.449597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:22.239572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"90'6","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450845+0000","last_change":"2023-09-30T22:56:40.434739+0000","last_active":"2023-09-30T22:56:41.450845+0000","last_peered":"2023-09-30T22:56:41.450845+0000","last_clean":"2023-09-30T22:56:41.450845+0000","last_became_active":"2023-09-30T22:56:40.433836+0000","last_became_peered":"2023-09-30T22:56:40.433836+0000","last_unstale":"2023-09-30T22:56:41.450845+0000","last_undegraded":"2023-09-30T22:56:41.450845+0000","last_fullsized":"2023-09-30T22:56:41.450845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:09.947858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.447800+0000","last_change":"2023-09-30T22:56:41.447800+0000","last_active":"2023-09-30T22:56:41.447800+0000","last_peered":"2023-09-30T22:56:41.447800+0000","last_clean":"2023-09-30T22:56:41.447800+0000","last_became_active":"2023-09-30T22:56:41.446959+0000","last_became_peered":"2023-09-30T22:56:41.446959+0000","last_unstale":"2023-09-30T22:56:41.447800+0000","last_undegraded":"2023-09-30T22:56:41.447800+0000","last_fullsized":"2023-09-30T22:56:41.447800+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:12.404915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.450784+0000","last_change":"2023-09-30T22:56:40.435443+0000","last_active":"2023-09-30T22:56:41.450784+0000","last_peered":"2023-09-30T22:56:41.450784+0000","last_clean":"2023-09-30T22:56:41.450784+0000","last_became_active":"2023-09-30T22:56:40.434913+0000","last_became_peered":"2023-09-30T22:56:40.434913+0000","last_unstale":"2023-09-30T22:56:41.450784+0000","last_undegraded":"2023-09-30T22:56:41.450784+0000","last_fullsized":"2023-09-30T22:56:41.450784+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:40:43.559230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442631+0000","last_change":"2023-09-30T22:56:41.442631+0000","last_active":"2023-09-30T22:56:41.442631+0000","last_peered":"2023-09-30T22:56:41.442631+0000","last_clean":"2023-09-30T22:56:41.442631+0000","last_became_active":"2023-09-30T22:56:41.442200+0000","last_became_peered":"2023-09-30T22:56:41.442200+0000","last_unstale":"2023-09-30T22:56:41.442631+0000","last_undegraded":"2023-09-30T22:56:41.442631+0000","last_fullsized":"2023-09-30T22:56:41.442631+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:07:06.185547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.438468+0000","last_change":"2023-09-30T22:56:40.438345+0000","last_active":"2023-09-30T22:56:40.438468+0000","last_peered":"2023-09-30T22:56:40.438468+0000","last_clean":"2023-09-30T22:56:40.438468+0000","last_became_active":"2023-09-30T22:56:40.438089+0000","last_became_peered":"2023-09-30T22:56:40.438089+0000","last_unstale":"2023-09-30T22:56:40.438468+0000","last_undegraded":"2023-09-30T22:56:40.438468+0000","last_fullsized":"2023-09-30T22:56:40.438468+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:06.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.446621+0000","last_change":"2023-09-30T22:56:41.446621+0000","last_active":"2023-09-30T22:56:41.446621+0000","last_peered":"2023-09-30T22:56:41.446621+0000","last_clean":"2023-09-30T22:56:41.446621+0000","last_became_active":"2023-09-30T22:56:41.446342+0000","last_became_peered":"2023-09-30T22:56:41.446342+0000","last_unstale":"2023-09-30T22:56:41.446621+0000","last_undegraded":"2023-09-30T22:56:41.446621+0000","last_fullsized":"2023-09-30T22:56:41.446621+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:19:38.499344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.440190+0000","last_change":"2023-09-30T22:56:40.440121+0000","last_active":"2023-09-30T22:56:40.440190+0000","last_peered":"2023-09-30T22:56:40.440190+0000","last_clean":"2023-09-30T22:56:40.440190+0000","last_became_active":"2023-09-30T22:56:40.439870+0000","last_became_peered":"2023-09-30T22:56:40.439870+0000","last_unstale":"2023-09-30T22:56:40.440190+0000","last_undegraded":"2023-09-30T22:56:40.440190+0000","last_fullsized":"2023-09-30T22:56:40.440190+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:55.720121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451741+0000","last_change":"2023-09-30T22:56:41.451741+0000","last_active":"2023-09-30T22:56:41.451741+0000","last_peered":"2023-09-30T22:56:41.451741+0000","last_clean":"2023-09-30T22:56:41.451741+0000","last_became_active":"2023-09-30T22:56:41.451495+0000","last_became_peered":"2023-09-30T22:56:41.451495+0000","last_unstale":"2023-09-30T22:56:41.451741+0000","last_undegraded":"2023-09-30T22:56:41.451741+0000","last_fullsized":"2023-09-30T22:56:41.451741+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:46.057835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"90'8","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.452568+0000","last_change":"2023-09-30T22:56:40.436775+0000","last_active":"2023-09-30T22:56:41.452568+0000","last_peered":"2023-09-30T22:56:41.452568+0000","last_clean":"2023-09-30T22:56:41.452568+0000","last_became_active":"2023-09-30T22:56:40.436554+0000","last_became_peered":"2023-09-30T22:56:40.436554+0000","last_unstale":"2023-09-30T22:56:41.452568+0000","last_undegraded":"2023-09-30T22:56:41.452568+0000","last_fullsized":"2023-09-30T22:56:41.452568+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:48.094949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.447657+0000","last_change":"2023-09-30T22:56:41.447657+0000","last_active":"2023-09-30T22:56:41.447657+0000","last_peered":"2023-09-30T22:56:41.447657+0000","last_clean":"2023-09-30T22:56:41.447657+0000","last_became_active":"2023-09-30T22:56:41.446423+0000","last_became_peered":"2023-09-30T22:56:41.446423+0000","last_unstale":"2023-09-30T22:56:41.447657+0000","last_undegraded":"2023-09-30T22:56:41.447657+0000","last_fullsized":"2023-09-30T22:56:41.447657+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:15.192944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449279+0000","last_change":"2023-09-30T22:56:40.436331+0000","last_active":"2023-09-30T22:56:41.449279+0000","last_peered":"2023-09-30T22:56:41.449279+0000","last_clean":"2023-09-30T22:56:41.449279+0000","last_became_active":"2023-09-30T22:56:40.436116+0000","last_became_peered":"2023-09-30T22:56:40.436116+0000","last_unstale":"2023-09-30T22:56:41.449279+0000","last_undegraded":"2023-09-30T22:56:41.449279+0000","last_fullsized":"2023-09-30T22:56:41.449279+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:38.458388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.442757+0000","last_change":"2023-09-30T22:56:41.442757+0000","last_active":"2023-09-30T22:56:41.442757+0000","last_peered":"2023-09-30T22:56:41.442757+0000","last_clean":"2023-09-30T22:56:41.442757+0000","last_became_active":"2023-09-30T22:56:41.442445+0000","last_became_peered":"2023-09-30T22:56:41.442445+0000","last_unstale":"2023-09-30T22:56:41.442757+0000","last_undegraded":"2023-09-30T22:56:41.442757+0000","last_fullsized":"2023-09-30T22:56:41.442757+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:31:24.176015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.436841+0000","last_change":"2023-09-30T22:56:40.436191+0000","last_active":"2023-09-30T22:56:40.436841+0000","last_peered":"2023-09-30T22:56:40.436841+0000","last_clean":"2023-09-30T22:56:40.436841+0000","last_became_active":"2023-09-30T22:56:40.435633+0000","last_became_peered":"2023-09-30T22:56:40.435633+0000","last_unstale":"2023-09-30T22:56:40.436841+0000","last_undegraded":"2023-09-30T22:56:40.436841+0000","last_fullsized":"2023-09-30T22:56:40.436841+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:11.399142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.454053+0000","last_change":"2023-09-30T22:56:41.454053+0000","last_active":"2023-09-30T22:56:41.454053+0000","last_peered":"2023-09-30T22:56:41.454053+0000","last_clean":"2023-09-30T22:56:41.454053+0000","last_became_active":"2023-09-30T22:56:41.453567+0000","last_became_peered":"2023-09-30T22:56:41.453567+0000","last_unstale":"2023-09-30T22:56:41.454053+0000","last_undegraded":"2023-09-30T22:56:41.454053+0000","last_fullsized":"2023-09-30T22:56:41.454053+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:32.294167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.435923+0000","last_change":"2023-09-30T22:56:40.435468+0000","last_active":"2023-09-30T22:56:40.435923+0000","last_peered":"2023-09-30T22:56:40.435923+0000","last_clean":"2023-09-30T22:56:40.435923+0000","last_became_active":"2023-09-30T22:56:40.435255+0000","last_became_peered":"2023-09-30T22:56:40.435255+0000","last_unstale":"2023-09-30T22:56:40.435923+0000","last_undegraded":"2023-09-30T22:56:40.435923+0000","last_fullsized":"2023-09-30T22:56:40.435923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:23:05.888900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439592+0000","last_change":"2023-09-30T22:56:41.439592+0000","last_active":"2023-09-30T22:56:41.439592+0000","last_peered":"2023-09-30T22:56:41.439592+0000","last_clean":"2023-09-30T22:56:41.439592+0000","last_became_active":"2023-09-30T22:56:41.439361+0000","last_became_peered":"2023-09-30T22:56:41.439361+0000","last_unstale":"2023-09-30T22:56:41.439592+0000","last_undegraded":"2023-09-30T22:56:41.439592+0000","last_fullsized":"2023-09-30T22:56:41.439592+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:12.490413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.431130+0000","last_change":"2023-09-30T22:56:40.431051+0000","last_active":"2023-09-30T22:56:40.431130+0000","last_peered":"2023-09-30T22:56:40.431130+0000","last_clean":"2023-09-30T22:56:40.431130+0000","last_became_active":"2023-09-30T22:56:40.430816+0000","last_became_peered":"2023-09-30T22:56:40.430816+0000","last_unstale":"2023-09-30T22:56:40.431130+0000","last_undegraded":"2023-09-30T22:56:40.431130+0000","last_fullsized":"2023-09-30T22:56:40.431130+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:08.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.440109+0000","last_change":"2023-09-30T22:56:41.440109+0000","last_active":"2023-09-30T22:56:41.440109+0000","last_peered":"2023-09-30T22:56:41.440109+0000","last_clean":"2023-09-30T22:56:41.440109+0000","last_became_active":"2023-09-30T22:56:41.439897+0000","last_became_peered":"2023-09-30T22:56:41.439897+0000","last_unstale":"2023-09-30T22:56:41.440109+0000","last_undegraded":"2023-09-30T22:56:41.440109+0000","last_fullsized":"2023-09-30T22:56:41.440109+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:33.479643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.434078+0000","last_change":"2023-09-30T22:56:40.433983+0000","last_active":"2023-09-30T22:56:40.434078+0000","last_peered":"2023-09-30T22:56:40.434078+0000","last_clean":"2023-09-30T22:56:40.434078+0000","last_became_active":"2023-09-30T22:56:40.433730+0000","last_became_peered":"2023-09-30T22:56:40.433730+0000","last_unstale":"2023-09-30T22:56:40.434078+0000","last_undegraded":"2023-09-30T22:56:40.434078+0000","last_fullsized":"2023-09-30T22:56:40.434078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:10.005908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435533+0000","last_change":"2023-09-30T22:56:41.435533+0000","last_active":"2023-09-30T22:56:41.435533+0000","last_peered":"2023-09-30T22:56:41.435533+0000","last_clean":"2023-09-30T22:56:41.435533+0000","last_became_active":"2023-09-30T22:56:41.435272+0000","last_became_peered":"2023-09-30T22:56:41.435272+0000","last_unstale":"2023-09-30T22:56:41.435533+0000","last_undegraded":"2023-09-30T22:56:41.435533+0000","last_fullsized":"2023-09-30T22:56:41.435533+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:49.100722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.433999+0000","last_change":"2023-09-30T22:56:40.433926+0000","last_active":"2023-09-30T22:56:40.433999+0000","last_peered":"2023-09-30T22:56:40.433999+0000","last_clean":"2023-09-30T22:56:40.433999+0000","last_became_active":"2023-09-30T22:56:40.433667+0000","last_became_peered":"2023-09-30T22:56:40.433667+0000","last_unstale":"2023-09-30T22:56:40.433999+0000","last_undegraded":"2023-09-30T22:56:40.433999+0000","last_fullsized":"2023-09-30T22:56:40.433999+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:44:03.348022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.432345+0000","last_change":"2023-09-30T22:56:41.432345+0000","last_active":"2023-09-30T22:56:41.432345+0000","last_peered":"2023-09-30T22:56:41.432345+0000","last_clean":"2023-09-30T22:56:41.432345+0000","last_became_active":"2023-09-30T22:56:41.432017+0000","last_became_peered":"2023-09-30T22:56:41.432017+0000","last_unstale":"2023-09-30T22:56:41.432345+0000","last_undegraded":"2023-09-30T22:56:41.432345+0000","last_fullsized":"2023-09-30T22:56:41.432345+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:43.860840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.437634+0000","last_change":"2023-09-30T22:56:40.437538+0000","last_active":"2023-09-30T22:56:40.437634+0000","last_peered":"2023-09-30T22:56:40.437634+0000","last_clean":"2023-09-30T22:56:40.437634+0000","last_became_active":"2023-09-30T22:56:40.437309+0000","last_became_peered":"2023-09-30T22:56:40.437309+0000","last_unstale":"2023-09-30T22:56:40.437634+0000","last_undegraded":"2023-09-30T22:56:40.437634+0000","last_fullsized":"2023-09-30T22:56:40.437634+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:47.713557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.453473+0000","last_change":"2023-09-30T22:56:41.453473+0000","last_active":"2023-09-30T22:56:41.453473+0000","last_peered":"2023-09-30T22:56:41.453473+0000","last_clean":"2023-09-30T22:56:41.453473+0000","last_became_active":"2023-09-30T22:56:41.453226+0000","last_became_peered":"2023-09-30T22:56:41.453226+0000","last_unstale":"2023-09-30T22:56:41.453473+0000","last_undegraded":"2023-09-30T22:56:41.453473+0000","last_fullsized":"2023-09-30T22:56:41.453473+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:33:22.239572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.439243+0000","last_change":"2023-09-30T22:56:40.438158+0000","last_active":"2023-09-30T22:56:40.439243+0000","last_peered":"2023-09-30T22:56:40.439243+0000","last_clean":"2023-09-30T22:56:40.439243+0000","last_became_active":"2023-09-30T22:56:40.437942+0000","last_became_peered":"2023-09-30T22:56:40.437942+0000","last_unstale":"2023-09-30T22:56:40.439243+0000","last_undegraded":"2023-09-30T22:56:40.439243+0000","last_fullsized":"2023-09-30T22:56:40.439243+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:15.580218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.445557+0000","last_change":"2023-09-30T22:56:41.445557+0000","last_active":"2023-09-30T22:56:41.445557+0000","last_peered":"2023-09-30T22:56:41.445557+0000","last_clean":"2023-09-30T22:56:41.445557+0000","last_became_active":"2023-09-30T22:56:41.445343+0000","last_became_peered":"2023-09-30T22:56:41.445343+0000","last_unstale":"2023-09-30T22:56:41.445557+0000","last_undegraded":"2023-09-30T22:56:41.445557+0000","last_fullsized":"2023-09-30T22:56:41.445557+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:11.011681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435380+0000","last_change":"2023-09-30T22:56:40.437869+0000","last_active":"2023-09-30T22:56:41.435380+0000","last_peered":"2023-09-30T22:56:41.435380+0000","last_clean":"2023-09-30T22:56:41.435380+0000","last_became_active":"2023-09-30T22:56:40.437370+0000","last_became_peered":"2023-09-30T22:56:40.437370+0000","last_unstale":"2023-09-30T22:56:41.435380+0000","last_undegraded":"2023-09-30T22:56:41.435380+0000","last_fullsized":"2023-09-30T22:56:41.435380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:45:16.917806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.430025+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:56:40.430025+0000","last_peered":"2023-09-30T22:56:40.430025+0000","last_clean":"2023-09-30T22:56:40.430025+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:56:40.430025+0000","last_undegraded":"2023-09-30T22:56:40.430025+0000","last_fullsized":"2023-09-30T22:56:40.430025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451028+0000","last_change":"2023-09-30T22:56:41.451028+0000","last_active":"2023-09-30T22:56:41.451028+0000","last_peered":"2023-09-30T22:56:41.451028+0000","last_clean":"2023-09-30T22:56:41.451028+0000","last_became_active":"2023-09-30T22:56:41.450783+0000","last_became_peered":"2023-09-30T22:56:41.450783+0000","last_unstale":"2023-09-30T22:56:41.451028+0000","last_undegraded":"2023-09-30T22:56:41.451028+0000","last_fullsized":"2023-09-30T22:56:41.451028+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:54.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.445304+0000","last_change":"2023-09-30T22:56:40.437406+0000","last_active":"2023-09-30T22:56:41.445304+0000","last_peered":"2023-09-30T22:56:41.445304+0000","last_clean":"2023-09-30T22:56:41.445304+0000","last_became_active":"2023-09-30T22:56:40.436671+0000","last_became_peered":"2023-09-30T22:56:40.436671+0000","last_unstale":"2023-09-30T22:56:41.445304+0000","last_undegraded":"2023-09-30T22:56:41.445304+0000","last_fullsized":"2023-09-30T22:56:41.445304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:14.187171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.423764+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:56:40.423764+0000","last_peered":"2023-09-30T22:56:40.423764+0000","last_clean":"2023-09-30T22:56:40.423764+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:56:40.423764+0000","last_undegraded":"2023-09-30T22:56:40.423764+0000","last_fullsized":"2023-09-30T22:56:40.423764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.449333+0000","last_change":"2023-09-30T22:56:41.449333+0000","last_active":"2023-09-30T22:56:41.449333+0000","last_peered":"2023-09-30T22:56:41.449333+0000","last_clean":"2023-09-30T22:56:41.449333+0000","last_became_active":"2023-09-30T22:56:41.449069+0000","last_became_peered":"2023-09-30T22:56:41.449069+0000","last_unstale":"2023-09-30T22:56:41.449333+0000","last_undegraded":"2023-09-30T22:56:41.449333+0000","last_fullsized":"2023-09-30T22:56:41.449333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:48:45.841565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.427325+0000","last_change":"2023-09-30T22:56:40.426699+0000","last_active":"2023-09-30T22:56:40.427325+0000","last_peered":"2023-09-30T22:56:40.427325+0000","last_clean":"2023-09-30T22:56:40.427325+0000","last_became_active":"2023-09-30T22:56:40.426461+0000","last_became_peered":"2023-09-30T22:56:40.426461+0000","last_unstale":"2023-09-30T22:56:40.427325+0000","last_undegraded":"2023-09-30T22:56:40.427325+0000","last_fullsized":"2023-09-30T22:56:40.427325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:40.020109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.428916+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:56:40.428916+0000","last_peered":"2023-09-30T22:56:40.428916+0000","last_clean":"2023-09-30T22:56:40.428916+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:56:40.428916+0000","last_undegraded":"2023-09-30T22:56:40.428916+0000","last_fullsized":"2023-09-30T22:56:40.428916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.444249+0000","last_change":"2023-09-30T22:56:41.444249+0000","last_active":"2023-09-30T22:56:41.444249+0000","last_peered":"2023-09-30T22:56:41.444249+0000","last_clean":"2023-09-30T22:56:41.444249+0000","last_became_active":"2023-09-30T22:56:41.444030+0000","last_became_peered":"2023-09-30T22:56:41.444030+0000","last_unstale":"2023-09-30T22:56:41.444249+0000","last_undegraded":"2023-09-30T22:56:41.444249+0000","last_fullsized":"2023-09-30T22:56:41.444249+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:22:05.962225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.439101+0000","last_change":"2023-09-30T22:56:40.439000+0000","last_active":"2023-09-30T22:56:40.439101+0000","last_peered":"2023-09-30T22:56:40.439101+0000","last_clean":"2023-09-30T22:56:40.439101+0000","last_became_active":"2023-09-30T22:56:40.438724+0000","last_became_peered":"2023-09-30T22:56:40.438724+0000","last_unstale":"2023-09-30T22:56:40.439101+0000","last_undegraded":"2023-09-30T22:56:40.439101+0000","last_fullsized":"2023-09-30T22:56:40.439101+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:06.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424067+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:56:40.424067+0000","last_peered":"2023-09-30T22:56:40.424067+0000","last_clean":"2023-09-30T22:56:40.424067+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:56:40.424067+0000","last_undegraded":"2023-09-30T22:56:40.424067+0000","last_fullsized":"2023-09-30T22:56:40.424067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.431420+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:56:40.431420+0000","last_peered":"2023-09-30T22:56:40.431420+0000","last_clean":"2023-09-30T22:56:40.431420+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:56:40.431420+0000","last_undegraded":"2023-09-30T22:56:40.431420+0000","last_fullsized":"2023-09-30T22:56:40.431420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.439430+0000","last_change":"2023-09-30T22:56:41.439430+0000","last_active":"2023-09-30T22:56:41.439430+0000","last_peered":"2023-09-30T22:56:41.439430+0000","last_clean":"2023-09-30T22:56:41.439430+0000","last_became_active":"2023-09-30T22:56:41.439203+0000","last_became_peered":"2023-09-30T22:56:41.439203+0000","last_unstale":"2023-09-30T22:56:41.439430+0000","last_undegraded":"2023-09-30T22:56:41.439430+0000","last_fullsized":"2023-09-30T22:56:41.439430+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:39.464161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.432029+0000","last_change":"2023-09-30T22:56:40.431939+0000","last_active":"2023-09-30T22:56:40.432029+0000","last_peered":"2023-09-30T22:56:40.432029+0000","last_clean":"2023-09-30T22:56:40.432029+0000","last_became_active":"2023-09-30T22:56:40.431188+0000","last_became_peered":"2023-09-30T22:56:40.431188+0000","last_unstale":"2023-09-30T22:56:40.432029+0000","last_undegraded":"2023-09-30T22:56:40.432029+0000","last_fullsized":"2023-09-30T22:56:40.432029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:26:47.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424273+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:56:40.424273+0000","last_peered":"2023-09-30T22:56:40.424273+0000","last_clean":"2023-09-30T22:56:40.424273+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:56:40.424273+0000","last_undegraded":"2023-09-30T22:56:40.424273+0000","last_fullsized":"2023-09-30T22:56:40.424273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.443877+0000","last_change":"2023-09-30T22:56:41.443877+0000","last_active":"2023-09-30T22:56:41.443877+0000","last_peered":"2023-09-30T22:56:41.443877+0000","last_clean":"2023-09-30T22:56:41.443877+0000","last_became_active":"2023-09-30T22:56:41.443285+0000","last_became_peered":"2023-09-30T22:56:41.443285+0000","last_unstale":"2023-09-30T22:56:41.443877+0000","last_undegraded":"2023-09-30T22:56:41.443877+0000","last_fullsized":"2023-09-30T22:56:41.443877+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:06:38.535366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.435749+0000","last_change":"2023-09-30T22:56:40.435669+0000","last_active":"2023-09-30T22:56:40.435749+0000","last_peered":"2023-09-30T22:56:40.435749+0000","last_clean":"2023-09-30T22:56:40.435749+0000","last_became_active":"2023-09-30T22:56:40.435431+0000","last_became_peered":"2023-09-30T22:56:40.435431+0000","last_unstale":"2023-09-30T22:56:40.435749+0000","last_undegraded":"2023-09-30T22:56:40.435749+0000","last_fullsized":"2023-09-30T22:56:40.435749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:19.257371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424199+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:56:40.424199+0000","last_peered":"2023-09-30T22:56:40.424199+0000","last_clean":"2023-09-30T22:56:40.424199+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:56:40.424199+0000","last_undegraded":"2023-09-30T22:56:40.424199+0000","last_fullsized":"2023-09-30T22:56:40.424199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.441548+0000","last_change":"2023-09-30T22:56:41.441548+0000","last_active":"2023-09-30T22:56:41.441548+0000","last_peered":"2023-09-30T22:56:41.441548+0000","last_clean":"2023-09-30T22:56:41.441548+0000","last_became_active":"2023-09-30T22:56:41.440916+0000","last_became_peered":"2023-09-30T22:56:41.440916+0000","last_unstale":"2023-09-30T22:56:41.441548+0000","last_undegraded":"2023-09-30T22:56:41.441548+0000","last_fullsized":"2023-09-30T22:56:41.441548+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:19.412534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"90'1","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.434454+0000","last_change":"2023-09-30T22:56:40.436118+0000","last_active":"2023-09-30T22:56:41.434454+0000","last_peered":"2023-09-30T22:56:41.434454+0000","last_clean":"2023-09-30T22:56:41.434454+0000","last_became_active":"2023-09-30T22:56:40.435906+0000","last_became_peered":"2023-09-30T22:56:40.435906+0000","last_unstale":"2023-09-30T22:56:41.434454+0000","last_undegraded":"2023-09-30T22:56:41.434454+0000","last_fullsized":"2023-09-30T22:56:41.434454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:49:45.123533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.424543+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:56:40.424543+0000","last_peered":"2023-09-30T22:56:40.424543+0000","last_clean":"2023-09-30T22:56:40.424543+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:56:40.424543+0000","last_undegraded":"2023-09-30T22:56:40.424543+0000","last_fullsized":"2023-09-30T22:56:40.424543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.435199+0000","last_change":"2023-09-30T22:56:41.435199+0000","last_active":"2023-09-30T22:56:41.435199+0000","last_peered":"2023-09-30T22:56:41.435199+0000","last_clean":"2023-09-30T22:56:41.435199+0000","last_became_active":"2023-09-30T22:56:41.434877+0000","last_became_peered":"2023-09-30T22:56:41.434877+0000","last_unstale":"2023-09-30T22:56:41.435199+0000","last_undegraded":"2023-09-30T22:56:41.435199+0000","last_fullsized":"2023-09-30T22:56:41.435199+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:40.415630+0000","last_clean_scrub_stamp":"2023-09-30T22:56:40.415630+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:14.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"90'2","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-09-30T22:56:41.451109+0000","last_change":"2023-09-30T22:56:40.435362+0000","last_active":"2023-09-30T22:56:41.451109+0000","last_peered":"2023-09-30T22:56:41.451109+0000","last_clean":"2023-09-30T22:56:41.451109+0000","last_became_active":"2023-09-30T22:56:40.435132+0000","last_became_peered":"2023-09-30T22:56:40.435132+0000","last_unstale":"2023-09-30T22:56:41.451109+0000","last_undegraded":"2023-09-30T22:56:41.451109+0000","last_fullsized":"2023-09-30T22:56:41.451109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:56:39.409858+0000","last_clean_scrub_stamp":"2023-09-30T22:56:39.409858+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:40.338672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-09-30T22:56:40.423697+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:56:40.423697+0000","last_peered":"2023-09-30T22:56:40.423697+0000","last_clean":"2023-09-30T22:56:40.423697+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:56:40.423697+0000","last_undegraded":"2023-09-30T22:56:40.423697+0000","last_fullsized":"2023-09-30T22:56:40.423697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194814,"statfs":{"total":200000000,"available":199490249,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96599999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65900000000000003,"15min":0.64500000000000002},"min":{"1min":0.52800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65200000000000002,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68100000000000005,"15min":0.66100000000000003},"min":{"1min":0.61899999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.91300000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71599999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.68999999999999995,"15min":0.67300000000000004},"min":{"1min":0.57899999999999996,"5min":0.44,"15min":0.44},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95399999999999996,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.55500000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.70299999999999996,"15min":0.67600000000000005},"min":{"1min":0.61599999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0049999999999999,"5min":1.056,"15min":1.056},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76100000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.59299999999999997},"min":{"1min":0.42199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82899999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.46000000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":1.135,"15min":1.135},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89500000000000002,"5min":1.004,"15min":1.004},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.55200000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.871,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.071},"last":0.73799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194814,"statfs":{"total":200000000,"available":199490229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":1.014},"min":{"1min":0.44,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.93999999999999995,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.80700000000000005},"min":{"1min":0.46300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84599999999999997,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.83999999999999997},"min":{"1min":0.48199999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.96599999999999997,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.92100000000000004,"15min":1.0489999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96599999999999997,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.67100000000000004}]},{"osd":2,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78900000000000003,"15min":0.82199999999999995},"min":{"1min":0.503,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91000000000000003,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.88600000000000001,"15min":1.054},"min":{"1min":0.52000000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0389999999999999,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.873}]},{"osd":3,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.89100000000000001,"15min":0.97499999999999998},"min":{"1min":0.53500000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91400000000000003,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93300000000000005,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.89300000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66000000000000003,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1399999999999999,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.5},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71099999999999997,"15min":0.66700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.65200000000000002},"min":{"1min":0.50900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83899999999999997,"5min":1.321,"15min":1.321},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.70099999999999996},"min":{"1min":0.48199999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1579999999999999,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.624},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92100000000000004,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1075,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194237,"statfs":{"total":200000000,"available":198898935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.40100000000000002},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46999999999999997,"15min":0.45100000000000001},"min":{"1min":0.39200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.432},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.61899999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.46500000000000002},"min":{"1min":0.438,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53800000000000003,"15min":0.51300000000000001},"min":{"1min":0.49099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.5,"15min":0.46999999999999997},"min":{"1min":0.45100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.442}]},{"osd":4,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.50800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":0.995,"15min":0.995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.66200000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.0429999999999999,"5min":1.097,"15min":1.097},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.095,"5min":1.22,"15min":1.22},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.60199999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97799999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.61799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99399999999999999,"5min":1.21,"15min":1.21},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78500000000000003,"15min":0.75700000000000001},"min":{"1min":0.67500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.022,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199490851,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.41699999999999998},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61499999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.35999999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.52800000000000002,"15min":0.50800000000000001},"min":{"1min":0.49299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76200000000000001,"5min":0.879,"15min":0.879},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.42599999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.61899999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.374},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.47599999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.72399999999999998,"15min":0.69999999999999996},"min":{"1min":0.66800000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0209999999999999,"5min":1.27,"15min":1.27},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58099999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.73899999999999999,"15min":0.71799999999999997},"min":{"1min":0.68100000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.72699999999999998,"15min":0.70699999999999996},"min":{"1min":0.67700000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92500000000000004,"5min":1.119,"15min":1.119},"last":0.755}]},{"osd":6,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.69399999999999995,"5min":0.434,"15min":0.434},"max":{"1min":0.98599999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.748,"15min":0.72399999999999998},"min":{"1min":0.70799999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0449999999999999,"5min":1.129,"15min":1.129},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.75900000000000001,"15min":0.72499999999999998},"min":{"1min":0.73699999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.125,"5min":1.173,"15min":1.173},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.628,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0780000000000001,"5min":1.21,"15min":1.21},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":497,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194815,"statfs":{"total":200000000,"available":199490873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.371},"min":{"1min":0.27900000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.438,"15min":0.41899999999999998},"min":{"1min":0.34000000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69499999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.313}]},{"osd":1,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.372},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.51200000000000001,"15min":0.49199999999999999},"min":{"1min":0.499,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74299999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.46000000000000002,"15min":0.44400000000000001},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.748,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51000000000000001,"15min":0.497},"min":{"1min":0.434,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76200000000000001,"15min":0.748},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.006,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93799999999999994,"5min":1.179,"15min":1.179},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.63800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90800000000000003,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.60599999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.77400000000000002},"min":{"1min":0.60799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99399999999999999,"5min":1.615,"15min":1.615},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89700000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.57299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":498,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194813,"statfs":{"total":200000000,"available":199489233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.39700000000000002},"min":{"1min":0.35699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.61699999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.309},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.49099999999999999,"15min":0.52000000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":1.919,"15min":1.919},"last":0.36099999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70999999999999996,"5min":1.254,"15min":1.254},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.48699999999999999,"15min":0.46700000000000003},"min":{"1min":0.42399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52900000000000003,"15min":0.53600000000000003},"min":{"1min":0.45100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.46899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80400000000000005,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.60299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0249999999999999,"5min":1.401,"15min":1.401},"last":0.623},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78600000000000003,"15min":0.75800000000000001},"min":{"1min":0.65000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0620000000000001,"5min":3.306,"15min":3.306},"last":0.66200000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.755,"15min":0.751},"min":{"1min":0.61399999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95399999999999996,"5min":1.508,"15min":1.508},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.129,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0800000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.60499999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0960000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:56:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.72999999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.145,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1970000000000001,"5min":1.573,"15min":1.573},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194822,"statfs":{"total":200000000,"available":199497989,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.61399999999999999,"15min":0.56799999999999995},"min":{"1min":0.496,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.87,"5min":1.022,"15min":1.022},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.626,"15min":0.58599999999999997},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64100000000000001,"15min":0.60099999999999998},"min":{"1min":0.53000000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.49099999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.502}]},{"osd":2,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.5,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":1.006,"15min":1.006},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.67300000000000004},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.97899999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.58599999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71699999999999997,"15min":0.68799999999999994},"min":{"1min":0.53800000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63300000000000001,"15min":0.65700000000000003},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.52100000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.626}]},{"osd":6,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89400000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.874,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46999999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92100000000000004,"5min":1.044,"15min":1.044},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1073,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.624,"15min":0.59299999999999997},"min":{"1min":0.48099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.65500000000000003,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.69099999999999995,"15min":0.65400000000000003},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68700000000000006,"15min":0.65600000000000003},"min":{"1min":0.55900000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91400000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.628},"min":{"1min":0.56000000000000005,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.66700000000000004,"15min":0.64500000000000002},"min":{"1min":0.51600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66100000000000003,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96199999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.68000000000000005,"15min":0.64400000000000002},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.94699999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69899999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.629,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81200000000000006,"5min":0.878,"15min":0.878},"last":0.71499999999999997}]},{"osd":6,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68100000000000005,"15min":0.66900000000000004},"min":{"1min":0.50600000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78400000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.55100000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.92700000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0129999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79900000000000004}]}]}],"pool_statfs":[]}} 2023-09-30T22:56:46.252 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:56:46.253 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T22:56:46.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.481+0000 7f4b3adff700 1 Processor -- start 2023-09-30T22:56:46.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.481+0000 7f4b3adff700 1 -- start start 2023-09-30T22:56:46.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3adff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b34159ba0 0x7f4b3406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3adff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b340ca5e0 0x7f4b340681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3adff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b34067d10 con 0x7f4b340b0de0 2023-09-30T22:56:46.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3adff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3406af90 con 0x7f4b340ca5e0 2023-09-30T22:56:46.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3adff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340676c0 con 0x7f4b34159ba0 2023-09-30T22:56:46.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3939c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b340ca5e0 0x7f4b340681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3939c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b340ca5e0 0x7f4b340681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42904/0 (socket says 172.21.15.142:42904) 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.482+0000 7f4b3939c700 1 -- 172.21.15.142:0/1385456168 learned_addr learned my addr 172.21.15.142:0/1385456168 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b38b9b700 1 --2- 172.21.15.142:0/1385456168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b34159ba0 0x7f4b3406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b3939c700 1 -- 172.21.15.142:0/1385456168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b34159ba0 msgr2=0x7f4b3406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b3939c700 1 --2- 172.21.15.142:0/1385456168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b34159ba0 0x7f4b3406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b3939c700 1 -- 172.21.15.142:0/1385456168 >> v1:172.21.15.148:6789/0 conn(0x7f4b340b0de0 legacy=0x7f4b340c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b3939c700 1 -- 172.21.15.142:0/1385456168 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340679a0 con 0x7f4b340ca5e0 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b3939c700 1 --2- 172.21.15.142:0/1385456168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b340ca5e0 0x7f4b340681a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0099b0 tx=0x7f4b2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcc53091f91013d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b337fe700 1 -- 172.21.15.142:0/1385456168 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00b860 con 0x7f4b340ca5e0 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b337fe700 1 -- 172.21.15.142:0/1385456168 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00b9c0 con 0x7f4b340ca5e0 2023-09-30T22:56:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.483+0000 7f4b337fe700 1 -- 172.21.15.142:0/1385456168 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00bd60 con 0x7f4b340ca5e0 2023-09-30T22:56:46.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 -- 172.21.15.142:0/1385456168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b340ca5e0 msgr2=0x7f4b340681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1385456168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b340ca5e0 0x7f4b340681a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0099b0 tx=0x7f4b2c009250 comp rx=0 tx=0).stop 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 -- 172.21.15.142:0/1385456168 shutdown_connections 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1385456168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b340ca5e0 0x7f4b340681a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1385456168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b34159ba0 0x7f4b3406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 -- 172.21.15.142:0/1385456168 >> 172.21.15.142:0/1385456168 conn(0x7f4b340cb2f0 msgr2=0x7f4b340cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 -- 172.21.15.142:0/1385456168 shutdown_connections 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.484+0000 7f4b3adff700 1 -- 172.21.15.142:0/1385456168 wait complete. 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.485+0000 7f4b3adff700 1 Processor -- start 2023-09-30T22:56:46.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.486+0000 7f4b3adff700 1 -- start start 2023-09-30T22:56:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.486+0000 7f4b3adff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b340b0de0 0x7f4b3414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.486+0000 7f4b3adff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b340ca5e0 0x7f4b340cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.486+0000 7f4b3adff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b34159ba0 0x7f4b340ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.486+0000 7f4b3adff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c93a0 con 0x7f4b34159ba0 2023-09-30T22:56:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.486+0000 7f4b3adff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c83d0 con 0x7f4b340b0de0 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.486+0000 7f4b3adff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3416e0a0 con 0x7f4b340ca5e0 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b34159ba0 0x7f4b340ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b34159ba0 0x7f4b340ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42906/0 (socket says 172.21.15.142:42906) 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 -- 172.21.15.142:0/1878310006 learned_addr learned my addr 172.21.15.142:0/1878310006 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b38b9b700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b340b0de0 0x7f4b3414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b33fff700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b340ca5e0 0x7f4b340cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 -- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b340ca5e0 msgr2=0x7f4b340cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b340ca5e0 0x7f4b340cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 -- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b340b0de0 msgr2=0x7f4b3414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b340b0de0 0x7f4b3414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 -- 172.21.15.142:0/1878310006 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0094f0 con 0x7f4b34159ba0 2023-09-30T22:56:46.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.487+0000 7f4b3939c700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b34159ba0 0x7f4b340ce140 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4b3406c8d0 tx=0x7f4b2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.488+0000 7f4b30ff9700 1 -- 172.21.15.142:0/1878310006 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c01a630 con 0x7f4b34159ba0 2023-09-30T22:56:46.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.488+0000 7f4b30ff9700 1 -- 172.21.15.142:0/1878310006 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c01a7b0 con 0x7f4b34159ba0 2023-09-30T22:56:46.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.488+0000 7f4b30ff9700 1 -- 172.21.15.142:0/1878310006 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c01ab70 con 0x7f4b34159ba0 2023-09-30T22:56:46.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.488+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3416d770 con 0x7f4b34159ba0 2023-09-30T22:56:46.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.488+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3416dd30 con 0x7f4b34159ba0 2023-09-30T22:56:46.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.489+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3406e4b0 con 0x7f4b34159ba0 2023-09-30T22:56:46.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.490+0000 7f4b30ff9700 1 -- 172.21.15.142:0/1878310006 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4b2c02d440 con 0x7f4b34159ba0 2023-09-30T22:56:46.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.490+0000 7f4b30ff9700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4b18067330 0x7f4b180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.490+0000 7f4b30ff9700 1 -- 172.21.15.142:0/1878310006 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b2c086870 con 0x7f4b34159ba0 2023-09-30T22:56:46.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.491+0000 7f4b38b9b700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4b18067330 0x7f4b180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.491+0000 7f4b38b9b700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4b18067330 0x7f4b180697e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4b280074f0 tx=0x7f4b28009700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.495+0000 7f4b30ff9700 1 -- 172.21.15.142:0/1878310006 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4b2c053770 con 0x7f4b34159ba0 2023-09-30T22:56:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.758+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4b340cac40 con 0x7f4b34159ba0 2023-09-30T22:56:46.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.764+0000 7f4b30ff9700 1 -- 172.21.15.142:0/1878310006 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4b2c056d90 con 0x7f4b34159ba0 2023-09-30T22:56:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4b18067330 msgr2=0x7f4b180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4b18067330 0x7f4b180697e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4b280074f0 tx=0x7f4b28009700 comp rx=0 tx=0).stop 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b34159ba0 msgr2=0x7f4b340ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b34159ba0 0x7f4b340ce140 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4b3406c8d0 tx=0x7f4b2c017000 comp rx=0 tx=0).stop 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 shutdown_connections 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4b18067330 0x7f4b180697e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b34159ba0 0x7f4b340ce140 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b340b0de0 0x7f4b3414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 --2- 172.21.15.142:0/1878310006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4b340ca5e0 0x7f4b340cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 >> 172.21.15.142:0/1878310006 conn(0x7f4b340cb2f0 msgr2=0x7f4b34158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 shutdown_connections 2023-09-30T22:56:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.766+0000 7f4b3adff700 1 -- 172.21.15.142:0/1878310006 wait complete. 2023-09-30T22:56:46.769 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T22:56:46.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:46.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.973+0000 7f91e53ff700 1 Processor -- start 2023-09-30T22:56:46.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.973+0000 7f91e53ff700 1 -- start start 2023-09-30T22:56:46.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.974+0000 7f91e53ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00692f0 0x7f91e015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.974+0000 7f91e53ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e015e0b0 con 0x7f91e015dc50 2023-09-30T22:56:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.974+0000 7f91e53ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00cc6b0 con 0x7f91e0143350 2023-09-30T22:56:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.974+0000 7f91e53ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00cbaa0 con 0x7f91e00692f0 2023-09-30T22:56:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91df7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f91e015dc50 0x7f91e006a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55910/0 (socket says 172.21.15.142:55910) 2023-09-30T22:56:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91df7fe700 1 -- 172.21.15.142:0/2257495926 learned_addr learned my addr 172.21.15.142:0/2257495926 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91de7fc700 1 --2- 172.21.15.142:0/2257495926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00692f0 0x7f91e015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91ddffb700 1 -- 172.21.15.142:0/2257495926 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506672027 0 0) 0x7f91d8001490 con 0x7f91e015dc50 2023-09-30T22:56:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91ddffb700 1 -- 172.21.15.142:0/2257495926 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c8003570 con 0x7f91e015dc50 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91ddffb700 1 -- 172.21.15.142:0/2257495926 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928087459 0 0) 0x7f91e00cc6b0 con 0x7f91e0143350 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91ddffb700 1 -- 172.21.15.142:0/2257495926 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d8001490 con 0x7f91e0143350 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91de7fc700 1 -- 172.21.15.142:0/2257495926 >> v1:172.21.15.148:6789/0 conn(0x7f91e0143350 legacy=0x7f91e00cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91de7fc700 1 -- 172.21.15.142:0/2257495926 >> v1:172.21.15.142:6789/0 conn(0x7f91e015dc50 legacy=0x7f91e006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.975+0000 7f91de7fc700 1 -- 172.21.15.142:0/2257495926 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00cbd80 con 0x7f91e00692f0 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91de7fc700 1 --2- 172.21.15.142:0/2257495926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00692f0 0x7f91e015d710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009910 tx=0x7f91d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e78fc0b5ff2e9645 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91ddffb700 1 -- 172.21.15.142:0/2257495926 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4011630 con 0x7f91e00692f0 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91ddffb700 1 -- 172.21.15.142:0/2257495926 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4011790 con 0x7f91e00692f0 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91ddffb700 1 -- 172.21.15.142:0/2257495926 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4011b30 con 0x7f91e00692f0 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91e53ff700 1 -- 172.21.15.142:0/2257495926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00692f0 msgr2=0x7f91e015d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2257495926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00692f0 0x7f91e015d710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009910 tx=0x7f91d40091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91e53ff700 1 -- 172.21.15.142:0/2257495926 shutdown_connections 2023-09-30T22:56:46.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2257495926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00692f0 0x7f91e015d710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91e53ff700 1 -- 172.21.15.142:0/2257495926 >> 172.21.15.142:0/2257495926 conn(0x7f91e00ce8e0 msgr2=0x7f91e00cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:46.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91e53ff700 1 -- 172.21.15.142:0/2257495926 shutdown_connections 2023-09-30T22:56:46.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.976+0000 7f91e53ff700 1 -- 172.21.15.142:0/2257495926 wait complete. 2023-09-30T22:56:46.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.978+0000 7f91e53ff700 1 Processor -- start 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.978+0000 7f91e53ff700 1 -- start start 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91e53ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e00692f0 0x7f91e00b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91e53ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0143350 0x7f91e013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91e53ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e015dc50 0x7f91e013c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91e53ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00b3340 con 0x7f91e0143350 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91e53ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00b3620 con 0x7f91e00692f0 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91e53ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00b3900 con 0x7f91e015dc50 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91de7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0143350 0x7f91e013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91de7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0143350 0x7f91e013c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42918/0 (socket says 172.21.15.142:42918) 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91de7fc700 1 -- 172.21.15.142:0/2545036681 learned_addr learned my addr 172.21.15.142:0/2545036681 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91deffd700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e00692f0 0x7f91e00b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91df7fe700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e015dc50 0x7f91e013c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91de7fc700 1 -- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e015dc50 msgr2=0x7f91e013c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.979+0000 7f91de7fc700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e015dc50 0x7f91e013c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91de7fc700 1 -- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e00692f0 msgr2=0x7f91e00b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91de7fc700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e00692f0 0x7f91e00b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91de7fc700 1 -- 172.21.15.142:0/2545036681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4009420 con 0x7f91e0143350 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91de7fc700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0143350 0x7f91e013c3b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009f00 tx=0x7f91d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91c6ffd700 1 -- 172.21.15.142:0/2545036681 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d401f070 con 0x7f91e0143350 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91c6ffd700 1 -- 172.21.15.142:0/2545036681 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4002f70 con 0x7f91e0143350 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e00b3be0 con 0x7f91e0143350 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91c6ffd700 1 -- 172.21.15.142:0/2545036681 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4011900 con 0x7f91e0143350 2023-09-30T22:56:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.980+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e015ab90 con 0x7f91e0143350 2023-09-30T22:56:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.981+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e00b4100 con 0x7f91e0143350 2023-09-30T22:56:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.982+0000 7f91c6ffd700 1 -- 172.21.15.142:0/2545036681 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f91d4023070 con 0x7f91e0143350 2023-09-30T22:56:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.983+0000 7f91c6ffd700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.983+0000 7f91c6ffd700 1 -- 172.21.15.142:0/2545036681 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f91d4085ef0 con 0x7f91e0143350 2023-09-30T22:56:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.984+0000 7f91deffd700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.984+0000 7f91deffd700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91e00b4570 tx=0x7f91d0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:46.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:46.988+0000 7f91c6ffd700 1 -- 172.21.15.142:0/2545036681 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f91e00b4100 con 0x7f91e0143350 2023-09-30T22:56:47.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.221+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91e00b4100 con 0x7f91e0143350 2023-09-30T22:56:47.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.222+0000 7f91c6ffd700 1 -- 172.21.15.142:0/2545036681 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f91e00b4100 con 0x7f91e0143350 2023-09-30T22:56:47.223 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:47.223 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:56:40.902309+0000","modified":"2023-09-30T22:56:44.449514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3908259553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3908259553},{"type":"v1","addr":"172.21.15.148:6835","nonce":3908259553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 msgr2=0x7f91cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91e00b4570 tx=0x7f91d0007d50 comp rx=0 tx=0).stop 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0143350 msgr2=0x7f91e013c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0143350 0x7f91e013c3b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009f00 tx=0x7f91d4017000 comp rx=0 tx=0).stop 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 shutdown_connections 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e015dc50 0x7f91e013c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e00692f0 0x7f91e00b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.224+0000 7f91e53ff700 1 --2- 172.21.15.142:0/2545036681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0143350 0x7f91e013c3b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.225+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 >> 172.21.15.142:0/2545036681 conn(0x7f91e00ce8e0 msgr2=0x7f91e00c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:47.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.225+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 shutdown_connections 2023-09-30T22:56:47.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.225+0000 7f91e53ff700 1 -- 172.21.15.142:0/2545036681 wait complete. 2023-09-30T22:56:47.227 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 41 2023-09-30T22:56:47.645 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:56:40.902309+0000', 'modified': '2023-09-30T22:56:44.449514+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6135}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6135': {'gid': 6135, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6835/3908259553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6833', 'nonce': 3908259553}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 3908259553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:56:47.646 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:56:47.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-30T22:56:47.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.836+0000 7fabd95ff700 1 Processor -- start 2023-09-30T22:56:47.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.836+0000 7fabd95ff700 1 -- start start 2023-09-30T22:56:47.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.837+0000 7fabd95ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabd40692f0 0x7fabd415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.837+0000 7fabd95ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fabd415dc50 0x7fabd406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.837+0000 7fabd95ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd40cc6b0 con 0x7fabd4143350 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.837+0000 7fabd95ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd415e050 con 0x7fabd40692f0 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.837+0000 7fabd95ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40cbaa0 con 0x7fabd415dc50 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabd40692f0 0x7fabd415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabd40692f0 0x7fabd415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42928/0 (socket says 172.21.15.142:42928) 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 -- 172.21.15.142:0/1180186777 learned_addr learned my addr 172.21.15.142:0/1180186777 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:47.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd37fe700 1 --2- 172.21.15.142:0/1180186777 >> v2:172.21.15.148:3300/0 conn(0x7fabd415dc50 0x7fabd406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 -- 172.21.15.142:0/1180186777 >> v2:172.21.15.148:3300/0 conn(0x7fabd415dc50 msgr2=0x7fabd406a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 --2- 172.21.15.142:0/1180186777 >> v2:172.21.15.148:3300/0 conn(0x7fabd415dc50 0x7fabd406a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 -- 172.21.15.142:0/1180186777 >> v1:172.21.15.148:6789/0 conn(0x7fabd4143350 legacy=0x7fabd40cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 -- 172.21.15.142:0/1180186777 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40cbd80 con 0x7fabd40692f0 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.838+0000 7fabd27fc700 1 --2- 172.21.15.142:0/1180186777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd40692f0 0x7fabd415d710 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fabd4069cf0 tx=0x7fabc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89783760414c05b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd1ffb700 1 -- 172.21.15.142:0/1180186777 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8009e70 con 0x7fabd40692f0 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd1ffb700 1 -- 172.21.15.142:0/1180186777 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800b860 con 0x7fabd40692f0 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd1ffb700 1 -- 172.21.15.142:0/1180186777 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800bc00 con 0x7fabd40692f0 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 -- 172.21.15.142:0/1180186777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd40692f0 msgr2=0x7fabd415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 --2- 172.21.15.142:0/1180186777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd40692f0 0x7fabd415d710 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fabd4069cf0 tx=0x7fabc8009250 comp rx=0 tx=0).stop 2023-09-30T22:56:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 -- 172.21.15.142:0/1180186777 shutdown_connections 2023-09-30T22:56:47.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 --2- 172.21.15.142:0/1180186777 >> v2:172.21.15.148:3300/0 conn(0x7fabd415dc50 0x7fabd406a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 --2- 172.21.15.142:0/1180186777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd40692f0 0x7fabd415d710 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 -- 172.21.15.142:0/1180186777 >> 172.21.15.142:0/1180186777 conn(0x7fabd40ce8e0 msgr2=0x7fabd40cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:47.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 -- 172.21.15.142:0/1180186777 shutdown_connections 2023-09-30T22:56:47.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.839+0000 7fabd95ff700 1 -- 172.21.15.142:0/1180186777 wait complete. 2023-09-30T22:56:47.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.841+0000 7fabd95ff700 1 Processor -- start 2023-09-30T22:56:47.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.841+0000 7fabd95ff700 1 -- start start 2023-09-30T22:56:47.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd95ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabd40692f0 0x7fabd40a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd95ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd4143350 0x7fabd40b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd95ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabd415dc50 0x7fabd415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd95ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40b1330 con 0x7fabd4143350 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd95ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd415a1c0 con 0x7fabd415dc50 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd95ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd415ad40 con 0x7fabd40692f0 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd4143350 0x7fabd40b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd4143350 0x7fabd40b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42940/0 (socket says 172.21.15.142:42940) 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd27fc700 1 -- 172.21.15.142:0/278738034 learned_addr learned my addr 172.21.15.142:0/278738034 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd37fe700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabd415dc50 0x7fabd415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabd40692f0 0x7fabd40a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd27fc700 1 -- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabd40692f0 msgr2=0x7fabd40a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd27fc700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabd40692f0 0x7fabd40a7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd27fc700 1 -- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabd415dc50 msgr2=0x7fabd415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.842+0000 7fabd27fc700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabd415dc50 0x7fabd415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.843+0000 7fabd27fc700 1 -- 172.21.15.142:0/278738034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80094f0 con 0x7fabd4143350 2023-09-30T22:56:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.843+0000 7fabd27fc700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd4143350 0x7fabd40b0df0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fabd4063f80 tx=0x7fabc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.843+0000 7fabbaffd700 1 -- 172.21.15.142:0/278738034 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800bbe0 con 0x7fabd4143350 2023-09-30T22:56:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.843+0000 7fabbaffd700 1 -- 172.21.15.142:0/278738034 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8011420 con 0x7fabd4143350 2023-09-30T22:56:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.843+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd415cef0 con 0x7fabd4143350 2023-09-30T22:56:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.843+0000 7fabbaffd700 1 -- 172.21.15.142:0/278738034 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80117c0 con 0x7fabd4143350 2023-09-30T22:56:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.843+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd415a6f0 con 0x7fabd4143350 2023-09-30T22:56:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.845+0000 7fabbaffd700 1 -- 172.21.15.142:0/278738034 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fabc8011bf0 con 0x7fabd4143350 2023-09-30T22:56:47.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.846+0000 7fabbaffd700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc0067330 0x7fabc00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.847+0000 7fabbaffd700 1 -- 172.21.15.142:0/278738034 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fabc80860a0 con 0x7fabd4143350 2023-09-30T22:56:47.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.847+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc0067330 0x7fabc00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.847+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc0067330 0x7fabc00697e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fabc4003a80 tx=0x7fabc4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.848+0000 7fabe7c9fb80 1 Processor -- start 2023-09-30T22:56:47.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.848+0000 7fabe7c9fb80 1 -- start start 2023-09-30T22:56:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.849+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 0x55f63da4d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.849+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da32f40 0x55f63da55f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.849+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da56940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.849+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63d920310 con 0x55f63da32f40 2023-09-30T22:56:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.849+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63d95d130 con 0x55f63da564d0 2023-09-30T22:56:47.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.849+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f63d95aaf0 con 0x55f63da4d450 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da32f40 0x55f63da55f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da32f40 0x55f63da55f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42942/0 (socket says 172.21.15.142:42942) 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 -- 172.21.15.142:0/2472373184 learned_addr learned my addr 172.21.15.142:0/2472373184 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd37fe700 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da56940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 0x55f63da4d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 -- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 msgr2=0x55f63da4d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 0x55f63da4d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 -- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 msgr2=0x55f63da56940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da56940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 -- 172.21.15.142:0/2472373184 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f63d75c790 con 0x55f63da32f40 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabd27fc700 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da32f40 0x55f63da55f90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fabc80843c0 tx=0x7fabc8084320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cee4394a992949 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:47.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabb3fff700 1 -- 172.21.15.142:0/2472373184 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011ea0 con 0x55f63da32f40 2023-09-30T22:56:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabb3fff700 1 -- 172.21.15.142:0/2472373184 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8056700 con 0x55f63da32f40 2023-09-30T22:56:47.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.850+0000 7fabb3fff700 1 -- 172.21.15.142:0/2472373184 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8056520 con 0x55f63da32f40 2023-09-30T22:56:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2472373184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da32f40 msgr2=0x55f63da55f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da32f40 0x55f63da55f90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fabc80843c0 tx=0x7fabc8084320 comp rx=0 tx=0).stop 2023-09-30T22:56:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2472373184 shutdown_connections 2023-09-30T22:56:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da56940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 0x55f63da4d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2472373184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da32f40 0x55f63da55f90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2472373184 >> 172.21.15.142:0/2472373184 conn(0x55f63da50880 msgr2=0x55f63da50c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2472373184 shutdown_connections 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.851+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2472373184 wait complete. 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.852+0000 7fabe7c9fb80 1 -- start start 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.852+0000 7fabe7c9fb80 1 Processor -- start 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da07ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da564d0 0x55f63da26a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63d9568e0 con 0x55f63da4d450 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63d902980 con 0x55f63da32f40 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f63d902620 con 0x55f63da564d0 2023-09-30T22:56:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabe7c9fb80 10 client.0 _ll_register_callbacks cb 0x55f63d765a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42946/0 (socket says 172.21.15.142:42946) 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabd27fc700 1 -- 172.21.15.142:0/2133402426 learned_addr learned my addr 172.21.15.142:0/2133402426 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabd37fe700 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da564d0 0x55f63da26a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.853+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da07ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabd27fc700 1 -- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da564d0 msgr2=0x55f63da26a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabd27fc700 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da564d0 0x55f63da26a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabd27fc700 1 -- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 msgr2=0x55f63da07ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabd27fc700 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da07ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabd27fc700 1 -- 172.21.15.142:0/2133402426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd415a6f0 con 0x55f63da4d450 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabd27fc700 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2a800 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fabc80568c0 tx=0x7fabc806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fbbc7156339b12 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:47.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabb17fa700 1 -- 172.21.15.142:0/2133402426 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80572c0 con 0x55f63da4d450 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabb17fa700 1 -- 172.21.15.142:0/2133402426 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fabc8056bc0 con 0x55f63da4d450 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f63d9fad60 con 0x55f63da4d450 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabb17fa700 1 -- 172.21.15.142:0/2133402426 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabc8059e10 con 0x55f63da4d450 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabe7c9fb80 10 client.6270 fetch_fsmap learned FSMap version 41 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.854+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55f63d8490a0 con 0x55f63da4d450 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabb17fa700 1 -- 172.21.15.142:0/2133402426 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f63d9fad60 con 0x55f63da4d450 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabb17fa700 1 -- 172.21.15.142:0/2133402426 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fabc8057bd0 con 0x55f63da4d450 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabe7c9fb80 10 client.6270 fetch_fsmap finished waiting for FSMap version 41 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabe7c9fb80 10 client.6270 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabe7c9fb80 20 client.6270 populate_metadata read hostname 'smithi142' 2023-09-30T22:56:47.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da4e780 0x55f63da4eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabe7c9fb80 4 client.6270 mds_command: new command op to 6135 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:56:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 --> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f63d9d7b30 con 0x55f63da4e780 2023-09-30T22:56:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.855+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da4e780 0x55f63da4eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.856+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da4e780 0x55f63da4eb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621b75ade9297987 server_cookie=90e6f51d92335334 in_seq=0 out_seq=0 2023-09-30T22:56:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.856+0000 7fabb17fa700 10 client.6270 ms_handle_connect on v2:172.21.15.148:6833/3908259553 2023-09-30T22:56:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabb17fa700 1 -- 172.21.15.142:0/2133402426 <== mds.0 v2:172.21.15.148:6833/3908259553 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x55f63d9d7b30 con 0x55f63da4e780 2023-09-30T22:56:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabb17fa700 10 client.6270 handle_command_reply: tid=0 2023-09-30T22:56:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 client.6270 shutdown 2023-09-30T22:56:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 msgr2=0x55f63da2a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2a800 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fabc80568c0 tx=0x7fabc806a000 comp rx=0 tx=0).stop 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 shutdown_connections 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da4e780 0x55f63da4eb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabb17fa700 0 client.6270 ms_handle_reset on v2:172.21.15.148:6833/3908259553 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da564d0 0x55f63da26a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da07ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/2133402426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2a800 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 >> 172.21.15.142:0/2133402426 conn(0x55f63da50880 msgr2=0x55f63da09420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 shutdown_connections 2023-09-30T22:56:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/2133402426 wait complete. 2023-09-30T22:56:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.857+0000 7fabe7c9fb80 20 client.6270 trim_cache size 0 max 16384 2023-09-30T22:56:47.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.875+0000 7fabe7c9fb80 1 Processor -- start 2023-09-30T22:56:47.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.875+0000 7fabe7c9fb80 1 -- start start 2023-09-30T22:56:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da50e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 0x55f63da35360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da564d0 0x55f63da358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63d7ee1e0 con 0x55f63da564d0 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63da089e0 con 0x55f63da32f40 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f63da04b40 con 0x55f63da4d450 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da564d0 0x55f63da358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da564d0 0x55f63da358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42952/0 (socket says 172.21.15.142:42952) 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 -- 172.21.15.142:0/3858880417 learned_addr learned my addr 172.21.15.142:0/3858880417 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da50e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 -- 172.21.15.142:0/3858880417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 msgr2=0x55f63da35360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 0x55f63da35360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 -- 172.21.15.142:0/3858880417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 msgr2=0x55f63da50e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da50e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 -- 172.21.15.142:0/3858880417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f63d9253c0 con 0x55f63da564d0 2023-09-30T22:56:47.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.876+0000 7fabd37fe700 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da564d0 0x55f63da358a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0167b0 tx=0x7fabcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4716ef4f4917e95a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabb8ff9700 1 -- 172.21.15.142:0/3858880417 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00e040 con 0x55f63da564d0 2023-09-30T22:56:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabb8ff9700 1 -- 172.21.15.142:0/3858880417 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00f040 con 0x55f63da564d0 2023-09-30T22:56:47.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabb8ff9700 1 -- 172.21.15.142:0/3858880417 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc017620 con 0x55f63da564d0 2023-09-30T22:56:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/3858880417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da564d0 msgr2=0x55f63da358a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da564d0 0x55f63da358a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0167b0 tx=0x7fabcc00b040 comp rx=0 tx=0).stop 2023-09-30T22:56:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/3858880417 shutdown_connections 2023-09-30T22:56:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da564d0 0x55f63da358a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da32f40 0x55f63da50e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/3858880417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da4d450 0x55f63da35360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/3858880417 >> 172.21.15.142:0/3858880417 conn(0x55f63da50880 msgr2=0x55f63da26850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/3858880417 shutdown_connections 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.877+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/3858880417 wait complete. 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.878+0000 7fabe7c9fb80 1 -- start start 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.878+0000 7fabe7c9fb80 1 Processor -- start 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da32f40 0x55f63da2c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabe7c9fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da02240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63da2d1d0 con 0x55f63da4d450 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63da554e0 con 0x55f63da564d0 2023-09-30T22:56:47.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabe7c9fb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f63dab2030 con 0x55f63da32f40 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabe7c9fb80 10 client.0 _ll_register_callbacks cb 0x55f63d765a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabd27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42966/0 (socket says 172.21.15.142:42966) 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.879+0000 7fabd27fc700 1 -- 172.21.15.142:0/1524077783 learned_addr learned my addr 172.21.15.142:0/1524077783 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd37fe700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da02240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da32f40 0x55f63da2c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd27fc700 1 -- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da32f40 msgr2=0x55f63da2c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd27fc700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da32f40 0x55f63da2c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd27fc700 1 -- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 msgr2=0x55f63da02240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd27fc700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da02240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd27fc700 1 -- 172.21.15.142:0/1524077783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc016480 con 0x55f63da4d450 2023-09-30T22:56:47.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd37fe700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da02240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabd27fc700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2c670 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fabc8006dd0 tx=0x7fabc806c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21620630cf81410f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabb17fa700 1 -- 172.21.15.142:0/1524077783 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011ea0 con 0x55f63da4d450 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fabc8056700 con 0x55f63da4d450 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabb17fa700 1 -- 172.21.15.142:0/1524077783 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fabc80572c0 con 0x55f63da4d450 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabb17fa700 1 -- 172.21.15.142:0/1524077783 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabc8056520 con 0x55f63da4d450 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabe7c9fb80 10 client.6276 fetch_fsmap learned FSMap version 41 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.880+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55f63d7bd1d0 con 0x55f63da4d450 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabb17fa700 1 -- 172.21.15.142:0/1524077783 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8056700 con 0x55f63da4d450 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabb17fa700 1 -- 172.21.15.142:0/1524077783 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fabc8057bd0 con 0x55f63da4d450 2023-09-30T22:56:47.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabe7c9fb80 10 client.6276 fetch_fsmap finished waiting for FSMap version 41 2023-09-30T22:56:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabe7c9fb80 10 client.6276 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T22:56:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabe7c9fb80 20 client.6276 populate_metadata read hostname 'smithi142' 2023-09-30T22:56:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da99200 0x55f63da02780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabe7c9fb80 4 client.6276 mds_command: new command op to 6135 tid=0[{"prefix": "status"}] 2023-09-30T22:56:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 --> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f63d8f98d0 con 0x55f63da99200 2023-09-30T22:56:47.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.881+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da99200 0x55f63da02780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabd2ffd700 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da99200 0x55f63da02780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df47143169e4a053 server_cookie=88c1ab0aa2852f0 in_seq=0 out_seq=0 2023-09-30T22:56:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabb17fa700 10 client.6276 ms_handle_connect on v2:172.21.15.148:6833/3908259553 2023-09-30T22:56:47.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabb17fa700 1 -- 172.21.15.142:0/1524077783 <== mds.0 v2:172.21.15.148:6833/3908259553 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f63d8f98d0 con 0x55f63da99200 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabb17fa700 10 client.6276 handle_command_reply: tid=0 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 client.6276 shutdown 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 msgr2=0x55f63da2c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2c670 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fabc8006dd0 tx=0x7fabc806c040 comp rx=0 tx=0).stop 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 shutdown_connections 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:6833/3908259553,v1:172.21.15.148:6835/3908259553] conn(0x55f63da99200 0x55f63da02780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f63da564d0 0x55f63da02240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55f63da32f40 0x55f63da2c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabb17fa700 0 client.6276 ms_handle_reset on v2:172.21.15.148:6833/3908259553 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 --2- 172.21.15.142:0/1524077783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f63da4d450 0x55f63da2c670 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 >> 172.21.15.142:0/1524077783 conn(0x55f63da50880 msgr2=0x55f63da092d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:47.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 shutdown_connections 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 1 -- 172.21.15.142:0/1524077783 wait complete. 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.882+0000 7fabe7c9fb80 20 client.6276 trim_cache size 0 max 16384 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 6135, 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:56:47.890 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:56:47.891 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 6.4584591199999997, 2023-09-30T22:56:47.891 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 41, 2023-09-30T22:56:47.891 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 91, 2023-09-30T22:56:47.891 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 91, 2023-09-30T22:56:47.891 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 12.959835062 2023-09-30T22:56:47.891 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc0067330 msgr2=0x7fabc00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc0067330 0x7fabc00697e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fabc4003a80 tx=0x7fabc4007ec0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd4143350 msgr2=0x7fabd40b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd4143350 0x7fabd40b0df0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fabd4063f80 tx=0x7fabc8017000 comp rx=0 tx=0).stop 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 shutdown_connections 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fabc0067330 0x7fabc00697e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabd415dc50 0x7fabd415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabd40692f0 0x7fabd40a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 --2- 172.21.15.142:0/278738034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabd4143350 0x7fabd40b0df0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 >> 172.21.15.142:0/278738034 conn(0x7fabd40ce8e0 msgr2=0x7fabd40cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 shutdown_connections 2023-09-30T22:56:47.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:47.883+0000 7fabd95ff700 1 -- 172.21.15.142:0/278738034 wait complete. 2023-09-30T22:56:47.901 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:56:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.089+0000 7effa79ff700 1 Processor -- start 2023-09-30T22:56:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.089+0000 7effa79ff700 1 -- start start 2023-09-30T22:56:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.090+0000 7effa79ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1950 0x7effa015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.090+0000 7effa79ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00ad630 con 0x7effa00b1580 2023-09-30T22:56:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.090+0000 7effa79ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa015ab10 con 0x7effa015a6c0 2023-09-30T22:56:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.090+0000 7effa79ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa0157c20 con 0x7effa00b1950 2023-09-30T22:56:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.090+0000 7effa579b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7effa00b1580 0x7effa00adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55918/0 (socket says 172.21.15.142:55918) 2023-09-30T22:56:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.090+0000 7effa579b700 1 -- 172.21.15.142:0/1930215846 learned_addr learned my addr 172.21.15.142:0/1930215846 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7effa4f9a700 1 --2- 172.21.15.142:0/1930215846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1950 0x7effa015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486484964 0 0) 0x7effa00ad630 con 0x7effa00b1580 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff8c003570 con 0x7effa00b1580 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189723367 0 0) 0x7effa015ab10 con 0x7effa015a6c0 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa00ad630 con 0x7effa015a6c0 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7effa4f9a700 1 -- 172.21.15.142:0/1930215846 >> v1:172.21.15.148:6789/0 conn(0x7effa015a6c0 legacy=0x7effa006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 977475823 0 0) 0x7eff8c003570 con 0x7effa00b1580 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7effa4f9a700 1 -- 172.21.15.142:0/1930215846 >> v1:172.21.15.142:6789/0 conn(0x7effa00b1580 legacy=0x7effa00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7effa4f9a700 1 -- 172.21.15.142:0/1930215846 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00b3360 con 0x7effa00b1950 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.091+0000 7effa4f9a700 1 --2- 172.21.15.142:0/1930215846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1950 0x7effa015a180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7eff90009910 tx=0x7eff900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d33a97d58aa58d5f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:48.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c001470 con 0x7effa00b1950 2023-09-30T22:56:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90011420 con 0x7effa00b1950 2023-09-30T22:56:48.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7eff97fff700 1 -- 172.21.15.142:0/1930215846 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900117c0 con 0x7effa00b1950 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7effa79ff700 1 -- 172.21.15.142:0/1930215846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1950 msgr2=0x7effa015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7effa79ff700 1 --2- 172.21.15.142:0/1930215846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1950 0x7effa015a180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7eff90009910 tx=0x7eff900091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7effa79ff700 1 -- 172.21.15.142:0/1930215846 shutdown_connections 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7effa79ff700 1 --2- 172.21.15.142:0/1930215846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1950 0x7effa015a180 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7effa79ff700 1 -- 172.21.15.142:0/1930215846 >> 172.21.15.142:0/1930215846 conn(0x7effa00ce1f0 msgr2=0x7effa0069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7effa79ff700 1 -- 172.21.15.142:0/1930215846 shutdown_connections 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.092+0000 7effa79ff700 1 -- 172.21.15.142:0/1930215846 wait complete. 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.094+0000 7effa79ff700 1 Processor -- start 2023-09-30T22:56:48.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.094+0000 7effa79ff700 1 -- start start 2023-09-30T22:56:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa79ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1580 0x7effa014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa79ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa00b1950 0x7effa016a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa79ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa015a6c0 0x7effa0155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa79ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa014dc80 con 0x7effa015a6c0 2023-09-30T22:56:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa79ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa016e370 con 0x7effa00b1950 2023-09-30T22:56:48.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa79ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa016e650 con 0x7effa00b1580 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa5f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa015a6c0 0x7effa0155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa5f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa015a6c0 0x7effa0155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42982/0 (socket says 172.21.15.142:42982) 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa5f9c700 1 -- 172.21.15.142:0/2476569207 learned_addr learned my addr 172.21.15.142:0/2476569207 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa579b700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1580 0x7effa014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.095+0000 7effa4f9a700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa00b1950 0x7effa016a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa5f9c700 1 -- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1580 msgr2=0x7effa014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa5f9c700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1580 0x7effa014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa5f9c700 1 -- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa00b1950 msgr2=0x7effa016a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa5f9c700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa00b1950 0x7effa016a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa5f9c700 1 -- 172.21.15.142:0/2476569207 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009420 con 0x7effa015a6c0 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa5f9c700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa015a6c0 0x7effa0155320 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7eff9800c860 tx=0x7eff98002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:48.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7eff957fa700 1 -- 172.21.15.142:0/2476569207 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98002030 con 0x7effa015a6c0 2023-09-30T22:56:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7eff957fa700 1 -- 172.21.15.142:0/2476569207 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff980021b0 con 0x7effa015a6c0 2023-09-30T22:56:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7eff957fa700 1 -- 172.21.15.142:0/2476569207 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98012630 con 0x7effa015a6c0 2023-09-30T22:56:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa016e930 con 0x7effa015a6c0 2023-09-30T22:56:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.096+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa014d860 con 0x7effa015a6c0 2023-09-30T22:56:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.097+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa014ddf0 con 0x7effa015a6c0 2023-09-30T22:56:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.098+0000 7eff957fa700 1 -- 172.21.15.142:0/2476569207 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff98012a20 con 0x7effa015a6c0 2023-09-30T22:56:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.099+0000 7eff957fa700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff84067330 0x7eff840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.099+0000 7eff957fa700 1 -- 172.21.15.142:0/2476569207 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff98084bb0 con 0x7effa015a6c0 2023-09-30T22:56:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.099+0000 7effa579b700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff84067330 0x7eff840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.100+0000 7effa579b700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff84067330 0x7eff840697e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7eff9c001380 tx=0x7eff9c0019f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.103+0000 7eff957fa700 1 -- 172.21.15.142:0/2476569207 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff98051a10 con 0x7effa015a6c0 2023-09-30T22:56:48.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.335+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effa00ae1d0 con 0x7effa015a6c0 2023-09-30T22:56:48.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.336+0000 7eff957fa700 1 -- 172.21.15.142:0/2476569207 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff98055030 con 0x7effa015a6c0 2023-09-30T22:56:48.337 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:56:48.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff84067330 msgr2=0x7eff840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff84067330 0x7eff840697e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7eff9c001380 tx=0x7eff9c0019f0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa015a6c0 msgr2=0x7effa0155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa015a6c0 0x7effa0155320 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7eff9800c860 tx=0x7eff98002700 comp rx=0 tx=0).stop 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 shutdown_connections 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff84067330 0x7eff840697e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa015a6c0 0x7effa0155320 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa00b1580 0x7effa014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 --2- 172.21.15.142:0/2476569207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa00b1950 0x7effa016a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:48.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.338+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 >> 172.21.15.142:0/2476569207 conn(0x7effa00ce1f0 msgr2=0x7effa0067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:48.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.339+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 shutdown_connections 2023-09-30T22:56:48.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:48.339+0000 7effa79ff700 1 -- 172.21.15.142:0/2476569207 wait complete. 2023-09-30T22:56:48.357 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:56:48.357 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:56:48.357 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:56:48.357 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:56:48.357 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:56:48.358 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:56:48.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:56:48.358 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:56:48.358 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:56:48.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:48.358 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:56:48.405 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:56:48.405 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:56:48.405 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:56:48.406 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42049sec preferred_lft 42049sec 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:56:48.407 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:48.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:48.409 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:56:48.513 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:56:48.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:48.516 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:56:48.565 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:56:48.566 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:56:48.566 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:56:48.566 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:56:48.566 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:56:48.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:48.566 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:56:48.567 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:56:48.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:56:48.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:56:48.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:56:48.567 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:56:48.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:48.735 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:56:48.782 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T22:56:48.782 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:56:48.782 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:56:48.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:48.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:56:48.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:56:48.893 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:56:48.939 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:56:48.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:56:48.939 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:56:49.024 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:56:49.024 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:56:49.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:56:49.163 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:56:49.163 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:56:49.163 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:56:49.177 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:56:49.178 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:56:49.178 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:56:49.178 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:56:49.178 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:56:49.199 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:56:49.199 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:56:49.199 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:56:49.200 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:56:49.200 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:56:49.200 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:56:49.200 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:56:49.200 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:56:49.204 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:56:49.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:49.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:56:49.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:56:49.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.467+0000 7fb93a7ff700 1 Processor -- start 2023-09-30T22:56:49.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.467+0000 7fb93a7ff700 1 -- start start 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.468+0000 7fb93a7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb934143350 0x7fb9340cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.468+0000 7fb93a7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9340692f0 0x7fb93415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.468+0000 7fb93a7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93415e0b0 con 0x7fb93415dc50 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb93a7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9340cc6b0 con 0x7fb9340692f0 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb93a7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340cb7d0 con 0x7fb934143350 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb9337fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9340692f0 0x7fb93415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb938d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb93415dc50 0x7fb934068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55924/0 (socket says 172.21.15.142:55924) 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb938d9c700 1 -- 172.21.15.142:0/1273371595 learned_addr learned my addr 172.21.15.142:0/1273371595 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:49.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb933fff700 1 --2- 172.21.15.142:0/1273371595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb934143350 0x7fb9340cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:49.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb9337fe700 1 -- 172.21.15.142:0/1273371595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb934143350 msgr2=0x7fb9340cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:49.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb9337fe700 1 --2- 172.21.15.142:0/1273371595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb934143350 0x7fb9340cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb9337fe700 1 -- 172.21.15.142:0/1273371595 >> v1:172.21.15.142:6789/0 conn(0x7fb93415dc50 legacy=0x7fb934068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:49.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb9337fe700 1 -- 172.21.15.142:0/1273371595 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340cbaa0 con 0x7fb9340692f0 2023-09-30T22:56:49.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.469+0000 7fb933fff700 1 --2- 172.21.15.142:0/1273371595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb934143350 0x7fb9340cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:56:49.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb9337fe700 1 --2- 172.21.15.142:0/1273371595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9340692f0 0x7fb93415d710 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb9280098e0 tx=0x7fb9280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3003a0d7c033f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb932ffd700 1 -- 172.21.15.142:0/1273371595 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928009e80 con 0x7fb9340692f0 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb932ffd700 1 -- 172.21.15.142:0/1273371595 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92800b860 con 0x7fb9340692f0 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb932ffd700 1 -- 172.21.15.142:0/1273371595 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92800bbe0 con 0x7fb9340692f0 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb93a7ff700 1 -- 172.21.15.142:0/1273371595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9340692f0 msgr2=0x7fb93415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/1273371595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9340692f0 0x7fb93415d710 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb9280098e0 tx=0x7fb9280091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb93a7ff700 1 -- 172.21.15.142:0/1273371595 shutdown_connections 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/1273371595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb934143350 0x7fb9340cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/1273371595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9340692f0 0x7fb93415d710 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.470+0000 7fb93a7ff700 1 -- 172.21.15.142:0/1273371595 >> 172.21.15.142:0/1273371595 conn(0x7fb9340ce8e0 msgr2=0x7fb9340cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.471+0000 7fb93a7ff700 1 -- 172.21.15.142:0/1273371595 shutdown_connections 2023-09-30T22:56:49.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.471+0000 7fb93a7ff700 1 -- 172.21.15.142:0/1273371595 wait complete. 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.472+0000 7fb93a7ff700 1 Processor -- start 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.472+0000 7fb93a7ff700 1 -- start start 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb93a7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9340692f0 0x7fb934159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb93a7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb934143350 0x7fb93415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb93a7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb93415dc50 0x7fb93415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb93a7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93413d5b0 con 0x7fb934143350 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb93a7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340b29b0 con 0x7fb93415dc50 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb93a7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9341597b0 con 0x7fb9340692f0 2023-09-30T22:56:49.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb9337fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb934143350 0x7fb93415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.473+0000 7fb933fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9340692f0 0x7fb934159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb938d9c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb93415dc50 0x7fb93415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb933fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9340692f0 0x7fb934159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:40640/0 (socket says 172.21.15.142:40640) 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb933fff700 1 -- 172.21.15.142:0/14684458 learned_addr learned my addr 172.21.15.142:0/14684458 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb9337fe700 1 -- 172.21.15.142:0/14684458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9340692f0 msgr2=0x7fb934159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb9337fe700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9340692f0 0x7fb934159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb9337fe700 1 -- 172.21.15.142:0/14684458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb93415dc50 msgr2=0x7fb93415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb9337fe700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb93415dc50 0x7fb93415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb9337fe700 1 -- 172.21.15.142:0/14684458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb928009420 con 0x7fb934143350 2023-09-30T22:56:49.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb9337fe700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb934143350 0x7fb93415a740 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb9340cb1c0 tx=0x7fb928017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:49.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb91bfff700 1 -- 172.21.15.142:0/14684458 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92800b9d0 con 0x7fb934143350 2023-09-30T22:56:49.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb91bfff700 1 -- 172.21.15.142:0/14684458 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92800bb30 con 0x7fb934143350 2023-09-30T22:56:49.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb91bfff700 1 -- 172.21.15.142:0/14684458 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928011670 con 0x7fb934143350 2023-09-30T22:56:49.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.474+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93413cd10 con 0x7fb934143350 2023-09-30T22:56:49.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.475+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93413d2d0 con 0x7fb934143350 2023-09-30T22:56:49.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.476+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93406ea70 con 0x7fb934143350 2023-09-30T22:56:49.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.476+0000 7fb91bfff700 1 -- 172.21.15.142:0/14684458 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb9280119e0 con 0x7fb934143350 2023-09-30T22:56:49.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.477+0000 7fb91bfff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb920067330 0x7fb9200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:49.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.477+0000 7fb91bfff700 1 -- 172.21.15.142:0/14684458 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb928085ff0 con 0x7fb934143350 2023-09-30T22:56:49.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.477+0000 7fb933fff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb920067330 0x7fb9200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:49.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.478+0000 7fb933fff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb920067330 0x7fb9200697e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb924006dc0 tx=0x7fb924008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:49.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.482+0000 7fb91bfff700 1 -- 172.21.15.142:0/14684458 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb928052ed0 con 0x7fb934143350 2023-09-30T22:56:49.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.714+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb9340b2af0 con 0x7fb934143350 2023-09-30T22:56:49.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.715+0000 7fb91bfff700 1 -- 172.21.15.142:0/14684458 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb928028070 con 0x7fb934143350 2023-09-30T22:56:49.716 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb920067330 msgr2=0x7fb9200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb920067330 0x7fb9200697e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb924006dc0 tx=0x7fb924008040 comp rx=0 tx=0).stop 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb934143350 msgr2=0x7fb93415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb934143350 0x7fb93415a740 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb9340cb1c0 tx=0x7fb928017000 comp rx=0 tx=0).stop 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 shutdown_connections 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb920067330 0x7fb9200697e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb93415dc50 0x7fb93415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9340692f0 0x7fb934159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 --2- 172.21.15.142:0/14684458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb934143350 0x7fb93415a740 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:49.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.717+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 >> 172.21.15.142:0/14684458 conn(0x7fb9340ce8e0 msgr2=0x7fb934140380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:49.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.718+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 shutdown_connections 2023-09-30T22:56:49.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:49.718+0000 7fb93a7ff700 1 -- 172.21.15.142:0/14684458 wait complete. 2023-09-30T22:56:49.736 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:56:49.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:56:49.736 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:56:49.737 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:56:49.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:56:49.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:56:49.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:56:49.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:56:49.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:56:49.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:49.737 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:56:49.790 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:56:49.790 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:56:49.790 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:49.791 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42079sec preferred_lft 42079sec 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:49.792 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:56:49.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:49.793 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:56:49.863 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:56:49.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:49.867 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:56:49.916 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:56:49.916 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:56:49.916 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:56:49.916 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:56:49.916 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:56:49.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:49.918 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:56:49.918 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:56:49.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:56:49.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:56:49.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:56:49.918 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:56:50.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:50.087 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:56:50.133 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T22:56:50.133 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:56:50.134 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:56:50.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:50.134 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:56:50.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:56:50.204 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:56:50.250 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:56:50.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:56:50.250 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:56:50.335 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:56:50.335 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:56:50.335 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:56:50.474 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:56:50.475 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:56:50.475 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:56:50.490 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:56:50.490 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:56:50.491 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:56:50.491 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:56:50.491 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:56:50.510 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:56:50.510 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:56:50.510 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:56:50.511 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:56:50.511 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:56:50.511 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:56:50.511 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:56:50.511 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:56:50.514 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:56:50.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:56:50.514 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:56:50.584 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:56:50.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.782+0000 7f19301ff700 1 Processor -- start 2023-09-30T22:56:50.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.782+0000 7f19301ff700 1 -- start start 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.783+0000 7f19301ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.783+0000 7f19301ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f192815dc50 0x7f192806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.783+0000 7f19301ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192815e0b0 con 0x7f1928143350 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.783+0000 7f19301ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280cc6b0 con 0x7f192815dc50 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.783+0000 7f19301ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280cbaa0 con 0x7f19280692f0 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192df9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1928143350 0x7f19280cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55932/0 (socket says 172.21.15.142:55932) 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192df9b700 1 -- 172.21.15.142:0/27629146 learned_addr learned my addr 172.21.15.142:0/27629146 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:56:50.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192d79a700 1 --2- 172.21.15.142:0/27629146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192e79c700 1 --2- 172.21.15.142:0/27629146 >> v2:172.21.15.148:3300/0 conn(0x7f192815dc50 0x7f192806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192cf99700 1 -- 172.21.15.142:0/27629146 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192971094 0 0) 0x7f1924001110 con 0x7f1928143350 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192cf99700 1 -- 172.21.15.142:0/27629146 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1914003570 con 0x7f1928143350 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192d79a700 1 -- 172.21.15.142:0/27629146 >> v2:172.21.15.148:3300/0 conn(0x7f192815dc50 msgr2=0x7f192806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192d79a700 1 --2- 172.21.15.142:0/27629146 >> v2:172.21.15.148:3300/0 conn(0x7f192815dc50 0x7f192806a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192d79a700 1 -- 172.21.15.142:0/27629146 >> v1:172.21.15.142:6789/0 conn(0x7f1928143350 legacy=0x7f19280cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.784+0000 7f192d79a700 1 -- 172.21.15.142:0/27629146 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280cbd80 con 0x7f19280692f0 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.785+0000 7f192d79a700 1 --2- 172.21.15.142:0/27629146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192815d710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19180098e0 tx=0x7f19180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f0715c2185a068 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.785+0000 7f192cf99700 1 -- 172.21.15.142:0/27629146 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011630 con 0x7f19280692f0 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.785+0000 7f192cf99700 1 -- 172.21.15.142:0/27629146 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918011790 con 0x7f19280692f0 2023-09-30T22:56:50.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.785+0000 7f192cf99700 1 -- 172.21.15.142:0/27629146 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011b30 con 0x7f19280692f0 2023-09-30T22:56:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.785+0000 7f19301ff700 1 -- 172.21.15.142:0/27629146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 msgr2=0x7f192815d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:50.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.785+0000 7f19301ff700 1 --2- 172.21.15.142:0/27629146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192815d710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19180098e0 tx=0x7f19180091a0 comp rx=0 tx=0).stop 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.786+0000 7f19301ff700 1 -- 172.21.15.142:0/27629146 shutdown_connections 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.786+0000 7f19301ff700 1 --2- 172.21.15.142:0/27629146 >> v2:172.21.15.148:3300/0 conn(0x7f192815dc50 0x7f192806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.786+0000 7f19301ff700 1 --2- 172.21.15.142:0/27629146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192815d710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.786+0000 7f19301ff700 1 -- 172.21.15.142:0/27629146 >> 172.21.15.142:0/27629146 conn(0x7f19280ce8e0 msgr2=0x7f19280cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.786+0000 7f19301ff700 1 -- 172.21.15.142:0/27629146 shutdown_connections 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.786+0000 7f19301ff700 1 -- 172.21.15.142:0/27629146 wait complete. 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.787+0000 7f19301ff700 1 Processor -- start 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.787+0000 7f19301ff700 1 -- start start 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f19301ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192813fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f19301ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1928143350 0x7f192816aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f19301ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f192815dc50 0x7f19280a7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f19301ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192813ff80 con 0x7f192815dc50 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f19301ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280a5790 con 0x7f1928143350 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f19301ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280a5a70 con 0x7f19280692f0 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f192e79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f192815dc50 0x7f19280a7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f192e79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f192815dc50 0x7f19280a7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43022/0 (socket says 172.21.15.142:43022) 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f192e79c700 1 -- 172.21.15.142:0/718721812 learned_addr learned my addr 172.21.15.142:0/718721812 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f192d79a700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1928143350 0x7f192816aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.788+0000 7f192df9b700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192813fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f192e79c700 1 -- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 msgr2=0x7f192813fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f192e79c700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192813fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f192e79c700 1 -- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1928143350 msgr2=0x7f192816aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f192e79c700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1928143350 0x7f192816aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f192e79c700 1 -- 172.21.15.142:0/718721812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918009420 con 0x7f192815dc50 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f192d79a700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1928143350 0x7f192816aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f192e79c700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f192815dc50 0x7f19280a7510 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1920009df0 tx=0x7f192000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f191dffb700 1 -- 172.21.15.142:0/718721812 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192000caa0 con 0x7f192815dc50 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f191dffb700 1 -- 172.21.15.142:0/718721812 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192000f040 con 0x7f192815dc50 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19280a5d50 con 0x7f192815dc50 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.789+0000 7f191dffb700 1 -- 172.21.15.142:0/718721812 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192000ce50 con 0x7f192815dc50 2023-09-30T22:56:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.790+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19280a6310 con 0x7f192815dc50 2023-09-30T22:56:50.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.790+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19280a6530 con 0x7f192815dc50 2023-09-30T22:56:50.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.791+0000 7f191dffb700 1 -- 172.21.15.142:0/718721812 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1920014690 con 0x7f192815dc50 2023-09-30T22:56:50.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.792+0000 7f191dffb700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f190c067330 0x7f190c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:56:50.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.792+0000 7f191dffb700 1 -- 172.21.15.142:0/718721812 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f19200853f0 con 0x7f192815dc50 2023-09-30T22:56:50.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.792+0000 7f192df9b700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f190c067330 0x7f190c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:56:50.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.793+0000 7f192df9b700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f190c067330 0x7f190c0697e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1924001270 tx=0x7f1924007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:56:50.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:50.796+0000 7f191dffb700 1 -- 172.21.15.142:0/718721812 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1920052250 con 0x7f192815dc50 2023-09-30T22:56:51.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.031+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19280cc060 con 0x7f192815dc50 2023-09-30T22:56:51.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.032+0000 7f191dffb700 1 -- 172.21.15.142:0/718721812 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f1920055870 con 0x7f192815dc50 2023-09-30T22:56:51.033 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:56:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:56:40.902309+0000","modified":"2023-09-30T22:56:44.449514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3908259553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3908259553},{"type":"v1","addr":"172.21.15.148:6835","nonce":3908259553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-09-30T22:56:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f190c067330 msgr2=0x7f190c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f190c067330 0x7f190c0697e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1924001270 tx=0x7f1924007bf0 comp rx=0 tx=0).stop 2023-09-30T22:56:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f192815dc50 msgr2=0x7f19280a7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:56:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f192815dc50 0x7f19280a7510 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1920009df0 tx=0x7f192000b040 comp rx=0 tx=0).stop 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 shutdown_connections 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f190c067330 0x7f190c0697e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f192815dc50 0x7f19280a7510 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f19280692f0 0x7f192813fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 --2- 172.21.15.142:0/718721812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1928143350 0x7f192816aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 >> 172.21.15.142:0/718721812 conn(0x7f19280ce8e0 msgr2=0x7f19280ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 shutdown_connections 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:56:51.034+0000 7f19301ff700 1 -- 172.21.15.142:0/718721812 wait complete. 2023-09-30T22:56:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 41 2023-09-30T22:56:51.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-09-30T22:56:51.268 INFO:teuthology.orchestra.run.smithi148.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6135,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.8285753289999995,"mdsmap_epoch":41,"osdmap_epoch":91,"osdmap_epoch_barrier":91,"uptime":16.329935332000002} 2023-09-30T22:56:51.268 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6135, "mdsmap_epoch": 41, "osdmap_epoch": 91, "osdmap_epoch_barrier": 91, "rank_uptime": 9.828575329, "state": "up:active", "uptime": 16.329935332, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:56:51.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T22:56:51.477 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T22:56:51.478 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T22:56:51.478 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-30T22:56:51.678 INFO:teuthology.orchestra.run.smithi142.stdout:{"mon_tick_interval":"5"} 2023-09-30T22:56:51.678 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-30T22:56:51.678 INFO:tasks.cephfs.test_full:pool capacity 556987968, 531MB should be enough to fill it 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> import time 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> import datetime 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> # Write some buffered data through before going full, all should be well 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> print("writing some data through which we expect to succeed") 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> bytes = 0 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-30T22:56:51.679 DEBUG:teuthology.orchestra.run.smithi142:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> # buffered IO, the error should always only appear from fsync and not 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> # from write 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> full = False 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.680 DEBUG:teuthology.orchestra.run.smithi142:> for n in range(0, int(531 * 1.1)): 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> print("wrote bytes via buffered write, moving on to fsync") 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> except OSError as e: 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> if False: 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> raise 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> full = True 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> break 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.681 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> print("fsync'"'"'ed successfully") 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> except OSError as e: 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> full = True 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> break 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> if n > 531 * 0.9: 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> # Be cautious in the last region where we expect to hit 2023-09-30T22:56:51.682 DEBUG:teuthology.orchestra.run.smithi142:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> time.sleep(15.0) 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> if not full: 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> # close() should not raise an error because we already caught it in 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> # since then because all IOs got cancelled on the full flag. 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> print("calling close") 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> os.close(f) 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> print("close() did not raise error") 2023-09-30T22:56:51.683 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T22:56:51.684 DEBUG:teuthology.orchestra.run.smithi142:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-30T22:56:51.684 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:56:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:writing some data through which we expect to succeed 2023-09-30T22:56:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-30T22:56:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 1.00 MB 2023-09-30T22:56:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 2.00 MB 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 3.00 MB 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 4.00 MB 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 5.00 MB 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.613 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 6.00 MB 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 7.00 MB 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 8.00 MB 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 9.00 MB 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.614 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 10.00 MB 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 11.00 MB 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 12.00 MB 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 13.00 MB 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 14.00 MB 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 15.00 MB 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 16.00 MB 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 17.00 MB 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 18.00 MB 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 19.00 MB 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 20.00 MB 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 21.00 MB 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 22.00 MB 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 23.00 MB 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 24.00 MB 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 25.00 MB 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.618 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 26.00 MB 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 27.00 MB 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 28.00 MB 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 29.00 MB 2023-09-30T22:56:55.619 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 30.00 MB 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 31.00 MB 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 32.00 MB 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.620 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 33.00 MB 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 34.00 MB 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 35.00 MB 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.621 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 36.00 MB 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 37.00 MB 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 38.00 MB 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.622 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 39.00 MB 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 40.00 MB 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 41.00 MB 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 42.00 MB 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.623 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 43.00 MB 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 44.00 MB 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 45.00 MB 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.624 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 46.00 MB 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 47.00 MB 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 48.00 MB 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.625 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 49.00 MB 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 50.00 MB 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 51.00 MB 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.626 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 52.00 MB 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 53.00 MB 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 54.00 MB 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 55.00 MB 2023-09-30T22:56:55.627 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 56.00 MB 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 57.00 MB 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 58.00 MB 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.628 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 59.00 MB 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 60.00 MB 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 61.00 MB 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.629 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 62.00 MB 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 63.00 MB 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 64.00 MB 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 65.00 MB 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.630 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 66.00 MB 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 67.00 MB 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 68.00 MB 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 69.00 MB 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.631 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 70.00 MB 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 71.00 MB 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 72.00 MB 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 73.00 MB 2023-09-30T22:56:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 74.00 MB 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 75.00 MB 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 76.00 MB 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 77.00 MB 2023-09-30T22:56:55.634 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.634 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.634 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 78.00 MB 2023-09-30T22:56:55.634 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.634 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.634 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 79.00 MB 2023-09-30T22:56:55.634 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:55.635 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:55.635 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 80.00 MB 2023-09-30T22:56:56.228 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.228 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.228 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 81.00 MB 2023-09-30T22:56:56.228 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.228 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.228 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 82.00 MB 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 83.00 MB 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 84.00 MB 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 85.00 MB 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 86.00 MB 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 87.00 MB 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 88.00 MB 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 89.00 MB 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 90.00 MB 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 91.00 MB 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 92.00 MB 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 93.00 MB 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 94.00 MB 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 95.00 MB 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 96.00 MB 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 97.00 MB 2023-09-30T22:56:56.232 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 98.00 MB 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 99.00 MB 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 100.00 MB 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.233 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 101.00 MB 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 102.00 MB 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 103.00 MB 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 104.00 MB 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.234 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 105.00 MB 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 106.00 MB 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 107.00 MB 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 108.00 MB 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 109.00 MB 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 110.00 MB 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 111.00 MB 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 112.00 MB 2023-09-30T22:56:56.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 113.00 MB 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 114.00 MB 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 115.00 MB 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 116.00 MB 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 117.00 MB 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 118.00 MB 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 119.00 MB 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 120.00 MB 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 121.00 MB 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 122.00 MB 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 123.00 MB 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 124.00 MB 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 125.00 MB 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.240 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 126.00 MB 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 127.00 MB 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 128.00 MB 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 129.00 MB 2023-09-30T22:56:56.241 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 130.00 MB 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 131.00 MB 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 132.00 MB 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 133.00 MB 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 134.00 MB 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 135.00 MB 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 136.00 MB 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 137.00 MB 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 138.00 MB 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 139.00 MB 2023-09-30T22:56:56.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 140.00 MB 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 141.00 MB 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.245 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 142.00 MB 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 143.00 MB 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 144.00 MB 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 145.00 MB 2023-09-30T22:56:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 146.00 MB 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 147.00 MB 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 148.00 MB 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 149.00 MB 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 150.00 MB 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 151.00 MB 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.248 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 152.00 MB 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 153.00 MB 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 154.00 MB 2023-09-30T22:56:56.249 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 155.00 MB 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 156.00 MB 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 157.00 MB 2023-09-30T22:56:56.250 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 158.00 MB 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 159.00 MB 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 160.00 MB 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.252 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 161.00 MB 2023-09-30T22:56:56.926 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.926 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.926 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 162.00 MB 2023-09-30T22:56:56.927 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.927 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.927 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 163.00 MB 2023-09-30T22:56:56.927 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.927 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.927 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 164.00 MB 2023-09-30T22:56:56.928 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.928 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.928 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 165.00 MB 2023-09-30T22:56:56.928 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.928 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.928 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 166.00 MB 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 167.00 MB 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 168.00 MB 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 169.00 MB 2023-09-30T22:56:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 170.00 MB 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 171.00 MB 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 172.00 MB 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 173.00 MB 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 174.00 MB 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 175.00 MB 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 176.00 MB 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.931 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 177.00 MB 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 178.00 MB 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 179.00 MB 2023-09-30T22:56:56.932 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.933 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.933 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 180.00 MB 2023-09-30T22:56:56.933 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.933 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.933 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 181.00 MB 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 182.00 MB 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 183.00 MB 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 184.00 MB 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 185.00 MB 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 186.00 MB 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 187.00 MB 2023-09-30T22:56:56.935 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 188.00 MB 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 189.00 MB 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.936 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 190.00 MB 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 191.00 MB 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 192.00 MB 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 193.00 MB 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.937 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 194.00 MB 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 195.00 MB 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 196.00 MB 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 197.00 MB 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.938 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 198.00 MB 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 199.00 MB 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 200.00 MB 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.939 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 201.00 MB 2023-09-30T22:56:56.941 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.941 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.941 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 202.00 MB 2023-09-30T22:56:56.941 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 203.00 MB 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 204.00 MB 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 205.00 MB 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.942 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 206.00 MB 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 207.00 MB 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 208.00 MB 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 209.00 MB 2023-09-30T22:56:56.943 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 210.00 MB 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 211.00 MB 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 212.00 MB 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.944 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 213.00 MB 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 214.00 MB 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 215.00 MB 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 216.00 MB 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.945 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 217.00 MB 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 218.00 MB 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 219.00 MB 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 220.00 MB 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.946 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 221.00 MB 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 222.00 MB 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 223.00 MB 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 224.00 MB 2023-09-30T22:56:56.947 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 225.00 MB 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 226.00 MB 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 227.00 MB 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 228.00 MB 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.948 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.949 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 229.00 MB 2023-09-30T22:56:56.949 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.949 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.949 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 230.00 MB 2023-09-30T22:56:56.949 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.949 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.949 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 231.00 MB 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 232.00 MB 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 233.00 MB 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.950 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 234.00 MB 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 235.00 MB 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 236.00 MB 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 237.00 MB 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 238.00 MB 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 239.00 MB 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 240.00 MB 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:56.952 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 241.00 MB 2023-09-30T22:56:57.543 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.543 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.543 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 242.00 MB 2023-09-30T22:56:57.543 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 243.00 MB 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 244.00 MB 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 245.00 MB 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.544 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 246.00 MB 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 247.00 MB 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 248.00 MB 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 249.00 MB 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 250.00 MB 2023-09-30T22:56:57.545 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 251.00 MB 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 252.00 MB 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 253.00 MB 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 254.00 MB 2023-09-30T22:56:57.546 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 255.00 MB 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 256.00 MB 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 257.00 MB 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 258.00 MB 2023-09-30T22:56:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 259.00 MB 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 260.00 MB 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 261.00 MB 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 262.00 MB 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 263.00 MB 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 264.00 MB 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 265.00 MB 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 266.00 MB 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.549 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 267.00 MB 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 268.00 MB 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 269.00 MB 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 270.00 MB 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.550 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 271.00 MB 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 272.00 MB 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 273.00 MB 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 274.00 MB 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.551 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.552 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 275.00 MB 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 276.00 MB 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 277.00 MB 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.554 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 278.00 MB 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 279.00 MB 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 280.00 MB 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 281.00 MB 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 282.00 MB 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 283.00 MB 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 284.00 MB 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 285.00 MB 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.556 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 286.00 MB 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 287.00 MB 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 288.00 MB 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 289.00 MB 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.557 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 290.00 MB 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 291.00 MB 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 292.00 MB 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 293.00 MB 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 294.00 MB 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 295.00 MB 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 296.00 MB 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 297.00 MB 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 298.00 MB 2023-09-30T22:56:57.559 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 299.00 MB 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 300.00 MB 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 301.00 MB 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 302.00 MB 2023-09-30T22:56:57.560 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 303.00 MB 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 304.00 MB 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 305.00 MB 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 306.00 MB 2023-09-30T22:56:57.561 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 307.00 MB 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 308.00 MB 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 309.00 MB 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 310.00 MB 2023-09-30T22:56:57.562 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 311.00 MB 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 312.00 MB 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 313.00 MB 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 314.00 MB 2023-09-30T22:56:57.563 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 315.00 MB 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 316.00 MB 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 317.00 MB 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 318.00 MB 2023-09-30T22:56:57.564 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 319.00 MB 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 320.00 MB 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 321.00 MB 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:57.565 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.218 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 322.00 MB 2023-09-30T22:56:58.218 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 323.00 MB 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 324.00 MB 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 325.00 MB 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.219 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 326.00 MB 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 327.00 MB 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 328.00 MB 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 329.00 MB 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.220 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 330.00 MB 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 331.00 MB 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 332.00 MB 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 333.00 MB 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 334.00 MB 2023-09-30T22:56:58.221 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 335.00 MB 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 336.00 MB 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 337.00 MB 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 338.00 MB 2023-09-30T22:56:58.222 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 339.00 MB 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 340.00 MB 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 341.00 MB 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 342.00 MB 2023-09-30T22:56:58.223 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 343.00 MB 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 344.00 MB 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 345.00 MB 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.224 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 346.00 MB 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 347.00 MB 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 348.00 MB 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.225 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 349.00 MB 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 350.00 MB 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 351.00 MB 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 352.00 MB 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.226 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 353.00 MB 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 354.00 MB 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 355.00 MB 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 356.00 MB 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 357.00 MB 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 358.00 MB 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 359.00 MB 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 360.00 MB 2023-09-30T22:56:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 361.00 MB 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 362.00 MB 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 363.00 MB 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 364.00 MB 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 365.00 MB 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 366.00 MB 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 367.00 MB 2023-09-30T22:56:58.231 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.231 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.231 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 368.00 MB 2023-09-30T22:56:58.231 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.231 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.231 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 369.00 MB 2023-09-30T22:56:58.231 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 370.00 MB 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 371.00 MB 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 372.00 MB 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.232 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 373.00 MB 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 374.00 MB 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 375.00 MB 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.233 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 376.00 MB 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 377.00 MB 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 378.00 MB 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.234 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 379.00 MB 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 380.00 MB 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 381.00 MB 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 382.00 MB 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 383.00 MB 2023-09-30T22:56:58.235 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 384.00 MB 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 385.00 MB 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 386.00 MB 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 387.00 MB 2023-09-30T22:56:58.236 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 388.00 MB 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 389.00 MB 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 390.00 MB 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 391.00 MB 2023-09-30T22:56:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 392.00 MB 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 393.00 MB 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 394.00 MB 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 395.00 MB 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.238 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 396.00 MB 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 397.00 MB 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 398.00 MB 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 399.00 MB 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.239 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.240 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 400.00 MB 2023-09-30T22:56:58.240 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.240 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.240 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 401.00 MB 2023-09-30T22:56:58.240 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:56:58.240 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:56:58.240 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 402.00 MB 2023-09-30T22:57:02.514 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:57:02.514+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-09-30T22:57:13.198 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:13.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:28.890 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 403.00 MB 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 404.00 MB 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 405.00 MB 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.891 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 406.00 MB 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 407.00 MB 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 408.00 MB 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 409.00 MB 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 410.00 MB 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 411.00 MB 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 412.00 MB 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 413.00 MB 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 414.00 MB 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 415.00 MB 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 416.00 MB 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 417.00 MB 2023-09-30T22:57:28.894 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 418.00 MB 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 419.00 MB 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 420.00 MB 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 421.00 MB 2023-09-30T22:57:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 422.00 MB 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 423.00 MB 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 424.00 MB 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 425.00 MB 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 426.00 MB 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 427.00 MB 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 428.00 MB 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.897 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 429.00 MB 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 430.00 MB 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 431.00 MB 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 432.00 MB 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 433.00 MB 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 434.00 MB 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 435.00 MB 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 436.00 MB 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 437.00 MB 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 438.00 MB 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 439.00 MB 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 440.00 MB 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 441.00 MB 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 442.00 MB 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 443.00 MB 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 444.00 MB 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 445.00 MB 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 446.00 MB 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 447.00 MB 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 448.00 MB 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 449.00 MB 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 450.00 MB 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 451.00 MB 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 452.00 MB 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 453.00 MB 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 454.00 MB 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 455.00 MB 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 456.00 MB 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 457.00 MB 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 458.00 MB 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 459.00 MB 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 460.00 MB 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 461.00 MB 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 462.00 MB 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 463.00 MB 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.906 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 464.00 MB 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 465.00 MB 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 466.00 MB 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 467.00 MB 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.907 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 468.00 MB 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 469.00 MB 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 470.00 MB 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 471.00 MB 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.908 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 472.00 MB 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 473.00 MB 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 474.00 MB 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 475.00 MB 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 476.00 MB 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 477.00 MB 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 478.00 MB 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 479.00 MB 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T22:57:28.910 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T22:57:28.911 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 480.00 MB 2023-09-30T22:57:28.911 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T22:57:28.911 INFO:teuthology.orchestra.run.smithi142.stdout:Reached fullness after 480.00 MB 2023-09-30T22:57:28.911 INFO:teuthology.orchestra.run.smithi142.stdout:calling close 2023-09-30T22:57:28.911 INFO:teuthology.orchestra.run.smithi142.stdout:close() did not raise error 2023-09-30T22:57:29.038 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:57:29.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:57:29.145 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:57:29.254 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:57:29.254 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:57:29.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:57:29.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:57:29.351 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:57:29.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:29.351 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:57:29.398 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:57:29.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:57:29.399 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T22:57:29.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:57:29.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:29.506 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:57:29.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:57:29.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.788+0000 7f41e79ff700 1 Processor -- start 2023-09-30T22:57:29.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.788+0000 7f41e79ff700 1 -- start start 2023-09-30T22:57:29.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.789+0000 7f41e79ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e00c6da0 0x7f41e006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:29.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.789+0000 7f41e79ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41e015e270 0x7f41e0159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:29.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.789+0000 7f41e79ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e015dde0 con 0x7f41e006d3f0 2023-09-30T22:57:29.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.789+0000 7f41e79ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e015e6e0 con 0x7f41e015e270 2023-09-30T22:57:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.789+0000 7f41e79ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e006b840 con 0x7f41e00c6da0 2023-09-30T22:57:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41e015e270 0x7f41e0159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41e015e270 0x7f41e0159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60262/0 (socket says 172.21.15.142:60262) 2023-09-30T22:57:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 -- 172.21.15.142:0/2619658165 learned_addr learned my addr 172.21.15.142:0/2619658165 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e4f9a700 1 --2- 172.21.15.142:0/2619658165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e00c6da0 0x7f41e006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:29.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 -- 172.21.15.142:0/2619658165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e00c6da0 msgr2=0x7f41e006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 --2- 172.21.15.142:0/2619658165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e00c6da0 0x7f41e006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 -- 172.21.15.142:0/2619658165 >> v1:172.21.15.148:6789/0 conn(0x7f41e006d3f0 legacy=0x7f41e006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 -- 172.21.15.142:0/2619658165 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e015d7d0 con 0x7f41e015e270 2023-09-30T22:57:29.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41e5f9c700 1 --2- 172.21.15.142:0/2619658165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e015e270 0x7f41e0159550 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009f20 tx=0x7f41d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb1b68391c7d069 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:29.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.790+0000 7f41d7fff700 1 -- 172.21.15.142:0/2619658165 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800e070 con 0x7f41e015e270 2023-09-30T22:57:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41d7fff700 1 -- 172.21.15.142:0/2619658165 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800b9d0 con 0x7f41e015e270 2023-09-30T22:57:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41d7fff700 1 -- 172.21.15.142:0/2619658165 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80092e0 con 0x7f41e015e270 2023-09-30T22:57:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 -- 172.21.15.142:0/2619658165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e015e270 msgr2=0x7f41e0159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:29.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 --2- 172.21.15.142:0/2619658165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e015e270 0x7f41e0159550 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009f20 tx=0x7f41d8009840 comp rx=0 tx=0).stop 2023-09-30T22:57:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 -- 172.21.15.142:0/2619658165 shutdown_connections 2023-09-30T22:57:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 --2- 172.21.15.142:0/2619658165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e015e270 0x7f41e0159550 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 --2- 172.21.15.142:0/2619658165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e00c6da0 0x7f41e006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:29.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 -- 172.21.15.142:0/2619658165 >> 172.21.15.142:0/2619658165 conn(0x7f41e0067e30 msgr2=0x7f41e0068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 -- 172.21.15.142:0/2619658165 shutdown_connections 2023-09-30T22:57:29.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.791+0000 7f41e79ff700 1 -- 172.21.15.142:0/2619658165 wait complete. 2023-09-30T22:57:29.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.793+0000 7f41e79ff700 1 Processor -- start 2023-09-30T22:57:29.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.793+0000 7f41e79ff700 1 -- start start 2023-09-30T22:57:29.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e79ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e006d3f0 0x7f41e01524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:29.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e79ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41e00c6da0 0x7f41e016ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:29.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e79ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e015e270 0x7f41e00ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e79ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00cb590 con 0x7f41e006d3f0 2023-09-30T22:57:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e79ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e016b4f0 con 0x7f41e00c6da0 2023-09-30T22:57:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e79ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00caa80 con 0x7f41e015e270 2023-09-30T22:57:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e579b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e006d3f0 0x7f41e01524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e4f9a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41e00c6da0 0x7f41e016ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e5f9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e015e270 0x7f41e00ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e579b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e006d3f0 0x7f41e01524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60266/0 (socket says 172.21.15.142:60266) 2023-09-30T22:57:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.794+0000 7f41e579b700 1 -- 172.21.15.142:0/536057656 learned_addr learned my addr 172.21.15.142:0/536057656 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e579b700 1 -- 172.21.15.142:0/536057656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e015e270 msgr2=0x7f41e00ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e579b700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e015e270 0x7f41e00ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e579b700 1 -- 172.21.15.142:0/536057656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41e00c6da0 msgr2=0x7f41e016ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e579b700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41e00c6da0 0x7f41e016ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e579b700 1 -- 172.21.15.142:0/536057656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009ae0 con 0x7f41e006d3f0 2023-09-30T22:57:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e5f9c700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e015e270 0x7f41e00ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e579b700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e006d3f0 0x7f41e01524f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c5c0 tx=0x7f41dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc011590 con 0x7f41e006d3f0 2023-09-30T22:57:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc011710 con 0x7f41e006d3f0 2023-09-30T22:57:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc011ad0 con 0x7f41e006d3f0 2023-09-30T22:57:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e00cacf0 con 0x7f41e006d3f0 2023-09-30T22:57:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.795+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00cb2b0 con 0x7f41e006d3f0 2023-09-30T22:57:29.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.796+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e0069420 con 0x7f41e006d3f0 2023-09-30T22:57:29.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.797+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f41dc01b3b0 con 0x7f41e006d3f0 2023-09-30T22:57:29.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.798+0000 7f41d57fa700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41c4067330 0x7f41c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:29.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.798+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f41dc0840a0 con 0x7f41e006d3f0 2023-09-30T22:57:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.798+0000 7f41e4f9a700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41c4067330 0x7f41c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.798+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f41c406f4f0 con 0x7f41e006d3f0 2023-09-30T22:57:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.799+0000 7f41e4f9a700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41c4067330 0x7f41c40697e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f41e00cfbf0 tx=0x7f41d00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:29.803+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f41dc017020 con 0x7f41e006d3f0 2023-09-30T22:57:30.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.039+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41e00c7230 con 0x7f41e006d3f0 2023-09-30T22:57:30.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.039+0000 7f41d57fa700 1 -- 172.21.15.142:0/536057656 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f41dc050f00 con 0x7f41e006d3f0 2023-09-30T22:57:30.039 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:30.039 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:56:40.902309+0000","modified":"2023-09-30T22:56:44.449514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3908259553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3908259553},{"type":"v1","addr":"172.21.15.148:6835","nonce":3908259553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-09-30T22:57:30.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.041+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41c4067330 msgr2=0x7f41c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.041+0000 7f41e79ff700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41c4067330 0x7f41c40697e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f41e00cfbf0 tx=0x7f41d00091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.041+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e006d3f0 msgr2=0x7f41e01524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.041+0000 7f41e79ff700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e006d3f0 0x7f41e01524f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c5c0 tx=0x7f41dc00c8d0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 shutdown_connections 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41c4067330 0x7f41c40697e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41e015e270 0x7f41e00ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e006d3f0 0x7f41e01524f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 --2- 172.21.15.142:0/536057656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41e00c6da0 0x7f41e016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 >> 172.21.15.142:0/536057656 conn(0x7f41e0067e30 msgr2=0x7f41e0153130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:30.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 shutdown_connections 2023-09-30T22:57:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.042+0000 7f41e79ff700 1 -- 172.21.15.142:0/536057656 wait complete. 2023-09-30T22:57:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 41 2023-09-30T22:57:30.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:57:30.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.249+0000 7ff4eebff700 1 Processor -- start 2023-09-30T22:57:30.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.249+0000 7ff4eebff700 1 -- start start 2023-09-30T22:57:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.250+0000 7ff4eebff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4e81598e0 0x7ff4e8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.250+0000 7ff4eebff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4e80cee50 0x7ff4e80d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.250+0000 7ff4eebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.250+0000 7ff4eebff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e80cff40 con 0x7ff4e81598e0 2023-09-30T22:57:30.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.250+0000 7ff4eebff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e80d0910 con 0x7ff4e80cee50 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.250+0000 7ff4eebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e80cf330 con 0x7ff4e806b1c0 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.250+0000 7ff4ec99b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4e81598e0 0x7ff4e8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4e81598e0 0x7ff4e8159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60268/0 (socket says 172.21.15.142:60268) 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 -- 172.21.15.142:0/3112311720 learned_addr learned my addr 172.21.15.142:0/3112311720 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4e7fff700 1 --2- 172.21.15.142:0/3112311720 >> v2:172.21.15.148:3300/0 conn(0x7ff4e80cee50 0x7ff4e80d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ed19c700 1 --2- 172.21.15.142:0/3112311720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 -- 172.21.15.142:0/3112311720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 msgr2=0x7ff4e815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 --2- 172.21.15.142:0/3112311720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 -- 172.21.15.142:0/3112311720 >> v2:172.21.15.148:3300/0 conn(0x7ff4e80cee50 msgr2=0x7ff4e80d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 --2- 172.21.15.142:0/3112311720 >> v2:172.21.15.148:3300/0 conn(0x7ff4e80cee50 0x7ff4e80d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 -- 172.21.15.142:0/3112311720 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80cf610 con 0x7ff4e81598e0 2023-09-30T22:57:30.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4ec99b700 1 --2- 172.21.15.142:0/3112311720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e81598e0 0x7ff4e8159cb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80b36f0 tx=0x7ff4dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7143751a450a6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:30.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4e77fe700 1 -- 172.21.15.142:0/3112311720 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00b640 con 0x7ff4e81598e0 2023-09-30T22:57:30.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.251+0000 7ff4e77fe700 1 -- 172.21.15.142:0/3112311720 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc00b7a0 con 0x7ff4e81598e0 2023-09-30T22:57:30.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4e77fe700 1 -- 172.21.15.142:0/3112311720 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00bb60 con 0x7ff4e81598e0 2023-09-30T22:57:30.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 -- 172.21.15.142:0/3112311720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e81598e0 msgr2=0x7ff4e8159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 --2- 172.21.15.142:0/3112311720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e81598e0 0x7ff4e8159cb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80b36f0 tx=0x7ff4dc009250 comp rx=0 tx=0).stop 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 -- 172.21.15.142:0/3112311720 shutdown_connections 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 --2- 172.21.15.142:0/3112311720 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 --2- 172.21.15.142:0/3112311720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e81598e0 0x7ff4e8159cb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 --2- 172.21.15.142:0/3112311720 >> v2:172.21.15.148:3300/0 conn(0x7ff4e80cee50 0x7ff4e80d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 -- 172.21.15.142:0/3112311720 >> 172.21.15.142:0/3112311720 conn(0x7ff4e80cd540 msgr2=0x7ff4e80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 -- 172.21.15.142:0/3112311720 shutdown_connections 2023-09-30T22:57:30.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.252+0000 7ff4eebff700 1 -- 172.21.15.142:0/3112311720 wait complete. 2023-09-30T22:57:30.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.254+0000 7ff4eebff700 1 Processor -- start 2023-09-30T22:57:30.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.254+0000 7ff4eebff700 1 -- start start 2023-09-30T22:57:30.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4eebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e8150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4eebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e80cee50 0x7ff4e815c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4eebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e81598e0 0x7ff4e815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4eebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e815bd60 con 0x7ff4e80cee50 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4eebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e815b1e0 con 0x7ff4e81598e0 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4eebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e815b4c0 con 0x7ff4e806b1c0 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e80cee50 0x7ff4e815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e80cee50 0x7ff4e815c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60272/0 (socket says 172.21.15.142:60272) 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4ec99b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e8150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4e7fff700 1 -- 172.21.15.142:0/2971051214 learned_addr learned my addr 172.21.15.142:0/2971051214 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4ed19c700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e81598e0 0x7ff4e815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4ec99b700 1 -- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e81598e0 msgr2=0x7ff4e815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4ec99b700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e81598e0 0x7ff4e815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4ec99b700 1 -- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e80cee50 msgr2=0x7ff4e815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4ec99b700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e80cee50 0x7ff4e815c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4ec99b700 1 -- 172.21.15.142:0/2971051214 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc0094f0 con 0x7ff4e806b1c0 2023-09-30T22:57:30.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.256+0000 7ff4e7fff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e80cee50 0x7ff4e815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:30.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.257+0000 7ff4ec99b700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e8150e40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ce070 tx=0x7ff4dc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.257+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00b910 con 0x7ff4e806b1c0 2023-09-30T22:57:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.257+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc00ba70 con 0x7ff4e806b1c0 2023-09-30T22:57:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.257+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc011650 con 0x7ff4e806b1c0 2023-09-30T22:57:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.257+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e815b7a0 con 0x7ff4e806b1c0 2023-09-30T22:57:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.257+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e8151380 con 0x7ff4e806b1c0 2023-09-30T22:57:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.258+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e8151570 con 0x7ff4e806b1c0 2023-09-30T22:57:30.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.259+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff4dc011a00 con 0x7ff4e806b1c0 2023-09-30T22:57:30.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.260+0000 7ff4e4ff9700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4cc067330 0x7ff4cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.260+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4dc0862e0 con 0x7ff4e806b1c0 2023-09-30T22:57:30.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.260+0000 7ff4e7fff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4cc067330 0x7ff4cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.260+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7ff4cc06f470 con 0x7ff4e806b1c0 2023-09-30T22:57:30.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.261+0000 7ff4e7fff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4cc067330 0x7ff4cc0697e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009fd0 tx=0x7ff4d40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:30.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.265+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff4e8151570 con 0x7ff4e806b1c0 2023-09-30T22:57:30.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.458+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4e8151570 con 0x7ff4e806b1c0 2023-09-30T22:57:30.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.460+0000 7ff4e4ff9700 1 -- 172.21.15.142:0/2971051214 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17115 (secure 0 0 0) 0x7ff4e8151570 con 0x7ff4e806b1c0 2023-09-30T22:57:30.460 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:30.460 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":96,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:57:04.729243+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:56:38.664603+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-09-30T22:56:39.889523+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:57:30.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4cc067330 msgr2=0x7ff4cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4cc067330 0x7ff4cc0697e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009fd0 tx=0x7ff4d40091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 msgr2=0x7ff4e8150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e8150e40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ce070 tx=0x7ff4dc017000 comp rx=0 tx=0).stop 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 shutdown_connections 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4cc067330 0x7ff4cc0697e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4e81598e0 0x7ff4e815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4e806b1c0 0x7ff4e8150e40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 --2- 172.21.15.142:0/2971051214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e80cee50 0x7ff4e815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 >> 172.21.15.142:0/2971051214 conn(0x7ff4e80cd540 msgr2=0x7ff4e80b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.462+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 shutdown_connections 2023-09-30T22:57:30.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.463+0000 7ff4eebff700 1 -- 172.21.15.142:0/2971051214 wait complete. 2023-09-30T22:57:30.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:56:38.664603+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:56:39.889523+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:57:30.480 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:57:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.673+0000 7f71405ff700 1 Processor -- start 2023-09-30T22:57:30.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.673+0000 7f71405ff700 1 -- start start 2023-09-30T22:57:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.674+0000 7f71405ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380cc3b0 0x7f713815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f71405ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380d0550 con 0x7f71380cbfe0 2023-09-30T22:57:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f71405ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380cf940 con 0x7f7138157ab0 2023-09-30T22:57:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f71405ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71380cfc20 con 0x7f71380cc3b0 2023-09-30T22:57:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f713e39b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f71380cbfe0 0x7f71381573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49914/0 (socket says 172.21.15.142:49914) 2023-09-30T22:57:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f713e39b700 1 -- 172.21.15.142:0/1149287807 learned_addr learned my addr 172.21.15.142:0/1149287807 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:30.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f713eb9c700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380cc3b0 0x7f713815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524099445 0 0) 0x7f71380d0550 con 0x7f71380cbfe0 2023-09-30T22:57:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7124003570 con 0x7f71380cbfe0 2023-09-30T22:57:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687711297 0 0) 0x7f71380cf940 con 0x7f7138157ab0 2023-09-30T22:57:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.675+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71380d0550 con 0x7f7138157ab0 2023-09-30T22:57:30.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132629567 0 0) 0x7f7124003570 con 0x7f71380cbfe0 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380cc3b0 msgr2=0x7f713815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380cc3b0 0x7f713815a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 >> v1:172.21.15.148:6789/0 conn(0x7f7138157ab0 legacy=0x7f713806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71380cff00 con 0x7f71380cbfe0 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f7134001470 con 0x7f71380cbfe0 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 >> v1:172.21.15.142:6789/0 conn(0x7f71380cbfe0 legacy=0x7f71381573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7124003c20 0x7f7124004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7124004810 0x7f7124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71240051c0 0x7f712400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71380cfc20 con 0x7f7124004810 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712400c130 con 0x7f71240051c0 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712400c2c0 con 0x7f7124003c20 2023-09-30T22:57:30.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713eb9c700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380cc3b0 0x7f713815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713db9a700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7124004810 0x7f7124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713e39b700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7124003c20 0x7f7124004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713eb9c700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71240051c0 0x7f712400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713db9a700 1 -- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7124003c20 msgr2=0x7f7124004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713db9a700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7124003c20 0x7f7124004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713db9a700 1 -- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71240051c0 msgr2=0x7f712400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713db9a700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71240051c0 0x7f712400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.676+0000 7f713db9a700 1 -- 172.21.15.142:0/1149287807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124003570 con 0x7f7124004810 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.677+0000 7f713db9a700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7124004810 0x7f7124004c80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f71280019e0 tx=0x7f7128007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cc8b2c04596d55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.677+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800c5d0 con 0x7f7124004810 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.677+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800c730 con 0x7f7124004810 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.677+0000 7f713d399700 1 -- 172.21.15.142:0/1149287807 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800cad0 con 0x7f7124004810 2023-09-30T22:57:30.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.677+0000 7f71405ff700 1 -- 172.21.15.142:0/1149287807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7124004810 msgr2=0x7f7124004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.677+0000 7f71405ff700 1 --2- 172.21.15.142:0/1149287807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7124004810 0x7f7124004c80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f71280019e0 tx=0x7f7128007d30 comp rx=0 tx=0).stop 2023-09-30T22:57:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.677+0000 7f713eb9c700 1 -- 172.21.15.142:0/1149287807 reap_dead start 2023-09-30T22:57:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.678+0000 7f71405ff700 1 -- 172.21.15.142:0/1149287807 shutdown_connections 2023-09-30T22:57:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.678+0000 7f71405ff700 1 -- 172.21.15.142:0/1149287807 >> 172.21.15.142:0/1149287807 conn(0x7f71380d0a80 msgr2=0x7f71380d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.678+0000 7f71405ff700 1 -- 172.21.15.142:0/1149287807 shutdown_connections 2023-09-30T22:57:30.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.678+0000 7f71405ff700 1 -- 172.21.15.142:0/1149287807 wait complete. 2023-09-30T22:57:30.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.680+0000 7f71405ff700 1 Processor -- start 2023-09-30T22:57:30.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.680+0000 7f71405ff700 1 -- start start 2023-09-30T22:57:30.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f71405ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7124004810 0x7f71380c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f71405ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71380cb040 0x7f713816a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f71405ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380c9550 0x7f713815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f71405ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713816a830 con 0x7f71380cb040 2023-09-30T22:57:30.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f71405ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71380cb4b0 con 0x7f7124004810 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f71405ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713816aad0 con 0x7f71380c9550 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f713db9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71380cb040 0x7f713816a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f713db9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71380cb040 0x7f713816a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60296/0 (socket says 172.21.15.142:60296) 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f713db9a700 1 -- 172.21.15.142:0/4133973792 learned_addr learned my addr 172.21.15.142:0/4133973792 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f713e39b700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7124004810 0x7f71380c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.681+0000 7f713eb9c700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380c9550 0x7f713815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f713db9a700 1 -- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380c9550 msgr2=0x7f713815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f713db9a700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380c9550 0x7f713815d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f713db9a700 1 -- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7124004810 msgr2=0x7f71380c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f713db9a700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7124004810 0x7f71380c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f713db9a700 1 -- 172.21.15.142:0/4133973792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713816adb0 con 0x7f71380cb040 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f713eb9c700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380c9550 0x7f713815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:30.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f713db9a700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71380cb040 0x7f713816a2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7128008fd0 tx=0x7f7128015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800c3f0 con 0x7f71380cb040 2023-09-30T22:57:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800cab0 con 0x7f71380cb040 2023-09-30T22:57:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128006a70 con 0x7f71380cb040 2023-09-30T22:57:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713816b090 con 0x7f71380cb040 2023-09-30T22:57:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.682+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71380c99c0 con 0x7f71380cb040 2023-09-30T22:57:30.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.683+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71380c4a40 con 0x7f71380cb040 2023-09-30T22:57:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.684+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7128019070 con 0x7f71380cb040 2023-09-30T22:57:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.685+0000 7f712e7fc700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f711c067330 0x7f711c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.686+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71280860d0 con 0x7f71380cb040 2023-09-30T22:57:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.686+0000 7f713e39b700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f711c067330 0x7f711c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.686+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f711c06f4f0 con 0x7f71380cb040 2023-09-30T22:57:30.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.686+0000 7f713e39b700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f711c067330 0x7f711c0697e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7134000e50 tx=0x7f7134001d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:30.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.690+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7128022060 con 0x7f71380cb040 2023-09-30T22:57:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.877+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f713816b280 con 0x7f71380cb040 2023-09-30T22:57:30.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.878+0000 7f712e7fc700 1 -- 172.21.15.142:0/4133973792 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7128017020 con 0x7f71380cb040 2023-09-30T22:57:30.878 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:57:30.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f711c067330 msgr2=0x7f711c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f711c067330 0x7f711c0697e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7134000e50 tx=0x7f7134001d40 comp rx=0 tx=0).stop 2023-09-30T22:57:30.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71380cb040 msgr2=0x7f713816a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71380cb040 0x7f713816a2f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7128008fd0 tx=0x7f7128015000 comp rx=0 tx=0).stop 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 shutdown_connections 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f711c067330 0x7f711c0697e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71380c9550 0x7f713815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7124004810 0x7f71380c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 --2- 172.21.15.142:0/4133973792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71380cb040 0x7f713816a2f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 >> 172.21.15.142:0/4133973792 conn(0x7f71380d0a80 msgr2=0x7f7138159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 shutdown_connections 2023-09-30T22:57:30.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:30.880+0000 7f71405ff700 1 -- 172.21.15.142:0/4133973792 wait complete. 2023-09-30T22:57:30.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:57:31.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.090+0000 7fcdbdfff700 1 Processor -- start 2023-09-30T22:57:31.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.090+0000 7fcdbdfff700 1 -- start start 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdbdfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdb8069f10 0x7fcdb80c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdbdfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcdb80cb350 0x7fcdb80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdbdfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb80c7690 con 0x7fcdb80c52a0 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdbdfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb81406a0 con 0x7fcdb8069f10 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdbdfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb80c3a50 con 0x7fcdb80cb350 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdb6ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdb8069f10 0x7fcdb80c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdb77fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcdb80c52a0 0x7fcdb80c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54624/0 (socket says 172.21.15.142:54624) 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdb6ffd700 1 --2- 172.21.15.142:0/2841758632 >> v2:172.21.15.142:3300/0 conn(0x7fcdb8069f10 0x7fcdb80c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50326/0 (socket says 172.21.15.142:50326) 2023-09-30T22:57:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdb77fe700 1 -- 172.21.15.142:0/2841758632 learned_addr learned my addr 172.21.15.142:0/2841758632 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdb6ffd700 1 -- 172.21.15.142:0/2841758632 >> v2:172.21.15.148:3300/0 conn(0x7fcdb80cb350 msgr2=0x7fcdb80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdb7fff700 1 --2- 172.21.15.142:0/2841758632 >> v2:172.21.15.148:3300/0 conn(0x7fcdb80cb350 0x7fcdb80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb6ffd700 1 --2- 172.21.15.142:0/2841758632 >> v2:172.21.15.148:3300/0 conn(0x7fcdb80cb350 0x7fcdb80c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.092+0000 7fcdb67fc700 1 -- 172.21.15.142:0/2841758632 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552776249 0 0) 0x7fcda8001110 con 0x7fcdb80c52a0 2023-09-30T22:57:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb6ffd700 1 -- 172.21.15.142:0/2841758632 >> v1:172.21.15.142:6789/0 conn(0x7fcdb80c52a0 legacy=0x7fcdb80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb6ffd700 1 -- 172.21.15.142:0/2841758632 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb80c7f20 con 0x7fcdb8069f10 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb7fff700 1 --2- 172.21.15.142:0/2841758632 >> v2:172.21.15.148:3300/0 conn(0x7fcdb80cb350 0x7fcdb80c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb6ffd700 1 --2- 172.21.15.142:0/2841758632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb8069f10 0x7fcdb80c5670 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80c0120 tx=0x7fcdac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8269e999e529642f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb67fc700 1 -- 172.21.15.142:0/2841758632 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac009e80 con 0x7fcdb8069f10 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb67fc700 1 -- 172.21.15.142:0/2841758632 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac00b820 con 0x7fcdb8069f10 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdb67fc700 1 -- 172.21.15.142:0/2841758632 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac00bba0 con 0x7fcdb8069f10 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2841758632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb8069f10 msgr2=0x7fcdb80c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.093+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2841758632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb8069f10 0x7fcdb80c5670 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80c0120 tx=0x7fcdac0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.094+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2841758632 shutdown_connections 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.094+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2841758632 >> v2:172.21.15.148:3300/0 conn(0x7fcdb80cb350 0x7fcdb80c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.094+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2841758632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb8069f10 0x7fcdb80c5670 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.094+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2841758632 >> 172.21.15.142:0/2841758632 conn(0x7fcdb80cc670 msgr2=0x7fcdb80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.094+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2841758632 shutdown_connections 2023-09-30T22:57:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.094+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2841758632 wait complete. 2023-09-30T22:57:31.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.095+0000 7fcdbdfff700 1 Processor -- start 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.095+0000 7fcdbdfff700 1 -- start start 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdbdfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb8069f10 0x7fcdb8131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdbdfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb80c52a0 0x7fcdb816a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdbdfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb80cb350 0x7fcdb80bd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdbdfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb813f6b0 con 0x7fcdb80c52a0 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdbdfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb80ba4c0 con 0x7fcdb8069f10 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdbdfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8132410 con 0x7fcdb80cb350 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdb6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb80c52a0 0x7fcdb816a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdb6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb80c52a0 0x7fcdb816a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50342/0 (socket says 172.21.15.142:50342) 2023-09-30T22:57:31.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.096+0000 7fcdb6ffd700 1 -- 172.21.15.142:0/2479060176 learned_addr learned my addr 172.21.15.142:0/2479060176 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb77fe700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb8069f10 0x7fcdb8131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb7fff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb80cb350 0x7fcdb80bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb6ffd700 1 -- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb80cb350 msgr2=0x7fcdb80bd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb6ffd700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb80cb350 0x7fcdb80bd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb6ffd700 1 -- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb8069f10 msgr2=0x7fcdb8131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb6ffd700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb8069f10 0x7fcdb8131ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb6ffd700 1 -- 172.21.15.142:0/2479060176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac009420 con 0x7fcdb80c52a0 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb7fff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb80cb350 0x7fcdb80bd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb77fe700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb8069f10 0x7fcdb8131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:31.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdb6ffd700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb80c52a0 0x7fcdb816a690 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcdac013000 tx=0x7fcdac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac011420 con 0x7fcdb80c52a0 2023-09-30T22:57:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac011580 con 0x7fcdb80c52a0 2023-09-30T22:57:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac011940 con 0x7fcdb80c52a0 2023-09-30T22:57:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.097+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb80b98b0 con 0x7fcdb80c52a0 2023-09-30T22:57:31.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.098+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb80b9e70 con 0x7fcdb80c52a0 2023-09-30T22:57:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.099+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb8069a50 con 0x7fcdb80c52a0 2023-09-30T22:57:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.099+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcdac011cb0 con 0x7fcdb80c52a0 2023-09-30T22:57:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.101+0000 7fcd9f7fe700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcda4067330 0x7fcda40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.101+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcdac086290 con 0x7fcdb80c52a0 2023-09-30T22:57:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.101+0000 7fcdb77fe700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcda4067330 0x7fcda40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.101+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fcda406f4f0 con 0x7fcdb80c52a0 2023-09-30T22:57:31.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.102+0000 7fcdb77fe700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcda4067330 0x7fcda40697e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcda80018c0 tx=0x7fcda8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.105+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcdac0530f0 con 0x7fcdb80c52a0 2023-09-30T22:57:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.295+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcdb80c9ed0 con 0x7fcdb80c52a0 2023-09-30T22:57:31.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.295+0000 7fcd9f7fe700 1 -- 172.21.15.142:0/2479060176 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcdac0150a0 con 0x7fcdb80c52a0 2023-09-30T22:57:31.295 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:57:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcda4067330 msgr2=0x7fcda40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcda4067330 0x7fcda40697e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcda80018c0 tx=0x7fcda8009040 comp rx=0 tx=0).stop 2023-09-30T22:57:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb80c52a0 msgr2=0x7fcdb816a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb80c52a0 0x7fcdb816a690 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcdac013000 tx=0x7fcdac017000 comp rx=0 tx=0).stop 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 shutdown_connections 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcda4067330 0x7fcda40697e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdb80cb350 0x7fcdb80bd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb8069f10 0x7fcdb8131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 --2- 172.21.15.142:0/2479060176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdb80c52a0 0x7fcdb816a690 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 >> 172.21.15.142:0/2479060176 conn(0x7fcdb80cc670 msgr2=0x7fcdb80c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 shutdown_connections 2023-09-30T22:57:31.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.298+0000 7fcdbdfff700 1 -- 172.21.15.142:0/2479060176 wait complete. 2023-09-30T22:57:31.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:57:31.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.508+0000 7fc570fff700 1 Processor -- start 2023-09-30T22:57:31.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.508+0000 7fc570fff700 1 -- start start 2023-09-30T22:57:31.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc570fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc56c159ba0 0x7fc56c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc570fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc56c0b0de0 0x7fc56c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc570fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c067d10 con 0x7fc56c0ca410 2023-09-30T22:57:31.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc570fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c0ca820 con 0x7fc56c159ba0 2023-09-30T22:57:31.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc570fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c06af90 con 0x7fc56c0b0de0 2023-09-30T22:57:31.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc56a59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc56c159ba0 0x7fc56c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc56ad9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc56c0ca410 0x7fc56c15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54636/0 (socket says 172.21.15.142:54636) 2023-09-30T22:57:31.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc56ad9d700 1 -- 172.21.15.142:0/3513868298 learned_addr learned my addr 172.21.15.142:0/3513868298 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:31.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.509+0000 7fc569d9b700 1 --2- 172.21.15.142:0/3513868298 >> v2:172.21.15.148:3300/0 conn(0x7fc56c0b0de0 0x7fc56c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56a59c700 1 -- 172.21.15.142:0/3513868298 >> v2:172.21.15.148:3300/0 conn(0x7fc56c0b0de0 msgr2=0x7fc56c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:31.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56a59c700 1 --2- 172.21.15.142:0/3513868298 >> v2:172.21.15.148:3300/0 conn(0x7fc56c0b0de0 0x7fc56c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56a59c700 1 -- 172.21.15.142:0/3513868298 >> v1:172.21.15.142:6789/0 conn(0x7fc56c0ca410 legacy=0x7fc56c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56a59c700 1 -- 172.21.15.142:0/3513868298 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0676c0 con 0x7fc56c159ba0 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56959a700 1 -- 172.21.15.142:0/3513868298 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776453584 0 0) 0x7fc56c067d10 con 0x7fc56c0ca410 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56a59c700 1 --2- 172.21.15.142:0/3513868298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c06a8d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc56c06efd0 tx=0x7fc55c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab525e47ac109417 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56959a700 1 -- 172.21.15.142:0/3513868298 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c011630 con 0x7fc56c159ba0 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56959a700 1 -- 172.21.15.142:0/3513868298 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c011790 con 0x7fc56c159ba0 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.510+0000 7fc56959a700 1 -- 172.21.15.142:0/3513868298 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c011b30 con 0x7fc56c159ba0 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 -- 172.21.15.142:0/3513868298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 msgr2=0x7fc56c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 --2- 172.21.15.142:0/3513868298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c06a8d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc56c06efd0 tx=0x7fc55c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 -- 172.21.15.142:0/3513868298 shutdown_connections 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 --2- 172.21.15.142:0/3513868298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c06a8d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 --2- 172.21.15.142:0/3513868298 >> v2:172.21.15.148:3300/0 conn(0x7fc56c0b0de0 0x7fc56c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 -- 172.21.15.142:0/3513868298 >> 172.21.15.142:0/3513868298 conn(0x7fc56c0cb2f0 msgr2=0x7fc56c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 -- 172.21.15.142:0/3513868298 shutdown_connections 2023-09-30T22:57:31.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.511+0000 7fc570fff700 1 -- 172.21.15.142:0/3513868298 wait complete. 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.513+0000 7fc570fff700 1 Processor -- start 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.513+0000 7fc570fff700 1 -- start start 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc570fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc56c0b0de0 0x7fc56c149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc570fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc56c0ca410 0x7fc56c0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc570fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc570fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c16b2e0 con 0x7fc56c159ba0 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc570fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c16d980 con 0x7fc56c0ca410 2023-09-30T22:57:31.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc570fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c16e500 con 0x7fc56c0b0de0 2023-09-30T22:57:31.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc56ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc56ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c0b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50356/0 (socket says 172.21.15.142:50356) 2023-09-30T22:57:31.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc56ad9d700 1 -- 172.21.15.142:0/1943794426 learned_addr learned my addr 172.21.15.142:0/1943794426 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:31.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc56a59c700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc56c0b0de0 0x7fc56c149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc569d9b700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc56c0ca410 0x7fc56c0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc56ad9d700 1 -- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc56c0b0de0 msgr2=0x7fc56c149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.514+0000 7fc56ad9d700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc56c0b0de0 0x7fc56c149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc56ad9d700 1 -- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc56c0ca410 msgr2=0x7fc56c0b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc56ad9d700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc56c0ca410 0x7fc56c0b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc56ad9d700 1 -- 172.21.15.142:0/1943794426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c009420 con 0x7fc56c159ba0 2023-09-30T22:57:31.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc569d9b700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc56c0ca410 0x7fc56c0b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc56ad9d700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c0b30e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc56400ccc0 tx=0x7fc564001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400a950 con 0x7fc56c159ba0 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56400aab0 con 0x7fc56c159ba0 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400ae70 con 0x7fc56c159ba0 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c14a210 con 0x7fc56c159ba0 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.515+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c16deb0 con 0x7fc56c159ba0 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.516+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c16e890 con 0x7fc56c159ba0 2023-09-30T22:57:31.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.517+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc564007300 con 0x7fc56c159ba0 2023-09-30T22:57:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.518+0000 7fc55a7fc700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc54c067330 0x7fc54c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.518+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc564084ff0 con 0x7fc56c159ba0 2023-09-30T22:57:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.519+0000 7fc56a59c700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc54c067330 0x7fc54c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.519+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fc54c06f4f0 con 0x7fc56c159ba0 2023-09-30T22:57:31.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.519+0000 7fc56a59c700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc54c067330 0x7fc54c0697e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0093f0 tx=0x7fc55c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.522+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc564051ed0 con 0x7fc56c159ba0 2023-09-30T22:57:31.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.710+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc56c16e640 con 0x7fc56c159ba0 2023-09-30T22:57:31.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.711+0000 7fc55a7fc700 1 -- 172.21.15.142:0/1943794426 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5640554f0 con 0x7fc56c159ba0 2023-09-30T22:57:31.711 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:57:31.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc54c067330 msgr2=0x7fc54c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc54c067330 0x7fc54c0697e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0093f0 tx=0x7fc55c017000 comp rx=0 tx=0).stop 2023-09-30T22:57:31.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 msgr2=0x7fc56c0b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c0b30e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc56400ccc0 tx=0x7fc564001a80 comp rx=0 tx=0).stop 2023-09-30T22:57:31.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 shutdown_connections 2023-09-30T22:57:31.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc54c067330 0x7fc54c0697e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c159ba0 0x7fc56c0b30e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc56c0b0de0 0x7fc56c149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 --2- 172.21.15.142:0/1943794426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc56c0ca410 0x7fc56c0b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 >> 172.21.15.142:0/1943794426 conn(0x7fc56c0cb2f0 msgr2=0x7fc56c0cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:31.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 shutdown_connections 2023-09-30T22:57:31.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.713+0000 7fc570fff700 1 -- 172.21.15.142:0/1943794426 wait complete. 2023-09-30T22:57:31.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:57:31.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.923+0000 7f2f00bff700 1 Processor -- start 2023-09-30T22:57:31.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.923+0000 7f2f00bff700 1 -- start start 2023-09-30T22:57:31.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.924+0000 7f2f00bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.924+0000 7f2f00bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2efc069f10 0x7f2efc0c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.924+0000 7f2f00bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0c7690 con 0x7f2efc0c5bb0 2023-09-30T22:57:31.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.924+0000 7f2f00bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc1406a0 con 0x7f2efc069f10 2023-09-30T22:57:31.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.924+0000 7f2f00bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c3a50 con 0x7f2efc0c52a0 2023-09-30T22:57:31.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2efad9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2efc0c5bb0 0x7f2efc0ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54650/0 (socket says 172.21.15.142:54650) 2023-09-30T22:57:31.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2efad9d700 1 -- 172.21.15.142:0/41042392 learned_addr learned my addr 172.21.15.142:0/41042392 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:31.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2efa59c700 1 --2- 172.21.15.142:0/41042392 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2ef9d9b700 1 --2- 172.21.15.142:0/41042392 >> v2:172.21.15.148:3300/0 conn(0x7f2efc069f10 0x7f2efc0c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2ef959a700 1 -- 172.21.15.142:0/41042392 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815714215 0 0) 0x7f2ef4001490 con 0x7f2efc0c5bb0 2023-09-30T22:57:31.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2ef959a700 1 -- 172.21.15.142:0/41042392 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee4003570 con 0x7f2efc0c5bb0 2023-09-30T22:57:31.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2efa59c700 1 -- 172.21.15.142:0/41042392 >> v2:172.21.15.148:3300/0 conn(0x7f2efc069f10 msgr2=0x7f2efc0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:31.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2efa59c700 1 --2- 172.21.15.142:0/41042392 >> v2:172.21.15.148:3300/0 conn(0x7f2efc069f10 0x7f2efc0c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2efa59c700 1 -- 172.21.15.142:0/41042392 >> v1:172.21.15.142:6789/0 conn(0x7f2efc0c5bb0 legacy=0x7f2efc0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.925+0000 7f2efa59c700 1 -- 172.21.15.142:0/41042392 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0c7f20 con 0x7f2efc0c52a0 2023-09-30T22:57:31.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2efa59c700 1 --2- 172.21.15.142:0/41042392 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc0c88d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009910 tx=0x7f2eec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2553feb8c5cb047 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2ef959a700 1 -- 172.21.15.142:0/41042392 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec011630 con 0x7f2efc0c52a0 2023-09-30T22:57:31.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2ef959a700 1 -- 172.21.15.142:0/41042392 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec011790 con 0x7f2efc0c52a0 2023-09-30T22:57:31.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2ef959a700 1 -- 172.21.15.142:0/41042392 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec011b10 con 0x7f2efc0c52a0 2023-09-30T22:57:31.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2f00bff700 1 -- 172.21.15.142:0/41042392 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 msgr2=0x7f2efc0c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2f00bff700 1 --2- 172.21.15.142:0/41042392 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc0c88d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009910 tx=0x7f2eec0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2f00bff700 1 -- 172.21.15.142:0/41042392 shutdown_connections 2023-09-30T22:57:31.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.926+0000 7f2f00bff700 1 --2- 172.21.15.142:0/41042392 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc0c88d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.927+0000 7f2f00bff700 1 --2- 172.21.15.142:0/41042392 >> v2:172.21.15.148:3300/0 conn(0x7f2efc069f10 0x7f2efc0c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.927+0000 7f2f00bff700 1 -- 172.21.15.142:0/41042392 >> 172.21.15.142:0/41042392 conn(0x7f2efc0cc670 msgr2=0x7f2efc0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:31.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.927+0000 7f2f00bff700 1 -- 172.21.15.142:0/41042392 shutdown_connections 2023-09-30T22:57:31.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.927+0000 7f2f00bff700 1 -- 172.21.15.142:0/41042392 wait complete. 2023-09-30T22:57:31.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.928+0000 7f2f00bff700 1 Processor -- start 2023-09-30T22:57:31.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.928+0000 7f2f00bff700 1 -- start start 2023-09-30T22:57:31.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2f00bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc069f10 0x7f2efc16b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2f00bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc13b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2f00bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2efc0c5bb0 0x7f2efc06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2f00bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1579c0 con 0x7f2efc069f10 2023-09-30T22:57:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2f00bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc159e40 con 0x7f2efc0c5bb0 2023-09-30T22:57:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2f00bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc16b610 con 0x7f2efc0c52a0 2023-09-30T22:57:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2efa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc069f10 0x7f2efc16b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2efa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc069f10 0x7f2efc16b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50370/0 (socket says 172.21.15.142:50370) 2023-09-30T22:57:31.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.929+0000 7f2efa59c700 1 -- 172.21.15.142:0/2212696195 learned_addr learned my addr 172.21.15.142:0/2212696195 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:31.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2ef9d9b700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc13b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2efad9d700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2efc0c5bb0 0x7f2efc06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2efa59c700 1 -- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 msgr2=0x7f2efc13b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2efa59c700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc13b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2efa59c700 1 -- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2efc0c5bb0 msgr2=0x7f2efc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2efa59c700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2efc0c5bb0 0x7f2efc06dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2efa59c700 1 -- 172.21.15.142:0/2212696195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009420 con 0x7f2efc069f10 2023-09-30T22:57:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2ef9d9b700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc13b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2efa59c700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc069f10 0x7f2efc16b0d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2eec011f00 tx=0x7f2eec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec011b10 con 0x7f2efc069f10 2023-09-30T22:57:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec01a430 con 0x7f2efc069f10 2023-09-30T22:57:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec01a7f0 con 0x7f2efc069f10 2023-09-30T22:57:31.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc159230 con 0x7f2efc069f10 2023-09-30T22:57:31.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.930+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc1597f0 con 0x7f2efc069f10 2023-09-30T22:57:31.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.931+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc069a50 con 0x7f2efc069f10 2023-09-30T22:57:31.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.932+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2eec01ab60 con 0x7f2efc069f10 2023-09-30T22:57:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.933+0000 7f2eea7fc700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2edc067330 0x7f2edc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.934+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2eec086940 con 0x7f2efc069f10 2023-09-30T22:57:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.934+0000 7f2ef9d9b700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2edc067330 0x7f2edc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.934+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f2edc06f4f0 con 0x7f2efc069f10 2023-09-30T22:57:31.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.934+0000 7f2ef9d9b700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2edc067330 0x7f2edc0697e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0c36d0 tx=0x7f2ef0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:31.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:31.938+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2eec015060 con 0x7f2efc069f10 2023-09-30T22:57:32.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.127+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2efc159b90 con 0x7f2efc069f10 2023-09-30T22:57:32.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.128+0000 7f2eea7fc700 1 -- 172.21.15.142:0/2212696195 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2eec0537a0 con 0x7f2efc069f10 2023-09-30T22:57:32.128 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:57:32.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2edc067330 msgr2=0x7f2edc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2edc067330 0x7f2edc0697e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0c36d0 tx=0x7f2ef0008040 comp rx=0 tx=0).stop 2023-09-30T22:57:32.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc069f10 msgr2=0x7f2efc16b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc069f10 0x7f2efc16b0d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2eec011f00 tx=0x7f2eec017000 comp rx=0 tx=0).stop 2023-09-30T22:57:32.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 shutdown_connections 2023-09-30T22:57:32.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2edc067330 0x7f2edc0697e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2efc0c5bb0 0x7f2efc06dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2efc069f10 0x7f2efc16b0d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 --2- 172.21.15.142:0/2212696195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2efc0c52a0 0x7f2efc13b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 >> 172.21.15.142:0/2212696195 conn(0x7f2efc0cc670 msgr2=0x7f2efc0cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:32.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 shutdown_connections 2023-09-30T22:57:32.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.130+0000 7f2f00bff700 1 -- 172.21.15.142:0/2212696195 wait complete. 2023-09-30T22:57:32.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:57:32.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.335+0000 7f4a0e7ff700 1 Processor -- start 2023-09-30T22:57:32.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.335+0000 7f4a0e7ff700 1 -- start start 2023-09-30T22:57:32.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.336+0000 7f4a0e7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4a080ac3a0 0x7f4a080aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.336+0000 7f4a0e7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a08068000 con 0x7f4a08159b50 2023-09-30T22:57:32.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.336+0000 7f4a0e7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a08068240 con 0x7f4a0806b930 2023-09-30T22:57:32.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.336+0000 7f4a0e7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a08069f10 con 0x7f4a080ac3a0 2023-09-30T22:57:32.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a07fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4a08159b50 0x7f4a080a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54664/0 (socket says 172.21.15.142:54664) 2023-09-30T22:57:32.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a07fff700 1 -- 172.21.15.142:0/1526285287 learned_addr learned my addr 172.21.15.142:0/1526285287 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:32.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a077fe700 1 --2- 172.21.15.142:0/1526285287 >> v2:172.21.15.148:3300/0 conn(0x7f4a080ac3a0 0x7f4a080aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387638050 0 0) 0x7f49f8001110 con 0x7f4a08159b50 2023-09-30T22:57:32.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f0003570 con 0x7f4a08159b50 2023-09-30T22:57:32.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056387007 0 0) 0x7f4a08068240 con 0x7f4a0806b930 2023-09-30T22:57:32.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f8001110 con 0x7f4a0806b930 2023-09-30T22:57:32.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610611928 0 0) 0x7f49f0003570 con 0x7f4a08159b50 2023-09-30T22:57:32.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 >> v2:172.21.15.148:3300/0 conn(0x7f4a080ac3a0 msgr2=0x7f4a080aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:32.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 --2- 172.21.15.142:0/1526285287 >> v2:172.21.15.148:3300/0 conn(0x7f4a080ac3a0 0x7f4a080aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 >> v1:172.21.15.148:6789/0 conn(0x7f4a0806b930 legacy=0x7f4a08163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08068520 con 0x7f4a08159b50 2023-09-30T22:57:32.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.337+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f49f8001600 con 0x7f4a08159b50 2023-09-30T22:57:32.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 >> v1:172.21.15.142:6789/0 conn(0x7f4a08159b50 legacy=0x7f4a080a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a06ffd700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f0003bf0 0x7f49f0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a06ffd700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49f0004810 0x7f49f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a06ffd700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49f00051c0 0x7f49f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08069f10 con 0x7f49f00051c0 2023-09-30T22:57:32.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f000c0b0 con 0x7f49f0003bf0 2023-09-30T22:57:32.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f000c270 con 0x7f49f0004810 2023-09-30T22:57:32.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a0cd9c700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49f00051c0 0x7f49f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a07fff700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f0003bf0 0x7f49f0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a077fe700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49f0004810 0x7f49f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49f0004810 msgr2=0x7f49f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:32.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a0cd9c700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49f0004810 0x7f49f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f0003bf0 msgr2=0x7f49f0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:32.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a0cd9c700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f0003bf0 0x7f49f0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/1526285287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f0003570 con 0x7f49f00051c0 2023-09-30T22:57:32.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.338+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/1526285287 reap_dead start 2023-09-30T22:57:32.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0cd9c700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49f00051c0 0x7f49f000ba60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4a00002120 tx=0x7f4a000017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8c7fe3e412094a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:32.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000c980 con 0x7f49f00051c0 2023-09-30T22:57:32.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0000cae0 con 0x7f49f00051c0 2023-09-30T22:57:32.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a06ffd700 1 -- 172.21.15.142:0/1526285287 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000ce80 con 0x7f49f00051c0 2023-09-30T22:57:32.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/1526285287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49f00051c0 msgr2=0x7f49f000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49f00051c0 0x7f49f000ba60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4a00002120 tx=0x7f4a000017a0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/1526285287 shutdown_connections 2023-09-30T22:57:32.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/1526285287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49f00051c0 0x7f49f000ba60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/1526285287 >> 172.21.15.142:0/1526285287 conn(0x7f4a0806dab0 msgr2=0x7f4a080aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:32.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/1526285287 shutdown_connections 2023-09-30T22:57:32.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.339+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/1526285287 wait complete. 2023-09-30T22:57:32.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.341+0000 7f4a0e7ff700 1 Processor -- start 2023-09-30T22:57:32.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.341+0000 7f4a0e7ff700 1 -- start start 2023-09-30T22:57:32.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0e7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f00051c0 0x7f4a0814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0e7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4a080cc2f0 0x7f4a080ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0e7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080acdf0 0x7f4a0815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0e7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0815ee70 con 0x7f4a080acdf0 2023-09-30T22:57:32.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0e7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080ad260 con 0x7f49f00051c0 2023-09-30T22:57:32.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0e7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0815e260 con 0x7f4a080cc2f0 2023-09-30T22:57:32.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0cd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080acdf0 0x7f4a0815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0cd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080acdf0 0x7f4a0815d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50402/0 (socket says 172.21.15.142:50402) 2023-09-30T22:57:32.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/573694134 learned_addr learned my addr 172.21.15.142:0/573694134 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:32.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a07fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f00051c0 0x7f4a0814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.342+0000 7f4a077fe700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4a080cc2f0 0x7f4a080ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/573694134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4a080cc2f0 msgr2=0x7f4a080ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0cd9c700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4a080cc2f0 0x7f4a080ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/573694134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f00051c0 msgr2=0x7f4a0814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0cd9c700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f00051c0 0x7f4a0814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0cd9c700 1 -- 172.21.15.142:0/573694134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0815e540 con 0x7f4a080acdf0 2023-09-30T22:57:32.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0cd9c700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080acdf0 0x7f4a0815d610 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c6a0 tx=0x7f4a00015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:32.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000c6d0 con 0x7f4a080acdf0 2023-09-30T22:57:32.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00006ba0 con 0x7f4a080acdf0 2023-09-30T22:57:32.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0815e820 con 0x7f4a080acdf0 2023-09-30T22:57:32.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0001e400 con 0x7f4a080acdf0 2023-09-30T22:57:32.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.343+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0814cfb0 con 0x7f4a080acdf0 2023-09-30T22:57:32.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.344+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0815ecc0 con 0x7f4a080acdf0 2023-09-30T22:57:32.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.345+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4a00019070 con 0x7f4a080acdf0 2023-09-30T22:57:32.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.346+0000 7f49effff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f49f4067330 0x7f49f40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.346+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a00085b30 con 0x7f4a080acdf0 2023-09-30T22:57:32.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.346+0000 7f4a07fff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f49f4067330 0x7f49f40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.346+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f49f406f4f0 con 0x7f4a080acdf0 2023-09-30T22:57:32.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.347+0000 7f4a07fff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f49f4067330 0x7f49f40697e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4a080cc8c0 tx=0x7f49f80079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:32.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.350+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4a00024020 con 0x7f4a080acdf0 2023-09-30T22:57:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.361+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(97..97 src has 1..97) v4 ==== 288+0+0 (secure 0 0 0) 0x7f4a00001a50 con 0x7f4a080acdf0 2023-09-30T22:57:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.361+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f49f406fe40 con 0x7f4a080acdf0 2023-09-30T22:57:32.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.583+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a0806c140 con 0x7f4a080acdf0 2023-09-30T22:57:32.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.583+0000 7f49effff700 1 -- 172.21.15.142:0/573694134 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f4a00017070 con 0x7f4a080acdf0 2023-09-30T22:57:32.585 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:32.585 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:56:40.902309+0000","modified":"2023-09-30T22:56:44.449514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3908259553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3908259553},{"type":"v1","addr":"172.21.15.148:6835","nonce":3908259553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-09-30T22:57:32.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f49f4067330 msgr2=0x7f49f40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f49f4067330 0x7f49f40697e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4a080cc8c0 tx=0x7f49f80079d0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080acdf0 msgr2=0x7f4a0815d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080acdf0 0x7f4a0815d610 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c6a0 tx=0x7f4a00015000 comp rx=0 tx=0).stop 2023-09-30T22:57:32.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 shutdown_connections 2023-09-30T22:57:32.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f49f4067330 0x7f49f40697e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080acdf0 0x7f4a0815d610 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f00051c0 0x7f4a0814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 --2- 172.21.15.142:0/573694134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4a080cc2f0 0x7f4a080ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 >> 172.21.15.142:0/573694134 conn(0x7f4a0806dab0 msgr2=0x7f4a0814e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:32.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 shutdown_connections 2023-09-30T22:57:32.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.586+0000 7f4a0e7ff700 1 -- 172.21.15.142:0/573694134 wait complete. 2023-09-30T22:57:32.588 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 41 2023-09-30T22:57:32.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:57:32.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.791+0000 7f1cb15ff700 1 Processor -- start 2023-09-30T22:57:32.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.791+0000 7f1cb15ff700 1 -- start start 2023-09-30T22:57:32.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.792+0000 7f1cb15ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1cac143350 0x7f1cac0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.792+0000 7f1cb15ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0cc6b0 con 0x7f1cac0692f0 2023-09-30T22:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1cb15ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0cb7d0 con 0x7f1cac15de20 2023-09-30T22:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1cb15ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac0cbaa0 con 0x7f1cac143350 2023-09-30T22:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1caaffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1cac143350 0x7f1cac0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1caa7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1cac0692f0 0x7f1cac15d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54680/0 (socket says 172.21.15.142:54680) 2023-09-30T22:57:32.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1caa7fc700 1 -- 172.21.15.142:0/2074072187 learned_addr learned my addr 172.21.15.142:0/2074072187 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1caaffd700 1 -- 172.21.15.142:0/2074072187 >> v1:172.21.15.148:6789/0 conn(0x7f1cac15de20 legacy=0x7f1cac06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1caaffd700 1 -- 172.21.15.142:0/2074072187 >> v1:172.21.15.142:6789/0 conn(0x7f1cac0692f0 legacy=0x7f1cac15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1caaffd700 1 -- 172.21.15.142:0/2074072187 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0cbd80 con 0x7f1cac143350 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1ca9ffb700 1 -- 172.21.15.142:0/2074072187 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839929797 0 0) 0x7f1cac0cc6b0 con 0x7f1cac0692f0 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.793+0000 7f1caaffd700 1 --2- 172.21.15.142:0/2074072187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac0cb290 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098e0 tx=0x7f1c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33c98503178b259 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1ca9ffb700 1 -- 172.21.15.142:0/2074072187 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c009e80 con 0x7f1cac143350 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1ca9ffb700 1 -- 172.21.15.142:0/2074072187 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00b860 con 0x7f1cac143350 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1ca9ffb700 1 -- 172.21.15.142:0/2074072187 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00bbe0 con 0x7f1cac143350 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1cb15ff700 1 -- 172.21.15.142:0/2074072187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 msgr2=0x7f1cac0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/2074072187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac0cb290 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098e0 tx=0x7f1c9c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1cb15ff700 1 -- 172.21.15.142:0/2074072187 shutdown_connections 2023-09-30T22:57:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/2074072187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac0cb290 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1cb15ff700 1 -- 172.21.15.142:0/2074072187 >> 172.21.15.142:0/2074072187 conn(0x7f1cac0ce8e0 msgr2=0x7f1cac0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1cb15ff700 1 -- 172.21.15.142:0/2074072187 shutdown_connections 2023-09-30T22:57:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.794+0000 7f1cb15ff700 1 -- 172.21.15.142:0/2074072187 wait complete. 2023-09-30T22:57:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.796+0000 7f1cb15ff700 1 Processor -- start 2023-09-30T22:57:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.797+0000 7f1cb15ff700 1 -- start start 2023-09-30T22:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1cb15ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac0692f0 0x7f1cac0a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1cb15ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1cb15ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cac15de20 0x7f1cac0a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1cb15ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac15b160 con 0x7f1cac143350 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1cb15ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0a63b0 con 0x7f1cac0692f0 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1cb15ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0a6610 con 0x7f1cac15de20 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1caa7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1caa7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50424/0 (socket says 172.21.15.142:50424) 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1caa7fc700 1 -- 172.21.15.142:0/1197950102 learned_addr learned my addr 172.21.15.142:0/1197950102 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1caaffd700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac0692f0 0x7f1cac0a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.798+0000 7f1cab7fe700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cac15de20 0x7f1cac0a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1caa7fc700 1 -- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cac15de20 msgr2=0x7f1cac0a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1caa7fc700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cac15de20 0x7f1cac0a71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1caa7fc700 1 -- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac0692f0 msgr2=0x7f1cac0a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:32.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1caa7fc700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac0692f0 0x7f1cac0a5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1caa7fc700 1 -- 172.21.15.142:0/1197950102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c009420 con 0x7f1cac143350 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1cab7fe700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cac15de20 0x7f1cac0a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1caa7fc700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac13f5d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000c810 tx=0x7f1ca0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0005c00 con 0x7f1cac143350 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca0005d60 con 0x7f1cac143350 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007320 con 0x7f1cac143350 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac0a68f0 con 0x7f1cac143350 2023-09-30T22:57:32.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.799+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac15b3b0 con 0x7f1cac143350 2023-09-30T22:57:32.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.800+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac06ea70 con 0x7f1cac143350 2023-09-30T22:57:32.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.801+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1ca001b3b0 con 0x7f1cac143350 2023-09-30T22:57:32.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.802+0000 7f1c92ffd700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c98067330 0x7f1c980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:32.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.802+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ca0084110 con 0x7f1cac143350 2023-09-30T22:57:32.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.803+0000 7f1caaffd700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c98067330 0x7f1c980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:32.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.803+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f1c9806f4f0 con 0x7f1cac143350 2023-09-30T22:57:32.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.803+0000 7f1caaffd700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c98067330 0x7f1c980697e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0093f0 tx=0x7f1c9c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.806+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1ca0051010 con 0x7f1cac143350 2023-09-30T22:57:32.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:32.999+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cac0cc060 con 0x7f1cac143350 2023-09-30T22:57:33.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.000+0000 7f1c92ffd700 1 -- 172.21.15.142:0/1197950102 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17100 (secure 0 0 0) 0x7f1ca0017070 con 0x7f1cac143350 2023-09-30T22:57:33.001 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:33.001 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":97,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:57:32.351433+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:56:38.664603+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-09-30T22:56:39.889523+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:57:33.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c98067330 msgr2=0x7f1c980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c98067330 0x7f1c980697e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0093f0 tx=0x7f1c9c017000 comp rx=0 tx=0).stop 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 msgr2=0x7f1cac13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac13f5d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000c810 tx=0x7f1ca0007d90 comp rx=0 tx=0).stop 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 shutdown_connections 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c98067330 0x7f1c980697e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1cac15de20 0x7f1cac0a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac0692f0 0x7f1cac0a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 --2- 172.21.15.142:0/1197950102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cac143350 0x7f1cac13f5d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 >> 172.21.15.142:0/1197950102 conn(0x7f1cac0ce8e0 msgr2=0x7f1cac0cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 shutdown_connections 2023-09-30T22:57:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.002+0000 7f1cb15ff700 1 -- 172.21.15.142:0/1197950102 wait complete. 2023-09-30T22:57:33.020 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:57:33.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:57:33.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.209+0000 7f3ae7dff700 1 Processor -- start 2023-09-30T22:57:33.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.209+0000 7f3ae7dff700 1 -- start start 2023-09-30T22:57:33.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.210+0000 7f3ae7dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3ae0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.210+0000 7f3ae7dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae006d3e0 con 0x7f3ae00b00d0 2023-09-30T22:57:33.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.210+0000 7f3ae7dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae006dc80 con 0x7f3ae006e820 2023-09-30T22:57:33.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.210+0000 7f3ae7dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae006b790 con 0x7f3ae00af020 2023-09-30T22:57:33.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.210+0000 7f3ae539a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3ae00b00d0 0x7f3ae006e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54696/0 (socket says 172.21.15.142:54696) 2023-09-30T22:57:33.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae539a700 1 -- 172.21.15.142:0/1790330869 learned_addr learned my addr 172.21.15.142:0/1790330869 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229954370 0 0) 0x7f3ae006d3e0 con 0x7f3ae00b00d0 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae5b9b700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3ae0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3acc003570 con 0x7f3ae00b00d0 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3125828578 0 0) 0x7f3acc003570 con 0x7f3ae00b00d0 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 msgr2=0x7f3ae0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3ae0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 >> v1:172.21.15.148:6789/0 conn(0x7f3ae006e820 legacy=0x7f3ae015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00b0650 con 0x7f3ae00b00d0 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f3ad0001470 con 0x7f3ae00b00d0 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 >> v1:172.21.15.142:6789/0 conn(0x7f3ae00b00d0 legacy=0x7f3ae006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc003a90 0x7f3acc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3acc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3acc004d50 0x7f3acc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae006b790 con 0x7f3acc004d50 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc00bbf0 con 0x7f3acc003a90 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.211+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc00bd80 con 0x7f3ae00af020 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae5b9b700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc003a90 0x7f3acc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae639c700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3acc004d50 0x7f3acc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae539a700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3acc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae539a700 1 -- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc003a90 msgr2=0x7f3acc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae539a700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc003a90 0x7f3acc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae539a700 1 -- 172.21.15.142:0/1790330869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3acc004d50 msgr2=0x7f3acc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae539a700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3acc004d50 0x7f3acc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae539a700 1 -- 172.21.15.142:0/1790330869 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc003570 con 0x7f3ae00af020 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae5b9b700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc003a90 0x7f3acc003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae639c700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3acc004d50 0x7f3acc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.212+0000 7f3ae539a700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3acc004810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c2a0 tx=0x7f3ae00b0540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ead7fbe1e857385b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000cb70 con 0x7f3ae00af020 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad000ccd0 con 0x7f3ae00af020 2023-09-30T22:57:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae4b99700 1 -- 172.21.15.142:0/1790330869 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0005b70 con 0x7f3ae00af020 2023-09-30T22:57:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae7dff700 1 -- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 msgr2=0x7f3acc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae7dff700 1 --2- 172.21.15.142:0/1790330869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3acc004810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c2a0 tx=0x7f3ae00b0540 comp rx=0 tx=0).stop 2023-09-30T22:57:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae639c700 1 -- 172.21.15.142:0/1790330869 reap_dead start 2023-09-30T22:57:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae7dff700 1 -- 172.21.15.142:0/1790330869 shutdown_connections 2023-09-30T22:57:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae7dff700 1 -- 172.21.15.142:0/1790330869 >> 172.21.15.142:0/1790330869 conn(0x7f3ae00680c0 msgr2=0x7f3ae00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae7dff700 1 -- 172.21.15.142:0/1790330869 shutdown_connections 2023-09-30T22:57:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.213+0000 7f3ae7dff700 1 -- 172.21.15.142:0/1790330869 wait complete. 2023-09-30T22:57:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.215+0000 7f3ae7dff700 1 Processor -- start 2023-09-30T22:57:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.215+0000 7f3ae7dff700 1 -- start start 2023-09-30T22:57:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae7dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3ae013d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae7dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae015af90 0x7f3ae00cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae7dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ae00cc5c0 0x7f3ae0159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae7dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00cca40 con 0x7f3ae015af90 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae7dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0159ef0 con 0x7f3ae00cc5c0 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae7dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae015a1d0 con 0x7f3ae00af020 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae539a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae015af90 0x7f3ae00cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae539a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae015af90 0x7f3ae00cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50444/0 (socket says 172.21.15.142:50444) 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae539a700 1 -- 172.21.15.142:0/3950602966 learned_addr learned my addr 172.21.15.142:0/3950602966 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae639c700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ae00cc5c0 0x7f3ae0159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.216+0000 7f3ae5b9b700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3ae013d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae539a700 1 -- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 msgr2=0x7f3ae013d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae539a700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3ae013d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae539a700 1 -- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ae00cc5c0 msgr2=0x7f3ae0159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae539a700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ae00cc5c0 0x7f3ae0159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae539a700 1 -- 172.21.15.142:0/3950602966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae015a4b0 con 0x7f3ae015af90 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae539a700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae015af90 0x7f3ae00cc080 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0007c00 tx=0x7f3ad0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000ce40 con 0x7f3ae015af90 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad00070d0 con 0x7f3ae015af90 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0007490 con 0x7f3ae015af90 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae015a790 con 0x7f3ae015af90 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.217+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae013dd60 con 0x7f3ae015af90 2023-09-30T22:57:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.219+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae013df50 con 0x7f3ae015af90 2023-09-30T22:57:33.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.219+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3ad0019030 con 0x7f3ae015af90 2023-09-30T22:57:33.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.220+0000 7f3ad5ffb700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ac4067330 0x7f3ac40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.220+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ad0086250 con 0x7f3ae015af90 2023-09-30T22:57:33.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.220+0000 7f3ae5b9b700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ac4067330 0x7f3ac40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.221+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f3ac406f4f0 con 0x7f3ae015af90 2023-09-30T22:57:33.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.221+0000 7f3ae5b9b700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ac4067330 0x7f3ac40697e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00bfd0 tx=0x7f3adc00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:33.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.225+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3ad0053200 con 0x7f3ae015af90 2023-09-30T22:57:33.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.367+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(98..98 src has 1..98) v4 ==== 288+0+0 (secure 0 0 0) 0x7f3ad0056ec0 con 0x7f3ae015af90 2023-09-30T22:57:33.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.367+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f3ac406fe40 con 0x7f3ae015af90 2023-09-30T22:57:33.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.459+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ae015ade0 con 0x7f3ae015af90 2023-09-30T22:57:33.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.460+0000 7f3ad5ffb700 1 -- 172.21.15.142:0/3950602966 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f3ad002b030 con 0x7f3ae015af90 2023-09-30T22:57:33.461 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:33.461 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:56:40.902309+0000","modified":"2023-09-30T22:56:44.449514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3908259553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3908259553},{"type":"v1","addr":"172.21.15.148:6835","nonce":3908259553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ac4067330 msgr2=0x7f3ac40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ac4067330 0x7f3ac40697e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00bfd0 tx=0x7f3adc00d040 comp rx=0 tx=0).stop 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae015af90 msgr2=0x7f3ae00cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae015af90 0x7f3ae00cc080 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0007c00 tx=0x7f3ad0015000 comp rx=0 tx=0).stop 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 shutdown_connections 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ac4067330 0x7f3ac40697e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ae00cc5c0 0x7f3ae0159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ae00af020 0x7f3ae013d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 --2- 172.21.15.142:0/3950602966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae015af90 0x7f3ae00cc080 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.462+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 >> 172.21.15.142:0/3950602966 conn(0x7f3ae00680c0 msgr2=0x7f3ae015bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:33.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.463+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 shutdown_connections 2023-09-30T22:57:33.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.463+0000 7f3ae7dff700 1 -- 172.21.15.142:0/3950602966 wait complete. 2023-09-30T22:57:33.465 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 41 2023-09-30T22:57:33.481 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:57:33.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.668+0000 7f038b5ff700 1 Processor -- start 2023-09-30T22:57:33.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.668+0000 7f038b5ff700 1 -- start start 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f038b5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f03840b00d0 0x7f038406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f038b5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f038406e650 0x7f038415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f038b5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038406d3e0 con 0x7f03840af020 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f038b5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038406dc80 con 0x7f038406e650 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f038b5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038406b790 con 0x7f03840b00d0 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f0389b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f038406e650 0x7f038415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f0389b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f038406e650 0x7f038415a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50460/0 (socket says 172.21.15.142:50460) 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f0389b9c700 1 -- 172.21.15.142:0/1302810832 learned_addr learned my addr 172.21.15.142:0/1302810832 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:33.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.670+0000 7f0388b9a700 1 --2- 172.21.15.142:0/1302810832 >> v2:172.21.15.148:3300/0 conn(0x7f03840b00d0 0x7f038406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f0389b9c700 1 -- 172.21.15.142:0/1302810832 >> v2:172.21.15.148:3300/0 conn(0x7f03840b00d0 msgr2=0x7f038406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f0389b9c700 1 --2- 172.21.15.142:0/1302810832 >> v2:172.21.15.148:3300/0 conn(0x7f03840b00d0 0x7f038406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f0389b9c700 1 -- 172.21.15.142:0/1302810832 >> v1:172.21.15.148:6789/0 conn(0x7f03840af020 legacy=0x7f0384156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f0389b9c700 1 -- 172.21.15.142:0/1302810832 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840b0650 con 0x7f038406e650 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f0389b9c700 1 --2- 172.21.15.142:0/1302810832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038406e650 0x7f038415a3f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f037c00d1a0 tx=0x7f037c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48e0bff01364ed1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f037bfff700 1 -- 172.21.15.142:0/1302810832 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c010070 con 0x7f038406e650 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f037bfff700 1 -- 172.21.15.142:0/1302810832 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c00ddd0 con 0x7f038406e650 2023-09-30T22:57:33.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.671+0000 7f037bfff700 1 -- 172.21.15.142:0/1302810832 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00b320 con 0x7f038406e650 2023-09-30T22:57:33.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 -- 172.21.15.142:0/1302810832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038406e650 msgr2=0x7f038415a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 --2- 172.21.15.142:0/1302810832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038406e650 0x7f038415a3f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f037c00d1a0 tx=0x7f037c00ba50 comp rx=0 tx=0).stop 2023-09-30T22:57:33.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 -- 172.21.15.142:0/1302810832 shutdown_connections 2023-09-30T22:57:33.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 --2- 172.21.15.142:0/1302810832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038406e650 0x7f038415a3f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 --2- 172.21.15.142:0/1302810832 >> v2:172.21.15.148:3300/0 conn(0x7f03840b00d0 0x7f038406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 -- 172.21.15.142:0/1302810832 >> 172.21.15.142:0/1302810832 conn(0x7f03840680c0 msgr2=0x7f03840c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:33.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 -- 172.21.15.142:0/1302810832 shutdown_connections 2023-09-30T22:57:33.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.672+0000 7f038b5ff700 1 -- 172.21.15.142:0/1302810832 wait complete. 2023-09-30T22:57:33.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.673+0000 7f038b5ff700 1 Processor -- start 2023-09-30T22:57:33.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.673+0000 7f038b5ff700 1 -- start start 2023-09-30T22:57:33.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.674+0000 7f038b5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f038406e650 0x7f03840aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.674+0000 7f038b5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03840af020 0x7f0384165e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.674+0000 7f038b5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840b00d0 0x7f03840a8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.674+0000 7f038b5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03840a82a0 con 0x7f03840b00d0 2023-09-30T22:57:33.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.674+0000 7f038b5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384166890 con 0x7f038406e650 2023-09-30T22:57:33.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.674+0000 7f038b5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0384166b70 con 0x7f03840af020 2023-09-30T22:57:33.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840b00d0 0x7f03840a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840b00d0 0x7f03840a8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50476/0 (socket says 172.21.15.142:50476) 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 -- 172.21.15.142:0/4163771878 learned_addr learned my addr 172.21.15.142:0/4163771878 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0388b9a700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03840af020 0x7f0384165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f038939b700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f038406e650 0x7f03840aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 -- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03840af020 msgr2=0x7f0384165e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03840af020 0x7f0384165e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 -- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f038406e650 msgr2=0x7f03840aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f038406e650 0x7f03840aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 -- 172.21.15.142:0/4163771878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c00bcf0 con 0x7f03840b00d0 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.675+0000 7f0389b9c700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840b00d0 0x7f03840a8730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0384068600 tx=0x7f037c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:33.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.676+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00b4d0 con 0x7f03840b00d0 2023-09-30T22:57:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.676+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c01e410 con 0x7f03840b00d0 2023-09-30T22:57:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.676+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c01e7d0 con 0x7f03840b00d0 2023-09-30T22:57:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.676+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03840a7f30 con 0x7f03840b00d0 2023-09-30T22:57:33.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.676+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03840a75f0 con 0x7f03840b00d0 2023-09-30T22:57:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.677+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03840a8450 con 0x7f03840b00d0 2023-09-30T22:57:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.678+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f037c003040 con 0x7f03840b00d0 2023-09-30T22:57:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.678+0000 7f03797fa700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0368067330 0x7f03680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.678+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f037c088630 con 0x7f03840b00d0 2023-09-30T22:57:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.679+0000 7f038939b700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0368067330 0x7f03680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.679+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f036806f4f0 con 0x7f03840b00d0 2023-09-30T22:57:33.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.679+0000 7f038939b700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0368067330 0x7f03680697e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f03840c8010 tx=0x7f0380009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:33.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.683+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f03840a8450 con 0x7f03840b00d0 2023-09-30T22:57:33.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.919+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03840a8450 con 0x7f03840b00d0 2023-09-30T22:57:33.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.920+0000 7f03797fa700 1 -- 172.21.15.142:0/4163771878 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f03840a8450 con 0x7f03840b00d0 2023-09-30T22:57:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:33.921 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:56:40.902309+0000","modified":"2023-09-30T22:56:44.449514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3908259553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3908259553},{"type":"v1","addr":"172.21.15.148:6835","nonce":3908259553}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-09-30T22:57:33.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0368067330 msgr2=0x7f03680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0368067330 0x7f03680697e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f03840c8010 tx=0x7f0380009040 comp rx=0 tx=0).stop 2023-09-30T22:57:33.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840b00d0 msgr2=0x7f03840a8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:33.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840b00d0 0x7f03840a8730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0384068600 tx=0x7f037c01a000 comp rx=0 tx=0).stop 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 shutdown_connections 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0368067330 0x7f03680697e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840b00d0 0x7f03840a8730 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f038406e650 0x7f03840aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 --2- 172.21.15.142:0/4163771878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03840af020 0x7f0384165e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 >> 172.21.15.142:0/4163771878 conn(0x7f03840680c0 msgr2=0x7f03840cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 shutdown_connections 2023-09-30T22:57:33.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:33.922+0000 7f038b5ff700 1 -- 172.21.15.142:0/4163771878 wait complete. 2023-09-30T22:57:33.925 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 41 2023-09-30T22:57:33.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:57:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.128+0000 7fbd4f3ff700 1 Processor -- start 2023-09-30T22:57:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.129+0000 7fbd4f3ff700 1 -- start start 2023-09-30T22:57:34.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4f3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbd48159ae0 0x7fbd480cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4f3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd480b1180 0x7fbd480cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4f3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4815d910 con 0x7fbd48159eb0 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4f3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4815e920 con 0x7fbd480b1180 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4f3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4815e490 con 0x7fbd48159ae0 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4c99a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd480b1180 0x7fbd480cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4c99a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd480b1180 0x7fbd480cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50490/0 (socket says 172.21.15.142:50490) 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1556546387 learned_addr learned my addr 172.21.15.142:0/1556546387 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4d19b700 1 --2- 172.21.15.142:0/1556546387 >> v2:172.21.15.148:3300/0 conn(0x7fbd48159ae0 0x7fbd480cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1556546387 >> v2:172.21.15.148:3300/0 conn(0x7fbd48159ae0 msgr2=0x7fbd480cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4c99a700 1 --2- 172.21.15.142:0/1556546387 >> v2:172.21.15.148:3300/0 conn(0x7fbd48159ae0 0x7fbd480cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1556546387 >> v1:172.21.15.148:6789/0 conn(0x7fbd48159eb0 legacy=0x7fbd48068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1556546387 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4815db60 con 0x7fbd480b1180 2023-09-30T22:57:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.130+0000 7fbd4d19b700 1 --2- 172.21.15.142:0/1556546387 >> v2:172.21.15.148:3300/0 conn(0x7fbd48159ae0 0x7fbd480cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:34.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.131+0000 7fbd4c99a700 1 --2- 172.21.15.142:0/1556546387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd480b1180 0x7fbd480cbe80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbd480cb650 tx=0x7fbd38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18929de8212ff991 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.131+0000 7fbd3ffff700 1 -- 172.21.15.142:0/1556546387 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800b820 con 0x7fbd480b1180 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.131+0000 7fbd3ffff700 1 -- 172.21.15.142:0/1556546387 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800b980 con 0x7fbd480b1180 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.131+0000 7fbd3ffff700 1 -- 172.21.15.142:0/1556546387 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800bd20 con 0x7fbd480b1180 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.131+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1556546387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd480b1180 msgr2=0x7fbd480cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.131+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1556546387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd480b1180 0x7fbd480cbe80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbd480cb650 tx=0x7fbd38009250 comp rx=0 tx=0).stop 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.132+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1556546387 shutdown_connections 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.132+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1556546387 >> v2:172.21.15.148:3300/0 conn(0x7fbd48159ae0 0x7fbd480cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.132+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1556546387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd480b1180 0x7fbd480cbe80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.132+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1556546387 >> 172.21.15.142:0/1556546387 conn(0x7fbd480ce8b0 msgr2=0x7fbd480cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.132+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1556546387 shutdown_connections 2023-09-30T22:57:34.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.132+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1556546387 wait complete. 2023-09-30T22:57:34.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.134+0000 7fbd4f3ff700 1 Processor -- start 2023-09-30T22:57:34.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.134+0000 7fbd4f3ff700 1 -- start start 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4f3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd480b1180 0x7fbd48169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4f3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd48159ae0 0x7fbd480ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4f3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd48159eb0 0x7fbd480ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4f3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48155ec0 con 0x7fbd48159ae0 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4f3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481561a0 con 0x7fbd480b1180 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4f3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48156480 con 0x7fbd48159eb0 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4c99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd48159ae0 0x7fbd480ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4c99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd48159ae0 0x7fbd480ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50496/0 (socket says 172.21.15.142:50496) 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.135+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1561259161 learned_addr learned my addr 172.21.15.142:0/1561259161 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4d19b700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd480b1180 0x7fbd48169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4d99c700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd48159eb0 0x7fbd480ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd48159eb0 msgr2=0x7fbd480ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4c99a700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd48159eb0 0x7fbd480ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd480b1180 msgr2=0x7fbd48169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4c99a700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd480b1180 0x7fbd48169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4c99a700 1 -- 172.21.15.142:0/1561259161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380094f0 con 0x7fbd48159ae0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4c99a700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd48159ae0 0x7fbd480ca090 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbd380030c0 tx=0x7fbd38016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38011d00 con 0x7fbd48159ae0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd38020070 con 0x7fbd48159ae0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd48156760 con 0x7fbd48159ae0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.136+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3801b6a0 con 0x7fbd48159ae0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.137+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4816a4e0 con 0x7fbd48159ae0 2023-09-30T22:57:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.137+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4806ea70 con 0x7fbd48159ae0 2023-09-30T22:57:34.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.138+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbd38022030 con 0x7fbd48159ae0 2023-09-30T22:57:34.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.139+0000 7fbd3d7fa700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd2c067330 0x7fbd2c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.139+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbd38086a90 con 0x7fbd48159ae0 2023-09-30T22:57:34.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.140+0000 7fbd4d19b700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd2c067330 0x7fbd2c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.140+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7fbd2c06f4f0 con 0x7fbd48159ae0 2023-09-30T22:57:34.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.140+0000 7fbd4d19b700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd2c067330 0x7fbd2c0697e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400adc0 tx=0x7fbd44006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:34.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.143+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbd38011e60 con 0x7fbd48159ae0 2023-09-30T22:57:34.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.336+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd4806ea70 con 0x7fbd48159ae0 2023-09-30T22:57:34.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.337+0000 7fbd3d7fa700 1 -- 172.21.15.142:0/1561259161 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+17085 (secure 0 0 0) 0x7fbd38011e60 con 0x7fbd48159ae0 2023-09-30T22:57:34.338 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:34.339 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":98,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:57:33.358241+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:56:38.664603+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-09-30T22:56:39.889523+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.339+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd2c067330 msgr2=0x7fbd2c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.339+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd2c067330 0x7fbd2c0697e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400adc0 tx=0x7fbd44006f90 comp rx=0 tx=0).stop 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.339+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd48159ae0 msgr2=0x7fbd480ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.339+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd48159ae0 0x7fbd480ca090 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbd380030c0 tx=0x7fbd38016000 comp rx=0 tx=0).stop 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 shutdown_connections 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbd2c067330 0x7fbd2c0697e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd48159eb0 0x7fbd480ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd480b1180 0x7fbd48169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 --2- 172.21.15.142:0/1561259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd48159ae0 0x7fbd480ca090 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 >> 172.21.15.142:0/1561259161 conn(0x7fbd480ce8b0 msgr2=0x7fbd480b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:34.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 shutdown_connections 2023-09-30T22:57:34.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.340+0000 7fbd4f3ff700 1 -- 172.21.15.142:0/1561259161 wait complete. 2023-09-30T22:57:34.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:57:34.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.551+0000 7f9d77fff700 1 Processor -- start 2023-09-30T22:57:34.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.551+0000 7f9d77fff700 1 -- start start 2023-09-30T22:57:34.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.552+0000 7f9d77fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d700b1180 0x7f9d700cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.552+0000 7f9d77fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9d70159eb0 0x7f9d700cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.552+0000 7f9d77fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7015d910 con 0x7f9d70159ae0 2023-09-30T22:57:34.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.552+0000 7f9d77fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7015e920 con 0x7f9d70159eb0 2023-09-30T22:57:34.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.552+0000 7f9d77fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7015e490 con 0x7f9d700b1180 2023-09-30T22:57:34.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9d70159eb0 0x7f9d700cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9d70159eb0 0x7f9d700cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50502/0 (socket says 172.21.15.142:50502) 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 -- 172.21.15.142:0/2896254666 learned_addr learned my addr 172.21.15.142:0/2896254666 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7559a700 1 --2- 172.21.15.142:0/2896254666 >> v2:172.21.15.148:3300/0 conn(0x7f9d700b1180 0x7f9d700cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 -- 172.21.15.142:0/2896254666 >> v2:172.21.15.148:3300/0 conn(0x7f9d700b1180 msgr2=0x7f9d700cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 --2- 172.21.15.142:0/2896254666 >> v2:172.21.15.148:3300/0 conn(0x7f9d700b1180 0x7f9d700cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 -- 172.21.15.142:0/2896254666 >> v1:172.21.15.148:6789/0 conn(0x7f9d70159ae0 legacy=0x7f9d700cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 -- 172.21.15.142:0/2896254666 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700ce5c0 con 0x7f9d70159eb0 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7559a700 1 --2- 172.21.15.142:0/2896254666 >> v2:172.21.15.148:3300/0 conn(0x7f9d700b1180 0x7f9d700cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d7659c700 1 --2- 172.21.15.142:0/2896254666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d700cc3c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9d70067af0 tx=0x7f9d68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c8ff5c46c89bd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d74d99700 1 -- 172.21.15.142:0/2896254666 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800e070 con 0x7f9d70159eb0 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d74d99700 1 -- 172.21.15.142:0/2896254666 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6800ba10 con 0x7f9d70159eb0 2023-09-30T22:57:34.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.553+0000 7f9d74d99700 1 -- 172.21.15.142:0/2896254666 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680092e0 con 0x7f9d70159eb0 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 -- 172.21.15.142:0/2896254666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 msgr2=0x7f9d700cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 --2- 172.21.15.142:0/2896254666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d700cc3c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9d70067af0 tx=0x7f9d68009840 comp rx=0 tx=0).stop 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 -- 172.21.15.142:0/2896254666 shutdown_connections 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 --2- 172.21.15.142:0/2896254666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d700cc3c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 --2- 172.21.15.142:0/2896254666 >> v2:172.21.15.148:3300/0 conn(0x7f9d700b1180 0x7f9d700cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 -- 172.21.15.142:0/2896254666 >> 172.21.15.142:0/2896254666 conn(0x7f9d700ce8b0 msgr2=0x7f9d700cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 -- 172.21.15.142:0/2896254666 shutdown_connections 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.554+0000 7f9d77fff700 1 -- 172.21.15.142:0/2896254666 wait complete. 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.556+0000 7f9d77fff700 1 Processor -- start 2023-09-30T22:57:34.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.556+0000 7f9d77fff700 1 -- start start 2023-09-30T22:57:34.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d700b1180 0x7f9d70144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d77fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d70159ae0 0x7f9d70155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d77fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d701442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d77fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d701564b0 con 0x7f9d70159eb0 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d77fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700c85d0 con 0x7f9d700b1180 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d77fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700c7ca0 con 0x7f9d70159ae0 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d701442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d701442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50504/0 (socket says 172.21.15.142:50504) 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 -- 172.21.15.142:0/1707211663 learned_addr learned my addr 172.21.15.142:0/1707211663 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7559a700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d70159ae0 0x7f9d70155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d75d9b700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d700b1180 0x7f9d70144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 -- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d70159ae0 msgr2=0x7f9d70155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d70159ae0 0x7f9d70155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 -- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d700b1180 msgr2=0x7f9d70144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d700b1180 0x7f9d70144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 -- 172.21.15.142:0/1707211663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68009ae0 con 0x7f9d70159eb0 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.557+0000 7f9d7659c700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d701442c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009fd0 tx=0x7f9d68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.558+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800bee0 con 0x7f9d70159eb0 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.558+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68012e90 con 0x7f9d70159eb0 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.558+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6801d670 con 0x7f9d70159eb0 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.558+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d700c7f80 con 0x7f9d70159eb0 2023-09-30T22:57:34.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.558+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d701450a0 con 0x7f9d70159eb0 2023-09-30T22:57:34.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.559+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d70068230 con 0x7f9d70159eb0 2023-09-30T22:57:34.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.560+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9d6801da20 con 0x7f9d70159eb0 2023-09-30T22:57:34.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.560+0000 7f9d65ffb700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9d54067330 0x7f9d540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:34.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.560+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9d680864d0 con 0x7f9d70159eb0 2023-09-30T22:57:34.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.561+0000 7f9d75d9b700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9d54067330 0x7f9d540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:34.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.561+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x7f9d5406f4f0 con 0x7f9d70159eb0 2023-09-30T22:57:34.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.561+0000 7f9d75d9b700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9d54067330 0x7f9d540697e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c003870 tx=0x7f9d6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:34.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.565+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9d68053330 con 0x7f9d70159eb0 2023-09-30T22:57:34.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.800+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9d700c8760 con 0x7f9d70159eb0 2023-09-30T22:57:34.801 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:57:34.801+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:57:34.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.803+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(100..100 src has 1..100) v4 ==== 374+0+0 (secure 0 0 0) 0x7f9d680576f0 con 0x7f9d70159eb0 2023-09-30T22:57:34.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.803+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7f9d5406fe40 con 0x7f9d70159eb0 2023-09-30T22:57:34.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.806+0000 7f9d65ffb700 1 -- 172.21.15.142:0/1707211663 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9d6802a020 con 0x7f9d70159eb0 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.809+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9d54067330 msgr2=0x7f9d540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.809+0000 7f9d77fff700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9d54067330 0x7f9d540697e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c003870 tx=0x7f9d6c009040 comp rx=0 tx=0).stop 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.809+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 msgr2=0x7f9d701442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.809+0000 7f9d77fff700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d701442c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009fd0 tx=0x7f9d68017000 comp rx=0 tx=0).stop 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 shutdown_connections 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9d54067330 0x7f9d540697e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d70159eb0 0x7f9d701442c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d700b1180 0x7f9d70144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 --2- 172.21.15.142:0/1707211663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d70159ae0 0x7f9d70155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:34.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 >> 172.21.15.142:0/1707211663 conn(0x7f9d700ce8b0 msgr2=0x7f9d700b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:34.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 shutdown_connections 2023-09-30T22:57:34.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:34.810+0000 7f9d77fff700 1 -- 172.21.15.142:0/1707211663 wait complete. 2023-09-30T22:57:34.812 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:57:34.828 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:57:34.870 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:57:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.019+0000 7f9cd65ff700 1 Processor -- start 2023-09-30T22:57:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.019+0000 7f9cd65ff700 1 -- start start 2023-09-30T22:57:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.021+0000 7f9cd65ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cbfe0 0x7f9cd015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.021+0000 7f9cd65ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd00d0550 con 0x7f9cd0157ab0 2023-09-30T22:57:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.021+0000 7f9cd65ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd00cf940 con 0x7f9cd00cc3b0 2023-09-30T22:57:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.021+0000 7f9cd65ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00cfc20 con 0x7f9cd00cbfe0 2023-09-30T22:57:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.021+0000 7f9cd4b9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9cd0157ab0 0x7f9cd006a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54702/0 (socket says 172.21.15.142:54702) 2023-09-30T22:57:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.021+0000 7f9cd4b9c700 1 -- 172.21.15.142:0/1174363829 learned_addr learned my addr 172.21.15.142:0/1174363829 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.021+0000 7f9ccffff700 1 --2- 172.21.15.142:0/1174363829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cbfe0 0x7f9cd015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9ccffff700 1 -- 172.21.15.142:0/1174363829 >> v1:172.21.15.148:6789/0 conn(0x7f9cd00cc3b0 legacy=0x7f9cd01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9ccffff700 1 -- 172.21.15.142:0/1174363829 >> v1:172.21.15.142:6789/0 conn(0x7f9cd0157ab0 legacy=0x7f9cd006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9cceffd700 1 -- 172.21.15.142:0/1174363829 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93828121 0 0) 0x7f9cd00d0550 con 0x7f9cd0157ab0 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9ccffff700 1 -- 172.21.15.142:0/1174363829 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00cff00 con 0x7f9cd00cbfe0 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9ccffff700 1 --2- 172.21.15.142:0/1174363829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cbfe0 0x7f9cd015a2a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00098c0 tx=0x7f9cc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c878c329c0661e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9cceffd700 1 -- 172.21.15.142:0/1174363829 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0009e60 con 0x7f9cd00cbfe0 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9cceffd700 1 -- 172.21.15.142:0/1174363829 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000b7e0 con 0x7f9cd00cbfe0 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.022+0000 7f9cceffd700 1 -- 172.21.15.142:0/1174363829 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000bb80 con 0x7f9cd00cbfe0 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.023+0000 7f9cd65ff700 1 -- 172.21.15.142:0/1174363829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cbfe0 msgr2=0x7f9cd015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:35.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.023+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/1174363829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cbfe0 0x7f9cd015a2a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00098c0 tx=0x7f9cc00091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.023+0000 7f9cd65ff700 1 -- 172.21.15.142:0/1174363829 shutdown_connections 2023-09-30T22:57:35.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.023+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/1174363829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cbfe0 0x7f9cd015a2a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.023+0000 7f9cd65ff700 1 -- 172.21.15.142:0/1174363829 >> 172.21.15.142:0/1174363829 conn(0x7f9cd00d0a80 msgr2=0x7f9cd00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:35.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.023+0000 7f9cd65ff700 1 -- 172.21.15.142:0/1174363829 shutdown_connections 2023-09-30T22:57:35.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.023+0000 7f9cd65ff700 1 -- 172.21.15.142:0/1174363829 wait complete. 2023-09-30T22:57:35.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.024+0000 7f9cd65ff700 1 Processor -- start 2023-09-30T22:57:35.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.024+0000 7f9cd65ff700 1 -- start start 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.025+0000 7f9cd65ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cd00cbfe0 0x7f9cd00cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.025+0000 7f9cd65ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cc3b0 0x7f9cd00c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.025+0000 7f9cd65ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cd0157ab0 0x7f9cd0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.025+0000 7f9cd65ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd016ef10 con 0x7f9cd0157ab0 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.025+0000 7f9cd65ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00c6660 con 0x7f9cd00cbfe0 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.025+0000 7f9cd65ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00cb8c0 con 0x7f9cd00cc3b0 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cd0157ab0 0x7f9cd0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cd0157ab0 0x7f9cd0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50520/0 (socket says 172.21.15.142:50520) 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 -- 172.21.15.142:0/3500683069 learned_addr learned my addr 172.21.15.142:0/3500683069 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9ccffff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cd00cbfe0 0x7f9cd00cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9ccf7fe700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cc3b0 0x7f9cd00c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 -- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cc3b0 msgr2=0x7f9cd00c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cc3b0 0x7f9cd00c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 -- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cd00cbfe0 msgr2=0x7f9cd00cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cd00cbfe0 0x7f9cd00cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 -- 172.21.15.142:0/3500683069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc0009420 con 0x7f9cd0157ab0 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9ccffff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cd00cbfe0 0x7f9cd00cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.026+0000 7f9cd4b9c700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cd0157ab0 0x7f9cd0157f10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800cbf0 tx=0x7f9cc80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.027+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800a850 con 0x7f9cd0157ab0 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.027+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc800a9b0 con 0x7f9cd0157ab0 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.027+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800ad70 con 0x7f9cd0157ab0 2023-09-30T22:57:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.027+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd016e290 con 0x7f9cd0157ab0 2023-09-30T22:57:35.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.027+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd016e850 con 0x7f9cd0157ab0 2023-09-30T22:57:35.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.028+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd016f050 con 0x7f9cd0157ab0 2023-09-30T22:57:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.029+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9cc8007300 con 0x7f9cd0157ab0 2023-09-30T22:57:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.030+0000 7f9cb7fff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9cbc067330 0x7f9cbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.030+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9cc8084e30 con 0x7f9cd0157ab0 2023-09-30T22:57:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.030+0000 7f9ccffff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9cbc067330 0x7f9cbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.030+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=101}) v3 -- 0x7f9cbc06f590 con 0x7f9cd0157ab0 2023-09-30T22:57:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.030+0000 7f9ccffff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9cbc067330 0x7f9cbc0697e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00030c0 tx=0x7f9cc0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:35.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.034+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9cd016f050 con 0x7f9cd0157ab0 2023-09-30T22:57:35.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.266+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9cd016f050 con 0x7f9cd0157ab0 2023-09-30T22:57:35.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.806+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9cd016f050 con 0x7f9cd0157ab0 2023-09-30T22:57:35.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.809+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 <== mon.0 v2:172.21.15.142:3300/0 8 ==== osd_map(101..101 src has 1..101) v4 ==== 1806+0+0 (secure 0 0 0) 0x7f9cc8056120 con 0x7f9cd0157ab0 2023-09-30T22:57:35.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.809+0000 7f9cb7fff700 1 -- 172.21.15.142:0/3500683069 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=102}) v3 -- 0x7f9cbc070da0 con 0x7f9cd0157ab0 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9cbc067330 msgr2=0x7f9cbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9cbc067330 0x7f9cbc0697e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00030c0 tx=0x7f9cc0016000 comp rx=0 tx=0).stop 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cd0157ab0 msgr2=0x7f9cd0157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cd0157ab0 0x7f9cd0157f10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800cbf0 tx=0x7f9cc80019b0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 shutdown_connections 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9cbc067330 0x7f9cbc0697e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cd0157ab0 0x7f9cd0157f10 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cd00cbfe0 0x7f9cd00cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 --2- 172.21.15.142:0/3500683069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cd00cc3b0 0x7f9cd00c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:35.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 >> 172.21.15.142:0/3500683069 conn(0x7f9cd00d0a80 msgr2=0x7f9cd01554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:35.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.810+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 shutdown_connections 2023-09-30T22:57:35.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:35.811+0000 7f9cd65ff700 1 -- 172.21.15.142:0/3500683069 wait complete. 2023-09-30T22:57:35.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:57:36.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.030+0000 7f96a6bff700 1 Processor -- start 2023-09-30T22:57:36.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.030+0000 7f96a6bff700 1 -- start start 2023-09-30T22:57:36.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.031+0000 7f96a6bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96a00ca5e0 0x7f96a00686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.031+0000 7f96a6bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159de0 0x7f96a0068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f96a6bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a0068230 con 0x7f96a0159a10 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f96a6bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a0067620 con 0x7f96a00ca5e0 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f96a6bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0067900 con 0x7f96a0159de0 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f969ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96a00ca5e0 0x7f96a00686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f96a499b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f96a0159a10 0x7f96a00c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54714/0 (socket says 172.21.15.142:54714) 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f96a499b700 1 -- 172.21.15.142:0/3972325055 learned_addr learned my addr 172.21.15.142:0/3972325055 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f96a519c700 1 --2- 172.21.15.142:0/3972325055 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159de0 0x7f96a0068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f969ffff700 1 -- 172.21.15.142:0/3972325055 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159de0 msgr2=0x7f96a0068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:36.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f969ffff700 1 --2- 172.21.15.142:0/3972325055 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159de0 0x7f96a0068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f969ffff700 1 -- 172.21.15.142:0/3972325055 >> v1:172.21.15.142:6789/0 conn(0x7f96a0159a10 legacy=0x7f96a00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f969ffff700 1 -- 172.21.15.142:0/3972325055 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0067be0 con 0x7f96a00ca5e0 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f969f7fe700 1 -- 172.21.15.142:0/3972325055 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743945264 0 0) 0x7f96a0068230 con 0x7f96a0159a10 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.032+0000 7f96a519c700 1 --2- 172.21.15.142:0/3972325055 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159de0 0x7f96a0068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f969ffff700 1 --2- 172.21.15.142:0/3972325055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a00686c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f968c0098e0 tx=0x7f968c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd82221dff1699f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f969f7fe700 1 -- 172.21.15.142:0/3972325055 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c009e80 con 0x7f96a00ca5e0 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f969f7fe700 1 -- 172.21.15.142:0/3972325055 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00b860 con 0x7f96a00ca5e0 2023-09-30T22:57:36.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f969f7fe700 1 -- 172.21.15.142:0/3972325055 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00bbe0 con 0x7f96a00ca5e0 2023-09-30T22:57:36.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f96a6bff700 1 -- 172.21.15.142:0/3972325055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 msgr2=0x7f96a00686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:36.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f96a6bff700 1 --2- 172.21.15.142:0/3972325055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a00686c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f968c0098e0 tx=0x7f968c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f96a6bff700 1 -- 172.21.15.142:0/3972325055 shutdown_connections 2023-09-30T22:57:36.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f96a6bff700 1 --2- 172.21.15.142:0/3972325055 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159de0 0x7f96a0068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f96a6bff700 1 --2- 172.21.15.142:0/3972325055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a00686c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.033+0000 7f96a6bff700 1 -- 172.21.15.142:0/3972325055 >> 172.21.15.142:0/3972325055 conn(0x7f96a00cb2f0 msgr2=0x7f96a00cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:36.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.034+0000 7f96a6bff700 1 -- 172.21.15.142:0/3972325055 shutdown_connections 2023-09-30T22:57:36.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.034+0000 7f96a6bff700 1 -- 172.21.15.142:0/3972325055 wait complete. 2023-09-30T22:57:36.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.035+0000 7f96a6bff700 1 Processor -- start 2023-09-30T22:57:36.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.035+0000 7f96a6bff700 1 -- start start 2023-09-30T22:57:36.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a6bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a015b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a6bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159a10 0x7f96a0147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a6bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96a0159de0 0x7f96a016aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a6bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0148280 con 0x7f96a00ca5e0 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a6bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a015b390 con 0x7f96a0159de0 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a6bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a016afb0 con 0x7f96a0159a10 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a499b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a499b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a015b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50538/0 (socket says 172.21.15.142:50538) 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a499b700 1 -- 172.21.15.142:0/2151425375 learned_addr learned my addr 172.21.15.142:0/2151425375 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f969ffff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159a10 0x7f96a0147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:36.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.036+0000 7f96a519c700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96a0159de0 0x7f96a016aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a499b700 1 -- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159a10 msgr2=0x7f96a0147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a499b700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159a10 0x7f96a0147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a499b700 1 -- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96a0159de0 msgr2=0x7f96a016aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a499b700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96a0159de0 0x7f96a016aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a499b700 1 -- 172.21.15.142:0/2151425375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c009420 con 0x7f96a00ca5e0 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a499b700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a015b820 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f969400c7e0 tx=0x7f9694007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f969cff9700 1 -- 172.21.15.142:0/2151425375 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694005b30 con 0x7f96a00ca5e0 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f969cff9700 1 -- 172.21.15.142:0/2151425375 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9694005c90 con 0x7f96a00ca5e0 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a0156570 con 0x7f96a00ca5e0 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f969cff9700 1 -- 172.21.15.142:0/2151425375 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694007300 con 0x7f96a00ca5e0 2023-09-30T22:57:36.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.037+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a015aa60 con 0x7f96a00ca5e0 2023-09-30T22:57:36.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.038+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a015b670 con 0x7f96a00ca5e0 2023-09-30T22:57:36.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.039+0000 7f969cff9700 1 -- 172.21.15.142:0/2151425375 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f96940076b0 con 0x7f96a00ca5e0 2023-09-30T22:57:36.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.040+0000 7f969cff9700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9684067330 0x7f96840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:36.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.040+0000 7f969cff9700 1 -- 172.21.15.142:0/2151425375 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9694084740 con 0x7f96a00ca5e0 2023-09-30T22:57:36.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.040+0000 7f969ffff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9684067330 0x7f96840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:36.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.041+0000 7f969ffff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9684067330 0x7f96840697e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f968c0091e0 tx=0x7f968c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:36.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.044+0000 7f969cff9700 1 -- 172.21.15.142:0/2151425375 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f96940515f0 con 0x7f96a00ca5e0 2023-09-30T22:57:36.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.235+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96a0067ec0 con 0x7f96a00ca5e0 2023-09-30T22:57:36.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.817+0000 7f969cff9700 1 -- 172.21.15.142:0/2151425375 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9694054c10 con 0x7f96a00ca5e0 2023-09-30T22:57:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.825+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9684067330 msgr2=0x7f96840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.825+0000 7f96a6bff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9684067330 0x7f96840697e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f968c0091e0 tx=0x7f968c017000 comp rx=0 tx=0).stop 2023-09-30T22:57:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.825+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 msgr2=0x7f96a015b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.825+0000 7f96a6bff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a015b820 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f969400c7e0 tx=0x7f9694007df0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 shutdown_connections 2023-09-30T22:57:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9684067330 0x7f96840697e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96a0159de0 0x7f96a016aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a00ca5e0 0x7f96a015b820 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 --2- 172.21.15.142:0/2151425375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96a0159a10 0x7f96a0147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 >> 172.21.15.142:0/2151425375 conn(0x7f96a00cb2f0 msgr2=0x7f96a0069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 shutdown_connections 2023-09-30T22:57:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:36.826+0000 7f96a6bff700 1 -- 172.21.15.142:0/2151425375 wait complete. 2023-09-30T22:57:36.828 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:57:36.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:57:37.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.042+0000 7efc60dff700 1 Processor -- start 2023-09-30T22:57:37.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.042+0000 7efc60dff700 1 -- start start 2023-09-30T22:57:37.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.043+0000 7efc60dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efc5c15ac40 0x7efc5c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:37.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.043+0000 7efc60dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc5c0cf180 0x7efc5c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.043+0000 7efc60dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c0cc0b0 0x7efc5c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc60dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0d04e0 con 0x7efc5c0cf180 2023-09-30T22:57:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc60dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0cc4d0 con 0x7efc5c15ac40 2023-09-30T22:57:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc60dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0cc8f0 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc5c0cf180 0x7efc5c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc5c0cf180 0x7efc5c0cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50546/0 (socket says 172.21.15.142:50546) 2023-09-30T22:57:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 -- 172.21.15.142:0/1220180627 learned_addr learned my addr 172.21.15.142:0/1220180627 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc5ad9d700 1 --2- 172.21.15.142:0/1220180627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c0cc0b0 0x7efc5c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc5a59c700 1 --2- 172.21.15.142:0/1220180627 >> v2:172.21.15.148:3300/0 conn(0x7efc5c15ac40 0x7efc5c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 -- 172.21.15.142:0/1220180627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c0cc0b0 msgr2=0x7efc5c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 --2- 172.21.15.142:0/1220180627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c0cc0b0 0x7efc5c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 -- 172.21.15.142:0/1220180627 >> v2:172.21.15.148:3300/0 conn(0x7efc5c15ac40 msgr2=0x7efc5c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 --2- 172.21.15.142:0/1220180627 >> v2:172.21.15.148:3300/0 conn(0x7efc5c15ac40 0x7efc5c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.044+0000 7efc59d9b700 1 -- 172.21.15.142:0/1220180627 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c0cf8d0 con 0x7efc5c0cf180 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.045+0000 7efc59d9b700 1 --2- 172.21.15.142:0/1220180627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cf180 0x7efc5c0cbb70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0d1b30 tx=0x7efc50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab013cb5106ee7eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.045+0000 7efc5959a700 1 -- 172.21.15.142:0/1220180627 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5000b640 con 0x7efc5c0cf180 2023-09-30T22:57:37.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.045+0000 7efc5959a700 1 -- 172.21.15.142:0/1220180627 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5000b7a0 con 0x7efc5c0cf180 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.045+0000 7efc5959a700 1 -- 172.21.15.142:0/1220180627 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5000bb60 con 0x7efc5c0cf180 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.045+0000 7efc60dff700 1 -- 172.21.15.142:0/1220180627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cf180 msgr2=0x7efc5c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.045+0000 7efc60dff700 1 --2- 172.21.15.142:0/1220180627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cf180 0x7efc5c0cbb70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0d1b30 tx=0x7efc50009250 comp rx=0 tx=0).stop 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.046+0000 7efc60dff700 1 -- 172.21.15.142:0/1220180627 shutdown_connections 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.046+0000 7efc60dff700 1 --2- 172.21.15.142:0/1220180627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c0cc0b0 0x7efc5c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.046+0000 7efc60dff700 1 --2- 172.21.15.142:0/1220180627 >> v2:172.21.15.148:3300/0 conn(0x7efc5c15ac40 0x7efc5c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.046+0000 7efc60dff700 1 --2- 172.21.15.142:0/1220180627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cf180 0x7efc5c0cbb70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.046+0000 7efc60dff700 1 -- 172.21.15.142:0/1220180627 >> 172.21.15.142:0/1220180627 conn(0x7efc5c0d0a80 msgr2=0x7efc5c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.046+0000 7efc60dff700 1 -- 172.21.15.142:0/1220180627 shutdown_connections 2023-09-30T22:57:37.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.046+0000 7efc60dff700 1 -- 172.21.15.142:0/1220180627 wait complete. 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.047+0000 7efc60dff700 1 Processor -- start 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.047+0000 7efc60dff700 1 -- start start 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc60dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cc0b0 0x7efc5c148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc60dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc5c0cf180 0x7efc5c15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc60dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c15ac40 0x7efc5c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc60dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c1490f0 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc60dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c16a890 con 0x7efc5c0cf180 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc60dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c15c800 con 0x7efc5c15ac40 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc5a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cc0b0 0x7efc5c148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:37.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.048+0000 7efc5a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cc0b0 0x7efc5c148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50552/0 (socket says 172.21.15.142:50552) 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5a59c700 1 -- 172.21.15.142:0/573036107 learned_addr learned my addr 172.21.15.142:0/573036107 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5ad9d700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c15ac40 0x7efc5c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc59d9b700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc5c0cf180 0x7efc5c15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5a59c700 1 -- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c15ac40 msgr2=0x7efc5c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5a59c700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c15ac40 0x7efc5c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5a59c700 1 -- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc5c0cf180 msgr2=0x7efc5c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5a59c700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc5c0cf180 0x7efc5c15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5a59c700 1 -- 172.21.15.142:0/573036107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500094f0 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc59d9b700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc5c0cf180 0x7efc5c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5ad9d700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c15ac40 0x7efc5c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc5a59c700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cc0b0 0x7efc5c148bb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00e960 tx=0x7efc4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:37.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc4a7fc700 1 -- 172.21.15.142:0/573036107 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00c850 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc4a7fc700 1 -- 172.21.15.142:0/573036107 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00c9b0 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc4a7fc700 1 -- 172.21.15.142:0/573036107 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00cd50 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.049+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c15cc90 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.050+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c15bed0 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.050+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c0d1930 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.051+0000 7efc4a7fc700 1 -- 172.21.15.142:0/573036107 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efc4c013680 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.052+0000 7efc4a7fc700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc3c067330 0x7efc3c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:37.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.053+0000 7efc4a7fc700 1 -- 172.21.15.142:0/573036107 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5706+0+0 (secure 0 0 0) 0x7efc4c084cd0 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.053+0000 7efc59d9b700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc3c067330 0x7efc3c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:37.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.053+0000 7efc59d9b700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc3c067330 0x7efc3c0697e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0d1b30 tx=0x7efc50017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:37.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.056+0000 7efc4a7fc700 1 -- 172.21.15.142:0/573036107 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efc4c051c90 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.248+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc5c06fc10 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.819+0000 7efc4a7fc700 1 -- 172.21.15.142:0/573036107 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) v1 ==== 169+0+0 (secure 0 0 0) 0x7efc4c0552b0 con 0x7efc5c0cc0b0 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc3c067330 msgr2=0x7efc3c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc3c067330 0x7efc3c0697e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0d1b30 tx=0x7efc50017000 comp rx=0 tx=0).stop 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cc0b0 msgr2=0x7efc5c148bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cc0b0 0x7efc5c148bb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00e960 tx=0x7efc4c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 shutdown_connections 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc3c067330 0x7efc3c0697e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc5c15ac40 0x7efc5c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc5c0cc0b0 0x7efc5c148bb0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 --2- 172.21.15.142:0/573036107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc5c0cf180 0x7efc5c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:37.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 >> 172.21.15.142:0/573036107 conn(0x7efc5c0d0a80 msgr2=0x7efc5c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:37.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 shutdown_connections 2023-09-30T22:57:37.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:37.823+0000 7efc60dff700 1 -- 172.21.15.142:0/573036107 wait complete. 2023-09-30T22:57:37.825 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:57:37.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T22:57:38.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.035+0000 7eff633ff700 1 Processor -- start 2023-09-30T22:57:38.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.035+0000 7eff633ff700 1 -- start start 2023-09-30T22:57:38.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.036+0000 7eff633ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 0x7eff5c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff633ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c067d10 con 0x7eff5c0b0de0 2023-09-30T22:57:38.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff633ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c06af90 con 0x7eff5c159ba0 2023-09-30T22:57:38.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff633ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0676c0 con 0x7eff5c0ca5e0 2023-09-30T22:57:38.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff6199c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7eff5c0b0de0 0x7eff5c0681a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54724/0 (socket says 172.21.15.142:54724) 2023-09-30T22:57:38.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff6199c700 1 -- 172.21.15.142:0/3885267400 learned_addr learned my addr 172.21.15.142:0/3885267400 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:38.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff6099a700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 0x7eff5c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454067870 0 0) 0x7eff5c067d10 con 0x7eff5c0b0de0 2023-09-30T22:57:38.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff48003570 con 0x7eff5c0b0de0 2023-09-30T22:57:38.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914063758 0 0) 0x7eff5c06af90 con 0x7eff5c159ba0 2023-09-30T22:57:38.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.037+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff5c067d10 con 0x7eff5c159ba0 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151077625 0 0) 0x7eff48003570 con 0x7eff5c0b0de0 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 msgr2=0x7eff5c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 0x7eff5c06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 >> v1:172.21.15.148:6789/0 conn(0x7eff5c159ba0 legacy=0x7eff5c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0679a0 con 0x7eff5c0b0de0 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7eff540017f0 con 0x7eff5c0b0de0 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6099a700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 0x7eff5c06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 >> v1:172.21.15.142:6789/0 conn(0x7eff5c0b0de0 legacy=0x7eff5c0681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff48003c20 0x7eff48004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 0x7eff480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0676c0 con 0x7eff48004810 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4800bb40 con 0x7eff48003c20 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4800bd00 con 0x7eff5c0ca5e0 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6099a700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6119b700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff48003c20 0x7eff48004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6199c700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 0x7eff480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6099a700 1 -- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 msgr2=0x7eff480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6099a700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c0ca5e0 0x7eff480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6099a700 1 -- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff48003c20 msgr2=0x7eff48004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6099a700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff48003c20 0x7eff48004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.038+0000 7eff6099a700 1 -- 172.21.15.142:0/3885267400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009420 con 0x7eff48004810 2023-09-30T22:57:38.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.039+0000 7eff6099a700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff48004c80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009df0 tx=0x7eff4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf820b3ee75b4ed7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.039+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c009740 con 0x7eff48004810 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.039+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00e920 con 0x7eff48004810 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.039+0000 7eff53fff700 1 -- 172.21.15.142:0/3885267400 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00ece0 con 0x7eff48004810 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.039+0000 7eff633ff700 1 -- 172.21.15.142:0/3885267400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 msgr2=0x7eff48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.039+0000 7eff633ff700 1 --2- 172.21.15.142:0/3885267400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff48004c80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009df0 tx=0x7eff4c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.039+0000 7eff6199c700 1 -- 172.21.15.142:0/3885267400 reap_dead start 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.040+0000 7eff633ff700 1 -- 172.21.15.142:0/3885267400 shutdown_connections 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.040+0000 7eff633ff700 1 -- 172.21.15.142:0/3885267400 >> 172.21.15.142:0/3885267400 conn(0x7eff5c0cb2f0 msgr2=0x7eff5c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.040+0000 7eff633ff700 1 -- 172.21.15.142:0/3885267400 shutdown_connections 2023-09-30T22:57:38.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.040+0000 7eff633ff700 1 -- 172.21.15.142:0/3885267400 wait complete. 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.041+0000 7eff633ff700 1 Processor -- start 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.041+0000 7eff633ff700 1 -- start start 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff633ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff5c0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff633ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c30a0 0x7eff5c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff633ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c15a4b0 0x7eff5c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff633ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c15a950 con 0x7eff48004810 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff633ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0c41b0 con 0x7eff5c0c30a0 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff633ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0c35a0 con 0x7eff5c15a4b0 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff6119b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff5c0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff6119b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff5c0c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50570/0 (socket says 172.21.15.142:50570) 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff6119b700 1 -- 172.21.15.142:0/695877202 learned_addr learned my addr 172.21.15.142:0/695877202 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff6199c700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c15a4b0 0x7eff5c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.042+0000 7eff6099a700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c30a0 0x7eff5c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6119b700 1 -- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c15a4b0 msgr2=0x7eff5c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6119b700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c15a4b0 0x7eff5c0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6119b700 1 -- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c30a0 msgr2=0x7eff5c159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6119b700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c30a0 0x7eff5c159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6119b700 1 -- 172.21.15.142:0/695877202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0c3880 con 0x7eff48004810 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6199c700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c15a4b0 0x7eff5c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6099a700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c30a0 0x7eff5c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:38.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff6119b700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff5c0c4640 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7eff5800e840 tx=0x7eff58009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff517fa700 1 -- 172.21.15.142:0/695877202 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58013630 con 0x7eff48004810 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff517fa700 1 -- 172.21.15.142:0/695877202 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58013790 con 0x7eff48004810 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff517fa700 1 -- 172.21.15.142:0/695877202 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58013b50 con 0x7eff48004810 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c0c3b60 con 0x7eff48004810 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.043+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c0c6a90 con 0x7eff48004810 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.044+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c06e4b0 con 0x7eff48004810 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.045+0000 7eff517fa700 1 -- 172.21.15.142:0/695877202 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff580023c0 con 0x7eff48004810 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.046+0000 7eff517fa700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff40067330 0x7eff400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.046+0000 7eff517fa700 1 -- 172.21.15.142:0/695877202 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5292+0+0 (secure 0 0 0) 0x7eff58084f90 con 0x7eff48004810 2023-09-30T22:57:38.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.046+0000 7eff6099a700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff40067330 0x7eff400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.047+0000 7eff6099a700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff40067330 0x7eff400697e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0093f0 tx=0x7eff4c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:38.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.050+0000 7eff517fa700 1 -- 172.21.15.142:0/695877202 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff580520f0 con 0x7eff48004810 2023-09-30T22:57:38.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.241+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7eff5c0cac40 con 0x7eff48004810 2023-09-30T22:57:38.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.245+0000 7eff517fa700 1 -- 172.21.15.142:0/695877202 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7eff58055710 con 0x7eff48004810 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.247+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff40067330 msgr2=0x7eff400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.247+0000 7eff633ff700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff40067330 0x7eff400697e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0093f0 tx=0x7eff4c01a000 comp rx=0 tx=0).stop 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.247+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 msgr2=0x7eff5c0c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.247+0000 7eff633ff700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff5c0c4640 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7eff5800e840 tx=0x7eff58009040 comp rx=0 tx=0).stop 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.247+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 shutdown_connections 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.248+0000 7eff633ff700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff40067330 0x7eff400697e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.248+0000 7eff633ff700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff5c15a4b0 0x7eff5c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.248+0000 7eff633ff700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff48004810 0x7eff5c0c4640 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.248+0000 7eff633ff700 1 --2- 172.21.15.142:0/695877202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c30a0 0x7eff5c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.248+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 >> 172.21.15.142:0/695877202 conn(0x7eff5c0cb2f0 msgr2=0x7eff5c157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:38.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.248+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 shutdown_connections 2023-09-30T22:57:38.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.248+0000 7eff633ff700 1 -- 172.21.15.142:0/695877202 wait complete. 2023-09-30T22:57:38.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-09-30T22:57:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.455+0000 7ffbdf9ff700 1 Processor -- start 2023-09-30T22:57:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.455+0000 7ffbdf9ff700 1 -- start start 2023-09-30T22:57:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.456+0000 7ffbdf9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbd80cc590 0x7ffbd8164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.456+0000 7ffbdf9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd815d910 con 0x7ffbd8159ae0 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbdf9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd815e490 con 0x7ffbd80b1180 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbdf9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd815e920 con 0x7ffbd80cc590 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbdd79b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ffbd8159ae0 0x7ffbd80cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54740/0 (socket says 172.21.15.142:54740) 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbdd79b700 1 -- 172.21.15.142:0/2197461685 learned_addr learned my addr 172.21.15.142:0/2197461685 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbddf9c700 1 --2- 172.21.15.142:0/2197461685 >> v2:172.21.15.142:3300/0 conn(0x7ffbd80cc590 0x7ffbd8164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbddf9c700 1 -- 172.21.15.142:0/2197461685 >> v1:172.21.15.148:6789/0 conn(0x7ffbd80b1180 legacy=0x7ffbd80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbddf9c700 1 -- 172.21.15.142:0/2197461685 >> v1:172.21.15.142:6789/0 conn(0x7ffbd8159ae0 legacy=0x7ffbd80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbddf9c700 1 -- 172.21.15.142:0/2197461685 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80ce5c0 con 0x7ffbd80cc590 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbcffff700 1 -- 172.21.15.142:0/2197461685 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793661814 0 0) 0x7ffbd815d910 con 0x7ffbd8159ae0 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.457+0000 7ffbddf9c700 1 --2- 172.21.15.142:0/2197461685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80cc590 0x7ffbd8164cb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009e60 tx=0x7ffbd0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab8cb9049983385 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbcffff700 1 -- 172.21.15.142:0/2197461685 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000e070 con 0x7ffbd80cc590 2023-09-30T22:57:38.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbcffff700 1 -- 172.21.15.142:0/2197461685 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000bc30 con 0x7ffbd80cc590 2023-09-30T22:57:38.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbcffff700 1 -- 172.21.15.142:0/2197461685 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0012430 con 0x7ffbd80cc590 2023-09-30T22:57:38.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/2197461685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80cc590 msgr2=0x7ffbd8164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/2197461685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80cc590 0x7ffbd8164cb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009e60 tx=0x7ffbd0009780 comp rx=0 tx=0).stop 2023-09-30T22:57:38.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/2197461685 shutdown_connections 2023-09-30T22:57:38.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/2197461685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80cc590 0x7ffbd8164cb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/2197461685 >> 172.21.15.142:0/2197461685 conn(0x7ffbd80ce8b0 msgr2=0x7ffbd80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:38.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/2197461685 shutdown_connections 2023-09-30T22:57:38.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.458+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/2197461685 wait complete. 2023-09-30T22:57:38.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.460+0000 7ffbdf9ff700 1 Processor -- start 2023-09-30T22:57:38.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.461+0000 7ffbdf9ff700 1 -- start start 2023-09-30T22:57:38.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdf9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd80b1180 0x7ffbd816e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdf9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbd80cc590 0x7ffbd80c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdf9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd8159ae0 0x7ffbd806a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdf9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80c9f70 con 0x7ffbd8159ae0 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdf9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80c86f0 con 0x7ffbd80b1180 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdf9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80c8970 con 0x7ffbd80cc590 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbddf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd8159ae0 0x7ffbd806a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbddf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd8159ae0 0x7ffbd806a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50590/0 (socket says 172.21.15.142:50590) 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbddf9c700 1 -- 172.21.15.142:0/1951779262 learned_addr learned my addr 172.21.15.142:0/1951779262 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdd79b700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd80b1180 0x7ffbd816e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.462+0000 7ffbdcf9a700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbd80cc590 0x7ffbd80c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbddf9c700 1 -- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbd80cc590 msgr2=0x7ffbd80c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbddf9c700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbd80cc590 0x7ffbd80c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbddf9c700 1 -- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd80b1180 msgr2=0x7ffbd816e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbddf9c700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd80b1180 0x7ffbd816e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbddf9c700 1 -- 172.21.15.142:0/1951779262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0009a20 con 0x7ffbd8159ae0 2023-09-30T22:57:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbddf9c700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd8159ae0 0x7ffbd806a850 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8063f90 tx=0x7ffbd0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbcd7fa700 1 -- 172.21.15.142:0/1951779262 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd001b420 con 0x7ffbd8159ae0 2023-09-30T22:57:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbcd7fa700 1 -- 172.21.15.142:0/1951779262 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd001b580 con 0x7ffbd8159ae0 2023-09-30T22:57:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbcd7fa700 1 -- 172.21.15.142:0/1951779262 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd001b940 con 0x7ffbd8159ae0 2023-09-30T22:57:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd80c8c50 con 0x7ffbd8159ae0 2023-09-30T22:57:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.463+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd806ad90 con 0x7ffbd8159ae0 2023-09-30T22:57:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.464+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd80c9170 con 0x7ffbd8159ae0 2023-09-30T22:57:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.465+0000 7ffbcd7fa700 1 -- 172.21.15.142:0/1951779262 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffbd001bcb0 con 0x7ffbd8159ae0 2023-09-30T22:57:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.466+0000 7ffbcd7fa700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbbc067330 0x7ffbbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.466+0000 7ffbcd7fa700 1 -- 172.21.15.142:0/1951779262 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ffbd00867c0 con 0x7ffbd8159ae0 2023-09-30T22:57:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.466+0000 7ffbdd79b700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbbc067330 0x7ffbbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.467+0000 7ffbdd79b700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbbc067330 0x7ffbbc0697e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4007160 tx=0x7ffbd4007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:38.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.470+0000 7ffbcd7fa700 1 -- 172.21.15.142:0/1951779262 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ffbd80c9170 con 0x7ffbd8159ae0 2023-09-30T22:57:38.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.735+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7ffbd80c9d40 con 0x7ffbd8159ae0 2023-09-30T22:57:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.824+0000 7ffbcd7fa700 1 -- 172.21.15.142:0/1951779262 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v269) v1 ==== 133+0+0 (secure 0 0 0) 0x7ffbd80c9d40 con 0x7ffbd8159ae0 2023-09-30T22:57:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbbc067330 msgr2=0x7ffbbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbbc067330 0x7ffbbc0697e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4007160 tx=0x7ffbd4007f50 comp rx=0 tx=0).stop 2023-09-30T22:57:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd8159ae0 msgr2=0x7ffbd806a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd8159ae0 0x7ffbd806a850 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8063f90 tx=0x7ffbd0019000 comp rx=0 tx=0).stop 2023-09-30T22:57:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 shutdown_connections 2023-09-30T22:57:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbbc067330 0x7ffbbc0697e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd8159ae0 0x7ffbd806a850 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd80b1180 0x7ffbd816e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 --2- 172.21.15.142:0/1951779262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbd80cc590 0x7ffbd80c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:38.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 >> 172.21.15.142:0/1951779262 conn(0x7ffbd80ce8b0 msgr2=0x7ffbd81551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:38.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 shutdown_connections 2023-09-30T22:57:38.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:38.827+0000 7ffbdf9ff700 1 -- 172.21.15.142:0/1951779262 wait complete. 2023-09-30T22:57:38.845 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-09-30T22:57:38.845 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-09-30T22:57:38.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-09-30T22:57:39.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.040+0000 7efd639ff700 1 Processor -- start 2023-09-30T22:57:39.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.040+0000 7efd639ff700 1 -- start start 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.041+0000 7efd639ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 0x7efd5c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.041+0000 7efd639ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd5c0cc590 0x7efd5c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.041+0000 7efd639ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c15d910 con 0x7efd5c0b1180 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.041+0000 7efd639ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c15e920 con 0x7efd5c0cc590 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.041+0000 7efd639ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c15e490 con 0x7efd5c159ae0 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd60f9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7efd5c0b1180 0x7efd5c0cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54750/0 (socket says 172.21.15.142:54750) 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd60f9a700 1 -- 172.21.15.142:0/1570038270 learned_addr learned my addr 172.21.15.142:0/1570038270 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd61f9c700 1 --2- 172.21.15.142:0/1570038270 >> v2:172.21.15.148:3300/0 conn(0x7efd5c0cc590 0x7efd5c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd6179b700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 0x7efd5c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725072721 0 0) 0x7efd5c15d910 con 0x7efd5c0b1180 2023-09-30T22:57:39.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd48003570 con 0x7efd5c0b1180 2023-09-30T22:57:39.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935660923 0 0) 0x7efd48003570 con 0x7efd5c0b1180 2023-09-30T22:57:39.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 msgr2=0x7efd5c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:39.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 0x7efd5c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 >> v2:172.21.15.148:3300/0 conn(0x7efd5c0cc590 msgr2=0x7efd5c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:39.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 --2- 172.21.15.142:0/1570038270 >> v2:172.21.15.148:3300/0 conn(0x7efd5c0cc590 0x7efd5c069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c15db60 con 0x7efd5c0b1180 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7efd4c001470 con 0x7efd5c0b1180 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.042+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 >> v1:172.21.15.142:6789/0 conn(0x7efd5c0b1180 legacy=0x7efd5c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd53fff700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 0x7efd48003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd53fff700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd48003fe0 0x7efd48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd53fff700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c15e490 con 0x7efd48004d50 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4800ba60 con 0x7efd48003fe0 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4800bbd0 con 0x7efd5c159ae0 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd61f9c700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd60f9a700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd48003fe0 0x7efd48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd6179b700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 0x7efd48003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd61f9c700 1 -- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 msgr2=0x7efd48003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd61f9c700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c159ae0 0x7efd48003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd61f9c700 1 -- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd48003fe0 msgr2=0x7efd48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd61f9c700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd48003fe0 0x7efd48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd61f9c700 1 -- 172.21.15.142:0/1570038270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48003570 con 0x7efd48004d50 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.043+0000 7efd61f9c700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd480051c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0643b0 tx=0x7efd5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310a72a105ae3b24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400ea00 con 0x7efd48004d50 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5400f040 con 0x7efd48004d50 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd53fff700 1 -- 172.21.15.142:0/1570038270 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400ed90 con 0x7efd48004d50 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd639ff700 1 -- 172.21.15.142:0/1570038270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 msgr2=0x7efd480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd639ff700 1 --2- 172.21.15.142:0/1570038270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd480051c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0643b0 tx=0x7efd5400b040 comp rx=0 tx=0).stop 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd61f9c700 1 -- 172.21.15.142:0/1570038270 reap_dead start 2023-09-30T22:57:39.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd639ff700 1 -- 172.21.15.142:0/1570038270 shutdown_connections 2023-09-30T22:57:39.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd639ff700 1 -- 172.21.15.142:0/1570038270 >> 172.21.15.142:0/1570038270 conn(0x7efd5c0ce8b0 msgr2=0x7efd5c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:39.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd639ff700 1 -- 172.21.15.142:0/1570038270 shutdown_connections 2023-09-30T22:57:39.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.044+0000 7efd639ff700 1 -- 172.21.15.142:0/1570038270 wait complete. 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.046+0000 7efd639ff700 1 Processor -- start 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.046+0000 7efd639ff700 1 -- start start 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd639ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd5c13fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd639ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0c81d0 0x7efd5c15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd639ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c155740 0x7efd5c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd639ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c15ce80 con 0x7efd48004d50 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd639ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c156120 con 0x7efd5c155740 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd639ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c1518a0 con 0x7efd5c0c81d0 2023-09-30T22:57:39.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd6179b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd5c13fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd6179b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd5c13fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50606/0 (socket says 172.21.15.142:50606) 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd6179b700 1 -- 172.21.15.142:0/1133447753 learned_addr learned my addr 172.21.15.142:0/1133447753 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd61f9c700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c155740 0x7efd5c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd60f9a700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0c81d0 0x7efd5c15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.047+0000 7efd6179b700 1 -- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0c81d0 msgr2=0x7efd5c15c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd6179b700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0c81d0 0x7efd5c15c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd6179b700 1 -- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c155740 msgr2=0x7efd5c155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd6179b700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c155740 0x7efd5c155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd6179b700 1 -- 172.21.15.142:0/1133447753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c15a170 con 0x7efd48004d50 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd6179b700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd5c13fc60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efd58006ac0 tx=0x7efd580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd517fa700 1 -- 172.21.15.142:0/1133447753 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800f940 con 0x7efd48004d50 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd517fa700 1 -- 172.21.15.142:0/1133447753 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800faa0 con 0x7efd48004d50 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c0c86d0 con 0x7efd48004d50 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd517fa700 1 -- 172.21.15.142:0/1133447753 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800fe20 con 0x7efd48004d50 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.048+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c0c8c90 con 0x7efd48004d50 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.049+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c06ea70 con 0x7efd48004d50 2023-09-30T22:57:39.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.050+0000 7efd517fa700 1 -- 172.21.15.142:0/1133447753 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efd58014650 con 0x7efd48004d50 2023-09-30T22:57:39.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.051+0000 7efd517fa700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd40067330 0x7efd400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:39.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.051+0000 7efd517fa700 1 -- 172.21.15.142:0/1133447753 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5292+0+0 (secure 0 0 0) 0x7efd58018030 con 0x7efd48004d50 2023-09-30T22:57:39.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.051+0000 7efd60f9a700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd40067330 0x7efd400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:39.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.052+0000 7efd60f9a700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd40067330 0x7efd400697e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd5c156300 tx=0x7efd4c001e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:39.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.055+0000 7efd517fa700 1 -- 172.21.15.142:0/1133447753 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efd58052430 con 0x7efd48004d50 2023-09-30T22:57:39.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.321+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7efd5c15de40 con 0x7efd48004d50 2023-09-30T22:57:39.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.827+0000 7efd517fa700 1 -- 172.21.15.142:0/1133447753 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v270) v1 ==== 140+0+0 (secure 0 0 0) 0x7efd58055a50 con 0x7efd48004d50 2023-09-30T22:57:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd40067330 msgr2=0x7efd400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd40067330 0x7efd400697e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd5c156300 tx=0x7efd4c001e90 comp rx=0 tx=0).stop 2023-09-30T22:57:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 msgr2=0x7efd5c13fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd5c13fc60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efd58006ac0 tx=0x7efd580091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 shutdown_connections 2023-09-30T22:57:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd40067330 0x7efd400697e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c155740 0x7efd5c155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48004d50 0x7efd5c13fc60 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.829+0000 7efd639ff700 1 --2- 172.21.15.142:0/1133447753 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd5c0c81d0 0x7efd5c15c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.830+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 >> 172.21.15.142:0/1133447753 conn(0x7efd5c0ce8b0 msgr2=0x7efd5c0cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.830+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 shutdown_connections 2023-09-30T22:57:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:39.830+0000 7efd639ff700 1 -- 172.21.15.142:0/1133447753 wait complete. 2023-09-30T22:57:39.850 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-30T22:57:40.057 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_objectstore":"memstore"} 2023-09-30T22:57:40.058 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-30T22:57:40.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:57:40.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.249+0000 7fbc3b3ff700 1 Processor -- start 2023-09-30T22:57:40.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.249+0000 7fbc3b3ff700 1 -- start start 2023-09-30T22:57:40.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.251+0000 7fbc3b3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc341598b0 0x7fbc34159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.251+0000 7fbc3b3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc340ce240 0x7fbc340b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.251+0000 7fbc3b3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc340687b0 con 0x7fbc34069f10 2023-09-30T22:57:40.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.251+0000 7fbc3b3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc340ce6b0 con 0x7fbc341598b0 2023-09-30T22:57:40.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.251+0000 7fbc3b3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340b0d50 con 0x7fbc340ce240 2023-09-30T22:57:40.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.251+0000 7fbc3899a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc340ce240 0x7fbc340b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3919b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc341598b0 0x7fbc34159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3899a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc340ce240 0x7fbc340b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:51696/0 (socket says 172.21.15.142:51696) 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3899a700 1 -- 172.21.15.142:0/2405027412 learned_addr learned my addr 172.21.15.142:0/2405027412 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3919b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc341598b0 0x7fbc34159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:60628/0 (socket says 172.21.15.142:60628) 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3999c700 1 --1- 172.21.15.142:0/2405027412 >> v1:172.21.15.148:6789/0 conn(0x7fbc34069f10 0x7fbc340cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:58026/0 (socket says 172.21.15.142:58026) 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3919b700 1 -- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc340ce240 msgr2=0x7fbc340b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3919b700 1 --2- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc340ce240 0x7fbc340b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3919b700 1 -- 172.21.15.142:0/2405027412 >> v1:172.21.15.148:6789/0 conn(0x7fbc34069f10 legacy=0x7fbc340cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3919b700 1 -- 172.21.15.142:0/2405027412 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340b1020 con 0x7fbc341598b0 2023-09-30T22:57:40.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc2bfff700 1 -- 172.21.15.142:0/2405027412 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921203563 0 0) 0x7fbc340687b0 con 0x7fbc34069f10 2023-09-30T22:57:40.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3899a700 1 --2- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc340ce240 0x7fbc340b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:40.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.252+0000 7fbc3919b700 1 --2- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 0x7fbc34159c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc300098e0 tx=0x7fbc300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fa898acccdec65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:40.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc2bfff700 1 -- 172.21.15.142:0/2405027412 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000b640 con 0x7fbc341598b0 2023-09-30T22:57:40.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc2bfff700 1 -- 172.21.15.142:0/2405027412 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3000b7a0 con 0x7fbc341598b0 2023-09-30T22:57:40.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc2bfff700 1 -- 172.21.15.142:0/2405027412 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000bb40 con 0x7fbc341598b0 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 msgr2=0x7fbc34159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 0x7fbc34159c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc300098e0 tx=0x7fbc300091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2405027412 shutdown_connections 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 0x7fbc34159c80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2405027412 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc340ce240 0x7fbc340b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2405027412 >> 172.21.15.142:0/2405027412 conn(0x7fbc340ce8a0 msgr2=0x7fbc340ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2405027412 shutdown_connections 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.253+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2405027412 wait complete. 2023-09-30T22:57:40.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.255+0000 7fbc3b3ff700 1 Processor -- start 2023-09-30T22:57:40.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.255+0000 7fbc3b3ff700 1 -- start start 2023-09-30T22:57:40.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3b3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc34069f10 0x7fbc340c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3b3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc340ce240 0x7fbc341525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3b3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 0x7fbc340cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3b3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c8430 con 0x7fbc340ce240 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3b3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c8710 con 0x7fbc341598b0 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3b3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c89f0 con 0x7fbc34069f10 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3899a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc340ce240 0x7fbc341525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3919b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc34069f10 0x7fbc340c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3919b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc34069f10 0x7fbc340c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:51706/0 (socket says 172.21.15.142:51706) 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3919b700 1 -- 172.21.15.142:0/2047995918 learned_addr learned my addr 172.21.15.142:0/2047995918 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.256+0000 7fbc3999c700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 0x7fbc340cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3919b700 1 -- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 msgr2=0x7fbc340cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3919b700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 0x7fbc340cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3919b700 1 -- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc340ce240 msgr2=0x7fbc341525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3919b700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc340ce240 0x7fbc341525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3919b700 1 -- 172.21.15.142:0/2047995918 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240094f0 con 0x7fbc34069f10 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3919b700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc34069f10 0x7fbc340c94d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc34063f80 tx=0x7fbc30017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc297fa700 1 -- 172.21.15.142:0/2047995918 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000bb20 con 0x7fbc34069f10 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc297fa700 1 -- 172.21.15.142:0/2047995918 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30000c90 con 0x7fbc34069f10 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc30009420 con 0x7fbc34069f10 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc297fa700 1 -- 172.21.15.142:0/2047995918 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30011630 con 0x7fbc34069f10 2023-09-30T22:57:40.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.257+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc340c8fb0 con 0x7fbc34069f10 2023-09-30T22:57:40.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.258+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc340c91a0 con 0x7fbc34069f10 2023-09-30T22:57:40.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.259+0000 7fbc297fa700 1 -- 172.21.15.142:0/2047995918 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbc300119a0 con 0x7fbc34069f10 2023-09-30T22:57:40.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.260+0000 7fbc297fa700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc18067330 0x7fbc180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.260+0000 7fbc297fa700 1 -- 172.21.15.142:0/2047995918 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbc30085bf0 con 0x7fbc34069f10 2023-09-30T22:57:40.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.260+0000 7fbc3899a700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc18067330 0x7fbc180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.261+0000 7fbc3899a700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc18067330 0x7fbc180697e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbc340cba60 tx=0x7fbc24009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:40.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.266+0000 7fbc297fa700 1 -- 172.21.15.142:0/2047995918 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbc30052d50 con 0x7fbc34069f10 2023-09-30T22:57:40.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.458+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbc34068160 con 0x7fbc34069f10 2023-09-30T22:57:40.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.465+0000 7fbc297fa700 1 -- 172.21.15.142:0/2047995918 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbc30056370 con 0x7fbc34069f10 2023-09-30T22:57:40.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc18067330 msgr2=0x7fbc180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc18067330 0x7fbc180697e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbc340cba60 tx=0x7fbc24009250 comp rx=0 tx=0).stop 2023-09-30T22:57:40.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc34069f10 msgr2=0x7fbc340c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc34069f10 0x7fbc340c94d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc34063f80 tx=0x7fbc30017000 comp rx=0 tx=0).stop 2023-09-30T22:57:40.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 shutdown_connections 2023-09-30T22:57:40.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc18067330 0x7fbc180697e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc341598b0 0x7fbc340cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc34069f10 0x7fbc340c94d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 --2- 172.21.15.142:0/2047995918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc340ce240 0x7fbc341525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 >> 172.21.15.142:0/2047995918 conn(0x7fbc340ce8a0 msgr2=0x7fbc341533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:40.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 shutdown_connections 2023-09-30T22:57:40.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.467+0000 7fbc3b3ff700 1 -- 172.21.15.142:0/2047995918 wait complete. 2023-09-30T22:57:40.485 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:57:40.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:57:40.583 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:57:40.688 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:57:40.689 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:57:40.689 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:57:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.878+0000 7fdbd63ff700 1 Processor -- start 2023-09-30T22:57:40.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.878+0000 7fdbd63ff700 1 -- start start 2023-09-30T22:57:40.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbd63ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbd00af020 0x7fdbd0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbd63ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00b00d0 0x7fdbd006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbd63ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd006d3e0 con 0x7fdbd006e650 2023-09-30T22:57:40.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbd63ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd015b400 con 0x7fdbd00af020 2023-09-30T22:57:40.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbd63ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd006dc80 con 0x7fdbd00b00d0 2023-09-30T22:57:40.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbcffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbd00af020 0x7fdbd0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbcffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbd00af020 0x7fdbd0156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50630/0 (socket says 172.21.15.142:50630) 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbd499c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdbd006e650 0x7fdbd00b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54766/0 (socket says 172.21.15.142:54766) 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbcffff700 1 -- 172.21.15.142:0/1510322381 learned_addr learned my addr 172.21.15.142:0/1510322381 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbcf7fe700 1 --2- 172.21.15.142:0/1510322381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00b00d0 0x7fdbd006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbcffff700 1 -- 172.21.15.142:0/1510322381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00b00d0 msgr2=0x7fdbd006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.880+0000 7fdbcffff700 1 --2- 172.21.15.142:0/1510322381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00b00d0 0x7fdbd006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbcffff700 1 -- 172.21.15.142:0/1510322381 >> v1:172.21.15.142:6789/0 conn(0x7fdbd006e650 legacy=0x7fdbd00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbcffff700 1 -- 172.21.15.142:0/1510322381 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd006b790 con 0x7fdbd00af020 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbceffd700 1 -- 172.21.15.142:0/1510322381 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457182899 0 0) 0x7fdbd006d3e0 con 0x7fdbd006e650 2023-09-30T22:57:40.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbcffff700 1 --2- 172.21.15.142:0/1510322381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00af020 0x7fdbd0156d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00099b0 tx=0x7fdbc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2925ba223327e155 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:40.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbceffd700 1 -- 172.21.15.142:0/1510322381 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0009ea0 con 0x7fdbd00af020 2023-09-30T22:57:40.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbceffd700 1 -- 172.21.15.142:0/1510322381 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000b860 con 0x7fdbd00af020 2023-09-30T22:57:40.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbceffd700 1 -- 172.21.15.142:0/1510322381 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000bc00 con 0x7fdbd00af020 2023-09-30T22:57:40.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1510322381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00af020 msgr2=0x7fdbd0156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.881+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1510322381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00af020 0x7fdbd0156d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00099b0 tx=0x7fdbc0009250 comp rx=0 tx=0).stop 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.882+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1510322381 shutdown_connections 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.882+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1510322381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00af020 0x7fdbd0156d80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.882+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1510322381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00b00d0 0x7fdbd006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.882+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1510322381 >> 172.21.15.142:0/1510322381 conn(0x7fdbd00680c0 msgr2=0x7fdbd00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.882+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1510322381 shutdown_connections 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.882+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1510322381 wait complete. 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.883+0000 7fdbd63ff700 1 Processor -- start 2023-09-30T22:57:40.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.883+0000 7fdbd63ff700 1 -- start start 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.884+0000 7fdbd63ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd006e650 0x7fdbd00c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.884+0000 7fdbd63ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00af020 0x7fdbd0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.884+0000 7fdbd63ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00b00d0 0x7fdbd00a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.884+0000 7fdbd63ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c69c0 con 0x7fdbd00b00d0 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.884+0000 7fdbd63ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c5420 con 0x7fdbd006e650 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.884+0000 7fdbd63ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c5700 con 0x7fdbd00af020 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.884+0000 7fdbd499c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00b00d0 0x7fdbd00a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00b00d0 0x7fdbd00a54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50634/0 (socket says 172.21.15.142:50634) 2023-09-30T22:57:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 -- 172.21.15.142:0/1290993325 learned_addr learned my addr 172.21.15.142:0/1290993325 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbcf7fe700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00af020 0x7fdbd0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbcffff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd006e650 0x7fdbd00c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 -- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00af020 msgr2=0x7fdbd0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00af020 0x7fdbd0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 -- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd006e650 msgr2=0x7fdbd00c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd006e650 0x7fdbd00c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 -- 172.21.15.142:0/1290993325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc00094f0 con 0x7fdbd00b00d0 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd499c700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00b00d0 0x7fdbd00a54b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800ccc0 tx=0x7fdbc8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbb7fff700 1 -- 172.21.15.142:0/1290993325 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800ce00 con 0x7fdbd00b00d0 2023-09-30T22:57:40.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbb7fff700 1 -- 172.21.15.142:0/1290993325 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8005df0 con 0x7fdbd00b00d0 2023-09-30T22:57:40.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd00c59e0 con 0x7fdbd00b00d0 2023-09-30T22:57:40.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbb7fff700 1 -- 172.21.15.142:0/1290993325 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800abb0 con 0x7fdbd00b00d0 2023-09-30T22:57:40.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.885+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd0154a60 con 0x7fdbd00b00d0 2023-09-30T22:57:40.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.886+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd00c6790 con 0x7fdbd00b00d0 2023-09-30T22:57:40.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.887+0000 7fdbb7fff700 1 -- 172.21.15.142:0/1290993325 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdbc80070f0 con 0x7fdbd00b00d0 2023-09-30T22:57:40.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.889+0000 7fdbb7fff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbbc067330 0x7fdbbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:40.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.889+0000 7fdbb7fff700 1 -- 172.21.15.142:0/1290993325 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fdbc8084aa0 con 0x7fdbd00b00d0 2023-09-30T22:57:40.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.889+0000 7fdbcffff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbbc067330 0x7fdbbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:40.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.889+0000 7fdbcffff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbbc067330 0x7fdbbc0697e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00099b0 tx=0x7fdbc0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:40.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:40.893+0000 7fdbb7fff700 1 -- 172.21.15.142:0/1290993325 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdbd00c6790 con 0x7fdbd00b00d0 2023-09-30T22:57:41.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.122+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbd00c6790 con 0x7fdbd00b00d0 2023-09-30T22:57:41.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.122+0000 7fdbb7fff700 1 -- 172.21.15.142:0/1290993325 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fdbd00c6790 con 0x7fdbd00b00d0 2023-09-30T22:57:41.124 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:41.124 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1699723544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1699723544},{"type":"v1","addr":"172.21.15.142:6837","nonce":1699723544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5830,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1272671718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1272671718},{"type":"v1","addr":"172.21.15.148:6834","nonce":1272671718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6046,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3515049663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3515049663},{"type":"v1","addr":"172.21.15.148:6835","nonce":3515049663}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6126,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3527832891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3527832891},{"type":"v1","addr":"172.21.15.142:6836","nonce":3527832891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-09-30T22:57:41.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbbc067330 msgr2=0x7fdbbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbbc067330 0x7fdbbc0697e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00099b0 tx=0x7fdbc0017000 comp rx=0 tx=0).stop 2023-09-30T22:57:41.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00b00d0 msgr2=0x7fdbd00a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00b00d0 0x7fdbd00a54b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800ccc0 tx=0x7fdbc8001a70 comp rx=0 tx=0).stop 2023-09-30T22:57:41.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 shutdown_connections 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbbc067330 0x7fdbbc0697e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd00b00d0 0x7fdbd00a54b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbd006e650 0x7fdbd00c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 --2- 172.21.15.142:0/1290993325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd00af020 0x7fdbd0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 >> 172.21.15.142:0/1290993325 conn(0x7fdbd00680c0 msgr2=0x7fdbd00af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 shutdown_connections 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.125+0000 7fdbd63ff700 1 -- 172.21.15.142:0/1290993325 wait complete. 2023-09-30T22:57:41.127 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 43 2023-09-30T22:57:41.145 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:57:41.145 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:57:41.145 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:57:41.146 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:57:41.146 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:57:41.146 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:57:41.147 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:57:41.147 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:57:41.147 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:57:41.148 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:57:41.148 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:57:41.148 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:57:41.149 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:57:41.149 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:57:41.149 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:57:41.150 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:57:41.159 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:57:41.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:57:41.161 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:57:41.161 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:57:41.169 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:57:41.169 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:57:41.170 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:57:41.171 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:57:41.203 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:57:41.204 DEBUG:teuthology.parallel:result is None 2023-09-30T22:57:41.206 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:57:41.206 DEBUG:teuthology.parallel:result is None 2023-09-30T22:57:41.213 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:57:41.214 DEBUG:teuthology.parallel:result is None 2023-09-30T22:57:41.216 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:57:41.217 DEBUG:teuthology.parallel:result is None 2023-09-30T22:57:41.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:57:41.349 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:57:41.350 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:57:41.364 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:57:41.364 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:57:41.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.421+0000 7f69799ff700 1 Processor -- start 2023-09-30T22:57:41.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.421+0000 7f69799ff700 1 -- start start 2023-09-30T22:57:41.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.423+0000 7f69799ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69741577c0 0x7f697415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.423+0000 7f69799ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697415e0c0 con 0x7f69741573f0 2023-09-30T22:57:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.423+0000 7f69799ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697415d790 con 0x7f697406a620 2023-09-30T22:57:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.423+0000 7f69799ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697406b8a0 con 0x7f69741577c0 2023-09-30T22:57:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.423+0000 7f6972ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f69741573f0 0x7f6974069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46548/0 (socket says 172.21.15.142:46548) 2023-09-30T22:57:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.423+0000 7f6972ffd700 1 -- 172.21.15.142:0/2149507199 learned_addr learned my addr 172.21.15.142:0/2149507199 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.423+0000 7f69737fe700 1 --2- 172.21.15.142:0/2149507199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69741577c0 0x7f697415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f6971ffb700 1 -- 172.21.15.142:0/2149507199 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155116973 0 0) 0x7f697415e0c0 con 0x7f69741573f0 2023-09-30T22:57:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f6971ffb700 1 -- 172.21.15.142:0/2149507199 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f695c003570 con 0x7f69741573f0 2023-09-30T22:57:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f6971ffb700 1 -- 172.21.15.142:0/2149507199 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524977047 0 0) 0x7f697415d790 con 0x7f697406a620 2023-09-30T22:57:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f6971ffb700 1 -- 172.21.15.142:0/2149507199 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f697415e0c0 con 0x7f697406a620 2023-09-30T22:57:41.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f69737fe700 1 -- 172.21.15.142:0/2149507199 >> v1:172.21.15.148:6789/0 conn(0x7f697406a620 legacy=0x7f697406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f69737fe700 1 -- 172.21.15.142:0/2149507199 >> v1:172.21.15.142:6789/0 conn(0x7f69741573f0 legacy=0x7f6974069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f69737fe700 1 -- 172.21.15.142:0/2149507199 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697415da70 con 0x7f69741577c0 2023-09-30T22:57:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f69737fe700 1 --2- 172.21.15.142:0/2149507199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69741577c0 0x7f697415ab90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f696c009e90 tx=0x7f696c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a85ff069c3e6503 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f6971ffb700 1 -- 172.21.15.142:0/2149507199 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00e070 con 0x7f69741577c0 2023-09-30T22:57:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f6971ffb700 1 -- 172.21.15.142:0/2149507199 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00bb80 con 0x7f69741577c0 2023-09-30T22:57:41.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.424+0000 7f6971ffb700 1 -- 172.21.15.142:0/2149507199 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c012430 con 0x7f69741577c0 2023-09-30T22:57:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.425+0000 7f69799ff700 1 -- 172.21.15.142:0/2149507199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69741577c0 msgr2=0x7f697415ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.425+0000 7f69799ff700 1 --2- 172.21.15.142:0/2149507199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69741577c0 0x7f697415ab90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f696c009e90 tx=0x7f696c009780 comp rx=0 tx=0).stop 2023-09-30T22:57:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.425+0000 7f69799ff700 1 -- 172.21.15.142:0/2149507199 shutdown_connections 2023-09-30T22:57:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.425+0000 7f69799ff700 1 --2- 172.21.15.142:0/2149507199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69741577c0 0x7f697415ab90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.425+0000 7f69799ff700 1 -- 172.21.15.142:0/2149507199 >> 172.21.15.142:0/2149507199 conn(0x7f69740d1510 msgr2=0x7f69740cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:41.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.425+0000 7f69799ff700 1 -- 172.21.15.142:0/2149507199 shutdown_connections 2023-09-30T22:57:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.425+0000 7f69799ff700 1 -- 172.21.15.142:0/2149507199 wait complete. 2023-09-30T22:57:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.427+0000 7f69799ff700 1 Processor -- start 2023-09-30T22:57:41.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.427+0000 7f69799ff700 1 -- start start 2023-09-30T22:57:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.427+0000 7f69799ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f697406a620 0x7f6974158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69799ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69741573f0 0x7f697415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69799ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69741577c0 0x7f697415a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69799ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740c64e0 con 0x7f69741573f0 2023-09-30T22:57:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69799ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740c67c0 con 0x7f69741577c0 2023-09-30T22:57:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69799ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740c6aa0 con 0x7f697406a620 2023-09-30T22:57:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69741573f0 0x7f697415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69741573f0 0x7f697415a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53686/0 (socket says 172.21.15.142:53686) 2023-09-30T22:57:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 -- 172.21.15.142:0/798222148 learned_addr learned my addr 172.21.15.142:0/798222148 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69737fe700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69741577c0 0x7f697415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f6972ffd700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f697406a620 0x7f6974158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 -- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f697406a620 msgr2=0x7f6974158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f697406a620 0x7f6974158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 -- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69741577c0 msgr2=0x7f697415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69741577c0 0x7f697415a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 -- 172.21.15.142:0/798222148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009a20 con 0x7f69741573f0 2023-09-30T22:57:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69737fe700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69741577c0 0x7f697415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f6972ffd700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f697406a620 0x7f6974158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.428+0000 7f69727fc700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69741573f0 0x7f697415a330 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f696800c790 tx=0x7f6968007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.429+0000 7f695affd700 1 -- 172.21.15.142:0/798222148 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968010510 con 0x7f69741573f0 2023-09-30T22:57:41.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.429+0000 7f695affd700 1 -- 172.21.15.142:0/798222148 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968010670 con 0x7f69741573f0 2023-09-30T22:57:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.429+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69740c6d80 con 0x7f69741573f0 2023-09-30T22:57:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.429+0000 7f695affd700 1 -- 172.21.15.142:0/798222148 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968010a10 con 0x7f69741573f0 2023-09-30T22:57:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.429+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6974169d10 con 0x7f69741573f0 2023-09-30T22:57:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.430+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974169f90 con 0x7f69741573f0 2023-09-30T22:57:41.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.431+0000 7f695affd700 1 -- 172.21.15.142:0/798222148 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f696801b400 con 0x7f69741573f0 2023-09-30T22:57:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.432+0000 7f695affd700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6960067330 0x7f69600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.432+0000 7f695affd700 1 -- 172.21.15.142:0/798222148 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6968084700 con 0x7f69741573f0 2023-09-30T22:57:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.432+0000 7f6972ffd700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6960067330 0x7f69600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.433+0000 7f6972ffd700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6960067330 0x7f69600697e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f69640058d0 tx=0x7f6964009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:41.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.437+0000 7f695affd700 1 -- 172.21.15.142:0/798222148 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6968051860 con 0x7f69741573f0 2023-09-30T22:57:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.643+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f697415dd50 con 0x7f69741573f0 2023-09-30T22:57:41.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.840+0000 7f695affd700 1 -- 172.21.15.142:0/798222148 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6968054e80 con 0x7f69741573f0 2023-09-30T22:57:41.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6960067330 msgr2=0x7f69600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6960067330 0x7f69600697e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f69640058d0 tx=0x7f6964009040 comp rx=0 tx=0).stop 2023-09-30T22:57:41.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69741573f0 msgr2=0x7f697415a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:41.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69741573f0 0x7f697415a330 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f696800c790 tx=0x7f6968007e10 comp rx=0 tx=0).stop 2023-09-30T22:57:41.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 shutdown_connections 2023-09-30T22:57:41.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6960067330 0x7f69600697e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69741577c0 0x7f697415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f697406a620 0x7f6974158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 --2- 172.21.15.142:0/798222148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69741573f0 0x7f697415a330 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 >> 172.21.15.142:0/798222148 conn(0x7f69740d1510 msgr2=0x7f697406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 shutdown_connections 2023-09-30T22:57:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:41.843+0000 7f69799ff700 1 -- 172.21.15.142:0/798222148 wait complete. 2023-09-30T22:57:41.848 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:57:41.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:57:42.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.052+0000 7f3fa81ff700 1 Processor -- start 2023-09-30T22:57:42.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.052+0000 7f3fa81ff700 1 -- start start 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa81ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3fa00b00d0 0x7f3fa006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa81ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa006e650 0x7f3fa015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa81ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa006d3e0 con 0x7f3fa00af020 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa81ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa006dc80 con 0x7f3fa00b00d0 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa81ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa006b790 con 0x7f3fa006e650 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa579a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3fa00b00d0 0x7f3fa006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa579a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3fa00b00d0 0x7f3fa006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53692/0 (socket says 172.21.15.142:53692) 2023-09-30T22:57:42.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa5f9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3fa00af020 0x7f3fa0156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46558/0 (socket says 172.21.15.142:46558) 2023-09-30T22:57:42.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa579a700 1 -- 172.21.15.142:0/2148265988 learned_addr learned my addr 172.21.15.142:0/2148265988 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa679c700 1 --2- 172.21.15.142:0/2148265988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa006e650 0x7f3fa015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa579a700 1 -- 172.21.15.142:0/2148265988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa006e650 msgr2=0x7f3fa015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa579a700 1 --2- 172.21.15.142:0/2148265988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa006e650 0x7f3fa015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa579a700 1 -- 172.21.15.142:0/2148265988 >> v1:172.21.15.142:6789/0 conn(0x7f3fa00af020 legacy=0x7f3fa0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa579a700 1 -- 172.21.15.142:0/2148265988 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00b0650 con 0x7f3fa00b00d0 2023-09-30T22:57:42.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.054+0000 7f3fa679c700 1 --2- 172.21.15.142:0/2148265988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa006e650 0x7f3fa015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.055+0000 7f3fa579a700 1 --2- 172.21.15.142:0/2148265988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa006e110 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3f900099b0 tx=0x7f3f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c845b53f8fe940c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.055+0000 7f3fa4f99700 1 -- 172.21.15.142:0/2148265988 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000b860 con 0x7f3fa00b00d0 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.055+0000 7f3fa4f99700 1 -- 172.21.15.142:0/2148265988 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000b9c0 con 0x7f3fa00b00d0 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.055+0000 7f3fa4f99700 1 -- 172.21.15.142:0/2148265988 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000bd60 con 0x7f3fa00b00d0 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.055+0000 7f3fa81ff700 1 -- 172.21.15.142:0/2148265988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 msgr2=0x7f3fa006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.055+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/2148265988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa006e110 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3f900099b0 tx=0x7f3f90009250 comp rx=0 tx=0).stop 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.056+0000 7f3fa81ff700 1 -- 172.21.15.142:0/2148265988 shutdown_connections 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.056+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/2148265988 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa006e650 0x7f3fa015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.056+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/2148265988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa006e110 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.056+0000 7f3fa81ff700 1 -- 172.21.15.142:0/2148265988 >> 172.21.15.142:0/2148265988 conn(0x7f3fa00680c0 msgr2=0x7f3fa00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:42.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.056+0000 7f3fa81ff700 1 -- 172.21.15.142:0/2148265988 shutdown_connections 2023-09-30T22:57:42.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.056+0000 7f3fa81ff700 1 -- 172.21.15.142:0/2148265988 wait complete. 2023-09-30T22:57:42.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.057+0000 7f3fa81ff700 1 Processor -- start 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.057+0000 7f3fa81ff700 1 -- start start 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa81ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa006e650 0x7f3fa0141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa81ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa00af020 0x7f3fa015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa81ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa81ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0141960 con 0x7f3fa00b00d0 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa81ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015a6a0 con 0x7f3fa006e650 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa81ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015bb60 con 0x7f3fa00af020 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa015e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53698/0 (socket says 172.21.15.142:53698) 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa679c700 1 -- 172.21.15.142:0/1099856816 learned_addr learned my addr 172.21.15.142:0/1099856816 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa5f9b700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa006e650 0x7f3fa0141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.058+0000 7f3fa579a700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa00af020 0x7f3fa015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3fa679c700 1 -- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa00af020 msgr2=0x7f3fa015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3fa679c700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa00af020 0x7f3fa015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3fa679c700 1 -- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa006e650 msgr2=0x7f3fa0141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3fa679c700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa006e650 0x7f3fa0141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3fa679c700 1 -- 172.21.15.142:0/1099856816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900094f0 con 0x7f3fa00b00d0 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3fa679c700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa015e170 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800a380 tx=0x7f3f98007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3f95ffb700 1 -- 172.21.15.142:0/1099856816 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98015440 con 0x7f3fa00b00d0 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3f95ffb700 1 -- 172.21.15.142:0/1099856816 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f980155a0 con 0x7f3fa00b00d0 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa015be40 con 0x7f3fa00b00d0 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.059+0000 7f3f95ffb700 1 -- 172.21.15.142:0/1099856816 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98015960 con 0x7f3fa00b00d0 2023-09-30T22:57:42.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.060+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa015c400 con 0x7f3fa00b00d0 2023-09-30T22:57:42.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.061+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa00695b0 con 0x7f3fa00b00d0 2023-09-30T22:57:42.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.061+0000 7f3f95ffb700 1 -- 172.21.15.142:0/1099856816 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3f9800d440 con 0x7f3fa00b00d0 2023-09-30T22:57:42.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.062+0000 7f3f95ffb700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f84067330 0x7f3f840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.062+0000 7f3f95ffb700 1 -- 172.21.15.142:0/1099856816 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3f98085330 con 0x7f3fa00b00d0 2023-09-30T22:57:42.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.062+0000 7f3fa5f9b700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f84067330 0x7f3f840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.063+0000 7f3fa5f9b700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f84067330 0x7f3f840697e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004fd0 tx=0x7f3f9c007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.066+0000 7f3f95ffb700 1 -- 172.21.15.142:0/1099856816 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3f98052580 con 0x7f3fa00b00d0 2023-09-30T22:57:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.331+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3fa006fc10 con 0x7f3fa00b00d0 2023-09-30T22:57:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.332+0000 7f3f95ffb700 1 -- 172.21.15.142:0/1099856816 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3f98083e60 con 0x7f3fa00b00d0 2023-09-30T22:57:42.333 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:42.333 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:57:42.333 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.338 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:57:42.339 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.340 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.341 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.342 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.345 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.346 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:57:42.347 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:57:42.348 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:57:42.349 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:57:42.350 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:57:42.351 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:57:42.351 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:57:42.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:42.351 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:57:42.351 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:57:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.334+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f84067330 msgr2=0x7f3f840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.334+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f84067330 0x7f3f840697e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004fd0 tx=0x7f3f9c007eb0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.334+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 msgr2=0x7f3fa015e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.334+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa015e170 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800a380 tx=0x7f3f98007900 comp rx=0 tx=0).stop 2023-09-30T22:57:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 shutdown_connections 2023-09-30T22:57:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3f84067330 0x7f3f840697e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fa00b00d0 0x7f3fa015e170 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fa006e650 0x7f3fa0141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 --2- 172.21.15.142:0/1099856816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3fa00af020 0x7f3fa015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 >> 172.21.15.142:0/1099856816 conn(0x7f3fa00680c0 msgr2=0x7f3fa00c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 shutdown_connections 2023-09-30T22:57:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.335+0000 7f3fa81ff700 1 -- 172.21.15.142:0/1099856816 wait complete. 2023-09-30T22:57:42.354 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:57:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.543+0000 7f8e43dff700 1 Processor -- start 2023-09-30T22:57:42.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.543+0000 7f8e43dff700 1 -- start start 2023-09-30T22:57:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.544+0000 7f8e43dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e3c06d3f0 0x7f8e3c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.544+0000 7f8e43dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e3c15e270 0x7f8e3c159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.544+0000 7f8e43dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c15dde0 con 0x7f8e3c0c6da0 2023-09-30T22:57:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.544+0000 7f8e43dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c15e710 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.544+0000 7f8e43dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c06b840 con 0x7f8e3c15e270 2023-09-30T22:57:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e41b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e3c06d3f0 0x7f8e3c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e4139a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8e3c0c6da0 0x7f8e3c06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46562/0 (socket says 172.21.15.142:46562) 2023-09-30T22:57:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e4139a700 1 -- 172.21.15.142:0/1810398080 learned_addr learned my addr 172.21.15.142:0/1810398080 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e4239c700 1 --2- 172.21.15.142:0/1810398080 >> v2:172.21.15.148:3300/0 conn(0x7f8e3c15e270 0x7f8e3c159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e41b9b700 1 -- 172.21.15.142:0/1810398080 >> v2:172.21.15.148:3300/0 conn(0x7f8e3c15e270 msgr2=0x7f8e3c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e41b9b700 1 --2- 172.21.15.142:0/1810398080 >> v2:172.21.15.148:3300/0 conn(0x7f8e3c15e270 0x7f8e3c159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e41b9b700 1 -- 172.21.15.142:0/1810398080 >> v1:172.21.15.142:6789/0 conn(0x7f8e3c0c6da0 legacy=0x7f8e3c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e41b9b700 1 -- 172.21.15.142:0/1810398080 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c15d7d0 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.545+0000 7f8e40b99700 1 -- 172.21.15.142:0/1810398080 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809566903 0 0) 0x7f8e3c15dde0 con 0x7f8e3c0c6da0 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e41b9b700 1 --2- 172.21.15.142:0/1810398080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c06d7c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8e380098e0 tx=0x7f8e380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dd65e4c725f92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e40b99700 1 -- 172.21.15.142:0/1810398080 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38009e80 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e40b99700 1 -- 172.21.15.142:0/1810398080 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3800b820 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e40b99700 1 -- 172.21.15.142:0/1810398080 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800bba0 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 -- 172.21.15.142:0/1810398080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 msgr2=0x7f8e3c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 --2- 172.21.15.142:0/1810398080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c06d7c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8e380098e0 tx=0x7f8e380091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 -- 172.21.15.142:0/1810398080 shutdown_connections 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 --2- 172.21.15.142:0/1810398080 >> v2:172.21.15.148:3300/0 conn(0x7f8e3c15e270 0x7f8e3c159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 --2- 172.21.15.142:0/1810398080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c06d7c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 -- 172.21.15.142:0/1810398080 >> 172.21.15.142:0/1810398080 conn(0x7f8e3c067e30 msgr2=0x7f8e3c068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 -- 172.21.15.142:0/1810398080 shutdown_connections 2023-09-30T22:57:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.546+0000 7f8e43dff700 1 -- 172.21.15.142:0/1810398080 wait complete. 2023-09-30T22:57:42.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.548+0000 7f8e43dff700 1 Processor -- start 2023-09-30T22:57:42.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.548+0000 7f8e43dff700 1 -- start start 2023-09-30T22:57:42.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e43dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e43dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e3c0c6da0 0x7f8e3c16a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e43dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e3c15e270 0x7f8e3c158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e43dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c144410 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e43dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0ccd70 con 0x7f8e3c15e270 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e43dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c16abd0 con 0x7f8e3c0c6da0 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53726/0 (socket says 172.21.15.142:53726) 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 -- 172.21.15.142:0/4211634270 learned_addr learned my addr 172.21.15.142:0/4211634270 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e4239c700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e3c15e270 0x7f8e3c158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e4139a700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e3c0c6da0 0x7f8e3c16a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 -- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e3c0c6da0 msgr2=0x7f8e3c16a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e3c0c6da0 0x7f8e3c16a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 -- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e3c15e270 msgr2=0x7f8e3c158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e3c15e270 0x7f8e3c158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e41b9b700 1 -- 172.21.15.142:0/4211634270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38009420 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.549+0000 7f8e4139a700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e3c0c6da0 0x7f8e3c16a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.550+0000 7f8e41b9b700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c143ed0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c067a40 tx=0x7f8e38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.550+0000 7f8e31ffb700 1 -- 172.21.15.142:0/4211634270 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3801f070 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.550+0000 7f8e31ffb700 1 -- 172.21.15.142:0/4211634270 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3800b990 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.550+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c16aeb0 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.550+0000 7f8e31ffb700 1 -- 172.21.15.142:0/4211634270 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38011670 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.550+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c0cd2a0 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.551+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c0cd4c0 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.552+0000 7f8e31ffb700 1 -- 172.21.15.142:0/4211634270 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8e380119e0 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.553+0000 7f8e31ffb700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e20067330 0x7f8e200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.553+0000 7f8e31ffb700 1 -- 172.21.15.142:0/4211634270 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8e38085d40 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.553+0000 7f8e4139a700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e20067330 0x7f8e200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.553+0000 7f8e4139a700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e20067330 0x7f8e200697e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c167c90 tx=0x7f8e2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.557+0000 7f8e31ffb700 1 -- 172.21.15.142:0/4211634270 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8e38052ef0 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.748+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e3c0c7230 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.749+0000 7f8e31ffb700 1 -- 172.21.15.142:0/4211634270 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+13798 (secure 0 0 0) 0x7f8e38015090 con 0x7f8e3c06d3f0 2023-09-30T22:57:42.750 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:42.750 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":107,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:57:41.846024+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:57:42.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e20067330 msgr2=0x7f8e200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e20067330 0x7f8e200697e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c167c90 tx=0x7f8e2c009040 comp rx=0 tx=0).stop 2023-09-30T22:57:42.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 msgr2=0x7f8e3c143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c143ed0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c067a40 tx=0x7f8e38017000 comp rx=0 tx=0).stop 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 shutdown_connections 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8e20067330 0x7f8e200697e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e3c15e270 0x7f8e3c158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c06d3f0 0x7f8e3c143ed0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 --2- 172.21.15.142:0/4211634270 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e3c0c6da0 0x7f8e3c16a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 >> 172.21.15.142:0/4211634270 conn(0x7f8e3c067e30 msgr2=0x7f8e3c068200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:42.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.751+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 shutdown_connections 2023-09-30T22:57:42.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.752+0000 7f8e43dff700 1 -- 172.21.15.142:0/4211634270 wait complete. 2023-09-30T22:57:42.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:57:42.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:57:42.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.963+0000 7ff4389ff700 1 Processor -- start 2023-09-30T22:57:42.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.963+0000 7ff4389ff700 1 -- start start 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff4389ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4340cbfe0 0x7ff43415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff4389ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cc3b0 0x7ff4340cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff4389ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4340d0550 con 0x7ff4341573a0 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff4389ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4340cf750 con 0x7ff4340cbfe0 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff4389ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340cf940 con 0x7ff4340cc3b0 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff43259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4340cbfe0 0x7ff43415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff43259c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4340cbfe0 0x7ff43415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53742/0 (socket says 172.21.15.142:53742) 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff43259c700 1 -- 172.21.15.142:0/1542690579 learned_addr learned my addr 172.21.15.142:0/1542690579 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff431d9b700 1 --2- 172.21.15.142:0/1542690579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cc3b0 0x7ff4340cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff43259c700 1 -- 172.21.15.142:0/1542690579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cc3b0 msgr2=0x7ff4340cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff43259c700 1 --2- 172.21.15.142:0/1542690579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cc3b0 0x7ff4340cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff43259c700 1 -- 172.21.15.142:0/1542690579 >> v1:172.21.15.148:6789/0 conn(0x7ff4341573a0 legacy=0x7ff43415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.965+0000 7ff43259c700 1 -- 172.21.15.142:0/1542690579 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340cfc20 con 0x7ff4340cbfe0 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.966+0000 7ff43259c700 1 --2- 172.21.15.142:0/1542690579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4340cbfe0 0x7ff43415a2a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff4240099e0 tx=0x7ff424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91bb98191f4a52e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.966+0000 7ff43159a700 1 -- 172.21.15.142:0/1542690579 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400b7e0 con 0x7ff4340cbfe0 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.966+0000 7ff43159a700 1 -- 172.21.15.142:0/1542690579 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400b940 con 0x7ff4340cbfe0 2023-09-30T22:57:42.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.966+0000 7ff43159a700 1 -- 172.21.15.142:0/1542690579 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400bce0 con 0x7ff4340cbfe0 2023-09-30T22:57:42.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.966+0000 7ff4389ff700 1 -- 172.21.15.142:0/1542690579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4340cbfe0 msgr2=0x7ff43415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.966+0000 7ff4389ff700 1 --2- 172.21.15.142:0/1542690579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4340cbfe0 0x7ff43415a2a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff4240099e0 tx=0x7ff424009250 comp rx=0 tx=0).stop 2023-09-30T22:57:42.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.967+0000 7ff4389ff700 1 -- 172.21.15.142:0/1542690579 shutdown_connections 2023-09-30T22:57:42.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.967+0000 7ff4389ff700 1 --2- 172.21.15.142:0/1542690579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4340cbfe0 0x7ff43415a2a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.967+0000 7ff4389ff700 1 --2- 172.21.15.142:0/1542690579 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cc3b0 0x7ff4340cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.967+0000 7ff4389ff700 1 -- 172.21.15.142:0/1542690579 >> 172.21.15.142:0/1542690579 conn(0x7ff4340d0a80 msgr2=0x7ff4340d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:42.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.967+0000 7ff4389ff700 1 -- 172.21.15.142:0/1542690579 shutdown_connections 2023-09-30T22:57:42.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.967+0000 7ff4389ff700 1 -- 172.21.15.142:0/1542690579 wait complete. 2023-09-30T22:57:42.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.968+0000 7ff4389ff700 1 Processor -- start 2023-09-30T22:57:42.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.968+0000 7ff4389ff700 1 -- start start 2023-09-30T22:57:42.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.969+0000 7ff4389ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cbfe0 0x7ff4341473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.969+0000 7ff4389ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4340cc3b0 0x7ff4340c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.969+0000 7ff4389ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4341573a0 0x7ff4340c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.969+0000 7ff4389ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340c4f50 con 0x7ff4341573a0 2023-09-30T22:57:42.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.969+0000 7ff4389ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434155ee0 con 0x7ff4340cc3b0 2023-09-30T22:57:42.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.969+0000 7ff4389ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340b88f0 con 0x7ff4340cbfe0 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4341573a0 0x7ff4340c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4341573a0 0x7ff4340c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53748/0 (socket says 172.21.15.142:53748) 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 -- 172.21.15.142:0/2559992628 learned_addr learned my addr 172.21.15.142:0/2559992628 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff431d9b700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4340cc3b0 0x7ff4340c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff43259c700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cbfe0 0x7ff4341473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 -- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cbfe0 msgr2=0x7ff4341473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cbfe0 0x7ff4341473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 -- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4340cc3b0 msgr2=0x7ff4340c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4340cc3b0 0x7ff4340c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 -- 172.21.15.142:0/2559992628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240094f0 con 0x7ff4341573a0 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff432d9d700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4341573a0 0x7ff4340c8ac0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00bc30 tx=0x7ff42c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff4227fc700 1 -- 172.21.15.142:0/2559992628 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00c840 con 0x7ff4341573a0 2023-09-30T22:57:42.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff4227fc700 1 -- 172.21.15.142:0/2559992628 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c00c9e0 con 0x7ff4341573a0 2023-09-30T22:57:42.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4340c4990 con 0x7ff4341573a0 2023-09-30T22:57:42.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.970+0000 7ff4227fc700 1 -- 172.21.15.142:0/2559992628 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00cda0 con 0x7ff4341573a0 2023-09-30T22:57:42.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.971+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4340c5390 con 0x7ff4341573a0 2023-09-30T22:57:42.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.972+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4340c55b0 con 0x7ff4341573a0 2023-09-30T22:57:42.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.972+0000 7ff4227fc700 1 -- 172.21.15.142:0/2559992628 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff42c014620 con 0x7ff4341573a0 2023-09-30T22:57:42.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.973+0000 7ff4227fc700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff414067330 0x7ff4140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:42.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.974+0000 7ff4227fc700 1 -- 172.21.15.142:0/2559992628 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff42c084800 con 0x7ff4341573a0 2023-09-30T22:57:42.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.974+0000 7ff43259c700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff414067330 0x7ff4140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:42.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.974+0000 7ff43259c700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff414067330 0x7ff4140697e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff4240099e0 tx=0x7ff424016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:42.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:42.977+0000 7ff4227fc700 1 -- 172.21.15.142:0/2559992628 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff42c04c570 con 0x7ff4341573a0 2023-09-30T22:57:43.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.165+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff43406fc10 con 0x7ff4341573a0 2023-09-30T22:57:43.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.166+0000 7ff4227fc700 1 -- 172.21.15.142:0/2559992628 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff42c0519b0 con 0x7ff4341573a0 2023-09-30T22:57:43.167 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.168+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff414067330 msgr2=0x7ff4140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.168+0000 7ff4389ff700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff414067330 0x7ff4140697e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff4240099e0 tx=0x7ff424016000 comp rx=0 tx=0).stop 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.168+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4341573a0 msgr2=0x7ff4340c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.168+0000 7ff4389ff700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4341573a0 0x7ff4340c8ac0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00bc30 tx=0x7ff42c009820 comp rx=0 tx=0).stop 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 shutdown_connections 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff414067330 0x7ff4140697e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4341573a0 0x7ff4340c8ac0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4340cbfe0 0x7ff4341473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 --2- 172.21.15.142:0/2559992628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4340cc3b0 0x7ff4340c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 >> 172.21.15.142:0/2559992628 conn(0x7ff4340d0a80 msgr2=0x7ff434156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 shutdown_connections 2023-09-30T22:57:43.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.169+0000 7ff4389ff700 1 -- 172.21.15.142:0/2559992628 wait complete. 2023-09-30T22:57:43.187 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:57:43.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.378+0000 7f37e7dff700 1 Processor -- start 2023-09-30T22:57:43.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.378+0000 7f37e7dff700 1 -- start start 2023-09-30T22:57:43.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:43.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e7dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37e00cbfe0 0x7f37e015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e7dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37e00cc3b0 0x7f37e00cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e7dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e00d0550 con 0x7f37e01573a0 2023-09-30T22:57:43.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e7dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e00cf750 con 0x7f37e00cc3b0 2023-09-30T22:57:43.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e7dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e00cf940 con 0x7f37e00cbfe0 2023-09-30T22:57:43.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e539a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37e00cc3b0 0x7f37e00cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e539a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37e00cc3b0 0x7f37e00cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53762/0 (socket says 172.21.15.142:53762) 2023-09-30T22:57:43.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e539a700 1 -- 172.21.15.142:0/4150922513 learned_addr learned my addr 172.21.15.142:0/4150922513 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:43.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.380+0000 7f37e5b9b700 1 --2- 172.21.15.142:0/4150922513 >> v2:172.21.15.148:3300/0 conn(0x7f37e00cbfe0 0x7f37e015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.384 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:43.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e539a700 1 -- 172.21.15.142:0/4150922513 >> v2:172.21.15.148:3300/0 conn(0x7f37e00cbfe0 msgr2=0x7f37e015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:43.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e539a700 1 --2- 172.21.15.142:0/4150922513 >> v2:172.21.15.148:3300/0 conn(0x7f37e00cbfe0 0x7f37e015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e539a700 1 -- 172.21.15.142:0/4150922513 >> v1:172.21.15.148:6789/0 conn(0x7f37e01573a0 legacy=0x7f37e015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e539a700 1 -- 172.21.15.142:0/4150922513 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e00cfc20 con 0x7f37e00cc3b0 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e539a700 1 --2- 172.21.15.142:0/4150922513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cc3b0 0x7f37e00cf210 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f37e006cf00 tx=0x7f37d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67af9064cfa4dd26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e4b99700 1 -- 172.21.15.142:0/4150922513 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000b860 con 0x7f37e00cc3b0 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e4b99700 1 -- 172.21.15.142:0/4150922513 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000b9c0 con 0x7f37e00cc3b0 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.381+0000 7f37e4b99700 1 -- 172.21.15.142:0/4150922513 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000bd60 con 0x7f37e00cc3b0 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 -- 172.21.15.142:0/4150922513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cc3b0 msgr2=0x7f37e00cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 --2- 172.21.15.142:0/4150922513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cc3b0 0x7f37e00cf210 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f37e006cf00 tx=0x7f37d0009250 comp rx=0 tx=0).stop 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 -- 172.21.15.142:0/4150922513 shutdown_connections 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 --2- 172.21.15.142:0/4150922513 >> v2:172.21.15.148:3300/0 conn(0x7f37e00cbfe0 0x7f37e015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 --2- 172.21.15.142:0/4150922513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cc3b0 0x7f37e00cf210 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 -- 172.21.15.142:0/4150922513 >> 172.21.15.142:0/4150922513 conn(0x7f37e00d0a80 msgr2=0x7f37e00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 -- 172.21.15.142:0/4150922513 shutdown_connections 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.382+0000 7f37e7dff700 1 -- 172.21.15.142:0/4150922513 wait complete. 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.383+0000 7f37e7dff700 1 Processor -- start 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.383+0000 7f37e7dff700 1 -- start start 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.384+0000 7f37e7dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cbfe0 0x7f37e0147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.384+0000 7f37e7dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37e00cc3b0 0x7f37e00b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.384+0000 7f37e7dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37e01573a0 0x7f37e00b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.384+0000 7f37e7dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00b8db0 con 0x7f37e00cbfe0 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.384+0000 7f37e7dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00ca650 con 0x7f37e01573a0 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.384+0000 7f37e7dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00c54d0 con 0x7f37e00cc3b0 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.384+0000 7f37e5b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cbfe0 0x7f37e0147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cbfe0 0x7f37e0147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53776/0 (socket says 172.21.15.142:53776) 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 -- 172.21.15.142:0/1090711606 learned_addr learned my addr 172.21.15.142:0/1090711606 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e539a700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37e00cc3b0 0x7f37e00b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e639c700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37e01573a0 0x7f37e00b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 -- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37e00cc3b0 msgr2=0x7f37e00b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37e00cc3b0 0x7f37e00b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 -- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37e01573a0 msgr2=0x7f37e00b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37e01573a0 0x7f37e00b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 -- 172.21.15.142:0/1090711606 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00094f0 con 0x7f37e00cbfe0 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e639c700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37e01573a0 0x7f37e00b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37e5b9b700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cbfe0 0x7f37e0147620 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d890 tx=0x7f37dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.385+0000 7f37d5ffb700 1 -- 172.21.15.142:0/1090711606 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00b600 con 0x7f37e00cbfe0 2023-09-30T22:57:43.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.386+0000 7f37d5ffb700 1 -- 172.21.15.142:0/1090711606 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc00b760 con 0x7f37e00cbfe0 2023-09-30T22:57:43.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.386+0000 7f37d5ffb700 1 -- 172.21.15.142:0/1090711606 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00bae0 con 0x7f37e00cbfe0 2023-09-30T22:57:43.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.386+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e00c57b0 con 0x7f37e00cbfe0 2023-09-30T22:57:43.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.386+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e00c5d70 con 0x7f37e00cbfe0 2023-09-30T22:57:43.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.387+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e00c5f60 con 0x7f37e00cbfe0 2023-09-30T22:57:43.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.387+0000 7f37d5ffb700 1 -- 172.21.15.142:0/1090711606 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f37dc01e460 con 0x7f37e00cbfe0 2023-09-30T22:57:43.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.388+0000 7f37d5ffb700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37c4067330 0x7f37c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.388+0000 7f37d5ffb700 1 -- 172.21.15.142:0/1090711606 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f37dc084fa0 con 0x7f37e00cbfe0 2023-09-30T22:57:43.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.389+0000 7f37e539a700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37c4067330 0x7f37c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.389+0000 7f37e539a700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37c4067330 0x7f37c40697e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37e006cf00 tx=0x7f37d0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:43.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.393+0000 7f37d5ffb700 1 -- 172.21.15.142:0/1090711606 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f37dc052150 con 0x7f37e00cbfe0 2023-09-30T22:57:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.587+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37e015a5c0 con 0x7f37e00cbfe0 2023-09-30T22:57:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.587+0000 7f37d5ffb700 1 -- 172.21.15.142:0/1090711606 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37dc055770 con 0x7f37e00cbfe0 2023-09-30T22:57:43.589 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:57:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37c4067330 msgr2=0x7f37c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37c4067330 0x7f37c40697e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37e006cf00 tx=0x7f37d0017000 comp rx=0 tx=0).stop 2023-09-30T22:57:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cbfe0 msgr2=0x7f37e0147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cbfe0 0x7f37e0147620 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d890 tx=0x7f37dc008040 comp rx=0 tx=0).stop 2023-09-30T22:57:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 shutdown_connections 2023-09-30T22:57:43.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f37c4067330 0x7f37c40697e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37e01573a0 0x7f37e00b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e00cbfe0 0x7f37e0147620 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 --2- 172.21.15.142:0/1090711606 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37e00cc3b0 0x7f37e00b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 >> 172.21.15.142:0/1090711606 conn(0x7f37e00d0a80 msgr2=0x7f37e0156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 shutdown_connections 2023-09-30T22:57:43.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.590+0000 7f37e7dff700 1 -- 172.21.15.142:0/1090711606 wait complete. 2023-09-30T22:57:43.608 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:57:43.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.796+0000 7f96a25ff700 1 Processor -- start 2023-09-30T22:57:43.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.796+0000 7f96a25ff700 1 -- start start 2023-09-30T22:57:43.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.797+0000 7f96a25ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f969c159ae0 0x7f969c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.797+0000 7f96a25ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f969c0cc590 0x7f969c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.797+0000 7f96a25ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c15d910 con 0x7f969c0b1180 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.797+0000 7f96a25ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c15e920 con 0x7f969c159ae0 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.797+0000 7f96a25ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c15e490 con 0x7f969c0cc590 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f969c159ae0 0x7f969c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f969c0b1180 0x7f969c0cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46568/0 (socket says 172.21.15.142:46568) 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969b7fe700 1 -- 172.21.15.142:0/541049070 learned_addr learned my addr 172.21.15.142:0/541049070 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f96a0b9c700 1 --2- 172.21.15.142:0/541049070 >> v2:172.21.15.148:3300/0 conn(0x7f969c0cc590 0x7f969c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969affd700 1 -- 172.21.15.142:0/541049070 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330099053 0 0) 0x7f969c15d910 con 0x7f969c0b1180 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969affd700 1 -- 172.21.15.142:0/541049070 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9684003570 con 0x7f969c0b1180 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969bfff700 1 -- 172.21.15.142:0/541049070 >> v2:172.21.15.148:3300/0 conn(0x7f969c0cc590 msgr2=0x7f969c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969bfff700 1 --2- 172.21.15.142:0/541049070 >> v2:172.21.15.148:3300/0 conn(0x7f969c0cc590 0x7f969c069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969bfff700 1 -- 172.21.15.142:0/541049070 >> v1:172.21.15.142:6789/0 conn(0x7f969c0b1180 legacy=0x7f969c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969bfff700 1 -- 172.21.15.142:0/541049070 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c15db60 con 0x7f969c159ae0 2023-09-30T22:57:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f96a0b9c700 1 --2- 172.21.15.142:0/541049070 >> v2:172.21.15.148:3300/0 conn(0x7f969c0cc590 0x7f969c069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.798+0000 7f969bfff700 1 --2- 172.21.15.142:0/541049070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c159ae0 0x7f969c0cdeb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f969c0cb3d0 tx=0x7f968c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a71340a128ed60 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f969affd700 1 -- 172.21.15.142:0/541049070 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c011630 con 0x7f969c159ae0 2023-09-30T22:57:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f969affd700 1 -- 172.21.15.142:0/541049070 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c011790 con 0x7f969c159ae0 2023-09-30T22:57:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f969affd700 1 -- 172.21.15.142:0/541049070 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c011b30 con 0x7f969c159ae0 2023-09-30T22:57:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 -- 172.21.15.142:0/541049070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c159ae0 msgr2=0x7f969c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 --2- 172.21.15.142:0/541049070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c159ae0 0x7f969c0cdeb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f969c0cb3d0 tx=0x7f968c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 -- 172.21.15.142:0/541049070 shutdown_connections 2023-09-30T22:57:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 --2- 172.21.15.142:0/541049070 >> v2:172.21.15.148:3300/0 conn(0x7f969c0cc590 0x7f969c069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 --2- 172.21.15.142:0/541049070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c159ae0 0x7f969c0cdeb0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 -- 172.21.15.142:0/541049070 >> 172.21.15.142:0/541049070 conn(0x7f969c0ce8b0 msgr2=0x7f969c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:43.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 -- 172.21.15.142:0/541049070 shutdown_connections 2023-09-30T22:57:43.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.799+0000 7f96a25ff700 1 -- 172.21.15.142:0/541049070 wait complete. 2023-09-30T22:57:43.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.801+0000 7f96a25ff700 1 Processor -- start 2023-09-30T22:57:43.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.801+0000 7f96a25ff700 1 -- start start 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a25ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f969c0b1180 0x7f969c141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a25ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0cc590 0x7f969c16d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a25ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f969c159ae0 0x7f969c16b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a25ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c16cf20 con 0x7f969c0cc590 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a25ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1423f0 con 0x7f969c159ae0 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a25ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0ca770 con 0x7f969c0b1180 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0cc590 0x7f969c16d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0cc590 0x7f969c16d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53794/0 (socket says 172.21.15.142:53794) 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 -- 172.21.15.142:0/225631306 learned_addr learned my addr 172.21.15.142:0/225631306 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969bfff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f969c0b1180 0x7f969c141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a0b9c700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f969c159ae0 0x7f969c16b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 -- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f969c0b1180 msgr2=0x7f969c141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f969c0b1180 0x7f969c141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 -- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f969c159ae0 msgr2=0x7f969c16b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f969c159ae0 0x7f969c16b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f969b7fe700 1 -- 172.21.15.142:0/225631306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c009420 con 0x7f969c0cc590 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.802+0000 7f96a0b9c700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f969c159ae0 0x7f969c16b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.803+0000 7f969b7fe700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0cc590 0x7f969c16d3b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f969000c7c0 tx=0x7f9690007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.803+0000 7f9683fff700 1 -- 172.21.15.142:0/225631306 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690005c00 con 0x7f969c0cc590 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.803+0000 7f9683fff700 1 -- 172.21.15.142:0/225631306 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690005d60 con 0x7f969c0cc590 2023-09-30T22:57:43.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.803+0000 7f9683fff700 1 -- 172.21.15.142:0/225631306 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690007300 con 0x7f969c0cc590 2023-09-30T22:57:43.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.803+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c16d8f0 con 0x7f969c0cc590 2023-09-30T22:57:43.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.803+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c16c5f0 con 0x7f969c0cc590 2023-09-30T22:57:43.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.804+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c16d0d0 con 0x7f969c0cc590 2023-09-30T22:57:43.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.805+0000 7f9683fff700 1 -- 172.21.15.142:0/225631306 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f96900076b0 con 0x7f969c0cc590 2023-09-30T22:57:43.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.806+0000 7f9683fff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9688067330 0x7f96880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:43.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.806+0000 7f9683fff700 1 -- 172.21.15.142:0/225631306 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9690083e60 con 0x7f969c0cc590 2023-09-30T22:57:43.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.806+0000 7f969bfff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9688067330 0x7f96880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:43.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.807+0000 7f969bfff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9688067330 0x7f96880697e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f968c0093f0 tx=0x7f968c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:43.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:43.810+0000 7f9683fff700 1 -- 172.21.15.142:0/225631306 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f969c16d0d0 con 0x7f969c0cc590 2023-09-30T22:57:44.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.005+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f969c16d0d0 con 0x7f969c0cc590 2023-09-30T22:57:44.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.006+0000 7f9683fff700 1 -- 172.21.15.142:0/225631306 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v107) v1 ==== 84+0+126 (secure 0 0 0) 0x7f969c16d0d0 con 0x7f969c0cc590 2023-09-30T22:57:44.007 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:44.007 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:57:44.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:44.007 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:57:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:57:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:57:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:57:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:57:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:57:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:57:44.008 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:57:44.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9688067330 msgr2=0x7f96880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:44.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9688067330 0x7f96880697e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f968c0093f0 tx=0x7f968c017000 comp rx=0 tx=0).stop 2023-09-30T22:57:44.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0cc590 msgr2=0x7f969c16d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:44.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0cc590 0x7f969c16d3b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f969000c7c0 tx=0x7f9690007dd0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 shutdown_connections 2023-09-30T22:57:44.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9688067330 0x7f96880697e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f969c159ae0 0x7f969c16b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f969c0b1180 0x7f969c141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 --2- 172.21.15.142:0/225631306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0cc590 0x7f969c16d3b0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 >> 172.21.15.142:0/225631306 conn(0x7f969c0ce8b0 msgr2=0x7f969c0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:44.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 shutdown_connections 2023-09-30T22:57:44.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.009+0000 7f96a25ff700 1 -- 172.21.15.142:0/225631306 wait complete. 2023-09-30T22:57:44.027 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:57:44.027 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:57:44.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.221+0000 7fba483ff700 1 Processor -- start 2023-09-30T22:57:44.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.221+0000 7fba483ff700 1 -- start start 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.222+0000 7fba483ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c6240 0x7fba400c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.222+0000 7fba483ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba400c6a80 con 0x7fba40141310 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.222+0000 7fba483ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba401416e0 con 0x7fba400c40e0 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.222+0000 7fba483ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba400c3250 con 0x7fba400c6240 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.222+0000 7fba4619b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fba40141310 0x7fba40158ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46584/0 (socket says 172.21.15.142:46584) 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.222+0000 7fba4619b700 1 -- 172.21.15.142:0/2773189654 learned_addr learned my addr 172.21.15.142:0/2773189654 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.222+0000 7fba4599a700 1 --2- 172.21.15.142:0/2773189654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c6240 0x7fba400c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:44.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299437903 0 0) 0x7fba400c6a80 con 0x7fba40141310 2023-09-30T22:57:44.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2c003570 con 0x7fba40141310 2023-09-30T22:57:44.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190162265 0 0) 0x7fba38001490 con 0x7fba400c40e0 2023-09-30T22:57:44.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba400c6a80 con 0x7fba400c40e0 2023-09-30T22:57:44.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1079504302 0 0) 0x7fba2c003570 con 0x7fba40141310 2023-09-30T22:57:44.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba4599a700 1 -- 172.21.15.142:0/2773189654 >> v1:172.21.15.148:6789/0 conn(0x7fba400c40e0 legacy=0x7fba4006aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:44.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba4599a700 1 -- 172.21.15.142:0/2773189654 >> v1:172.21.15.142:6789/0 conn(0x7fba40141310 legacy=0x7fba40158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:44.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba4599a700 1 -- 172.21.15.142:0/2773189654 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400c67e0 con 0x7fba400c6240 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.223+0000 7fba4599a700 1 --2- 172.21.15.142:0/2773189654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c6240 0x7fba400c7450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fba30009910 tx=0x7fba300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a0bbb2348290832 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c001470 con 0x7fba400c6240 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30011420 con 0x7fba400c6240 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba45199700 1 -- 172.21.15.142:0/2773189654 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300117c0 con 0x7fba400c6240 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba483ff700 1 -- 172.21.15.142:0/2773189654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c6240 msgr2=0x7fba400c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba483ff700 1 --2- 172.21.15.142:0/2773189654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c6240 0x7fba400c7450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fba30009910 tx=0x7fba300091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba483ff700 1 -- 172.21.15.142:0/2773189654 shutdown_connections 2023-09-30T22:57:44.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba483ff700 1 --2- 172.21.15.142:0/2773189654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c6240 0x7fba400c7450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba483ff700 1 -- 172.21.15.142:0/2773189654 >> 172.21.15.142:0/2773189654 conn(0x7fba400cc670 msgr2=0x7fba400cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:44.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba483ff700 1 -- 172.21.15.142:0/2773189654 shutdown_connections 2023-09-30T22:57:44.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.224+0000 7fba483ff700 1 -- 172.21.15.142:0/2773189654 wait complete. 2023-09-30T22:57:44.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.226+0000 7fba483ff700 1 Processor -- start 2023-09-30T22:57:44.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.226+0000 7fba483ff700 1 -- start start 2023-09-30T22:57:44.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba483ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c40e0 0x7fba400b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:44.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba483ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba400c6240 0x7fba400b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:44.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba483ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba40141310 0x7fba400b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:44.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba483ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba400b4b50 con 0x7fba40141310 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba483ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba400b6350 con 0x7fba400c6240 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba483ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba40168a90 con 0x7fba400c40e0 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba4699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba40141310 0x7fba400b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba4699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba40141310 0x7fba400b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53796/0 (socket says 172.21.15.142:53796) 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba4699c700 1 -- 172.21.15.142:0/1978154145 learned_addr learned my addr 172.21.15.142:0/1978154145 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba4619b700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c40e0 0x7fba400b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba4599a700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba400c6240 0x7fba400b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba4699c700 1 -- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c40e0 msgr2=0x7fba400b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:44.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.227+0000 7fba4699c700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c40e0 0x7fba400b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba4699c700 1 -- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba400c6240 msgr2=0x7fba400b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba4699c700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba400c6240 0x7fba400b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba4699c700 1 -- 172.21.15.142:0/1978154145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30009420 con 0x7fba40141310 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba4699c700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba40141310 0x7fba400b56f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fba3800c910 tx=0x7fba3800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba367fc700 1 -- 172.21.15.142:0/1978154145 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800a7a0 con 0x7fba40141310 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba367fc700 1 -- 172.21.15.142:0/1978154145 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800a920 con 0x7fba40141310 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba400b7d60 con 0x7fba40141310 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba367fc700 1 -- 172.21.15.142:0/1978154145 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800ace0 con 0x7fba40141310 2023-09-30T22:57:44.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.228+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba400b6070 con 0x7fba40141310 2023-09-30T22:57:44.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.229+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba40069a50 con 0x7fba40141310 2023-09-30T22:57:44.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.230+0000 7fba367fc700 1 -- 172.21.15.142:0/1978154145 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fba38012630 con 0x7fba40141310 2023-09-30T22:57:44.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.231+0000 7fba367fc700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fba24067330 0x7fba240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:44.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.231+0000 7fba367fc700 1 -- 172.21.15.142:0/1978154145 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fba38084a20 con 0x7fba40141310 2023-09-30T22:57:44.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.231+0000 7fba4619b700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fba24067330 0x7fba240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:44.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.232+0000 7fba4619b700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fba24067330 0x7fba240697e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fba3c001380 tx=0x7fba3c0015c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:44.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.235+0000 7fba367fc700 1 -- 172.21.15.142:0/1978154145 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fba38051c70 con 0x7fba40141310 2023-09-30T22:57:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:44.426+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fba401416e0 con 0x7fba40141310 2023-09-30T22:57:45.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.314+0000 7fba367fc700 1 -- 172.21.15.142:0/1978154145 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v108) v1 ==== 138+0+0 (secure 0 0 0) 0x7fba401416e0 con 0x7fba40141310 2023-09-30T22:57:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fba24067330 msgr2=0x7fba240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:45.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fba24067330 0x7fba240697e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fba3c001380 tx=0x7fba3c0015c0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba40141310 msgr2=0x7fba400b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba40141310 0x7fba400b56f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fba3800c910 tx=0x7fba3800ccd0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 shutdown_connections 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fba24067330 0x7fba240697e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba40141310 0x7fba400b56f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba400c40e0 0x7fba400b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 --2- 172.21.15.142:0/1978154145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba400c6240 0x7fba400b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 >> 172.21.15.142:0/1978154145 conn(0x7fba400cc670 msgr2=0x7fba400cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 shutdown_connections 2023-09-30T22:57:45.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.318+0000 7fba483ff700 1 -- 172.21.15.142:0/1978154145 wait complete. 2023-09-30T22:57:45.321 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:57:45.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:57:45.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.539+0000 7fbc7a3ff700 1 Processor -- start 2023-09-30T22:57:45.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.540+0000 7fbc7a3ff700 1 -- start start 2023-09-30T22:57:45.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc7a3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc740c52a0 0x7fbc740c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:45.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc7a3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc74069f10 0x7fbc740c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:45.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc7a3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc740c7690 con 0x7fbc740c5bb0 2023-09-30T22:57:45.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc7a3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc741406a0 con 0x7fbc740c52a0 2023-09-30T22:57:45.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc7a3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc740c3a50 con 0x7fbc74069f10 2023-09-30T22:57:45.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc73fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc740c52a0 0x7fbc740c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:45.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc7899c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbc740c5bb0 0x7fbc740ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46598/0 (socket says 172.21.15.142:46598) 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc73fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc740c52a0 0x7fbc740c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53810/0 (socket says 172.21.15.142:53810) 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.541+0000 7fbc7899c700 1 -- 172.21.15.142:0/1222429595 learned_addr learned my addr 172.21.15.142:0/1222429595 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc737fe700 1 --2- 172.21.15.142:0/1222429595 >> v2:172.21.15.148:3300/0 conn(0x7fbc74069f10 0x7fbc740c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc73fff700 1 -- 172.21.15.142:0/1222429595 >> v2:172.21.15.148:3300/0 conn(0x7fbc74069f10 msgr2=0x7fbc740c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc73fff700 1 --2- 172.21.15.142:0/1222429595 >> v2:172.21.15.148:3300/0 conn(0x7fbc74069f10 0x7fbc740c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc73fff700 1 -- 172.21.15.142:0/1222429595 >> v1:172.21.15.142:6789/0 conn(0x7fbc740c5bb0 legacy=0x7fbc740ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc73fff700 1 -- 172.21.15.142:0/1222429595 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740c7f20 con 0x7fbc740c52a0 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc72ffd700 1 -- 172.21.15.142:0/1222429595 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769927211 0 0) 0x7fbc6c001490 con 0x7fbc740c5bb0 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc73fff700 1 --2- 172.21.15.142:0/1222429595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc740c88d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406b940 tx=0x7fbc640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af17f80d60df5d32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc72ffd700 1 -- 172.21.15.142:0/1222429595 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64009e80 con 0x7fbc740c52a0 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc72ffd700 1 -- 172.21.15.142:0/1222429595 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6400b820 con 0x7fbc740c52a0 2023-09-30T22:57:45.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.542+0000 7fbc72ffd700 1 -- 172.21.15.142:0/1222429595 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400bba0 con 0x7fbc740c52a0 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1222429595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 msgr2=0x7fbc740c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1222429595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc740c88d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406b940 tx=0x7fbc640091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1222429595 shutdown_connections 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1222429595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc740c88d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1222429595 >> v2:172.21.15.148:3300/0 conn(0x7fbc74069f10 0x7fbc740c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1222429595 >> 172.21.15.142:0/1222429595 conn(0x7fbc740cc670 msgr2=0x7fbc740cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1222429595 shutdown_connections 2023-09-30T22:57:45.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.543+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1222429595 wait complete. 2023-09-30T22:57:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.544+0000 7fbc7a3ff700 1 Processor -- start 2023-09-30T22:57:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.545+0000 7fbc7a3ff700 1 -- start start 2023-09-30T22:57:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.545+0000 7fbc7a3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc74069f10 0x7fbc740b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.545+0000 7fbc7a3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc7413d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.545+0000 7fbc7a3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc740c5bb0 0x7fbc7413de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:45.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.545+0000 7fbc7a3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74156780 con 0x7fbc740c52a0 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc7a3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740b5730 con 0x7fbc74069f10 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc7a3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740b5a10 con 0x7fbc740c5bb0 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc7413d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc7413d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53824/0 (socket says 172.21.15.142:53824) 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 -- 172.21.15.142:0/1506420532 learned_addr learned my addr 172.21.15.142:0/1506420532 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc73fff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc74069f10 0x7fbc740b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc7899c700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc740c5bb0 0x7fbc7413de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 -- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc740c5bb0 msgr2=0x7fbc7413de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc740c5bb0 0x7fbc7413de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 -- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc74069f10 msgr2=0x7fbc740b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc74069f10 0x7fbc740b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:45.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.546+0000 7fbc737fe700 1 -- 172.21.15.142:0/1506420532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc64009420 con 0x7fbc740c52a0 2023-09-30T22:57:45.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.547+0000 7fbc737fe700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc7413d920 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800d860 tx=0x7fbc68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:45.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.547+0000 7fbc5bfff700 1 -- 172.21.15.142:0/1506420532 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680125f0 con 0x7fbc740c52a0 2023-09-30T22:57:45.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.547+0000 7fbc5bfff700 1 -- 172.21.15.142:0/1506420532 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68012750 con 0x7fbc740c52a0 2023-09-30T22:57:45.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.547+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc740b5cf0 con 0x7fbc740c52a0 2023-09-30T22:57:45.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.547+0000 7fbc5bfff700 1 -- 172.21.15.142:0/1506420532 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68012af0 con 0x7fbc740c52a0 2023-09-30T22:57:45.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.547+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc740b62b0 con 0x7fbc740c52a0 2023-09-30T22:57:45.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.548+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc74069a50 con 0x7fbc740c52a0 2023-09-30T22:57:45.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.549+0000 7fbc5bfff700 1 -- 172.21.15.142:0/1506420532 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbc68013480 con 0x7fbc740c52a0 2023-09-30T22:57:45.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.550+0000 7fbc5bfff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc60067330 0x7fbc600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:45.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.550+0000 7fbc5bfff700 1 -- 172.21.15.142:0/1506420532 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fbc68084de0 con 0x7fbc740c52a0 2023-09-30T22:57:45.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.551+0000 7fbc73fff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc60067330 0x7fbc600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:45.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.551+0000 7fbc73fff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc60067330 0x7fbc600697e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbc640093f0 tx=0x7fbc64017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:45.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.555+0000 7fbc5bfff700 1 -- 172.21.15.142:0/1506420532 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbc680558b0 con 0x7fbc740c52a0 2023-09-30T22:57:45.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:45.746+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbc7406fc10 con 0x7fbc740c52a0 2023-09-30T22:57:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.319+0000 7fbc5bfff700 1 -- 172.21.15.142:0/1506420532 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v109) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbc68055440 con 0x7fbc740c52a0 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.326+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc60067330 msgr2=0x7fbc600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.326+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc60067330 0x7fbc600697e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbc640093f0 tx=0x7fbc64017000 comp rx=0 tx=0).stop 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.326+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 msgr2=0x7fbc7413d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.326+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc7413d920 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800d860 tx=0x7fbc68008040 comp rx=0 tx=0).stop 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.327+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 shutdown_connections 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.327+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbc60067330 0x7fbc600697e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.327+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbc740c5bb0 0x7fbc7413de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.327+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc74069f10 0x7fbc740b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.327+0000 7fbc7a3ff700 1 --2- 172.21.15.142:0/1506420532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc740c52a0 0x7fbc7413d920 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.327+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 >> 172.21.15.142:0/1506420532 conn(0x7fbc740cc670 msgr2=0x7fbc7406d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.328+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 shutdown_connections 2023-09-30T22:57:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.328+0000 7fbc7a3ff700 1 -- 172.21.15.142:0/1506420532 wait complete. 2023-09-30T22:57:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:57:46.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:57:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.543+0000 7fad48bff700 1 Processor -- start 2023-09-30T22:57:46.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.543+0000 7fad48bff700 1 -- start start 2023-09-30T22:57:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad48bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fad440c52a0 0x7fad440c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad48bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440cb350 0x7fad441605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad48bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440c7690 con 0x7fad44069f10 2023-09-30T22:57:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad48bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad441406a0 con 0x7fad440c52a0 2023-09-30T22:57:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad48bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440c3a50 con 0x7fad440cb350 2023-09-30T22:57:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad42d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440cb350 0x7fad441605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad42d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440cb350 0x7fad441605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:54422/0 (socket says 172.21.15.142:54422) 2023-09-30T22:57:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad4259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fad440c52a0 0x7fad440c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad42d9d700 1 -- 172.21.15.142:0/3876146751 learned_addr learned my addr 172.21.15.142:0/3876146751 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.545+0000 7fad41d9b700 1 --1- 172.21.15.142:0/3876146751 >> v1:172.21.15.148:6789/0 conn(0x7fad44069f10 0x7fad440c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:53850/0 (socket says 172.21.15.142:53850) 2023-09-30T22:57:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad42d9d700 1 -- 172.21.15.142:0/3876146751 >> v2:172.21.15.148:3300/0 conn(0x7fad440c52a0 msgr2=0x7fad440c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad42d9d700 1 --2- 172.21.15.142:0/3876146751 >> v2:172.21.15.148:3300/0 conn(0x7fad440c52a0 0x7fad440c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad42d9d700 1 -- 172.21.15.142:0/3876146751 >> v1:172.21.15.148:6789/0 conn(0x7fad44069f10 legacy=0x7fad440c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad42d9d700 1 -- 172.21.15.142:0/3876146751 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440c7f20 con 0x7fad440cb350 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad42d9d700 1 --2- 172.21.15.142:0/3876146751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440cb350 0x7fad441605e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009f20 tx=0x7fad3c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=706c7d2a036a67b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad4159a700 1 -- 172.21.15.142:0/3876146751 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00e070 con 0x7fad440cb350 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad4159a700 1 -- 172.21.15.142:0/3876146751 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c00b9d0 con 0x7fad440cb350 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.546+0000 7fad4159a700 1 -- 172.21.15.142:0/3876146751 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0092e0 con 0x7fad440cb350 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 -- 172.21.15.142:0/3876146751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440cb350 msgr2=0x7fad441605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 --2- 172.21.15.142:0/3876146751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440cb350 0x7fad441605e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009f20 tx=0x7fad3c009840 comp rx=0 tx=0).stop 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 -- 172.21.15.142:0/3876146751 shutdown_connections 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 --2- 172.21.15.142:0/3876146751 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440cb350 0x7fad441605e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 --2- 172.21.15.142:0/3876146751 >> v2:172.21.15.148:3300/0 conn(0x7fad440c52a0 0x7fad440c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 -- 172.21.15.142:0/3876146751 >> 172.21.15.142:0/3876146751 conn(0x7fad440cc670 msgr2=0x7fad440cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 -- 172.21.15.142:0/3876146751 shutdown_connections 2023-09-30T22:57:46.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.547+0000 7fad48bff700 1 -- 172.21.15.142:0/3876146751 wait complete. 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.548+0000 7fad48bff700 1 Processor -- start 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.548+0000 7fad48bff700 1 -- start start 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.549+0000 7fad48bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad44069f10 0x7fad4413b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.549+0000 7fad48bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440c52a0 0x7fad4413b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.549+0000 7fad48bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440cb350 0x7fad4413cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.549+0000 7fad48bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4413da50 con 0x7fad44069f10 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.549+0000 7fad48bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440c15b0 con 0x7fad440cb350 2023-09-30T22:57:46.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.549+0000 7fad48bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4416ae10 con 0x7fad440c52a0 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad44069f10 0x7fad4413b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad44069f10 0x7fad4413b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53830/0 (socket says 172.21.15.142:53830) 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 -- 172.21.15.142:0/2905390099 learned_addr learned my addr 172.21.15.142:0/2905390099 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 -- 172.21.15.142:0/2905390099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440c52a0 msgr2=0x7fad4413b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440c52a0 0x7fad4413b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 -- 172.21.15.142:0/2905390099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440cb350 msgr2=0x7fad4413cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440cb350 0x7fad4413cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 -- 172.21.15.142:0/2905390099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009ae0 con 0x7fad44069f10 2023-09-30T22:57:46.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad4259c700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad44069f10 0x7fad4413b0b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fad3400ec80 tx=0x7fad340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.550+0000 7fad327fc700 1 -- 172.21.15.142:0/2905390099 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3400c970 con 0x7fad44069f10 2023-09-30T22:57:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.551+0000 7fad327fc700 1 -- 172.21.15.142:0/2905390099 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3400cad0 con 0x7fad44069f10 2023-09-30T22:57:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.551+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad440c1e10 con 0x7fad44069f10 2023-09-30T22:57:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.551+0000 7fad327fc700 1 -- 172.21.15.142:0/2905390099 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3400ce70 con 0x7fad44069f10 2023-09-30T22:57:46.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.551+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad440c17c0 con 0x7fad44069f10 2023-09-30T22:57:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.552+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad44069a50 con 0x7fad44069f10 2023-09-30T22:57:46.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.553+0000 7fad327fc700 1 -- 172.21.15.142:0/2905390099 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad34013680 con 0x7fad44069f10 2023-09-30T22:57:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.554+0000 7fad327fc700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.554+0000 7fad327fc700 1 -- 172.21.15.142:0/2905390099 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fad34084f10 con 0x7fad44069f10 2023-09-30T22:57:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.555+0000 7fad41d9b700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:46.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.555+0000 7fad41d9b700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fad4413dc80 tx=0x7fad38007b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:46.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.559+0000 7fad327fc700 1 -- 172.21.15.142:0/2905390099 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad34051dd0 con 0x7fad44069f10 2023-09-30T22:57:46.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:46.791+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fad4406fc10 con 0x7fad44069f10 2023-09-30T22:57:47.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.337+0000 7fad327fc700 1 -- 172.21.15.142:0/2905390099 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v46) v1 ==== 174+0+0 (secure 0 0 0) 0x7fad340170c0 con 0x7fad44069f10 2023-09-30T22:57:47.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.344+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 msgr2=0x7fad240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.344+0000 7fad48bff700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fad4413dc80 tx=0x7fad38007b30 comp rx=0 tx=0).stop 2023-09-30T22:57:47.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.344+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad44069f10 msgr2=0x7fad4413b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.344+0000 7fad48bff700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad44069f10 0x7fad4413b0b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fad3400ec80 tx=0x7fad340091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.352+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 shutdown_connections 2023-09-30T22:57:47.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.352+0000 7fad48bff700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.352+0000 7fad48bff700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad440cb350 0x7fad4413cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.352+0000 7fad48bff700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad44069f10 0x7fad4413b0b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.352+0000 7fad48bff700 1 --2- 172.21.15.142:0/2905390099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad440c52a0 0x7fad4413b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.352+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 >> 172.21.15.142:0/2905390099 conn(0x7fad440cc670 msgr2=0x7fad4413f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:47.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.353+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 shutdown_connections 2023-09-30T22:57:47.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.353+0000 7fad48bff700 1 -- 172.21.15.142:0/2905390099 wait complete. 2023-09-30T22:57:47.359 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 13 and data pool 14 2023-09-30T22:57:47.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:57:47.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.567+0000 7f877dfff700 1 Processor -- start 2023-09-30T22:57:47.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.568+0000 7f877dfff700 1 -- start start 2023-09-30T22:57:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.569+0000 7f877dfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 0x7f87780cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.569+0000 7f877dfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877815d910 con 0x7f8778159eb0 2023-09-30T22:57:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.569+0000 7f877dfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877815e490 con 0x7f8778159ae0 2023-09-30T22:57:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.569+0000 7f877dfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877815e920 con 0x7f87780b1180 2023-09-30T22:57:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.569+0000 7f8777fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8778159eb0 0x7f8778069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46610/0 (socket says 172.21.15.142:46610) 2023-09-30T22:57:47.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.569+0000 7f8777fff700 1 -- 172.21.15.142:0/233364391 learned_addr learned my addr 172.21.15.142:0/233364391 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:47.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.569+0000 7f8776ffd700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 0x7f87780cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148768396 0 0) 0x7f877815d910 con 0x7f8778159eb0 2023-09-30T22:57:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8760003570 con 0x7f8778159eb0 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2901608029 0 0) 0x7f8760003570 con 0x7f8778159eb0 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 msgr2=0x7f87780cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 0x7f87780cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 >> v1:172.21.15.148:6789/0 conn(0x7f8778159ae0 legacy=0x7f87780cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780ce5c0 con 0x7f8778159eb0 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f87700017f0 con 0x7f8778159eb0 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 >> v1:172.21.15.142:6789/0 conn(0x7f8778159eb0 legacy=0x7f8778069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8760003a90 0x7f8760003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 0x7f8760004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760004d50 0x7f87600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876000bb10 con 0x7f8760003a90 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876000bc80 con 0x7f8760004d50 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876000be40 con 0x7f87780b1180 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f87777fe700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8760003a90 0x7f8760003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f8776ffd700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 0x7f8760004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.570+0000 7f8777fff700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760004d50 0x7f87600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87777fe700 1 -- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 msgr2=0x7f8760004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87777fe700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780b1180 0x7f8760004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87777fe700 1 -- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760004d50 msgr2=0x7f87600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87777fe700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760004d50 0x7f87600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87777fe700 1 -- 172.21.15.142:0/233364391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760003570 con 0x7f8760003a90 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f8777fff700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760004d50 0x7f87600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87777fe700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8760003a90 0x7f8760003e60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8768001a60 tx=0x7f8768007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dc983a4bacf5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:47.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768001ea0 con 0x7f8760003a90 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876800c590 con 0x7f8760003a90 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.571+0000 7f87767fc700 1 -- 172.21.15.142:0/233364391 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800c930 con 0x7f8760003a90 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.572+0000 7f877dfff700 1 -- 172.21.15.142:0/233364391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8760003a90 msgr2=0x7f8760003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.572+0000 7f877dfff700 1 --2- 172.21.15.142:0/233364391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8760003a90 0x7f8760003e60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8768001a60 tx=0x7f8768007d30 comp rx=0 tx=0).stop 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.572+0000 7f8777fff700 1 -- 172.21.15.142:0/233364391 reap_dead start 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.572+0000 7f877dfff700 1 -- 172.21.15.142:0/233364391 shutdown_connections 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.572+0000 7f877dfff700 1 -- 172.21.15.142:0/233364391 >> 172.21.15.142:0/233364391 conn(0x7f87780ce8b0 msgr2=0x7f87780cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.572+0000 7f877dfff700 1 -- 172.21.15.142:0/233364391 shutdown_connections 2023-09-30T22:57:47.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.572+0000 7f877dfff700 1 -- 172.21.15.142:0/233364391 wait complete. 2023-09-30T22:57:47.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.573+0000 7f877dfff700 1 Processor -- start 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.573+0000 7f877dfff700 1 -- start start 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.574+0000 7f877dfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760003a90 0x7f87780c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.574+0000 7f877dfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780c91f0 0x7f877814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.574+0000 7f877dfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877815c330 0x7f87780c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.574+0000 7f877dfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780c8d60 con 0x7f877815c330 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.574+0000 7f877dfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780c8150 con 0x7f8760003a90 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.574+0000 7f877dfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780c8430 con 0x7f87780c91f0 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.574+0000 7f8777fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877815c330 0x7f87780c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877815c330 0x7f87780c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53860/0 (socket says 172.21.15.142:53860) 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 -- 172.21.15.142:0/1517927050 learned_addr learned my addr 172.21.15.142:0/1517927050 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f87777fe700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760003a90 0x7f87780c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8776ffd700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780c91f0 0x7f877814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 -- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780c91f0 msgr2=0x7f877814ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780c91f0 0x7f877814ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 -- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760003a90 msgr2=0x7f87780c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760003a90 0x7f87780c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 -- 172.21.15.142:0/1517927050 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780c8710 con 0x7f877815c330 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8776ffd700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780c91f0 0x7f877814ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f8777fff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877815c330 0x7f87780c9e40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8770001370 tx=0x7f87700017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f875f7fe700 1 -- 172.21.15.142:0/1517927050 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877000ebc0 con 0x7f877815c330 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f875f7fe700 1 -- 172.21.15.142:0/1517927050 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877000ed40 con 0x7f877815c330 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87780c89f0 con 0x7f877815c330 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.575+0000 7f875f7fe700 1 -- 172.21.15.142:0/1517927050 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770013670 con 0x7f877815c330 2023-09-30T22:57:47.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.576+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877815c960 con 0x7f877815c330 2023-09-30T22:57:47.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.577+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877806ea70 con 0x7f877815c330 2023-09-30T22:57:47.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.577+0000 7f875f7fe700 1 -- 172.21.15.142:0/1517927050 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f87700139e0 con 0x7f877815c330 2023-09-30T22:57:47.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.578+0000 7f875f7fe700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8764067330 0x7f87640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.578+0000 7f875f7fe700 1 -- 172.21.15.142:0/1517927050 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8770085250 con 0x7f877815c330 2023-09-30T22:57:47.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.578+0000 7f87777fe700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8764067330 0x7f87640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.579+0000 7f87777fe700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8764067330 0x7f87640697e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8768001500 tx=0x7f8768015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:47.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.583+0000 7f875f7fe700 1 -- 172.21.15.142:0/1517927050 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f87700520b0 con 0x7f877815c330 2023-09-30T22:57:47.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.773+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f877815db60 con 0x7f877815c330 2023-09-30T22:57:47.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.774+0000 7f875f7fe700 1 -- 172.21.15.142:0/1517927050 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f87700556d0 con 0x7f877815c330 2023-09-30T22:57:47.775 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:47.775 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":110,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:57:46.793888+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:57:44.465774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-09-30T22:57:45.784661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:57:47.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8764067330 msgr2=0x7f87640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8764067330 0x7f87640697e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8768001500 tx=0x7f8768015000 comp rx=0 tx=0).stop 2023-09-30T22:57:47.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877815c330 msgr2=0x7f87780c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877815c330 0x7f87780c9e40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8770001370 tx=0x7f87700017b0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 shutdown_connections 2023-09-30T22:57:47.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8764067330 0x7f87640697e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f877815c330 0x7f87780c9e40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8760003a90 0x7f87780c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 --2- 172.21.15.142:0/1517927050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87780c91f0 0x7f877814ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 >> 172.21.15.142:0/1517927050 conn(0x7f87780ce8b0 msgr2=0x7f87780b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:47.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 shutdown_connections 2023-09-30T22:57:47.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.776+0000 7f877dfff700 1 -- 172.21.15.142:0/1517927050 wait complete. 2023-09-30T22:57:47.795 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:57:47.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.985+0000 7ff7df1ff700 1 Processor -- start 2023-09-30T22:57:47.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.985+0000 7ff7df1ff700 1 -- start start 2023-09-30T22:57:47.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.986+0000 7ff7df1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d806d3f0 0x7ff7d806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.986+0000 7ff7df1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff7d80c6da0 0x7ff7d815e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.986+0000 7ff7df1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d815dde0 con 0x7ff7d806b130 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.986+0000 7ff7df1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d815d7d0 con 0x7ff7d80c6da0 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.986+0000 7ff7df1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80c7230 con 0x7ff7d806d3f0 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7d7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff7d80c6da0 0x7ff7d815e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7dcf9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d806d3f0 0x7ff7d806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7dd79c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff7d806b130 0x7ff7d8069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:53868/0 (socket says 172.21.15.142:53868) 2023-09-30T22:57:47.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7dd79c700 1 -- 172.21.15.142:0/3200867248 learned_addr learned my addr 172.21.15.142:0/3200867248 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7d7fff700 1 -- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d806d3f0 msgr2=0x7ff7d806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7d7fff700 1 --2- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d806d3f0 0x7ff7d806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7d7fff700 1 -- 172.21.15.142:0/3200867248 >> v1:172.21.15.148:6789/0 conn(0x7ff7d806b130 legacy=0x7ff7d8069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7d7fff700 1 -- 172.21.15.142:0/3200867248 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d815da70 con 0x7ff7d80c6da0 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7dcf9b700 1 --2- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d806d3f0 0x7ff7d806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.987+0000 7ff7d7fff700 1 --2- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d80c6da0 0x7ff7d815e270 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40098e0 tx=0x7ff7c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34fe0c4551b89b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7d77fe700 1 -- 172.21.15.142:0/3200867248 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400b640 con 0x7ff7d80c6da0 2023-09-30T22:57:47.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7d77fe700 1 -- 172.21.15.142:0/3200867248 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400b7a0 con 0x7ff7d80c6da0 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7d77fe700 1 -- 172.21.15.142:0/3200867248 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400bb40 con 0x7ff7d80c6da0 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 -- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d80c6da0 msgr2=0x7ff7d815e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d80c6da0 0x7ff7d815e270 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40098e0 tx=0x7ff7c40091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 -- 172.21.15.142:0/3200867248 shutdown_connections 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d806d3f0 0x7ff7d806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/3200867248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d80c6da0 0x7ff7d815e270 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 -- 172.21.15.142:0/3200867248 >> 172.21.15.142:0/3200867248 conn(0x7ff7d8067e30 msgr2=0x7ff7d8068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 -- 172.21.15.142:0/3200867248 shutdown_connections 2023-09-30T22:57:47.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.988+0000 7ff7df1ff700 1 -- 172.21.15.142:0/3200867248 wait complete. 2023-09-30T22:57:47.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.990+0000 7ff7df1ff700 1 Processor -- start 2023-09-30T22:57:47.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.990+0000 7ff7df1ff700 1 -- start start 2023-09-30T22:57:47.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7df1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d806b130 0x7ff7d80cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7df1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d806d3f0 0x7ff7d81440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7df1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d80c6da0 0x7ff7d8144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7df1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8144b40 con 0x7ff7d806b130 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7df1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80cdbc0 con 0x7ff7d806d3f0 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7df1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80ccfd0 con 0x7ff7d80c6da0 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7dcf9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d806b130 0x7ff7d80cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7dcf9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d806b130 0x7ff7d80cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53872/0 (socket says 172.21.15.142:53872) 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7dcf9b700 1 -- 172.21.15.142:0/948653103 learned_addr learned my addr 172.21.15.142:0/948653103 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7dd79c700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d80c6da0 0x7ff7d8144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.991+0000 7ff7d7fff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d806d3f0 0x7ff7d81440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7dcf9b700 1 -- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d80c6da0 msgr2=0x7ff7d8144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7dcf9b700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d80c6da0 0x7ff7d8144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7dcf9b700 1 -- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d806d3f0 msgr2=0x7ff7d81440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7dcf9b700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d806d3f0 0x7ff7d81440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7dcf9b700 1 -- 172.21.15.142:0/948653103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc009420 con 0x7ff7d806b130 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7dcf9b700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d806b130 0x7ff7d80cfa90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00ec80 tx=0x7ff7cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7d4ff9700 1 -- 172.21.15.142:0/948653103 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00c920 con 0x7ff7d806b130 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7d4ff9700 1 -- 172.21.15.142:0/948653103 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc00ca80 con 0x7ff7d806b130 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7d4ff9700 1 -- 172.21.15.142:0/948653103 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00ce00 con 0x7ff7d806b130 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c4009420 con 0x7ff7d806b130 2023-09-30T22:57:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.992+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d80cd570 con 0x7ff7d806b130 2023-09-30T22:57:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.993+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d8069420 con 0x7ff7d806b130 2023-09-30T22:57:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.994+0000 7ff7d4ff9700 1 -- 172.21.15.142:0/948653103 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff7cc013680 con 0x7ff7d806b130 2023-09-30T22:57:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.995+0000 7ff7d4ff9700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7bc067330 0x7ff7bc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.995+0000 7ff7d4ff9700 1 -- 172.21.15.142:0/948653103 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7cc084fe0 con 0x7ff7d806b130 2023-09-30T22:57:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.995+0000 7ff7d7fff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7bc067330 0x7ff7bc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:47.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.996+0000 7ff7d7fff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7bc067330 0x7ff7bc0697e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40093f0 tx=0x7ff7c4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:48.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:47.999+0000 7ff7d4ff9700 1 -- 172.21.15.142:0/948653103 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff7cc051ea0 con 0x7ff7d806b130 2023-09-30T22:57:48.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.188+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7d80c7510 con 0x7ff7d806b130 2023-09-30T22:57:48.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.189+0000 7ff7d4ff9700 1 -- 172.21.15.142:0/948653103 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17039 (secure 0 0 0) 0x7ff7cc0554c0 con 0x7ff7d806b130 2023-09-30T22:57:48.190 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:48.190 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":110,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:57:46.793888+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:57:44.465774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-09-30T22:57:45.784661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:57:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7bc067330 msgr2=0x7ff7bc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:48.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7bc067330 0x7ff7bc0697e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40093f0 tx=0x7ff7c4017000 comp rx=0 tx=0).stop 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d806b130 msgr2=0x7ff7d80cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d806b130 0x7ff7d80cfa90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00ec80 tx=0x7ff7cc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 shutdown_connections 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7bc067330 0x7ff7bc0697e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7d80c6da0 0x7ff7d8144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d806b130 0x7ff7d80cfa90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 --2- 172.21.15.142:0/948653103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7d806d3f0 0x7ff7d81440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 >> 172.21.15.142:0/948653103 conn(0x7ff7d8067e30 msgr2=0x7ff7d81581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:48.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 shutdown_connections 2023-09-30T22:57:48.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.191+0000 7ff7df1ff700 1 -- 172.21.15.142:0/948653103 wait complete. 2023-09-30T22:57:48.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:57:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.405+0000 7fde073ff700 1 Processor -- start 2023-09-30T22:57:48.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.405+0000 7fde073ff700 1 -- start start 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.406+0000 7fde073ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde00159ba0 0x7fde0006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.406+0000 7fde073ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde000b0de0 0x7fde000c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.406+0000 7fde073ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde00067d10 con 0x7fde000ca410 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.406+0000 7fde073ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000ca820 con 0x7fde000b0de0 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.406+0000 7fde073ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0006af90 con 0x7fde00159ba0 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.406+0000 7fde0499a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde000b0de0 0x7fde000c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fde0499a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde000b0de0 0x7fde000c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53884/0 (socket says 172.21.15.142:53884) 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fde0499a700 1 -- 172.21.15.142:0/1732691698 learned_addr learned my addr 172.21.15.142:0/1732691698 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fde0499a700 1 -- 172.21.15.142:0/1732691698 >> v2:172.21.15.148:3300/0 conn(0x7fde00159ba0 msgr2=0x7fde0006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:48.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fde0499a700 1 --2- 172.21.15.142:0/1732691698 >> v2:172.21.15.148:3300/0 conn(0x7fde00159ba0 0x7fde0006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fde0499a700 1 -- 172.21.15.142:0/1732691698 >> v1:172.21.15.148:6789/0 conn(0x7fde000ca410 legacy=0x7fde0015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fde0499a700 1 -- 172.21.15.142:0/1732691698 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000676c0 con 0x7fde000b0de0 2023-09-30T22:57:48.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fde0499a700 1 --2- 172.21.15.142:0/1732691698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000b0de0 0x7fde000c9ed0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fde0006ec80 tx=0x7fddf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a408f32800af21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fddf7fff700 1 -- 172.21.15.142:0/1732691698 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000b820 con 0x7fde000b0de0 2023-09-30T22:57:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fddf7fff700 1 -- 172.21.15.142:0/1732691698 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf000b980 con 0x7fde000b0de0 2023-09-30T22:57:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.407+0000 7fddf7fff700 1 -- 172.21.15.142:0/1732691698 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000bd20 con 0x7fde000b0de0 2023-09-30T22:57:48.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 -- 172.21.15.142:0/1732691698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000b0de0 msgr2=0x7fde000c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 --2- 172.21.15.142:0/1732691698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000b0de0 0x7fde000c9ed0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fde0006ec80 tx=0x7fddf0009250 comp rx=0 tx=0).stop 2023-09-30T22:57:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 -- 172.21.15.142:0/1732691698 shutdown_connections 2023-09-30T22:57:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 --2- 172.21.15.142:0/1732691698 >> v2:172.21.15.148:3300/0 conn(0x7fde00159ba0 0x7fde0006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 --2- 172.21.15.142:0/1732691698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000b0de0 0x7fde000c9ed0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 -- 172.21.15.142:0/1732691698 >> 172.21.15.142:0/1732691698 conn(0x7fde000cb2f0 msgr2=0x7fde000cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:48.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 -- 172.21.15.142:0/1732691698 shutdown_connections 2023-09-30T22:57:48.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.408+0000 7fde073ff700 1 -- 172.21.15.142:0/1732691698 wait complete. 2023-09-30T22:57:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.409+0000 7fde073ff700 1 Processor -- start 2023-09-30T22:57:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.410+0000 7fde073ff700 1 -- start start 2023-09-30T22:57:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.410+0000 7fde073ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde000b0de0 0x7fde000c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde073ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000ca410 0x7fde000c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde073ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde00159ba0 0x7fde0016ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:48.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde073ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0016b260 con 0x7fde000ca410 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde073ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde00156680 con 0x7fde00159ba0 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde073ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c62d0 con 0x7fde000b0de0 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000ca410 0x7fde000c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000ca410 0x7fde000c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53890/0 (socket says 172.21.15.142:53890) 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 -- 172.21.15.142:0/3098200332 learned_addr learned my addr 172.21.15.142:0/3098200332 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0599c700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde00159ba0 0x7fde0016ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0519b700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde000b0de0 0x7fde000c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 -- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde000b0de0 msgr2=0x7fde000c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde000b0de0 0x7fde000c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 -- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde00159ba0 msgr2=0x7fde0016ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde00159ba0 0x7fde0016ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:48.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 -- 172.21.15.142:0/3098200332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf00094f0 con 0x7fde000ca410 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0519b700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde000b0de0 0x7fde000c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0599c700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde00159ba0 0x7fde0016ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.411+0000 7fde0499a700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000ca410 0x7fde000c5c40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009290 tx=0x7fddf0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.412+0000 7fddf57fa700 1 -- 172.21.15.142:0/3098200332 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf001a460 con 0x7fde000ca410 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.412+0000 7fddf57fa700 1 -- 172.21.15.142:0/3098200332 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf001a5c0 con 0x7fde000ca410 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.412+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0016d990 con 0x7fde000ca410 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.412+0000 7fddf57fa700 1 -- 172.21.15.142:0/3098200332 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf001a980 con 0x7fde000ca410 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.412+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0016df10 con 0x7fde000ca410 2023-09-30T22:57:48.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.413+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0006e4b0 con 0x7fde000ca410 2023-09-30T22:57:48.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.414+0000 7fddf57fa700 1 -- 172.21.15.142:0/3098200332 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fddf001b440 con 0x7fde000ca410 2023-09-30T22:57:48.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.415+0000 7fddf57fa700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdde4067330 0x7fdde40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:48.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.415+0000 7fddf57fa700 1 -- 172.21.15.142:0/3098200332 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fddf0086690 con 0x7fde000ca410 2023-09-30T22:57:48.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.415+0000 7fde0519b700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdde4067330 0x7fdde40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:48.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.415+0000 7fde0519b700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdde4067330 0x7fdde40697e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fddfc006fd0 tx=0x7fddfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:48.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.419+0000 7fddf57fa700 1 -- 172.21.15.142:0/3098200332 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fddf00534f0 con 0x7fde000ca410 2023-09-30T22:57:48.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:48.655+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fde000679a0 con 0x7fde000ca410 2023-09-30T22:57:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.357+0000 7fddf57fa700 1 -- 172.21.15.142:0/3098200332 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7fddf0056b10 con 0x7fde000ca410 2023-09-30T22:57:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdde4067330 msgr2=0x7fdde40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdde4067330 0x7fdde40697e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fddfc006fd0 tx=0x7fddfc008040 comp rx=0 tx=0).stop 2023-09-30T22:57:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000ca410 msgr2=0x7fde000c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000ca410 0x7fde000c5c40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009290 tx=0x7fddf0016000 comp rx=0 tx=0).stop 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 shutdown_connections 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdde4067330 0x7fdde40697e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde00159ba0 0x7fde0016ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fde000b0de0 0x7fde000c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 --2- 172.21.15.142:0/3098200332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde000ca410 0x7fde000c5c40 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 >> 172.21.15.142:0/3098200332 conn(0x7fde000cb2f0 msgr2=0x7fde000cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 shutdown_connections 2023-09-30T22:57:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.360+0000 7fde073ff700 1 -- 172.21.15.142:0/3098200332 wait complete. 2023-09-30T22:57:49.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:57:49.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.577+0000 7f85029ff700 1 Processor -- start 2023-09-30T22:57:49.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.577+0000 7f85029ff700 1 -- start start 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.578+0000 7f85029ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f84fc1565e0 0x7f84fc15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.578+0000 7f85029ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f84fc06b2e0 0x7f84fc0c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.578+0000 7f85029ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc06ae50 con 0x7f84fc0c8800 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.578+0000 7f85029ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc15b330 con 0x7f84fc06b2e0 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.578+0000 7f85029ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0c8bd0 con 0x7f84fc1565e0 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84fb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f84fc06b2e0 0x7f84fc0c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f8500f9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f84fc0c8800 0x7f84fc157f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46612/0 (socket says 172.21.15.142:46612) 2023-09-30T22:57:49.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f8500f9c700 1 -- 172.21.15.142:0/412490684 learned_addr learned my addr 172.21.15.142:0/412490684 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:49.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84fbfff700 1 --2- 172.21.15.142:0/412490684 >> v2:172.21.15.148:3300/0 conn(0x7f84fc1565e0 0x7f84fc15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:49.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84fb7fe700 1 -- 172.21.15.142:0/412490684 >> v2:172.21.15.148:3300/0 conn(0x7f84fc1565e0 msgr2=0x7f84fc15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:49.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84fb7fe700 1 --2- 172.21.15.142:0/412490684 >> v2:172.21.15.148:3300/0 conn(0x7f84fc1565e0 0x7f84fc15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84fb7fe700 1 -- 172.21.15.142:0/412490684 >> v1:172.21.15.142:6789/0 conn(0x7f84fc0c8800 legacy=0x7f84fc157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:49.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84fb7fe700 1 -- 172.21.15.142:0/412490684 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc06a240 con 0x7f84fc06b2e0 2023-09-30T22:57:49.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84faffd700 1 -- 172.21.15.142:0/412490684 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034787592 0 0) 0x7f84fc06ae50 con 0x7f84fc0c8800 2023-09-30T22:57:49.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.579+0000 7f84fb7fe700 1 --2- 172.21.15.142:0/412490684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc06b2e0 0x7f84fc0c82c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0642b0 tx=0x7f84f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5b9d5bea02405e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:49.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f84faffd700 1 -- 172.21.15.142:0/412490684 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000b6b0 con 0x7f84fc06b2e0 2023-09-30T22:57:49.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f84faffd700 1 -- 172.21.15.142:0/412490684 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000b810 con 0x7f84fc06b2e0 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f84faffd700 1 -- 172.21.15.142:0/412490684 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000bbb0 con 0x7f84fc06b2e0 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 -- 172.21.15.142:0/412490684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc06b2e0 msgr2=0x7f84fc0c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 --2- 172.21.15.142:0/412490684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc06b2e0 0x7f84fc0c82c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0642b0 tx=0x7f84f00091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 -- 172.21.15.142:0/412490684 shutdown_connections 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 --2- 172.21.15.142:0/412490684 >> v2:172.21.15.148:3300/0 conn(0x7f84fc1565e0 0x7f84fc15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 --2- 172.21.15.142:0/412490684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc06b2e0 0x7f84fc0c82c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 -- 172.21.15.142:0/412490684 >> 172.21.15.142:0/412490684 conn(0x7f84fc0680b0 msgr2=0x7f84fc0cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 -- 172.21.15.142:0/412490684 shutdown_connections 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.580+0000 7f85029ff700 1 -- 172.21.15.142:0/412490684 wait complete. 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.582+0000 7f85029ff700 1 Processor -- start 2023-09-30T22:57:49.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.582+0000 7f85029ff700 1 -- start start 2023-09-30T22:57:49.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f85029ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84fc06b2e0 0x7f84fc152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:49.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f85029ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc0c8800 0x7f84fc16d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:49.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f85029ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc1565e0 0x7f84fc16b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:49.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f85029ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc157800 con 0x7f84fc0c8800 2023-09-30T22:57:49.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f85029ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc156ed0 con 0x7f84fc1565e0 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f85029ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1571b0 con 0x7f84fc06b2e0 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc0c8800 0x7f84fc16d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc0c8800 0x7f84fc16d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53908/0 (socket says 172.21.15.142:53908) 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 -- 172.21.15.142:0/924844588 learned_addr learned my addr 172.21.15.142:0/924844588 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 -- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84fc06b2e0 msgr2=0x7f84fc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fbfff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84fc06b2e0 0x7f84fc152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f8500f9c700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc1565e0 0x7f84fc16b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84fc06b2e0 0x7f84fc152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 -- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc1565e0 msgr2=0x7f84fc16b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc1565e0 0x7f84fc16b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fb7fe700 1 -- 172.21.15.142:0/924844588 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0009420 con 0x7f84fc0c8800 2023-09-30T22:57:49.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f84fbfff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84fc06b2e0 0x7f84fc152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.583+0000 7f8500f9c700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc1565e0 0x7f84fc16b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.584+0000 7f84fb7fe700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc0c8800 0x7f84fc16d320 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0710e0 tx=0x7f84f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.584+0000 7f84e3fff700 1 -- 172.21.15.142:0/924844588 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0011420 con 0x7f84fc0c8800 2023-09-30T22:57:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.584+0000 7f84e3fff700 1 -- 172.21.15.142:0/924844588 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0011580 con 0x7f84fc0c8800 2023-09-30T22:57:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.584+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc157490 con 0x7f84fc0c8800 2023-09-30T22:57:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.584+0000 7f84e3fff700 1 -- 172.21.15.142:0/924844588 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0011940 con 0x7f84fc0c8800 2023-09-30T22:57:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.584+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc155650 con 0x7f84fc0c8800 2023-09-30T22:57:49.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.585+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc0697b0 con 0x7f84fc0c8800 2023-09-30T22:57:49.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.586+0000 7f84e3fff700 1 -- 172.21.15.142:0/924844588 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f84f0011d30 con 0x7f84fc0c8800 2023-09-30T22:57:49.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.587+0000 7f84e3fff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f84e8067330 0x7f84e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:49.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.587+0000 7f84e3fff700 1 -- 172.21.15.142:0/924844588 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f84f00861b0 con 0x7f84fc0c8800 2023-09-30T22:57:49.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.587+0000 7f84fbfff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f84e8067330 0x7f84e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:49.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.588+0000 7f84fbfff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f84e8067330 0x7f84e80697e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009990 tx=0x7f84ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:49.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.591+0000 7f84e3fff700 1 -- 172.21.15.142:0/924844588 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f84f0053010 con 0x7f84fc0c8800 2023-09-30T22:57:49.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:49.825+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f84fc06a520 con 0x7f84fc0c8800 2023-09-30T22:57:50.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.366+0000 7f84e3fff700 1 -- 172.21.15.142:0/924844588 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84f0056630 con 0x7f84fc0c8800 2023-09-30T22:57:50.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f84e8067330 msgr2=0x7f84e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f84e8067330 0x7f84e80697e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009990 tx=0x7f84ec008040 comp rx=0 tx=0).stop 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc0c8800 msgr2=0x7f84fc16d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc0c8800 0x7f84fc16d320 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0710e0 tx=0x7f84f0017000 comp rx=0 tx=0).stop 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 shutdown_connections 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f84e8067330 0x7f84e80697e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84fc1565e0 0x7f84fc16b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f84fc06b2e0 0x7f84fc152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 --2- 172.21.15.142:0/924844588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc0c8800 0x7f84fc16d320 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.368+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 >> 172.21.15.142:0/924844588 conn(0x7f84fc0680b0 msgr2=0x7f84fc06d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:50.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.369+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 shutdown_connections 2023-09-30T22:57:50.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.369+0000 7f85029ff700 1 -- 172.21.15.142:0/924844588 wait complete. 2023-09-30T22:57:50.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:57:50.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.578+0000 7fad549ff700 1 Processor -- start 2023-09-30T22:57:50.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.578+0000 7fad549ff700 1 -- start start 2023-09-30T22:57:50.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.579+0000 7fad549ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fad500692f0 0x7fad5015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.579+0000 7fad549ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 0x7fad5006a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.579+0000 7fad549ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad500cc6b0 con 0x7fad50143350 2023-09-30T22:57:50.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.579+0000 7fad549ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5015e090 con 0x7fad500692f0 2023-09-30T22:57:50.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.579+0000 7fad549ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500cbaa0 con 0x7fad5015dc50 2023-09-30T22:57:50.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fad50143350 0x7fad500cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46626/0 (socket says 172.21.15.142:46626) 2023-09-30T22:57:50.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4e59c700 1 -- 172.21.15.142:0/2571925629 learned_addr learned my addr 172.21.15.142:0/2571925629 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:50.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4ed9d700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 0x7fad5006a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4dd9b700 1 --2- 172.21.15.142:0/2571925629 >> v2:172.21.15.148:3300/0 conn(0x7fad500692f0 0x7fad5015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050213093 0 0) 0x7fad500cc6b0 con 0x7fad50143350 2023-09-30T22:57:50.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad38003570 con 0x7fad50143350 2023-09-30T22:57:50.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2264845330 0 0) 0x7fad38003570 con 0x7fad50143350 2023-09-30T22:57:50.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 msgr2=0x7fad5006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:50.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 0x7fad5006a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 >> v2:172.21.15.148:3300/0 conn(0x7fad500692f0 msgr2=0x7fad5015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 --2- 172.21.15.142:0/2571925629 >> v2:172.21.15.148:3300/0 conn(0x7fad500692f0 0x7fad5015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500cbd80 con 0x7fad50143350 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.580+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fad40001470 con 0x7fad50143350 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 >> v1:172.21.15.142:6789/0 conn(0x7fad50143350 legacy=0x7fad500cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4d59a700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 0x7fad38003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4d59a700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad380040b0 0x7fad38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4d59a700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad38004d50 0x7fad380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5015e090 con 0x7fad38004d50 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500cbaa0 con 0x7fad380040b0 2023-09-30T22:57:50.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3800bb60 con 0x7fad5015dc50 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4ed9d700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad38004d50 0x7fad380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4e59c700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 0x7fad38003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4dd9b700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad380040b0 0x7fad38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4ed9d700 1 -- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 msgr2=0x7fad38003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4ed9d700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad5015dc50 0x7fad38003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4ed9d700 1 -- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad380040b0 msgr2=0x7fad38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4ed9d700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad380040b0 0x7fad38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.581+0000 7fad4ed9d700 1 -- 172.21.15.142:0/2571925629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38003570 con 0x7fad38004d50 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad4ed9d700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad38004d50 0x7fad380051c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fad480094d0 tx=0x7fad4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6e2450e06f528c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800ea90 con 0x7fad38004d50 2023-09-30T22:57:50.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4800f040 con 0x7fad38004d50 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad4d59a700 1 -- 172.21.15.142:0/2571925629 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800ee20 con 0x7fad38004d50 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad549ff700 1 -- 172.21.15.142:0/2571925629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad38004d50 msgr2=0x7fad380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad549ff700 1 --2- 172.21.15.142:0/2571925629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad38004d50 0x7fad380051c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fad480094d0 tx=0x7fad4800b040 comp rx=0 tx=0).stop 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad4ed9d700 1 -- 172.21.15.142:0/2571925629 reap_dead start 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad549ff700 1 -- 172.21.15.142:0/2571925629 shutdown_connections 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad549ff700 1 -- 172.21.15.142:0/2571925629 >> 172.21.15.142:0/2571925629 conn(0x7fad500ce8e0 msgr2=0x7fad500cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.582+0000 7fad549ff700 1 -- 172.21.15.142:0/2571925629 shutdown_connections 2023-09-30T22:57:50.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.583+0000 7fad549ff700 1 -- 172.21.15.142:0/2571925629 wait complete. 2023-09-30T22:57:50.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.584+0000 7fad549ff700 1 Processor -- start 2023-09-30T22:57:50.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.584+0000 7fad549ff700 1 -- start start 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad549ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad38004d50 0x7fad500c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad549ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c90e0 0x7fad5015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad549ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad5015b6d0 0x7fad500a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad549ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500c9550 con 0x7fad500c90e0 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad549ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500a5ca0 con 0x7fad5015b6d0 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad549ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5015bec0 con 0x7fad38004d50 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad4dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c90e0 0x7fad5015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad4dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c90e0 0x7fad5015b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53936/0 (socket says 172.21.15.142:53936) 2023-09-30T22:57:50.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad4dd9b700 1 -- 172.21.15.142:0/586201280 learned_addr learned my addr 172.21.15.142:0/586201280 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.585+0000 7fad4e59c700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad38004d50 0x7fad500c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4ed9d700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad5015b6d0 0x7fad500a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4dd9b700 1 -- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad38004d50 msgr2=0x7fad500c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4dd9b700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad38004d50 0x7fad500c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4dd9b700 1 -- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad5015b6d0 msgr2=0x7fad500a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4dd9b700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad5015b6d0 0x7fad500a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4dd9b700 1 -- 172.21.15.142:0/586201280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500a5650 con 0x7fad500c90e0 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4ed9d700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad5015b6d0 0x7fad500a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4e59c700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad38004d50 0x7fad500c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad4dd9b700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c90e0 0x7fad5015b190 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fad44006ac0 tx=0x7fad440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad3e7fc700 1 -- 172.21.15.142:0/586201280 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400fa10 con 0x7fad500c90e0 2023-09-30T22:57:50.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad3e7fc700 1 -- 172.21.15.142:0/586201280 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400fb70 con 0x7fad500c90e0 2023-09-30T22:57:50.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500a5930 con 0x7fad500c90e0 2023-09-30T22:57:50.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad3e7fc700 1 -- 172.21.15.142:0/586201280 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44014440 con 0x7fad500c90e0 2023-09-30T22:57:50.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.586+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad500a6670 con 0x7fad500c90e0 2023-09-30T22:57:50.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.587+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad500a54b0 con 0x7fad500c90e0 2023-09-30T22:57:50.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.588+0000 7fad3e7fc700 1 -- 172.21.15.142:0/586201280 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad44014830 con 0x7fad500c90e0 2023-09-30T22:57:50.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.589+0000 7fad3e7fc700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad30067330 0x7fad300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:50.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.589+0000 7fad3e7fc700 1 -- 172.21.15.142:0/586201280 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad44018030 con 0x7fad500c90e0 2023-09-30T22:57:50.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.589+0000 7fad4e59c700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad30067330 0x7fad300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:50.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.590+0000 7fad4e59c700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad30067330 0x7fad300697e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fad400010e0 tx=0x7fad40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:50.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.593+0000 7fad3e7fc700 1 -- 172.21.15.142:0/586201280 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad500a54b0 con 0x7fad500c90e0 2023-09-30T22:57:50.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.822+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad500a54b0 con 0x7fad500c90e0 2023-09-30T22:57:50.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.823+0000 7fad3e7fc700 1 -- 172.21.15.142:0/586201280 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fad500a54b0 con 0x7fad500c90e0 2023-09-30T22:57:50.824 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:50.824 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:57:50.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad30067330 msgr2=0x7fad300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad30067330 0x7fad300697e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fad400010e0 tx=0x7fad40009040 comp rx=0 tx=0).stop 2023-09-30T22:57:50.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c90e0 msgr2=0x7fad5015b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:50.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c90e0 0x7fad5015b190 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fad44006ac0 tx=0x7fad440091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 shutdown_connections 2023-09-30T22:57:50.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad30067330 0x7fad300697e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad5015b6d0 0x7fad500a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad38004d50 0x7fad500c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 --2- 172.21.15.142:0/586201280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad500c90e0 0x7fad5015b190 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:50.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 >> 172.21.15.142:0/586201280 conn(0x7fad500ce8e0 msgr2=0x7fad500c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:50.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 shutdown_connections 2023-09-30T22:57:50.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:50.825+0000 7fad549ff700 1 -- 172.21.15.142:0/586201280 wait complete. 2023-09-30T22:57:50.827 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:57:50.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:57:51.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.030+0000 7fa0785ff700 1 Processor -- start 2023-09-30T22:57:51.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.030+0000 7fa0785ff700 1 -- start start 2023-09-30T22:57:51.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa0785ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0700af020 0x7fa070156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa0785ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa0700b00d0 0x7fa07006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa0785ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07006d3e0 con 0x7fa07006e650 2023-09-30T22:57:51.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa0785ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07015b400 con 0x7fa0700af020 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa0785ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07006dc80 con 0x7fa0700b00d0 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa07639b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0700af020 0x7fa070156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa07639b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0700af020 0x7fa070156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46082/0 (socket says 172.21.15.142:46082) 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa07639b700 1 -- 172.21.15.142:0/311993462 learned_addr learned my addr 172.21.15.142:0/311993462 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa075b9a700 1 --2- 172.21.15.142:0/311993462 >> v2:172.21.15.148:3300/0 conn(0x7fa0700b00d0 0x7fa07006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa075399700 1 -- 172.21.15.142:0/311993462 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583303458 0 0) 0x7fa07006d3e0 con 0x7fa07006e650 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa075399700 1 -- 172.21.15.142:0/311993462 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa05c003570 con 0x7fa07006e650 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa07639b700 1 -- 172.21.15.142:0/311993462 >> v2:172.21.15.148:3300/0 conn(0x7fa0700b00d0 msgr2=0x7fa07006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.032+0000 7fa07639b700 1 --2- 172.21.15.142:0/311993462 >> v2:172.21.15.148:3300/0 conn(0x7fa0700b00d0 0x7fa07006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa07639b700 1 -- 172.21.15.142:0/311993462 >> v1:172.21.15.142:6789/0 conn(0x7fa07006e650 legacy=0x7fa0700b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa07639b700 1 -- 172.21.15.142:0/311993462 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07006b790 con 0x7fa0700af020 2023-09-30T22:57:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa07639b700 1 --2- 172.21.15.142:0/311993462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700af020 0x7fa070156d80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0099b0 tx=0x7fa06c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbc8a267f3721c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa075399700 1 -- 172.21.15.142:0/311993462 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c009ea0 con 0x7fa0700af020 2023-09-30T22:57:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa075399700 1 -- 172.21.15.142:0/311993462 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00b820 con 0x7fa0700af020 2023-09-30T22:57:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa075399700 1 -- 172.21.15.142:0/311993462 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00bbc0 con 0x7fa0700af020 2023-09-30T22:57:51.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa0785ff700 1 -- 172.21.15.142:0/311993462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700af020 msgr2=0x7fa070156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.033+0000 7fa0785ff700 1 --2- 172.21.15.142:0/311993462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700af020 0x7fa070156d80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0099b0 tx=0x7fa06c009250 comp rx=0 tx=0).stop 2023-09-30T22:57:51.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.034+0000 7fa0785ff700 1 -- 172.21.15.142:0/311993462 shutdown_connections 2023-09-30T22:57:51.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.034+0000 7fa0785ff700 1 --2- 172.21.15.142:0/311993462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700af020 0x7fa070156d80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.034+0000 7fa0785ff700 1 --2- 172.21.15.142:0/311993462 >> v2:172.21.15.148:3300/0 conn(0x7fa0700b00d0 0x7fa07006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.034+0000 7fa0785ff700 1 -- 172.21.15.142:0/311993462 >> 172.21.15.142:0/311993462 conn(0x7fa0700680c0 msgr2=0x7fa0700c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:51.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.034+0000 7fa0785ff700 1 -- 172.21.15.142:0/311993462 shutdown_connections 2023-09-30T22:57:51.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.034+0000 7fa0785ff700 1 -- 172.21.15.142:0/311993462 wait complete. 2023-09-30T22:57:51.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.036+0000 7fa0785ff700 1 Processor -- start 2023-09-30T22:57:51.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.036+0000 7fa0785ff700 1 -- start start 2023-09-30T22:57:51.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.037+0000 7fa0785ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07006e650 0x7fa0701513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.037+0000 7fa0785ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0700af020 0x7fa0700c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.037+0000 7fa0785ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700b00d0 0x7fa0700a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.037+0000 7fa0785ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c87e0 con 0x7fa0700b00d0 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.037+0000 7fa0785ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c7bd0 con 0x7fa07006e650 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.037+0000 7fa0785ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c7eb0 con 0x7fa0700af020 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700b00d0 0x7fa0700a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700b00d0 0x7fa0700a5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46098/0 (socket says 172.21.15.142:46098) 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 -- 172.21.15.142:0/1101071183 learned_addr learned my addr 172.21.15.142:0/1101071183 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa07639b700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07006e650 0x7fa0701513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa075b9a700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0700af020 0x7fa0700c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 -- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0700af020 msgr2=0x7fa0700c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0700af020 0x7fa0700c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 -- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07006e650 msgr2=0x7fa0701513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07006e650 0x7fa0701513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 -- 172.21.15.142:0/1101071183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0094f0 con 0x7fa0700b00d0 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa075b9a700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0700af020 0x7fa0700c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa076b9c700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700b00d0 0x7fa0700a5d60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c910 tx=0x7fa0680027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa0667fc700 1 -- 172.21.15.142:0/1101071183 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800a7e0 con 0x7fa0700b00d0 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa0667fc700 1 -- 172.21.15.142:0/1101071183 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800a960 con 0x7fa0700b00d0 2023-09-30T22:57:51.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa0667fc700 1 -- 172.21.15.142:0/1101071183 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800ad20 con 0x7fa0700b00d0 2023-09-30T22:57:51.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.038+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0700c8190 con 0x7fa0700b00d0 2023-09-30T22:57:51.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.039+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0701518f0 con 0x7fa0700b00d0 2023-09-30T22:57:51.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.039+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0700695b0 con 0x7fa0700b00d0 2023-09-30T22:57:51.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.040+0000 7fa0667fc700 1 -- 172.21.15.142:0/1101071183 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa068012630 con 0x7fa0700b00d0 2023-09-30T22:57:51.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.041+0000 7fa0667fc700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa054067330 0x7fa0540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.041+0000 7fa0667fc700 1 -- 172.21.15.142:0/1101071183 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa0680850c0 con 0x7fa0700b00d0 2023-09-30T22:57:51.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.041+0000 7fa07639b700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa054067330 0x7fa0540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.042+0000 7fa07639b700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa054067330 0x7fa0540697e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0099b0 tx=0x7fa06c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.045+0000 7fa0667fc700 1 -- 172.21.15.142:0/1101071183 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa068051f20 con 0x7fa0700b00d0 2023-09-30T22:57:51.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.237+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0700cb0c0 con 0x7fa0700b00d0 2023-09-30T22:57:51.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.237+0000 7fa0667fc700 1 -- 172.21.15.142:0/1101071183 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+17026 (secure 0 0 0) 0x7fa068055540 con 0x7fa0700b00d0 2023-09-30T22:57:51.239 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:51.239 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":111,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:57:48.333754+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:57:44.465774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-09-30T22:57:45.784661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:57:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa054067330 msgr2=0x7fa0540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa054067330 0x7fa0540697e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0099b0 tx=0x7fa06c019000 comp rx=0 tx=0).stop 2023-09-30T22:57:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700b00d0 msgr2=0x7fa0700a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700b00d0 0x7fa0700a5d60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c910 tx=0x7fa0680027a0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 shutdown_connections 2023-09-30T22:57:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa054067330 0x7fa0540697e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0700b00d0 0x7fa0700a5d60 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa07006e650 0x7fa0701513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 --2- 172.21.15.142:0/1101071183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0700af020 0x7fa0700c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 >> 172.21.15.142:0/1101071183 conn(0x7fa0700680c0 msgr2=0x7fa0700cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 shutdown_connections 2023-09-30T22:57:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.240+0000 7fa0785ff700 1 -- 172.21.15.142:0/1101071183 wait complete. 2023-09-30T22:57:51.259 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:57:51.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:57:51.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.448+0000 7f7927dff700 1 Processor -- start 2023-09-30T22:57:51.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.449+0000 7f7927dff700 1 -- start start 2023-09-30T22:57:51.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.450+0000 7f7927dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7920143350 0x7f79200cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.450+0000 7f7927dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79200cc6b0 con 0x7f79200692f0 2023-09-30T22:57:51.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.450+0000 7f7927dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79200cb7d0 con 0x7f792015de20 2023-09-30T22:57:51.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.450+0000 7f7927dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79200cbaa0 con 0x7f7920143350 2023-09-30T22:57:51.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.450+0000 7f792539a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f79200692f0 0x7f792015d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51108/0 (socket says 172.21.15.142:51108) 2023-09-30T22:57:51.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.450+0000 7f792539a700 1 -- 172.21.15.142:0/2284996318 learned_addr learned my addr 172.21.15.142:0/2284996318 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870057689 0 0) 0x7f79200cc6b0 con 0x7f79200692f0 2023-09-30T22:57:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7925b9b700 1 --2- 172.21.15.142:0/2284996318 >> v2:172.21.15.148:3300/0 conn(0x7f7920143350 0x7f79200cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f790c003570 con 0x7f79200692f0 2023-09-30T22:57:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2734156576 0 0) 0x7f790c003570 con 0x7f79200692f0 2023-09-30T22:57:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 >> v2:172.21.15.148:3300/0 conn(0x7f7920143350 msgr2=0x7f79200cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:51.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 --2- 172.21.15.142:0/2284996318 >> v2:172.21.15.148:3300/0 conn(0x7f7920143350 0x7f79200cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 >> v1:172.21.15.148:6789/0 conn(0x7f792015de20 legacy=0x7f792006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200cbd80 con 0x7f79200692f0 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f7910001470 con 0x7f79200692f0 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 >> v1:172.21.15.142:6789/0 conn(0x7f79200692f0 legacy=0x7f792015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f790c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f790c004810 0x7f790c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790c005210 0x7f790c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200cbaa0 con 0x7f790c003ab0 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c00c1b0 con 0x7f790c005210 2023-09-30T22:57:51.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c00c370 con 0x7f790c004810 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f7925b9b700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f790c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f792539a700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f790c004810 0x7f790c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.451+0000 7f792639c700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790c005210 0x7f790c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7925b9b700 1 -- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f790c004810 msgr2=0x7f790c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7925b9b700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f790c004810 0x7f790c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7925b9b700 1 -- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790c005210 msgr2=0x7f790c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7925b9b700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790c005210 0x7f790c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7925b9b700 1 -- 172.21.15.142:0/2284996318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c003570 con 0x7f790c003ab0 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f792539a700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f790c004810 0x7f790c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f792639c700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790c005210 0x7f790c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:51.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f792639c700 1 -- 172.21.15.142:0/2284996318 reap_dead start 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7925b9b700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f790c003ec0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f791c009c00 tx=0x7f791c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd040e02367bfcf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00e710 con 0x7f790c003ab0 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00e870 con 0x7f790c003ab0 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.452+0000 7f7924b99700 1 -- 172.21.15.142:0/2284996318 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00ec30 con 0x7f790c003ab0 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.453+0000 7f7927dff700 1 -- 172.21.15.142:0/2284996318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 msgr2=0x7f790c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.453+0000 7f7927dff700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f790c003ec0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f791c009c00 tx=0x7f791c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.453+0000 7f7927dff700 1 -- 172.21.15.142:0/2284996318 shutdown_connections 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.453+0000 7f7927dff700 1 --2- 172.21.15.142:0/2284996318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f790c003ec0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.453+0000 7f7927dff700 1 -- 172.21.15.142:0/2284996318 >> 172.21.15.142:0/2284996318 conn(0x7f79200ce8e0 msgr2=0x7f79200cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.453+0000 7f7927dff700 1 -- 172.21.15.142:0/2284996318 shutdown_connections 2023-09-30T22:57:51.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.453+0000 7f7927dff700 1 -- 172.21.15.142:0/2284996318 wait complete. 2023-09-30T22:57:51.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.454+0000 7f7927dff700 1 Processor -- start 2023-09-30T22:57:51.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.454+0000 7f7927dff700 1 -- start start 2023-09-30T22:57:51.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.455+0000 7f7927dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f792015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.455+0000 7f7927dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79200b40c0 0x7f79200b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.455+0000 7f7927dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79200a7610 0x7f79200a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.455+0000 7f7927dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200a7fc0 con 0x7f790c003ab0 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.455+0000 7f7927dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792015c2a0 con 0x7f79200b40c0 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.455+0000 7f7927dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792015c580 con 0x7f79200a7610 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.455+0000 7f7925b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f792015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f792015bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46116/0 (socket says 172.21.15.142:46116) 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 -- 172.21.15.142:0/232932960 learned_addr learned my addr 172.21.15.142:0/232932960 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f792539a700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79200b40c0 0x7f79200b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f792639c700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79200a7610 0x7f79200a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 -- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79200a7610 msgr2=0x7f79200a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79200a7610 0x7f79200a7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 -- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79200b40c0 msgr2=0x7f79200b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79200b40c0 0x7f79200b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 -- 172.21.15.142:0/232932960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792015c860 con 0x7f790c003ab0 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f792539a700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79200b40c0 0x7f79200b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7925b9b700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f792015bba0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c180 tx=0x7f791c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7915ffb700 1 -- 172.21.15.142:0/232932960 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c022070 con 0x7f790c003ab0 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7915ffb700 1 -- 172.21.15.142:0/232932960 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00e9e0 con 0x7f790c003ab0 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7915ffb700 1 -- 172.21.15.142:0/232932960 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c01c450 con 0x7f790c003ab0 2023-09-30T22:57:51.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.456+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792015cb40 con 0x7f790c003ab0 2023-09-30T22:57:51.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.457+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200b11d0 con 0x7f790c003ab0 2023-09-30T22:57:51.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.458+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792006ea70 con 0x7f790c003ab0 2023-09-30T22:57:51.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.458+0000 7f7915ffb700 1 -- 172.21.15.142:0/232932960 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f791c01c880 con 0x7f790c003ab0 2023-09-30T22:57:51.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.460+0000 7f7915ffb700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7904067330 0x7f79040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.460+0000 7f7915ffb700 1 -- 172.21.15.142:0/232932960 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f791c0862b0 con 0x7f790c003ab0 2023-09-30T22:57:51.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.460+0000 7f792539a700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7904067330 0x7f79040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.460+0000 7f792539a700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7904067330 0x7f79040697e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f79100015a0 tx=0x7f7910001150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.464+0000 7f7915ffb700 1 -- 172.21.15.142:0/232932960 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f791c053260 con 0x7f790c003ab0 2023-09-30T22:57:51.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.650+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f792015c410 con 0x7f7904067330 2023-09-30T22:57:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.659+0000 7f7915ffb700 1 -- 172.21.15.142:0/232932960 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300225 (secure 0 0 0) 0x7f792015c410 con 0x7f7904067330 2023-09-30T22:57:51.664 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7904067330 msgr2=0x7f79040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7904067330 0x7f79040697e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f79100015a0 tx=0x7f7910001150 comp rx=0 tx=0).stop 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 msgr2=0x7f792015bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f792015bba0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c180 tx=0x7f791c01a000 comp rx=0 tx=0).stop 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 shutdown_connections 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7904067330 0x7f79040697e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79200a7610 0x7f79200a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790c003ab0 0x7f792015bba0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 --2- 172.21.15.142:0/232932960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79200b40c0 0x7f79200b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.663+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 >> 172.21.15.142:0/232932960 conn(0x7f79200ce8e0 msgr2=0x7f79200c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:51.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.664+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 shutdown_connections 2023-09-30T22:57:51.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.664+0000 7f7927dff700 1 -- 172.21.15.142:0/232932960 wait complete. 2023-09-30T22:57:51.668 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:57:51.682 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2023-09-30T22:57:50.175346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556425,"statfs":{"total":1600000000,"available":1593779808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.862500"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.324240+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:15.328972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317153+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:57.316255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320840+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:51.209679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318633+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:16.914069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.324715+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:34.970083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320537+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:59.338702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317462+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:34.970083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319141+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:13.114692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318008+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319278+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:48.429614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317568+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319712+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:58.224759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316946+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:29.271352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.321096+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:00.800542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318890+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:18.585352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320158+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:26:54.157763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318319+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:57.316255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320118+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:01.155489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315575+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:29.271352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318730+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:45.574707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317774+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:53.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315302+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:51.209679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317503+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:45.574707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323190+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317681+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:13.114692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317373+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:58.623724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319289+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:52:39.752774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316557+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:51.209679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322414+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:26:54.157763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.324165+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:25:16.153993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.314855+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:48.429614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317869+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:50:51.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323842+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:57.307570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327869+0000","last_change":"2023-09-30T22:57:46.327869+0000","last_active":"2023-09-30T22:57:46.327869+0000","last_peered":"2023-09-30T22:57:46.327869+0000","last_clean":"2023-09-30T22:57:46.327869+0000","last_became_active":"2023-09-30T22:57:46.327406+0000","last_became_peered":"2023-09-30T22:57:46.327406+0000","last_unstale":"2023-09-30T22:57:46.327869+0000","last_undegraded":"2023-09-30T22:57:46.327869+0000","last_fullsized":"2023-09-30T22:57:46.327869+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:21.409395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317469+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:00.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325137+0000","last_change":"2023-09-30T22:57:46.325137+0000","last_active":"2023-09-30T22:57:46.325137+0000","last_peered":"2023-09-30T22:57:46.325137+0000","last_clean":"2023-09-30T22:57:46.325137+0000","last_became_active":"2023-09-30T22:57:46.324895+0000","last_became_peered":"2023-09-30T22:57:46.324895+0000","last_unstale":"2023-09-30T22:57:46.325137+0000","last_undegraded":"2023-09-30T22:57:46.325137+0000","last_fullsized":"2023-09-30T22:57:46.325137+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:43:30.607338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318347+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330625+0000","last_change":"2023-09-30T22:57:46.330625+0000","last_active":"2023-09-30T22:57:46.330625+0000","last_peered":"2023-09-30T22:57:46.330625+0000","last_clean":"2023-09-30T22:57:46.330625+0000","last_became_active":"2023-09-30T22:57:46.330091+0000","last_became_peered":"2023-09-30T22:57:46.330091+0000","last_unstale":"2023-09-30T22:57:46.330625+0000","last_undegraded":"2023-09-30T22:57:46.330625+0000","last_fullsized":"2023-09-30T22:57:46.330625+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:37.900944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320488+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:04.452346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325868+0000","last_change":"2023-09-30T22:57:46.325868+0000","last_active":"2023-09-30T22:57:46.325868+0000","last_peered":"2023-09-30T22:57:46.325868+0000","last_clean":"2023-09-30T22:57:46.325868+0000","last_became_active":"2023-09-30T22:57:46.325652+0000","last_became_peered":"2023-09-30T22:57:46.325652+0000","last_unstale":"2023-09-30T22:57:46.325868+0000","last_undegraded":"2023-09-30T22:57:46.325868+0000","last_fullsized":"2023-09-30T22:57:46.325868+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:58:52.324524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316423+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:04.452346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325950+0000","last_change":"2023-09-30T22:57:46.325950+0000","last_active":"2023-09-30T22:57:46.325950+0000","last_peered":"2023-09-30T22:57:46.325950+0000","last_clean":"2023-09-30T22:57:46.325950+0000","last_became_active":"2023-09-30T22:57:46.325694+0000","last_became_peered":"2023-09-30T22:57:46.325694+0000","last_unstale":"2023-09-30T22:57:46.325950+0000","last_undegraded":"2023-09-30T22:57:46.325950+0000","last_fullsized":"2023-09-30T22:57:46.325950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:45.916234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317667+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.320132+0000","last_change":"2023-09-30T22:57:46.320132+0000","last_active":"2023-09-30T22:57:46.320132+0000","last_peered":"2023-09-30T22:57:46.320132+0000","last_clean":"2023-09-30T22:57:46.320132+0000","last_became_active":"2023-09-30T22:57:46.319599+0000","last_became_peered":"2023-09-30T22:57:46.319599+0000","last_unstale":"2023-09-30T22:57:46.320132+0000","last_undegraded":"2023-09-30T22:57:46.320132+0000","last_fullsized":"2023-09-30T22:57:46.320132+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318694+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:58.623724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.323796+0000","last_change":"2023-09-30T22:57:46.323796+0000","last_active":"2023-09-30T22:57:46.323796+0000","last_peered":"2023-09-30T22:57:46.323796+0000","last_clean":"2023-09-30T22:57:46.323796+0000","last_became_active":"2023-09-30T22:57:46.323523+0000","last_became_peered":"2023-09-30T22:57:46.323523+0000","last_unstale":"2023-09-30T22:57:46.323796+0000","last_undegraded":"2023-09-30T22:57:46.323796+0000","last_fullsized":"2023-09-30T22:57:46.323796+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:18:59.796566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322860+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.329838+0000","last_change":"2023-09-30T22:57:46.329838+0000","last_active":"2023-09-30T22:57:46.329838+0000","last_peered":"2023-09-30T22:57:46.329838+0000","last_clean":"2023-09-30T22:57:46.329838+0000","last_became_active":"2023-09-30T22:57:46.329311+0000","last_became_peered":"2023-09-30T22:57:46.329311+0000","last_unstale":"2023-09-30T22:57:46.329838+0000","last_undegraded":"2023-09-30T22:57:46.329838+0000","last_fullsized":"2023-09-30T22:57:46.329838+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:46:59.626736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318302+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:43.719188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326797+0000","last_change":"2023-09-30T22:57:46.326797+0000","last_active":"2023-09-30T22:57:46.326797+0000","last_peered":"2023-09-30T22:57:46.326797+0000","last_clean":"2023-09-30T22:57:46.326797+0000","last_became_active":"2023-09-30T22:57:46.326535+0000","last_became_peered":"2023-09-30T22:57:46.326535+0000","last_unstale":"2023-09-30T22:57:46.326797+0000","last_undegraded":"2023-09-30T22:57:46.326797+0000","last_fullsized":"2023-09-30T22:57:46.326797+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:59.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318709+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:48.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.328233+0000","last_change":"2023-09-30T22:57:46.328233+0000","last_active":"2023-09-30T22:57:46.328233+0000","last_peered":"2023-09-30T22:57:46.328233+0000","last_clean":"2023-09-30T22:57:46.328233+0000","last_became_active":"2023-09-30T22:57:46.328011+0000","last_became_peered":"2023-09-30T22:57:46.328011+0000","last_unstale":"2023-09-30T22:57:46.328233+0000","last_undegraded":"2023-09-30T22:57:46.328233+0000","last_fullsized":"2023-09-30T22:57:46.328233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:53.277996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322496+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.328096+0000","last_change":"2023-09-30T22:57:46.328096+0000","last_active":"2023-09-30T22:57:46.328096+0000","last_peered":"2023-09-30T22:57:46.328096+0000","last_clean":"2023-09-30T22:57:46.328096+0000","last_became_active":"2023-09-30T22:57:46.327733+0000","last_became_peered":"2023-09-30T22:57:46.327733+0000","last_unstale":"2023-09-30T22:57:46.328096+0000","last_undegraded":"2023-09-30T22:57:46.328096+0000","last_fullsized":"2023-09-30T22:57:46.328096+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:10.249931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319775+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:43.719188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326967+0000","last_change":"2023-09-30T22:57:46.326967+0000","last_active":"2023-09-30T22:57:46.326967+0000","last_peered":"2023-09-30T22:57:46.326967+0000","last_clean":"2023-09-30T22:57:46.326967+0000","last_became_active":"2023-09-30T22:57:46.326481+0000","last_became_peered":"2023-09-30T22:57:46.326481+0000","last_unstale":"2023-09-30T22:57:46.326967+0000","last_undegraded":"2023-09-30T22:57:46.326967+0000","last_fullsized":"2023-09-30T22:57:46.326967+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:50.205703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322618+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330755+0000","last_change":"2023-09-30T22:57:46.330755+0000","last_active":"2023-09-30T22:57:46.330755+0000","last_peered":"2023-09-30T22:57:46.330755+0000","last_clean":"2023-09-30T22:57:46.330755+0000","last_became_active":"2023-09-30T22:57:46.330373+0000","last_became_peered":"2023-09-30T22:57:46.330373+0000","last_unstale":"2023-09-30T22:57:46.330755+0000","last_undegraded":"2023-09-30T22:57:46.330755+0000","last_fullsized":"2023-09-30T22:57:46.330755+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:53.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317922+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:47:27.062944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327220+0000","last_change":"2023-09-30T22:57:46.327220+0000","last_active":"2023-09-30T22:57:46.327220+0000","last_peered":"2023-09-30T22:57:46.327220+0000","last_clean":"2023-09-30T22:57:46.327220+0000","last_became_active":"2023-09-30T22:57:46.326718+0000","last_became_peered":"2023-09-30T22:57:46.326718+0000","last_unstale":"2023-09-30T22:57:46.327220+0000","last_undegraded":"2023-09-30T22:57:46.327220+0000","last_fullsized":"2023-09-30T22:57:46.327220+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:28.267376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323099+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326928+0000","last_change":"2023-09-30T22:57:46.326928+0000","last_active":"2023-09-30T22:57:46.326928+0000","last_peered":"2023-09-30T22:57:46.326928+0000","last_clean":"2023-09-30T22:57:46.326928+0000","last_became_active":"2023-09-30T22:57:46.326433+0000","last_became_peered":"2023-09-30T22:57:46.326433+0000","last_unstale":"2023-09-30T22:57:46.326928+0000","last_undegraded":"2023-09-30T22:57:46.326928+0000","last_fullsized":"2023-09-30T22:57:46.326928+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:57.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316041+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:01.155489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327580+0000","last_change":"2023-09-30T22:57:46.327580+0000","last_active":"2023-09-30T22:57:46.327580+0000","last_peered":"2023-09-30T22:57:46.327580+0000","last_clean":"2023-09-30T22:57:46.327580+0000","last_became_active":"2023-09-30T22:57:46.327347+0000","last_became_peered":"2023-09-30T22:57:46.327347+0000","last_unstale":"2023-09-30T22:57:46.327580+0000","last_undegraded":"2023-09-30T22:57:46.327580+0000","last_fullsized":"2023-09-30T22:57:46.327580+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:22.893668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.314874+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:01.155489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.324881+0000","last_change":"2023-09-30T22:57:46.324881+0000","last_active":"2023-09-30T22:57:46.324881+0000","last_peered":"2023-09-30T22:57:46.324881+0000","last_clean":"2023-09-30T22:57:46.324881+0000","last_became_active":"2023-09-30T22:57:46.324629+0000","last_became_peered":"2023-09-30T22:57:46.324629+0000","last_unstale":"2023-09-30T22:57:46.324881+0000","last_undegraded":"2023-09-30T22:57:46.324881+0000","last_fullsized":"2023-09-30T22:57:46.324881+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:51.004328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316016+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:52:39.752774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330434+0000","last_change":"2023-09-30T22:57:46.330434+0000","last_active":"2023-09-30T22:57:46.330434+0000","last_peered":"2023-09-30T22:57:46.330434+0000","last_clean":"2023-09-30T22:57:46.330434+0000","last_became_active":"2023-09-30T22:57:46.330220+0000","last_became_peered":"2023-09-30T22:57:46.330220+0000","last_unstale":"2023-09-30T22:57:46.330434+0000","last_undegraded":"2023-09-30T22:57:46.330434+0000","last_fullsized":"2023-09-30T22:57:46.330434+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:36.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315957+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:58.224759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326357+0000","last_change":"2023-09-30T22:57:46.326357+0000","last_active":"2023-09-30T22:57:46.326357+0000","last_peered":"2023-09-30T22:57:46.326357+0000","last_clean":"2023-09-30T22:57:46.326357+0000","last_became_active":"2023-09-30T22:57:46.326124+0000","last_became_peered":"2023-09-30T22:57:46.326124+0000","last_unstale":"2023-09-30T22:57:46.326357+0000","last_undegraded":"2023-09-30T22:57:46.326357+0000","last_fullsized":"2023-09-30T22:57:46.326357+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317581+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:34.904326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.321470+0000","last_change":"2023-09-30T22:57:46.321470+0000","last_active":"2023-09-30T22:57:46.321470+0000","last_peered":"2023-09-30T22:57:46.321470+0000","last_clean":"2023-09-30T22:57:46.321470+0000","last_became_active":"2023-09-30T22:57:46.321233+0000","last_became_peered":"2023-09-30T22:57:46.321233+0000","last_unstale":"2023-09-30T22:57:46.321470+0000","last_undegraded":"2023-09-30T22:57:46.321470+0000","last_fullsized":"2023-09-30T22:57:46.321470+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:58.334725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318166+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.323408+0000","last_change":"2023-09-30T22:57:46.323408+0000","last_active":"2023-09-30T22:57:46.323408+0000","last_peered":"2023-09-30T22:57:46.323408+0000","last_clean":"2023-09-30T22:57:46.323408+0000","last_became_active":"2023-09-30T22:57:46.322636+0000","last_became_peered":"2023-09-30T22:57:46.322636+0000","last_unstale":"2023-09-30T22:57:46.323408+0000","last_undegraded":"2023-09-30T22:57:46.323408+0000","last_fullsized":"2023-09-30T22:57:46.323408+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:00.151513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318859+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:46.920211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327259+0000","last_change":"2023-09-30T22:57:46.327259+0000","last_active":"2023-09-30T22:57:46.327259+0000","last_peered":"2023-09-30T22:57:46.327259+0000","last_clean":"2023-09-30T22:57:46.327259+0000","last_became_active":"2023-09-30T22:57:46.326989+0000","last_became_peered":"2023-09-30T22:57:46.326989+0000","last_unstale":"2023-09-30T22:57:46.327259+0000","last_undegraded":"2023-09-30T22:57:46.327259+0000","last_fullsized":"2023-09-30T22:57:46.327259+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.314895+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:58.224759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327694+0000","last_change":"2023-09-30T22:57:46.327694+0000","last_active":"2023-09-30T22:57:46.327694+0000","last_peered":"2023-09-30T22:57:46.327694+0000","last_clean":"2023-09-30T22:57:46.327694+0000","last_became_active":"2023-09-30T22:57:46.327163+0000","last_became_peered":"2023-09-30T22:57:46.327163+0000","last_unstale":"2023-09-30T22:57:46.327694+0000","last_undegraded":"2023-09-30T22:57:46.327694+0000","last_fullsized":"2023-09-30T22:57:46.327694+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:56.303593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319036+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:34.904326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326830+0000","last_change":"2023-09-30T22:57:46.326830+0000","last_active":"2023-09-30T22:57:46.326830+0000","last_peered":"2023-09-30T22:57:46.326830+0000","last_clean":"2023-09-30T22:57:46.326830+0000","last_became_active":"2023-09-30T22:57:46.326524+0000","last_became_peered":"2023-09-30T22:57:46.326524+0000","last_unstale":"2023-09-30T22:57:46.326830+0000","last_undegraded":"2023-09-30T22:57:46.326830+0000","last_fullsized":"2023-09-30T22:57:46.326830+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:14.959667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319396+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:53.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327951+0000","last_change":"2023-09-30T22:57:46.327951+0000","last_active":"2023-09-30T22:57:46.327951+0000","last_peered":"2023-09-30T22:57:46.327951+0000","last_clean":"2023-09-30T22:57:46.327951+0000","last_became_active":"2023-09-30T22:57:46.327380+0000","last_became_peered":"2023-09-30T22:57:46.327380+0000","last_unstale":"2023-09-30T22:57:46.327951+0000","last_undegraded":"2023-09-30T22:57:46.327951+0000","last_fullsized":"2023-09-30T22:57:46.327951+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:55.273827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.318299+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:57:45.318299+0000","last_peered":"2023-09-30T22:57:45.318299+0000","last_clean":"2023-09-30T22:57:45.318299+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:57:45.318299+0000","last_undegraded":"2023-09-30T22:57:45.318299+0000","last_fullsized":"2023-09-30T22:57:45.318299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323797+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:59.338702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.329817+0000","last_change":"2023-09-30T22:57:46.329817+0000","last_active":"2023-09-30T22:57:46.329817+0000","last_peered":"2023-09-30T22:57:46.329817+0000","last_clean":"2023-09-30T22:57:46.329817+0000","last_became_active":"2023-09-30T22:57:46.329534+0000","last_became_peered":"2023-09-30T22:57:46.329534+0000","last_unstale":"2023-09-30T22:57:46.329817+0000","last_undegraded":"2023-09-30T22:57:46.329817+0000","last_fullsized":"2023-09-30T22:57:46.329817+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:11:14.497043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.314983+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:57:45.314983+0000","last_peered":"2023-09-30T22:57:45.314983+0000","last_clean":"2023-09-30T22:57:45.314983+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:57:45.314983+0000","last_undegraded":"2023-09-30T22:57:45.314983+0000","last_fullsized":"2023-09-30T22:57:45.314983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317182+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:25:16.153993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330494+0000","last_change":"2023-09-30T22:57:46.330494+0000","last_active":"2023-09-30T22:57:46.330494+0000","last_peered":"2023-09-30T22:57:46.330494+0000","last_clean":"2023-09-30T22:57:46.330494+0000","last_became_active":"2023-09-30T22:57:46.330277+0000","last_became_peered":"2023-09-30T22:57:46.330277+0000","last_unstale":"2023-09-30T22:57:46.330494+0000","last_undegraded":"2023-09-30T22:57:46.330494+0000","last_fullsized":"2023-09-30T22:57:46.330494+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:57:31.215330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313891+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:57:45.313891+0000","last_peered":"2023-09-30T22:57:45.313891+0000","last_clean":"2023-09-30T22:57:45.313891+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:57:45.313891+0000","last_undegraded":"2023-09-30T22:57:45.313891+0000","last_fullsized":"2023-09-30T22:57:45.313891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316689+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.322115+0000","last_change":"2023-09-30T22:57:46.322115+0000","last_active":"2023-09-30T22:57:46.322115+0000","last_peered":"2023-09-30T22:57:46.322115+0000","last_clean":"2023-09-30T22:57:46.322115+0000","last_became_active":"2023-09-30T22:57:46.321808+0000","last_became_peered":"2023-09-30T22:57:46.321808+0000","last_unstale":"2023-09-30T22:57:46.322115+0000","last_undegraded":"2023-09-30T22:57:46.322115+0000","last_fullsized":"2023-09-30T22:57:46.322115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:03.448369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313668+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:57:45.313668+0000","last_peered":"2023-09-30T22:57:45.313668+0000","last_clean":"2023-09-30T22:57:45.313668+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:57:45.313668+0000","last_undegraded":"2023-09-30T22:57:45.313668+0000","last_fullsized":"2023-09-30T22:57:45.313668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":243,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313368+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:57:45.313368+0000","last_peered":"2023-09-30T22:57:45.313368+0000","last_clean":"2023-09-30T22:57:45.313368+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:57:45.313368+0000","last_undegraded":"2023-09-30T22:57:45.313368+0000","last_fullsized":"2023-09-30T22:57:45.313368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315938+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:48.429614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.322978+0000","last_change":"2023-09-30T22:57:46.322978+0000","last_active":"2023-09-30T22:57:46.322978+0000","last_peered":"2023-09-30T22:57:46.322978+0000","last_clean":"2023-09-30T22:57:46.322978+0000","last_became_active":"2023-09-30T22:57:46.322754+0000","last_became_peered":"2023-09-30T22:57:46.322754+0000","last_unstale":"2023-09-30T22:57:46.322978+0000","last_undegraded":"2023-09-30T22:57:46.322978+0000","last_fullsized":"2023-09-30T22:57:46.322978+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313984+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:57:45.313984+0000","last_peered":"2023-09-30T22:57:45.313984+0000","last_clean":"2023-09-30T22:57:45.313984+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:57:45.313984+0000","last_undegraded":"2023-09-30T22:57:45.313984+0000","last_fullsized":"2023-09-30T22:57:45.313984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320714+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:23.897645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325177+0000","last_change":"2023-09-30T22:57:46.325177+0000","last_active":"2023-09-30T22:57:46.325177+0000","last_peered":"2023-09-30T22:57:46.325177+0000","last_clean":"2023-09-30T22:57:46.325177+0000","last_became_active":"2023-09-30T22:57:46.324955+0000","last_became_peered":"2023-09-30T22:57:46.324955+0000","last_unstale":"2023-09-30T22:57:46.325177+0000","last_undegraded":"2023-09-30T22:57:46.325177+0000","last_fullsized":"2023-09-30T22:57:46.325177+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313900+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:57:45.313900+0000","last_peered":"2023-09-30T22:57:45.313900+0000","last_clean":"2023-09-30T22:57:45.313900+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:57:45.313900+0000","last_undegraded":"2023-09-30T22:57:45.313900+0000","last_fullsized":"2023-09-30T22:57:45.313900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315197+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:04.452346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325292+0000","last_change":"2023-09-30T22:57:46.325292+0000","last_active":"2023-09-30T22:57:46.325292+0000","last_peered":"2023-09-30T22:57:46.325292+0000","last_clean":"2023-09-30T22:57:46.325292+0000","last_became_active":"2023-09-30T22:57:46.325062+0000","last_became_peered":"2023-09-30T22:57:46.325062+0000","last_unstale":"2023-09-30T22:57:46.325292+0000","last_undegraded":"2023-09-30T22:57:46.325292+0000","last_fullsized":"2023-09-30T22:57:46.325292+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:41.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313228+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:57:45.313228+0000","last_peered":"2023-09-30T22:57:45.313228+0000","last_clean":"2023-09-30T22:57:45.313228+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:57:45.313228+0000","last_undegraded":"2023-09-30T22:57:45.313228+0000","last_fullsized":"2023-09-30T22:57:45.313228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322234+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.324050+0000","last_change":"2023-09-30T22:57:46.324050+0000","last_active":"2023-09-30T22:57:46.324050+0000","last_peered":"2023-09-30T22:57:46.324050+0000","last_clean":"2023-09-30T22:57:46.324050+0000","last_became_active":"2023-09-30T22:57:46.323824+0000","last_became_peered":"2023-09-30T22:57:46.323824+0000","last_unstale":"2023-09-30T22:57:46.324050+0000","last_undegraded":"2023-09-30T22:57:46.324050+0000","last_fullsized":"2023-09-30T22:57:46.324050+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.314903+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:57:45.314903+0000","last_peered":"2023-09-30T22:57:45.314903+0000","last_clean":"2023-09-30T22:57:45.314903+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:57:45.314903+0000","last_undegraded":"2023-09-30T22:57:45.314903+0000","last_fullsized":"2023-09-30T22:57:45.314903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66700000000000004,"15min":0.63500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.65000000000000002},"min":{"1min":0.53800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.874,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.442},{"interface":"front","average":{"1min":0.745,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.67800000000000005},"min":{"1min":0.53700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.52400000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.502,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.056,"15min":1.056},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.871,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.135,"15min":1.135},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.071,"15min":1.071},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78000000000000003,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.97699999999999998,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.80200000000000005},"min":{"1min":0.51700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0800000000000001,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.46200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.83999999999999997,"15min":1.022},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":1.0289999999999999},"min":{"1min":0.48099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0429999999999999,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.95599999999999996},"min":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0089999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.107,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1259999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.65700000000000003},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.321,"15min":1.321},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80300000000000005,"15min":0.75900000000000001},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.198,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.61399999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194120,"statfs":{"total":200000000,"available":198779700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45700000000000002,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.441},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.47099999999999997},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.52000000000000002},"min":{"1min":0.44400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.47299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.72599999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60599999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.71199999999999997},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.22},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76300000000000001,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.622}]},{"osd":6,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.72399999999999998},"min":{"1min":0.56999999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.032,"5min":1.127,"15min":1.127},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0660000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80300000000000005,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.51400000000000001},"min":{"1min":0.34399999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.879},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.438},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.27,"15min":1.27},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.48599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0600000000000001,"5min":1.171,"15min":1.171},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.57599999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.119,"15min":1.119},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76600000000000001,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.173,"15min":1.173},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.095,"5min":1.21,"15min":1.21},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79200000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.53600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.38,"15min":0.38},"max":{"1min":1.04,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.151,"5min":1.179,"15min":1.179},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.236,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.615,"15min":1.615},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.59199999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.57299999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.117,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47899999999999998,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59899999999999998,"5min":1.919,"15min":1.919},"last":0.26000000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68300000000000005,"5min":1.254,"15min":1.254},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.747,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.372}]},{"osd":4,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.747,"15min":0.72799999999999998},"min":{"1min":0.52900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.242,"5min":1.401,"15min":1.401},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.76400000000000001},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.21,"5min":3.306,"15min":3.306},"last":0.443}]},{"osd":5,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98199999999999998,"5min":1.508,"15min":1.508},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.745},"min":{"1min":0.57099999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.151,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0700000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.61799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1160000000000001,"5min":1.573,"15min":1.573},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93100000000000005,"5min":1.022,"15min":1.022},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64300000000000002,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64600000000000002,"15min":0.623},"min":{"1min":0.48199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60099999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.66400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95199999999999996,"5min":1.006,"15min":1.006},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72199999999999998,"15min":0.67900000000000005},"min":{"1min":0.53400000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91100000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72499999999999998,"15min":0.69099999999999995},"min":{"1min":0.52500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90100000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":1,"5min":1,"15min":1},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.623}]},{"osd":7,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93500000000000005,"5min":1.016,"15min":1.016},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.026,"5min":1.044,"15min":1.044},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194120,"statfs":{"total":200000000,"available":198779700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.42199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.623},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65100000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84299999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.044,"15min":1.044},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69499999999999995,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90700000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.37,"15min":0.37},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.74299999999999999}]}]}],"pool_statfs":[]}} 2023-09-30T22:57:51.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:57:51.839 INFO:tasks.ceph.mds.a.smithi142.stderr:2023-09-30T22:57:51.839+0000 7f6e3c9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:57:51.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.911+0000 7f67777ff700 1 Processor -- start 2023-09-30T22:57:51.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.911+0000 7f67777ff700 1 -- start start 2023-09-30T22:57:51.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.912+0000 7f67777ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67700aebf0 0x7f677006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.912+0000 7f67777ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f677006f190 0x7f6770159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.912+0000 7f67777ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67700b0ee0 con 0x7f677015a0d0 2023-09-30T22:57:51.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.912+0000 7f67777ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67700aefc0 con 0x7f67700aebf0 2023-09-30T22:57:51.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.912+0000 7f67777ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677015a550 con 0x7f677006f190 2023-09-30T22:57:51.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f6774d9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f677006f190 0x7f6770159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f677559b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67700aebf0 0x7f677006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f6774d9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f677006f190 0x7f6770159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:39908/0 (socket says 172.21.15.142:39908) 2023-09-30T22:57:51.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f6774d9a700 1 -- 172.21.15.142:0/1998832571 learned_addr learned my addr 172.21.15.142:0/1998832571 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:51.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f6775d9c700 1 --1- 172.21.15.142:0/1998832571 >> v1:172.21.15.148:6789/0 conn(0x7f677015a0d0 0x7f6770156590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:47436/0 (socket says 172.21.15.142:47436) 2023-09-30T22:57:51.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f677559b700 1 -- 172.21.15.142:0/1998832571 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f677006f190 msgr2=0x7f6770159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:51.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f677559b700 1 --2- 172.21.15.142:0/1998832571 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f677006f190 0x7f6770159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f677559b700 1 -- 172.21.15.142:0/1998832571 >> v1:172.21.15.148:6789/0 conn(0x7f677015a0d0 legacy=0x7f6770156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.913+0000 7f677559b700 1 -- 172.21.15.142:0/1998832571 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700b02d0 con 0x7f67700aebf0 2023-09-30T22:57:51.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.914+0000 7f677559b700 1 --2- 172.21.15.142:0/1998832571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67700aebf0 0x7f677006ec50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f676c009910 tx=0x7f676c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a9a22ed108af86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.914+0000 7f6767fff700 1 -- 172.21.15.142:0/1998832571 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00b640 con 0x7f67700aebf0 2023-09-30T22:57:51.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.914+0000 7f6767fff700 1 -- 172.21.15.142:0/1998832571 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c00b7a0 con 0x7f67700aebf0 2023-09-30T22:57:51.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.914+0000 7f6767fff700 1 -- 172.21.15.142:0/1998832571 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00bb60 con 0x7f67700aebf0 2023-09-30T22:57:51.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 -- 172.21.15.142:0/1998832571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67700aebf0 msgr2=0x7f677006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 --2- 172.21.15.142:0/1998832571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67700aebf0 0x7f677006ec50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f676c009910 tx=0x7f676c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 -- 172.21.15.142:0/1998832571 shutdown_connections 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 --2- 172.21.15.142:0/1998832571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67700aebf0 0x7f677006ec50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 --2- 172.21.15.142:0/1998832571 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f677006f190 0x7f6770159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 -- 172.21.15.142:0/1998832571 >> 172.21.15.142:0/1998832571 conn(0x7f67700680c0 msgr2=0x7f67700c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 -- 172.21.15.142:0/1998832571 shutdown_connections 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.915+0000 7f67777ff700 1 -- 172.21.15.142:0/1998832571 wait complete. 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.916+0000 7f67777ff700 1 Processor -- start 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.916+0000 7f67777ff700 1 -- start start 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.917+0000 7f67777ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f677006f190 0x7f67701529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.917+0000 7f67777ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67700aebf0 0x7f677016b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.917+0000 7f67777ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f677015a0d0 0x7f677006aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.917+0000 7f67777ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677016b8c0 con 0x7f677015a0d0 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.917+0000 7f67777ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6770157490 con 0x7f677006f190 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.917+0000 7f67777ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6770156880 con 0x7f67700aebf0 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f677015a0d0 0x7f677006aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f677015a0d0 0x7f677006aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46122/0 (socket says 172.21.15.142:46122) 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 -- 172.21.15.142:0/1052915103 learned_addr learned my addr 172.21.15.142:0/1052915103 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f677559b700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f677006f190 0x7f67701529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6774d9a700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67700aebf0 0x7f677016b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 -- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67700aebf0 msgr2=0x7f677016b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67700aebf0 0x7f677016b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 -- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f677006f190 msgr2=0x7f67701529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f677006f190 0x7f67701529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 -- 172.21.15.142:0/1052915103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c009420 con 0x7f677015a0d0 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f6775d9c700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f677015a0d0 0x7f677006aec0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f676800cc70 tx=0x7f6768001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.918+0000 7f67657fa700 1 -- 172.21.15.142:0/1052915103 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768004bb0 con 0x7f677015a0d0 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.919+0000 7f67657fa700 1 -- 172.21.15.142:0/1052915103 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6768004d10 con 0x7f677015a0d0 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.919+0000 7f67657fa700 1 -- 172.21.15.142:0/1052915103 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800ab90 con 0x7f677015a0d0 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.919+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6770156b60 con 0x7f677015a0d0 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.919+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6770157120 con 0x7f677015a0d0 2023-09-30T22:57:51.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.920+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67700695b0 con 0x7f677015a0d0 2023-09-30T22:57:51.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.920+0000 7f67657fa700 1 -- 172.21.15.142:0/1052915103 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f67680070f0 con 0x7f677015a0d0 2023-09-30T22:57:51.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.922+0000 7f67657fa700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6754067330 0x7f67540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:51.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.922+0000 7f67657fa700 1 -- 172.21.15.142:0/1052915103 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6768084720 con 0x7f677015a0d0 2023-09-30T22:57:51.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.922+0000 7f677559b700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6754067330 0x7f67540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:51.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.922+0000 7f677559b700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6754067330 0x7f67540697e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f676c009860 tx=0x7f676c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:51.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:51.926+0000 7f67657fa700 1 -- 172.21.15.142:0/1052915103 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6768051600 con 0x7f677015a0d0 2023-09-30T22:57:52.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.110+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67701575d0 con 0x7f6754067330 2023-09-30T22:57:52.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.118+0000 7f67657fa700 1 -- 172.21.15.142:0/1052915103 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300225 (secure 0 0 0) 0x7f676c00b910 con 0x7f6754067330 2023-09-30T22:57:52.123 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6754067330 msgr2=0x7f67540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6754067330 0x7f67540697e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f676c009860 tx=0x7f676c017000 comp rx=0 tx=0).stop 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f677015a0d0 msgr2=0x7f677006aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f677015a0d0 0x7f677006aec0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f676800cc70 tx=0x7f6768001a70 comp rx=0 tx=0).stop 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 shutdown_connections 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6754067330 0x7f67540697e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f677015a0d0 0x7f677006aec0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f677006f190 0x7f67701529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 --2- 172.21.15.142:0/1052915103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67700aebf0 0x7f677016b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.122+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 >> 172.21.15.142:0/1052915103 conn(0x7f67700680c0 msgr2=0x7f67700cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:52.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.123+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 shutdown_connections 2023-09-30T22:57:52.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.123+0000 7f67777ff700 1 -- 172.21.15.142:0/1052915103 wait complete. 2023-09-30T22:57:52.127 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:57:52.141 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2023-09-30T22:57:50.175346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556425,"statfs":{"total":1600000000,"available":1593779808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.862500"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.324240+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:15.328972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317153+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:57.316255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320840+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:51.209679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318633+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:16.914069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.324715+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:34.970083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320537+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:59.338702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317462+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:34.970083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319141+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:13.114692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318008+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319278+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:48.429614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317568+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319712+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:58.224759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316946+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:29.271352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.321096+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:00.800542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318890+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:18.585352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320158+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:26:54.157763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318319+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:57.316255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320118+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:01.155489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315575+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:29.271352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318730+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:45.574707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317774+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:53.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315302+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:51.209679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317503+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:45.574707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323190+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317681+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:13:13.114692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317373+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:58.623724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319289+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:52:39.752774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316557+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:51.209679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322414+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:26:54.157763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.324165+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:25:16.153993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.314855+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:48.429614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317869+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:50:51.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323842+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:57.307570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327869+0000","last_change":"2023-09-30T22:57:46.327869+0000","last_active":"2023-09-30T22:57:46.327869+0000","last_peered":"2023-09-30T22:57:46.327869+0000","last_clean":"2023-09-30T22:57:46.327869+0000","last_became_active":"2023-09-30T22:57:46.327406+0000","last_became_peered":"2023-09-30T22:57:46.327406+0000","last_unstale":"2023-09-30T22:57:46.327869+0000","last_undegraded":"2023-09-30T22:57:46.327869+0000","last_fullsized":"2023-09-30T22:57:46.327869+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:21.409395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317469+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:00.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325137+0000","last_change":"2023-09-30T22:57:46.325137+0000","last_active":"2023-09-30T22:57:46.325137+0000","last_peered":"2023-09-30T22:57:46.325137+0000","last_clean":"2023-09-30T22:57:46.325137+0000","last_became_active":"2023-09-30T22:57:46.324895+0000","last_became_peered":"2023-09-30T22:57:46.324895+0000","last_unstale":"2023-09-30T22:57:46.325137+0000","last_undegraded":"2023-09-30T22:57:46.325137+0000","last_fullsized":"2023-09-30T22:57:46.325137+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:43:30.607338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318347+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330625+0000","last_change":"2023-09-30T22:57:46.330625+0000","last_active":"2023-09-30T22:57:46.330625+0000","last_peered":"2023-09-30T22:57:46.330625+0000","last_clean":"2023-09-30T22:57:46.330625+0000","last_became_active":"2023-09-30T22:57:46.330091+0000","last_became_peered":"2023-09-30T22:57:46.330091+0000","last_unstale":"2023-09-30T22:57:46.330625+0000","last_undegraded":"2023-09-30T22:57:46.330625+0000","last_fullsized":"2023-09-30T22:57:46.330625+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:37.900944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320488+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:04.452346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325868+0000","last_change":"2023-09-30T22:57:46.325868+0000","last_active":"2023-09-30T22:57:46.325868+0000","last_peered":"2023-09-30T22:57:46.325868+0000","last_clean":"2023-09-30T22:57:46.325868+0000","last_became_active":"2023-09-30T22:57:46.325652+0000","last_became_peered":"2023-09-30T22:57:46.325652+0000","last_unstale":"2023-09-30T22:57:46.325868+0000","last_undegraded":"2023-09-30T22:57:46.325868+0000","last_fullsized":"2023-09-30T22:57:46.325868+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:58:52.324524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316423+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:04.452346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325950+0000","last_change":"2023-09-30T22:57:46.325950+0000","last_active":"2023-09-30T22:57:46.325950+0000","last_peered":"2023-09-30T22:57:46.325950+0000","last_clean":"2023-09-30T22:57:46.325950+0000","last_became_active":"2023-09-30T22:57:46.325694+0000","last_became_peered":"2023-09-30T22:57:46.325694+0000","last_unstale":"2023-09-30T22:57:46.325950+0000","last_undegraded":"2023-09-30T22:57:46.325950+0000","last_fullsized":"2023-09-30T22:57:46.325950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:45.916234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317667+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.320132+0000","last_change":"2023-09-30T22:57:46.320132+0000","last_active":"2023-09-30T22:57:46.320132+0000","last_peered":"2023-09-30T22:57:46.320132+0000","last_clean":"2023-09-30T22:57:46.320132+0000","last_became_active":"2023-09-30T22:57:46.319599+0000","last_became_peered":"2023-09-30T22:57:46.319599+0000","last_unstale":"2023-09-30T22:57:46.320132+0000","last_undegraded":"2023-09-30T22:57:46.320132+0000","last_fullsized":"2023-09-30T22:57:46.320132+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318694+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:58.623724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.323796+0000","last_change":"2023-09-30T22:57:46.323796+0000","last_active":"2023-09-30T22:57:46.323796+0000","last_peered":"2023-09-30T22:57:46.323796+0000","last_clean":"2023-09-30T22:57:46.323796+0000","last_became_active":"2023-09-30T22:57:46.323523+0000","last_became_peered":"2023-09-30T22:57:46.323523+0000","last_unstale":"2023-09-30T22:57:46.323796+0000","last_undegraded":"2023-09-30T22:57:46.323796+0000","last_fullsized":"2023-09-30T22:57:46.323796+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:18:59.796566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322860+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.329838+0000","last_change":"2023-09-30T22:57:46.329838+0000","last_active":"2023-09-30T22:57:46.329838+0000","last_peered":"2023-09-30T22:57:46.329838+0000","last_clean":"2023-09-30T22:57:46.329838+0000","last_became_active":"2023-09-30T22:57:46.329311+0000","last_became_peered":"2023-09-30T22:57:46.329311+0000","last_unstale":"2023-09-30T22:57:46.329838+0000","last_undegraded":"2023-09-30T22:57:46.329838+0000","last_fullsized":"2023-09-30T22:57:46.329838+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:46:59.626736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318302+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:43.719188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326797+0000","last_change":"2023-09-30T22:57:46.326797+0000","last_active":"2023-09-30T22:57:46.326797+0000","last_peered":"2023-09-30T22:57:46.326797+0000","last_clean":"2023-09-30T22:57:46.326797+0000","last_became_active":"2023-09-30T22:57:46.326535+0000","last_became_peered":"2023-09-30T22:57:46.326535+0000","last_unstale":"2023-09-30T22:57:46.326797+0000","last_undegraded":"2023-09-30T22:57:46.326797+0000","last_fullsized":"2023-09-30T22:57:46.326797+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:59.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318709+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:48.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.328233+0000","last_change":"2023-09-30T22:57:46.328233+0000","last_active":"2023-09-30T22:57:46.328233+0000","last_peered":"2023-09-30T22:57:46.328233+0000","last_clean":"2023-09-30T22:57:46.328233+0000","last_became_active":"2023-09-30T22:57:46.328011+0000","last_became_peered":"2023-09-30T22:57:46.328011+0000","last_unstale":"2023-09-30T22:57:46.328233+0000","last_undegraded":"2023-09-30T22:57:46.328233+0000","last_fullsized":"2023-09-30T22:57:46.328233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:53.277996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322496+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.328096+0000","last_change":"2023-09-30T22:57:46.328096+0000","last_active":"2023-09-30T22:57:46.328096+0000","last_peered":"2023-09-30T22:57:46.328096+0000","last_clean":"2023-09-30T22:57:46.328096+0000","last_became_active":"2023-09-30T22:57:46.327733+0000","last_became_peered":"2023-09-30T22:57:46.327733+0000","last_unstale":"2023-09-30T22:57:46.328096+0000","last_undegraded":"2023-09-30T22:57:46.328096+0000","last_fullsized":"2023-09-30T22:57:46.328096+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:10.249931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319775+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:24:43.719188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326967+0000","last_change":"2023-09-30T22:57:46.326967+0000","last_active":"2023-09-30T22:57:46.326967+0000","last_peered":"2023-09-30T22:57:46.326967+0000","last_clean":"2023-09-30T22:57:46.326967+0000","last_became_active":"2023-09-30T22:57:46.326481+0000","last_became_peered":"2023-09-30T22:57:46.326481+0000","last_unstale":"2023-09-30T22:57:46.326967+0000","last_undegraded":"2023-09-30T22:57:46.326967+0000","last_fullsized":"2023-09-30T22:57:46.326967+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:50.205703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322618+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330755+0000","last_change":"2023-09-30T22:57:46.330755+0000","last_active":"2023-09-30T22:57:46.330755+0000","last_peered":"2023-09-30T22:57:46.330755+0000","last_clean":"2023-09-30T22:57:46.330755+0000","last_became_active":"2023-09-30T22:57:46.330373+0000","last_became_peered":"2023-09-30T22:57:46.330373+0000","last_unstale":"2023-09-30T22:57:46.330755+0000","last_undegraded":"2023-09-30T22:57:46.330755+0000","last_fullsized":"2023-09-30T22:57:46.330755+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:53.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317922+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:47:27.062944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327220+0000","last_change":"2023-09-30T22:57:46.327220+0000","last_active":"2023-09-30T22:57:46.327220+0000","last_peered":"2023-09-30T22:57:46.327220+0000","last_clean":"2023-09-30T22:57:46.327220+0000","last_became_active":"2023-09-30T22:57:46.326718+0000","last_became_peered":"2023-09-30T22:57:46.326718+0000","last_unstale":"2023-09-30T22:57:46.327220+0000","last_undegraded":"2023-09-30T22:57:46.327220+0000","last_fullsized":"2023-09-30T22:57:46.327220+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:28.267376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323099+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326928+0000","last_change":"2023-09-30T22:57:46.326928+0000","last_active":"2023-09-30T22:57:46.326928+0000","last_peered":"2023-09-30T22:57:46.326928+0000","last_clean":"2023-09-30T22:57:46.326928+0000","last_became_active":"2023-09-30T22:57:46.326433+0000","last_became_peered":"2023-09-30T22:57:46.326433+0000","last_unstale":"2023-09-30T22:57:46.326928+0000","last_undegraded":"2023-09-30T22:57:46.326928+0000","last_fullsized":"2023-09-30T22:57:46.326928+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:57.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316041+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:01.155489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327580+0000","last_change":"2023-09-30T22:57:46.327580+0000","last_active":"2023-09-30T22:57:46.327580+0000","last_peered":"2023-09-30T22:57:46.327580+0000","last_clean":"2023-09-30T22:57:46.327580+0000","last_became_active":"2023-09-30T22:57:46.327347+0000","last_became_peered":"2023-09-30T22:57:46.327347+0000","last_unstale":"2023-09-30T22:57:46.327580+0000","last_undegraded":"2023-09-30T22:57:46.327580+0000","last_fullsized":"2023-09-30T22:57:46.327580+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:22.893668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.314874+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:01.155489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.324881+0000","last_change":"2023-09-30T22:57:46.324881+0000","last_active":"2023-09-30T22:57:46.324881+0000","last_peered":"2023-09-30T22:57:46.324881+0000","last_clean":"2023-09-30T22:57:46.324881+0000","last_became_active":"2023-09-30T22:57:46.324629+0000","last_became_peered":"2023-09-30T22:57:46.324629+0000","last_unstale":"2023-09-30T22:57:46.324881+0000","last_undegraded":"2023-09-30T22:57:46.324881+0000","last_fullsized":"2023-09-30T22:57:46.324881+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:51.004328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316016+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:52:39.752774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330434+0000","last_change":"2023-09-30T22:57:46.330434+0000","last_active":"2023-09-30T22:57:46.330434+0000","last_peered":"2023-09-30T22:57:46.330434+0000","last_clean":"2023-09-30T22:57:46.330434+0000","last_became_active":"2023-09-30T22:57:46.330220+0000","last_became_peered":"2023-09-30T22:57:46.330220+0000","last_unstale":"2023-09-30T22:57:46.330434+0000","last_undegraded":"2023-09-30T22:57:46.330434+0000","last_fullsized":"2023-09-30T22:57:46.330434+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:36.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315957+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:58.224759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326357+0000","last_change":"2023-09-30T22:57:46.326357+0000","last_active":"2023-09-30T22:57:46.326357+0000","last_peered":"2023-09-30T22:57:46.326357+0000","last_clean":"2023-09-30T22:57:46.326357+0000","last_became_active":"2023-09-30T22:57:46.326124+0000","last_became_peered":"2023-09-30T22:57:46.326124+0000","last_unstale":"2023-09-30T22:57:46.326357+0000","last_undegraded":"2023-09-30T22:57:46.326357+0000","last_fullsized":"2023-09-30T22:57:46.326357+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317581+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:34.904326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.321470+0000","last_change":"2023-09-30T22:57:46.321470+0000","last_active":"2023-09-30T22:57:46.321470+0000","last_peered":"2023-09-30T22:57:46.321470+0000","last_clean":"2023-09-30T22:57:46.321470+0000","last_became_active":"2023-09-30T22:57:46.321233+0000","last_became_peered":"2023-09-30T22:57:46.321233+0000","last_unstale":"2023-09-30T22:57:46.321470+0000","last_undegraded":"2023-09-30T22:57:46.321470+0000","last_fullsized":"2023-09-30T22:57:46.321470+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:58.334725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318166+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.323408+0000","last_change":"2023-09-30T22:57:46.323408+0000","last_active":"2023-09-30T22:57:46.323408+0000","last_peered":"2023-09-30T22:57:46.323408+0000","last_clean":"2023-09-30T22:57:46.323408+0000","last_became_active":"2023-09-30T22:57:46.322636+0000","last_became_peered":"2023-09-30T22:57:46.322636+0000","last_unstale":"2023-09-30T22:57:46.323408+0000","last_undegraded":"2023-09-30T22:57:46.323408+0000","last_fullsized":"2023-09-30T22:57:46.323408+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:00.151513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.318859+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:46.920211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327259+0000","last_change":"2023-09-30T22:57:46.327259+0000","last_active":"2023-09-30T22:57:46.327259+0000","last_peered":"2023-09-30T22:57:46.327259+0000","last_clean":"2023-09-30T22:57:46.327259+0000","last_became_active":"2023-09-30T22:57:46.326989+0000","last_became_peered":"2023-09-30T22:57:46.326989+0000","last_unstale":"2023-09-30T22:57:46.327259+0000","last_undegraded":"2023-09-30T22:57:46.327259+0000","last_fullsized":"2023-09-30T22:57:46.327259+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.314895+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:58.224759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327694+0000","last_change":"2023-09-30T22:57:46.327694+0000","last_active":"2023-09-30T22:57:46.327694+0000","last_peered":"2023-09-30T22:57:46.327694+0000","last_clean":"2023-09-30T22:57:46.327694+0000","last_became_active":"2023-09-30T22:57:46.327163+0000","last_became_peered":"2023-09-30T22:57:46.327163+0000","last_unstale":"2023-09-30T22:57:46.327694+0000","last_undegraded":"2023-09-30T22:57:46.327694+0000","last_fullsized":"2023-09-30T22:57:46.327694+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:56.303593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319036+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:39:34.904326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.326830+0000","last_change":"2023-09-30T22:57:46.326830+0000","last_active":"2023-09-30T22:57:46.326830+0000","last_peered":"2023-09-30T22:57:46.326830+0000","last_clean":"2023-09-30T22:57:46.326830+0000","last_became_active":"2023-09-30T22:57:46.326524+0000","last_became_peered":"2023-09-30T22:57:46.326524+0000","last_unstale":"2023-09-30T22:57:46.326830+0000","last_undegraded":"2023-09-30T22:57:46.326830+0000","last_fullsized":"2023-09-30T22:57:46.326830+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:14.959667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.319396+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:03:53.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.327951+0000","last_change":"2023-09-30T22:57:46.327951+0000","last_active":"2023-09-30T22:57:46.327951+0000","last_peered":"2023-09-30T22:57:46.327951+0000","last_clean":"2023-09-30T22:57:46.327951+0000","last_became_active":"2023-09-30T22:57:46.327380+0000","last_became_peered":"2023-09-30T22:57:46.327380+0000","last_unstale":"2023-09-30T22:57:46.327951+0000","last_undegraded":"2023-09-30T22:57:46.327951+0000","last_fullsized":"2023-09-30T22:57:46.327951+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:55.273827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.318299+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:57:45.318299+0000","last_peered":"2023-09-30T22:57:45.318299+0000","last_clean":"2023-09-30T22:57:45.318299+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:57:45.318299+0000","last_undegraded":"2023-09-30T22:57:45.318299+0000","last_fullsized":"2023-09-30T22:57:45.318299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.323797+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:59.338702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.329817+0000","last_change":"2023-09-30T22:57:46.329817+0000","last_active":"2023-09-30T22:57:46.329817+0000","last_peered":"2023-09-30T22:57:46.329817+0000","last_clean":"2023-09-30T22:57:46.329817+0000","last_became_active":"2023-09-30T22:57:46.329534+0000","last_became_peered":"2023-09-30T22:57:46.329534+0000","last_unstale":"2023-09-30T22:57:46.329817+0000","last_undegraded":"2023-09-30T22:57:46.329817+0000","last_fullsized":"2023-09-30T22:57:46.329817+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:11:14.497043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.314983+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:57:45.314983+0000","last_peered":"2023-09-30T22:57:45.314983+0000","last_clean":"2023-09-30T22:57:45.314983+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:57:45.314983+0000","last_undegraded":"2023-09-30T22:57:45.314983+0000","last_fullsized":"2023-09-30T22:57:45.314983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.317182+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:25:16.153993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.330494+0000","last_change":"2023-09-30T22:57:46.330494+0000","last_active":"2023-09-30T22:57:46.330494+0000","last_peered":"2023-09-30T22:57:46.330494+0000","last_clean":"2023-09-30T22:57:46.330494+0000","last_became_active":"2023-09-30T22:57:46.330277+0000","last_became_peered":"2023-09-30T22:57:46.330277+0000","last_unstale":"2023-09-30T22:57:46.330494+0000","last_undegraded":"2023-09-30T22:57:46.330494+0000","last_fullsized":"2023-09-30T22:57:46.330494+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:57:31.215330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313891+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:57:45.313891+0000","last_peered":"2023-09-30T22:57:45.313891+0000","last_clean":"2023-09-30T22:57:45.313891+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:57:45.313891+0000","last_undegraded":"2023-09-30T22:57:45.313891+0000","last_fullsized":"2023-09-30T22:57:45.313891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.316689+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.322115+0000","last_change":"2023-09-30T22:57:46.322115+0000","last_active":"2023-09-30T22:57:46.322115+0000","last_peered":"2023-09-30T22:57:46.322115+0000","last_clean":"2023-09-30T22:57:46.322115+0000","last_became_active":"2023-09-30T22:57:46.321808+0000","last_became_peered":"2023-09-30T22:57:46.321808+0000","last_unstale":"2023-09-30T22:57:46.322115+0000","last_undegraded":"2023-09-30T22:57:46.322115+0000","last_fullsized":"2023-09-30T22:57:46.322115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:03.448369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313668+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:57:45.313668+0000","last_peered":"2023-09-30T22:57:45.313668+0000","last_clean":"2023-09-30T22:57:45.313668+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:57:45.313668+0000","last_undegraded":"2023-09-30T22:57:45.313668+0000","last_fullsized":"2023-09-30T22:57:45.313668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":243,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313368+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:57:45.313368+0000","last_peered":"2023-09-30T22:57:45.313368+0000","last_clean":"2023-09-30T22:57:45.313368+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:57:45.313368+0000","last_undegraded":"2023-09-30T22:57:45.313368+0000","last_fullsized":"2023-09-30T22:57:45.313368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315938+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:48.429614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.322978+0000","last_change":"2023-09-30T22:57:46.322978+0000","last_active":"2023-09-30T22:57:46.322978+0000","last_peered":"2023-09-30T22:57:46.322978+0000","last_clean":"2023-09-30T22:57:46.322978+0000","last_became_active":"2023-09-30T22:57:46.322754+0000","last_became_peered":"2023-09-30T22:57:46.322754+0000","last_unstale":"2023-09-30T22:57:46.322978+0000","last_undegraded":"2023-09-30T22:57:46.322978+0000","last_fullsized":"2023-09-30T22:57:46.322978+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313984+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:57:45.313984+0000","last_peered":"2023-09-30T22:57:45.313984+0000","last_clean":"2023-09-30T22:57:45.313984+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:57:45.313984+0000","last_undegraded":"2023-09-30T22:57:45.313984+0000","last_fullsized":"2023-09-30T22:57:45.313984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.320714+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:23.897645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325177+0000","last_change":"2023-09-30T22:57:46.325177+0000","last_active":"2023-09-30T22:57:46.325177+0000","last_peered":"2023-09-30T22:57:46.325177+0000","last_clean":"2023-09-30T22:57:46.325177+0000","last_became_active":"2023-09-30T22:57:46.324955+0000","last_became_peered":"2023-09-30T22:57:46.324955+0000","last_unstale":"2023-09-30T22:57:46.325177+0000","last_undegraded":"2023-09-30T22:57:46.325177+0000","last_fullsized":"2023-09-30T22:57:46.325177+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313900+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:57:45.313900+0000","last_peered":"2023-09-30T22:57:45.313900+0000","last_clean":"2023-09-30T22:57:45.313900+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:57:45.313900+0000","last_undegraded":"2023-09-30T22:57:45.313900+0000","last_fullsized":"2023-09-30T22:57:45.313900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.315197+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:04.452346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.325292+0000","last_change":"2023-09-30T22:57:46.325292+0000","last_active":"2023-09-30T22:57:46.325292+0000","last_peered":"2023-09-30T22:57:46.325292+0000","last_clean":"2023-09-30T22:57:46.325292+0000","last_became_active":"2023-09-30T22:57:46.325062+0000","last_became_peered":"2023-09-30T22:57:46.325062+0000","last_unstale":"2023-09-30T22:57:46.325292+0000","last_undegraded":"2023-09-30T22:57:46.325292+0000","last_fullsized":"2023-09-30T22:57:46.325292+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:41.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.313228+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:57:45.313228+0000","last_peered":"2023-09-30T22:57:45.313228+0000","last_clean":"2023-09-30T22:57:45.313228+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:57:45.313228+0000","last_undegraded":"2023-09-30T22:57:45.313228+0000","last_fullsized":"2023-09-30T22:57:45.313228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:57:46.309574+0000","last_change":"2023-09-30T22:57:46.322234+0000","last_active":"2023-09-30T22:57:46.309574+0000","last_peered":"2023-09-30T22:57:46.309574+0000","last_clean":"2023-09-30T22:57:46.309574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:57:46.309574+0000","last_undegraded":"2023-09-30T22:57:46.309574+0000","last_fullsized":"2023-09-30T22:57:46.309574+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-09-30T22:57:46.324050+0000","last_change":"2023-09-30T22:57:46.324050+0000","last_active":"2023-09-30T22:57:46.324050+0000","last_peered":"2023-09-30T22:57:46.324050+0000","last_clean":"2023-09-30T22:57:46.324050+0000","last_became_active":"2023-09-30T22:57:46.323824+0000","last_became_peered":"2023-09-30T22:57:46.323824+0000","last_unstale":"2023-09-30T22:57:46.324050+0000","last_undegraded":"2023-09-30T22:57:46.324050+0000","last_fullsized":"2023-09-30T22:57:46.324050+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-09-30T22:57:45.314903+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:57:45.314903+0000","last_peered":"2023-09-30T22:57:45.314903+0000","last_clean":"2023-09-30T22:57:45.314903+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:57:45.314903+0000","last_undegraded":"2023-09-30T22:57:45.314903+0000","last_fullsized":"2023-09-30T22:57:45.314903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66700000000000004,"15min":0.63500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.65000000000000002},"min":{"1min":0.53800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.874,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.442},{"interface":"front","average":{"1min":0.745,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.67800000000000005},"min":{"1min":0.53700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.52400000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.502,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.056,"15min":1.056},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.871,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.135,"15min":1.135},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.071,"15min":1.071},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78000000000000003,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.97699999999999998,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.80200000000000005},"min":{"1min":0.51700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0800000000000001,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.46200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.83999999999999997,"15min":1.022},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":1.0289999999999999},"min":{"1min":0.48099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0429999999999999,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.95599999999999996},"min":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0089999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.107,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1259999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.65700000000000003},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.321,"15min":1.321},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80300000000000005,"15min":0.75900000000000001},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.198,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.61399999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194120,"statfs":{"total":200000000,"available":198779700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45700000000000002,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.441},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.47099999999999997},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.52000000000000002},"min":{"1min":0.44400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.47299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.72599999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60599999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.71199999999999997},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.22},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76300000000000001,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.622}]},{"osd":6,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.72399999999999998},"min":{"1min":0.56999999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.032,"5min":1.127,"15min":1.127},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0660000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80300000000000005,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.51400000000000001},"min":{"1min":0.34399999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.879},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.438},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.27,"15min":1.27},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.48599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0600000000000001,"5min":1.171,"15min":1.171},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.57599999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.119,"15min":1.119},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76600000000000001,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.173,"15min":1.173},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.095,"5min":1.21,"15min":1.21},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79200000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.53600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.38,"15min":0.38},"max":{"1min":1.04,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.151,"5min":1.179,"15min":1.179},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.236,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.615,"15min":1.615},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.59199999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.57299999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.117,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47899999999999998,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59899999999999998,"5min":1.919,"15min":1.919},"last":0.26000000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68300000000000005,"5min":1.254,"15min":1.254},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.747,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.372}]},{"osd":4,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.747,"15min":0.72799999999999998},"min":{"1min":0.52900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.242,"5min":1.401,"15min":1.401},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.76400000000000001},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.21,"5min":3.306,"15min":3.306},"last":0.443}]},{"osd":5,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98199999999999998,"5min":1.508,"15min":1.508},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.745},"min":{"1min":0.57099999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.151,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0700000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.61799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1160000000000001,"5min":1.573,"15min":1.573},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93100000000000005,"5min":1.022,"15min":1.022},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64300000000000002,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64600000000000002,"15min":0.623},"min":{"1min":0.48199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60099999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.66400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95199999999999996,"5min":1.006,"15min":1.006},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72199999999999998,"15min":0.67900000000000005},"min":{"1min":0.53400000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91100000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72499999999999998,"15min":0.69099999999999995},"min":{"1min":0.52500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90100000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":1,"5min":1,"15min":1},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.623}]},{"osd":7,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93500000000000005,"5min":1.016,"15min":1.016},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.026,"5min":1.044,"15min":1.044},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194120,"statfs":{"total":200000000,"available":198779700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.42199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.623},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65100000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84299999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.044,"15min":1.044},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69499999999999995,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90700000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.37,"15min":0.37},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.74299999999999999}]}]}],"pool_statfs":[]}} 2023-09-30T22:57:52.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:57:52.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.372+0000 7f16337ff700 1 Processor -- start 2023-09-30T22:57:52.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.373+0000 7f16337ff700 1 -- start start 2023-09-30T22:57:52.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.374+0000 7f16337ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.374+0000 7f16337ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c06d3e0 con 0x7f162c06e820 2023-09-30T22:57:52.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.374+0000 7f16337ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c06dc80 con 0x7f162c0b00d0 2023-09-30T22:57:52.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.374+0000 7f16337ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c06b790 con 0x7f162c0af020 2023-09-30T22:57:52.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.374+0000 7f1631d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f162c06e820 0x7f162c15a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51124/0 (socket says 172.21.15.142:51124) 2023-09-30T22:57:52.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.374+0000 7f1631d9c700 1 -- 172.21.15.142:0/1219460249 learned_addr learned my addr 172.21.15.142:0/1219460249 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:52.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.374+0000 7f163159b700 1 --2- 172.21.15.142:0/1219460249 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275538847 0 0) 0x7f162c06d3e0 con 0x7f162c06e820 2023-09-30T22:57:52.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1618003570 con 0x7f162c06e820 2023-09-30T22:57:52.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919952291 0 0) 0x7f162c06dc80 con 0x7f162c0b00d0 2023-09-30T22:57:52.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f162c06d3e0 con 0x7f162c0b00d0 2023-09-30T22:57:52.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 81013905 0 0) 0x7f1618003570 con 0x7f162c06e820 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f163159b700 1 -- 172.21.15.142:0/1219460249 >> v1:172.21.15.148:6789/0 conn(0x7f162c0b00d0 legacy=0x7f162c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f163159b700 1 -- 172.21.15.142:0/1219460249 >> v1:172.21.15.142:6789/0 conn(0x7f162c06e820 legacy=0x7f162c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f163159b700 1 -- 172.21.15.142:0/1219460249 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0b0650 con 0x7f162c0af020 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f163159b700 1 --2- 172.21.15.142:0/1219460249 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c156d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1628009910 tx=0x7f16280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b135436b7aeda53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16240017f0 con 0x7f162c0af020 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.375+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1628011420 con 0x7f162c0af020 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f1623fff700 1 -- 172.21.15.142:0/1219460249 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280117c0 con 0x7f162c0af020 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f16337ff700 1 -- 172.21.15.142:0/1219460249 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 msgr2=0x7f162c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f16337ff700 1 --2- 172.21.15.142:0/1219460249 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c156d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1628009910 tx=0x7f16280091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f16337ff700 1 -- 172.21.15.142:0/1219460249 shutdown_connections 2023-09-30T22:57:52.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f16337ff700 1 --2- 172.21.15.142:0/1219460249 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c156d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f16337ff700 1 -- 172.21.15.142:0/1219460249 >> 172.21.15.142:0/1219460249 conn(0x7f162c0680c0 msgr2=0x7f162c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:52.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f16337ff700 1 -- 172.21.15.142:0/1219460249 shutdown_connections 2023-09-30T22:57:52.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.376+0000 7f16337ff700 1 -- 172.21.15.142:0/1219460249 wait complete. 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.378+0000 7f16337ff700 1 Processor -- start 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.378+0000 7f16337ff700 1 -- start start 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f16337ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f162c06e820 0x7f162c144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f16337ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c16b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f16337ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f162c0b00d0 0x7f162c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f16337ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c16b840 con 0x7f162c06e820 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f16337ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c159a50 con 0x7f162c0b00d0 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f16337ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c158b60 con 0x7f162c0af020 2023-09-30T22:57:52.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f162c06e820 0x7f162c144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f162c06e820 0x7f162c144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46126/0 (socket says 172.21.15.142:46126) 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 -- 172.21.15.142:0/2325433764 learned_addr learned my addr 172.21.15.142:0/2325433764 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f1630d9a700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c16b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f1631d9c700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f162c0b00d0 0x7f162c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 -- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 msgr2=0x7f162c16b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c16b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 -- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f162c0b00d0 msgr2=0x7f162c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f162c0b00d0 0x7f162c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.379+0000 7f163159b700 1 -- 172.21.15.142:0/2325433764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628009420 con 0x7f162c06e820 2023-09-30T22:57:52.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.380+0000 7f163159b700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f162c06e820 0x7f162c144300 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1628009860 tx=0x7f1628016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:52.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.380+0000 7f16217fa700 1 -- 172.21.15.142:0/2325433764 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162801cc90 con 0x7f162c06e820 2023-09-30T22:57:52.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.380+0000 7f16217fa700 1 -- 172.21.15.142:0/2325433764 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162801cdf0 con 0x7f162c06e820 2023-09-30T22:57:52.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.380+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c158e40 con 0x7f162c06e820 2023-09-30T22:57:52.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.380+0000 7f16217fa700 1 -- 172.21.15.142:0/2325433764 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162801a6a0 con 0x7f162c06e820 2023-09-30T22:57:52.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.380+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c159400 con 0x7f162c06e820 2023-09-30T22:57:52.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.381+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c0695b0 con 0x7f162c06e820 2023-09-30T22:57:52.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.382+0000 7f16217fa700 1 -- 172.21.15.142:0/2325433764 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f162801aad0 con 0x7f162c06e820 2023-09-30T22:57:52.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.383+0000 7f16217fa700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1610067330 0x7f16100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.383+0000 7f16217fa700 1 -- 172.21.15.142:0/2325433764 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1628086b40 con 0x7f162c06e820 2023-09-30T22:57:52.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.383+0000 7f1630d9a700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1610067330 0x7f16100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.383+0000 7f1630d9a700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1610067330 0x7f16100697e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f162c15b040 tx=0x7f161c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:52.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.387+0000 7f16217fa700 1 -- 172.21.15.142:0/2325433764 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f16280539a0 con 0x7f162c06e820 2023-09-30T22:57:52.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.575+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f162c0ae8f0 con 0x7f1610067330 2023-09-30T22:57:52.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.584+0000 7f16217fa700 1 -- 172.21.15.142:0/2325433764 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303175 (secure 0 0 0) 0x7f162c0ae8f0 con 0x7f1610067330 2023-09-30T22:57:52.588 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:52.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1610067330 msgr2=0x7f16100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1610067330 0x7f16100697e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f162c15b040 tx=0x7f161c009040 comp rx=0 tx=0).stop 2023-09-30T22:57:52.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f162c06e820 msgr2=0x7f162c144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f162c06e820 0x7f162c144300 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1628009860 tx=0x7f1628016000 comp rx=0 tx=0).stop 2023-09-30T22:57:52.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 shutdown_connections 2023-09-30T22:57:52.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1610067330 0x7f16100697e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f162c0b00d0 0x7f162c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f162c06e820 0x7f162c144300 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 --2- 172.21.15.142:0/2325433764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f162c0af020 0x7f162c16b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.588+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 >> 172.21.15.142:0/2325433764 conn(0x7f162c0680c0 msgr2=0x7f162c1552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:52.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.589+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 shutdown_connections 2023-09-30T22:57:52.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.589+0000 7f16337ff700 1 -- 172.21.15.142:0/2325433764 wait complete. 2023-09-30T22:57:52.592 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:57:52.607 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2023-09-30T22:57:52.175750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6186,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556313,"statfs":{"total":1600000000,"available":1593665140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001323"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359075+0000","last_change":"2023-09-30T22:57:47.358770+0000","last_active":"2023-09-30T22:57:47.359075+0000","last_peered":"2023-09-30T22:57:47.359075+0000","last_clean":"2023-09-30T22:57:47.359075+0000","last_became_active":"2023-09-30T22:57:47.358552+0000","last_became_peered":"2023-09-30T22:57:47.358552+0000","last_unstale":"2023-09-30T22:57:47.359075+0000","last_undegraded":"2023-09-30T22:57:47.359075+0000","last_fullsized":"2023-09-30T22:57:47.359075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:57.316255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347445+0000","last_change":"2023-09-30T22:57:47.347285+0000","last_active":"2023-09-30T22:57:47.347445+0000","last_peered":"2023-09-30T22:57:47.347445+0000","last_clean":"2023-09-30T22:57:47.347445+0000","last_became_active":"2023-09-30T22:57:47.347012+0000","last_became_peered":"2023-09-30T22:57:47.347012+0000","last_unstale":"2023-09-30T22:57:47.347445+0000","last_undegraded":"2023-09-30T22:57:47.347445+0000","last_fullsized":"2023-09-30T22:57:47.347445+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:37.162388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357441+0000","last_change":"2023-09-30T22:57:47.357352+0000","last_active":"2023-09-30T22:57:47.357441+0000","last_peered":"2023-09-30T22:57:47.357441+0000","last_clean":"2023-09-30T22:57:47.357441+0000","last_became_active":"2023-09-30T22:57:47.357097+0000","last_became_peered":"2023-09-30T22:57:47.357097+0000","last_unstale":"2023-09-30T22:57:47.357441+0000","last_undegraded":"2023-09-30T22:57:47.357441+0000","last_fullsized":"2023-09-30T22:57:47.357441+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:57.307570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345889+0000","last_change":"2023-09-30T22:57:47.345202+0000","last_active":"2023-09-30T22:57:47.345889+0000","last_peered":"2023-09-30T22:57:47.345889+0000","last_clean":"2023-09-30T22:57:47.345889+0000","last_became_active":"2023-09-30T22:57:47.344674+0000","last_became_peered":"2023-09-30T22:57:47.344674+0000","last_unstale":"2023-09-30T22:57:47.345889+0000","last_undegraded":"2023-09-30T22:57:47.345889+0000","last_fullsized":"2023-09-30T22:57:47.345889+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:29.271352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355245+0000","last_change":"2023-09-30T22:57:47.354137+0000","last_active":"2023-09-30T22:57:47.355245+0000","last_peered":"2023-09-30T22:57:47.355245+0000","last_clean":"2023-09-30T22:57:47.355245+0000","last_became_active":"2023-09-30T22:57:47.352452+0000","last_became_peered":"2023-09-30T22:57:47.352452+0000","last_unstale":"2023-09-30T22:57:47.355245+0000","last_undegraded":"2023-09-30T22:57:47.355245+0000","last_fullsized":"2023-09-30T22:57:47.355245+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:24.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351148+0000","last_change":"2023-09-30T22:57:47.351077+0000","last_active":"2023-09-30T22:57:47.351148+0000","last_peered":"2023-09-30T22:57:47.351148+0000","last_clean":"2023-09-30T22:57:47.351148+0000","last_became_active":"2023-09-30T22:57:47.350336+0000","last_became_peered":"2023-09-30T22:57:47.350336+0000","last_unstale":"2023-09-30T22:57:47.351148+0000","last_undegraded":"2023-09-30T22:57:47.351148+0000","last_fullsized":"2023-09-30T22:57:47.351148+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:25:16.153993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344376+0000","last_change":"2023-09-30T22:57:47.344329+0000","last_active":"2023-09-30T22:57:47.344376+0000","last_peered":"2023-09-30T22:57:47.344376+0000","last_clean":"2023-09-30T22:57:47.344376+0000","last_became_active":"2023-09-30T22:57:47.344106+0000","last_became_peered":"2023-09-30T22:57:47.344106+0000","last_unstale":"2023-09-30T22:57:47.344376+0000","last_undegraded":"2023-09-30T22:57:47.344376+0000","last_fullsized":"2023-09-30T22:57:47.344376+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:03.436048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349767+0000","last_change":"2023-09-30T22:57:47.349592+0000","last_active":"2023-09-30T22:57:47.349767+0000","last_peered":"2023-09-30T22:57:47.349767+0000","last_clean":"2023-09-30T22:57:47.349767+0000","last_became_active":"2023-09-30T22:57:47.349100+0000","last_became_peered":"2023-09-30T22:57:47.349100+0000","last_unstale":"2023-09-30T22:57:47.349767+0000","last_undegraded":"2023-09-30T22:57:47.349767+0000","last_fullsized":"2023-09-30T22:57:47.349767+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346945+0000","last_change":"2023-09-30T22:57:47.346890+0000","last_active":"2023-09-30T22:57:47.346945+0000","last_peered":"2023-09-30T22:57:47.346945+0000","last_clean":"2023-09-30T22:57:47.346945+0000","last_became_active":"2023-09-30T22:57:47.346670+0000","last_became_peered":"2023-09-30T22:57:47.346670+0000","last_unstale":"2023-09-30T22:57:47.346945+0000","last_undegraded":"2023-09-30T22:57:47.346945+0000","last_fullsized":"2023-09-30T22:57:47.346945+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:27:08.010448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346572+0000","last_change":"2023-09-30T22:57:47.346469+0000","last_active":"2023-09-30T22:57:47.346572+0000","last_peered":"2023-09-30T22:57:47.346572+0000","last_clean":"2023-09-30T22:57:47.346572+0000","last_became_active":"2023-09-30T22:57:47.346055+0000","last_became_peered":"2023-09-30T22:57:47.346055+0000","last_unstale":"2023-09-30T22:57:47.346572+0000","last_undegraded":"2023-09-30T22:57:47.346572+0000","last_fullsized":"2023-09-30T22:57:47.346572+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344921+0000","last_change":"2023-09-30T22:57:47.344771+0000","last_active":"2023-09-30T22:57:47.344921+0000","last_peered":"2023-09-30T22:57:47.344921+0000","last_clean":"2023-09-30T22:57:47.344921+0000","last_became_active":"2023-09-30T22:57:47.344548+0000","last_became_peered":"2023-09-30T22:57:47.344548+0000","last_unstale":"2023-09-30T22:57:47.344921+0000","last_undegraded":"2023-09-30T22:57:47.344921+0000","last_fullsized":"2023-09-30T22:57:47.344921+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:53.689308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347591+0000","last_change":"2023-09-30T22:57:47.347422+0000","last_active":"2023-09-30T22:57:47.347591+0000","last_peered":"2023-09-30T22:57:47.347591+0000","last_clean":"2023-09-30T22:57:47.347591+0000","last_became_active":"2023-09-30T22:57:47.347186+0000","last_became_peered":"2023-09-30T22:57:47.347186+0000","last_unstale":"2023-09-30T22:57:47.347591+0000","last_undegraded":"2023-09-30T22:57:47.347591+0000","last_fullsized":"2023-09-30T22:57:47.347591+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359459+0000","last_change":"2023-09-30T22:57:47.357297+0000","last_active":"2023-09-30T22:57:47.359459+0000","last_peered":"2023-09-30T22:57:47.359459+0000","last_clean":"2023-09-30T22:57:47.359459+0000","last_became_active":"2023-09-30T22:57:47.357069+0000","last_became_peered":"2023-09-30T22:57:47.357069+0000","last_unstale":"2023-09-30T22:57:47.359459+0000","last_undegraded":"2023-09-30T22:57:47.359459+0000","last_fullsized":"2023-09-30T22:57:47.359459+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.350974+0000","last_change":"2023-09-30T22:57:47.350409+0000","last_active":"2023-09-30T22:57:47.350974+0000","last_peered":"2023-09-30T22:57:47.350974+0000","last_clean":"2023-09-30T22:57:47.350974+0000","last_became_active":"2023-09-30T22:57:47.350186+0000","last_became_peered":"2023-09-30T22:57:47.350186+0000","last_unstale":"2023-09-30T22:57:47.350974+0000","last_undegraded":"2023-09-30T22:57:47.350974+0000","last_fullsized":"2023-09-30T22:57:47.350974+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:54.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346457+0000","last_change":"2023-09-30T22:57:47.346320+0000","last_active":"2023-09-30T22:57:47.346457+0000","last_peered":"2023-09-30T22:57:47.346457+0000","last_clean":"2023-09-30T22:57:47.346457+0000","last_became_active":"2023-09-30T22:57:47.345715+0000","last_became_peered":"2023-09-30T22:57:47.345715+0000","last_unstale":"2023-09-30T22:57:47.346457+0000","last_undegraded":"2023-09-30T22:57:47.346457+0000","last_fullsized":"2023-09-30T22:57:47.346457+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351118+0000","last_change":"2023-09-30T22:57:47.350778+0000","last_active":"2023-09-30T22:57:47.351118+0000","last_peered":"2023-09-30T22:57:47.351118+0000","last_clean":"2023-09-30T22:57:47.351118+0000","last_became_active":"2023-09-30T22:57:47.349662+0000","last_became_peered":"2023-09-30T22:57:47.349662+0000","last_unstale":"2023-09-30T22:57:47.351118+0000","last_undegraded":"2023-09-30T22:57:47.351118+0000","last_fullsized":"2023-09-30T22:57:47.351118+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:34.970083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357498+0000","last_change":"2023-09-30T22:57:47.356479+0000","last_active":"2023-09-30T22:57:47.357498+0000","last_peered":"2023-09-30T22:57:47.357498+0000","last_clean":"2023-09-30T22:57:47.357498+0000","last_became_active":"2023-09-30T22:57:47.356238+0000","last_became_peered":"2023-09-30T22:57:47.356238+0000","last_unstale":"2023-09-30T22:57:47.357498+0000","last_undegraded":"2023-09-30T22:57:47.357498+0000","last_fullsized":"2023-09-30T22:57:47.357498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:37.162388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348181+0000","last_change":"2023-09-30T22:57:47.348104+0000","last_active":"2023-09-30T22:57:47.348181+0000","last_peered":"2023-09-30T22:57:47.348181+0000","last_clean":"2023-09-30T22:57:47.348181+0000","last_became_active":"2023-09-30T22:57:47.347686+0000","last_became_peered":"2023-09-30T22:57:47.347686+0000","last_unstale":"2023-09-30T22:57:47.348181+0000","last_undegraded":"2023-09-30T22:57:47.348181+0000","last_fullsized":"2023-09-30T22:57:47.348181+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349847+0000","last_change":"2023-09-30T22:57:47.349736+0000","last_active":"2023-09-30T22:57:47.349847+0000","last_peered":"2023-09-30T22:57:47.349847+0000","last_clean":"2023-09-30T22:57:47.349847+0000","last_became_active":"2023-09-30T22:57:47.349333+0000","last_became_peered":"2023-09-30T22:57:47.349333+0000","last_unstale":"2023-09-30T22:57:47.349847+0000","last_undegraded":"2023-09-30T22:57:47.349847+0000","last_fullsized":"2023-09-30T22:57:47.349847+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348597+0000","last_change":"2023-09-30T22:57:47.344043+0000","last_active":"2023-09-30T22:57:47.348597+0000","last_peered":"2023-09-30T22:57:47.348597+0000","last_clean":"2023-09-30T22:57:47.348597+0000","last_became_active":"2023-09-30T22:57:47.343597+0000","last_became_peered":"2023-09-30T22:57:47.343597+0000","last_unstale":"2023-09-30T22:57:47.348597+0000","last_undegraded":"2023-09-30T22:57:47.348597+0000","last_fullsized":"2023-09-30T22:57:47.348597+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:33:14.420556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348092+0000","last_change":"2023-09-30T22:57:47.347969+0000","last_active":"2023-09-30T22:57:47.348092+0000","last_peered":"2023-09-30T22:57:47.348092+0000","last_clean":"2023-09-30T22:57:47.348092+0000","last_became_active":"2023-09-30T22:57:47.347393+0000","last_became_peered":"2023-09-30T22:57:47.347393+0000","last_unstale":"2023-09-30T22:57:47.348092+0000","last_undegraded":"2023-09-30T22:57:47.348092+0000","last_fullsized":"2023-09-30T22:57:47.348092+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352001+0000","last_change":"2023-09-30T22:57:47.351930+0000","last_active":"2023-09-30T22:57:47.352001+0000","last_peered":"2023-09-30T22:57:47.352001+0000","last_clean":"2023-09-30T22:57:47.352001+0000","last_became_active":"2023-09-30T22:57:47.351708+0000","last_became_peered":"2023-09-30T22:57:47.351708+0000","last_unstale":"2023-09-30T22:57:47.352001+0000","last_undegraded":"2023-09-30T22:57:47.352001+0000","last_fullsized":"2023-09-30T22:57:47.352001+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357142+0000","last_change":"2023-09-30T22:57:47.357071+0000","last_active":"2023-09-30T22:57:47.357142+0000","last_peered":"2023-09-30T22:57:47.357142+0000","last_clean":"2023-09-30T22:57:47.357142+0000","last_became_active":"2023-09-30T22:57:47.356848+0000","last_became_peered":"2023-09-30T22:57:47.356848+0000","last_unstale":"2023-09-30T22:57:47.357142+0000","last_undegraded":"2023-09-30T22:57:47.357142+0000","last_fullsized":"2023-09-30T22:57:47.357142+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:59.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347881+0000","last_change":"2023-09-30T22:57:47.347788+0000","last_active":"2023-09-30T22:57:47.347881+0000","last_peered":"2023-09-30T22:57:47.347881+0000","last_clean":"2023-09-30T22:57:47.347881+0000","last_became_active":"2023-09-30T22:57:47.347347+0000","last_became_peered":"2023-09-30T22:57:47.347347+0000","last_unstale":"2023-09-30T22:57:47.347881+0000","last_undegraded":"2023-09-30T22:57:47.347881+0000","last_fullsized":"2023-09-30T22:57:47.347881+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:58.623724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355227+0000","last_change":"2023-09-30T22:57:47.354001+0000","last_active":"2023-09-30T22:57:47.355227+0000","last_peered":"2023-09-30T22:57:47.355227+0000","last_clean":"2023-09-30T22:57:47.355227+0000","last_became_active":"2023-09-30T22:57:47.352197+0000","last_became_peered":"2023-09-30T22:57:47.352197+0000","last_unstale":"2023-09-30T22:57:47.355227+0000","last_undegraded":"2023-09-30T22:57:47.355227+0000","last_fullsized":"2023-09-30T22:57:47.355227+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:48.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348204+0000","last_change":"2023-09-30T22:57:47.348108+0000","last_active":"2023-09-30T22:57:47.348204+0000","last_peered":"2023-09-30T22:57:47.348204+0000","last_clean":"2023-09-30T22:57:47.348204+0000","last_became_active":"2023-09-30T22:57:47.347732+0000","last_became_peered":"2023-09-30T22:57:47.347732+0000","last_unstale":"2023-09-30T22:57:47.348204+0000","last_undegraded":"2023-09-30T22:57:47.348204+0000","last_fullsized":"2023-09-30T22:57:47.348204+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:56.277804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357378+0000","last_change":"2023-09-30T22:57:47.355441+0000","last_active":"2023-09-30T22:57:47.357378+0000","last_peered":"2023-09-30T22:57:47.357378+0000","last_clean":"2023-09-30T22:57:47.357378+0000","last_became_active":"2023-09-30T22:57:47.354914+0000","last_became_peered":"2023-09-30T22:57:47.354914+0000","last_unstale":"2023-09-30T22:57:47.357378+0000","last_undegraded":"2023-09-30T22:57:47.357378+0000","last_fullsized":"2023-09-30T22:57:47.357378+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355077+0000","last_change":"2023-09-30T22:57:47.353946+0000","last_active":"2023-09-30T22:57:47.355077+0000","last_peered":"2023-09-30T22:57:47.355077+0000","last_clean":"2023-09-30T22:57:47.355077+0000","last_became_active":"2023-09-30T22:57:47.353359+0000","last_became_peered":"2023-09-30T22:57:47.353359+0000","last_unstale":"2023-09-30T22:57:47.355077+0000","last_undegraded":"2023-09-30T22:57:47.355077+0000","last_fullsized":"2023-09-30T22:57:47.355077+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346878+0000","last_change":"2023-09-30T22:57:47.346307+0000","last_active":"2023-09-30T22:57:47.346878+0000","last_peered":"2023-09-30T22:57:47.346878+0000","last_clean":"2023-09-30T22:57:47.346878+0000","last_became_active":"2023-09-30T22:57:47.345984+0000","last_became_peered":"2023-09-30T22:57:47.345984+0000","last_unstale":"2023-09-30T22:57:47.346878+0000","last_undegraded":"2023-09-30T22:57:47.346878+0000","last_fullsized":"2023-09-30T22:57:47.346878+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:27.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355259+0000","last_change":"2023-09-30T22:57:47.355183+0000","last_active":"2023-09-30T22:57:47.355259+0000","last_peered":"2023-09-30T22:57:47.355259+0000","last_clean":"2023-09-30T22:57:47.355259+0000","last_became_active":"2023-09-30T22:57:47.353063+0000","last_became_peered":"2023-09-30T22:57:47.353063+0000","last_unstale":"2023-09-30T22:57:47.355259+0000","last_undegraded":"2023-09-30T22:57:47.355259+0000","last_fullsized":"2023-09-30T22:57:47.355259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349807+0000","last_change":"2023-09-30T22:57:47.349384+0000","last_active":"2023-09-30T22:57:47.349807+0000","last_peered":"2023-09-30T22:57:47.349807+0000","last_clean":"2023-09-30T22:57:47.349807+0000","last_became_active":"2023-09-30T22:57:47.349103+0000","last_became_peered":"2023-09-30T22:57:47.349103+0000","last_unstale":"2023-09-30T22:57:47.349807+0000","last_undegraded":"2023-09-30T22:57:47.349807+0000","last_fullsized":"2023-09-30T22:57:47.349807+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351103+0000","last_change":"2023-09-30T22:57:47.350745+0000","last_active":"2023-09-30T22:57:47.351103+0000","last_peered":"2023-09-30T22:57:47.351103+0000","last_clean":"2023-09-30T22:57:47.351103+0000","last_became_active":"2023-09-30T22:57:47.350260+0000","last_became_peered":"2023-09-30T22:57:47.350260+0000","last_unstale":"2023-09-30T22:57:47.351103+0000","last_undegraded":"2023-09-30T22:57:47.351103+0000","last_fullsized":"2023-09-30T22:57:47.351103+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353345+0000","last_change":"2023-09-30T22:57:47.353268+0000","last_active":"2023-09-30T22:57:47.353345+0000","last_peered":"2023-09-30T22:57:47.353345+0000","last_clean":"2023-09-30T22:57:47.353345+0000","last_became_active":"2023-09-30T22:57:47.352762+0000","last_became_peered":"2023-09-30T22:57:47.352762+0000","last_unstale":"2023-09-30T22:57:47.353345+0000","last_undegraded":"2023-09-30T22:57:47.353345+0000","last_fullsized":"2023-09-30T22:57:47.353345+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:00.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356320+0000","last_change":"2023-09-30T22:57:46.327869+0000","last_active":"2023-09-30T22:57:47.356320+0000","last_peered":"2023-09-30T22:57:47.356320+0000","last_clean":"2023-09-30T22:57:47.356320+0000","last_became_active":"2023-09-30T22:57:46.327406+0000","last_became_peered":"2023-09-30T22:57:46.327406+0000","last_unstale":"2023-09-30T22:57:47.356320+0000","last_undegraded":"2023-09-30T22:57:47.356320+0000","last_fullsized":"2023-09-30T22:57:47.356320+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:21.409395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348575+0000","last_change":"2023-09-30T22:57:47.343883+0000","last_active":"2023-09-30T22:57:47.348575+0000","last_peered":"2023-09-30T22:57:47.348575+0000","last_clean":"2023-09-30T22:57:47.348575+0000","last_became_active":"2023-09-30T22:57:47.343260+0000","last_became_peered":"2023-09-30T22:57:47.343260+0000","last_unstale":"2023-09-30T22:57:47.348575+0000","last_undegraded":"2023-09-30T22:57:47.348575+0000","last_fullsized":"2023-09-30T22:57:47.348575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:11.253908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352491+0000","last_change":"2023-09-30T22:57:46.325137+0000","last_active":"2023-09-30T22:57:47.352491+0000","last_peered":"2023-09-30T22:57:47.352491+0000","last_clean":"2023-09-30T22:57:47.352491+0000","last_became_active":"2023-09-30T22:57:46.324895+0000","last_became_peered":"2023-09-30T22:57:46.324895+0000","last_unstale":"2023-09-30T22:57:47.352491+0000","last_undegraded":"2023-09-30T22:57:47.352491+0000","last_fullsized":"2023-09-30T22:57:47.352491+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:43:30.607338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353966+0000","last_change":"2023-09-30T22:57:47.353291+0000","last_active":"2023-09-30T22:57:47.353966+0000","last_peered":"2023-09-30T22:57:47.353966+0000","last_clean":"2023-09-30T22:57:47.353966+0000","last_became_active":"2023-09-30T22:57:47.353046+0000","last_became_peered":"2023-09-30T22:57:47.353046+0000","last_unstale":"2023-09-30T22:57:47.353966+0000","last_undegraded":"2023-09-30T22:57:47.353966+0000","last_fullsized":"2023-09-30T22:57:47.353966+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:24.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353335+0000","last_change":"2023-09-30T22:57:46.330625+0000","last_active":"2023-09-30T22:57:47.353335+0000","last_peered":"2023-09-30T22:57:47.353335+0000","last_clean":"2023-09-30T22:57:47.353335+0000","last_became_active":"2023-09-30T22:57:46.330091+0000","last_became_peered":"2023-09-30T22:57:46.330091+0000","last_unstale":"2023-09-30T22:57:47.353335+0000","last_undegraded":"2023-09-30T22:57:47.353335+0000","last_fullsized":"2023-09-30T22:57:47.353335+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:37.900944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352636+0000","last_change":"2023-09-30T22:57:47.351921+0000","last_active":"2023-09-30T22:57:47.352636+0000","last_peered":"2023-09-30T22:57:47.352636+0000","last_clean":"2023-09-30T22:57:47.352636+0000","last_became_active":"2023-09-30T22:57:47.351615+0000","last_became_peered":"2023-09-30T22:57:47.351615+0000","last_unstale":"2023-09-30T22:57:47.352636+0000","last_undegraded":"2023-09-30T22:57:47.352636+0000","last_fullsized":"2023-09-30T22:57:47.352636+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355213+0000","last_change":"2023-09-30T22:57:46.325868+0000","last_active":"2023-09-30T22:57:47.355213+0000","last_peered":"2023-09-30T22:57:47.355213+0000","last_clean":"2023-09-30T22:57:47.355213+0000","last_became_active":"2023-09-30T22:57:46.325652+0000","last_became_peered":"2023-09-30T22:57:46.325652+0000","last_unstale":"2023-09-30T22:57:47.355213+0000","last_undegraded":"2023-09-30T22:57:47.355213+0000","last_fullsized":"2023-09-30T22:57:47.355213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:58:52.324524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355123+0000","last_change":"2023-09-30T22:57:47.355016+0000","last_active":"2023-09-30T22:57:47.355123+0000","last_peered":"2023-09-30T22:57:47.355123+0000","last_clean":"2023-09-30T22:57:47.355123+0000","last_became_active":"2023-09-30T22:57:47.354607+0000","last_became_peered":"2023-09-30T22:57:47.354607+0000","last_unstale":"2023-09-30T22:57:47.355123+0000","last_undegraded":"2023-09-30T22:57:47.355123+0000","last_fullsized":"2023-09-30T22:57:47.355123+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358110+0000","last_change":"2023-09-30T22:57:46.325950+0000","last_active":"2023-09-30T22:57:47.358110+0000","last_peered":"2023-09-30T22:57:47.358110+0000","last_clean":"2023-09-30T22:57:47.358110+0000","last_became_active":"2023-09-30T22:57:46.325694+0000","last_became_peered":"2023-09-30T22:57:46.325694+0000","last_unstale":"2023-09-30T22:57:47.358110+0000","last_undegraded":"2023-09-30T22:57:47.358110+0000","last_fullsized":"2023-09-30T22:57:47.358110+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:45.916234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344358+0000","last_change":"2023-09-30T22:57:47.344284+0000","last_active":"2023-09-30T22:57:47.344358+0000","last_peered":"2023-09-30T22:57:47.344358+0000","last_clean":"2023-09-30T22:57:47.344358+0000","last_became_active":"2023-09-30T22:57:47.343791+0000","last_became_peered":"2023-09-30T22:57:47.343791+0000","last_unstale":"2023-09-30T22:57:47.344358+0000","last_undegraded":"2023-09-30T22:57:47.344358+0000","last_fullsized":"2023-09-30T22:57:47.344358+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:27.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.361644+0000","last_change":"2023-09-30T22:57:46.320132+0000","last_active":"2023-09-30T22:57:47.361644+0000","last_peered":"2023-09-30T22:57:47.361644+0000","last_clean":"2023-09-30T22:57:47.361644+0000","last_became_active":"2023-09-30T22:57:46.319599+0000","last_became_peered":"2023-09-30T22:57:46.319599+0000","last_unstale":"2023-09-30T22:57:47.361644+0000","last_undegraded":"2023-09-30T22:57:47.361644+0000","last_fullsized":"2023-09-30T22:57:47.361644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349749+0000","last_change":"2023-09-30T22:57:47.349410+0000","last_active":"2023-09-30T22:57:47.349749+0000","last_peered":"2023-09-30T22:57:47.349749+0000","last_clean":"2023-09-30T22:57:47.349749+0000","last_became_active":"2023-09-30T22:57:47.348804+0000","last_became_peered":"2023-09-30T22:57:47.348804+0000","last_unstale":"2023-09-30T22:57:47.349749+0000","last_undegraded":"2023-09-30T22:57:47.349749+0000","last_fullsized":"2023-09-30T22:57:47.349749+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336709+0000","last_change":"2023-09-30T22:57:46.323796+0000","last_active":"2023-09-30T22:57:47.336709+0000","last_peered":"2023-09-30T22:57:47.336709+0000","last_clean":"2023-09-30T22:57:47.336709+0000","last_became_active":"2023-09-30T22:57:46.323523+0000","last_became_peered":"2023-09-30T22:57:46.323523+0000","last_unstale":"2023-09-30T22:57:47.336709+0000","last_undegraded":"2023-09-30T22:57:47.336709+0000","last_fullsized":"2023-09-30T22:57:47.336709+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:18:59.796566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345199+0000","last_change":"2023-09-30T22:57:47.344969+0000","last_active":"2023-09-30T22:57:47.345199+0000","last_peered":"2023-09-30T22:57:47.345199+0000","last_clean":"2023-09-30T22:57:47.345199+0000","last_became_active":"2023-09-30T22:57:47.344381+0000","last_became_peered":"2023-09-30T22:57:47.344381+0000","last_unstale":"2023-09-30T22:57:47.345199+0000","last_undegraded":"2023-09-30T22:57:47.345199+0000","last_fullsized":"2023-09-30T22:57:47.345199+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345555+0000","last_change":"2023-09-30T22:57:46.329838+0000","last_active":"2023-09-30T22:57:47.345555+0000","last_peered":"2023-09-30T22:57:47.345555+0000","last_clean":"2023-09-30T22:57:47.345555+0000","last_became_active":"2023-09-30T22:57:46.329311+0000","last_became_peered":"2023-09-30T22:57:46.329311+0000","last_unstale":"2023-09-30T22:57:47.345555+0000","last_undegraded":"2023-09-30T22:57:47.345555+0000","last_fullsized":"2023-09-30T22:57:47.345555+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:46:59.626736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358258+0000","last_change":"2023-09-30T22:57:47.358122+0000","last_active":"2023-09-30T22:57:47.358258+0000","last_peered":"2023-09-30T22:57:47.358258+0000","last_clean":"2023-09-30T22:57:47.358258+0000","last_became_active":"2023-09-30T22:57:47.357598+0000","last_became_peered":"2023-09-30T22:57:47.357598+0000","last_unstale":"2023-09-30T22:57:47.358258+0000","last_undegraded":"2023-09-30T22:57:47.358258+0000","last_fullsized":"2023-09-30T22:57:47.358258+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.342334+0000","last_change":"2023-09-30T22:57:46.326797+0000","last_active":"2023-09-30T22:57:47.342334+0000","last_peered":"2023-09-30T22:57:47.342334+0000","last_clean":"2023-09-30T22:57:47.342334+0000","last_became_active":"2023-09-30T22:57:46.326535+0000","last_became_peered":"2023-09-30T22:57:46.326535+0000","last_unstale":"2023-09-30T22:57:47.342334+0000","last_undegraded":"2023-09-30T22:57:47.342334+0000","last_fullsized":"2023-09-30T22:57:47.342334+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:59.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357908+0000","last_change":"2023-09-30T22:57:47.357746+0000","last_active":"2023-09-30T22:57:47.357908+0000","last_peered":"2023-09-30T22:57:47.357908+0000","last_clean":"2023-09-30T22:57:47.357908+0000","last_became_active":"2023-09-30T22:57:47.357300+0000","last_became_peered":"2023-09-30T22:57:47.357300+0000","last_unstale":"2023-09-30T22:57:47.357908+0000","last_undegraded":"2023-09-30T22:57:47.357908+0000","last_fullsized":"2023-09-30T22:57:47.357908+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:42:51.624488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337662+0000","last_change":"2023-09-30T22:57:46.328233+0000","last_active":"2023-09-30T22:57:47.337662+0000","last_peered":"2023-09-30T22:57:47.337662+0000","last_clean":"2023-09-30T22:57:47.337662+0000","last_became_active":"2023-09-30T22:57:46.328011+0000","last_became_peered":"2023-09-30T22:57:46.328011+0000","last_unstale":"2023-09-30T22:57:47.337662+0000","last_undegraded":"2023-09-30T22:57:47.337662+0000","last_fullsized":"2023-09-30T22:57:47.337662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:53.277996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347091+0000","last_change":"2023-09-30T22:57:47.345324+0000","last_active":"2023-09-30T22:57:47.347091+0000","last_peered":"2023-09-30T22:57:47.347091+0000","last_clean":"2023-09-30T22:57:47.347091+0000","last_became_active":"2023-09-30T22:57:47.344697+0000","last_became_peered":"2023-09-30T22:57:47.344697+0000","last_unstale":"2023-09-30T22:57:47.347091+0000","last_undegraded":"2023-09-30T22:57:47.347091+0000","last_fullsized":"2023-09-30T22:57:47.347091+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:22.413372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359778+0000","last_change":"2023-09-30T22:57:46.328096+0000","last_active":"2023-09-30T22:57:47.359778+0000","last_peered":"2023-09-30T22:57:47.359778+0000","last_clean":"2023-09-30T22:57:47.359778+0000","last_became_active":"2023-09-30T22:57:46.327733+0000","last_became_peered":"2023-09-30T22:57:46.327733+0000","last_unstale":"2023-09-30T22:57:47.359778+0000","last_undegraded":"2023-09-30T22:57:47.359778+0000","last_fullsized":"2023-09-30T22:57:47.359778+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:10.249931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351086+0000","last_change":"2023-09-30T22:57:47.350617+0000","last_active":"2023-09-30T22:57:47.351086+0000","last_peered":"2023-09-30T22:57:47.351086+0000","last_clean":"2023-09-30T22:57:47.351086+0000","last_became_active":"2023-09-30T22:57:47.349376+0000","last_became_peered":"2023-09-30T22:57:47.349376+0000","last_unstale":"2023-09-30T22:57:47.351086+0000","last_undegraded":"2023-09-30T22:57:47.351086+0000","last_fullsized":"2023-09-30T22:57:47.351086+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"110'6","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.362611+0000","last_change":"2023-09-30T22:57:46.326967+0000","last_active":"2023-09-30T22:57:47.362611+0000","last_peered":"2023-09-30T22:57:47.362611+0000","last_clean":"2023-09-30T22:57:47.362611+0000","last_became_active":"2023-09-30T22:57:46.326481+0000","last_became_peered":"2023-09-30T22:57:46.326481+0000","last_unstale":"2023-09-30T22:57:47.362611+0000","last_undegraded":"2023-09-30T22:57:47.362611+0000","last_fullsized":"2023-09-30T22:57:47.362611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:50.205703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359389+0000","last_change":"2023-09-30T22:57:47.359304+0000","last_active":"2023-09-30T22:57:47.359389+0000","last_peered":"2023-09-30T22:57:47.359389+0000","last_clean":"2023-09-30T22:57:47.359389+0000","last_became_active":"2023-09-30T22:57:47.358833+0000","last_became_peered":"2023-09-30T22:57:47.358833+0000","last_unstale":"2023-09-30T22:57:47.359389+0000","last_undegraded":"2023-09-30T22:57:47.359389+0000","last_fullsized":"2023-09-30T22:57:47.359389+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:45.574707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353583+0000","last_change":"2023-09-30T22:57:46.330755+0000","last_active":"2023-09-30T22:57:47.353583+0000","last_peered":"2023-09-30T22:57:47.353583+0000","last_clean":"2023-09-30T22:57:47.353583+0000","last_became_active":"2023-09-30T22:57:46.330373+0000","last_became_peered":"2023-09-30T22:57:46.330373+0000","last_unstale":"2023-09-30T22:57:47.353583+0000","last_undegraded":"2023-09-30T22:57:47.353583+0000","last_fullsized":"2023-09-30T22:57:47.353583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:53.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355719+0000","last_change":"2023-09-30T22:57:47.355654+0000","last_active":"2023-09-30T22:57:47.355719+0000","last_peered":"2023-09-30T22:57:47.355719+0000","last_clean":"2023-09-30T22:57:47.355719+0000","last_became_active":"2023-09-30T22:57:47.353273+0000","last_became_peered":"2023-09-30T22:57:47.353273+0000","last_unstale":"2023-09-30T22:57:47.355719+0000","last_undegraded":"2023-09-30T22:57:47.355719+0000","last_fullsized":"2023-09-30T22:57:47.355719+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:33:14.420556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336966+0000","last_change":"2023-09-30T22:57:46.327220+0000","last_active":"2023-09-30T22:57:47.336966+0000","last_peered":"2023-09-30T22:57:47.336966+0000","last_clean":"2023-09-30T22:57:47.336966+0000","last_became_active":"2023-09-30T22:57:46.326718+0000","last_became_peered":"2023-09-30T22:57:46.326718+0000","last_unstale":"2023-09-30T22:57:47.336966+0000","last_undegraded":"2023-09-30T22:57:47.336966+0000","last_fullsized":"2023-09-30T22:57:47.336966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:28.267376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.340878+0000","last_change":"2023-09-30T22:57:47.340802+0000","last_active":"2023-09-30T22:57:47.340878+0000","last_peered":"2023-09-30T22:57:47.340878+0000","last_clean":"2023-09-30T22:57:47.340878+0000","last_became_active":"2023-09-30T22:57:47.340563+0000","last_became_peered":"2023-09-30T22:57:47.340563+0000","last_unstale":"2023-09-30T22:57:47.340878+0000","last_undegraded":"2023-09-30T22:57:47.340878+0000","last_fullsized":"2023-09-30T22:57:47.340878+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:50:51.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336825+0000","last_change":"2023-09-30T22:57:46.326928+0000","last_active":"2023-09-30T22:57:47.336825+0000","last_peered":"2023-09-30T22:57:47.336825+0000","last_clean":"2023-09-30T22:57:47.336825+0000","last_became_active":"2023-09-30T22:57:46.326433+0000","last_became_peered":"2023-09-30T22:57:46.326433+0000","last_unstale":"2023-09-30T22:57:47.336825+0000","last_undegraded":"2023-09-30T22:57:47.336825+0000","last_fullsized":"2023-09-30T22:57:47.336825+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:57.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355109+0000","last_change":"2023-09-30T22:57:47.354855+0000","last_active":"2023-09-30T22:57:47.355109+0000","last_peered":"2023-09-30T22:57:47.355109+0000","last_clean":"2023-09-30T22:57:47.355109+0000","last_became_active":"2023-09-30T22:57:47.354277+0000","last_became_peered":"2023-09-30T22:57:47.354277+0000","last_unstale":"2023-09-30T22:57:47.355109+0000","last_undegraded":"2023-09-30T22:57:47.355109+0000","last_fullsized":"2023-09-30T22:57:47.355109+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"110'8","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.360417+0000","last_change":"2023-09-30T22:57:46.327580+0000","last_active":"2023-09-30T22:57:47.360417+0000","last_peered":"2023-09-30T22:57:47.360417+0000","last_clean":"2023-09-30T22:57:47.360417+0000","last_became_active":"2023-09-30T22:57:46.327347+0000","last_became_peered":"2023-09-30T22:57:46.327347+0000","last_unstale":"2023-09-30T22:57:47.360417+0000","last_undegraded":"2023-09-30T22:57:47.360417+0000","last_fullsized":"2023-09-30T22:57:47.360417+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:22.893668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349980+0000","last_change":"2023-09-30T22:57:47.349864+0000","last_active":"2023-09-30T22:57:47.349980+0000","last_peered":"2023-09-30T22:57:47.349980+0000","last_clean":"2023-09-30T22:57:47.349980+0000","last_became_active":"2023-09-30T22:57:47.349662+0000","last_became_peered":"2023-09-30T22:57:47.349662+0000","last_unstale":"2023-09-30T22:57:47.349980+0000","last_undegraded":"2023-09-30T22:57:47.349980+0000","last_fullsized":"2023-09-30T22:57:47.349980+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354472+0000","last_change":"2023-09-30T22:57:46.324881+0000","last_active":"2023-09-30T22:57:47.354472+0000","last_peered":"2023-09-30T22:57:47.354472+0000","last_clean":"2023-09-30T22:57:47.354472+0000","last_became_active":"2023-09-30T22:57:46.324629+0000","last_became_peered":"2023-09-30T22:57:46.324629+0000","last_unstale":"2023-09-30T22:57:47.354472+0000","last_undegraded":"2023-09-30T22:57:47.354472+0000","last_fullsized":"2023-09-30T22:57:47.354472+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:51.004328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352704+0000","last_change":"2023-09-30T22:57:47.352586+0000","last_active":"2023-09-30T22:57:47.352704+0000","last_peered":"2023-09-30T22:57:47.352704+0000","last_clean":"2023-09-30T22:57:47.352704+0000","last_became_active":"2023-09-30T22:57:47.352184+0000","last_became_peered":"2023-09-30T22:57:47.352184+0000","last_unstale":"2023-09-30T22:57:47.352704+0000","last_undegraded":"2023-09-30T22:57:47.352704+0000","last_fullsized":"2023-09-30T22:57:47.352704+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-09-30T22:57:49.697050+0000","last_change":"2023-09-30T22:57:46.330434+0000","last_active":"2023-09-30T22:57:49.697050+0000","last_peered":"2023-09-30T22:57:49.697050+0000","last_clean":"2023-09-30T22:57:49.697050+0000","last_became_active":"2023-09-30T22:57:46.330220+0000","last_became_peered":"2023-09-30T22:57:46.330220+0000","last_unstale":"2023-09-30T22:57:49.697050+0000","last_undegraded":"2023-09-30T22:57:49.697050+0000","last_fullsized":"2023-09-30T22:57:49.697050+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:36.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355094+0000","last_change":"2023-09-30T22:57:47.354174+0000","last_active":"2023-09-30T22:57:47.355094+0000","last_peered":"2023-09-30T22:57:47.355094+0000","last_clean":"2023-09-30T22:57:47.355094+0000","last_became_active":"2023-09-30T22:57:47.353694+0000","last_became_peered":"2023-09-30T22:57:47.353694+0000","last_unstale":"2023-09-30T22:57:47.355094+0000","last_undegraded":"2023-09-30T22:57:47.355094+0000","last_fullsized":"2023-09-30T22:57:47.355094+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.341428+0000","last_change":"2023-09-30T22:57:46.326357+0000","last_active":"2023-09-30T22:57:47.341428+0000","last_peered":"2023-09-30T22:57:47.341428+0000","last_clean":"2023-09-30T22:57:47.341428+0000","last_became_active":"2023-09-30T22:57:46.326124+0000","last_became_peered":"2023-09-30T22:57:46.326124+0000","last_unstale":"2023-09-30T22:57:47.341428+0000","last_undegraded":"2023-09-30T22:57:47.341428+0000","last_fullsized":"2023-09-30T22:57:47.341428+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355581+0000","last_change":"2023-09-30T22:57:47.355504+0000","last_active":"2023-09-30T22:57:47.355581+0000","last_peered":"2023-09-30T22:57:47.355581+0000","last_clean":"2023-09-30T22:57:47.355581+0000","last_became_active":"2023-09-30T22:57:47.352945+0000","last_became_peered":"2023-09-30T22:57:47.352945+0000","last_unstale":"2023-09-30T22:57:47.355581+0000","last_undegraded":"2023-09-30T22:57:47.355581+0000","last_fullsized":"2023-09-30T22:57:47.355581+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:11.253908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337429+0000","last_change":"2023-09-30T22:57:46.321470+0000","last_active":"2023-09-30T22:57:47.337429+0000","last_peered":"2023-09-30T22:57:47.337429+0000","last_clean":"2023-09-30T22:57:47.337429+0000","last_became_active":"2023-09-30T22:57:46.321233+0000","last_became_peered":"2023-09-30T22:57:46.321233+0000","last_unstale":"2023-09-30T22:57:47.337429+0000","last_undegraded":"2023-09-30T22:57:47.337429+0000","last_fullsized":"2023-09-30T22:57:47.337429+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:58.334725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354191+0000","last_change":"2023-09-30T22:57:47.354114+0000","last_active":"2023-09-30T22:57:47.354191+0000","last_peered":"2023-09-30T22:57:47.354191+0000","last_clean":"2023-09-30T22:57:47.354191+0000","last_became_active":"2023-09-30T22:57:47.353887+0000","last_became_peered":"2023-09-30T22:57:47.353887+0000","last_unstale":"2023-09-30T22:57:47.354191+0000","last_undegraded":"2023-09-30T22:57:47.354191+0000","last_fullsized":"2023-09-30T22:57:47.354191+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:47:27.062944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336851+0000","last_change":"2023-09-30T22:57:46.323408+0000","last_active":"2023-09-30T22:57:47.336851+0000","last_peered":"2023-09-30T22:57:47.336851+0000","last_clean":"2023-09-30T22:57:47.336851+0000","last_became_active":"2023-09-30T22:57:46.322636+0000","last_became_peered":"2023-09-30T22:57:46.322636+0000","last_unstale":"2023-09-30T22:57:47.336851+0000","last_undegraded":"2023-09-30T22:57:47.336851+0000","last_fullsized":"2023-09-30T22:57:47.336851+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:00.151513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345920+0000","last_change":"2023-09-30T22:57:47.345338+0000","last_active":"2023-09-30T22:57:47.345920+0000","last_peered":"2023-09-30T22:57:47.345920+0000","last_clean":"2023-09-30T22:57:47.345920+0000","last_became_active":"2023-09-30T22:57:47.345110+0000","last_became_peered":"2023-09-30T22:57:47.345110+0000","last_unstale":"2023-09-30T22:57:47.345920+0000","last_undegraded":"2023-09-30T22:57:47.345920+0000","last_fullsized":"2023-09-30T22:57:47.345920+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343405+0000","last_change":"2023-09-30T22:57:46.327259+0000","last_active":"2023-09-30T22:57:47.343405+0000","last_peered":"2023-09-30T22:57:47.343405+0000","last_clean":"2023-09-30T22:57:47.343405+0000","last_became_active":"2023-09-30T22:57:46.326989+0000","last_became_peered":"2023-09-30T22:57:46.326989+0000","last_unstale":"2023-09-30T22:57:47.343405+0000","last_undegraded":"2023-09-30T22:57:47.343405+0000","last_fullsized":"2023-09-30T22:57:47.343405+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354041+0000","last_change":"2023-09-30T22:57:47.353846+0000","last_active":"2023-09-30T22:57:47.354041+0000","last_peered":"2023-09-30T22:57:47.354041+0000","last_clean":"2023-09-30T22:57:47.354041+0000","last_became_active":"2023-09-30T22:57:47.353595+0000","last_became_peered":"2023-09-30T22:57:47.353595+0000","last_unstale":"2023-09-30T22:57:47.354041+0000","last_undegraded":"2023-09-30T22:57:47.354041+0000","last_fullsized":"2023-09-30T22:57:47.354041+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349990+0000","last_change":"2023-09-30T22:57:46.327694+0000","last_active":"2023-09-30T22:57:47.349990+0000","last_peered":"2023-09-30T22:57:47.349990+0000","last_clean":"2023-09-30T22:57:47.349990+0000","last_became_active":"2023-09-30T22:57:46.327163+0000","last_became_peered":"2023-09-30T22:57:46.327163+0000","last_unstale":"2023-09-30T22:57:47.349990+0000","last_undegraded":"2023-09-30T22:57:47.349990+0000","last_fullsized":"2023-09-30T22:57:47.349990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:56.303593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351132+0000","last_change":"2023-09-30T22:57:47.350939+0000","last_active":"2023-09-30T22:57:47.351132+0000","last_peered":"2023-09-30T22:57:47.351132+0000","last_clean":"2023-09-30T22:57:47.351132+0000","last_became_active":"2023-09-30T22:57:47.349984+0000","last_became_peered":"2023-09-30T22:57:47.349984+0000","last_unstale":"2023-09-30T22:57:47.351132+0000","last_undegraded":"2023-09-30T22:57:47.351132+0000","last_fullsized":"2023-09-30T22:57:47.351132+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:52.008304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343214+0000","last_change":"2023-09-30T22:57:46.326830+0000","last_active":"2023-09-30T22:57:47.343214+0000","last_peered":"2023-09-30T22:57:47.343214+0000","last_clean":"2023-09-30T22:57:47.343214+0000","last_became_active":"2023-09-30T22:57:46.326524+0000","last_became_peered":"2023-09-30T22:57:46.326524+0000","last_unstale":"2023-09-30T22:57:47.343214+0000","last_undegraded":"2023-09-30T22:57:47.343214+0000","last_fullsized":"2023-09-30T22:57:47.343214+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:14.959667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356281+0000","last_change":"2023-09-30T22:57:47.355568+0000","last_active":"2023-09-30T22:57:47.356281+0000","last_peered":"2023-09-30T22:57:47.356281+0000","last_clean":"2023-09-30T22:57:47.356281+0000","last_became_active":"2023-09-30T22:57:47.355329+0000","last_became_peered":"2023-09-30T22:57:47.355329+0000","last_unstale":"2023-09-30T22:57:47.356281+0000","last_undegraded":"2023-09-30T22:57:47.356281+0000","last_fullsized":"2023-09-30T22:57:47.356281+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:56.277804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359856+0000","last_change":"2023-09-30T22:57:46.327951+0000","last_active":"2023-09-30T22:57:47.359856+0000","last_peered":"2023-09-30T22:57:47.359856+0000","last_clean":"2023-09-30T22:57:47.359856+0000","last_became_active":"2023-09-30T22:57:46.327380+0000","last_became_peered":"2023-09-30T22:57:46.327380+0000","last_unstale":"2023-09-30T22:57:47.359856+0000","last_undegraded":"2023-09-30T22:57:47.359856+0000","last_fullsized":"2023-09-30T22:57:47.359856+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:55.273827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346961+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:57:47.346961+0000","last_peered":"2023-09-30T22:57:47.346961+0000","last_clean":"2023-09-30T22:57:47.346961+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:57:47.346961+0000","last_undegraded":"2023-09-30T22:57:47.346961+0000","last_fullsized":"2023-09-30T22:57:47.346961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358211+0000","last_change":"2023-09-30T22:57:47.357841+0000","last_active":"2023-09-30T22:57:47.358211+0000","last_peered":"2023-09-30T22:57:47.358211+0000","last_clean":"2023-09-30T22:57:47.358211+0000","last_became_active":"2023-09-30T22:57:47.357426+0000","last_became_peered":"2023-09-30T22:57:47.357426+0000","last_unstale":"2023-09-30T22:57:47.358211+0000","last_undegraded":"2023-09-30T22:57:47.358211+0000","last_fullsized":"2023-09-30T22:57:47.358211+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356617+0000","last_change":"2023-09-30T22:57:46.329817+0000","last_active":"2023-09-30T22:57:47.356617+0000","last_peered":"2023-09-30T22:57:47.356617+0000","last_clean":"2023-09-30T22:57:47.356617+0000","last_became_active":"2023-09-30T22:57:46.329534+0000","last_became_peered":"2023-09-30T22:57:46.329534+0000","last_unstale":"2023-09-30T22:57:47.356617+0000","last_undegraded":"2023-09-30T22:57:47.356617+0000","last_fullsized":"2023-09-30T22:57:47.356617+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:11:14.497043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.338031+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:57:47.338031+0000","last_peered":"2023-09-30T22:57:47.338031+0000","last_clean":"2023-09-30T22:57:47.338031+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:57:47.338031+0000","last_undegraded":"2023-09-30T22:57:47.338031+0000","last_fullsized":"2023-09-30T22:57:47.338031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343580+0000","last_change":"2023-09-30T22:57:47.343168+0000","last_active":"2023-09-30T22:57:47.343580+0000","last_peered":"2023-09-30T22:57:47.343580+0000","last_clean":"2023-09-30T22:57:47.343580+0000","last_became_active":"2023-09-30T22:57:47.342935+0000","last_became_peered":"2023-09-30T22:57:47.342935+0000","last_unstale":"2023-09-30T22:57:47.343580+0000","last_undegraded":"2023-09-30T22:57:47.343580+0000","last_fullsized":"2023-09-30T22:57:47.343580+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:59.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356087+0000","last_change":"2023-09-30T22:57:46.330494+0000","last_active":"2023-09-30T22:57:47.356087+0000","last_peered":"2023-09-30T22:57:47.356087+0000","last_clean":"2023-09-30T22:57:47.356087+0000","last_became_active":"2023-09-30T22:57:46.330277+0000","last_became_peered":"2023-09-30T22:57:46.330277+0000","last_unstale":"2023-09-30T22:57:47.356087+0000","last_undegraded":"2023-09-30T22:57:47.356087+0000","last_fullsized":"2023-09-30T22:57:47.356087+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:57:31.215330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337610+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:57:47.337610+0000","last_peered":"2023-09-30T22:57:47.337610+0000","last_clean":"2023-09-30T22:57:47.337610+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:57:47.337610+0000","last_undegraded":"2023-09-30T22:57:47.337610+0000","last_fullsized":"2023-09-30T22:57:47.337610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358241+0000","last_change":"2023-09-30T22:57:47.357853+0000","last_active":"2023-09-30T22:57:47.358241+0000","last_peered":"2023-09-30T22:57:47.358241+0000","last_clean":"2023-09-30T22:57:47.358241+0000","last_became_active":"2023-09-30T22:57:47.357288+0000","last_became_peered":"2023-09-30T22:57:47.357288+0000","last_unstale":"2023-09-30T22:57:47.358241+0000","last_undegraded":"2023-09-30T22:57:47.358241+0000","last_fullsized":"2023-09-30T22:57:47.358241+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:52.008304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336944+0000","last_change":"2023-09-30T22:57:46.322115+0000","last_active":"2023-09-30T22:57:47.336944+0000","last_peered":"2023-09-30T22:57:47.336944+0000","last_clean":"2023-09-30T22:57:47.336944+0000","last_became_active":"2023-09-30T22:57:46.321808+0000","last_became_peered":"2023-09-30T22:57:46.321808+0000","last_unstale":"2023-09-30T22:57:47.336944+0000","last_undegraded":"2023-09-30T22:57:47.336944+0000","last_fullsized":"2023-09-30T22:57:47.336944+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:03.448369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.338076+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:57:47.338076+0000","last_peered":"2023-09-30T22:57:47.338076+0000","last_clean":"2023-09-30T22:57:47.338076+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:57:47.338076+0000","last_undegraded":"2023-09-30T22:57:47.338076+0000","last_fullsized":"2023-09-30T22:57:47.338076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343317+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:57:47.343317+0000","last_peered":"2023-09-30T22:57:47.343317+0000","last_clean":"2023-09-30T22:57:47.343317+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:57:47.343317+0000","last_undegraded":"2023-09-30T22:57:47.343317+0000","last_fullsized":"2023-09-30T22:57:47.343317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.350505+0000","last_change":"2023-09-30T22:57:47.350420+0000","last_active":"2023-09-30T22:57:47.350505+0000","last_peered":"2023-09-30T22:57:47.350505+0000","last_clean":"2023-09-30T22:57:47.350505+0000","last_became_active":"2023-09-30T22:57:47.349955+0000","last_became_peered":"2023-09-30T22:57:47.349955+0000","last_unstale":"2023-09-30T22:57:47.350505+0000","last_undegraded":"2023-09-30T22:57:47.350505+0000","last_fullsized":"2023-09-30T22:57:47.350505+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354813+0000","last_change":"2023-09-30T22:57:46.322978+0000","last_active":"2023-09-30T22:57:47.354813+0000","last_peered":"2023-09-30T22:57:47.354813+0000","last_clean":"2023-09-30T22:57:47.354813+0000","last_became_active":"2023-09-30T22:57:46.322754+0000","last_became_peered":"2023-09-30T22:57:46.322754+0000","last_unstale":"2023-09-30T22:57:47.354813+0000","last_undegraded":"2023-09-30T22:57:47.354813+0000","last_fullsized":"2023-09-30T22:57:47.354813+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.339575+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:57:47.339575+0000","last_peered":"2023-09-30T22:57:47.339575+0000","last_clean":"2023-09-30T22:57:47.339575+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:57:47.339575+0000","last_undegraded":"2023-09-30T22:57:47.339575+0000","last_fullsized":"2023-09-30T22:57:47.339575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348944+0000","last_change":"2023-09-30T22:57:47.348879+0000","last_active":"2023-09-30T22:57:47.348944+0000","last_peered":"2023-09-30T22:57:47.348944+0000","last_clean":"2023-09-30T22:57:47.348944+0000","last_became_active":"2023-09-30T22:57:47.348671+0000","last_became_peered":"2023-09-30T22:57:47.348671+0000","last_unstale":"2023-09-30T22:57:47.348944+0000","last_undegraded":"2023-09-30T22:57:47.348944+0000","last_fullsized":"2023-09-30T22:57:47.348944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:38.468211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.340453+0000","last_change":"2023-09-30T22:57:46.325177+0000","last_active":"2023-09-30T22:57:47.340453+0000","last_peered":"2023-09-30T22:57:47.340453+0000","last_clean":"2023-09-30T22:57:47.340453+0000","last_became_active":"2023-09-30T22:57:46.324955+0000","last_became_peered":"2023-09-30T22:57:46.324955+0000","last_unstale":"2023-09-30T22:57:47.340453+0000","last_undegraded":"2023-09-30T22:57:47.340453+0000","last_fullsized":"2023-09-30T22:57:47.340453+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.339322+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:57:47.339322+0000","last_peered":"2023-09-30T22:57:47.339322+0000","last_clean":"2023-09-30T22:57:47.339322+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:57:47.339322+0000","last_undegraded":"2023-09-30T22:57:47.339322+0000","last_fullsized":"2023-09-30T22:57:47.339322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349833+0000","last_change":"2023-09-30T22:57:47.349580+0000","last_active":"2023-09-30T22:57:47.349833+0000","last_peered":"2023-09-30T22:57:47.349833+0000","last_clean":"2023-09-30T22:57:47.349833+0000","last_became_active":"2023-09-30T22:57:47.349005+0000","last_became_peered":"2023-09-30T22:57:47.349005+0000","last_unstale":"2023-09-30T22:57:47.349833+0000","last_undegraded":"2023-09-30T22:57:47.349833+0000","last_fullsized":"2023-09-30T22:57:47.349833+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346385+0000","last_change":"2023-09-30T22:57:46.325292+0000","last_active":"2023-09-30T22:57:47.346385+0000","last_peered":"2023-09-30T22:57:47.346385+0000","last_clean":"2023-09-30T22:57:47.346385+0000","last_became_active":"2023-09-30T22:57:46.325062+0000","last_became_peered":"2023-09-30T22:57:46.325062+0000","last_unstale":"2023-09-30T22:57:47.346385+0000","last_undegraded":"2023-09-30T22:57:47.346385+0000","last_fullsized":"2023-09-30T22:57:47.346385+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:41.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344417+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:57:47.344417+0000","last_peered":"2023-09-30T22:57:47.344417+0000","last_clean":"2023-09-30T22:57:47.344417+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:57:47.344417+0000","last_undegraded":"2023-09-30T22:57:47.344417+0000","last_fullsized":"2023-09-30T22:57:47.344417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351627+0000","last_change":"2023-09-30T22:57:47.351092+0000","last_active":"2023-09-30T22:57:47.351627+0000","last_peered":"2023-09-30T22:57:47.351627+0000","last_clean":"2023-09-30T22:57:47.351627+0000","last_became_active":"2023-09-30T22:57:47.350831+0000","last_became_peered":"2023-09-30T22:57:47.350831+0000","last_unstale":"2023-09-30T22:57:47.351627+0000","last_undegraded":"2023-09-30T22:57:47.351627+0000","last_fullsized":"2023-09-30T22:57:47.351627+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:38.904920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345515+0000","last_change":"2023-09-30T22:57:46.324050+0000","last_active":"2023-09-30T22:57:47.345515+0000","last_peered":"2023-09-30T22:57:47.345515+0000","last_clean":"2023-09-30T22:57:47.345515+0000","last_became_active":"2023-09-30T22:57:46.323824+0000","last_became_peered":"2023-09-30T22:57:46.323824+0000","last_unstale":"2023-09-30T22:57:47.345515+0000","last_undegraded":"2023-09-30T22:57:47.345515+0000","last_fullsized":"2023-09-30T22:57:47.345515+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337955+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:57:47.337955+0000","last_peered":"2023-09-30T22:57:47.337955+0000","last_clean":"2023-09-30T22:57:47.337955+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:57:47.337955+0000","last_undegraded":"2023-09-30T22:57:47.337955+0000","last_fullsized":"2023-09-30T22:57:47.337955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66700000000000004,"15min":0.63500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.65000000000000002},"min":{"1min":0.53800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.874,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.747}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.67800000000000005},"min":{"1min":0.53700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.52400000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.502,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.871,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.135,"15min":1.135},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.071,"15min":1.071},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":630,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194682,"statfs":{"total":200000000,"available":199354651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78000000000000003,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.97699999999999998,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.80200000000000005},"min":{"1min":0.51700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0800000000000001,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.67100000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.46200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.83999999999999997,"15min":1.022},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":1.0289999999999999},"min":{"1min":0.48099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0429999999999999,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.95599999999999996},"min":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0089999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.107,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1259999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.65700000000000003},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.321,"15min":1.321},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80300000000000005,"15min":0.75900000000000001},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.198,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.61399999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.97399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194106,"statfs":{"total":200000000,"available":198765285,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45700000000000002,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.47099999999999997},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.52000000000000002},"min":{"1min":0.44400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.47299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.755},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.72599999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.71199999999999997},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.22},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76300000000000001,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.72399999999999998},"min":{"1min":0.56999999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.032,"5min":1.127,"15min":1.127},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0660000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.629},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80300000000000005,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.51400000000000001},"min":{"1min":0.34399999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.879},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.27,"15min":1.27},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.48599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0600000000000001,"5min":1.171,"15min":1.171},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.57599999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.119,"15min":1.119},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76600000000000001,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.621}]},{"osd":7,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.173,"15min":1.173},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.095,"5min":1.21,"15min":1.21},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":629,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199355735,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79200000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.53600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.38,"15min":0.38},"max":{"1min":1.04,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.151,"5min":1.179,"15min":1.179},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.236,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.615,"15min":1.615},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.59199999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.57299999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.117,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":630,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194682,"statfs":{"total":200000000,"available":199354663,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47899999999999998,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59899999999999998,"5min":1.919,"15min":1.919},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68300000000000005,"5min":1.254,"15min":1.254},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.747,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.747,"15min":0.72799999999999998},"min":{"1min":0.52900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.242,"5min":1.401,"15min":1.401},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.76400000000000001},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.21,"5min":3.306,"15min":3.306},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98199999999999998,"5min":1.508,"15min":1.508},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.745},"min":{"1min":0.57099999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.621}]},{"osd":6,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.151,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0700000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.61799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1160000000000001,"5min":1.573,"15min":1.573},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93100000000000005,"5min":1.022,"15min":1.022},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64300000000000002,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.746}]},{"osd":1,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64600000000000002,"15min":0.623},"min":{"1min":0.48199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.66400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95199999999999996,"5min":1.006,"15min":1.006},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72199999999999998,"15min":0.67900000000000005},"min":{"1min":0.53400000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91100000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72499999999999998,"15min":0.69099999999999995},"min":{"1min":0.52500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90100000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81399999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.878},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":1,"5min":1,"15min":1},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93500000000000005,"5min":1.016,"15min":1.016},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.026,"5min":1.044,"15min":1.044},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194107,"statfs":{"total":200000000,"available":198765943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.42199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.623},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.81399999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84299999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.044,"15min":1.044},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69499999999999995,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.79500000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.91000000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.749},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90700000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.37,"15min":0.37},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.87},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.84899999999999998}]}]}],"pool_statfs":[]}} 2023-09-30T22:57:52.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T22:57:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.836+0000 7efcc9bff700 1 Processor -- start 2023-09-30T22:57:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.836+0000 7efcc9bff700 1 -- start start 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.837+0000 7efcc9bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc406a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.837+0000 7efcc9bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcc406ae60 0x7efcc40b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.837+0000 7efcc9bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc40cc4e0 con 0x7efcc4157c90 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.837+0000 7efcc9bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40cc7c0 con 0x7efcc406ae60 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.837+0000 7efcc9bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc406b300 con 0x7efcc41578c0 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.837+0000 7efcc2ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcc406ae60 0x7efcc40b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc2ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcc406ae60 0x7efcc40b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46142/0 (socket says 172.21.15.142:46142) 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc2ffd700 1 -- 172.21.15.142:0/614426092 learned_addr learned my addr 172.21.15.142:0/614426092 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc37fe700 1 --2- 172.21.15.142:0/614426092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc2ffd700 1 -- 172.21.15.142:0/614426092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 msgr2=0x7efcc406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc2ffd700 1 --2- 172.21.15.142:0/614426092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc406a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc2ffd700 1 -- 172.21.15.142:0/614426092 >> v1:172.21.15.148:6789/0 conn(0x7efcc4157c90 legacy=0x7efcc415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc2ffd700 1 -- 172.21.15.142:0/614426092 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc406b5e0 con 0x7efcc406ae60 2023-09-30T22:57:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc37fe700 1 --2- 172.21.15.142:0/614426092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc2ffd700 1 --2- 172.21.15.142:0/614426092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc40b0770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efcb80099b0 tx=0x7efcb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d7efbdde19d9da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:52.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc27fc700 1 -- 172.21.15.142:0/614426092 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb800b860 con 0x7efcc406ae60 2023-09-30T22:57:52.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.838+0000 7efcc27fc700 1 -- 172.21.15.142:0/614426092 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb800b9c0 con 0x7efcc406ae60 2023-09-30T22:57:52.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc27fc700 1 -- 172.21.15.142:0/614426092 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb800bd60 con 0x7efcc406ae60 2023-09-30T22:57:52.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 -- 172.21.15.142:0/614426092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 msgr2=0x7efcc40b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 --2- 172.21.15.142:0/614426092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc40b0770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efcb80099b0 tx=0x7efcb8009250 comp rx=0 tx=0).stop 2023-09-30T22:57:52.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 -- 172.21.15.142:0/614426092 shutdown_connections 2023-09-30T22:57:52.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 --2- 172.21.15.142:0/614426092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 --2- 172.21.15.142:0/614426092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc40b0770 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 -- 172.21.15.142:0/614426092 >> 172.21.15.142:0/614426092 conn(0x7efcc40ce8b0 msgr2=0x7efcc40cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 -- 172.21.15.142:0/614426092 shutdown_connections 2023-09-30T22:57:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.839+0000 7efcc9bff700 1 -- 172.21.15.142:0/614426092 wait complete. 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.841+0000 7efcc9bff700 1 Processor -- start 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.841+0000 7efcc9bff700 1 -- start start 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc9bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc41520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc9bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc416dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc9bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc4157c90 0x7efcc416e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc9bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc415cb20 con 0x7efcc406ae60 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc9bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc415bf50 con 0x7efcc4157c90 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc9bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc415c1f0 con 0x7efcc41578c0 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc41520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc41520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46148/0 (socket says 172.21.15.142:46148) 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 -- 172.21.15.142:0/1209593477 learned_addr learned my addr 172.21.15.142:0/1209593477 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 -- 172.21.15.142:0/1209593477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 msgr2=0x7efcc416dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc416dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 -- 172.21.15.142:0/1209593477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc4157c90 msgr2=0x7efcc416e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc4157c90 0x7efcc416e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.842+0000 7efcc37fe700 1 -- 172.21.15.142:0/1209593477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80094f0 con 0x7efcc406ae60 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.843+0000 7efcc37fe700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc41520e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7efcb400e8d0 tx=0x7efcb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.843+0000 7efcab7fe700 1 -- 172.21.15.142:0/1209593477 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400ee70 con 0x7efcc406ae60 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.843+0000 7efcab7fe700 1 -- 172.21.15.142:0/1209593477 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400c5e0 con 0x7efcc406ae60 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.843+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc415c4d0 con 0x7efcc406ae60 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.843+0000 7efcab7fe700 1 -- 172.21.15.142:0/1209593477 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400c980 con 0x7efcc406ae60 2023-09-30T22:57:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.843+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc41530b0 con 0x7efcc406ae60 2023-09-30T22:57:52.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.844+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc406ea70 con 0x7efcc406ae60 2023-09-30T22:57:52.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.845+0000 7efcab7fe700 1 -- 172.21.15.142:0/1209593477 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efcb4013410 con 0x7efcc406ae60 2023-09-30T22:57:52.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.845+0000 7efcab7fe700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcb0067330 0x7efcb00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:52.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.846+0000 7efcab7fe700 1 -- 172.21.15.142:0/1209593477 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efcb4084d20 con 0x7efcc406ae60 2023-09-30T22:57:52.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.846+0000 7efcc2ffd700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcb0067330 0x7efcb00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:52.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.846+0000 7efcc2ffd700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcb0067330 0x7efcb00697e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efcb80099b0 tx=0x7efcb8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:52.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:52.850+0000 7efcab7fe700 1 -- 172.21.15.142:0/1209593477 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efcb40556b0 con 0x7efcc406ae60 2023-09-30T22:57:53.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.114+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7efcc406b8c0 con 0x7efcc406ae60 2023-09-30T22:57:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.115+0000 7efcab7fe700 1 -- 172.21.15.142:0/1209593477 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1172 (secure 0 0 0) 0x7efcb40204b0 con 0x7efcc406ae60 2023-09-30T22:57:53.116 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:53.116 INFO:teuthology.orchestra.run.smithi142.stdout:{"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":343,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1696114335,"num_in_osds":8,"osd_in_since":1696114332,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592674,"bytes_used":6334860,"bytes_avail":1593665140,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":50,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6450}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-09-30T22:57:36.172800+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-09-30T22:57:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.117+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcb0067330 msgr2=0x7efcb00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.117+0000 7efcc9bff700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcb0067330 0x7efcb00697e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efcb80099b0 tx=0x7efcb8017000 comp rx=0 tx=0).stop 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.117+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 msgr2=0x7efcc41520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.117+0000 7efcc9bff700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc41520e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7efcb400e8d0 tx=0x7efcb4008040 comp rx=0 tx=0).stop 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 shutdown_connections 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efcb0067330 0x7efcb00697e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc4157c90 0x7efcc416e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc406ae60 0x7efcc41520e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 --2- 172.21.15.142:0/1209593477 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcc41578c0 0x7efcc416dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 >> 172.21.15.142:0/1209593477 conn(0x7efcc40ce8b0 msgr2=0x7efcc4067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 shutdown_connections 2023-09-30T22:57:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.118+0000 7efcc9bff700 1 -- 172.21.15.142:0/1209593477 wait complete. 2023-09-30T22:57:53.136 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T22:57:53.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:57:53.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.325+0000 7fb5a51ff700 1 Processor -- start 2023-09-30T22:57:53.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.325+0000 7fb5a51ff700 1 -- start start 2023-09-30T22:57:53.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.326+0000 7fb5a51ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5a00af020 0x7fb5a0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:53.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.326+0000 7fb5a51ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a006e820 0x7fb5a015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:53.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.326+0000 7fb5a51ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a006d3e0 con 0x7fb5a00b00d0 2023-09-30T22:57:53.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.326+0000 7fb5a51ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a006dc80 con 0x7fb5a00af020 2023-09-30T22:57:53.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.326+0000 7fb5a51ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a006eca0 con 0x7fb5a006e820 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb5a00b00d0 0x7fb5a006e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51132/0 (socket says 172.21.15.142:51132) 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59e59c700 1 -- 172.21.15.142:0/2565452922 learned_addr learned my addr 172.21.15.142:0/2565452922 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59ed9d700 1 --2- 172.21.15.142:0/2565452922 >> v2:172.21.15.148:3300/0 conn(0x7fb5a00af020 0x7fb5a0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59f59e700 1 --2- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a006e820 0x7fb5a015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59dd9b700 1 -- 172.21.15.142:0/2565452922 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995884132 0 0) 0x7fb5a006d3e0 con 0x7fb5a00b00d0 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59dd9b700 1 -- 172.21.15.142:0/2565452922 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb588003570 con 0x7fb5a00b00d0 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59ed9d700 1 -- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a006e820 msgr2=0x7fb5a015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59ed9d700 1 --2- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a006e820 0x7fb5a015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59ed9d700 1 -- 172.21.15.142:0/2565452922 >> v1:172.21.15.142:6789/0 conn(0x7fb5a00b00d0 legacy=0x7fb5a006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59ed9d700 1 -- 172.21.15.142:0/2565452922 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a006b790 con 0x7fb5a00af020 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59f59e700 1 --2- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a006e820 0x7fb5a015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:53.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.327+0000 7fb59ed9d700 1 --2- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 0x7fb5a0156d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb5900098e0 tx=0x7fb5900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1883b109f9a9a5b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb59dd9b700 1 -- 172.21.15.142:0/2565452922 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590011630 con 0x7fb5a00af020 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb59dd9b700 1 -- 172.21.15.142:0/2565452922 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb590011790 con 0x7fb5a00af020 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb59dd9b700 1 -- 172.21.15.142:0/2565452922 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590011b30 con 0x7fb5a00af020 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 msgr2=0x7fb5a0156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 0x7fb5a0156d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb5900098e0 tx=0x7fb5900091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2565452922 shutdown_connections 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 0x7fb5a0156d80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2565452922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a006e820 0x7fb5a015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2565452922 >> 172.21.15.142:0/2565452922 conn(0x7fb5a00680c0 msgr2=0x7fb5a00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2565452922 shutdown_connections 2023-09-30T22:57:53.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.328+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2565452922 wait complete. 2023-09-30T22:57:53.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.330+0000 7fb5a51ff700 1 Processor -- start 2023-09-30T22:57:53.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.330+0000 7fb5a51ff700 1 -- start start 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb5a51ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a006e820 0x7fb5a0151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb5a51ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 0x7fb5a015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb5a51ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a00b00d0 0x7fb5a014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb5a51ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c65c0 con 0x7fb5a006e820 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb5a51ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0152010 con 0x7fb5a00af020 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb5a51ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a01515b0 con 0x7fb5a00b00d0 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb59ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a006e820 0x7fb5a0151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb59ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a006e820 0x7fb5a0151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46154/0 (socket says 172.21.15.142:46154) 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb59ed9d700 1 -- 172.21.15.142:0/2941879980 learned_addr learned my addr 172.21.15.142:0/2941879980 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb59e59c700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 0x7fb5a015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb59f59e700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a00b00d0 0x7fb5a014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb59ed9d700 1 -- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a00b00d0 msgr2=0x7fb5a014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.331+0000 7fb59ed9d700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a00b00d0 0x7fb5a014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb59ed9d700 1 -- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 msgr2=0x7fb5a015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb59ed9d700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 0x7fb5a015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb59ed9d700 1 -- 172.21.15.142:0/2941879980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598009a20 con 0x7fb5a006e820 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb59f59e700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a00b00d0 0x7fb5a014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb59ed9d700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a006e820 0x7fb5a0151ad0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0068600 tx=0x7fb590017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb586ffd700 1 -- 172.21.15.142:0/2941879980 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590011b10 con 0x7fb5a006e820 2023-09-30T22:57:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb586ffd700 1 -- 172.21.15.142:0/2941879980 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5900253f0 con 0x7fb5a006e820 2023-09-30T22:57:53.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb586ffd700 1 -- 172.21.15.142:0/2941879980 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5900257b0 con 0x7fb5a006e820 2023-09-30T22:57:53.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb590009420 con 0x7fb5a006e820 2023-09-30T22:57:53.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.332+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a016dad0 con 0x7fb5a006e820 2023-09-30T22:57:53.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.333+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00695b0 con 0x7fb5a006e820 2023-09-30T22:57:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.334+0000 7fb586ffd700 1 -- 172.21.15.142:0/2941879980 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb590025ba0 con 0x7fb5a006e820 2023-09-30T22:57:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.335+0000 7fb586ffd700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb58c067330 0x7fb58c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.335+0000 7fb586ffd700 1 -- 172.21.15.142:0/2941879980 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb5900864d0 con 0x7fb5a006e820 2023-09-30T22:57:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.335+0000 7fb59e59c700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb58c067330 0x7fb58c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.336+0000 7fb59e59c700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb58c067330 0x7fb58c0697e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0155a40 tx=0x7fb594009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:53.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.339+0000 7fb586ffd700 1 -- 172.21.15.142:0/2941879980 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb590053330 con 0x7fb5a006e820 2023-09-30T22:57:53.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.528+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5a006fc10 con 0x7fb58c067330 2023-09-30T22:57:53.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.536+0000 7fb586ffd700 1 -- 172.21.15.142:0/2941879980 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303175 (secure 0 0 0) 0x7fb5a006fc10 con 0x7fb58c067330 2023-09-30T22:57:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:53.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb58c067330 msgr2=0x7fb58c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb58c067330 0x7fb58c0697e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0155a40 tx=0x7fb594009040 comp rx=0 tx=0).stop 2023-09-30T22:57:53.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a006e820 msgr2=0x7fb5a0151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:53.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a006e820 0x7fb5a0151ad0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0068600 tx=0x7fb590017000 comp rx=0 tx=0).stop 2023-09-30T22:57:53.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 shutdown_connections 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb58c067330 0x7fb58c0697e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5a00b00d0 0x7fb5a014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a006e820 0x7fb5a0151ad0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 --2- 172.21.15.142:0/2941879980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a00af020 0x7fb5a015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 >> 172.21.15.142:0/2941879980 conn(0x7fb5a00680c0 msgr2=0x7fb5a0154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 shutdown_connections 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:53.541+0000 7fb5a51ff700 1 -- 172.21.15.142:0/2941879980 wait complete. 2023-09-30T22:57:53.544 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:57:53.559 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2023-09-30T22:57:52.175750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6186,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556313,"statfs":{"total":1600000000,"available":1593665140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001323"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359075+0000","last_change":"2023-09-30T22:57:47.358770+0000","last_active":"2023-09-30T22:57:47.359075+0000","last_peered":"2023-09-30T22:57:47.359075+0000","last_clean":"2023-09-30T22:57:47.359075+0000","last_became_active":"2023-09-30T22:57:47.358552+0000","last_became_peered":"2023-09-30T22:57:47.358552+0000","last_unstale":"2023-09-30T22:57:47.359075+0000","last_undegraded":"2023-09-30T22:57:47.359075+0000","last_fullsized":"2023-09-30T22:57:47.359075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:57.316255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347445+0000","last_change":"2023-09-30T22:57:47.347285+0000","last_active":"2023-09-30T22:57:47.347445+0000","last_peered":"2023-09-30T22:57:47.347445+0000","last_clean":"2023-09-30T22:57:47.347445+0000","last_became_active":"2023-09-30T22:57:47.347012+0000","last_became_peered":"2023-09-30T22:57:47.347012+0000","last_unstale":"2023-09-30T22:57:47.347445+0000","last_undegraded":"2023-09-30T22:57:47.347445+0000","last_fullsized":"2023-09-30T22:57:47.347445+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:37.162388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357441+0000","last_change":"2023-09-30T22:57:47.357352+0000","last_active":"2023-09-30T22:57:47.357441+0000","last_peered":"2023-09-30T22:57:47.357441+0000","last_clean":"2023-09-30T22:57:47.357441+0000","last_became_active":"2023-09-30T22:57:47.357097+0000","last_became_peered":"2023-09-30T22:57:47.357097+0000","last_unstale":"2023-09-30T22:57:47.357441+0000","last_undegraded":"2023-09-30T22:57:47.357441+0000","last_fullsized":"2023-09-30T22:57:47.357441+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:57.307570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345889+0000","last_change":"2023-09-30T22:57:47.345202+0000","last_active":"2023-09-30T22:57:47.345889+0000","last_peered":"2023-09-30T22:57:47.345889+0000","last_clean":"2023-09-30T22:57:47.345889+0000","last_became_active":"2023-09-30T22:57:47.344674+0000","last_became_peered":"2023-09-30T22:57:47.344674+0000","last_unstale":"2023-09-30T22:57:47.345889+0000","last_undegraded":"2023-09-30T22:57:47.345889+0000","last_fullsized":"2023-09-30T22:57:47.345889+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:29.271352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355245+0000","last_change":"2023-09-30T22:57:47.354137+0000","last_active":"2023-09-30T22:57:47.355245+0000","last_peered":"2023-09-30T22:57:47.355245+0000","last_clean":"2023-09-30T22:57:47.355245+0000","last_became_active":"2023-09-30T22:57:47.352452+0000","last_became_peered":"2023-09-30T22:57:47.352452+0000","last_unstale":"2023-09-30T22:57:47.355245+0000","last_undegraded":"2023-09-30T22:57:47.355245+0000","last_fullsized":"2023-09-30T22:57:47.355245+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:24.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351148+0000","last_change":"2023-09-30T22:57:47.351077+0000","last_active":"2023-09-30T22:57:47.351148+0000","last_peered":"2023-09-30T22:57:47.351148+0000","last_clean":"2023-09-30T22:57:47.351148+0000","last_became_active":"2023-09-30T22:57:47.350336+0000","last_became_peered":"2023-09-30T22:57:47.350336+0000","last_unstale":"2023-09-30T22:57:47.351148+0000","last_undegraded":"2023-09-30T22:57:47.351148+0000","last_fullsized":"2023-09-30T22:57:47.351148+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:25:16.153993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344376+0000","last_change":"2023-09-30T22:57:47.344329+0000","last_active":"2023-09-30T22:57:47.344376+0000","last_peered":"2023-09-30T22:57:47.344376+0000","last_clean":"2023-09-30T22:57:47.344376+0000","last_became_active":"2023-09-30T22:57:47.344106+0000","last_became_peered":"2023-09-30T22:57:47.344106+0000","last_unstale":"2023-09-30T22:57:47.344376+0000","last_undegraded":"2023-09-30T22:57:47.344376+0000","last_fullsized":"2023-09-30T22:57:47.344376+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:03.436048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349767+0000","last_change":"2023-09-30T22:57:47.349592+0000","last_active":"2023-09-30T22:57:47.349767+0000","last_peered":"2023-09-30T22:57:47.349767+0000","last_clean":"2023-09-30T22:57:47.349767+0000","last_became_active":"2023-09-30T22:57:47.349100+0000","last_became_peered":"2023-09-30T22:57:47.349100+0000","last_unstale":"2023-09-30T22:57:47.349767+0000","last_undegraded":"2023-09-30T22:57:47.349767+0000","last_fullsized":"2023-09-30T22:57:47.349767+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346945+0000","last_change":"2023-09-30T22:57:47.346890+0000","last_active":"2023-09-30T22:57:47.346945+0000","last_peered":"2023-09-30T22:57:47.346945+0000","last_clean":"2023-09-30T22:57:47.346945+0000","last_became_active":"2023-09-30T22:57:47.346670+0000","last_became_peered":"2023-09-30T22:57:47.346670+0000","last_unstale":"2023-09-30T22:57:47.346945+0000","last_undegraded":"2023-09-30T22:57:47.346945+0000","last_fullsized":"2023-09-30T22:57:47.346945+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:27:08.010448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346572+0000","last_change":"2023-09-30T22:57:47.346469+0000","last_active":"2023-09-30T22:57:47.346572+0000","last_peered":"2023-09-30T22:57:47.346572+0000","last_clean":"2023-09-30T22:57:47.346572+0000","last_became_active":"2023-09-30T22:57:47.346055+0000","last_became_peered":"2023-09-30T22:57:47.346055+0000","last_unstale":"2023-09-30T22:57:47.346572+0000","last_undegraded":"2023-09-30T22:57:47.346572+0000","last_fullsized":"2023-09-30T22:57:47.346572+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344921+0000","last_change":"2023-09-30T22:57:47.344771+0000","last_active":"2023-09-30T22:57:47.344921+0000","last_peered":"2023-09-30T22:57:47.344921+0000","last_clean":"2023-09-30T22:57:47.344921+0000","last_became_active":"2023-09-30T22:57:47.344548+0000","last_became_peered":"2023-09-30T22:57:47.344548+0000","last_unstale":"2023-09-30T22:57:47.344921+0000","last_undegraded":"2023-09-30T22:57:47.344921+0000","last_fullsized":"2023-09-30T22:57:47.344921+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:53.689308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347591+0000","last_change":"2023-09-30T22:57:47.347422+0000","last_active":"2023-09-30T22:57:47.347591+0000","last_peered":"2023-09-30T22:57:47.347591+0000","last_clean":"2023-09-30T22:57:47.347591+0000","last_became_active":"2023-09-30T22:57:47.347186+0000","last_became_peered":"2023-09-30T22:57:47.347186+0000","last_unstale":"2023-09-30T22:57:47.347591+0000","last_undegraded":"2023-09-30T22:57:47.347591+0000","last_fullsized":"2023-09-30T22:57:47.347591+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359459+0000","last_change":"2023-09-30T22:57:47.357297+0000","last_active":"2023-09-30T22:57:47.359459+0000","last_peered":"2023-09-30T22:57:47.359459+0000","last_clean":"2023-09-30T22:57:47.359459+0000","last_became_active":"2023-09-30T22:57:47.357069+0000","last_became_peered":"2023-09-30T22:57:47.357069+0000","last_unstale":"2023-09-30T22:57:47.359459+0000","last_undegraded":"2023-09-30T22:57:47.359459+0000","last_fullsized":"2023-09-30T22:57:47.359459+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.350974+0000","last_change":"2023-09-30T22:57:47.350409+0000","last_active":"2023-09-30T22:57:47.350974+0000","last_peered":"2023-09-30T22:57:47.350974+0000","last_clean":"2023-09-30T22:57:47.350974+0000","last_became_active":"2023-09-30T22:57:47.350186+0000","last_became_peered":"2023-09-30T22:57:47.350186+0000","last_unstale":"2023-09-30T22:57:47.350974+0000","last_undegraded":"2023-09-30T22:57:47.350974+0000","last_fullsized":"2023-09-30T22:57:47.350974+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:54.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346457+0000","last_change":"2023-09-30T22:57:47.346320+0000","last_active":"2023-09-30T22:57:47.346457+0000","last_peered":"2023-09-30T22:57:47.346457+0000","last_clean":"2023-09-30T22:57:47.346457+0000","last_became_active":"2023-09-30T22:57:47.345715+0000","last_became_peered":"2023-09-30T22:57:47.345715+0000","last_unstale":"2023-09-30T22:57:47.346457+0000","last_undegraded":"2023-09-30T22:57:47.346457+0000","last_fullsized":"2023-09-30T22:57:47.346457+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351118+0000","last_change":"2023-09-30T22:57:47.350778+0000","last_active":"2023-09-30T22:57:47.351118+0000","last_peered":"2023-09-30T22:57:47.351118+0000","last_clean":"2023-09-30T22:57:47.351118+0000","last_became_active":"2023-09-30T22:57:47.349662+0000","last_became_peered":"2023-09-30T22:57:47.349662+0000","last_unstale":"2023-09-30T22:57:47.351118+0000","last_undegraded":"2023-09-30T22:57:47.351118+0000","last_fullsized":"2023-09-30T22:57:47.351118+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:34.970083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357498+0000","last_change":"2023-09-30T22:57:47.356479+0000","last_active":"2023-09-30T22:57:47.357498+0000","last_peered":"2023-09-30T22:57:47.357498+0000","last_clean":"2023-09-30T22:57:47.357498+0000","last_became_active":"2023-09-30T22:57:47.356238+0000","last_became_peered":"2023-09-30T22:57:47.356238+0000","last_unstale":"2023-09-30T22:57:47.357498+0000","last_undegraded":"2023-09-30T22:57:47.357498+0000","last_fullsized":"2023-09-30T22:57:47.357498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:37.162388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348181+0000","last_change":"2023-09-30T22:57:47.348104+0000","last_active":"2023-09-30T22:57:47.348181+0000","last_peered":"2023-09-30T22:57:47.348181+0000","last_clean":"2023-09-30T22:57:47.348181+0000","last_became_active":"2023-09-30T22:57:47.347686+0000","last_became_peered":"2023-09-30T22:57:47.347686+0000","last_unstale":"2023-09-30T22:57:47.348181+0000","last_undegraded":"2023-09-30T22:57:47.348181+0000","last_fullsized":"2023-09-30T22:57:47.348181+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349847+0000","last_change":"2023-09-30T22:57:47.349736+0000","last_active":"2023-09-30T22:57:47.349847+0000","last_peered":"2023-09-30T22:57:47.349847+0000","last_clean":"2023-09-30T22:57:47.349847+0000","last_became_active":"2023-09-30T22:57:47.349333+0000","last_became_peered":"2023-09-30T22:57:47.349333+0000","last_unstale":"2023-09-30T22:57:47.349847+0000","last_undegraded":"2023-09-30T22:57:47.349847+0000","last_fullsized":"2023-09-30T22:57:47.349847+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348597+0000","last_change":"2023-09-30T22:57:47.344043+0000","last_active":"2023-09-30T22:57:47.348597+0000","last_peered":"2023-09-30T22:57:47.348597+0000","last_clean":"2023-09-30T22:57:47.348597+0000","last_became_active":"2023-09-30T22:57:47.343597+0000","last_became_peered":"2023-09-30T22:57:47.343597+0000","last_unstale":"2023-09-30T22:57:47.348597+0000","last_undegraded":"2023-09-30T22:57:47.348597+0000","last_fullsized":"2023-09-30T22:57:47.348597+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:33:14.420556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348092+0000","last_change":"2023-09-30T22:57:47.347969+0000","last_active":"2023-09-30T22:57:47.348092+0000","last_peered":"2023-09-30T22:57:47.348092+0000","last_clean":"2023-09-30T22:57:47.348092+0000","last_became_active":"2023-09-30T22:57:47.347393+0000","last_became_peered":"2023-09-30T22:57:47.347393+0000","last_unstale":"2023-09-30T22:57:47.348092+0000","last_undegraded":"2023-09-30T22:57:47.348092+0000","last_fullsized":"2023-09-30T22:57:47.348092+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352001+0000","last_change":"2023-09-30T22:57:47.351930+0000","last_active":"2023-09-30T22:57:47.352001+0000","last_peered":"2023-09-30T22:57:47.352001+0000","last_clean":"2023-09-30T22:57:47.352001+0000","last_became_active":"2023-09-30T22:57:47.351708+0000","last_became_peered":"2023-09-30T22:57:47.351708+0000","last_unstale":"2023-09-30T22:57:47.352001+0000","last_undegraded":"2023-09-30T22:57:47.352001+0000","last_fullsized":"2023-09-30T22:57:47.352001+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357142+0000","last_change":"2023-09-30T22:57:47.357071+0000","last_active":"2023-09-30T22:57:47.357142+0000","last_peered":"2023-09-30T22:57:47.357142+0000","last_clean":"2023-09-30T22:57:47.357142+0000","last_became_active":"2023-09-30T22:57:47.356848+0000","last_became_peered":"2023-09-30T22:57:47.356848+0000","last_unstale":"2023-09-30T22:57:47.357142+0000","last_undegraded":"2023-09-30T22:57:47.357142+0000","last_fullsized":"2023-09-30T22:57:47.357142+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:59.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347881+0000","last_change":"2023-09-30T22:57:47.347788+0000","last_active":"2023-09-30T22:57:47.347881+0000","last_peered":"2023-09-30T22:57:47.347881+0000","last_clean":"2023-09-30T22:57:47.347881+0000","last_became_active":"2023-09-30T22:57:47.347347+0000","last_became_peered":"2023-09-30T22:57:47.347347+0000","last_unstale":"2023-09-30T22:57:47.347881+0000","last_undegraded":"2023-09-30T22:57:47.347881+0000","last_fullsized":"2023-09-30T22:57:47.347881+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:58.623724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355227+0000","last_change":"2023-09-30T22:57:47.354001+0000","last_active":"2023-09-30T22:57:47.355227+0000","last_peered":"2023-09-30T22:57:47.355227+0000","last_clean":"2023-09-30T22:57:47.355227+0000","last_became_active":"2023-09-30T22:57:47.352197+0000","last_became_peered":"2023-09-30T22:57:47.352197+0000","last_unstale":"2023-09-30T22:57:47.355227+0000","last_undegraded":"2023-09-30T22:57:47.355227+0000","last_fullsized":"2023-09-30T22:57:47.355227+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:48.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348204+0000","last_change":"2023-09-30T22:57:47.348108+0000","last_active":"2023-09-30T22:57:47.348204+0000","last_peered":"2023-09-30T22:57:47.348204+0000","last_clean":"2023-09-30T22:57:47.348204+0000","last_became_active":"2023-09-30T22:57:47.347732+0000","last_became_peered":"2023-09-30T22:57:47.347732+0000","last_unstale":"2023-09-30T22:57:47.348204+0000","last_undegraded":"2023-09-30T22:57:47.348204+0000","last_fullsized":"2023-09-30T22:57:47.348204+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:56.277804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357378+0000","last_change":"2023-09-30T22:57:47.355441+0000","last_active":"2023-09-30T22:57:47.357378+0000","last_peered":"2023-09-30T22:57:47.357378+0000","last_clean":"2023-09-30T22:57:47.357378+0000","last_became_active":"2023-09-30T22:57:47.354914+0000","last_became_peered":"2023-09-30T22:57:47.354914+0000","last_unstale":"2023-09-30T22:57:47.357378+0000","last_undegraded":"2023-09-30T22:57:47.357378+0000","last_fullsized":"2023-09-30T22:57:47.357378+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355077+0000","last_change":"2023-09-30T22:57:47.353946+0000","last_active":"2023-09-30T22:57:47.355077+0000","last_peered":"2023-09-30T22:57:47.355077+0000","last_clean":"2023-09-30T22:57:47.355077+0000","last_became_active":"2023-09-30T22:57:47.353359+0000","last_became_peered":"2023-09-30T22:57:47.353359+0000","last_unstale":"2023-09-30T22:57:47.355077+0000","last_undegraded":"2023-09-30T22:57:47.355077+0000","last_fullsized":"2023-09-30T22:57:47.355077+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346878+0000","last_change":"2023-09-30T22:57:47.346307+0000","last_active":"2023-09-30T22:57:47.346878+0000","last_peered":"2023-09-30T22:57:47.346878+0000","last_clean":"2023-09-30T22:57:47.346878+0000","last_became_active":"2023-09-30T22:57:47.345984+0000","last_became_peered":"2023-09-30T22:57:47.345984+0000","last_unstale":"2023-09-30T22:57:47.346878+0000","last_undegraded":"2023-09-30T22:57:47.346878+0000","last_fullsized":"2023-09-30T22:57:47.346878+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:27.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355259+0000","last_change":"2023-09-30T22:57:47.355183+0000","last_active":"2023-09-30T22:57:47.355259+0000","last_peered":"2023-09-30T22:57:47.355259+0000","last_clean":"2023-09-30T22:57:47.355259+0000","last_became_active":"2023-09-30T22:57:47.353063+0000","last_became_peered":"2023-09-30T22:57:47.353063+0000","last_unstale":"2023-09-30T22:57:47.355259+0000","last_undegraded":"2023-09-30T22:57:47.355259+0000","last_fullsized":"2023-09-30T22:57:47.355259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349807+0000","last_change":"2023-09-30T22:57:47.349384+0000","last_active":"2023-09-30T22:57:47.349807+0000","last_peered":"2023-09-30T22:57:47.349807+0000","last_clean":"2023-09-30T22:57:47.349807+0000","last_became_active":"2023-09-30T22:57:47.349103+0000","last_became_peered":"2023-09-30T22:57:47.349103+0000","last_unstale":"2023-09-30T22:57:47.349807+0000","last_undegraded":"2023-09-30T22:57:47.349807+0000","last_fullsized":"2023-09-30T22:57:47.349807+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351103+0000","last_change":"2023-09-30T22:57:47.350745+0000","last_active":"2023-09-30T22:57:47.351103+0000","last_peered":"2023-09-30T22:57:47.351103+0000","last_clean":"2023-09-30T22:57:47.351103+0000","last_became_active":"2023-09-30T22:57:47.350260+0000","last_became_peered":"2023-09-30T22:57:47.350260+0000","last_unstale":"2023-09-30T22:57:47.351103+0000","last_undegraded":"2023-09-30T22:57:47.351103+0000","last_fullsized":"2023-09-30T22:57:47.351103+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353345+0000","last_change":"2023-09-30T22:57:47.353268+0000","last_active":"2023-09-30T22:57:47.353345+0000","last_peered":"2023-09-30T22:57:47.353345+0000","last_clean":"2023-09-30T22:57:47.353345+0000","last_became_active":"2023-09-30T22:57:47.352762+0000","last_became_peered":"2023-09-30T22:57:47.352762+0000","last_unstale":"2023-09-30T22:57:47.353345+0000","last_undegraded":"2023-09-30T22:57:47.353345+0000","last_fullsized":"2023-09-30T22:57:47.353345+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:00.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356320+0000","last_change":"2023-09-30T22:57:46.327869+0000","last_active":"2023-09-30T22:57:47.356320+0000","last_peered":"2023-09-30T22:57:47.356320+0000","last_clean":"2023-09-30T22:57:47.356320+0000","last_became_active":"2023-09-30T22:57:46.327406+0000","last_became_peered":"2023-09-30T22:57:46.327406+0000","last_unstale":"2023-09-30T22:57:47.356320+0000","last_undegraded":"2023-09-30T22:57:47.356320+0000","last_fullsized":"2023-09-30T22:57:47.356320+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:21.409395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348575+0000","last_change":"2023-09-30T22:57:47.343883+0000","last_active":"2023-09-30T22:57:47.348575+0000","last_peered":"2023-09-30T22:57:47.348575+0000","last_clean":"2023-09-30T22:57:47.348575+0000","last_became_active":"2023-09-30T22:57:47.343260+0000","last_became_peered":"2023-09-30T22:57:47.343260+0000","last_unstale":"2023-09-30T22:57:47.348575+0000","last_undegraded":"2023-09-30T22:57:47.348575+0000","last_fullsized":"2023-09-30T22:57:47.348575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:11.253908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352491+0000","last_change":"2023-09-30T22:57:46.325137+0000","last_active":"2023-09-30T22:57:47.352491+0000","last_peered":"2023-09-30T22:57:47.352491+0000","last_clean":"2023-09-30T22:57:47.352491+0000","last_became_active":"2023-09-30T22:57:46.324895+0000","last_became_peered":"2023-09-30T22:57:46.324895+0000","last_unstale":"2023-09-30T22:57:47.352491+0000","last_undegraded":"2023-09-30T22:57:47.352491+0000","last_fullsized":"2023-09-30T22:57:47.352491+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:43:30.607338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353966+0000","last_change":"2023-09-30T22:57:47.353291+0000","last_active":"2023-09-30T22:57:47.353966+0000","last_peered":"2023-09-30T22:57:47.353966+0000","last_clean":"2023-09-30T22:57:47.353966+0000","last_became_active":"2023-09-30T22:57:47.353046+0000","last_became_peered":"2023-09-30T22:57:47.353046+0000","last_unstale":"2023-09-30T22:57:47.353966+0000","last_undegraded":"2023-09-30T22:57:47.353966+0000","last_fullsized":"2023-09-30T22:57:47.353966+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:24.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353335+0000","last_change":"2023-09-30T22:57:46.330625+0000","last_active":"2023-09-30T22:57:47.353335+0000","last_peered":"2023-09-30T22:57:47.353335+0000","last_clean":"2023-09-30T22:57:47.353335+0000","last_became_active":"2023-09-30T22:57:46.330091+0000","last_became_peered":"2023-09-30T22:57:46.330091+0000","last_unstale":"2023-09-30T22:57:47.353335+0000","last_undegraded":"2023-09-30T22:57:47.353335+0000","last_fullsized":"2023-09-30T22:57:47.353335+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:37.900944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352636+0000","last_change":"2023-09-30T22:57:47.351921+0000","last_active":"2023-09-30T22:57:47.352636+0000","last_peered":"2023-09-30T22:57:47.352636+0000","last_clean":"2023-09-30T22:57:47.352636+0000","last_became_active":"2023-09-30T22:57:47.351615+0000","last_became_peered":"2023-09-30T22:57:47.351615+0000","last_unstale":"2023-09-30T22:57:47.352636+0000","last_undegraded":"2023-09-30T22:57:47.352636+0000","last_fullsized":"2023-09-30T22:57:47.352636+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355213+0000","last_change":"2023-09-30T22:57:46.325868+0000","last_active":"2023-09-30T22:57:47.355213+0000","last_peered":"2023-09-30T22:57:47.355213+0000","last_clean":"2023-09-30T22:57:47.355213+0000","last_became_active":"2023-09-30T22:57:46.325652+0000","last_became_peered":"2023-09-30T22:57:46.325652+0000","last_unstale":"2023-09-30T22:57:47.355213+0000","last_undegraded":"2023-09-30T22:57:47.355213+0000","last_fullsized":"2023-09-30T22:57:47.355213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:58:52.324524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355123+0000","last_change":"2023-09-30T22:57:47.355016+0000","last_active":"2023-09-30T22:57:47.355123+0000","last_peered":"2023-09-30T22:57:47.355123+0000","last_clean":"2023-09-30T22:57:47.355123+0000","last_became_active":"2023-09-30T22:57:47.354607+0000","last_became_peered":"2023-09-30T22:57:47.354607+0000","last_unstale":"2023-09-30T22:57:47.355123+0000","last_undegraded":"2023-09-30T22:57:47.355123+0000","last_fullsized":"2023-09-30T22:57:47.355123+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358110+0000","last_change":"2023-09-30T22:57:46.325950+0000","last_active":"2023-09-30T22:57:47.358110+0000","last_peered":"2023-09-30T22:57:47.358110+0000","last_clean":"2023-09-30T22:57:47.358110+0000","last_became_active":"2023-09-30T22:57:46.325694+0000","last_became_peered":"2023-09-30T22:57:46.325694+0000","last_unstale":"2023-09-30T22:57:47.358110+0000","last_undegraded":"2023-09-30T22:57:47.358110+0000","last_fullsized":"2023-09-30T22:57:47.358110+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:45.916234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344358+0000","last_change":"2023-09-30T22:57:47.344284+0000","last_active":"2023-09-30T22:57:47.344358+0000","last_peered":"2023-09-30T22:57:47.344358+0000","last_clean":"2023-09-30T22:57:47.344358+0000","last_became_active":"2023-09-30T22:57:47.343791+0000","last_became_peered":"2023-09-30T22:57:47.343791+0000","last_unstale":"2023-09-30T22:57:47.344358+0000","last_undegraded":"2023-09-30T22:57:47.344358+0000","last_fullsized":"2023-09-30T22:57:47.344358+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:27.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.361644+0000","last_change":"2023-09-30T22:57:46.320132+0000","last_active":"2023-09-30T22:57:47.361644+0000","last_peered":"2023-09-30T22:57:47.361644+0000","last_clean":"2023-09-30T22:57:47.361644+0000","last_became_active":"2023-09-30T22:57:46.319599+0000","last_became_peered":"2023-09-30T22:57:46.319599+0000","last_unstale":"2023-09-30T22:57:47.361644+0000","last_undegraded":"2023-09-30T22:57:47.361644+0000","last_fullsized":"2023-09-30T22:57:47.361644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349749+0000","last_change":"2023-09-30T22:57:47.349410+0000","last_active":"2023-09-30T22:57:47.349749+0000","last_peered":"2023-09-30T22:57:47.349749+0000","last_clean":"2023-09-30T22:57:47.349749+0000","last_became_active":"2023-09-30T22:57:47.348804+0000","last_became_peered":"2023-09-30T22:57:47.348804+0000","last_unstale":"2023-09-30T22:57:47.349749+0000","last_undegraded":"2023-09-30T22:57:47.349749+0000","last_fullsized":"2023-09-30T22:57:47.349749+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336709+0000","last_change":"2023-09-30T22:57:46.323796+0000","last_active":"2023-09-30T22:57:47.336709+0000","last_peered":"2023-09-30T22:57:47.336709+0000","last_clean":"2023-09-30T22:57:47.336709+0000","last_became_active":"2023-09-30T22:57:46.323523+0000","last_became_peered":"2023-09-30T22:57:46.323523+0000","last_unstale":"2023-09-30T22:57:47.336709+0000","last_undegraded":"2023-09-30T22:57:47.336709+0000","last_fullsized":"2023-09-30T22:57:47.336709+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:18:59.796566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345199+0000","last_change":"2023-09-30T22:57:47.344969+0000","last_active":"2023-09-30T22:57:47.345199+0000","last_peered":"2023-09-30T22:57:47.345199+0000","last_clean":"2023-09-30T22:57:47.345199+0000","last_became_active":"2023-09-30T22:57:47.344381+0000","last_became_peered":"2023-09-30T22:57:47.344381+0000","last_unstale":"2023-09-30T22:57:47.345199+0000","last_undegraded":"2023-09-30T22:57:47.345199+0000","last_fullsized":"2023-09-30T22:57:47.345199+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345555+0000","last_change":"2023-09-30T22:57:46.329838+0000","last_active":"2023-09-30T22:57:47.345555+0000","last_peered":"2023-09-30T22:57:47.345555+0000","last_clean":"2023-09-30T22:57:47.345555+0000","last_became_active":"2023-09-30T22:57:46.329311+0000","last_became_peered":"2023-09-30T22:57:46.329311+0000","last_unstale":"2023-09-30T22:57:47.345555+0000","last_undegraded":"2023-09-30T22:57:47.345555+0000","last_fullsized":"2023-09-30T22:57:47.345555+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:46:59.626736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358258+0000","last_change":"2023-09-30T22:57:47.358122+0000","last_active":"2023-09-30T22:57:47.358258+0000","last_peered":"2023-09-30T22:57:47.358258+0000","last_clean":"2023-09-30T22:57:47.358258+0000","last_became_active":"2023-09-30T22:57:47.357598+0000","last_became_peered":"2023-09-30T22:57:47.357598+0000","last_unstale":"2023-09-30T22:57:47.358258+0000","last_undegraded":"2023-09-30T22:57:47.358258+0000","last_fullsized":"2023-09-30T22:57:47.358258+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.342334+0000","last_change":"2023-09-30T22:57:46.326797+0000","last_active":"2023-09-30T22:57:47.342334+0000","last_peered":"2023-09-30T22:57:47.342334+0000","last_clean":"2023-09-30T22:57:47.342334+0000","last_became_active":"2023-09-30T22:57:46.326535+0000","last_became_peered":"2023-09-30T22:57:46.326535+0000","last_unstale":"2023-09-30T22:57:47.342334+0000","last_undegraded":"2023-09-30T22:57:47.342334+0000","last_fullsized":"2023-09-30T22:57:47.342334+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:59.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357908+0000","last_change":"2023-09-30T22:57:47.357746+0000","last_active":"2023-09-30T22:57:47.357908+0000","last_peered":"2023-09-30T22:57:47.357908+0000","last_clean":"2023-09-30T22:57:47.357908+0000","last_became_active":"2023-09-30T22:57:47.357300+0000","last_became_peered":"2023-09-30T22:57:47.357300+0000","last_unstale":"2023-09-30T22:57:47.357908+0000","last_undegraded":"2023-09-30T22:57:47.357908+0000","last_fullsized":"2023-09-30T22:57:47.357908+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:42:51.624488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337662+0000","last_change":"2023-09-30T22:57:46.328233+0000","last_active":"2023-09-30T22:57:47.337662+0000","last_peered":"2023-09-30T22:57:47.337662+0000","last_clean":"2023-09-30T22:57:47.337662+0000","last_became_active":"2023-09-30T22:57:46.328011+0000","last_became_peered":"2023-09-30T22:57:46.328011+0000","last_unstale":"2023-09-30T22:57:47.337662+0000","last_undegraded":"2023-09-30T22:57:47.337662+0000","last_fullsized":"2023-09-30T22:57:47.337662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:53.277996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347091+0000","last_change":"2023-09-30T22:57:47.345324+0000","last_active":"2023-09-30T22:57:47.347091+0000","last_peered":"2023-09-30T22:57:47.347091+0000","last_clean":"2023-09-30T22:57:47.347091+0000","last_became_active":"2023-09-30T22:57:47.344697+0000","last_became_peered":"2023-09-30T22:57:47.344697+0000","last_unstale":"2023-09-30T22:57:47.347091+0000","last_undegraded":"2023-09-30T22:57:47.347091+0000","last_fullsized":"2023-09-30T22:57:47.347091+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:22.413372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359778+0000","last_change":"2023-09-30T22:57:46.328096+0000","last_active":"2023-09-30T22:57:47.359778+0000","last_peered":"2023-09-30T22:57:47.359778+0000","last_clean":"2023-09-30T22:57:47.359778+0000","last_became_active":"2023-09-30T22:57:46.327733+0000","last_became_peered":"2023-09-30T22:57:46.327733+0000","last_unstale":"2023-09-30T22:57:47.359778+0000","last_undegraded":"2023-09-30T22:57:47.359778+0000","last_fullsized":"2023-09-30T22:57:47.359778+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:10.249931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351086+0000","last_change":"2023-09-30T22:57:47.350617+0000","last_active":"2023-09-30T22:57:47.351086+0000","last_peered":"2023-09-30T22:57:47.351086+0000","last_clean":"2023-09-30T22:57:47.351086+0000","last_became_active":"2023-09-30T22:57:47.349376+0000","last_became_peered":"2023-09-30T22:57:47.349376+0000","last_unstale":"2023-09-30T22:57:47.351086+0000","last_undegraded":"2023-09-30T22:57:47.351086+0000","last_fullsized":"2023-09-30T22:57:47.351086+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"110'6","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.362611+0000","last_change":"2023-09-30T22:57:46.326967+0000","last_active":"2023-09-30T22:57:47.362611+0000","last_peered":"2023-09-30T22:57:47.362611+0000","last_clean":"2023-09-30T22:57:47.362611+0000","last_became_active":"2023-09-30T22:57:46.326481+0000","last_became_peered":"2023-09-30T22:57:46.326481+0000","last_unstale":"2023-09-30T22:57:47.362611+0000","last_undegraded":"2023-09-30T22:57:47.362611+0000","last_fullsized":"2023-09-30T22:57:47.362611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:50.205703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359389+0000","last_change":"2023-09-30T22:57:47.359304+0000","last_active":"2023-09-30T22:57:47.359389+0000","last_peered":"2023-09-30T22:57:47.359389+0000","last_clean":"2023-09-30T22:57:47.359389+0000","last_became_active":"2023-09-30T22:57:47.358833+0000","last_became_peered":"2023-09-30T22:57:47.358833+0000","last_unstale":"2023-09-30T22:57:47.359389+0000","last_undegraded":"2023-09-30T22:57:47.359389+0000","last_fullsized":"2023-09-30T22:57:47.359389+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:45.574707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353583+0000","last_change":"2023-09-30T22:57:46.330755+0000","last_active":"2023-09-30T22:57:47.353583+0000","last_peered":"2023-09-30T22:57:47.353583+0000","last_clean":"2023-09-30T22:57:47.353583+0000","last_became_active":"2023-09-30T22:57:46.330373+0000","last_became_peered":"2023-09-30T22:57:46.330373+0000","last_unstale":"2023-09-30T22:57:47.353583+0000","last_undegraded":"2023-09-30T22:57:47.353583+0000","last_fullsized":"2023-09-30T22:57:47.353583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:53.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355719+0000","last_change":"2023-09-30T22:57:47.355654+0000","last_active":"2023-09-30T22:57:47.355719+0000","last_peered":"2023-09-30T22:57:47.355719+0000","last_clean":"2023-09-30T22:57:47.355719+0000","last_became_active":"2023-09-30T22:57:47.353273+0000","last_became_peered":"2023-09-30T22:57:47.353273+0000","last_unstale":"2023-09-30T22:57:47.355719+0000","last_undegraded":"2023-09-30T22:57:47.355719+0000","last_fullsized":"2023-09-30T22:57:47.355719+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:33:14.420556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336966+0000","last_change":"2023-09-30T22:57:46.327220+0000","last_active":"2023-09-30T22:57:47.336966+0000","last_peered":"2023-09-30T22:57:47.336966+0000","last_clean":"2023-09-30T22:57:47.336966+0000","last_became_active":"2023-09-30T22:57:46.326718+0000","last_became_peered":"2023-09-30T22:57:46.326718+0000","last_unstale":"2023-09-30T22:57:47.336966+0000","last_undegraded":"2023-09-30T22:57:47.336966+0000","last_fullsized":"2023-09-30T22:57:47.336966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:28.267376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.340878+0000","last_change":"2023-09-30T22:57:47.340802+0000","last_active":"2023-09-30T22:57:47.340878+0000","last_peered":"2023-09-30T22:57:47.340878+0000","last_clean":"2023-09-30T22:57:47.340878+0000","last_became_active":"2023-09-30T22:57:47.340563+0000","last_became_peered":"2023-09-30T22:57:47.340563+0000","last_unstale":"2023-09-30T22:57:47.340878+0000","last_undegraded":"2023-09-30T22:57:47.340878+0000","last_fullsized":"2023-09-30T22:57:47.340878+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:50:51.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336825+0000","last_change":"2023-09-30T22:57:46.326928+0000","last_active":"2023-09-30T22:57:47.336825+0000","last_peered":"2023-09-30T22:57:47.336825+0000","last_clean":"2023-09-30T22:57:47.336825+0000","last_became_active":"2023-09-30T22:57:46.326433+0000","last_became_peered":"2023-09-30T22:57:46.326433+0000","last_unstale":"2023-09-30T22:57:47.336825+0000","last_undegraded":"2023-09-30T22:57:47.336825+0000","last_fullsized":"2023-09-30T22:57:47.336825+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:57.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355109+0000","last_change":"2023-09-30T22:57:47.354855+0000","last_active":"2023-09-30T22:57:47.355109+0000","last_peered":"2023-09-30T22:57:47.355109+0000","last_clean":"2023-09-30T22:57:47.355109+0000","last_became_active":"2023-09-30T22:57:47.354277+0000","last_became_peered":"2023-09-30T22:57:47.354277+0000","last_unstale":"2023-09-30T22:57:47.355109+0000","last_undegraded":"2023-09-30T22:57:47.355109+0000","last_fullsized":"2023-09-30T22:57:47.355109+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"110'8","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.360417+0000","last_change":"2023-09-30T22:57:46.327580+0000","last_active":"2023-09-30T22:57:47.360417+0000","last_peered":"2023-09-30T22:57:47.360417+0000","last_clean":"2023-09-30T22:57:47.360417+0000","last_became_active":"2023-09-30T22:57:46.327347+0000","last_became_peered":"2023-09-30T22:57:46.327347+0000","last_unstale":"2023-09-30T22:57:47.360417+0000","last_undegraded":"2023-09-30T22:57:47.360417+0000","last_fullsized":"2023-09-30T22:57:47.360417+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:22.893668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349980+0000","last_change":"2023-09-30T22:57:47.349864+0000","last_active":"2023-09-30T22:57:47.349980+0000","last_peered":"2023-09-30T22:57:47.349980+0000","last_clean":"2023-09-30T22:57:47.349980+0000","last_became_active":"2023-09-30T22:57:47.349662+0000","last_became_peered":"2023-09-30T22:57:47.349662+0000","last_unstale":"2023-09-30T22:57:47.349980+0000","last_undegraded":"2023-09-30T22:57:47.349980+0000","last_fullsized":"2023-09-30T22:57:47.349980+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354472+0000","last_change":"2023-09-30T22:57:46.324881+0000","last_active":"2023-09-30T22:57:47.354472+0000","last_peered":"2023-09-30T22:57:47.354472+0000","last_clean":"2023-09-30T22:57:47.354472+0000","last_became_active":"2023-09-30T22:57:46.324629+0000","last_became_peered":"2023-09-30T22:57:46.324629+0000","last_unstale":"2023-09-30T22:57:47.354472+0000","last_undegraded":"2023-09-30T22:57:47.354472+0000","last_fullsized":"2023-09-30T22:57:47.354472+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:51.004328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352704+0000","last_change":"2023-09-30T22:57:47.352586+0000","last_active":"2023-09-30T22:57:47.352704+0000","last_peered":"2023-09-30T22:57:47.352704+0000","last_clean":"2023-09-30T22:57:47.352704+0000","last_became_active":"2023-09-30T22:57:47.352184+0000","last_became_peered":"2023-09-30T22:57:47.352184+0000","last_unstale":"2023-09-30T22:57:47.352704+0000","last_undegraded":"2023-09-30T22:57:47.352704+0000","last_fullsized":"2023-09-30T22:57:47.352704+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-09-30T22:57:49.697050+0000","last_change":"2023-09-30T22:57:46.330434+0000","last_active":"2023-09-30T22:57:49.697050+0000","last_peered":"2023-09-30T22:57:49.697050+0000","last_clean":"2023-09-30T22:57:49.697050+0000","last_became_active":"2023-09-30T22:57:46.330220+0000","last_became_peered":"2023-09-30T22:57:46.330220+0000","last_unstale":"2023-09-30T22:57:49.697050+0000","last_undegraded":"2023-09-30T22:57:49.697050+0000","last_fullsized":"2023-09-30T22:57:49.697050+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:36.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355094+0000","last_change":"2023-09-30T22:57:47.354174+0000","last_active":"2023-09-30T22:57:47.355094+0000","last_peered":"2023-09-30T22:57:47.355094+0000","last_clean":"2023-09-30T22:57:47.355094+0000","last_became_active":"2023-09-30T22:57:47.353694+0000","last_became_peered":"2023-09-30T22:57:47.353694+0000","last_unstale":"2023-09-30T22:57:47.355094+0000","last_undegraded":"2023-09-30T22:57:47.355094+0000","last_fullsized":"2023-09-30T22:57:47.355094+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.341428+0000","last_change":"2023-09-30T22:57:46.326357+0000","last_active":"2023-09-30T22:57:47.341428+0000","last_peered":"2023-09-30T22:57:47.341428+0000","last_clean":"2023-09-30T22:57:47.341428+0000","last_became_active":"2023-09-30T22:57:46.326124+0000","last_became_peered":"2023-09-30T22:57:46.326124+0000","last_unstale":"2023-09-30T22:57:47.341428+0000","last_undegraded":"2023-09-30T22:57:47.341428+0000","last_fullsized":"2023-09-30T22:57:47.341428+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355581+0000","last_change":"2023-09-30T22:57:47.355504+0000","last_active":"2023-09-30T22:57:47.355581+0000","last_peered":"2023-09-30T22:57:47.355581+0000","last_clean":"2023-09-30T22:57:47.355581+0000","last_became_active":"2023-09-30T22:57:47.352945+0000","last_became_peered":"2023-09-30T22:57:47.352945+0000","last_unstale":"2023-09-30T22:57:47.355581+0000","last_undegraded":"2023-09-30T22:57:47.355581+0000","last_fullsized":"2023-09-30T22:57:47.355581+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:11.253908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337429+0000","last_change":"2023-09-30T22:57:46.321470+0000","last_active":"2023-09-30T22:57:47.337429+0000","last_peered":"2023-09-30T22:57:47.337429+0000","last_clean":"2023-09-30T22:57:47.337429+0000","last_became_active":"2023-09-30T22:57:46.321233+0000","last_became_peered":"2023-09-30T22:57:46.321233+0000","last_unstale":"2023-09-30T22:57:47.337429+0000","last_undegraded":"2023-09-30T22:57:47.337429+0000","last_fullsized":"2023-09-30T22:57:47.337429+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:58.334725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354191+0000","last_change":"2023-09-30T22:57:47.354114+0000","last_active":"2023-09-30T22:57:47.354191+0000","last_peered":"2023-09-30T22:57:47.354191+0000","last_clean":"2023-09-30T22:57:47.354191+0000","last_became_active":"2023-09-30T22:57:47.353887+0000","last_became_peered":"2023-09-30T22:57:47.353887+0000","last_unstale":"2023-09-30T22:57:47.354191+0000","last_undegraded":"2023-09-30T22:57:47.354191+0000","last_fullsized":"2023-09-30T22:57:47.354191+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:47:27.062944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336851+0000","last_change":"2023-09-30T22:57:46.323408+0000","last_active":"2023-09-30T22:57:47.336851+0000","last_peered":"2023-09-30T22:57:47.336851+0000","last_clean":"2023-09-30T22:57:47.336851+0000","last_became_active":"2023-09-30T22:57:46.322636+0000","last_became_peered":"2023-09-30T22:57:46.322636+0000","last_unstale":"2023-09-30T22:57:47.336851+0000","last_undegraded":"2023-09-30T22:57:47.336851+0000","last_fullsized":"2023-09-30T22:57:47.336851+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:00.151513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345920+0000","last_change":"2023-09-30T22:57:47.345338+0000","last_active":"2023-09-30T22:57:47.345920+0000","last_peered":"2023-09-30T22:57:47.345920+0000","last_clean":"2023-09-30T22:57:47.345920+0000","last_became_active":"2023-09-30T22:57:47.345110+0000","last_became_peered":"2023-09-30T22:57:47.345110+0000","last_unstale":"2023-09-30T22:57:47.345920+0000","last_undegraded":"2023-09-30T22:57:47.345920+0000","last_fullsized":"2023-09-30T22:57:47.345920+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343405+0000","last_change":"2023-09-30T22:57:46.327259+0000","last_active":"2023-09-30T22:57:47.343405+0000","last_peered":"2023-09-30T22:57:47.343405+0000","last_clean":"2023-09-30T22:57:47.343405+0000","last_became_active":"2023-09-30T22:57:46.326989+0000","last_became_peered":"2023-09-30T22:57:46.326989+0000","last_unstale":"2023-09-30T22:57:47.343405+0000","last_undegraded":"2023-09-30T22:57:47.343405+0000","last_fullsized":"2023-09-30T22:57:47.343405+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354041+0000","last_change":"2023-09-30T22:57:47.353846+0000","last_active":"2023-09-30T22:57:47.354041+0000","last_peered":"2023-09-30T22:57:47.354041+0000","last_clean":"2023-09-30T22:57:47.354041+0000","last_became_active":"2023-09-30T22:57:47.353595+0000","last_became_peered":"2023-09-30T22:57:47.353595+0000","last_unstale":"2023-09-30T22:57:47.354041+0000","last_undegraded":"2023-09-30T22:57:47.354041+0000","last_fullsized":"2023-09-30T22:57:47.354041+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349990+0000","last_change":"2023-09-30T22:57:46.327694+0000","last_active":"2023-09-30T22:57:47.349990+0000","last_peered":"2023-09-30T22:57:47.349990+0000","last_clean":"2023-09-30T22:57:47.349990+0000","last_became_active":"2023-09-30T22:57:46.327163+0000","last_became_peered":"2023-09-30T22:57:46.327163+0000","last_unstale":"2023-09-30T22:57:47.349990+0000","last_undegraded":"2023-09-30T22:57:47.349990+0000","last_fullsized":"2023-09-30T22:57:47.349990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:56.303593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351132+0000","last_change":"2023-09-30T22:57:47.350939+0000","last_active":"2023-09-30T22:57:47.351132+0000","last_peered":"2023-09-30T22:57:47.351132+0000","last_clean":"2023-09-30T22:57:47.351132+0000","last_became_active":"2023-09-30T22:57:47.349984+0000","last_became_peered":"2023-09-30T22:57:47.349984+0000","last_unstale":"2023-09-30T22:57:47.351132+0000","last_undegraded":"2023-09-30T22:57:47.351132+0000","last_fullsized":"2023-09-30T22:57:47.351132+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:52.008304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343214+0000","last_change":"2023-09-30T22:57:46.326830+0000","last_active":"2023-09-30T22:57:47.343214+0000","last_peered":"2023-09-30T22:57:47.343214+0000","last_clean":"2023-09-30T22:57:47.343214+0000","last_became_active":"2023-09-30T22:57:46.326524+0000","last_became_peered":"2023-09-30T22:57:46.326524+0000","last_unstale":"2023-09-30T22:57:47.343214+0000","last_undegraded":"2023-09-30T22:57:47.343214+0000","last_fullsized":"2023-09-30T22:57:47.343214+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:14.959667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356281+0000","last_change":"2023-09-30T22:57:47.355568+0000","last_active":"2023-09-30T22:57:47.356281+0000","last_peered":"2023-09-30T22:57:47.356281+0000","last_clean":"2023-09-30T22:57:47.356281+0000","last_became_active":"2023-09-30T22:57:47.355329+0000","last_became_peered":"2023-09-30T22:57:47.355329+0000","last_unstale":"2023-09-30T22:57:47.356281+0000","last_undegraded":"2023-09-30T22:57:47.356281+0000","last_fullsized":"2023-09-30T22:57:47.356281+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:56.277804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359856+0000","last_change":"2023-09-30T22:57:46.327951+0000","last_active":"2023-09-30T22:57:47.359856+0000","last_peered":"2023-09-30T22:57:47.359856+0000","last_clean":"2023-09-30T22:57:47.359856+0000","last_became_active":"2023-09-30T22:57:46.327380+0000","last_became_peered":"2023-09-30T22:57:46.327380+0000","last_unstale":"2023-09-30T22:57:47.359856+0000","last_undegraded":"2023-09-30T22:57:47.359856+0000","last_fullsized":"2023-09-30T22:57:47.359856+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:55.273827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346961+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:57:47.346961+0000","last_peered":"2023-09-30T22:57:47.346961+0000","last_clean":"2023-09-30T22:57:47.346961+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:57:47.346961+0000","last_undegraded":"2023-09-30T22:57:47.346961+0000","last_fullsized":"2023-09-30T22:57:47.346961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358211+0000","last_change":"2023-09-30T22:57:47.357841+0000","last_active":"2023-09-30T22:57:47.358211+0000","last_peered":"2023-09-30T22:57:47.358211+0000","last_clean":"2023-09-30T22:57:47.358211+0000","last_became_active":"2023-09-30T22:57:47.357426+0000","last_became_peered":"2023-09-30T22:57:47.357426+0000","last_unstale":"2023-09-30T22:57:47.358211+0000","last_undegraded":"2023-09-30T22:57:47.358211+0000","last_fullsized":"2023-09-30T22:57:47.358211+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356617+0000","last_change":"2023-09-30T22:57:46.329817+0000","last_active":"2023-09-30T22:57:47.356617+0000","last_peered":"2023-09-30T22:57:47.356617+0000","last_clean":"2023-09-30T22:57:47.356617+0000","last_became_active":"2023-09-30T22:57:46.329534+0000","last_became_peered":"2023-09-30T22:57:46.329534+0000","last_unstale":"2023-09-30T22:57:47.356617+0000","last_undegraded":"2023-09-30T22:57:47.356617+0000","last_fullsized":"2023-09-30T22:57:47.356617+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:11:14.497043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.338031+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:57:47.338031+0000","last_peered":"2023-09-30T22:57:47.338031+0000","last_clean":"2023-09-30T22:57:47.338031+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:57:47.338031+0000","last_undegraded":"2023-09-30T22:57:47.338031+0000","last_fullsized":"2023-09-30T22:57:47.338031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343580+0000","last_change":"2023-09-30T22:57:47.343168+0000","last_active":"2023-09-30T22:57:47.343580+0000","last_peered":"2023-09-30T22:57:47.343580+0000","last_clean":"2023-09-30T22:57:47.343580+0000","last_became_active":"2023-09-30T22:57:47.342935+0000","last_became_peered":"2023-09-30T22:57:47.342935+0000","last_unstale":"2023-09-30T22:57:47.343580+0000","last_undegraded":"2023-09-30T22:57:47.343580+0000","last_fullsized":"2023-09-30T22:57:47.343580+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:59.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356087+0000","last_change":"2023-09-30T22:57:46.330494+0000","last_active":"2023-09-30T22:57:47.356087+0000","last_peered":"2023-09-30T22:57:47.356087+0000","last_clean":"2023-09-30T22:57:47.356087+0000","last_became_active":"2023-09-30T22:57:46.330277+0000","last_became_peered":"2023-09-30T22:57:46.330277+0000","last_unstale":"2023-09-30T22:57:47.356087+0000","last_undegraded":"2023-09-30T22:57:47.356087+0000","last_fullsized":"2023-09-30T22:57:47.356087+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:57:31.215330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337610+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:57:47.337610+0000","last_peered":"2023-09-30T22:57:47.337610+0000","last_clean":"2023-09-30T22:57:47.337610+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:57:47.337610+0000","last_undegraded":"2023-09-30T22:57:47.337610+0000","last_fullsized":"2023-09-30T22:57:47.337610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358241+0000","last_change":"2023-09-30T22:57:47.357853+0000","last_active":"2023-09-30T22:57:47.358241+0000","last_peered":"2023-09-30T22:57:47.358241+0000","last_clean":"2023-09-30T22:57:47.358241+0000","last_became_active":"2023-09-30T22:57:47.357288+0000","last_became_peered":"2023-09-30T22:57:47.357288+0000","last_unstale":"2023-09-30T22:57:47.358241+0000","last_undegraded":"2023-09-30T22:57:47.358241+0000","last_fullsized":"2023-09-30T22:57:47.358241+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:52.008304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336944+0000","last_change":"2023-09-30T22:57:46.322115+0000","last_active":"2023-09-30T22:57:47.336944+0000","last_peered":"2023-09-30T22:57:47.336944+0000","last_clean":"2023-09-30T22:57:47.336944+0000","last_became_active":"2023-09-30T22:57:46.321808+0000","last_became_peered":"2023-09-30T22:57:46.321808+0000","last_unstale":"2023-09-30T22:57:47.336944+0000","last_undegraded":"2023-09-30T22:57:47.336944+0000","last_fullsized":"2023-09-30T22:57:47.336944+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:03.448369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.338076+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:57:47.338076+0000","last_peered":"2023-09-30T22:57:47.338076+0000","last_clean":"2023-09-30T22:57:47.338076+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:57:47.338076+0000","last_undegraded":"2023-09-30T22:57:47.338076+0000","last_fullsized":"2023-09-30T22:57:47.338076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343317+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:57:47.343317+0000","last_peered":"2023-09-30T22:57:47.343317+0000","last_clean":"2023-09-30T22:57:47.343317+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:57:47.343317+0000","last_undegraded":"2023-09-30T22:57:47.343317+0000","last_fullsized":"2023-09-30T22:57:47.343317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.350505+0000","last_change":"2023-09-30T22:57:47.350420+0000","last_active":"2023-09-30T22:57:47.350505+0000","last_peered":"2023-09-30T22:57:47.350505+0000","last_clean":"2023-09-30T22:57:47.350505+0000","last_became_active":"2023-09-30T22:57:47.349955+0000","last_became_peered":"2023-09-30T22:57:47.349955+0000","last_unstale":"2023-09-30T22:57:47.350505+0000","last_undegraded":"2023-09-30T22:57:47.350505+0000","last_fullsized":"2023-09-30T22:57:47.350505+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354813+0000","last_change":"2023-09-30T22:57:46.322978+0000","last_active":"2023-09-30T22:57:47.354813+0000","last_peered":"2023-09-30T22:57:47.354813+0000","last_clean":"2023-09-30T22:57:47.354813+0000","last_became_active":"2023-09-30T22:57:46.322754+0000","last_became_peered":"2023-09-30T22:57:46.322754+0000","last_unstale":"2023-09-30T22:57:47.354813+0000","last_undegraded":"2023-09-30T22:57:47.354813+0000","last_fullsized":"2023-09-30T22:57:47.354813+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.339575+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:57:47.339575+0000","last_peered":"2023-09-30T22:57:47.339575+0000","last_clean":"2023-09-30T22:57:47.339575+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:57:47.339575+0000","last_undegraded":"2023-09-30T22:57:47.339575+0000","last_fullsized":"2023-09-30T22:57:47.339575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348944+0000","last_change":"2023-09-30T22:57:47.348879+0000","last_active":"2023-09-30T22:57:47.348944+0000","last_peered":"2023-09-30T22:57:47.348944+0000","last_clean":"2023-09-30T22:57:47.348944+0000","last_became_active":"2023-09-30T22:57:47.348671+0000","last_became_peered":"2023-09-30T22:57:47.348671+0000","last_unstale":"2023-09-30T22:57:47.348944+0000","last_undegraded":"2023-09-30T22:57:47.348944+0000","last_fullsized":"2023-09-30T22:57:47.348944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:38.468211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.340453+0000","last_change":"2023-09-30T22:57:46.325177+0000","last_active":"2023-09-30T22:57:47.340453+0000","last_peered":"2023-09-30T22:57:47.340453+0000","last_clean":"2023-09-30T22:57:47.340453+0000","last_became_active":"2023-09-30T22:57:46.324955+0000","last_became_peered":"2023-09-30T22:57:46.324955+0000","last_unstale":"2023-09-30T22:57:47.340453+0000","last_undegraded":"2023-09-30T22:57:47.340453+0000","last_fullsized":"2023-09-30T22:57:47.340453+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.339322+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:57:47.339322+0000","last_peered":"2023-09-30T22:57:47.339322+0000","last_clean":"2023-09-30T22:57:47.339322+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:57:47.339322+0000","last_undegraded":"2023-09-30T22:57:47.339322+0000","last_fullsized":"2023-09-30T22:57:47.339322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349833+0000","last_change":"2023-09-30T22:57:47.349580+0000","last_active":"2023-09-30T22:57:47.349833+0000","last_peered":"2023-09-30T22:57:47.349833+0000","last_clean":"2023-09-30T22:57:47.349833+0000","last_became_active":"2023-09-30T22:57:47.349005+0000","last_became_peered":"2023-09-30T22:57:47.349005+0000","last_unstale":"2023-09-30T22:57:47.349833+0000","last_undegraded":"2023-09-30T22:57:47.349833+0000","last_fullsized":"2023-09-30T22:57:47.349833+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346385+0000","last_change":"2023-09-30T22:57:46.325292+0000","last_active":"2023-09-30T22:57:47.346385+0000","last_peered":"2023-09-30T22:57:47.346385+0000","last_clean":"2023-09-30T22:57:47.346385+0000","last_became_active":"2023-09-30T22:57:46.325062+0000","last_became_peered":"2023-09-30T22:57:46.325062+0000","last_unstale":"2023-09-30T22:57:47.346385+0000","last_undegraded":"2023-09-30T22:57:47.346385+0000","last_fullsized":"2023-09-30T22:57:47.346385+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:41.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344417+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:57:47.344417+0000","last_peered":"2023-09-30T22:57:47.344417+0000","last_clean":"2023-09-30T22:57:47.344417+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:57:47.344417+0000","last_undegraded":"2023-09-30T22:57:47.344417+0000","last_fullsized":"2023-09-30T22:57:47.344417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351627+0000","last_change":"2023-09-30T22:57:47.351092+0000","last_active":"2023-09-30T22:57:47.351627+0000","last_peered":"2023-09-30T22:57:47.351627+0000","last_clean":"2023-09-30T22:57:47.351627+0000","last_became_active":"2023-09-30T22:57:47.350831+0000","last_became_peered":"2023-09-30T22:57:47.350831+0000","last_unstale":"2023-09-30T22:57:47.351627+0000","last_undegraded":"2023-09-30T22:57:47.351627+0000","last_fullsized":"2023-09-30T22:57:47.351627+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:38.904920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345515+0000","last_change":"2023-09-30T22:57:46.324050+0000","last_active":"2023-09-30T22:57:47.345515+0000","last_peered":"2023-09-30T22:57:47.345515+0000","last_clean":"2023-09-30T22:57:47.345515+0000","last_became_active":"2023-09-30T22:57:46.323824+0000","last_became_peered":"2023-09-30T22:57:46.323824+0000","last_unstale":"2023-09-30T22:57:47.345515+0000","last_undegraded":"2023-09-30T22:57:47.345515+0000","last_fullsized":"2023-09-30T22:57:47.345515+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337955+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:57:47.337955+0000","last_peered":"2023-09-30T22:57:47.337955+0000","last_clean":"2023-09-30T22:57:47.337955+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:57:47.337955+0000","last_undegraded":"2023-09-30T22:57:47.337955+0000","last_fullsized":"2023-09-30T22:57:47.337955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66700000000000004,"15min":0.63500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.65000000000000002},"min":{"1min":0.53800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.874,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.747}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.67800000000000005},"min":{"1min":0.53700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.52400000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.502,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.871,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.135,"15min":1.135},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.071,"15min":1.071},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":630,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194682,"statfs":{"total":200000000,"available":199354651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78000000000000003,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.97699999999999998,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.80200000000000005},"min":{"1min":0.51700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0800000000000001,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.67100000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.46200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.83999999999999997,"15min":1.022},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":1.0289999999999999},"min":{"1min":0.48099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0429999999999999,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.95599999999999996},"min":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0089999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.107,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1259999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.65700000000000003},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.321,"15min":1.321},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80300000000000005,"15min":0.75900000000000001},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.198,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.61399999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.97399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194106,"statfs":{"total":200000000,"available":198765285,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45700000000000002,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.47099999999999997},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.52000000000000002},"min":{"1min":0.44400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.47299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.755},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.72599999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.71199999999999997},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.22},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76300000000000001,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.72399999999999998},"min":{"1min":0.56999999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.032,"5min":1.127,"15min":1.127},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0660000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.629},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80300000000000005,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.51400000000000001},"min":{"1min":0.34399999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.879},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.27,"15min":1.27},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.48599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0600000000000001,"5min":1.171,"15min":1.171},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.57599999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.119,"15min":1.119},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76600000000000001,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.621}]},{"osd":7,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.173,"15min":1.173},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.095,"5min":1.21,"15min":1.21},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":629,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199355735,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79200000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.53600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.38,"15min":0.38},"max":{"1min":1.04,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.151,"5min":1.179,"15min":1.179},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.236,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.615,"15min":1.615},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.59199999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.57299999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.117,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":630,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194682,"statfs":{"total":200000000,"available":199354663,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47899999999999998,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59899999999999998,"5min":1.919,"15min":1.919},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68300000000000005,"5min":1.254,"15min":1.254},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.747,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.747,"15min":0.72799999999999998},"min":{"1min":0.52900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.242,"5min":1.401,"15min":1.401},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.76400000000000001},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.21,"5min":3.306,"15min":3.306},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98199999999999998,"5min":1.508,"15min":1.508},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.745},"min":{"1min":0.57099999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.621}]},{"osd":6,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.151,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0700000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.61799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1160000000000001,"5min":1.573,"15min":1.573},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93100000000000005,"5min":1.022,"15min":1.022},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64300000000000002,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.746}]},{"osd":1,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64600000000000002,"15min":0.623},"min":{"1min":0.48199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.66400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95199999999999996,"5min":1.006,"15min":1.006},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72199999999999998,"15min":0.67900000000000005},"min":{"1min":0.53400000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91100000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72499999999999998,"15min":0.69099999999999995},"min":{"1min":0.52500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90100000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81399999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.878},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":1,"5min":1,"15min":1},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93500000000000005,"5min":1.016,"15min":1.016},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.026,"5min":1.044,"15min":1.044},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194107,"statfs":{"total":200000000,"available":198765943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.42199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.623},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.81399999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84299999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.044,"15min":1.044},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69499999999999995,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.79500000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.91000000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.749},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90700000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.37,"15min":0.37},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.87},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.84899999999999998}]}]}],"pool_statfs":[]}} 2023-09-30T22:57:56.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:57:56.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.765+0000 7f27565ff700 1 Processor -- start 2023-09-30T22:57:56.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.765+0000 7f27565ff700 1 -- start start 2023-09-30T22:57:56.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.766+0000 7f27565ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27501598e0 0x7f2750159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:56.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.766+0000 7f27565ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27500d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:56.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.766+0000 7f27565ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27500cff40 con 0x7f275006b1c0 2023-09-30T22:57:56.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.766+0000 7f27565ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27500d0910 con 0x7f27501598e0 2023-09-30T22:57:56.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.766+0000 7f27565ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cf330 con 0x7f27500cee50 2023-09-30T22:57:56.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f274ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27501598e0 0x7f2750159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f2747fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27500d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f2754b9c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f275006b1c0 0x7f275015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:47474/0 (socket says 172.21.15.142:47474) 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f2754b9c700 1 -- 172.21.15.142:0/2550607174 learned_addr learned my addr 172.21.15.142:0/2550607174 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f274f7fe700 1 -- 172.21.15.142:0/2550607174 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870066707 0 0) 0x7f27500cff40 con 0x7f275006b1c0 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f274f7fe700 1 -- 172.21.15.142:0/2550607174 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c003570 con 0x7f275006b1c0 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f2747fff700 1 -- 172.21.15.142:0/2550607174 >> v2:172.21.15.148:3300/0 conn(0x7f27501598e0 msgr2=0x7f2750159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f2747fff700 1 --2- 172.21.15.142:0/2550607174 >> v2:172.21.15.148:3300/0 conn(0x7f27501598e0 0x7f2750159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f2747fff700 1 -- 172.21.15.142:0/2550607174 >> v1:172.21.15.148:6789/0 conn(0x7f275006b1c0 legacy=0x7f275015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f2747fff700 1 -- 172.21.15.142:0/2550607174 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500cf610 con 0x7f27500cee50 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.767+0000 7f274ffff700 1 --2- 172.21.15.142:0/2550607174 >> v2:172.21.15.148:3300/0 conn(0x7f27501598e0 0x7f2750159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.768+0000 7f2747fff700 1 --2- 172.21.15.142:0/2550607174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27500d03d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27380098e0 tx=0x7f27380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580c740a52fc4b73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.768+0000 7f274f7fe700 1 -- 172.21.15.142:0/2550607174 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011630 con 0x7f27500cee50 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.768+0000 7f274f7fe700 1 -- 172.21.15.142:0/2550607174 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738011790 con 0x7f27500cee50 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.768+0000 7f274f7fe700 1 -- 172.21.15.142:0/2550607174 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738011b30 con 0x7f27500cee50 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.768+0000 7f27565ff700 1 -- 172.21.15.142:0/2550607174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 msgr2=0x7f27500d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.768+0000 7f27565ff700 1 --2- 172.21.15.142:0/2550607174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27500d03d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27380098e0 tx=0x7f27380091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.769+0000 7f27565ff700 1 -- 172.21.15.142:0/2550607174 shutdown_connections 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.769+0000 7f27565ff700 1 --2- 172.21.15.142:0/2550607174 >> v2:172.21.15.148:3300/0 conn(0x7f27501598e0 0x7f2750159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.769+0000 7f27565ff700 1 --2- 172.21.15.142:0/2550607174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27500d03d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.769+0000 7f27565ff700 1 -- 172.21.15.142:0/2550607174 >> 172.21.15.142:0/2550607174 conn(0x7f27500cd540 msgr2=0x7f27500cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:56.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.769+0000 7f27565ff700 1 -- 172.21.15.142:0/2550607174 shutdown_connections 2023-09-30T22:57:56.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.769+0000 7f27565ff700 1 -- 172.21.15.142:0/2550607174 wait complete. 2023-09-30T22:57:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.770+0000 7f27565ff700 1 Processor -- start 2023-09-30T22:57:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.770+0000 7f27565ff700 1 -- start start 2023-09-30T22:57:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.771+0000 7f27565ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f275006b1c0 0x7f2750151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.771+0000 7f27565ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27501521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.771+0000 7f27565ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27501598e0 0x7f2750153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.771+0000 7f27565ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500c55c0 con 0x7f27501598e0 2023-09-30T22:57:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.771+0000 7f27565ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750152730 con 0x7f275006b1c0 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.771+0000 7f27565ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27501529e0 con 0x7f27500cee50 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27501598e0 0x7f2750153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27501598e0 0x7f2750153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46168/0 (socket says 172.21.15.142:46168) 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 -- 172.21.15.142:0/411403400 learned_addr learned my addr 172.21.15.142:0/411403400 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f274ffff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f275006b1c0 0x7f2750151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2747fff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27501521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 -- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 msgr2=0x7f27501521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27501521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 -- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f275006b1c0 msgr2=0x7f2750151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f275006b1c0 0x7f2750151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 -- 172.21.15.142:0/411403400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740009420 con 0x7f27501598e0 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f2754b9c700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27501598e0 0x7f2750153fc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2748001460 tx=0x7f2748001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.772+0000 7f274cff9700 1 -- 172.21.15.142:0/411403400 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800a870 con 0x7f27501598e0 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.773+0000 7f274cff9700 1 -- 172.21.15.142:0/411403400 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800a9d0 con 0x7f27501598e0 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.773+0000 7f274cff9700 1 -- 172.21.15.142:0/411403400 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800ad50 con 0x7f27501598e0 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.773+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2738009420 con 0x7f27501598e0 2023-09-30T22:57:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.773+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2750152fa0 con 0x7f27501598e0 2023-09-30T22:57:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.774+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27500b6aa0 con 0x7f27501598e0 2023-09-30T22:57:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.775+0000 7f274cff9700 1 -- 172.21.15.142:0/411403400 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2748007300 con 0x7f27501598e0 2023-09-30T22:57:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.776+0000 7f274cff9700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2730067330 0x7f27300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.776+0000 7f274cff9700 1 -- 172.21.15.142:0/411403400 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2748084f40 con 0x7f27501598e0 2023-09-30T22:57:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.776+0000 7f274ffff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2730067330 0x7f27300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.777+0000 7f274ffff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2730067330 0x7f27300697e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f27500c7250 tx=0x7f27400091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:56.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.780+0000 7f274cff9700 1 -- 172.21.15.142:0/411403400 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2748051ed0 con 0x7f27501598e0 2023-09-30T22:57:56.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.965+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27500c5700 con 0x7f2730067330 2023-09-30T22:57:56.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.973+0000 7f274cff9700 1 -- 172.21.15.142:0/411403400 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303175 (secure 0 0 0) 0x7f27500c5700 con 0x7f2730067330 2023-09-30T22:57:56.977 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2730067330 msgr2=0x7f27300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2730067330 0x7f27300697e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f27500c7250 tx=0x7f27400091a0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27501598e0 msgr2=0x7f2750153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27501598e0 0x7f2750153fc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2748001460 tx=0x7f2748001a40 comp rx=0 tx=0).stop 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 shutdown_connections 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2730067330 0x7f27300697e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27501598e0 0x7f2750153fc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f275006b1c0 0x7f2750151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 --2- 172.21.15.142:0/411403400 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27500cee50 0x7f27501521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:56.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.977+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 >> 172.21.15.142:0/411403400 conn(0x7f27500cd540 msgr2=0x7f2750069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.978+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 shutdown_connections 2023-09-30T22:57:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:56.978+0000 7f27565ff700 1 -- 172.21.15.142:0/411403400 wait complete. 2023-09-30T22:57:56.981 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:57:56.995 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2023-09-30T22:57:56.176762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6186,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556313,"statfs":{"total":1600000000,"available":1593665140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.842291"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359075+0000","last_change":"2023-09-30T22:57:47.358770+0000","last_active":"2023-09-30T22:57:47.359075+0000","last_peered":"2023-09-30T22:57:47.359075+0000","last_clean":"2023-09-30T22:57:47.359075+0000","last_became_active":"2023-09-30T22:57:47.358552+0000","last_became_peered":"2023-09-30T22:57:47.358552+0000","last_unstale":"2023-09-30T22:57:47.359075+0000","last_undegraded":"2023-09-30T22:57:47.359075+0000","last_fullsized":"2023-09-30T22:57:47.359075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:57.316255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347445+0000","last_change":"2023-09-30T22:57:47.347285+0000","last_active":"2023-09-30T22:57:47.347445+0000","last_peered":"2023-09-30T22:57:47.347445+0000","last_clean":"2023-09-30T22:57:47.347445+0000","last_became_active":"2023-09-30T22:57:47.347012+0000","last_became_peered":"2023-09-30T22:57:47.347012+0000","last_unstale":"2023-09-30T22:57:47.347445+0000","last_undegraded":"2023-09-30T22:57:47.347445+0000","last_fullsized":"2023-09-30T22:57:47.347445+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:37.162388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357441+0000","last_change":"2023-09-30T22:57:47.357352+0000","last_active":"2023-09-30T22:57:47.357441+0000","last_peered":"2023-09-30T22:57:47.357441+0000","last_clean":"2023-09-30T22:57:47.357441+0000","last_became_active":"2023-09-30T22:57:47.357097+0000","last_became_peered":"2023-09-30T22:57:47.357097+0000","last_unstale":"2023-09-30T22:57:47.357441+0000","last_undegraded":"2023-09-30T22:57:47.357441+0000","last_fullsized":"2023-09-30T22:57:47.357441+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:57.307570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345889+0000","last_change":"2023-09-30T22:57:47.345202+0000","last_active":"2023-09-30T22:57:47.345889+0000","last_peered":"2023-09-30T22:57:47.345889+0000","last_clean":"2023-09-30T22:57:47.345889+0000","last_became_active":"2023-09-30T22:57:47.344674+0000","last_became_peered":"2023-09-30T22:57:47.344674+0000","last_unstale":"2023-09-30T22:57:47.345889+0000","last_undegraded":"2023-09-30T22:57:47.345889+0000","last_fullsized":"2023-09-30T22:57:47.345889+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:29.271352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355245+0000","last_change":"2023-09-30T22:57:47.354137+0000","last_active":"2023-09-30T22:57:47.355245+0000","last_peered":"2023-09-30T22:57:47.355245+0000","last_clean":"2023-09-30T22:57:47.355245+0000","last_became_active":"2023-09-30T22:57:47.352452+0000","last_became_peered":"2023-09-30T22:57:47.352452+0000","last_unstale":"2023-09-30T22:57:47.355245+0000","last_undegraded":"2023-09-30T22:57:47.355245+0000","last_fullsized":"2023-09-30T22:57:47.355245+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:24.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351148+0000","last_change":"2023-09-30T22:57:47.351077+0000","last_active":"2023-09-30T22:57:47.351148+0000","last_peered":"2023-09-30T22:57:47.351148+0000","last_clean":"2023-09-30T22:57:47.351148+0000","last_became_active":"2023-09-30T22:57:47.350336+0000","last_became_peered":"2023-09-30T22:57:47.350336+0000","last_unstale":"2023-09-30T22:57:47.351148+0000","last_undegraded":"2023-09-30T22:57:47.351148+0000","last_fullsized":"2023-09-30T22:57:47.351148+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:25:16.153993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344376+0000","last_change":"2023-09-30T22:57:47.344329+0000","last_active":"2023-09-30T22:57:47.344376+0000","last_peered":"2023-09-30T22:57:47.344376+0000","last_clean":"2023-09-30T22:57:47.344376+0000","last_became_active":"2023-09-30T22:57:47.344106+0000","last_became_peered":"2023-09-30T22:57:47.344106+0000","last_unstale":"2023-09-30T22:57:47.344376+0000","last_undegraded":"2023-09-30T22:57:47.344376+0000","last_fullsized":"2023-09-30T22:57:47.344376+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:03.436048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349767+0000","last_change":"2023-09-30T22:57:47.349592+0000","last_active":"2023-09-30T22:57:47.349767+0000","last_peered":"2023-09-30T22:57:47.349767+0000","last_clean":"2023-09-30T22:57:47.349767+0000","last_became_active":"2023-09-30T22:57:47.349100+0000","last_became_peered":"2023-09-30T22:57:47.349100+0000","last_unstale":"2023-09-30T22:57:47.349767+0000","last_undegraded":"2023-09-30T22:57:47.349767+0000","last_fullsized":"2023-09-30T22:57:47.349767+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346945+0000","last_change":"2023-09-30T22:57:47.346890+0000","last_active":"2023-09-30T22:57:47.346945+0000","last_peered":"2023-09-30T22:57:47.346945+0000","last_clean":"2023-09-30T22:57:47.346945+0000","last_became_active":"2023-09-30T22:57:47.346670+0000","last_became_peered":"2023-09-30T22:57:47.346670+0000","last_unstale":"2023-09-30T22:57:47.346945+0000","last_undegraded":"2023-09-30T22:57:47.346945+0000","last_fullsized":"2023-09-30T22:57:47.346945+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:27:08.010448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346572+0000","last_change":"2023-09-30T22:57:47.346469+0000","last_active":"2023-09-30T22:57:47.346572+0000","last_peered":"2023-09-30T22:57:47.346572+0000","last_clean":"2023-09-30T22:57:47.346572+0000","last_became_active":"2023-09-30T22:57:47.346055+0000","last_became_peered":"2023-09-30T22:57:47.346055+0000","last_unstale":"2023-09-30T22:57:47.346572+0000","last_undegraded":"2023-09-30T22:57:47.346572+0000","last_fullsized":"2023-09-30T22:57:47.346572+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344921+0000","last_change":"2023-09-30T22:57:47.344771+0000","last_active":"2023-09-30T22:57:47.344921+0000","last_peered":"2023-09-30T22:57:47.344921+0000","last_clean":"2023-09-30T22:57:47.344921+0000","last_became_active":"2023-09-30T22:57:47.344548+0000","last_became_peered":"2023-09-30T22:57:47.344548+0000","last_unstale":"2023-09-30T22:57:47.344921+0000","last_undegraded":"2023-09-30T22:57:47.344921+0000","last_fullsized":"2023-09-30T22:57:47.344921+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:53.689308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347591+0000","last_change":"2023-09-30T22:57:47.347422+0000","last_active":"2023-09-30T22:57:47.347591+0000","last_peered":"2023-09-30T22:57:47.347591+0000","last_clean":"2023-09-30T22:57:47.347591+0000","last_became_active":"2023-09-30T22:57:47.347186+0000","last_became_peered":"2023-09-30T22:57:47.347186+0000","last_unstale":"2023-09-30T22:57:47.347591+0000","last_undegraded":"2023-09-30T22:57:47.347591+0000","last_fullsized":"2023-09-30T22:57:47.347591+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359459+0000","last_change":"2023-09-30T22:57:47.357297+0000","last_active":"2023-09-30T22:57:47.359459+0000","last_peered":"2023-09-30T22:57:47.359459+0000","last_clean":"2023-09-30T22:57:47.359459+0000","last_became_active":"2023-09-30T22:57:47.357069+0000","last_became_peered":"2023-09-30T22:57:47.357069+0000","last_unstale":"2023-09-30T22:57:47.359459+0000","last_undegraded":"2023-09-30T22:57:47.359459+0000","last_fullsized":"2023-09-30T22:57:47.359459+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.350974+0000","last_change":"2023-09-30T22:57:47.350409+0000","last_active":"2023-09-30T22:57:47.350974+0000","last_peered":"2023-09-30T22:57:47.350974+0000","last_clean":"2023-09-30T22:57:47.350974+0000","last_became_active":"2023-09-30T22:57:47.350186+0000","last_became_peered":"2023-09-30T22:57:47.350186+0000","last_unstale":"2023-09-30T22:57:47.350974+0000","last_undegraded":"2023-09-30T22:57:47.350974+0000","last_fullsized":"2023-09-30T22:57:47.350974+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:54.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346457+0000","last_change":"2023-09-30T22:57:47.346320+0000","last_active":"2023-09-30T22:57:47.346457+0000","last_peered":"2023-09-30T22:57:47.346457+0000","last_clean":"2023-09-30T22:57:47.346457+0000","last_became_active":"2023-09-30T22:57:47.345715+0000","last_became_peered":"2023-09-30T22:57:47.345715+0000","last_unstale":"2023-09-30T22:57:47.346457+0000","last_undegraded":"2023-09-30T22:57:47.346457+0000","last_fullsized":"2023-09-30T22:57:47.346457+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351118+0000","last_change":"2023-09-30T22:57:47.350778+0000","last_active":"2023-09-30T22:57:47.351118+0000","last_peered":"2023-09-30T22:57:47.351118+0000","last_clean":"2023-09-30T22:57:47.351118+0000","last_became_active":"2023-09-30T22:57:47.349662+0000","last_became_peered":"2023-09-30T22:57:47.349662+0000","last_unstale":"2023-09-30T22:57:47.351118+0000","last_undegraded":"2023-09-30T22:57:47.351118+0000","last_fullsized":"2023-09-30T22:57:47.351118+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:34.970083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357498+0000","last_change":"2023-09-30T22:57:47.356479+0000","last_active":"2023-09-30T22:57:47.357498+0000","last_peered":"2023-09-30T22:57:47.357498+0000","last_clean":"2023-09-30T22:57:47.357498+0000","last_became_active":"2023-09-30T22:57:47.356238+0000","last_became_peered":"2023-09-30T22:57:47.356238+0000","last_unstale":"2023-09-30T22:57:47.357498+0000","last_undegraded":"2023-09-30T22:57:47.357498+0000","last_fullsized":"2023-09-30T22:57:47.357498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:37.162388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348181+0000","last_change":"2023-09-30T22:57:47.348104+0000","last_active":"2023-09-30T22:57:47.348181+0000","last_peered":"2023-09-30T22:57:47.348181+0000","last_clean":"2023-09-30T22:57:47.348181+0000","last_became_active":"2023-09-30T22:57:47.347686+0000","last_became_peered":"2023-09-30T22:57:47.347686+0000","last_unstale":"2023-09-30T22:57:47.348181+0000","last_undegraded":"2023-09-30T22:57:47.348181+0000","last_fullsized":"2023-09-30T22:57:47.348181+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349847+0000","last_change":"2023-09-30T22:57:47.349736+0000","last_active":"2023-09-30T22:57:47.349847+0000","last_peered":"2023-09-30T22:57:47.349847+0000","last_clean":"2023-09-30T22:57:47.349847+0000","last_became_active":"2023-09-30T22:57:47.349333+0000","last_became_peered":"2023-09-30T22:57:47.349333+0000","last_unstale":"2023-09-30T22:57:47.349847+0000","last_undegraded":"2023-09-30T22:57:47.349847+0000","last_fullsized":"2023-09-30T22:57:47.349847+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348597+0000","last_change":"2023-09-30T22:57:47.344043+0000","last_active":"2023-09-30T22:57:47.348597+0000","last_peered":"2023-09-30T22:57:47.348597+0000","last_clean":"2023-09-30T22:57:47.348597+0000","last_became_active":"2023-09-30T22:57:47.343597+0000","last_became_peered":"2023-09-30T22:57:47.343597+0000","last_unstale":"2023-09-30T22:57:47.348597+0000","last_undegraded":"2023-09-30T22:57:47.348597+0000","last_fullsized":"2023-09-30T22:57:47.348597+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:33:14.420556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348092+0000","last_change":"2023-09-30T22:57:47.347969+0000","last_active":"2023-09-30T22:57:47.348092+0000","last_peered":"2023-09-30T22:57:47.348092+0000","last_clean":"2023-09-30T22:57:47.348092+0000","last_became_active":"2023-09-30T22:57:47.347393+0000","last_became_peered":"2023-09-30T22:57:47.347393+0000","last_unstale":"2023-09-30T22:57:47.348092+0000","last_undegraded":"2023-09-30T22:57:47.348092+0000","last_fullsized":"2023-09-30T22:57:47.348092+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:13.188446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352001+0000","last_change":"2023-09-30T22:57:47.351930+0000","last_active":"2023-09-30T22:57:47.352001+0000","last_peered":"2023-09-30T22:57:47.352001+0000","last_clean":"2023-09-30T22:57:47.352001+0000","last_became_active":"2023-09-30T22:57:47.351708+0000","last_became_peered":"2023-09-30T22:57:47.351708+0000","last_unstale":"2023-09-30T22:57:47.352001+0000","last_undegraded":"2023-09-30T22:57:47.352001+0000","last_fullsized":"2023-09-30T22:57:47.352001+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357142+0000","last_change":"2023-09-30T22:57:47.357071+0000","last_active":"2023-09-30T22:57:47.357142+0000","last_peered":"2023-09-30T22:57:47.357142+0000","last_clean":"2023-09-30T22:57:47.357142+0000","last_became_active":"2023-09-30T22:57:47.356848+0000","last_became_peered":"2023-09-30T22:57:47.356848+0000","last_unstale":"2023-09-30T22:57:47.357142+0000","last_undegraded":"2023-09-30T22:57:47.357142+0000","last_fullsized":"2023-09-30T22:57:47.357142+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:59.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347881+0000","last_change":"2023-09-30T22:57:47.347788+0000","last_active":"2023-09-30T22:57:47.347881+0000","last_peered":"2023-09-30T22:57:47.347881+0000","last_clean":"2023-09-30T22:57:47.347881+0000","last_became_active":"2023-09-30T22:57:47.347347+0000","last_became_peered":"2023-09-30T22:57:47.347347+0000","last_unstale":"2023-09-30T22:57:47.347881+0000","last_undegraded":"2023-09-30T22:57:47.347881+0000","last_fullsized":"2023-09-30T22:57:47.347881+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:51:58.623724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355227+0000","last_change":"2023-09-30T22:57:47.354001+0000","last_active":"2023-09-30T22:57:47.355227+0000","last_peered":"2023-09-30T22:57:47.355227+0000","last_clean":"2023-09-30T22:57:47.355227+0000","last_became_active":"2023-09-30T22:57:47.352197+0000","last_became_peered":"2023-09-30T22:57:47.352197+0000","last_unstale":"2023-09-30T22:57:47.355227+0000","last_undegraded":"2023-09-30T22:57:47.355227+0000","last_fullsized":"2023-09-30T22:57:47.355227+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:48.031145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348204+0000","last_change":"2023-09-30T22:57:47.348108+0000","last_active":"2023-09-30T22:57:47.348204+0000","last_peered":"2023-09-30T22:57:47.348204+0000","last_clean":"2023-09-30T22:57:47.348204+0000","last_became_active":"2023-09-30T22:57:47.347732+0000","last_became_peered":"2023-09-30T22:57:47.347732+0000","last_unstale":"2023-09-30T22:57:47.348204+0000","last_undegraded":"2023-09-30T22:57:47.348204+0000","last_fullsized":"2023-09-30T22:57:47.348204+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:56.277804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357378+0000","last_change":"2023-09-30T22:57:47.355441+0000","last_active":"2023-09-30T22:57:47.357378+0000","last_peered":"2023-09-30T22:57:47.357378+0000","last_clean":"2023-09-30T22:57:47.357378+0000","last_became_active":"2023-09-30T22:57:47.354914+0000","last_became_peered":"2023-09-30T22:57:47.354914+0000","last_unstale":"2023-09-30T22:57:47.357378+0000","last_undegraded":"2023-09-30T22:57:47.357378+0000","last_fullsized":"2023-09-30T22:57:47.357378+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355077+0000","last_change":"2023-09-30T22:57:47.353946+0000","last_active":"2023-09-30T22:57:47.355077+0000","last_peered":"2023-09-30T22:57:47.355077+0000","last_clean":"2023-09-30T22:57:47.355077+0000","last_became_active":"2023-09-30T22:57:47.353359+0000","last_became_peered":"2023-09-30T22:57:47.353359+0000","last_unstale":"2023-09-30T22:57:47.355077+0000","last_undegraded":"2023-09-30T22:57:47.355077+0000","last_fullsized":"2023-09-30T22:57:47.355077+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:15:48.532655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346878+0000","last_change":"2023-09-30T22:57:47.346307+0000","last_active":"2023-09-30T22:57:47.346878+0000","last_peered":"2023-09-30T22:57:47.346878+0000","last_clean":"2023-09-30T22:57:47.346878+0000","last_became_active":"2023-09-30T22:57:47.345984+0000","last_became_peered":"2023-09-30T22:57:47.345984+0000","last_unstale":"2023-09-30T22:57:47.346878+0000","last_undegraded":"2023-09-30T22:57:47.346878+0000","last_fullsized":"2023-09-30T22:57:47.346878+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:27.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355259+0000","last_change":"2023-09-30T22:57:47.355183+0000","last_active":"2023-09-30T22:57:47.355259+0000","last_peered":"2023-09-30T22:57:47.355259+0000","last_clean":"2023-09-30T22:57:47.355259+0000","last_became_active":"2023-09-30T22:57:47.353063+0000","last_became_peered":"2023-09-30T22:57:47.353063+0000","last_unstale":"2023-09-30T22:57:47.355259+0000","last_undegraded":"2023-09-30T22:57:47.355259+0000","last_fullsized":"2023-09-30T22:57:47.355259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349807+0000","last_change":"2023-09-30T22:57:47.349384+0000","last_active":"2023-09-30T22:57:47.349807+0000","last_peered":"2023-09-30T22:57:47.349807+0000","last_clean":"2023-09-30T22:57:47.349807+0000","last_became_active":"2023-09-30T22:57:47.349103+0000","last_became_peered":"2023-09-30T22:57:47.349103+0000","last_unstale":"2023-09-30T22:57:47.349807+0000","last_undegraded":"2023-09-30T22:57:47.349807+0000","last_fullsized":"2023-09-30T22:57:47.349807+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351103+0000","last_change":"2023-09-30T22:57:47.350745+0000","last_active":"2023-09-30T22:57:47.351103+0000","last_peered":"2023-09-30T22:57:47.351103+0000","last_clean":"2023-09-30T22:57:47.351103+0000","last_became_active":"2023-09-30T22:57:47.350260+0000","last_became_peered":"2023-09-30T22:57:47.350260+0000","last_unstale":"2023-09-30T22:57:47.351103+0000","last_undegraded":"2023-09-30T22:57:47.351103+0000","last_fullsized":"2023-09-30T22:57:47.351103+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353345+0000","last_change":"2023-09-30T22:57:47.353268+0000","last_active":"2023-09-30T22:57:47.353345+0000","last_peered":"2023-09-30T22:57:47.353345+0000","last_clean":"2023-09-30T22:57:47.353345+0000","last_became_active":"2023-09-30T22:57:47.352762+0000","last_became_peered":"2023-09-30T22:57:47.352762+0000","last_unstale":"2023-09-30T22:57:47.353345+0000","last_undegraded":"2023-09-30T22:57:47.353345+0000","last_fullsized":"2023-09-30T22:57:47.353345+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:47:00.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356320+0000","last_change":"2023-09-30T22:57:46.327869+0000","last_active":"2023-09-30T22:57:47.356320+0000","last_peered":"2023-09-30T22:57:47.356320+0000","last_clean":"2023-09-30T22:57:47.356320+0000","last_became_active":"2023-09-30T22:57:46.327406+0000","last_became_peered":"2023-09-30T22:57:46.327406+0000","last_unstale":"2023-09-30T22:57:47.356320+0000","last_undegraded":"2023-09-30T22:57:47.356320+0000","last_fullsized":"2023-09-30T22:57:47.356320+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:21.409395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348575+0000","last_change":"2023-09-30T22:57:47.343883+0000","last_active":"2023-09-30T22:57:47.348575+0000","last_peered":"2023-09-30T22:57:47.348575+0000","last_clean":"2023-09-30T22:57:47.348575+0000","last_became_active":"2023-09-30T22:57:47.343260+0000","last_became_peered":"2023-09-30T22:57:47.343260+0000","last_unstale":"2023-09-30T22:57:47.348575+0000","last_undegraded":"2023-09-30T22:57:47.348575+0000","last_fullsized":"2023-09-30T22:57:47.348575+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:11.253908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352491+0000","last_change":"2023-09-30T22:57:46.325137+0000","last_active":"2023-09-30T22:57:47.352491+0000","last_peered":"2023-09-30T22:57:47.352491+0000","last_clean":"2023-09-30T22:57:47.352491+0000","last_became_active":"2023-09-30T22:57:46.324895+0000","last_became_peered":"2023-09-30T22:57:46.324895+0000","last_unstale":"2023-09-30T22:57:47.352491+0000","last_undegraded":"2023-09-30T22:57:47.352491+0000","last_fullsized":"2023-09-30T22:57:47.352491+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:43:30.607338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353966+0000","last_change":"2023-09-30T22:57:47.353291+0000","last_active":"2023-09-30T22:57:47.353966+0000","last_peered":"2023-09-30T22:57:47.353966+0000","last_clean":"2023-09-30T22:57:47.353966+0000","last_became_active":"2023-09-30T22:57:47.353046+0000","last_became_peered":"2023-09-30T22:57:47.353046+0000","last_unstale":"2023-09-30T22:57:47.353966+0000","last_undegraded":"2023-09-30T22:57:47.353966+0000","last_fullsized":"2023-09-30T22:57:47.353966+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:24.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353335+0000","last_change":"2023-09-30T22:57:46.330625+0000","last_active":"2023-09-30T22:57:47.353335+0000","last_peered":"2023-09-30T22:57:47.353335+0000","last_clean":"2023-09-30T22:57:47.353335+0000","last_became_active":"2023-09-30T22:57:46.330091+0000","last_became_peered":"2023-09-30T22:57:46.330091+0000","last_unstale":"2023-09-30T22:57:47.353335+0000","last_undegraded":"2023-09-30T22:57:47.353335+0000","last_fullsized":"2023-09-30T22:57:47.353335+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:37.900944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352636+0000","last_change":"2023-09-30T22:57:47.351921+0000","last_active":"2023-09-30T22:57:47.352636+0000","last_peered":"2023-09-30T22:57:47.352636+0000","last_clean":"2023-09-30T22:57:47.352636+0000","last_became_active":"2023-09-30T22:57:47.351615+0000","last_became_peered":"2023-09-30T22:57:47.351615+0000","last_unstale":"2023-09-30T22:57:47.352636+0000","last_undegraded":"2023-09-30T22:57:47.352636+0000","last_fullsized":"2023-09-30T22:57:47.352636+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:00.453397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355213+0000","last_change":"2023-09-30T22:57:46.325868+0000","last_active":"2023-09-30T22:57:47.355213+0000","last_peered":"2023-09-30T22:57:47.355213+0000","last_clean":"2023-09-30T22:57:47.355213+0000","last_became_active":"2023-09-30T22:57:46.325652+0000","last_became_peered":"2023-09-30T22:57:46.325652+0000","last_unstale":"2023-09-30T22:57:47.355213+0000","last_undegraded":"2023-09-30T22:57:47.355213+0000","last_fullsized":"2023-09-30T22:57:47.355213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:58:52.324524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355123+0000","last_change":"2023-09-30T22:57:47.355016+0000","last_active":"2023-09-30T22:57:47.355123+0000","last_peered":"2023-09-30T22:57:47.355123+0000","last_clean":"2023-09-30T22:57:47.355123+0000","last_became_active":"2023-09-30T22:57:47.354607+0000","last_became_peered":"2023-09-30T22:57:47.354607+0000","last_unstale":"2023-09-30T22:57:47.355123+0000","last_undegraded":"2023-09-30T22:57:47.355123+0000","last_fullsized":"2023-09-30T22:57:47.355123+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:15.963643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358110+0000","last_change":"2023-09-30T22:57:46.325950+0000","last_active":"2023-09-30T22:57:47.358110+0000","last_peered":"2023-09-30T22:57:47.358110+0000","last_clean":"2023-09-30T22:57:47.358110+0000","last_became_active":"2023-09-30T22:57:46.325694+0000","last_became_peered":"2023-09-30T22:57:46.325694+0000","last_unstale":"2023-09-30T22:57:47.358110+0000","last_undegraded":"2023-09-30T22:57:47.358110+0000","last_fullsized":"2023-09-30T22:57:47.358110+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:45.916234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344358+0000","last_change":"2023-09-30T22:57:47.344284+0000","last_active":"2023-09-30T22:57:47.344358+0000","last_peered":"2023-09-30T22:57:47.344358+0000","last_clean":"2023-09-30T22:57:47.344358+0000","last_became_active":"2023-09-30T22:57:47.343791+0000","last_became_peered":"2023-09-30T22:57:47.343791+0000","last_unstale":"2023-09-30T22:57:47.344358+0000","last_undegraded":"2023-09-30T22:57:47.344358+0000","last_fullsized":"2023-09-30T22:57:47.344358+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:27.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.361644+0000","last_change":"2023-09-30T22:57:46.320132+0000","last_active":"2023-09-30T22:57:47.361644+0000","last_peered":"2023-09-30T22:57:47.361644+0000","last_clean":"2023-09-30T22:57:47.361644+0000","last_became_active":"2023-09-30T22:57:46.319599+0000","last_became_peered":"2023-09-30T22:57:46.319599+0000","last_unstale":"2023-09-30T22:57:47.361644+0000","last_undegraded":"2023-09-30T22:57:47.361644+0000","last_fullsized":"2023-09-30T22:57:47.361644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349749+0000","last_change":"2023-09-30T22:57:47.349410+0000","last_active":"2023-09-30T22:57:47.349749+0000","last_peered":"2023-09-30T22:57:47.349749+0000","last_clean":"2023-09-30T22:57:47.349749+0000","last_became_active":"2023-09-30T22:57:47.348804+0000","last_became_peered":"2023-09-30T22:57:47.348804+0000","last_unstale":"2023-09-30T22:57:47.349749+0000","last_undegraded":"2023-09-30T22:57:47.349749+0000","last_fullsized":"2023-09-30T22:57:47.349749+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336709+0000","last_change":"2023-09-30T22:57:46.323796+0000","last_active":"2023-09-30T22:57:47.336709+0000","last_peered":"2023-09-30T22:57:47.336709+0000","last_clean":"2023-09-30T22:57:47.336709+0000","last_became_active":"2023-09-30T22:57:46.323523+0000","last_became_peered":"2023-09-30T22:57:46.323523+0000","last_unstale":"2023-09-30T22:57:47.336709+0000","last_undegraded":"2023-09-30T22:57:47.336709+0000","last_fullsized":"2023-09-30T22:57:47.336709+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:18:59.796566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345199+0000","last_change":"2023-09-30T22:57:47.344969+0000","last_active":"2023-09-30T22:57:47.345199+0000","last_peered":"2023-09-30T22:57:47.345199+0000","last_clean":"2023-09-30T22:57:47.345199+0000","last_became_active":"2023-09-30T22:57:47.344381+0000","last_became_peered":"2023-09-30T22:57:47.344381+0000","last_unstale":"2023-09-30T22:57:47.345199+0000","last_undegraded":"2023-09-30T22:57:47.345199+0000","last_fullsized":"2023-09-30T22:57:47.345199+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345555+0000","last_change":"2023-09-30T22:57:46.329838+0000","last_active":"2023-09-30T22:57:47.345555+0000","last_peered":"2023-09-30T22:57:47.345555+0000","last_clean":"2023-09-30T22:57:47.345555+0000","last_became_active":"2023-09-30T22:57:46.329311+0000","last_became_peered":"2023-09-30T22:57:46.329311+0000","last_unstale":"2023-09-30T22:57:47.345555+0000","last_undegraded":"2023-09-30T22:57:47.345555+0000","last_fullsized":"2023-09-30T22:57:47.345555+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:46:59.626736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358258+0000","last_change":"2023-09-30T22:57:47.358122+0000","last_active":"2023-09-30T22:57:47.358258+0000","last_peered":"2023-09-30T22:57:47.358258+0000","last_clean":"2023-09-30T22:57:47.358258+0000","last_became_active":"2023-09-30T22:57:47.357598+0000","last_became_peered":"2023-09-30T22:57:47.357598+0000","last_unstale":"2023-09-30T22:57:47.358258+0000","last_undegraded":"2023-09-30T22:57:47.358258+0000","last_fullsized":"2023-09-30T22:57:47.358258+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:46.249501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.342334+0000","last_change":"2023-09-30T22:57:46.326797+0000","last_active":"2023-09-30T22:57:47.342334+0000","last_peered":"2023-09-30T22:57:47.342334+0000","last_clean":"2023-09-30T22:57:47.342334+0000","last_became_active":"2023-09-30T22:57:46.326535+0000","last_became_peered":"2023-09-30T22:57:46.326535+0000","last_unstale":"2023-09-30T22:57:47.342334+0000","last_undegraded":"2023-09-30T22:57:47.342334+0000","last_fullsized":"2023-09-30T22:57:47.342334+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:59.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.357908+0000","last_change":"2023-09-30T22:57:47.357746+0000","last_active":"2023-09-30T22:57:47.357908+0000","last_peered":"2023-09-30T22:57:47.357908+0000","last_clean":"2023-09-30T22:57:47.357908+0000","last_became_active":"2023-09-30T22:57:47.357300+0000","last_became_peered":"2023-09-30T22:57:47.357300+0000","last_unstale":"2023-09-30T22:57:47.357908+0000","last_undegraded":"2023-09-30T22:57:47.357908+0000","last_fullsized":"2023-09-30T22:57:47.357908+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:42:51.624488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337662+0000","last_change":"2023-09-30T22:57:46.328233+0000","last_active":"2023-09-30T22:57:47.337662+0000","last_peered":"2023-09-30T22:57:47.337662+0000","last_clean":"2023-09-30T22:57:47.337662+0000","last_became_active":"2023-09-30T22:57:46.328011+0000","last_became_peered":"2023-09-30T22:57:46.328011+0000","last_unstale":"2023-09-30T22:57:47.337662+0000","last_undegraded":"2023-09-30T22:57:47.337662+0000","last_fullsized":"2023-09-30T22:57:47.337662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:53.277996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.347091+0000","last_change":"2023-09-30T22:57:47.345324+0000","last_active":"2023-09-30T22:57:47.347091+0000","last_peered":"2023-09-30T22:57:47.347091+0000","last_clean":"2023-09-30T22:57:47.347091+0000","last_became_active":"2023-09-30T22:57:47.344697+0000","last_became_peered":"2023-09-30T22:57:47.344697+0000","last_unstale":"2023-09-30T22:57:47.347091+0000","last_undegraded":"2023-09-30T22:57:47.347091+0000","last_fullsized":"2023-09-30T22:57:47.347091+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:22.413372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359778+0000","last_change":"2023-09-30T22:57:46.328096+0000","last_active":"2023-09-30T22:57:47.359778+0000","last_peered":"2023-09-30T22:57:47.359778+0000","last_clean":"2023-09-30T22:57:47.359778+0000","last_became_active":"2023-09-30T22:57:46.327733+0000","last_became_peered":"2023-09-30T22:57:46.327733+0000","last_unstale":"2023-09-30T22:57:47.359778+0000","last_undegraded":"2023-09-30T22:57:47.359778+0000","last_fullsized":"2023-09-30T22:57:47.359778+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:10.249931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351086+0000","last_change":"2023-09-30T22:57:47.350617+0000","last_active":"2023-09-30T22:57:47.351086+0000","last_peered":"2023-09-30T22:57:47.351086+0000","last_clean":"2023-09-30T22:57:47.351086+0000","last_became_active":"2023-09-30T22:57:47.349376+0000","last_became_peered":"2023-09-30T22:57:47.349376+0000","last_unstale":"2023-09-30T22:57:47.351086+0000","last_undegraded":"2023-09-30T22:57:47.351086+0000","last_fullsized":"2023-09-30T22:57:47.351086+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:32:16.041998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"110'6","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.362611+0000","last_change":"2023-09-30T22:57:46.326967+0000","last_active":"2023-09-30T22:57:47.362611+0000","last_peered":"2023-09-30T22:57:47.362611+0000","last_clean":"2023-09-30T22:57:47.362611+0000","last_became_active":"2023-09-30T22:57:46.326481+0000","last_became_peered":"2023-09-30T22:57:46.326481+0000","last_unstale":"2023-09-30T22:57:47.362611+0000","last_undegraded":"2023-09-30T22:57:47.362611+0000","last_fullsized":"2023-09-30T22:57:47.362611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:50.205703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359389+0000","last_change":"2023-09-30T22:57:47.359304+0000","last_active":"2023-09-30T22:57:47.359389+0000","last_peered":"2023-09-30T22:57:47.359389+0000","last_clean":"2023-09-30T22:57:47.359389+0000","last_became_active":"2023-09-30T22:57:47.358833+0000","last_became_peered":"2023-09-30T22:57:47.358833+0000","last_unstale":"2023-09-30T22:57:47.359389+0000","last_undegraded":"2023-09-30T22:57:47.359389+0000","last_fullsized":"2023-09-30T22:57:47.359389+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:45.574707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.353583+0000","last_change":"2023-09-30T22:57:46.330755+0000","last_active":"2023-09-30T22:57:47.353583+0000","last_peered":"2023-09-30T22:57:47.353583+0000","last_clean":"2023-09-30T22:57:47.353583+0000","last_became_active":"2023-09-30T22:57:46.330373+0000","last_became_peered":"2023-09-30T22:57:46.330373+0000","last_unstale":"2023-09-30T22:57:47.353583+0000","last_undegraded":"2023-09-30T22:57:47.353583+0000","last_fullsized":"2023-09-30T22:57:47.353583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:53.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355719+0000","last_change":"2023-09-30T22:57:47.355654+0000","last_active":"2023-09-30T22:57:47.355719+0000","last_peered":"2023-09-30T22:57:47.355719+0000","last_clean":"2023-09-30T22:57:47.355719+0000","last_became_active":"2023-09-30T22:57:47.353273+0000","last_became_peered":"2023-09-30T22:57:47.353273+0000","last_unstale":"2023-09-30T22:57:47.355719+0000","last_undegraded":"2023-09-30T22:57:47.355719+0000","last_fullsized":"2023-09-30T22:57:47.355719+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:33:14.420556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336966+0000","last_change":"2023-09-30T22:57:46.327220+0000","last_active":"2023-09-30T22:57:47.336966+0000","last_peered":"2023-09-30T22:57:47.336966+0000","last_clean":"2023-09-30T22:57:47.336966+0000","last_became_active":"2023-09-30T22:57:46.326718+0000","last_became_peered":"2023-09-30T22:57:46.326718+0000","last_unstale":"2023-09-30T22:57:47.336966+0000","last_undegraded":"2023-09-30T22:57:47.336966+0000","last_fullsized":"2023-09-30T22:57:47.336966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:04:28.267376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.340878+0000","last_change":"2023-09-30T22:57:47.340802+0000","last_active":"2023-09-30T22:57:47.340878+0000","last_peered":"2023-09-30T22:57:47.340878+0000","last_clean":"2023-09-30T22:57:47.340878+0000","last_became_active":"2023-09-30T22:57:47.340563+0000","last_became_peered":"2023-09-30T22:57:47.340563+0000","last_unstale":"2023-09-30T22:57:47.340878+0000","last_undegraded":"2023-09-30T22:57:47.340878+0000","last_fullsized":"2023-09-30T22:57:47.340878+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:50:51.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336825+0000","last_change":"2023-09-30T22:57:46.326928+0000","last_active":"2023-09-30T22:57:47.336825+0000","last_peered":"2023-09-30T22:57:47.336825+0000","last_clean":"2023-09-30T22:57:47.336825+0000","last_became_active":"2023-09-30T22:57:46.326433+0000","last_became_peered":"2023-09-30T22:57:46.326433+0000","last_unstale":"2023-09-30T22:57:47.336825+0000","last_undegraded":"2023-09-30T22:57:47.336825+0000","last_fullsized":"2023-09-30T22:57:47.336825+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:05:57.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355109+0000","last_change":"2023-09-30T22:57:47.354855+0000","last_active":"2023-09-30T22:57:47.355109+0000","last_peered":"2023-09-30T22:57:47.355109+0000","last_clean":"2023-09-30T22:57:47.355109+0000","last_became_active":"2023-09-30T22:57:47.354277+0000","last_became_peered":"2023-09-30T22:57:47.354277+0000","last_unstale":"2023-09-30T22:57:47.355109+0000","last_undegraded":"2023-09-30T22:57:47.355109+0000","last_fullsized":"2023-09-30T22:57:47.355109+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"110'8","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.360417+0000","last_change":"2023-09-30T22:57:46.327580+0000","last_active":"2023-09-30T22:57:47.360417+0000","last_peered":"2023-09-30T22:57:47.360417+0000","last_clean":"2023-09-30T22:57:47.360417+0000","last_became_active":"2023-09-30T22:57:46.327347+0000","last_became_peered":"2023-09-30T22:57:46.327347+0000","last_unstale":"2023-09-30T22:57:47.360417+0000","last_undegraded":"2023-09-30T22:57:47.360417+0000","last_fullsized":"2023-09-30T22:57:47.360417+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:22.893668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349980+0000","last_change":"2023-09-30T22:57:47.349864+0000","last_active":"2023-09-30T22:57:47.349980+0000","last_peered":"2023-09-30T22:57:47.349980+0000","last_clean":"2023-09-30T22:57:47.349980+0000","last_became_active":"2023-09-30T22:57:47.349662+0000","last_became_peered":"2023-09-30T22:57:47.349662+0000","last_unstale":"2023-09-30T22:57:47.349980+0000","last_undegraded":"2023-09-30T22:57:47.349980+0000","last_fullsized":"2023-09-30T22:57:47.349980+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354472+0000","last_change":"2023-09-30T22:57:46.324881+0000","last_active":"2023-09-30T22:57:47.354472+0000","last_peered":"2023-09-30T22:57:47.354472+0000","last_clean":"2023-09-30T22:57:47.354472+0000","last_became_active":"2023-09-30T22:57:46.324629+0000","last_became_peered":"2023-09-30T22:57:46.324629+0000","last_unstale":"2023-09-30T22:57:47.354472+0000","last_undegraded":"2023-09-30T22:57:47.354472+0000","last_fullsized":"2023-09-30T22:57:47.354472+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:51.004328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.352704+0000","last_change":"2023-09-30T22:57:47.352586+0000","last_active":"2023-09-30T22:57:47.352704+0000","last_peered":"2023-09-30T22:57:47.352704+0000","last_clean":"2023-09-30T22:57:47.352704+0000","last_became_active":"2023-09-30T22:57:47.352184+0000","last_became_peered":"2023-09-30T22:57:47.352184+0000","last_unstale":"2023-09-30T22:57:47.352704+0000","last_undegraded":"2023-09-30T22:57:47.352704+0000","last_fullsized":"2023-09-30T22:57:47.352704+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-09-30T22:57:49.697050+0000","last_change":"2023-09-30T22:57:46.330434+0000","last_active":"2023-09-30T22:57:49.697050+0000","last_peered":"2023-09-30T22:57:49.697050+0000","last_clean":"2023-09-30T22:57:49.697050+0000","last_became_active":"2023-09-30T22:57:46.330220+0000","last_became_peered":"2023-09-30T22:57:46.330220+0000","last_unstale":"2023-09-30T22:57:49.697050+0000","last_undegraded":"2023-09-30T22:57:49.697050+0000","last_fullsized":"2023-09-30T22:57:49.697050+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:36.158412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355094+0000","last_change":"2023-09-30T22:57:47.354174+0000","last_active":"2023-09-30T22:57:47.355094+0000","last_peered":"2023-09-30T22:57:47.355094+0000","last_clean":"2023-09-30T22:57:47.355094+0000","last_became_active":"2023-09-30T22:57:47.353694+0000","last_became_peered":"2023-09-30T22:57:47.353694+0000","last_unstale":"2023-09-30T22:57:47.355094+0000","last_undegraded":"2023-09-30T22:57:47.355094+0000","last_fullsized":"2023-09-30T22:57:47.355094+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.341428+0000","last_change":"2023-09-30T22:57:46.326357+0000","last_active":"2023-09-30T22:57:47.341428+0000","last_peered":"2023-09-30T22:57:47.341428+0000","last_clean":"2023-09-30T22:57:47.341428+0000","last_became_active":"2023-09-30T22:57:46.326124+0000","last_became_peered":"2023-09-30T22:57:46.326124+0000","last_unstale":"2023-09-30T22:57:47.341428+0000","last_undegraded":"2023-09-30T22:57:47.341428+0000","last_fullsized":"2023-09-30T22:57:47.341428+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.355581+0000","last_change":"2023-09-30T22:57:47.355504+0000","last_active":"2023-09-30T22:57:47.355581+0000","last_peered":"2023-09-30T22:57:47.355581+0000","last_clean":"2023-09-30T22:57:47.355581+0000","last_became_active":"2023-09-30T22:57:47.352945+0000","last_became_peered":"2023-09-30T22:57:47.352945+0000","last_unstale":"2023-09-30T22:57:47.355581+0000","last_undegraded":"2023-09-30T22:57:47.355581+0000","last_fullsized":"2023-09-30T22:57:47.355581+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:34:11.253908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337429+0000","last_change":"2023-09-30T22:57:46.321470+0000","last_active":"2023-09-30T22:57:47.337429+0000","last_peered":"2023-09-30T22:57:47.337429+0000","last_clean":"2023-09-30T22:57:47.337429+0000","last_became_active":"2023-09-30T22:57:46.321233+0000","last_became_peered":"2023-09-30T22:57:46.321233+0000","last_unstale":"2023-09-30T22:57:47.337429+0000","last_undegraded":"2023-09-30T22:57:47.337429+0000","last_fullsized":"2023-09-30T22:57:47.337429+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:58.334725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354191+0000","last_change":"2023-09-30T22:57:47.354114+0000","last_active":"2023-09-30T22:57:47.354191+0000","last_peered":"2023-09-30T22:57:47.354191+0000","last_clean":"2023-09-30T22:57:47.354191+0000","last_became_active":"2023-09-30T22:57:47.353887+0000","last_became_peered":"2023-09-30T22:57:47.353887+0000","last_unstale":"2023-09-30T22:57:47.354191+0000","last_undegraded":"2023-09-30T22:57:47.354191+0000","last_fullsized":"2023-09-30T22:57:47.354191+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:47:27.062944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336851+0000","last_change":"2023-09-30T22:57:46.323408+0000","last_active":"2023-09-30T22:57:47.336851+0000","last_peered":"2023-09-30T22:57:47.336851+0000","last_clean":"2023-09-30T22:57:47.336851+0000","last_became_active":"2023-09-30T22:57:46.322636+0000","last_became_peered":"2023-09-30T22:57:46.322636+0000","last_unstale":"2023-09-30T22:57:47.336851+0000","last_undegraded":"2023-09-30T22:57:47.336851+0000","last_fullsized":"2023-09-30T22:57:47.336851+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:00.151513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345920+0000","last_change":"2023-09-30T22:57:47.345338+0000","last_active":"2023-09-30T22:57:47.345920+0000","last_peered":"2023-09-30T22:57:47.345920+0000","last_clean":"2023-09-30T22:57:47.345920+0000","last_became_active":"2023-09-30T22:57:47.345110+0000","last_became_peered":"2023-09-30T22:57:47.345110+0000","last_unstale":"2023-09-30T22:57:47.345920+0000","last_undegraded":"2023-09-30T22:57:47.345920+0000","last_fullsized":"2023-09-30T22:57:47.345920+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:13.248539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343405+0000","last_change":"2023-09-30T22:57:46.327259+0000","last_active":"2023-09-30T22:57:47.343405+0000","last_peered":"2023-09-30T22:57:47.343405+0000","last_clean":"2023-09-30T22:57:47.343405+0000","last_became_active":"2023-09-30T22:57:46.326989+0000","last_became_peered":"2023-09-30T22:57:46.326989+0000","last_unstale":"2023-09-30T22:57:47.343405+0000","last_undegraded":"2023-09-30T22:57:47.343405+0000","last_fullsized":"2023-09-30T22:57:47.343405+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354041+0000","last_change":"2023-09-30T22:57:47.353846+0000","last_active":"2023-09-30T22:57:47.354041+0000","last_peered":"2023-09-30T22:57:47.354041+0000","last_clean":"2023-09-30T22:57:47.354041+0000","last_became_active":"2023-09-30T22:57:47.353595+0000","last_became_peered":"2023-09-30T22:57:47.353595+0000","last_unstale":"2023-09-30T22:57:47.354041+0000","last_undegraded":"2023-09-30T22:57:47.354041+0000","last_fullsized":"2023-09-30T22:57:47.354041+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:18.138519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349990+0000","last_change":"2023-09-30T22:57:46.327694+0000","last_active":"2023-09-30T22:57:47.349990+0000","last_peered":"2023-09-30T22:57:47.349990+0000","last_clean":"2023-09-30T22:57:47.349990+0000","last_became_active":"2023-09-30T22:57:46.327163+0000","last_became_peered":"2023-09-30T22:57:46.327163+0000","last_unstale":"2023-09-30T22:57:47.349990+0000","last_undegraded":"2023-09-30T22:57:47.349990+0000","last_fullsized":"2023-09-30T22:57:47.349990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:37:56.303593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351132+0000","last_change":"2023-09-30T22:57:47.350939+0000","last_active":"2023-09-30T22:57:47.351132+0000","last_peered":"2023-09-30T22:57:47.351132+0000","last_clean":"2023-09-30T22:57:47.351132+0000","last_became_active":"2023-09-30T22:57:47.349984+0000","last_became_peered":"2023-09-30T22:57:47.349984+0000","last_unstale":"2023-09-30T22:57:47.351132+0000","last_undegraded":"2023-09-30T22:57:47.351132+0000","last_fullsized":"2023-09-30T22:57:47.351132+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:52.008304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343214+0000","last_change":"2023-09-30T22:57:46.326830+0000","last_active":"2023-09-30T22:57:47.343214+0000","last_peered":"2023-09-30T22:57:47.343214+0000","last_clean":"2023-09-30T22:57:47.343214+0000","last_became_active":"2023-09-30T22:57:46.326524+0000","last_became_peered":"2023-09-30T22:57:46.326524+0000","last_unstale":"2023-09-30T22:57:47.343214+0000","last_undegraded":"2023-09-30T22:57:47.343214+0000","last_fullsized":"2023-09-30T22:57:47.343214+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:14.959667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356281+0000","last_change":"2023-09-30T22:57:47.355568+0000","last_active":"2023-09-30T22:57:47.356281+0000","last_peered":"2023-09-30T22:57:47.356281+0000","last_clean":"2023-09-30T22:57:47.356281+0000","last_became_active":"2023-09-30T22:57:47.355329+0000","last_became_peered":"2023-09-30T22:57:47.355329+0000","last_unstale":"2023-09-30T22:57:47.356281+0000","last_undegraded":"2023-09-30T22:57:47.356281+0000","last_fullsized":"2023-09-30T22:57:47.356281+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:56.277804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.359856+0000","last_change":"2023-09-30T22:57:46.327951+0000","last_active":"2023-09-30T22:57:47.359856+0000","last_peered":"2023-09-30T22:57:47.359856+0000","last_clean":"2023-09-30T22:57:47.359856+0000","last_became_active":"2023-09-30T22:57:46.327380+0000","last_became_peered":"2023-09-30T22:57:46.327380+0000","last_unstale":"2023-09-30T22:57:47.359856+0000","last_undegraded":"2023-09-30T22:57:47.359856+0000","last_fullsized":"2023-09-30T22:57:47.359856+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:50:55.273827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346961+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:57:47.346961+0000","last_peered":"2023-09-30T22:57:47.346961+0000","last_clean":"2023-09-30T22:57:47.346961+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:57:47.346961+0000","last_undegraded":"2023-09-30T22:57:47.346961+0000","last_fullsized":"2023-09-30T22:57:47.346961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358211+0000","last_change":"2023-09-30T22:57:47.357841+0000","last_active":"2023-09-30T22:57:47.358211+0000","last_peered":"2023-09-30T22:57:47.358211+0000","last_clean":"2023-09-30T22:57:47.358211+0000","last_became_active":"2023-09-30T22:57:47.357426+0000","last_became_peered":"2023-09-30T22:57:47.357426+0000","last_unstale":"2023-09-30T22:57:47.358211+0000","last_undegraded":"2023-09-30T22:57:47.358211+0000","last_fullsized":"2023-09-30T22:57:47.358211+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:18.377055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356617+0000","last_change":"2023-09-30T22:57:46.329817+0000","last_active":"2023-09-30T22:57:47.356617+0000","last_peered":"2023-09-30T22:57:47.356617+0000","last_clean":"2023-09-30T22:57:47.356617+0000","last_became_active":"2023-09-30T22:57:46.329534+0000","last_became_peered":"2023-09-30T22:57:46.329534+0000","last_unstale":"2023-09-30T22:57:47.356617+0000","last_undegraded":"2023-09-30T22:57:47.356617+0000","last_fullsized":"2023-09-30T22:57:47.356617+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:11:14.497043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.338031+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:57:47.338031+0000","last_peered":"2023-09-30T22:57:47.338031+0000","last_clean":"2023-09-30T22:57:47.338031+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:57:47.338031+0000","last_undegraded":"2023-09-30T22:57:47.338031+0000","last_fullsized":"2023-09-30T22:57:47.338031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343580+0000","last_change":"2023-09-30T22:57:47.343168+0000","last_active":"2023-09-30T22:57:47.343580+0000","last_peered":"2023-09-30T22:57:47.343580+0000","last_clean":"2023-09-30T22:57:47.343580+0000","last_became_active":"2023-09-30T22:57:47.342935+0000","last_became_peered":"2023-09-30T22:57:47.342935+0000","last_unstale":"2023-09-30T22:57:47.343580+0000","last_undegraded":"2023-09-30T22:57:47.343580+0000","last_fullsized":"2023-09-30T22:57:47.343580+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:59.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.356087+0000","last_change":"2023-09-30T22:57:46.330494+0000","last_active":"2023-09-30T22:57:47.356087+0000","last_peered":"2023-09-30T22:57:47.356087+0000","last_clean":"2023-09-30T22:57:47.356087+0000","last_became_active":"2023-09-30T22:57:46.330277+0000","last_became_peered":"2023-09-30T22:57:46.330277+0000","last_unstale":"2023-09-30T22:57:47.356087+0000","last_undegraded":"2023-09-30T22:57:47.356087+0000","last_fullsized":"2023-09-30T22:57:47.356087+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:57:31.215330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337610+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:57:47.337610+0000","last_peered":"2023-09-30T22:57:47.337610+0000","last_clean":"2023-09-30T22:57:47.337610+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:57:47.337610+0000","last_undegraded":"2023-09-30T22:57:47.337610+0000","last_fullsized":"2023-09-30T22:57:47.337610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.358241+0000","last_change":"2023-09-30T22:57:47.357853+0000","last_active":"2023-09-30T22:57:47.358241+0000","last_peered":"2023-09-30T22:57:47.358241+0000","last_clean":"2023-09-30T22:57:47.358241+0000","last_became_active":"2023-09-30T22:57:47.357288+0000","last_became_peered":"2023-09-30T22:57:47.357288+0000","last_unstale":"2023-09-30T22:57:47.358241+0000","last_undegraded":"2023-09-30T22:57:47.358241+0000","last_fullsized":"2023-09-30T22:57:47.358241+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:22:52.008304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.336944+0000","last_change":"2023-09-30T22:57:46.322115+0000","last_active":"2023-09-30T22:57:47.336944+0000","last_peered":"2023-09-30T22:57:47.336944+0000","last_clean":"2023-09-30T22:57:47.336944+0000","last_became_active":"2023-09-30T22:57:46.321808+0000","last_became_peered":"2023-09-30T22:57:46.321808+0000","last_unstale":"2023-09-30T22:57:47.336944+0000","last_undegraded":"2023-09-30T22:57:47.336944+0000","last_fullsized":"2023-09-30T22:57:47.336944+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:40:03.448369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.338076+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:57:47.338076+0000","last_peered":"2023-09-30T22:57:47.338076+0000","last_clean":"2023-09-30T22:57:47.338076+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:57:47.338076+0000","last_undegraded":"2023-09-30T22:57:47.338076+0000","last_fullsized":"2023-09-30T22:57:47.338076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.343317+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:57:47.343317+0000","last_peered":"2023-09-30T22:57:47.343317+0000","last_clean":"2023-09-30T22:57:47.343317+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:57:47.343317+0000","last_undegraded":"2023-09-30T22:57:47.343317+0000","last_fullsized":"2023-09-30T22:57:47.343317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.350505+0000","last_change":"2023-09-30T22:57:47.350420+0000","last_active":"2023-09-30T22:57:47.350505+0000","last_peered":"2023-09-30T22:57:47.350505+0000","last_clean":"2023-09-30T22:57:47.350505+0000","last_became_active":"2023-09-30T22:57:47.349955+0000","last_became_peered":"2023-09-30T22:57:47.349955+0000","last_unstale":"2023-09-30T22:57:47.350505+0000","last_undegraded":"2023-09-30T22:57:47.350505+0000","last_fullsized":"2023-09-30T22:57:47.350505+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:00:27.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.354813+0000","last_change":"2023-09-30T22:57:46.322978+0000","last_active":"2023-09-30T22:57:47.354813+0000","last_peered":"2023-09-30T22:57:47.354813+0000","last_clean":"2023-09-30T22:57:47.354813+0000","last_became_active":"2023-09-30T22:57:46.322754+0000","last_became_peered":"2023-09-30T22:57:46.322754+0000","last_unstale":"2023-09-30T22:57:47.354813+0000","last_undegraded":"2023-09-30T22:57:47.354813+0000","last_fullsized":"2023-09-30T22:57:47.354813+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:15.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.339575+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:57:47.339575+0000","last_peered":"2023-09-30T22:57:47.339575+0000","last_clean":"2023-09-30T22:57:47.339575+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:57:47.339575+0000","last_undegraded":"2023-09-30T22:57:47.339575+0000","last_fullsized":"2023-09-30T22:57:47.339575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.348944+0000","last_change":"2023-09-30T22:57:47.348879+0000","last_active":"2023-09-30T22:57:47.348944+0000","last_peered":"2023-09-30T22:57:47.348944+0000","last_clean":"2023-09-30T22:57:47.348944+0000","last_became_active":"2023-09-30T22:57:47.348671+0000","last_became_peered":"2023-09-30T22:57:47.348671+0000","last_unstale":"2023-09-30T22:57:47.348944+0000","last_undegraded":"2023-09-30T22:57:47.348944+0000","last_fullsized":"2023-09-30T22:57:47.348944+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:38.468211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.340453+0000","last_change":"2023-09-30T22:57:46.325177+0000","last_active":"2023-09-30T22:57:47.340453+0000","last_peered":"2023-09-30T22:57:47.340453+0000","last_clean":"2023-09-30T22:57:47.340453+0000","last_became_active":"2023-09-30T22:57:46.324955+0000","last_became_peered":"2023-09-30T22:57:46.324955+0000","last_unstale":"2023-09-30T22:57:47.340453+0000","last_undegraded":"2023-09-30T22:57:47.340453+0000","last_fullsized":"2023-09-30T22:57:47.340453+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:14.324996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.339322+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:57:47.339322+0000","last_peered":"2023-09-30T22:57:47.339322+0000","last_clean":"2023-09-30T22:57:47.339322+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:57:47.339322+0000","last_undegraded":"2023-09-30T22:57:47.339322+0000","last_fullsized":"2023-09-30T22:57:47.339322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.349833+0000","last_change":"2023-09-30T22:57:47.349580+0000","last_active":"2023-09-30T22:57:47.349833+0000","last_peered":"2023-09-30T22:57:47.349833+0000","last_clean":"2023-09-30T22:57:47.349833+0000","last_became_active":"2023-09-30T22:57:47.349005+0000","last_became_peered":"2023-09-30T22:57:47.349005+0000","last_unstale":"2023-09-30T22:57:47.349833+0000","last_undegraded":"2023-09-30T22:57:47.349833+0000","last_fullsized":"2023-09-30T22:57:47.349833+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:54.937505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.346385+0000","last_change":"2023-09-30T22:57:46.325292+0000","last_active":"2023-09-30T22:57:47.346385+0000","last_peered":"2023-09-30T22:57:47.346385+0000","last_clean":"2023-09-30T22:57:47.346385+0000","last_became_active":"2023-09-30T22:57:46.325062+0000","last_became_peered":"2023-09-30T22:57:46.325062+0000","last_unstale":"2023-09-30T22:57:47.346385+0000","last_undegraded":"2023-09-30T22:57:47.346385+0000","last_fullsized":"2023-09-30T22:57:47.346385+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:41.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.344417+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:57:47.344417+0000","last_peered":"2023-09-30T22:57:47.344417+0000","last_clean":"2023-09-30T22:57:47.344417+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:57:47.344417+0000","last_undegraded":"2023-09-30T22:57:47.344417+0000","last_fullsized":"2023-09-30T22:57:47.344417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.351627+0000","last_change":"2023-09-30T22:57:47.351092+0000","last_active":"2023-09-30T22:57:47.351627+0000","last_peered":"2023-09-30T22:57:47.351627+0000","last_clean":"2023-09-30T22:57:47.351627+0000","last_became_active":"2023-09-30T22:57:47.350831+0000","last_became_peered":"2023-09-30T22:57:47.350831+0000","last_unstale":"2023-09-30T22:57:47.351627+0000","last_undegraded":"2023-09-30T22:57:47.351627+0000","last_fullsized":"2023-09-30T22:57:47.351627+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:46.309574+0000","last_clean_scrub_stamp":"2023-09-30T22:57:46.309574+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:38.904920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.345515+0000","last_change":"2023-09-30T22:57:46.324050+0000","last_active":"2023-09-30T22:57:47.345515+0000","last_peered":"2023-09-30T22:57:47.345515+0000","last_clean":"2023-09-30T22:57:47.345515+0000","last_became_active":"2023-09-30T22:57:46.323824+0000","last_became_peered":"2023-09-30T22:57:46.323824+0000","last_unstale":"2023-09-30T22:57:47.345515+0000","last_undegraded":"2023-09-30T22:57:47.345515+0000","last_fullsized":"2023-09-30T22:57:47.345515+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:57:45.305597+0000","last_clean_scrub_stamp":"2023-09-30T22:57:45.305597+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:05:37.464235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-09-30T22:57:47.337955+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:57:47.337955+0000","last_peered":"2023-09-30T22:57:47.337955+0000","last_clean":"2023-09-30T22:57:47.337955+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:57:47.337955+0000","last_undegraded":"2023-09-30T22:57:47.337955+0000","last_fullsized":"2023-09-30T22:57:47.337955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66700000000000004,"15min":0.63500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.65000000000000002},"min":{"1min":0.53800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.874,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.747}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.67800000000000005},"min":{"1min":0.53700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.52400000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.502,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.871,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.135,"15min":1.135},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.004},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94499999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.071,"15min":1.071},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":630,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194682,"statfs":{"total":200000000,"available":199354651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78000000000000003,"15min":0.98799999999999999},"min":{"1min":0.55700000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.97699999999999998,"5min":6.5190000000000001,"15min":6.5190000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76000000000000001,"15min":0.80200000000000005},"min":{"1min":0.51700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0800000000000001,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.67100000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.46200000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.83999999999999997,"15min":1.022},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95299999999999996,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.81299999999999994},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":1.0289999999999999},"min":{"1min":0.48099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0429999999999999,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.95599999999999996},"min":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0089999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.107,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1259999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68500000000000005,"15min":0.65700000000000003},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.321,"15min":1.321},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0229999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80300000000000005,"15min":0.75900000000000001},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.198,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.61399999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.97399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194106,"statfs":{"total":200000000,"available":198765285,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45700000000000002,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.47099999999999997},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.52000000000000002},"min":{"1min":0.44400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.47299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.755},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.72599999999999998},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.71199999999999997},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.22},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76300000000000001,"15min":0.73299999999999998},"min":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.72399999999999998},"min":{"1min":0.56999999999999995,"5min":0.432,"15min":0.432},"max":{"1min":1.032,"5min":1.127,"15min":1.127},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Sep 30 22:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0660000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.629},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80300000000000005,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.44800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.51400000000000001},"min":{"1min":0.34399999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.879,"15min":0.879},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.96799999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.27,"15min":1.27},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.48599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0600000000000001,"5min":1.171,"15min":1.171},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.57599999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.119,"15min":1.119},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76600000000000001,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.621}]},{"osd":7,"last update":"Sat Sep 30 22:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.173,"15min":1.173},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.095,"5min":1.21,"15min":1.21},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":629,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199355735,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79200000000000004,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.751},"min":{"1min":0.53600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.38,"15min":0.38},"max":{"1min":1.04,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.151,"5min":1.179,"15min":1.179},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.236,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.014,"5min":1.615,"15min":1.615},"last":0.878},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.59199999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.57299999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.117,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":630,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194682,"statfs":{"total":200000000,"available":199354663,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.251,"15min":0.251},"max":{"1min":0.58099999999999996,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47899999999999998,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59899999999999998,"5min":1.919,"15min":1.919},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68300000000000005,"5min":1.254,"15min":1.254},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.747,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.747,"15min":0.72799999999999998},"min":{"1min":0.52900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.242,"5min":1.401,"15min":1.401},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.76400000000000001},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.21,"5min":3.306,"15min":3.306},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98199999999999998,"5min":1.508,"15min":1.508},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.745},"min":{"1min":0.57099999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.621}]},{"osd":6,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.151,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0700000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.61799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1160000000000001,"5min":1.573,"15min":1.573},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194683,"statfs":{"total":200000000,"available":199356311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93100000000000005,"5min":1.022,"15min":1.022},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64300000000000002,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.746}]},{"osd":1,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64600000000000002,"15min":0.623},"min":{"1min":0.48199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.66400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95199999999999996,"5min":1.006,"15min":1.006},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72199999999999998,"15min":0.67900000000000005},"min":{"1min":0.53400000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91100000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72499999999999998,"15min":0.69099999999999995},"min":{"1min":0.52500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90100000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81399999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.878},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":1,"5min":1,"15min":1},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93500000000000005,"5min":1.016,"15min":1.016},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.026,"5min":1.044,"15min":1.044},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194107,"statfs":{"total":200000000,"available":198765943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.42199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.623},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.81399999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84299999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.044,"15min":1.044},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69499999999999995,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.79500000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.878,"15min":0.878},"last":0.91000000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.749},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.39200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90700000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.37,"15min":0.37},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.87},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97899999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.84899999999999998}]}]}],"pool_statfs":[]}} 2023-09-30T22:57:57.003 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:57:57.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T22:57:57.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.232+0000 7efc651ff700 1 Processor -- start 2023-09-30T22:57:57.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.232+0000 7efc651ff700 1 -- start start 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.233+0000 7efc651ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efc60141150 0x7efc601580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.233+0000 7efc651ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc600c40e0 0x7efc600c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc651ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc600c38d0 con 0x7efc600c6270 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc651ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc600c6aa0 con 0x7efc600c40e0 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc651ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc600c4a30 con 0x7efc60141150 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc600c40e0 0x7efc600c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc600c40e0 0x7efc600c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46174/0 (socket says 172.21.15.142:46174) 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5f59e700 1 -- 172.21.15.142:0/1440670652 learned_addr learned my addr 172.21.15.142:0/1440670652 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:57.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5ed9d700 1 --2- 172.21.15.142:0/1440670652 >> v2:172.21.15.148:3300/0 conn(0x7efc60141150 0x7efc601580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5f59e700 1 -- 172.21.15.142:0/1440670652 >> v2:172.21.15.148:3300/0 conn(0x7efc60141150 msgr2=0x7efc601580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5f59e700 1 --2- 172.21.15.142:0/1440670652 >> v2:172.21.15.148:3300/0 conn(0x7efc60141150 0x7efc601580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5f59e700 1 -- 172.21.15.142:0/1440670652 >> v1:172.21.15.148:6789/0 conn(0x7efc600c6270 legacy=0x7efc6015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.234+0000 7efc5f59e700 1 -- 172.21.15.142:0/1440670652 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6006a040 con 0x7efc600c40e0 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc5f59e700 1 --2- 172.21.15.142:0/1440670652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c40e0 0x7efc600c44f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efc6006c230 tx=0x7efc58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ba74f2ffbedc86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc5dd9b700 1 -- 172.21.15.142:0/1440670652 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800e070 con 0x7efc600c40e0 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc5dd9b700 1 -- 172.21.15.142:0/1440670652 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800ba20 con 0x7efc600c40e0 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc5dd9b700 1 -- 172.21.15.142:0/1440670652 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580092e0 con 0x7efc600c40e0 2023-09-30T22:57:57.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc651ff700 1 -- 172.21.15.142:0/1440670652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c40e0 msgr2=0x7efc600c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc651ff700 1 --2- 172.21.15.142:0/1440670652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c40e0 0x7efc600c44f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efc6006c230 tx=0x7efc58009840 comp rx=0 tx=0).stop 2023-09-30T22:57:57.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc651ff700 1 -- 172.21.15.142:0/1440670652 shutdown_connections 2023-09-30T22:57:57.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc651ff700 1 --2- 172.21.15.142:0/1440670652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c40e0 0x7efc600c44f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc651ff700 1 --2- 172.21.15.142:0/1440670652 >> v2:172.21.15.148:3300/0 conn(0x7efc60141150 0x7efc601580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.235+0000 7efc651ff700 1 -- 172.21.15.142:0/1440670652 >> 172.21.15.142:0/1440670652 conn(0x7efc600cc670 msgr2=0x7efc600cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:57.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.236+0000 7efc651ff700 1 -- 172.21.15.142:0/1440670652 shutdown_connections 2023-09-30T22:57:57.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.236+0000 7efc651ff700 1 -- 172.21.15.142:0/1440670652 wait complete. 2023-09-30T22:57:57.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.237+0000 7efc651ff700 1 Processor -- start 2023-09-30T22:57:57.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.237+0000 7efc651ff700 1 -- start start 2023-09-30T22:57:57.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc651ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc600c40e0 0x7efc600b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc651ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c6270 0x7efc600b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc651ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc60141150 0x7efc6013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc651ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600b6980 con 0x7efc600c6270 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc651ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc60168730 con 0x7efc60141150 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc651ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc600b60e0 con 0x7efc600c40e0 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc5e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c6270 0x7efc600b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc5e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c6270 0x7efc600b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46178/0 (socket says 172.21.15.142:46178) 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc5e59c700 1 -- 172.21.15.142:0/1915880413 learned_addr learned my addr 172.21.15.142:0/1915880413 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc5f59e700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc60141150 0x7efc6013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.238+0000 7efc5ed9d700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc600c40e0 0x7efc600b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc5e59c700 1 -- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc600c40e0 msgr2=0x7efc600b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc5e59c700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc600c40e0 0x7efc600b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc5e59c700 1 -- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc60141150 msgr2=0x7efc6013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc5e59c700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc60141150 0x7efc6013fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc5e59c700 1 -- 172.21.15.142:0/1915880413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009ae0 con 0x7efc600c6270 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc5f59e700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc60141150 0x7efc6013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc5e59c700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c6270 0x7efc600b58b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c7f0 tx=0x7efc54007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc46ffd700 1 -- 172.21.15.142:0/1915880413 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54011590 con 0x7efc600c6270 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc46ffd700 1 -- 172.21.15.142:0/1915880413 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc540116f0 con 0x7efc600c6270 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc600b63c0 con 0x7efc600c6270 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc46ffd700 1 -- 172.21.15.142:0/1915880413 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54011ab0 con 0x7efc600c6270 2023-09-30T22:57:57.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.239+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc600b5df0 con 0x7efc600c6270 2023-09-30T22:57:57.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.240+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc60069a50 con 0x7efc600c6270 2023-09-30T22:57:57.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.241+0000 7efc46ffd700 1 -- 172.21.15.142:0/1915880413 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efc5401b3b0 con 0x7efc600c6270 2023-09-30T22:57:57.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.242+0000 7efc46ffd700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc4c067360 0x7efc4c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.242+0000 7efc46ffd700 1 -- 172.21.15.142:0/1915880413 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efc540841d0 con 0x7efc600c6270 2023-09-30T22:57:57.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.242+0000 7efc5ed9d700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc4c067360 0x7efc4c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.243+0000 7efc5ed9d700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc4c067360 0x7efc4c069810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc50009ca0 tx=0x7efc50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:57.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.246+0000 7efc46ffd700 1 -- 172.21.15.142:0/1915880413 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efc54051030 con 0x7efc600c6270 2023-09-30T22:57:57.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.514+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efc6006e120 con 0x7efc600c6270 2023-09-30T22:57:57.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.518+0000 7efc46ffd700 1 -- 172.21.15.142:0/1915880413 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7efc54054650 con 0x7efc600c6270 2023-09-30T22:57:57.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc4c067360 msgr2=0x7efc4c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc4c067360 0x7efc4c069810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc50009ca0 tx=0x7efc50008040 comp rx=0 tx=0).stop 2023-09-30T22:57:57.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c6270 msgr2=0x7efc600b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c6270 0x7efc600b58b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c7f0 tx=0x7efc54007f50 comp rx=0 tx=0).stop 2023-09-30T22:57:57.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 shutdown_connections 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efc4c067360 0x7efc4c069810 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc60141150 0x7efc6013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc600c40e0 0x7efc600b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 --2- 172.21.15.142:0/1915880413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc600c6270 0x7efc600b58b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 >> 172.21.15.142:0/1915880413 conn(0x7efc600cc670 msgr2=0x7efc600c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 shutdown_connections 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.521+0000 7efc651ff700 1 -- 172.21.15.142:0/1915880413 wait complete. 2023-09-30T22:57:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T22:57:57.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:57:57.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.729+0000 7fefd7dff700 1 Processor -- start 2023-09-30T22:57:57.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.729+0000 7fefd7dff700 1 -- start start 2023-09-30T22:57:57.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd7dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 0x7fefd00c5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd7dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00c5f70 con 0x7fefd013ad00 2023-09-30T22:57:57.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd7dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00c6250 con 0x7fefd006b630 2023-09-30T22:57:57.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd7dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00c6530 con 0x7fefd013a930 2023-09-30T22:57:57.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd539a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fefd013ad00 0x7fefd006af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51148/0 (socket says 172.21.15.142:51148) 2023-09-30T22:57:57.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd539a700 1 -- 172.21.15.142:0/4095754876 learned_addr learned my addr 172.21.15.142:0/4095754876 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:57:57.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd5b9b700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 0x7fefd00c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049955725 0 0) 0x7fefd00c5f70 con 0x7fefd013ad00 2023-09-30T22:57:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.731+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefbc003570 con 0x7fefd013ad00 2023-09-30T22:57:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879084221 0 0) 0x7fefd00c6250 con 0x7fefd006b630 2023-09-30T22:57:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd00c5f70 con 0x7fefd006b630 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 160890363 0 0) 0x7fefbc003570 con 0x7fefd013ad00 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 msgr2=0x7fefd00c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 0x7fefd00c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 >> v1:172.21.15.148:6789/0 conn(0x7fefd006b630 legacy=0x7fefd00c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00c6810 con 0x7fefd013ad00 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fefc0001470 con 0x7fefd013ad00 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd5b9b700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 0x7fefd00c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 >> v1:172.21.15.142:6789/0 conn(0x7fefd013ad00 legacy=0x7fefd006af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 0x7fefbc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefbc0041b0 0x7fefbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00c6530 con 0x7fefbc004d50 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc00bc70 con 0x7fefbc0041b0 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc00be30 con 0x7fefd013a930 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd639c700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd539a700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefbc0041b0 0x7fefbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd5b9b700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 0x7fefbc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd639c700 1 -- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 msgr2=0x7fefbc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd639c700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd013a930 0x7fefbc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd639c700 1 -- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefbc0041b0 msgr2=0x7fefbc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd639c700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefbc0041b0 0x7fefbc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.732+0000 7fefd639c700 1 -- 172.21.15.142:0/4095754876 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc009420 con 0x7fefbc004d50 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd639c700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefbc0051c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fefc80020f0 tx=0x7fefc80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fad77ec6c831202 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800c8b0 con 0x7fefbc004d50 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc800ca10 con 0x7fefbc004d50 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd4b99700 1 -- 172.21.15.142:0/4095754876 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800cdb0 con 0x7fefbc004d50 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd7dff700 1 -- 172.21.15.142:0/4095754876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 msgr2=0x7fefbc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd7dff700 1 --2- 172.21.15.142:0/4095754876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefbc0051c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fefc80020f0 tx=0x7fefc80017a0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd639c700 1 -- 172.21.15.142:0/4095754876 reap_dead start 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd7dff700 1 -- 172.21.15.142:0/4095754876 shutdown_connections 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.733+0000 7fefd7dff700 1 -- 172.21.15.142:0/4095754876 >> 172.21.15.142:0/4095754876 conn(0x7fefd00cd160 msgr2=0x7fefd00c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.734+0000 7fefd7dff700 1 -- 172.21.15.142:0/4095754876 shutdown_connections 2023-09-30T22:57:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.734+0000 7fefd7dff700 1 -- 172.21.15.142:0/4095754876 wait complete. 2023-09-30T22:57:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.735+0000 7fefd7dff700 1 Processor -- start 2023-09-30T22:57:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.735+0000 7fefd7dff700 1 -- start start 2023-09-30T22:57:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd7dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefd0133cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd7dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd01341f0 0x7fefd015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd7dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd01309a0 0x7fefd015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd7dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01346c0 con 0x7fefbc004d50 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd7dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd016a580 con 0x7fefd01309a0 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd7dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd016b0c0 con 0x7fefd01341f0 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd5b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefd0133cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd5b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefd0133cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46184/0 (socket says 172.21.15.142:46184) 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd5b9b700 1 -- 172.21.15.142:0/3579889147 learned_addr learned my addr 172.21.15.142:0/3579889147 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd539a700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd01341f0 0x7fefd015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.736+0000 7fefd639c700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd01309a0 0x7fefd015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd5b9b700 1 -- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd01341f0 msgr2=0x7fefd015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd5b9b700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd01341f0 0x7fefd015e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd5b9b700 1 -- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd01309a0 msgr2=0x7fefd015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd5b9b700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd01309a0 0x7fefd015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd5b9b700 1 -- 172.21.15.142:0/3579889147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd016a790 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd639c700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd01309a0 0x7fefd015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd5b9b700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefd0133cb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0118b0 tx=0x7fefcc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefc5ffb700 1 -- 172.21.15.142:0/3579889147 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc015670 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefc5ffb700 1 -- 172.21.15.142:0/3579889147 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc0157d0 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefc5ffb700 1 -- 172.21.15.142:0/3579889147 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc015b90 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd016aa70 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.737+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd0135ba0 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.738+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd00707d0 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.739+0000 7fefc5ffb700 1 -- 172.21.15.142:0/3579889147 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fefcc00f470 con 0x7fefbc004d50 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.740+0000 7fefc5ffb700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefb4067330 0x7fefb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:57.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.740+0000 7fefc5ffb700 1 -- 172.21.15.142:0/3579889147 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fefcc0854a0 con 0x7fefbc004d50 2023-09-30T22:57:57.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.740+0000 7fefd539a700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefb4067330 0x7fefb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:57.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.741+0000 7fefd539a700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefb4067330 0x7fefb40697e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fefd015d1e0 tx=0x7fefc0001d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.744+0000 7fefc5ffb700 1 -- 172.21.15.142:0/3579889147 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fefcc052300 con 0x7fefbc004d50 2023-09-30T22:57:57.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.975+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefd006fc10 con 0x7fefbc004d50 2023-09-30T22:57:57.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.976+0000 7fefc5ffb700 1 -- 172.21.15.142:0/3579889147 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fefcc055920 con 0x7fefbc004d50 2023-09-30T22:57:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:57:57.976 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:57:57.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefb4067330 msgr2=0x7fefb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefb4067330 0x7fefb40697e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fefd015d1e0 tx=0x7fefc0001d20 comp rx=0 tx=0).stop 2023-09-30T22:57:57.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 msgr2=0x7fefd0133cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:57.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefd0133cb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0118b0 tx=0x7fefcc008040 comp rx=0 tx=0).stop 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 shutdown_connections 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefb4067330 0x7fefb40697e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd01309a0 0x7fefd015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefbc004d50 0x7fefd0133cb0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 --2- 172.21.15.142:0/3579889147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd01341f0 0x7fefd015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 >> 172.21.15.142:0/3579889147 conn(0x7fefd00cd160 msgr2=0x7fefd00c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 shutdown_connections 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:57.978+0000 7fefd7dff700 1 -- 172.21.15.142:0/3579889147 wait complete. 2023-09-30T22:57:57.979 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:57:58.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:57:46.794250+0000', 'modified': '2023-09-30T22:57:50.357340+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6450}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6450': {'gid': 6450, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6836/3184788452', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 3184788452}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 3184788452}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:57:58.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:57:58.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:57:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.592+0000 7fb3703ff700 1 Processor -- start 2023-09-30T22:57:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.592+0000 7fb3703ff700 1 -- start start 2023-09-30T22:57:58.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb3703ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3680b1580 0x7fb3680adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb3703ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3680b1950 0x7fb36815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb3703ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680ae000 0x7fb36815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb3703ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb368157c20 con 0x7fb3680b1580 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb3703ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680ad630 con 0x7fb3680b1950 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb3703ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680b3360 con 0x7fb3680ae000 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb36e19b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3680b1580 0x7fb3680adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.593+0000 7fb36e19b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3680b1580 0x7fb3680adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46198/0 (socket says 172.21.15.142:46198) 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e19b700 1 -- 172.21.15.142:0/3524475057 learned_addr learned my addr 172.21.15.142:0/3524475057 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e99c700 1 --2- 172.21.15.142:0/3524475057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680ae000 0x7fb36815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36d99a700 1 --2- 172.21.15.142:0/3524475057 >> v2:172.21.15.148:3300/0 conn(0x7fb3680b1950 0x7fb36815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e19b700 1 -- 172.21.15.142:0/3524475057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680ae000 msgr2=0x7fb36815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e19b700 1 --2- 172.21.15.142:0/3524475057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680ae000 0x7fb36815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e19b700 1 -- 172.21.15.142:0/3524475057 >> v2:172.21.15.148:3300/0 conn(0x7fb3680b1950 msgr2=0x7fb36815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e19b700 1 --2- 172.21.15.142:0/3524475057 >> v2:172.21.15.148:3300/0 conn(0x7fb3680b1950 0x7fb36815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e19b700 1 -- 172.21.15.142:0/3524475057 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36815ad60 con 0x7fb3680b1580 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e99c700 1 --2- 172.21.15.142:0/3524475057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680ae000 0x7fb36815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36d99a700 1 --2- 172.21.15.142:0/3524475057 >> v2:172.21.15.148:3300/0 conn(0x7fb3680b1950 0x7fb36815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36e19b700 1 --2- 172.21.15.142:0/3524475057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680adac0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb36806e0b0 tx=0x7fb364009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1f2584e7359d92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36d199700 1 -- 172.21.15.142:0/3524475057 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400b860 con 0x7fb3680b1580 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36d199700 1 -- 172.21.15.142:0/3524475057 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36400b9c0 con 0x7fb3680b1580 2023-09-30T22:57:58.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.594+0000 7fb36d199700 1 -- 172.21.15.142:0/3524475057 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400bd60 con 0x7fb3680b1580 2023-09-30T22:57:58.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 -- 172.21.15.142:0/3524475057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 msgr2=0x7fb3680adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 --2- 172.21.15.142:0/3524475057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680adac0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb36806e0b0 tx=0x7fb364009250 comp rx=0 tx=0).stop 2023-09-30T22:57:58.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 -- 172.21.15.142:0/3524475057 shutdown_connections 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 --2- 172.21.15.142:0/3524475057 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680ae000 0x7fb36815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 --2- 172.21.15.142:0/3524475057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680adac0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 --2- 172.21.15.142:0/3524475057 >> v2:172.21.15.148:3300/0 conn(0x7fb3680b1950 0x7fb36815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 -- 172.21.15.142:0/3524475057 >> 172.21.15.142:0/3524475057 conn(0x7fb3680ce1f0 msgr2=0x7fb368069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 -- 172.21.15.142:0/3524475057 shutdown_connections 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.595+0000 7fb3703ff700 1 -- 172.21.15.142:0/3524475057 wait complete. 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.597+0000 7fb3703ff700 1 Processor -- start 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.597+0000 7fb3703ff700 1 -- start start 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb3703ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3680ae000 0x7fb368158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb3703ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb3703ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680b1950 0x7fb3680681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb3703ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368159720 con 0x7fb3680b1580 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb3703ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368158870 con 0x7fb3680ae000 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb3703ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb368158b10 con 0x7fb3680b1950 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46208/0 (socket says 172.21.15.142:46208) 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 -- 172.21.15.142:0/980948801 learned_addr learned my addr 172.21.15.142:0/980948801 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36e19b700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3680ae000 0x7fb368158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36e99c700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680b1950 0x7fb3680681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 -- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680b1950 msgr2=0x7fb3680681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680b1950 0x7fb3680681c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 -- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3680ae000 msgr2=0x7fb368158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3680ae000 0x7fb368158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36d99a700 1 -- 172.21.15.142:0/980948801 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640094f0 con 0x7fb3680b1580 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36e19b700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3680ae000 0x7fb368158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.598+0000 7fb36e99c700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680b1950 0x7fb3680681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.599+0000 7fb36d99a700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680ac550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb35800d860 tx=0x7fb358008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.599+0000 7fb35e7fc700 1 -- 172.21.15.142:0/980948801 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358009610 con 0x7fb3680b1580 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.599+0000 7fb35e7fc700 1 -- 172.21.15.142:0/980948801 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358009770 con 0x7fb3680b1580 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.599+0000 7fb35e7fc700 1 -- 172.21.15.142:0/980948801 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358009b10 con 0x7fb3680b1580 2023-09-30T22:57:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.599+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb368158df0 con 0x7fb3680b1580 2023-09-30T22:57:58.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.599+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3681593b0 con 0x7fb3680b1580 2023-09-30T22:57:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.601+0000 7fb35e7fc700 1 -- 172.21.15.142:0/980948801 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb358014430 con 0x7fb3680b1580 2023-09-30T22:57:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.602+0000 7fb35e7fc700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb34c067330 0x7fb34c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.602+0000 7fb35e7fc700 1 -- 172.21.15.142:0/980948801 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb358084fe0 con 0x7fb3680b1580 2023-09-30T22:57:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.602+0000 7fb36e19b700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb34c067330 0x7fb34c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.603+0000 7fb36e19b700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb34c067330 0x7fb34c0697e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb36806e0b0 tx=0x7fb364017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.604+0000 7fb37eb5bb80 1 Processor -- start 2023-09-30T22:57:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.604+0000 7fb37eb5bb80 1 -- start start 2023-09-30T22:57:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f86e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f876f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f877940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f741310 con 0x55688f853f40 2023-09-30T22:57:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f77e130 con 0x55688f86e450 2023-09-30T22:57:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55688f77baf0 con 0x55688f8774d0 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb36d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f876f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb36d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f876f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46220/0 (socket says 172.21.15.142:46220) 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb36d99a700 1 -- 172.21.15.142:0/2980579729 learned_addr learned my addr 172.21.15.142:0/2980579729 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb36e19b700 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f86e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.605+0000 7fb36e99c700 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f877940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb36d99a700 1 -- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 msgr2=0x55688f877940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb36d99a700 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f877940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb36d99a700 1 -- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 msgr2=0x55688f86e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb36d99a700 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f86e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb36d99a700 1 -- 172.21.15.142:0/2980579729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55688f57d790 con 0x55688f853f40 2023-09-30T22:57:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb36d99a700 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f876f90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb358055af0 tx=0x7fb3580832c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b028ec07df62da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb34b7fe700 1 -- 172.21.15.142:0/2980579729 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358055be0 con 0x55688f853f40 2023-09-30T22:57:58.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb34b7fe700 1 -- 172.21.15.142:0/2980579729 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358058db0 con 0x55688f853f40 2023-09-30T22:57:58.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.606+0000 7fb34b7fe700 1 -- 172.21.15.142:0/2980579729 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35805cb00 con 0x55688f853f40 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/2980579729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 msgr2=0x55688f876f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f876f90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb358055af0 tx=0x7fb3580832c0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/2980579729 shutdown_connections 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f877940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f86e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/2980579729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f876f90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/2980579729 >> 172.21.15.142:0/2980579729 conn(0x55688f871880 msgr2=0x55688f871c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:58.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/2980579729 shutdown_connections 2023-09-30T22:57:58.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.607+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/2980579729 wait complete. 2023-09-30T22:57:58.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.608+0000 7fb37eb5bb80 1 -- start start 2023-09-30T22:57:58.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.608+0000 7fb37eb5bb80 1 Processor -- start 2023-09-30T22:57:58.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f84b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f84b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f870570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f7778e0 con 0x55688f853f40 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f723980 con 0x55688f86e450 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55688f723620 con 0x55688f8774d0 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb37eb5bb80 10 client.0 _ll_register_callbacks cb 0x55688f586a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f84b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f84b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46226/0 (socket says 172.21.15.142:46226) 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 -- 172.21.15.142:0/364626765 learned_addr learned my addr 172.21.15.142:0/364626765 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e99c700 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f870570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36d99a700 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f84b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 -- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 msgr2=0x55688f870570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f870570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 -- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 msgr2=0x55688f84b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f84b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.610+0000 7fb36e19b700 1 -- 172.21.15.142:0/364626765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3681593b0 con 0x55688f853f40 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb36e19b700 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f84b280 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb364000e50 tx=0x7fb36401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6da4db870eacdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb348ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb348ff9700 1 -- 172.21.15.142:0/364626765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36402b070 con 0x55688f853f40 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb348ff9700 1 -- 172.21.15.142:0/364626765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb36401a420 con 0x55688f853f40 2023-09-30T22:57:58.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55688f81bd60 con 0x55688f853f40 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb348ff9700 1 -- 172.21.15.142:0/364626765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb36401f070 con 0x55688f853f40 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb37eb5bb80 10 client.6621 fetch_fsmap learned FSMap version 50 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55688f66a0a0 con 0x55688f853f40 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb348ff9700 1 -- 172.21.15.142:0/364626765 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55688f81bd60 con 0x55688f853f40 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb348ff9700 1 -- 172.21.15.142:0/364626765 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 50) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb36401a7f0 con 0x55688f853f40 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb37eb5bb80 10 client.6621 fetch_fsmap finished waiting for FSMap version 50 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.611+0000 7fb37eb5bb80 10 client.6621 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.612+0000 7fb37eb5bb80 20 client.6621 populate_metadata read hostname 'smithi142' 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.612+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f8484e0 0x55688f88ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.612+0000 7fb37eb5bb80 4 client.6621 mds_command: new command op to 6450 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:57:58.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.612+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 --> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55688f7f8b30 con 0x55688f8484e0 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.612+0000 7fb36d99a700 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f8484e0 0x55688f88ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.612+0000 7fb36d99a700 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f8484e0 0x55688f88ae20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77f117620aa9ab9a server_cookie=2b949d132556d07e in_seq=0 out_seq=0 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.612+0000 7fb348ff9700 10 client.6621 ms_handle_connect on v2:172.21.15.142:6834/3184788452 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb348ff9700 1 -- 172.21.15.142:0/364626765 <== mds.0 v2:172.21.15.142:6834/3184788452 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x55688f7f8b30 con 0x55688f8484e0 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb348ff9700 10 client.6621 handle_command_reply: tid=0 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 client.6621 shutdown 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 msgr2=0x55688f84b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f84b280 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb364000e50 tx=0x7fb36401f000 comp rx=0 tx=0).stop 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 shutdown_connections 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f8484e0 0x55688f88ae20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f870570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f84b280 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb348ff9700 0 client.6621 ms_handle_reset on v2:172.21.15.142:6834/3184788452 2023-09-30T22:57:58.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/364626765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f86e450 0x55688f84b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 >> 172.21.15.142:0/364626765 conn(0x55688f871880 msgr2=0x55688f823c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:58.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.613+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 shutdown_connections 2023-09-30T22:57:58.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.614+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/364626765 wait complete. 2023-09-30T22:57:58.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.614+0000 7fb37eb5bb80 20 client.6621 trim_cache size 0 max 16384 2023-09-30T22:57:58.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.631+0000 7fb37eb5bb80 1 Processor -- start 2023-09-30T22:57:58.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.631+0000 7fb37eb5bb80 1 -- start start 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f853f40 0x55688f8492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f86e450 0x55688f86ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f8237f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f60f1e0 con 0x55688f86e450 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f86e9c0 con 0x55688f853f40 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55688f829e20 con 0x55688f8774d0 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f86e450 0x55688f86ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f86e450 0x55688f86ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46234/0 (socket says 172.21.15.142:46234) 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 -- 172.21.15.142:0/3683204469 learned_addr learned my addr 172.21.15.142:0/3683204469 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36e19b700 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f853f40 0x55688f8492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36e99c700 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f8237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 -- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 msgr2=0x55688f8237f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f8237f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 -- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f853f40 msgr2=0x55688f8492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f853f40 0x55688f8492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.632+0000 7fb36d99a700 1 -- 172.21.15.142:0/3683204469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55688f7463c0 con 0x55688f86e450 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb36d99a700 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f86e450 0x55688f86ef70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb35806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e404e9ec70e89d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb34bfff700 1 -- 172.21.15.142:0/3683204469 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358055b60 con 0x55688f86e450 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb34bfff700 1 -- 172.21.15.142:0/3683204469 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35805cb00 con 0x55688f86e450 2023-09-30T22:57:58.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb34bfff700 1 -- 172.21.15.142:0/3683204469 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358083440 con 0x55688f86e450 2023-09-30T22:57:58.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/3683204469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f86e450 msgr2=0x55688f86ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f86e450 0x55688f86ef70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb35806a000 comp rx=0 tx=0).stop 2023-09-30T22:57:58.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/3683204469 shutdown_connections 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f8774d0 0x55688f8237f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f853f40 0x55688f8492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/3683204469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f86e450 0x55688f86ef70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.633+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/3683204469 >> 172.21.15.142:0/3683204469 conn(0x55688f871880 msgr2=0x55688f81d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.634+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/3683204469 shutdown_connections 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.634+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/3683204469 wait complete. 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.634+0000 7fb37eb5bb80 1 -- start start 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.634+0000 7fb37eb5bb80 1 Processor -- start 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.635+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f846800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.635+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f86e450 0x55688f846d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.635+0000 7fb37eb5bb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f8774d0 0x55688f8451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.635+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f875570 con 0x55688f853f40 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.635+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688f8505c0 con 0x55688f8774d0 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.635+0000 7fb37eb5bb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55688f84f630 con 0x55688f86e450 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.635+0000 7fb37eb5bb80 10 client.0 _ll_register_callbacks cb 0x55688f586a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f846800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f846800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46238/0 (socket says 172.21.15.142:46238) 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 -- 172.21.15.142:0/996622883 learned_addr learned my addr 172.21.15.142:0/996622883 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36d99a700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f86e450 0x55688f846d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e99c700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f8774d0 0x55688f8451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 -- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f86e450 msgr2=0x55688f846d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f86e450 0x55688f846d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 -- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f8774d0 msgr2=0x55688f8451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f8774d0 0x55688f8451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 -- 172.21.15.142:0/996622883 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55688f57d790 con 0x55688f853f40 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e99c700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f8774d0 0x55688f8451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb36e19b700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f846800 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb364000e50 tx=0x7fb36400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ce01420c32e636 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb348ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.636+0000 7fb348ff9700 1 -- 172.21.15.142:0/996622883 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36402b050 con 0x55688f853f40 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb348ff9700 1 -- 172.21.15.142:0/996622883 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb36401a420 con 0x55688f853f40 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb358058db0 con 0x55688f853f40 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb348ff9700 1 -- 172.21.15.142:0/996622883 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb36401f040 con 0x55688f853f40 2023-09-30T22:57:58.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 10 client.6627 fetch_fsmap learned FSMap version 50 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55688f5de1d0 con 0x55688f853f40 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb348ff9700 1 -- 172.21.15.142:0/996622883 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358058db0 con 0x55688f853f40 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb348ff9700 1 -- 172.21.15.142:0/996622883 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 50) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb36401a7f0 con 0x55688f853f40 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 10 client.6627 fetch_fsmap finished waiting for FSMap version 50 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 10 client.6627 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 20 client.6627 populate_metadata read hostname 'smithi142' 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f845730 0x55688f845b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 4 client.6627 mds_command: new command op to 6450 tid=0[{"prefix": "status"}] 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 --> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55688f71a8d0 con 0x55688f845730 2023-09-30T22:57:58.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.637+0000 7fb36d99a700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f845730 0x55688f845b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb348ff9700 10 client.6627 ms_handle_connect on v2:172.21.15.142:6834/3184788452 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb36d99a700 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f845730 0x55688f845b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bab39df7e1d6d52 server_cookie=34bc9513becd0d2d in_seq=0 out_seq=0 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb348ff9700 1 -- 172.21.15.142:0/996622883 <== mds.0 v2:172.21.15.142:6834/3184788452 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55688f71a8d0 con 0x55688f845730 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb348ff9700 10 client.6627 handle_command_reply: tid=0 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 client.6627 shutdown 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 msgr2=0x55688f846800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f846800 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb364000e50 tx=0x7fb36400b050 comp rx=0 tx=0).stop 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 shutdown_connections 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:6834/3184788452,v1:172.21.15.142:6836/3184788452] conn(0x55688f845730 0x55688f845b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55688f8774d0 0x55688f8451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55688f853f40 0x55688f846800 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb348ff9700 0 client.6627 ms_handle_reset on v2:172.21.15.142:6834/3184788452 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 --2- 172.21.15.142:0/996622883 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55688f86e450 0x55688f846d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 >> 172.21.15.142:0/996622883 conn(0x55688f871880 msgr2=0x55688f8237f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 shutdown_connections 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.638+0000 7fb37eb5bb80 1 -- 172.21.15.142:0/996622883 wait complete. 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb37eb5bb80 20 client.6627 trim_cache size 0 max 16384 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:57:58.645 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 6450, 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 11.304443709999999, 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 50, 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 111, 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 111, 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 17.285091064 2023-09-30T22:57:58.646 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:57:58.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb34c067330 msgr2=0x7fb34c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb34c067330 0x7fb34c0697e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb36806e0b0 tx=0x7fb364017000 comp rx=0 tx=0).stop 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 msgr2=0x7fb3680ac550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680ac550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb35800d860 tx=0x7fb358008040 comp rx=0 tx=0).stop 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 shutdown_connections 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb34c067330 0x7fb34c0697e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3680b1950 0x7fb3680681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3680ae000 0x7fb368158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 --2- 172.21.15.142:0/980948801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3680b1580 0x7fb3680ac550 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 >> 172.21.15.142:0/980948801 conn(0x7fb3680ce1f0 msgr2=0x7fb3680af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:58.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 shutdown_connections 2023-09-30T22:57:58.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.639+0000 7fb3703ff700 1 -- 172.21.15.142:0/980948801 wait complete. 2023-09-30T22:57:58.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:57:58.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.846+0000 7f71a09ff700 1 Processor -- start 2023-09-30T22:57:58.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.846+0000 7f71a09ff700 1 -- start start 2023-09-30T22:57:58.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.847+0000 7f71a09ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c0aebf0 0x7f719c06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.847+0000 7f71a09ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f719c06f190 0x7f719c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.847+0000 7f71a09ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f719c15a0d0 0x7f719c156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.847+0000 7f71a09ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0aefc0 con 0x7f719c06f190 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.847+0000 7f71a09ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0b0ee0 con 0x7f719c15a0d0 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.847+0000 7f71a09ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c15a510 con 0x7f719c0aebf0 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.847+0000 7f7199d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f719c06f190 0x7f719c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f719c06f190 0x7f719c159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46240/0 (socket says 172.21.15.142:46240) 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 -- 172.21.15.142:0/3917856907 learned_addr learned my addr 172.21.15.142:0/3917856907 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f719ad9d700 1 --2- 172.21.15.142:0/3917856907 >> v2:172.21.15.148:3300/0 conn(0x7f719c15a0d0 0x7f719c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f719a59c700 1 --2- 172.21.15.142:0/3917856907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c0aebf0 0x7f719c06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 -- 172.21.15.142:0/3917856907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c0aebf0 msgr2=0x7f719c06ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 --2- 172.21.15.142:0/3917856907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c0aebf0 0x7f719c06ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 -- 172.21.15.142:0/3917856907 >> v2:172.21.15.148:3300/0 conn(0x7f719c15a0d0 msgr2=0x7f719c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:57:58.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 --2- 172.21.15.142:0/3917856907 >> v2:172.21.15.148:3300/0 conn(0x7f719c15a0d0 0x7f719c156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 -- 172.21.15.142:0/3917856907 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0b02d0 con 0x7f719c06f190 2023-09-30T22:57:58.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f7199d9b700 1 --2- 172.21.15.142:0/3917856907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c159b90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f719c0cc650 tx=0x7f7190009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8e81d60da56c2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.848+0000 7f719959a700 1 -- 172.21.15.142:0/3917856907 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000b860 con 0x7f719c06f190 2023-09-30T22:57:58.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f719959a700 1 -- 172.21.15.142:0/3917856907 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719000b9c0 con 0x7f719c06f190 2023-09-30T22:57:58.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f719959a700 1 -- 172.21.15.142:0/3917856907 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000bd60 con 0x7f719c06f190 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 -- 172.21.15.142:0/3917856907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 msgr2=0x7f719c159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 --2- 172.21.15.142:0/3917856907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c159b90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f719c0cc650 tx=0x7f7190009250 comp rx=0 tx=0).stop 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 -- 172.21.15.142:0/3917856907 shutdown_connections 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 --2- 172.21.15.142:0/3917856907 >> v2:172.21.15.148:3300/0 conn(0x7f719c15a0d0 0x7f719c156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 --2- 172.21.15.142:0/3917856907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c0aebf0 0x7f719c06ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 --2- 172.21.15.142:0/3917856907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c159b90 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 -- 172.21.15.142:0/3917856907 >> 172.21.15.142:0/3917856907 conn(0x7f719c0680c0 msgr2=0x7f719c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 -- 172.21.15.142:0/3917856907 shutdown_connections 2023-09-30T22:57:58.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.849+0000 7f71a09ff700 1 -- 172.21.15.142:0/3917856907 wait complete. 2023-09-30T22:57:58.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.851+0000 7f71a09ff700 1 Processor -- start 2023-09-30T22:57:58.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.851+0000 7f71a09ff700 1 -- start start 2023-09-30T22:57:58.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f71a09ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f71a09ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f719c0aebf0 0x7f719c1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f71a09ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c15a0d0 0x7f719c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f71a09ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c6450 con 0x7f719c06f190 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f71a09ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c2980 con 0x7f719c0aebf0 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f71a09ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c2c60 con 0x7f719c15a0d0 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46246/0 (socket says 172.21.15.142:46246) 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 -- 172.21.15.142:0/124846921 learned_addr learned my addr 172.21.15.142:0/124846921 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f7199d9b700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f719c0aebf0 0x7f719c1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719ad9d700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c15a0d0 0x7f719c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 -- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c15a0d0 msgr2=0x7f719c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c15a0d0 0x7f719c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 -- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f719c0aebf0 msgr2=0x7f719c1541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f719c0aebf0 0x7f719c1541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.852+0000 7f719a59c700 1 -- 172.21.15.142:0/124846921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900094f0 con 0x7f719c06f190 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.853+0000 7f719a59c700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c150130 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f718c00d890 tx=0x7f718c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.853+0000 7f718a7fc700 1 -- 172.21.15.142:0/124846921 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0125f0 con 0x7f719c06f190 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.853+0000 7f718a7fc700 1 -- 172.21.15.142:0/124846921 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c012750 con 0x7f719c06f190 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.853+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0c2f40 con 0x7f719c06f190 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.853+0000 7f718a7fc700 1 -- 172.21.15.142:0/124846921 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c012af0 con 0x7f719c06f190 2023-09-30T22:57:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.853+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c150670 con 0x7f719c06f190 2023-09-30T22:57:58.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.854+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c0695b0 con 0x7f719c06f190 2023-09-30T22:57:58.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.855+0000 7f718a7fc700 1 -- 172.21.15.142:0/124846921 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f718c01e460 con 0x7f719c06f190 2023-09-30T22:57:58.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.857+0000 7f718a7fc700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f717c067330 0x7f717c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:57:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.857+0000 7f718a7fc700 1 -- 172.21.15.142:0/124846921 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f718c0851e0 con 0x7f719c06f190 2023-09-30T22:57:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.857+0000 7f7199d9b700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f717c067330 0x7f717c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:57:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.857+0000 7f7199d9b700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f717c067330 0x7f717c0697e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f719c0cc650 tx=0x7f7190019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:57:58.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:58.861+0000 7f718a7fc700 1 -- 172.21.15.142:0/124846921 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f718c052040 con 0x7f719c06f190 2023-09-30T22:57:59.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.088+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f719c0c6220 con 0x7f719c06f190 2023-09-30T22:57:59.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.089+0000 7f718a7fc700 1 -- 172.21.15.142:0/124846921 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f718c055660 con 0x7f719c06f190 2023-09-30T22:57:59.089 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:57:59.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f717c067330 msgr2=0x7f717c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:59.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f717c067330 0x7f717c0697e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f719c0cc650 tx=0x7f7190019000 comp rx=0 tx=0).stop 2023-09-30T22:57:59.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 msgr2=0x7f719c150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:57:59.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c150130 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f718c00d890 tx=0x7f718c008040 comp rx=0 tx=0).stop 2023-09-30T22:57:59.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 shutdown_connections 2023-09-30T22:57:59.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f717c067330 0x7f717c0697e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:59.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f719c15a0d0 0x7f719c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:59.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c06f190 0x7f719c150130 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:59.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 --2- 172.21.15.142:0/124846921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f719c0aebf0 0x7f719c1541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:57:59.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 >> 172.21.15.142:0/124846921 conn(0x7f719c0680c0 msgr2=0x7f719c158400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:57:59.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 shutdown_connections 2023-09-30T22:57:59.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:57:59.091+0000 7f71a09ff700 1 -- 172.21.15.142:0/124846921 wait complete. 2023-09-30T22:57:59.108 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:57:59.109 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:57:59.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:59.109 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:57:59.156 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:57:59.156 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:57:59.156 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:57:59.156 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:57:59.156 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:57:59.156 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:57:59.157 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41979sec preferred_lft 41979sec 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:57:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:57:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T22:57:59.160 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:57:59.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:59.160 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:57:59.227 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:57:59.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:59.230 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:57:59.280 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:57:59.280 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:57:59.280 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:57:59.281 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:57:59.281 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:57:59.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:59.281 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:57:59.281 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:57:59.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:57:59.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:57:59.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:57:59.282 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:57:59.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:59.450 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:57:59.497 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T22:57:59.498 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:57:59.498 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:57:59.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:59.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:57:59.569 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:57:59.569 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:57:59.615 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:57:59.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:57:59.616 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:57:59.700 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:57:59.701 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:57:59.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:57:59.840 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:57:59.840 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:57:59.841 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:57:59.855 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:57:59.855 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:57:59.855 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:57:59.855 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:57:59.855 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:57:59.876 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:57:59.881 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:57:59.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:57:59.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:57:59.951 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:58:00.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.159+0000 7f76fefff700 1 Processor -- start 2023-09-30T22:58:00.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.159+0000 7f76fefff700 1 -- start start 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.160+0000 7f76fefff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76f80cee50 0x7f76f8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.160+0000 7f76fefff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.160+0000 7f76fefff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f806b8d0 con 0x7f76f81598e0 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.160+0000 7f76fefff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80cff40 con 0x7f76f80cee50 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.160+0000 7f76fefff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80cf330 con 0x7f76f80d03d0 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.160+0000 7f76fcd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f76f81598e0 0x7f76f806b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51162/0 (socket says 172.21.15.142:51162) 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.160+0000 7f76fcd9b700 1 -- 172.21.15.142:0/3437116316 learned_addr learned my addr 172.21.15.142:0/3437116316 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f7fff700 1 --2- 172.21.15.142:0/3437116316 >> v2:172.21.15.142:3300/0 conn(0x7f76f80cee50 0x7f76f8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76fd59c700 1 --2- 172.21.15.142:0/3437116316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f77fe700 1 -- 172.21.15.142:0/3437116316 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206276924 0 0) 0x7f76f806b8d0 con 0x7f76f81598e0 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f77fe700 1 -- 172.21.15.142:0/3437116316 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e8003570 con 0x7f76f81598e0 2023-09-30T22:58:00.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f7fff700 1 -- 172.21.15.142:0/3437116316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 msgr2=0x7f76f815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f7fff700 1 --2- 172.21.15.142:0/3437116316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f7fff700 1 -- 172.21.15.142:0/3437116316 >> v1:172.21.15.142:6789/0 conn(0x7f76f81598e0 legacy=0x7f76f806b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f7fff700 1 -- 172.21.15.142:0/3437116316 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80cf610 con 0x7f76f80cee50 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.161+0000 7f76f7fff700 1 --2- 172.21.15.142:0/3437116316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f8159cb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f76e40098e0 tx=0x7f76e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf499a56f543f38d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76f77fe700 1 -- 172.21.15.142:0/3437116316 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011630 con 0x7f76f80cee50 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76f77fe700 1 -- 172.21.15.142:0/3437116316 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e4011790 con 0x7f76f80cee50 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76f77fe700 1 -- 172.21.15.142:0/3437116316 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011b30 con 0x7f76f80cee50 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 -- 172.21.15.142:0/3437116316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 msgr2=0x7f76f8159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 --2- 172.21.15.142:0/3437116316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f8159cb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f76e40098e0 tx=0x7f76e40091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 -- 172.21.15.142:0/3437116316 shutdown_connections 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 --2- 172.21.15.142:0/3437116316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 --2- 172.21.15.142:0/3437116316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f8159cb0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 -- 172.21.15.142:0/3437116316 >> 172.21.15.142:0/3437116316 conn(0x7f76f80cd540 msgr2=0x7f76f80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:00.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 -- 172.21.15.142:0/3437116316 shutdown_connections 2023-09-30T22:58:00.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.162+0000 7f76fefff700 1 -- 172.21.15.142:0/3437116316 wait complete. 2023-09-30T22:58:00.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.164+0000 7f76fefff700 1 Processor -- start 2023-09-30T22:58:00.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.164+0000 7f76fefff700 1 -- start start 2023-09-30T22:58:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fefff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f816d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fefff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fefff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f81598e0 0x7f76f80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fefff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f816c150 con 0x7f76f80cee50 2023-09-30T22:58:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fefff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f816c430 con 0x7f76f81598e0 2023-09-30T22:58:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fefff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f816c710 con 0x7f76f80d03d0 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f816d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f816d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46270/0 (socket says 172.21.15.142:46270) 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 -- 172.21.15.142:0/2375481298 learned_addr learned my addr 172.21.15.142:0/2375481298 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fd59c700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f81598e0 0x7f76f80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76f7fff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 -- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 msgr2=0x7f76f80c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f80c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 -- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f81598e0 msgr2=0x7f76f80b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f81598e0 0x7f76f80b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.165+0000 7f76fcd9b700 1 -- 172.21.15.142:0/2375481298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4009420 con 0x7f76f80cee50 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.166+0000 7f76fcd9b700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f816d1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c590 tx=0x7f76ec007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.166+0000 7f76f4ff9700 1 -- 172.21.15.142:0/2375481298 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec005b30 con 0x7f76f80cee50 2023-09-30T22:58:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.166+0000 7f76f4ff9700 1 -- 172.21.15.142:0/2375481298 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec005cb0 con 0x7f76f80cee50 2023-09-30T22:58:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.166+0000 7f76f4ff9700 1 -- 172.21.15.142:0/2375481298 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec007320 con 0x7f76f80cee50 2023-09-30T22:58:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.166+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f816c9f0 con 0x7f76f80cee50 2023-09-30T22:58:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.166+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f80c8650 con 0x7f76f80cee50 2023-09-30T22:58:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.167+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f80c8840 con 0x7f76f80cee50 2023-09-30T22:58:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.168+0000 7f76f4ff9700 1 -- 172.21.15.142:0/2375481298 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f76ec01b3b0 con 0x7f76f80cee50 2023-09-30T22:58:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.169+0000 7f76f4ff9700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f76dc067330 0x7f76dc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:00.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.169+0000 7f76f4ff9700 1 -- 172.21.15.142:0/2375481298 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f76ec0840a0 con 0x7f76f80cee50 2023-09-30T22:58:00.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.169+0000 7f76f7fff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f76dc067330 0x7f76dc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:00.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.170+0000 7f76f7fff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f76dc067330 0x7f76dc0697e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f76e40091e0 tx=0x7f76e4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:00.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.173+0000 7f76f4ff9700 1 -- 172.21.15.142:0/2375481298 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f76ec050f00 con 0x7f76f80cee50 2023-09-30T22:58:00.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.412+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76f806fc10 con 0x7f76f80cee50 2023-09-30T22:58:00.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.412+0000 7f76f4ff9700 1 -- 172.21.15.142:0/2375481298 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f76ec017060 con 0x7f76f80cee50 2023-09-30T22:58:00.413 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:58:00.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f76dc067330 msgr2=0x7f76dc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:00.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f76dc067330 0x7f76dc0697e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f76e40091e0 tx=0x7f76e4017000 comp rx=0 tx=0).stop 2023-09-30T22:58:00.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 msgr2=0x7f76f816d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:00.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f816d1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c590 tx=0x7f76ec007e00 comp rx=0 tx=0).stop 2023-09-30T22:58:00.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 shutdown_connections 2023-09-30T22:58:00.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f76dc067330 0x7f76dc0697e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f81598e0 0x7f76f80b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f80cee50 0x7f76f816d1f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 --2- 172.21.15.142:0/2375481298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76f80d03d0 0x7f76f80c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:00.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 >> 172.21.15.142:0/2375481298 conn(0x7f76f80cd540 msgr2=0x7f76f815d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:00.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 shutdown_connections 2023-09-30T22:58:00.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:00.415+0000 7f76fefff700 1 -- 172.21.15.142:0/2375481298 wait complete. 2023-09-30T22:58:00.432 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:58:00.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:58:00.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:58:00.432 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:58:00.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:00.433 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:58:00.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:58:00.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:58:00.433 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:58:00.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:00.433 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:00.485 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42008sec preferred_lft 42008sec 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:58:00.486 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T22:58:00.487 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:00.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:00.488 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:58:00.560 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:58:00.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:00.563 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:58:00.613 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:58:00.613 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:58:00.613 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:58:00.614 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:58:00.614 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:58:00.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:00.615 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:58:00.615 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:58:00.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:58:00.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:58:00.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:58:00.615 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:58:00.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:00.784 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:58:00.830 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T22:58:00.830 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:58:00.831 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:58:00.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:00.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:58:00.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:58:00.903 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:00.949 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:58:00.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:58:00.949 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:01.034 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:58:01.034 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:58:01.034 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:01.173 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:01.173 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:58:01.173 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:58:01.187 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:01.187 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:58:01.187 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:58:01.187 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:58:01.187 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:58:01.207 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:01.208 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:58:01.208 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:58:01.208 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:58:01.208 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:58:01.208 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:58:01.208 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:58:01.208 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:58:01.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:58:01.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:01.213 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:01.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:01.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.484+0000 7f7d8e3ff700 1 Processor -- start 2023-09-30T22:58:01.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.484+0000 7f7d8e3ff700 1 -- start start 2023-09-30T22:58:01.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.485+0000 7f7d8e3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d881598e0 0x7f7d88159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:01.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.485+0000 7f7d8e3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d880cee50 0x7f7d880d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:01.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.485+0000 7f7d8e3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880cff40 con 0x7f7d8806b1c0 2023-09-30T22:58:01.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.485+0000 7f7d8e3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d880d0910 con 0x7f7d880cee50 2023-09-30T22:58:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.485+0000 7f7d8e3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d880cf330 con 0x7f7d881598e0 2023-09-30T22:58:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d880cee50 0x7f7d880d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d880cee50 0x7f7d880d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46324/0 (socket says 172.21.15.142:46324) 2023-09-30T22:58:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 -- 172.21.15.142:0/1045343015 learned_addr learned my addr 172.21.15.142:0/1045343015 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d87fff700 1 --2- 172.21.15.142:0/1045343015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d881598e0 0x7f7d88159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 -- 172.21.15.142:0/1045343015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d881598e0 msgr2=0x7f7d88159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 --2- 172.21.15.142:0/1045343015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d881598e0 0x7f7d88159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 -- 172.21.15.142:0/1045343015 >> v1:172.21.15.148:6789/0 conn(0x7f7d8806b1c0 legacy=0x7f7d8815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 -- 172.21.15.142:0/1045343015 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d880cf610 con 0x7f7d880cee50 2023-09-30T22:58:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.486+0000 7f7d877fe700 1 --2- 172.21.15.142:0/1045343015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d880d03d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0099b0 tx=0x7f7d7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76aa66097fb4951 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:01.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d86ffd700 1 -- 172.21.15.142:0/1045343015 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c009ea0 con 0x7f7d880cee50 2023-09-30T22:58:01.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d86ffd700 1 -- 172.21.15.142:0/1045343015 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c00b860 con 0x7f7d880cee50 2023-09-30T22:58:01.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d86ffd700 1 -- 172.21.15.142:0/1045343015 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00bc00 con 0x7f7d880cee50 2023-09-30T22:58:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/1045343015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 msgr2=0x7f7d880d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/1045343015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d880d03d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0099b0 tx=0x7f7d7c009250 comp rx=0 tx=0).stop 2023-09-30T22:58:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/1045343015 shutdown_connections 2023-09-30T22:58:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/1045343015 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d881598e0 0x7f7d88159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/1045343015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d880d03d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/1045343015 >> 172.21.15.142:0/1045343015 conn(0x7f7d880cd540 msgr2=0x7f7d880cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/1045343015 shutdown_connections 2023-09-30T22:58:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.487+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/1045343015 wait complete. 2023-09-30T22:58:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.489+0000 7f7d8e3ff700 1 Processor -- start 2023-09-30T22:58:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.489+0000 7f7d8e3ff700 1 -- start start 2023-09-30T22:58:01.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d8e3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d8806b1c0 0x7f7d88151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:01.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d8e3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d88153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:01.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d8e3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881598e0 0x7f7d8815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:01.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d8e3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d88152e00 con 0x7f7d880cee50 2023-09-30T22:58:01.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d8e3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d881521f0 con 0x7f7d881598e0 2023-09-30T22:58:01.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d8e3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d881524d0 con 0x7f7d8806b1c0 2023-09-30T22:58:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d877fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d88153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d877fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d88153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46336/0 (socket says 172.21.15.142:46336) 2023-09-30T22:58:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d877fe700 1 -- 172.21.15.142:0/2404688879 learned_addr learned my addr 172.21.15.142:0/2404688879 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d87fff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d8806b1c0 0x7f7d88151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.490+0000 7f7d8c99c700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881598e0 0x7f7d8815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d877fe700 1 -- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d8806b1c0 msgr2=0x7f7d88151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d877fe700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d8806b1c0 0x7f7d88151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d877fe700 1 -- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881598e0 msgr2=0x7f7d8815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d877fe700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881598e0 0x7f7d8815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d877fe700 1 -- 172.21.15.142:0/2404688879 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c0094f0 con 0x7f7d880cee50 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d877fe700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d88153290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7d880ce0a0 tx=0x7f7d7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d6ffff700 1 -- 172.21.15.142:0/2404688879 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c000d10 con 0x7f7d880cee50 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d6ffff700 1 -- 172.21.15.142:0/2404688879 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c00bbe0 con 0x7f7d880cee50 2023-09-30T22:58:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d6ffff700 1 -- 172.21.15.142:0/2404688879 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c011670 con 0x7f7d880cee50 2023-09-30T22:58:01.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d881527b0 con 0x7f7d880cee50 2023-09-30T22:58:01.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.491+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d881515c0 con 0x7f7d880cee50 2023-09-30T22:58:01.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.492+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d88152f70 con 0x7f7d880cee50 2023-09-30T22:58:01.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.493+0000 7f7d6ffff700 1 -- 172.21.15.142:0/2404688879 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7d7c011aa0 con 0x7f7d880cee50 2023-09-30T22:58:01.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.494+0000 7f7d6ffff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d74067330 0x7f7d740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:01.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.494+0000 7f7d6ffff700 1 -- 172.21.15.142:0/2404688879 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d7c086430 con 0x7f7d880cee50 2023-09-30T22:58:01.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.494+0000 7f7d87fff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d74067330 0x7f7d740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:01.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.495+0000 7f7d87fff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d74067330 0x7f7d740697e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009d10 tx=0x7f7d780091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:01.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.498+0000 7f7d6ffff700 1 -- 172.21.15.142:0/2404688879 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7d7c053290 con 0x7f7d880cee50 2023-09-30T22:58:01.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.730+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d8806fc10 con 0x7f7d880cee50 2023-09-30T22:58:01.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.730+0000 7f7d6ffff700 1 -- 172.21.15.142:0/2404688879 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f7d7c0568b0 con 0x7f7d880cee50 2023-09-30T22:58:01.730 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:01.731 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:58:01.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d74067330 msgr2=0x7f7d740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:01.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d74067330 0x7f7d740697e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009d10 tx=0x7f7d780091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 msgr2=0x7f7d88153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:01.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d88153290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7d880ce0a0 tx=0x7f7d7c017000 comp rx=0 tx=0).stop 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 shutdown_connections 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d74067330 0x7f7d740697e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881598e0 0x7f7d8815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d8806b1c0 0x7f7d88151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 --2- 172.21.15.142:0/2404688879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d880cee50 0x7f7d88153290 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 >> 172.21.15.142:0/2404688879 conn(0x7f7d880cd540 msgr2=0x7f7d88158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 shutdown_connections 2023-09-30T22:58:01.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:01.733+0000 7f7d8e3ff700 1 -- 172.21.15.142:0/2404688879 wait complete. 2023-09-30T22:58:01.735 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:58:01.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:58:01.962 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6450,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.614366719,"mdsmap_epoch":50,"osdmap_epoch":111,"osdmap_epoch_barrier":111,"uptime":20.595016584} 2023-09-30T22:58:01.962 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6450, "mdsmap_epoch": 50, "osdmap_epoch": 111, "osdmap_epoch_barrier": 111, "rank_uptime": 14.614366719, "state": "up:active", "uptime": 20.595016584, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:58:01.963 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T22:58:02.171 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T22:58:02.172 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T22:58:02.172 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-09-30T22:58:02.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:02.172 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-09-30T22:58:04.118 INFO:teuthology.orchestra.run.smithi142.stderr:265+0 records in 2023-09-30T22:58:04.118 INFO:teuthology.orchestra.run.smithi142.stderr:265+0 records out 2023-09-30T22:58:04.118 INFO:teuthology.orchestra.run.smithi142.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.8966 s, 147 MB/s 2023-09-30T22:58:04.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:04.120 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-09-30T22:58:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:292+0 records in 2023-09-30T22:58:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:292+0 records out 2023-09-30T22:58:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.14841 s, 143 MB/s 2023-09-30T22:58:06.317 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-30T22:58:06.317 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:58:06.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.509+0000 7fd300dff700 1 Processor -- start 2023-09-30T22:58:06.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.509+0000 7fd300dff700 1 -- start start 2023-09-30T22:58:06.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.510+0000 7fd300dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc159ae0 0x7fd2fc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.510+0000 7fd300dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2fc0b1180 0x7fd2fc0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.510+0000 7fd300dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc15d910 con 0x7fd2fc159eb0 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.510+0000 7fd300dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc15e920 con 0x7fd2fc0b1180 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.510+0000 7fd300dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc15e490 con 0x7fd2fc159ae0 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2f9d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2fc0b1180 0x7fd2fc0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2f9d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2fc0b1180 0x7fd2fc0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46350/0 (socket says 172.21.15.142:46350) 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/2708386451 learned_addr learned my addr 172.21.15.142:0/2708386451 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:06.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2fa59c700 1 --2- 172.21.15.142:0/2708386451 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc159ae0 0x7fd2fc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/2708386451 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc159ae0 msgr2=0x7fd2fc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2f9d9b700 1 --2- 172.21.15.142:0/2708386451 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc159ae0 0x7fd2fc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/2708386451 >> v1:172.21.15.148:6789/0 conn(0x7fd2fc159eb0 legacy=0x7fd2fc068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.511+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/2708386451 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc15db60 con 0x7fd2fc0b1180 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd2f9d9b700 1 --2- 172.21.15.142:0/2708386451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc0b1180 0x7fd2fc0cbe80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00099b0 tx=0x7fd2f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a9f21538037344 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd2f959a700 1 -- 172.21.15.142:0/2708386451 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0009ea0 con 0x7fd2fc0b1180 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd2f959a700 1 -- 172.21.15.142:0/2708386451 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f000b860 con 0x7fd2fc0b1180 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd2f959a700 1 -- 172.21.15.142:0/2708386451 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000bc00 con 0x7fd2fc0b1180 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd300dff700 1 -- 172.21.15.142:0/2708386451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc0b1180 msgr2=0x7fd2fc0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd300dff700 1 --2- 172.21.15.142:0/2708386451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc0b1180 0x7fd2fc0cbe80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00099b0 tx=0x7fd2f0009250 comp rx=0 tx=0).stop 2023-09-30T22:58:06.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd300dff700 1 -- 172.21.15.142:0/2708386451 shutdown_connections 2023-09-30T22:58:06.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd300dff700 1 --2- 172.21.15.142:0/2708386451 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc159ae0 0x7fd2fc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd300dff700 1 --2- 172.21.15.142:0/2708386451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc0b1180 0x7fd2fc0cbe80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd300dff700 1 -- 172.21.15.142:0/2708386451 >> 172.21.15.142:0/2708386451 conn(0x7fd2fc0ce8b0 msgr2=0x7fd2fc0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:06.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.512+0000 7fd300dff700 1 -- 172.21.15.142:0/2708386451 shutdown_connections 2023-09-30T22:58:06.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.513+0000 7fd300dff700 1 -- 172.21.15.142:0/2708386451 wait complete. 2023-09-30T22:58:06.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.514+0000 7fd300dff700 1 Processor -- start 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.514+0000 7fd300dff700 1 -- start start 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd300dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc0b1180 0x7fd2fc153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd300dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc159ae0 0x7fd2fc157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd300dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2fc159eb0 0x7fd2fc16a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd300dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc156490 con 0x7fd2fc159ae0 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd300dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc155880 con 0x7fd2fc159eb0 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd300dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc155b60 con 0x7fd2fc0b1180 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd2f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc159ae0 0x7fd2fc157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd2f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc159ae0 0x7fd2fc157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46362/0 (socket says 172.21.15.142:46362) 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/768891628 learned_addr learned my addr 172.21.15.142:0/768891628 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd2fad9d700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2fc159eb0 0x7fd2fc16a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:06.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.515+0000 7fd2fa59c700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc0b1180 0x7fd2fc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:06.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc0b1180 msgr2=0x7fd2fc153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:06.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2f9d9b700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc0b1180 0x7fd2fc153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2fc159eb0 msgr2=0x7fd2fc16a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:06.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2f9d9b700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2fc159eb0 0x7fd2fc16a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2f9d9b700 1 -- 172.21.15.142:0/768891628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00094f0 con 0x7fd2fc159ae0 2023-09-30T22:58:06.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2f9d9b700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc159ae0 0x7fd2fc157c20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc063f90 tx=0x7fd2f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:06.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2ea7fc700 1 -- 172.21.15.142:0/768891628 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0000d10 con 0x7fd2fc159ae0 2023-09-30T22:58:06.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2ea7fc700 1 -- 172.21.15.142:0/768891628 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f000bbe0 con 0x7fd2fc159ae0 2023-09-30T22:58:06.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc155e40 con 0x7fd2fc159ae0 2023-09-30T22:58:06.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd2ea7fc700 1 -- 172.21.15.142:0/768891628 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0011670 con 0x7fd2fc159ae0 2023-09-30T22:58:06.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.516+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc155530 con 0x7fd2fc159ae0 2023-09-30T22:58:06.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.517+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc156600 con 0x7fd2fc159ae0 2023-09-30T22:58:06.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.518+0000 7fd2ea7fc700 1 -- 172.21.15.142:0/768891628 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd2f0011aa0 con 0x7fd2fc159ae0 2023-09-30T22:58:06.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.519+0000 7fd2ea7fc700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd2dc067360 0x7fd2dc069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:06.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.519+0000 7fd2ea7fc700 1 -- 172.21.15.142:0/768891628 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd2f00863e0 con 0x7fd2fc159ae0 2023-09-30T22:58:06.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.519+0000 7fd2fa59c700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd2dc067360 0x7fd2dc069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:06.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.520+0000 7fd2fa59c700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd2dc067360 0x7fd2dc069810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009db0 tx=0x7fd2ec0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:06.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.524+0000 7fd2ea7fc700 1 -- 172.21.15.142:0/768891628 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd2f0053240 con 0x7fd2fc159ae0 2023-09-30T22:58:06.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.718+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd2fc15de40 con 0x7fd2fc159ae0 2023-09-30T22:58:06.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.719+0000 7fd2ea7fc700 1 -- 172.21.15.142:0/768891628 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+34977 (secure 0 0 0) 0x7fd2f0056860 con 0x7fd2fc159ae0 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 111, 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:57:48.333754+0000", 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:58:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:58:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 14, 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "101", 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:06.727 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:06.727 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:06.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "101", 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:58:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 13, 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:44.465774+0000", 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:58:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "110", 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 14, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:45.784661+0000", 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "111", 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:58:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:58:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:58:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:58:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:58:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:58:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:58:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:06.810 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd2dc067360 msgr2=0x7fd2dc069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd2dc067360 0x7fd2dc069810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009db0 tx=0x7fd2ec0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc159ae0 msgr2=0x7fd2fc157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc159ae0 0x7fd2fc157c20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc063f90 tx=0x7fd2f0017000 comp rx=0 tx=0).stop 2023-09-30T22:58:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 shutdown_connections 2023-09-30T22:58:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd2dc067360 0x7fd2dc069810 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2fc159eb0 0x7fd2fc16a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd2fc0b1180 0x7fd2fc153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 --2- 172.21.15.142:0/768891628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2fc159ae0 0x7fd2fc157c20 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:06.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 >> 172.21.15.142:0/768891628 conn(0x7fd2fc0ce8b0 msgr2=0x7fd2fc15c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:06.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 shutdown_connections 2023-09-30T22:58:06.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:06.722+0000 7fd300dff700 1 -- 172.21.15.142:0/768891628 wait complete. 2023-09-30T22:58:06.813 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:58:08.544 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:58:08.544+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-09-30T22:58:11.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:58:12.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.014+0000 7f078ffff700 1 Processor -- start 2023-09-30T22:58:12.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.014+0000 7f078ffff700 1 -- start start 2023-09-30T22:58:12.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.015+0000 7f078ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1950 0x7f078815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.015+0000 7f078ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f078815a6c0 0x7f078806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.015+0000 7f078ffff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07880ad630 con 0x7f07880b1580 2023-09-30T22:58:12.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.015+0000 7f078ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0788157c20 con 0x7f078815a6c0 2023-09-30T22:58:12.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.015+0000 7f078ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078815ab10 con 0x7f07880b1950 2023-09-30T22:58:12.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.015+0000 7f078d59a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1950 0x7f078815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078d59a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1950 0x7f078815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:35286/0 (socket says 172.21.15.142:35286) 2023-09-30T22:58:12.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078d59a700 1 -- 172.21.15.142:0/673285653 learned_addr learned my addr 172.21.15.142:0/673285653 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:12.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078e59c700 1 --2- 172.21.15.142:0/673285653 >> v2:172.21.15.148:3300/0 conn(0x7f078815a6c0 0x7f078806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078d59a700 1 -- 172.21.15.142:0/673285653 >> v2:172.21.15.148:3300/0 conn(0x7f078815a6c0 msgr2=0x7f078806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:12.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078d59a700 1 --2- 172.21.15.142:0/673285653 >> v2:172.21.15.148:3300/0 conn(0x7f078815a6c0 0x7f078806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078d59a700 1 -- 172.21.15.142:0/673285653 >> v1:172.21.15.148:6789/0 conn(0x7f07880b1580 legacy=0x7f07880adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078d59a700 1 -- 172.21.15.142:0/673285653 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880b3360 con 0x7f07880b1950 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.016+0000 7f078d59a700 1 --2- 172.21.15.142:0/673285653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1950 0x7f078815a180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07780099b0 tx=0x7f0778009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93181bb5db64472 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078cd99700 1 -- 172.21.15.142:0/673285653 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778009ea0 con 0x7f07880b1950 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078cd99700 1 -- 172.21.15.142:0/673285653 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800b860 con 0x7f07880b1950 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078cd99700 1 -- 172.21.15.142:0/673285653 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800bc00 con 0x7f07880b1950 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 -- 172.21.15.142:0/673285653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1950 msgr2=0x7f078815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 --2- 172.21.15.142:0/673285653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1950 0x7f078815a180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07780099b0 tx=0x7f0778009250 comp rx=0 tx=0).stop 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 -- 172.21.15.142:0/673285653 shutdown_connections 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 --2- 172.21.15.142:0/673285653 >> v2:172.21.15.148:3300/0 conn(0x7f078815a6c0 0x7f078806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 --2- 172.21.15.142:0/673285653 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1950 0x7f078815a180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 -- 172.21.15.142:0/673285653 >> 172.21.15.142:0/673285653 conn(0x7f07880ce1f0 msgr2=0x7f0788069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:12.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 -- 172.21.15.142:0/673285653 shutdown_connections 2023-09-30T22:58:12.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.017+0000 7f078ffff700 1 -- 172.21.15.142:0/673285653 wait complete. 2023-09-30T22:58:12.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.019+0000 7f078ffff700 1 Processor -- start 2023-09-30T22:58:12.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.019+0000 7f078ffff700 1 -- start start 2023-09-30T22:58:12.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1580 0x7f0788154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07880b1950 0x7f0788067a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f078815a6c0 0x7f0788067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078816a3a0 con 0x7f078815a6c0 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880cc670 con 0x7f07880b1950 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880cc950 con 0x7f07880b1580 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f078815a6c0 0x7f0788067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078dd9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1580 0x7f0788154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f078815a6c0 0x7f0788067fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50164/0 (socket says 172.21.15.142:50164) 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078e59c700 1 -- 172.21.15.142:0/2594815491 learned_addr learned my addr 172.21.15.142:0/2594815491 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.020+0000 7f078d59a700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07880b1950 0x7f0788067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078e59c700 1 -- 172.21.15.142:0/2594815491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1580 msgr2=0x7f0788154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078e59c700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1580 0x7f0788154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078e59c700 1 -- 172.21.15.142:0/2594815491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07880b1950 msgr2=0x7f0788067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078e59c700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07880b1950 0x7f0788067a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078e59c700 1 -- 172.21.15.142:0/2594815491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780094f0 con 0x7f078815a6c0 2023-09-30T22:58:12.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078e59c700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f078815a6c0 0x7f0788067fb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0780009df0 tx=0x7f078000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:12.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000caa0 con 0x7f078815a6c0 2023-09-30T22:58:12.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000f040 con 0x7f078815a6c0 2023-09-30T22:58:12.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000ce70 con 0x7f078815a6c0 2023-09-30T22:58:12.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07880ccc30 con 0x7f078815a6c0 2023-09-30T22:58:12.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.021+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0788154b70 con 0x7f078815a6c0 2023-09-30T22:58:12.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.022+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078806d600 con 0x7f078815a6c0 2023-09-30T22:58:12.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.023+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0780014690 con 0x7f078815a6c0 2023-09-30T22:58:12.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.024+0000 7f077dffb700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f076c067330 0x7f076c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.024+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f07800854c0 con 0x7f078815a6c0 2023-09-30T22:58:12.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.024+0000 7f078dd9b700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f076c067330 0x7f076c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.024+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=115}) v3 -- 0x7f076c06f4f0 con 0x7f078815a6c0 2023-09-30T22:58:12.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.025+0000 7f078dd9b700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f076c067330 0x7f076c0697e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0784003a10 tx=0x7f0784000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:12.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.028+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0780055db0 con 0x7f078815a6c0 2023-09-30T22:58:12.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.221+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f07880ae1d0 con 0x7f078815a6c0 2023-09-30T22:58:12.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.222+0000 7f077dffb700 1 -- 172.21.15.142:0/2594815491 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v114) v1 ==== 81+0+35093 (secure 0 0 0) 0x7f0780018070 con 0x7f078815a6c0 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 114, 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:58:11.318040+0000", 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:58:12.223 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 14, 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:58:12.224 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:58:12.226 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:12.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:12.228 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.229 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:12.230 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:12.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:58:12.232 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:12.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:12.234 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.235 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:12.236 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 13, 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:44.465774+0000", 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:58:12.238 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:12.239 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:12.240 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:58:12.242 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 14, 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:45.784661+0000", 2023-09-30T22:58:12.243 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:12.244 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.245 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:12.246 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:12.247 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:12.248 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.249 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.250 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:58:12.251 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.252 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.255 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.256 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:58:12.258 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.259 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.260 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:58:12.261 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.262 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.263 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.264 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:12.267 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.270 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:58:12.271 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.272 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.273 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.274 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.275 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.276 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.277 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:58:12.279 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:58:12.280 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.281 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:58:12.284 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:58:12.285 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:58:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.287 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.288 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.288 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.288 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.289 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.289 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.289 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.289 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.289 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.289 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.289 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.290 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.290 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.290 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:58:12.290 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.291 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.291 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:58:12.291 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.291 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.291 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.292 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:58:12.294 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.295 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.295 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.295 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.295 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:12.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.297 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:12.298 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.300 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.302 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:58:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:58:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:12.314 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f076c067330 msgr2=0x7f076c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f076c067330 0x7f076c0697e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0784003a10 tx=0x7f0784000bc0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f078815a6c0 msgr2=0x7f0788067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f078815a6c0 0x7f0788067fb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0780009df0 tx=0x7f078000b040 comp rx=0 tx=0).stop 2023-09-30T22:58:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 shutdown_connections 2023-09-30T22:58:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f076c067330 0x7f076c0697e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f078815a6c0 0x7f0788067fb0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07880b1580 0x7f0788154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 --2- 172.21.15.142:0/2594815491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07880b1950 0x7f0788067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 >> 172.21.15.142:0/2594815491 conn(0x7f07880ce1f0 msgr2=0x7f0788157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 shutdown_connections 2023-09-30T22:58:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.225+0000 7f078ffff700 1 -- 172.21.15.142:0/2594815491 wait complete. 2023-09-30T22:58:12.317 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-30T22:58:12.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:12.318 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-09-30T22:58:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-30T22:58:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T22:58:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T22:58:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.370049 s, 142 MB/s 2023-09-30T22:58:12.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:58:12.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:58:12.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.951+0000 7fe4f6dff700 1 Processor -- start 2023-09-30T22:58:12.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.951+0000 7fe4f6dff700 1 -- start start 2023-09-30T22:58:12.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4f6dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0159b90 0x7fe4f0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4f6dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4f0069f10 0x7fe4f006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4f6dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f00b0ee0 con 0x7fe4f00aebf0 2023-09-30T22:58:12.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4f6dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00aefc0 con 0x7fe4f0069f10 2023-09-30T22:58:12.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4f6dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015a520 con 0x7fe4f0159b90 2023-09-30T22:58:12.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4f539c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4f0069f10 0x7fe4f006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4effff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0159b90 0x7fe4f0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4f539c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4f0069f10 0x7fe4f006a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50166/0 (socket says 172.21.15.142:50166) 2023-09-30T22:58:12.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.952+0000 7fe4f4b9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe4f00aebf0 0x7fe4f006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:56918/0 (socket says 172.21.15.142:56918) 2023-09-30T22:58:12.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4f539c700 1 -- 172.21.15.142:0/1898004265 learned_addr learned my addr 172.21.15.142:0/1898004265 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:12.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4f539c700 1 -- 172.21.15.142:0/1898004265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0159b90 msgr2=0x7fe4f0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:12.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4f539c700 1 --2- 172.21.15.142:0/1898004265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0159b90 0x7fe4f0159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4f539c700 1 -- 172.21.15.142:0/1898004265 >> v1:172.21.15.148:6789/0 conn(0x7fe4f00aebf0 legacy=0x7fe4f006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4ef7fe700 1 -- 172.21.15.142:0/1898004265 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717541538 0 0) 0x7fe4f00b0ee0 con 0x7fe4f00aebf0 2023-09-30T22:58:12.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4f539c700 1 -- 172.21.15.142:0/1898004265 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f006f360 con 0x7fe4f0069f10 2023-09-30T22:58:12.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4effff700 1 --2- 172.21.15.142:0/1898004265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0159b90 0x7fe4f0159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:12.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4f539c700 1 --2- 172.21.15.142:0/1898004265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0069f10 0x7fe4f006a390 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f20 tx=0x7fe4e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d786bf3a40e7702 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:12.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.953+0000 7fe4ef7fe700 1 -- 172.21.15.142:0/1898004265 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e800e070 con 0x7fe4f0069f10 2023-09-30T22:58:12.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4ef7fe700 1 -- 172.21.15.142:0/1898004265 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e800b9d0 con 0x7fe4f0069f10 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4ef7fe700 1 -- 172.21.15.142:0/1898004265 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80092e0 con 0x7fe4f0069f10 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1898004265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0069f10 msgr2=0x7fe4f006a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1898004265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0069f10 0x7fe4f006a390 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f20 tx=0x7fe4e8009840 comp rx=0 tx=0).stop 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1898004265 shutdown_connections 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1898004265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0069f10 0x7fe4f006a390 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1898004265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0159b90 0x7fe4f0159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1898004265 >> 172.21.15.142:0/1898004265 conn(0x7fe4f00680c0 msgr2=0x7fe4f00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1898004265 shutdown_connections 2023-09-30T22:58:12.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.954+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1898004265 wait complete. 2023-09-30T22:58:12.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.956+0000 7fe4f6dff700 1 Processor -- start 2023-09-30T22:58:12.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.956+0000 7fe4f6dff700 1 -- start start 2023-09-30T22:58:12.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f6dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0069f10 0x7fe4f01494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f6dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00aebf0 0x7fe4f01563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f6dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0159b90 0x7fe4f0153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f6dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00c7450 con 0x7fe4f0159b90 2023-09-30T22:58:12.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f6dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0149a20 con 0x7fe4f00aebf0 2023-09-30T22:58:12.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f6dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00c6840 con 0x7fe4f0069f10 2023-09-30T22:58:12.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0159b90 0x7fe4f0153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0159b90 0x7fe4f0153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50174/0 (socket says 172.21.15.142:50174) 2023-09-30T22:58:12.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 -- 172.21.15.142:0/1822767800 learned_addr learned my addr 172.21.15.142:0/1822767800 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f4b9b700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0069f10 0x7fe4f01494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4effff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00aebf0 0x7fe4f01563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 -- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0069f10 msgr2=0x7fe4f01494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0069f10 0x7fe4f01494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 -- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00aebf0 msgr2=0x7fe4f01563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00aebf0 0x7fe4f01563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4f539c700 1 -- 172.21.15.142:0/1822767800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc009420 con 0x7fe4f0159b90 2023-09-30T22:58:12.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.957+0000 7fe4effff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00aebf0 0x7fe4f01563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.958+0000 7fe4f539c700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0159b90 0x7fe4f0153230 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b610 tx=0x7fe4e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.958+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8008b90 con 0x7fe4f0159b90 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.958+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e8008d10 con 0x7fe4f0159b90 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.958+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e8009ae0 con 0x7fe4f0159b90 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.958+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80266b0 con 0x7fe4f0159b90 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.958+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f00c6e00 con 0x7fe4f0159b90 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.959+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f00c7600 con 0x7fe4f0159b90 2023-09-30T22:58:12.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.960+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe4e8003040 con 0x7fe4f0159b90 2023-09-30T22:58:12.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.961+0000 7fe4ecff9700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe4d4067330 0x7fe4d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:12.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.961+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe4e8086c10 con 0x7fe4f0159b90 2023-09-30T22:58:12.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.961+0000 7fe4f4b9b700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe4d4067330 0x7fe4d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:12.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.961+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=116}) v3 -- 0x7fe4d406f4f0 con 0x7fe4f0159b90 2023-09-30T22:58:12.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.961+0000 7fe4f4b9b700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe4d4067330 0x7fe4d40697e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4007fd0 tx=0x7fe4e4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:12.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:12.965+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe4e8021060 con 0x7fe4f0159b90 2023-09-30T22:58:13.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.156+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe4f01560d0 con 0x7fe4f0159b90 2023-09-30T22:58:13.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.158+0000 7fe4ecff9700 1 -- 172.21.15.142:0/1822767800 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+35149 (secure 0 0 0) 0x7fe4f00c7600 con 0x7fe4f0159b90 2023-09-30T22:58:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:13.158 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 115, 2023-09-30T22:58:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:58:12.323750+0000", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:58:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 14, 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:58:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:58:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:58:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:58:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 13, 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:44.465774+0000", 2023-09-30T22:58:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 14, 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:45.784661+0000", 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:58:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:58:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:58:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:58:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:58:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:58:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:58:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:58:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:58:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:58:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:58:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:58:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:58:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:58:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:58:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:58:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:58:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:58:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:58:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:58:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:58:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:58:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:58:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:58:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:58:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:58:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:58:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:58:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:58:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:58:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:58:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:58:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:58:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:58:13.265 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:58:13.265 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:58:13.265 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:58:13.265 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:58:13.265 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:58:13.265 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:58:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:58:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:58:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:58:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:58:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:58:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:58:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:58:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:58:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:58:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:58:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:58:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:58:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:58:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:58:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe4d4067330 msgr2=0x7fe4d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe4d4067330 0x7fe4d40697e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4007fd0 tx=0x7fe4e4007d30 comp rx=0 tx=0).stop 2023-09-30T22:58:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0159b90 msgr2=0x7fe4f0153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0159b90 0x7fe4f0153230 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b610 tx=0x7fe4e8018000 comp rx=0 tx=0).stop 2023-09-30T22:58:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 shutdown_connections 2023-09-30T22:58:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe4d4067330 0x7fe4d40697e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4f0159b90 0x7fe4f0153230 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f0069f10 0x7fe4f01494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 --2- 172.21.15.142:0/1822767800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00aebf0 0x7fe4f01563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 >> 172.21.15.142:0/1822767800 conn(0x7fe4f00680c0 msgr2=0x7fe4f006e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.160+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 shutdown_connections 2023-09-30T22:58:13.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.161+0000 7fe4f6dff700 1 -- 172.21.15.142:0/1822767800 wait complete. 2023-09-30T22:58:13.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:13.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.465+0000 7fd7393ff700 1 Processor -- start 2023-09-30T22:58:13.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.465+0000 7fd7393ff700 1 -- start start 2023-09-30T22:58:13.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.466+0000 7fd7393ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340cee50 0x7fd734159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:13.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.466+0000 7fd7393ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7340d03d0 0x7fd73415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:13.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.466+0000 7fd7393ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73406b8d0 con 0x7fd7341598e0 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.466+0000 7fd7393ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7340cff40 con 0x7fd7340d03d0 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.466+0000 7fd7393ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7340cf330 con 0x7fd7340cee50 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7337fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7340d03d0 0x7fd73415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7337fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7340d03d0 0x7fd73415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50180/0 (socket says 172.21.15.142:50180) 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7337fe700 1 -- 172.21.15.142:0/26729644 learned_addr learned my addr 172.21.15.142:0/26729644 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7327fc700 1 --2- 172.21.15.142:0/26729644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340cee50 0x7fd734159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7337fe700 1 -- 172.21.15.142:0/26729644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340cee50 msgr2=0x7fd734159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:13.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7337fe700 1 --2- 172.21.15.142:0/26729644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340cee50 0x7fd734159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7337fe700 1 -- 172.21.15.142:0/26729644 >> v1:172.21.15.148:6789/0 conn(0x7fd7341598e0 legacy=0x7fd73406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.467+0000 7fd7337fe700 1 -- 172.21.15.142:0/26729644 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7340cf610 con 0x7fd7340d03d0 2023-09-30T22:58:13.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7337fe700 1 --2- 172.21.15.142:0/26729644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7340d03d0 0x7fd73415d7d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009f20 tx=0x7fd72c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943bb738e8078512 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd731ffb700 1 -- 172.21.15.142:0/26729644 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c00e070 con 0x7fd7340d03d0 2023-09-30T22:58:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd731ffb700 1 -- 172.21.15.142:0/26729644 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c00b9d0 con 0x7fd7340d03d0 2023-09-30T22:58:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd731ffb700 1 -- 172.21.15.142:0/26729644 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0092e0 con 0x7fd7340d03d0 2023-09-30T22:58:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 -- 172.21.15.142:0/26729644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7340d03d0 msgr2=0x7fd73415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 --2- 172.21.15.142:0/26729644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7340d03d0 0x7fd73415d7d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009f20 tx=0x7fd72c009840 comp rx=0 tx=0).stop 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 -- 172.21.15.142:0/26729644 shutdown_connections 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 --2- 172.21.15.142:0/26729644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7340d03d0 0x7fd73415d7d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 --2- 172.21.15.142:0/26729644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340cee50 0x7fd734159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 -- 172.21.15.142:0/26729644 >> 172.21.15.142:0/26729644 conn(0x7fd7340cd540 msgr2=0x7fd7340cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 -- 172.21.15.142:0/26729644 shutdown_connections 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.468+0000 7fd7393ff700 1 -- 172.21.15.142:0/26729644 wait complete. 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.470+0000 7fd7393ff700 1 Processor -- start 2023-09-30T22:58:13.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.470+0000 7fd7393ff700 1 -- start start 2023-09-30T22:58:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7393ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7340cee50 0x7fd73416b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7393ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340d03d0 0x7fd734150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:13.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7393ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7341598e0 0x7fd73415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7393ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734151520 con 0x7fd7341598e0 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7393ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73415c7b0 con 0x7fd7340cee50 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7393ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73415c9f0 con 0x7fd7340d03d0 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7337fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7341598e0 0x7fd73415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7337fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7341598e0 0x7fd73415c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50184/0 (socket says 172.21.15.142:50184) 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7337fe700 1 -- 172.21.15.142:0/3770053355 learned_addr learned my addr 172.21.15.142:0/3770053355 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd732ffd700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7340cee50 0x7fd73416b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.471+0000 7fd7327fc700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340d03d0 0x7fd734150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:13.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7337fe700 1 -- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340d03d0 msgr2=0x7fd734150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7337fe700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340d03d0 0x7fd734150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7337fe700 1 -- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7340cee50 msgr2=0x7fd73416b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7337fe700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7340cee50 0x7fd73416b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7337fe700 1 -- 172.21.15.142:0/3770053355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c009ae0 con 0x7fd7341598e0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7337fe700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7341598e0 0x7fd73415c270 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ce0a0 tx=0x7fd72c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c008b10 con 0x7fd7341598e0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c008cb0 con 0x7fd7341598e0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0266b0 con 0x7fd7341598e0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7340c46e0 con 0x7fd7341598e0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.472+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7340c4ca0 con 0x7fd7341598e0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.473+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7340c4e90 con 0x7fd7341598e0 2023-09-30T22:58:13.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.474+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd72c003040 con 0x7fd7341598e0 2023-09-30T22:58:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.475+0000 7fd71affd700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd720067330 0x7fd7200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.475+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd72c086b30 con 0x7fd7341598e0 2023-09-30T22:58:13.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.475+0000 7fd732ffd700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd720067330 0x7fd7200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:13.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.476+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=116}) v3 -- 0x7fd72006f4f0 con 0x7fd7341598e0 2023-09-30T22:58:13.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.476+0000 7fd732ffd700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd720067330 0x7fd7200697e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd724003a80 tx=0x7fd724007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:13.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.479+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd72c053990 con 0x7fd7341598e0 2023-09-30T22:58:13.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:13.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:13.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.717+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7340b2b80 con 0x7fd7341598e0 2023-09-30T22:58:13.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.718+0000 7fd71affd700 1 -- 172.21.15.142:0/3770053355 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fd72c02b090 con 0x7fd7341598e0 2023-09-30T22:58:13.718 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:13.718 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:58:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.720+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd720067330 msgr2=0x7fd7200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.720+0000 7fd7393ff700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd720067330 0x7fd7200697e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd724003a80 tx=0x7fd724007ec0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.720+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7341598e0 msgr2=0x7fd73415c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.720+0000 7fd7393ff700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7341598e0 0x7fd73415c270 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ce0a0 tx=0x7fd72c018000 comp rx=0 tx=0).stop 2023-09-30T22:58:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 shutdown_connections 2023-09-30T22:58:13.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd720067330 0x7fd7200697e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7341598e0 0x7fd73415c270 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7340cee50 0x7fd73416b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 --2- 172.21.15.142:0/3770053355 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7340d03d0 0x7fd734150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 >> 172.21.15.142:0/3770053355 conn(0x7fd7340cd540 msgr2=0x7fd7340b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 shutdown_connections 2023-09-30T22:58:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:13.721+0000 7fd7393ff700 1 -- 172.21.15.142:0/3770053355 wait complete. 2023-09-30T22:58:13.722 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:58:13.738 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:58:13.950 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6450,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.602127930999998,"mdsmap_epoch":50,"osdmap_epoch":115,"osdmap_epoch_barrier":115,"uptime":32.582778324000003} 2023-09-30T22:58:13.950 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6450, "mdsmap_epoch": 50, "osdmap_epoch": 115, "osdmap_epoch_barrier": 115, "rank_uptime": 26.602127931, "state": "up:active", "uptime": 32.582778324, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:58:13.951 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:58:13.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:13.951 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-09-30T22:58:13.997 INFO:teuthology.orchestra.run.smithi142.stderr:dd: failed to open 'small_file_1': Permission denied 2023-09-30T22:58:13.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:58:13.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:13.998 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-30T22:58:14.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:14.087 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-30T22:58:14.196 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:58:14.309 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:58:14.309+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-09-30T22:58:14.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.387+0000 7f408ffff700 1 Processor -- start 2023-09-30T22:58:14.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.387+0000 7f408ffff700 1 -- start start 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f40880b1180 0x7f40880cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4088159eb0 0x7f40880cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408815d910 con 0x7f4088159ae0 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408815e920 con 0x7f4088159eb0 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408815e490 con 0x7f40880b1180 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408dd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4088159ae0 0x7f40880cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39554/0 (socket says 172.21.15.142:39554) 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408dd9b700 1 -- 172.21.15.142:0/2873696011 learned_addr learned my addr 172.21.15.142:0/2873696011 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408e59c700 1 --2- 172.21.15.142:0/2873696011 >> v2:172.21.15.142:3300/0 conn(0x7f4088159eb0 0x7f40880cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408d59a700 1 --2- 172.21.15.142:0/2873696011 >> v2:172.21.15.148:3300/0 conn(0x7f40880b1180 0x7f40880cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:14.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408cd99700 1 -- 172.21.15.142:0/2873696011 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048102456 0 0) 0x7f408815d910 con 0x7f4088159ae0 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408cd99700 1 -- 172.21.15.142:0/2873696011 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4074003570 con 0x7f4088159ae0 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408e59c700 1 -- 172.21.15.142:0/2873696011 >> v2:172.21.15.148:3300/0 conn(0x7f40880b1180 msgr2=0x7f40880cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408e59c700 1 --2- 172.21.15.142:0/2873696011 >> v2:172.21.15.148:3300/0 conn(0x7f40880b1180 0x7f40880cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408e59c700 1 -- 172.21.15.142:0/2873696011 >> v1:172.21.15.142:6789/0 conn(0x7f4088159ae0 legacy=0x7f40880cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.389+0000 7f408e59c700 1 -- 172.21.15.142:0/2873696011 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40880ce5c0 con 0x7f4088159eb0 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.390+0000 7f408e59c700 1 --2- 172.21.15.142:0/2873696011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f40880cc3c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4088067af0 tx=0x7f4080009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e96afdd538e85bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.390+0000 7f408cd99700 1 -- 172.21.15.142:0/2873696011 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000e070 con 0x7f4088159eb0 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.390+0000 7f408cd99700 1 -- 172.21.15.142:0/2873696011 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000bb60 con 0x7f4088159eb0 2023-09-30T22:58:14.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.390+0000 7f408cd99700 1 -- 172.21.15.142:0/2873696011 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080012430 con 0x7f4088159eb0 2023-09-30T22:58:14.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.390+0000 7f408ffff700 1 -- 172.21.15.142:0/2873696011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 msgr2=0x7f40880cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:14.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.390+0000 7f408ffff700 1 --2- 172.21.15.142:0/2873696011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f40880cc3c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4088067af0 tx=0x7f4080009780 comp rx=0 tx=0).stop 2023-09-30T22:58:14.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.391+0000 7f408ffff700 1 -- 172.21.15.142:0/2873696011 shutdown_connections 2023-09-30T22:58:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.391+0000 7f408ffff700 1 --2- 172.21.15.142:0/2873696011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f40880cc3c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.391+0000 7f408ffff700 1 --2- 172.21.15.142:0/2873696011 >> v2:172.21.15.148:3300/0 conn(0x7f40880b1180 0x7f40880cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.391+0000 7f408ffff700 1 -- 172.21.15.142:0/2873696011 >> 172.21.15.142:0/2873696011 conn(0x7f40880ce8b0 msgr2=0x7f40880cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.391+0000 7f408ffff700 1 -- 172.21.15.142:0/2873696011 shutdown_connections 2023-09-30T22:58:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.391+0000 7f408ffff700 1 -- 172.21.15.142:0/2873696011 wait complete. 2023-09-30T22:58:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.393+0000 7f408ffff700 1 Processor -- start 2023-09-30T22:58:14.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.393+0000 7f408ffff700 1 -- start start 2023-09-30T22:58:14.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40880b1180 0x7f4088149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4088159ae0 0x7f4088149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f408815f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408815aa10 con 0x7f4088159eb0 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4088160290 con 0x7f40880b1180 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408815ac60 con 0x7f4088159ae0 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f408815f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f408815f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50204/0 (socket says 172.21.15.142:50204) 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.394+0000 7f408e59c700 1 -- 172.21.15.142:0/3706950910 learned_addr learned my addr 172.21.15.142:0/3706950910 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408d59a700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4088159ae0 0x7f4088149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408dd9b700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40880b1180 0x7f4088149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408e59c700 1 -- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4088159ae0 msgr2=0x7f4088149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408e59c700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4088159ae0 0x7f4088149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408e59c700 1 -- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40880b1180 msgr2=0x7f4088149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408e59c700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40880b1180 0x7f4088149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408e59c700 1 -- 172.21.15.142:0/3706950910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080009a20 con 0x7f4088159eb0 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408e59c700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f408815f990 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4080009fd0 tx=0x7f4080019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080012e00 con 0x7f4088159eb0 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408001d630 con 0x7f4088159eb0 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408815af40 con 0x7f4088159eb0 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.395+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408001d9f0 con 0x7f4088159eb0 2023-09-30T22:58:14.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.396+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40881498c0 con 0x7f4088159eb0 2023-09-30T22:58:14.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.397+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408815b460 con 0x7f4088159eb0 2023-09-30T22:58:14.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.398+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4080024070 con 0x7f4088159eb0 2023-09-30T22:58:14.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.398+0000 7f407dffb700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f406c067360 0x7f406c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:14.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.398+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4080087350 con 0x7f4088159eb0 2023-09-30T22:58:14.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.399+0000 7f408dd9b700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f406c067360 0x7f406c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:14.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.399+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=116}) v3 -- 0x7f406c06f520 con 0x7f4088159eb0 2023-09-30T22:58:14.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.399+0000 7f408dd9b700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f406c067360 0x7f406c069810 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f40840058d0 tx=0x7f4084009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:14.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.403+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f408815b460 con 0x7f4088159eb0 2023-09-30T22:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.596+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f408815b460 con 0x7f4088159eb0 2023-09-30T22:58:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.597+0000 7f407dffb700 1 -- 172.21.15.142:0/3706950910 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+35149 (secure 0 0 0) 0x7f408815b460 con 0x7f4088159eb0 2023-09-30T22:58:14.597 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:14.597 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 115, 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:58:12.323750+0000", 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:58:14.598 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 14, 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:58:14.599 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:58:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 13, 2023-09-30T22:58:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:44.465774+0000", 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 14, 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:45.784661+0000", 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 3, 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full", 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:58:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "112", 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:58:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:58:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:58:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:58:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:58:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:58:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull", 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:58:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:58:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:58:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:58:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:58:14.677 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "full", 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:58:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:58:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:58:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:58:14.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:14.688 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:14.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.599+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f406c067360 msgr2=0x7f406c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:14.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.599+0000 7f408ffff700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f406c067360 0x7f406c069810 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f40840058d0 tx=0x7f4084009040 comp rx=0 tx=0).stop 2023-09-30T22:58:14.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 msgr2=0x7f408815f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f408815f990 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4080009fd0 tx=0x7f4080019000 comp rx=0 tx=0).stop 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 shutdown_connections 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f406c067360 0x7f406c069810 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4088159eb0 0x7f408815f990 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40880b1180 0x7f4088149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 --2- 172.21.15.142:0/3706950910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4088159ae0 0x7f4088149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 >> 172.21.15.142:0/3706950910 conn(0x7f40880ce8b0 msgr2=0x7f40880cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 shutdown_connections 2023-09-30T22:58:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:14.600+0000 7f408ffff700 1 -- 172.21.15.142:0/3706950910 wait complete. 2023-09-30T22:58:14.691 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:58:19.310 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:58:19.311+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-09-30T22:58:19.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:58:19.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.892+0000 7f1e08fff700 1 Processor -- start 2023-09-30T22:58:19.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.892+0000 7f1e08fff700 1 -- start start 2023-09-30T22:58:19.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.893+0000 7f1e08fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040b1580 0x7f1e040adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:19.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e08fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e040ae000 0x7f1e0406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:19.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e08fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e040ad630 con 0x7f1e040b1950 2023-09-30T22:58:19.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e08fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e04157c20 con 0x7f1e040ae000 2023-09-30T22:58:19.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e08fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040b3360 con 0x7f1e040b1580 2023-09-30T22:58:19.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e02d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e040ae000 0x7f1e0406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:19.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e0259c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040b1580 0x7f1e040adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:19.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e02d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e040ae000 0x7f1e0406a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:57302/0 (socket says 172.21.15.142:57302) 2023-09-30T22:58:19.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e02d9d700 1 -- 172.21.15.142:0/806732791 learned_addr learned my addr 172.21.15.142:0/806732791 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:19.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e02d9d700 1 -- 172.21.15.142:0/806732791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040b1580 msgr2=0x7f1e040adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:19.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e02d9d700 1 --2- 172.21.15.142:0/806732791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040b1580 0x7f1e040adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:19.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.894+0000 7f1e02d9d700 1 -- 172.21.15.142:0/806732791 >> v1:172.21.15.148:6789/0 conn(0x7f1e040b1950 legacy=0x7f1e0415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:19.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.895+0000 7f1e02d9d700 1 -- 172.21.15.142:0/806732791 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0415ad60 con 0x7f1e040ae000 2023-09-30T22:58:19.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.895+0000 7f1e02d9d700 1 --2- 172.21.15.142:0/806732791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040ae000 0x7f1e0406a7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009f20 tx=0x7f1dfc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ba5d0c7d7fb2bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:19.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.895+0000 7f1e0159a700 1 -- 172.21.15.142:0/806732791 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00e070 con 0x7f1e040ae000 2023-09-30T22:58:19.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.895+0000 7f1e0159a700 1 -- 172.21.15.142:0/806732791 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc00b9d0 con 0x7f1e040ae000 2023-09-30T22:58:19.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.895+0000 7f1e0159a700 1 -- 172.21.15.142:0/806732791 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0092e0 con 0x7f1e040ae000 2023-09-30T22:58:19.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 -- 172.21.15.142:0/806732791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040ae000 msgr2=0x7f1e0406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:19.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 --2- 172.21.15.142:0/806732791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040ae000 0x7f1e0406a7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009f20 tx=0x7f1dfc009840 comp rx=0 tx=0).stop 2023-09-30T22:58:19.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 -- 172.21.15.142:0/806732791 shutdown_connections 2023-09-30T22:58:19.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 --2- 172.21.15.142:0/806732791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040ae000 0x7f1e0406a7a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:19.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 --2- 172.21.15.142:0/806732791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040b1580 0x7f1e040adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:19.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 -- 172.21.15.142:0/806732791 >> 172.21.15.142:0/806732791 conn(0x7f1e040ce1f0 msgr2=0x7f1e04069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:19.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 -- 172.21.15.142:0/806732791 shutdown_connections 2023-09-30T22:58:19.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.896+0000 7f1e08fff700 1 -- 172.21.15.142:0/806732791 wait complete. 2023-09-30T22:58:19.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.898+0000 7f1e08fff700 1 Processor -- start 2023-09-30T22:58:19.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.898+0000 7f1e08fff700 1 -- start start 2023-09-30T22:58:19.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.899+0000 7f1e08fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040ae000 0x7f1e040aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.899+0000 7f1e08fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040b1580 0x7f1e040c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.899+0000 7f1e08fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e040b1950 0x7f1e0416e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.899+0000 7f1e08fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040c2a50 con 0x7f1e040b1950 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.899+0000 7f1e08fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040aaf10 con 0x7f1e040b1580 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.899+0000 7f1e08fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040ab1f0 con 0x7f1e040ae000 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e040b1950 0x7f1e0416e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e040b1950 0x7f1e0416e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50210/0 (socket says 172.21.15.142:50210) 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 -- 172.21.15.142:0/2436907692 learned_addr learned my addr 172.21.15.142:0/2436907692 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e0259c700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040ae000 0x7f1e040aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:19.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e01d9b700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040b1580 0x7f1e040c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 -- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040ae000 msgr2=0x7f1e040aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040ae000 0x7f1e040aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 -- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040b1580 msgr2=0x7f1e040c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040b1580 0x7f1e040c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 -- 172.21.15.142:0/2436907692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc009ae0 con 0x7f1e040b1950 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.900+0000 7f1e02d9d700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e040b1950 0x7f1e0416e370 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00b610 tx=0x7f1dfc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.901+0000 7f1df27fc700 1 -- 172.21.15.142:0/2436907692 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc008ad0 con 0x7f1e040b1950 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.901+0000 7f1df27fc700 1 -- 172.21.15.142:0/2436907692 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc008c30 con 0x7f1e040b1950 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.901+0000 7f1df27fc700 1 -- 172.21.15.142:0/2436907692 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc026460 con 0x7f1e040b1950 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.901+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e040ab4d0 con 0x7f1e040b1950 2023-09-30T22:58:19.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.901+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e040aba90 con 0x7f1e040b1950 2023-09-30T22:58:19.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.902+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0406d600 con 0x7f1e040b1950 2023-09-30T22:58:19.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.903+0000 7f1df27fc700 1 -- 172.21.15.142:0/2436907692 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1dfc003040 con 0x7f1e040b1950 2023-09-30T22:58:19.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.904+0000 7f1df27fc700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1de4067330 0x7f1de40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:19.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.904+0000 7f1df27fc700 1 -- 172.21.15.142:0/2436907692 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f1dfc086a50 con 0x7f1e040b1950 2023-09-30T22:58:19.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.904+0000 7f1e0259c700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1de4067330 0x7f1de40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:19.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.905+0000 7f1e0259c700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1de4067330 0x7f1de40697e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009db0 tx=0x7f1df40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:19.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:19.908+0000 7f1df27fc700 1 -- 172.21.15.142:0/2436907692 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1dfc053880 con 0x7f1e040b1950 2023-09-30T22:58:20.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.098+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1e0415b040 con 0x7f1e040b1950 2023-09-30T22:58:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.099+0000 7f1df27fc700 1 -- 172.21.15.142:0/2436907692 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v118) v1 ==== 81+0+36279 (secure 0 0 0) 0x7f1dfc056ea0 con 0x7f1e040b1950 2023-09-30T22:58:20.099 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:20.099 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 118, 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:58:19.362138+0000", 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:58:20.100 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:58:20.101 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 14, 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:58:20.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.103 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:58:20.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.105 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.106 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.107 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.109 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:20.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.111 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.112 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:58:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.114 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.115 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.116 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.117 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:58:20.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 13, 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:44.465774+0000", 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.119 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.122 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.123 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.125 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 14, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:45.784661+0000", 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.127 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.128 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.129 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.130 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.131 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:58:20.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.133 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.134 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.136 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:58:20.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:58:20.139 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.140 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:58:20.141 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:58:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:58:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:58:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:58:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:58:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "13.14", 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 6, 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 4 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.20", 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 7, 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.26", 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 1, 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.27", 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 1, 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.2a", 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 1, 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.35", 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 7, 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.3d", 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 7, 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:58:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:58:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:58:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:58:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:58:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.203 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:20.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1de4067330 msgr2=0x7f1de40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1de4067330 0x7f1de40697e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009db0 tx=0x7f1df40091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e040b1950 msgr2=0x7f1e0416e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e040b1950 0x7f1e0416e370 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00b610 tx=0x7f1dfc018000 comp rx=0 tx=0).stop 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 shutdown_connections 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1de4067330 0x7f1de40697e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e040b1950 0x7f1e0416e370 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e040ae000 0x7f1e040aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 --2- 172.21.15.142:0/2436907692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e040b1580 0x7f1e040c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 >> 172.21.15.142:0/2436907692 conn(0x7f1e040ce1f0 msgr2=0x7f1e04068560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.101+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 shutdown_connections 2023-09-30T22:58:20.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.102+0000 7f1e08fff700 1 -- 172.21.15.142:0/2436907692 wait complete. 2023-09-30T22:58:20.206 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-30T22:58:20.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:58:20.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.397+0000 7ff4525ff700 1 Processor -- start 2023-09-30T22:58:20.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.397+0000 7ff4525ff700 1 -- start start 2023-09-30T22:58:20.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.398+0000 7ff4525ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff44c159ae0 0x7ff44c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.398+0000 7ff4525ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff44c0cc590 0x7ff44c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.398+0000 7ff4525ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c15d910 con 0x7ff44c0b1180 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff4525ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c15e920 con 0x7ff44c0cc590 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff4525ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c15e490 con 0x7ff44c159ae0 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff44b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff44c0b1180 0x7ff44c0cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39558/0 (socket says 172.21.15.142:39558) 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff44b7fe700 1 -- 172.21.15.142:0/495094805 learned_addr learned my addr 172.21.15.142:0/495094805 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff450b9c700 1 --2- 172.21.15.142:0/495094805 >> v2:172.21.15.142:3300/0 conn(0x7ff44c0cc590 0x7ff44c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff44bfff700 1 --2- 172.21.15.142:0/495094805 >> v2:172.21.15.148:3300/0 conn(0x7ff44c159ae0 0x7ff44c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff44affd700 1 -- 172.21.15.142:0/495094805 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362974576 0 0) 0x7ff44c15d910 con 0x7ff44c0b1180 2023-09-30T22:58:20.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff44affd700 1 -- 172.21.15.142:0/495094805 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff434003570 con 0x7ff44c0b1180 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff450b9c700 1 -- 172.21.15.142:0/495094805 >> v2:172.21.15.148:3300/0 conn(0x7ff44c159ae0 msgr2=0x7ff44c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff450b9c700 1 --2- 172.21.15.142:0/495094805 >> v2:172.21.15.148:3300/0 conn(0x7ff44c159ae0 0x7ff44c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff450b9c700 1 -- 172.21.15.142:0/495094805 >> v1:172.21.15.142:6789/0 conn(0x7ff44c0b1180 legacy=0x7ff44c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.399+0000 7ff450b9c700 1 -- 172.21.15.142:0/495094805 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c15db60 con 0x7ff44c0cc590 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff450b9c700 1 --2- 172.21.15.142:0/495094805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0cc590 0x7ff44c069f10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0cb650 tx=0x7ff444009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca309c855242523 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff44affd700 1 -- 172.21.15.142:0/495094805 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44400e070 con 0x7ff44c0cc590 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff44affd700 1 -- 172.21.15.142:0/495094805 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44400bab0 con 0x7ff44c0cc590 2023-09-30T22:58:20.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff44affd700 1 -- 172.21.15.142:0/495094805 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44400be70 con 0x7ff44c0cc590 2023-09-30T22:58:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff4525ff700 1 -- 172.21.15.142:0/495094805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0cc590 msgr2=0x7ff44c069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff4525ff700 1 --2- 172.21.15.142:0/495094805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0cc590 0x7ff44c069f10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0cb650 tx=0x7ff444009780 comp rx=0 tx=0).stop 2023-09-30T22:58:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff4525ff700 1 -- 172.21.15.142:0/495094805 shutdown_connections 2023-09-30T22:58:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff4525ff700 1 --2- 172.21.15.142:0/495094805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0cc590 0x7ff44c069f10 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff4525ff700 1 --2- 172.21.15.142:0/495094805 >> v2:172.21.15.148:3300/0 conn(0x7ff44c159ae0 0x7ff44c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff4525ff700 1 -- 172.21.15.142:0/495094805 >> 172.21.15.142:0/495094805 conn(0x7ff44c0ce8b0 msgr2=0x7ff44c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.400+0000 7ff4525ff700 1 -- 172.21.15.142:0/495094805 shutdown_connections 2023-09-30T22:58:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.401+0000 7ff4525ff700 1 -- 172.21.15.142:0/495094805 wait complete. 2023-09-30T22:58:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.402+0000 7ff4525ff700 1 Processor -- start 2023-09-30T22:58:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.402+0000 7ff4525ff700 1 -- start start 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff4525ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0b1180 0x7ff44c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff4525ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c0cc590 0x7ff44c0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff4525ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c159ae0 0x7ff44c16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff4525ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c16bd10 con 0x7ff44c159ae0 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff4525ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0a5750 con 0x7ff44c0b1180 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff4525ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0ca9d0 con 0x7ff44c0cc590 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff450b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c159ae0 0x7ff44c16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff450b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c159ae0 0x7ff44c16a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50222/0 (socket says 172.21.15.142:50222) 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff450b9c700 1 -- 172.21.15.142:0/1918791306 learned_addr learned my addr 172.21.15.142:0/1918791306 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff44bfff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0b1180 0x7ff44c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.403+0000 7ff44b7fe700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c0cc590 0x7ff44c0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff450b9c700 1 -- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c0cc590 msgr2=0x7ff44c0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff450b9c700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c0cc590 0x7ff44c0ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff450b9c700 1 -- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0b1180 msgr2=0x7ff44c0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff450b9c700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0b1180 0x7ff44c0c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff450b9c700 1 -- 172.21.15.142:0/1918791306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff444009a20 con 0x7ff44c159ae0 2023-09-30T22:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff450b9c700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c159ae0 0x7ff44c16a340 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff44c063f90 tx=0x7ff444019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff433fff700 1 -- 172.21.15.142:0/1918791306 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444012dd0 con 0x7ff44c159ae0 2023-09-30T22:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff433fff700 1 -- 172.21.15.142:0/1918791306 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444027470 con 0x7ff44c159ae0 2023-09-30T22:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff433fff700 1 -- 172.21.15.142:0/1918791306 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444027830 con 0x7ff44c159ae0 2023-09-30T22:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.404+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c0cacb0 con 0x7ff44c159ae0 2023-09-30T22:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.405+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c16a880 con 0x7ff44c159ae0 2023-09-30T22:58:20.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.406+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c06ea70 con 0x7ff44c159ae0 2023-09-30T22:58:20.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.406+0000 7ff433fff700 1 -- 172.21.15.142:0/1918791306 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff444024070 con 0x7ff44c159ae0 2023-09-30T22:58:20.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.408+0000 7ff433fff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff438067330 0x7ff4380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.408+0000 7ff433fff700 1 -- 172.21.15.142:0/1918791306 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7ff444087730 con 0x7ff44c159ae0 2023-09-30T22:58:20.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.408+0000 7ff44bfff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff438067330 0x7ff4380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.408+0000 7ff44bfff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff438067330 0x7ff4380697e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0cb290 tx=0x7ff43c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:20.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.412+0000 7ff433fff700 1 -- 172.21.15.142:0/1918791306 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff4440544c0 con 0x7ff44c159ae0 2023-09-30T22:58:20.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.604+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff44c15de40 con 0x7ff44c159ae0 2023-09-30T22:58:20.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.605+0000 7ff433fff700 1 -- 172.21.15.142:0/1918791306 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v118) v1 ==== 81+0+36279 (secure 0 0 0) 0x7ff444057ae0 con 0x7ff44c159ae0 2023-09-30T22:58:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:20.606 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 118, 2023-09-30T22:58:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:58:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:58:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:58:19.362138+0000", 2023-09-30T22:58:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 14, 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "luminous", 2023-09-30T22:58:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:58:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 13, 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:44.465774+0000", 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:58:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 14, 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:57:45.784661+0000", 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:58:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:58:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:58:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:58:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:58:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:58:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:58:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:58:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:58:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:58:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:58:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:58:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:58:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:58:20.651 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:58:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 116, 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:58:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:58:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:58:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:58:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 109, 2023-09-30T22:58:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:58:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:58:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:58:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:58:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:58:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [ 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "13.14", 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 6, 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 4 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.20", 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 7, 2023-09-30T22:58:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.26", 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 1, 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.27", 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 1, 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 3 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.2a", 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 1, 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.35", 2023-09-30T22:58:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 7, 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "pgid": "14.3d", 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "mappings": [ 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "from": 7, 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "to": 0 2023-09-30T22:58:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:58:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:58:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:58:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:58:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:58:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:58:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:58:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:58:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:20.711 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff438067330 msgr2=0x7ff4380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff438067330 0x7ff4380697e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0cb290 tx=0x7ff43c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c159ae0 msgr2=0x7ff44c16a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c159ae0 0x7ff44c16a340 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff44c063f90 tx=0x7ff444019000 comp rx=0 tx=0).stop 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 shutdown_connections 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff438067330 0x7ff4380697e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c159ae0 0x7ff44c16a340 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0b1180 0x7ff44c0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 --2- 172.21.15.142:0/1918791306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c0cc590 0x7ff44c0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 >> 172.21.15.142:0/1918791306 conn(0x7ff44c0ce8b0 msgr2=0x7ff44c068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 shutdown_connections 2023-09-30T22:58:20.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.608+0000 7ff4525ff700 1 -- 172.21.15.142:0/1918791306 wait complete. 2023-09-30T22:58:20.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:20.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.905+0000 7f5de91ff700 1 Processor -- start 2023-09-30T22:58:20.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.905+0000 7f5de91ff700 1 -- start start 2023-09-30T22:58:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de91ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5de4159b50 0x7f5de40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de91ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5de40ac3a0 0x7f5de40aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de91ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de40aa7e0 0x7f5de406a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de91ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de4069f10 con 0x7f5de4159b50 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de91ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de4068000 con 0x7f5de40ac3a0 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de91ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40aac30 con 0x7f5de40aa7e0 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5de4159b50 0x7f5de40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5de4159b50 0x7f5de40a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41758/0 (socket says 172.21.15.142:41758) 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 -- 172.21.15.142:0/3698172774 learned_addr learned my addr 172.21.15.142:0/3698172774 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de259c700 1 --2- 172.21.15.142:0/3698172774 >> v2:172.21.15.148:3300/0 conn(0x7f5de40ac3a0 0x7f5de40aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de359e700 1 --2- 172.21.15.142:0/3698172774 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de40aa7e0 0x7f5de406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 -- 172.21.15.142:0/3698172774 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de40aa7e0 msgr2=0x7f5de406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 --2- 172.21.15.142:0/3698172774 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de40aa7e0 0x7f5de406a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 -- 172.21.15.142:0/3698172774 >> v2:172.21.15.148:3300/0 conn(0x7f5de40ac3a0 msgr2=0x7f5de40aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 --2- 172.21.15.142:0/3698172774 >> v2:172.21.15.148:3300/0 conn(0x7f5de40ac3a0 0x7f5de40aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.907+0000 7f5de2d9d700 1 -- 172.21.15.142:0/3698172774 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40a9e00 con 0x7f5de4159b50 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.908+0000 7f5de2d9d700 1 --2- 172.21.15.142:0/3698172774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de4159b50 0x7f5de40a98c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5de406c300 tx=0x7f5dd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b2a896d1ea68f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.908+0000 7f5de1d9b700 1 -- 172.21.15.142:0/3698172774 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400b640 con 0x7f5de4159b50 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.908+0000 7f5de1d9b700 1 -- 172.21.15.142:0/3698172774 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd400b7a0 con 0x7f5de4159b50 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.908+0000 7f5de1d9b700 1 -- 172.21.15.142:0/3698172774 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400bb60 con 0x7f5de4159b50 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.908+0000 7f5de91ff700 1 -- 172.21.15.142:0/3698172774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de4159b50 msgr2=0x7f5de40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.908+0000 7f5de91ff700 1 --2- 172.21.15.142:0/3698172774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de4159b50 0x7f5de40a98c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5de406c300 tx=0x7f5dd4009250 comp rx=0 tx=0).stop 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.909+0000 7f5de91ff700 1 -- 172.21.15.142:0/3698172774 shutdown_connections 2023-09-30T22:58:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.909+0000 7f5de91ff700 1 --2- 172.21.15.142:0/3698172774 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de40aa7e0 0x7f5de406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.909+0000 7f5de91ff700 1 --2- 172.21.15.142:0/3698172774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de4159b50 0x7f5de40a98c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.909+0000 7f5de91ff700 1 --2- 172.21.15.142:0/3698172774 >> v2:172.21.15.148:3300/0 conn(0x7f5de40ac3a0 0x7f5de40aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.909+0000 7f5de91ff700 1 -- 172.21.15.142:0/3698172774 >> 172.21.15.142:0/3698172774 conn(0x7f5de406dab0 msgr2=0x7f5de40aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:20.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.909+0000 7f5de91ff700 1 -- 172.21.15.142:0/3698172774 shutdown_connections 2023-09-30T22:58:20.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.909+0000 7f5de91ff700 1 -- 172.21.15.142:0/3698172774 wait complete. 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.910+0000 7f5de91ff700 1 Processor -- start 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.910+0000 7f5de91ff700 1 -- start start 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de91ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de40aa7e0 0x7f5de4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de91ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5de40ac3a0 0x7f5de40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de91ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de4159b50 0x7f5de415b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de91ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41562e0 con 0x7f5de40aa7e0 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de91ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415ce30 con 0x7f5de40ac3a0 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de91ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415b100 con 0x7f5de4159b50 2023-09-30T22:58:20.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de40aa7e0 0x7f5de4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de40aa7e0 0x7f5de4155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41772/0 (socket says 172.21.15.142:41772) 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.911+0000 7f5de2d9d700 1 -- 172.21.15.142:0/2928965689 learned_addr learned my addr 172.21.15.142:0/2928965689 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de259c700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5de40ac3a0 0x7f5de40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de2d9d700 1 -- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de4159b50 msgr2=0x7f5de415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de2d9d700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de4159b50 0x7f5de415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de2d9d700 1 -- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5de40ac3a0 msgr2=0x7f5de40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de2d9d700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5de40ac3a0 0x7f5de40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de2d9d700 1 -- 172.21.15.142:0/2928965689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40094f0 con 0x7f5de40aa7e0 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de259c700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5de40ac3a0 0x7f5de40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de2d9d700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de40aa7e0 0x7f5de4155da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5de406c8a0 tx=0x7f5dd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:20.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5dcaffd700 1 -- 172.21.15.142:0/2928965689 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4000d10 con 0x7f5de40aa7e0 2023-09-30T22:58:20.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5dcaffd700 1 -- 172.21.15.142:0/2928965689 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd400bb20 con 0x7f5de40aa7e0 2023-09-30T22:58:20.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5dcaffd700 1 -- 172.21.15.142:0/2928965689 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4011670 con 0x7f5de40aa7e0 2023-09-30T22:58:20.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.912+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de40cc950 con 0x7f5de40aa7e0 2023-09-30T22:58:20.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.913+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de415ad90 con 0x7f5de40aa7e0 2023-09-30T22:58:20.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.914+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de415b3e0 con 0x7f5de40aa7e0 2023-09-30T22:58:20.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.914+0000 7f5dcaffd700 1 -- 172.21.15.142:0/2928965689 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5dd40119e0 con 0x7f5de40aa7e0 2023-09-30T22:58:20.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.916+0000 7f5dcaffd700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5dd0067360 0x7f5dd0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:20.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.916+0000 7f5dcaffd700 1 -- 172.21.15.142:0/2928965689 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f5dd4086510 con 0x7f5de40aa7e0 2023-09-30T22:58:20.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.916+0000 7f5de259c700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5dd0067360 0x7f5dd0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:20.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.916+0000 7f5de259c700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5dd0067360 0x7f5dd0069810 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8006f00 tx=0x7f5dd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:20.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:20.920+0000 7f5dcaffd700 1 -- 172.21.15.142:0/2928965689 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5dd4053340 con 0x7f5de40aa7e0 2023-09-30T22:58:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.148+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5de415a8e0 con 0x7f5de40aa7e0 2023-09-30T22:58:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.149+0000 7f5dcaffd700 1 -- 172.21.15.142:0/2928965689 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f5dd4056960 con 0x7f5de40aa7e0 2023-09-30T22:58:21.149 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:21.149 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:58:21.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5dd0067360 msgr2=0x7f5dd0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:21.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5dd0067360 0x7f5dd0069810 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8006f00 tx=0x7f5dd8008040 comp rx=0 tx=0).stop 2023-09-30T22:58:21.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de40aa7e0 msgr2=0x7f5de4155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:21.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de40aa7e0 0x7f5de4155da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5de406c8a0 tx=0x7f5dd4017000 comp rx=0 tx=0).stop 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 shutdown_connections 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5dd0067360 0x7f5dd0069810 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5de4159b50 0x7f5de415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de40aa7e0 0x7f5de4155da0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 --2- 172.21.15.142:0/2928965689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5de40ac3a0 0x7f5de40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 >> 172.21.15.142:0/2928965689 conn(0x7f5de406dab0 msgr2=0x7f5de40afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 shutdown_connections 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:21.151+0000 7f5de91ff700 1 -- 172.21.15.142:0/2928965689 wait complete. 2023-09-30T22:58:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:58:21.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:58:21.382 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6450,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":34.033537455000001,"mdsmap_epoch":50,"osdmap_epoch":118,"osdmap_epoch_barrier":115,"uptime":40.014183924000001} 2023-09-30T22:58:21.382 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6450, "mdsmap_epoch": 50, "osdmap_epoch": 118, "osdmap_epoch_barrier": 115, "rank_uptime": 34.033537455, "state": "up:active", "uptime": 40.014183924, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:58:21.382 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:58:21.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:21.383 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-30T22:58:21.873 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T22:58:21.874 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T22:58:21.874 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.443566 s, 118 MB/s 2023-09-30T22:58:21.875 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:58:21.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:58:21.974 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:58:22.080 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:58:22.080 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:58:22.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:22.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:58:22.193 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:58:22.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:22.193 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:58:22.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:58:22.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:22.241 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:22.325 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:58:22.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:22.325 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:58:22.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:22.381 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:58:22.381+0000 7fdac4df6700 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-09-30T22:58:22.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.562+0000 7f71d07ff700 1 Processor -- start 2023-09-30T22:58:22.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.563+0000 7f71d07ff700 1 -- start start 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71d07ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71c8157a90 0x7f71c815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71d07ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71d07ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71c80b1f40 0x7f71c8069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71d07ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c80b23e0 con 0x7f71c8157a90 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71d07ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c806d470 con 0x7f71c80b1f40 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71d07ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8157e60 con 0x7f71c806b3d0 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71c8157a90 0x7f71c815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71c8157a90 0x7f71c815bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41778/0 (socket says 172.21.15.142:41778) 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 -- 172.21.15.142:0/2477285417 learned_addr learned my addr 172.21.15.142:0/2477285417 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71cdd9a700 1 --2- 172.21.15.142:0/2477285417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ced9c700 1 --2- 172.21.15.142:0/2477285417 >> v2:172.21.15.148:3300/0 conn(0x7f71c80b1f40 0x7f71c8069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 -- 172.21.15.142:0/2477285417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 msgr2=0x7f71c80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 --2- 172.21.15.142:0/2477285417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 -- 172.21.15.142:0/2477285417 >> v2:172.21.15.148:3300/0 conn(0x7f71c80b1f40 msgr2=0x7f71c8069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 --2- 172.21.15.142:0/2477285417 >> v2:172.21.15.148:3300/0 conn(0x7f71c80b1f40 0x7f71c8069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.564+0000 7f71ce59b700 1 -- 172.21.15.142:0/2477285417 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c815c430 con 0x7f71c8157a90 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.565+0000 7f71ce59b700 1 --2- 172.21.15.142:0/2477285417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c815bef0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f71c80b2900 tx=0x7f71c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3b192390f3c494 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.565+0000 7f71cd599700 1 -- 172.21.15.142:0/2477285417 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400b860 con 0x7f71c8157a90 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.565+0000 7f71cd599700 1 -- 172.21.15.142:0/2477285417 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400b9c0 con 0x7f71c8157a90 2023-09-30T22:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.565+0000 7f71cd599700 1 -- 172.21.15.142:0/2477285417 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400bd60 con 0x7f71c8157a90 2023-09-30T22:58:22.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.565+0000 7f71d07ff700 1 -- 172.21.15.142:0/2477285417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 msgr2=0x7f71c815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.565+0000 7f71d07ff700 1 --2- 172.21.15.142:0/2477285417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c815bef0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f71c80b2900 tx=0x7f71c4009250 comp rx=0 tx=0).stop 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.566+0000 7f71d07ff700 1 -- 172.21.15.142:0/2477285417 shutdown_connections 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.566+0000 7f71d07ff700 1 --2- 172.21.15.142:0/2477285417 >> v2:172.21.15.148:3300/0 conn(0x7f71c80b1f40 0x7f71c8069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.566+0000 7f71d07ff700 1 --2- 172.21.15.142:0/2477285417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c815bef0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.566+0000 7f71d07ff700 1 --2- 172.21.15.142:0/2477285417 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.566+0000 7f71d07ff700 1 -- 172.21.15.142:0/2477285417 >> 172.21.15.142:0/2477285417 conn(0x7f71c80680c0 msgr2=0x7f71c80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.566+0000 7f71d07ff700 1 -- 172.21.15.142:0/2477285417 shutdown_connections 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.566+0000 7f71d07ff700 1 -- 172.21.15.142:0/2477285417 wait complete. 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.567+0000 7f71d07ff700 1 Processor -- start 2023-09-30T22:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.567+0000 7f71d07ff700 1 -- start start 2023-09-30T22:58:22.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.568+0000 7f71d07ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.568+0000 7f71d07ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80b1f40 0x7f71c814e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.568+0000 7f71d07ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c816b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.568+0000 7f71d07ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8155b00 con 0x7f71c8157a90 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.568+0000 7f71d07ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8155d50 con 0x7f71c80b1f40 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.568+0000 7f71d07ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8156030 con 0x7f71c806b3d0 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c816b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c816b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41792/0 (socket says 172.21.15.142:41792) 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 -- 172.21.15.142:0/842039064 learned_addr learned my addr 172.21.15.142:0/842039064 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ce59b700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71cdd9a700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80b1f40 0x7f71c814e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 -- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 msgr2=0x7f71c80c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 -- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80b1f40 msgr2=0x7f71c814e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80b1f40 0x7f71c814e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 -- 172.21.15.142:0/842039064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40094f0 con 0x7f71c8157a90 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.569+0000 7f71ced9c700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c816b3f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f71c0007f20 tx=0x7f71c0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.570+0000 7f71be7fc700 1 -- 172.21.15.142:0/842039064 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000eb90 con 0x7f71c8157a90 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.570+0000 7f71be7fc700 1 -- 172.21.15.142:0/842039064 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000ed10 con 0x7f71c8157a90 2023-09-30T22:58:22.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.570+0000 7f71be7fc700 1 -- 172.21.15.142:0/842039064 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0014670 con 0x7f71c8157a90 2023-09-30T22:58:22.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.570+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c8156310 con 0x7f71c8157a90 2023-09-30T22:58:22.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.570+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c80c7720 con 0x7f71c8157a90 2023-09-30T22:58:22.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.571+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c80695b0 con 0x7f71c8157a90 2023-09-30T22:58:22.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.572+0000 7f71be7fc700 1 -- 172.21.15.142:0/842039064 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f71c00149e0 con 0x7f71c8157a90 2023-09-30T22:58:22.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.573+0000 7f71be7fc700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f71ac067400 0x7f71ac0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:22.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.573+0000 7f71be7fc700 1 -- 172.21.15.142:0/842039064 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f71c0085270 con 0x7f71c8157a90 2023-09-30T22:58:22.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.573+0000 7f71ce59b700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f71ac067400 0x7f71ac0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:22.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.573+0000 7f71ce59b700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f71ac067400 0x7f71ac0698b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f71c80b2900 tx=0x7f71c4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:22.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.577+0000 7f71be7fc700 1 -- 172.21.15.142:0/842039064 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f71c0052080 con 0x7f71c8157a90 2023-09-30T22:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.808+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71c806fc10 con 0x7f71c8157a90 2023-09-30T22:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.809+0000 7f71be7fc700 1 -- 172.21.15.142:0/842039064 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f71c00556a0 con 0x7f71c8157a90 2023-09-30T22:58:22.809 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:22.809 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f71ac067400 msgr2=0x7f71ac0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f71ac067400 0x7f71ac0698b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f71c80b2900 tx=0x7f71c4017000 comp rx=0 tx=0).stop 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 msgr2=0x7f71c816b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c816b3f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f71c0007f20 tx=0x7f71c0009860 comp rx=0 tx=0).stop 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 shutdown_connections 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f71ac067400 0x7f71ac0698b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71c8157a90 0x7f71c816b3f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f71c806b3d0 0x7f71c80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 --2- 172.21.15.142:0/842039064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80b1f40 0x7f71c814e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:22.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.811+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 >> 172.21.15.142:0/842039064 conn(0x7f71c80680c0 msgr2=0x7f71c80cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:22.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.812+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 shutdown_connections 2023-09-30T22:58:22.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:22.812+0000 7f71d07ff700 1 -- 172.21.15.142:0/842039064 wait complete. 2023-09-30T22:58:22.813 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:58:22.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:23.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.058+0000 7f30f8dff700 1 Processor -- start 2023-09-30T22:58:23.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.058+0000 7f30f8dff700 1 -- start start 2023-09-30T22:58:23.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.059+0000 7f30f8dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30f4159ae0 0x7f30f40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.059+0000 7f30f8dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f415d910 con 0x7f30f40b1180 2023-09-30T22:58:23.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.059+0000 7f30f8dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f415e490 con 0x7f30f40cc590 2023-09-30T22:58:23.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.059+0000 7f30f8dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f415e920 con 0x7f30f4159ae0 2023-09-30T22:58:23.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f1d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f30f40b1180 0x7f30f40cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48154/0 (socket says 172.21.15.142:48154) 2023-09-30T22:58:23.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f1d9b700 1 -- 172.21.15.142:0/3245742418 learned_addr learned my addr 172.21.15.142:0/3245742418 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:23.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415461935 0 0) 0x7f30f415d910 con 0x7f30f40b1180 2023-09-30T22:58:23.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f259c700 1 --2- 172.21.15.142:0/3245742418 >> v2:172.21.15.148:3300/0 conn(0x7f30f4159ae0 0x7f30f40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30dc003570 con 0x7f30f40b1180 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4029985680 0 0) 0x7f30dc003570 con 0x7f30f40b1180 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 >> v2:172.21.15.148:3300/0 conn(0x7f30f4159ae0 msgr2=0x7f30f40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 --2- 172.21.15.142:0/3245742418 >> v2:172.21.15.148:3300/0 conn(0x7f30f4159ae0 0x7f30f40cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 >> v1:172.21.15.148:6789/0 conn(0x7f30f40cc590 legacy=0x7f30f4069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f415db60 con 0x7f30f40b1180 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.060+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f30e8001470 con 0x7f30f40b1180 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 >> v1:172.21.15.142:6789/0 conn(0x7f30f40b1180 legacy=0x7f30f40cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f159a700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc003a60 0x7f30dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f159a700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f159a700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30dc0051c0 0x7f30dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc00c130 con 0x7f30dc004810 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc00c2a0 con 0x7f30dc003a60 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc00c460 con 0x7f30dc0051c0 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f259c700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc003a60 0x7f30dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f2d9d700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30dc0051c0 0x7f30dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f1d9b700 1 -- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30dc0051c0 msgr2=0x7f30dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30dc0051c0 0x7f30dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f1d9b700 1 -- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc003a60 msgr2=0x7f30dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30dc003a60 0x7f30dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f1d9b700 1 -- 172.21.15.142:0/3245742418 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc003570 con 0x7f30dc004810 2023-09-30T22:58:23.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.061+0000 7f30f2d9d700 1 -- 172.21.15.142:0/3245742418 reap_dead start 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30dc004c80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c390 tx=0x7f30e8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7662c55cc3ca2c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800cc60 con 0x7f30dc004810 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800cdc0 con 0x7f30dc004810 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f159a700 1 -- 172.21.15.142:0/3245742418 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8005b70 con 0x7f30dc004810 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f8dff700 1 -- 172.21.15.142:0/3245742418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 msgr2=0x7f30dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f8dff700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30dc004c80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c390 tx=0x7f30e8001e50 comp rx=0 tx=0).stop 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f8dff700 1 -- 172.21.15.142:0/3245742418 shutdown_connections 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f8dff700 1 --2- 172.21.15.142:0/3245742418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30dc004c80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.062+0000 7f30f8dff700 1 -- 172.21.15.142:0/3245742418 >> 172.21.15.142:0/3245742418 conn(0x7f30f40ce8b0 msgr2=0x7f30f40cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.063+0000 7f30f8dff700 1 -- 172.21.15.142:0/3245742418 shutdown_connections 2023-09-30T22:58:23.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.063+0000 7f30f8dff700 1 -- 172.21.15.142:0/3245742418 wait complete. 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.064+0000 7f30f8dff700 1 Processor -- start 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.064+0000 7f30f8dff700 1 -- start start 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f8dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30f4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f8dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f415a230 0x7f30f415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f8dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f416a9b0 0x7f30f416ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f8dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4153a60 con 0x7f30dc004810 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f8dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40c9750 con 0x7f30f415a230 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f8dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40c8b40 con 0x7f30f416a9b0 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30f4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30f4153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41814/0 (socket says 172.21.15.142:41814) 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f259c700 1 -- 172.21.15.142:0/436621378 learned_addr learned my addr 172.21.15.142:0/436621378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f415a230 0x7f30f415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.065+0000 7f30f2d9d700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f416a9b0 0x7f30f416ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f259c700 1 -- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f416a9b0 msgr2=0x7f30f416ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f259c700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f416a9b0 0x7f30f416ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f259c700 1 -- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f415a230 msgr2=0x7f30f415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f259c700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f415a230 0x7f30f415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f259c700 1 -- 172.21.15.142:0/436621378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40c8e20 con 0x7f30dc004810 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f415a230 0x7f30f415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f2d9d700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f416a9b0 0x7f30f416ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:23.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f259c700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30f4153520 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f30e4011a10 tx=0x7f30e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30e27fc700 1 -- 172.21.15.142:0/436621378 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e400f940 con 0x7f30dc004810 2023-09-30T22:58:23.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30e27fc700 1 -- 172.21.15.142:0/436621378 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e400faa0 con 0x7f30dc004810 2023-09-30T22:58:23.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30e27fc700 1 -- 172.21.15.142:0/436621378 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e400fe20 con 0x7f30dc004810 2023-09-30T22:58:23.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f40c9100 con 0x7f30dc004810 2023-09-30T22:58:23.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.066+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f415b7b0 con 0x7f30dc004810 2023-09-30T22:58:23.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.068+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f40c9a30 con 0x7f30dc004810 2023-09-30T22:58:23.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.068+0000 7f30e27fc700 1 -- 172.21.15.142:0/436621378 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f30e4014650 con 0x7f30dc004810 2023-09-30T22:58:23.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.070+0000 7f30e27fc700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f30d4067330 0x7f30d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.070+0000 7f30e27fc700 1 -- 172.21.15.142:0/436621378 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f30e4018030 con 0x7f30dc004810 2023-09-30T22:58:23.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.070+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f30d4067330 0x7f30d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.071+0000 7f30f1d9b700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f30d4067330 0x7f30d40697e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f30e8001e90 tx=0x7f30e8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.074+0000 7f30e27fc700 1 -- 172.21.15.142:0/436621378 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f30e4052510 con 0x7f30dc004810 2023-09-30T22:58:23.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.267+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30f4155db0 con 0x7f30dc004810 2023-09-30T22:58:23.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.268+0000 7f30e27fc700 1 -- 172.21.15.142:0/436621378 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+17364 (secure 0 0 0) 0x7f30e4055b30 con 0x7f30dc004810 2023-09-30T22:58:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:23.268 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":118,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:19.362138+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:57:44.465774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-09-30T22:57:45.784661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.14","mappings":[{"from":6,"to":4}]},{"pgid":"14.20","mappings":[{"from":7,"to":3}]},{"pgid":"14.26","mappings":[{"from":1,"to":0}]},{"pgid":"14.27","mappings":[{"from":1,"to":3}]},{"pgid":"14.2a","mappings":[{"from":1,"to":0}]},{"pgid":"14.35","mappings":[{"from":7,"to":0}]},{"pgid":"14.3d","mappings":[{"from":7,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:23.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f30d4067330 msgr2=0x7f30d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f30d4067330 0x7f30d40697e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f30e8001e90 tx=0x7f30e8015000 comp rx=0 tx=0).stop 2023-09-30T22:58:23.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 msgr2=0x7f30f4153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30f4153520 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f30e4011a10 tx=0x7f30e40091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 shutdown_connections 2023-09-30T22:58:23.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f30d4067330 0x7f30d40697e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30f416a9b0 0x7f30f416ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30dc004810 0x7f30f4153520 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 --2- 172.21.15.142:0/436621378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30f415a230 0x7f30f415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 >> 172.21.15.142:0/436621378 conn(0x7f30f40ce8b0 msgr2=0x7f30f40cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:23.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 shutdown_connections 2023-09-30T22:58:23.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.270+0000 7f30f8dff700 1 -- 172.21.15.142:0/436621378 wait complete. 2023-09-30T22:58:23.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:57:44.465774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:57:45.784661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:58:23.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:58:23.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.481+0000 7f871d3ff700 1 Processor -- start 2023-09-30T22:58:23.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.481+0000 7f871d3ff700 1 -- start start 2023-09-30T22:58:23.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.483+0000 7f871d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 0x7f87180c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.483+0000 7f871d3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180c7690 con 0x7f87180c52a0 2023-09-30T22:58:23.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.483+0000 7f871d3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180c7f20 con 0x7f87180cb350 2023-09-30T22:58:23.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.483+0000 7f871d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87181406a0 con 0x7f8718069f10 2023-09-30T22:58:23.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.483+0000 7f8716ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f87180c52a0 0x7f87180c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48162/0 (socket says 172.21.15.142:48162) 2023-09-30T22:58:23.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.483+0000 7f8716ffd700 1 -- 172.21.15.142:0/2892629850 learned_addr learned my addr 172.21.15.142:0/2892629850 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:23.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.483+0000 7f87167fc700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 0x7f87180c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693513675 0 0) 0x7f8708001110 con 0x7f87180c52a0 2023-09-30T22:58:23.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8700003570 con 0x7f87180c52a0 2023-09-30T22:58:23.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450942983 0 0) 0x7f87180c7f20 con 0x7f87180cb350 2023-09-30T22:58:23.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8708001110 con 0x7f87180cb350 2023-09-30T22:58:23.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4273150569 0 0) 0x7f8700003570 con 0x7f87180c52a0 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 msgr2=0x7f87180c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 0x7f87180c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 >> v1:172.21.15.148:6789/0 conn(0x7f87180cb350 legacy=0x7f87181605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871806a3f0 con 0x7f87180c52a0 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f8708001580 con 0x7f87180c52a0 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 >> v1:172.21.15.142:6789/0 conn(0x7f87180c52a0 legacy=0x7f87180c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 0x7f8700003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87000041d0 0x7f8700004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8700004d50 0x7f87000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87181406a0 con 0x7f8700004d50 2023-09-30T22:58:23.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870000bbf0 con 0x7f87000041d0 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870000bdb0 con 0x7f8718069f10 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f8716ffd700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 0x7f8700003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f87177fe700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8700004d50 0x7f87000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.484+0000 7f87167fc700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87000041d0 0x7f8700004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f87177fe700 1 -- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 msgr2=0x7f8700003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f87177fe700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8718069f10 0x7f8700003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f87177fe700 1 -- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87000041d0 msgr2=0x7f8700004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f87177fe700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87000041d0 0x7f8700004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f87177fe700 1 -- 172.21.15.142:0/2892629850 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700003570 con 0x7f8700004d50 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f87167fc700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87000041d0 0x7f8700004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f87177fe700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8700004d50 0x7f87000051c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87100021a0 tx=0x7f8710001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ce55347141e559 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000eb90 con 0x7f8700004d50 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000ecf0 con 0x7f8700004d50 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.485+0000 7f8715ffb700 1 -- 172.21.15.142:0/2892629850 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100116a0 con 0x7f8700004d50 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.486+0000 7f871d3ff700 1 -- 172.21.15.142:0/2892629850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8700004d50 msgr2=0x7f87000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.486+0000 7f871d3ff700 1 --2- 172.21.15.142:0/2892629850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8700004d50 0x7f87000051c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87100021a0 tx=0x7f8710001820 comp rx=0 tx=0).stop 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.486+0000 7f87177fe700 1 -- 172.21.15.142:0/2892629850 reap_dead start 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.486+0000 7f871d3ff700 1 -- 172.21.15.142:0/2892629850 shutdown_connections 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.486+0000 7f871d3ff700 1 -- 172.21.15.142:0/2892629850 >> 172.21.15.142:0/2892629850 conn(0x7f87180cc670 msgr2=0x7f87180cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.486+0000 7f871d3ff700 1 -- 172.21.15.142:0/2892629850 shutdown_connections 2023-09-30T22:58:23.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.486+0000 7f871d3ff700 1 -- 172.21.15.142:0/2892629850 wait complete. 2023-09-30T22:58:23.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.487+0000 7f871d3ff700 1 Processor -- start 2023-09-30T22:58:23.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.488+0000 7f871d3ff700 1 -- start start 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.488+0000 7f871d3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700004d50 0x7f87181560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.488+0000 7f871d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87180ba720 0x7f87180bab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.488+0000 7f871d3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180bcbd0 0x7f87180bd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.488+0000 7f871d3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180bb0d0 con 0x7f87180bcbd0 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.488+0000 7f871d3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871813e300 con 0x7f8700004d50 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.488+0000 7f871d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871813e5e0 con 0x7f87180ba720 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180bcbd0 0x7f87180bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180bcbd0 0x7f87180bd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41828/0 (socket says 172.21.15.142:41828) 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 -- 172.21.15.142:0/3196662762 learned_addr learned my addr 172.21.15.142:0/3196662762 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87167fc700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87180ba720 0x7f87180bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f8716ffd700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700004d50 0x7f87181560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 -- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87180ba720 msgr2=0x7f87180bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87180ba720 0x7f87180bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 -- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700004d50 msgr2=0x7f87181560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700004d50 0x7f87181560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 -- 172.21.15.142:0/3196662762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871813e8c0 con 0x7f87180bcbd0 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87167fc700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87180ba720 0x7f87180bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.489+0000 7f87177fe700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180bcbd0 0x7f87180bd070 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8710003000 tx=0x7f871001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.490+0000 7f86feffd700 1 -- 172.21.15.142:0/3196662762 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871001f070 con 0x7f87180bcbd0 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.490+0000 7f86feffd700 1 -- 172.21.15.142:0/3196662762 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000ee60 con 0x7f87180bcbd0 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.490+0000 7f86feffd700 1 -- 172.21.15.142:0/3196662762 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000eb90 con 0x7f87180bcbd0 2023-09-30T22:58:23.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.490+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871813eba0 con 0x7f87180bcbd0 2023-09-30T22:58:23.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.490+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871813df90 con 0x7f87180bcbd0 2023-09-30T22:58:23.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.491+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8718069a50 con 0x7f87180bcbd0 2023-09-30T22:58:23.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.492+0000 7f86feffd700 1 -- 172.21.15.142:0/3196662762 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8710017030 con 0x7f87180bcbd0 2023-09-30T22:58:23.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.493+0000 7f86feffd700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8704067330 0x7f87040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.493+0000 7f86feffd700 1 -- 172.21.15.142:0/3196662762 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f8710015070 con 0x7f87180bcbd0 2023-09-30T22:58:23.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.493+0000 7f8716ffd700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8704067330 0x7f87040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.493+0000 7f8716ffd700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8704067330 0x7f87040697e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8708000c00 tx=0x7f8708001e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.497+0000 7f86feffd700 1 -- 172.21.15.142:0/3196662762 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8710052cf0 con 0x7f87180bcbd0 2023-09-30T22:58:23.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.683+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f871806fc10 con 0x7f87180bcbd0 2023-09-30T22:58:23.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.683+0000 7f86feffd700 1 -- 172.21.15.142:0/3196662762 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8710056310 con 0x7f87180bcbd0 2023-09-30T22:58:23.683 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:58:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8704067330 msgr2=0x7f87040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8704067330 0x7f87040697e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8708000c00 tx=0x7f8708001e50 comp rx=0 tx=0).stop 2023-09-30T22:58:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180bcbd0 msgr2=0x7f87180bd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180bcbd0 0x7f87180bd070 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8710003000 tx=0x7f871001a000 comp rx=0 tx=0).stop 2023-09-30T22:58:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 shutdown_connections 2023-09-30T22:58:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8704067330 0x7f87040697e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180bcbd0 0x7f87180bd070 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8700004d50 0x7f87181560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 --2- 172.21.15.142:0/3196662762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f87180ba720 0x7f87180bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 >> 172.21.15.142:0/3196662762 conn(0x7f87180cc670 msgr2=0x7f87180ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:23.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 shutdown_connections 2023-09-30T22:58:23.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.686+0000 7f871d3ff700 1 -- 172.21.15.142:0/3196662762 wait complete. 2023-09-30T22:58:23.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:58:23.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.896+0000 7fa8f3dff700 1 Processor -- start 2023-09-30T22:58:23.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.896+0000 7fa8f3dff700 1 -- start start 2023-09-30T22:58:23.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.897+0000 7fa8f3dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 0x7fa8ec1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.897+0000 7fa8f3dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0c7690 con 0x7fa8ec0c52a0 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.897+0000 7fa8f3dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0c7f20 con 0x7fa8ec069f10 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.897+0000 7fa8f3dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec1406a0 con 0x7fa8ec0cb350 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f1b9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa8ec0c52a0 0x7fa8ec0c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48172/0 (socket says 172.21.15.142:48172) 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f1b9b700 1 -- 172.21.15.142:0/138264970 learned_addr learned my addr 172.21.15.142:0/138264970 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f239c700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 0x7fa8ec1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805389844 0 0) 0x7fa8e8001110 con 0x7fa8ec0c52a0 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d8003570 con 0x7fa8ec0c52a0 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277170508 0 0) 0x7fa8d8003570 con 0x7fa8ec0c52a0 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 msgr2=0x7fa8ec1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 0x7fa8ec1615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 >> v1:172.21.15.148:6789/0 conn(0x7fa8ec069f10 legacy=0x7fa8ec0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec06a3f0 con 0x7fa8ec0c52a0 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.898+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fa8e8001600 con 0x7fa8ec0c52a0 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 >> v1:172.21.15.142:6789/0 conn(0x7fa8ec0c52a0 legacy=0x7fa8ec0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f0b99700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 0x7fa8d8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f0b99700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d8003fd0 0x7fa8d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f0b99700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec1406a0 con 0x7fa8d8004d50 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d800bba0 con 0x7fa8d8003fd0 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d800df70 con 0x7fa8ec0cb350 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f239c700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f1b9b700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 0x7fa8d8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f139a700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d8003fd0 0x7fa8d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f239c700 1 -- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 msgr2=0x7fa8d8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f239c700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 0x7fa8d8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f239c700 1 -- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d8003fd0 msgr2=0x7fa8d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f239c700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d8003fd0 0x7fa8d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f239c700 1 -- 172.21.15.142:0/138264970 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8003570 con 0x7fa8d8004d50 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f1b9b700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8ec0cb350 0x7fa8d8003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f139a700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d8003fd0 0x7fa8d8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.899+0000 7fa8f239c700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e210 tx=0x7fa8e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54a370b41a24782 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400eac0 con 0x7fa8d8004d50 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e400f040 con 0x7fa8d8004d50 2023-09-30T22:58:23.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f0b99700 1 -- 172.21.15.142:0/138264970 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400ee70 con 0x7fa8d8004d50 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f3dff700 1 -- 172.21.15.142:0/138264970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8004d50 msgr2=0x7fa8d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f3dff700 1 --2- 172.21.15.142:0/138264970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8004d50 0x7fa8d80051c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e210 tx=0x7fa8e400b040 comp rx=0 tx=0).stop 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f239c700 1 -- 172.21.15.142:0/138264970 reap_dead start 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f3dff700 1 -- 172.21.15.142:0/138264970 shutdown_connections 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f3dff700 1 -- 172.21.15.142:0/138264970 >> 172.21.15.142:0/138264970 conn(0x7fa8ec0cc670 msgr2=0x7fa8ec0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f3dff700 1 -- 172.21.15.142:0/138264970 shutdown_connections 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.900+0000 7fa8f3dff700 1 -- 172.21.15.142:0/138264970 wait complete. 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.902+0000 7fa8f3dff700 1 Processor -- start 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.902+0000 7fa8f3dff700 1 -- start start 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f3dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8d8004d50 0x7fa8ec1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f3dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8ec0b9d10 0x7fa8ec0ba180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f3dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ec06ac90 0x7fa8ec06b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f3dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0ba6c0 con 0x7fa8ec06ac90 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f3dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec16e890 con 0x7fa8ec0b9d10 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f3dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec06b640 con 0x7fa8d8004d50 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f239c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ec06ac90 0x7fa8ec06b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f239c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ec06ac90 0x7fa8ec06b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41844/0 (socket says 172.21.15.142:41844) 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f239c700 1 -- 172.21.15.142:0/2516426431 learned_addr learned my addr 172.21.15.142:0/2516426431 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f139a700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8ec0b9d10 0x7fa8ec0ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.903+0000 7fa8f1b9b700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8d8004d50 0x7fa8ec1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f239c700 1 -- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8d8004d50 msgr2=0x7fa8ec1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f239c700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8d8004d50 0x7fa8ec1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f239c700 1 -- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8ec0b9d10 msgr2=0x7fa8ec0ba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f239c700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8ec0b9d10 0x7fa8ec0ba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f239c700 1 -- 172.21.15.142:0/2516426431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec16dc80 con 0x7fa8ec06ac90 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f239c700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ec06ac90 0x7fa8ec06b100 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e800 tx=0x7fa8e401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8e1ffb700 1 -- 172.21.15.142:0/2516426431 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400eec0 con 0x7fa8ec06ac90 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8e1ffb700 1 -- 172.21.15.142:0/2516426431 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e401e430 con 0x7fa8ec06ac90 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8e1ffb700 1 -- 172.21.15.142:0/2516426431 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e401e5e0 con 0x7fa8ec06ac90 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec16df60 con 0x7fa8ec06ac90 2023-09-30T22:58:23.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.904+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec16e520 con 0x7fa8ec06ac90 2023-09-30T22:58:23.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.905+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec0b8330 con 0x7fa8ec06ac90 2023-09-30T22:58:23.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.906+0000 7fa8e1ffb700 1 -- 172.21.15.142:0/2516426431 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa8e4024020 con 0x7fa8ec06ac90 2023-09-30T22:58:23.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.907+0000 7fa8e1ffb700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa8d0067330 0x7fa8d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:23.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.907+0000 7fa8e1ffb700 1 -- 172.21.15.142:0/2516426431 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fa8e4086b90 con 0x7fa8ec06ac90 2023-09-30T22:58:23.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.907+0000 7fa8f1b9b700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa8d0067330 0x7fa8d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:23.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.908+0000 7fa8f1b9b700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa8d0067330 0x7fa8d00697e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8000e10 tx=0x7fa8e8007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:23.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:23.911+0000 7fa8e1ffb700 1 -- 172.21.15.142:0/2516426431 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa8ec0b8330 con 0x7fa8ec06ac90 2023-09-30T22:58:24.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.101+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa8ec0b8330 con 0x7fa8ec06ac90 2023-09-30T22:58:24.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.102+0000 7fa8e1ffb700 1 -- 172.21.15.142:0/2516426431 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8e402c020 con 0x7fa8ec06ac90 2023-09-30T22:58:24.102 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:58:24.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa8d0067330 msgr2=0x7fa8d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa8d0067330 0x7fa8d00697e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8000e10 tx=0x7fa8e8007040 comp rx=0 tx=0).stop 2023-09-30T22:58:24.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ec06ac90 msgr2=0x7fa8ec06b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ec06ac90 0x7fa8ec06b100 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e800 tx=0x7fa8e401a000 comp rx=0 tx=0).stop 2023-09-30T22:58:24.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 shutdown_connections 2023-09-30T22:58:24.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa8d0067330 0x7fa8d00697e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ec06ac90 0x7fa8ec06b100 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8d8004d50 0x7fa8ec1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 --2- 172.21.15.142:0/2516426431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8ec0b9d10 0x7fa8ec0ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 >> 172.21.15.142:0/2516426431 conn(0x7fa8ec0cc670 msgr2=0x7fa8ec06d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:24.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 shutdown_connections 2023-09-30T22:58:24.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.104+0000 7fa8f3dff700 1 -- 172.21.15.142:0/2516426431 wait complete. 2023-09-30T22:58:24.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:58:24.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.315+0000 7f97011ff700 1 Processor -- start 2023-09-30T22:58:24.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.315+0000 7f97011ff700 1 -- start start 2023-09-30T22:58:24.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f97011ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f97011ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc067d10 con 0x7f96fc159ba0 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f97011ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc06af90 con 0x7f96fc0b0de0 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f97011ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0676c0 con 0x7f96fc0ca5e0 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f96fad9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f96fc159ba0 0x7f96fc0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48180/0 (socket says 172.21.15.142:48180) 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f96fad9d700 1 -- 172.21.15.142:0/1248029266 learned_addr learned my addr 172.21.15.142:0/1248029266 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f96fa59c700 1 --2- 172.21.15.142:0/1248029266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f96f9d9b700 1 -- 172.21.15.142:0/1248029266 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550842077 0 0) 0x7f96fc067d10 con 0x7f96fc159ba0 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f96f9d9b700 1 -- 172.21.15.142:0/1248029266 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e4003570 con 0x7f96fc159ba0 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f96f9d9b700 1 -- 172.21.15.142:0/1248029266 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082320484 0 0) 0x7f96fc06af90 con 0x7f96fc0b0de0 2023-09-30T22:58:24.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.317+0000 7f96f9d9b700 1 -- 172.21.15.142:0/1248029266 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96fc067d10 con 0x7f96fc0b0de0 2023-09-30T22:58:24.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.318+0000 7f96fa59c700 1 -- 172.21.15.142:0/1248029266 >> v1:172.21.15.148:6789/0 conn(0x7f96fc0b0de0 legacy=0x7f96fc0681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.318+0000 7f96fa59c700 1 -- 172.21.15.142:0/1248029266 >> v1:172.21.15.142:6789/0 conn(0x7f96fc159ba0 legacy=0x7f96fc0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.318+0000 7f96fa59c700 1 -- 172.21.15.142:0/1248029266 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0679a0 con 0x7f96fc0ca5e0 2023-09-30T22:58:24.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.318+0000 7f96fa59c700 1 --2- 172.21.15.142:0/1248029266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc06a8d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009910 tx=0x7f96f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e939d3c8021a512e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.318+0000 7f96f9d9b700 1 -- 172.21.15.142:0/1248029266 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0011630 con 0x7f96fc0ca5e0 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.318+0000 7f96f9d9b700 1 -- 172.21.15.142:0/1248029266 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f0011790 con 0x7f96fc0ca5e0 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.318+0000 7f96f9d9b700 1 -- 172.21.15.142:0/1248029266 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0011b30 con 0x7f96fc0ca5e0 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.319+0000 7f97011ff700 1 -- 172.21.15.142:0/1248029266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 msgr2=0x7f96fc06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.319+0000 7f97011ff700 1 --2- 172.21.15.142:0/1248029266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc06a8d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009910 tx=0x7f96f00091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.319+0000 7f97011ff700 1 -- 172.21.15.142:0/1248029266 shutdown_connections 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.319+0000 7f97011ff700 1 --2- 172.21.15.142:0/1248029266 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc06a8d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.319+0000 7f97011ff700 1 -- 172.21.15.142:0/1248029266 >> 172.21.15.142:0/1248029266 conn(0x7f96fc0cb2f0 msgr2=0x7f96fc0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.319+0000 7f97011ff700 1 -- 172.21.15.142:0/1248029266 shutdown_connections 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.319+0000 7f97011ff700 1 -- 172.21.15.142:0/1248029266 wait complete. 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.320+0000 7f97011ff700 1 Processor -- start 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.320+0000 7f97011ff700 1 -- start start 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.321+0000 7f97011ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96fc0b0de0 0x7f96fc0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.321+0000 7f97011ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.321+0000 7f97011ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96fc159ba0 0x7f96fc0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.321+0000 7f97011ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0c4400 con 0x7f96fc159ba0 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.321+0000 7f97011ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0c9400 con 0x7f96fc0b0de0 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.321+0000 7f97011ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0c37f0 con 0x7f96fc0ca5e0 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96fc159ba0 0x7f96fc0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96fc159ba0 0x7f96fc0c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41856/0 (socket says 172.21.15.142:41856) 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 -- 172.21.15.142:0/763481071 learned_addr learned my addr 172.21.15.142:0/763481071 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fa59c700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fad9d700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96fc0b0de0 0x7f96fc0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 -- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 msgr2=0x7f96fc0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 -- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96fc0b0de0 msgr2=0x7f96fc0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96fc0b0de0 0x7f96fc0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 -- 172.21.15.142:0/763481071 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f0009420 con 0x7f96fc159ba0 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fad9d700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96fc0b0de0 0x7f96fc0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fa59c700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:24.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96fb59e700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96fc159ba0 0x7f96fc0c6500 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f96f400c910 tx=0x7f96f40027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:24.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96e2ffd700 1 -- 172.21.15.142:0/763481071 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f400a7e0 con 0x7f96fc159ba0 2023-09-30T22:58:24.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f96e2ffd700 1 -- 172.21.15.142:0/763481071 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f400a960 con 0x7f96fc159ba0 2023-09-30T22:58:24.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.322+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96fc0c3ad0 con 0x7f96fc159ba0 2023-09-30T22:58:24.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.323+0000 7f96e2ffd700 1 -- 172.21.15.142:0/763481071 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f400ad20 con 0x7f96fc159ba0 2023-09-30T22:58:24.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.323+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc0c4090 con 0x7f96fc159ba0 2023-09-30T22:58:24.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.324+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96fc0c4570 con 0x7f96fc159ba0 2023-09-30T22:58:24.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.324+0000 7f96e2ffd700 1 -- 172.21.15.142:0/763481071 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f96f4012630 con 0x7f96fc159ba0 2023-09-30T22:58:24.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.325+0000 7f96e2ffd700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96e8067330 0x7f96e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.325+0000 7f96e2ffd700 1 -- 172.21.15.142:0/763481071 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f96f4085230 con 0x7f96fc159ba0 2023-09-30T22:58:24.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.326+0000 7f96fad9d700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96e8067330 0x7f96e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.326+0000 7f96fad9d700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96e8067330 0x7f96e80697e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0058d0 tx=0x7f96ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:24.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.330+0000 7f96e2ffd700 1 -- 172.21.15.142:0/763481071 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f96f4052070 con 0x7f96fc159ba0 2023-09-30T22:58:24.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.523+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96fc0cac40 con 0x7f96fc159ba0 2023-09-30T22:58:24.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.523+0000 7f96e2ffd700 1 -- 172.21.15.142:0/763481071 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96f4055690 con 0x7f96fc159ba0 2023-09-30T22:58:24.523 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:58:24.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96e8067330 msgr2=0x7f96e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96e8067330 0x7f96e80697e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0058d0 tx=0x7f96ec009040 comp rx=0 tx=0).stop 2023-09-30T22:58:24.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96fc159ba0 msgr2=0x7f96fc0c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96fc159ba0 0x7f96fc0c6500 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f96f400c910 tx=0x7f96f40027a0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 shutdown_connections 2023-09-30T22:58:24.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f96e8067330 0x7f96e80697e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96fc159ba0 0x7f96fc0c6500 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96fc0b0de0 0x7f96fc0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 --2- 172.21.15.142:0/763481071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96fc0ca5e0 0x7f96fc0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 >> 172.21.15.142:0/763481071 conn(0x7f96fc0cb2f0 msgr2=0x7f96fc0b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:24.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 shutdown_connections 2023-09-30T22:58:24.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.526+0000 7f97011ff700 1 -- 172.21.15.142:0/763481071 wait complete. 2023-09-30T22:58:24.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:58:24.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.735+0000 7f2d081ff700 1 Processor -- start 2023-09-30T22:58:24.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.735+0000 7f2d081ff700 1 -- start start 2023-09-30T22:58:24.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cbfe0 0x7f2d0015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d081ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d00157ab0 0x7f2d000cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d081ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d000d0550 con 0x7f2d000cc3b0 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d081ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d000cf750 con 0x7f2d00157ab0 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d081ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000cf940 con 0x7f2d000cbfe0 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d0579a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2d000cc3b0 0x7f2d001573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48186/0 (socket says 172.21.15.142:48186) 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d0579a700 1 -- 172.21.15.142:0/392680637 learned_addr learned my addr 172.21.15.142:0/392680637 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d0679c700 1 --2- 172.21.15.142:0/392680637 >> v2:172.21.15.148:3300/0 conn(0x7f2d00157ab0 0x7f2d000cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d05f9b700 1 --2- 172.21.15.142:0/392680637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cbfe0 0x7f2d0015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d04f99700 1 -- 172.21.15.142:0/392680637 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715929228 0 0) 0x7f2d000d0550 con 0x7f2d000cc3b0 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.737+0000 7f2d04f99700 1 -- 172.21.15.142:0/392680637 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cec003570 con 0x7f2d000cc3b0 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d05f9b700 1 -- 172.21.15.142:0/392680637 >> v2:172.21.15.148:3300/0 conn(0x7f2d00157ab0 msgr2=0x7f2d000cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d05f9b700 1 --2- 172.21.15.142:0/392680637 >> v2:172.21.15.148:3300/0 conn(0x7f2d00157ab0 0x7f2d000cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d05f9b700 1 -- 172.21.15.142:0/392680637 >> v1:172.21.15.142:6789/0 conn(0x7f2d000cc3b0 legacy=0x7f2d001573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d05f9b700 1 -- 172.21.15.142:0/392680637 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d000cfc20 con 0x7f2d000cbfe0 2023-09-30T22:58:24.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d05f9b700 1 --2- 172.21.15.142:0/392680637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cbfe0 0x7f2d0015a2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009910 tx=0x7f2cfc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f0c776efae5223 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d04f99700 1 -- 172.21.15.142:0/392680637 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc011630 con 0x7f2d000cbfe0 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d04f99700 1 -- 172.21.15.142:0/392680637 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc011790 con 0x7f2d000cbfe0 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.738+0000 7f2d04f99700 1 -- 172.21.15.142:0/392680637 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc011b30 con 0x7f2d000cbfe0 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 -- 172.21.15.142:0/392680637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cbfe0 msgr2=0x7f2d0015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 --2- 172.21.15.142:0/392680637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cbfe0 0x7f2d0015a2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009910 tx=0x7f2cfc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 -- 172.21.15.142:0/392680637 shutdown_connections 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 --2- 172.21.15.142:0/392680637 >> v2:172.21.15.148:3300/0 conn(0x7f2d00157ab0 0x7f2d000cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 --2- 172.21.15.142:0/392680637 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cbfe0 0x7f2d0015a2a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 -- 172.21.15.142:0/392680637 >> 172.21.15.142:0/392680637 conn(0x7f2d000d0a80 msgr2=0x7f2d000d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:24.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 -- 172.21.15.142:0/392680637 shutdown_connections 2023-09-30T22:58:24.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.739+0000 7f2d081ff700 1 -- 172.21.15.142:0/392680637 wait complete. 2023-09-30T22:58:24.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.740+0000 7f2d081ff700 1 Processor -- start 2023-09-30T22:58:24.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.741+0000 7f2d081ff700 1 -- start start 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.741+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d000cbfe0 0x7f2d000c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.741+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cc3b0 0x7f2d00157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.741+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00157ab0 0x7f2d00158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.741+0000 7f2d081ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000cb550 con 0x7f2d00157ab0 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d081ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000cafd0 con 0x7f2d000cbfe0 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d081ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000cb270 con 0x7f2d000cc3b0 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00157ab0 0x7f2d00158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00157ab0 0x7f2d00158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41858/0 (socket says 172.21.15.142:41858) 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 -- 172.21.15.142:0/4093224215 learned_addr learned my addr 172.21.15.142:0/4093224215 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d05f9b700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d000cbfe0 0x7f2d000c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0579a700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cc3b0 0x7f2d00157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 -- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cc3b0 msgr2=0x7f2d00157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cc3b0 0x7f2d00157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 -- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d000cbfe0 msgr2=0x7f2d000c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d000cbfe0 0x7f2d000c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 -- 172.21.15.142:0/4093224215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc009420 con 0x7f2d00157ab0 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.742+0000 7f2d0679c700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00157ab0 0x7f2d00158430 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009df0 tx=0x7f2cf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.743+0000 7f2cf5ffb700 1 -- 172.21.15.142:0/4093224215 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800cb50 con 0x7f2d00157ab0 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.743+0000 7f2cf5ffb700 1 -- 172.21.15.142:0/4093224215 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800f040 con 0x7f2d00157ab0 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.743+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d000c6b00 con 0x7f2d00157ab0 2023-09-30T22:58:24.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.743+0000 7f2cf5ffb700 1 -- 172.21.15.142:0/4093224215 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8014480 con 0x7f2d00157ab0 2023-09-30T22:58:24.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.743+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d00153830 con 0x7f2d00157ab0 2023-09-30T22:58:24.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.744+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d000c6960 con 0x7f2d00157ab0 2023-09-30T22:58:24.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.744+0000 7f2cf5ffb700 1 -- 172.21.15.142:0/4093224215 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2cf8014830 con 0x7f2d00157ab0 2023-09-30T22:58:24.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.745+0000 7f2cf5ffb700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2ce4067330 0x7f2ce40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:24.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.745+0000 7f2cf5ffb700 1 -- 172.21.15.142:0/4093224215 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f2cf8085950 con 0x7f2d00157ab0 2023-09-30T22:58:24.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.746+0000 7f2d05f9b700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2ce4067330 0x7f2ce40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:24.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.746+0000 7f2d05f9b700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2ce4067330 0x7f2ce40697e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0098e0 tx=0x7f2cfc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:24.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.750+0000 7f2cf5ffb700 1 -- 172.21.15.142:0/4093224215 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2d000c6960 con 0x7f2d00157ab0 2023-09-30T22:58:24.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.938+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d000c6960 con 0x7f2d00157ab0 2023-09-30T22:58:24.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.939+0000 7f2cf5ffb700 1 -- 172.21.15.142:0/4093224215 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d000c6960 con 0x7f2d00157ab0 2023-09-30T22:58:24.939 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:58:24.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2ce4067330 msgr2=0x7f2ce40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2ce4067330 0x7f2ce40697e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0098e0 tx=0x7f2cfc017000 comp rx=0 tx=0).stop 2023-09-30T22:58:24.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00157ab0 msgr2=0x7f2d00158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:24.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00157ab0 0x7f2d00158430 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009df0 tx=0x7f2cf800b040 comp rx=0 tx=0).stop 2023-09-30T22:58:24.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 shutdown_connections 2023-09-30T22:58:24.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2ce4067330 0x7f2ce40697e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00157ab0 0x7f2d00158430 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d000cbfe0 0x7f2d000c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 --2- 172.21.15.142:0/4093224215 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d000cc3b0 0x7f2d00157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:24.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 >> 172.21.15.142:0/4093224215 conn(0x7f2d000d0a80 msgr2=0x7f2d001555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:24.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 shutdown_connections 2023-09-30T22:58:24.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:24.941+0000 7f2d081ff700 1 -- 172.21.15.142:0/4093224215 wait complete. 2023-09-30T22:58:24.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:25.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.147+0000 7ff3441ff700 1 Processor -- start 2023-09-30T22:58:25.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.147+0000 7ff3441ff700 1 -- start start 2023-09-30T22:58:25.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.148+0000 7ff3441ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff33c159b50 0x7ff33c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.148+0000 7ff3441ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff33c0ac3a0 0x7ff33c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.148+0000 7ff3441ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c068000 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.148+0000 7ff3441ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c069f10 con 0x7ff33c0ac3a0 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.148+0000 7ff3441ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0aac60 con 0x7ff33c159b50 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff33c0ac3a0 0x7ff33c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff33c0ac3a0 0x7ff33c0aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41866/0 (socket says 172.21.15.142:41866) 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 -- 172.21.15.142:0/947946348 learned_addr learned my addr 172.21.15.142:0/947946348 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34279c700 1 --1- 172.21.15.142:0/947946348 >> v1:172.21.15.142:6789/0 conn(0x7ff33c0aa7e0 0x7ff33c06a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48188/0 (socket says 172.21.15.142:48188) 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff341f9b700 1 --2- 172.21.15.142:0/947946348 >> v2:172.21.15.148:3300/0 conn(0x7ff33c159b50 0x7ff33c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 -- 172.21.15.142:0/947946348 >> v2:172.21.15.148:3300/0 conn(0x7ff33c159b50 msgr2=0x7ff33c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 --2- 172.21.15.142:0/947946348 >> v2:172.21.15.148:3300/0 conn(0x7ff33c159b50 0x7ff33c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 -- 172.21.15.142:0/947946348 >> v1:172.21.15.142:6789/0 conn(0x7ff33c0aa7e0 legacy=0x7ff33c06a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 -- 172.21.15.142:0/947946348 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0a9e00 con 0x7ff33c0ac3a0 2023-09-30T22:58:25.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff341f9b700 1 --2- 172.21.15.142:0/947946348 >> v2:172.21.15.148:3300/0 conn(0x7ff33c159b50 0x7ff33c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:25.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.149+0000 7ff34179a700 1 --2- 172.21.15.142:0/947946348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0ac3a0 0x7ff33c0aa2a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06ee90 tx=0x7ff32c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a77d217575cf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:25.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff340f99700 1 -- 172.21.15.142:0/947946348 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00b860 con 0x7ff33c0ac3a0 2023-09-30T22:58:25.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff340f99700 1 -- 172.21.15.142:0/947946348 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00b9c0 con 0x7ff33c0ac3a0 2023-09-30T22:58:25.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff340f99700 1 -- 172.21.15.142:0/947946348 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00bd60 con 0x7ff33c0ac3a0 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 -- 172.21.15.142:0/947946348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0ac3a0 msgr2=0x7ff33c0aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 --2- 172.21.15.142:0/947946348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0ac3a0 0x7ff33c0aa2a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06ee90 tx=0x7ff32c009250 comp rx=0 tx=0).stop 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 -- 172.21.15.142:0/947946348 shutdown_connections 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 --2- 172.21.15.142:0/947946348 >> v2:172.21.15.148:3300/0 conn(0x7ff33c159b50 0x7ff33c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 --2- 172.21.15.142:0/947946348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0ac3a0 0x7ff33c0aa2a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 -- 172.21.15.142:0/947946348 >> 172.21.15.142:0/947946348 conn(0x7ff33c06dab0 msgr2=0x7ff33c0aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 -- 172.21.15.142:0/947946348 shutdown_connections 2023-09-30T22:58:25.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.150+0000 7ff3441ff700 1 -- 172.21.15.142:0/947946348 wait complete. 2023-09-30T22:58:25.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.152+0000 7ff3441ff700 1 Processor -- start 2023-09-30T22:58:25.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.152+0000 7ff3441ff700 1 -- start start 2023-09-30T22:58:25.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff3441ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0aa7e0 0x7ff33c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff3441ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff33c0ac3a0 0x7ff33c16da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff3441ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff33c159b50 0x7ff33c16dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff3441ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0acc10 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff3441ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c14f140 con 0x7ff33c0ac3a0 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff3441ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c14e530 con 0x7ff33c159b50 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff341f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0aa7e0 0x7ff33c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff341f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0aa7e0 0x7ff33c14f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41872/0 (socket says 172.21.15.142:41872) 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff341f9b700 1 -- 172.21.15.142:0/1988824307 learned_addr learned my addr 172.21.15.142:0/1988824307 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff34179a700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff33c0ac3a0 0x7ff33c16da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.153+0000 7ff34279c700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff33c159b50 0x7ff33c16dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff341f9b700 1 -- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff33c159b50 msgr2=0x7ff33c16dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff341f9b700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff33c159b50 0x7ff33c16dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff341f9b700 1 -- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff33c0ac3a0 msgr2=0x7ff33c16da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff341f9b700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff33c0ac3a0 0x7ff33c16da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff341f9b700 1 -- 172.21.15.142:0/1988824307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0094f0 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff34279c700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff33c159b50 0x7ff33c16dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff341f9b700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0aa7e0 0x7ff33c14f5d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d860 tx=0x7ff338008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff331ffb700 1 -- 172.21.15.142:0/1988824307 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380125f0 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff331ffb700 1 -- 172.21.15.142:0/1988824307 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338012750 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c14e810 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff331ffb700 1 -- 172.21.15.142:0/1988824307 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338012af0 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.154+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c14edd0 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.155+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c06cfd0 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.156+0000 7ff331ffb700 1 -- 172.21.15.142:0/1988824307 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff338014430 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.157+0000 7ff331ffb700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff320067330 0x7ff3200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.157+0000 7ff331ffb700 1 -- 172.21.15.142:0/1988824307 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7ff338085000 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.157+0000 7ff34179a700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff320067330 0x7ff3200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.158+0000 7ff34179a700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff320067330 0x7ff3200697e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06ee90 tx=0x7ff32c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:25.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.161+0000 7ff331ffb700 1 -- 172.21.15.142:0/1988824307 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff338051e30 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.396+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff33c06fc10 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.397+0000 7ff331ffb700 1 -- 172.21.15.142:0/1988824307 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7ff338055450 con 0x7ff33c0aa7e0 2023-09-30T22:58:25.397 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:25.397 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:58:25.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff320067330 msgr2=0x7ff3200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff320067330 0x7ff3200697e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06ee90 tx=0x7ff32c017000 comp rx=0 tx=0).stop 2023-09-30T22:58:25.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0aa7e0 msgr2=0x7ff33c14f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0aa7e0 0x7ff33c14f5d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d860 tx=0x7ff338008040 comp rx=0 tx=0).stop 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 shutdown_connections 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff320067330 0x7ff3200697e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff33c159b50 0x7ff33c16dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff33c0aa7e0 0x7ff33c14f5d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 --2- 172.21.15.142:0/1988824307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff33c0ac3a0 0x7ff33c16da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 >> 172.21.15.142:0/1988824307 conn(0x7ff33c06dab0 msgr2=0x7ff33c157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 shutdown_connections 2023-09-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.399+0000 7ff3441ff700 1 -- 172.21.15.142:0/1988824307 wait complete. 2023-09-30T22:58:25.401 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:58:25.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:25.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.608+0000 7f269ffff700 1 Processor -- start 2023-09-30T22:58:25.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.608+0000 7f269ffff700 1 -- start start 2023-09-30T22:58:25.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.609+0000 7f269ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26981598e0 0x7f2698159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.609+0000 7f269ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f26980d03d0 0x7f269815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.609+0000 7f269ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269806b8d0 con 0x7f26980cee50 2023-09-30T22:58:25.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.609+0000 7f269ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26980cff40 con 0x7f26981598e0 2023-09-30T22:58:25.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.609+0000 7f269ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26980cf330 con 0x7f26980d03d0 2023-09-30T22:58:25.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26981598e0 0x7f2698159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26981598e0 0x7f2698159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41876/0 (socket says 172.21.15.142:41876) 2023-09-30T22:58:25.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 -- 172.21.15.142:0/3571150379 learned_addr learned my addr 172.21.15.142:0/3571150379 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:25.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269d59a700 1 --1- 172.21.15.142:0/3571150379 >> v1:172.21.15.142:6789/0 conn(0x7f26980cee50 0x7f269806b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48204/0 (socket says 172.21.15.142:48204) 2023-09-30T22:58:25.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269e59c700 1 --2- 172.21.15.142:0/3571150379 >> v2:172.21.15.148:3300/0 conn(0x7f26980d03d0 0x7f269815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 -- 172.21.15.142:0/3571150379 >> v2:172.21.15.148:3300/0 conn(0x7f26980d03d0 msgr2=0x7f269815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 --2- 172.21.15.142:0/3571150379 >> v2:172.21.15.148:3300/0 conn(0x7f26980d03d0 0x7f269815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 -- 172.21.15.142:0/3571150379 >> v1:172.21.15.142:6789/0 conn(0x7f26980cee50 legacy=0x7f269806b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 -- 172.21.15.142:0/3571150379 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26980cf610 con 0x7f26981598e0 2023-09-30T22:58:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269cd99700 1 -- 172.21.15.142:0/3571150379 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252096763 0 0) 0x7f269806b8d0 con 0x7f26980cee50 2023-09-30T22:58:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.610+0000 7f269dd9b700 1 --2- 172.21.15.142:0/3571150379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26981598e0 0x7f2698159cb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f26980cfeb0 tx=0x7f2694009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687ab3647d45fbf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269cd99700 1 -- 172.21.15.142:0/3571150379 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694009e70 con 0x7f26981598e0 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269cd99700 1 -- 172.21.15.142:0/3571150379 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400b860 con 0x7f26981598e0 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269cd99700 1 -- 172.21.15.142:0/3571150379 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400bc00 con 0x7f26981598e0 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 -- 172.21.15.142:0/3571150379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26981598e0 msgr2=0x7f2698159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 --2- 172.21.15.142:0/3571150379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26981598e0 0x7f2698159cb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f26980cfeb0 tx=0x7f2694009250 comp rx=0 tx=0).stop 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 -- 172.21.15.142:0/3571150379 shutdown_connections 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 --2- 172.21.15.142:0/3571150379 >> v2:172.21.15.148:3300/0 conn(0x7f26980d03d0 0x7f269815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 --2- 172.21.15.142:0/3571150379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26981598e0 0x7f2698159cb0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 -- 172.21.15.142:0/3571150379 >> 172.21.15.142:0/3571150379 conn(0x7f26980cd540 msgr2=0x7f26980cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:25.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 -- 172.21.15.142:0/3571150379 shutdown_connections 2023-09-30T22:58:25.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.611+0000 7f269ffff700 1 -- 172.21.15.142:0/3571150379 wait complete. 2023-09-30T22:58:25.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.613+0000 7f269ffff700 1 Processor -- start 2023-09-30T22:58:25.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.613+0000 7f269ffff700 1 -- start start 2023-09-30T22:58:25.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26980cee50 0x7f2698156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26980d03d0 0x7f269815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26981598e0 0x7f2698150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698156e80 con 0x7f26980cee50 2023-09-30T22:58:25.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269815c560 con 0x7f26980d03d0 2023-09-30T22:58:25.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26980c5c20 con 0x7f26981598e0 2023-09-30T22:58:25.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26980cee50 0x7f2698156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26980cee50 0x7f2698156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41882/0 (socket says 172.21.15.142:41882) 2023-09-30T22:58:25.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 -- 172.21.15.142:0/1522112217 learned_addr learned my addr 172.21.15.142:0/1522112217 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:25.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269d59a700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26980d03d0 0x7f269815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269e59c700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26981598e0 0x7f2698150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 -- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26981598e0 msgr2=0x7f2698150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26981598e0 0x7f2698150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 -- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26980d03d0 msgr2=0x7f269815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26980d03d0 0x7f269815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269dd9b700 1 -- 172.21.15.142:0/1522112217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940094f0 con 0x7f26980cee50 2023-09-30T22:58:25.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.614+0000 7f269e59c700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26981598e0 0x7f2698150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:25.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.615+0000 7f269dd9b700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26980cee50 0x7f2698156940 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f26940094c0 tx=0x7f2694017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:25.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.615+0000 7f268dffb700 1 -- 172.21.15.142:0/1522112217 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400b9d0 con 0x7f26980cee50 2023-09-30T22:58:25.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.615+0000 7f268dffb700 1 -- 172.21.15.142:0/1522112217 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400bb30 con 0x7f26980cee50 2023-09-30T22:58:25.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.615+0000 7f268dffb700 1 -- 172.21.15.142:0/1522112217 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694025670 con 0x7f26980cee50 2023-09-30T22:58:25.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.615+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269815c750 con 0x7f26980cee50 2023-09-30T22:58:25.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.615+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26980c55d0 con 0x7f26980cee50 2023-09-30T22:58:25.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.616+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26980697b0 con 0x7f26980cee50 2023-09-30T22:58:25.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.617+0000 7f268dffb700 1 -- 172.21.15.142:0/1522112217 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2694023070 con 0x7f26980cee50 2023-09-30T22:58:25.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.618+0000 7f268dffb700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f267c067330 0x7f267c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:25.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.618+0000 7f268dffb700 1 -- 172.21.15.142:0/1522112217 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f2694086280 con 0x7f26980cee50 2023-09-30T22:58:25.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.618+0000 7f269d59a700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f267c067330 0x7f267c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:25.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.619+0000 7f269d59a700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f267c067330 0x7f267c0697e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f26880011e0 tx=0x7f2688007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:25.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.622+0000 7f268dffb700 1 -- 172.21.15.142:0/1522112217 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2694053010 con 0x7f26980cee50 2023-09-30T22:58:25.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.811+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2698159500 con 0x7f26980cee50 2023-09-30T22:58:25.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.812+0000 7f268dffb700 1 -- 172.21.15.142:0/1522112217 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+17364 (secure 0 0 0) 0x7f2694056630 con 0x7f26980cee50 2023-09-30T22:58:25.812 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:25.813 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":118,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:19.362138+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:57:44.465774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-09-30T22:57:45.784661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.14","mappings":[{"from":6,"to":4}]},{"pgid":"14.20","mappings":[{"from":7,"to":3}]},{"pgid":"14.26","mappings":[{"from":1,"to":0}]},{"pgid":"14.27","mappings":[{"from":1,"to":3}]},{"pgid":"14.2a","mappings":[{"from":1,"to":0}]},{"pgid":"14.35","mappings":[{"from":7,"to":0}]},{"pgid":"14.3d","mappings":[{"from":7,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.814+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f267c067330 msgr2=0x7f267c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.814+0000 7f269ffff700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f267c067330 0x7f267c0697e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f26880011e0 tx=0x7f2688007bf0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.814+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26980cee50 msgr2=0x7f2698156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.814+0000 7f269ffff700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26980cee50 0x7f2698156940 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f26940094c0 tx=0x7f2694017000 comp rx=0 tx=0).stop 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 shutdown_connections 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f267c067330 0x7f267c0697e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26981598e0 0x7f2698150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26980cee50 0x7f2698156940 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 --2- 172.21.15.142:0/1522112217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26980d03d0 0x7f269815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:25.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 >> 172.21.15.142:0/1522112217 conn(0x7f26980cd540 msgr2=0x7f26981589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:25.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 shutdown_connections 2023-09-30T22:58:25.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:25.815+0000 7f269ffff700 1 -- 172.21.15.142:0/1522112217 wait complete. 2023-09-30T22:58:25.832 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:58:25.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:26.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.021+0000 7ff50efff700 1 Processor -- start 2023-09-30T22:58:26.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.022+0000 7ff50efff700 1 -- start start 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.023+0000 7ff50efff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 0x7ff50806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.023+0000 7ff50efff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50806d3e0 con 0x7ff5080af020 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.023+0000 7ff50efff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50806dc80 con 0x7ff50806e650 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.023+0000 7ff50efff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50806b790 con 0x7ff5080b00d0 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.023+0000 7ff50cd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff5080af020 0x7ff508156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48214/0 (socket says 172.21.15.142:48214) 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.023+0000 7ff50cd9b700 1 -- 172.21.15.142:0/166558724 learned_addr learned my addr 172.21.15.142:0/166558724 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff507fff700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 0x7ff50806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911746498 0 0) 0x7ff50806d3e0 con 0x7ff5080af020 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f8003570 con 0x7ff5080af020 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893196710 0 0) 0x7ff50806dc80 con 0x7ff50806e650 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff50806d3e0 con 0x7ff50806e650 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294920860 0 0) 0x7ff4f8003570 con 0x7ff5080af020 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 msgr2=0x7ff50806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 0x7ff50806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 >> v1:172.21.15.148:6789/0 conn(0x7ff50806e650 legacy=0x7ff50815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080b0650 con 0x7ff5080af020 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7ff4fc001470 con 0x7ff5080af020 2023-09-30T22:58:26.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 >> v1:172.21.15.142:6789/0 conn(0x7ff5080af020 legacy=0x7ff508156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f8003c20 0x7ff4f8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 0x7ff4f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004d50 0x7ff4f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50806b790 con 0x7ff4f8003c20 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f800bb40 con 0x7ff4f8004d50 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.024+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f800df10 con 0x7ff5080b00d0 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50cd9b700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f8003c20 0x7ff4f8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50d59c700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004d50 0x7ff4f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff507fff700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 0x7ff4f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50cd9b700 1 -- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 msgr2=0x7ff4f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50cd9b700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5080b00d0 0x7ff4f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50cd9b700 1 -- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004d50 msgr2=0x7ff4f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50cd9b700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004d50 0x7ff4f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50cd9b700 1 -- 172.21.15.142:0/166558724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8003570 con 0x7ff4f8003c20 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff50cd9b700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f8003c20 0x7ff4f8004010 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c2d0 tx=0x7ff5080b0540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568a7966e0282c24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00cc00 con 0x7ff4f8003c20 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00cd60 con 0x7ff4f8003c20 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.025+0000 7ff5077fe700 1 -- 172.21.15.142:0/166558724 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc005b70 con 0x7ff4f8003c20 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.026+0000 7ff50efff700 1 -- 172.21.15.142:0/166558724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f8003c20 msgr2=0x7ff4f8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.026+0000 7ff50efff700 1 --2- 172.21.15.142:0/166558724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f8003c20 0x7ff4f8004010 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c2d0 tx=0x7ff5080b0540 comp rx=0 tx=0).stop 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.026+0000 7ff50d59c700 1 -- 172.21.15.142:0/166558724 reap_dead start 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.026+0000 7ff50efff700 1 -- 172.21.15.142:0/166558724 shutdown_connections 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.026+0000 7ff50efff700 1 -- 172.21.15.142:0/166558724 >> 172.21.15.142:0/166558724 conn(0x7ff5080680c0 msgr2=0x7ff5080c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:26.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.026+0000 7ff50efff700 1 -- 172.21.15.142:0/166558724 shutdown_connections 2023-09-30T22:58:26.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.026+0000 7ff50efff700 1 -- 172.21.15.142:0/166558724 wait complete. 2023-09-30T22:58:26.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.027+0000 7ff50efff700 1 Processor -- start 2023-09-30T22:58:26.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.028+0000 7ff50efff700 1 -- start start 2023-09-30T22:58:26.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.028+0000 7ff50efff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4f8003c20 0x7ff5080c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff50efff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5080ae0e0 0x7ff5080c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff50efff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5080c42b0 0x7ff5081593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff50efff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5080c56f0 con 0x7ff5080ae0e0 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff50efff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5080ae530 con 0x7ff5080c42b0 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff50efff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5080c60c0 con 0x7ff4f8003c20 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5080ae0e0 0x7ff5080c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5080ae0e0 0x7ff5080c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41890/0 (socket says 172.21.15.142:41890) 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 -- 172.21.15.142:0/1263879556 learned_addr learned my addr 172.21.15.142:0/1263879556 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff50cd9b700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4f8003c20 0x7ff5080c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff50d59c700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5080c42b0 0x7ff5081593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 -- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4f8003c20 msgr2=0x7ff5080c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4f8003c20 0x7ff5080c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 -- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5080c42b0 msgr2=0x7ff5081593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5080c42b0 0x7ff5081593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 -- 172.21.15.142:0/1263879556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080c4ae0 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.029+0000 7ff507fff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5080ae0e0 0x7ff5080c5b80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4011d40 tx=0x7ff4f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.030+0000 7ff504ff9700 1 -- 172.21.15.142:0/1263879556 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400fac0 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.030+0000 7ff504ff9700 1 -- 172.21.15.142:0/1263879556 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f400fc20 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.030+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5080c4dc0 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.030+0000 7ff504ff9700 1 -- 172.21.15.142:0/1263879556 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4014440 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.030+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5080c5380 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.031+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff508064180 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.032+0000 7ff504ff9700 1 -- 172.21.15.142:0/1263879556 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff4f4014870 con 0x7ff5080ae0e0 2023-09-30T22:58:26.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.032+0000 7ff504ff9700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4ec067330 0x7ff4ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.032+0000 7ff504ff9700 1 -- 172.21.15.142:0/1263879556 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7ff4f4018030 con 0x7ff5080ae0e0 2023-09-30T22:58:26.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.033+0000 7ff50cd9b700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4ec067330 0x7ff4ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.033+0000 7ff50cd9b700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4ec067330 0x7ff4ec0697e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc007c60 tx=0x7ff4fc015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.037+0000 7ff504ff9700 1 -- 172.21.15.142:0/1263879556 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff4f4052610 con 0x7ff5080ae0e0 2023-09-30T22:58:26.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.270+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5080c5830 con 0x7ff5080ae0e0 2023-09-30T22:58:26.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.270+0000 7ff504ff9700 1 -- 172.21.15.142:0/1263879556 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7ff4f4055c30 con 0x7ff5080ae0e0 2023-09-30T22:58:26.270 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:26.270 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.272+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4ec067330 msgr2=0x7ff4ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.272+0000 7ff50efff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4ec067330 0x7ff4ec0697e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc007c60 tx=0x7ff4fc015000 comp rx=0 tx=0).stop 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.272+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5080ae0e0 msgr2=0x7ff5080c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.272+0000 7ff50efff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5080ae0e0 0x7ff5080c5b80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4011d40 tx=0x7ff4f40091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 shutdown_connections 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff4ec067330 0x7ff4ec0697e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5080c42b0 0x7ff5081593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4f8003c20 0x7ff5080c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 --2- 172.21.15.142:0/1263879556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5080ae0e0 0x7ff5080c5b80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 >> 172.21.15.142:0/1263879556 conn(0x7ff5080680c0 msgr2=0x7ff5080ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:26.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 shutdown_connections 2023-09-30T22:58:26.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.273+0000 7ff50efff700 1 -- 172.21.15.142:0/1263879556 wait complete. 2023-09-30T22:58:26.274 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:58:26.290 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:26.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.484+0000 7f311a1ff700 1 Processor -- start 2023-09-30T22:58:26.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.484+0000 7f311a1ff700 1 -- start start 2023-09-30T22:58:26.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.485+0000 7f311a1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3114143350 0x7f31140cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.485+0000 7f311a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 0x7f311415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.485+0000 7f311a1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311415e0b0 con 0x7f311415dc50 2023-09-30T22:58:26.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.485+0000 7f311a1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31140cc6b0 con 0x7f3114143350 2023-09-30T22:58:26.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.485+0000 7f311a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31140cb7d0 con 0x7f31140692f0 2023-09-30T22:58:26.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f3113fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f311415dc50 0x7f3114068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48216/0 (socket says 172.21.15.142:48216) 2023-09-30T22:58:26.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f3113fff700 1 -- 172.21.15.142:0/854443200 learned_addr learned my addr 172.21.15.142:0/854443200 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:26.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f3112ffd700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 0x7f311415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31137fe700 1 --2- 172.21.15.142:0/854443200 >> v2:172.21.15.148:3300/0 conn(0x7f3114143350 0x7f31140cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296772103 0 0) 0x7f310c001490 con 0x7f311415dc50 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30fc003570 con 0x7f311415dc50 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558062034 0 0) 0x7f30fc003570 con 0x7f311415dc50 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 msgr2=0x7f311415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 0x7f311415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 >> v2:172.21.15.148:3300/0 conn(0x7f3114143350 msgr2=0x7f31140cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 --2- 172.21.15.142:0/854443200 >> v2:172.21.15.148:3300/0 conn(0x7f3114143350 0x7f31140cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140cbaa0 con 0x7f311415dc50 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.486+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f310c001980 con 0x7f311415dc50 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 >> v1:172.21.15.142:6789/0 conn(0x7f311415dc50 legacy=0x7f3114068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31127fc700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f30fc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31127fc700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 0x7f30fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31127fc700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30fc004d50 0x7f30fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140cc6b0 con 0x7f30fc003ae0 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140cb7d0 con 0x7f30fc004d50 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc00bb10 con 0x7f31140692f0 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31137fe700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f30fc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f3112ffd700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 0x7f30fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f3113fff700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30fc004d50 0x7f30fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31137fe700 1 -- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 msgr2=0x7f30fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31137fe700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140692f0 0x7f30fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31137fe700 1 -- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30fc004d50 msgr2=0x7f30fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31137fe700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30fc004d50 0x7f30fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f31137fe700 1 -- 172.21.15.142:0/854443200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc003570 con 0x7f30fc003ae0 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.487+0000 7f3113fff700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30fc004d50 0x7f30fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f31137fe700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f30fc003ef0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3104009c30 tx=0x7f31040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c4ab9210a8b6e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400e710 con 0x7f30fc003ae0 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400e870 con 0x7f30fc003ae0 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f31127fc700 1 -- 172.21.15.142:0/854443200 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400ec30 con 0x7f30fc003ae0 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f311a1ff700 1 -- 172.21.15.142:0/854443200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 msgr2=0x7f30fc003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f311a1ff700 1 --2- 172.21.15.142:0/854443200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f30fc003ef0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3104009c30 tx=0x7f31040091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f3113fff700 1 -- 172.21.15.142:0/854443200 reap_dead start 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f311a1ff700 1 -- 172.21.15.142:0/854443200 shutdown_connections 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.488+0000 7f311a1ff700 1 -- 172.21.15.142:0/854443200 >> 172.21.15.142:0/854443200 conn(0x7f31140ce8e0 msgr2=0x7f31140cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.489+0000 7f311a1ff700 1 -- 172.21.15.142:0/854443200 shutdown_connections 2023-09-30T22:58:26.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.489+0000 7f311a1ff700 1 -- 172.21.15.142:0/854443200 wait complete. 2023-09-30T22:58:26.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.490+0000 7f311a1ff700 1 Processor -- start 2023-09-30T22:58:26.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.490+0000 7f311a1ff700 1 -- start start 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f311a1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f311416cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f311a1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311416b010 0x7f31140a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f311a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140a7310 0x7f31140a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f311a1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311415aad0 con 0x7f30fc003ae0 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f311a1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311416d290 con 0x7f311416b010 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f311a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311415a200 con 0x7f31140a7310 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f31137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f311416cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f31137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f311416cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41910/0 (socket says 172.21.15.142:41910) 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.491+0000 7f31137fe700 1 -- 172.21.15.142:0/1835842343 learned_addr learned my addr 172.21.15.142:0/1835842343 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f3113fff700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140a7310 0x7f31140a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f3112ffd700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311416b010 0x7f31140a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f31137fe700 1 -- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140a7310 msgr2=0x7f31140a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f31137fe700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140a7310 0x7f31140a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f31137fe700 1 -- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311416b010 msgr2=0x7f31140a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f31137fe700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311416b010 0x7f31140a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f31137fe700 1 -- 172.21.15.142:0/1835842343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140a7770 con 0x7f30fc003ae0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f31137fe700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f311416cd50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f310400e4b0 tx=0x7f310401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f30fb7fe700 1 -- 172.21.15.142:0/1835842343 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104022070 con 0x7f30fc003ae0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f30fb7fe700 1 -- 172.21.15.142:0/1835842343 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104000d10 con 0x7f30fc003ae0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f30fb7fe700 1 -- 172.21.15.142:0/1835842343 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040276a0 con 0x7f30fc003ae0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31140a64f0 con 0x7f30fc003ae0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.492+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311415a6f0 con 0x7f30fc003ae0 2023-09-30T22:58:26.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.493+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311406ea70 con 0x7f30fc003ae0 2023-09-30T22:58:26.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.494+0000 7f30fb7fe700 1 -- 172.21.15.142:0/1835842343 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f310401c450 con 0x7f30fc003ae0 2023-09-30T22:58:26.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.495+0000 7f30fb7fe700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3100067330 0x7f31000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.495+0000 7f30fb7fe700 1 -- 172.21.15.142:0/1835842343 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f3104086700 con 0x7f30fc003ae0 2023-09-30T22:58:26.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.495+0000 7f3112ffd700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3100067330 0x7f31000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.496+0000 7f3112ffd700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3100067330 0x7f31000697e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f311406b680 tx=0x7f3108008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.499+0000 7f30fb7fe700 1 -- 172.21.15.142:0/1835842343 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3104053490 con 0x7f30fc003ae0 2023-09-30T22:58:26.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.733+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31140a7770 con 0x7f30fc003ae0 2023-09-30T22:58:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.733+0000 7f30fb7fe700 1 -- 172.21.15.142:0/1835842343 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f31140a7770 con 0x7f30fc003ae0 2023-09-30T22:58:26.733 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:26.733 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:57:46.794250+0000","modified":"2023-09-30T22:57:50.357340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6450":{"gid":6450,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/3184788452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3184788452},{"type":"v1","addr":"172.21.15.142:6836","nonce":3184788452}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3100067330 msgr2=0x7f31000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3100067330 0x7f31000697e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f311406b680 tx=0x7f3108008040 comp rx=0 tx=0).stop 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 msgr2=0x7f311416cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f311416cd50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f310400e4b0 tx=0x7f310401a000 comp rx=0 tx=0).stop 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 shutdown_connections 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3100067330 0x7f31000697e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f31140a7310 0x7f31140a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30fc003ae0 0x7f311416cd50 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 --2- 172.21.15.142:0/1835842343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311416b010 0x7f31140a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 >> 172.21.15.142:0/1835842343 conn(0x7f31140ce8e0 msgr2=0x7f3114142140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 shutdown_connections 2023-09-30T22:58:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.736+0000 7f311a1ff700 1 -- 172.21.15.142:0/1835842343 wait complete. 2023-09-30T22:58:26.737 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 50 2023-09-30T22:58:26.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:26.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.942+0000 7fdd225ff700 1 Processor -- start 2023-09-30T22:58:26.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.943+0000 7fdd225ff700 1 -- start start 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd225ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd1c1598e0 0x7fdd1c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd225ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd1c0cee50 0x7fdd1c0d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd225ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0cff40 con 0x7fdd1c06b1c0 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd225ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0d0910 con 0x7fdd1c0cee50 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd225ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cf330 con 0x7fdd1c1598e0 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd1b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd1c0cee50 0x7fdd1c0d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd20b9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdd1c06b1c0 0x7fdd1c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48230/0 (socket says 172.21.15.142:48230) 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd20b9c700 1 -- 172.21.15.142:0/741130302 learned_addr learned my addr 172.21.15.142:0/741130302 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd1bfff700 1 --2- 172.21.15.142:0/741130302 >> v2:172.21.15.148:3300/0 conn(0x7fdd1c1598e0 0x7fdd1c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd1b7fe700 1 -- 172.21.15.142:0/741130302 >> v2:172.21.15.148:3300/0 conn(0x7fdd1c1598e0 msgr2=0x7fdd1c159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:26.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd1b7fe700 1 --2- 172.21.15.142:0/741130302 >> v2:172.21.15.148:3300/0 conn(0x7fdd1c1598e0 0x7fdd1c159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd1b7fe700 1 -- 172.21.15.142:0/741130302 >> v1:172.21.15.142:6789/0 conn(0x7fdd1c06b1c0 legacy=0x7fdd1c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.944+0000 7fdd1affd700 1 -- 172.21.15.142:0/741130302 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658059302 0 0) 0x7fdd1c0cff40 con 0x7fdd1c06b1c0 2023-09-30T22:58:26.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.945+0000 7fdd1b7fe700 1 -- 172.21.15.142:0/741130302 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0cf610 con 0x7fdd1c0cee50 2023-09-30T22:58:26.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.945+0000 7fdd1b7fe700 1 --2- 172.21.15.142:0/741130302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c0d03d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ce070 tx=0x7fdd100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd9f7b93ec8fe3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.945+0000 7fdd1affd700 1 -- 172.21.15.142:0/741130302 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000b6b0 con 0x7fdd1c0cee50 2023-09-30T22:58:26.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.945+0000 7fdd1affd700 1 -- 172.21.15.142:0/741130302 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000b810 con 0x7fdd1c0cee50 2023-09-30T22:58:26.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.945+0000 7fdd1affd700 1 -- 172.21.15.142:0/741130302 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000bbb0 con 0x7fdd1c0cee50 2023-09-30T22:58:26.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.945+0000 7fdd225ff700 1 -- 172.21.15.142:0/741130302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 msgr2=0x7fdd1c0d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.945+0000 7fdd225ff700 1 --2- 172.21.15.142:0/741130302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c0d03d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ce070 tx=0x7fdd100091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.946+0000 7fdd225ff700 1 -- 172.21.15.142:0/741130302 shutdown_connections 2023-09-30T22:58:26.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.946+0000 7fdd225ff700 1 --2- 172.21.15.142:0/741130302 >> v2:172.21.15.148:3300/0 conn(0x7fdd1c1598e0 0x7fdd1c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.946+0000 7fdd225ff700 1 --2- 172.21.15.142:0/741130302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c0d03d0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.946+0000 7fdd225ff700 1 -- 172.21.15.142:0/741130302 >> 172.21.15.142:0/741130302 conn(0x7fdd1c0cd540 msgr2=0x7fdd1c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:26.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.946+0000 7fdd225ff700 1 -- 172.21.15.142:0/741130302 shutdown_connections 2023-09-30T22:58:26.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.946+0000 7fdd225ff700 1 -- 172.21.15.142:0/741130302 wait complete. 2023-09-30T22:58:26.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.948+0000 7fdd225ff700 1 Processor -- start 2023-09-30T22:58:26.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.948+0000 7fdd225ff700 1 -- start start 2023-09-30T22:58:26.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd225ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c06b1c0 0x7fdd1c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd225ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c16a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd225ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd1c1598e0 0x7fdd1c16b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd225ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0ca220 con 0x7fdd1c0cee50 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd225ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c16ad80 con 0x7fdd1c06b1c0 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd225ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c16b060 con 0x7fdd1c1598e0 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd1b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c16a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd1b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c16a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41936/0 (socket says 172.21.15.142:41936) 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.949+0000 7fdd1b7fe700 1 -- 172.21.15.142:0/2881869431 learned_addr learned my addr 172.21.15.142:0/2881869431 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1bfff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c06b1c0 0x7fdd1c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd20b9c700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd1c1598e0 0x7fdd1c16b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1b7fe700 1 -- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd1c1598e0 msgr2=0x7fdd1c16b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1b7fe700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd1c1598e0 0x7fdd1c16b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1b7fe700 1 -- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c06b1c0 msgr2=0x7fdd1c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1b7fe700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c06b1c0 0x7fdd1c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:26.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1b7fe700 1 -- 172.21.15.142:0/2881869431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd10009420 con 0x7fdd1c0cee50 2023-09-30T22:58:26.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1bfff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c06b1c0 0x7fdd1c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:26.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd1b7fe700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c16a4c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ce0a0 tx=0x7fdd10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd03fff700 1 -- 172.21.15.142:0/2881869431 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011420 con 0x7fdd1c0cee50 2023-09-30T22:58:26.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd03fff700 1 -- 172.21.15.142:0/2881869431 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10011580 con 0x7fdd1c0cee50 2023-09-30T22:58:26.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd03fff700 1 -- 172.21.15.142:0/2881869431 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011940 con 0x7fdd1c0cee50 2023-09-30T22:58:26.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.950+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c16b340 con 0x7fdd1c0cee50 2023-09-30T22:58:26.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.951+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c16aa00 con 0x7fdd1c0cee50 2023-09-30T22:58:26.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.951+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0ca390 con 0x7fdd1c0cee50 2023-09-30T22:58:26.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.952+0000 7fdd03fff700 1 -- 172.21.15.142:0/2881869431 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdd10011d30 con 0x7fdd1c0cee50 2023-09-30T22:58:26.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.953+0000 7fdd03fff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd08067330 0x7fdd080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:26.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.953+0000 7fdd03fff700 1 -- 172.21.15.142:0/2881869431 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fdd100861f0 con 0x7fdd1c0cee50 2023-09-30T22:58:26.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.954+0000 7fdd1bfff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd08067330 0x7fdd080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:26.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.954+0000 7fdd1bfff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd08067330 0x7fdd080697e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0d0730 tx=0x7fdd0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:26.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:26.958+0000 7fdd03fff700 1 -- 172.21.15.142:0/2881869431 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdd10053020 con 0x7fdd1c0cee50 2023-09-30T22:58:27.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.149+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd1c0cc050 con 0x7fdd1c0cee50 2023-09-30T22:58:27.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.150+0000 7fdd03fff700 1 -- 172.21.15.142:0/2881869431 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+17364 (secure 0 0 0) 0x7fdd10056640 con 0x7fdd1c0cee50 2023-09-30T22:58:27.150 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:27.151 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":118,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:19.362138+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:57:44.465774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-09-30T22:57:45.784661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.14","mappings":[{"from":6,"to":4}]},{"pgid":"14.20","mappings":[{"from":7,"to":3}]},{"pgid":"14.26","mappings":[{"from":1,"to":0}]},{"pgid":"14.27","mappings":[{"from":1,"to":3}]},{"pgid":"14.2a","mappings":[{"from":1,"to":0}]},{"pgid":"14.35","mappings":[{"from":7,"to":0}]},{"pgid":"14.3d","mappings":[{"from":7,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:27.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd08067330 msgr2=0x7fdd080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd08067330 0x7fdd080697e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0d0730 tx=0x7fdd0c008040 comp rx=0 tx=0).stop 2023-09-30T22:58:27.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 msgr2=0x7fdd1c16a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c16a4c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ce0a0 tx=0x7fdd10017000 comp rx=0 tx=0).stop 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 shutdown_connections 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd08067330 0x7fdd080697e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd1c1598e0 0x7fdd1c16b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c06b1c0 0x7fdd1c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 --2- 172.21.15.142:0/2881869431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd1c0cee50 0x7fdd1c16a4c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 >> 172.21.15.142:0/2881869431 conn(0x7fdd1c0cd540 msgr2=0x7fdd1c158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 shutdown_connections 2023-09-30T22:58:27.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.153+0000 7fdd225ff700 1 -- 172.21.15.142:0/2881869431 wait complete. 2023-09-30T22:58:27.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:58:27.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.364+0000 7f228b59e700 1 Processor -- start 2023-09-30T22:58:27.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.364+0000 7f228b59e700 1 -- start start 2023-09-30T22:58:27.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.365+0000 7f228b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c06b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.365+0000 7f228b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f228c06b840 0x7f228c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.365+0000 7f228b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228c06a5f0 con 0x7f228c159b40 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.365+0000 7f228b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228c06e6f0 con 0x7f228c06b840 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.365+0000 7f228b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228c06ae70 con 0x7f228c0d0310 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f2289d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f2289d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c06b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:59598/0 (socket says 172.21.15.142:59598) 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f228a59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f228c159b40 0x7f228c06dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:46908/0 (socket says 172.21.15.142:46908) 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f2289d9b700 1 -- 172.21.15.142:0/2988261466 learned_addr learned my addr 172.21.15.142:0/2988261466 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f228ad9d700 1 --2- 172.21.15.142:0/2988261466 >> v2:172.21.15.148:3300/0 conn(0x7f228c06b840 0x7f228c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f2289d9b700 1 -- 172.21.15.142:0/2988261466 >> v2:172.21.15.148:3300/0 conn(0x7f228c06b840 msgr2=0x7f228c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f2289d9b700 1 --2- 172.21.15.142:0/2988261466 >> v2:172.21.15.148:3300/0 conn(0x7f228c06b840 0x7f228c0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f2289d9b700 1 -- 172.21.15.142:0/2988261466 >> v1:172.21.15.148:6789/0 conn(0x7f228c159b40 legacy=0x7f228c06dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.366+0000 7f2289d9b700 1 -- 172.21.15.142:0/2988261466 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c06e410 con 0x7f228c0d0310 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f2289d9b700 1 --2- 172.21.15.142:0/2988261466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c06b300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c645c32e830e92cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228959a700 1 -- 172.21.15.142:0/2988261466 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280009ea0 con 0x7f228c0d0310 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228959a700 1 -- 172.21.15.142:0/2988261466 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000b860 con 0x7f228c0d0310 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228959a700 1 -- 172.21.15.142:0/2988261466 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000bc00 con 0x7f228c0d0310 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 -- 172.21.15.142:0/2988261466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 msgr2=0x7f228c06b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 --2- 172.21.15.142:0/2988261466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c06b300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280009250 comp rx=0 tx=0).stop 2023-09-30T22:58:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 -- 172.21.15.142:0/2988261466 shutdown_connections 2023-09-30T22:58:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 --2- 172.21.15.142:0/2988261466 >> v2:172.21.15.148:3300/0 conn(0x7f228c06b840 0x7f228c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 --2- 172.21.15.142:0/2988261466 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c06b300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 -- 172.21.15.142:0/2988261466 >> 172.21.15.142:0/2988261466 conn(0x7f228c0cd300 msgr2=0x7f228c0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 -- 172.21.15.142:0/2988261466 shutdown_connections 2023-09-30T22:58:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.367+0000 7f228b59e700 1 -- 172.21.15.142:0/2988261466 wait complete. 2023-09-30T22:58:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.369+0000 7f228b59e700 1 Processor -- start 2023-09-30T22:58:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.369+0000 7f228b59e700 1 -- start start 2023-09-30T22:58:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228c06b840 0x7f228c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228b59e700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c159b40 0x7f228c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c149c70 con 0x7f228c06b840 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c15ebf0 con 0x7f228c159b40 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228b59e700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228c15f080 con 0x7f228c0d0310 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228c06b840 0x7f228c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228c06b840 0x7f228c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41948/0 (socket says 172.21.15.142:41948) 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.370+0000 7f228a59c700 1 -- 172.21.15.142:0/1187808346 learned_addr learned my addr 172.21.15.142:0/1187808346 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f2289d9b700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228ad9d700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c159b40 0x7f228c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228a59c700 1 -- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 msgr2=0x7f228c14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228a59c700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c14eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228a59c700 1 -- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c159b40 msgr2=0x7f228c14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228a59c700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c159b40 0x7f228c14f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228a59c700 1 -- 172.21.15.142:0/1187808346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800094f0 con 0x7f228c06b840 2023-09-30T22:58:27.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228ad9d700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c159b40 0x7f228c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228a59c700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228c06b840 0x7f228c15d690 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f227c00c560 tx=0x7f227c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f227a7fc700 1 -- 172.21.15.142:0/1187808346 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c005a70 con 0x7f228c06b840 2023-09-30T22:58:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f227a7fc700 1 -- 172.21.15.142:0/1187808346 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c005bd0 con 0x7f228c06b840 2023-09-30T22:58:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f227a7fc700 1 -- 172.21.15.142:0/1187808346 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0070d0 con 0x7f228c06b840 2023-09-30T22:58:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c15dfe0 con 0x7f228c06b840 2023-09-30T22:58:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.371+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c15e5a0 con 0x7f228c06b840 2023-09-30T22:58:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.373+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c064bc0 con 0x7f228c06b840 2023-09-30T22:58:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.373+0000 7f227a7fc700 1 -- 172.21.15.142:0/1187808346 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f227c007480 con 0x7f228c06b840 2023-09-30T22:58:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.374+0000 7f227a7fc700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f226c067330 0x7f226c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.375+0000 7f227a7fc700 1 -- 172.21.15.142:0/1187808346 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f227c084240 con 0x7f228c06b840 2023-09-30T22:58:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.375+0000 7f2289d9b700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f226c067330 0x7f226c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.375+0000 7f2289d9b700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f226c067330 0x7f226c0697e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:27.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.379+0000 7f227a7fc700 1 -- 172.21.15.142:0/1187808346 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f227c050fd0 con 0x7f228c06b840 2023-09-30T22:58:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.617+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f228c06a820 con 0x7f228c06b840 2023-09-30T22:58:27.617 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:58:27.618+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:58:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.624+0000 7f227a7fc700 1 -- 172.21.15.142:0/1187808346 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f227c0545f0 con 0x7f228c06b840 2023-09-30T22:58:27.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f226c067330 msgr2=0x7f226c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f226c067330 0x7f226c0697e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280017000 comp rx=0 tx=0).stop 2023-09-30T22:58:27.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228c06b840 msgr2=0x7f228c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228c06b840 0x7f228c15d690 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f227c00c560 tx=0x7f227c007f70 comp rx=0 tx=0).stop 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 shutdown_connections 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f226c067330 0x7f226c0697e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f228c159b40 0x7f228c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228c06b840 0x7f228c15d690 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 --2- 172.21.15.142:0/1187808346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f228c0d0310 0x7f228c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 >> 172.21.15.142:0/1187808346 conn(0x7f228c0cd300 msgr2=0x7f228c0cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 shutdown_connections 2023-09-30T22:58:27.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.627+0000 7f228b59e700 1 -- 172.21.15.142:0/1187808346 wait complete. 2023-09-30T22:58:27.629 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:58:27.634 INFO:tasks.ceph.mds.a.smithi142.stderr: -9073> 2023-09-30T22:57:51.839+0000 7f6e3c9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:58:27.645 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:58:27.685 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:58:27.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.837+0000 7ff611bff700 1 Processor -- start 2023-09-30T22:58:27.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.838+0000 7ff611bff700 1 -- start start 2023-09-30T22:58:27.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.839+0000 7ff611bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff60c0cbfe0 0x7ff60c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.839+0000 7ff611bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.839+0000 7ff611bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0d0550 con 0x7ff60c1573a0 2023-09-30T22:58:27.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.839+0000 7ff611bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0cf750 con 0x7ff60c0cbfe0 2023-09-30T22:58:27.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.839+0000 7ff611bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0cf940 con 0x7ff60c0cc3b0 2023-09-30T22:58:27.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.840+0000 7ff60affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.840+0000 7ff60affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:59612/0 (socket says 172.21.15.142:59612) 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.840+0000 7ff60bfff700 1 --1- 172.21.15.142:0/1632805969 >> v1:172.21.15.148:6789/0 conn(0x7ff60c1573a0 0x7ff60c15d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:46920/0 (socket says 172.21.15.142:46920) 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.840+0000 7ff60affd700 1 -- 172.21.15.142:0/1632805969 learned_addr learned my addr 172.21.15.142:0/1632805969 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.840+0000 7ff60b7fe700 1 --2- 172.21.15.142:0/1632805969 >> v2:172.21.15.148:3300/0 conn(0x7ff60c0cbfe0 0x7ff60c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.840+0000 7ff60a7fc700 1 -- 172.21.15.142:0/1632805969 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065192381 0 0) 0x7ff60c0d0550 con 0x7ff60c1573a0 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.840+0000 7ff60a7fc700 1 -- 172.21.15.142:0/1632805969 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f4003570 con 0x7ff60c1573a0 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60b7fe700 1 -- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 msgr2=0x7ff60c0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60b7fe700 1 --2- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60b7fe700 1 -- 172.21.15.142:0/1632805969 >> v1:172.21.15.148:6789/0 conn(0x7ff60c1573a0 legacy=0x7ff60c15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60b7fe700 1 -- 172.21.15.142:0/1632805969 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0cfc20 con 0x7ff60c0cbfe0 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60affd700 1 --2- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:27.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60b7fe700 1 --2- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 0x7ff60c15a2a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009910 tx=0x7ff5fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8313e9891444ee99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:27.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60a7fc700 1 -- 172.21.15.142:0/1632805969 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc011630 con 0x7ff60c0cbfe0 2023-09-30T22:58:27.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60a7fc700 1 -- 172.21.15.142:0/1632805969 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc011790 con 0x7ff60c0cbfe0 2023-09-30T22:58:27.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.841+0000 7ff60a7fc700 1 -- 172.21.15.142:0/1632805969 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc011b30 con 0x7ff60c0cbfe0 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 -- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 msgr2=0x7ff60c15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 --2- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 0x7ff60c15a2a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009910 tx=0x7ff5fc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 -- 172.21.15.142:0/1632805969 shutdown_connections 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 --2- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 0x7ff60c15a2a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 --2- 172.21.15.142:0/1632805969 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 -- 172.21.15.142:0/1632805969 >> 172.21.15.142:0/1632805969 conn(0x7ff60c0d0a80 msgr2=0x7ff60c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 -- 172.21.15.142:0/1632805969 shutdown_connections 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.842+0000 7ff611bff700 1 -- 172.21.15.142:0/1632805969 wait complete. 2023-09-30T22:58:27.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.844+0000 7ff611bff700 1 Processor -- start 2023-09-30T22:58:27.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.844+0000 7ff611bff700 1 -- start start 2023-09-30T22:58:27.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.845+0000 7ff611bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 0x7ff60c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.845+0000 7ff611bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.845+0000 7ff611bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1573a0 0x7ff60c16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.845+0000 7ff611bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c158330 con 0x7ff60c1573a0 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.845+0000 7ff611bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c158580 con 0x7ff60c0cbfe0 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.845+0000 7ff611bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c158860 con 0x7ff60c0cc3b0 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1573a0 0x7ff60c16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1573a0 0x7ff60c16a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41980/0 (socket says 172.21.15.142:41980) 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 -- 172.21.15.142:0/2193445106 learned_addr learned my addr 172.21.15.142:0/2193445106 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60b7fe700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 0x7ff60c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60affd700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 -- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 msgr2=0x7ff60c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 -- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 msgr2=0x7ff60c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 0x7ff60c0c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 -- 172.21.15.142:0/2193445106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000094f0 con 0x7ff60c1573a0 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.846+0000 7ff60bfff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1573a0 0x7ff60c16a340 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff60400cd30 tx=0x7ff604001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.847+0000 7ff5f37fe700 1 -- 172.21.15.142:0/2193445106 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400ce30 con 0x7ff60c1573a0 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.847+0000 7ff5f37fe700 1 -- 172.21.15.142:0/2193445106 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff604005df0 con 0x7ff60c1573a0 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.847+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc009420 con 0x7ff60c1573a0 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.847+0000 7ff5f37fe700 1 -- 172.21.15.142:0/2193445106 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400aac0 con 0x7ff60c1573a0 2023-09-30T22:58:27.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.847+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c159100 con 0x7ff60c1573a0 2023-09-30T22:58:27.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.848+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c069770 con 0x7ff60c1573a0 2023-09-30T22:58:27.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.849+0000 7ff5f37fe700 1 -- 172.21.15.142:0/2193445106 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff6040070f0 con 0x7ff60c1573a0 2023-09-30T22:58:27.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.849+0000 7ff5f37fe700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5f8067330 0x7ff5f80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:27.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.850+0000 7ff5f37fe700 1 -- 172.21.15.142:0/2193445106 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6347+0+0 (secure 0 0 0) 0x7ff604084d30 con 0x7ff60c1573a0 2023-09-30T22:58:27.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.850+0000 7ff60b7fe700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5f8067330 0x7ff5f80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:27.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.850+0000 7ff60b7fe700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5f8067330 0x7ff5f80697e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc003080 tx=0x7ff5fc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:27.853+0000 7ff5f37fe700 1 -- 172.21.15.142:0/2193445106 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff604051af0 con 0x7ff60c1573a0 2023-09-30T22:58:28.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.083+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff60c158a20 con 0x7ff60c1573a0 2023-09-30T22:58:28.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.625+0000 7ff5f37fe700 1 -- 172.21.15.142:0/2193445106 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff604055110 con 0x7ff60c1573a0 2023-09-30T22:58:28.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5f8067330 msgr2=0x7ff5f80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:28.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5f8067330 0x7ff5f80697e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc003080 tx=0x7ff5fc017000 comp rx=0 tx=0).stop 2023-09-30T22:58:28.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1573a0 msgr2=0x7ff60c16a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:28.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1573a0 0x7ff60c16a340 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff60400cd30 tx=0x7ff604001ac0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 shutdown_connections 2023-09-30T22:58:28.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff5f8067330 0x7ff5f80697e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1573a0 0x7ff60c16a340 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff60c0cbfe0 0x7ff60c0c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 --2- 172.21.15.142:0/2193445106 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff60c0cc3b0 0x7ff60c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 >> 172.21.15.142:0/2193445106 conn(0x7ff60c0d0a80 msgr2=0x7ff60c15de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:28.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 shutdown_connections 2023-09-30T22:58:28.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.628+0000 7ff611bff700 1 -- 172.21.15.142:0/2193445106 wait complete. 2023-09-30T22:58:28.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:58:28.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.881+0000 7f85e9bff700 1 Processor -- start 2023-09-30T22:58:28.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.881+0000 7f85e9bff700 1 -- start start 2023-09-30T22:58:28.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.882+0000 7f85e9bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85e415ac40 0x7f85e415a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:28.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.882+0000 7f85e9bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e40d04e0 con 0x7f85e40cf180 2023-09-30T22:58:28.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.882+0000 7f85e9bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e40cc8f0 con 0x7f85e40cc280 2023-09-30T22:58:28.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.882+0000 7f85e9bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40cf8d0 con 0x7f85e415ac40 2023-09-30T22:58:28.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.882+0000 7f85e37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85e415ac40 0x7f85e415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:28.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e2ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f85e40cf180 0x7f85e40cbb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48246/0 (socket says 172.21.15.142:48246) 2023-09-30T22:58:28.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e2ffd700 1 -- 172.21.15.142:0/159291303 learned_addr learned my addr 172.21.15.142:0/159291303 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:28.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e37fe700 1 -- 172.21.15.142:0/159291303 >> v1:172.21.15.148:6789/0 conn(0x7f85e40cc280 legacy=0x7f85e406a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:28.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e37fe700 1 -- 172.21.15.142:0/159291303 >> v1:172.21.15.142:6789/0 conn(0x7f85e40cf180 legacy=0x7f85e40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:28.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e37fe700 1 -- 172.21.15.142:0/159291303 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40cfbb0 con 0x7f85e415ac40 2023-09-30T22:58:28.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e27fc700 1 -- 172.21.15.142:0/159291303 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211348259 0 0) 0x7f85e40d04e0 con 0x7f85e40cf180 2023-09-30T22:58:28.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e37fe700 1 --2- 172.21.15.142:0/159291303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e415ac40 0x7f85e415a220 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f85d40098e0 tx=0x7f85d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e4b0b3c68951b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:28.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e27fc700 1 -- 172.21.15.142:0/159291303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4009e80 con 0x7f85e415ac40 2023-09-30T22:58:28.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e27fc700 1 -- 172.21.15.142:0/159291303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d400b820 con 0x7f85e415ac40 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.883+0000 7f85e27fc700 1 -- 172.21.15.142:0/159291303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400bba0 con 0x7f85e415ac40 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.884+0000 7f85e9bff700 1 -- 172.21.15.142:0/159291303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e415ac40 msgr2=0x7f85e415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.884+0000 7f85e9bff700 1 --2- 172.21.15.142:0/159291303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e415ac40 0x7f85e415a220 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f85d40098e0 tx=0x7f85d40091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.884+0000 7f85e9bff700 1 -- 172.21.15.142:0/159291303 shutdown_connections 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.884+0000 7f85e9bff700 1 --2- 172.21.15.142:0/159291303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e415ac40 0x7f85e415a220 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.884+0000 7f85e9bff700 1 -- 172.21.15.142:0/159291303 >> 172.21.15.142:0/159291303 conn(0x7f85e40d0a80 msgr2=0x7f85e40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.884+0000 7f85e9bff700 1 -- 172.21.15.142:0/159291303 shutdown_connections 2023-09-30T22:58:28.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.884+0000 7f85e9bff700 1 -- 172.21.15.142:0/159291303 wait complete. 2023-09-30T22:58:28.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.886+0000 7f85e9bff700 1 Processor -- start 2023-09-30T22:58:28.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.886+0000 7f85e9bff700 1 -- start start 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e9bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85e40cc280 0x7f85e40c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e9bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e40cf180 0x7f85e41592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e9bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85e415ac40 0x7f85e414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e9bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e41512d0 con 0x7f85e40cf180 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e9bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4151890 con 0x7f85e40cc280 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e9bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4159810 con 0x7f85e415ac40 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e40cf180 0x7f85e41592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e40cf180 0x7f85e41592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42000/0 (socket says 172.21.15.142:42000) 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 -- 172.21.15.142:0/1653838247 learned_addr learned my addr 172.21.15.142:0/1653838247 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:28.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e37fe700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85e40cc280 0x7f85e40c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e3fff700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85e415ac40 0x7f85e414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 -- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85e415ac40 msgr2=0x7f85e414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85e415ac40 0x7f85e414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 -- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85e40cc280 msgr2=0x7f85e40c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85e40cc280 0x7f85e40c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e2ffd700 1 -- 172.21.15.142:0/1653838247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d4009420 con 0x7f85e40cf180 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.887+0000 7f85e37fe700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85e40cc280 0x7f85e40c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.888+0000 7f85e2ffd700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e40cf180 0x7f85e41592d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f85d800c7e0 tx=0x7f85d8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.888+0000 7f85cb7fe700 1 -- 172.21.15.142:0/1653838247 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8005b30 con 0x7f85e40cf180 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.888+0000 7f85cb7fe700 1 -- 172.21.15.142:0/1653838247 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8005c90 con 0x7f85e40cf180 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.888+0000 7f85cb7fe700 1 -- 172.21.15.142:0/1653838247 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8007300 con 0x7f85e40cf180 2023-09-30T22:58:28.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.888+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e4159ac0 con 0x7f85e40cf180 2023-09-30T22:58:28.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.888+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e4151520 con 0x7f85e40cf180 2023-09-30T22:58:28.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.889+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e4069770 con 0x7f85e40cf180 2023-09-30T22:58:28.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.890+0000 7f85cb7fe700 1 -- 172.21.15.142:0/1653838247 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f85d801b400 con 0x7f85e40cf180 2023-09-30T22:58:28.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.891+0000 7f85cb7fe700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f85d0067330 0x7f85d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:28.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.891+0000 7f85cb7fe700 1 -- 172.21.15.142:0/1653838247 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f85d8084820 con 0x7f85e40cf180 2023-09-30T22:58:28.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.891+0000 7f85e37fe700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f85d0067330 0x7f85d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:28.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.891+0000 7f85e37fe700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f85d0067330 0x7f85d00697e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f85d40030c0 tx=0x7f85d4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:28.895+0000 7f85cb7fe700 1 -- 172.21.15.142:0/1653838247 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f85d8051680 con 0x7f85e40cf180 2023-09-30T22:58:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.086+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85e415d5e0 con 0x7f85e40cf180 2023-09-30T22:58:29.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.627+0000 7f85cb7fe700 1 -- 172.21.15.142:0/1653838247 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 181+0+0 (secure 0 0 0) 0x7f85d8054ca0 con 0x7f85e40cf180 2023-09-30T22:58:29.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f85d0067330 msgr2=0x7f85d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:29.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f85d0067330 0x7f85d00697e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f85d40030c0 tx=0x7f85d4016000 comp rx=0 tx=0).stop 2023-09-30T22:58:29.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e40cf180 msgr2=0x7f85e41592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:29.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e40cf180 0x7f85e41592d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f85d800c7e0 tx=0x7f85d8007df0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 shutdown_connections 2023-09-30T22:58:29.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f85d0067330 0x7f85d00697e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85e415ac40 0x7f85e414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85e40cc280 0x7f85e40c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 --2- 172.21.15.142:0/1653838247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e40cf180 0x7f85e41592d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 >> 172.21.15.142:0/1653838247 conn(0x7f85e40d0a80 msgr2=0x7f85e40c8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:29.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 shutdown_connections 2023-09-30T22:58:29.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.630+0000 7f85e9bff700 1 -- 172.21.15.142:0/1653838247 wait complete. 2023-09-30T22:58:29.632 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:58:29.652 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:58:29.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.844+0000 7f02e21ff700 1 Processor -- start 2023-09-30T22:58:29.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.844+0000 7f02e21ff700 1 -- start start 2023-09-30T22:58:29.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02e21ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f02dc15ac40 0x7f02dc15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02e21ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 0x7f02dc06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02e21ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0d04e0 con 0x7f02dc0cf180 2023-09-30T22:58:29.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02e21ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0cc8f0 con 0x7f02dc15ac40 2023-09-30T22:58:29.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02e21ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0cf8d0 con 0x7f02dc0cc280 2023-09-30T22:58:29.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02daffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f02dc0cf180 0x7f02dc0cbb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48250/0 (socket says 172.21.15.142:48250) 2023-09-30T22:58:29.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02daffd700 1 -- 172.21.15.142:0/2388776517 learned_addr learned my addr 172.21.15.142:0/2388776517 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02db7fe700 1 --2- 172.21.15.142:0/2388776517 >> v2:172.21.15.148:3300/0 conn(0x7f02dc15ac40 0x7f02dc15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02dbfff700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 0x7f02dc06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335819873 0 0) 0x7f02dc0d04e0 con 0x7f02dc0cf180 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.846+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c4003570 con 0x7f02dc0cf180 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3382709489 0 0) 0x7f02c4003570 con 0x7f02dc0cf180 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 msgr2=0x7f02dc06a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 0x7f02dc06a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 >> v2:172.21.15.148:3300/0 conn(0x7f02dc15ac40 msgr2=0x7f02dc15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 --2- 172.21.15.142:0/2388776517 >> v2:172.21.15.148:3300/0 conn(0x7f02dc15ac40 0x7f02dc15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0cfbb0 con 0x7f02dc0cf180 2023-09-30T22:58:29.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f02d0001470 con 0x7f02dc0cf180 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 >> v1:172.21.15.142:6789/0 conn(0x7f02dc0cf180 legacy=0x7f02dc0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4003a60 0x7f02c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 0x7f02c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02c4004d50 0x7f02c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0cc8f0 con 0x7f02c4004d50 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0cf8d0 con 0x7f02c4003a60 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c400ba60 con 0x7f02dc0cc280 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02dbfff700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02c4004d50 0x7f02c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02db7fe700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4003a60 0x7f02c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.847+0000 7f02daffd700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 0x7f02c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02dbfff700 1 -- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 msgr2=0x7f02c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02dbfff700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc0cc280 0x7f02c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02dbfff700 1 -- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4003a60 msgr2=0x7f02c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02dbfff700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4003a60 0x7f02c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02dbfff700 1 -- 172.21.15.142:0/2388776517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4003570 con 0x7f02c4004d50 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02dbfff700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02c4004d50 0x7f02c40051c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0cc680 tx=0x7f02d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bead099da9fcadd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400ea30 con 0x7f02c4004d50 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d400f040 con 0x7f02c4004d50 2023-09-30T22:58:29.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02da7fc700 1 -- 172.21.15.142:0/2388776517 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400ede0 con 0x7f02c4004d50 2023-09-30T22:58:29.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02e21ff700 1 -- 172.21.15.142:0/2388776517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02c4004d50 msgr2=0x7f02c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:29.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.848+0000 7f02e21ff700 1 --2- 172.21.15.142:0/2388776517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02c4004d50 0x7f02c40051c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0cc680 tx=0x7f02d400b040 comp rx=0 tx=0).stop 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.849+0000 7f02dbfff700 1 -- 172.21.15.142:0/2388776517 reap_dead start 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.849+0000 7f02e21ff700 1 -- 172.21.15.142:0/2388776517 shutdown_connections 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.849+0000 7f02e21ff700 1 -- 172.21.15.142:0/2388776517 >> 172.21.15.142:0/2388776517 conn(0x7f02dc0d0a80 msgr2=0x7f02dc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.849+0000 7f02e21ff700 1 -- 172.21.15.142:0/2388776517 shutdown_connections 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.849+0000 7f02e21ff700 1 -- 172.21.15.142:0/2388776517 wait complete. 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.850+0000 7f02e21ff700 1 Processor -- start 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.850+0000 7f02e21ff700 1 -- start start 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02e21ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4004d50 0x7f02dc155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02e21ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02dc155d80 0x7f02dc16aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02e21ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc16af40 0x7f02dc16b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02e21ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc16b8f0 con 0x7f02dc155d80 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02e21ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc1570b0 con 0x7f02c4004d50 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02e21ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc156530 con 0x7f02dc16af40 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02daffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02dc155d80 0x7f02dc16aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02daffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02dc155d80 0x7f02dc16aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42024/0 (socket says 172.21.15.142:42024) 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.851+0000 7f02daffd700 1 -- 172.21.15.142:0/576607141 learned_addr learned my addr 172.21.15.142:0/576607141 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02db7fe700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4004d50 0x7f02dc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02dbfff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc16af40 0x7f02dc16b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02daffd700 1 -- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc16af40 msgr2=0x7f02dc16b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02daffd700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc16af40 0x7f02dc16b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02daffd700 1 -- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4004d50 msgr2=0x7f02dc155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02daffd700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4004d50 0x7f02dc155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02daffd700 1 -- 172.21.15.142:0/576607141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc156810 con 0x7f02dc155d80 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02dbfff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc16af40 0x7f02dc16b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02daffd700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02dc155d80 0x7f02dc16aa00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f02d0001d20 tx=0x7f02d0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02c37fe700 1 -- 172.21.15.142:0/576607141 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0018030 con 0x7f02dc155d80 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02c37fe700 1 -- 172.21.15.142:0/576607141 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d000f8a0 con 0x7f02dc155d80 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02c37fe700 1 -- 172.21.15.142:0/576607141 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d000fc60 con 0x7f02dc155d80 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc156af0 con 0x7f02dc155d80 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.852+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc152a20 con 0x7f02dc155d80 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.853+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc069770 con 0x7f02dc155d80 2023-09-30T22:58:29.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.854+0000 7f02c37fe700 1 -- 172.21.15.142:0/576607141 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f02d001b070 con 0x7f02dc155d80 2023-09-30T22:58:29.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.855+0000 7f02c37fe700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02c8067330 0x7f02c80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:29.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.855+0000 7f02c37fe700 1 -- 172.21.15.142:0/576607141 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5880+0+0 (secure 0 0 0) 0x7f02d0019070 con 0x7f02dc155d80 2023-09-30T22:58:29.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.855+0000 7f02db7fe700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02c8067330 0x7f02c80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:29.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.856+0000 7f02db7fe700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02c8067330 0x7f02c80697e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02cc006f00 tx=0x7f02cc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:29.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:29.860+0000 7f02c37fe700 1 -- 172.21.15.142:0/576607141 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f02d00519c0 con 0x7f02dc155d80 2023-09-30T22:58:30.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.056+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02dc0cc060 con 0x7f02dc155d80 2023-09-30T22:58:30.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.635+0000 7f02c37fe700 1 -- 172.21.15.142:0/576607141 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) v1 ==== 169+0+0 (secure 0 0 0) 0x7f02d0054fe0 con 0x7f02dc155d80 2023-09-30T22:58:30.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02c8067330 msgr2=0x7f02c80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:30.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02c8067330 0x7f02c80697e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02cc006f00 tx=0x7f02cc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02dc155d80 msgr2=0x7f02dc16aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:30.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02dc155d80 0x7f02dc16aa00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f02d0001d20 tx=0x7f02d0001e90 comp rx=0 tx=0).stop 2023-09-30T22:58:30.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 shutdown_connections 2023-09-30T22:58:30.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02c8067330 0x7f02c80697e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02dc16af40 0x7f02dc16b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02c4004d50 0x7f02dc155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 --2- 172.21.15.142:0/576607141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02dc155d80 0x7f02dc16aa00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 >> 172.21.15.142:0/576607141 conn(0x7f02dc0d0a80 msgr2=0x7f02dc152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:30.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 shutdown_connections 2023-09-30T22:58:30.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.639+0000 7f02e21ff700 1 -- 172.21.15.142:0/576607141 wait complete. 2023-09-30T22:58:30.641 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:58:30.659 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T22:58:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.848+0000 7f6e8b7ff700 1 Processor -- start 2023-09-30T22:58:30.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.849+0000 7f6e8b7ff700 1 -- start start 2023-09-30T22:58:30.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e8b7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6e840ca5e0 0x7f6e8406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:30.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e8b7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840b0de0 0x7f6e840681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:30.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e8b7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e84067d10 con 0x7f6e84159ba0 2023-09-30T22:58:30.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e8b7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8406af90 con 0x7f6e840ca5e0 2023-09-30T22:58:30.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e8b7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840676c0 con 0x7f6e840b0de0 2023-09-30T22:58:30.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e89d9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840b0de0 0x7f6e840681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:30.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e8959b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6e84159ba0 0x7f6e840c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:46934/0 (socket says 172.21.15.142:46934) 2023-09-30T22:58:30.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e8959b700 1 -- 172.21.15.142:0/1568311363 learned_addr learned my addr 172.21.15.142:0/1568311363 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:30.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.850+0000 7f6e88d9a700 1 --2- 172.21.15.142:0/1568311363 >> v2:172.21.15.148:3300/0 conn(0x7f6e840ca5e0 0x7f6e8406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:30.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e7bfff700 1 -- 172.21.15.142:0/1568311363 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761625378 0 0) 0x7f6e84067d10 con 0x7f6e84159ba0 2023-09-30T22:58:30.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e7bfff700 1 -- 172.21.15.142:0/1568311363 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e70003570 con 0x7f6e84159ba0 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e88d9a700 1 -- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840b0de0 msgr2=0x7f6e840681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e88d9a700 1 --2- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840b0de0 0x7f6e840681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e88d9a700 1 -- 172.21.15.142:0/1568311363 >> v1:172.21.15.148:6789/0 conn(0x7f6e84159ba0 legacy=0x7f6e840c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e88d9a700 1 -- 172.21.15.142:0/1568311363 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840679a0 con 0x7f6e840ca5e0 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e89d9c700 1 --2- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840b0de0 0x7f6e840681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e88d9a700 1 --2- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e840ca5e0 0x7f6e8406a8d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6e740098e0 tx=0x7f6e740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47a8db4a1f07917e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.851+0000 7f6e7bfff700 1 -- 172.21.15.142:0/1568311363 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74011630 con 0x7f6e840ca5e0 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e7bfff700 1 -- 172.21.15.142:0/1568311363 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e74011790 con 0x7f6e840ca5e0 2023-09-30T22:58:30.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e7bfff700 1 -- 172.21.15.142:0/1568311363 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74011b30 con 0x7f6e840ca5e0 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e840ca5e0 msgr2=0x7f6e8406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e840ca5e0 0x7f6e8406a8d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6e740098e0 tx=0x7f6e740091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/1568311363 shutdown_connections 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840b0de0 0x7f6e840681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/1568311363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e840ca5e0 0x7f6e8406a8d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/1568311363 >> 172.21.15.142:0/1568311363 conn(0x7f6e840cb2f0 msgr2=0x7f6e840cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/1568311363 shutdown_connections 2023-09-30T22:58:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.852+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/1568311363 wait complete. 2023-09-30T22:58:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.854+0000 7f6e8b7ff700 1 Processor -- start 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.854+0000 7f6e8b7ff700 1 -- start start 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8b7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e840b0de0 0x7f6e840c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8b7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840ca5e0 0x7f6e84157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8b7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e84159ba0 0x7f6e840cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8b7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841578b0 con 0x7f6e840b0de0 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8b7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8415b760 con 0x7f6e84159ba0 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8b7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8415ba40 con 0x7f6e840ca5e0 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8959b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e840b0de0 0x7f6e840c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8959b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e840b0de0 0x7f6e840c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42028/0 (socket says 172.21.15.142:42028) 2023-09-30T22:58:30.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8959b700 1 -- 172.21.15.142:0/3119240313 learned_addr learned my addr 172.21.15.142:0/3119240313 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e88d9a700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840ca5e0 0x7f6e84157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e89d9c700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e84159ba0 0x7f6e840cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8959b700 1 -- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840ca5e0 msgr2=0x7f6e84157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8959b700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840ca5e0 0x7f6e84157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8959b700 1 -- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e84159ba0 msgr2=0x7f6e840cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.855+0000 7f6e8959b700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e84159ba0 0x7f6e840cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e8959b700 1 -- 172.21.15.142:0/3119240313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c009a20 con 0x7f6e840b0de0 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e88d9a700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840ca5e0 0x7f6e84157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e8959b700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e840b0de0 0x7f6e840c8470 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000c590 tx=0x7f6e80007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e797fa700 1 -- 172.21.15.142:0/3119240313 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80005b30 con 0x7f6e840b0de0 2023-09-30T22:58:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e797fa700 1 -- 172.21.15.142:0/3119240313 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80005cb0 con 0x7f6e840b0de0 2023-09-30T22:58:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e74009420 con 0x7f6e840b0de0 2023-09-30T22:58:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e797fa700 1 -- 172.21.15.142:0/3119240313 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80007320 con 0x7f6e840b0de0 2023-09-30T22:58:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.856+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8415c000 con 0x7f6e840b0de0 2023-09-30T22:58:30.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.857+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8406e4b0 con 0x7f6e840b0de0 2023-09-30T22:58:30.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.858+0000 7f6e797fa700 1 -- 172.21.15.142:0/3119240313 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6e8001b3b0 con 0x7f6e840b0de0 2023-09-30T22:58:30.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.859+0000 7f6e797fa700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6e68067330 0x7f6e680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:30.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.859+0000 7f6e797fa700 1 -- 172.21.15.142:0/3119240313 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6e80083f60 con 0x7f6e840b0de0 2023-09-30T22:58:30.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.859+0000 7f6e88d9a700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6e68067330 0x7f6e680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:30.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.860+0000 7f6e88d9a700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6e68067330 0x7f6e680697e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6e840ca9e0 tx=0x7f6e74017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:30.863+0000 7f6e797fa700 1 -- 172.21.15.142:0/3119240313 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6e800510c0 con 0x7f6e840b0de0 2023-09-30T22:58:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.054+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6e840cac40 con 0x7f6e840b0de0 2023-09-30T22:58:31.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.059+0000 7f6e797fa700 1 -- 172.21.15.142:0/3119240313 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e800546e0 con 0x7f6e840b0de0 2023-09-30T22:58:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6e68067330 msgr2=0x7f6e680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6e68067330 0x7f6e680697e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6e840ca9e0 tx=0x7f6e74017000 comp rx=0 tx=0).stop 2023-09-30T22:58:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e840b0de0 msgr2=0x7f6e840c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e840b0de0 0x7f6e840c8470 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000c590 tx=0x7f6e80007e00 comp rx=0 tx=0).stop 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 shutdown_connections 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6e68067330 0x7f6e680697e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e84159ba0 0x7f6e840cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e840b0de0 0x7f6e840c8470 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 --2- 172.21.15.142:0/3119240313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6e840ca5e0 0x7f6e84157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 >> 172.21.15.142:0/3119240313 conn(0x7f6e840cb2f0 msgr2=0x7f6e84158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 shutdown_connections 2023-09-30T22:58:31.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.061+0000 7f6e8b7ff700 1 -- 172.21.15.142:0/3119240313 wait complete. 2023-09-30T22:58:31.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-09-30T22:58:31.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.269+0000 7f265ebff700 1 Processor -- start 2023-09-30T22:58:31.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.269+0000 7f265ebff700 1 -- start start 2023-09-30T22:58:31.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.270+0000 7f265ebff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f26580692f0 0x7f265815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.270+0000 7f265ebff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f265815dc50 0x7f265806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.270+0000 7f265ebff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26580cc6b0 con 0x7f2658143350 2023-09-30T22:58:31.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.270+0000 7f265ebff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265815e050 con 0x7f265815dc50 2023-09-30T22:58:31.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.270+0000 7f265ebff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26580cbaa0 con 0x7f26580692f0 2023-09-30T22:58:31.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f265815dc50 0x7f265806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f265815dc50 0x7f265806a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46570/0 (socket says 172.21.15.142:46570) 2023-09-30T22:58:31.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 -- 172.21.15.142:0/2453157448 learned_addr learned my addr 172.21.15.142:0/2453157448 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 -- 172.21.15.142:0/2453157448 >> v2:172.21.15.148:3300/0 conn(0x7f26580692f0 msgr2=0x7f265815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f2657fff700 1 --2- 172.21.15.142:0/2453157448 >> v2:172.21.15.148:3300/0 conn(0x7f26580692f0 0x7f265815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 --2- 172.21.15.142:0/2453157448 >> v2:172.21.15.148:3300/0 conn(0x7f26580692f0 0x7f265815d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 -- 172.21.15.142:0/2453157448 >> v1:172.21.15.148:6789/0 conn(0x7f2658143350 legacy=0x7f26580cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 -- 172.21.15.142:0/2453157448 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580cbd80 con 0x7f265815dc50 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f2657fff700 1 --2- 172.21.15.142:0/2453157448 >> v2:172.21.15.148:3300/0 conn(0x7f26580692f0 0x7f265815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.271+0000 7f265d19c700 1 --2- 172.21.15.142:0/2453157448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815dc50 0x7f265806a0c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2658069c90 tx=0x7f2650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b1e8e6039bb080 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f26577fe700 1 -- 172.21.15.142:0/2453157448 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265000e070 con 0x7f265815dc50 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f26577fe700 1 -- 172.21.15.142:0/2453157448 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265000ba10 con 0x7f265815dc50 2023-09-30T22:58:31.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f26577fe700 1 -- 172.21.15.142:0/2453157448 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500092e0 con 0x7f265815dc50 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 -- 172.21.15.142:0/2453157448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815dc50 msgr2=0x7f265806a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 --2- 172.21.15.142:0/2453157448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815dc50 0x7f265806a0c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2658069c90 tx=0x7f2650009840 comp rx=0 tx=0).stop 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 -- 172.21.15.142:0/2453157448 shutdown_connections 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 --2- 172.21.15.142:0/2453157448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815dc50 0x7f265806a0c0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 --2- 172.21.15.142:0/2453157448 >> v2:172.21.15.148:3300/0 conn(0x7f26580692f0 0x7f265815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 -- 172.21.15.142:0/2453157448 >> 172.21.15.142:0/2453157448 conn(0x7f26580ce8e0 msgr2=0x7f26580cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 -- 172.21.15.142:0/2453157448 shutdown_connections 2023-09-30T22:58:31.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.272+0000 7f265ebff700 1 -- 172.21.15.142:0/2453157448 wait complete. 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.274+0000 7f265ebff700 1 Processor -- start 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.274+0000 7f265ebff700 1 -- start start 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26580692f0 0x7f265815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265ebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2658143350 0x7f265814a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f265815dc50 0x7f265816db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265815b540 con 0x7f26580692f0 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265ebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2658147a90 con 0x7f2658143350 2023-09-30T22:58:31.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265815ac30 con 0x7f265815dc50 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26580692f0 0x7f265815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26580692f0 0x7f265815a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46578/0 (socket says 172.21.15.142:46578) 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 -- 172.21.15.142:0/1672195075 learned_addr learned my addr 172.21.15.142:0/1672195075 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f2657fff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2658143350 0x7f265814a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 -- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f265815dc50 msgr2=0x7f265816db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f265815dc50 0x7f265816db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 -- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2658143350 msgr2=0x7f265814a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2658143350 0x7f265814a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f265c99b700 1 -- 172.21.15.142:0/1672195075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650009ae0 con 0x7f26580692f0 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.275+0000 7f2657fff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2658143350 0x7f265814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:31.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.276+0000 7f265c99b700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26580692f0 0x7f265815a2e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c600 tx=0x7f264c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:31.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.276+0000 7f2654ff9700 1 -- 172.21.15.142:0/1672195075 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c011590 con 0x7f26580692f0 2023-09-30T22:58:31.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.276+0000 7f2654ff9700 1 -- 172.21.15.142:0/1672195075 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c011710 con 0x7f26580692f0 2023-09-30T22:58:31.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.276+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265814a9f0 con 0x7f26580692f0 2023-09-30T22:58:31.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.276+0000 7f2654ff9700 1 -- 172.21.15.142:0/1672195075 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c011ad0 con 0x7f26580692f0 2023-09-30T22:58:31.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.276+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265815ae80 con 0x7f26580692f0 2023-09-30T22:58:31.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.277+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265806ea70 con 0x7f26580692f0 2023-09-30T22:58:31.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.278+0000 7f2654ff9700 1 -- 172.21.15.142:0/1672195075 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f264c01c460 con 0x7f26580692f0 2023-09-30T22:58:31.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.279+0000 7f2654ff9700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f263c067330 0x7f263c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.279+0000 7f2654ff9700 1 -- 172.21.15.142:0/1672195075 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f264c084720 con 0x7f26580692f0 2023-09-30T22:58:31.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.279+0000 7f2657fff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f263c067330 0x7f263c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.279+0000 7f2657fff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f263c067330 0x7f263c0697e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2644006fd0 tx=0x7f2644008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:31.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.283+0000 7f2654ff9700 1 -- 172.21.15.142:0/1672195075 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f264c051880 con 0x7f26580692f0 2023-09-30T22:58:31.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.547+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f26580cc060 con 0x7f26580692f0 2023-09-30T22:58:31.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.636+0000 7f2654ff9700 1 -- 172.21.15.142:0/1672195075 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v314) v1 ==== 137+0+0 (secure 0 0 0) 0x7f264c054ea0 con 0x7f26580692f0 2023-09-30T22:58:31.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f263c067330 msgr2=0x7f263c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f263c067330 0x7f263c0697e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2644006fd0 tx=0x7f2644008040 comp rx=0 tx=0).stop 2023-09-30T22:58:31.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26580692f0 msgr2=0x7f265815a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26580692f0 0x7f265815a2e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c600 tx=0x7f264c007f60 comp rx=0 tx=0).stop 2023-09-30T22:58:31.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 shutdown_connections 2023-09-30T22:58:31.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f263c067330 0x7f263c0697e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f265815dc50 0x7f265816db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26580692f0 0x7f265815a2e0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 --2- 172.21.15.142:0/1672195075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2658143350 0x7f265814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 >> 172.21.15.142:0/1672195075 conn(0x7f26580ce8e0 msgr2=0x7f2658159230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:31.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 shutdown_connections 2023-09-30T22:58:31.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.639+0000 7f265ebff700 1 -- 172.21.15.142:0/1672195075 wait complete. 2023-09-30T22:58:31.657 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-09-30T22:58:31.658 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-09-30T22:58:31.658 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-09-30T22:58:31.658 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-09-30T22:58:31.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.847+0000 7fd75ddff700 1 Processor -- start 2023-09-30T22:58:31.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.847+0000 7fd75ddff700 1 -- start start 2023-09-30T22:58:31.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.848+0000 7fd75ddff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7580aebf0 0x7fd75806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.848+0000 7fd75ddff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd75806f190 0x7fd758159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.848+0000 7fd75ddff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7580b0ee0 con 0x7fd75815a0d0 2023-09-30T22:58:31.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.848+0000 7fd75ddff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7580aefc0 con 0x7fd7580aebf0 2023-09-30T22:58:31.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.848+0000 7fd75ddff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75815a4d0 con 0x7fd75806f190 2023-09-30T22:58:31.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7580aebf0 0x7fd75806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7580aebf0 0x7fd75806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46586/0 (socket says 172.21.15.142:46586) 2023-09-30T22:58:31.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 -- 172.21.15.142:0/1913778710 learned_addr learned my addr 172.21.15.142:0/1913778710 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:31.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd756ffd700 1 --2- 172.21.15.142:0/1913778710 >> v2:172.21.15.148:3300/0 conn(0x7fd75806f190 0x7fd758159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 -- 172.21.15.142:0/1913778710 >> v2:172.21.15.148:3300/0 conn(0x7fd75806f190 msgr2=0x7fd758159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 --2- 172.21.15.142:0/1913778710 >> v2:172.21.15.148:3300/0 conn(0x7fd75806f190 0x7fd758159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 -- 172.21.15.142:0/1913778710 >> v1:172.21.15.148:6789/0 conn(0x7fd75815a0d0 legacy=0x7fd758156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 -- 172.21.15.142:0/1913778710 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580b02d0 con 0x7fd7580aebf0 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.849+0000 7fd7577fe700 1 --2- 172.21.15.142:0/1913778710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7580aebf0 0x7fd75806ec50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd75806ce90 tx=0x7fd74800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72865319d75c113c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd7567fc700 1 -- 172.21.15.142:0/1913778710 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74800ca40 con 0x7fd7580aebf0 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd7567fc700 1 -- 172.21.15.142:0/1913778710 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74800cba0 con 0x7fd7580aebf0 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd7567fc700 1 -- 172.21.15.142:0/1913778710 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748018400 con 0x7fd7580aebf0 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 -- 172.21.15.142:0/1913778710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7580aebf0 msgr2=0x7fd75806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 --2- 172.21.15.142:0/1913778710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7580aebf0 0x7fd75806ec50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd75806ce90 tx=0x7fd74800a3f0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 -- 172.21.15.142:0/1913778710 shutdown_connections 2023-09-30T22:58:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 --2- 172.21.15.142:0/1913778710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7580aebf0 0x7fd75806ec50 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 --2- 172.21.15.142:0/1913778710 >> v2:172.21.15.148:3300/0 conn(0x7fd75806f190 0x7fd758159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 -- 172.21.15.142:0/1913778710 >> 172.21.15.142:0/1913778710 conn(0x7fd7580680c0 msgr2=0x7fd7580c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:31.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 -- 172.21.15.142:0/1913778710 shutdown_connections 2023-09-30T22:58:31.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.850+0000 7fd75ddff700 1 -- 172.21.15.142:0/1913778710 wait complete. 2023-09-30T22:58:31.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.852+0000 7fd75ddff700 1 Processor -- start 2023-09-30T22:58:31.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.852+0000 7fd75ddff700 1 -- start start 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd75ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd75806f190 0x7fd758156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd75ddff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7580aebf0 0x7fd75814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd75ddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd75815a0d0 0x7fd758154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd75ddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7581573c0 con 0x7fd75815a0d0 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd75ddff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75816a5b0 con 0x7fd7580aebf0 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd75ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75816a890 con 0x7fd75806f190 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd75815a0d0 0x7fd758154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd75815a0d0 0x7fd758154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46590/0 (socket says 172.21.15.142:46590) 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 -- 172.21.15.142:0/3152262286 learned_addr learned my addr 172.21.15.142:0/3152262286 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd756ffd700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7580aebf0 0x7fd75814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd7577fe700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd75806f190 0x7fd758156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 -- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd75806f190 msgr2=0x7fd758156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd75806f190 0x7fd758156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 -- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7580aebf0 msgr2=0x7fd75814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:31.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7580aebf0 0x7fd75814d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:31.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.853+0000 7fd757fff700 1 -- 172.21.15.142:0/3152262286 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74800a690 con 0x7fd75815a0d0 2023-09-30T22:58:31.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.854+0000 7fd757fff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd75815a0d0 0x7fd758154fa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c840 tx=0x7fd750001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:31.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.854+0000 7fd73f7fe700 1 -- 172.21.15.142:0/3152262286 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750012630 con 0x7fd75815a0d0 2023-09-30T22:58:31.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.854+0000 7fd73f7fe700 1 -- 172.21.15.142:0/3152262286 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7500127b0 con 0x7fd75815a0d0 2023-09-30T22:58:31.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.854+0000 7fd73f7fe700 1 -- 172.21.15.142:0/3152262286 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750012b70 con 0x7fd75815a0d0 2023-09-30T22:58:31.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.854+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75816ab70 con 0x7fd75815a0d0 2023-09-30T22:58:31.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.854+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75816b130 con 0x7fd75815a0d0 2023-09-30T22:58:31.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.855+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7580695b0 con 0x7fd75815a0d0 2023-09-30T22:58:31.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.856+0000 7fd73f7fe700 1 -- 172.21.15.142:0/3152262286 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd75001a3a0 con 0x7fd75815a0d0 2023-09-30T22:58:31.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.857+0000 7fd73f7fe700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd744067330 0x7fd7440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:31.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.857+0000 7fd73f7fe700 1 -- 172.21.15.142:0/3152262286 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd750084a50 con 0x7fd75815a0d0 2023-09-30T22:58:31.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.857+0000 7fd7577fe700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd744067330 0x7fd7440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:31.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.858+0000 7fd7577fe700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd744067330 0x7fd7440697e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd75806ce90 tx=0x7fd748018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:31.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:31.861+0000 7fd73f7fe700 1 -- 172.21.15.142:0/3152262286 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd750051bb0 con 0x7fd75815a0d0 2023-09-30T22:58:32.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.134+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fd75806fc10 con 0x7fd75815a0d0 2023-09-30T22:58:32.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.641+0000 7fd73f7fe700 1 -- 172.21.15.142:0/3152262286 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v315) v1 ==== 131+0+0 (secure 0 0 0) 0x7fd7500551d0 con 0x7fd75815a0d0 2023-09-30T22:58:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd744067330 msgr2=0x7fd7440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd744067330 0x7fd7440697e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd75806ce90 tx=0x7fd748018000 comp rx=0 tx=0).stop 2023-09-30T22:58:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd75815a0d0 msgr2=0x7fd758154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd75815a0d0 0x7fd758154fa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c840 tx=0x7fd750001670 comp rx=0 tx=0).stop 2023-09-30T22:58:32.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 shutdown_connections 2023-09-30T22:58:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd744067330 0x7fd7440697e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd75815a0d0 0x7fd758154fa0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd75806f190 0x7fd758156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 --2- 172.21.15.142:0/3152262286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7580aebf0 0x7fd75814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 >> 172.21.15.142:0/3152262286 conn(0x7fd7580680c0 msgr2=0x7fd7580ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 shutdown_connections 2023-09-30T22:58:32.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.644+0000 7fd75ddff700 1 -- 172.21.15.142:0/3152262286 wait complete. 2023-09-30T22:58:32.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:58:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.856+0000 7f517d7ff700 1 Processor -- start 2023-09-30T22:58:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.857+0000 7f517d7ff700 1 -- start start 2023-09-30T22:58:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.858+0000 7f517d7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5178159ba0 0x7f517806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.858+0000 7f517d7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51780ca5e0 0x7f51780681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.858+0000 7f517d7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5178067d10 con 0x7f51780b0de0 2023-09-30T22:58:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.858+0000 7f517d7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517806af90 con 0x7f51780ca5e0 2023-09-30T22:58:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.858+0000 7f517d7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51780676c0 con 0x7f5178159ba0 2023-09-30T22:58:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51780ca5e0 0x7f51780681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51780ca5e0 0x7f51780681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46594/0 (socket says 172.21.15.142:46594) 2023-09-30T22:58:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 -- 172.21.15.142:0/3168242834 learned_addr learned my addr 172.21.15.142:0/3168242834 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f5176ffd700 1 --2- 172.21.15.142:0/3168242834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5178159ba0 0x7f517806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 -- 172.21.15.142:0/3168242834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5178159ba0 msgr2=0x7f517806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 --2- 172.21.15.142:0/3168242834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5178159ba0 0x7f517806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 -- 172.21.15.142:0/3168242834 >> v1:172.21.15.148:6789/0 conn(0x7f51780b0de0 legacy=0x7f51780c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 -- 172.21.15.142:0/3168242834 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780679a0 con 0x7f51780ca5e0 2023-09-30T22:58:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.859+0000 7f51777fe700 1 --2- 172.21.15.142:0/3168242834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f51780681a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5170009f20 tx=0x7f5170009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867b6e550925b90f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f5175ffb700 1 -- 172.21.15.142:0/3168242834 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517000e070 con 0x7f51780ca5e0 2023-09-30T22:58:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f5175ffb700 1 -- 172.21.15.142:0/3168242834 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517000ba80 con 0x7f51780ca5e0 2023-09-30T22:58:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f5175ffb700 1 -- 172.21.15.142:0/3168242834 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51700092e0 con 0x7f51780ca5e0 2023-09-30T22:58:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 -- 172.21.15.142:0/3168242834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 msgr2=0x7f51780681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 --2- 172.21.15.142:0/3168242834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f51780681a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5170009f20 tx=0x7f5170009840 comp rx=0 tx=0).stop 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 -- 172.21.15.142:0/3168242834 shutdown_connections 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 --2- 172.21.15.142:0/3168242834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f51780681a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 --2- 172.21.15.142:0/3168242834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5178159ba0 0x7f517806a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 -- 172.21.15.142:0/3168242834 >> 172.21.15.142:0/3168242834 conn(0x7f51780cb2f0 msgr2=0x7f51780cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 -- 172.21.15.142:0/3168242834 shutdown_connections 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.860+0000 7f517d7ff700 1 -- 172.21.15.142:0/3168242834 wait complete. 2023-09-30T22:58:32.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.862+0000 7f517d7ff700 1 Processor -- start 2023-09-30T22:58:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.862+0000 7f517d7ff700 1 -- start start 2023-09-30T22:58:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f517d7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51780b0de0 0x7f51780c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f517d7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f517815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f517d7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5178159ba0 0x7f517814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f517d7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517815ba80 con 0x7f51780ca5e0 2023-09-30T22:58:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f517d7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517815bd60 con 0x7f5178159ba0 2023-09-30T22:58:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f517d7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517815c040 con 0x7f51780b0de0 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f51767fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f517815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f51767fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f517815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46606/0 (socket says 172.21.15.142:46606) 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f51767fc700 1 -- 172.21.15.142:0/1858570936 learned_addr learned my addr 172.21.15.142:0/1858570936 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f5176ffd700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51780b0de0 0x7f51780c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.863+0000 7f51777fe700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5178159ba0 0x7f517814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f51767fc700 1 -- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51780b0de0 msgr2=0x7f51780c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f51767fc700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51780b0de0 0x7f51780c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f51767fc700 1 -- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5178159ba0 msgr2=0x7f517814c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f51767fc700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5178159ba0 0x7f517814c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f51767fc700 1 -- 172.21.15.142:0/1858570936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5170009ae0 con 0x7f51780ca5e0 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f51767fc700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f517815d560 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c590 tx=0x7f516c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f515effd700 1 -- 172.21.15.142:0/1858570936 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c011590 con 0x7f51780ca5e0 2023-09-30T22:58:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f515effd700 1 -- 172.21.15.142:0/1858570936 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c011710 con 0x7f51780ca5e0 2023-09-30T22:58:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f515effd700 1 -- 172.21.15.142:0/1858570936 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c011ad0 con 0x7f51780ca5e0 2023-09-30T22:58:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517815c320 con 0x7f51780ca5e0 2023-09-30T22:58:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.864+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51780c6ea0 con 0x7f51780ca5e0 2023-09-30T22:58:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.865+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517806e4b0 con 0x7f51780ca5e0 2023-09-30T22:58:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.866+0000 7f515effd700 1 -- 172.21.15.142:0/1858570936 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f516c01b3b0 con 0x7f51780ca5e0 2023-09-30T22:58:32.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.867+0000 7f515effd700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5164067330 0x7f51640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:32.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.867+0000 7f515effd700 1 -- 172.21.15.142:0/1858570936 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f516c083d90 con 0x7f51780ca5e0 2023-09-30T22:58:32.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.867+0000 7f5176ffd700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5164067330 0x7f51640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:32.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.868+0000 7f5176ffd700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5164067330 0x7f51640697e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f51780c9c50 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:32.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:32.871+0000 7f515effd700 1 -- 172.21.15.142:0/1858570936 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f516c050ef0 con 0x7f51780ca5e0 2023-09-30T22:58:33.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.061+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f51780cac40 con 0x7f51780ca5e0 2023-09-30T22:58:33.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.065+0000 7f515effd700 1 -- 172.21.15.142:0/1858570936 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f516c017070 con 0x7f51780ca5e0 2023-09-30T22:58:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5164067330 msgr2=0x7f51640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5164067330 0x7f51640697e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f51780c9c50 tx=0x7f5168008040 comp rx=0 tx=0).stop 2023-09-30T22:58:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 msgr2=0x7f517815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f517815d560 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c590 tx=0x7f516c00c8a0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 shutdown_connections 2023-09-30T22:58:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5164067330 0x7f51640697e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5178159ba0 0x7f517814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51780b0de0 0x7f51780c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 --2- 172.21.15.142:0/1858570936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780ca5e0 0x7f517815d560 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 >> 172.21.15.142:0/1858570936 conn(0x7f51780cb2f0 msgr2=0x7f5178158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 shutdown_connections 2023-09-30T22:58:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.068+0000 7f517d7ff700 1 -- 172.21.15.142:0/1858570936 wait complete. 2023-09-30T22:58:33.086 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:58:33.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:58:33.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:58:33.287 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:58:33.287 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:58:33.287 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:33.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.477+0000 7f4211bff700 1 Processor -- start 2023-09-30T22:58:33.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.477+0000 7f4211bff700 1 -- start start 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.478+0000 7f4211bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f420c0b1180 0x7f420c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4211bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c15d910 con 0x7f420c159eb0 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4211bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c15e490 con 0x7f420c159ae0 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4211bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c15e920 con 0x7f420c0b1180 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4203fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f420c0b1180 0x7f420c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f420bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f420c159eb0 0x7f420c069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55336/0 (socket says 172.21.15.142:55336) 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4203fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f420c0b1180 0x7f420c0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46608/0 (socket says 172.21.15.142:46608) 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f420bfff700 1 -- 172.21.15.142:0/2908073419 learned_addr learned my addr 172.21.15.142:0/2908073419 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4203fff700 1 -- 172.21.15.142:0/2908073419 >> v1:172.21.15.148:6789/0 conn(0x7f420c159ae0 legacy=0x7f420c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4203fff700 1 -- 172.21.15.142:0/2908073419 >> v1:172.21.15.142:6789/0 conn(0x7f420c159eb0 legacy=0x7f420c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4203fff700 1 -- 172.21.15.142:0/2908073419 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0ce5c0 con 0x7f420c0b1180 2023-09-30T22:58:33.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.479+0000 7f4203fff700 1 --2- 172.21.15.142:0/2908073419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c0b1180 0x7f420c0cbe80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098e0 tx=0x7f41f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97b4b1fb519eff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:33.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f420affd700 1 -- 172.21.15.142:0/2908073419 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4009e80 con 0x7f420c0b1180 2023-09-30T22:58:33.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f420affd700 1 -- 172.21.15.142:0/2908073419 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f400b820 con 0x7f420c0b1180 2023-09-30T22:58:33.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f420affd700 1 -- 172.21.15.142:0/2908073419 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400bba0 con 0x7f420c0b1180 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f4211bff700 1 -- 172.21.15.142:0/2908073419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c0b1180 msgr2=0x7f420c0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f4211bff700 1 --2- 172.21.15.142:0/2908073419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c0b1180 0x7f420c0cbe80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098e0 tx=0x7f41f40091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f4211bff700 1 -- 172.21.15.142:0/2908073419 shutdown_connections 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f4211bff700 1 --2- 172.21.15.142:0/2908073419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c0b1180 0x7f420c0cbe80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f4211bff700 1 -- 172.21.15.142:0/2908073419 >> 172.21.15.142:0/2908073419 conn(0x7f420c0ce8b0 msgr2=0x7f420c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.480+0000 7f4211bff700 1 -- 172.21.15.142:0/2908073419 shutdown_connections 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.481+0000 7f4211bff700 1 -- 172.21.15.142:0/2908073419 wait complete. 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.482+0000 7f4211bff700 1 Processor -- start 2023-09-30T22:58:33.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.482+0000 7f4211bff700 1 -- start start 2023-09-30T22:58:33.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4211bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c0b1180 0x7f420c0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:33.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4211bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c159ae0 0x7f420c16abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:33.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4211bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c159eb0 0x7f420c16b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:33.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4211bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0c8fb0 con 0x7f420c159ae0 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4211bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0c83a0 con 0x7f420c159eb0 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4211bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0c8680 con 0x7f420c0b1180 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c159ae0 0x7f420c16abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c159ae0 0x7f420c16abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46610/0 (socket says 172.21.15.142:46610) 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 -- 172.21.15.142:0/326057506 learned_addr learned my addr 172.21.15.142:0/326057506 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 -- 172.21.15.142:0/326057506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c0b1180 msgr2=0x7f420c0c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c0b1180 0x7f420c0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 -- 172.21.15.142:0/326057506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c159eb0 msgr2=0x7f420c16b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c159eb0 0x7f420c16b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.483+0000 7f4203fff700 1 -- 172.21.15.142:0/326057506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009420 con 0x7f420c159ae0 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.484+0000 7f4203fff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c159ae0 0x7f420c16abe0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f41f40030c0 tx=0x7f41f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:33.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.484+0000 7f42037fe700 1 -- 172.21.15.142:0/326057506 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400bae0 con 0x7f420c159ae0 2023-09-30T22:58:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.484+0000 7f42037fe700 1 -- 172.21.15.142:0/326057506 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4020070 con 0x7f420c159ae0 2023-09-30T22:58:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.484+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c0c8960 con 0x7f420c159ae0 2023-09-30T22:58:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.484+0000 7f42037fe700 1 -- 172.21.15.142:0/326057506 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f401b6a0 con 0x7f420c159ae0 2023-09-30T22:58:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.484+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c0c80b0 con 0x7f420c159ae0 2023-09-30T22:58:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.485+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c06ea70 con 0x7f420c159ae0 2023-09-30T22:58:33.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.486+0000 7f42037fe700 1 -- 172.21.15.142:0/326057506 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f41f4022030 con 0x7f420c159ae0 2023-09-30T22:58:33.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.488+0000 7f42037fe700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41ec067330 0x7f41ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:33.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.488+0000 7f42037fe700 1 -- 172.21.15.142:0/326057506 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f41f4086830 con 0x7f420c159ae0 2023-09-30T22:58:33.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.488+0000 7f420b7fe700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41ec067330 0x7f41ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:33.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.488+0000 7f420b7fe700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41ec067330 0x7f41ec0697e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f41fc007fd0 tx=0x7f41fc007b20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:33.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.492+0000 7f42037fe700 1 -- 172.21.15.142:0/326057506 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f41f4053a30 con 0x7f420c159ae0 2023-09-30T22:58:33.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.727+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f420c06ea70 con 0x7f420c159ae0 2023-09-30T22:58:33.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.728+0000 7f42037fe700 1 -- 172.21.15.142:0/326057506 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f41f4057050 con 0x7f420c159ae0 2023-09-30T22:58:33.729 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:33.729 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2200074322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2200074322},{"type":"v1","addr":"172.21.15.142:6837","nonce":2200074322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3476956492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3476956492},{"type":"v1","addr":"172.21.15.148:6835","nonce":3476956492}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4280555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4280555979},{"type":"v1","addr":"172.21.15.148:6834","nonce":4280555979}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/4203163759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":4203163759},{"type":"v1","addr":"172.21.15.142:6836","nonce":4203163759}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[]} 2023-09-30T22:58:33.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41ec067330 msgr2=0x7f41ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41ec067330 0x7f41ec0697e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f41fc007fd0 tx=0x7f41fc007b20 comp rx=0 tx=0).stop 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c159ae0 msgr2=0x7f420c16abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c159ae0 0x7f420c16abe0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f41f40030c0 tx=0x7f41f4016000 comp rx=0 tx=0).stop 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 shutdown_connections 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f41ec067330 0x7f41ec0697e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f420c159eb0 0x7f420c16b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f420c0b1180 0x7f420c0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 --2- 172.21.15.142:0/326057506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f420c159ae0 0x7f420c16abe0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.730+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 >> 172.21.15.142:0/326057506 conn(0x7f420c0ce8b0 msgr2=0x7f420c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:33.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.731+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 shutdown_connections 2023-09-30T22:58:33.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:33.731+0000 7f4211bff700 1 -- 172.21.15.142:0/326057506 wait complete. 2023-09-30T22:58:33.733 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 52 2023-09-30T22:58:33.749 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:58:33.749 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:58:33.750 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:58:33.750 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:58:33.750 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:58:33.750 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:58:33.750 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:58:33.750 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:58:33.751 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:58:33.751 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:58:33.751 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:58:33.751 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:58:33.751 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:58:33.751 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:58:33.752 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:58:33.752 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:58:33.765 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:58:33.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:58:33.766 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:58:33.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:58:33.770 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:58:33.770 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:58:33.771 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:58:33.771 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:58:33.810 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:58:33.810 DEBUG:teuthology.parallel:result is None 2023-09-30T22:58:33.813 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:58:33.813 DEBUG:teuthology.parallel:result is None 2023-09-30T22:58:33.814 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:58:33.815 DEBUG:teuthology.parallel:result is None 2023-09-30T22:58:33.817 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:58:33.817 DEBUG:teuthology.parallel:result is None 2023-09-30T22:58:33.818 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:58:33.958 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:58:33.960 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:58:33.961 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:58:33.961 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:58:34.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.020+0000 7f54cadff700 1 Processor -- start 2023-09-30T22:58:34.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.020+0000 7f54cadff700 1 -- start start 2023-09-30T22:58:34.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.021+0000 7f54cadff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54c40af020 0x7f54c4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:34.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.021+0000 7f54cadff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c40b00d0 0x7f54c406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.021+0000 7f54cadff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54c406e650 0x7f54c40b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54cadff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c406d3e0 con 0x7f54c40af020 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54cadff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c406dc80 con 0x7f54c406e650 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54cadff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c406b790 con 0x7f54c40b00d0 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54c40af020 0x7f54c4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54c40af020 0x7f54c4156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46652/0 (socket says 172.21.15.142:46652) 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 -- 172.21.15.142:0/1052661912 learned_addr learned my addr 172.21.15.142:0/1052661912 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c3fff700 1 --2- 172.21.15.142:0/1052661912 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c40b00d0 0x7f54c406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:34.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c939c700 1 --2- 172.21.15.142:0/1052661912 >> v2:172.21.15.148:3300/0 conn(0x7f54c406e650 0x7f54c40b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 -- 172.21.15.142:0/1052661912 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c40b00d0 msgr2=0x7f54c406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 --2- 172.21.15.142:0/1052661912 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c40b00d0 0x7f54c406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 -- 172.21.15.142:0/1052661912 >> v2:172.21.15.148:3300/0 conn(0x7f54c406e650 msgr2=0x7f54c40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 --2- 172.21.15.142:0/1052661912 >> v2:172.21.15.148:3300/0 conn(0x7f54c406e650 0x7f54c40b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.022+0000 7f54c8b9b700 1 -- 172.21.15.142:0/1052661912 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40b0650 con 0x7f54c40af020 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54c8b9b700 1 --2- 172.21.15.142:0/1052661912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40af020 0x7f54c4156d80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f54c40c9c40 tx=0x7f54b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5be01ae23cb3d7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54c37fe700 1 -- 172.21.15.142:0/1052661912 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800b640 con 0x7f54c40af020 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54c37fe700 1 -- 172.21.15.142:0/1052661912 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b800b7a0 con 0x7f54c40af020 2023-09-30T22:58:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54c37fe700 1 -- 172.21.15.142:0/1052661912 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800bb60 con 0x7f54c40af020 2023-09-30T22:58:34.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54cadff700 1 -- 172.21.15.142:0/1052661912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40af020 msgr2=0x7f54c4156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54cadff700 1 --2- 172.21.15.142:0/1052661912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40af020 0x7f54c4156d80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f54c40c9c40 tx=0x7f54b8009250 comp rx=0 tx=0).stop 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54cadff700 1 -- 172.21.15.142:0/1052661912 shutdown_connections 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54cadff700 1 --2- 172.21.15.142:0/1052661912 >> v2:172.21.15.148:3300/0 conn(0x7f54c406e650 0x7f54c40b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54cadff700 1 --2- 172.21.15.142:0/1052661912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40af020 0x7f54c4156d80 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54cadff700 1 --2- 172.21.15.142:0/1052661912 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c40b00d0 0x7f54c406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.023+0000 7f54cadff700 1 -- 172.21.15.142:0/1052661912 >> 172.21.15.142:0/1052661912 conn(0x7f54c40680c0 msgr2=0x7f54c40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.024+0000 7f54cadff700 1 -- 172.21.15.142:0/1052661912 shutdown_connections 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.024+0000 7f54cadff700 1 -- 172.21.15.142:0/1052661912 wait complete. 2023-09-30T22:58:34.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.026+0000 7f54cadff700 1 Processor -- start 2023-09-30T22:58:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.026+0000 7f54cadff700 1 -- start start 2023-09-30T22:58:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54cadff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c406e650 0x7f54c414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54cadff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54c40af020 0x7f54c40a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54cadff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40b00d0 0x7f54c40c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54cadff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40a7620 con 0x7f54c40b00d0 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54cadff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40a6cf0 con 0x7f54c40af020 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54cadff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40a6fd0 con 0x7f54c406e650 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54c939c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40b00d0 0x7f54c40c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54c939c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40b00d0 0x7f54c40c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46654/0 (socket says 172.21.15.142:46654) 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54c8b9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c406e650 0x7f54c414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54c939c700 1 -- 172.21.15.142:0/2548956301 learned_addr learned my addr 172.21.15.142:0/2548956301 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.027+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54c40af020 0x7f54c40a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c939c700 1 -- 172.21.15.142:0/2548956301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c406e650 msgr2=0x7f54c414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c939c700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c406e650 0x7f54c414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c939c700 1 -- 172.21.15.142:0/2548956301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54c40af020 msgr2=0x7f54c40a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c939c700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54c40af020 0x7f54c40a5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c939c700 1 -- 172.21.15.142:0/2548956301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80094f0 con 0x7f54c40b00d0 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c939c700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40b00d0 0x7f54c40c68a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009df0 tx=0x7f54bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c0ff9700 1 -- 172.21.15.142:0/2548956301 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00caa0 con 0x7f54c40b00d0 2023-09-30T22:58:34.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c0ff9700 1 -- 172.21.15.142:0/2548956301 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00f040 con 0x7f54c40b00d0 2023-09-30T22:58:34.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54c0ff9700 1 -- 172.21.15.142:0/2548956301 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00ce70 con 0x7f54c40b00d0 2023-09-30T22:58:34.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c40a72b0 con 0x7f54c40b00d0 2023-09-30T22:58:34.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.028+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c414e330 con 0x7f54c40b00d0 2023-09-30T22:58:34.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.030+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c40a77d0 con 0x7f54c40b00d0 2023-09-30T22:58:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.030+0000 7f54c0ff9700 1 -- 172.21.15.142:0/2548956301 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f54bc014690 con 0x7f54c40b00d0 2023-09-30T22:58:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.031+0000 7f54c0ff9700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f54a8067330 0x7f54a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.032+0000 7f54c0ff9700 1 -- 172.21.15.142:0/2548956301 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f54bc0853f0 con 0x7f54c40b00d0 2023-09-30T22:58:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.032+0000 7f54c8b9b700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f54a8067330 0x7f54a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:34.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.032+0000 7f54c8b9b700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f54a8067330 0x7f54a80697e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54c40c9c40 tx=0x7f54b8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:34.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.036+0000 7f54c0ff9700 1 -- 172.21.15.142:0/2548956301 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f54c40a77d0 con 0x7f54c40b00d0 2023-09-30T22:58:34.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:34.243+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54c40c89b0 con 0x7f54c40b00d0 2023-09-30T22:58:35.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.337+0000 7f54c0ff9700 1 -- 172.21.15.142:0/2548956301 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54bc056080 con 0x7f54c40b00d0 2023-09-30T22:58:35.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f54a8067330 msgr2=0x7f54a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f54a8067330 0x7f54a80697e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54c40c9c40 tx=0x7f54b8017000 comp rx=0 tx=0).stop 2023-09-30T22:58:35.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40b00d0 msgr2=0x7f54c40c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40b00d0 0x7f54c40c68a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009df0 tx=0x7f54bc00b040 comp rx=0 tx=0).stop 2023-09-30T22:58:35.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 shutdown_connections 2023-09-30T22:58:35.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f54a8067330 0x7f54a80697e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54c40b00d0 0x7f54c40c68a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54c406e650 0x7f54c414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 --2- 172.21.15.142:0/2548956301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54c40af020 0x7f54c40a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 >> 172.21.15.142:0/2548956301 conn(0x7f54c40680c0 msgr2=0x7f54c40cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:35.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 shutdown_connections 2023-09-30T22:58:35.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.341+0000 7f54cadff700 1 -- 172.21.15.142:0/2548956301 wait complete. 2023-09-30T22:58:35.343 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:58:35.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:58:35.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.555+0000 7effacfff700 1 Processor -- start 2023-09-30T22:58:35.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.556+0000 7effacfff700 1 -- start start 2023-09-30T22:58:35.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.557+0000 7effacfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa806e820 0x7effa8161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:35.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.557+0000 7effacfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa806d3e0 con 0x7effa80af020 2023-09-30T22:58:35.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.557+0000 7effacfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa806dc80 con 0x7effa80b00d0 2023-09-30T22:58:35.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.557+0000 7effacfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa815b400 con 0x7effa806e820 2023-09-30T22:58:35.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.557+0000 7effa659c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7effa80af020 0x7effa8156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55352/0 (socket says 172.21.15.142:55352) 2023-09-30T22:58:35.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.557+0000 7effa659c700 1 -- 172.21.15.142:0/3144035002 learned_addr learned my addr 172.21.15.142:0/3144035002 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:35.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.557+0000 7effa6d9d700 1 --2- 172.21.15.142:0/3144035002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa806e820 0x7effa8161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063984962 0 0) 0x7effa806d3e0 con 0x7effa80af020 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff90003570 con 0x7effa80af020 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163241212 0 0) 0x7effa806dc80 con 0x7effa80b00d0 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa806d3e0 con 0x7effa80b00d0 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111420704 0 0) 0x7eff90003570 con 0x7effa80af020 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa6d9d700 1 -- 172.21.15.142:0/3144035002 >> v1:172.21.15.148:6789/0 conn(0x7effa80b00d0 legacy=0x7effa806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa6d9d700 1 -- 172.21.15.142:0/3144035002 >> v1:172.21.15.142:6789/0 conn(0x7effa80af020 legacy=0x7effa8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa6d9d700 1 -- 172.21.15.142:0/3144035002 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa806eca0 con 0x7effa806e820 2023-09-30T22:58:35.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.558+0000 7effa6d9d700 1 --2- 172.21.15.142:0/3144035002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa806e820 0x7effa8161790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effa0009e90 tx=0x7effa0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceaf60b5fd327b1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:35.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa000e070 con 0x7effa806e820 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa000b870 con 0x7effa806e820 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effa559a700 1 -- 172.21.15.142:0/3144035002 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98001470 con 0x7effa806e820 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effacfff700 1 -- 172.21.15.142:0/3144035002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa806e820 msgr2=0x7effa8161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effacfff700 1 --2- 172.21.15.142:0/3144035002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa806e820 0x7effa8161790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effa0009e90 tx=0x7effa0009780 comp rx=0 tx=0).stop 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effacfff700 1 -- 172.21.15.142:0/3144035002 shutdown_connections 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effacfff700 1 --2- 172.21.15.142:0/3144035002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa806e820 0x7effa8161790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effacfff700 1 -- 172.21.15.142:0/3144035002 >> 172.21.15.142:0/3144035002 conn(0x7effa80680c0 msgr2=0x7effa80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effacfff700 1 -- 172.21.15.142:0/3144035002 shutdown_connections 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.559+0000 7effacfff700 1 -- 172.21.15.142:0/3144035002 wait complete. 2023-09-30T22:58:35.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.561+0000 7effacfff700 1 Processor -- start 2023-09-30T22:58:35.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.561+0000 7effacfff700 1 -- start start 2023-09-30T22:58:35.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effacfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa806e820 0x7effa8151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effacfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa80af020 0x7effa80a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effacfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa80b00d0 0x7effa81588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effacfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa8158410 con 0x7effa80af020 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effacfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80a6ff0 con 0x7effa806e820 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effacfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa8157520 con 0x7effa80b00d0 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa80af020 0x7effa80a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa80af020 0x7effa80a8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46662/0 (socket says 172.21.15.142:46662) 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effa5d9b700 1 -- 172.21.15.142:0/884453963 learned_addr learned my addr 172.21.15.142:0/884453963 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.562+0000 7effa659c700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa806e820 0x7effa8151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa5d9b700 1 -- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa80b00d0 msgr2=0x7effa81588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa6d9d700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa80b00d0 0x7effa81588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:35.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa5d9b700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa80b00d0 0x7effa81588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa5d9b700 1 -- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa806e820 msgr2=0x7effa8151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa5d9b700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa806e820 0x7effa8151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa5d9b700 1 -- 172.21.15.142:0/884453963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009a20 con 0x7effa80af020 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa659c700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa806e820 0x7effa8151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa6d9d700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa80b00d0 0x7effa81588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effa5d9b700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa80af020 0x7effa80a8630 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c7c0 tx=0x7eff9c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7eff967fc700 1 -- 172.21.15.142:0/884453963 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c016070 con 0x7effa80af020 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7eff967fc700 1 -- 172.21.15.142:0/884453963 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c011680 con 0x7effa80af020 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa8157800 con 0x7effa80af020 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7eff967fc700 1 -- 172.21.15.142:0/884453963 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c011a20 con 0x7effa80af020 2023-09-30T22:58:35.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.563+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa8157dc0 con 0x7effa80af020 2023-09-30T22:58:35.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.564+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa80695b0 con 0x7effa80af020 2023-09-30T22:58:35.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.565+0000 7eff967fc700 1 -- 172.21.15.142:0/884453963 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff9c012440 con 0x7effa80af020 2023-09-30T22:58:35.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.567+0000 7eff967fc700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff88067330 0x7eff880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:35.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.567+0000 7eff967fc700 1 -- 172.21.15.142:0/884453963 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5206+0+0 (secure 0 0 0) 0x7eff9c0846f0 con 0x7effa80af020 2023-09-30T22:58:35.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.567+0000 7effa659c700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff88067330 0x7eff880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:35.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.568+0000 7effa659c700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff88067330 0x7eff880697e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff98001ed0 tx=0x7eff98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:35.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.571+0000 7eff967fc700 1 -- 172.21.15.142:0/884453963 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff9c0518a0 con 0x7effa80af020 2023-09-30T22:58:35.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.836+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7effa806fc10 con 0x7effa80af020 2023-09-30T22:58:35.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.836+0000 7eff967fc700 1 -- 172.21.15.142:0/884453963 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7eff9c054ec0 con 0x7effa80af020 2023-09-30T22:58:35.837 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:58:35.838 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:58:35.840 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.841 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:58:35.843 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.845 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:58:35.846 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T22:58:35.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:58:35.849 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.850 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:58:35.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:58:35.852 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:35.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff88067330 msgr2=0x7eff880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff88067330 0x7eff880697e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff98001ed0 tx=0x7eff98009040 comp rx=0 tx=0).stop 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa80af020 msgr2=0x7effa80a8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa80af020 0x7effa80a8630 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c7c0 tx=0x7eff9c007dd0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 shutdown_connections 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff88067330 0x7eff880697e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effa80b00d0 0x7effa81588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa806e820 0x7effa8151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 --2- 172.21.15.142:0/884453963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effa80af020 0x7effa80a8630 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 >> 172.21.15.142:0/884453963 conn(0x7effa80680c0 msgr2=0x7effa80af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 shutdown_connections 2023-09-30T22:58:35.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:35.839+0000 7effacfff700 1 -- 172.21.15.142:0/884453963 wait complete. 2023-09-30T22:58:35.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:36.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.047+0000 7fc098dff700 1 Processor -- start 2023-09-30T22:58:36.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.047+0000 7fc098dff700 1 -- start start 2023-09-30T22:58:36.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.048+0000 7fc098dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09415de20 0x7fc094164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.048+0000 7fc098dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940cc6b0 con 0x7fc094143350 2023-09-30T22:58:36.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.048+0000 7fc098dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940cbaa0 con 0x7fc0940692f0 2023-09-30T22:58:36.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.048+0000 7fc098dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940cbd80 con 0x7fc09415de20 2023-09-30T22:58:36.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.048+0000 7fc09259c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc094143350 0x7fc0940cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55362/0 (socket says 172.21.15.142:55362) 2023-09-30T22:58:36.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.048+0000 7fc09259c700 1 -- 172.21.15.142:0/4238614654 learned_addr learned my addr 172.21.15.142:0/4238614654 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:36.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc092d9d700 1 --2- 172.21.15.142:0/4238614654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09415de20 0x7fc094164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc09159a700 1 -- 172.21.15.142:0/4238614654 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083171482 0 0) 0x7fc0940cc6b0 con 0x7fc094143350 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc09159a700 1 -- 172.21.15.142:0/4238614654 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc07c003570 con 0x7fc094143350 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc09159a700 1 -- 172.21.15.142:0/4238614654 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235552754 0 0) 0x7fc0940cbaa0 con 0x7fc0940692f0 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc09159a700 1 -- 172.21.15.142:0/4238614654 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0940cc6b0 con 0x7fc0940692f0 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc092d9d700 1 -- 172.21.15.142:0/4238614654 >> v1:172.21.15.148:6789/0 conn(0x7fc0940692f0 legacy=0x7fc09415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc092d9d700 1 -- 172.21.15.142:0/4238614654 >> v1:172.21.15.142:6789/0 conn(0x7fc094143350 legacy=0x7fc0940cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc092d9d700 1 -- 172.21.15.142:0/4238614654 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940cc060 con 0x7fc09415de20 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.049+0000 7fc092d9d700 1 --2- 172.21.15.142:0/4238614654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09415de20 0x7fc094164ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009e90 tx=0x7fc08c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7893ef0b8e17bfc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc09159a700 1 -- 172.21.15.142:0/4238614654 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00e070 con 0x7fc09415de20 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc09159a700 1 -- 172.21.15.142:0/4238614654 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00bb80 con 0x7fc09415de20 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc09159a700 1 -- 172.21.15.142:0/4238614654 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c012430 con 0x7fc09415de20 2023-09-30T22:58:36.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc098dff700 1 -- 172.21.15.142:0/4238614654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09415de20 msgr2=0x7fc094164ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc098dff700 1 --2- 172.21.15.142:0/4238614654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09415de20 0x7fc094164ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009e90 tx=0x7fc08c009780 comp rx=0 tx=0).stop 2023-09-30T22:58:36.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc098dff700 1 -- 172.21.15.142:0/4238614654 shutdown_connections 2023-09-30T22:58:36.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc098dff700 1 --2- 172.21.15.142:0/4238614654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc09415de20 0x7fc094164ab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc098dff700 1 -- 172.21.15.142:0/4238614654 >> 172.21.15.142:0/4238614654 conn(0x7fc0940ce8e0 msgr2=0x7fc0940cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:36.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc098dff700 1 -- 172.21.15.142:0/4238614654 shutdown_connections 2023-09-30T22:58:36.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.050+0000 7fc098dff700 1 -- 172.21.15.142:0/4238614654 wait complete. 2023-09-30T22:58:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.052+0000 7fc098dff700 1 Processor -- start 2023-09-30T22:58:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.052+0000 7fc098dff700 1 -- start start 2023-09-30T22:58:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc098dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940692f0 0x7fc0940b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc098dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094143350 0x7fc09415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc098dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09415de20 0x7fc09415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc098dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094136b50 con 0x7fc094143350 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc098dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940b3cf0 con 0x7fc09415de20 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc098dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940b30e0 con 0x7fc0940692f0 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc091d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094143350 0x7fc09415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc091d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094143350 0x7fc09415a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46674/0 (socket says 172.21.15.142:46674) 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc091d9b700 1 -- 172.21.15.142:0/2733984303 learned_addr learned my addr 172.21.15.142:0/2733984303 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc09259c700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940692f0 0x7fc0940b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.053+0000 7fc092d9d700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09415de20 0x7fc09415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc091d9b700 1 -- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940692f0 msgr2=0x7fc0940b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc091d9b700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940692f0 0x7fc0940b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc091d9b700 1 -- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09415de20 msgr2=0x7fc09415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc091d9b700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09415de20 0x7fc09415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc091d9b700 1 -- 172.21.15.142:0/2733984303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009a20 con 0x7fc094143350 2023-09-30T22:58:36.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc091d9b700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094143350 0x7fc09415a3b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c790 tx=0x7fc088007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc0827fc700 1 -- 172.21.15.142:0/2733984303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088010510 con 0x7fc094143350 2023-09-30T22:58:36.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc0827fc700 1 -- 172.21.15.142:0/2733984303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088010670 con 0x7fc094143350 2023-09-30T22:58:36.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc0827fc700 1 -- 172.21.15.142:0/2733984303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088010a10 con 0x7fc094143350 2023-09-30T22:58:36.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940b33c0 con 0x7fc094143350 2023-09-30T22:58:36.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.054+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940b3980 con 0x7fc094143350 2023-09-30T22:58:36.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.055+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940b4720 con 0x7fc094143350 2023-09-30T22:58:36.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.056+0000 7fc0827fc700 1 -- 172.21.15.142:0/2733984303 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc08801b3b0 con 0x7fc094143350 2023-09-30T22:58:36.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.057+0000 7fc0827fc700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.057+0000 7fc0827fc700 1 -- 172.21.15.142:0/2733984303 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc088084190 con 0x7fc094143350 2023-09-30T22:58:36.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.057+0000 7fc09259c700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.058+0000 7fc09259c700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc084007fd0 tx=0x7fc084009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.061+0000 7fc0827fc700 1 -- 172.21.15.142:0/2733984303 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc088051340 con 0x7fc094143350 2023-09-30T22:58:36.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.255+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0940b3e30 con 0x7fc094143350 2023-09-30T22:58:36.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.256+0000 7fc0827fc700 1 -- 172.21.15.142:0/2733984303 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+13806 (secure 0 0 0) 0x7fc088054960 con 0x7fc094143350 2023-09-30T22:58:36.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:36.257 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":126,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:35.334384+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:36.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 msgr2=0x7fc0740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc084007fd0 tx=0x7fc084009040 comp rx=0 tx=0).stop 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094143350 msgr2=0x7fc09415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094143350 0x7fc09415a3b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c790 tx=0x7fc088007e10 comp rx=0 tx=0).stop 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 shutdown_connections 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc074067330 0x7fc0740697e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc09415de20 0x7fc09415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0940692f0 0x7fc0940b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 --2- 172.21.15.142:0/2733984303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094143350 0x7fc09415a3b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.258+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 >> 172.21.15.142:0/2733984303 conn(0x7fc0940ce8e0 msgr2=0x7fc0940c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.259+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 shutdown_connections 2023-09-30T22:58:36.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.259+0000 7fc098dff700 1 -- 172.21.15.142:0/2733984303 wait complete. 2023-09-30T22:58:36.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:58:36.278 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:58:36.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.469+0000 7fbdf21ff700 1 Processor -- start 2023-09-30T22:58:36.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.469+0000 7fbdf21ff700 1 -- start start 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.470+0000 7fbdf21ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec159ba0 0x7fbdec06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdf21ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbdec0ca5e0 0x7fbdec0681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdf21ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec067d10 con 0x7fbdec0b0de0 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdf21ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec06af90 con 0x7fbdec0ca5e0 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdf21ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0676c0 con 0x7fbdec159ba0 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbdec0ca5e0 0x7fbdec0681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdebfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbdec0ca5e0 0x7fbdec0681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46686/0 (socket says 172.21.15.142:46686) 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdebfff700 1 -- 172.21.15.142:0/3164862197 learned_addr learned my addr 172.21.15.142:0/3164862197 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:36.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdeb7fe700 1 --2- 172.21.15.142:0/3164862197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec159ba0 0x7fbdec06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdebfff700 1 -- 172.21.15.142:0/3164862197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec159ba0 msgr2=0x7fbdec06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdebfff700 1 --2- 172.21.15.142:0/3164862197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec159ba0 0x7fbdec06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdebfff700 1 -- 172.21.15.142:0/3164862197 >> v1:172.21.15.148:6789/0 conn(0x7fbdec0b0de0 legacy=0x7fbdec0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.471+0000 7fbdebfff700 1 -- 172.21.15.142:0/3164862197 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0679a0 con 0x7fbdec0ca5e0 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdebfff700 1 --2- 172.21.15.142:0/3164862197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec0ca5e0 0x7fbdec0681a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009f20 tx=0x7fbde4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516bdecb3c31e371 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdea7fc700 1 -- 172.21.15.142:0/3164862197 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde400e070 con 0x7fbdec0ca5e0 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdea7fc700 1 -- 172.21.15.142:0/3164862197 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400b9d0 con 0x7fbdec0ca5e0 2023-09-30T22:58:36.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdea7fc700 1 -- 172.21.15.142:0/3164862197 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40092e0 con 0x7fbdec0ca5e0 2023-09-30T22:58:36.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdf21ff700 1 -- 172.21.15.142:0/3164862197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec0ca5e0 msgr2=0x7fbdec0681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/3164862197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec0ca5e0 0x7fbdec0681a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009f20 tx=0x7fbde4009840 comp rx=0 tx=0).stop 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdf21ff700 1 -- 172.21.15.142:0/3164862197 shutdown_connections 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/3164862197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec0ca5e0 0x7fbdec0681a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.472+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/3164862197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec159ba0 0x7fbdec06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.473+0000 7fbdf21ff700 1 -- 172.21.15.142:0/3164862197 >> 172.21.15.142:0/3164862197 conn(0x7fbdec0cb2f0 msgr2=0x7fbdec0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.473+0000 7fbdf21ff700 1 -- 172.21.15.142:0/3164862197 shutdown_connections 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.473+0000 7fbdf21ff700 1 -- 172.21.15.142:0/3164862197 wait complete. 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.474+0000 7fbdf21ff700 1 Processor -- start 2023-09-30T22:58:36.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.474+0000 7fbdf21ff700 1 -- start start 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.475+0000 7fbdf21ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdec0b0de0 0x7fbdec0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.475+0000 7fbdf21ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec0ca5e0 0x7fbdec15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.475+0000 7fbdf21ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec159ba0 0x7fbdec14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.475+0000 7fbdf21ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec15ba80 con 0x7fbdec159ba0 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.475+0000 7fbdf21ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec15bd60 con 0x7fbdec0b0de0 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.475+0000 7fbdf21ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec15c040 con 0x7fbdec0ca5e0 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.475+0000 7fbdebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec159ba0 0x7fbdec14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec159ba0 0x7fbdec14c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46696/0 (socket says 172.21.15.142:46696) 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 -- 172.21.15.142:0/1574075220 learned_addr learned my addr 172.21.15.142:0/1574075220 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdeaffd700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec0ca5e0 0x7fbdec15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdeb7fe700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdec0b0de0 0x7fbdec0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 -- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec0ca5e0 msgr2=0x7fbdec15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec0ca5e0 0x7fbdec15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 -- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdec0b0de0 msgr2=0x7fbdec0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdec0b0de0 0x7fbdec0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 -- 172.21.15.142:0/1574075220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4009ae0 con 0x7fbdec159ba0 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdeaffd700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec0ca5e0 0x7fbdec15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdeb7fe700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdec0b0de0 0x7fbdec0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdebfff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec159ba0 0x7fbdec14c8f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbdec06c8d0 tx=0x7fbde4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdd37fe700 1 -- 172.21.15.142:0/1574075220 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4008c30 con 0x7fbdec159ba0 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdd37fe700 1 -- 172.21.15.142:0/1574075220 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4008d90 con 0x7fbdec159ba0 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec15c320 con 0x7fbdec159ba0 2023-09-30T22:58:36.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.476+0000 7fbdd37fe700 1 -- 172.21.15.142:0/1574075220 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40266b0 con 0x7fbdec159ba0 2023-09-30T22:58:36.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.477+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec0c6ea0 con 0x7fbdec159ba0 2023-09-30T22:58:36.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.478+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec06e4b0 con 0x7fbdec159ba0 2023-09-30T22:58:36.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.478+0000 7fbdd37fe700 1 -- 172.21.15.142:0/1574075220 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbde4003040 con 0x7fbdec159ba0 2023-09-30T22:58:36.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.479+0000 7fbdd37fe700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbdd8067330 0x7fbdd80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.479+0000 7fbdd37fe700 1 -- 172.21.15.142:0/1574075220 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbde4086610 con 0x7fbdec159ba0 2023-09-30T22:58:36.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.479+0000 7fbdeb7fe700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbdd8067330 0x7fbdd80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.480+0000 7fbdeb7fe700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbdd8067330 0x7fbdd80697e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0c9c50 tx=0x7fbddc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.484+0000 7fbdd37fe700 1 -- 172.21.15.142:0/1574075220 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbde40537c0 con 0x7fbdec159ba0 2023-09-30T22:58:36.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.674+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdec0cac40 con 0x7fbdec159ba0 2023-09-30T22:58:36.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.674+0000 7fbdd37fe700 1 -- 172.21.15.142:0/1574075220 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbde4056de0 con 0x7fbdec159ba0 2023-09-30T22:58:36.675 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbdd8067330 msgr2=0x7fbdd80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbdd8067330 0x7fbdd80697e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0c9c50 tx=0x7fbddc008040 comp rx=0 tx=0).stop 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec159ba0 msgr2=0x7fbdec14c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec159ba0 0x7fbdec14c8f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbdec06c8d0 tx=0x7fbde4018000 comp rx=0 tx=0).stop 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 shutdown_connections 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbdd8067330 0x7fbdd80697e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdec159ba0 0x7fbdec14c8f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdec0b0de0 0x7fbdec0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 --2- 172.21.15.142:0/1574075220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbdec0ca5e0 0x7fbdec15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.676+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 >> 172.21.15.142:0/1574075220 conn(0x7fbdec0cb2f0 msgr2=0x7fbdec158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:36.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.677+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 shutdown_connections 2023-09-30T22:58:36.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.677+0000 7fbdf21ff700 1 -- 172.21.15.142:0/1574075220 wait complete. 2023-09-30T22:58:36.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:58:36.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.886+0000 7f320f5ff700 1 Processor -- start 2023-09-30T22:58:36.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.886+0000 7f320f5ff700 1 -- start start 2023-09-30T22:58:36.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.887+0000 7f320f5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32080cc3b0 0x7f320815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.887+0000 7f320f5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080d0550 con 0x7f3208157ab0 2023-09-30T22:58:36.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.887+0000 7f320f5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080cf940 con 0x7f32080cbfe0 2023-09-30T22:58:36.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.887+0000 7f320f5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080cfc20 con 0x7f32080cc3b0 2023-09-30T22:58:36.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.887+0000 7f320cb9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3208157ab0 0x7f320806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55368/0 (socket says 172.21.15.142:55368) 2023-09-30T22:58:36.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.887+0000 7f320cb9a700 1 -- 172.21.15.142:0/3923872077 learned_addr learned my addr 172.21.15.142:0/3923872077 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:36.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.887+0000 7f320db9c700 1 --2- 172.21.15.142:0/3923872077 >> v2:172.21.15.142:3300/0 conn(0x7f32080cc3b0 0x7f320815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f31fffff700 1 -- 172.21.15.142:0/3923872077 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446189561 0 0) 0x7f32080d0550 con 0x7f3208157ab0 2023-09-30T22:58:36.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f320db9c700 1 -- 172.21.15.142:0/3923872077 >> v1:172.21.15.148:6789/0 conn(0x7f32080cbfe0 legacy=0x7f32081573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f320db9c700 1 -- 172.21.15.142:0/3923872077 >> v1:172.21.15.142:6789/0 conn(0x7f3208157ab0 legacy=0x7f320806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f320db9c700 1 -- 172.21.15.142:0/3923872077 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32080cff00 con 0x7f32080cc3b0 2023-09-30T22:58:36.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f320db9c700 1 --2- 172.21.15.142:0/3923872077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32080cc3b0 0x7f320815a2a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3200009e60 tx=0x7f3200009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afda931aae77d6bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f31fffff700 1 -- 172.21.15.142:0/3923872077 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320000e070 con 0x7f32080cc3b0 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f31fffff700 1 -- 172.21.15.142:0/3923872077 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320000bc30 con 0x7f32080cc3b0 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.888+0000 7f31fffff700 1 -- 172.21.15.142:0/3923872077 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200012430 con 0x7f32080cc3b0 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.889+0000 7f320f5ff700 1 -- 172.21.15.142:0/3923872077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32080cc3b0 msgr2=0x7f320815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.889+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3923872077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32080cc3b0 0x7f320815a2a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3200009e60 tx=0x7f3200009780 comp rx=0 tx=0).stop 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.889+0000 7f320f5ff700 1 -- 172.21.15.142:0/3923872077 shutdown_connections 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.889+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3923872077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32080cc3b0 0x7f320815a2a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.889+0000 7f320f5ff700 1 -- 172.21.15.142:0/3923872077 >> 172.21.15.142:0/3923872077 conn(0x7f32080d0a80 msgr2=0x7f32080d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.889+0000 7f320f5ff700 1 -- 172.21.15.142:0/3923872077 shutdown_connections 2023-09-30T22:58:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.889+0000 7f320f5ff700 1 -- 172.21.15.142:0/3923872077 wait complete. 2023-09-30T22:58:36.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.890+0000 7f320f5ff700 1 Processor -- start 2023-09-30T22:58:36.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.891+0000 7f320f5ff700 1 -- start start 2023-09-30T22:58:36.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.891+0000 7f320f5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32080cbfe0 0x7f32080c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.891+0000 7f320f5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32080cc3b0 0x7f3208158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.891+0000 7f320f5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3208157ab0 0x7f3208158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.891+0000 7f320f5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080c5590 con 0x7f3208157ab0 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.891+0000 7f320f5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080c5870 con 0x7f32080cbfe0 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.891+0000 7f320f5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080c5b50 con 0x7f32080cc3b0 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3208157ab0 0x7f3208158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3208157ab0 0x7f3208158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46708/0 (socket says 172.21.15.142:46708) 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 -- 172.21.15.142:0/3660261267 learned_addr learned my addr 172.21.15.142:0/3660261267 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320d39b700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32080cbfe0 0x7f32080c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320cb9a700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32080cc3b0 0x7f3208158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 -- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32080cc3b0 msgr2=0x7f3208158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32080cc3b0 0x7f3208158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 -- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32080cbfe0 msgr2=0x7f32080c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:36.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32080cbfe0 0x7f32080c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:36.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 -- 172.21.15.142:0/3660261267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200009a20 con 0x7f3208157ab0 2023-09-30T22:58:36.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.892+0000 7f320db9c700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3208157ab0 0x7f3208158690 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3200013000 tx=0x7f3200019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.893+0000 7f31fd7fa700 1 -- 172.21.15.142:0/3660261267 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320001b630 con 0x7f3208157ab0 2023-09-30T22:58:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.893+0000 7f31fd7fa700 1 -- 172.21.15.142:0/3660261267 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320001b790 con 0x7f3208157ab0 2023-09-30T22:58:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.893+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32080c5e30 con 0x7f3208157ab0 2023-09-30T22:58:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.893+0000 7f31fd7fa700 1 -- 172.21.15.142:0/3660261267 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320001bb30 con 0x7f3208157ab0 2023-09-30T22:58:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.893+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3208147940 con 0x7f3208157ab0 2023-09-30T22:58:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.894+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3208069770 con 0x7f3208157ab0 2023-09-30T22:58:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.895+0000 7f31fd7fa700 1 -- 172.21.15.142:0/3660261267 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f320001c400 con 0x7f3208157ab0 2023-09-30T22:58:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.895+0000 7f31fd7fa700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f31ec067330 0x7f31ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.895+0000 7f31fd7fa700 1 -- 172.21.15.142:0/3660261267 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f32000868f0 con 0x7f3208157ab0 2023-09-30T22:58:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.896+0000 7f320d39b700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f31ec067330 0x7f31ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.896+0000 7f320d39b700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f31ec067330 0x7f31ec0697e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3204003860 tx=0x7f3204009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:36.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:36.900+0000 7f31fd7fa700 1 -- 172.21.15.142:0/3660261267 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3200053aa0 con 0x7f3208157ab0 2023-09-30T22:58:37.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.091+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f320806fc10 con 0x7f3208157ab0 2023-09-30T22:58:37.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.092+0000 7f31fd7fa700 1 -- 172.21.15.142:0/3660261267 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7f320002a0a0 con 0x7f3208157ab0 2023-09-30T22:58:37.093 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:58:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f31ec067330 msgr2=0x7f31ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f31ec067330 0x7f31ec0697e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3204003860 tx=0x7f3204009040 comp rx=0 tx=0).stop 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3208157ab0 msgr2=0x7f3208158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3208157ab0 0x7f3208158690 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3200013000 tx=0x7f3200019000 comp rx=0 tx=0).stop 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 shutdown_connections 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f31ec067330 0x7f31ec0697e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3208157ab0 0x7f3208158690 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32080cbfe0 0x7f32080c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 --2- 172.21.15.142:0/3660261267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32080cc3b0 0x7f3208158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 >> 172.21.15.142:0/3660261267 conn(0x7f32080d0a80 msgr2=0x7f32081567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.094+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 shutdown_connections 2023-09-30T22:58:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.095+0000 7f320f5ff700 1 -- 172.21.15.142:0/3660261267 wait complete. 2023-09-30T22:58:37.113 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:58:37.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.303+0000 7f71431ff700 1 Processor -- start 2023-09-30T22:58:37.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.303+0000 7f71431ff700 1 -- start start 2023-09-30T22:58:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.304+0000 7f71431ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0aebf0 0x7f713c06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.304+0000 7f71431ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0b0ee0 con 0x7f713c15a2a0 2023-09-30T22:58:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.304+0000 7f71431ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0b02d0 con 0x7f713c06f190 2023-09-30T22:58:37.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.304+0000 7f71431ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0aefc0 con 0x7f713c0aebf0 2023-09-30T22:58:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.304+0000 7f714179c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f713c15a2a0 0x7f713c069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55370/0 (socket says 172.21.15.142:55370) 2023-09-30T22:58:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f714179c700 1 -- 172.21.15.142:0/3723070069 learned_addr learned my addr 172.21.15.142:0/3723070069 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f7140f9b700 1 --2- 172.21.15.142:0/3723070069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0aebf0 0x7f713c06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f713b7fe700 1 -- 172.21.15.142:0/3723070069 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202019213 0 0) 0x7f713c0b0ee0 con 0x7f713c15a2a0 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f713b7fe700 1 -- 172.21.15.142:0/3723070069 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c003570 con 0x7f713c15a2a0 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f713b7fe700 1 -- 172.21.15.142:0/3723070069 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310981868 0 0) 0x7f713c0b02d0 con 0x7f713c06f190 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f713b7fe700 1 -- 172.21.15.142:0/3723070069 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713c0b0ee0 con 0x7f713c06f190 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f7140f9b700 1 -- 172.21.15.142:0/3723070069 >> v1:172.21.15.148:6789/0 conn(0x7f713c06f190 legacy=0x7f713c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f7140f9b700 1 -- 172.21.15.142:0/3723070069 >> v1:172.21.15.142:6789/0 conn(0x7f713c15a2a0 legacy=0x7f713c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f7140f9b700 1 -- 172.21.15.142:0/3723070069 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0b05b0 con 0x7f713c0aebf0 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.305+0000 7f7140f9b700 1 --2- 172.21.15.142:0/3723070069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0aebf0 0x7f713c06ec50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f713000aac0 tx=0x7f713000a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ec0db117415587 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f713b7fe700 1 -- 172.21.15.142:0/3723070069 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713000c970 con 0x7f713c0aebf0 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f713b7fe700 1 -- 172.21.15.142:0/3723070069 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713000cad0 con 0x7f713c0aebf0 2023-09-30T22:58:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f713b7fe700 1 -- 172.21.15.142:0/3723070069 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713000ce70 con 0x7f713c0aebf0 2023-09-30T22:58:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f71431ff700 1 -- 172.21.15.142:0/3723070069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0aebf0 msgr2=0x7f713c06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f71431ff700 1 --2- 172.21.15.142:0/3723070069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0aebf0 0x7f713c06ec50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f713000aac0 tx=0x7f713000a330 comp rx=0 tx=0).stop 2023-09-30T22:58:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f71431ff700 1 -- 172.21.15.142:0/3723070069 shutdown_connections 2023-09-30T22:58:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f71431ff700 1 --2- 172.21.15.142:0/3723070069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0aebf0 0x7f713c06ec50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f71431ff700 1 -- 172.21.15.142:0/3723070069 >> 172.21.15.142:0/3723070069 conn(0x7f713c0680c0 msgr2=0x7f713c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f71431ff700 1 -- 172.21.15.142:0/3723070069 shutdown_connections 2023-09-30T22:58:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.306+0000 7f71431ff700 1 -- 172.21.15.142:0/3723070069 wait complete. 2023-09-30T22:58:37.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.308+0000 7f71431ff700 1 Processor -- start 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.308+0000 7f71431ff700 1 -- start start 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f71431ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c06f190 0x7f713c14e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f71431ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0aebf0 0x7f713c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f71431ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f713c15a2a0 0x7f713c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f71431ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0cbf70 con 0x7f713c15a2a0 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f71431ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c14e6b0 con 0x7f713c0aebf0 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f71431ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0cb9b0 con 0x7f713c06f190 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f714179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f713c15a2a0 0x7f713c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f714179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f713c15a2a0 0x7f713c151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46714/0 (socket says 172.21.15.142:46714) 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f714179c700 1 -- 172.21.15.142:0/776434921 learned_addr learned my addr 172.21.15.142:0/776434921 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f7140f9b700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c06f190 0x7f713c14e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f713bfff700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0aebf0 0x7f713c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f714179c700 1 -- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c06f190 msgr2=0x7f713c14e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f714179c700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c06f190 0x7f713c14e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f714179c700 1 -- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0aebf0 msgr2=0x7f713c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.309+0000 7f714179c700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0aebf0 0x7f713c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.310+0000 7f714179c700 1 -- 172.21.15.142:0/776434921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713000a5d0 con 0x7f713c15a2a0 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.310+0000 7f714179c700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f713c15a2a0 0x7f713c151490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f713400cb70 tx=0x7f71340019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.310+0000 7f7138ff9700 1 -- 172.21.15.142:0/776434921 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400a8b0 con 0x7f713c15a2a0 2023-09-30T22:58:37.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.310+0000 7f7138ff9700 1 -- 172.21.15.142:0/776434921 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400aa30 con 0x7f713c15a2a0 2023-09-30T22:58:37.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.310+0000 7f7138ff9700 1 -- 172.21.15.142:0/776434921 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400adf0 con 0x7f713c15a2a0 2023-09-30T22:58:37.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.310+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0cbc90 con 0x7f713c15a2a0 2023-09-30T22:58:37.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.310+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c157830 con 0x7f713c15a2a0 2023-09-30T22:58:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.311+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c1573b0 con 0x7f713c15a2a0 2023-09-30T22:58:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.312+0000 7f7138ff9700 1 -- 172.21.15.142:0/776434921 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7134007300 con 0x7f713c15a2a0 2023-09-30T22:58:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.313+0000 7f7138ff9700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.313+0000 7f7138ff9700 1 -- 172.21.15.142:0/776434921 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7134084bb0 con 0x7f713c15a2a0 2023-09-30T22:58:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.313+0000 7f7140f9b700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.314+0000 7f7140f9b700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f713000aa10 tx=0x7f713001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:37.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.317+0000 7f7138ff9700 1 -- 172.21.15.142:0/776434921 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f713c1573b0 con 0x7f713c15a2a0 2023-09-30T22:58:37.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.510+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f713c1573b0 con 0x7f713c15a2a0 2023-09-30T22:58:37.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.511+0000 7f7138ff9700 1 -- 172.21.15.142:0/776434921 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) v1 ==== 84+0+126 (secure 0 0 0) 0x7f713c1573b0 con 0x7f713c15a2a0 2023-09-30T22:58:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:37.512 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:58:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:58:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:58:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:58:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:58:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:58:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:58:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:58:37.513 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:58:37.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 msgr2=0x7f71200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f713000aa10 tx=0x7f713001a000 comp rx=0 tx=0).stop 2023-09-30T22:58:37.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f713c15a2a0 msgr2=0x7f713c151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f713c15a2a0 0x7f713c151490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f713400cb70 tx=0x7f71340019e0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 shutdown_connections 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f713c15a2a0 0x7f713c151490 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c06f190 0x7f713c14e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 --2- 172.21.15.142:0/776434921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0aebf0 0x7f713c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 >> 172.21.15.142:0/776434921 conn(0x7f713c0680c0 msgr2=0x7f713c14ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 shutdown_connections 2023-09-30T22:58:37.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.513+0000 7f71431ff700 1 -- 172.21.15.142:0/776434921 wait complete. 2023-09-30T22:58:37.531 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:58:37.532 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:58:37.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.726+0000 7f6cbfdff700 1 Processor -- start 2023-09-30T22:58:37.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.726+0000 7f6cbfdff700 1 -- start start 2023-09-30T22:58:37.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbfdff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6cb815ac40 0x7f6cb815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbfdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cc280 0x7f6cb806a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbfdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb80d04e0 con 0x7f6cb80cf180 2023-09-30T22:58:37.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbfdff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb80cc8f0 con 0x7f6cb815ac40 2023-09-30T22:58:37.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbfdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80cf8d0 con 0x7f6cb80cc280 2023-09-30T22:58:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbdb9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6cb815ac40 0x7f6cb815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbe39c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cc280 0x7f6cb806a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbdb9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6cb815ac40 0x7f6cb815a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:51004/0 (socket says 172.21.15.142:51004) 2023-09-30T22:58:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.728+0000 7f6cbdb9b700 1 -- 172.21.15.142:0/1205879111 learned_addr learned my addr 172.21.15.142:0/1205879111 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbdb9b700 1 -- 172.21.15.142:0/1205879111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cc280 msgr2=0x7f6cb806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:37.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbdb9b700 1 --2- 172.21.15.142:0/1205879111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cc280 0x7f6cb806a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbdb9b700 1 -- 172.21.15.142:0/1205879111 >> v1:172.21.15.148:6789/0 conn(0x7f6cb80cf180 legacy=0x7f6cb80cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbdb9b700 1 -- 172.21.15.142:0/1205879111 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80cfbb0 con 0x7f6cb815ac40 2023-09-30T22:58:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbcb99700 1 -- 172.21.15.142:0/1205879111 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483897324 0 0) 0x7f6cb80d04e0 con 0x7f6cb80cf180 2023-09-30T22:58:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbdb9b700 1 --2- 172.21.15.142:0/1205879111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb815ac40 0x7f6cb815a220 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40099b0 tx=0x7f6cb4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631d16e0891f2c4e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbcb99700 1 -- 172.21.15.142:0/1205879111 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4009ea0 con 0x7f6cb815ac40 2023-09-30T22:58:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbcb99700 1 -- 172.21.15.142:0/1205879111 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb400b860 con 0x7f6cb815ac40 2023-09-30T22:58:37.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.729+0000 7f6cbcb99700 1 -- 172.21.15.142:0/1205879111 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400bc00 con 0x7f6cb815ac40 2023-09-30T22:58:37.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 -- 172.21.15.142:0/1205879111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb815ac40 msgr2=0x7f6cb815a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/1205879111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb815ac40 0x7f6cb815a220 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40099b0 tx=0x7f6cb4009250 comp rx=0 tx=0).stop 2023-09-30T22:58:37.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 -- 172.21.15.142:0/1205879111 shutdown_connections 2023-09-30T22:58:37.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/1205879111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cc280 0x7f6cb806a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/1205879111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb815ac40 0x7f6cb815a220 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 -- 172.21.15.142:0/1205879111 >> 172.21.15.142:0/1205879111 conn(0x7f6cb80d0a80 msgr2=0x7f6cb80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:37.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 -- 172.21.15.142:0/1205879111 shutdown_connections 2023-09-30T22:58:37.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.730+0000 7f6cbfdff700 1 -- 172.21.15.142:0/1205879111 wait complete. 2023-09-30T22:58:37.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.731+0000 7f6cbfdff700 1 Processor -- start 2023-09-30T22:58:37.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.732+0000 7f6cbfdff700 1 -- start start 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.732+0000 7f6cbfdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb80cc280 0x7f6cb814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.732+0000 7f6cbfdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cf180 0x7f6cb814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.732+0000 7f6cbfdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb815ac40 0x7f6cb814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.732+0000 7f6cbfdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb816da50 con 0x7f6cb815ac40 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.732+0000 7f6cbfdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb816e2f0 con 0x7f6cb80cc280 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.732+0000 7f6cbfdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb816b1f0 con 0x7f6cb80cf180 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb815ac40 0x7f6cb814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb815ac40 0x7f6cb814f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46720/0 (socket says 172.21.15.142:46720) 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 -- 172.21.15.142:0/3498259460 learned_addr learned my addr 172.21.15.142:0/3498259460 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbdb9b700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb80cc280 0x7f6cb814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbd39a700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cf180 0x7f6cb814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 -- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cf180 msgr2=0x7f6cb814ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cf180 0x7f6cb814ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 -- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb80cc280 msgr2=0x7f6cb814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb80cc280 0x7f6cb814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 -- 172.21.15.142:0/3498259460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40094f0 con 0x7f6cb815ac40 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.733+0000 7f6cbe39c700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb815ac40 0x7f6cb814f350 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009f20 tx=0x7f6cb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.734+0000 7f6cadffb700 1 -- 172.21.15.142:0/3498259460 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000cbd0 con 0x7f6cb815ac40 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.734+0000 7f6cadffb700 1 -- 172.21.15.142:0/3498259460 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000f040 con 0x7f6cb815ac40 2023-09-30T22:58:37.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.734+0000 7f6cadffb700 1 -- 172.21.15.142:0/3498259460 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0014480 con 0x7f6cb815ac40 2023-09-30T22:58:37.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.734+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb816dca0 con 0x7f6cb815ac40 2023-09-30T22:58:37.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.734+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb816a420 con 0x7f6cb815ac40 2023-09-30T22:58:37.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.735+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb816e480 con 0x7f6cb815ac40 2023-09-30T22:58:37.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.736+0000 7f6cadffb700 1 -- 172.21.15.142:0/3498259460 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6cb0014830 con 0x7f6cb815ac40 2023-09-30T22:58:37.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.737+0000 7f6cadffb700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c9c067330 0x7f6c9c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:37.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.737+0000 7f6cadffb700 1 -- 172.21.15.142:0/3498259460 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6cb0085580 con 0x7f6cb815ac40 2023-09-30T22:58:37.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.737+0000 7f6cbdb9b700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c9c067330 0x7f6c9c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:37.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.738+0000 7f6cbdb9b700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c9c067330 0x7f6c9c0697e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40099b0 tx=0x7f6cb4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:37.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.741+0000 7f6cadffb700 1 -- 172.21.15.142:0/3498259460 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6cb0052730 con 0x7f6cb815ac40 2023-09-30T22:58:37.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:37.929+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6cb814cfd0 con 0x7f6cb815ac40 2023-09-30T22:58:38.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.667+0000 7f6cadffb700 1 -- 172.21.15.142:0/3498259460 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v127) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6cb0055d50 con 0x7f6cb815ac40 2023-09-30T22:58:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c9c067330 msgr2=0x7f6c9c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c9c067330 0x7f6c9c0697e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40099b0 tx=0x7f6cb4017000 comp rx=0 tx=0).stop 2023-09-30T22:58:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb815ac40 msgr2=0x7f6cb814f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb815ac40 0x7f6cb814f350 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009f20 tx=0x7f6cb000b040 comp rx=0 tx=0).stop 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 shutdown_connections 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c9c067330 0x7f6c9c0697e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb815ac40 0x7f6cb814f350 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb80cc280 0x7f6cb814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 --2- 172.21.15.142:0/3498259460 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb80cf180 0x7f6cb814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 >> 172.21.15.142:0/3498259460 conn(0x7f6cb80d0a80 msgr2=0x7f6cb80c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 shutdown_connections 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.672+0000 7f6cbfdff700 1 -- 172.21.15.142:0/3498259460 wait complete. 2023-09-30T22:58:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:58:38.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:58:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.892+0000 7f6a77fff700 1 Processor -- start 2023-09-30T22:58:38.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.892+0000 7f6a77fff700 1 -- start start 2023-09-30T22:58:38.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.893+0000 7f6a77fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a701580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:38.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.893+0000 7f6a77fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700c38d0 con 0x7f6a70141150 2023-09-30T22:58:38.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.893+0000 7f6a77fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700c6aa0 con 0x7f6a700c6270 2023-09-30T22:58:38.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.893+0000 7f6a77fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7006a040 con 0x7f6a700c47f0 2023-09-30T22:58:38.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.893+0000 7f6a75d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6a70141150 0x7f6a7015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55376/0 (socket says 172.21.15.142:55376) 2023-09-30T22:58:38.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a75d9b700 1 -- 172.21.15.142:0/3155800235 learned_addr learned my addr 172.21.15.142:0/3155800235 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:38.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a7659c700 1 --2- 172.21.15.142:0/3155800235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a701580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a74d99700 1 -- 172.21.15.142:0/3155800235 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382359144 0 0) 0x7f6a700c38d0 con 0x7f6a70141150 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a74d99700 1 -- 172.21.15.142:0/3155800235 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c003570 con 0x7f6a70141150 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a74d99700 1 -- 172.21.15.142:0/3155800235 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054257778 0 0) 0x7f6a700c6aa0 con 0x7f6a700c6270 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a74d99700 1 -- 172.21.15.142:0/3155800235 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a700c38d0 con 0x7f6a700c6270 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a7659c700 1 -- 172.21.15.142:0/3155800235 >> v1:172.21.15.148:6789/0 conn(0x7f6a700c6270 legacy=0x7f6a700c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a7659c700 1 -- 172.21.15.142:0/3155800235 >> v1:172.21.15.142:6789/0 conn(0x7f6a70141150 legacy=0x7f6a7015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.894+0000 7f6a7659c700 1 -- 172.21.15.142:0/3155800235 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700c67c0 con 0x7f6a700c47f0 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a7659c700 1 --2- 172.21.15.142:0/3155800235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a701580c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009e90 tx=0x7f6a68009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51183fb5599da4bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a74d99700 1 -- 172.21.15.142:0/3155800235 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800e070 con 0x7f6a700c47f0 2023-09-30T22:58:38.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a74d99700 1 -- 172.21.15.142:0/3155800235 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800bb80 con 0x7f6a700c47f0 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a74d99700 1 -- 172.21.15.142:0/3155800235 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68012430 con 0x7f6a700c47f0 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a77fff700 1 -- 172.21.15.142:0/3155800235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 msgr2=0x7f6a701580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a77fff700 1 --2- 172.21.15.142:0/3155800235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a701580c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009e90 tx=0x7f6a68009780 comp rx=0 tx=0).stop 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a77fff700 1 -- 172.21.15.142:0/3155800235 shutdown_connections 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a77fff700 1 --2- 172.21.15.142:0/3155800235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a701580c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a77fff700 1 -- 172.21.15.142:0/3155800235 >> 172.21.15.142:0/3155800235 conn(0x7f6a700cc670 msgr2=0x7f6a700cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.895+0000 7f6a77fff700 1 -- 172.21.15.142:0/3155800235 shutdown_connections 2023-09-30T22:58:38.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.896+0000 7f6a77fff700 1 -- 172.21.15.142:0/3155800235 wait complete. 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.897+0000 7f6a77fff700 1 Processor -- start 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.897+0000 7f6a77fff700 1 -- start start 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a77fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a7016d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a700c6270 0x7f6a7016de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a77fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a70141150 0x7f6a700bcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a77fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7016bef0 con 0x7f6a70141150 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a77fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700cbad0 con 0x7f6a700c6270 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a77fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7016b5c0 con 0x7f6a700c47f0 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a7659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a70141150 0x7f6a700bcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:38.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a7659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a70141150 0x7f6a700bcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46728/0 (socket says 172.21.15.142:46728) 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a7659c700 1 -- 172.21.15.142:0/2803527020 learned_addr learned my addr 172.21.15.142:0/2803527020 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a7559a700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a700c6270 0x7f6a7016de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.898+0000 7f6a75d9b700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a7016d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a7659c700 1 -- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 msgr2=0x7f6a7016d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a7659c700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a7016d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a7659c700 1 -- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a700c6270 msgr2=0x7f6a7016de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a7659c700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a700c6270 0x7f6a7016de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a7659c700 1 -- 172.21.15.142:0/2803527020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009a20 con 0x7f6a70141150 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a7559a700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a700c6270 0x7f6a7016de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a7659c700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a70141150 0x7f6a700bcbf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6a68013000 tx=0x7f6a68019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a65ffb700 1 -- 172.21.15.142:0/2803527020 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68012e00 con 0x7f6a70141150 2023-09-30T22:58:38.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a65ffb700 1 -- 172.21.15.142:0/2803527020 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6801b630 con 0x7f6a70141150 2023-09-30T22:58:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a65ffb700 1 -- 172.21.15.142:0/2803527020 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6801b9f0 con 0x7f6a70141150 2023-09-30T22:58:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7016b8a0 con 0x7f6a70141150 2023-09-30T22:58:38.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.899+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a700bd130 con 0x7f6a70141150 2023-09-30T22:58:38.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.900+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a70069a50 con 0x7f6a70141150 2023-09-30T22:58:38.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.902+0000 7f6a65ffb700 1 -- 172.21.15.142:0/2803527020 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6a680253f0 con 0x7f6a70141150 2023-09-30T22:58:38.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.902+0000 7f6a65ffb700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a54067330 0x7f6a540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:38.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.902+0000 7f6a65ffb700 1 -- 172.21.15.142:0/2803527020 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f6a68086b80 con 0x7f6a70141150 2023-09-30T22:58:38.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.903+0000 7f6a75d9b700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a54067330 0x7f6a540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:38.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.903+0000 7f6a75d9b700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a54067330 0x7f6a540697e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a7013e9f0 tx=0x7f6a6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:38.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:38.906+0000 7f6a65ffb700 1 -- 172.21.15.142:0/2803527020 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6a68057780 con 0x7f6a70141150 2023-09-30T22:58:39.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.095+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a7016c030 con 0x7f6a70141150 2023-09-30T22:58:39.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.670+0000 7f6a65ffb700 1 -- 172.21.15.142:0/2803527020 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v128) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a68057310 con 0x7f6a70141150 2023-09-30T22:58:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.675+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a54067330 msgr2=0x7f6a540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.675+0000 7f6a77fff700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a54067330 0x7f6a540697e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a7013e9f0 tx=0x7f6a6c009040 comp rx=0 tx=0).stop 2023-09-30T22:58:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.675+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a70141150 msgr2=0x7f6a700bcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.675+0000 7f6a77fff700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a70141150 0x7f6a700bcbf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6a68013000 tx=0x7f6a68019000 comp rx=0 tx=0).stop 2023-09-30T22:58:39.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.679+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 shutdown_connections 2023-09-30T22:58:39.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.679+0000 7f6a77fff700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a54067330 0x7f6a540697e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.679+0000 7f6a77fff700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a70141150 0x7f6a700bcbf0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.679+0000 7f6a77fff700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a700c47f0 0x7f6a7016d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.679+0000 7f6a77fff700 1 --2- 172.21.15.142:0/2803527020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a700c6270 0x7f6a7016de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.679+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 >> 172.21.15.142:0/2803527020 conn(0x7f6a700cc670 msgr2=0x7f6a7006e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:39.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.684+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 shutdown_connections 2023-09-30T22:58:39.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.684+0000 7f6a77fff700 1 -- 172.21.15.142:0/2803527020 wait complete. 2023-09-30T22:58:39.686 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:58:39.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:58:39.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.896+0000 7f6475dff700 1 Processor -- start 2023-09-30T22:58:39.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.897+0000 7f6475dff700 1 -- start start 2023-09-30T22:58:39.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.898+0000 7f6475dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64700c6270 0x7f64701580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:39.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.898+0000 7f6475dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64700c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:39.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.898+0000 7f6475dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64700c4a80 con 0x7f6470141150 2023-09-30T22:58:39.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.898+0000 7f6475dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64700c38d0 con 0x7f64700c6270 2023-09-30T22:58:39.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.898+0000 7f6475dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64700c6aa0 con 0x7f64700c40e0 2023-09-30T22:58:39.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64700c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:39.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64700c6270 0x7f64701580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:39.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64700c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:53528/0 (socket says 172.21.15.142:53528) 2023-09-30T22:58:39.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 -- 172.21.15.142:0/1600833236 learned_addr learned my addr 172.21.15.142:0/1600833236 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:39.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646f7fe700 1 --1- 172.21.15.142:0/1600833236 >> v1:172.21.15.148:6789/0 conn(0x7f6470141150 0x7f647015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:44846/0 (socket says 172.21.15.142:44846) 2023-09-30T22:58:39.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 -- 172.21.15.142:0/1600833236 >> v2:172.21.15.148:3300/0 conn(0x7f64700c6270 msgr2=0x7f64701580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 --2- 172.21.15.142:0/1600833236 >> v2:172.21.15.148:3300/0 conn(0x7f64700c6270 0x7f64701580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646e7fc700 1 -- 172.21.15.142:0/1600833236 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612520154 0 0) 0x7f6460001110 con 0x7f6470141150 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 -- 172.21.15.142:0/1600833236 >> v1:172.21.15.148:6789/0 conn(0x7f6470141150 legacy=0x7f647015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 -- 172.21.15.142:0/1600833236 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647006a040 con 0x7f64700c40e0 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646effd700 1 --2- 172.21.15.142:0/1600833236 >> v2:172.21.15.148:3300/0 conn(0x7f64700c6270 0x7f64701580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.899+0000 7f646ffff700 1 --2- 172.21.15.142:0/1600833236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64700c4540 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6468009f20 tx=0x7f6468009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c65f3570124810 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f646e7fc700 1 -- 172.21.15.142:0/1600833236 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800e070 con 0x7f64700c40e0 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f646e7fc700 1 -- 172.21.15.142:0/1600833236 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800b9d0 con 0x7f64700c40e0 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f646e7fc700 1 -- 172.21.15.142:0/1600833236 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680092e0 con 0x7f64700c40e0 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 -- 172.21.15.142:0/1600833236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 msgr2=0x7f64700c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:39.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 --2- 172.21.15.142:0/1600833236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64700c4540 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6468009f20 tx=0x7f6468009840 comp rx=0 tx=0).stop 2023-09-30T22:58:39.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 -- 172.21.15.142:0/1600833236 shutdown_connections 2023-09-30T22:58:39.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 --2- 172.21.15.142:0/1600833236 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64700c4540 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 --2- 172.21.15.142:0/1600833236 >> v2:172.21.15.148:3300/0 conn(0x7f64700c6270 0x7f64701580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 -- 172.21.15.142:0/1600833236 >> 172.21.15.142:0/1600833236 conn(0x7f64700cc670 msgr2=0x7f64700cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:39.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 -- 172.21.15.142:0/1600833236 shutdown_connections 2023-09-30T22:58:39.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.900+0000 7f6475dff700 1 -- 172.21.15.142:0/1600833236 wait complete. 2023-09-30T22:58:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.902+0000 7f6475dff700 1 Processor -- start 2023-09-30T22:58:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.902+0000 7f6475dff700 1 -- start start 2023-09-30T22:58:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f6475dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64701564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f6475dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64700c6270 0x7f647013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f6475dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6470141150 0x7f647013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f6475dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470166aa0 con 0x7f6470141150 2023-09-30T22:58:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f6475dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470157bc0 con 0x7f64700c6270 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f6475dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6470166170 con 0x7f64700c40e0 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6470141150 0x7f647013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6470141150 0x7f647013f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46742/0 (socket says 172.21.15.142:46742) 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646ffff700 1 -- 172.21.15.142:0/1721168849 learned_addr learned my addr 172.21.15.142:0/1721168849 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646effd700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64700c6270 0x7f647013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646f7fe700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64701564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646ffff700 1 -- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 msgr2=0x7f64701564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646ffff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64701564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646ffff700 1 -- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64700c6270 msgr2=0x7f647013f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.903+0000 7f646ffff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64700c6270 0x7f647013f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.904+0000 7f646ffff700 1 -- 172.21.15.142:0/1721168849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464009420 con 0x7f6470141150 2023-09-30T22:58:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.904+0000 7f646ffff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6470141150 0x7f647013f9d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f647006c260 tx=0x7f6468018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:39.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.904+0000 7f64577fe700 1 -- 172.21.15.142:0/1721168849 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468008c70 con 0x7f6470141150 2023-09-30T22:58:39.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.904+0000 7f64577fe700 1 -- 172.21.15.142:0/1721168849 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468008df0 con 0x7f6470141150 2023-09-30T22:58:39.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.904+0000 7f64577fe700 1 -- 172.21.15.142:0/1721168849 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680266b0 con 0x7f6470141150 2023-09-30T22:58:39.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.904+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6468009ae0 con 0x7f6470141150 2023-09-30T22:58:39.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.904+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6470166730 con 0x7f6470141150 2023-09-30T22:58:39.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.905+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470166c10 con 0x7f6470141150 2023-09-30T22:58:39.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.906+0000 7f64577fe700 1 -- 172.21.15.142:0/1721168849 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6468003040 con 0x7f6470141150 2023-09-30T22:58:39.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.907+0000 7f64577fe700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f645c067330 0x7f645c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:39.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.907+0000 7f64577fe700 1 -- 172.21.15.142:0/1721168849 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f6468086b70 con 0x7f6470141150 2023-09-30T22:58:39.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.907+0000 7f646f7fe700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f645c067330 0x7f645c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:39.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.908+0000 7f646f7fe700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f645c067330 0x7f645c0697e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6460007fd0 tx=0x7f6460007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:39.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:39.912+0000 7f64577fe700 1 -- 172.21.15.142:0/1721168849 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6468053a30 con 0x7f6470141150 2023-09-30T22:58:40.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.147+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6470158730 con 0x7f6470141150 2023-09-30T22:58:40.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.700+0000 7f64577fe700 1 -- 172.21.15.142:0/1721168849 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6468057050 con 0x7f6470141150 2023-09-30T22:58:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.703+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f645c067330 msgr2=0x7f645c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.703+0000 7f6475dff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f645c067330 0x7f645c0697e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6460007fd0 tx=0x7f6460007e10 comp rx=0 tx=0).stop 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.703+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6470141150 msgr2=0x7f647013f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.703+0000 7f6475dff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6470141150 0x7f647013f9d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f647006c260 tx=0x7f6468018000 comp rx=0 tx=0).stop 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.703+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 shutdown_connections 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.703+0000 7f6475dff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f645c067330 0x7f645c0697e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.703+0000 7f6475dff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6470141150 0x7f647013f9d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.704+0000 7f6475dff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64700c40e0 0x7f64701564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.704+0000 7f6475dff700 1 --2- 172.21.15.142:0/1721168849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64700c6270 0x7f647013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.704+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 >> 172.21.15.142:0/1721168849 conn(0x7f64700cc670 msgr2=0x7f6470158e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.704+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 shutdown_connections 2023-09-30T22:58:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.704+0000 7f6475dff700 1 -- 172.21.15.142:0/1721168849 wait complete. 2023-09-30T22:58:40.706 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 15 and data pool 16 2023-09-30T22:58:40.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.916+0000 7f365a3ff700 1 Processor -- start 2023-09-30T22:58:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.916+0000 7f365a3ff700 1 -- start start 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f365a3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3654159ae0 0x7f36540cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f365a3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36540b1180 0x7f36540cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f365a3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365415d910 con 0x7f3654159eb0 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f365a3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365415e920 con 0x7f3654159ae0 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f365a3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365415e490 con 0x7f36540b1180 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f3653fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3654159ae0 0x7f36540cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f3653fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3654159ae0 0x7f36540cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49208/0 (socket says 172.21.15.142:49208) 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f365899c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3654159eb0 0x7f3654068790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58144/0 (socket says 172.21.15.142:58144) 2023-09-30T22:58:40.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.917+0000 7f3653fff700 1 -- 172.21.15.142:0/2762105491 learned_addr learned my addr 172.21.15.142:0/2762105491 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:40.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f36537fe700 1 --2- 172.21.15.142:0/2762105491 >> v2:172.21.15.148:3300/0 conn(0x7f36540b1180 0x7f36540cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:40.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3653fff700 1 -- 172.21.15.142:0/2762105491 >> v2:172.21.15.148:3300/0 conn(0x7f36540b1180 msgr2=0x7f36540cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:40.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3653fff700 1 --2- 172.21.15.142:0/2762105491 >> v2:172.21.15.148:3300/0 conn(0x7f36540b1180 0x7f36540cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3653fff700 1 -- 172.21.15.142:0/2762105491 >> v1:172.21.15.142:6789/0 conn(0x7f3654159eb0 legacy=0x7f3654068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:40.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3653fff700 1 -- 172.21.15.142:0/2762105491 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365415db60 con 0x7f3654159ae0 2023-09-30T22:58:40.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3652ffd700 1 -- 172.21.15.142:0/2762105491 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636151771 0 0) 0x7f365415d910 con 0x7f3654159eb0 2023-09-30T22:58:40.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3653fff700 1 --2- 172.21.15.142:0/2762105491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f36540cdeb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3654067af0 tx=0x7f3644009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5faa3a93c58e4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:40.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3652ffd700 1 -- 172.21.15.142:0/2762105491 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400b860 con 0x7f3654159ae0 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3652ffd700 1 -- 172.21.15.142:0/2762105491 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400b9c0 con 0x7f3654159ae0 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.918+0000 7f3652ffd700 1 -- 172.21.15.142:0/2762105491 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400bd60 con 0x7f3654159ae0 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 -- 172.21.15.142:0/2762105491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 msgr2=0x7f36540cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 --2- 172.21.15.142:0/2762105491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f36540cdeb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3654067af0 tx=0x7f3644009250 comp rx=0 tx=0).stop 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 -- 172.21.15.142:0/2762105491 shutdown_connections 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 --2- 172.21.15.142:0/2762105491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f36540cdeb0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 --2- 172.21.15.142:0/2762105491 >> v2:172.21.15.148:3300/0 conn(0x7f36540b1180 0x7f36540cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 -- 172.21.15.142:0/2762105491 >> 172.21.15.142:0/2762105491 conn(0x7f36540ce8b0 msgr2=0x7f36540cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:40.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 -- 172.21.15.142:0/2762105491 shutdown_connections 2023-09-30T22:58:40.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.919+0000 7f365a3ff700 1 -- 172.21.15.142:0/2762105491 wait complete. 2023-09-30T22:58:40.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.921+0000 7f365a3ff700 1 Processor -- start 2023-09-30T22:58:40.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.921+0000 7f365a3ff700 1 -- start start 2023-09-30T22:58:40.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.921+0000 7f365a3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36540b1180 0x7f36540ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:40.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f365a3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f365415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f365a3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3654159eb0 0x7f36540c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f365a3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36540c8cd0 con 0x7f3654159ae0 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f365a3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365415bfd0 con 0x7f36540b1180 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f365a3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36540c8ac0 con 0x7f3654159eb0 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f365415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f365415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49216/0 (socket says 172.21.15.142:49216) 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 -- 172.21.15.142:0/1751313211 learned_addr learned my addr 172.21.15.142:0/1751313211 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f3653fff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36540b1180 0x7f36540ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:40.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f365899c700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3654159eb0 0x7f36540c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 -- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3654159eb0 msgr2=0x7f36540c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3654159eb0 0x7f36540c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 -- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36540b1180 msgr2=0x7f36540ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36540b1180 0x7f36540ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.922+0000 7f36537fe700 1 -- 172.21.15.142:0/1751313211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440094f0 con 0x7f3654159ae0 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.923+0000 7f36537fe700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f365415ba90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f364800d860 tx=0x7f3648008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.923+0000 7f363bfff700 1 -- 172.21.15.142:0/1751313211 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36480125f0 con 0x7f3654159ae0 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.923+0000 7f363bfff700 1 -- 172.21.15.142:0/1751313211 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3648012750 con 0x7f3654159ae0 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.923+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36540c9d70 con 0x7f3654159ae0 2023-09-30T22:58:40.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.923+0000 7f363bfff700 1 -- 172.21.15.142:0/1751313211 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648012af0 con 0x7f3654159ae0 2023-09-30T22:58:40.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.923+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36540c9a00 con 0x7f3654159ae0 2023-09-30T22:58:40.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.924+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36540c9f00 con 0x7f3654159ae0 2023-09-30T22:58:40.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.925+0000 7f363bfff700 1 -- 172.21.15.142:0/1751313211 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f364801e460 con 0x7f3654159ae0 2023-09-30T22:58:40.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.925+0000 7f363bfff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3640067330 0x7f36400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:40.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.926+0000 7f363bfff700 1 -- 172.21.15.142:0/1751313211 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3648085260 con 0x7f3654159ae0 2023-09-30T22:58:40.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.926+0000 7f3653fff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3640067330 0x7f36400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:40.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.926+0000 7f3653fff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3640067330 0x7f36400697e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3654067af0 tx=0x7f3644017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:40.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:40.930+0000 7f363bfff700 1 -- 172.21.15.142:0/1751313211 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3648055b50 con 0x7f3654159ae0 2023-09-30T22:58:41.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.119+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f365415de40 con 0x7f3654159ae0 2023-09-30T22:58:41.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.120+0000 7f363bfff700 1 -- 172.21.15.142:0/1751313211 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f36480556e0 con 0x7f3654159ae0 2023-09-30T22:58:41.121 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:41.121 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":129,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:40.149369+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:58:37.968620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-09-30T22:58:39.134383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:41.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3640067330 msgr2=0x7f36400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3640067330 0x7f36400697e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3654067af0 tx=0x7f3644017000 comp rx=0 tx=0).stop 2023-09-30T22:58:41.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 msgr2=0x7f365415ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f365415ba90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f364800d860 tx=0x7f3648008040 comp rx=0 tx=0).stop 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 shutdown_connections 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3640067330 0x7f36400697e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3654159eb0 0x7f36540c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36540b1180 0x7f36540ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 --2- 172.21.15.142:0/1751313211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3654159ae0 0x7f365415ba90 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 >> 172.21.15.142:0/1751313211 conn(0x7f36540ce8b0 msgr2=0x7f36541552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 shutdown_connections 2023-09-30T22:58:41.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.122+0000 7f365a3ff700 1 -- 172.21.15.142:0/1751313211 wait complete. 2023-09-30T22:58:41.141 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:41.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.332+0000 7f6cbadff700 1 Processor -- start 2023-09-30T22:58:41.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.333+0000 7f6cbadff700 1 -- start start 2023-09-30T22:58:41.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.334+0000 7f6cbadff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6cb4159ae0 0x7f6cb40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.334+0000 7f6cbadff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb415d910 con 0x7f6cb40cc590 2023-09-30T22:58:41.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.334+0000 7f6cbadff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb415e490 con 0x7f6cb40b1180 2023-09-30T22:58:41.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.334+0000 7f6cbadff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb415e920 con 0x7f6cb4159ae0 2023-09-30T22:58:41.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.334+0000 7f6cb939c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6cb40cc590 0x7f6cb4069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58152/0 (socket says 172.21.15.142:58152) 2023-09-30T22:58:41.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.334+0000 7f6cb939c700 1 -- 172.21.15.142:0/491835627 learned_addr learned my addr 172.21.15.142:0/491835627 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:41.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.334+0000 7f6cb8b9b700 1 --2- 172.21.15.142:0/491835627 >> v2:172.21.15.148:3300/0 conn(0x7f6cb4159ae0 0x7f6cb40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb37fe700 1 -- 172.21.15.142:0/491835627 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623884339 0 0) 0x7f6cb415d910 con 0x7f6cb40cc590 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb37fe700 1 -- 172.21.15.142:0/491835627 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca4003570 con 0x7f6cb40cc590 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb8b9b700 1 -- 172.21.15.142:0/491835627 >> v1:172.21.15.148:6789/0 conn(0x7f6cb40b1180 legacy=0x7f6cb40cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb8b9b700 1 -- 172.21.15.142:0/491835627 >> v1:172.21.15.142:6789/0 conn(0x7f6cb40cc590 legacy=0x7f6cb4069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb8b9b700 1 -- 172.21.15.142:0/491835627 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb415db60 con 0x7f6cb4159ae0 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb8b9b700 1 --2- 172.21.15.142:0/491835627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb4159ae0 0x7f6cb40cdeb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80098e0 tx=0x7f6ca80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acfdbf8eda624af9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb37fe700 1 -- 172.21.15.142:0/491835627 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800b640 con 0x7f6cb4159ae0 2023-09-30T22:58:41.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb37fe700 1 -- 172.21.15.142:0/491835627 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800b7a0 con 0x7f6cb4159ae0 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.335+0000 7f6cb37fe700 1 -- 172.21.15.142:0/491835627 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800bb40 con 0x7f6cb4159ae0 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.336+0000 7f6cbadff700 1 -- 172.21.15.142:0/491835627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb4159ae0 msgr2=0x7f6cb40cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.336+0000 7f6cbadff700 1 --2- 172.21.15.142:0/491835627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb4159ae0 0x7f6cb40cdeb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80098e0 tx=0x7f6ca80091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.336+0000 7f6cbadff700 1 -- 172.21.15.142:0/491835627 shutdown_connections 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.336+0000 7f6cbadff700 1 --2- 172.21.15.142:0/491835627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb4159ae0 0x7f6cb40cdeb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.336+0000 7f6cbadff700 1 -- 172.21.15.142:0/491835627 >> 172.21.15.142:0/491835627 conn(0x7f6cb40ce8b0 msgr2=0x7f6cb40cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.336+0000 7f6cbadff700 1 -- 172.21.15.142:0/491835627 shutdown_connections 2023-09-30T22:58:41.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.336+0000 7f6cbadff700 1 -- 172.21.15.142:0/491835627 wait complete. 2023-09-30T22:58:41.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.337+0000 7f6cbadff700 1 Processor -- start 2023-09-30T22:58:41.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.338+0000 7f6cbadff700 1 -- start start 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.338+0000 7f6cbadff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb40b1180 0x7f6cb4148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.338+0000 7f6cbadff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40cc590 0x7f6cb415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.338+0000 7f6cbadff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb4159ae0 0x7f6cb415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.338+0000 7f6cbadff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4145c80 con 0x7f6cb40b1180 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.338+0000 7f6cbadff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb415b280 con 0x7f6cb40cc590 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.338+0000 7f6cbadff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb415a670 con 0x7f6cb4159ae0 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb40b1180 0x7f6cb4148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb40b1180 0x7f6cb4148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49220/0 (socket says 172.21.15.142:49220) 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 -- 172.21.15.142:0/1275252939 learned_addr learned my addr 172.21.15.142:0/1275252939 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb939c700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb4159ae0 0x7f6cb415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb3fff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40cc590 0x7f6cb415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 -- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb4159ae0 msgr2=0x7f6cb415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb4159ae0 0x7f6cb415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 -- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40cc590 msgr2=0x7f6cb415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40cc590 0x7f6cb415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 -- 172.21.15.142:0/1275252939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009420 con 0x7f6cb40b1180 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb3fff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40cc590 0x7f6cb415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.339+0000 7f6cb8b9b700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb40b1180 0x7f6cb4148570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4063f90 tx=0x7f6ca8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.340+0000 7f6cb0ff9700 1 -- 172.21.15.142:0/1275252939 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800bb20 con 0x7f6cb40b1180 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.340+0000 7f6cb0ff9700 1 -- 172.21.15.142:0/1275252939 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8011420 con 0x7f6cb40b1180 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.340+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb415a950 con 0x7f6cb40b1180 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.340+0000 7f6cb0ff9700 1 -- 172.21.15.142:0/1275252939 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80117c0 con 0x7f6cb40b1180 2023-09-30T22:58:41.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.340+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb415af10 con 0x7f6cb40b1180 2023-09-30T22:58:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.341+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb406ea70 con 0x7f6cb40b1180 2023-09-30T22:58:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.342+0000 7f6cb0ff9700 1 -- 172.21.15.142:0/1275252939 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6ca8011b70 con 0x7f6cb40b1180 2023-09-30T22:58:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.342+0000 7f6cb0ff9700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c98067330 0x7f6c980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.342+0000 7f6cb0ff9700 1 -- 172.21.15.142:0/1275252939 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ca80862b0 con 0x7f6cb40b1180 2023-09-30T22:58:41.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.343+0000 7f6cb3fff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c98067330 0x7f6c980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.343+0000 7f6cb3fff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c98067330 0x7f6c980697e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40b1b30 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:41.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.347+0000 7f6cb0ff9700 1 -- 172.21.15.142:0/1275252939 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6ca8053110 con 0x7f6cb40b1180 2023-09-30T22:58:41.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.537+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cb415de40 con 0x7f6cb40b1180 2023-09-30T22:58:41.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.538+0000 7f6cb0ff9700 1 -- 172.21.15.142:0/1275252939 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f6ca8056730 con 0x7f6cb40b1180 2023-09-30T22:58:41.539 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:41.539 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":129,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:40.149369+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:58:37.968620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-09-30T22:58:39.134383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c98067330 msgr2=0x7f6c980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c98067330 0x7f6c980697e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40b1b30 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2023-09-30T22:58:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb40b1180 msgr2=0x7f6cb4148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb40b1180 0x7f6cb4148570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4063f90 tx=0x7f6ca8017000 comp rx=0 tx=0).stop 2023-09-30T22:58:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 shutdown_connections 2023-09-30T22:58:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c98067330 0x7f6c980697e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6cb4159ae0 0x7f6cb415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb40b1180 0x7f6cb4148570 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 --2- 172.21.15.142:0/1275252939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40cc590 0x7f6cb415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 >> 172.21.15.142:0/1275252939 conn(0x7f6cb40ce8b0 msgr2=0x7f6cb40b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 shutdown_connections 2023-09-30T22:58:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.540+0000 7f6cbadff700 1 -- 172.21.15.142:0/1275252939 wait complete. 2023-09-30T22:58:41.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:58:41.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.753+0000 7ff48ebff700 1 Processor -- start 2023-09-30T22:58:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.754+0000 7ff48ebff700 1 -- start start 2023-09-30T22:58:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48ebff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff488141150 0x7ff4881580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4880c40e0 0x7ff4880c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48ebff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880c4a80 con 0x7ff4880c6270 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48ebff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880c38d0 con 0x7ff488141150 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c6aa0 con 0x7ff4880c40e0 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48c99b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff488141150 0x7ff4881580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48c99b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff488141150 0x7ff4881580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49236/0 (socket says 172.21.15.142:49236) 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48c99b700 1 -- 172.21.15.142:0/421198520 learned_addr learned my addr 172.21.15.142:0/421198520 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.755+0000 7ff48d19c700 1 --2- 172.21.15.142:0/421198520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4880c40e0 0x7ff4880c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff48c99b700 1 -- 172.21.15.142:0/421198520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4880c40e0 msgr2=0x7ff4880c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff48c99b700 1 --2- 172.21.15.142:0/421198520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4880c40e0 0x7ff4880c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff48c99b700 1 -- 172.21.15.142:0/421198520 >> v1:172.21.15.148:6789/0 conn(0x7ff4880c6270 legacy=0x7ff48815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff48c99b700 1 -- 172.21.15.142:0/421198520 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48806a040 con 0x7ff488141150 2023-09-30T22:58:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff48c99b700 1 --2- 172.21.15.142:0/421198520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff488141150 0x7ff4881580c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0099b0 tx=0x7ff47c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba034c0d7516426 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff4877fe700 1 -- 172.21.15.142:0/421198520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00b860 con 0x7ff488141150 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff4877fe700 1 -- 172.21.15.142:0/421198520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00b9c0 con 0x7ff488141150 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.756+0000 7ff4877fe700 1 -- 172.21.15.142:0/421198520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00bd60 con 0x7ff488141150 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 -- 172.21.15.142:0/421198520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff488141150 msgr2=0x7ff4881580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 --2- 172.21.15.142:0/421198520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff488141150 0x7ff4881580c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0099b0 tx=0x7ff47c009250 comp rx=0 tx=0).stop 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 -- 172.21.15.142:0/421198520 shutdown_connections 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 --2- 172.21.15.142:0/421198520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff4880c40e0 0x7ff4880c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 --2- 172.21.15.142:0/421198520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff488141150 0x7ff4881580c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 -- 172.21.15.142:0/421198520 >> 172.21.15.142:0/421198520 conn(0x7ff4880cc670 msgr2=0x7ff4880cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 -- 172.21.15.142:0/421198520 shutdown_connections 2023-09-30T22:58:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.757+0000 7ff48ebff700 1 -- 172.21.15.142:0/421198520 wait complete. 2023-09-30T22:58:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.758+0000 7ff48ebff700 1 Processor -- start 2023-09-30T22:58:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.758+0000 7ff48ebff700 1 -- start start 2023-09-30T22:58:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.759+0000 7ff48ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4880c40e0 0x7ff488167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.759+0000 7ff48ebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4880c6270 0x7ff4880b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.759+0000 7ff48ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff488141150 0x7ff4880b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.759+0000 7ff48ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880b70c0 con 0x7ff4880c40e0 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.759+0000 7ff48ebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880b5980 con 0x7ff4880c6270 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.759+0000 7ff48ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880b56a0 con 0x7ff488141150 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4880c40e0 0x7ff488167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4880c40e0 0x7ff488167ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49242/0 (socket says 172.21.15.142:49242) 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 -- 172.21.15.142:0/1839573000 learned_addr learned my addr 172.21.15.142:0/1839573000 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 -- 172.21.15.142:0/1839573000 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff488141150 msgr2=0x7ff4880b8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff488141150 0x7ff4880b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 -- 172.21.15.142:0/1839573000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4880c6270 msgr2=0x7ff4880b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4880c6270 0x7ff4880b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 -- 172.21.15.142:0/1839573000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0094f0 con 0x7ff4880c40e0 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48c99b700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4880c40e0 0x7ff488167ea0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff4880c7990 tx=0x7ff47c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff484ff9700 1 -- 172.21.15.142:0/1839573000 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c024440 con 0x7ff4880c40e0 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff484ff9700 1 -- 172.21.15.142:0/1839573000 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c0245c0 con 0x7ff4880c40e0 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880b6a70 con 0x7ff4880c40e0 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.760+0000 7ff484ff9700 1 -- 172.21.15.142:0/1839573000 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c024980 con 0x7ff4880c40e0 2023-09-30T22:58:41.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.761+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881683e0 con 0x7ff4880c40e0 2023-09-30T22:58:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.762+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff488069a50 con 0x7ff4880c40e0 2023-09-30T22:58:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.762+0000 7ff484ff9700 1 -- 172.21.15.142:0/1839573000 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff47c01a420 con 0x7ff4880c40e0 2023-09-30T22:58:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.763+0000 7ff484ff9700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff46c067330 0x7ff46c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.763+0000 7ff484ff9700 1 -- 172.21.15.142:0/1839573000 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff47c086a10 con 0x7ff4880c40e0 2023-09-30T22:58:41.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.764+0000 7ff487fff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff46c067330 0x7ff46c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:41.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.764+0000 7ff487fff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff46c067330 0x7ff46c0697e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff4880c66f0 tx=0x7ff474007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:41.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:41.768+0000 7ff484ff9700 1 -- 172.21.15.142:0/1839573000 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff47c053870 con 0x7ff4880c40e0 2023-09-30T22:58:42.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.007+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff488157ea0 con 0x7ff4880c40e0 2023-09-30T22:58:42.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.710+0000 7ff484ff9700 1 -- 172.21.15.142:0/1839573000 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff47c0150b0 con 0x7ff4880c40e0 2023-09-30T22:58:42.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff46c067330 msgr2=0x7ff46c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff46c067330 0x7ff46c0697e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff4880c66f0 tx=0x7ff474007b40 comp rx=0 tx=0).stop 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4880c40e0 msgr2=0x7ff488167ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4880c40e0 0x7ff488167ea0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff4880c7990 tx=0x7ff47c017000 comp rx=0 tx=0).stop 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 shutdown_connections 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff46c067330 0x7ff46c0697e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff488141150 0x7ff4880b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4880c40e0 0x7ff488167ea0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 --2- 172.21.15.142:0/1839573000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4880c6270 0x7ff4880b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.713+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 >> 172.21.15.142:0/1839573000 conn(0x7ff4880cc670 msgr2=0x7ff488159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:42.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.714+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 shutdown_connections 2023-09-30T22:58:42.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.714+0000 7ff48ebff700 1 -- 172.21.15.142:0/1839573000 wait complete. 2023-09-30T22:58:42.734 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:58:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.927+0000 7f5e65fff700 1 Processor -- start 2023-09-30T22:58:42.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.927+0000 7f5e65fff700 1 -- start start 2023-09-30T22:58:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.928+0000 7f5e65fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c6270 0x7f5e601580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.928+0000 7f5e65fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e600c40e0 0x7f5e600c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.928+0000 7f5e65fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e600c38d0 con 0x7f5e60141150 2023-09-30T22:58:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.928+0000 7f5e65fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e600c4aa0 con 0x7f5e600c40e0 2023-09-30T22:58:42.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.928+0000 7f5e65fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600c6aa0 con 0x7f5e600c6270 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.928+0000 7f5e5ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e600c40e0 0x7f5e600c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5e60141150 0x7f5e6015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58164/0 (socket says 172.21.15.142:58164) 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5f7fe700 1 -- 172.21.15.142:0/1136622310 learned_addr learned my addr 172.21.15.142:0/1136622310 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e600c40e0 0x7f5e600c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49256/0 (socket says 172.21.15.142:49256) 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5effd700 1 --2- 172.21.15.142:0/1136622310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c6270 0x7f5e601580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5e7fc700 1 -- 172.21.15.142:0/1136622310 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052979254 0 0) 0x7f5e600c38d0 con 0x7f5e60141150 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5ffff700 1 -- 172.21.15.142:0/1136622310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c6270 msgr2=0x7f5e601580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5ffff700 1 --2- 172.21.15.142:0/1136622310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c6270 0x7f5e601580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5ffff700 1 -- 172.21.15.142:0/1136622310 >> v1:172.21.15.142:6789/0 conn(0x7f5e60141150 legacy=0x7f5e6015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5ffff700 1 -- 172.21.15.142:0/1136622310 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6006a040 con 0x7f5e600c40e0 2023-09-30T22:58:42.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5effd700 1 --2- 172.21.15.142:0/1136622310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c6270 0x7f5e601580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:42.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5ffff700 1 --2- 172.21.15.142:0/1136622310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e600c40e0 0x7f5e600c4560 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e60 tx=0x7f5e58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db0979e72a35604 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:42.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.929+0000 7f5e5e7fc700 1 -- 172.21.15.142:0/1136622310 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800e070 con 0x7f5e600c40e0 2023-09-30T22:58:42.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e5e7fc700 1 -- 172.21.15.142:0/1136622310 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5800bc30 con 0x7f5e600c40e0 2023-09-30T22:58:42.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e5e7fc700 1 -- 172.21.15.142:0/1136622310 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58012430 con 0x7f5e600c40e0 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 -- 172.21.15.142:0/1136622310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e600c40e0 msgr2=0x7f5e600c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 --2- 172.21.15.142:0/1136622310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e600c40e0 0x7f5e600c4560 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e60 tx=0x7f5e58009780 comp rx=0 tx=0).stop 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 -- 172.21.15.142:0/1136622310 shutdown_connections 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 --2- 172.21.15.142:0/1136622310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e600c40e0 0x7f5e600c4560 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 --2- 172.21.15.142:0/1136622310 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c6270 0x7f5e601580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 -- 172.21.15.142:0/1136622310 >> 172.21.15.142:0/1136622310 conn(0x7f5e600cc670 msgr2=0x7f5e600cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 -- 172.21.15.142:0/1136622310 shutdown_connections 2023-09-30T22:58:42.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.930+0000 7f5e65fff700 1 -- 172.21.15.142:0/1136622310 wait complete. 2023-09-30T22:58:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.932+0000 7f5e65fff700 1 Processor -- start 2023-09-30T22:58:42.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.932+0000 7f5e65fff700 1 -- start start 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e65fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c40e0 0x7f5e601598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e65fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e600c6270 0x7f5e600ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e65fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e60141150 0x7f5e60157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e65fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600cb340 con 0x7f5e60141150 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e65fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600cb620 con 0x7f5e600c6270 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e65fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600cb900 con 0x7f5e600c40e0 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e5ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e60141150 0x7f5e60157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e5ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e60141150 0x7f5e60157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49262/0 (socket says 172.21.15.142:49262) 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e5ffff700 1 -- 172.21.15.142:0/4211569851 learned_addr learned my addr 172.21.15.142:0/4211569851 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e5effd700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e600c6270 0x7f5e600ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:42.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.933+0000 7f5e5f7fe700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c40e0 0x7f5e601598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e5ffff700 1 -- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c40e0 msgr2=0x7f5e601598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e5ffff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c40e0 0x7f5e601598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e5ffff700 1 -- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e600c6270 msgr2=0x7f5e600ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e5ffff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e600c6270 0x7f5e600ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e5ffff700 1 -- 172.21.15.142:0/4211569851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009a20 con 0x7f5e60141150 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e5f7fe700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c40e0 0x7f5e601598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e5ffff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e60141150 0x7f5e60157360 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f5e580097c0 tx=0x7f5e58019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e477fe700 1 -- 172.21.15.142:0/4211569851 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58027470 con 0x7f5e60141150 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e477fe700 1 -- 172.21.15.142:0/4211569851 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580275d0 con 0x7f5e60141150 2023-09-30T22:58:42.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e600cbbe0 con 0x7f5e60141150 2023-09-30T22:58:42.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e477fe700 1 -- 172.21.15.142:0/4211569851 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58027990 con 0x7f5e60141150 2023-09-30T22:58:42.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.934+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6013e4c0 con 0x7f5e60141150 2023-09-30T22:58:42.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.935+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e60069a50 con 0x7f5e60141150 2023-09-30T22:58:42.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.936+0000 7f5e477fe700 1 -- 172.21.15.142:0/4211569851 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5e58024070 con 0x7f5e60141150 2023-09-30T22:58:42.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.937+0000 7f5e477fe700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e4c067330 0x7f5e4c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:42.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.937+0000 7f5e477fe700 1 -- 172.21.15.142:0/4211569851 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5e58087370 con 0x7f5e60141150 2023-09-30T22:58:42.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.937+0000 7f5e5f7fe700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e4c067330 0x7f5e4c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:42.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.938+0000 7f5e5f7fe700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e4c067330 0x7f5e4c0697e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5e50001890 tx=0x7f5e50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:42.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:42.941+0000 7f5e477fe700 1 -- 172.21.15.142:0/4211569851 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5e580541d0 con 0x7f5e60141150 2023-09-30T22:58:43.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.173+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e6006fc10 con 0x7f5e60141150 2023-09-30T22:58:43.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:43.639 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:43.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.713+0000 7f5e477fe700 1 -- 172.21.15.142:0/4211569851 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e580577f0 con 0x7f5e60141150 2023-09-30T22:58:43.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.715+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e4c067330 msgr2=0x7f5e4c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:43.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.715+0000 7f5e65fff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e4c067330 0x7f5e4c0697e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5e50001890 tx=0x7f5e50009040 comp rx=0 tx=0).stop 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.715+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e60141150 msgr2=0x7f5e60157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.715+0000 7f5e65fff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e60141150 0x7f5e60157360 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f5e580097c0 tx=0x7f5e58019000 comp rx=0 tx=0).stop 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.715+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 shutdown_connections 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.715+0000 7f5e65fff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e4c067330 0x7f5e4c0697e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.716+0000 7f5e65fff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e60141150 0x7f5e60157360 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.716+0000 7f5e65fff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e600c40e0 0x7f5e601598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.716+0000 7f5e65fff700 1 --2- 172.21.15.142:0/4211569851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e600c6270 0x7f5e600ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.716+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 >> 172.21.15.142:0/4211569851 conn(0x7f5e600cc670 msgr2=0x7f5e6015aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.716+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 shutdown_connections 2023-09-30T22:58:43.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.716+0000 7f5e65fff700 1 -- 172.21.15.142:0/4211569851 wait complete. 2023-09-30T22:58:43.734 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:43.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.922+0000 7f2689bff700 1 Processor -- start 2023-09-30T22:58:43.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.922+0000 7f2689bff700 1 -- start start 2023-09-30T22:58:43.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.923+0000 7f2689bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f268406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:43.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.923+0000 7f2689bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268406d3e0 con 0x7f268406e650 2023-09-30T22:58:43.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.923+0000 7f2689bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268406dc80 con 0x7f26840af020 2023-09-30T22:58:43.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.923+0000 7f2689bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268406b790 con 0x7f26840b00d0 2023-09-30T22:58:43.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f2683fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f268406e650 0x7f268415a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58180/0 (socket says 172.21.15.142:58180) 2023-09-30T22:58:43.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f2683fff700 1 -- 172.21.15.142:0/2578539570 learned_addr learned my addr 172.21.15.142:0/2578539570 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f2682ffd700 1 --2- 172.21.15.142:0/2578539570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f268406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f26827fc700 1 -- 172.21.15.142:0/2578539570 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096381227 0 0) 0x7f268406d3e0 con 0x7f268406e650 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f26827fc700 1 -- 172.21.15.142:0/2578539570 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f266c003570 con 0x7f268406e650 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f26827fc700 1 -- 172.21.15.142:0/2578539570 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135575124 0 0) 0x7f268406dc80 con 0x7f26840af020 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f26827fc700 1 -- 172.21.15.142:0/2578539570 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f268406d3e0 con 0x7f26840af020 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f2682ffd700 1 -- 172.21.15.142:0/2578539570 >> v1:172.21.15.148:6789/0 conn(0x7f26840af020 legacy=0x7f2684156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f2682ffd700 1 -- 172.21.15.142:0/2578539570 >> v1:172.21.15.142:6789/0 conn(0x7f268406e650 legacy=0x7f268415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.924+0000 7f2682ffd700 1 -- 172.21.15.142:0/2578539570 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840b0650 con 0x7f26840b00d0 2023-09-30T22:58:43.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f2682ffd700 1 --2- 172.21.15.142:0/2578539570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f268406e110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2678009910 tx=0x7f26780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb203bbc15e68db8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f26827fc700 1 -- 172.21.15.142:0/2578539570 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678011630 con 0x7f26840b00d0 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f26827fc700 1 -- 172.21.15.142:0/2578539570 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2678011790 con 0x7f26840b00d0 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f26827fc700 1 -- 172.21.15.142:0/2578539570 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678011b30 con 0x7f26840b00d0 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f2689bff700 1 -- 172.21.15.142:0/2578539570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 msgr2=0x7f268406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f2689bff700 1 --2- 172.21.15.142:0/2578539570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f268406e110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2678009910 tx=0x7f26780091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f2689bff700 1 -- 172.21.15.142:0/2578539570 shutdown_connections 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f2689bff700 1 --2- 172.21.15.142:0/2578539570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f268406e110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.925+0000 7f2689bff700 1 -- 172.21.15.142:0/2578539570 >> 172.21.15.142:0/2578539570 conn(0x7f26840680c0 msgr2=0x7f26840c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.926+0000 7f2689bff700 1 -- 172.21.15.142:0/2578539570 shutdown_connections 2023-09-30T22:58:43.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.926+0000 7f2689bff700 1 -- 172.21.15.142:0/2578539570 wait complete. 2023-09-30T22:58:43.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.927+0000 7f2689bff700 1 Processor -- start 2023-09-30T22:58:43.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.927+0000 7f2689bff700 1 -- start start 2023-09-30T22:58:43.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2689bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f268406e650 0x7f2684149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:43.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2689bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26840af020 0x7f2684141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2689bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f26841447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2689bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c6ab0 con 0x7f26840af020 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2689bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c6180 con 0x7f268406e650 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2689bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c6460 con 0x7f26840b00d0 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2682ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26840af020 0x7f2684141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2682ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26840af020 0x7f2684141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49278/0 (socket says 172.21.15.142:49278) 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.928+0000 7f2682ffd700 1 -- 172.21.15.142:0/2680945656 learned_addr learned my addr 172.21.15.142:0/2680945656 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f26837fe700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f268406e650 0x7f2684149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2682ffd700 1 -- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 msgr2=0x7f26841447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2682ffd700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f26841447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2682ffd700 1 -- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f268406e650 msgr2=0x7f2684149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2682ffd700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f268406e650 0x7f2684149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2682ffd700 1 -- 172.21.15.142:0/2680945656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678009420 con 0x7f26840af020 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f26837fe700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f268406e650 0x7f2684149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2682ffd700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26840af020 0x7f2684141bf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2678009f00 tx=0x7f2678017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f266b7fe700 1 -- 172.21.15.142:0/2680945656 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267801f070 con 0x7f26840af020 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f266b7fe700 1 -- 172.21.15.142:0/2680945656 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2678000bc0 con 0x7f26840af020 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26840c6740 con 0x7f26840af020 2023-09-30T22:58:43.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f266b7fe700 1 -- 172.21.15.142:0/2680945656 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678025420 con 0x7f26840af020 2023-09-30T22:58:43.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.929+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2684142130 con 0x7f26840af020 2023-09-30T22:58:43.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.930+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26840c6c60 con 0x7f26840af020 2023-09-30T22:58:43.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.931+0000 7f266b7fe700 1 -- 172.21.15.142:0/2680945656 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2678023070 con 0x7f26840af020 2023-09-30T22:58:43.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.932+0000 7f266b7fe700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2670067330 0x7f26700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:43.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.932+0000 7f266b7fe700 1 -- 172.21.15.142:0/2680945656 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2678085fc0 con 0x7f26840af020 2023-09-30T22:58:43.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.932+0000 7f26837fe700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2670067330 0x7f26700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:43.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.933+0000 7f26837fe700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2670067330 0x7f26700697e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2674007fd0 tx=0x7f2674009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:43.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:43.936+0000 7f266b7fe700 1 -- 172.21.15.142:0/2680945656 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f26840c6c60 con 0x7f26840af020 2023-09-30T22:58:44.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.166+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f268406d570 con 0x7f26840af020 2023-09-30T22:58:44.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.167+0000 7f266b7fe700 1 -- 172.21.15.142:0/2680945656 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f267802a090 con 0x7f26840af020 2023-09-30T22:58:44.167 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:44.167 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:58:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2670067330 msgr2=0x7f26700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2670067330 0x7f26700697e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2674007fd0 tx=0x7f2674009040 comp rx=0 tx=0).stop 2023-09-30T22:58:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26840af020 msgr2=0x7f2684141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26840af020 0x7f2684141bf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2678009f00 tx=0x7f2678017000 comp rx=0 tx=0).stop 2023-09-30T22:58:44.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 shutdown_connections 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2670067330 0x7f26700697e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26840b00d0 0x7f26841447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f268406e650 0x7f2684149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 --2- 172.21.15.142:0/2680945656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26840af020 0x7f2684141bf0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 >> 172.21.15.142:0/2680945656 conn(0x7f26840680c0 msgr2=0x7f26840ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 shutdown_connections 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.169+0000 7f2689bff700 1 -- 172.21.15.142:0/2680945656 wait complete. 2023-09-30T22:58:44.171 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:58:44.187 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:44.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.418+0000 7fcdda1ff700 1 Processor -- start 2023-09-30T22:58:44.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.418+0000 7fcdda1ff700 1 -- start start 2023-09-30T22:58:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.419+0000 7fcdda1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdd40c6da0 0x7fcdd406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.419+0000 7fcdda1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd415dde0 con 0x7fcdd406d3f0 2023-09-30T22:58:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.419+0000 7fcdda1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd406b840 con 0x7fcdd415e270 2023-09-30T22:58:44.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.419+0000 7fcdda1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd415e710 con 0x7fcdd40c6da0 2023-09-30T22:58:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.419+0000 7fcdd2ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdd40c6da0 0x7fcdd406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.419+0000 7fcdd37fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcdd406d3f0 0x7fcdd406b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58186/0 (socket says 172.21.15.142:58186) 2023-09-30T22:58:44.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.419+0000 7fcdd37fe700 1 -- 172.21.15.142:0/888996263 learned_addr learned my addr 172.21.15.142:0/888996263 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.420+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/888996263 >> v1:172.21.15.148:6789/0 conn(0x7fcdd415e270 legacy=0x7fcdd4159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.420+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/888996263 >> v1:172.21.15.142:6789/0 conn(0x7fcdd406d3f0 legacy=0x7fcdd406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.420+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/888996263 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd415d7d0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.420+0000 7fcdd2ffd700 1 --2- 172.21.15.142:0/888996263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd406d7c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009910 tx=0x7fcdc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96416c95697c4962 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.420+0000 7fcdd27fc700 1 -- 172.21.15.142:0/888996263 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8009eb0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.420+0000 7fcdd27fc700 1 -- 172.21.15.142:0/888996263 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800b760 con 0x7fcdd40c6da0 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.420+0000 7fcdd27fc700 1 -- 172.21.15.142:0/888996263 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800bb00 con 0x7fcdd40c6da0 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.421+0000 7fcdda1ff700 1 -- 172.21.15.142:0/888996263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 msgr2=0x7fcdd406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.421+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/888996263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd406d7c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009910 tx=0x7fcdc80091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.421+0000 7fcdda1ff700 1 -- 172.21.15.142:0/888996263 shutdown_connections 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.421+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/888996263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd406d7c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.421+0000 7fcdda1ff700 1 -- 172.21.15.142:0/888996263 >> 172.21.15.142:0/888996263 conn(0x7fcdd4067e30 msgr2=0x7fcdd4068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.421+0000 7fcdda1ff700 1 -- 172.21.15.142:0/888996263 shutdown_connections 2023-09-30T22:58:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.421+0000 7fcdda1ff700 1 -- 172.21.15.142:0/888996263 wait complete. 2023-09-30T22:58:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.422+0000 7fcdda1ff700 1 Processor -- start 2023-09-30T22:58:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.423+0000 7fcdda1ff700 1 -- start start 2023-09-30T22:58:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.423+0000 7fcdda1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdd406d3f0 0x7fcdd4150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.423+0000 7fcdda1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.423+0000 7fcdda1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdd415e270 0x7fcdd414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.423+0000 7fcdda1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd416a460 con 0x7fcdd40c6da0 2023-09-30T22:58:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.423+0000 7fcdda1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd414ed10 con 0x7fcdd415e270 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.423+0000 7fcdda1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd414eff0 con 0x7fcdd406d3f0 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd414ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49300/0 (socket says 172.21.15.142:49300) 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/2482106675 learned_addr learned my addr 172.21.15.142:0/2482106675 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd3fff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdd415e270 0x7fcdd414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdd406d3f0 msgr2=0x7fcdd4150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd37fe700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdd406d3f0 0x7fcdd4150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdd406d3f0 0x7fcdd4150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdd415e270 msgr2=0x7fcdd414c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdd415e270 0x7fcdd414c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/2482106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8009420 con 0x7fcdd40c6da0 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd3fff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdd415e270 0x7fcdd414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd37fe700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdd406d3f0 0x7fcdd4150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.424+0000 7fcdd2ffd700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd414ad00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80030c0 tx=0x7fcdc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.425+0000 7fcdbb7fe700 1 -- 172.21.15.142:0/2482106675 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8011cf0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.425+0000 7fcdbb7fe700 1 -- 172.21.15.142:0/2482106675 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc8020070 con 0x7fcdd40c6da0 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.425+0000 7fcdbb7fe700 1 -- 172.21.15.142:0/2482106675 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80256d0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.425+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd414f2d0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.425+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd41514c0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.426+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd416a6b0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.427+0000 7fcdbb7fe700 1 -- 172.21.15.142:0/2482106675 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcdc8022030 con 0x7fcdd40c6da0 2023-09-30T22:58:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.427+0000 7fcdbb7fe700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcdc0067330 0x7fcdc00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.428+0000 7fcdbb7fe700 1 -- 172.21.15.142:0/2482106675 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcdc80869b0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.428+0000 7fcdd37fe700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcdc0067330 0x7fcdc00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.428+0000 7fcdd37fe700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcdc0067330 0x7fcdc00697e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40058d0 tx=0x7fcdc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.432+0000 7fcdbb7fe700 1 -- 172.21.15.142:0/2482106675 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcdd416a6b0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.625+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdd416a6b0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.626+0000 7fcdbb7fe700 1 -- 172.21.15.142:0/2482106675 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+17026 (secure 0 0 0) 0x7fcdd416a6b0 con 0x7fcdd40c6da0 2023-09-30T22:58:44.627 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:44.627 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":130,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:41.682801+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:58:37.968620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-09-30T22:58:39.134383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcdc0067330 msgr2=0x7fcdc00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcdc0067330 0x7fcdc00697e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40058d0 tx=0x7fcdc4009040 comp rx=0 tx=0).stop 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 msgr2=0x7fcdd414ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd414ad00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80030c0 tx=0x7fcdc8016000 comp rx=0 tx=0).stop 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 shutdown_connections 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcdc0067330 0x7fcdc00697e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdd415e270 0x7fcdd414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcdd406d3f0 0x7fcdd4150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.628+0000 7fcdda1ff700 1 --2- 172.21.15.142:0/2482106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40c6da0 0x7fcdd414ad00 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.629+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 >> 172.21.15.142:0/2482106675 conn(0x7fcdd4067e30 msgr2=0x7fcdd414a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.629+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 shutdown_connections 2023-09-30T22:58:44.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.629+0000 7fcdda1ff700 1 -- 172.21.15.142:0/2482106675 wait complete. 2023-09-30T22:58:44.647 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:58:44.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:58:44.660 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-09-30T22:58:44.660+0000 7f4380ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:58:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.837+0000 7f6c377ff700 1 Processor -- start 2023-09-30T22:58:44.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.837+0000 7f6c377ff700 1 -- start start 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c377ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c377ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c300c6da0 0x7f6c3015e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c377ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3015dde0 con 0x7f6c3006b130 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c377ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3015d7d0 con 0x7f6c300c6da0 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c377ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c300c7230 con 0x7f6c3006d3f0 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c34d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c300c6da0 0x7f6c3015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c35d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6c3006b130 0x7f6c30069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58202/0 (socket says 172.21.15.142:58202) 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c35d9c700 1 -- 172.21.15.142:0/2405866409 learned_addr learned my addr 172.21.15.142:0/2405866409 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:44.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c34d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c300c6da0 0x7f6c3015e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49312/0 (socket says 172.21.15.142:49312) 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c3559b700 1 --2- 172.21.15.142:0/2405866409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c34d9a700 1 -- 172.21.15.142:0/2405866409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 msgr2=0x7f6c3006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c34d9a700 1 --2- 172.21.15.142:0/2405866409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.839+0000 7f6c34d9a700 1 -- 172.21.15.142:0/2405866409 >> v1:172.21.15.142:6789/0 conn(0x7f6c3006b130 legacy=0x7f6c30069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c34d9a700 1 -- 172.21.15.142:0/2405866409 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3015da70 con 0x7f6c300c6da0 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c27fff700 1 -- 172.21.15.142:0/2405866409 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983041288 0 0) 0x7f6c3015dde0 con 0x7f6c3006b130 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c34d9a700 1 --2- 172.21.15.142:0/2405866409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3015e270 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6c200098e0 tx=0x7f6c200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7717641565a0d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c27fff700 1 -- 172.21.15.142:0/2405866409 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20009e80 con 0x7f6c300c6da0 2023-09-30T22:58:44.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c27fff700 1 -- 172.21.15.142:0/2405866409 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2000b860 con 0x7f6c300c6da0 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c27fff700 1 -- 172.21.15.142:0/2405866409 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000bbe0 con 0x7f6c300c6da0 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c377ff700 1 -- 172.21.15.142:0/2405866409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 msgr2=0x7f6c3015e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.840+0000 7f6c377ff700 1 --2- 172.21.15.142:0/2405866409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3015e270 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6c200098e0 tx=0x7f6c200091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.841+0000 7f6c377ff700 1 -- 172.21.15.142:0/2405866409 shutdown_connections 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.841+0000 7f6c377ff700 1 --2- 172.21.15.142:0/2405866409 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.841+0000 7f6c377ff700 1 --2- 172.21.15.142:0/2405866409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3015e270 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.841+0000 7f6c377ff700 1 -- 172.21.15.142:0/2405866409 >> 172.21.15.142:0/2405866409 conn(0x7f6c30067e30 msgr2=0x7f6c30068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.841+0000 7f6c377ff700 1 -- 172.21.15.142:0/2405866409 shutdown_connections 2023-09-30T22:58:44.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.841+0000 7f6c377ff700 1 -- 172.21.15.142:0/2405866409 wait complete. 2023-09-30T22:58:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.842+0000 7f6c377ff700 1 Processor -- start 2023-09-30T22:58:44.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.842+0000 7f6c377ff700 1 -- start start 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c377ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c3006b130 0x7f6c3013be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c377ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c377ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3014f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c377ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3013c3a0 con 0x7f6c300c6da0 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c377ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3014b2b0 con 0x7f6c3006b130 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c377ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3014d3c0 con 0x7f6c3006d3f0 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c35d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c35d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3014f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49322/0 (socket says 172.21.15.142:49322) 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.843+0000 7f6c35d9c700 1 -- 172.21.15.142:0/1806925674 learned_addr learned my addr 172.21.15.142:0/1806925674 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:44.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c34d9a700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c3559b700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c3006b130 0x7f6c3013be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c35d9c700 1 -- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 msgr2=0x7f6c3014ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c35d9c700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3014ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c35d9c700 1 -- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c3006b130 msgr2=0x7f6c3013be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c35d9c700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c3006b130 0x7f6c3013be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c35d9c700 1 -- 172.21.15.142:0/1806925674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20009420 con 0x7f6c300c6da0 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c34d9a700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c35d9c700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3014f620 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800cc90 tx=0x7f6c28001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c257fa700 1 -- 172.21.15.142:0/1806925674 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800cea0 con 0x7f6c300c6da0 2023-09-30T22:58:44.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c257fa700 1 -- 172.21.15.142:0/1806925674 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2800ab70 con 0x7f6c300c6da0 2023-09-30T22:58:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3014dcb0 con 0x7f6c300c6da0 2023-09-30T22:58:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.844+0000 7f6c257fa700 1 -- 172.21.15.142:0/1806925674 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280070f0 con 0x7f6c300c6da0 2023-09-30T22:58:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.845+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3014afd0 con 0x7f6c300c6da0 2023-09-30T22:58:44.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.845+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c30156bd0 con 0x7f6c300c6da0 2023-09-30T22:58:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.846+0000 7f6c257fa700 1 -- 172.21.15.142:0/1806925674 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6c280074a0 con 0x7f6c300c6da0 2023-09-30T22:58:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.847+0000 7f6c257fa700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c14067330 0x7f6c140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.847+0000 7f6c257fa700 1 -- 172.21.15.142:0/1806925674 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6c28085140 con 0x7f6c300c6da0 2023-09-30T22:58:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.847+0000 7f6c3559b700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c14067330 0x7f6c140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:44.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.848+0000 7f6c3559b700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c14067330 0x7f6c140697e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c006fd0 tx=0x7f6c2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:44.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:44.851+0000 7f6c257fa700 1 -- 172.21.15.142:0/1806925674 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6c30156bd0 con 0x7f6c300c6da0 2023-09-30T22:58:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.037+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c30156bd0 con 0x7f6c14067330 2023-09-30T22:58:45.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.046+0000 7f6c257fa700 1 -- 172.21.15.142:0/1806925674 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303506 (secure 0 0 0) 0x7f6c30156bd0 con 0x7f6c14067330 2023-09-30T22:58:45.051 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c14067330 msgr2=0x7f6c140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c14067330 0x7f6c140697e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c006fd0 tx=0x7f6c2c008040 comp rx=0 tx=0).stop 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 msgr2=0x7f6c3014f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3014f620 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800cc90 tx=0x7f6c28001a80 comp rx=0 tx=0).stop 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 shutdown_connections 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6c14067330 0x7f6c140697e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c300c6da0 0x7f6c3014f620 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c3006b130 0x7f6c3013be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 --2- 172.21.15.142:0/1806925674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c3006d3f0 0x7f6c3014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 >> 172.21.15.142:0/1806925674 conn(0x7f6c30067e30 msgr2=0x7f6c3006dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 shutdown_connections 2023-09-30T22:58:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.051+0000 7f6c377ff700 1 -- 172.21.15.142:0/1806925674 wait complete. 2023-09-30T22:58:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:58:45.069 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-09-30T22:58:44.187632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555415,"statfs":{"total":1600000000,"available":1592745123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.520297"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694726+0000","last_change":"2023-09-30T22:58:40.694442+0000","last_active":"2023-09-30T22:58:40.694726+0000","last_peered":"2023-09-30T22:58:40.694726+0000","last_clean":"2023-09-30T22:58:40.694726+0000","last_became_active":"2023-09-30T22:58:40.694184+0000","last_became_peered":"2023-09-30T22:58:40.694184+0000","last_unstale":"2023-09-30T22:58:40.694726+0000","last_undegraded":"2023-09-30T22:58:40.694726+0000","last_fullsized":"2023-09-30T22:58:40.694726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:31:41.595143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.703331+0000","last_change":"2023-09-30T22:58:40.703260+0000","last_active":"2023-09-30T22:58:40.703331+0000","last_peered":"2023-09-30T22:58:40.703331+0000","last_clean":"2023-09-30T22:58:40.703331+0000","last_became_active":"2023-09-30T22:58:40.703043+0000","last_became_peered":"2023-09-30T22:58:40.703043+0000","last_unstale":"2023-09-30T22:58:40.703331+0000","last_undegraded":"2023-09-30T22:58:40.703331+0000","last_fullsized":"2023-09-30T22:58:40.703331+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:04:39.583420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688036+0000","last_change":"2023-09-30T22:58:40.687958+0000","last_active":"2023-09-30T22:58:40.688036+0000","last_peered":"2023-09-30T22:58:40.688036+0000","last_clean":"2023-09-30T22:58:40.688036+0000","last_became_active":"2023-09-30T22:58:40.687682+0000","last_became_peered":"2023-09-30T22:58:40.687682+0000","last_unstale":"2023-09-30T22:58:40.688036+0000","last_undegraded":"2023-09-30T22:58:40.688036+0000","last_fullsized":"2023-09-30T22:58:40.688036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:21.897119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697536+0000","last_change":"2023-09-30T22:58:40.697424+0000","last_active":"2023-09-30T22:58:40.697536+0000","last_peered":"2023-09-30T22:58:40.697536+0000","last_clean":"2023-09-30T22:58:40.697536+0000","last_became_active":"2023-09-30T22:58:40.696961+0000","last_became_peered":"2023-09-30T22:58:40.696961+0000","last_unstale":"2023-09-30T22:58:40.697536+0000","last_undegraded":"2023-09-30T22:58:40.697536+0000","last_fullsized":"2023-09-30T22:58:40.697536+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:47:30.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696683+0000","last_change":"2023-09-30T22:58:40.696309+0000","last_active":"2023-09-30T22:58:40.696683+0000","last_peered":"2023-09-30T22:58:40.696683+0000","last_clean":"2023-09-30T22:58:40.696683+0000","last_became_active":"2023-09-30T22:58:40.696083+0000","last_became_peered":"2023-09-30T22:58:40.696083+0000","last_unstale":"2023-09-30T22:58:40.696683+0000","last_undegraded":"2023-09-30T22:58:40.696683+0000","last_fullsized":"2023-09-30T22:58:40.696683+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:54:59.181686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688277+0000","last_change":"2023-09-30T22:58:40.688213+0000","last_active":"2023-09-30T22:58:40.688277+0000","last_peered":"2023-09-30T22:58:40.688277+0000","last_clean":"2023-09-30T22:58:40.688277+0000","last_became_active":"2023-09-30T22:58:40.687969+0000","last_became_peered":"2023-09-30T22:58:40.687969+0000","last_unstale":"2023-09-30T22:58:40.688277+0000","last_undegraded":"2023-09-30T22:58:40.688277+0000","last_fullsized":"2023-09-30T22:58:40.688277+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:08:35.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702081+0000","last_change":"2023-09-30T22:58:40.701988+0000","last_active":"2023-09-30T22:58:40.702081+0000","last_peered":"2023-09-30T22:58:40.702081+0000","last_clean":"2023-09-30T22:58:40.702081+0000","last_became_active":"2023-09-30T22:58:40.701034+0000","last_became_peered":"2023-09-30T22:58:40.701034+0000","last_unstale":"2023-09-30T22:58:40.702081+0000","last_undegraded":"2023-09-30T22:58:40.702081+0000","last_fullsized":"2023-09-30T22:58:40.702081+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:58:39.857906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.689726+0000","last_change":"2023-09-30T22:58:40.689316+0000","last_active":"2023-09-30T22:58:40.689726+0000","last_peered":"2023-09-30T22:58:40.689726+0000","last_clean":"2023-09-30T22:58:40.689726+0000","last_became_active":"2023-09-30T22:58:40.689061+0000","last_became_peered":"2023-09-30T22:58:40.689061+0000","last_unstale":"2023-09-30T22:58:40.689726+0000","last_undegraded":"2023-09-30T22:58:40.689726+0000","last_fullsized":"2023-09-30T22:58:40.689726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:49:11.255812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700654+0000","last_change":"2023-09-30T22:58:40.700209+0000","last_active":"2023-09-30T22:58:40.700654+0000","last_peered":"2023-09-30T22:58:40.700654+0000","last_clean":"2023-09-30T22:58:40.700654+0000","last_became_active":"2023-09-30T22:58:40.699980+0000","last_became_peered":"2023-09-30T22:58:40.699980+0000","last_unstale":"2023-09-30T22:58:40.700654+0000","last_undegraded":"2023-09-30T22:58:40.700654+0000","last_fullsized":"2023-09-30T22:58:40.700654+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:52:56.762498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694529+0000","last_change":"2023-09-30T22:58:40.694444+0000","last_active":"2023-09-30T22:58:40.694529+0000","last_peered":"2023-09-30T22:58:40.694529+0000","last_clean":"2023-09-30T22:58:40.694529+0000","last_became_active":"2023-09-30T22:58:40.693751+0000","last_became_peered":"2023-09-30T22:58:40.693751+0000","last_unstale":"2023-09-30T22:58:40.694529+0000","last_undegraded":"2023-09-30T22:58:40.694529+0000","last_fullsized":"2023-09-30T22:58:40.694529+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:44:29.167172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695286+0000","last_change":"2023-09-30T22:58:40.694719+0000","last_active":"2023-09-30T22:58:40.695286+0000","last_peered":"2023-09-30T22:58:40.695286+0000","last_clean":"2023-09-30T22:58:40.695286+0000","last_became_active":"2023-09-30T22:58:40.694502+0000","last_became_peered":"2023-09-30T22:58:40.694502+0000","last_unstale":"2023-09-30T22:58:40.695286+0000","last_undegraded":"2023-09-30T22:58:40.695286+0000","last_fullsized":"2023-09-30T22:58:40.695286+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:31:13.989442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.701347+0000","last_change":"2023-09-30T22:58:40.701254+0000","last_active":"2023-09-30T22:58:40.701347+0000","last_peered":"2023-09-30T22:58:40.701347+0000","last_clean":"2023-09-30T22:58:40.701347+0000","last_became_active":"2023-09-30T22:58:40.700412+0000","last_became_peered":"2023-09-30T22:58:40.700412+0000","last_unstale":"2023-09-30T22:58:40.701347+0000","last_undegraded":"2023-09-30T22:58:40.701347+0000","last_fullsized":"2023-09-30T22:58:40.701347+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:44:29.167172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699169+0000","last_change":"2023-09-30T22:58:40.698861+0000","last_active":"2023-09-30T22:58:40.699169+0000","last_peered":"2023-09-30T22:58:40.699169+0000","last_clean":"2023-09-30T22:58:40.699169+0000","last_became_active":"2023-09-30T22:58:40.698618+0000","last_became_peered":"2023-09-30T22:58:40.698618+0000","last_unstale":"2023-09-30T22:58:40.699169+0000","last_undegraded":"2023-09-30T22:58:40.699169+0000","last_fullsized":"2023-09-30T22:58:40.699169+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:32.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700481+0000","last_change":"2023-09-30T22:58:40.700050+0000","last_active":"2023-09-30T22:58:40.700481+0000","last_peered":"2023-09-30T22:58:40.700481+0000","last_clean":"2023-09-30T22:58:40.700481+0000","last_became_active":"2023-09-30T22:58:40.699688+0000","last_became_peered":"2023-09-30T22:58:40.699688+0000","last_unstale":"2023-09-30T22:58:40.700481+0000","last_undegraded":"2023-09-30T22:58:40.700481+0000","last_fullsized":"2023-09-30T22:58:40.700481+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:49:11.255812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698630+0000","last_change":"2023-09-30T22:58:40.698469+0000","last_active":"2023-09-30T22:58:40.698630+0000","last_peered":"2023-09-30T22:58:40.698630+0000","last_clean":"2023-09-30T22:58:40.698630+0000","last_became_active":"2023-09-30T22:58:40.697976+0000","last_became_peered":"2023-09-30T22:58:40.697976+0000","last_unstale":"2023-09-30T22:58:40.698630+0000","last_undegraded":"2023-09-30T22:58:40.698630+0000","last_fullsized":"2023-09-30T22:58:40.698630+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:38.042453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695479+0000","last_change":"2023-09-30T22:58:40.694527+0000","last_active":"2023-09-30T22:58:40.695479+0000","last_peered":"2023-09-30T22:58:40.695479+0000","last_clean":"2023-09-30T22:58:40.695479+0000","last_became_active":"2023-09-30T22:58:40.694175+0000","last_became_peered":"2023-09-30T22:58:40.694175+0000","last_unstale":"2023-09-30T22:58:40.695479+0000","last_undegraded":"2023-09-30T22:58:40.695479+0000","last_fullsized":"2023-09-30T22:58:40.695479+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:01.015115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688556+0000","last_change":"2023-09-30T22:58:40.688466+0000","last_active":"2023-09-30T22:58:40.688556+0000","last_peered":"2023-09-30T22:58:40.688556+0000","last_clean":"2023-09-30T22:58:40.688556+0000","last_became_active":"2023-09-30T22:58:40.688179+0000","last_became_peered":"2023-09-30T22:58:40.688179+0000","last_unstale":"2023-09-30T22:58:40.688556+0000","last_undegraded":"2023-09-30T22:58:40.688556+0000","last_fullsized":"2023-09-30T22:58:40.688556+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:43:14.152495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698960+0000","last_change":"2023-09-30T22:58:40.698898+0000","last_active":"2023-09-30T22:58:40.698960+0000","last_peered":"2023-09-30T22:58:40.698960+0000","last_clean":"2023-09-30T22:58:40.698960+0000","last_became_active":"2023-09-30T22:58:40.698675+0000","last_became_peered":"2023-09-30T22:58:40.698675+0000","last_unstale":"2023-09-30T22:58:40.698960+0000","last_undegraded":"2023-09-30T22:58:40.698960+0000","last_fullsized":"2023-09-30T22:58:40.698960+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:24:55.012825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697518+0000","last_change":"2023-09-30T22:58:40.697221+0000","last_active":"2023-09-30T22:58:40.697518+0000","last_peered":"2023-09-30T22:58:40.697518+0000","last_clean":"2023-09-30T22:58:40.697518+0000","last_became_active":"2023-09-30T22:58:40.695853+0000","last_became_peered":"2023-09-30T22:58:40.695853+0000","last_unstale":"2023-09-30T22:58:40.697518+0000","last_undegraded":"2023-09-30T22:58:40.697518+0000","last_fullsized":"2023-09-30T22:58:40.697518+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:04.498833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697633+0000","last_change":"2023-09-30T22:58:40.697559+0000","last_active":"2023-09-30T22:58:40.697633+0000","last_peered":"2023-09-30T22:58:40.697633+0000","last_clean":"2023-09-30T22:58:40.697633+0000","last_became_active":"2023-09-30T22:58:40.697337+0000","last_became_peered":"2023-09-30T22:58:40.697337+0000","last_unstale":"2023-09-30T22:58:40.697633+0000","last_undegraded":"2023-09-30T22:58:40.697633+0000","last_fullsized":"2023-09-30T22:58:40.697633+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:27:27.696411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695399+0000","last_change":"2023-09-30T22:58:40.695240+0000","last_active":"2023-09-30T22:58:40.695399+0000","last_peered":"2023-09-30T22:58:40.695399+0000","last_clean":"2023-09-30T22:58:40.695399+0000","last_became_active":"2023-09-30T22:58:40.695001+0000","last_became_peered":"2023-09-30T22:58:40.695001+0000","last_unstale":"2023-09-30T22:58:40.695399+0000","last_undegraded":"2023-09-30T22:58:40.695399+0000","last_fullsized":"2023-09-30T22:58:40.695399+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:07:04.501786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.707049+0000","last_change":"2023-09-30T22:58:40.706896+0000","last_active":"2023-09-30T22:58:40.707049+0000","last_peered":"2023-09-30T22:58:40.707049+0000","last_clean":"2023-09-30T22:58:40.707049+0000","last_became_active":"2023-09-30T22:58:40.706600+0000","last_became_peered":"2023-09-30T22:58:40.706600+0000","last_unstale":"2023-09-30T22:58:40.707049+0000","last_undegraded":"2023-09-30T22:58:40.707049+0000","last_fullsized":"2023-09-30T22:58:40.707049+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:37:23.839463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.706680+0000","last_change":"2023-09-30T22:58:40.706549+0000","last_active":"2023-09-30T22:58:40.706680+0000","last_peered":"2023-09-30T22:58:40.706680+0000","last_clean":"2023-09-30T22:58:40.706680+0000","last_became_active":"2023-09-30T22:58:40.706264+0000","last_became_peered":"2023-09-30T22:58:40.706264+0000","last_unstale":"2023-09-30T22:58:40.706680+0000","last_undegraded":"2023-09-30T22:58:40.706680+0000","last_fullsized":"2023-09-30T22:58:40.706680+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:45:58.782620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698435+0000","last_change":"2023-09-30T22:58:40.698302+0000","last_active":"2023-09-30T22:58:40.698435+0000","last_peered":"2023-09-30T22:58:40.698435+0000","last_clean":"2023-09-30T22:58:40.698435+0000","last_became_active":"2023-09-30T22:58:40.697631+0000","last_became_peered":"2023-09-30T22:58:40.697631+0000","last_unstale":"2023-09-30T22:58:40.698435+0000","last_undegraded":"2023-09-30T22:58:40.698435+0000","last_fullsized":"2023-09-30T22:58:40.698435+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:58:39.857906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696855+0000","last_change":"2023-09-30T22:58:40.696730+0000","last_active":"2023-09-30T22:58:40.696855+0000","last_peered":"2023-09-30T22:58:40.696855+0000","last_clean":"2023-09-30T22:58:40.696855+0000","last_became_active":"2023-09-30T22:58:40.696514+0000","last_became_peered":"2023-09-30T22:58:40.696514+0000","last_unstale":"2023-09-30T22:58:40.696855+0000","last_undegraded":"2023-09-30T22:58:40.696855+0000","last_fullsized":"2023-09-30T22:58:40.696855+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:23:01.628360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696794+0000","last_change":"2023-09-30T22:58:40.695347+0000","last_active":"2023-09-30T22:58:40.696794+0000","last_peered":"2023-09-30T22:58:40.696794+0000","last_clean":"2023-09-30T22:58:40.696794+0000","last_became_active":"2023-09-30T22:58:40.695129+0000","last_became_peered":"2023-09-30T22:58:40.695129+0000","last_unstale":"2023-09-30T22:58:40.696794+0000","last_undegraded":"2023-09-30T22:58:40.696794+0000","last_fullsized":"2023-09-30T22:58:40.696794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:51:13.635665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702636+0000","last_change":"2023-09-30T22:58:40.702527+0000","last_active":"2023-09-30T22:58:40.702636+0000","last_peered":"2023-09-30T22:58:40.702636+0000","last_clean":"2023-09-30T22:58:40.702636+0000","last_became_active":"2023-09-30T22:58:40.702304+0000","last_became_peered":"2023-09-30T22:58:40.702304+0000","last_unstale":"2023-09-30T22:58:40.702636+0000","last_undegraded":"2023-09-30T22:58:40.702636+0000","last_fullsized":"2023-09-30T22:58:40.702636+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:32:20.271801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696650+0000","last_change":"2023-09-30T22:58:40.696577+0000","last_active":"2023-09-30T22:58:40.696650+0000","last_peered":"2023-09-30T22:58:40.696650+0000","last_clean":"2023-09-30T22:58:40.696650+0000","last_became_active":"2023-09-30T22:58:40.696366+0000","last_became_peered":"2023-09-30T22:58:40.696366+0000","last_unstale":"2023-09-30T22:58:40.696650+0000","last_undegraded":"2023-09-30T22:58:40.696650+0000","last_fullsized":"2023-09-30T22:58:40.696650+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:05.719718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.689181+0000","last_change":"2023-09-30T22:58:40.689098+0000","last_active":"2023-09-30T22:58:40.689181+0000","last_peered":"2023-09-30T22:58:40.689181+0000","last_clean":"2023-09-30T22:58:40.689181+0000","last_became_active":"2023-09-30T22:58:40.688841+0000","last_became_peered":"2023-09-30T22:58:40.688841+0000","last_unstale":"2023-09-30T22:58:40.689181+0000","last_undegraded":"2023-09-30T22:58:40.689181+0000","last_fullsized":"2023-09-30T22:58:40.689181+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:08:35.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695674+0000","last_change":"2023-09-30T22:58:40.695599+0000","last_active":"2023-09-30T22:58:40.695674+0000","last_peered":"2023-09-30T22:58:40.695674+0000","last_clean":"2023-09-30T22:58:40.695674+0000","last_became_active":"2023-09-30T22:58:40.695389+0000","last_became_peered":"2023-09-30T22:58:40.695389+0000","last_unstale":"2023-09-30T22:58:40.695674+0000","last_undegraded":"2023-09-30T22:58:40.695674+0000","last_fullsized":"2023-09-30T22:58:40.695674+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:03.663901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697421+0000","last_change":"2023-09-30T22:58:40.696638+0000","last_active":"2023-09-30T22:58:40.697421+0000","last_peered":"2023-09-30T22:58:40.697421+0000","last_clean":"2023-09-30T22:58:40.697421+0000","last_became_active":"2023-09-30T22:58:40.696420+0000","last_became_peered":"2023-09-30T22:58:40.696420+0000","last_unstale":"2023-09-30T22:58:40.697421+0000","last_undegraded":"2023-09-30T22:58:40.697421+0000","last_fullsized":"2023-09-30T22:58:40.697421+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:29.359388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696521+0000","last_change":"2023-09-30T22:58:40.695985+0000","last_active":"2023-09-30T22:58:40.696521+0000","last_peered":"2023-09-30T22:58:40.696521+0000","last_clean":"2023-09-30T22:58:40.696521+0000","last_became_active":"2023-09-30T22:58:40.695649+0000","last_became_peered":"2023-09-30T22:58:40.695649+0000","last_unstale":"2023-09-30T22:58:40.696521+0000","last_undegraded":"2023-09-30T22:58:40.696521+0000","last_fullsized":"2023-09-30T22:58:40.696521+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:21.897119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688575+0000","last_change":"2023-09-30T22:58:40.688514+0000","last_active":"2023-09-30T22:58:40.688575+0000","last_peered":"2023-09-30T22:58:40.688575+0000","last_clean":"2023-09-30T22:58:40.688575+0000","last_became_active":"2023-09-30T22:58:40.688108+0000","last_became_peered":"2023-09-30T22:58:40.688108+0000","last_unstale":"2023-09-30T22:58:40.688575+0000","last_undegraded":"2023-09-30T22:58:40.688575+0000","last_fullsized":"2023-09-30T22:58:40.688575+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:57:20.410289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716963+0000","last_change":"2023-09-30T22:58:39.682410+0000","last_active":"2023-09-30T22:58:40.716963+0000","last_peered":"2023-09-30T22:58:40.716963+0000","last_clean":"2023-09-30T22:58:40.716963+0000","last_became_active":"2023-09-30T22:58:39.681975+0000","last_became_peered":"2023-09-30T22:58:39.681975+0000","last_unstale":"2023-09-30T22:58:40.716963+0000","last_undegraded":"2023-09-30T22:58:40.716963+0000","last_fullsized":"2023-09-30T22:58:40.716963+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:37.036140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698411+0000","last_change":"2023-09-30T22:58:40.698179+0000","last_active":"2023-09-30T22:58:40.698411+0000","last_peered":"2023-09-30T22:58:40.698411+0000","last_clean":"2023-09-30T22:58:40.698411+0000","last_became_active":"2023-09-30T22:58:40.697562+0000","last_became_peered":"2023-09-30T22:58:40.697562+0000","last_unstale":"2023-09-30T22:58:40.698411+0000","last_undegraded":"2023-09-30T22:58:40.698411+0000","last_fullsized":"2023-09-30T22:58:40.698411+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:10:44.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.717632+0000","last_change":"2023-09-30T22:58:39.677723+0000","last_active":"2023-09-30T22:58:40.717632+0000","last_peered":"2023-09-30T22:58:40.717632+0000","last_clean":"2023-09-30T22:58:40.717632+0000","last_became_active":"2023-09-30T22:58:39.677467+0000","last_became_peered":"2023-09-30T22:58:39.677467+0000","last_unstale":"2023-09-30T22:58:40.717632+0000","last_undegraded":"2023-09-30T22:58:40.717632+0000","last_fullsized":"2023-09-30T22:58:40.717632+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:03.895204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.705901+0000","last_change":"2023-09-30T22:58:40.705837+0000","last_active":"2023-09-30T22:58:40.705901+0000","last_peered":"2023-09-30T22:58:40.705901+0000","last_clean":"2023-09-30T22:58:40.705901+0000","last_became_active":"2023-09-30T22:58:40.705658+0000","last_became_peered":"2023-09-30T22:58:40.705658+0000","last_unstale":"2023-09-30T22:58:40.705901+0000","last_undegraded":"2023-09-30T22:58:40.705901+0000","last_fullsized":"2023-09-30T22:58:40.705901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:52:38.533981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716096+0000","last_change":"2023-09-30T22:58:39.683876+0000","last_active":"2023-09-30T22:58:40.716096+0000","last_peered":"2023-09-30T22:58:40.716096+0000","last_clean":"2023-09-30T22:58:40.716096+0000","last_became_active":"2023-09-30T22:58:39.683592+0000","last_became_peered":"2023-09-30T22:58:39.683592+0000","last_unstale":"2023-09-30T22:58:40.716096+0000","last_undegraded":"2023-09-30T22:58:40.716096+0000","last_fullsized":"2023-09-30T22:58:40.716096+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:30.916018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694086+0000","last_change":"2023-09-30T22:58:40.693961+0000","last_active":"2023-09-30T22:58:40.694086+0000","last_peered":"2023-09-30T22:58:40.694086+0000","last_clean":"2023-09-30T22:58:40.694086+0000","last_became_active":"2023-09-30T22:58:40.693762+0000","last_became_peered":"2023-09-30T22:58:40.693762+0000","last_unstale":"2023-09-30T22:58:40.694086+0000","last_undegraded":"2023-09-30T22:58:40.694086+0000","last_fullsized":"2023-09-30T22:58:40.694086+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:32.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716942+0000","last_change":"2023-09-30T22:58:39.685208+0000","last_active":"2023-09-30T22:58:40.716942+0000","last_peered":"2023-09-30T22:58:40.716942+0000","last_clean":"2023-09-30T22:58:40.716942+0000","last_became_active":"2023-09-30T22:58:39.684619+0000","last_became_peered":"2023-09-30T22:58:39.684619+0000","last_unstale":"2023-09-30T22:58:40.716942+0000","last_undegraded":"2023-09-30T22:58:40.716942+0000","last_fullsized":"2023-09-30T22:58:40.716942+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:26:16.335174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696376+0000","last_change":"2023-09-30T22:58:40.695610+0000","last_active":"2023-09-30T22:58:40.696376+0000","last_peered":"2023-09-30T22:58:40.696376+0000","last_clean":"2023-09-30T22:58:40.696376+0000","last_became_active":"2023-09-30T22:58:40.695023+0000","last_became_peered":"2023-09-30T22:58:40.695023+0000","last_unstale":"2023-09-30T22:58:40.696376+0000","last_undegraded":"2023-09-30T22:58:40.696376+0000","last_fullsized":"2023-09-30T22:58:40.696376+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:59.714949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716816+0000","last_change":"2023-09-30T22:58:39.682873+0000","last_active":"2023-09-30T22:58:40.716816+0000","last_peered":"2023-09-30T22:58:40.716816+0000","last_clean":"2023-09-30T22:58:40.716816+0000","last_became_active":"2023-09-30T22:58:39.682596+0000","last_became_peered":"2023-09-30T22:58:39.682596+0000","last_unstale":"2023-09-30T22:58:40.716816+0000","last_undegraded":"2023-09-30T22:58:40.716816+0000","last_fullsized":"2023-09-30T22:58:40.716816+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:00.008801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699147+0000","last_change":"2023-09-30T22:58:40.697964+0000","last_active":"2023-09-30T22:58:40.699147+0000","last_peered":"2023-09-30T22:58:40.699147+0000","last_clean":"2023-09-30T22:58:40.699147+0000","last_became_active":"2023-09-30T22:58:40.697647+0000","last_became_peered":"2023-09-30T22:58:40.697647+0000","last_unstale":"2023-09-30T22:58:40.699147+0000","last_undegraded":"2023-09-30T22:58:40.699147+0000","last_fullsized":"2023-09-30T22:58:40.699147+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:22.970518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718373+0000","last_change":"2023-09-30T22:58:39.683464+0000","last_active":"2023-09-30T22:58:40.718373+0000","last_peered":"2023-09-30T22:58:40.718373+0000","last_clean":"2023-09-30T22:58:40.718373+0000","last_became_active":"2023-09-30T22:58:39.683237+0000","last_became_peered":"2023-09-30T22:58:39.683237+0000","last_unstale":"2023-09-30T22:58:40.718373+0000","last_undegraded":"2023-09-30T22:58:40.718373+0000","last_fullsized":"2023-09-30T22:58:40.718373+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:45:57.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.704036+0000","last_change":"2023-09-30T22:58:40.703964+0000","last_active":"2023-09-30T22:58:40.704036+0000","last_peered":"2023-09-30T22:58:40.704036+0000","last_clean":"2023-09-30T22:58:40.704036+0000","last_became_active":"2023-09-30T22:58:40.703728+0000","last_became_peered":"2023-09-30T22:58:40.703728+0000","last_unstale":"2023-09-30T22:58:40.704036+0000","last_undegraded":"2023-09-30T22:58:40.704036+0000","last_fullsized":"2023-09-30T22:58:40.704036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:31:41.595143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690992+0000","last_change":"2023-09-30T22:58:39.683102+0000","last_active":"2023-09-30T22:58:40.690992+0000","last_peered":"2023-09-30T22:58:40.690992+0000","last_clean":"2023-09-30T22:58:40.690992+0000","last_became_active":"2023-09-30T22:58:39.682876+0000","last_became_peered":"2023-09-30T22:58:39.682876+0000","last_unstale":"2023-09-30T22:58:40.690992+0000","last_undegraded":"2023-09-30T22:58:40.690992+0000","last_fullsized":"2023-09-30T22:58:40.690992+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:00.908278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702969+0000","last_change":"2023-09-30T22:58:40.702856+0000","last_active":"2023-09-30T22:58:40.702969+0000","last_peered":"2023-09-30T22:58:40.702969+0000","last_clean":"2023-09-30T22:58:40.702969+0000","last_became_active":"2023-09-30T22:58:40.701610+0000","last_became_peered":"2023-09-30T22:58:40.701610+0000","last_unstale":"2023-09-30T22:58:40.702969+0000","last_undegraded":"2023-09-30T22:58:40.702969+0000","last_fullsized":"2023-09-30T22:58:40.702969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:32.566886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.692177+0000","last_change":"2023-09-30T22:58:39.689207+0000","last_active":"2023-09-30T22:58:40.692177+0000","last_peered":"2023-09-30T22:58:40.692177+0000","last_clean":"2023-09-30T22:58:40.692177+0000","last_became_active":"2023-09-30T22:58:39.688963+0000","last_became_peered":"2023-09-30T22:58:39.688963+0000","last_unstale":"2023-09-30T22:58:40.692177+0000","last_undegraded":"2023-09-30T22:58:40.692177+0000","last_fullsized":"2023-09-30T22:58:40.692177+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:08:07.262716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697552+0000","last_change":"2023-09-30T22:58:40.697452+0000","last_active":"2023-09-30T22:58:40.697552+0000","last_peered":"2023-09-30T22:58:40.697552+0000","last_clean":"2023-09-30T22:58:40.697552+0000","last_became_active":"2023-09-30T22:58:40.697208+0000","last_became_peered":"2023-09-30T22:58:40.697208+0000","last_unstale":"2023-09-30T22:58:40.697552+0000","last_undegraded":"2023-09-30T22:58:40.697552+0000","last_fullsized":"2023-09-30T22:58:40.697552+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:03.663901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685990+0000","last_change":"2023-09-30T22:58:39.682387+0000","last_active":"2023-09-30T22:58:40.685990+0000","last_peered":"2023-09-30T22:58:40.685990+0000","last_clean":"2023-09-30T22:58:40.685990+0000","last_became_active":"2023-09-30T22:58:39.682165+0000","last_became_peered":"2023-09-30T22:58:39.682165+0000","last_unstale":"2023-09-30T22:58:40.685990+0000","last_undegraded":"2023-09-30T22:58:40.685990+0000","last_fullsized":"2023-09-30T22:58:40.685990+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:03.895204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696394+0000","last_change":"2023-09-30T22:58:40.695789+0000","last_active":"2023-09-30T22:58:40.696394+0000","last_peered":"2023-09-30T22:58:40.696394+0000","last_clean":"2023-09-30T22:58:40.696394+0000","last_became_active":"2023-09-30T22:58:40.695371+0000","last_became_peered":"2023-09-30T22:58:40.695371+0000","last_unstale":"2023-09-30T22:58:40.696394+0000","last_undegraded":"2023-09-30T22:58:40.696394+0000","last_fullsized":"2023-09-30T22:58:40.696394+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:00.627436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.687416+0000","last_change":"2023-09-30T22:58:39.676094+0000","last_active":"2023-09-30T22:58:40.687416+0000","last_peered":"2023-09-30T22:58:40.687416+0000","last_clean":"2023-09-30T22:58:40.687416+0000","last_became_active":"2023-09-30T22:58:39.675736+0000","last_became_peered":"2023-09-30T22:58:39.675736+0000","last_unstale":"2023-09-30T22:58:40.687416+0000","last_undegraded":"2023-09-30T22:58:40.687416+0000","last_fullsized":"2023-09-30T22:58:40.687416+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:40.145225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698667+0000","last_change":"2023-09-30T22:58:40.698455+0000","last_active":"2023-09-30T22:58:40.698667+0000","last_peered":"2023-09-30T22:58:40.698667+0000","last_clean":"2023-09-30T22:58:40.698667+0000","last_became_active":"2023-09-30T22:58:40.698001+0000","last_became_peered":"2023-09-30T22:58:40.698001+0000","last_unstale":"2023-09-30T22:58:40.698667+0000","last_undegraded":"2023-09-30T22:58:40.698667+0000","last_fullsized":"2023-09-30T22:58:40.698667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"129'3","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.719175+0000","last_change":"2023-09-30T22:58:39.674547+0000","last_active":"2023-09-30T22:58:40.719175+0000","last_peered":"2023-09-30T22:58:40.719175+0000","last_clean":"2023-09-30T22:58:40.719175+0000","last_became_active":"2023-09-30T22:58:39.674329+0000","last_became_peered":"2023-09-30T22:58:39.674329+0000","last_unstale":"2023-09-30T22:58:40.719175+0000","last_undegraded":"2023-09-30T22:58:40.719175+0000","last_fullsized":"2023-09-30T22:58:40.719175+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:51.176180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699748+0000","last_change":"2023-09-30T22:58:40.699616+0000","last_active":"2023-09-30T22:58:40.699748+0000","last_peered":"2023-09-30T22:58:40.699748+0000","last_clean":"2023-09-30T22:58:40.699748+0000","last_became_active":"2023-09-30T22:58:40.699198+0000","last_became_peered":"2023-09-30T22:58:40.699198+0000","last_unstale":"2023-09-30T22:58:40.699748+0000","last_undegraded":"2023-09-30T22:58:40.699748+0000","last_fullsized":"2023-09-30T22:58:40.699748+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:26:17.341487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"129'6","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.719603+0000","last_change":"2023-09-30T22:58:39.682265+0000","last_active":"2023-09-30T22:58:40.719603+0000","last_peered":"2023-09-30T22:58:40.719603+0000","last_clean":"2023-09-30T22:58:40.719603+0000","last_became_active":"2023-09-30T22:58:39.681938+0000","last_became_peered":"2023-09-30T22:58:39.681938+0000","last_unstale":"2023-09-30T22:58:40.719603+0000","last_undegraded":"2023-09-30T22:58:40.719603+0000","last_fullsized":"2023-09-30T22:58:40.719603+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:08.920262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.704039+0000","last_change":"2023-09-30T22:58:40.703978+0000","last_active":"2023-09-30T22:58:40.704039+0000","last_peered":"2023-09-30T22:58:40.704039+0000","last_clean":"2023-09-30T22:58:40.704039+0000","last_became_active":"2023-09-30T22:58:40.703759+0000","last_became_peered":"2023-09-30T22:58:40.703759+0000","last_unstale":"2023-09-30T22:58:40.704039+0000","last_undegraded":"2023-09-30T22:58:40.704039+0000","last_fullsized":"2023-09-30T22:58:40.704039+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:57.068524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716599+0000","last_change":"2023-09-30T22:58:39.688718+0000","last_active":"2023-09-30T22:58:40.716599+0000","last_peered":"2023-09-30T22:58:40.716599+0000","last_clean":"2023-09-30T22:58:40.716599+0000","last_became_active":"2023-09-30T22:58:39.687989+0000","last_became_peered":"2023-09-30T22:58:39.687989+0000","last_unstale":"2023-09-30T22:58:40.716599+0000","last_undegraded":"2023-09-30T22:58:40.716599+0000","last_fullsized":"2023-09-30T22:58:40.716599+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:41.590976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696097+0000","last_change":"2023-09-30T22:58:40.696018+0000","last_active":"2023-09-30T22:58:40.696097+0000","last_peered":"2023-09-30T22:58:40.696097+0000","last_clean":"2023-09-30T22:58:40.696097+0000","last_became_active":"2023-09-30T22:58:40.695683+0000","last_became_peered":"2023-09-30T22:58:40.695683+0000","last_unstale":"2023-09-30T22:58:40.696097+0000","last_undegraded":"2023-09-30T22:58:40.696097+0000","last_fullsized":"2023-09-30T22:58:40.696097+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:45:58.591669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.687680+0000","last_change":"2023-09-30T22:58:39.685340+0000","last_active":"2023-09-30T22:58:40.687680+0000","last_peered":"2023-09-30T22:58:40.687680+0000","last_clean":"2023-09-30T22:58:40.687680+0000","last_became_active":"2023-09-30T22:58:39.684980+0000","last_became_peered":"2023-09-30T22:58:39.684980+0000","last_unstale":"2023-09-30T22:58:40.687680+0000","last_undegraded":"2023-09-30T22:58:40.687680+0000","last_fullsized":"2023-09-30T22:58:40.687680+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:01.049721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700346+0000","last_change":"2023-09-30T22:58:40.700267+0000","last_active":"2023-09-30T22:58:40.700346+0000","last_peered":"2023-09-30T22:58:40.700346+0000","last_clean":"2023-09-30T22:58:40.700346+0000","last_became_active":"2023-09-30T22:58:40.699835+0000","last_became_peered":"2023-09-30T22:58:40.699835+0000","last_unstale":"2023-09-30T22:58:40.700346+0000","last_undegraded":"2023-09-30T22:58:40.700346+0000","last_fullsized":"2023-09-30T22:58:40.700346+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:02.056034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694644+0000","last_change":"2023-09-30T22:58:39.684258+0000","last_active":"2023-09-30T22:58:40.694644+0000","last_peered":"2023-09-30T22:58:40.694644+0000","last_clean":"2023-09-30T22:58:40.694644+0000","last_became_active":"2023-09-30T22:58:39.684032+0000","last_became_peered":"2023-09-30T22:58:39.684032+0000","last_unstale":"2023-09-30T22:58:40.694644+0000","last_undegraded":"2023-09-30T22:58:40.694644+0000","last_fullsized":"2023-09-30T22:58:40.694644+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:14.182466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688455+0000","last_change":"2023-09-30T22:58:40.688355+0000","last_active":"2023-09-30T22:58:40.688455+0000","last_peered":"2023-09-30T22:58:40.688455+0000","last_clean":"2023-09-30T22:58:40.688455+0000","last_became_active":"2023-09-30T22:58:40.687793+0000","last_became_peered":"2023-09-30T22:58:40.687793+0000","last_unstale":"2023-09-30T22:58:40.688455+0000","last_undegraded":"2023-09-30T22:58:40.688455+0000","last_fullsized":"2023-09-30T22:58:40.688455+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:30:27.659649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"129'8","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718099+0000","last_change":"2023-09-30T22:58:39.683255+0000","last_active":"2023-09-30T22:58:40.718099+0000","last_peered":"2023-09-30T22:58:40.718099+0000","last_clean":"2023-09-30T22:58:40.718099+0000","last_became_active":"2023-09-30T22:58:39.682776+0000","last_became_peered":"2023-09-30T22:58:39.682776+0000","last_unstale":"2023-09-30T22:58:40.718099+0000","last_undegraded":"2023-09-30T22:58:40.718099+0000","last_fullsized":"2023-09-30T22:58:40.718099+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:27:26.690098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697846+0000","last_change":"2023-09-30T22:58:40.697715+0000","last_active":"2023-09-30T22:58:40.697846+0000","last_peered":"2023-09-30T22:58:40.697846+0000","last_clean":"2023-09-30T22:58:40.697846+0000","last_became_active":"2023-09-30T22:58:40.697491+0000","last_became_peered":"2023-09-30T22:58:40.697491+0000","last_unstale":"2023-09-30T22:58:40.697846+0000","last_undegraded":"2023-09-30T22:58:40.697846+0000","last_fullsized":"2023-09-30T22:58:40.697846+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:52.182493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718013+0000","last_change":"2023-09-30T22:58:39.678572+0000","last_active":"2023-09-30T22:58:40.718013+0000","last_peered":"2023-09-30T22:58:40.718013+0000","last_clean":"2023-09-30T22:58:40.718013+0000","last_became_active":"2023-09-30T22:58:39.678203+0000","last_became_peered":"2023-09-30T22:58:39.678203+0000","last_unstale":"2023-09-30T22:58:40.718013+0000","last_undegraded":"2023-09-30T22:58:40.718013+0000","last_fullsized":"2023-09-30T22:58:40.718013+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:52:37.527668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694290+0000","last_change":"2023-09-30T22:58:40.694010+0000","last_active":"2023-09-30T22:58:40.694290+0000","last_peered":"2023-09-30T22:58:40.694290+0000","last_clean":"2023-09-30T22:58:40.694290+0000","last_became_active":"2023-09-30T22:58:40.693748+0000","last_became_peered":"2023-09-30T22:58:40.693748+0000","last_unstale":"2023-09-30T22:58:40.694290+0000","last_undegraded":"2023-09-30T22:58:40.694290+0000","last_fullsized":"2023-09-30T22:58:40.694290+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:03.489639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686045+0000","last_change":"2023-09-30T22:58:39.678282+0000","last_active":"2023-09-30T22:58:40.686045+0000","last_peered":"2023-09-30T22:58:40.686045+0000","last_clean":"2023-09-30T22:58:40.686045+0000","last_became_active":"2023-09-30T22:58:39.677978+0000","last_became_peered":"2023-09-30T22:58:39.677978+0000","last_unstale":"2023-09-30T22:58:40.686045+0000","last_undegraded":"2023-09-30T22:58:40.686045+0000","last_fullsized":"2023-09-30T22:58:40.686045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:56.062211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690333+0000","last_change":"2023-09-30T22:58:40.690252+0000","last_active":"2023-09-30T22:58:40.690333+0000","last_peered":"2023-09-30T22:58:40.690333+0000","last_clean":"2023-09-30T22:58:40.690333+0000","last_became_active":"2023-09-30T22:58:40.689983+0000","last_became_peered":"2023-09-30T22:58:40.689983+0000","last_unstale":"2023-09-30T22:58:40.690333+0000","last_undegraded":"2023-09-30T22:58:40.690333+0000","last_fullsized":"2023-09-30T22:58:40.690333+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:29.359388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691234+0000","last_change":"2023-09-30T22:58:39.685991+0000","last_active":"2023-09-30T22:58:40.691234+0000","last_peered":"2023-09-30T22:58:40.691234+0000","last_clean":"2023-09-30T22:58:40.691234+0000","last_became_active":"2023-09-30T22:58:39.685310+0000","last_became_peered":"2023-09-30T22:58:39.685310+0000","last_unstale":"2023-09-30T22:58:40.691234+0000","last_undegraded":"2023-09-30T22:58:40.691234+0000","last_fullsized":"2023-09-30T22:58:40.691234+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:51:12.629352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697951+0000","last_change":"2023-09-30T22:58:40.697666+0000","last_active":"2023-09-30T22:58:40.697951+0000","last_peered":"2023-09-30T22:58:40.697951+0000","last_clean":"2023-09-30T22:58:40.697951+0000","last_became_active":"2023-09-30T22:58:40.697436+0000","last_became_peered":"2023-09-30T22:58:40.697436+0000","last_unstale":"2023-09-30T22:58:40.697951+0000","last_undegraded":"2023-09-30T22:58:40.697951+0000","last_fullsized":"2023-09-30T22:58:40.697951+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:09.305544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.693590+0000","last_change":"2023-09-30T22:58:39.688234+0000","last_active":"2023-09-30T22:58:40.693590+0000","last_peered":"2023-09-30T22:58:40.693590+0000","last_clean":"2023-09-30T22:58:40.693590+0000","last_became_active":"2023-09-30T22:58:39.687022+0000","last_became_peered":"2023-09-30T22:58:39.687022+0000","last_unstale":"2023-09-30T22:58:40.693590+0000","last_undegraded":"2023-09-30T22:58:40.693590+0000","last_fullsized":"2023-09-30T22:58:40.693590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:08.299231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.703306+0000","last_change":"2023-09-30T22:58:40.703115+0000","last_active":"2023-09-30T22:58:40.703306+0000","last_peered":"2023-09-30T22:58:40.703306+0000","last_clean":"2023-09-30T22:58:40.703306+0000","last_became_active":"2023-09-30T22:58:40.702544+0000","last_became_peered":"2023-09-30T22:58:40.702544+0000","last_unstale":"2023-09-30T22:58:40.703306+0000","last_undegraded":"2023-09-30T22:58:40.703306+0000","last_fullsized":"2023-09-30T22:58:40.703306+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:25.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690735+0000","last_change":"2023-09-30T22:58:39.682955+0000","last_active":"2023-09-30T22:58:40.690735+0000","last_peered":"2023-09-30T22:58:40.690735+0000","last_clean":"2023-09-30T22:58:40.690735+0000","last_became_active":"2023-09-30T22:58:39.682499+0000","last_became_peered":"2023-09-30T22:58:39.682499+0000","last_unstale":"2023-09-30T22:58:40.690735+0000","last_undegraded":"2023-09-30T22:58:40.690735+0000","last_fullsized":"2023-09-30T22:58:40.690735+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:32:19.265488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702932+0000","last_change":"2023-09-30T22:58:40.701273+0000","last_active":"2023-09-30T22:58:40.702932+0000","last_peered":"2023-09-30T22:58:40.702932+0000","last_clean":"2023-09-30T22:58:40.702932+0000","last_became_active":"2023-09-30T22:58:40.700969+0000","last_became_peered":"2023-09-30T22:58:40.700969+0000","last_unstale":"2023-09-30T22:58:40.702932+0000","last_undegraded":"2023-09-30T22:58:40.702932+0000","last_fullsized":"2023-09-30T22:58:40.702932+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:37:03.557770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685798+0000","last_change":"2023-09-30T22:58:39.677443+0000","last_active":"2023-09-30T22:58:40.685798+0000","last_peered":"2023-09-30T22:58:40.685798+0000","last_clean":"2023-09-30T22:58:40.685798+0000","last_became_active":"2023-09-30T22:58:39.677104+0000","last_became_peered":"2023-09-30T22:58:39.677104+0000","last_unstale":"2023-09-30T22:58:40.685798+0000","last_undegraded":"2023-09-30T22:58:40.685798+0000","last_fullsized":"2023-09-30T22:58:40.685798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:45:57.585356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698460+0000","last_change":"2023-09-30T22:58:40.698395+0000","last_active":"2023-09-30T22:58:40.698460+0000","last_peered":"2023-09-30T22:58:40.698460+0000","last_clean":"2023-09-30T22:58:40.698460+0000","last_became_active":"2023-09-30T22:58:40.698187+0000","last_became_peered":"2023-09-30T22:58:40.698187+0000","last_unstale":"2023-09-30T22:58:40.698460+0000","last_undegraded":"2023-09-30T22:58:40.698460+0000","last_fullsized":"2023-09-30T22:58:40.698460+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:11:25.738844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695199+0000","last_change":"2023-09-30T22:58:39.679317+0000","last_active":"2023-09-30T22:58:40.695199+0000","last_peered":"2023-09-30T22:58:40.695199+0000","last_clean":"2023-09-30T22:58:40.695199+0000","last_became_active":"2023-09-30T22:58:39.679101+0000","last_became_peered":"2023-09-30T22:58:39.679101+0000","last_unstale":"2023-09-30T22:58:40.695199+0000","last_undegraded":"2023-09-30T22:58:40.695199+0000","last_fullsized":"2023-09-30T22:58:40.695199+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:10:43.506709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700868+0000","last_change":"2023-09-30T22:58:40.700786+0000","last_active":"2023-09-30T22:58:40.700868+0000","last_peered":"2023-09-30T22:58:40.700868+0000","last_clean":"2023-09-30T22:58:40.700868+0000","last_became_active":"2023-09-30T22:58:40.700552+0000","last_became_peered":"2023-09-30T22:58:40.700552+0000","last_unstale":"2023-09-30T22:58:40.700868+0000","last_undegraded":"2023-09-30T22:58:40.700868+0000","last_fullsized":"2023-09-30T22:58:40.700868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:34:33.710516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686169+0000","last_change":"2023-09-30T22:58:39.683398+0000","last_active":"2023-09-30T22:58:40.686169+0000","last_peered":"2023-09-30T22:58:40.686169+0000","last_clean":"2023-09-30T22:58:40.686169+0000","last_became_active":"2023-09-30T22:58:39.683163+0000","last_became_peered":"2023-09-30T22:58:39.683163+0000","last_unstale":"2023-09-30T22:58:40.686169+0000","last_undegraded":"2023-09-30T22:58:40.686169+0000","last_fullsized":"2023-09-30T22:58:40.686169+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:02:27.331064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700580+0000","last_change":"2023-09-30T22:58:40.700410+0000","last_active":"2023-09-30T22:58:40.700580+0000","last_peered":"2023-09-30T22:58:40.700580+0000","last_clean":"2023-09-30T22:58:40.700580+0000","last_became_active":"2023-09-30T22:58:40.700121+0000","last_became_peered":"2023-09-30T22:58:40.700121+0000","last_unstale":"2023-09-30T22:58:40.700580+0000","last_undegraded":"2023-09-30T22:58:40.700580+0000","last_fullsized":"2023-09-30T22:58:40.700580+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:41.151538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685037+0000","last_change":"2023-09-30T22:58:39.687773+0000","last_active":"2023-09-30T22:58:40.685037+0000","last_peered":"2023-09-30T22:58:40.685037+0000","last_clean":"2023-09-30T22:58:40.685037+0000","last_became_active":"2023-09-30T22:58:39.687639+0000","last_became_peered":"2023-09-30T22:58:39.687639+0000","last_unstale":"2023-09-30T22:58:40.685037+0000","last_undegraded":"2023-09-30T22:58:40.685037+0000","last_fullsized":"2023-09-30T22:58:40.685037+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:01.049721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685564+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:58:40.685564+0000","last_peered":"2023-09-30T22:58:40.685564+0000","last_clean":"2023-09-30T22:58:40.685564+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:58:40.685564+0000","last_undegraded":"2023-09-30T22:58:40.685564+0000","last_fullsized":"2023-09-30T22:58:40.685564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698452+0000","last_change":"2023-09-30T22:58:40.698342+0000","last_active":"2023-09-30T22:58:40.698452+0000","last_peered":"2023-09-30T22:58:40.698452+0000","last_clean":"2023-09-30T22:58:40.698452+0000","last_became_active":"2023-09-30T22:58:40.697933+0000","last_became_peered":"2023-09-30T22:58:40.697933+0000","last_unstale":"2023-09-30T22:58:40.698452+0000","last_undegraded":"2023-09-30T22:58:40.698452+0000","last_fullsized":"2023-09-30T22:58:40.698452+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:27.651331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718426+0000","last_change":"2023-09-30T22:58:39.676593+0000","last_active":"2023-09-30T22:58:40.718426+0000","last_peered":"2023-09-30T22:58:40.718426+0000","last_clean":"2023-09-30T22:58:40.718426+0000","last_became_active":"2023-09-30T22:58:39.676349+0000","last_became_peered":"2023-09-30T22:58:39.676349+0000","last_unstale":"2023-09-30T22:58:40.718426+0000","last_undegraded":"2023-09-30T22:58:40.718426+0000","last_fullsized":"2023-09-30T22:58:40.718426+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:37:22.833150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690450+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:58:40.690450+0000","last_peered":"2023-09-30T22:58:40.690450+0000","last_clean":"2023-09-30T22:58:40.690450+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:58:40.690450+0000","last_undegraded":"2023-09-30T22:58:40.690450+0000","last_fullsized":"2023-09-30T22:58:40.690450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700250+0000","last_change":"2023-09-30T22:58:40.700083+0000","last_active":"2023-09-30T22:58:40.700250+0000","last_peered":"2023-09-30T22:58:40.700250+0000","last_clean":"2023-09-30T22:58:40.700250+0000","last_became_active":"2023-09-30T22:58:40.699521+0000","last_became_peered":"2023-09-30T22:58:40.699521+0000","last_unstale":"2023-09-30T22:58:40.700250+0000","last_undegraded":"2023-09-30T22:58:40.700250+0000","last_fullsized":"2023-09-30T22:58:40.700250+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:08.002099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686197+0000","last_change":"2023-09-30T22:58:39.679151+0000","last_active":"2023-09-30T22:58:40.686197+0000","last_peered":"2023-09-30T22:58:40.686197+0000","last_clean":"2023-09-30T22:58:40.686197+0000","last_became_active":"2023-09-30T22:58:39.678636+0000","last_became_peered":"2023-09-30T22:58:39.678636+0000","last_unstale":"2023-09-30T22:58:40.686197+0000","last_undegraded":"2023-09-30T22:58:40.686197+0000","last_fullsized":"2023-09-30T22:58:40.686197+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:40.145225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691288+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:58:40.691288+0000","last_peered":"2023-09-30T22:58:40.691288+0000","last_clean":"2023-09-30T22:58:40.691288+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:58:40.691288+0000","last_undegraded":"2023-09-30T22:58:40.691288+0000","last_fullsized":"2023-09-30T22:58:40.691288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702064+0000","last_change":"2023-09-30T22:58:40.701849+0000","last_active":"2023-09-30T22:58:40.702064+0000","last_peered":"2023-09-30T22:58:40.702064+0000","last_clean":"2023-09-30T22:58:40.702064+0000","last_became_active":"2023-09-30T22:58:40.700727+0000","last_became_peered":"2023-09-30T22:58:40.700727+0000","last_unstale":"2023-09-30T22:58:40.702064+0000","last_undegraded":"2023-09-30T22:58:40.702064+0000","last_fullsized":"2023-09-30T22:58:40.702064+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716807+0000","last_change":"2023-09-30T22:58:39.687500+0000","last_active":"2023-09-30T22:58:40.716807+0000","last_peered":"2023-09-30T22:58:40.716807+0000","last_clean":"2023-09-30T22:58:40.716807+0000","last_became_active":"2023-09-30T22:58:39.686604+0000","last_became_peered":"2023-09-30T22:58:39.686604+0000","last_unstale":"2023-09-30T22:58:40.716807+0000","last_undegraded":"2023-09-30T22:58:40.716807+0000","last_fullsized":"2023-09-30T22:58:40.716807+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:41:58.354974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690810+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:58:40.690810+0000","last_peered":"2023-09-30T22:58:40.690810+0000","last_clean":"2023-09-30T22:58:40.690810+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:58:40.690810+0000","last_undegraded":"2023-09-30T22:58:40.690810+0000","last_fullsized":"2023-09-30T22:58:40.690810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691075+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:58:40.691075+0000","last_peered":"2023-09-30T22:58:40.691075+0000","last_clean":"2023-09-30T22:58:40.691075+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:58:40.691075+0000","last_undegraded":"2023-09-30T22:58:40.691075+0000","last_fullsized":"2023-09-30T22:58:40.691075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695462+0000","last_change":"2023-09-30T22:58:40.694403+0000","last_active":"2023-09-30T22:58:40.695462+0000","last_peered":"2023-09-30T22:58:40.695462+0000","last_clean":"2023-09-30T22:58:40.695462+0000","last_became_active":"2023-09-30T22:58:40.693900+0000","last_became_peered":"2023-09-30T22:58:40.693900+0000","last_unstale":"2023-09-30T22:58:40.695462+0000","last_undegraded":"2023-09-30T22:58:40.695462+0000","last_fullsized":"2023-09-30T22:58:40.695462+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:09.926575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718341+0000","last_change":"2023-09-30T22:58:39.682374+0000","last_active":"2023-09-30T22:58:40.718341+0000","last_peered":"2023-09-30T22:58:40.718341+0000","last_clean":"2023-09-30T22:58:40.718341+0000","last_became_active":"2023-09-30T22:58:39.682087+0000","last_became_peered":"2023-09-30T22:58:39.682087+0000","last_unstale":"2023-09-30T22:58:40.718341+0000","last_undegraded":"2023-09-30T22:58:40.718341+0000","last_fullsized":"2023-09-30T22:58:40.718341+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:26.645018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691377+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:58:40.691377+0000","last_peered":"2023-09-30T22:58:40.691377+0000","last_clean":"2023-09-30T22:58:40.691377+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:58:40.691377+0000","last_undegraded":"2023-09-30T22:58:40.691377+0000","last_fullsized":"2023-09-30T22:58:40.691377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.703325+0000","last_change":"2023-09-30T22:58:40.703267+0000","last_active":"2023-09-30T22:58:40.703325+0000","last_peered":"2023-09-30T22:58:40.703325+0000","last_clean":"2023-09-30T22:58:40.703325+0000","last_became_active":"2023-09-30T22:58:40.702865+0000","last_became_peered":"2023-09-30T22:58:40.702865+0000","last_unstale":"2023-09-30T22:58:40.703325+0000","last_undegraded":"2023-09-30T22:58:40.703325+0000","last_fullsized":"2023-09-30T22:58:40.703325+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:40.020637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.687790+0000","last_change":"2023-09-30T22:58:39.676444+0000","last_active":"2023-09-30T22:58:40.687790+0000","last_peered":"2023-09-30T22:58:40.687790+0000","last_clean":"2023-09-30T22:58:40.687790+0000","last_became_active":"2023-09-30T22:58:39.676125+0000","last_became_peered":"2023-09-30T22:58:39.676125+0000","last_unstale":"2023-09-30T22:58:40.687790+0000","last_undegraded":"2023-09-30T22:58:40.687790+0000","last_fullsized":"2023-09-30T22:58:40.687790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:06.995786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691306+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:58:40.691306+0000","last_peered":"2023-09-30T22:58:40.691306+0000","last_clean":"2023-09-30T22:58:40.691306+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:58:40.691306+0000","last_undegraded":"2023-09-30T22:58:40.691306+0000","last_fullsized":"2023-09-30T22:58:40.691306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702896+0000","last_change":"2023-09-30T22:58:40.700797+0000","last_active":"2023-09-30T22:58:40.702896+0000","last_peered":"2023-09-30T22:58:40.702896+0000","last_clean":"2023-09-30T22:58:40.702896+0000","last_became_active":"2023-09-30T22:58:40.700550+0000","last_became_peered":"2023-09-30T22:58:40.700550+0000","last_unstale":"2023-09-30T22:58:40.702896+0000","last_undegraded":"2023-09-30T22:58:40.702896+0000","last_fullsized":"2023-09-30T22:58:40.702896+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:03.489639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.719103+0000","last_change":"2023-09-30T22:58:39.681894+0000","last_active":"2023-09-30T22:58:40.719103+0000","last_peered":"2023-09-30T22:58:40.719103+0000","last_clean":"2023-09-30T22:58:40.719103+0000","last_became_active":"2023-09-30T22:58:39.681664+0000","last_became_peered":"2023-09-30T22:58:39.681664+0000","last_unstale":"2023-09-30T22:58:40.719103+0000","last_undegraded":"2023-09-30T22:58:40.719103+0000","last_fullsized":"2023-09-30T22:58:40.719103+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:13:11.147018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691671+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:58:40.691671+0000","last_peered":"2023-09-30T22:58:40.691671+0000","last_clean":"2023-09-30T22:58:40.691671+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:58:40.691671+0000","last_undegraded":"2023-09-30T22:58:40.691671+0000","last_fullsized":"2023-09-30T22:58:40.691671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699727+0000","last_change":"2023-09-30T22:58:40.699442+0000","last_active":"2023-09-30T22:58:40.699727+0000","last_peered":"2023-09-30T22:58:40.699727+0000","last_clean":"2023-09-30T22:58:40.699727+0000","last_became_active":"2023-09-30T22:58:40.698855+0000","last_became_peered":"2023-09-30T22:58:40.698855+0000","last_unstale":"2023-09-30T22:58:40.699727+0000","last_undegraded":"2023-09-30T22:58:40.699727+0000","last_fullsized":"2023-09-30T22:58:40.699727+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:07:43.997056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686079+0000","last_change":"2023-09-30T22:58:39.688153+0000","last_active":"2023-09-30T22:58:40.686079+0000","last_peered":"2023-09-30T22:58:40.686079+0000","last_clean":"2023-09-30T22:58:40.686079+0000","last_became_active":"2023-09-30T22:58:39.687869+0000","last_became_peered":"2023-09-30T22:58:39.687869+0000","last_unstale":"2023-09-30T22:58:40.686079+0000","last_undegraded":"2023-09-30T22:58:40.686079+0000","last_fullsized":"2023-09-30T22:58:40.686079+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:52:55.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690375+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:58:40.690375+0000","last_peered":"2023-09-30T22:58:40.690375+0000","last_clean":"2023-09-30T22:58:40.690375+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:58:40.690375+0000","last_undegraded":"2023-09-30T22:58:40.690375+0000","last_fullsized":"2023-09-30T22:58:40.690375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241515,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66300000000000003,"15min":0.63300000000000001},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76200000000000001,"5min":0.96599999999999997,"15min":1.0229999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89100000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91800000000000004},"last":0.623},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70199999999999996,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66300000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69399999999999995,"15min":0.67400000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73099999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83699999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72799999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78300000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.752},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.434},"max":{"1min":0.84199999999999997,"5min":1.056,"15min":1.056},"last":0.68300000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61799999999999999,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.623,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.81799999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65900000000000003,"15min":0.63100000000000001},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":1.135,"15min":1.135},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.004},"last":0.82999999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":1.016},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85699999999999998,"5min":1.071,"15min":1.071},"last":0.86899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199240603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.96499999999999997},"min":{"1min":0.52800000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":1.823,"15min":6.5190000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.51900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.5710000000000002,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.94199999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.75700000000000001,"15min":0.82199999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94599999999999995,"5min":2.6230000000000002,"15min":3.6339999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.996},"min":{"1min":0.503,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0649999999999999,"5min":5.6749999999999998,"15min":8.4339999999999993},"last":1.073}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.80500000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0029999999999999,"5min":3.2629999999999999,"15min":3.4580000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.73299999999999998,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.0429999999999999,"15min":6.5730000000000004},"last":0.877}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.93999999999999995},"min":{"1min":0.58499999999999996,"5min":0.49299999999999999,"15min":0.44400000000000001},"max":{"1min":1.343,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.036,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.90000000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.64200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.94199999999999995,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75900000000000001,"15min":0.68300000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2909999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.97799999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.66200000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.996,"5min":1.321,"15min":1.321},"last":1.05},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.754,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0289999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":1.002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.69299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1140000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44400000000000001,"15min":0.40799999999999997},"min":{"1min":0.30599999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.48799999999999999,"5min":1.083,"15min":1.083},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.49099999999999999,"15min":0.45800000000000002},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.59099999999999997,"5min":0.745,"15min":0.745},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46100000000000002,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.47399999999999998},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":0.57199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56299999999999994,"15min":0.52100000000000002},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.313},"max":{"1min":0.65300000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.47499999999999998},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54300000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.57599999999999996,"5min":0.52000000000000002,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.45100000000000001},"max":{"1min":0.94499999999999995,"5min":1.22,"15min":1.22},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.72899999999999998},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.432},"max":{"1min":1.002,"5min":1.127,"15min":1.127},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89600000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79100000000000004,"15min":0.76300000000000001},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97799999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81899999999999995,"15min":0.76900000000000002},"min":{"1min":0.64700000000000002,"5min":0.54500000000000004,"15min":0.52900000000000003},"max":{"1min":0.97799999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.432,"15min":0.41799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53100000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.46500000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.61899999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.316}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61399999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.51500000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.879,"15min":0.879},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48699999999999999,"15min":0.46100000000000002},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65900000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.5}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.70699999999999996},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.141,"5min":1.27,"15min":1.27},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.006,"5min":1.171,"15min":1.171},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96899999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.78800000000000003,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.82399999999999995}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":0.84799999999999998,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.2610000000000001,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.623,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.81699999999999995,"15min":0.77200000000000002},"min":{"1min":0.54200000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194572,"statfs":{"total":200000000,"available":199242027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.23599999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.42999999999999999},"min":{"1min":0.311,"5min":0.251,"15min":0.249},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.501},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79300000000000004,"5min":0.83999999999999997,"15min":1.0449999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.45300000000000001},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4910000000000001},"last":1}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.179},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.008,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.84299999999999997}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.615},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.55200000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77000000000000002,"15min":0.73799999999999999},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.46000000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.497,"5min":0.495,"15min":0.439},"max":{"1min":1.113,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.81100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199240603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.63300000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.51100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73299999999999998,"5min":1.0700000000000001,"15min":1.919},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.53500000000000003,"5min":0.75800000000000001,"15min":1.254},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67900000000000005,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59099999999999997,"5min":0.72399999999999998,"15min":1.6020000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.96199999999999997,"5min":1.2190000000000001,"15min":1.5309999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.72699999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92500000000000004,"5min":1.242,"15min":1.401},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.76200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93999999999999995,"5min":3.306,"15min":3.306},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75,"15min":0.749},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.98199999999999998,"15min":1.508},"last":0.754},{"interface":"front","average":{"1min":0.75,"5min":0.755,"15min":0.746},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":0.92700000000000005,"5min":1.274,"15min":1.4910000000000001},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1870000000000001,"15min":1.5620000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0489999999999999,"5min":1.0960000000000001,"15min":1.3140000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":1.135,"5min":1.3440000000000001,"15min":1.3640000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97199999999999998,"5min":1.1970000000000001,"15min":1.573},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199235464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.022,"15min":1.022},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.59699999999999998},"min":{"1min":0.50700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.746,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.74299999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.61599999999999999},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.68300000000000005},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.877,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70099999999999996,"15min":0.65500000000000003},"min":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63400000000000001,"15min":0.65700000000000003},"min":{"1min":0.44,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.37},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.97099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98599999999999999,"5min":1.016,"15min":1.016},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.56399999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":1.044,"15min":1.044},"last":0.94399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88400000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0369999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.27400000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94499999999999995,"5min":1.044,"15min":1.044},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.64000000000000001},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.621},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.80700000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86799999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.433}]},{"osd":6,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.93700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.37},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.748},"min":{"1min":0.64000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.85899999999999999}]}]}],"pool_statfs":[]}} 2023-09-30T22:58:45.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:58:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.299+0000 7ff7cbbff700 1 Processor -- start 2023-09-30T22:58:45.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.299+0000 7ff7cbbff700 1 -- start start 2023-09-30T22:58:45.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.300+0000 7ff7cbbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7c41598e0 0x7ff7c4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.300+0000 7ff7cbbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff7c40d03d0 0x7ff7c415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.300+0000 7ff7cbbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c406b8d0 con 0x7ff7c40cee50 2023-09-30T22:58:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.300+0000 7ff7cbbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40cff40 con 0x7ff7c41598e0 2023-09-30T22:58:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.300+0000 7ff7cbbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40cf330 con 0x7ff7c40d03d0 2023-09-30T22:58:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.300+0000 7ff7c999b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7c41598e0 0x7ff7c4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c919a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff7c40cee50 0x7ff7c406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58204/0 (socket says 172.21.15.142:58204) 2023-09-30T22:58:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c999b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7c41598e0 0x7ff7c4159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49328/0 (socket says 172.21.15.142:49328) 2023-09-30T22:58:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c919a700 1 -- 172.21.15.142:0/2111023093 learned_addr learned my addr 172.21.15.142:0/2111023093 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:45.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7ca19c700 1 --2- 172.21.15.142:0/2111023093 >> v2:172.21.15.148:3300/0 conn(0x7ff7c40d03d0 0x7ff7c415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c999b700 1 -- 172.21.15.142:0/2111023093 >> v2:172.21.15.148:3300/0 conn(0x7ff7c40d03d0 msgr2=0x7ff7c415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c999b700 1 --2- 172.21.15.142:0/2111023093 >> v2:172.21.15.148:3300/0 conn(0x7ff7c40d03d0 0x7ff7c415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c999b700 1 -- 172.21.15.142:0/2111023093 >> v1:172.21.15.142:6789/0 conn(0x7ff7c40cee50 legacy=0x7ff7c406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c999b700 1 -- 172.21.15.142:0/2111023093 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40cf610 con 0x7ff7c41598e0 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c8999700 1 -- 172.21.15.142:0/2111023093 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584049134 0 0) 0x7ff7c406b8d0 con 0x7ff7c40cee50 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c999b700 1 --2- 172.21.15.142:0/2111023093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c41598e0 0x7ff7c4159cb0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cfeb0 tx=0x7ff7c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c1164e963b8d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c8999700 1 -- 172.21.15.142:0/2111023093 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0011630 con 0x7ff7c41598e0 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.301+0000 7ff7c8999700 1 -- 172.21.15.142:0/2111023093 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0011790 con 0x7ff7c41598e0 2023-09-30T22:58:45.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7c8999700 1 -- 172.21.15.142:0/2111023093 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0011b30 con 0x7ff7c41598e0 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 -- 172.21.15.142:0/2111023093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c41598e0 msgr2=0x7ff7c4159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/2111023093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c41598e0 0x7ff7c4159cb0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cfeb0 tx=0x7ff7c00091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 -- 172.21.15.142:0/2111023093 shutdown_connections 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/2111023093 >> v2:172.21.15.148:3300/0 conn(0x7ff7c40d03d0 0x7ff7c415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/2111023093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c41598e0 0x7ff7c4159cb0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 -- 172.21.15.142:0/2111023093 >> 172.21.15.142:0/2111023093 conn(0x7ff7c40cd540 msgr2=0x7ff7c40cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 -- 172.21.15.142:0/2111023093 shutdown_connections 2023-09-30T22:58:45.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.302+0000 7ff7cbbff700 1 -- 172.21.15.142:0/2111023093 wait complete. 2023-09-30T22:58:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.304+0000 7ff7cbbff700 1 Processor -- start 2023-09-30T22:58:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.304+0000 7ff7cbbff700 1 -- start start 2023-09-30T22:58:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7cbbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40cee50 0x7ff7c4156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7cbbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7c40d03d0 0x7ff7c415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7cbbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c41598e0 0x7ff7c4150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7cbbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4156e80 con 0x7ff7c40cee50 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7cbbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c415c560 con 0x7ff7c41598e0 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7cbbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c5c20 con 0x7ff7c40d03d0 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40cee50 0x7ff7c4156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40cee50 0x7ff7c4156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49330/0 (socket says 172.21.15.142:49330) 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 -- 172.21.15.142:0/1699448496 learned_addr learned my addr 172.21.15.142:0/1699448496 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c919a700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7c40d03d0 0x7ff7c415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7ca19c700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c41598e0 0x7ff7c4150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 -- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7c40d03d0 msgr2=0x7ff7c415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7c40d03d0 0x7ff7c415c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 -- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c41598e0 msgr2=0x7ff7c4150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c41598e0 0x7ff7c4150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.305+0000 7ff7c999b700 1 -- 172.21.15.142:0/1699448496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0009420 con 0x7ff7c40cee50 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.306+0000 7ff7c999b700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40cee50 0x7ff7c4156940 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ce0a0 tx=0x7ff7c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.306+0000 7ff7b9ffb700 1 -- 172.21.15.142:0/1699448496 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0011b10 con 0x7ff7c40cee50 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.306+0000 7ff7b9ffb700 1 -- 172.21.15.142:0/1699448496 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c00253f0 con 0x7ff7c40cee50 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.306+0000 7ff7b9ffb700 1 -- 172.21.15.142:0/1699448496 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0025790 con 0x7ff7c40cee50 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.306+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c415c750 con 0x7ff7c40cee50 2023-09-30T22:58:45.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.306+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c40c55d0 con 0x7ff7c40cee50 2023-09-30T22:58:45.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.307+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c40697b0 con 0x7ff7c40cee50 2023-09-30T22:58:45.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.308+0000 7ff7b9ffb700 1 -- 172.21.15.142:0/1699448496 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff7c0025b40 con 0x7ff7c40cee50 2023-09-30T22:58:45.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.309+0000 7ff7b9ffb700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7a8067330 0x7ff7a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.309+0000 7ff7b9ffb700 1 -- 172.21.15.142:0/1699448496 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7c0086520 con 0x7ff7c40cee50 2023-09-30T22:58:45.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.309+0000 7ff7c919a700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7a8067330 0x7ff7a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.309+0000 7ff7c919a700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7a8067330 0x7ff7a80697e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40011e0 tx=0x7ff7b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:45.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.313+0000 7ff7b9ffb700 1 -- 172.21.15.142:0/1699448496 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff7c0053380 con 0x7ff7c40cee50 2023-09-30T22:58:45.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.498+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7c4159500 con 0x7ff7a8067330 2023-09-30T22:58:45.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.507+0000 7ff7b9ffb700 1 -- 172.21.15.142:0/1699448496 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303506 (secure 0 0 0) 0x7ff7c4159500 con 0x7ff7a8067330 2023-09-30T22:58:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7a8067330 msgr2=0x7ff7a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7a8067330 0x7ff7a80697e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40011e0 tx=0x7ff7b4009040 comp rx=0 tx=0).stop 2023-09-30T22:58:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40cee50 msgr2=0x7ff7c4156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40cee50 0x7ff7c4156940 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ce0a0 tx=0x7ff7c0017000 comp rx=0 tx=0).stop 2023-09-30T22:58:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 shutdown_connections 2023-09-30T22:58:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff7a8067330 0x7ff7a80697e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c41598e0 0x7ff7c4150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40cee50 0x7ff7c4156940 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 --2- 172.21.15.142:0/1699448496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff7c40d03d0 0x7ff7c415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 >> 172.21.15.142:0/1699448496 conn(0x7ff7c40cd540 msgr2=0x7ff7c41589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:45.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 shutdown_connections 2023-09-30T22:58:45.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.511+0000 7ff7cbbff700 1 -- 172.21.15.142:0/1699448496 wait complete. 2023-09-30T22:58:45.515 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:58:45.529 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-09-30T22:58:44.187632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555415,"statfs":{"total":1600000000,"available":1592745123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.520297"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694726+0000","last_change":"2023-09-30T22:58:40.694442+0000","last_active":"2023-09-30T22:58:40.694726+0000","last_peered":"2023-09-30T22:58:40.694726+0000","last_clean":"2023-09-30T22:58:40.694726+0000","last_became_active":"2023-09-30T22:58:40.694184+0000","last_became_peered":"2023-09-30T22:58:40.694184+0000","last_unstale":"2023-09-30T22:58:40.694726+0000","last_undegraded":"2023-09-30T22:58:40.694726+0000","last_fullsized":"2023-09-30T22:58:40.694726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:31:41.595143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.703331+0000","last_change":"2023-09-30T22:58:40.703260+0000","last_active":"2023-09-30T22:58:40.703331+0000","last_peered":"2023-09-30T22:58:40.703331+0000","last_clean":"2023-09-30T22:58:40.703331+0000","last_became_active":"2023-09-30T22:58:40.703043+0000","last_became_peered":"2023-09-30T22:58:40.703043+0000","last_unstale":"2023-09-30T22:58:40.703331+0000","last_undegraded":"2023-09-30T22:58:40.703331+0000","last_fullsized":"2023-09-30T22:58:40.703331+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:04:39.583420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688036+0000","last_change":"2023-09-30T22:58:40.687958+0000","last_active":"2023-09-30T22:58:40.688036+0000","last_peered":"2023-09-30T22:58:40.688036+0000","last_clean":"2023-09-30T22:58:40.688036+0000","last_became_active":"2023-09-30T22:58:40.687682+0000","last_became_peered":"2023-09-30T22:58:40.687682+0000","last_unstale":"2023-09-30T22:58:40.688036+0000","last_undegraded":"2023-09-30T22:58:40.688036+0000","last_fullsized":"2023-09-30T22:58:40.688036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:21.897119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697536+0000","last_change":"2023-09-30T22:58:40.697424+0000","last_active":"2023-09-30T22:58:40.697536+0000","last_peered":"2023-09-30T22:58:40.697536+0000","last_clean":"2023-09-30T22:58:40.697536+0000","last_became_active":"2023-09-30T22:58:40.696961+0000","last_became_peered":"2023-09-30T22:58:40.696961+0000","last_unstale":"2023-09-30T22:58:40.697536+0000","last_undegraded":"2023-09-30T22:58:40.697536+0000","last_fullsized":"2023-09-30T22:58:40.697536+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:47:30.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696683+0000","last_change":"2023-09-30T22:58:40.696309+0000","last_active":"2023-09-30T22:58:40.696683+0000","last_peered":"2023-09-30T22:58:40.696683+0000","last_clean":"2023-09-30T22:58:40.696683+0000","last_became_active":"2023-09-30T22:58:40.696083+0000","last_became_peered":"2023-09-30T22:58:40.696083+0000","last_unstale":"2023-09-30T22:58:40.696683+0000","last_undegraded":"2023-09-30T22:58:40.696683+0000","last_fullsized":"2023-09-30T22:58:40.696683+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:54:59.181686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688277+0000","last_change":"2023-09-30T22:58:40.688213+0000","last_active":"2023-09-30T22:58:40.688277+0000","last_peered":"2023-09-30T22:58:40.688277+0000","last_clean":"2023-09-30T22:58:40.688277+0000","last_became_active":"2023-09-30T22:58:40.687969+0000","last_became_peered":"2023-09-30T22:58:40.687969+0000","last_unstale":"2023-09-30T22:58:40.688277+0000","last_undegraded":"2023-09-30T22:58:40.688277+0000","last_fullsized":"2023-09-30T22:58:40.688277+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:08:35.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702081+0000","last_change":"2023-09-30T22:58:40.701988+0000","last_active":"2023-09-30T22:58:40.702081+0000","last_peered":"2023-09-30T22:58:40.702081+0000","last_clean":"2023-09-30T22:58:40.702081+0000","last_became_active":"2023-09-30T22:58:40.701034+0000","last_became_peered":"2023-09-30T22:58:40.701034+0000","last_unstale":"2023-09-30T22:58:40.702081+0000","last_undegraded":"2023-09-30T22:58:40.702081+0000","last_fullsized":"2023-09-30T22:58:40.702081+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:58:39.857906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.689726+0000","last_change":"2023-09-30T22:58:40.689316+0000","last_active":"2023-09-30T22:58:40.689726+0000","last_peered":"2023-09-30T22:58:40.689726+0000","last_clean":"2023-09-30T22:58:40.689726+0000","last_became_active":"2023-09-30T22:58:40.689061+0000","last_became_peered":"2023-09-30T22:58:40.689061+0000","last_unstale":"2023-09-30T22:58:40.689726+0000","last_undegraded":"2023-09-30T22:58:40.689726+0000","last_fullsized":"2023-09-30T22:58:40.689726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:49:11.255812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700654+0000","last_change":"2023-09-30T22:58:40.700209+0000","last_active":"2023-09-30T22:58:40.700654+0000","last_peered":"2023-09-30T22:58:40.700654+0000","last_clean":"2023-09-30T22:58:40.700654+0000","last_became_active":"2023-09-30T22:58:40.699980+0000","last_became_peered":"2023-09-30T22:58:40.699980+0000","last_unstale":"2023-09-30T22:58:40.700654+0000","last_undegraded":"2023-09-30T22:58:40.700654+0000","last_fullsized":"2023-09-30T22:58:40.700654+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:52:56.762498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694529+0000","last_change":"2023-09-30T22:58:40.694444+0000","last_active":"2023-09-30T22:58:40.694529+0000","last_peered":"2023-09-30T22:58:40.694529+0000","last_clean":"2023-09-30T22:58:40.694529+0000","last_became_active":"2023-09-30T22:58:40.693751+0000","last_became_peered":"2023-09-30T22:58:40.693751+0000","last_unstale":"2023-09-30T22:58:40.694529+0000","last_undegraded":"2023-09-30T22:58:40.694529+0000","last_fullsized":"2023-09-30T22:58:40.694529+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:44:29.167172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695286+0000","last_change":"2023-09-30T22:58:40.694719+0000","last_active":"2023-09-30T22:58:40.695286+0000","last_peered":"2023-09-30T22:58:40.695286+0000","last_clean":"2023-09-30T22:58:40.695286+0000","last_became_active":"2023-09-30T22:58:40.694502+0000","last_became_peered":"2023-09-30T22:58:40.694502+0000","last_unstale":"2023-09-30T22:58:40.695286+0000","last_undegraded":"2023-09-30T22:58:40.695286+0000","last_fullsized":"2023-09-30T22:58:40.695286+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:31:13.989442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.701347+0000","last_change":"2023-09-30T22:58:40.701254+0000","last_active":"2023-09-30T22:58:40.701347+0000","last_peered":"2023-09-30T22:58:40.701347+0000","last_clean":"2023-09-30T22:58:40.701347+0000","last_became_active":"2023-09-30T22:58:40.700412+0000","last_became_peered":"2023-09-30T22:58:40.700412+0000","last_unstale":"2023-09-30T22:58:40.701347+0000","last_undegraded":"2023-09-30T22:58:40.701347+0000","last_fullsized":"2023-09-30T22:58:40.701347+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:44:29.167172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699169+0000","last_change":"2023-09-30T22:58:40.698861+0000","last_active":"2023-09-30T22:58:40.699169+0000","last_peered":"2023-09-30T22:58:40.699169+0000","last_clean":"2023-09-30T22:58:40.699169+0000","last_became_active":"2023-09-30T22:58:40.698618+0000","last_became_peered":"2023-09-30T22:58:40.698618+0000","last_unstale":"2023-09-30T22:58:40.699169+0000","last_undegraded":"2023-09-30T22:58:40.699169+0000","last_fullsized":"2023-09-30T22:58:40.699169+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:32.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700481+0000","last_change":"2023-09-30T22:58:40.700050+0000","last_active":"2023-09-30T22:58:40.700481+0000","last_peered":"2023-09-30T22:58:40.700481+0000","last_clean":"2023-09-30T22:58:40.700481+0000","last_became_active":"2023-09-30T22:58:40.699688+0000","last_became_peered":"2023-09-30T22:58:40.699688+0000","last_unstale":"2023-09-30T22:58:40.700481+0000","last_undegraded":"2023-09-30T22:58:40.700481+0000","last_fullsized":"2023-09-30T22:58:40.700481+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:49:11.255812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698630+0000","last_change":"2023-09-30T22:58:40.698469+0000","last_active":"2023-09-30T22:58:40.698630+0000","last_peered":"2023-09-30T22:58:40.698630+0000","last_clean":"2023-09-30T22:58:40.698630+0000","last_became_active":"2023-09-30T22:58:40.697976+0000","last_became_peered":"2023-09-30T22:58:40.697976+0000","last_unstale":"2023-09-30T22:58:40.698630+0000","last_undegraded":"2023-09-30T22:58:40.698630+0000","last_fullsized":"2023-09-30T22:58:40.698630+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:38.042453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695479+0000","last_change":"2023-09-30T22:58:40.694527+0000","last_active":"2023-09-30T22:58:40.695479+0000","last_peered":"2023-09-30T22:58:40.695479+0000","last_clean":"2023-09-30T22:58:40.695479+0000","last_became_active":"2023-09-30T22:58:40.694175+0000","last_became_peered":"2023-09-30T22:58:40.694175+0000","last_unstale":"2023-09-30T22:58:40.695479+0000","last_undegraded":"2023-09-30T22:58:40.695479+0000","last_fullsized":"2023-09-30T22:58:40.695479+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:01.015115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688556+0000","last_change":"2023-09-30T22:58:40.688466+0000","last_active":"2023-09-30T22:58:40.688556+0000","last_peered":"2023-09-30T22:58:40.688556+0000","last_clean":"2023-09-30T22:58:40.688556+0000","last_became_active":"2023-09-30T22:58:40.688179+0000","last_became_peered":"2023-09-30T22:58:40.688179+0000","last_unstale":"2023-09-30T22:58:40.688556+0000","last_undegraded":"2023-09-30T22:58:40.688556+0000","last_fullsized":"2023-09-30T22:58:40.688556+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:43:14.152495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698960+0000","last_change":"2023-09-30T22:58:40.698898+0000","last_active":"2023-09-30T22:58:40.698960+0000","last_peered":"2023-09-30T22:58:40.698960+0000","last_clean":"2023-09-30T22:58:40.698960+0000","last_became_active":"2023-09-30T22:58:40.698675+0000","last_became_peered":"2023-09-30T22:58:40.698675+0000","last_unstale":"2023-09-30T22:58:40.698960+0000","last_undegraded":"2023-09-30T22:58:40.698960+0000","last_fullsized":"2023-09-30T22:58:40.698960+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:24:55.012825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697518+0000","last_change":"2023-09-30T22:58:40.697221+0000","last_active":"2023-09-30T22:58:40.697518+0000","last_peered":"2023-09-30T22:58:40.697518+0000","last_clean":"2023-09-30T22:58:40.697518+0000","last_became_active":"2023-09-30T22:58:40.695853+0000","last_became_peered":"2023-09-30T22:58:40.695853+0000","last_unstale":"2023-09-30T22:58:40.697518+0000","last_undegraded":"2023-09-30T22:58:40.697518+0000","last_fullsized":"2023-09-30T22:58:40.697518+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:04.498833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697633+0000","last_change":"2023-09-30T22:58:40.697559+0000","last_active":"2023-09-30T22:58:40.697633+0000","last_peered":"2023-09-30T22:58:40.697633+0000","last_clean":"2023-09-30T22:58:40.697633+0000","last_became_active":"2023-09-30T22:58:40.697337+0000","last_became_peered":"2023-09-30T22:58:40.697337+0000","last_unstale":"2023-09-30T22:58:40.697633+0000","last_undegraded":"2023-09-30T22:58:40.697633+0000","last_fullsized":"2023-09-30T22:58:40.697633+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:27:27.696411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695399+0000","last_change":"2023-09-30T22:58:40.695240+0000","last_active":"2023-09-30T22:58:40.695399+0000","last_peered":"2023-09-30T22:58:40.695399+0000","last_clean":"2023-09-30T22:58:40.695399+0000","last_became_active":"2023-09-30T22:58:40.695001+0000","last_became_peered":"2023-09-30T22:58:40.695001+0000","last_unstale":"2023-09-30T22:58:40.695399+0000","last_undegraded":"2023-09-30T22:58:40.695399+0000","last_fullsized":"2023-09-30T22:58:40.695399+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:07:04.501786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.707049+0000","last_change":"2023-09-30T22:58:40.706896+0000","last_active":"2023-09-30T22:58:40.707049+0000","last_peered":"2023-09-30T22:58:40.707049+0000","last_clean":"2023-09-30T22:58:40.707049+0000","last_became_active":"2023-09-30T22:58:40.706600+0000","last_became_peered":"2023-09-30T22:58:40.706600+0000","last_unstale":"2023-09-30T22:58:40.707049+0000","last_undegraded":"2023-09-30T22:58:40.707049+0000","last_fullsized":"2023-09-30T22:58:40.707049+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:37:23.839463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.706680+0000","last_change":"2023-09-30T22:58:40.706549+0000","last_active":"2023-09-30T22:58:40.706680+0000","last_peered":"2023-09-30T22:58:40.706680+0000","last_clean":"2023-09-30T22:58:40.706680+0000","last_became_active":"2023-09-30T22:58:40.706264+0000","last_became_peered":"2023-09-30T22:58:40.706264+0000","last_unstale":"2023-09-30T22:58:40.706680+0000","last_undegraded":"2023-09-30T22:58:40.706680+0000","last_fullsized":"2023-09-30T22:58:40.706680+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:45:58.782620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698435+0000","last_change":"2023-09-30T22:58:40.698302+0000","last_active":"2023-09-30T22:58:40.698435+0000","last_peered":"2023-09-30T22:58:40.698435+0000","last_clean":"2023-09-30T22:58:40.698435+0000","last_became_active":"2023-09-30T22:58:40.697631+0000","last_became_peered":"2023-09-30T22:58:40.697631+0000","last_unstale":"2023-09-30T22:58:40.698435+0000","last_undegraded":"2023-09-30T22:58:40.698435+0000","last_fullsized":"2023-09-30T22:58:40.698435+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:58:39.857906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696855+0000","last_change":"2023-09-30T22:58:40.696730+0000","last_active":"2023-09-30T22:58:40.696855+0000","last_peered":"2023-09-30T22:58:40.696855+0000","last_clean":"2023-09-30T22:58:40.696855+0000","last_became_active":"2023-09-30T22:58:40.696514+0000","last_became_peered":"2023-09-30T22:58:40.696514+0000","last_unstale":"2023-09-30T22:58:40.696855+0000","last_undegraded":"2023-09-30T22:58:40.696855+0000","last_fullsized":"2023-09-30T22:58:40.696855+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:23:01.628360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696794+0000","last_change":"2023-09-30T22:58:40.695347+0000","last_active":"2023-09-30T22:58:40.696794+0000","last_peered":"2023-09-30T22:58:40.696794+0000","last_clean":"2023-09-30T22:58:40.696794+0000","last_became_active":"2023-09-30T22:58:40.695129+0000","last_became_peered":"2023-09-30T22:58:40.695129+0000","last_unstale":"2023-09-30T22:58:40.696794+0000","last_undegraded":"2023-09-30T22:58:40.696794+0000","last_fullsized":"2023-09-30T22:58:40.696794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:51:13.635665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702636+0000","last_change":"2023-09-30T22:58:40.702527+0000","last_active":"2023-09-30T22:58:40.702636+0000","last_peered":"2023-09-30T22:58:40.702636+0000","last_clean":"2023-09-30T22:58:40.702636+0000","last_became_active":"2023-09-30T22:58:40.702304+0000","last_became_peered":"2023-09-30T22:58:40.702304+0000","last_unstale":"2023-09-30T22:58:40.702636+0000","last_undegraded":"2023-09-30T22:58:40.702636+0000","last_fullsized":"2023-09-30T22:58:40.702636+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:32:20.271801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696650+0000","last_change":"2023-09-30T22:58:40.696577+0000","last_active":"2023-09-30T22:58:40.696650+0000","last_peered":"2023-09-30T22:58:40.696650+0000","last_clean":"2023-09-30T22:58:40.696650+0000","last_became_active":"2023-09-30T22:58:40.696366+0000","last_became_peered":"2023-09-30T22:58:40.696366+0000","last_unstale":"2023-09-30T22:58:40.696650+0000","last_undegraded":"2023-09-30T22:58:40.696650+0000","last_fullsized":"2023-09-30T22:58:40.696650+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:05.719718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.689181+0000","last_change":"2023-09-30T22:58:40.689098+0000","last_active":"2023-09-30T22:58:40.689181+0000","last_peered":"2023-09-30T22:58:40.689181+0000","last_clean":"2023-09-30T22:58:40.689181+0000","last_became_active":"2023-09-30T22:58:40.688841+0000","last_became_peered":"2023-09-30T22:58:40.688841+0000","last_unstale":"2023-09-30T22:58:40.689181+0000","last_undegraded":"2023-09-30T22:58:40.689181+0000","last_fullsized":"2023-09-30T22:58:40.689181+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:08:35.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695674+0000","last_change":"2023-09-30T22:58:40.695599+0000","last_active":"2023-09-30T22:58:40.695674+0000","last_peered":"2023-09-30T22:58:40.695674+0000","last_clean":"2023-09-30T22:58:40.695674+0000","last_became_active":"2023-09-30T22:58:40.695389+0000","last_became_peered":"2023-09-30T22:58:40.695389+0000","last_unstale":"2023-09-30T22:58:40.695674+0000","last_undegraded":"2023-09-30T22:58:40.695674+0000","last_fullsized":"2023-09-30T22:58:40.695674+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:03.663901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697421+0000","last_change":"2023-09-30T22:58:40.696638+0000","last_active":"2023-09-30T22:58:40.697421+0000","last_peered":"2023-09-30T22:58:40.697421+0000","last_clean":"2023-09-30T22:58:40.697421+0000","last_became_active":"2023-09-30T22:58:40.696420+0000","last_became_peered":"2023-09-30T22:58:40.696420+0000","last_unstale":"2023-09-30T22:58:40.697421+0000","last_undegraded":"2023-09-30T22:58:40.697421+0000","last_fullsized":"2023-09-30T22:58:40.697421+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:29.359388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696521+0000","last_change":"2023-09-30T22:58:40.695985+0000","last_active":"2023-09-30T22:58:40.696521+0000","last_peered":"2023-09-30T22:58:40.696521+0000","last_clean":"2023-09-30T22:58:40.696521+0000","last_became_active":"2023-09-30T22:58:40.695649+0000","last_became_peered":"2023-09-30T22:58:40.695649+0000","last_unstale":"2023-09-30T22:58:40.696521+0000","last_undegraded":"2023-09-30T22:58:40.696521+0000","last_fullsized":"2023-09-30T22:58:40.696521+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:21.897119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688575+0000","last_change":"2023-09-30T22:58:40.688514+0000","last_active":"2023-09-30T22:58:40.688575+0000","last_peered":"2023-09-30T22:58:40.688575+0000","last_clean":"2023-09-30T22:58:40.688575+0000","last_became_active":"2023-09-30T22:58:40.688108+0000","last_became_peered":"2023-09-30T22:58:40.688108+0000","last_unstale":"2023-09-30T22:58:40.688575+0000","last_undegraded":"2023-09-30T22:58:40.688575+0000","last_fullsized":"2023-09-30T22:58:40.688575+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:57:20.410289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"129'4","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716963+0000","last_change":"2023-09-30T22:58:39.682410+0000","last_active":"2023-09-30T22:58:40.716963+0000","last_peered":"2023-09-30T22:58:40.716963+0000","last_clean":"2023-09-30T22:58:40.716963+0000","last_became_active":"2023-09-30T22:58:39.681975+0000","last_became_peered":"2023-09-30T22:58:39.681975+0000","last_unstale":"2023-09-30T22:58:40.716963+0000","last_undegraded":"2023-09-30T22:58:40.716963+0000","last_fullsized":"2023-09-30T22:58:40.716963+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:37.036140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698411+0000","last_change":"2023-09-30T22:58:40.698179+0000","last_active":"2023-09-30T22:58:40.698411+0000","last_peered":"2023-09-30T22:58:40.698411+0000","last_clean":"2023-09-30T22:58:40.698411+0000","last_became_active":"2023-09-30T22:58:40.697562+0000","last_became_peered":"2023-09-30T22:58:40.697562+0000","last_unstale":"2023-09-30T22:58:40.698411+0000","last_undegraded":"2023-09-30T22:58:40.698411+0000","last_fullsized":"2023-09-30T22:58:40.698411+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:10:44.513022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.717632+0000","last_change":"2023-09-30T22:58:39.677723+0000","last_active":"2023-09-30T22:58:40.717632+0000","last_peered":"2023-09-30T22:58:40.717632+0000","last_clean":"2023-09-30T22:58:40.717632+0000","last_became_active":"2023-09-30T22:58:39.677467+0000","last_became_peered":"2023-09-30T22:58:39.677467+0000","last_unstale":"2023-09-30T22:58:40.717632+0000","last_undegraded":"2023-09-30T22:58:40.717632+0000","last_fullsized":"2023-09-30T22:58:40.717632+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:03.895204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.705901+0000","last_change":"2023-09-30T22:58:40.705837+0000","last_active":"2023-09-30T22:58:40.705901+0000","last_peered":"2023-09-30T22:58:40.705901+0000","last_clean":"2023-09-30T22:58:40.705901+0000","last_became_active":"2023-09-30T22:58:40.705658+0000","last_became_peered":"2023-09-30T22:58:40.705658+0000","last_unstale":"2023-09-30T22:58:40.705901+0000","last_undegraded":"2023-09-30T22:58:40.705901+0000","last_fullsized":"2023-09-30T22:58:40.705901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:52:38.533981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716096+0000","last_change":"2023-09-30T22:58:39.683876+0000","last_active":"2023-09-30T22:58:40.716096+0000","last_peered":"2023-09-30T22:58:40.716096+0000","last_clean":"2023-09-30T22:58:40.716096+0000","last_became_active":"2023-09-30T22:58:39.683592+0000","last_became_peered":"2023-09-30T22:58:39.683592+0000","last_unstale":"2023-09-30T22:58:40.716096+0000","last_undegraded":"2023-09-30T22:58:40.716096+0000","last_fullsized":"2023-09-30T22:58:40.716096+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:30.916018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694086+0000","last_change":"2023-09-30T22:58:40.693961+0000","last_active":"2023-09-30T22:58:40.694086+0000","last_peered":"2023-09-30T22:58:40.694086+0000","last_clean":"2023-09-30T22:58:40.694086+0000","last_became_active":"2023-09-30T22:58:40.693762+0000","last_became_peered":"2023-09-30T22:58:40.693762+0000","last_unstale":"2023-09-30T22:58:40.694086+0000","last_undegraded":"2023-09-30T22:58:40.694086+0000","last_fullsized":"2023-09-30T22:58:40.694086+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:32.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716942+0000","last_change":"2023-09-30T22:58:39.685208+0000","last_active":"2023-09-30T22:58:40.716942+0000","last_peered":"2023-09-30T22:58:40.716942+0000","last_clean":"2023-09-30T22:58:40.716942+0000","last_became_active":"2023-09-30T22:58:39.684619+0000","last_became_peered":"2023-09-30T22:58:39.684619+0000","last_unstale":"2023-09-30T22:58:40.716942+0000","last_undegraded":"2023-09-30T22:58:40.716942+0000","last_fullsized":"2023-09-30T22:58:40.716942+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:26:16.335174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696376+0000","last_change":"2023-09-30T22:58:40.695610+0000","last_active":"2023-09-30T22:58:40.696376+0000","last_peered":"2023-09-30T22:58:40.696376+0000","last_clean":"2023-09-30T22:58:40.696376+0000","last_became_active":"2023-09-30T22:58:40.695023+0000","last_became_peered":"2023-09-30T22:58:40.695023+0000","last_unstale":"2023-09-30T22:58:40.696376+0000","last_undegraded":"2023-09-30T22:58:40.696376+0000","last_fullsized":"2023-09-30T22:58:40.696376+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:27:59.714949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716816+0000","last_change":"2023-09-30T22:58:39.682873+0000","last_active":"2023-09-30T22:58:40.716816+0000","last_peered":"2023-09-30T22:58:40.716816+0000","last_clean":"2023-09-30T22:58:40.716816+0000","last_became_active":"2023-09-30T22:58:39.682596+0000","last_became_peered":"2023-09-30T22:58:39.682596+0000","last_unstale":"2023-09-30T22:58:40.716816+0000","last_undegraded":"2023-09-30T22:58:40.716816+0000","last_fullsized":"2023-09-30T22:58:40.716816+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:31:00.008801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699147+0000","last_change":"2023-09-30T22:58:40.697964+0000","last_active":"2023-09-30T22:58:40.699147+0000","last_peered":"2023-09-30T22:58:40.699147+0000","last_clean":"2023-09-30T22:58:40.699147+0000","last_became_active":"2023-09-30T22:58:40.697647+0000","last_became_peered":"2023-09-30T22:58:40.697647+0000","last_unstale":"2023-09-30T22:58:40.699147+0000","last_undegraded":"2023-09-30T22:58:40.699147+0000","last_fullsized":"2023-09-30T22:58:40.699147+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:22.970518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718373+0000","last_change":"2023-09-30T22:58:39.683464+0000","last_active":"2023-09-30T22:58:40.718373+0000","last_peered":"2023-09-30T22:58:40.718373+0000","last_clean":"2023-09-30T22:58:40.718373+0000","last_became_active":"2023-09-30T22:58:39.683237+0000","last_became_peered":"2023-09-30T22:58:39.683237+0000","last_unstale":"2023-09-30T22:58:40.718373+0000","last_undegraded":"2023-09-30T22:58:40.718373+0000","last_fullsized":"2023-09-30T22:58:40.718373+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:45:57.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.704036+0000","last_change":"2023-09-30T22:58:40.703964+0000","last_active":"2023-09-30T22:58:40.704036+0000","last_peered":"2023-09-30T22:58:40.704036+0000","last_clean":"2023-09-30T22:58:40.704036+0000","last_became_active":"2023-09-30T22:58:40.703728+0000","last_became_peered":"2023-09-30T22:58:40.703728+0000","last_unstale":"2023-09-30T22:58:40.704036+0000","last_undegraded":"2023-09-30T22:58:40.704036+0000","last_fullsized":"2023-09-30T22:58:40.704036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:31:41.595143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690992+0000","last_change":"2023-09-30T22:58:39.683102+0000","last_active":"2023-09-30T22:58:40.690992+0000","last_peered":"2023-09-30T22:58:40.690992+0000","last_clean":"2023-09-30T22:58:40.690992+0000","last_became_active":"2023-09-30T22:58:39.682876+0000","last_became_peered":"2023-09-30T22:58:39.682876+0000","last_unstale":"2023-09-30T22:58:40.690992+0000","last_undegraded":"2023-09-30T22:58:40.690992+0000","last_fullsized":"2023-09-30T22:58:40.690992+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:00.908278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702969+0000","last_change":"2023-09-30T22:58:40.702856+0000","last_active":"2023-09-30T22:58:40.702969+0000","last_peered":"2023-09-30T22:58:40.702969+0000","last_clean":"2023-09-30T22:58:40.702969+0000","last_became_active":"2023-09-30T22:58:40.701610+0000","last_became_peered":"2023-09-30T22:58:40.701610+0000","last_unstale":"2023-09-30T22:58:40.702969+0000","last_undegraded":"2023-09-30T22:58:40.702969+0000","last_fullsized":"2023-09-30T22:58:40.702969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:32.566886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.692177+0000","last_change":"2023-09-30T22:58:39.689207+0000","last_active":"2023-09-30T22:58:40.692177+0000","last_peered":"2023-09-30T22:58:40.692177+0000","last_clean":"2023-09-30T22:58:40.692177+0000","last_became_active":"2023-09-30T22:58:39.688963+0000","last_became_peered":"2023-09-30T22:58:39.688963+0000","last_unstale":"2023-09-30T22:58:40.692177+0000","last_undegraded":"2023-09-30T22:58:40.692177+0000","last_fullsized":"2023-09-30T22:58:40.692177+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:08:07.262716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697552+0000","last_change":"2023-09-30T22:58:40.697452+0000","last_active":"2023-09-30T22:58:40.697552+0000","last_peered":"2023-09-30T22:58:40.697552+0000","last_clean":"2023-09-30T22:58:40.697552+0000","last_became_active":"2023-09-30T22:58:40.697208+0000","last_became_peered":"2023-09-30T22:58:40.697208+0000","last_unstale":"2023-09-30T22:58:40.697552+0000","last_undegraded":"2023-09-30T22:58:40.697552+0000","last_fullsized":"2023-09-30T22:58:40.697552+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:03.663901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685990+0000","last_change":"2023-09-30T22:58:39.682387+0000","last_active":"2023-09-30T22:58:40.685990+0000","last_peered":"2023-09-30T22:58:40.685990+0000","last_clean":"2023-09-30T22:58:40.685990+0000","last_became_active":"2023-09-30T22:58:39.682165+0000","last_became_peered":"2023-09-30T22:58:39.682165+0000","last_unstale":"2023-09-30T22:58:40.685990+0000","last_undegraded":"2023-09-30T22:58:40.685990+0000","last_fullsized":"2023-09-30T22:58:40.685990+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:03.895204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696394+0000","last_change":"2023-09-30T22:58:40.695789+0000","last_active":"2023-09-30T22:58:40.696394+0000","last_peered":"2023-09-30T22:58:40.696394+0000","last_clean":"2023-09-30T22:58:40.696394+0000","last_became_active":"2023-09-30T22:58:40.695371+0000","last_became_peered":"2023-09-30T22:58:40.695371+0000","last_unstale":"2023-09-30T22:58:40.696394+0000","last_undegraded":"2023-09-30T22:58:40.696394+0000","last_fullsized":"2023-09-30T22:58:40.696394+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:00.627436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.687416+0000","last_change":"2023-09-30T22:58:39.676094+0000","last_active":"2023-09-30T22:58:40.687416+0000","last_peered":"2023-09-30T22:58:40.687416+0000","last_clean":"2023-09-30T22:58:40.687416+0000","last_became_active":"2023-09-30T22:58:39.675736+0000","last_became_peered":"2023-09-30T22:58:39.675736+0000","last_unstale":"2023-09-30T22:58:40.687416+0000","last_undegraded":"2023-09-30T22:58:40.687416+0000","last_fullsized":"2023-09-30T22:58:40.687416+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:40.145225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698667+0000","last_change":"2023-09-30T22:58:40.698455+0000","last_active":"2023-09-30T22:58:40.698667+0000","last_peered":"2023-09-30T22:58:40.698667+0000","last_clean":"2023-09-30T22:58:40.698667+0000","last_became_active":"2023-09-30T22:58:40.698001+0000","last_became_peered":"2023-09-30T22:58:40.698001+0000","last_unstale":"2023-09-30T22:58:40.698667+0000","last_undegraded":"2023-09-30T22:58:40.698667+0000","last_fullsized":"2023-09-30T22:58:40.698667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"129'3","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.719175+0000","last_change":"2023-09-30T22:58:39.674547+0000","last_active":"2023-09-30T22:58:40.719175+0000","last_peered":"2023-09-30T22:58:40.719175+0000","last_clean":"2023-09-30T22:58:40.719175+0000","last_became_active":"2023-09-30T22:58:39.674329+0000","last_became_peered":"2023-09-30T22:58:39.674329+0000","last_unstale":"2023-09-30T22:58:40.719175+0000","last_undegraded":"2023-09-30T22:58:40.719175+0000","last_fullsized":"2023-09-30T22:58:40.719175+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:51.176180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699748+0000","last_change":"2023-09-30T22:58:40.699616+0000","last_active":"2023-09-30T22:58:40.699748+0000","last_peered":"2023-09-30T22:58:40.699748+0000","last_clean":"2023-09-30T22:58:40.699748+0000","last_became_active":"2023-09-30T22:58:40.699198+0000","last_became_peered":"2023-09-30T22:58:40.699198+0000","last_unstale":"2023-09-30T22:58:40.699748+0000","last_undegraded":"2023-09-30T22:58:40.699748+0000","last_fullsized":"2023-09-30T22:58:40.699748+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:26:17.341487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"129'6","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.719603+0000","last_change":"2023-09-30T22:58:39.682265+0000","last_active":"2023-09-30T22:58:40.719603+0000","last_peered":"2023-09-30T22:58:40.719603+0000","last_clean":"2023-09-30T22:58:40.719603+0000","last_became_active":"2023-09-30T22:58:39.681938+0000","last_became_peered":"2023-09-30T22:58:39.681938+0000","last_unstale":"2023-09-30T22:58:40.719603+0000","last_undegraded":"2023-09-30T22:58:40.719603+0000","last_fullsized":"2023-09-30T22:58:40.719603+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:08.920262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.704039+0000","last_change":"2023-09-30T22:58:40.703978+0000","last_active":"2023-09-30T22:58:40.704039+0000","last_peered":"2023-09-30T22:58:40.704039+0000","last_clean":"2023-09-30T22:58:40.704039+0000","last_became_active":"2023-09-30T22:58:40.703759+0000","last_became_peered":"2023-09-30T22:58:40.703759+0000","last_unstale":"2023-09-30T22:58:40.704039+0000","last_undegraded":"2023-09-30T22:58:40.704039+0000","last_fullsized":"2023-09-30T22:58:40.704039+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:57.068524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716599+0000","last_change":"2023-09-30T22:58:39.688718+0000","last_active":"2023-09-30T22:58:40.716599+0000","last_peered":"2023-09-30T22:58:40.716599+0000","last_clean":"2023-09-30T22:58:40.716599+0000","last_became_active":"2023-09-30T22:58:39.687989+0000","last_became_peered":"2023-09-30T22:58:39.687989+0000","last_unstale":"2023-09-30T22:58:40.716599+0000","last_undegraded":"2023-09-30T22:58:40.716599+0000","last_fullsized":"2023-09-30T22:58:40.716599+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:41.590976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.696097+0000","last_change":"2023-09-30T22:58:40.696018+0000","last_active":"2023-09-30T22:58:40.696097+0000","last_peered":"2023-09-30T22:58:40.696097+0000","last_clean":"2023-09-30T22:58:40.696097+0000","last_became_active":"2023-09-30T22:58:40.695683+0000","last_became_peered":"2023-09-30T22:58:40.695683+0000","last_unstale":"2023-09-30T22:58:40.696097+0000","last_undegraded":"2023-09-30T22:58:40.696097+0000","last_fullsized":"2023-09-30T22:58:40.696097+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:45:58.591669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.687680+0000","last_change":"2023-09-30T22:58:39.685340+0000","last_active":"2023-09-30T22:58:40.687680+0000","last_peered":"2023-09-30T22:58:40.687680+0000","last_clean":"2023-09-30T22:58:40.687680+0000","last_became_active":"2023-09-30T22:58:39.684980+0000","last_became_peered":"2023-09-30T22:58:39.684980+0000","last_unstale":"2023-09-30T22:58:40.687680+0000","last_undegraded":"2023-09-30T22:58:40.687680+0000","last_fullsized":"2023-09-30T22:58:40.687680+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:01.049721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700346+0000","last_change":"2023-09-30T22:58:40.700267+0000","last_active":"2023-09-30T22:58:40.700346+0000","last_peered":"2023-09-30T22:58:40.700346+0000","last_clean":"2023-09-30T22:58:40.700346+0000","last_became_active":"2023-09-30T22:58:40.699835+0000","last_became_peered":"2023-09-30T22:58:40.699835+0000","last_unstale":"2023-09-30T22:58:40.700346+0000","last_undegraded":"2023-09-30T22:58:40.700346+0000","last_fullsized":"2023-09-30T22:58:40.700346+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:02.056034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694644+0000","last_change":"2023-09-30T22:58:39.684258+0000","last_active":"2023-09-30T22:58:40.694644+0000","last_peered":"2023-09-30T22:58:40.694644+0000","last_clean":"2023-09-30T22:58:40.694644+0000","last_became_active":"2023-09-30T22:58:39.684032+0000","last_became_peered":"2023-09-30T22:58:39.684032+0000","last_unstale":"2023-09-30T22:58:40.694644+0000","last_undegraded":"2023-09-30T22:58:40.694644+0000","last_fullsized":"2023-09-30T22:58:40.694644+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:14.182466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.688455+0000","last_change":"2023-09-30T22:58:40.688355+0000","last_active":"2023-09-30T22:58:40.688455+0000","last_peered":"2023-09-30T22:58:40.688455+0000","last_clean":"2023-09-30T22:58:40.688455+0000","last_became_active":"2023-09-30T22:58:40.687793+0000","last_became_peered":"2023-09-30T22:58:40.687793+0000","last_unstale":"2023-09-30T22:58:40.688455+0000","last_undegraded":"2023-09-30T22:58:40.688455+0000","last_fullsized":"2023-09-30T22:58:40.688455+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:30:27.659649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"129'8","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718099+0000","last_change":"2023-09-30T22:58:39.683255+0000","last_active":"2023-09-30T22:58:40.718099+0000","last_peered":"2023-09-30T22:58:40.718099+0000","last_clean":"2023-09-30T22:58:40.718099+0000","last_became_active":"2023-09-30T22:58:39.682776+0000","last_became_peered":"2023-09-30T22:58:39.682776+0000","last_unstale":"2023-09-30T22:58:40.718099+0000","last_undegraded":"2023-09-30T22:58:40.718099+0000","last_fullsized":"2023-09-30T22:58:40.718099+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:27:26.690098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697846+0000","last_change":"2023-09-30T22:58:40.697715+0000","last_active":"2023-09-30T22:58:40.697846+0000","last_peered":"2023-09-30T22:58:40.697846+0000","last_clean":"2023-09-30T22:58:40.697846+0000","last_became_active":"2023-09-30T22:58:40.697491+0000","last_became_peered":"2023-09-30T22:58:40.697491+0000","last_unstale":"2023-09-30T22:58:40.697846+0000","last_undegraded":"2023-09-30T22:58:40.697846+0000","last_fullsized":"2023-09-30T22:58:40.697846+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:52.182493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718013+0000","last_change":"2023-09-30T22:58:39.678572+0000","last_active":"2023-09-30T22:58:40.718013+0000","last_peered":"2023-09-30T22:58:40.718013+0000","last_clean":"2023-09-30T22:58:40.718013+0000","last_became_active":"2023-09-30T22:58:39.678203+0000","last_became_peered":"2023-09-30T22:58:39.678203+0000","last_unstale":"2023-09-30T22:58:40.718013+0000","last_undegraded":"2023-09-30T22:58:40.718013+0000","last_fullsized":"2023-09-30T22:58:40.718013+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:52:37.527668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.694290+0000","last_change":"2023-09-30T22:58:40.694010+0000","last_active":"2023-09-30T22:58:40.694290+0000","last_peered":"2023-09-30T22:58:40.694290+0000","last_clean":"2023-09-30T22:58:40.694290+0000","last_became_active":"2023-09-30T22:58:40.693748+0000","last_became_peered":"2023-09-30T22:58:40.693748+0000","last_unstale":"2023-09-30T22:58:40.694290+0000","last_undegraded":"2023-09-30T22:58:40.694290+0000","last_fullsized":"2023-09-30T22:58:40.694290+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:03.489639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686045+0000","last_change":"2023-09-30T22:58:39.678282+0000","last_active":"2023-09-30T22:58:40.686045+0000","last_peered":"2023-09-30T22:58:40.686045+0000","last_clean":"2023-09-30T22:58:40.686045+0000","last_became_active":"2023-09-30T22:58:39.677978+0000","last_became_peered":"2023-09-30T22:58:39.677978+0000","last_unstale":"2023-09-30T22:58:40.686045+0000","last_undegraded":"2023-09-30T22:58:40.686045+0000","last_fullsized":"2023-09-30T22:58:40.686045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:04:56.062211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690333+0000","last_change":"2023-09-30T22:58:40.690252+0000","last_active":"2023-09-30T22:58:40.690333+0000","last_peered":"2023-09-30T22:58:40.690333+0000","last_clean":"2023-09-30T22:58:40.690333+0000","last_became_active":"2023-09-30T22:58:40.689983+0000","last_became_peered":"2023-09-30T22:58:40.689983+0000","last_unstale":"2023-09-30T22:58:40.690333+0000","last_undegraded":"2023-09-30T22:58:40.690333+0000","last_fullsized":"2023-09-30T22:58:40.690333+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:14:29.359388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691234+0000","last_change":"2023-09-30T22:58:39.685991+0000","last_active":"2023-09-30T22:58:40.691234+0000","last_peered":"2023-09-30T22:58:40.691234+0000","last_clean":"2023-09-30T22:58:40.691234+0000","last_became_active":"2023-09-30T22:58:39.685310+0000","last_became_peered":"2023-09-30T22:58:39.685310+0000","last_unstale":"2023-09-30T22:58:40.691234+0000","last_undegraded":"2023-09-30T22:58:40.691234+0000","last_fullsized":"2023-09-30T22:58:40.691234+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:51:12.629352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.697951+0000","last_change":"2023-09-30T22:58:40.697666+0000","last_active":"2023-09-30T22:58:40.697951+0000","last_peered":"2023-09-30T22:58:40.697951+0000","last_clean":"2023-09-30T22:58:40.697951+0000","last_became_active":"2023-09-30T22:58:40.697436+0000","last_became_peered":"2023-09-30T22:58:40.697436+0000","last_unstale":"2023-09-30T22:58:40.697951+0000","last_undegraded":"2023-09-30T22:58:40.697951+0000","last_fullsized":"2023-09-30T22:58:40.697951+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:09.305544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.693590+0000","last_change":"2023-09-30T22:58:39.688234+0000","last_active":"2023-09-30T22:58:40.693590+0000","last_peered":"2023-09-30T22:58:40.693590+0000","last_clean":"2023-09-30T22:58:40.693590+0000","last_became_active":"2023-09-30T22:58:39.687022+0000","last_became_peered":"2023-09-30T22:58:39.687022+0000","last_unstale":"2023-09-30T22:58:40.693590+0000","last_undegraded":"2023-09-30T22:58:40.693590+0000","last_fullsized":"2023-09-30T22:58:40.693590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:08.299231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.703306+0000","last_change":"2023-09-30T22:58:40.703115+0000","last_active":"2023-09-30T22:58:40.703306+0000","last_peered":"2023-09-30T22:58:40.703306+0000","last_clean":"2023-09-30T22:58:40.703306+0000","last_became_active":"2023-09-30T22:58:40.702544+0000","last_became_peered":"2023-09-30T22:58:40.702544+0000","last_unstale":"2023-09-30T22:58:40.703306+0000","last_undegraded":"2023-09-30T22:58:40.703306+0000","last_fullsized":"2023-09-30T22:58:40.703306+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:25.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690735+0000","last_change":"2023-09-30T22:58:39.682955+0000","last_active":"2023-09-30T22:58:40.690735+0000","last_peered":"2023-09-30T22:58:40.690735+0000","last_clean":"2023-09-30T22:58:40.690735+0000","last_became_active":"2023-09-30T22:58:39.682499+0000","last_became_peered":"2023-09-30T22:58:39.682499+0000","last_unstale":"2023-09-30T22:58:40.690735+0000","last_undegraded":"2023-09-30T22:58:40.690735+0000","last_fullsized":"2023-09-30T22:58:40.690735+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:32:19.265488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702932+0000","last_change":"2023-09-30T22:58:40.701273+0000","last_active":"2023-09-30T22:58:40.702932+0000","last_peered":"2023-09-30T22:58:40.702932+0000","last_clean":"2023-09-30T22:58:40.702932+0000","last_became_active":"2023-09-30T22:58:40.700969+0000","last_became_peered":"2023-09-30T22:58:40.700969+0000","last_unstale":"2023-09-30T22:58:40.702932+0000","last_undegraded":"2023-09-30T22:58:40.702932+0000","last_fullsized":"2023-09-30T22:58:40.702932+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:37:03.557770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685798+0000","last_change":"2023-09-30T22:58:39.677443+0000","last_active":"2023-09-30T22:58:40.685798+0000","last_peered":"2023-09-30T22:58:40.685798+0000","last_clean":"2023-09-30T22:58:40.685798+0000","last_became_active":"2023-09-30T22:58:39.677104+0000","last_became_peered":"2023-09-30T22:58:39.677104+0000","last_unstale":"2023-09-30T22:58:40.685798+0000","last_undegraded":"2023-09-30T22:58:40.685798+0000","last_fullsized":"2023-09-30T22:58:40.685798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:45:57.585356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698460+0000","last_change":"2023-09-30T22:58:40.698395+0000","last_active":"2023-09-30T22:58:40.698460+0000","last_peered":"2023-09-30T22:58:40.698460+0000","last_clean":"2023-09-30T22:58:40.698460+0000","last_became_active":"2023-09-30T22:58:40.698187+0000","last_became_peered":"2023-09-30T22:58:40.698187+0000","last_unstale":"2023-09-30T22:58:40.698460+0000","last_undegraded":"2023-09-30T22:58:40.698460+0000","last_fullsized":"2023-09-30T22:58:40.698460+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:11:25.738844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695199+0000","last_change":"2023-09-30T22:58:39.679317+0000","last_active":"2023-09-30T22:58:40.695199+0000","last_peered":"2023-09-30T22:58:40.695199+0000","last_clean":"2023-09-30T22:58:40.695199+0000","last_became_active":"2023-09-30T22:58:39.679101+0000","last_became_peered":"2023-09-30T22:58:39.679101+0000","last_unstale":"2023-09-30T22:58:40.695199+0000","last_undegraded":"2023-09-30T22:58:40.695199+0000","last_fullsized":"2023-09-30T22:58:40.695199+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:10:43.506709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700868+0000","last_change":"2023-09-30T22:58:40.700786+0000","last_active":"2023-09-30T22:58:40.700868+0000","last_peered":"2023-09-30T22:58:40.700868+0000","last_clean":"2023-09-30T22:58:40.700868+0000","last_became_active":"2023-09-30T22:58:40.700552+0000","last_became_peered":"2023-09-30T22:58:40.700552+0000","last_unstale":"2023-09-30T22:58:40.700868+0000","last_undegraded":"2023-09-30T22:58:40.700868+0000","last_fullsized":"2023-09-30T22:58:40.700868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:34:33.710516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686169+0000","last_change":"2023-09-30T22:58:39.683398+0000","last_active":"2023-09-30T22:58:40.686169+0000","last_peered":"2023-09-30T22:58:40.686169+0000","last_clean":"2023-09-30T22:58:40.686169+0000","last_became_active":"2023-09-30T22:58:39.683163+0000","last_became_peered":"2023-09-30T22:58:39.683163+0000","last_unstale":"2023-09-30T22:58:40.686169+0000","last_undegraded":"2023-09-30T22:58:40.686169+0000","last_fullsized":"2023-09-30T22:58:40.686169+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:02:27.331064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700580+0000","last_change":"2023-09-30T22:58:40.700410+0000","last_active":"2023-09-30T22:58:40.700580+0000","last_peered":"2023-09-30T22:58:40.700580+0000","last_clean":"2023-09-30T22:58:40.700580+0000","last_became_active":"2023-09-30T22:58:40.700121+0000","last_became_peered":"2023-09-30T22:58:40.700121+0000","last_unstale":"2023-09-30T22:58:40.700580+0000","last_undegraded":"2023-09-30T22:58:40.700580+0000","last_fullsized":"2023-09-30T22:58:40.700580+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:41.151538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685037+0000","last_change":"2023-09-30T22:58:39.687773+0000","last_active":"2023-09-30T22:58:40.685037+0000","last_peered":"2023-09-30T22:58:40.685037+0000","last_clean":"2023-09-30T22:58:40.685037+0000","last_became_active":"2023-09-30T22:58:39.687639+0000","last_became_peered":"2023-09-30T22:58:39.687639+0000","last_unstale":"2023-09-30T22:58:40.685037+0000","last_undegraded":"2023-09-30T22:58:40.685037+0000","last_fullsized":"2023-09-30T22:58:40.685037+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:01.049721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.685564+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:58:40.685564+0000","last_peered":"2023-09-30T22:58:40.685564+0000","last_clean":"2023-09-30T22:58:40.685564+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:58:40.685564+0000","last_undegraded":"2023-09-30T22:58:40.685564+0000","last_fullsized":"2023-09-30T22:58:40.685564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.698452+0000","last_change":"2023-09-30T22:58:40.698342+0000","last_active":"2023-09-30T22:58:40.698452+0000","last_peered":"2023-09-30T22:58:40.698452+0000","last_clean":"2023-09-30T22:58:40.698452+0000","last_became_active":"2023-09-30T22:58:40.697933+0000","last_became_peered":"2023-09-30T22:58:40.697933+0000","last_unstale":"2023-09-30T22:58:40.698452+0000","last_undegraded":"2023-09-30T22:58:40.698452+0000","last_fullsized":"2023-09-30T22:58:40.698452+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:27.651331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718426+0000","last_change":"2023-09-30T22:58:39.676593+0000","last_active":"2023-09-30T22:58:40.718426+0000","last_peered":"2023-09-30T22:58:40.718426+0000","last_clean":"2023-09-30T22:58:40.718426+0000","last_became_active":"2023-09-30T22:58:39.676349+0000","last_became_peered":"2023-09-30T22:58:39.676349+0000","last_unstale":"2023-09-30T22:58:40.718426+0000","last_undegraded":"2023-09-30T22:58:40.718426+0000","last_fullsized":"2023-09-30T22:58:40.718426+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:37:22.833150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690450+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:58:40.690450+0000","last_peered":"2023-09-30T22:58:40.690450+0000","last_clean":"2023-09-30T22:58:40.690450+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:58:40.690450+0000","last_undegraded":"2023-09-30T22:58:40.690450+0000","last_fullsized":"2023-09-30T22:58:40.690450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.700250+0000","last_change":"2023-09-30T22:58:40.700083+0000","last_active":"2023-09-30T22:58:40.700250+0000","last_peered":"2023-09-30T22:58:40.700250+0000","last_clean":"2023-09-30T22:58:40.700250+0000","last_became_active":"2023-09-30T22:58:40.699521+0000","last_became_peered":"2023-09-30T22:58:40.699521+0000","last_unstale":"2023-09-30T22:58:40.700250+0000","last_undegraded":"2023-09-30T22:58:40.700250+0000","last_fullsized":"2023-09-30T22:58:40.700250+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:08.002099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686197+0000","last_change":"2023-09-30T22:58:39.679151+0000","last_active":"2023-09-30T22:58:40.686197+0000","last_peered":"2023-09-30T22:58:40.686197+0000","last_clean":"2023-09-30T22:58:40.686197+0000","last_became_active":"2023-09-30T22:58:39.678636+0000","last_became_peered":"2023-09-30T22:58:39.678636+0000","last_unstale":"2023-09-30T22:58:40.686197+0000","last_undegraded":"2023-09-30T22:58:40.686197+0000","last_fullsized":"2023-09-30T22:58:40.686197+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:40.145225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691288+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:58:40.691288+0000","last_peered":"2023-09-30T22:58:40.691288+0000","last_clean":"2023-09-30T22:58:40.691288+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:58:40.691288+0000","last_undegraded":"2023-09-30T22:58:40.691288+0000","last_fullsized":"2023-09-30T22:58:40.691288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702064+0000","last_change":"2023-09-30T22:58:40.701849+0000","last_active":"2023-09-30T22:58:40.702064+0000","last_peered":"2023-09-30T22:58:40.702064+0000","last_clean":"2023-09-30T22:58:40.702064+0000","last_became_active":"2023-09-30T22:58:40.700727+0000","last_became_peered":"2023-09-30T22:58:40.700727+0000","last_unstale":"2023-09-30T22:58:40.702064+0000","last_undegraded":"2023-09-30T22:58:40.702064+0000","last_fullsized":"2023-09-30T22:58:40.702064+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.716807+0000","last_change":"2023-09-30T22:58:39.687500+0000","last_active":"2023-09-30T22:58:40.716807+0000","last_peered":"2023-09-30T22:58:40.716807+0000","last_clean":"2023-09-30T22:58:40.716807+0000","last_became_active":"2023-09-30T22:58:39.686604+0000","last_became_peered":"2023-09-30T22:58:39.686604+0000","last_unstale":"2023-09-30T22:58:40.716807+0000","last_undegraded":"2023-09-30T22:58:40.716807+0000","last_fullsized":"2023-09-30T22:58:40.716807+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:41:58.354974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690810+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:58:40.690810+0000","last_peered":"2023-09-30T22:58:40.690810+0000","last_clean":"2023-09-30T22:58:40.690810+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:58:40.690810+0000","last_undegraded":"2023-09-30T22:58:40.690810+0000","last_fullsized":"2023-09-30T22:58:40.690810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691075+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:58:40.691075+0000","last_peered":"2023-09-30T22:58:40.691075+0000","last_clean":"2023-09-30T22:58:40.691075+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:58:40.691075+0000","last_undegraded":"2023-09-30T22:58:40.691075+0000","last_fullsized":"2023-09-30T22:58:40.691075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.695462+0000","last_change":"2023-09-30T22:58:40.694403+0000","last_active":"2023-09-30T22:58:40.695462+0000","last_peered":"2023-09-30T22:58:40.695462+0000","last_clean":"2023-09-30T22:58:40.695462+0000","last_became_active":"2023-09-30T22:58:40.693900+0000","last_became_peered":"2023-09-30T22:58:40.693900+0000","last_unstale":"2023-09-30T22:58:40.695462+0000","last_undegraded":"2023-09-30T22:58:40.695462+0000","last_fullsized":"2023-09-30T22:58:40.695462+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:09.926575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"129'1","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.718341+0000","last_change":"2023-09-30T22:58:39.682374+0000","last_active":"2023-09-30T22:58:40.718341+0000","last_peered":"2023-09-30T22:58:40.718341+0000","last_clean":"2023-09-30T22:58:40.718341+0000","last_became_active":"2023-09-30T22:58:39.682087+0000","last_became_peered":"2023-09-30T22:58:39.682087+0000","last_unstale":"2023-09-30T22:58:40.718341+0000","last_undegraded":"2023-09-30T22:58:40.718341+0000","last_fullsized":"2023-09-30T22:58:40.718341+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:05:26.645018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691377+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:58:40.691377+0000","last_peered":"2023-09-30T22:58:40.691377+0000","last_clean":"2023-09-30T22:58:40.691377+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:58:40.691377+0000","last_undegraded":"2023-09-30T22:58:40.691377+0000","last_fullsized":"2023-09-30T22:58:40.691377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.703325+0000","last_change":"2023-09-30T22:58:40.703267+0000","last_active":"2023-09-30T22:58:40.703325+0000","last_peered":"2023-09-30T22:58:40.703325+0000","last_clean":"2023-09-30T22:58:40.703325+0000","last_became_active":"2023-09-30T22:58:40.702865+0000","last_became_peered":"2023-09-30T22:58:40.702865+0000","last_unstale":"2023-09-30T22:58:40.703325+0000","last_undegraded":"2023-09-30T22:58:40.703325+0000","last_fullsized":"2023-09-30T22:58:40.703325+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:44:40.020637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.687790+0000","last_change":"2023-09-30T22:58:39.676444+0000","last_active":"2023-09-30T22:58:40.687790+0000","last_peered":"2023-09-30T22:58:40.687790+0000","last_clean":"2023-09-30T22:58:40.687790+0000","last_became_active":"2023-09-30T22:58:39.676125+0000","last_became_peered":"2023-09-30T22:58:39.676125+0000","last_unstale":"2023-09-30T22:58:40.687790+0000","last_undegraded":"2023-09-30T22:58:40.687790+0000","last_fullsized":"2023-09-30T22:58:40.687790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:44:06.995786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691306+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:58:40.691306+0000","last_peered":"2023-09-30T22:58:40.691306+0000","last_clean":"2023-09-30T22:58:40.691306+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:58:40.691306+0000","last_undegraded":"2023-09-30T22:58:40.691306+0000","last_fullsized":"2023-09-30T22:58:40.691306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.702896+0000","last_change":"2023-09-30T22:58:40.700797+0000","last_active":"2023-09-30T22:58:40.702896+0000","last_peered":"2023-09-30T22:58:40.702896+0000","last_clean":"2023-09-30T22:58:40.702896+0000","last_became_active":"2023-09-30T22:58:40.700550+0000","last_became_peered":"2023-09-30T22:58:40.700550+0000","last_unstale":"2023-09-30T22:58:40.702896+0000","last_undegraded":"2023-09-30T22:58:40.702896+0000","last_fullsized":"2023-09-30T22:58:40.702896+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:03.489639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"129'2","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.719103+0000","last_change":"2023-09-30T22:58:39.681894+0000","last_active":"2023-09-30T22:58:40.719103+0000","last_peered":"2023-09-30T22:58:40.719103+0000","last_clean":"2023-09-30T22:58:40.719103+0000","last_became_active":"2023-09-30T22:58:39.681664+0000","last_became_peered":"2023-09-30T22:58:39.681664+0000","last_unstale":"2023-09-30T22:58:40.719103+0000","last_undegraded":"2023-09-30T22:58:40.719103+0000","last_fullsized":"2023-09-30T22:58:40.719103+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:13:11.147018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.691671+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:58:40.691671+0000","last_peered":"2023-09-30T22:58:40.691671+0000","last_clean":"2023-09-30T22:58:40.691671+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:58:40.691671+0000","last_undegraded":"2023-09-30T22:58:40.691671+0000","last_fullsized":"2023-09-30T22:58:40.691671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.699727+0000","last_change":"2023-09-30T22:58:40.699442+0000","last_active":"2023-09-30T22:58:40.699727+0000","last_peered":"2023-09-30T22:58:40.699727+0000","last_clean":"2023-09-30T22:58:40.699727+0000","last_became_active":"2023-09-30T22:58:40.698855+0000","last_became_peered":"2023-09-30T22:58:40.698855+0000","last_unstale":"2023-09-30T22:58:40.699727+0000","last_undegraded":"2023-09-30T22:58:40.699727+0000","last_fullsized":"2023-09-30T22:58:40.699727+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:39.666955+0000","last_clean_scrub_stamp":"2023-09-30T22:58:39.666955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:07:43.997056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.686079+0000","last_change":"2023-09-30T22:58:39.688153+0000","last_active":"2023-09-30T22:58:40.686079+0000","last_peered":"2023-09-30T22:58:40.686079+0000","last_clean":"2023-09-30T22:58:40.686079+0000","last_became_active":"2023-09-30T22:58:39.687869+0000","last_became_peered":"2023-09-30T22:58:39.687869+0000","last_unstale":"2023-09-30T22:58:40.686079+0000","last_undegraded":"2023-09-30T22:58:40.686079+0000","last_fullsized":"2023-09-30T22:58:40.686079+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:58:38.660642+0000","last_clean_scrub_stamp":"2023-09-30T22:58:38.660642+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:52:55.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-09-30T22:58:40.690375+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:58:40.690375+0000","last_peered":"2023-09-30T22:58:40.690375+0000","last_clean":"2023-09-30T22:58:40.690375+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:58:40.690375+0000","last_undegraded":"2023-09-30T22:58:40.690375+0000","last_fullsized":"2023-09-30T22:58:40.690375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241515,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66300000000000003,"15min":0.63300000000000001},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76200000000000001,"5min":0.96599999999999997,"15min":1.0229999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89100000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91800000000000004},"last":0.623},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70199999999999996,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66300000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69399999999999995,"15min":0.67400000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73099999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83699999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72799999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78300000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.752},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.434},"max":{"1min":0.84199999999999997,"5min":1.056,"15min":1.056},"last":0.68300000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61799999999999999,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.623,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.81799999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65900000000000003,"15min":0.63100000000000001},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":1.135,"15min":1.135},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.004},"last":0.82999999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":1.016},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85699999999999998,"5min":1.071,"15min":1.071},"last":0.86899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199240603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.96499999999999997},"min":{"1min":0.52800000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":1.823,"15min":6.5190000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.51900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.5710000000000002,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.94199999999999995}]},{"osd":1,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.75700000000000001,"15min":0.82199999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94599999999999995,"5min":2.6230000000000002,"15min":3.6339999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.996},"min":{"1min":0.503,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0649999999999999,"5min":5.6749999999999998,"15min":8.4339999999999993},"last":1.073}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.80500000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0029999999999999,"5min":3.2629999999999999,"15min":3.4580000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.73299999999999998,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.0429999999999999,"15min":6.5730000000000004},"last":0.877}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.93999999999999995},"min":{"1min":0.58499999999999996,"5min":0.49299999999999999,"15min":0.44400000000000001},"max":{"1min":1.343,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.036,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.90000000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.64200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.94199999999999995,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75900000000000001,"15min":0.68300000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2909999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.97799999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.66200000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.996,"5min":1.321,"15min":1.321},"last":1.05},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.754,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0289999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":1.002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.69299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1140000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44400000000000001,"15min":0.40799999999999997},"min":{"1min":0.30599999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.48799999999999999,"5min":1.083,"15min":1.083},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.49099999999999999,"15min":0.45800000000000002},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.59099999999999997,"5min":0.745,"15min":0.745},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46100000000000002,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.47399999999999998},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":0.57199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56299999999999994,"15min":0.52100000000000002},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.313},"max":{"1min":0.65300000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.47499999999999998},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54300000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.57599999999999996,"5min":0.52000000000000002,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.45100000000000001},"max":{"1min":0.94499999999999995,"5min":1.22,"15min":1.22},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.72899999999999998},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.432},"max":{"1min":1.002,"5min":1.127,"15min":1.127},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89600000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79100000000000004,"15min":0.76300000000000001},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97799999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81899999999999995,"15min":0.76900000000000002},"min":{"1min":0.64700000000000002,"5min":0.54500000000000004,"15min":0.52900000000000003},"max":{"1min":0.97799999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.432,"15min":0.41799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53100000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.46500000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.61899999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.316}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61399999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.51500000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.879,"15min":0.879},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48699999999999999,"15min":0.46100000000000002},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65900000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.5}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.70699999999999996},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.141,"5min":1.27,"15min":1.27},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.006,"5min":1.171,"15min":1.171},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96899999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.78800000000000003,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.82399999999999995}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":0.84799999999999998,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.2610000000000001,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.623,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.81699999999999995,"15min":0.77200000000000002},"min":{"1min":0.54200000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194572,"statfs":{"total":200000000,"available":199242027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.23599999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.42999999999999999},"min":{"1min":0.311,"5min":0.251,"15min":0.249},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.501},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79300000000000004,"5min":0.83999999999999997,"15min":1.0449999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.45300000000000001},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4910000000000001},"last":1}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.179},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.008,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.84299999999999997}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.615},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.55200000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77000000000000002,"15min":0.73799999999999999},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.46000000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.497,"5min":0.495,"15min":0.439},"max":{"1min":1.113,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.81100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199240603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.63300000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.51100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73299999999999998,"5min":1.0700000000000001,"15min":1.919},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.53500000000000003,"5min":0.75800000000000001,"15min":1.254},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67900000000000005,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59099999999999997,"5min":0.72399999999999998,"15min":1.6020000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.96199999999999997,"5min":1.2190000000000001,"15min":1.5309999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.72699999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92500000000000004,"5min":1.242,"15min":1.401},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.76200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93999999999999995,"5min":3.306,"15min":3.306},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75,"15min":0.749},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.98199999999999998,"15min":1.508},"last":0.754},{"interface":"front","average":{"1min":0.75,"5min":0.755,"15min":0.746},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":0.92700000000000005,"5min":1.274,"15min":1.4910000000000001},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1870000000000001,"15min":1.5620000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0489999999999999,"5min":1.0960000000000001,"15min":1.3140000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":1.135,"5min":1.3440000000000001,"15min":1.3640000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97199999999999998,"5min":1.1970000000000001,"15min":1.573},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199235464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.022,"15min":1.022},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.59699999999999998},"min":{"1min":0.50700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.746,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.74299999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.61599999999999999},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.68300000000000005},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.877,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70099999999999996,"15min":0.65500000000000003},"min":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63400000000000001,"15min":0.65700000000000003},"min":{"1min":0.44,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.37},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.97099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98599999999999999,"5min":1.016,"15min":1.016},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.56399999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":1.044,"15min":1.044},"last":0.94399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88400000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0369999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.27400000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94499999999999995,"5min":1.044,"15min":1.044},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.64000000000000001},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.621},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.80700000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86799999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.433}]},{"osd":6,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.93700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.37},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.748},"min":{"1min":0.64000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.85899999999999999}]}]}],"pool_statfs":[]}} 2023-09-30T22:58:45.535 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:58:45.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T22:58:45.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.767+0000 7fe88bbff700 1 Processor -- start 2023-09-30T22:58:45.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.767+0000 7fe88bbff700 1 -- start start 2023-09-30T22:58:45.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.768+0000 7fe88bbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 0x7fe88406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.768+0000 7fe88bbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88406b650 con 0x7fe884159f10 2023-09-30T22:58:45.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.768+0000 7fe88bbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88406aa40 con 0x7fe884067620 2023-09-30T22:58:45.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.768+0000 7fe88bbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88406ad20 con 0x7fe884159b40 2023-09-30T22:58:45.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe88919a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe884159f10 0x7fe8840683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58212/0 (socket says 172.21.15.142:58212) 2023-09-30T22:58:45.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe88919a700 1 -- 172.21.15.142:0/328888047 learned_addr learned my addr 172.21.15.142:0/328888047 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:45.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059112386 0 0) 0x7fe88406b650 con 0x7fe884159f10 2023-09-30T22:58:45.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe88999b700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 0x7fe88406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe870003570 con 0x7fe884159f10 2023-09-30T22:58:45.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3515348448 0 0) 0x7fe870003570 con 0x7fe884159f10 2023-09-30T22:58:45.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 msgr2=0x7fe88406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 0x7fe88406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 >> v1:172.21.15.148:6789/0 conn(0x7fe884067620 legacy=0x7fe8840cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88406b000 con 0x7fe884159f10 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fe874001470 con 0x7fe884159f10 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.769+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 >> v1:172.21.15.142:6789/0 conn(0x7fe884159f10 legacy=0x7fe8840683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe888999700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870003a90 0x7fe870003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe888999700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 0x7fe870004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe888999700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe870004d50 0x7fe8700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88406ad20 con 0x7fe870004d50 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87000bbf0 con 0x7fe870003a90 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87000bd80 con 0x7fe884159b40 2023-09-30T22:58:45.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88a19c700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe870004d50 0x7fe8700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88999b700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870003a90 0x7fe870003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88919a700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 0x7fe870004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88a19c700 1 -- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 msgr2=0x7fe870004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88a19c700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe884159b40 0x7fe870004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88a19c700 1 -- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870003a90 msgr2=0x7fe870003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88a19c700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870003a90 0x7fe870003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.770+0000 7fe88a19c700 1 -- 172.21.15.142:0/328888047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870003570 con 0x7fe870004d50 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe88a19c700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe870004d50 0x7fe8700051c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe87c001fc0 tx=0x7fe87c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7354d1b9be11bbf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c001950 con 0x7fe870004d50 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c00c8b0 con 0x7fe870004d50 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe888999700 1 -- 172.21.15.142:0/328888047 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00cc50 con 0x7fe870004d50 2023-09-30T22:58:45.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe88bbff700 1 -- 172.21.15.142:0/328888047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe870004d50 msgr2=0x7fe8700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe88bbff700 1 --2- 172.21.15.142:0/328888047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe870004d50 0x7fe8700051c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe87c001fc0 tx=0x7fe87c001640 comp rx=0 tx=0).stop 2023-09-30T22:58:45.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe88a19c700 1 -- 172.21.15.142:0/328888047 reap_dead start 2023-09-30T22:58:45.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe88bbff700 1 -- 172.21.15.142:0/328888047 shutdown_connections 2023-09-30T22:58:45.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe88bbff700 1 -- 172.21.15.142:0/328888047 >> 172.21.15.142:0/328888047 conn(0x7fe8840c9950 msgr2=0x7fe8840c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:45.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.771+0000 7fe88bbff700 1 -- 172.21.15.142:0/328888047 shutdown_connections 2023-09-30T22:58:45.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.772+0000 7fe88bbff700 1 -- 172.21.15.142:0/328888047 wait complete. 2023-09-30T22:58:45.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.773+0000 7fe88bbff700 1 Processor -- start 2023-09-30T22:58:45.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.774+0000 7fe88bbff700 1 -- start start 2023-09-30T22:58:45.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88bbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870004d50 0x7fe88414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88bbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe88415bf30 0x7fe884154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88bbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88415c3a0 0x7fe884155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88bbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c4f10 con 0x7fe88415c3a0 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88bbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c4300 con 0x7fe870004d50 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88bbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c45e0 con 0x7fe88415bf30 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88a19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88415c3a0 0x7fe884155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88a19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88415c3a0 0x7fe884155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49350/0 (socket says 172.21.15.142:49350) 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88a19c700 1 -- 172.21.15.142:0/2475059082 learned_addr learned my addr 172.21.15.142:0/2475059082 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88999b700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870004d50 0x7fe88414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.775+0000 7fe88919a700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe88415bf30 0x7fe884154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88a19c700 1 -- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe88415bf30 msgr2=0x7fe884154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88a19c700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe88415bf30 0x7fe884154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88a19c700 1 -- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870004d50 msgr2=0x7fe88414fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:45.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88a19c700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870004d50 0x7fe88414fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:45.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88a19c700 1 -- 172.21.15.142:0/2475059082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8840c48c0 con 0x7fe88415c3a0 2023-09-30T22:58:45.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88a19c700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88415c3a0 0x7fe884155070 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe8700057c0 tx=0x7fe87c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:45.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe879ffb700 1 -- 172.21.15.142:0/2475059082 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c024070 con 0x7fe88415c3a0 2023-09-30T22:58:45.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe879ffb700 1 -- 172.21.15.142:0/2475059082 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c00c6d0 con 0x7fe88415c3a0 2023-09-30T22:58:45.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8840c4ba0 con 0x7fe88415c3a0 2023-09-30T22:58:45.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe879ffb700 1 -- 172.21.15.142:0/2475059082 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c006df0 con 0x7fe88415c3a0 2023-09-30T22:58:45.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.776+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8841503a0 con 0x7fe88415c3a0 2023-09-30T22:58:45.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.777+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8840ccb30 con 0x7fe88415c3a0 2023-09-30T22:58:45.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.778+0000 7fe879ffb700 1 -- 172.21.15.142:0/2475059082 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe87c01f620 con 0x7fe88415c3a0 2023-09-30T22:58:45.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.779+0000 7fe879ffb700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe868067330 0x7fe8680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:45.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.779+0000 7fe879ffb700 1 -- 172.21.15.142:0/2475059082 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe87c086480 con 0x7fe88415c3a0 2023-09-30T22:58:45.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.779+0000 7fe88999b700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe868067330 0x7fe8680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:45.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.780+0000 7fe88999b700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe868067330 0x7fe8680697e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe880006f00 tx=0x7fe8800091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:45.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:45.784+0000 7fe879ffb700 1 -- 172.21.15.142:0/2475059082 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe87c0532e0 con 0x7fe88415c3a0 2023-09-30T22:58:46.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.047+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe8840c5050 con 0x7fe88415c3a0 2023-09-30T22:58:46.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.051+0000 7fe879ffb700 1 -- 172.21.15.142:0/2475059082 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe8840c5050 con 0x7fe88415c3a0 2023-09-30T22:58:46.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe868067330 msgr2=0x7fe8680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe868067330 0x7fe8680697e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe880006f00 tx=0x7fe8800091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88415c3a0 msgr2=0x7fe884155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88415c3a0 0x7fe884155070 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe8700057c0 tx=0x7fe87c015000 comp rx=0 tx=0).stop 2023-09-30T22:58:46.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 shutdown_connections 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe868067330 0x7fe8680697e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88415c3a0 0x7fe884155070 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe870004d50 0x7fe88414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 --2- 172.21.15.142:0/2475059082 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe88415bf30 0x7fe884154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 >> 172.21.15.142:0/2475059082 conn(0x7fe8840c9950 msgr2=0x7fe884157150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 shutdown_connections 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.054+0000 7fe88bbff700 1 -- 172.21.15.142:0/2475059082 wait complete. 2023-09-30T22:58:46.056 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T22:58:46.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.263+0000 7ff0985ff700 1 Processor -- start 2023-09-30T22:58:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.263+0000 7ff0985ff700 1 -- start start 2023-09-30T22:58:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.264+0000 7ff0985ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff09006e820 0x7ff090161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.264+0000 7ff0985ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09006d3e0 con 0x7ff0900b00d0 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.264+0000 7ff0985ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09006dc80 con 0x7ff0900af020 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.264+0000 7ff0985ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09015b400 con 0x7ff09006e820 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff095b9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff0900b00d0 0x7ff09006e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58220/0 (socket says 172.21.15.142:58220) 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff095b9a700 1 -- 172.21.15.142:0/736265690 learned_addr learned my addr 172.21.15.142:0/736265690 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff096b9c700 1 --2- 172.21.15.142:0/736265690 >> v2:172.21.15.142:3300/0 conn(0x7ff09006e820 0x7ff090161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff095399700 1 -- 172.21.15.142:0/736265690 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919815671 0 0) 0x7ff09006d3e0 con 0x7ff0900b00d0 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff095399700 1 -- 172.21.15.142:0/736265690 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07c003570 con 0x7ff0900b00d0 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff096b9c700 1 -- 172.21.15.142:0/736265690 >> v1:172.21.15.148:6789/0 conn(0x7ff0900af020 legacy=0x7ff090156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff096b9c700 1 -- 172.21.15.142:0/736265690 >> v1:172.21.15.142:6789/0 conn(0x7ff0900b00d0 legacy=0x7ff09006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.265+0000 7ff096b9c700 1 -- 172.21.15.142:0/736265690 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09006eca0 con 0x7ff09006e820 2023-09-30T22:58:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff096b9c700 1 --2- 172.21.15.142:0/736265690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff09006e820 0x7ff090161790 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff088009e90 tx=0x7ff088009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ffc6c3eca83158 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff095399700 1 -- 172.21.15.142:0/736265690 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08800bc40 con 0x7ff09006e820 2023-09-30T22:58:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff095399700 1 -- 172.21.15.142:0/736265690 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08800bda0 con 0x7ff09006e820 2023-09-30T22:58:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff095399700 1 -- 172.21.15.142:0/736265690 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880116b0 con 0x7ff09006e820 2023-09-30T22:58:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff0985ff700 1 -- 172.21.15.142:0/736265690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff09006e820 msgr2=0x7ff090161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff0985ff700 1 --2- 172.21.15.142:0/736265690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff09006e820 0x7ff090161790 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff088009e90 tx=0x7ff088009780 comp rx=0 tx=0).stop 2023-09-30T22:58:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff0985ff700 1 -- 172.21.15.142:0/736265690 shutdown_connections 2023-09-30T22:58:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff0985ff700 1 --2- 172.21.15.142:0/736265690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff09006e820 0x7ff090161790 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff0985ff700 1 -- 172.21.15.142:0/736265690 >> 172.21.15.142:0/736265690 conn(0x7ff0900680c0 msgr2=0x7ff0900c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.266+0000 7ff0985ff700 1 -- 172.21.15.142:0/736265690 shutdown_connections 2023-09-30T22:58:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.267+0000 7ff0985ff700 1 -- 172.21.15.142:0/736265690 wait complete. 2023-09-30T22:58:46.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.268+0000 7ff0985ff700 1 Processor -- start 2023-09-30T22:58:46.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.269+0000 7ff0985ff700 1 -- start start 2023-09-30T22:58:46.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff0985ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09006e820 0x7ff0900c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:46.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff0985ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0900af020 0x7ff0900c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:46.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff0985ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900b00d0 0x7ff0900c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:46.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff0985ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900c29a0 con 0x7ff0900b00d0 2023-09-30T22:58:46.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff0985ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900c1d90 con 0x7ff09006e820 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff0985ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900c2070 con 0x7ff0900af020 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff096b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900b00d0 0x7ff0900c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff096b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900b00d0 0x7ff0900c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49382/0 (socket says 172.21.15.142:49382) 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff096b9c700 1 -- 172.21.15.142:0/2486771320 learned_addr learned my addr 172.21.15.142:0/2486771320 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff095b9a700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0900af020 0x7ff0900c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.270+0000 7ff09639b700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09006e820 0x7ff0900c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff096b9c700 1 -- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0900af020 msgr2=0x7ff0900c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff096b9c700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0900af020 0x7ff0900c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff096b9c700 1 -- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09006e820 msgr2=0x7ff0900c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff096b9c700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09006e820 0x7ff0900c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff096b9c700 1 -- 172.21.15.142:0/2486771320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009a20 con 0x7ff0900b00d0 2023-09-30T22:58:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff096b9c700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900b00d0 0x7ff0900c91a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ff090068600 tx=0x7ff08801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff0867fc700 1 -- 172.21.15.142:0/2486771320 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08800bc40 con 0x7ff0900b00d0 2023-09-30T22:58:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff0867fc700 1 -- 172.21.15.142:0/2486771320 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880032f0 con 0x7ff0900b00d0 2023-09-30T22:58:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff0867fc700 1 -- 172.21.15.142:0/2486771320 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08801ab70 con 0x7ff0900b00d0 2023-09-30T22:58:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0900c2350 con 0x7ff0900b00d0 2023-09-30T22:58:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.271+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0900c6270 con 0x7ff0900b00d0 2023-09-30T22:58:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.272+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0900c6460 con 0x7ff0900b00d0 2023-09-30T22:58:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.273+0000 7ff0867fc700 1 -- 172.21.15.142:0/2486771320 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff088022030 con 0x7ff0900b00d0 2023-09-30T22:58:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.274+0000 7ff0867fc700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff074067330 0x7ff0740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.274+0000 7ff0867fc700 1 -- 172.21.15.142:0/2486771320 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff0880892c0 con 0x7ff0900b00d0 2023-09-30T22:58:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.274+0000 7ff09639b700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff074067330 0x7ff0740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.275+0000 7ff09639b700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff074067330 0x7ff0740697e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff08c003a80 tx=0x7ff08c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.278+0000 7ff0867fc700 1 -- 172.21.15.142:0/2486771320 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff088056120 con 0x7ff0900b00d0 2023-09-30T22:58:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.517+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0900c2ae0 con 0x7ff0900b00d0 2023-09-30T22:58:46.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.518+0000 7ff0867fc700 1 -- 172.21.15.142:0/2486771320 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7ff0900c2ae0 con 0x7ff0900b00d0 2023-09-30T22:58:46.519 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:46.519 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:58:46.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff074067330 msgr2=0x7ff0740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff074067330 0x7ff0740697e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff08c003a80 tx=0x7ff08c007ec0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900b00d0 msgr2=0x7ff0900c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900b00d0 0x7ff0900c91a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ff090068600 tx=0x7ff08801b000 comp rx=0 tx=0).stop 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 shutdown_connections 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff074067330 0x7ff0740697e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900b00d0 0x7ff0900c91a0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff09006e820 0x7ff0900c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 --2- 172.21.15.142:0/2486771320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0900af020 0x7ff0900c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 >> 172.21.15.142:0/2486771320 conn(0x7ff0900680c0 msgr2=0x7ff090152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.520+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 shutdown_connections 2023-09-30T22:58:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:46.521+0000 7ff0985ff700 1 -- 172.21.15.142:0/2486771320 wait complete. 2023-09-30T22:58:46.523 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:58:46.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:58:40.149739+0000', 'modified': '2023-09-30T22:58:43.711024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6484': {'gid': 6484, 'name': 'b', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6834/302118526', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6832', 'nonce': 302118526}, {'type': 'v1', 'addr': '172.21.15.148:6834', 'nonce': 302118526}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:58:46.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:58:46.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-30T22:58:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.133+0000 7f3790fff700 1 Processor -- start 2023-09-30T22:58:47.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.133+0000 7f3790fff700 1 -- start start 2023-09-30T22:58:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.134+0000 7f3790fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 0x7f378c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.134+0000 7f3790fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378c06d3e0 con 0x7f378c06e820 2023-09-30T22:58:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.134+0000 7f3790fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378c06dc80 con 0x7f378c0b00d0 2023-09-30T22:58:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.134+0000 7f3790fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c06b790 con 0x7f378c0af020 2023-09-30T22:58:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.134+0000 7f378ad9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f378c06e820 0x7f378c15a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58222/0 (socket says 172.21.15.142:58222) 2023-09-30T22:58:47.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.134+0000 7f378ad9d700 1 -- 172.21.15.142:0/313054426 learned_addr learned my addr 172.21.15.142:0/313054426 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:47.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f378a59c700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 0x7f378c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610338704 0 0) 0x7f378c06d3e0 con 0x7f378c06e820 2023-09-30T22:58:47.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3778003570 con 0x7f378c06e820 2023-09-30T22:58:47.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 429494285 0 0) 0x7f3778003570 con 0x7f378c06e820 2023-09-30T22:58:47.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 msgr2=0x7f378c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 0x7f378c156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 >> v1:172.21.15.148:6789/0 conn(0x7f378c0b00d0 legacy=0x7f378c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0b0650 con 0x7f378c06e820 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f37840017f0 con 0x7f378c06e820 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 >> v1:172.21.15.142:6789/0 conn(0x7f378c06e820 legacy=0x7f378c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f3778003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3778004810 0x7f3778004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 0x7f37780051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c06b790 con 0x7f3778003a90 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377800bb60 con 0x7f3778004810 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377800df30 con 0x7f378c0af020 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.135+0000 7f378a59c700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f3778003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f3783fff700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3778004810 0x7f3778004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f378ad9d700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 0x7f37780051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f378a59c700 1 -- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 msgr2=0x7f37780051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f378a59c700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c0af020 0x7f37780051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f378a59c700 1 -- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3778004810 msgr2=0x7f3778004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f378a59c700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3778004810 0x7f3778004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f378a59c700 1 -- 172.21.15.142:0/313054426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778003570 con 0x7f3778003a90 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f378a59c700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f3778003ea0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f377c009c00 tx=0x7f377c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4098cc205ca0aa1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00e710 con 0x7f3778003a90 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c00e870 con 0x7f3778003a90 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.136+0000 7f3789d9b700 1 -- 172.21.15.142:0/313054426 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00ec30 con 0x7f3778003a90 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.137+0000 7f3790fff700 1 -- 172.21.15.142:0/313054426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 msgr2=0x7f3778003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.137+0000 7f3790fff700 1 --2- 172.21.15.142:0/313054426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f3778003ea0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f377c009c00 tx=0x7f377c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.137+0000 7f378ad9d700 1 -- 172.21.15.142:0/313054426 reap_dead start 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.137+0000 7f3790fff700 1 -- 172.21.15.142:0/313054426 shutdown_connections 2023-09-30T22:58:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.137+0000 7f3790fff700 1 -- 172.21.15.142:0/313054426 >> 172.21.15.142:0/313054426 conn(0x7f378c0680c0 msgr2=0x7f378c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.137+0000 7f3790fff700 1 -- 172.21.15.142:0/313054426 shutdown_connections 2023-09-30T22:58:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.137+0000 7f3790fff700 1 -- 172.21.15.142:0/313054426 wait complete. 2023-09-30T22:58:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.138+0000 7f3790fff700 1 Processor -- start 2023-09-30T22:58:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.138+0000 7f3790fff700 1 -- start start 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.139+0000 7f3790fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f378c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.139+0000 7f3790fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c1668e0 0x7f378c166d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.139+0000 7f3790fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f378c156b50 0x7f378c0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.139+0000 7f3790fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c15a9e0 con 0x7f3778003a90 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.139+0000 7f3790fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c15acc0 con 0x7f378c156b50 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.139+0000 7f3790fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c1574c0 con 0x7f378c1668e0 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f378c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f378c155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49394/0 (socket says 172.21.15.142:49394) 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 -- 172.21.15.142:0/1532951650 learned_addr learned my addr 172.21.15.142:0/1532951650 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f3783fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c1668e0 0x7f378c166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378ad9d700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f378c156b50 0x7f378c0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 -- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c1668e0 msgr2=0x7f378c166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c1668e0 0x7f378c166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 -- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f378c156b50 msgr2=0x7f378c0c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f378c156b50 0x7f378c0c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 -- 172.21.15.142:0/1532951650 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c1577a0 con 0x7f3778003a90 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378ad9d700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f378c156b50 0x7f378c0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.140+0000 7f378a59c700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f378c155370 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f377800bb30 tx=0x7f377c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.141+0000 7f37827fc700 1 -- 172.21.15.142:0/1532951650 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c022070 con 0x7f3778003a90 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.141+0000 7f37827fc700 1 -- 172.21.15.142:0/1532951650 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c00e9e0 con 0x7f3778003a90 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.141+0000 7f37827fc700 1 -- 172.21.15.142:0/1532951650 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c01c450 con 0x7f3778003a90 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.141+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c157a80 con 0x7f3778003a90 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.141+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c156fd0 con 0x7f3778003a90 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.143+0000 7f37827fc700 1 -- 172.21.15.142:0/1532951650 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f377c01c8a0 con 0x7f3778003a90 2023-09-30T22:58:47.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.143+0000 7f37827fc700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f376c067330 0x7f376c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.143+0000 7f37827fc700 1 -- 172.21.15.142:0/1532951650 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f377c086340 con 0x7f3778003a90 2023-09-30T22:58:47.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.144+0000 7f3783fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f376c067330 0x7f376c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.144+0000 7f3783fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f376c067330 0x7f376c0697e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f378c0aeb60 tx=0x7f3774009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.145+0000 7f379f7bcb80 1 Processor -- start 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.146+0000 7f379f7bcb80 1 -- start start 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.146+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b1092e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.146+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b108f920 0x55d8b1062d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.146+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1092910 0x55d8b1093640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.146+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b0f80310 con 0x55d8b108f920 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.146+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b0fbd130 con 0x55d8b1092910 2023-09-30T22:58:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.146+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b0fbaaf0 con 0x55d8b1062930 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b108f920 0x55d8b1062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b108f920 0x55d8b1062d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49410/0 (socket says 172.21.15.142:49410) 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 -- 172.21.15.142:0/4201645597 learned_addr learned my addr 172.21.15.142:0/4201645597 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f378a59c700 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b1092e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f378ad9d700 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1092910 0x55d8b1093640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 -- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 msgr2=0x55d8b1092e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b1092e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 -- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1092910 msgr2=0x55d8b1093640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1092910 0x55d8b1093640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 -- 172.21.15.142:0/4201645597 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8b0dbc790 con 0x55d8b108f920 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f378ad9d700 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1092910 0x55d8b1093640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.147+0000 7f3783fff700 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b108f920 0x55d8b1062d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f37740117f0 tx=0x7f3774017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36e3b1f4620fad9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f376b7fe700 1 -- 172.21.15.142:0/4201645597 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774015640 con 0x55d8b108f920 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f376b7fe700 1 -- 172.21.15.142:0/4201645597 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37740157a0 con 0x55d8b108f920 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f376b7fe700 1 -- 172.21.15.142:0/4201645597 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774015b20 con 0x55d8b108f920 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 -- 172.21.15.142:0/4201645597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b108f920 msgr2=0x55d8b1062d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b108f920 0x55d8b1062d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f37740117f0 tx=0x7f3774017000 comp rx=0 tx=0).stop 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 -- 172.21.15.142:0/4201645597 shutdown_connections 2023-09-30T22:58:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1092910 0x55d8b1093640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b1092e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/4201645597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b108f920 0x55d8b1062d00 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 -- 172.21.15.142:0/4201645597 >> 172.21.15.142:0/4201645597 conn(0x55d8b10b0880 msgr2=0x55d8b10b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 -- 172.21.15.142:0/4201645597 shutdown_connections 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.148+0000 7f379f7bcb80 1 -- 172.21.15.142:0/4201645597 wait complete. 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.149+0000 7f379f7bcb80 1 -- start start 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.149+0000 7f379f7bcb80 1 Processor -- start 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.150+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b108a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.150+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1092910 0x55d8b1068430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.150+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b1068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b0fb68e0 con 0x55d8b1092910 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b0f62980 con 0x55d8b1095dc0 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b0f62620 con 0x55d8b1062930 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f379f7bcb80 10 client.0 _ll_register_callbacks cb 0x55d8b0dc5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1092910 0x55d8b1068430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1092910 0x55d8b1068430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49426/0 (socket says 172.21.15.142:49426) 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 -- 172.21.15.142:0/2154492756 learned_addr learned my addr 172.21.15.142:0/2154492756 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f378a59c700 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b108a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f378ad9d700 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b1068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 -- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 msgr2=0x55d8b108a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b108a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 -- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 msgr2=0x55d8b1068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b1068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 -- 172.21.15.142:0/2154492756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377400f040 con 0x55d8b1092910 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3783fff700 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1092910 0x55d8b1068430 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3774022000 tx=0x7f3774021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389927853b7f7a72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.151+0000 7f3768ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f3768ff9700 1 -- 172.21.15.142:0/2154492756 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774015640 con 0x55d8b1092910 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f3768ff9700 1 -- 172.21.15.142:0/2154492756 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f377401a030 con 0x55d8b1092910 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8b105ad60 con 0x55d8b1092910 2023-09-30T22:58:47.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f3768ff9700 1 -- 172.21.15.142:0/2154492756 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3774035e60 con 0x55d8b1092910 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 10 client.6999 fetch_fsmap learned FSMap version 58 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d8b0ea90a0 con 0x55d8b1092910 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f3768ff9700 1 -- 172.21.15.142:0/2154492756 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8b105ad60 con 0x55d8b1092910 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f3768ff9700 1 -- 172.21.15.142:0/2154492756 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3774021a60 con 0x55d8b1092910 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 10 client.6999 fetch_fsmap finished waiting for FSMap version 58 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 10 client.6999 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 20 client.6999 populate_metadata read hostname 'smithi142' 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b10c1110 0x55d8b1065e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 4 client.6999 mds_command: new command op to 6484 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:58:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.152+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 --> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8b1037b30 con 0x55d8b10c1110 2023-09-30T22:58:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.153+0000 7f378a59c700 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b10c1110 0x55d8b1065e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.154+0000 7f378a59c700 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b10c1110 0x55d8b1065e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b99f4994aab54faa server_cookie=ec76bb591c34776a in_seq=0 out_seq=0 2023-09-30T22:58:47.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.154+0000 7f3768ff9700 10 client.6999 ms_handle_connect on v2:172.21.15.148:6832/302118526 2023-09-30T22:58:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.154+0000 7f3768ff9700 1 -- 172.21.15.142:0/2154492756 <== mds.0 v2:172.21.15.148:6832/302118526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x55d8b1037b30 con 0x55d8b10c1110 2023-09-30T22:58:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.154+0000 7f3768ff9700 10 client.6999 handle_command_reply: tid=0 2023-09-30T22:58:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.154+0000 7f379f7bcb80 1 client.6999 shutdown 2023-09-30T22:58:47.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1092910 msgr2=0x55d8b1068430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1092910 0x55d8b1068430 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3774022000 tx=0x7f3774021000 comp rx=0 tx=0).stop 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 shutdown_connections 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b1068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b10c1110 0x55d8b1065e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1062930 0x55d8b108a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/2154492756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1092910 0x55d8b1068430 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 >> 172.21.15.142:0/2154492756 conn(0x55d8b10b0880 msgr2=0x55d8b10b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f3768ff9700 0 client.6999 ms_handle_reset on v2:172.21.15.148:6832/302118526 2023-09-30T22:58:47.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 shutdown_connections 2023-09-30T22:58:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 1 -- 172.21.15.142:0/2154492756 wait complete. 2023-09-30T22:58:47.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.155+0000 7f379f7bcb80 20 client.6999 trim_cache size 0 max 16384 2023-09-30T22:58:47.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.172+0000 7f379f7bcb80 1 Processor -- start 2023-09-30T22:58:47.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.172+0000 7f379f7bcb80 1 -- start start 2023-09-30T22:58:47.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b105d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b10685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b1068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b0e4e1e0 con 0x55d8b1062930 2023-09-30T22:58:47.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b108ed00 con 0x55d8b1095dc0 2023-09-30T22:58:47.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b1064e00 con 0x55d8b1092910 2023-09-30T22:58:47.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f378a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b105d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f378a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b105d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49432/0 (socket says 172.21.15.142:49432) 2023-09-30T22:58:47.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f378a59c700 1 -- 172.21.15.142:0/3286966775 learned_addr learned my addr 172.21.15.142:0/3286966775 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:47.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f378a59c700 1 -- 172.21.15.142:0/3286966775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 msgr2=0x55d8b10685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.173+0000 7f378a59c700 1 --2- 172.21.15.142:0/3286966775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b10685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f378a59c700 1 -- 172.21.15.142:0/3286966775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 msgr2=0x55d8b1068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f378a59c700 1 --2- 172.21.15.142:0/3286966775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b1068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f378a59c700 1 -- 172.21.15.142:0/3286966775 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8b0f853c0 con 0x55d8b1062930 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f378a59c700 1 --2- 172.21.15.142:0/3286966775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b105d000 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f377c01c660 tx=0x7f377c059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8191b72905c9fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f376bfff700 1 -- 172.21.15.142:0/3286966775 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c05a0b0 con 0x55d8b1062930 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f376bfff700 1 -- 172.21.15.142:0/3286966775 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c05de00 con 0x55d8b1062930 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f376bfff700 1 -- 172.21.15.142:0/3286966775 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c054fa0 con 0x55d8b1062930 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3286966775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 msgr2=0x55d8b105d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.174+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3286966775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b105d000 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f377c01c660 tx=0x7f377c059040 comp rx=0 tx=0).stop 2023-09-30T22:58:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3286966775 shutdown_connections 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3286966775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b1068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3286966775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b105d000 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3286966775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b10685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3286966775 >> 172.21.15.142:0/3286966775 conn(0x55d8b10b0880 msgr2=0x55d8b10b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3286966775 shutdown_connections 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3286966775 wait complete. 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 -- start start 2023-09-30T22:58:47.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.175+0000 7f379f7bcb80 1 Processor -- start 2023-09-30T22:58:47.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.176+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b1062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.176+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b1116f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.176+0000 7f379f7bcb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b105ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b10ad4e0 con 0x55d8b1062930 2023-09-30T22:58:47.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b1119d70 con 0x55d8b1095dc0 2023-09-30T22:58:47.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f379f7bcb80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b10633d0 con 0x55d8b1092910 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f379f7bcb80 10 client.0 _ll_register_callbacks cb 0x55d8b0dc5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b1062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b1062e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49436/0 (socket says 172.21.15.142:49436) 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 -- 172.21.15.142:0/3824706064 learned_addr learned my addr 172.21.15.142:0/3824706064 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f3783fff700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b1116f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 -- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 msgr2=0x55d8b1116f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378ad9d700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b105ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b1116f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 -- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 msgr2=0x55d8b105ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b105ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 -- 172.21.15.142:0/3824706064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c057e70 con 0x55d8b1062930 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f3783fff700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b1116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378ad9d700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b105ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f378a59c700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b1062e90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f377c057710 tx=0x7f377c028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98bb39c5f4e7060 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f3768ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f3768ff9700 1 -- 172.21.15.142:0/3824706064 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c054fa0 con 0x55d8b1062930 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f3768ff9700 1 -- 172.21.15.142:0/3824706064 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f377c0860b0 con 0x55d8b1062930 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.177+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37740157a0 con 0x55d8b1062930 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f3768ff9700 1 -- 172.21.15.142:0/3824706064 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f377c084770 con 0x55d8b1062930 2023-09-30T22:58:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 10 client.7005 fetch_fsmap learned FSMap version 58 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d8b0e1d1d0 con 0x55d8b1062930 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f3768ff9700 1 -- 172.21.15.142:0/3824706064 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37740157a0 con 0x55d8b1062930 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f3768ff9700 1 -- 172.21.15.142:0/3824706064 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f377c0570c0 con 0x55d8b1062930 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 10 client.7005 fetch_fsmap finished waiting for FSMap version 58 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 10 client.7005 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 20 client.7005 populate_metadata read hostname 'smithi142' 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b105d1e0 0x55d8b1066060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 4 client.7005 mds_command: new command op to 6484 tid=0[{"prefix": "status"}] 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.178+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 --> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8b0f598d0 con 0x55d8b105d1e0 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.179+0000 7f3783fff700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b105d1e0 0x55d8b1066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.179+0000 7f3768ff9700 10 client.7005 ms_handle_connect on v2:172.21.15.148:6832/302118526 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.179+0000 7f3783fff700 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b105d1e0 0x55d8b1066060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64701778646adff4 server_cookie=c9c22eacb00722ce in_seq=0 out_seq=0 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f3768ff9700 1 -- 172.21.15.142:0/3824706064 <== mds.0 v2:172.21.15.148:6832/302118526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d8b0f598d0 con 0x55d8b105d1e0 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f3768ff9700 10 client.7005 handle_command_reply: tid=0 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 client.7005 shutdown 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 msgr2=0x55d8b1062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b1062e90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f377c057710 tx=0x7f377c028000 comp rx=0 tx=0).stop 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 shutdown_connections 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8b1095dc0 0x55d8b105ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8b1062930 0x55d8b1062e90 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:6832/302118526,v1:172.21.15.148:6834/302118526] conn(0x55d8b105d1e0 0x55d8b1066060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 --2- 172.21.15.142:0/3824706064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55d8b1092910 0x55d8b1116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f3768ff9700 0 client.7005 ms_handle_reset on v2:172.21.15.148:6832/302118526 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 >> 172.21.15.142:0/3824706064 conn(0x55d8b10b0880 msgr2=0x55d8b10b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 shutdown_connections 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 1 -- 172.21.15.142:0/3824706064 wait complete. 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.180+0000 7f379f7bcb80 20 client.7005 trim_cache size 0 max 16384 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:58:47.187 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 6484, 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 6.4791421140000001, 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 58, 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 130, 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 130, 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 13.216478729 2023-09-30T22:58:47.188 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:58:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f376c067330 msgr2=0x7f376c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f376c067330 0x7f376c0697e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f378c0aeb60 tx=0x7f3774009040 comp rx=0 tx=0).stop 2023-09-30T22:58:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 msgr2=0x7f378c155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f378c155370 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f377800bb30 tx=0x7f377c01a000 comp rx=0 tx=0).stop 2023-09-30T22:58:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 shutdown_connections 2023-09-30T22:58:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f376c067330 0x7f376c0697e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f378c156b50 0x7f378c0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3778003a90 0x7f378c155370 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 --2- 172.21.15.142:0/1532951650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f378c1668e0 0x7f378c166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 >> 172.21.15.142:0/1532951650 conn(0x7f378c0680c0 msgr2=0x7f378c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 shutdown_connections 2023-09-30T22:58:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.181+0000 7f3790fff700 1 -- 172.21.15.142:0/1532951650 wait complete. 2023-09-30T22:58:47.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:58:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.386+0000 7f37b4fff700 1 Processor -- start 2023-09-30T22:58:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.386+0000 7f37b4fff700 1 -- start start 2023-09-30T22:58:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.387+0000 7f37b4fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37b0157a90 0x7f37b015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.387+0000 7f37b4fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37b006b3d0 0x7f37b00b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.387+0000 7f37b4fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b0069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.387+0000 7f37b4fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b00b23c0 con 0x7f37b0157a90 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.387+0000 7f37b4fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b006d470 con 0x7f37b006b3d0 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.387+0000 7f37b4fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0157e60 con 0x7f37b00b1f40 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37b0157a90 0x7f37b015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37b0157a90 0x7f37b015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49450/0 (socket says 172.21.15.142:49450) 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 -- 172.21.15.142:0/2115401731 learned_addr learned my addr 172.21.15.142:0/2115401731 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37add9b700 1 --2- 172.21.15.142:0/2115401731 >> v2:172.21.15.148:3300/0 conn(0x7f37b006b3d0 0x7f37b00b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37aed9d700 1 --2- 172.21.15.142:0/2115401731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b0069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 -- 172.21.15.142:0/2115401731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 msgr2=0x7f37b0069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 --2- 172.21.15.142:0/2115401731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b0069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 -- 172.21.15.142:0/2115401731 >> v2:172.21.15.148:3300/0 conn(0x7f37b006b3d0 msgr2=0x7f37b00b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 --2- 172.21.15.142:0/2115401731 >> v2:172.21.15.148:3300/0 conn(0x7f37b006b3d0 0x7f37b00b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.388+0000 7f37ae59c700 1 -- 172.21.15.142:0/2115401731 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b015c430 con 0x7f37b0157a90 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37ae59c700 1 --2- 172.21.15.142:0/2115401731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b0157a90 0x7f37b015bef0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f37b006bac0 tx=0x7f37a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f95dbad70e8dd4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37ad59a700 1 -- 172.21.15.142:0/2115401731 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a000b640 con 0x7f37b0157a90 2023-09-30T22:58:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37ad59a700 1 -- 172.21.15.142:0/2115401731 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a000b7a0 con 0x7f37b0157a90 2023-09-30T22:58:47.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37ad59a700 1 -- 172.21.15.142:0/2115401731 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a000bb60 con 0x7f37b0157a90 2023-09-30T22:58:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37b4fff700 1 -- 172.21.15.142:0/2115401731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b0157a90 msgr2=0x7f37b015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37b4fff700 1 --2- 172.21.15.142:0/2115401731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b0157a90 0x7f37b015bef0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f37b006bac0 tx=0x7f37a0009250 comp rx=0 tx=0).stop 2023-09-30T22:58:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37b4fff700 1 -- 172.21.15.142:0/2115401731 shutdown_connections 2023-09-30T22:58:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37b4fff700 1 --2- 172.21.15.142:0/2115401731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b0069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37b4fff700 1 --2- 172.21.15.142:0/2115401731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b0157a90 0x7f37b015bef0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37b4fff700 1 --2- 172.21.15.142:0/2115401731 >> v2:172.21.15.148:3300/0 conn(0x7f37b006b3d0 0x7f37b00b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.389+0000 7f37b4fff700 1 -- 172.21.15.142:0/2115401731 >> 172.21.15.142:0/2115401731 conn(0x7f37b00680c0 msgr2=0x7f37b00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.390+0000 7f37b4fff700 1 -- 172.21.15.142:0/2115401731 shutdown_connections 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.390+0000 7f37b4fff700 1 -- 172.21.15.142:0/2115401731 wait complete. 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.391+0000 7f37b4fff700 1 Processor -- start 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.391+0000 7f37b4fff700 1 -- start start 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37b4fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b006b3d0 0x7f37b00af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37b4fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37b4fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37b0157a90 0x7f37b014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37b4fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b015b300 con 0x7f37b006b3d0 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37b4fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00b0720 con 0x7f37b0157a90 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37b4fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b014b280 con 0x7f37b00b1f40 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b006b3d0 0x7f37b00af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b006b3d0 0x7f37b00af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49452/0 (socket says 172.21.15.142:49452) 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37ae59c700 1 -- 172.21.15.142:0/3829069448 learned_addr learned my addr 172.21.15.142:0/3829069448 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37add9b700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.392+0000 7f37aed9d700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37b0157a90 0x7f37b014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37ae59c700 1 -- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 msgr2=0x7f37b015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37ae59c700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37ae59c700 1 -- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37b0157a90 msgr2=0x7f37b014ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37ae59c700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37b0157a90 0x7f37b014ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37ae59c700 1 -- 172.21.15.142:0/3829069448 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00094f0 con 0x7f37b006b3d0 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37ae59c700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b006b3d0 0x7f37b00af7f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f37b0068600 tx=0x7f37a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f379e7fc700 1 -- 172.21.15.142:0/3829069448 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0000d10 con 0x7f37b006b3d0 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f379e7fc700 1 -- 172.21.15.142:0/3829069448 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a000bb20 con 0x7f37b006b3d0 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b00afe80 con 0x7f37b006b3d0 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f379e7fc700 1 -- 172.21.15.142:0/3829069448 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0011670 con 0x7f37b006b3d0 2023-09-30T22:58:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.393+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b00b0440 con 0x7f37b006b3d0 2023-09-30T22:58:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.394+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b00695b0 con 0x7f37b006b3d0 2023-09-30T22:58:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.395+0000 7f379e7fc700 1 -- 172.21.15.142:0/3829069448 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f37a00119e0 con 0x7f37b006b3d0 2023-09-30T22:58:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.396+0000 7f379e7fc700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3790067330 0x7f37900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.396+0000 7f379e7fc700 1 -- 172.21.15.142:0/3829069448 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f37a0086400 con 0x7f37b006b3d0 2023-09-30T22:58:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.396+0000 7f37add9b700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3790067330 0x7f37900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.397+0000 7f37add9b700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3790067330 0x7f37900697e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f37b00b0e00 tx=0x7f37a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.400+0000 7f379e7fc700 1 -- 172.21.15.142:0/3829069448 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f37a0053260 con 0x7f37b006b3d0 2023-09-30T22:58:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.632+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37b006fc10 con 0x7f37b006b3d0 2023-09-30T22:58:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.633+0000 7f379e7fc700 1 -- 172.21.15.142:0/3829069448 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37a0056880 con 0x7f37b006b3d0 2023-09-30T22:58:47.634 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:58:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3790067330 msgr2=0x7f37900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3790067330 0x7f37900697e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f37b00b0e00 tx=0x7f37a4008040 comp rx=0 tx=0).stop 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b006b3d0 msgr2=0x7f37b00af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b006b3d0 0x7f37b00af7f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f37b0068600 tx=0x7f37a0017000 comp rx=0 tx=0).stop 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 shutdown_connections 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3790067330 0x7f37900697e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37b0157a90 0x7f37b014ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b006b3d0 0x7f37b00af7f0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 --2- 172.21.15.142:0/3829069448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37b00b1f40 0x7f37b015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 >> 172.21.15.142:0/3829069448 conn(0x7f37b00680c0 msgr2=0x7f37b00cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 shutdown_connections 2023-09-30T22:58:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:47.635+0000 7f37b4fff700 1 -- 172.21.15.142:0/3829069448 wait complete. 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:58:47.654 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:58:47.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:47.655 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:58:47.702 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:58:47.702 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:58:47.702 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:47.703 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41930sec preferred_lft 41930sec 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:47.704 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:58:47.705 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:58:47.705 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T22:58:47.705 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:47.705 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:58:47.705 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:58:47.705 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T22:58:47.705 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:47.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:47.706 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:58:47.773 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:58:47.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:47.776 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:58:47.824 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:58:47.824 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:58:47.824 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:58:47.824 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:58:47.824 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:58:47.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:47.825 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:58:47.826 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:58:47.826 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:58:47.826 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:58:47.826 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:58:47.826 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:58:47.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:47.995 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:58:48.040 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T22:58:48.041 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:58:48.041 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:58:48.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:48.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:58:48.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:58:48.112 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:58:48.157 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:58:48.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:58:48.157 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:58:48.243 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:58:48.243 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:58:48.243 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:58:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:58:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:58:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:58:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:58:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:58:48.397 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:58:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:58:48.398 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:58:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:58:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:58:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:58:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:58:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:58:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:58:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:58:48.420 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:58:48.424 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:58:48.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:48.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:58:48.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:58:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.682+0000 7f08b4fff700 1 Processor -- start 2023-09-30T22:58:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.682+0000 7f08b4fff700 1 -- start start 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08b4fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08b0143350 0x7f08b00cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08b4fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b015de20 0x7f08b006a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08b4fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b00cc6b0 con 0x7f08b00692f0 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08b4fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b00cb7d0 con 0x7f08b0143350 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08b4fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00cbaa0 con 0x7f08b015de20 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08ae59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08b0143350 0x7f08b00cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08a7fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f08b00692f0 0x7f08b015d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58230/0 (socket says 172.21.15.142:58230) 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08a7fff700 1 -- 172.21.15.142:0/594886628 learned_addr learned my addr 172.21.15.142:0/594886628 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08aed9d700 1 --2- 172.21.15.142:0/594886628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b015de20 0x7f08b006a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08ae59c700 1 -- 172.21.15.142:0/594886628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b015de20 msgr2=0x7f08b006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08ae59c700 1 --2- 172.21.15.142:0/594886628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b015de20 0x7f08b006a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08ae59c700 1 -- 172.21.15.142:0/594886628 >> v1:172.21.15.142:6789/0 conn(0x7f08b00692f0 legacy=0x7f08b015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.684+0000 7f08add9b700 1 -- 172.21.15.142:0/594886628 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746418003 0 0) 0x7f08b00cc6b0 con 0x7f08b00692f0 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.685+0000 7f08ae59c700 1 -- 172.21.15.142:0/594886628 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00cbd80 con 0x7f08b0143350 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.685+0000 7f08ae59c700 1 --2- 172.21.15.142:0/594886628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b0143350 0x7f08b00cb290 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f08a00098e0 tx=0x7f08a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2be066ec83c2228 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.685+0000 7f08add9b700 1 -- 172.21.15.142:0/594886628 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0009e80 con 0x7f08b0143350 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.685+0000 7f08add9b700 1 -- 172.21.15.142:0/594886628 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a000b860 con 0x7f08b0143350 2023-09-30T22:58:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.685+0000 7f08add9b700 1 -- 172.21.15.142:0/594886628 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000bbe0 con 0x7f08b0143350 2023-09-30T22:58:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.685+0000 7f08b4fff700 1 -- 172.21.15.142:0/594886628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b0143350 msgr2=0x7f08b00cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.685+0000 7f08b4fff700 1 --2- 172.21.15.142:0/594886628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b0143350 0x7f08b00cb290 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f08a00098e0 tx=0x7f08a00091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.686+0000 7f08b4fff700 1 -- 172.21.15.142:0/594886628 shutdown_connections 2023-09-30T22:58:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.686+0000 7f08b4fff700 1 --2- 172.21.15.142:0/594886628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b0143350 0x7f08b00cb290 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.686+0000 7f08b4fff700 1 --2- 172.21.15.142:0/594886628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b015de20 0x7f08b006a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.686+0000 7f08b4fff700 1 -- 172.21.15.142:0/594886628 >> 172.21.15.142:0/594886628 conn(0x7f08b00ce8e0 msgr2=0x7f08b00cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.686+0000 7f08b4fff700 1 -- 172.21.15.142:0/594886628 shutdown_connections 2023-09-30T22:58:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.686+0000 7f08b4fff700 1 -- 172.21.15.142:0/594886628 wait complete. 2023-09-30T22:58:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.687+0000 7f08b4fff700 1 Processor -- start 2023-09-30T22:58:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.687+0000 7f08b4fff700 1 -- start start 2023-09-30T22:58:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.688+0000 7f08b4fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b00692f0 0x7f08b00a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.688+0000 7f08b4fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b0143350 0x7f08b016cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.688+0000 7f08b4fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b015de20 0x7f08b00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.688+0000 7f08b4fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b016d2a0 con 0x7f08b015de20 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.688+0000 7f08b4fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b016b080 con 0x7f08b00692f0 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.688+0000 7f08b4fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00a7240 con 0x7f08b0143350 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b015de20 0x7f08b00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b015de20 0x7f08b00b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49466/0 (socket says 172.21.15.142:49466) 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 -- 172.21.15.142:0/1520947208 learned_addr learned my addr 172.21.15.142:0/1520947208 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08ae59c700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b00692f0 0x7f08b00a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08a7fff700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b0143350 0x7f08b016cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 -- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b0143350 msgr2=0x7f08b016cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b0143350 0x7f08b016cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 -- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b00692f0 msgr2=0x7f08b00a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b00692f0 0x7f08b00a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 -- 172.21.15.142:0/1520947208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0009420 con 0x7f08b015de20 2023-09-30T22:58:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.689+0000 7f08aed9d700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b015de20 0x7f08b00b3830 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007ef0 tx=0x7f08a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.690+0000 7f08a67fc700 1 -- 172.21.15.142:0/1520947208 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a800eb30 con 0x7f08b015de20 2023-09-30T22:58:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.690+0000 7f08a67fc700 1 -- 172.21.15.142:0/1520947208 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800ec90 con 0x7f08b015de20 2023-09-30T22:58:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.690+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b016a470 con 0x7f08b015de20 2023-09-30T22:58:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.690+0000 7f08a67fc700 1 -- 172.21.15.142:0/1520947208 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8014670 con 0x7f08b015de20 2023-09-30T22:58:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.690+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b016aa30 con 0x7f08b015de20 2023-09-30T22:58:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.691+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b006ea70 con 0x7f08b015de20 2023-09-30T22:58:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.691+0000 7f08a67fc700 1 -- 172.21.15.142:0/1520947208 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f08a8014a60 con 0x7f08b015de20 2023-09-30T22:58:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.693+0000 7f08a67fc700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0890067330 0x7f08900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.693+0000 7f08a67fc700 1 -- 172.21.15.142:0/1520947208 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f08a8085220 con 0x7f08b015de20 2023-09-30T22:58:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.693+0000 7f08ae59c700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0890067330 0x7f08900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.694+0000 7f08ae59c700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0890067330 0x7f08900697e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f08a00091e0 tx=0x7f08a0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.698+0000 7f08a67fc700 1 -- 172.21.15.142:0/1520947208 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f08a8052080 con 0x7f08b015de20 2023-09-30T22:58:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.930+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08b00cc060 con 0x7f08b015de20 2023-09-30T22:58:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.931+0000 7f08a67fc700 1 -- 172.21.15.142:0/1520947208 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08a8009980 con 0x7f08b015de20 2023-09-30T22:58:48.932 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:58:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0890067330 msgr2=0x7f08900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0890067330 0x7f08900697e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f08a00091e0 tx=0x7f08a0017000 comp rx=0 tx=0).stop 2023-09-30T22:58:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b015de20 msgr2=0x7f08b00b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:48.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b015de20 0x7f08b00b3830 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007ef0 tx=0x7f08a8009840 comp rx=0 tx=0).stop 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 shutdown_connections 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0890067330 0x7f08900697e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b015de20 0x7f08b00b3830 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b00692f0 0x7f08b00a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 --2- 172.21.15.142:0/1520947208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08b0143350 0x7f08b016cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 >> 172.21.15.142:0/1520947208 conn(0x7f08b00ce8e0 msgr2=0x7f08b00cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.933+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 shutdown_connections 2023-09-30T22:58:48.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:48.934+0000 7f08b4fff700 1 -- 172.21.15.142:0/1520947208 wait complete. 2023-09-30T22:58:48.952 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:58:48.952 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:58:48.952 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:58:48.952 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:58:48.952 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:48.952 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:58:48.952 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:58:48.953 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:58:48.953 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:58:48.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:48.953 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:49.006 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41960sec preferred_lft 41960sec 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:49.007 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:58:49.008 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T22:58:49.009 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:58:49.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:49.009 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:58:49.081 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:58:49.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:49.084 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:58:49.133 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:58:49.133 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:58:49.133 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:58:49.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:58:49.134 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:58:49.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:49.135 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:58:49.135 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:58:49.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:58:49.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:58:49.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:58:49.135 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:58:49.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:49.304 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:58:49.350 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T22:58:49.350 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:58:49.351 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:58:49.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:49.352 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:58:49.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:58:49.422 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:49.467 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:58:49.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:58:49.467 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:49.552 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:58:49.552 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:58:49.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:49.651 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:49.652 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:58:49.652 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:58:49.666 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:49.666 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:58:49.666 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:58:49.666 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:58:49.666 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:58:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:58:49.691 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:58:49.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:49.692 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:49.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.960+0000 7fa8819ff700 1 Processor -- start 2023-09-30T22:58:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.961+0000 7fa8819ff700 1 -- start start 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa8819ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa87c1598e0 0x7fa87c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa8819ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa87c0d03d0 0x7fa87c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa8819ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c06b8d0 con 0x7fa87c0cee50 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa8819ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0cff40 con 0x7fa87c0d03d0 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa8819ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0cf330 con 0x7fa87c1598e0 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa87c0d03d0 0x7fa87c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa87c0d03d0 0x7fa87c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49476/0 (socket says 172.21.15.142:49476) 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87b7fe700 1 -- 172.21.15.142:0/1607305666 learned_addr learned my addr 172.21.15.142:0/1607305666 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87a7fc700 1 --1- 172.21.15.142:0/1607305666 >> v1:172.21.15.142:6789/0 conn(0x7fa87c0cee50 0x7fa87c06b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58246/0 (socket says 172.21.15.142:58246) 2023-09-30T22:58:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87affd700 1 --2- 172.21.15.142:0/1607305666 >> v2:172.21.15.148:3300/0 conn(0x7fa87c1598e0 0x7fa87c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87b7fe700 1 -- 172.21.15.142:0/1607305666 >> v2:172.21.15.148:3300/0 conn(0x7fa87c1598e0 msgr2=0x7fa87c159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87b7fe700 1 --2- 172.21.15.142:0/1607305666 >> v2:172.21.15.148:3300/0 conn(0x7fa87c1598e0 0x7fa87c159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.962+0000 7fa87b7fe700 1 -- 172.21.15.142:0/1607305666 >> v1:172.21.15.142:6789/0 conn(0x7fa87c0cee50 legacy=0x7fa87c06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa87b7fe700 1 -- 172.21.15.142:0/1607305666 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0cf610 con 0x7fa87c0d03d0 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa879ffb700 1 -- 172.21.15.142:0/1607305666 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086369547 0 0) 0x7fa87c06b8d0 con 0x7fa87c0cee50 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa87affd700 1 --2- 172.21.15.142:0/1607305666 >> v2:172.21.15.148:3300/0 conn(0x7fa87c1598e0 0x7fa87c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa87b7fe700 1 --2- 172.21.15.142:0/1607305666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c15d7d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0ce070 tx=0x7fa874009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda4867b0262a045 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa879ffb700 1 -- 172.21.15.142:0/1607305666 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400e070 con 0x7fa87c0d03d0 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa879ffb700 1 -- 172.21.15.142:0/1607305666 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400ba50 con 0x7fa87c0d03d0 2023-09-30T22:58:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa879ffb700 1 -- 172.21.15.142:0/1607305666 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740092e0 con 0x7fa87c0d03d0 2023-09-30T22:58:49.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa8819ff700 1 -- 172.21.15.142:0/1607305666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 msgr2=0x7fa87c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:49.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.963+0000 7fa8819ff700 1 --2- 172.21.15.142:0/1607305666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c15d7d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0ce070 tx=0x7fa874009840 comp rx=0 tx=0).stop 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.964+0000 7fa8819ff700 1 -- 172.21.15.142:0/1607305666 shutdown_connections 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.964+0000 7fa8819ff700 1 --2- 172.21.15.142:0/1607305666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c15d7d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.964+0000 7fa8819ff700 1 --2- 172.21.15.142:0/1607305666 >> v2:172.21.15.148:3300/0 conn(0x7fa87c1598e0 0x7fa87c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.964+0000 7fa8819ff700 1 -- 172.21.15.142:0/1607305666 >> 172.21.15.142:0/1607305666 conn(0x7fa87c0cd540 msgr2=0x7fa87c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.964+0000 7fa8819ff700 1 -- 172.21.15.142:0/1607305666 shutdown_connections 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.964+0000 7fa8819ff700 1 -- 172.21.15.142:0/1607305666 wait complete. 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.965+0000 7fa8819ff700 1 Processor -- start 2023-09-30T22:58:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.965+0000 7fa8819ff700 1 -- start start 2023-09-30T22:58:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.966+0000 7fa8819ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cee50 0x7fa87c16a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.966+0000 7fa8819ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.966+0000 7fa8819ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c1598e0 0x7fa87c148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.966+0000 7fa8819ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0c5d40 con 0x7fa87c0d03d0 2023-09-30T22:58:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.966+0000 7fa8819ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c16a8e0 con 0x7fa87c0cee50 2023-09-30T22:58:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.966+0000 7fa8819ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c16abc0 con 0x7fa87c1598e0 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.966+0000 7fa87a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49490/0 (socket says 172.21.15.142:49490) 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 -- 172.21.15.142:0/2389337167 learned_addr learned my addr 172.21.15.142:0/2389337167 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87affd700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cee50 0x7fa87c16a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87b7fe700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c1598e0 0x7fa87c148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 -- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c1598e0 msgr2=0x7fa87c148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c1598e0 0x7fa87c148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 -- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cee50 msgr2=0x7fa87c16a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cee50 0x7fa87c16a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 -- 172.21.15.142:0/2389337167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009ae0 con 0x7fa87c0d03d0 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa87a7fc700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c0b5220 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fa8700011e0 tx=0x7fa870007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.967+0000 7fa862ffd700 1 -- 172.21.15.142:0/2389337167 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870005a70 con 0x7fa87c0d03d0 2023-09-30T22:58:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.968+0000 7fa862ffd700 1 -- 172.21.15.142:0/2389337167 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870005bd0 con 0x7fa87c0d03d0 2023-09-30T22:58:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.968+0000 7fa862ffd700 1 -- 172.21.15.142:0/2389337167 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700070d0 con 0x7fa87c0d03d0 2023-09-30T22:58:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.968+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c16aea0 con 0x7fa87c0d03d0 2023-09-30T22:58:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.968+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c16a5a0 con 0x7fa87c0d03d0 2023-09-30T22:58:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.969+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c0c61d0 con 0x7fa87c0d03d0 2023-09-30T22:58:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.970+0000 7fa862ffd700 1 -- 172.21.15.142:0/2389337167 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa870007480 con 0x7fa87c0d03d0 2023-09-30T22:58:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.971+0000 7fa862ffd700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa868067330 0x7fa8680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.971+0000 7fa862ffd700 1 -- 172.21.15.142:0/2389337167 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa870084100 con 0x7fa87c0d03d0 2023-09-30T22:58:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.971+0000 7fa87affd700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa868067330 0x7fa8680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.972+0000 7fa87affd700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa868067330 0x7fa8680697e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006f00 tx=0x7fa86c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:49.976+0000 7fa862ffd700 1 -- 172.21.15.142:0/2389337167 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa87c0c61d0 con 0x7fa87c0d03d0 2023-09-30T22:58:50.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.207+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa87c0c61d0 con 0x7fa87c0d03d0 2023-09-30T22:58:50.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.207+0000 7fa862ffd700 1 -- 172.21.15.142:0/2389337167 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fa87c0c61d0 con 0x7fa87c0d03d0 2023-09-30T22:58:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:50.208 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:58:50.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa868067330 msgr2=0x7fa8680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:50.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa868067330 0x7fa8680697e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006f00 tx=0x7fa86c008040 comp rx=0 tx=0).stop 2023-09-30T22:58:50.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 msgr2=0x7fa87c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:50.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c0b5220 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fa8700011e0 tx=0x7fa870007e10 comp rx=0 tx=0).stop 2023-09-30T22:58:50.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 shutdown_connections 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa868067330 0x7fa8680697e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa87c1598e0 0x7fa87c148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa87c0cee50 0x7fa87c16a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 --2- 172.21.15.142:0/2389337167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa87c0d03d0 0x7fa87c0b5220 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 >> 172.21.15.142:0/2389337167 conn(0x7fa87c0cd540 msgr2=0x7fa87c06e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 shutdown_connections 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.210+0000 7fa8819ff700 1 -- 172.21.15.142:0/2389337167 wait complete. 2023-09-30T22:58:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:58:50.228 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-09-30T22:58:50.444 INFO:teuthology.orchestra.run.smithi148.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6484,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.7285104320000002,"mdsmap_epoch":58,"osdmap_epoch":130,"osdmap_epoch_barrier":130,"uptime":16.465848337000001} 2023-09-30T22:58:50.444 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6484, "mdsmap_epoch": 58, "osdmap_epoch": 130, "osdmap_epoch_barrier": 130, "rank_uptime": 9.728510432, "state": "up:active", "uptime": 16.465848337, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:58:50.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-30T22:58:50.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.640+0000 7f15cffff700 1 Processor -- start 2023-09-30T22:58:50.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.640+0000 7f15cffff700 1 -- start start 2023-09-30T22:58:50.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.641+0000 7f15cffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15c815ac40 0x7f15c815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:50.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.641+0000 7f15cffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15c80cf180 0x7f15c80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:50.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.641+0000 7f15cffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80d04e0 con 0x7f15c80cc0b0 2023-09-30T22:58:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.641+0000 7f15cffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c80cc4d0 con 0x7f15c80cf180 2023-09-30T22:58:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.641+0000 7f15cffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c80cc8f0 con 0x7f15c815ac40 2023-09-30T22:58:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.641+0000 7f15cd59a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15c80cf180 0x7f15c80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cd59a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15c80cf180 0x7f15c80cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49492/0 (socket says 172.21.15.142:49492) 2023-09-30T22:58:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cd59a700 1 -- 172.21.15.142:0/1895318976 learned_addr learned my addr 172.21.15.142:0/1895318976 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cdd9b700 1 --2- 172.21.15.142:0/1895318976 >> v2:172.21.15.148:3300/0 conn(0x7f15c815ac40 0x7f15c815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cd59a700 1 -- 172.21.15.142:0/1895318976 >> v2:172.21.15.148:3300/0 conn(0x7f15c815ac40 msgr2=0x7f15c815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cd59a700 1 --2- 172.21.15.142:0/1895318976 >> v2:172.21.15.148:3300/0 conn(0x7f15c815ac40 0x7f15c815a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cd59a700 1 -- 172.21.15.142:0/1895318976 >> v1:172.21.15.142:6789/0 conn(0x7f15c80cc0b0 legacy=0x7f15c815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cd59a700 1 -- 172.21.15.142:0/1895318976 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c80cf8d0 con 0x7f15c80cf180 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15ccd99700 1 -- 172.21.15.142:0/1895318976 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035841992 0 0) 0x7f15c80d04e0 con 0x7f15c80cc0b0 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15cd59a700 1 --2- 172.21.15.142:0/1895318976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c80cbb70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f15c80d1b30 tx=0x7f15b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5a6d71ec285d1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.642+0000 7f15ccd99700 1 -- 172.21.15.142:0/1895318976 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8009e70 con 0x7f15c80cf180 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15ccd99700 1 -- 172.21.15.142:0/1895318976 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b800b860 con 0x7f15c80cf180 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15ccd99700 1 -- 172.21.15.142:0/1895318976 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800bc00 con 0x7f15c80cf180 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 -- 172.21.15.142:0/1895318976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 msgr2=0x7f15c80cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 --2- 172.21.15.142:0/1895318976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c80cbb70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f15c80d1b30 tx=0x7f15b8009250 comp rx=0 tx=0).stop 2023-09-30T22:58:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 -- 172.21.15.142:0/1895318976 shutdown_connections 2023-09-30T22:58:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 --2- 172.21.15.142:0/1895318976 >> v2:172.21.15.148:3300/0 conn(0x7f15c815ac40 0x7f15c815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 --2- 172.21.15.142:0/1895318976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c80cbb70 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 -- 172.21.15.142:0/1895318976 >> 172.21.15.142:0/1895318976 conn(0x7f15c80d0a80 msgr2=0x7f15c80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 -- 172.21.15.142:0/1895318976 shutdown_connections 2023-09-30T22:58:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.643+0000 7f15cffff700 1 -- 172.21.15.142:0/1895318976 wait complete. 2023-09-30T22:58:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.645+0000 7f15cffff700 1 Processor -- start 2023-09-30T22:58:50.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.646+0000 7f15cffff700 1 -- start start 2023-09-30T22:58:50.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15c80cc0b0 0x7f15c8151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:50.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c8159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:50.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c815ac40 0x7f15c816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:50.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c81596d0 con 0x7f15c80cf180 2023-09-30T22:58:50.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c815d800 con 0x7f15c815ac40 2023-09-30T22:58:50.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c815dae0 con 0x7f15c80cc0b0 2023-09-30T22:58:50.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c8159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c8159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49506/0 (socket says 172.21.15.142:49506) 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cdd9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15c80cc0b0 0x7f15c8151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 -- 172.21.15.142:0/1421157506 learned_addr learned my addr 172.21.15.142:0/1421157506 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15ce59c700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c815ac40 0x7f15c816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 -- 172.21.15.142:0/1421157506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15c80cc0b0 msgr2=0x7f15c8151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15c80cc0b0 0x7f15c8151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 -- 172.21.15.142:0/1421157506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c815ac40 msgr2=0x7f15c816a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c815ac40 0x7f15c816a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.647+0000 7f15cd59a700 1 -- 172.21.15.142:0/1421157506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80094f0 con 0x7f15c80cf180 2023-09-30T22:58:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.648+0000 7f15cd59a700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c8159190 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f15c806cee0 tx=0x7f15b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.648+0000 7f15bdffb700 1 -- 172.21.15.142:0/1421157506 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800bbe0 con 0x7f15c80cf180 2023-09-30T22:58:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.648+0000 7f15bdffb700 1 -- 172.21.15.142:0/1421157506 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8000c90 con 0x7f15c80cf180 2023-09-30T22:58:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.648+0000 7f15bdffb700 1 -- 172.21.15.142:0/1421157506 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8011650 con 0x7f15c80cf180 2023-09-30T22:58:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.648+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c816ad30 con 0x7f15c80cf180 2023-09-30T22:58:50.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.648+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c816b2f0 con 0x7f15c80cf180 2023-09-30T22:58:50.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.649+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c8069770 con 0x7f15c80cf180 2023-09-30T22:58:50.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.650+0000 7f15bdffb700 1 -- 172.21.15.142:0/1421157506 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f15b8011a00 con 0x7f15c80cf180 2023-09-30T22:58:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.651+0000 7f15bdffb700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15ac067330 0x7f15ac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.651+0000 7f15bdffb700 1 -- 172.21.15.142:0/1421157506 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f15b80863f0 con 0x7f15c80cf180 2023-09-30T22:58:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.651+0000 7f15cdd9b700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15ac067330 0x7f15ac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:50.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.652+0000 7f15cdd9b700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15ac067330 0x7f15ac0697e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d10 tx=0x7f15c40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:50.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.656+0000 7f15bdffb700 1 -- 172.21.15.142:0/1421157506 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f15b8053250 con 0x7f15c80cf180 2023-09-30T22:58:50.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:50.846+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f15c806fc10 con 0x7f15c80cf180 2023-09-30T22:58:51.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.329+0000 7f15bdffb700 1 -- 172.21.15.142:0/1421157506 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v131) v1 ==== 181+0+0 (secure 0 0 0) 0x7f15b8011cb0 con 0x7f15c80cf180 2023-09-30T22:58:51.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15ac067330 msgr2=0x7f15ac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:51.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15ac067330 0x7f15ac0697e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d10 tx=0x7f15c40091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 msgr2=0x7f15c8159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c8159190 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f15c806cee0 tx=0x7f15b8017000 comp rx=0 tx=0).stop 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 shutdown_connections 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f15ac067330 0x7f15ac0697e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c815ac40 0x7f15c816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f15c80cc0b0 0x7f15c8151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 --2- 172.21.15.142:0/1421157506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c80cf180 0x7f15c8159190 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:51.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 >> 172.21.15.142:0/1421157506 conn(0x7f15c80d0a80 msgr2=0x7f15c80c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:51.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.332+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 shutdown_connections 2023-09-30T22:58:51.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:51.333+0000 7f15cffff700 1 -- 172.21.15.142:0/1421157506 wait complete. 2023-09-30T22:58:51.334 INFO:teuthology.orchestra.run.smithi142.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-30T22:58:51.351 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:58:51.351 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:58:51.352 DEBUG:teuthology.orchestra.run.smithi142:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-30T22:58:51.352 DEBUG:teuthology.orchestra.run.smithi142:> os.fchmod(fd, 0O666) 2023-09-30T22:58:51.352 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(fd) 2023-09-30T22:58:51.352 DEBUG:teuthology.orchestra.run.smithi142:> os.close(fd) 2023-09-30T22:58:51.352 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:58:51.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:51.651 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:58:51.780 INFO:teuthology.orchestra.run.smithi142.stdout:client6610 2023-09-30T22:58:51.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:51.780 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client6610/osdmap') 2023-09-30T22:58:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 130 barrier 130 flags 0x588000 2023-09-30T22:58:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:58:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:58:51.891 INFO:teuthology.orchestra.run.smithi142.stderr:908 bytes copied, 6.433e-05 s, 14.1 MB/s 2023-09-30T22:58:51.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-09-30T22:58:52.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.083+0000 7f9b8a1ff700 1 Processor -- start 2023-09-30T22:58:52.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.083+0000 7f9b8a1ff700 1 -- start start 2023-09-30T22:58:52.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.084+0000 7f9b8a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 0x7f9b8415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.084+0000 7f9b8a1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8406d470 con 0x7f9b8406b3d0 2023-09-30T22:58:52.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.084+0000 7f9b8a1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b84157e60 con 0x7f9b840b2110 2023-09-30T22:58:52.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.084+0000 7f9b8a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8415c430 con 0x7f9b84157a90 2023-09-30T22:58:52.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b82ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9b8406b3d0 0x7f9b840b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51674/0 (socket says 172.21.15.142:51674) 2023-09-30T22:58:52.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b82ffd700 1 -- 172.21.15.142:0/2992130186 learned_addr learned my addr 172.21.15.142:0/2992130186 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:52.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b837fe700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 0x7f9b8415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753814328 0 0) 0x7f9b8406d470 con 0x7f9b8406b3d0 2023-09-30T22:58:52.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6c003570 con 0x7f9b8406b3d0 2023-09-30T22:58:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047433415 0 0) 0x7f9b84157e60 con 0x7f9b840b2110 2023-09-30T22:58:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b8406d470 con 0x7f9b840b2110 2023-09-30T22:58:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274196242 0 0) 0x7f9b6c003570 con 0x7f9b8406b3d0 2023-09-30T22:58:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 msgr2=0x7f9b8415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 0x7f9b8415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 >> v1:172.21.15.148:6789/0 conn(0x7f9b840b2110 legacy=0x7f9b8406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840ae880 con 0x7f9b8406b3d0 2023-09-30T22:58:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.085+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f9b78001470 con 0x7f9b8406b3d0 2023-09-30T22:58:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 >> v1:172.21.15.142:6789/0 conn(0x7f9b8406b3d0 legacy=0x7f9b840b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b827fc700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 0x7f9b6c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b827fc700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004180 0x7f9b6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b827fc700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b6c004d50 0x7f9b6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8415c430 con 0x7f9b6c004d50 2023-09-30T22:58:52.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c00bba0 con 0x7f9b6c004180 2023-09-30T22:58:52.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c00bd60 con 0x7f9b84157a90 2023-09-30T22:58:52.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b83fff700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b6c004d50 0x7f9b6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b837fe700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 0x7f9b6c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b82ffd700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004180 0x7f9b6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b83fff700 1 -- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 msgr2=0x7f9b6c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:52.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b83fff700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 0x7f9b6c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b83fff700 1 -- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004180 msgr2=0x7f9b6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:52.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b83fff700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004180 0x7f9b6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b83fff700 1 -- 172.21.15.142:0/2992130186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c003570 con 0x7f9b6c004d50 2023-09-30T22:58:52.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.086+0000 7f9b837fe700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b84157a90 0x7f9b6c003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:52.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b83fff700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b6c004d50 0x7f9b6c0051c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9b8406ce60 tx=0x7f9b7c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1027a76cf65c2b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c001ab0 con 0x7f9b6c004d50 2023-09-30T22:58:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00c880 con 0x7f9b6c004d50 2023-09-30T22:58:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b827fc700 1 -- 172.21.15.142:0/2992130186 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00cc20 con 0x7f9b6c004d50 2023-09-30T22:58:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/2992130186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b6c004d50 msgr2=0x7f9b6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b8a1ff700 1 --2- 172.21.15.142:0/2992130186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b6c004d50 0x7f9b6c0051c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9b8406ce60 tx=0x7f9b7c0017a0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b83fff700 1 -- 172.21.15.142:0/2992130186 reap_dead start 2023-09-30T22:58:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/2992130186 shutdown_connections 2023-09-30T22:58:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/2992130186 >> 172.21.15.142:0/2992130186 conn(0x7f9b840680c0 msgr2=0x7f9b840c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/2992130186 shutdown_connections 2023-09-30T22:58:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.087+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/2992130186 wait complete. 2023-09-30T22:58:52.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.089+0000 7f9b8a1ff700 1 Processor -- start 2023-09-30T22:58:52.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.090+0000 7f9b8a1ff700 1 -- start start 2023-09-30T22:58:52.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b8a1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004d50 0x7f9b84169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b8a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8414e4a0 0x7f9b84151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b8a1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b841522d0 0x7f9b84155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b8a1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84152770 con 0x7f9b841522d0 2023-09-30T22:58:52.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b8a1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b841697d0 con 0x7f9b6c004d50 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b8a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84156f30 con 0x7f9b8414e4a0 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b841522d0 0x7f9b84155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b837fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004d50 0x7f9b84169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b841522d0 0x7f9b84155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55946/0 (socket says 172.21.15.142:55946) 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b83fff700 1 -- 172.21.15.142:0/1949775279 learned_addr learned my addr 172.21.15.142:0/1949775279 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b82ffd700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8414e4a0 0x7f9b84151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b83fff700 1 -- 172.21.15.142:0/1949775279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8414e4a0 msgr2=0x7f9b84151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.091+0000 7f9b83fff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8414e4a0 0x7f9b84151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b83fff700 1 -- 172.21.15.142:0/1949775279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004d50 msgr2=0x7f9b84169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b83fff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004d50 0x7f9b84169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b83fff700 1 -- 172.21.15.142:0/1949775279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84156c50 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b83fff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b841522d0 0x7f9b84155ed0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00bb70 tx=0x7f9b7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b6b7fe700 1 -- 172.21.15.142:0/1949775279 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00c6a0 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b6b7fe700 1 -- 172.21.15.142:0/1949775279 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00c9f0 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b84153ba0 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b6b7fe700 1 -- 172.21.15.142:0/1949775279 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c006ba0 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.092+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b84154160 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.093+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b84153a00 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.094+0000 7f9b6b7fe700 1 -- 172.21.15.142:0/1949775279 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9b7c003030 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.095+0000 7f9b6b7fe700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.095+0000 7f9b6b7fe700 1 -- 172.21.15.142:0/1949775279 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b7c086e10 con 0x7f9b841522d0 2023-09-30T22:58:52.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.095+0000 7f9b837fe700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.096+0000 7f9b837fe700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006eb0 tx=0x7f9b740091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:52.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.099+0000 7f9b6b7fe700 1 -- 172.21.15.142:0/1949775279 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9b84153a00 con 0x7f9b841522d0 2023-09-30T22:58:52.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.301+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f9b84153a00 con 0x7f9b841522d0 2023-09-30T22:58:52.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.341+0000 7f9b6b7fe700 1 -- 172.21.15.142:0/1949775279 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v132) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9b84153a00 con 0x7f9b841522d0 2023-09-30T22:58:52.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 msgr2=0x7f9b700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006eb0 tx=0x7f9b740091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b841522d0 msgr2=0x7f9b84155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b841522d0 0x7f9b84155ed0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00bb70 tx=0x7f9b7c016000 comp rx=0 tx=0).stop 2023-09-30T22:58:52.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 shutdown_connections 2023-09-30T22:58:52.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b841522d0 0x7f9b84155ed0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b6c004d50 0x7f9b84169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 --2- 172.21.15.142:0/1949775279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8414e4a0 0x7f9b84151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 >> 172.21.15.142:0/1949775279 conn(0x7f9b840680c0 msgr2=0x7f9b840b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:52.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 shutdown_connections 2023-09-30T22:58:52.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.343+0000 7f9b8a1ff700 1 -- 172.21.15.142:0/1949775279 wait complete. 2023-09-30T22:58:52.346 INFO:teuthology.orchestra.run.smithi142.stderr:pauserd,pausewr is set 2023-09-30T22:58:52.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-09-30T22:58:52.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.553+0000 7f8bb1fff700 1 Processor -- start 2023-09-30T22:58:52.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.553+0000 7f8bb1fff700 1 -- start start 2023-09-30T22:58:52.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.554+0000 7f8bb1fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cee50 0x7f8bac159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.554+0000 7f8bb1fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac06b8d0 con 0x7f8bac1598e0 2023-09-30T22:58:52.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8bb1fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac0cff40 con 0x7f8bac0d03d0 2023-09-30T22:58:52.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8bb1fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0cf330 con 0x7f8bac0cee50 2023-09-30T22:58:52.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8bab7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8bac1598e0 0x7f8bac06b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51690/0 (socket says 172.21.15.142:51690) 2023-09-30T22:58:52.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8bab7fe700 1 -- 172.21.15.142:0/1754710705 learned_addr learned my addr 172.21.15.142:0/1754710705 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:52.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8baaffd700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cee50 0x7f8bac159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054727332 0 0) 0x7f8bac06b8d0 con 0x7f8bac1598e0 2023-09-30T22:58:52.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b94003570 con 0x7f8bac1598e0 2023-09-30T22:58:52.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990603351 0 0) 0x7f8bac0cff40 con 0x7f8bac0d03d0 2023-09-30T22:58:52.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.555+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bac06b8d0 con 0x7f8bac0d03d0 2023-09-30T22:58:52.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477608611 0 0) 0x7f8b94003570 con 0x7f8bac1598e0 2023-09-30T22:58:52.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cee50 msgr2=0x7f8bac159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:52.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cee50 0x7f8bac159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 >> v1:172.21.15.148:6789/0 conn(0x7f8bac0d03d0 legacy=0x7f8bac15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0cf610 con 0x7f8bac1598e0 2023-09-30T22:58:52.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f8b9c001470 con 0x7f8bac1598e0 2023-09-30T22:58:52.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 >> v1:172.21.15.142:6789/0 conn(0x7f8bac1598e0 legacy=0x7f8bac06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b94003c20 0x7f8b94004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b94004810 0x7f8b94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940051c0 0x7f8b9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0cf330 con 0x7f8b940051c0 2023-09-30T22:58:52.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9400c080 con 0x7f8b94003c20 2023-09-30T22:58:52.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9400c240 con 0x7f8b94004810 2023-09-30T22:58:52.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baaffd700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bac0cee50 0x7f8bac159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:52.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8babfff700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940051c0 0x7f8b9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8bab7fe700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b94003c20 0x7f8b94004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baaffd700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b94004810 0x7f8b94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8babfff700 1 -- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b94004810 msgr2=0x7f8b94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:52.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8babfff700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b94004810 0x7f8b94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8babfff700 1 -- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b94003c20 msgr2=0x7f8b94004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:52.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8babfff700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b94003c20 0x7f8b94004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8babfff700 1 -- 172.21.15.142:0/1754710705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b94003570 con 0x7f8b940051c0 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.556+0000 7f8baaffd700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b94004810 0x7f8b94004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8babfff700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940051c0 0x7f8b9400ba60 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4002120 tx=0x7f8ba40017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47033c3aaec2a7d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4001ab0 con 0x7f8b940051c0 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba400c980 con 0x7f8b940051c0 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8baa7fc700 1 -- 172.21.15.142:0/1754710705 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400cd20 con 0x7f8b940051c0 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8bb1fff700 1 -- 172.21.15.142:0/1754710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940051c0 msgr2=0x7f8b9400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8bb1fff700 1 --2- 172.21.15.142:0/1754710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940051c0 0x7f8b9400ba60 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4002120 tx=0x7f8ba40017a0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8babfff700 1 -- 172.21.15.142:0/1754710705 reap_dead start 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8bb1fff700 1 -- 172.21.15.142:0/1754710705 shutdown_connections 2023-09-30T22:58:52.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.557+0000 7f8bb1fff700 1 -- 172.21.15.142:0/1754710705 >> 172.21.15.142:0/1754710705 conn(0x7f8bac0cd540 msgr2=0x7f8bac0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:52.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.558+0000 7f8bb1fff700 1 -- 172.21.15.142:0/1754710705 shutdown_connections 2023-09-30T22:58:52.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.558+0000 7f8bb1fff700 1 -- 172.21.15.142:0/1754710705 wait complete. 2023-09-30T22:58:52.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.559+0000 7f8bb1fff700 1 Processor -- start 2023-09-30T22:58:52.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.559+0000 7f8bb1fff700 1 -- start start 2023-09-30T22:58:52.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8bb1fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b940051c0 0x7f8bac0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8bb1fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1534f0 0x7f8bac153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8bb1fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bac0b5540 0x7f8bac0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8bb1fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0b5f00 con 0x7f8bac0b5540 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8bb1fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac153e80 con 0x7f8bac1534f0 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8bb1fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac1540b0 con 0x7f8b940051c0 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8babfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bac0b5540 0x7f8bac0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8babfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bac0b5540 0x7f8bac0b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55954/0 (socket says 172.21.15.142:55954) 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8babfff700 1 -- 172.21.15.142:0/2312768963 learned_addr learned my addr 172.21.15.142:0/2312768963 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.560+0000 7f8baaffd700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1534f0 0x7f8bac153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8bab7fe700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b940051c0 0x7f8bac0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8babfff700 1 -- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b940051c0 msgr2=0x7f8bac0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8babfff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b940051c0 0x7f8bac0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8babfff700 1 -- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1534f0 msgr2=0x7f8bac153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8babfff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1534f0 0x7f8bac153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8babfff700 1 -- 172.21.15.142:0/2312768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac154390 con 0x7f8bac0b5540 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8babfff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bac0b5540 0x7f8bac0b59c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400c050 tx=0x7f8ba4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400c6d0 con 0x7f8bac0b5540 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba4006db0 con 0x7f8bac0b5540 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac154670 con 0x7f8bac0b5540 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4012dc0 con 0x7f8bac0b5540 2023-09-30T22:58:52.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.561+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac154c30 con 0x7f8bac0b5540 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.562+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac0697b0 con 0x7f8bac0b5540 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.563+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ba4003030 con 0x7f8bac0b5540 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.564+0000 7f8b937fe700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8b98067330 0x7f8b980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.564+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ba4086e80 con 0x7f8bac0b5540 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.564+0000 7f8bab7fe700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8b98067330 0x7f8b980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.564+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=133+}) v3 -- 0x7f8b9806f4f0 con 0x7f8bac0b5540 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.565+0000 7f8bab7fe700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8b98067330 0x7f8b980697e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c001200 tx=0x7f8b9c001d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:52.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.568+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ba4053da0 con 0x7f8bac0b5540 2023-09-30T22:58:52.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:52.771+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f8bac06fc10 con 0x7f8bac0b5540 2023-09-30T22:58:53.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.344+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(133..133 src has 1..133) v4 ==== 280+0+0 (secure 0 0 0) 0x7f8ba4058160 con 0x7f8bac0b5540 2023-09-30T22:58:53.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.344+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=134}) v3 -- 0x7f8b9806fcd0 con 0x7f8bac0b5540 2023-09-30T22:58:53.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.346+0000 7f8b937fe700 1 -- 172.21.15.142:0/2312768963 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v133) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8ba40573c0 con 0x7f8bac0b5540 2023-09-30T22:58:53.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8b98067330 msgr2=0x7f8b980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8b98067330 0x7f8b980697e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c001200 tx=0x7f8b9c001d20 comp rx=0 tx=0).stop 2023-09-30T22:58:53.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bac0b5540 msgr2=0x7f8bac0b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bac0b5540 0x7f8bac0b59c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400c050 tx=0x7f8ba4016000 comp rx=0 tx=0).stop 2023-09-30T22:58:53.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 shutdown_connections 2023-09-30T22:58:53.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8b98067330 0x7f8b980697e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bac0b5540 0x7f8bac0b59c0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8b940051c0 0x7f8bac0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 --2- 172.21.15.142:0/2312768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bac1534f0 0x7f8bac153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 >> 172.21.15.142:0/2312768963 conn(0x7f8bac0cd540 msgr2=0x7f8bac06a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:53.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 shutdown_connections 2023-09-30T22:58:53.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.350+0000 7f8bb1fff700 1 -- 172.21.15.142:0/2312768963 wait complete. 2023-09-30T22:58:53.351 INFO:teuthology.orchestra.run.smithi142.stderr:pauserd,pausewr is unset 2023-09-30T22:58:53.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:53.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.561+0000 7f8f001ff700 1 Processor -- start 2023-09-30T22:58:53.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.562+0000 7f8f001ff700 1 -- start start 2023-09-30T22:58:53.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.563+0000 7f8f001ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ef80af020 0x7f8ef8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:53.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.563+0000 7f8f001ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef806d3e0 con 0x7f8ef806e820 2023-09-30T22:58:53.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.563+0000 7f8f001ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef806dc80 con 0x7f8ef80b00d0 2023-09-30T22:58:53.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.563+0000 7f8f001ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef806eca0 con 0x7f8ef80af020 2023-09-30T22:58:53.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.563+0000 7f8efdf9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ef80af020 0x7f8ef8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:53.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.563+0000 7f8efe79c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8ef806e820 0x7f8ef815a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51698/0 (socket says 172.21.15.142:51698) 2023-09-30T22:58:53.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.563+0000 7f8efe79c700 1 -- 172.21.15.142:0/1299836095 learned_addr learned my addr 172.21.15.142:0/1299836095 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:53.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efdf9b700 1 -- 172.21.15.142:0/1299836095 >> v1:172.21.15.148:6789/0 conn(0x7f8ef80b00d0 legacy=0x7f8ef806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efdf9b700 1 -- 172.21.15.142:0/1299836095 >> v1:172.21.15.142:6789/0 conn(0x7f8ef806e820 legacy=0x7f8ef815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efdf9b700 1 -- 172.21.15.142:0/1299836095 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef806b790 con 0x7f8ef80af020 2023-09-30T22:58:53.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efcf99700 1 -- 172.21.15.142:0/1299836095 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942715281 0 0) 0x7f8ef806d3e0 con 0x7f8ef806e820 2023-09-30T22:58:53.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efdf9b700 1 --2- 172.21.15.142:0/1299836095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef80af020 0x7f8ef8156d80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400bbc0 tx=0x7f8ef400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f6bfb6a97355d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:53.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efcf99700 1 -- 172.21.15.142:0/1299836095 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400db90 con 0x7f8ef80af020 2023-09-30T22:58:53.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efcf99700 1 -- 172.21.15.142:0/1299836095 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400dcf0 con 0x7f8ef80af020 2023-09-30T22:58:53.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.564+0000 7f8efcf99700 1 -- 172.21.15.142:0/1299836095 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40196b0 con 0x7f8ef80af020 2023-09-30T22:58:53.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.565+0000 7f8f001ff700 1 -- 172.21.15.142:0/1299836095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef80af020 msgr2=0x7f8ef8156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.565+0000 7f8f001ff700 1 --2- 172.21.15.142:0/1299836095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef80af020 0x7f8ef8156d80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400bbc0 tx=0x7f8ef400b430 comp rx=0 tx=0).stop 2023-09-30T22:58:53.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.565+0000 7f8f001ff700 1 -- 172.21.15.142:0/1299836095 shutdown_connections 2023-09-30T22:58:53.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.565+0000 7f8f001ff700 1 --2- 172.21.15.142:0/1299836095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef80af020 0x7f8ef8156d80 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.565+0000 7f8f001ff700 1 -- 172.21.15.142:0/1299836095 >> 172.21.15.142:0/1299836095 conn(0x7f8ef80680c0 msgr2=0x7f8ef80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:53.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.565+0000 7f8f001ff700 1 -- 172.21.15.142:0/1299836095 shutdown_connections 2023-09-30T22:58:53.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.565+0000 7f8f001ff700 1 -- 172.21.15.142:0/1299836095 wait complete. 2023-09-30T22:58:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.566+0000 7f8f001ff700 1 Processor -- start 2023-09-30T22:58:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.566+0000 7f8f001ff700 1 -- start start 2023-09-30T22:58:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8f001ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef806e820 0x7f8ef815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8f001ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef80af020 0x7f8ef815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8f001ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef80b00d0 0x7f8ef816a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:53.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8f001ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8154570 con 0x7f8ef806e820 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8f001ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8156c80 con 0x7f8ef80af020 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8f001ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8159b70 con 0x7f8ef80b00d0 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8efdf9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef806e820 0x7f8ef815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8efdf9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef806e820 0x7f8ef815a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55970/0 (socket says 172.21.15.142:55970) 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.567+0000 7f8efdf9b700 1 -- 172.21.15.142:0/2306336371 learned_addr learned my addr 172.21.15.142:0/2306336371 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8efdf9b700 1 -- 172.21.15.142:0/2306336371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef80b00d0 msgr2=0x7f8ef816a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8efdf9b700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef80b00d0 0x7f8ef816a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8efdf9b700 1 -- 172.21.15.142:0/2306336371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef80af020 msgr2=0x7f8ef815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8efdf9b700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef80af020 0x7f8ef815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8efdf9b700 1 -- 172.21.15.142:0/2306336371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef400b6d0 con 0x7f8ef806e820 2023-09-30T22:58:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8efdf9b700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef806e820 0x7f8ef815a1d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400b6a0 tx=0x7f8ef401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8eedffb700 1 -- 172.21.15.142:0/2306336371 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40106c0 con 0x7f8ef806e820 2023-09-30T22:58:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8eedffb700 1 -- 172.21.15.142:0/2306336371 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4010840 con 0x7f8ef806e820 2023-09-30T22:58:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8eedffb700 1 -- 172.21.15.142:0/2306336371 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4010c00 con 0x7f8ef806e820 2023-09-30T22:58:53.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef815ae20 con 0x7f8ef806e820 2023-09-30T22:58:53.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.568+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef815b3e0 con 0x7f8ef806e820 2023-09-30T22:58:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.569+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef80695b0 con 0x7f8ef806e820 2023-09-30T22:58:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.570+0000 7f8eedffb700 1 -- 172.21.15.142:0/2306336371 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ef4024420 con 0x7f8ef806e820 2023-09-30T22:58:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.571+0000 7f8eedffb700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8edc067330 0x7f8edc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.571+0000 7f8eedffb700 1 -- 172.21.15.142:0/2306336371 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ef4020070 con 0x7f8ef806e820 2023-09-30T22:58:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.571+0000 7f8efd79a700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8edc067330 0x7f8edc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:53.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.572+0000 7f8efd79a700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8edc067330 0x7f8edc0697e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80ae510 tx=0x7f8ee8007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:53.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.575+0000 7f8eedffb700 1 -- 172.21.15.142:0/2306336371 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ef4053bd0 con 0x7f8ef806e820 2023-09-30T22:58:53.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.766+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ef80ae540 con 0x7f8ef806e820 2023-09-30T22:58:53.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.767+0000 7f8eedffb700 1 -- 172.21.15.142:0/2306336371 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+17033 (secure 0 0 0) 0x7f8ef40571f0 con 0x7f8ef806e820 2023-09-30T22:58:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:53.768 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":133,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:53.338123+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:58:37.968620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-09-30T22:58:39.134383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8edc067330 msgr2=0x7f8edc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8edc067330 0x7f8edc0697e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80ae510 tx=0x7f8ee8007b40 comp rx=0 tx=0).stop 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef806e820 msgr2=0x7f8ef815a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef806e820 0x7f8ef815a1d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400b6a0 tx=0x7f8ef401b000 comp rx=0 tx=0).stop 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 shutdown_connections 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8edc067330 0x7f8edc0697e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ef80b00d0 0x7f8ef816a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef806e820 0x7f8ef815a1d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 --2- 172.21.15.142:0/2306336371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ef80af020 0x7f8ef815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 >> 172.21.15.142:0/2306336371 conn(0x7f8ef80680c0 msgr2=0x7f8ef80c6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:53.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 shutdown_connections 2023-09-30T22:58:53.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:53.770+0000 7f8f001ff700 1 -- 172.21.15.142:0/2306336371 wait complete. 2023-09-30T22:58:53.788 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:58:53.788 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:58:53.788 DEBUG:teuthology.orchestra.run.smithi142:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-30T22:58:53.788 DEBUG:teuthology.orchestra.run.smithi142:> os.fchmod(fd, 0O666) 2023-09-30T22:58:53.788 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(fd) 2023-09-30T22:58:53.788 DEBUG:teuthology.orchestra.run.smithi142:> os.close(fd) 2023-09-30T22:58:53.788 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:58:54.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:54.087 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:58:54.216 INFO:teuthology.orchestra.run.smithi142.stdout:client6610 2023-09-30T22:58:54.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:54.216 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client6610/osdmap') 2023-09-30T22:58:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 130 barrier 130 flags 0x588000 2023-09-30T22:58:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:58:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:58:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:58:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:58:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:58:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:58:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:58:54.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:58:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:58:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:58:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:908 bytes copied, 7.3498e-05 s, 12.4 MB/s 2023-09-30T22:58:54.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:54.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.516+0000 7faf0a9ff700 1 Processor -- start 2023-09-30T22:58:54.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.516+0000 7faf0a9ff700 1 -- start start 2023-09-30T22:58:54.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf0a9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf0415dee0 0x7faf04159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:54.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf0a9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0406b8d0 con 0x7faf041598e0 2023-09-30T22:58:54.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf0a9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040cff40 con 0x7faf040cee50 2023-09-30T22:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf0a9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040cf330 con 0x7faf0415dee0 2023-09-30T22:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf08f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf0415dee0 0x7faf04159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf08f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf0415dee0 0x7faf04159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55978/0 (socket says 172.21.15.142:55978) 2023-09-30T22:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf08f9c700 1 -- 172.21.15.142:0/2971982771 learned_addr learned my addr 172.21.15.142:0/2971982771 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.517+0000 7faf03fff700 1 --1- 172.21.15.142:0/2971982771 >> v1:172.21.15.142:6789/0 conn(0x7faf041598e0 0x7faf0406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51704/0 (socket says 172.21.15.142:51704) 2023-09-30T22:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.518+0000 7faf08f9c700 1 -- 172.21.15.142:0/2971982771 >> v1:172.21.15.148:6789/0 conn(0x7faf040cee50 legacy=0x7faf0415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.518+0000 7faf08f9c700 1 -- 172.21.15.142:0/2971982771 >> v1:172.21.15.142:6789/0 conn(0x7faf041598e0 legacy=0x7faf0406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.518+0000 7faf08f9c700 1 -- 172.21.15.142:0/2971982771 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040cf610 con 0x7faf0415dee0 2023-09-30T22:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.518+0000 7faf08f9c700 1 --2- 172.21.15.142:0/2971982771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0415dee0 0x7faf04159cb0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7faefc009f20 tx=0x7faefc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6831177d3df787 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.518+0000 7faf02ffd700 1 -- 172.21.15.142:0/2971982771 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00e070 con 0x7faf0415dee0 2023-09-30T22:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.518+0000 7faf02ffd700 1 -- 172.21.15.142:0/2971982771 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc00ba80 con 0x7faf0415dee0 2023-09-30T22:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.518+0000 7faf02ffd700 1 -- 172.21.15.142:0/2971982771 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0092e0 con 0x7faf0415dee0 2023-09-30T22:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.519+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2971982771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0415dee0 msgr2=0x7faf04159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.519+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2971982771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0415dee0 0x7faf04159cb0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7faefc009f20 tx=0x7faefc009840 comp rx=0 tx=0).stop 2023-09-30T22:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.519+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2971982771 shutdown_connections 2023-09-30T22:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.519+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2971982771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0415dee0 0x7faf04159cb0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.519+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2971982771 >> 172.21.15.142:0/2971982771 conn(0x7faf040cd540 msgr2=0x7faf040cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.519+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2971982771 shutdown_connections 2023-09-30T22:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.519+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2971982771 wait complete. 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.521+0000 7faf0a9ff700 1 Processor -- start 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.521+0000 7faf0a9ff700 1 -- start start 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf0a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf040cee50 0x7faf040b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf0a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf041598e0 0x7faf040cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf0a9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf0415dee0 0x7faf0416a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf0a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf04157ba0 con 0x7faf040cee50 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf0a9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040cbfc0 con 0x7faf0415dee0 2023-09-30T22:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf0a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf041575c0 con 0x7faf041598e0 2023-09-30T22:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf040cee50 0x7faf040b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf040cee50 0x7faf040b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55982/0 (socket says 172.21.15.142:55982) 2023-09-30T22:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 -- 172.21.15.142:0/2517449527 learned_addr learned my addr 172.21.15.142:0/2517449527 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 -- 172.21.15.142:0/2517449527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf041598e0 msgr2=0x7faf040cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf041598e0 0x7faf040cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 -- 172.21.15.142:0/2517449527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf0415dee0 msgr2=0x7faf0416a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf0415dee0 0x7faf0416a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.522+0000 7faf03fff700 1 -- 172.21.15.142:0/2517449527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc009ae0 con 0x7faf040cee50 2023-09-30T22:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.523+0000 7faf03fff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf040cee50 0x7faf040b23d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7faef400c7c0 tx=0x7faef4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.523+0000 7faeebfff700 1 -- 172.21.15.142:0/2517449527 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4005a70 con 0x7faf040cee50 2023-09-30T22:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.523+0000 7faeebfff700 1 -- 172.21.15.142:0/2517449527 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4005bf0 con 0x7faf040cee50 2023-09-30T22:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.523+0000 7faeebfff700 1 -- 172.21.15.142:0/2517449527 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef40070f0 con 0x7faf040cee50 2023-09-30T22:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.523+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0415c120 con 0x7faf040cee50 2023-09-30T22:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.523+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0415c650 con 0x7faf040cee50 2023-09-30T22:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.524+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf040697b0 con 0x7faf040cee50 2023-09-30T22:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.525+0000 7faeebfff700 1 -- 172.21.15.142:0/2517449527 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7faef4007460 con 0x7faf040cee50 2023-09-30T22:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.526+0000 7faeebfff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faef0067330 0x7faef00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:54.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.526+0000 7faeebfff700 1 -- 172.21.15.142:0/2517449527 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faef4084660 con 0x7faf040cee50 2023-09-30T22:58:54.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.526+0000 7faf037fe700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faef0067330 0x7faef00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:54.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.527+0000 7faf037fe700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faef0067330 0x7faef00697e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faf040681d0 tx=0x7faef8007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:54.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.530+0000 7faeebfff700 1 -- 172.21.15.142:0/2517449527 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faef40515e0 con 0x7faf040cee50 2023-09-30T22:58:54.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.763+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf0406fc10 con 0x7faf040cee50 2023-09-30T22:58:54.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.764+0000 7faeebfff700 1 -- 172.21.15.142:0/2517449527 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7faef4054c00 con 0x7faf040cee50 2023-09-30T22:58:54.764 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:54.764 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:58:54.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.766+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faef0067330 msgr2=0x7faef00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:54.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.766+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faef0067330 0x7faef00697e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faf040681d0 tx=0x7faef8007b40 comp rx=0 tx=0).stop 2023-09-30T22:58:54.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.766+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf040cee50 msgr2=0x7faf040b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:54.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.766+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf040cee50 0x7faf040b23d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7faef400c7c0 tx=0x7faef4007f70 comp rx=0 tx=0).stop 2023-09-30T22:58:54.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 shutdown_connections 2023-09-30T22:58:54.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faef0067330 0x7faef00697e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:54.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf0415dee0 0x7faf0416a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:54.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf040cee50 0x7faf040b23d0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:54.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 --2- 172.21.15.142:0/2517449527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf041598e0 0x7faf040cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:54.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 >> 172.21.15.142:0/2517449527 conn(0x7faf040cd540 msgr2=0x7faf04158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:54.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 shutdown_connections 2023-09-30T22:58:54.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:54.767+0000 7faf0a9ff700 1 -- 172.21.15.142:0/2517449527 wait complete. 2023-09-30T22:58:54.768 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:58:54.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json osdmap barrier 133 2023-09-30T22:58:55.004 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-09-30T22:58:55.004 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T22:58:55.004 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T22:58:55.004 DEBUG:teuthology.orchestra.run.smithi142:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-30T22:58:55.004 DEBUG:teuthology.orchestra.run.smithi142:> os.fchmod(fd, 0O666) 2023-09-30T22:58:55.004 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(fd) 2023-09-30T22:58:55.004 DEBUG:teuthology.orchestra.run.smithi142:> os.close(fd) 2023-09-30T22:58:55.005 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T22:58:55.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:55.302 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:58:55.433 INFO:teuthology.orchestra.run.smithi142.stdout:client6610 2023-09-30T22:58:55.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:55.434 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client6610/osdmap') 2023-09-30T22:58:55.541 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 133 barrier 133 flags 0x588000 2023-09-30T22:58:55.541 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:58:55.542 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:58:55.543 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:58:55.543 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:58:55.543 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:58:55.543 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:58:55.543 INFO:teuthology.orchestra.run.smithi142.stderr:908 bytes copied, 6.912e-05 s, 13.1 MB/s 2023-09-30T22:58:55.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:55.544 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:58:55.632 INFO:teuthology.orchestra.run.smithi142.stdout:client6610 2023-09-30T22:58:55.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:55.632 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/45159191-1b2c-47ed-b172-96c0a1a05709.client6610/osdmap') 2023-09-30T22:58:55.741 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 133 barrier 133 flags 0x588000 2023-09-30T22:58:55.741 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.741 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.741 INFO:teuthology.orchestra.run.smithi142.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.741 INFO:teuthology.orchestra.run.smithi142.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-30T22:58:55.741 INFO:teuthology.orchestra.run.smithi142.stdout:osd0 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-09-30T22:58:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd1 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-09-30T22:58:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd2 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-09-30T22:58:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd3 (1)172.21.15.142:6814 100% (exists, up) 100% -1 2023-09-30T22:58:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd4 (1)172.21.15.148:6801 100% (exists, up) 100% -1 2023-09-30T22:58:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd5 (1)172.21.15.148:6809 100% (exists, up) 100% -1 2023-09-30T22:58:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd6 (1)172.21.15.148:6816 100% (exists, up) 100% -1 2023-09-30T22:58:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd7 (1)172.21.15.148:6825 100% (exists, up) 100% -1 2023-09-30T22:58:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records in 2023-09-30T22:58:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:1+1 records out 2023-09-30T22:58:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:908 bytes copied, 8.2253e-05 s, 11.0 MB/s 2023-09-30T22:58:55.744 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:58:55.744 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:58:55.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:58:55.847 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:58:55.952 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:58:55.952 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:58:55.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:55.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:58:56.057 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:58:56.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:56.057 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:58:56.104 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:58:56.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:58:56.104 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T22:58:56.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:58:56.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:58:56.201 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:58:56.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:56.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.439+0000 7fbf487ff700 1 Processor -- start 2023-09-30T22:58:56.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.439+0000 7fbf487ff700 1 -- start start 2023-09-30T22:58:56.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf487ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbf400af020 0x7fbf40156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf487ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf400b00d0 0x7fbf4006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf487ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf4006e650 0x7fbf400b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf487ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4006d3e0 con 0x7fbf400b00d0 2023-09-30T22:58:56.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf487ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4006dc80 con 0x7fbf400af020 2023-09-30T22:58:56.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf487ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4006b790 con 0x7fbf4006e650 2023-09-30T22:58:56.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf45d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf400b00d0 0x7fbf4006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf45d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf400b00d0 0x7fbf4006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55990/0 (socket says 172.21.15.142:55990) 2023-09-30T22:58:56.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf45d9a700 1 -- 172.21.15.142:0/3139832085 learned_addr learned my addr 172.21.15.142:0/3139832085 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:56.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf4659b700 1 --2- 172.21.15.142:0/3139832085 >> v2:172.21.15.148:3300/0 conn(0x7fbf400af020 0x7fbf40156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.440+0000 7fbf46d9c700 1 --2- 172.21.15.142:0/3139832085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf4006e650 0x7fbf400b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45d9a700 1 -- 172.21.15.142:0/3139832085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf4006e650 msgr2=0x7fbf400b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:56.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45d9a700 1 --2- 172.21.15.142:0/3139832085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf4006e650 0x7fbf400b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45d9a700 1 -- 172.21.15.142:0/3139832085 >> v2:172.21.15.148:3300/0 conn(0x7fbf400af020 msgr2=0x7fbf40156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:56.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45d9a700 1 --2- 172.21.15.142:0/3139832085 >> v2:172.21.15.148:3300/0 conn(0x7fbf400af020 0x7fbf40156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45d9a700 1 -- 172.21.15.142:0/3139832085 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400b0650 con 0x7fbf400b00d0 2023-09-30T22:58:56.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45d9a700 1 --2- 172.21.15.142:0/3139832085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf400b00d0 0x7fbf4006e110 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006cdd0 tx=0x7fbf30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c478ffacb5d28762 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:56.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45599700 1 -- 172.21.15.142:0/3139832085 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000b640 con 0x7fbf400b00d0 2023-09-30T22:58:56.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45599700 1 -- 172.21.15.142:0/3139832085 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000b7a0 con 0x7fbf400b00d0 2023-09-30T22:58:56.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.441+0000 7fbf45599700 1 -- 172.21.15.142:0/3139832085 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000bb60 con 0x7fbf400b00d0 2023-09-30T22:58:56.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 -- 172.21.15.142:0/3139832085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf400b00d0 msgr2=0x7fbf4006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 --2- 172.21.15.142:0/3139832085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf400b00d0 0x7fbf4006e110 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006cdd0 tx=0x7fbf30009250 comp rx=0 tx=0).stop 2023-09-30T22:58:56.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 -- 172.21.15.142:0/3139832085 shutdown_connections 2023-09-30T22:58:56.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 --2- 172.21.15.142:0/3139832085 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf4006e650 0x7fbf400b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 --2- 172.21.15.142:0/3139832085 >> v2:172.21.15.148:3300/0 conn(0x7fbf400af020 0x7fbf40156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 --2- 172.21.15.142:0/3139832085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf400b00d0 0x7fbf4006e110 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 -- 172.21.15.142:0/3139832085 >> 172.21.15.142:0/3139832085 conn(0x7fbf400680c0 msgr2=0x7fbf400c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:56.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 -- 172.21.15.142:0/3139832085 shutdown_connections 2023-09-30T22:58:56.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.442+0000 7fbf487ff700 1 -- 172.21.15.142:0/3139832085 wait complete. 2023-09-30T22:58:56.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.444+0000 7fbf487ff700 1 Processor -- start 2023-09-30T22:58:56.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.444+0000 7fbf487ff700 1 -- start start 2023-09-30T22:58:56.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf487ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4006e650 0x7fbf4015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf487ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf400af020 0x7fbf4016a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf487ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf400b00d0 0x7fbf4016a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf487ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4016adb0 con 0x7fbf4006e650 2023-09-30T22:58:56.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf487ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400a9110 con 0x7fbf400af020 2023-09-30T22:58:56.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf487ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4016bf30 con 0x7fbf400b00d0 2023-09-30T22:58:56.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4006e650 0x7fbf4015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4006e650 0x7fbf4015f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55994/0 (socket says 172.21.15.142:55994) 2023-09-30T22:58:56.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 -- 172.21.15.142:0/4060135938 learned_addr learned my addr 172.21.15.142:0/4060135938 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:56.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf45d9a700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf400af020 0x7fbf4016a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf46d9c700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf400b00d0 0x7fbf4016a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 -- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf400b00d0 msgr2=0x7fbf4016a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf400b00d0 0x7fbf4016a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 -- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf400af020 msgr2=0x7fbf4016a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf400af020 0x7fbf4016a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.445+0000 7fbf4659b700 1 -- 172.21.15.142:0/4060135938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300094f0 con 0x7fbf4006e650 2023-09-30T22:58:56.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.446+0000 7fbf4659b700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4006e650 0x7fbf4015f5c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00ec80 tx=0x7fbf3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:56.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.446+0000 7fbf367fc700 1 -- 172.21.15.142:0/4060135938 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00c850 con 0x7fbf4006e650 2023-09-30T22:58:56.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.446+0000 7fbf367fc700 1 -- 172.21.15.142:0/4060135938 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c00c9b0 con 0x7fbf4006e650 2023-09-30T22:58:56.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.446+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4016b600 con 0x7fbf4006e650 2023-09-30T22:58:56.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.446+0000 7fbf367fc700 1 -- 172.21.15.142:0/4060135938 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00cd50 con 0x7fbf4006e650 2023-09-30T22:58:56.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.446+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4016bbc0 con 0x7fbf4006e650 2023-09-30T22:58:56.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.447+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf400695b0 con 0x7fbf4006e650 2023-09-30T22:58:56.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.448+0000 7fbf367fc700 1 -- 172.21.15.142:0/4060135938 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbf3c013680 con 0x7fbf4006e650 2023-09-30T22:58:56.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.449+0000 7fbf367fc700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf24067330 0x7fbf240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.449+0000 7fbf367fc700 1 -- 172.21.15.142:0/4060135938 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf3c084d90 con 0x7fbf4006e650 2023-09-30T22:58:56.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.449+0000 7fbf45d9a700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf24067330 0x7fbf240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.450+0000 7fbf45d9a700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf24067330 0x7fbf240697e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006cdd0 tx=0x7fbf30017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:56.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.453+0000 7fbf367fc700 1 -- 172.21.15.142:0/4060135938 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbf3c051c90 con 0x7fbf4006e650 2023-09-30T22:58:56.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.685+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf40156790 con 0x7fbf4006e650 2023-09-30T22:58:56.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.685+0000 7fbf367fc700 1 -- 172.21.15.142:0/4060135938 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fbf3c0552b0 con 0x7fbf4006e650 2023-09-30T22:58:56.686 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:56.686 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:58:56.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf24067330 msgr2=0x7fbf240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf24067330 0x7fbf240697e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006cdd0 tx=0x7fbf30017000 comp rx=0 tx=0).stop 2023-09-30T22:58:56.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4006e650 msgr2=0x7fbf4015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4006e650 0x7fbf4015f5c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00ec80 tx=0x7fbf3c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 shutdown_connections 2023-09-30T22:58:56.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbf24067330 0x7fbf240697e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf400b00d0 0x7fbf4016a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4006e650 0x7fbf4015f5c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 --2- 172.21.15.142:0/4060135938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf400af020 0x7fbf4016a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 >> 172.21.15.142:0/4060135938 conn(0x7fbf400680c0 msgr2=0x7fbf40155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:56.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 shutdown_connections 2023-09-30T22:58:56.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.688+0000 7fbf487ff700 1 -- 172.21.15.142:0/4060135938 wait complete. 2023-09-30T22:58:56.690 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:58:56.707 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.897+0000 7f29c2fff700 1 Processor -- start 2023-09-30T22:58:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.897+0000 7f29c2fff700 1 -- start start 2023-09-30T22:58:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.898+0000 7f29c2fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29bc0692f0 0x7f29bc15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.898+0000 7f29c2fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29bc15dc50 0x7f29bc06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.898+0000 7f29c2fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0cc6b0 con 0x7f29bc143350 2023-09-30T22:58:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.898+0000 7f29c2fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc15e050 con 0x7f29bc0692f0 2023-09-30T22:58:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.898+0000 7f29c2fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc0cbaa0 con 0x7f29bc15dc50 2023-09-30T22:58:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29bbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29bc0692f0 0x7f29bc15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29bbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29bc0692f0 0x7f29bc15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56004/0 (socket says 172.21.15.142:56004) 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29bbfff700 1 -- 172.21.15.142:0/3483860497 learned_addr learned my addr 172.21.15.142:0/3483860497 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29c159c700 1 --2- 172.21.15.142:0/3483860497 >> v2:172.21.15.148:3300/0 conn(0x7f29bc15dc50 0x7f29bc06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29bbfff700 1 -- 172.21.15.142:0/3483860497 >> v2:172.21.15.148:3300/0 conn(0x7f29bc15dc50 msgr2=0x7f29bc06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29bbfff700 1 --2- 172.21.15.142:0/3483860497 >> v2:172.21.15.148:3300/0 conn(0x7f29bc15dc50 0x7f29bc06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29bbfff700 1 -- 172.21.15.142:0/3483860497 >> v1:172.21.15.148:6789/0 conn(0x7f29bc143350 legacy=0x7f29bc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.899+0000 7f29bbfff700 1 -- 172.21.15.142:0/3483860497 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0cbd80 con 0x7f29bc0692f0 2023-09-30T22:58:56.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29bbfff700 1 --2- 172.21.15.142:0/3483860497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0692f0 0x7f29bc15d710 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f29bc069cf0 tx=0x7f29a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98982eb5fbe70aad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29bb7fe700 1 -- 172.21.15.142:0/3483860497 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800b860 con 0x7f29bc0692f0 2023-09-30T22:58:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29bb7fe700 1 -- 172.21.15.142:0/3483860497 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a800b9c0 con 0x7f29bc0692f0 2023-09-30T22:58:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29bb7fe700 1 -- 172.21.15.142:0/3483860497 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800bd60 con 0x7f29bc0692f0 2023-09-30T22:58:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 -- 172.21.15.142:0/3483860497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0692f0 msgr2=0x7f29bc15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3483860497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0692f0 0x7f29bc15d710 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f29bc069cf0 tx=0x7f29a8009250 comp rx=0 tx=0).stop 2023-09-30T22:58:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 -- 172.21.15.142:0/3483860497 shutdown_connections 2023-09-30T22:58:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3483860497 >> v2:172.21.15.148:3300/0 conn(0x7f29bc15dc50 0x7f29bc06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3483860497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc0692f0 0x7f29bc15d710 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 -- 172.21.15.142:0/3483860497 >> 172.21.15.142:0/3483860497 conn(0x7f29bc0ce8e0 msgr2=0x7f29bc0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 -- 172.21.15.142:0/3483860497 shutdown_connections 2023-09-30T22:58:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.900+0000 7f29c2fff700 1 -- 172.21.15.142:0/3483860497 wait complete. 2023-09-30T22:58:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.902+0000 7f29c2fff700 1 Processor -- start 2023-09-30T22:58:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.902+0000 7f29c2fff700 1 -- start start 2023-09-30T22:58:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c2fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0692f0 0x7f29bc0a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c2fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc143350 0x7f29bc0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c2fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc15dc50 0x7f29bc15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c2fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b1330 con 0x7f29bc143350 2023-09-30T22:58:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c2fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc15a1c0 con 0x7f29bc15dc50 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c2fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc15ad40 con 0x7f29bc0692f0 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29bbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc143350 0x7f29bc0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29bbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc143350 0x7f29bc0b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56006/0 (socket says 172.21.15.142:56006) 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29bbfff700 1 -- 172.21.15.142:0/3784253535 learned_addr learned my addr 172.21.15.142:0/3784253535 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c0d9b700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0692f0 0x7f29bc0a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.903+0000 7f29c159c700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc15dc50 0x7f29bc15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29bbfff700 1 -- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0692f0 msgr2=0x7f29bc0a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29bbfff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0692f0 0x7f29bc0a7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29bbfff700 1 -- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc15dc50 msgr2=0x7f29bc15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29bbfff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc15dc50 0x7f29bc15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29bbfff700 1 -- 172.21.15.142:0/3784253535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80094f0 con 0x7f29bc143350 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29c0d9b700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0692f0 0x7f29bc0a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:56.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29bbfff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc143350 0x7f29bc0b0df0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f29bc063f80 tx=0x7f29a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:56.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29b8ff9700 1 -- 172.21.15.142:0/3784253535 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a8024440 con 0x7f29bc143350 2023-09-30T22:58:56.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29b8ff9700 1 -- 172.21.15.142:0/3784253535 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a80245a0 con 0x7f29bc143350 2023-09-30T22:58:56.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc15cef0 con 0x7f29bc143350 2023-09-30T22:58:56.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29b8ff9700 1 -- 172.21.15.142:0/3784253535 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a8024960 con 0x7f29bc143350 2023-09-30T22:58:56.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.904+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc15a6f0 con 0x7f29bc143350 2023-09-30T22:58:56.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.905+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc15aeb0 con 0x7f29bc143350 2023-09-30T22:58:56.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.906+0000 7f29b8ff9700 1 -- 172.21.15.142:0/3784253535 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f29a8024d50 con 0x7f29bc143350 2023-09-30T22:58:56.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.907+0000 7f29b8ff9700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29a0067330 0x7f29a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:56.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.907+0000 7f29b8ff9700 1 -- 172.21.15.142:0/3784253535 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f29a80867c0 con 0x7f29bc143350 2023-09-30T22:58:56.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.907+0000 7f29c0d9b700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29a0067330 0x7f29a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:56.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.908+0000 7f29c0d9b700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29a0067330 0x7f29a00697e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f29b0001dc0 tx=0x7f29b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:56.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:56.912+0000 7f29b8ff9700 1 -- 172.21.15.142:0/3784253535 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f29a80536a0 con 0x7f29bc143350 2023-09-30T22:58:57.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.102+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29bc0cc060 con 0x7f29bc143350 2023-09-30T22:58:57.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.103+0000 7f29b8ff9700 1 -- 172.21.15.142:0/3784253535 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+17033 (secure 0 0 0) 0x7f29a802b340 con 0x7f29bc143350 2023-09-30T22:58:57.103 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:57.103 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":133,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:53.338123+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:58:37.968620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-09-30T22:58:39.134383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:57.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29a0067330 msgr2=0x7f29a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29a0067330 0x7f29a00697e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f29b0001dc0 tx=0x7f29b0009040 comp rx=0 tx=0).stop 2023-09-30T22:58:57.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc143350 msgr2=0x7f29bc0b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc143350 0x7f29bc0b0df0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f29bc063f80 tx=0x7f29a8017000 comp rx=0 tx=0).stop 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 shutdown_connections 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29a0067330 0x7f29a00697e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc15dc50 0x7f29bc15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29bc0692f0 0x7f29bc0a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 --2- 172.21.15.142:0/3784253535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29bc143350 0x7f29bc0b0df0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 >> 172.21.15.142:0/3784253535 conn(0x7f29bc0ce8e0 msgr2=0x7f29bc0cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.105+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 shutdown_connections 2023-09-30T22:58:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.106+0000 7f29c2fff700 1 -- 172.21.15.142:0/3784253535 wait complete. 2023-09-30T22:58:57.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:58:37.968620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:58:39.134383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:58:57.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:58:57.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.316+0000 7f8dfc7ff700 1 Processor -- start 2023-09-30T22:58:57.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.316+0000 7f8dfc7ff700 1 -- start start 2023-09-30T22:58:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfc7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 0x7f8df415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfc7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8df40cc3b0 0x7f8df40cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfc7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df40d0550 con 0x7f8df41573a0 2023-09-30T22:58:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfc7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40cf750 con 0x7f8df40cc3b0 2023-09-30T22:58:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfc7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40cf940 con 0x7f8df40cbfe0 2023-09-30T22:58:57.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfad9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8df41573a0 0x7f8df415d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51720/0 (socket says 172.21.15.142:51720) 2023-09-30T22:58:57.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfad9c700 1 -- 172.21.15.142:0/1328851308 learned_addr learned my addr 172.21.15.142:0/1328851308 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:57.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8dfa59b700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 0x7f8df415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.318+0000 7f8df9d9a700 1 --2- 172.21.15.142:0/1328851308 >> v2:172.21.15.148:3300/0 conn(0x7f8df40cc3b0 0x7f8df40cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060057872 0 0) 0x7f8df40d0550 con 0x7f8df41573a0 2023-09-30T22:58:57.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de0003570 con 0x7f8df41573a0 2023-09-30T22:58:57.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2075920613 0 0) 0x7f8de0003570 con 0x7f8df41573a0 2023-09-30T22:58:57.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 msgr2=0x7f8df415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 0x7f8df415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 >> v2:172.21.15.148:3300/0 conn(0x7f8df40cc3b0 msgr2=0x7f8df40cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 --2- 172.21.15.142:0/1328851308 >> v2:172.21.15.148:3300/0 conn(0x7f8df40cc3b0 0x7f8df40cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40cfc20 con 0x7f8df41573a0 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f8dec0017f0 con 0x7f8df41573a0 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 >> v1:172.21.15.142:6789/0 conn(0x7f8df41573a0 legacy=0x7f8df415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 0x7f8de0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0003fe0 0x7f8de0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de0004d50 0x7f8de00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40cf940 con 0x7f8de0004d50 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de000ba60 con 0x7f8de0003fe0 2023-09-30T22:58:57.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de000bbd0 con 0x7f8df40cbfe0 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8df9d9a700 1 --2- 172.21.15.142:0/1328851308 >> v2:172.21.15.148:3300/0 conn(0x7f8df40cc3b0 0x7f8df40cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8dfad9c700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de0004d50 0x7f8de00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.319+0000 7f8dfa59b700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 0x7f8de0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8df9d9a700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0003fe0 0x7f8de0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8dfad9c700 1 -- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 msgr2=0x7f8de0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8dfad9c700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df40cbfe0 0x7f8de0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8dfad9c700 1 -- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0003fe0 msgr2=0x7f8de0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8dfad9c700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0003fe0 0x7f8de0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8dfad9c700 1 -- 172.21.15.142:0/1328851308 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de0003570 con 0x7f8de0004d50 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8df9d9a700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0003fe0 0x7f8de0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8dfad9c700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de0004d50 0x7f8de00051c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00a900 tx=0x7f8df40cd3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94432a053a243a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:57.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec0070d0 con 0x7f8de0004d50 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec007230 con 0x7f8de0004d50 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.320+0000 7f8df9599700 1 -- 172.21.15.142:0/1328851308 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec0075f0 con 0x7f8de0004d50 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.321+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/1328851308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de0004d50 msgr2=0x7f8de00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.321+0000 7f8dfc7ff700 1 --2- 172.21.15.142:0/1328851308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8de0004d50 0x7f8de00051c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00a900 tx=0x7f8df40cd3f0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.321+0000 7f8dfad9c700 1 -- 172.21.15.142:0/1328851308 reap_dead start 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.321+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/1328851308 shutdown_connections 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.321+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/1328851308 >> 172.21.15.142:0/1328851308 conn(0x7f8df40d0a80 msgr2=0x7f8df40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.321+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/1328851308 shutdown_connections 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.321+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/1328851308 wait complete. 2023-09-30T22:58:57.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.322+0000 7f8dfc7ff700 1 Processor -- start 2023-09-30T22:58:57.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.322+0000 7f8dfc7ff700 1 -- start start 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.323+0000 7f8dfc7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0004d50 0x7f8df40c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.323+0000 7f8dfc7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8df41589e0 0x7f8df41450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.323+0000 7f8dfc7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df4158e50 0x7f8df4145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.323+0000 7f8dfc7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40c92e0 con 0x7f8df41589e0 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.323+0000 7f8dfc7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40c8710 con 0x7f8de0004d50 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.323+0000 7f8dfc7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40c89b0 con 0x7f8df4158e50 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8df41589e0 0x7f8df41450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8df41589e0 0x7f8df41450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56030/0 (socket says 172.21.15.142:56030) 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 -- 172.21.15.142:0/2618685995 learned_addr learned my addr 172.21.15.142:0/2618685995 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:57.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 -- 172.21.15.142:0/2618685995 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df4158e50 msgr2=0x7f8df4145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df4158e50 0x7f8df4145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 -- 172.21.15.142:0/2618685995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0004d50 msgr2=0x7f8df40c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0004d50 0x7f8df40c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 -- 172.21.15.142:0/2618685995 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40c8c90 con 0x7f8df41589e0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8df9d9a700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8df41589e0 0x7f8df41450e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8de4011990 tx=0x7f8de4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8dea7fc700 1 -- 172.21.15.142:0/2618685995 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400f8e0 con 0x7f8df41589e0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8dea7fc700 1 -- 172.21.15.142:0/2618685995 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de400fa40 con 0x7f8df41589e0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df40c8f70 con 0x7f8df41589e0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.324+0000 7f8dea7fc700 1 -- 172.21.15.142:0/2618685995 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400fdc0 con 0x7f8df41589e0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.325+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df4154c30 con 0x7f8df41589e0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.325+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df4069770 con 0x7f8df41589e0 2023-09-30T22:58:57.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.326+0000 7f8dea7fc700 1 -- 172.21.15.142:0/2618685995 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8de4015670 con 0x7f8df41589e0 2023-09-30T22:58:57.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.327+0000 7f8dea7fc700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dd8067330 0x7f8dd80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.327+0000 7f8dea7fc700 1 -- 172.21.15.142:0/2618685995 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8de4085610 con 0x7f8df41589e0 2023-09-30T22:58:57.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.328+0000 7f8dfa59b700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dd8067330 0x7f8dd80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.328+0000 7f8dfa59b700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dd8067330 0x7f8dd80697e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8df0006eb0 tx=0x7f8df00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:57.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.332+0000 7f8dea7fc700 1 -- 172.21.15.142:0/2618685995 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8de4052470 con 0x7f8df41589e0 2023-09-30T22:58:57.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.519+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8df415aac0 con 0x7f8df41589e0 2023-09-30T22:58:57.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.519+0000 7f8dea7fc700 1 -- 172.21.15.142:0/2618685995 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8de4055a90 con 0x7f8df41589e0 2023-09-30T22:58:57.519 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.521+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dd8067330 msgr2=0x7f8dd80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dd8067330 0x7f8dd80697e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8df0006eb0 tx=0x7f8df00091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8df41589e0 msgr2=0x7f8df41450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8df41589e0 0x7f8df41450e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8de4011990 tx=0x7f8de4008040 comp rx=0 tx=0).stop 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 shutdown_connections 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dd8067330 0x7f8dd80697e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8df4158e50 0x7f8df4145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de0004d50 0x7f8df40c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 --2- 172.21.15.142:0/2618685995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8df41589e0 0x7f8df41450e0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 >> 172.21.15.142:0/2618685995 conn(0x7f8df40d0a80 msgr2=0x7f8df406d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:57.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 shutdown_connections 2023-09-30T22:58:57.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.522+0000 7f8dfc7ff700 1 -- 172.21.15.142:0/2618685995 wait complete. 2023-09-30T22:58:57.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:58:57.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.732+0000 7fdbdabff700 1 Processor -- start 2023-09-30T22:58:57.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.732+0000 7fdbdabff700 1 -- start start 2023-09-30T22:58:57.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.733+0000 7fdbdabff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdbd4157ab0 0x7fdbd415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbdabff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40d0550 con 0x7fdbd40cc3b0 2023-09-30T22:58:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbdabff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40cf940 con 0x7fdbd40cbfe0 2023-09-30T22:58:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbdabff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40cfc20 con 0x7fdbd4157ab0 2023-09-30T22:58:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbd919c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdbd40cc3b0 0x7fdbd406a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51730/0 (socket says 172.21.15.142:51730) 2023-09-30T22:58:57.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbd919c700 1 -- 172.21.15.142:0/4280744712 learned_addr learned my addr 172.21.15.142:0/4280744712 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbd3fff700 1 --2- 172.21.15.142:0/4280744712 >> v2:172.21.15.148:3300/0 conn(0x7fdbd4157ab0 0x7fdbd415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537966688 0 0) 0x7fdbd40d0550 con 0x7fdbd40cc3b0 2023-09-30T22:58:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.734+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc4003570 con 0x7fdbd40cc3b0 2023-09-30T22:58:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 781663044 0 0) 0x7fdbc4003570 con 0x7fdbd40cc3b0 2023-09-30T22:58:57.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 >> v2:172.21.15.148:3300/0 conn(0x7fdbd4157ab0 msgr2=0x7fdbd415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 --2- 172.21.15.142:0/4280744712 >> v2:172.21.15.148:3300/0 conn(0x7fdbd4157ab0 0x7fdbd415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 >> v1:172.21.15.148:6789/0 conn(0x7fdbd40cbfe0 legacy=0x7fdbd41573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40cff00 con 0x7fdbd40cc3b0 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fdbcc0017f0 con 0x7fdbd40cc3b0 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 >> v1:172.21.15.142:6789/0 conn(0x7fdbd40cc3b0 legacy=0x7fdbd406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc4003a60 0x7fdbc4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc4004810 0x7fdbc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc40051c0 0x7fdbc400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40cfc20 con 0x7fdbc40051c0 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc400c160 con 0x7fdbc4004810 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc400c320 con 0x7fdbc4003a60 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd919c700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc40051c0 0x7fdbc400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd899b700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc4003a60 0x7fdbc4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd3fff700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc4004810 0x7fdbc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd919c700 1 -- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc4003a60 msgr2=0x7fdbc4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd919c700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbc4003a60 0x7fdbc4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd919c700 1 -- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc4004810 msgr2=0x7fdbc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.735+0000 7fdbd919c700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc4004810 0x7fdbc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbd919c700 1 -- 172.21.15.142:0/4280744712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4003570 con 0x7fdbc40051c0 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbd919c700 1 -- 172.21.15.142:0/4280744712 reap_dead start 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbd919c700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc40051c0 0x7fdbc400ba60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00a930 tx=0x7fdbcc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fded8b8df530b79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0070d0 con 0x7fdbc40051c0 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc007230 con 0x7fdbc40051c0 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbd37fe700 1 -- 172.21.15.142:0/4280744712 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0075d0 con 0x7fdbc40051c0 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbdabff700 1 -- 172.21.15.142:0/4280744712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc40051c0 msgr2=0x7fdbc400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.736+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc40051c0 0x7fdbc400ba60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00a930 tx=0x7fdbcc0021d0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.737+0000 7fdbdabff700 1 -- 172.21.15.142:0/4280744712 shutdown_connections 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.737+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4280744712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbc40051c0 0x7fdbc400ba60 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.737+0000 7fdbdabff700 1 -- 172.21.15.142:0/4280744712 >> 172.21.15.142:0/4280744712 conn(0x7fdbd40d0a80 msgr2=0x7fdbd40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.737+0000 7fdbdabff700 1 -- 172.21.15.142:0/4280744712 shutdown_connections 2023-09-30T22:58:57.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.737+0000 7fdbdabff700 1 -- 172.21.15.142:0/4280744712 wait complete. 2023-09-30T22:58:57.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.738+0000 7fdbdabff700 1 Processor -- start 2023-09-30T22:58:57.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.738+0000 7fdbdabff700 1 -- start start 2023-09-30T22:58:57.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbdabff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40051c0 0x7fdbd4144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbdabff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40b8330 0x7fdbd40cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbdabff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd40b87a0 0x7fdbd416d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbdabff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40c52e0 con 0x7fdbd40b8330 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbdabff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40c9e90 con 0x7fdbc40051c0 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbdabff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4155d90 con 0x7fdbd40b87a0 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbd3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40b8330 0x7fdbd40cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbd3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40b8330 0x7fdbd40cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56048/0 (socket says 172.21.15.142:56048) 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.739+0000 7fdbd3fff700 1 -- 172.21.15.142:0/4049692694 learned_addr learned my addr 172.21.15.142:0/4049692694 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd919c700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd40b87a0 0x7fdbd416d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd899b700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40051c0 0x7fdbd4144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd3fff700 1 -- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd40b87a0 msgr2=0x7fdbd416d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd3fff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd40b87a0 0x7fdbd416d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd3fff700 1 -- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40051c0 msgr2=0x7fdbd4144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd3fff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40051c0 0x7fdbd4144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd3fff700 1 -- 172.21.15.142:0/4049692694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40c5000 con 0x7fdbd40b8330 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd919c700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd40b87a0 0x7fdbd416d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd899b700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40051c0 0x7fdbd4144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd3fff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40b8330 0x7fdbd40cab60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009fd0 tx=0x7fdbc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd0ff9700 1 -- 172.21.15.142:0/4049692694 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000f940 con 0x7fdbd40b8330 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd0ff9700 1 -- 172.21.15.142:0/4049692694 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000faa0 con 0x7fdbd40b8330 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbd0ff9700 1 -- 172.21.15.142:0/4049692694 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000fe20 con 0x7fdbd40b8330 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd40ca080 con 0x7fdbd40b8330 2023-09-30T22:58:57.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.740+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd41445c0 con 0x7fdbd40b8330 2023-09-30T22:58:57.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.741+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd40ca9b0 con 0x7fdbd40b8330 2023-09-30T22:58:57.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.742+0000 7fdbd0ff9700 1 -- 172.21.15.142:0/4049692694 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdbc0014650 con 0x7fdbd40b8330 2023-09-30T22:58:57.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.743+0000 7fdbd0ff9700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbb8067330 0x7fdbb80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:57.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.743+0000 7fdbd0ff9700 1 -- 172.21.15.142:0/4049692694 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdbc0018030 con 0x7fdbd40b8330 2023-09-30T22:58:57.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.743+0000 7fdbd899b700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbb8067330 0x7fdbb80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:57.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.744+0000 7fdbd899b700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbb8067330 0x7fdbb80697e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8007bc0 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:57.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.747+0000 7fdbd0ff9700 1 -- 172.21.15.142:0/4049692694 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdbc0052500 con 0x7fdbd40b8330 2023-09-30T22:58:57.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.936+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdbd406fc10 con 0x7fdbd40b8330 2023-09-30T22:58:57.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.937+0000 7fdbd0ff9700 1 -- 172.21.15.142:0/4049692694 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v133) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdbc0055b20 con 0x7fdbd40b8330 2023-09-30T22:58:57.937 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:58:57.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbb8067330 msgr2=0x7fdbb80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbb8067330 0x7fdbb80697e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8007bc0 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40b8330 msgr2=0x7fdbd40cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40b8330 0x7fdbd40cab60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009fd0 tx=0x7fdbc00091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 shutdown_connections 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdbb8067330 0x7fdbb80697e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdbd40b87a0 0x7fdbd416d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc40051c0 0x7fdbd4144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 --2- 172.21.15.142:0/4049692694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40b8330 0x7fdbd40cab60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 >> 172.21.15.142:0/4049692694 conn(0x7fdbd40d0a80 msgr2=0x7fdbd4156760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 shutdown_connections 2023-09-30T22:58:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:57.939+0000 7fdbdabff700 1 -- 172.21.15.142:0/4049692694 wait complete. 2023-09-30T22:58:57.957 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:58:58.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.152+0000 7fa7253ff700 1 Processor -- start 2023-09-30T22:58:58.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.152+0000 7fa7253ff700 1 -- start start 2023-09-30T22:58:58.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.153+0000 7fa7253ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7200cbfe0 0x7fa72015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.153+0000 7fa7253ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7200d0550 con 0x7fa720157ab0 2023-09-30T22:58:58.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.153+0000 7fa7253ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7200cf940 con 0x7fa7200cc3b0 2023-09-30T22:58:58.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.153+0000 7fa7253ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7200cfc20 con 0x7fa7200cbfe0 2023-09-30T22:58:58.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7200cbfe0 0x7fa72015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa720157ab0 0x7fa72006a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51732/0 (socket says 172.21.15.142:51732) 2023-09-30T22:58:58.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71f7fe700 1 -- 172.21.15.142:0/3383405950 learned_addr learned my addr 172.21.15.142:0/3383405950 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:58.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71dffb700 1 -- 172.21.15.142:0/3383405950 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276614418 0 0) 0x7fa7200d0550 con 0x7fa720157ab0 2023-09-30T22:58:58.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71dffb700 1 -- 172.21.15.142:0/3383405950 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa708003570 con 0x7fa720157ab0 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71effd700 1 -- 172.21.15.142:0/3383405950 >> v1:172.21.15.148:6789/0 conn(0x7fa7200cc3b0 legacy=0x7fa7201573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71effd700 1 -- 172.21.15.142:0/3383405950 >> v1:172.21.15.142:6789/0 conn(0x7fa720157ab0 legacy=0x7fa72006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71effd700 1 -- 172.21.15.142:0/3383405950 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7200cff00 con 0x7fa7200cbfe0 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.154+0000 7fa71effd700 1 --2- 172.21.15.142:0/3383405950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72015a2a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa7100098e0 tx=0x7fa7100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfd764bb4ce8c5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa71dffb700 1 -- 172.21.15.142:0/3383405950 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71000b640 con 0x7fa7200cbfe0 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa71dffb700 1 -- 172.21.15.142:0/3383405950 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71000b7a0 con 0x7fa7200cbfe0 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa71dffb700 1 -- 172.21.15.142:0/3383405950 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71000bb40 con 0x7fa7200cbfe0 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa7253ff700 1 -- 172.21.15.142:0/3383405950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 msgr2=0x7fa72015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa7253ff700 1 --2- 172.21.15.142:0/3383405950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72015a2a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa7100098e0 tx=0x7fa7100091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa7253ff700 1 -- 172.21.15.142:0/3383405950 shutdown_connections 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa7253ff700 1 --2- 172.21.15.142:0/3383405950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72015a2a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa7253ff700 1 -- 172.21.15.142:0/3383405950 >> 172.21.15.142:0/3383405950 conn(0x7fa7200d0a80 msgr2=0x7fa7200d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:58.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa7253ff700 1 -- 172.21.15.142:0/3383405950 shutdown_connections 2023-09-30T22:58:58.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.155+0000 7fa7253ff700 1 -- 172.21.15.142:0/3383405950 wait complete. 2023-09-30T22:58:58.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.157+0000 7fa7253ff700 1 Processor -- start 2023-09-30T22:58:58.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.157+0000 7fa7253ff700 1 -- start start 2023-09-30T22:58:58.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa7253ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72016af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa7253ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7200cc3b0 0x7fa7200b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa7253ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa720157ab0 0x7fa7200b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa7253ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72016c2b0 con 0x7fa7200cbfe0 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa7253ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72016b9c0 con 0x7fa7200cc3b0 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa7253ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72016bc60 con 0x7fa720157ab0 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72016af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72016af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56070/0 (socket says 172.21.15.142:56070) 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 -- 172.21.15.142:0/1978905980 learned_addr learned my addr 172.21.15.142:0/1978905980 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71f7fe700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa720157ab0 0x7fa7200b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71e7fc700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7200cc3b0 0x7fa7200b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 -- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa720157ab0 msgr2=0x7fa7200b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa720157ab0 0x7fa7200b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 -- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7200cc3b0 msgr2=0x7fa7200b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7200cc3b0 0x7fa7200b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.158+0000 7fa71effd700 1 -- 172.21.15.142:0/1978905980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710009420 con 0x7fa7200cbfe0 2023-09-30T22:58:58.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.159+0000 7fa71effd700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72016af70 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa72006cf30 tx=0x7fa710017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.159+0000 7fa706ffd700 1 -- 172.21.15.142:0/1978905980 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71000bb20 con 0x7fa7200cbfe0 2023-09-30T22:58:58.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.159+0000 7fa706ffd700 1 -- 172.21.15.142:0/1978905980 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa710011420 con 0x7fa7200cbfe0 2023-09-30T22:58:58.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.159+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72016bf40 con 0x7fa7200cbfe0 2023-09-30T22:58:58.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.159+0000 7fa706ffd700 1 -- 172.21.15.142:0/1978905980 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100117c0 con 0x7fa7200cbfe0 2023-09-30T22:58:58.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.159+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72016b4b0 con 0x7fa7200cbfe0 2023-09-30T22:58:58.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.160+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7200c7df0 con 0x7fa7200cbfe0 2023-09-30T22:58:58.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.161+0000 7fa706ffd700 1 -- 172.21.15.142:0/1978905980 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa710011b70 con 0x7fa7200cbfe0 2023-09-30T22:58:58.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.162+0000 7fa706ffd700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa70c067330 0x7fa70c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.162+0000 7fa706ffd700 1 -- 172.21.15.142:0/1978905980 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa7100862e0 con 0x7fa7200cbfe0 2023-09-30T22:58:58.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.162+0000 7fa71e7fc700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa70c067330 0x7fa70c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.163+0000 7fa71e7fc700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa70c067330 0x7fa70c0697e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa7200c7ae0 tx=0x7fa714009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.166+0000 7fa706ffd700 1 -- 172.21.15.142:0/1978905980 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa710053140 con 0x7fa7200cbfe0 2023-09-30T22:58:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.356+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa72016b6a0 con 0x7fa7200cbfe0 2023-09-30T22:58:58.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.357+0000 7fa706ffd700 1 -- 172.21.15.142:0/1978905980 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v133) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa710056760 con 0x7fa7200cbfe0 2023-09-30T22:58:58.357 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:58:58.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa70c067330 msgr2=0x7fa70c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa70c067330 0x7fa70c0697e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa7200c7ae0 tx=0x7fa714009040 comp rx=0 tx=0).stop 2023-09-30T22:58:58.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 msgr2=0x7fa72016af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72016af70 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa72006cf30 tx=0x7fa710017000 comp rx=0 tx=0).stop 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 shutdown_connections 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa70c067330 0x7fa70c0697e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa720157ab0 0x7fa7200b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7200cbfe0 0x7fa72016af70 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 --2- 172.21.15.142:0/1978905980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7200cc3b0 0x7fa7200b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 >> 172.21.15.142:0/1978905980 conn(0x7fa7200d0a80 msgr2=0x7fa72006ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 shutdown_connections 2023-09-30T22:58:58.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.359+0000 7fa7253ff700 1 -- 172.21.15.142:0/1978905980 wait complete. 2023-09-30T22:58:58.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:58:58.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.569+0000 7f10673ff700 1 Processor -- start 2023-09-30T22:58:58.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.569+0000 7f10673ff700 1 -- start start 2023-09-30T22:58:58.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.570+0000 7f10673ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c6270 0x7f10601580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.570+0000 7f10673ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f10600c40e0 0x7f10600c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.570+0000 7f10673ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600c38d0 con 0x7f1060141150 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.570+0000 7f10673ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600c4aa0 con 0x7f10600c40e0 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.570+0000 7f10673ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c6aa0 con 0x7f10600c6270 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.570+0000 7f106519b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1060141150 0x7f106015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51734/0 (socket says 172.21.15.142:51734) 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.570+0000 7f106519b700 1 -- 172.21.15.142:0/1416586475 learned_addr learned my addr 172.21.15.142:0/1416586475 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f106499a700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c6270 0x7f10601580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f106599c700 1 --2- 172.21.15.142:0/1416586475 >> v2:172.21.15.148:3300/0 conn(0x7f10600c40e0 0x7f10600c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936607959 0 0) 0x7f10600c38d0 con 0x7f1060141150 2023-09-30T22:58:58.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104c003570 con 0x7f1060141150 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1398468723 0 0) 0x7f104c003570 con 0x7f1060141150 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c6270 msgr2=0x7f10601580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c6270 0x7f10601580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 >> v2:172.21.15.148:3300/0 conn(0x7f10600c40e0 msgr2=0x7f10600c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 --2- 172.21.15.142:0/1416586475 >> v2:172.21.15.148:3300/0 conn(0x7f10600c40e0 0x7f10600c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106006a040 con 0x7f1060141150 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f105c001470 con 0x7f1060141150 2023-09-30T22:58:58.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 >> v1:172.21.15.142:6789/0 conn(0x7f1060141150 legacy=0x7f106015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f104c003a60 0x7f104c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c004810 0x7f104c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c0051c0 0x7f104c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c4aa0 con 0x7f104c004810 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c6aa0 con 0x7f104c0051c0 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104c00bfa0 con 0x7f104c003a60 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.571+0000 7f106499a700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c6270 0x7f10601580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106599c700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c0051c0 0x7f104c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106519b700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f104c003a60 0x7f104c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106499a700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c004810 0x7f104c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106599c700 1 -- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f104c003a60 msgr2=0x7f104c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106599c700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f104c003a60 0x7f104c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106599c700 1 -- 172.21.15.142:0/1416586475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c004810 msgr2=0x7f104c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106599c700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c004810 0x7f104c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106599c700 1 -- 172.21.15.142:0/1416586475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c003570 con 0x7f104c0051c0 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106499a700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c004810 0x7f104c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.572+0000 7f106599c700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c0051c0 0x7f104c00ba60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f105800e210 tx=0x7f105800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24c27708234bc19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800eac0 con 0x7f104c0051c0 2023-09-30T22:58:58.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800f040 con 0x7f104c0051c0 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f1057fff700 1 -- 172.21.15.142:0/1416586475 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800ee70 con 0x7f104c0051c0 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f10673ff700 1 -- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c0051c0 msgr2=0x7f104c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f10673ff700 1 --2- 172.21.15.142:0/1416586475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f104c0051c0 0x7f104c00ba60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f105800e210 tx=0x7f105800b040 comp rx=0 tx=0).stop 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f106599c700 1 -- 172.21.15.142:0/1416586475 reap_dead start 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f10673ff700 1 -- 172.21.15.142:0/1416586475 shutdown_connections 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f10673ff700 1 -- 172.21.15.142:0/1416586475 >> 172.21.15.142:0/1416586475 conn(0x7f10600cc670 msgr2=0x7f10600cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f10673ff700 1 -- 172.21.15.142:0/1416586475 shutdown_connections 2023-09-30T22:58:58.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.573+0000 7f10673ff700 1 -- 172.21.15.142:0/1416586475 wait complete. 2023-09-30T22:58:58.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.575+0000 7f10673ff700 1 Processor -- start 2023-09-30T22:58:58.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.575+0000 7f10673ff700 1 -- start start 2023-09-30T22:58:58.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f10673ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c0051c0 0x7f106013f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f10673ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10600be370 0x7f10600be7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f10673ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600b8b90 0x7f10600b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f10673ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600bed20 con 0x7f104c0051c0 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f10673ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600b9900 con 0x7f10600be370 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f10673ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600b9be0 con 0x7f10600b8b90 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c0051c0 0x7f106013f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c0051c0 0x7f106013f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56092/0 (socket says 172.21.15.142:56092) 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 -- 172.21.15.142:0/699799318 learned_addr learned my addr 172.21.15.142:0/699799318 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:58.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106599c700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600b8b90 0x7f10600b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106499a700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10600be370 0x7f10600be7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 -- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600b8b90 msgr2=0x7f10600b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600b8b90 0x7f10600b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 -- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10600be370 msgr2=0x7f10600be7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10600be370 0x7f10600be7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 -- 172.21.15.142:0/699799318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600b9ec0 con 0x7f104c0051c0 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.576+0000 7f106519b700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c0051c0 0x7f106013f300 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f105c0074e0 tx=0x7f106006a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.577+0000 7f10557fa700 1 -- 172.21.15.142:0/699799318 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c018030 con 0x7f104c0051c0 2023-09-30T22:58:58.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.577+0000 7f10557fa700 1 -- 172.21.15.142:0/699799318 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c00f9a0 con 0x7f104c0051c0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.577+0000 7f10557fa700 1 -- 172.21.15.142:0/699799318 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c00fd40 con 0x7f104c0051c0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.577+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600ba1a0 con 0x7f104c0051c0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.577+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600b9530 con 0x7f104c0051c0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.578+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1060069a50 con 0x7f104c0051c0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.579+0000 7f10557fa700 1 -- 172.21.15.142:0/699799318 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f105c01b070 con 0x7f104c0051c0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.579+0000 7f10557fa700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1044067330 0x7f10440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.580+0000 7f10557fa700 1 -- 172.21.15.142:0/699799318 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f105c019070 con 0x7f104c0051c0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.580+0000 7f106499a700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1044067330 0x7f10440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.580+0000 7f106499a700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1044067330 0x7f10440697e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10600c90b0 tx=0x7f1050008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.584+0000 7f10557fa700 1 -- 172.21.15.142:0/699799318 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f105c051c20 con 0x7f104c0051c0 2023-09-30T22:58:58.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.774+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1060157ea0 con 0x7f104c0051c0 2023-09-30T22:58:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.774+0000 7f10557fa700 1 -- 172.21.15.142:0/699799318 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v133) v1 ==== 100+0+11 (secure 0 0 0) 0x7f105c00fea0 con 0x7f104c0051c0 2023-09-30T22:58:58.774 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:58:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1044067330 msgr2=0x7f10440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1044067330 0x7f10440697e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10600c90b0 tx=0x7f1050008040 comp rx=0 tx=0).stop 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c0051c0 msgr2=0x7f106013f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c0051c0 0x7f106013f300 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f105c0074e0 tx=0x7f106006a1d0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 shutdown_connections 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1044067330 0x7f10440697e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600b8b90 0x7f10600b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f104c0051c0 0x7f106013f300 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 --2- 172.21.15.142:0/699799318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10600be370 0x7f10600be7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 >> 172.21.15.142:0/699799318 conn(0x7f10600cc670 msgr2=0x7f10600c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 shutdown_connections 2023-09-30T22:58:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.776+0000 7f10673ff700 1 -- 172.21.15.142:0/699799318 wait complete. 2023-09-30T22:58:58.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:58.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.984+0000 7f8ae67ff700 1 Processor -- start 2023-09-30T22:58:58.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.984+0000 7f8ae67ff700 1 -- start start 2023-09-30T22:58:58.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8ae67ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ae00aebf0 0x7f8ae006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8ae67ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8ae67ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ae015a0d0 0x7f8ae0156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8ae67ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae00aefc0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8ae67ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae015a550 con 0x7f8ae015a0d0 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8ae67ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00b0ee0 con 0x7f8ae006f190 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8adffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ae00aebf0 0x7f8ae006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8adffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ae00aebf0 0x7f8ae006ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56102/0 (socket says 172.21.15.142:56102) 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8adffff700 1 -- 172.21.15.142:0/823165374 learned_addr learned my addr 172.21.15.142:0/823165374 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8ae4d9c700 1 --2- 172.21.15.142:0/823165374 >> v2:172.21.15.148:3300/0 conn(0x7f8ae015a0d0 0x7f8ae0156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8adf7fe700 1 --2- 172.21.15.142:0/823165374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8adffff700 1 -- 172.21.15.142:0/823165374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 msgr2=0x7f8ae0159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8adffff700 1 --2- 172.21.15.142:0/823165374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.986+0000 7f8adffff700 1 -- 172.21.15.142:0/823165374 >> v2:172.21.15.148:3300/0 conn(0x7f8ae015a0d0 msgr2=0x7f8ae0156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8adffff700 1 --2- 172.21.15.142:0/823165374 >> v2:172.21.15.148:3300/0 conn(0x7f8ae015a0d0 0x7f8ae0156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8adffff700 1 -- 172.21.15.142:0/823165374 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00b02d0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8adffff700 1 --2- 172.21.15.142:0/823165374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae006ec50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00685e0 tx=0x7f8ad0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde30763506b3fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8adeffd700 1 -- 172.21.15.142:0/823165374 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000b7e0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8adeffd700 1 -- 172.21.15.142:0/823165374 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000b940 con 0x7f8ae00aebf0 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8adeffd700 1 -- 172.21.15.142:0/823165374 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000bce0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8ae67ff700 1 -- 172.21.15.142:0/823165374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 msgr2=0x7f8ae006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.987+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/823165374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae006ec50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00685e0 tx=0x7f8ad0009250 comp rx=0 tx=0).stop 2023-09-30T22:58:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.988+0000 7f8ae67ff700 1 -- 172.21.15.142:0/823165374 shutdown_connections 2023-09-30T22:58:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.988+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/823165374 >> v2:172.21.15.148:3300/0 conn(0x7f8ae015a0d0 0x7f8ae0156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.988+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/823165374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae006ec50 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.988+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/823165374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.988+0000 7f8ae67ff700 1 -- 172.21.15.142:0/823165374 >> 172.21.15.142:0/823165374 conn(0x7f8ae00680c0 msgr2=0x7f8ae00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.988+0000 7f8ae67ff700 1 -- 172.21.15.142:0/823165374 shutdown_connections 2023-09-30T22:58:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.988+0000 7f8ae67ff700 1 -- 172.21.15.142:0/823165374 wait complete. 2023-09-30T22:58:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.990+0000 7f8ae67ff700 1 Processor -- start 2023-09-30T22:58:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.990+0000 7f8ae67ff700 1 -- start start 2023-09-30T22:58:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8ae67ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8ae67ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae0158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8ae67ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ae015a0d0 0x7f8ae01431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8ae67ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0152a40 con 0x7f8ae00aebf0 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8ae67ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0147820 con 0x7f8ae015a0d0 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8ae67ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0152cc0 con 0x7f8ae006f190 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8adf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae0158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8adf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae0158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56118/0 (socket says 172.21.15.142:56118) 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8adf7fe700 1 -- 172.21.15.142:0/1853360897 learned_addr learned my addr 172.21.15.142:0/1853360897 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8adffff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.991+0000 7f8ae4d9c700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ae015a0d0 0x7f8ae01431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8adf7fe700 1 -- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 msgr2=0x7f8ae0145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8adf7fe700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8adf7fe700 1 -- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ae015a0d0 msgr2=0x7f8ae01431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8adf7fe700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ae015a0d0 0x7f8ae01431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8adf7fe700 1 -- 172.21.15.142:0/1853360897 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00094f0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8ae4d9c700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ae015a0d0 0x7f8ae01431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8adf7fe700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae0158df0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d860 tx=0x7f8ad4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8ac7fff700 1 -- 172.21.15.142:0/1853360897 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40125f0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8ac7fff700 1 -- 172.21.15.142:0/1853360897 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad4012750 con 0x7f8ae00aebf0 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0159330 con 0x7f8ae00aebf0 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8ac7fff700 1 -- 172.21.15.142:0/1853360897 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4012af0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.992+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae0147540 con 0x7f8ae00aebf0 2023-09-30T22:58:58.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.993+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae00695b0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.994+0000 7f8ac7fff700 1 -- 172.21.15.142:0/1853360897 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ad401e460 con 0x7f8ae00aebf0 2023-09-30T22:58:58.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.995+0000 7f8ac7fff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8acc067330 0x7f8acc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:58.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.995+0000 7f8ac7fff700 1 -- 172.21.15.142:0/1853360897 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ad40851e0 con 0x7f8ae00aebf0 2023-09-30T22:58:58.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.995+0000 7f8adffff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8acc067330 0x7f8acc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:58.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.996+0000 7f8adffff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8acc067330 0x7f8acc0697e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00685e0 tx=0x7f8ad0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:58.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:58.999+0000 7f8ac7fff700 1 -- 172.21.15.142:0/1853360897 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ad4055ad0 con 0x7f8ae00aebf0 2023-09-30T22:58:59.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.228+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ae006fc10 con 0x7f8ae00aebf0 2023-09-30T22:58:59.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.228+0000 7f8ac7fff700 1 -- 172.21.15.142:0/1853360897 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f8ad4055660 con 0x7f8ae00aebf0 2023-09-30T22:58:59.228 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:59.228 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8acc067330 msgr2=0x7f8acc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8acc067330 0x7f8acc0697e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00685e0 tx=0x7f8ad0017000 comp rx=0 tx=0).stop 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 msgr2=0x7f8ae0158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae0158df0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d860 tx=0x7f8ad4008040 comp rx=0 tx=0).stop 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 shutdown_connections 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8acc067330 0x7f8acc0697e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ae015a0d0 0x7f8ae01431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ae006f190 0x7f8ae0145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 --2- 172.21.15.142:0/1853360897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ae00aebf0 0x7f8ae0158df0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 >> 172.21.15.142:0/1853360897 conn(0x7f8ae00680c0 msgr2=0x7f8ae00cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 shutdown_connections 2023-09-30T22:58:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.231+0000 7f8ae67ff700 1 -- 172.21.15.142:0/1853360897 wait complete. 2023-09-30T22:58:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:58:59.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:58:59.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.440+0000 7f33b7fff700 1 Processor -- start 2023-09-30T22:58:59.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.440+0000 7f33b7fff700 1 -- start start 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.441+0000 7f33b7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f33b00af020 0x7f33b0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.441+0000 7f33b7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33b00b00d0 0x7f33b006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.441+0000 7f33b7fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b006d3e0 con 0x7f33b006e650 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.441+0000 7f33b7fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b015b400 con 0x7f33b00b00d0 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.441+0000 7f33b7fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b006dc80 con 0x7f33b00af020 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33b00b00d0 0x7f33b006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33b00b00d0 0x7f33b006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56132/0 (socket says 172.21.15.142:56132) 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 -- 172.21.15.142:0/1254856899 learned_addr learned my addr 172.21.15.142:0/1254856899 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:59.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b5d9b700 1 --2- 172.21.15.142:0/1254856899 >> v2:172.21.15.148:3300/0 conn(0x7f33b00af020 0x7f33b0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 -- 172.21.15.142:0/1254856899 >> v2:172.21.15.148:3300/0 conn(0x7f33b00af020 msgr2=0x7f33b0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:59.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 --2- 172.21.15.142:0/1254856899 >> v2:172.21.15.148:3300/0 conn(0x7f33b00af020 0x7f33b0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 -- 172.21.15.142:0/1254856899 >> v1:172.21.15.148:6789/0 conn(0x7f33b006e650 legacy=0x7f33b00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 -- 172.21.15.142:0/1254856899 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b006b790 con 0x7f33b00b00d0 2023-09-30T22:58:59.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b559a700 1 --2- 172.21.15.142:0/1254856899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b006e110 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f33a00099b0 tx=0x7f33a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8e7bde349472da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.442+0000 7f33b4d99700 1 -- 172.21.15.142:0/1254856899 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0009ea0 con 0x7f33b00b00d0 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b4d99700 1 -- 172.21.15.142:0/1254856899 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a000b820 con 0x7f33b00b00d0 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b4d99700 1 -- 172.21.15.142:0/1254856899 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000bbc0 con 0x7f33b00b00d0 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 -- 172.21.15.142:0/1254856899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 msgr2=0x7f33b006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 --2- 172.21.15.142:0/1254856899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b006e110 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f33a00099b0 tx=0x7f33a0009250 comp rx=0 tx=0).stop 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 -- 172.21.15.142:0/1254856899 shutdown_connections 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 --2- 172.21.15.142:0/1254856899 >> v2:172.21.15.148:3300/0 conn(0x7f33b00af020 0x7f33b0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 --2- 172.21.15.142:0/1254856899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b006e110 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 -- 172.21.15.142:0/1254856899 >> 172.21.15.142:0/1254856899 conn(0x7f33b00680c0 msgr2=0x7f33b00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:59.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 -- 172.21.15.142:0/1254856899 shutdown_connections 2023-09-30T22:58:59.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.443+0000 7f33b7fff700 1 -- 172.21.15.142:0/1254856899 wait complete. 2023-09-30T22:58:59.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.445+0000 7f33b7fff700 1 Processor -- start 2023-09-30T22:58:59.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.445+0000 7f33b7fff700 1 -- start start 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b7fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f33b006e650 0x7f33b0149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33b00af020 0x7f33b016db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b016e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0149490 con 0x7f33b00b00d0 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b7fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0148880 con 0x7f33b00af020 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b7fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0148b60 con 0x7f33b006e650 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b016e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b5d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f33b006e650 0x7f33b0149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b016e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56140/0 (socket says 172.21.15.142:56140) 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b5d9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f33b006e650 0x7f33b0149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:50104/0 (socket says 172.21.15.142:50104) 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b659c700 1 -- 172.21.15.142:0/4126394237 learned_addr learned my addr 172.21.15.142:0/4126394237 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.446+0000 7f33b559a700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33b00af020 0x7f33b016db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b659c700 1 -- 172.21.15.142:0/4126394237 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f33b006e650 msgr2=0x7f33b0149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b659c700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f33b006e650 0x7f33b0149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b659c700 1 -- 172.21.15.142:0/4126394237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33b00af020 msgr2=0x7f33b016db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b659c700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33b00af020 0x7f33b016db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b659c700 1 -- 172.21.15.142:0/4126394237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00094f0 con 0x7f33b00b00d0 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b659c700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b016e040 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c8e0 tx=0x7f33a8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33a5ffb700 1 -- 172.21.15.142:0/4126394237 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8012630 con 0x7f33b00b00d0 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33a5ffb700 1 -- 172.21.15.142:0/4126394237 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a8012790 con 0x7f33b00b00d0 2023-09-30T22:58:59.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b0148e40 con 0x7f33b00b00d0 2023-09-30T22:58:59.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33a5ffb700 1 -- 172.21.15.142:0/4126394237 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8012b50 con 0x7f33b00b00d0 2023-09-30T22:58:59.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.447+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b0146a70 con 0x7f33b00b00d0 2023-09-30T22:58:59.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.448+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b0149600 con 0x7f33b00b00d0 2023-09-30T22:58:59.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.449+0000 7f33a5ffb700 1 -- 172.21.15.142:0/4126394237 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f33a801a3a0 con 0x7f33b00b00d0 2023-09-30T22:58:59.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.450+0000 7f33a5ffb700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3394067330 0x7f33940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.450+0000 7f33a5ffb700 1 -- 172.21.15.142:0/4126394237 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f33a8084de0 con 0x7f33b00b00d0 2023-09-30T22:58:59.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.450+0000 7f33b5d9b700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3394067330 0x7f33940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.451+0000 7f33b5d9b700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3394067330 0x7f33940697e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009db0 tx=0x7f33ac0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:59.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.454+0000 7f33a5ffb700 1 -- 172.21.15.142:0/4126394237 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f33a80556d0 con 0x7f33b00b00d0 2023-09-30T22:58:59.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.645+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33b006fc10 con 0x7f33b00b00d0 2023-09-30T22:58:59.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.645+0000 7f33a5ffb700 1 -- 172.21.15.142:0/4126394237 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+17033 (secure 0 0 0) 0x7f33a8055260 con 0x7f33b00b00d0 2023-09-30T22:58:59.646 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:58:59.646 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":133,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:53.338123+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:58:37.968620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-09-30T22:58:39.134383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:58:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3394067330 msgr2=0x7f33940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3394067330 0x7f33940697e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009db0 tx=0x7f33ac0091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 msgr2=0x7f33b016e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b016e040 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c8e0 tx=0x7f33a8001710 comp rx=0 tx=0).stop 2023-09-30T22:58:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 shutdown_connections 2023-09-30T22:58:59.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3394067330 0x7f33940697e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33b00b00d0 0x7f33b016e040 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f33b006e650 0x7f33b0149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 --2- 172.21.15.142:0/4126394237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33b00af020 0x7f33b016db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 >> 172.21.15.142:0/4126394237 conn(0x7f33b00680c0 msgr2=0x7f33b00cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 shutdown_connections 2023-09-30T22:58:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.648+0000 7f33b7fff700 1 -- 172.21.15.142:0/4126394237 wait complete. 2023-09-30T22:58:59.666 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:58:59.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:58:59.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.855+0000 7f2e51fff700 1 Processor -- start 2023-09-30T22:58:59.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.856+0000 7f2e51fff700 1 -- start start 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e51fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 0x7f2e4c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e51fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e4c15dc50 0x7f2e4c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e51fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c15e0b0 con 0x7f2e4c143350 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e51fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0cc6b0 con 0x7f2e4c15dc50 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e51fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0cbaa0 con 0x7f2e4c0692f0 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e4b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2e4c143350 0x7f2e4c0cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51736/0 (socket says 172.21.15.142:51736) 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e4b7fe700 1 -- 172.21.15.142:0/1197225368 learned_addr learned my addr 172.21.15.142:0/1197225368 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:58:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e4bfff700 1 --2- 172.21.15.142:0/1197225368 >> v2:172.21.15.148:3300/0 conn(0x7f2e4c15dc50 0x7f2e4c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e4affd700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 0x7f2e4c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.857+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236001152 0 0) 0x7f2e3c001110 con 0x7f2e4c143350 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e34003570 con 0x7f2e4c143350 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748824201 0 0) 0x7f2e34003570 con 0x7f2e4c143350 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 msgr2=0x7f2e4c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 0x7f2e4c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 >> v2:172.21.15.148:3300/0 conn(0x7f2e4c15dc50 msgr2=0x7f2e4c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/1197225368 >> v2:172.21.15.148:3300/0 conn(0x7f2e4c15dc50 0x7f2e4c06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0cbd80 con 0x7f2e4c143350 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f2e3c001600 con 0x7f2e4c143350 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 >> v1:172.21.15.142:6789/0 conn(0x7f2e4c143350 legacy=0x7f2e4c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34003a60 0x7f2e34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e34004810 0x7f2e34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 0x7f2e340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0cc6b0 con 0x7f2e34004810 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0cbaa0 con 0x7f2e34003a60 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3400ba60 con 0x7f2e4c0692f0 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4affd700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e34004810 0x7f2e34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4b7fe700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34003a60 0x7f2e34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.858+0000 7f2e4bfff700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 0x7f2e340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4affd700 1 -- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 msgr2=0x7f2e340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4affd700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e4c0692f0 0x7f2e340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4affd700 1 -- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34003a60 msgr2=0x7f2e34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4affd700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34003a60 0x7f2e34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4affd700 1 -- 172.21.15.142:0/1197225368 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34003570 con 0x7f2e34004810 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4affd700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e34004810 0x7f2e34004c80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009c30 tx=0x7f2e400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94582c8c0090eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000e710 con 0x7f2e34004810 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4000e870 con 0x7f2e34004810 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.859+0000 7f2e4a7fc700 1 -- 172.21.15.142:0/1197225368 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000ec30 con 0x7f2e34004810 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.860+0000 7f2e51fff700 1 -- 172.21.15.142:0/1197225368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e34004810 msgr2=0x7f2e34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.860+0000 7f2e51fff700 1 --2- 172.21.15.142:0/1197225368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e34004810 0x7f2e34004c80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009c30 tx=0x7f2e400091a0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.860+0000 7f2e4bfff700 1 -- 172.21.15.142:0/1197225368 reap_dead start 2023-09-30T22:58:59.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.860+0000 7f2e51fff700 1 -- 172.21.15.142:0/1197225368 shutdown_connections 2023-09-30T22:58:59.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.860+0000 7f2e51fff700 1 -- 172.21.15.142:0/1197225368 >> 172.21.15.142:0/1197225368 conn(0x7f2e4c0ce8e0 msgr2=0x7f2e4c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:58:59.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.860+0000 7f2e51fff700 1 -- 172.21.15.142:0/1197225368 shutdown_connections 2023-09-30T22:58:59.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.860+0000 7f2e51fff700 1 -- 172.21.15.142:0/1197225368 wait complete. 2023-09-30T22:58:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.861+0000 7f2e51fff700 1 Processor -- start 2023-09-30T22:58:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.861+0000 7f2e51fff700 1 -- start start 2023-09-30T22:58:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e51fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e34004810 0x7f2e4c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e51fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c13af10 0x7f2e4c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e51fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b28d0 0x7f2e4c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e51fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0b3270 con 0x7f2e4c13af10 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e51fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15b880 con 0x7f2e4c0b28d0 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e51fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15bb60 con 0x7f2e34004810 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e4affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c13af10 0x7f2e4c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.862+0000 7f2e4affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c13af10 0x7f2e4c159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56156/0 (socket says 172.21.15.142:56156) 2023-09-30T22:58:59.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4affd700 1 -- 172.21.15.142:0/846270247 learned_addr learned my addr 172.21.15.142:0/846270247 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:58:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4b7fe700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e34004810 0x7f2e4c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4bfff700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b28d0 0x7f2e4c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4affd700 1 -- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e34004810 msgr2=0x7f2e4c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4affd700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e34004810 0x7f2e4c15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4affd700 1 -- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b28d0 msgr2=0x7f2e4c0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:58:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4affd700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b28d0 0x7f2e4c0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:58:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4affd700 1 -- 172.21.15.142:0/846270247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c15aac0 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e4affd700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c13af10 0x7f2e4c159020 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000e4b0 tx=0x7f2e4001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e337fe700 1 -- 172.21.15.142:0/846270247 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40022070 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e337fe700 1 -- 172.21.15.142:0/846270247 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4000e9e0 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e337fe700 1 -- 172.21.15.142:0/846270247 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40006e50 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.863+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c15ada0 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.864+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c15a700 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.865+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c06ea70 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.865+0000 7f2e337fe700 1 -- 172.21.15.142:0/846270247 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2e4001c660 con 0x7f2e4c13af10 2023-09-30T22:58:59.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.867+0000 7f2e337fe700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:58:59.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.867+0000 7f2e337fe700 1 -- 172.21.15.142:0/846270247 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e400861b0 con 0x7f2e4c13af10 2023-09-30T22:58:59.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.867+0000 7f2e4b7fe700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:58:59.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.867+0000 7f2e4b7fe700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c007fd0 tx=0x7f2e3c007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:58:59.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:58:59.871+0000 7f2e337fe700 1 -- 172.21.15.142:0/846270247 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2e400530c0 con 0x7f2e4c13af10 2023-09-30T22:59:00.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.103+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e4c15bca0 con 0x7f2e4c13af10 2023-09-30T22:59:00.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.103+0000 7f2e337fe700 1 -- 172.21.15.142:0/846270247 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f2e400566e0 con 0x7f2e4c13af10 2023-09-30T22:59:00.103 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:00.103 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 msgr2=0x7f2e380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c007fd0 tx=0x7f2e3c007a80 comp rx=0 tx=0).stop 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c13af10 msgr2=0x7f2e4c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c13af10 0x7f2e4c159020 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000e4b0 tx=0x7f2e4001a000 comp rx=0 tx=0).stop 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 shutdown_connections 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2e38067330 0x7f2e380697e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e4c0b28d0 0x7f2e4c0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e34004810 0x7f2e4c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 --2- 172.21.15.142:0/846270247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4c13af10 0x7f2e4c159020 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 >> 172.21.15.142:0/846270247 conn(0x7f2e4c0ce8e0 msgr2=0x7f2e4c0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:00.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 shutdown_connections 2023-09-30T22:59:00.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.106+0000 7f2e51fff700 1 -- 172.21.15.142:0/846270247 wait complete. 2023-09-30T22:59:00.107 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:59:00.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:00.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.314+0000 7f7de53ff700 1 Processor -- start 2023-09-30T22:59:00.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.314+0000 7f7de53ff700 1 -- start start 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.315+0000 7f7de53ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7de00af020 0x7f7de0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.315+0000 7f7de53ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7de00b00d0 0x7f7de006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.315+0000 7f7de53ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de006d3e0 con 0x7f7de006e650 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.315+0000 7f7de53ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de015b400 con 0x7f7de00af020 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.315+0000 7f7de53ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de006dc80 con 0x7f7de00b00d0 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7de00af020 0x7f7de0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7de00af020 0x7f7de0156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56158/0 (socket says 172.21.15.142:56158) 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 -- 172.21.15.142:0/1671969705 learned_addr learned my addr 172.21.15.142:0/1671969705 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 -- 172.21.15.142:0/1671969705 >> v2:172.21.15.148:3300/0 conn(0x7f7de00b00d0 msgr2=0x7f7de006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 --2- 172.21.15.142:0/1671969705 >> v2:172.21.15.148:3300/0 conn(0x7f7de00b00d0 0x7f7de006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 -- 172.21.15.142:0/1671969705 >> v1:172.21.15.148:6789/0 conn(0x7f7de006e650 legacy=0x7f7de00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 -- 172.21.15.142:0/1671969705 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de006b790 con 0x7f7de00af020 2023-09-30T22:59:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7ddeffd700 1 --2- 172.21.15.142:0/1671969705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00af020 0x7f7de0156d80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00099b0 tx=0x7f7dd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd1de3d77661558 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.316+0000 7f7dddffb700 1 -- 172.21.15.142:0/1671969705 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000b7e0 con 0x7f7de00af020 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7dddffb700 1 -- 172.21.15.142:0/1671969705 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000b940 con 0x7f7de00af020 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7dddffb700 1 -- 172.21.15.142:0/1671969705 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bce0 con 0x7f7de00af020 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 -- 172.21.15.142:0/1671969705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00af020 msgr2=0x7f7de0156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1671969705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00af020 0x7f7de0156d80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00099b0 tx=0x7f7dd0009250 comp rx=0 tx=0).stop 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 -- 172.21.15.142:0/1671969705 shutdown_connections 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1671969705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00af020 0x7f7de0156d80 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1671969705 >> v2:172.21.15.148:3300/0 conn(0x7f7de00b00d0 0x7f7de006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 -- 172.21.15.142:0/1671969705 >> 172.21.15.142:0/1671969705 conn(0x7f7de00680c0 msgr2=0x7f7de00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:00.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 -- 172.21.15.142:0/1671969705 shutdown_connections 2023-09-30T22:59:00.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.317+0000 7f7de53ff700 1 -- 172.21.15.142:0/1671969705 wait complete. 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.319+0000 7f7de53ff700 1 Processor -- start 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.319+0000 7f7de53ff700 1 -- start start 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7de53ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de006e650 0x7f7de015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7de53ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de00af020 0x7f7de015d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7de53ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00b00d0 0x7f7de015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7de53ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de014d1f0 con 0x7f7de00b00d0 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7de53ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de015e0b0 con 0x7f7de00af020 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7de53ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de015e330 con 0x7f7de006e650 2023-09-30T22:59:00.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00b00d0 0x7f7de015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00b00d0 0x7f7de015db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56164/0 (socket says 172.21.15.142:56164) 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 -- 172.21.15.142:0/1230693052 learned_addr learned my addr 172.21.15.142:0/1230693052 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddeffd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de006e650 0x7f7de015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7dde7fc700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de00af020 0x7f7de015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 -- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de006e650 msgr2=0x7f7de015f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de006e650 0x7f7de015f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 -- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de00af020 msgr2=0x7f7de015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de00af020 0x7f7de015d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.320+0000 7f7ddf7fe700 1 -- 172.21.15.142:0/1230693052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd00094f0 con 0x7f7de00b00d0 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.321+0000 7f7ddeffd700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de006e650 0x7f7de015f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.321+0000 7f7ddf7fe700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00b00d0 0x7f7de015db70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800bbb0 tx=0x7f7dd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:00.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.321+0000 7f7dc6ffd700 1 -- 172.21.15.142:0/1230693052 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80092e0 con 0x7f7de00b00d0 2023-09-30T22:59:00.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.321+0000 7f7dc6ffd700 1 -- 172.21.15.142:0/1230693052 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd800c630 con 0x7f7de00b00d0 2023-09-30T22:59:00.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.321+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de0157b30 con 0x7f7de00b00d0 2023-09-30T22:59:00.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.321+0000 7f7dc6ffd700 1 -- 172.21.15.142:0/1230693052 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800c9f0 con 0x7f7de00b00d0 2023-09-30T22:59:00.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.321+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de01580f0 con 0x7f7de00b00d0 2023-09-30T22:59:00.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.322+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de00695b0 con 0x7f7de00b00d0 2023-09-30T22:59:00.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.323+0000 7f7dc6ffd700 1 -- 172.21.15.142:0/1230693052 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7dd8012070 con 0x7f7de00b00d0 2023-09-30T22:59:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.324+0000 7f7dc6ffd700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dcc067330 0x7f7dcc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.325+0000 7f7dc6ffd700 1 -- 172.21.15.142:0/1230693052 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7dd8084850 con 0x7f7de00b00d0 2023-09-30T22:59:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.325+0000 7f7ddeffd700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dcc067330 0x7f7dcc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.325+0000 7f7ddeffd700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dcc067330 0x7f7dcc0697e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00099b0 tx=0x7f7dd0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:00.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.329+0000 7f7dc6ffd700 1 -- 172.21.15.142:0/1230693052 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7dd80516b0 con 0x7f7de00b00d0 2023-09-30T22:59:00.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.560+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7de006fc10 con 0x7f7de00b00d0 2023-09-30T22:59:00.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.560+0000 7f7dc6ffd700 1 -- 172.21.15.142:0/1230693052 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f7dd8054cd0 con 0x7f7de00b00d0 2023-09-30T22:59:00.560 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:00.561 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:58:40.149739+0000","modified":"2023-09-30T22:58:43.711024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6484":{"gid":6484,"name":"b","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/302118526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":302118526},{"type":"v1","addr":"172.21.15.148:6834","nonce":302118526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-09-30T22:59:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dcc067330 msgr2=0x7f7dcc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dcc067330 0x7f7dcc0697e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00099b0 tx=0x7f7dd0016000 comp rx=0 tx=0).stop 2023-09-30T22:59:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00b00d0 msgr2=0x7f7de015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00b00d0 0x7f7de015db70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800bbb0 tx=0x7f7dd8009840 comp rx=0 tx=0).stop 2023-09-30T22:59:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 shutdown_connections 2023-09-30T22:59:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7dcc067330 0x7f7dcc0697e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7de00b00d0 0x7f7de015db70 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7de006e650 0x7f7de015f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 --2- 172.21.15.142:0/1230693052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7de00af020 0x7f7de015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 >> 172.21.15.142:0/1230693052 conn(0x7f7de00680c0 msgr2=0x7f7de00c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 shutdown_connections 2023-09-30T22:59:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.563+0000 7f7de53ff700 1 -- 172.21.15.142:0/1230693052 wait complete. 2023-09-30T22:59:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 58 2023-09-30T22:59:00.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.770+0000 7f89a21ff700 1 Processor -- start 2023-09-30T22:59:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.770+0000 7f89a21ff700 1 -- start start 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.771+0000 7f89a21ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f899c1598e0 0x7f899c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.771+0000 7f89a21ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c06b8d0 con 0x7f899c0d03d0 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.771+0000 7f89a21ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0cff40 con 0x7f899c0cee50 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.771+0000 7f89a21ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0cf330 con 0x7f899c1598e0 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.772+0000 7f899b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f899c1598e0 0x7f899c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.772+0000 7f899bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f899c0d03d0 0x7f899c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51748/0 (socket says 172.21.15.142:51748) 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.772+0000 7f899bfff700 1 -- 172.21.15.142:0/660935398 learned_addr learned my addr 172.21.15.142:0/660935398 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.772+0000 7f899b7fe700 1 -- 172.21.15.142:0/660935398 >> v1:172.21.15.148:6789/0 conn(0x7f899c0cee50 legacy=0x7f899c06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.772+0000 7f899b7fe700 1 -- 172.21.15.142:0/660935398 >> v1:172.21.15.142:6789/0 conn(0x7f899c0d03d0 legacy=0x7f899c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.772+0000 7f899b7fe700 1 -- 172.21.15.142:0/660935398 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0cf610 con 0x7f899c1598e0 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.772+0000 7f899b7fe700 1 --2- 172.21.15.142:0/660935398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c159cb0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f898c0098e0 tx=0x7f898c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae53765619b0f6dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f899a7fc700 1 -- 172.21.15.142:0/660935398 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c009e80 con 0x7f899c1598e0 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f899a7fc700 1 -- 172.21.15.142:0/660935398 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00b820 con 0x7f899c1598e0 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f899a7fc700 1 -- 172.21.15.142:0/660935398 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00bba0 con 0x7f899c1598e0 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f89a21ff700 1 -- 172.21.15.142:0/660935398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 msgr2=0x7f899c159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f89a21ff700 1 --2- 172.21.15.142:0/660935398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c159cb0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f898c0098e0 tx=0x7f898c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f89a21ff700 1 -- 172.21.15.142:0/660935398 shutdown_connections 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f89a21ff700 1 --2- 172.21.15.142:0/660935398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c159cb0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f89a21ff700 1 -- 172.21.15.142:0/660935398 >> 172.21.15.142:0/660935398 conn(0x7f899c0cd540 msgr2=0x7f899c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f89a21ff700 1 -- 172.21.15.142:0/660935398 shutdown_connections 2023-09-30T22:59:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.773+0000 7f89a21ff700 1 -- 172.21.15.142:0/660935398 wait complete. 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.775+0000 7f89a21ff700 1 Processor -- start 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.775+0000 7f89a21ff700 1 -- start start 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f89a21ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c0cee50 0x7f899c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f89a21ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c0d03d0 0x7f899c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f89a21ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f89a21ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c156a70 con 0x7f899c1598e0 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f89a21ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0c5450 con 0x7f899c0cee50 2023-09-30T22:59:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f89a21ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0c8d90 con 0x7f899c0d03d0 2023-09-30T22:59:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f899b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c0cee50 0x7f899c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f899bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f899b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c0cee50 0x7f899c156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:47206/0 (socket says 172.21.15.142:47206) 2023-09-30T22:59:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f899b7fe700 1 -- 172.21.15.142:0/3388441243 learned_addr learned my addr 172.21.15.142:0/3388441243 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.776+0000 7f899affd700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c0d03d0 0x7f899c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f899bfff700 1 -- 172.21.15.142:0/3388441243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c0d03d0 msgr2=0x7f899c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f899bfff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c0d03d0 0x7f899c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f899bfff700 1 -- 172.21.15.142:0/3388441243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c0cee50 msgr2=0x7f899c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f899bfff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c0cee50 0x7f899c156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f899bfff700 1 -- 172.21.15.142:0/3388441243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c009420 con 0x7f899c1598e0 2023-09-30T22:59:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f899bfff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c0b5330 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f899400cb90 tx=0x7f89940019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f89837fe700 1 -- 172.21.15.142:0/3388441243 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400a7e0 con 0x7f899c1598e0 2023-09-30T22:59:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f89837fe700 1 -- 172.21.15.142:0/3388441243 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400a960 con 0x7f899c1598e0 2023-09-30T22:59:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c0c4560 con 0x7f899c1598e0 2023-09-30T22:59:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f89837fe700 1 -- 172.21.15.142:0/3388441243 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400ad20 con 0x7f899c1598e0 2023-09-30T22:59:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.777+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c0c4b20 con 0x7f899c1598e0 2023-09-30T22:59:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.778+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c0c55e0 con 0x7f899c1598e0 2023-09-30T22:59:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.779+0000 7f89837fe700 1 -- 172.21.15.142:0/3388441243 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8994007300 con 0x7f899c1598e0 2023-09-30T22:59:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.780+0000 7f89837fe700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8988067330 0x7f89880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.780+0000 7f89837fe700 1 -- 172.21.15.142:0/3388441243 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8994084dd0 con 0x7f899c1598e0 2023-09-30T22:59:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.780+0000 7f899b7fe700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8988067330 0x7f89880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.781+0000 7f899b7fe700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8988067330 0x7f89880697e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f898c0091e0 tx=0x7f898c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:00.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.784+0000 7f89837fe700 1 -- 172.21.15.142:0/3388441243 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8994051cb0 con 0x7f899c1598e0 2023-09-30T22:59:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.977+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f899c06fc10 con 0x7f899c1598e0 2023-09-30T22:59:00.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.978+0000 7f89837fe700 1 -- 172.21.15.142:0/3388441243 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+17033 (secure 0 0 0) 0x7f89940552d0 con 0x7f899c1598e0 2023-09-30T22:59:00.978 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:00.979 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":133,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:58:53.338123+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:58:37.968620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-09-30T22:58:39.134383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.980+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8988067330 msgr2=0x7f89880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.980+0000 7f89a21ff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8988067330 0x7f89880697e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f898c0091e0 tx=0x7f898c016000 comp rx=0 tx=0).stop 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.980+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 msgr2=0x7f899c0b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.980+0000 7f89a21ff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c0b5330 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f899400cb90 tx=0x7f89940019a0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 shutdown_connections 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8988067330 0x7f89880697e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899c1598e0 0x7f899c0b5330 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f899c0cee50 0x7f899c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 --2- 172.21.15.142:0/3388441243 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f899c0d03d0 0x7f899c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 >> 172.21.15.142:0/3388441243 conn(0x7f899c0cd540 msgr2=0x7f899c067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:00.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 shutdown_connections 2023-09-30T22:59:00.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:00.981+0000 7f89a21ff700 1 -- 172.21.15.142:0/3388441243 wait complete. 2023-09-30T22:59:00.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:59:01.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.190+0000 7eff203ff700 1 Processor -- start 2023-09-30T22:59:01.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.190+0000 7eff203ff700 1 -- start start 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.191+0000 7eff203ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.191+0000 7eff203ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff1815e270 0x7eff18159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.191+0000 7eff203ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1815dde0 con 0x7eff1806d3f0 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.191+0000 7eff203ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1815e6e0 con 0x7eff1815e270 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.191+0000 7eff203ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1806b840 con 0x7eff180c6da0 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.191+0000 7eff1e99c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff1815e270 0x7eff18159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1e99c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff1815e270 0x7eff18159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47566/0 (socket says 172.21.15.142:47566) 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1e99c700 1 -- 172.21.15.142:0/4129065560 learned_addr learned my addr 172.21.15.142:0/4129065560 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:01.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1d99a700 1 --2- 172.21.15.142:0/4129065560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1e99c700 1 -- 172.21.15.142:0/4129065560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 msgr2=0x7eff1806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:01.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1e99c700 1 --2- 172.21.15.142:0/4129065560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1e99c700 1 -- 172.21.15.142:0/4129065560 >> v1:172.21.15.148:6789/0 conn(0x7eff1806d3f0 legacy=0x7eff1806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1e99c700 1 -- 172.21.15.142:0/4129065560 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1815d7d0 con 0x7eff1815e270 2023-09-30T22:59:01.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1d99a700 1 --2- 172.21.15.142:0/4129065560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:01.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1e99c700 1 --2- 172.21.15.142:0/4129065560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff18159550 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7eff10009f20 tx=0x7eff10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da516585c27e5b2a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:01.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1d199700 1 -- 172.21.15.142:0/4129065560 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000e070 con 0x7eff1815e270 2023-09-30T22:59:01.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1d199700 1 -- 172.21.15.142:0/4129065560 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000ba80 con 0x7eff1815e270 2023-09-30T22:59:01.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.192+0000 7eff1d199700 1 -- 172.21.15.142:0/4129065560 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100092e0 con 0x7eff1815e270 2023-09-30T22:59:01.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 -- 172.21.15.142:0/4129065560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 msgr2=0x7eff18159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 --2- 172.21.15.142:0/4129065560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff18159550 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7eff10009f20 tx=0x7eff10009840 comp rx=0 tx=0).stop 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 -- 172.21.15.142:0/4129065560 shutdown_connections 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 --2- 172.21.15.142:0/4129065560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff18159550 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 --2- 172.21.15.142:0/4129065560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 -- 172.21.15.142:0/4129065560 >> 172.21.15.142:0/4129065560 conn(0x7eff18067e30 msgr2=0x7eff18068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 -- 172.21.15.142:0/4129065560 shutdown_connections 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.193+0000 7eff203ff700 1 -- 172.21.15.142:0/4129065560 wait complete. 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.195+0000 7eff203ff700 1 Processor -- start 2023-09-30T22:59:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.195+0000 7eff203ff700 1 -- start start 2023-09-30T22:59:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff203ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff1806d3f0 0x7eff18155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff203ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1814dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff203ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff1814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff203ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18157090 con 0x7eff1815e270 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff203ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18156480 con 0x7eff1806d3f0 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff203ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff18156760 con 0x7eff180c6da0 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff1814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff1814e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47574/0 (socket says 172.21.15.142:47574) 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 -- 172.21.15.142:0/1061147844 learned_addr learned my addr 172.21.15.142:0/1061147844 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1d99a700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1814dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e19b700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff1806d3f0 0x7eff18155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 -- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 msgr2=0x7eff1814dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1814dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 -- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff1806d3f0 msgr2=0x7eff18155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff1806d3f0 0x7eff18155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1e99c700 1 -- 172.21.15.142:0/1061147844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009ae0 con 0x7eff1815e270 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.196+0000 7eff1d99a700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1814dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.197+0000 7eff1e99c700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff1814e2e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7eff18067a40 tx=0x7eff10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.197+0000 7eff0e7fc700 1 -- 172.21.15.142:0/1061147844 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100032f0 con 0x7eff1815e270 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.197+0000 7eff0e7fc700 1 -- 172.21.15.142:0/1061147844 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10008e80 con 0x7eff1815e270 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.197+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff18156a40 con 0x7eff1815e270 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.197+0000 7eff0e7fc700 1 -- 172.21.15.142:0/1061147844 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10026660 con 0x7eff1815e270 2023-09-30T22:59:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.197+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff18156060 con 0x7eff1815e270 2023-09-30T22:59:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.198+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff18157240 con 0x7eff1815e270 2023-09-30T22:59:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.199+0000 7eff0e7fc700 1 -- 172.21.15.142:0/1061147844 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff10003040 con 0x7eff1815e270 2023-09-30T22:59:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.200+0000 7eff0e7fc700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.200+0000 7eff0e7fc700 1 -- 172.21.15.142:0/1061147844 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff10086560 con 0x7eff1815e270 2023-09-30T22:59:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.200+0000 7eff1e19b700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.200+0000 7eff1e19b700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff14003860 tx=0x7eff14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:01.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.204+0000 7eff0e7fc700 1 -- 172.21.15.142:0/1061147844 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff18157240 con 0x7eff1815e270 2023-09-30T22:59:01.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.441+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7eff181571d0 con 0x7eff1815e270 2023-09-30T22:59:01.442 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:59:01.442+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:59:01.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.447+0000 7eff0e7fc700 1 -- 172.21.15.142:0/1061147844 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7eff100533c0 con 0x7eff1815e270 2023-09-30T22:59:01.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 msgr2=0x7efefc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff14003860 tx=0x7eff14009040 comp rx=0 tx=0).stop 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 msgr2=0x7eff1814e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff1814e2e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7eff18067a40 tx=0x7eff10018000 comp rx=0 tx=0).stop 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 shutdown_connections 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff1815e270 0x7eff1814e2e0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff1806d3f0 0x7eff18155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 --2- 172.21.15.142:0/1061147844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff180c6da0 0x7eff1814dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 >> 172.21.15.142:0/1061147844 conn(0x7eff18067e30 msgr2=0x7eff18152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 shutdown_connections 2023-09-30T22:59:01.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.450+0000 7eff203ff700 1 -- 172.21.15.142:0/1061147844 wait complete. 2023-09-30T22:59:01.452 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:59:01.456 INFO:tasks.ceph.mds.b.smithi148.stderr: -3466> 2023-09-30T22:58:44.660+0000 7f4380ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:59:01.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:59:01.502 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:59:01.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.661+0000 7fa6e87ff700 1 Processor -- start 2023-09-30T22:59:01.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.661+0000 7fa6e87ff700 1 -- start start 2023-09-30T22:59:01.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.662+0000 7fa6e87ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6e00cbfe0 0x7fa6e015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.662+0000 7fa6e87ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6e0157ab0 0x7fa6e00cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.662+0000 7fa6e87ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00d0550 con 0x7fa6e00cc3b0 2023-09-30T22:59:01.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.662+0000 7fa6e87ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e00cf750 con 0x7fa6e0157ab0 2023-09-30T22:59:01.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.662+0000 7fa6e87ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e00cf940 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6e0157ab0 0x7fa6e00cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6e0157ab0 0x7fa6e00cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47582/0 (socket says 172.21.15.142:47582) 2023-09-30T22:59:01.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 -- 172.21.15.142:0/2893915804 learned_addr learned my addr 172.21.15.142:0/2893915804 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:01.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e659b700 1 --2- 172.21.15.142:0/2893915804 >> v2:172.21.15.148:3300/0 conn(0x7fa6e00cbfe0 0x7fa6e015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 -- 172.21.15.142:0/2893915804 >> v2:172.21.15.148:3300/0 conn(0x7fa6e00cbfe0 msgr2=0x7fa6e015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:01.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 --2- 172.21.15.142:0/2893915804 >> v2:172.21.15.148:3300/0 conn(0x7fa6e00cbfe0 0x7fa6e015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 -- 172.21.15.142:0/2893915804 >> v1:172.21.15.148:6789/0 conn(0x7fa6e00cc3b0 legacy=0x7fa6e01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 -- 172.21.15.142:0/2893915804 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00cfc20 con 0x7fa6e0157ab0 2023-09-30T22:59:01.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.663+0000 7fa6e6d9c700 1 --2- 172.21.15.142:0/2893915804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e0157ab0 0x7fa6e00cf210 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006cf00 tx=0x7fa6d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d8ccf6af8fb276 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:01.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e5599700 1 -- 172.21.15.142:0/2893915804 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800e070 con 0x7fa6e0157ab0 2023-09-30T22:59:01.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e5599700 1 -- 172.21.15.142:0/2893915804 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d800ba20 con 0x7fa6e0157ab0 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e5599700 1 -- 172.21.15.142:0/2893915804 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80092e0 con 0x7fa6e0157ab0 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 -- 172.21.15.142:0/2893915804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e0157ab0 msgr2=0x7fa6e00cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/2893915804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e0157ab0 0x7fa6e00cf210 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006cf00 tx=0x7fa6d8009840 comp rx=0 tx=0).stop 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 -- 172.21.15.142:0/2893915804 shutdown_connections 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/2893915804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e0157ab0 0x7fa6e00cf210 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/2893915804 >> v2:172.21.15.148:3300/0 conn(0x7fa6e00cbfe0 0x7fa6e015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 -- 172.21.15.142:0/2893915804 >> 172.21.15.142:0/2893915804 conn(0x7fa6e00d0a80 msgr2=0x7fa6e00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 -- 172.21.15.142:0/2893915804 shutdown_connections 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.664+0000 7fa6e87ff700 1 -- 172.21.15.142:0/2893915804 wait complete. 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.666+0000 7fa6e87ff700 1 Processor -- start 2023-09-30T22:59:01.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.666+0000 7fa6e87ff700 1 -- start start 2023-09-30T22:59:01.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e87ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e00cbfe0 0x7fa6e01445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e87ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e00cc3b0 0x7fa6e0158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e87ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e0157ab0 0x7fa6e01593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e87ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00b9000 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e87ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e016bac0 con 0x7fa6e0157ab0 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e87ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e016bda0 con 0x7fa6e00cc3b0 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e00cbfe0 0x7fa6e01445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e00cbfe0 0x7fa6e01445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47594/0 (socket says 172.21.15.142:47594) 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 -- 172.21.15.142:0/1998588752 learned_addr learned my addr 172.21.15.142:0/1998588752 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e6d9c700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e0157ab0 0x7fa6e01593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e5d9a700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e00cc3b0 0x7fa6e0158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 -- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e00cc3b0 msgr2=0x7fa6e0158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e00cc3b0 0x7fa6e0158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 -- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e0157ab0 msgr2=0x7fa6e01593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e0157ab0 0x7fa6e01593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.667+0000 7fa6e659b700 1 -- 172.21.15.142:0/1998588752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8009ae0 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.668+0000 7fa6e659b700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e00cbfe0 0x7fa6e01445e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00ec80 tx=0x7fa6dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.668+0000 7fa6d67fc700 1 -- 172.21.15.142:0/1998588752 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00c850 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.668+0000 7fa6d67fc700 1 -- 172.21.15.142:0/1998588752 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00c9b0 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.668+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e016c080 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.668+0000 7fa6d67fc700 1 -- 172.21.15.142:0/1998588752 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00cd50 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.668+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e0144b20 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.669+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e016c520 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.670+0000 7fa6d67fc700 1 -- 172.21.15.142:0/1998588752 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa6dc013680 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.671+0000 7fa6d67fc700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa6c4067330 0x7fa6c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:01.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.671+0000 7fa6d67fc700 1 -- 172.21.15.142:0/1998588752 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa6dc084f50 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.671+0000 7fa6e5d9a700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa6c4067330 0x7fa6c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:01.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.672+0000 7fa6e5d9a700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa6c4067330 0x7fa6c40697e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa6e015a370 tx=0x7fa6d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:01.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.675+0000 7fa6d67fc700 1 -- 172.21.15.142:0/1998588752 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa6dc051d80 con 0x7fa6e00cbfe0 2023-09-30T22:59:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:01.908+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa6e016c6d0 con 0x7fa6e00cbfe0 2023-09-30T22:59:02.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.452+0000 7fa6d67fc700 1 -- 172.21.15.142:0/1998588752 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa6dc0553a0 con 0x7fa6e00cbfe0 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.454+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa6c4067330 msgr2=0x7fa6c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.454+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa6c4067330 0x7fa6c40697e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa6e015a370 tx=0x7fa6d0009040 comp rx=0 tx=0).stop 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.454+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e00cbfe0 msgr2=0x7fa6e01445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.454+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e00cbfe0 0x7fa6e01445e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00ec80 tx=0x7fa6dc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 shutdown_connections 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa6c4067330 0x7fa6c40697e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6e0157ab0 0x7fa6e01593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6e00cbfe0 0x7fa6e01445e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 --2- 172.21.15.142:0/1998588752 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6e00cc3b0 0x7fa6e0158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 >> 172.21.15.142:0/1998588752 conn(0x7fa6e00d0a80 msgr2=0x7fa6e006e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:02.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 shutdown_connections 2023-09-30T22:59:02.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.455+0000 7fa6e87ff700 1 -- 172.21.15.142:0/1998588752 wait complete. 2023-09-30T22:59:02.474 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:59:02.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.669+0000 7f91e5bff700 1 Processor -- start 2023-09-30T22:59:02.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.669+0000 7f91e5bff700 1 -- start start 2023-09-30T22:59:02.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91e5bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91e00ca5e0 0x7f91e00686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:02.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91e5bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e0159de0 0x7f91e0068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:02.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91e5bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e0068230 con 0x7f91e0159a10 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91e5bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e0067620 con 0x7f91e00ca5e0 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91e5bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0067900 con 0x7f91e0159de0 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91deffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91e00ca5e0 0x7f91e00686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91df7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f91e0159a10 0x7f91e00c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47372/0 (socket says 172.21.15.142:47372) 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91deffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91e00ca5e0 0x7f91e00686c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47600/0 (socket says 172.21.15.142:47600) 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.670+0000 7f91df7fe700 1 -- 172.21.15.142:0/1602425821 learned_addr learned my addr 172.21.15.142:0/1602425821 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91dffff700 1 --2- 172.21.15.142:0/1602425821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e0159de0 0x7f91e0068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91deffd700 1 -- 172.21.15.142:0/1602425821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e0159de0 msgr2=0x7f91e0068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91deffd700 1 --2- 172.21.15.142:0/1602425821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e0159de0 0x7f91e0068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91deffd700 1 -- 172.21.15.142:0/1602425821 >> v1:172.21.15.142:6789/0 conn(0x7f91e0159a10 legacy=0x7f91e00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:02.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91deffd700 1 -- 172.21.15.142:0/1602425821 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0067be0 con 0x7f91e00ca5e0 2023-09-30T22:59:02.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91de7fc700 1 -- 172.21.15.142:0/1602425821 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475895276 0 0) 0x7f91e0068230 con 0x7f91e0159a10 2023-09-30T22:59:02.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91deffd700 1 --2- 172.21.15.142:0/1602425821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e00ca5e0 0x7f91e00686c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f91d40098e0 tx=0x7f91d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28daaf22b6d5f4ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:02.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91de7fc700 1 -- 172.21.15.142:0/1602425821 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4009e80 con 0x7f91e00ca5e0 2023-09-30T22:59:02.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91de7fc700 1 -- 172.21.15.142:0/1602425821 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d400b860 con 0x7f91e00ca5e0 2023-09-30T22:59:02.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.671+0000 7f91de7fc700 1 -- 172.21.15.142:0/1602425821 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400bbe0 con 0x7f91e00ca5e0 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 -- 172.21.15.142:0/1602425821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e00ca5e0 msgr2=0x7f91e00686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 --2- 172.21.15.142:0/1602425821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e00ca5e0 0x7f91e00686c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f91d40098e0 tx=0x7f91d40091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 -- 172.21.15.142:0/1602425821 shutdown_connections 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 --2- 172.21.15.142:0/1602425821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e0159de0 0x7f91e0068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 --2- 172.21.15.142:0/1602425821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e00ca5e0 0x7f91e00686c0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 -- 172.21.15.142:0/1602425821 >> 172.21.15.142:0/1602425821 conn(0x7f91e00cb2f0 msgr2=0x7f91e00cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 -- 172.21.15.142:0/1602425821 shutdown_connections 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.672+0000 7f91e5bff700 1 -- 172.21.15.142:0/1602425821 wait complete. 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.674+0000 7f91e5bff700 1 Processor -- start 2023-09-30T22:59:02.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.674+0000 7f91e5bff700 1 -- start start 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91e5bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00ca5e0 0x7f91e01561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91e5bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e0159a10 0x7f91e015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91e5bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0159de0 0x7f91e00c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91e5bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00c6770 con 0x7f91e0159de0 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91e5bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0156700 con 0x7f91e0159a10 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91e5bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00c5b60 con 0x7f91e00ca5e0 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0159de0 0x7f91e00c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0159de0 0x7f91e00c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47616/0 (socket says 172.21.15.142:47616) 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 -- 172.21.15.142:0/412040129 learned_addr learned my addr 172.21.15.142:0/412040129 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91df7fe700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00ca5e0 0x7f91e01561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:02.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91deffd700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e0159a10 0x7f91e015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 -- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00ca5e0 msgr2=0x7f91e01561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00ca5e0 0x7f91e01561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 -- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e0159a10 msgr2=0x7f91e015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e0159a10 0x7f91e015b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.675+0000 7f91dffff700 1 -- 172.21.15.142:0/412040129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4009420 con 0x7f91e0159de0 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.676+0000 7f91dffff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0159de0 0x7f91e00c6c00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f91d8007f20 tx=0x7f91d8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.676+0000 7f91c77fe700 1 -- 172.21.15.142:0/412040129 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800eb90 con 0x7f91e0159de0 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.676+0000 7f91c77fe700 1 -- 172.21.15.142:0/412040129 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d800ed10 con 0x7f91e0159de0 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.676+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e00c5e40 con 0x7f91e0159de0 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.676+0000 7f91c77fe700 1 -- 172.21.15.142:0/412040129 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8014670 con 0x7f91e0159de0 2023-09-30T22:59:02.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.676+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e00c6400 con 0x7f91e0159de0 2023-09-30T22:59:02.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.677+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e00c68e0 con 0x7f91e0159de0 2023-09-30T22:59:02.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.678+0000 7f91c77fe700 1 -- 172.21.15.142:0/412040129 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f91d8014a20 con 0x7f91e0159de0 2023-09-30T22:59:02.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.679+0000 7f91c77fe700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:02.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.679+0000 7f91c77fe700 1 -- 172.21.15.142:0/412040129 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f91d8085150 con 0x7f91e0159de0 2023-09-30T22:59:02.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.679+0000 7f91df7fe700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:02.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.680+0000 7f91df7fe700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f91d0007fd0 tx=0x7f91d0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:02.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.683+0000 7f91c77fe700 1 -- 172.21.15.142:0/412040129 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f91d8052000 con 0x7f91e0159de0 2023-09-30T22:59:02.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:02.876+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f91e0067ec0 con 0x7f91e0159de0 2023-09-30T22:59:03.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.454+0000 7f91c77fe700 1 -- 172.21.15.142:0/412040129 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v135) v1 ==== 181+0+0 (secure 0 0 0) 0x7f91d8055620 con 0x7f91e0159de0 2023-09-30T22:59:03.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.456+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 msgr2=0x7f91cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:03.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.456+0000 7f91e5bff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f91d0007fd0 tx=0x7f91d0007d30 comp rx=0 tx=0).stop 2023-09-30T22:59:03.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.456+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0159de0 msgr2=0x7f91e00c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:03.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.456+0000 7f91e5bff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0159de0 0x7f91e00c6c00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f91d8007f20 tx=0x7f91d8009800 comp rx=0 tx=0).stop 2023-09-30T22:59:03.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 shutdown_connections 2023-09-30T22:59:03.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91cc067330 0x7f91cc0697e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0159de0 0x7f91e00c6c00 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91e00ca5e0 0x7f91e01561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 --2- 172.21.15.142:0/412040129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e0159a10 0x7f91e015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 >> 172.21.15.142:0/412040129 conn(0x7f91e00cb2f0 msgr2=0x7f91e00686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:03.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 shutdown_connections 2023-09-30T22:59:03.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.457+0000 7f91e5bff700 1 -- 172.21.15.142:0/412040129 wait complete. 2023-09-30T22:59:03.458 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:59:03.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:59:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.677+0000 7f242d3ff700 1 Processor -- start 2023-09-30T22:59:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.677+0000 7f242d3ff700 1 -- start start 2023-09-30T22:59:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.678+0000 7f242d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24280ca240 0x7f24280c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.678+0000 7f242d3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24281573d0 0x7f2428157830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.678+0000 7f242d3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280c5970 con 0x7f2428157000 2023-09-30T22:59:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.678+0000 7f242d3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24280ca6b0 con 0x7f24281573d0 2023-09-30T22:59:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.678+0000 7f242d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280c7d60 con 0x7f24280ca240 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.678+0000 7f24277fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24281573d0 0x7f2428157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.678+0000 7f2426ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2428157000 0x7f24280c3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47388/0 (socket says 172.21.15.142:47388) 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f2426ffd700 1 -- 172.21.15.142:0/3634552413 learned_addr learned my addr 172.21.15.142:0/3634552413 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f24267fc700 1 --2- 172.21.15.142:0/3634552413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24280ca240 0x7f24280c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f2425ffb700 1 -- 172.21.15.142:0/3634552413 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710623421 0 0) 0x7f24280c5970 con 0x7f2428157000 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f2425ffb700 1 -- 172.21.15.142:0/3634552413 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2410003570 con 0x7f2428157000 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f24277fe700 1 -- 172.21.15.142:0/3634552413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24280ca240 msgr2=0x7f24280c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f24277fe700 1 --2- 172.21.15.142:0/3634552413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24280ca240 0x7f24280c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f24277fe700 1 -- 172.21.15.142:0/3634552413 >> v1:172.21.15.142:6789/0 conn(0x7f2428157000 legacy=0x7f24280c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f24277fe700 1 -- 172.21.15.142:0/3634552413 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280c5320 con 0x7f24281573d0 2023-09-30T22:59:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f24277fe700 1 --2- 172.21.15.142:0/3634552413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24281573d0 0x7f2428157830 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f2420009e60 tx=0x7f2420009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232c42e8d108f815 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.679+0000 7f2425ffb700 1 -- 172.21.15.142:0/3634552413 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000e070 con 0x7f24281573d0 2023-09-30T22:59:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f2425ffb700 1 -- 172.21.15.142:0/3634552413 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000bab0 con 0x7f24281573d0 2023-09-30T22:59:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f2425ffb700 1 -- 172.21.15.142:0/3634552413 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000be30 con 0x7f24281573d0 2023-09-30T22:59:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 -- 172.21.15.142:0/3634552413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24281573d0 msgr2=0x7f2428157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 --2- 172.21.15.142:0/3634552413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24281573d0 0x7f2428157830 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f2420009e60 tx=0x7f2420009780 comp rx=0 tx=0).stop 2023-09-30T22:59:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 -- 172.21.15.142:0/3634552413 shutdown_connections 2023-09-30T22:59:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 --2- 172.21.15.142:0/3634552413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24281573d0 0x7f2428157830 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 --2- 172.21.15.142:0/3634552413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24280ca240 0x7f24280c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 -- 172.21.15.142:0/3634552413 >> 172.21.15.142:0/3634552413 conn(0x7f24280cc670 msgr2=0x7f24280cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 -- 172.21.15.142:0/3634552413 shutdown_connections 2023-09-30T22:59:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.680+0000 7f242d3ff700 1 -- 172.21.15.142:0/3634552413 wait complete. 2023-09-30T22:59:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.682+0000 7f242d3ff700 1 Processor -- start 2023-09-30T22:59:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.682+0000 7f242d3ff700 1 -- start start 2023-09-30T22:59:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f242d3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24280ca240 0x7f2428159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f242d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2428157000 0x7f2428154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f242d3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281573d0 0x7f24281580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f242d3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242813e230 con 0x7f24280ca240 2023-09-30T22:59:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f242d3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428156ab0 con 0x7f24281573d0 2023-09-30T22:59:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f242d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242813ca00 con 0x7f2428157000 2023-09-30T22:59:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f2426ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24280ca240 0x7f2428159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f2426ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24280ca240 0x7f2428159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47638/0 (socket says 172.21.15.142:47638) 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f2426ffd700 1 -- 172.21.15.142:0/31692352 learned_addr learned my addr 172.21.15.142:0/31692352 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f24267fc700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2428157000 0x7f2428154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.683+0000 7f24277fe700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281573d0 0x7f24281580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f2426ffd700 1 -- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2428157000 msgr2=0x7f2428154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f2426ffd700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2428157000 0x7f2428154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f2426ffd700 1 -- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281573d0 msgr2=0x7f24281580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f2426ffd700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281573d0 0x7f24281580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f2426ffd700 1 -- 172.21.15.142:0/31692352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420009a20 con 0x7f24280ca240 2023-09-30T22:59:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f24277fe700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281573d0 0x7f24281580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f24267fc700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2428157000 0x7f2428154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f2426ffd700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24280ca240 0x7f2428159530 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f24180011e0 tx=0x7f2418007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f240effd700 1 -- 172.21.15.142:0/31692352 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418005b30 con 0x7f24280ca240 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f240effd700 1 -- 172.21.15.142:0/31692352 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418005c90 con 0x7f24280ca240 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242813cce0 con 0x7f24280ca240 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f240effd700 1 -- 172.21.15.142:0/31692352 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24180072e0 con 0x7f24280ca240 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.684+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242813d320 con 0x7f24280ca240 2023-09-30T22:59:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.685+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2428069a50 con 0x7f24280ca240 2023-09-30T22:59:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.686+0000 7f240effd700 1 -- 172.21.15.142:0/31692352 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2418007650 con 0x7f24280ca240 2023-09-30T22:59:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.688+0000 7f240effd700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2414067330 0x7f24140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.688+0000 7f240effd700 1 -- 172.21.15.142:0/31692352 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f2418083ed0 con 0x7f24280ca240 2023-09-30T22:59:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.688+0000 7f24267fc700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2414067330 0x7f24140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:03.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.688+0000 7f24267fc700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2414067330 0x7f24140697e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f241c006f00 tx=0x7f241c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:03.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.692+0000 7f240effd700 1 -- 172.21.15.142:0/31692352 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f241804b570 con 0x7f24280ca240 2023-09-30T22:59:03.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:03.883+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f242806fc10 con 0x7f24280ca240 2023-09-30T22:59:04.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.466+0000 7f240effd700 1 -- 172.21.15.142:0/31692352 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v136) v1 ==== 169+0+0 (secure 0 0 0) 0x7f24180170d0 con 0x7f24280ca240 2023-09-30T22:59:04.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2414067330 msgr2=0x7f24140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2414067330 0x7f24140697e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f241c006f00 tx=0x7f241c008040 comp rx=0 tx=0).stop 2023-09-30T22:59:04.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24280ca240 msgr2=0x7f2428159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24280ca240 0x7f2428159530 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f24180011e0 tx=0x7f2418007df0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 shutdown_connections 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2414067330 0x7f24140697e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281573d0 0x7f24281580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24280ca240 0x7f2428159530 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 --2- 172.21.15.142:0/31692352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2428157000 0x7f2428154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 >> 172.21.15.142:0/31692352 conn(0x7f24280cc670 msgr2=0x7f24280c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 shutdown_connections 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.469+0000 7f242d3ff700 1 -- 172.21.15.142:0/31692352 wait complete. 2023-09-30T22:59:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:59:04.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T22:59:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.683+0000 7f80dd3ff700 1 Processor -- start 2023-09-30T22:59:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.683+0000 7f80dd3ff700 1 -- start start 2023-09-30T22:59:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.684+0000 7f80dd3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80c52a0 0x7f80d80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.684+0000 7f80dd3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80d80cb350 0x7f80d81605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.684+0000 7f80dd3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d80c7690 con 0x7f80d8069f10 2023-09-30T22:59:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.684+0000 7f80dd3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d81406a0 con 0x7f80d80cb350 2023-09-30T22:59:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80dd3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d80c3a50 con 0x7f80d80c52a0 2023-09-30T22:59:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d67fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f80d8069f10 0x7f80d80c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47396/0 (socket says 172.21.15.142:47396) 2023-09-30T22:59:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d67fc700 1 -- 172.21.15.142:0/4120160892 learned_addr learned my addr 172.21.15.142:0/4120160892 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d77fe700 1 --2- 172.21.15.142:0/4120160892 >> v2:172.21.15.142:3300/0 conn(0x7f80d80cb350 0x7f80d81605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d6ffd700 1 --2- 172.21.15.142:0/4120160892 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80c52a0 0x7f80d80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d5ffb700 1 -- 172.21.15.142:0/4120160892 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506006912 0 0) 0x7f80cc001110 con 0x7f80d8069f10 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d5ffb700 1 -- 172.21.15.142:0/4120160892 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c0003570 con 0x7f80d8069f10 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d77fe700 1 -- 172.21.15.142:0/4120160892 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80c52a0 msgr2=0x7f80d80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d77fe700 1 --2- 172.21.15.142:0/4120160892 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80c52a0 0x7f80d80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d77fe700 1 -- 172.21.15.142:0/4120160892 >> v1:172.21.15.142:6789/0 conn(0x7f80d8069f10 legacy=0x7f80d80c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.685+0000 7f80d77fe700 1 -- 172.21.15.142:0/4120160892 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80c7f20 con 0x7f80d80cb350 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.686+0000 7f80d77fe700 1 --2- 172.21.15.142:0/4120160892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d80cb350 0x7f80d81605e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009e90 tx=0x7f80d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1591da67deecb1d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.686+0000 7f80d5ffb700 1 -- 172.21.15.142:0/4120160892 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d000bb40 con 0x7f80d80cb350 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.686+0000 7f80d5ffb700 1 -- 172.21.15.142:0/4120160892 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d000bca0 con 0x7f80d80cb350 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.686+0000 7f80d5ffb700 1 -- 172.21.15.142:0/4120160892 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00116b0 con 0x7f80d80cb350 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.686+0000 7f80dd3ff700 1 -- 172.21.15.142:0/4120160892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d80cb350 msgr2=0x7f80d81605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.686+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/4120160892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d80cb350 0x7f80d81605e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009e90 tx=0x7f80d0009780 comp rx=0 tx=0).stop 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.686+0000 7f80dd3ff700 1 -- 172.21.15.142:0/4120160892 shutdown_connections 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.687+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/4120160892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d80cb350 0x7f80d81605e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.687+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/4120160892 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80c52a0 0x7f80d80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.687+0000 7f80dd3ff700 1 -- 172.21.15.142:0/4120160892 >> 172.21.15.142:0/4120160892 conn(0x7f80d80cc670 msgr2=0x7f80d80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.687+0000 7f80dd3ff700 1 -- 172.21.15.142:0/4120160892 shutdown_connections 2023-09-30T22:59:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.687+0000 7f80dd3ff700 1 -- 172.21.15.142:0/4120160892 wait complete. 2023-09-30T22:59:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.688+0000 7f80dd3ff700 1 Processor -- start 2023-09-30T22:59:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.688+0000 7f80dd3ff700 1 -- start start 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80dd3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d8069f10 0x7f80d813d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80dd3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80d80c52a0 0x7f80d815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80dd3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80cb350 0x7f80d81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80dd3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d813dad0 con 0x7f80d8069f10 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80dd3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815e820 con 0x7f80d80c52a0 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80dd3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815de50 con 0x7f80d80cb350 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80d6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d8069f10 0x7f80d813d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80d6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d8069f10 0x7f80d813d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47646/0 (socket says 172.21.15.142:47646) 2023-09-30T22:59:04.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80d6ffd700 1 -- 172.21.15.142:0/2588470168 learned_addr learned my addr 172.21.15.142:0/2588470168 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.689+0000 7f80d77fe700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80cb350 0x7f80d81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d67fc700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80d80c52a0 0x7f80d815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d6ffd700 1 -- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80cb350 msgr2=0x7f80d81579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d6ffd700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80cb350 0x7f80d81579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d6ffd700 1 -- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80d80c52a0 msgr2=0x7f80d815e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d6ffd700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80d80c52a0 0x7f80d815e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d6ffd700 1 -- 172.21.15.142:0/2588470168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0009a20 con 0x7f80d8069f10 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d77fe700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80cb350 0x7f80d81579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80d6ffd700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d8069f10 0x7f80d813d590 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f80c800ecb0 tx=0x7f80c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80beffd700 1 -- 172.21.15.142:0/2588470168 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800c9d0 con 0x7f80d8069f10 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80beffd700 1 -- 172.21.15.142:0/2588470168 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800cb30 con 0x7f80d8069f10 2023-09-30T22:59:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d8158700 con 0x7f80d8069f10 2023-09-30T22:59:04.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80beffd700 1 -- 172.21.15.142:0/2588470168 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800ced0 con 0x7f80d8069f10 2023-09-30T22:59:04.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.690+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d815d520 con 0x7f80d8069f10 2023-09-30T22:59:04.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.692+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d815e130 con 0x7f80d8069f10 2023-09-30T22:59:04.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.692+0000 7f80beffd700 1 -- 172.21.15.142:0/2588470168 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f80c8013680 con 0x7f80d8069f10 2023-09-30T22:59:04.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.693+0000 7f80beffd700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f80c4067330 0x7f80c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:04.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.693+0000 7f80beffd700 1 -- 172.21.15.142:0/2588470168 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f80c8084d10 con 0x7f80d8069f10 2023-09-30T22:59:04.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.694+0000 7f80d67fc700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f80c4067330 0x7f80c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:04.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.694+0000 7f80d67fc700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f80c4067330 0x7f80c40697e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f80d815cc40 tx=0x7f80cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:04.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.698+0000 7f80beffd700 1 -- 172.21.15.142:0/2588470168 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f80c808a020 con 0x7f80d8069f10 2023-09-30T22:59:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.889+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f80d806d2a0 con 0x7f80d8069f10 2023-09-30T22:59:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.895+0000 7f80beffd700 1 -- 172.21.15.142:0/2588470168 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f80c8051e70 con 0x7f80d8069f10 2023-09-30T22:59:04.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f80c4067330 msgr2=0x7f80c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f80c4067330 0x7f80c40697e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f80d815cc40 tx=0x7f80cc009040 comp rx=0 tx=0).stop 2023-09-30T22:59:04.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d8069f10 msgr2=0x7f80d813d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d8069f10 0x7f80d813d590 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f80c800ecb0 tx=0x7f80c80091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 shutdown_connections 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f80c4067330 0x7f80c40697e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80d80cb350 0x7f80d81579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d8069f10 0x7f80d813d590 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 --2- 172.21.15.142:0/2588470168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80d80c52a0 0x7f80d815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 >> 172.21.15.142:0/2588470168 conn(0x7f80d80cc670 msgr2=0x7f80d806d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 shutdown_connections 2023-09-30T22:59:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:04.897+0000 7f80dd3ff700 1 -- 172.21.15.142:0/2588470168 wait complete. 2023-09-30T22:59:04.915 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-09-30T22:59:05.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.105+0000 7fa8747ff700 1 Processor -- start 2023-09-30T22:59:05.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.105+0000 7fa8747ff700 1 -- start start 2023-09-30T22:59:05.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa8747ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa86c0cbfe0 0x7fa86c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa8747ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cc3b0 0x7fa86c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa8747ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa86c1573a0 0x7fa86c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa8747ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86c0cf750 con 0x7fa86c1573a0 2023-09-30T22:59:05.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa8747ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86c0d0550 con 0x7fa86c0cbfe0 2023-09-30T22:59:05.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa8747ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c157d60 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa872d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa86c1573a0 0x7fa86c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa872d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa86c1573a0 0x7fa86c157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47658/0 (socket says 172.21.15.142:47658) 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.106+0000 7fa872d9c700 1 -- 172.21.15.142:0/299712453 learned_addr learned my addr 172.21.15.142:0/299712453 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa87259b700 1 --2- 172.21.15.142:0/299712453 >> v2:172.21.15.148:3300/0 conn(0x7fa86c0cbfe0 0x7fa86c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa871d9a700 1 --2- 172.21.15.142:0/299712453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cc3b0 0x7fa86c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa872d9c700 1 -- 172.21.15.142:0/299712453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cc3b0 msgr2=0x7fa86c0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa872d9c700 1 --2- 172.21.15.142:0/299712453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cc3b0 0x7fa86c0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa872d9c700 1 -- 172.21.15.142:0/299712453 >> v2:172.21.15.148:3300/0 conn(0x7fa86c0cbfe0 msgr2=0x7fa86c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa872d9c700 1 --2- 172.21.15.142:0/299712453 >> v2:172.21.15.148:3300/0 conn(0x7fa86c0cbfe0 0x7fa86c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa872d9c700 1 -- 172.21.15.142:0/299712453 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c0cf940 con 0x7fa86c1573a0 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa872d9c700 1 --2- 172.21.15.142:0/299712453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c1573a0 0x7fa86c157820 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa864009f20 tx=0x7fa864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9c9a287e289d5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:05.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa871599700 1 -- 172.21.15.142:0/299712453 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400e070 con 0x7fa86c1573a0 2023-09-30T22:59:05.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa871599700 1 -- 172.21.15.142:0/299712453 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400ba40 con 0x7fa86c1573a0 2023-09-30T22:59:05.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.107+0000 7fa871599700 1 -- 172.21.15.142:0/299712453 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8640092e0 con 0x7fa86c1573a0 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 -- 172.21.15.142:0/299712453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c1573a0 msgr2=0x7fa86c157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 --2- 172.21.15.142:0/299712453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c1573a0 0x7fa86c157820 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa864009f20 tx=0x7fa864009840 comp rx=0 tx=0).stop 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 -- 172.21.15.142:0/299712453 shutdown_connections 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 --2- 172.21.15.142:0/299712453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c1573a0 0x7fa86c157820 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 --2- 172.21.15.142:0/299712453 >> v2:172.21.15.148:3300/0 conn(0x7fa86c0cbfe0 0x7fa86c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 --2- 172.21.15.142:0/299712453 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cc3b0 0x7fa86c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 -- 172.21.15.142:0/299712453 >> 172.21.15.142:0/299712453 conn(0x7fa86c0d0a80 msgr2=0x7fa86c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:05.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 -- 172.21.15.142:0/299712453 shutdown_connections 2023-09-30T22:59:05.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.108+0000 7fa8747ff700 1 -- 172.21.15.142:0/299712453 wait complete. 2023-09-30T22:59:05.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.110+0000 7fa8747ff700 1 Processor -- start 2023-09-30T22:59:05.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.110+0000 7fa8747ff700 1 -- start start 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa8747ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cbfe0 0x7fa86c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa8747ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c0cc3b0 0x7fa86c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa8747ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa86c1573a0 0x7fa86c16a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa8747ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c16ad40 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa8747ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c16b7f0 con 0x7fa86c1573a0 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa8747ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c16e080 con 0x7fa86c0cbfe0 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c0cc3b0 0x7fa86c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c0cc3b0 0x7fa86c159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47666/0 (socket says 172.21.15.142:47666) 2023-09-30T22:59:05.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 -- 172.21.15.142:0/1749084319 learned_addr learned my addr 172.21.15.142:0/1749084319 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa87259b700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cbfe0 0x7fa86c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa872d9c700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa86c1573a0 0x7fa86c16a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 -- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cbfe0 msgr2=0x7fa86c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cbfe0 0x7fa86c153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 -- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa86c1573a0 msgr2=0x7fa86c16a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa86c1573a0 0x7fa86c16a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa871d9a700 1 -- 172.21.15.142:0/1749084319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864009ae0 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.111+0000 7fa872d9c700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa86c1573a0 0x7fa86c16a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.112+0000 7fa871d9a700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c0cc3b0 0x7fa86c159f30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00d8c0 tx=0x7fa85c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.112+0000 7fa8627fc700 1 -- 172.21.15.142:0/1749084319 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0125f0 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.112+0000 7fa8627fc700 1 -- 172.21.15.142:0/1749084319 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c012750 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.112+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c150f80 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.112+0000 7fa8627fc700 1 -- 172.21.15.142:0/1749084319 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c012af0 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.112+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86c16b230 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.113+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86c16de50 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.114+0000 7fa8627fc700 1 -- 172.21.15.142:0/1749084319 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa85c01e460 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.115+0000 7fa8627fc700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa850067330 0x7fa8500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.115+0000 7fa8627fc700 1 -- 172.21.15.142:0/1749084319 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa85c084ee0 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.115+0000 7fa87259b700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa850067330 0x7fa8500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.115+0000 7fa87259b700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa850067330 0x7fa8500697e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa868006fd0 tx=0x7fa868008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:05.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.119+0000 7fa8627fc700 1 -- 172.21.15.142:0/1749084319 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa86c16de50 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.384+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fa86c16de50 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.461+0000 7fa8627fc700 1 -- 172.21.15.142:0/1749084319 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v346) v1 ==== 128+0+0 (secure 0 0 0) 0x7fa86c16de50 con 0x7fa86c0cc3b0 2023-09-30T22:59:05.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa850067330 msgr2=0x7fa8500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa850067330 0x7fa8500697e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa868006fd0 tx=0x7fa868008040 comp rx=0 tx=0).stop 2023-09-30T22:59:05.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c0cc3b0 msgr2=0x7fa86c159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c0cc3b0 0x7fa86c159f30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00d8c0 tx=0x7fa85c008040 comp rx=0 tx=0).stop 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 shutdown_connections 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa850067330 0x7fa8500697e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa86c1573a0 0x7fa86c16a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa86c0cbfe0 0x7fa86c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 --2- 172.21.15.142:0/1749084319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86c0cc3b0 0x7fa86c159f30 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 >> 172.21.15.142:0/1749084319 conn(0x7fa86c0d0a80 msgr2=0x7fa86c1565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 shutdown_connections 2023-09-30T22:59:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.464+0000 7fa8747ff700 1 -- 172.21.15.142:0/1749084319 wait complete. 2023-09-30T22:59:05.481 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-09-30T22:59:05.481 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-09-30T22:59:05.482 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-09-30T22:59:05.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.670+0000 7f8eea3ff700 1 Processor -- start 2023-09-30T22:59:05.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.670+0000 7f8eea3ff700 1 -- start start 2023-09-30T22:59:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.671+0000 7f8eea3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee40cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.671+0000 7f8eea3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ee40692f0 0x7f8ee415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.671+0000 7f8eea3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee415e0b0 con 0x7f8ee415dc50 2023-09-30T22:59:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.671+0000 7f8eea3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee40cc6b0 con 0x7f8ee40692f0 2023-09-30T22:59:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.671+0000 7f8eea3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40cb7d0 con 0x7f8ee4143350 2023-09-30T22:59:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.671+0000 7f8ee37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ee40692f0 0x7f8ee415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ee40692f0 0x7f8ee415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47674/0 (socket says 172.21.15.142:47674) 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee37fe700 1 -- 172.21.15.142:0/1874306034 learned_addr learned my addr 172.21.15.142:0/1874306034 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee3fff700 1 --2- 172.21.15.142:0/1874306034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee40cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee37fe700 1 -- 172.21.15.142:0/1874306034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 msgr2=0x7f8ee40cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/1874306034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee40cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee37fe700 1 -- 172.21.15.142:0/1874306034 >> v1:172.21.15.148:6789/0 conn(0x7f8ee415dc50 legacy=0x7f8ee4068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee37fe700 1 -- 172.21.15.142:0/1874306034 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40cbaa0 con 0x7f8ee40692f0 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/1874306034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40692f0 0x7f8ee415d710 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80099b0 tx=0x7f8ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c404d087203f95d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/1874306034 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8009ea0 con 0x7f8ee40692f0 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/1874306034 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800b860 con 0x7f8ee40692f0 2023-09-30T22:59:05.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.672+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/1874306034 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800bc00 con 0x7f8ee40692f0 2023-09-30T22:59:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 -- 172.21.15.142:0/1874306034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40692f0 msgr2=0x7f8ee415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/1874306034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40692f0 0x7f8ee415d710 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80099b0 tx=0x7f8ed8009250 comp rx=0 tx=0).stop 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 -- 172.21.15.142:0/1874306034 shutdown_connections 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/1874306034 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee40cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/1874306034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40692f0 0x7f8ee415d710 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 -- 172.21.15.142:0/1874306034 >> 172.21.15.142:0/1874306034 conn(0x7f8ee40ce8e0 msgr2=0x7f8ee40cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 -- 172.21.15.142:0/1874306034 shutdown_connections 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.673+0000 7f8eea3ff700 1 -- 172.21.15.142:0/1874306034 wait complete. 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.675+0000 7f8eea3ff700 1 Processor -- start 2023-09-30T22:59:05.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.675+0000 7f8eea3ff700 1 -- start start 2023-09-30T22:59:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8eea3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ee40692f0 0x7f8ee40b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8eea3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee416b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8eea3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee415dc50 0x7f8ee40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8eea3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415c000 con 0x7f8ee415dc50 2023-09-30T22:59:05.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8eea3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40a54b0 con 0x7f8ee40692f0 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8eea3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee416b600 con 0x7f8ee4143350 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee899c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee415dc50 0x7f8ee40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee899c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee415dc50 0x7f8ee40cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47678/0 (socket says 172.21.15.142:47678) 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee899c700 1 -- 172.21.15.142:0/336321038 learned_addr learned my addr 172.21.15.142:0/336321038 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee416b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee3fff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ee40692f0 0x7f8ee40b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee37fe700 1 -- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ee40692f0 msgr2=0x7f8ee40b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ee40692f0 0x7f8ee40b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee37fe700 1 -- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee415dc50 msgr2=0x7f8ee40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee415dc50 0x7f8ee40cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee37fe700 1 -- 172.21.15.142:0/336321038 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80094f0 con 0x7f8ee4143350 2023-09-30T22:59:05.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.676+0000 7f8ee899c700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee415dc50 0x7f8ee40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.677+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee416b0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40cb1c0 tx=0x7f8ed8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.677+0000 7f8ecbfff700 1 -- 172.21.15.142:0/336321038 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8000d10 con 0x7f8ee4143350 2023-09-30T22:59:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.677+0000 7f8ecbfff700 1 -- 172.21.15.142:0/336321038 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800bbe0 con 0x7f8ee4143350 2023-09-30T22:59:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.677+0000 7f8ecbfff700 1 -- 172.21.15.142:0/336321038 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8011670 con 0x7f8ee4143350 2023-09-30T22:59:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.677+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee415a770 con 0x7f8ee4143350 2023-09-30T22:59:05.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.677+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee415ad30 con 0x7f8ee4143350 2023-09-30T22:59:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.678+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40a5660 con 0x7f8ee4143350 2023-09-30T22:59:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.679+0000 7f8ecbfff700 1 -- 172.21.15.142:0/336321038 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ed8011aa0 con 0x7f8ee4143350 2023-09-30T22:59:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.680+0000 7f8ecbfff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067330 0x7f8ed00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.680+0000 7f8ecbfff700 1 -- 172.21.15.142:0/336321038 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8ed80862c0 con 0x7f8ee4143350 2023-09-30T22:59:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.680+0000 7f8ee3fff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067330 0x7f8ed00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:05.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.681+0000 7f8ee3fff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067330 0x7f8ed00697e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009db0 tx=0x7f8ed40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:05.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.685+0000 7f8ecbfff700 1 -- 172.21.15.142:0/336321038 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ee40a5660 con 0x7f8ee4143350 2023-09-30T22:59:05.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:05.948+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f8ee40a5660 con 0x7f8ee4143350 2023-09-30T22:59:06.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.468+0000 7f8ecbfff700 1 -- 172.21.15.142:0/336321038 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v347) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8ee40a5660 con 0x7f8ee4143350 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.470+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067330 msgr2=0x7f8ed00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.470+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067330 0x7f8ed00697e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009db0 tx=0x7f8ed40091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.470+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 msgr2=0x7f8ee416b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee416b0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40cb1c0 tx=0x7f8ed8017000 comp rx=0 tx=0).stop 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 shutdown_connections 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067330 0x7f8ed00697e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee415dc50 0x7f8ee40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ee40692f0 0x7f8ee40b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 --2- 172.21.15.142:0/336321038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4143350 0x7f8ee416b0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 >> 172.21.15.142:0/336321038 conn(0x7f8ee40ce8e0 msgr2=0x7f8ee4069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 shutdown_connections 2023-09-30T22:59:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.471+0000 7f8eea3ff700 1 -- 172.21.15.142:0/336321038 wait complete. 2023-09-30T22:59:06.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:59:06.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.684+0000 7f32b67ff700 1 Processor -- start 2023-09-30T22:59:06.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.684+0000 7f32b67ff700 1 -- start start 2023-09-30T22:59:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.685+0000 7f32b67ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 0x7f32b01580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.685+0000 7f32b67ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f32b00c40e0 0x7f32b00c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.685+0000 7f32b67ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00c38d0 con 0x7f32b00c6270 2023-09-30T22:59:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.685+0000 7f32b67ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00c4aa0 con 0x7f32b00c40e0 2023-09-30T22:59:06.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.685+0000 7f32b67ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c6aa0 con 0x7f32b0141150 2023-09-30T22:59:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.685+0000 7f32af7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f32b00c6270 0x7f32b015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47410/0 (socket says 172.21.15.142:47410) 2023-09-30T22:59:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.685+0000 7f32af7fe700 1 -- 172.21.15.142:0/2767301760 learned_addr learned my addr 172.21.15.142:0/2767301760 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32b4d9c700 1 --2- 172.21.15.142:0/2767301760 >> v2:172.21.15.148:3300/0 conn(0x7f32b00c40e0 0x7f32b00c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32affff700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 0x7f32b01580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962850854 0 0) 0x7f32b00c38d0 con 0x7f32b00c6270 2023-09-30T22:59:06.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3298003570 con 0x7f32b00c6270 2023-09-30T22:59:06.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493605049 0 0) 0x7f3298003570 con 0x7f32b00c6270 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 msgr2=0x7f32b01580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 0x7f32b01580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 >> v2:172.21.15.148:3300/0 conn(0x7f32b00c40e0 msgr2=0x7f32b00c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 --2- 172.21.15.142:0/2767301760 >> v2:172.21.15.148:3300/0 conn(0x7f32b00c40e0 0x7f32b00c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b006a040 con 0x7f32b00c6270 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f32a4001470 con 0x7f32b00c6270 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 >> v1:172.21.15.142:6789/0 conn(0x7f32b00c6270 legacy=0x7f32b015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3298003ae0 0x7f3298003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f3298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 0x7f32980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c4aa0 con 0x7f3298004810 2023-09-30T22:59:06.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c6aa0 con 0x7f3298003ae0 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329800bb10 con 0x7f32b0141150 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.686+0000 7f32af7fe700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f3298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32affff700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3298003ae0 0x7f3298003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32b4d9c700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 0x7f32980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32af7fe700 1 -- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 msgr2=0x7f32980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32af7fe700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b0141150 0x7f32980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32af7fe700 1 -- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3298003ae0 msgr2=0x7f3298003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32af7fe700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3298003ae0 0x7f3298003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32af7fe700 1 -- 172.21.15.142:0/2767301760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3298003570 con 0x7f3298004810 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32af7fe700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f3298004c80 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c2a0 tx=0x7f32b006a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4517c64e235a8a04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400cbd0 con 0x7f3298004810 2023-09-30T22:59:06.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400cd30 con 0x7f3298004810 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.687+0000 7f32aeffd700 1 -- 172.21.15.142:0/2767301760 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400cea0 con 0x7f3298004810 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.688+0000 7f32b67ff700 1 -- 172.21.15.142:0/2767301760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 msgr2=0x7f3298004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.688+0000 7f32b67ff700 1 --2- 172.21.15.142:0/2767301760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f3298004c80 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c2a0 tx=0x7f32b006a1d0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.688+0000 7f32b4d9c700 1 -- 172.21.15.142:0/2767301760 reap_dead start 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.688+0000 7f32b67ff700 1 -- 172.21.15.142:0/2767301760 shutdown_connections 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.688+0000 7f32b67ff700 1 -- 172.21.15.142:0/2767301760 >> 172.21.15.142:0/2767301760 conn(0x7f32b00cc670 msgr2=0x7f32b00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.688+0000 7f32b67ff700 1 -- 172.21.15.142:0/2767301760 shutdown_connections 2023-09-30T22:59:06.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.688+0000 7f32b67ff700 1 -- 172.21.15.142:0/2767301760 wait complete. 2023-09-30T22:59:06.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.690+0000 7f32b67ff700 1 Processor -- start 2023-09-30T22:59:06.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.690+0000 7f32b67ff700 1 -- start start 2023-09-30T22:59:06.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.691+0000 7f32b67ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f32b0157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.691+0000 7f32b67ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b00b94a0 0x7f32b00b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32b67ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32b00b9910 0x7f32b015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32b67ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00b9010 con 0x7f3298004810 2023-09-30T22:59:06.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32b67ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00b8400 con 0x7f32b00b9910 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32b67ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00b86e0 con 0x7f32b00b94a0 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f32b0157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f32b0157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47694/0 (socket says 172.21.15.142:47694) 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 -- 172.21.15.142:0/3641056934 learned_addr learned my addr 172.21.15.142:0/3641056934 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32af7fe700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b00b94a0 0x7f32b00b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32b4d9c700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32b00b9910 0x7f32b015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 -- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b00b94a0 msgr2=0x7f32b00b9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b00b94a0 0x7f32b00b9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 -- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32b00b9910 msgr2=0x7f32b015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32b00b9910 0x7f32b015b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.692+0000 7f32affff700 1 -- 172.21.15.142:0/3641056934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b00b89c0 con 0x7f3298004810 2023-09-30T22:59:06.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.693+0000 7f32affff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f32b0157680 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f32a0011d40 tx=0x7f32a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:06.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.693+0000 7f3297fff700 1 -- 172.21.15.142:0/3641056934 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000f990 con 0x7f3298004810 2023-09-30T22:59:06.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.693+0000 7f3297fff700 1 -- 172.21.15.142:0/3641056934 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000faf0 con 0x7f3298004810 2023-09-30T22:59:06.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.693+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b00b8ca0 con 0x7f3298004810 2023-09-30T22:59:06.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.693+0000 7f3297fff700 1 -- 172.21.15.142:0/3641056934 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000feb0 con 0x7f3298004810 2023-09-30T22:59:06.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.693+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b00b8090 con 0x7f3298004810 2023-09-30T22:59:06.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.694+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b0069a50 con 0x7f3298004810 2023-09-30T22:59:06.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.695+0000 7f3297fff700 1 -- 172.21.15.142:0/3641056934 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f32a0014650 con 0x7f3298004810 2023-09-30T22:59:06.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.696+0000 7f3297fff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f329c067330 0x7f329c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:06.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.696+0000 7f3297fff700 1 -- 172.21.15.142:0/3641056934 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f32a0018030 con 0x7f3298004810 2023-09-30T22:59:06.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.696+0000 7f32af7fe700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f329c067330 0x7f329c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:06.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.697+0000 7f32af7fe700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f329c067330 0x7f329c0697e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f32a4001ea0 tx=0x7f32a4015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:06.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.701+0000 7f3297fff700 1 -- 172.21.15.142:0/3641056934 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f32a00526e0 con 0x7f3298004810 2023-09-30T22:59:06.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.891+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f32b0157ea0 con 0x7f3298004810 2023-09-30T22:59:06.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.895+0000 7f3297fff700 1 -- 172.21.15.142:0/3641056934 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32a0055d00 con 0x7f3298004810 2023-09-30T22:59:06.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f329c067330 msgr2=0x7f329c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f329c067330 0x7f329c0697e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f32a4001ea0 tx=0x7f32a4015000 comp rx=0 tx=0).stop 2023-09-30T22:59:06.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 msgr2=0x7f32b0157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:06.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f32b0157680 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f32a0011d40 tx=0x7f32a00091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 shutdown_connections 2023-09-30T22:59:06.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f329c067330 0x7f329c0697e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32b00b9910 0x7f32b015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3298004810 0x7f32b0157680 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 --2- 172.21.15.142:0/3641056934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32b00b94a0 0x7f32b00b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:06.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 >> 172.21.15.142:0/3641056934 conn(0x7f32b00cc670 msgr2=0x7f32b015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:06.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 shutdown_connections 2023-09-30T22:59:06.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:06.898+0000 7f32b67ff700 1 -- 172.21.15.142:0/3641056934 wait complete. 2023-09-30T22:59:06.915 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:59:06.915 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:59:07.007 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:59:07.115 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:59:07.115 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:59:07.115 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.305+0000 7f9f5adff700 1 Processor -- start 2023-09-30T22:59:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.305+0000 7f9f5adff700 1 -- start start 2023-09-30T22:59:07.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f5adff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f540b1580 0x7f9f540adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f5adff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f540ad630 con 0x7f9f540b1950 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f5adff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f540b3360 con 0x7f9f540ae000 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f5adff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f54157c20 con 0x7f9f540b1580 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f58b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f540b1580 0x7f9f540adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f58b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f540b1580 0x7f9f540adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47698/0 (socket says 172.21.15.142:47698) 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f58b9b700 1 -- 172.21.15.142:0/2328840440 learned_addr learned my addr 172.21.15.142:0/2328840440 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f53fff700 1 --1- 172.21.15.142:0/2328840440 >> v1:172.21.15.142:6789/0 conn(0x7f9f540b1950 0x7f9f5415a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47426/0 (socket says 172.21.15.142:47426) 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f58b9b700 1 -- 172.21.15.142:0/2328840440 >> v1:172.21.15.148:6789/0 conn(0x7f9f540ae000 legacy=0x7f9f5406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f58b9b700 1 -- 172.21.15.142:0/2328840440 >> v1:172.21.15.142:6789/0 conn(0x7f9f540b1950 legacy=0x7f9f5415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.307+0000 7f9f58b9b700 1 -- 172.21.15.142:0/2328840440 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5415ad60 con 0x7f9f540b1580 2023-09-30T22:59:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.308+0000 7f9f58b9b700 1 --2- 172.21.15.142:0/2328840440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540b1580 0x7f9f540adac0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f9f480099b0 tx=0x7f9f48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55290de11ff983fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.308+0000 7f9f537fe700 1 -- 172.21.15.142:0/2328840440 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800b860 con 0x7f9f540b1580 2023-09-30T22:59:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.308+0000 7f9f537fe700 1 -- 172.21.15.142:0/2328840440 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4800b9c0 con 0x7f9f540b1580 2023-09-30T22:59:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.308+0000 7f9f537fe700 1 -- 172.21.15.142:0/2328840440 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800bd60 con 0x7f9f540b1580 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.308+0000 7f9f5adff700 1 -- 172.21.15.142:0/2328840440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540b1580 msgr2=0x7f9f540adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.308+0000 7f9f5adff700 1 --2- 172.21.15.142:0/2328840440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540b1580 0x7f9f540adac0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f9f480099b0 tx=0x7f9f48009250 comp rx=0 tx=0).stop 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.309+0000 7f9f5adff700 1 -- 172.21.15.142:0/2328840440 shutdown_connections 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.309+0000 7f9f5adff700 1 --2- 172.21.15.142:0/2328840440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540b1580 0x7f9f540adac0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.309+0000 7f9f5adff700 1 -- 172.21.15.142:0/2328840440 >> 172.21.15.142:0/2328840440 conn(0x7f9f540ce1f0 msgr2=0x7f9f54069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.309+0000 7f9f5adff700 1 -- 172.21.15.142:0/2328840440 shutdown_connections 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.309+0000 7f9f5adff700 1 -- 172.21.15.142:0/2328840440 wait complete. 2023-09-30T22:59:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.310+0000 7f9f5adff700 1 Processor -- start 2023-09-30T22:59:07.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.310+0000 7f9f5adff700 1 -- start start 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.311+0000 7f9f5adff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540ae000 0x7f9f540cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.311+0000 7f9f5adff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f540b1580 0x7f9f540cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.311+0000 7f9f5adff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f540b1950 0x7f9f54150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.311+0000 7f9f5adff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540a9f30 con 0x7f9f540ae000 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.311+0000 7f9f5adff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540cbc40 con 0x7f9f540b1580 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.311+0000 7f9f5adff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540aa1f0 con 0x7f9f540b1950 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.311+0000 7f9f58b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540ae000 0x7f9f540cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540ae000 0x7f9f540cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47710/0 (socket says 172.21.15.142:47710) 2023-09-30T22:59:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 -- 172.21.15.142:0/3688916685 learned_addr learned my addr 172.21.15.142:0/3688916685 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f53fff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f540b1580 0x7f9f540cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f5939c700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f540b1950 0x7f9f54150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 -- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f540b1950 msgr2=0x7f9f54150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f540b1950 0x7f9f54150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 -- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f540b1580 msgr2=0x7f9f540cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f540b1580 0x7f9f540cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 -- 172.21.15.142:0/3688916685 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480094f0 con 0x7f9f540ae000 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f53fff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f540b1580 0x7f9f540cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f58b9b700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540ae000 0x7f9f540cab50 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9f48006fd0 tx=0x7f9f48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f50ff9700 1 -- 172.21.15.142:0/3688916685 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48011e60 con 0x7f9f540ae000 2023-09-30T22:59:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f50ff9700 1 -- 172.21.15.142:0/3688916685 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4801a630 con 0x7f9f540ae000 2023-09-30T22:59:07.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f540cb3a0 con 0x7f9f540ae000 2023-09-30T22:59:07.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.312+0000 7f9f50ff9700 1 -- 172.21.15.142:0/3688916685 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4801a9b0 con 0x7f9f540ae000 2023-09-30T22:59:07.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.313+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f540cb730 con 0x7f9f540ae000 2023-09-30T22:59:07.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.314+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f540cb0f0 con 0x7f9f540ae000 2023-09-30T22:59:07.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.315+0000 7f9f50ff9700 1 -- 172.21.15.142:0/3688916685 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9f4802d440 con 0x7f9f540ae000 2023-09-30T22:59:07.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.315+0000 7f9f50ff9700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f38067330 0x7f9f380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.315+0000 7f9f50ff9700 1 -- 172.21.15.142:0/3688916685 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9f48086540 con 0x7f9f540ae000 2023-09-30T22:59:07.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.316+0000 7f9f53fff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f38067330 0x7f9f380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.316+0000 7f9f53fff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f38067330 0x7f9f380697e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007fd0 tx=0x7f9f40007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:07.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.320+0000 7f9f50ff9700 1 -- 172.21.15.142:0/3688916685 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9f480536a0 con 0x7f9f540ae000 2023-09-30T22:59:07.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.554+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f5415b040 con 0x7f9f540ae000 2023-09-30T22:59:07.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.555+0000 7f9f50ff9700 1 -- 172.21.15.142:0/3688916685 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f9f48015df0 con 0x7f9f540ae000 2023-09-30T22:59:07.555 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:07.555 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":60,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2706362623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2706362623},{"type":"v1","addr":"172.21.15.142:6837","nonce":2706362623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2536685529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2536685529},{"type":"v1","addr":"172.21.15.148:6835","nonce":2536685529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3122606220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3122606220},{"type":"v1","addr":"172.21.15.142:6836","nonce":3122606220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1176995314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1176995314},{"type":"v1","addr":"172.21.15.148:6834","nonce":1176995314}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[]} 2023-09-30T22:59:07.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f38067330 msgr2=0x7f9f380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f38067330 0x7f9f380697e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007fd0 tx=0x7f9f40007e10 comp rx=0 tx=0).stop 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540ae000 msgr2=0x7f9f540cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540ae000 0x7f9f540cab50 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9f48006fd0 tx=0x7f9f48017000 comp rx=0 tx=0).stop 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 shutdown_connections 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f38067330 0x7f9f380697e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f540b1950 0x7f9f54150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f540ae000 0x7f9f540cab50 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 --2- 172.21.15.142:0/3688916685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f540b1580 0x7f9f540cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 >> 172.21.15.142:0/3688916685 conn(0x7f9f540ce1f0 msgr2=0x7f9f54159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 shutdown_connections 2023-09-30T22:59:07.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.557+0000 7f9f5adff700 1 -- 172.21.15.142:0/3688916685 wait complete. 2023-09-30T22:59:07.559 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 60 2023-09-30T22:59:07.574 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:59:07.575 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:59:07.575 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:59:07.575 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:07.575 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:59:07.575 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:59:07.575 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:59:07.575 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:07.576 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:59:07.576 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:59:07.576 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:59:07.576 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:07.576 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:59:07.576 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:59:07.577 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:59:07.577 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:07.588 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:59:07.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:59:07.589 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:59:07.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:59:07.590 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:59:07.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:59:07.591 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:59:07.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:59:07.632 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:59:07.632 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:07.634 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:59:07.634 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:07.635 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:59:07.635 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:07.637 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:59:07.637 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:07.637 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:59:07.776 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:59:07.776 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:59:07.776 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:59:07.777 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:59:07.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.840+0000 7f1305fff700 1 Processor -- start 2023-09-30T22:59:07.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.840+0000 7f1305fff700 1 -- start start 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f1305fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f130006a8d0 0x7f130015b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f1305fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f130015ba70 0x7f13000cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f1305fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130015be80 con 0x7f1300151f00 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f1305fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000cbdb0 con 0x7f130015ba70 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f1305fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130006aec0 con 0x7f130006a8d0 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f12ff7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1300151f00 0x7f13000ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47438/0 (socket says 172.21.15.142:47438) 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f12ff7fe700 1 -- 172.21.15.142:0/81804791 learned_addr learned my addr 172.21.15.142:0/81804791 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f12fffff700 1 --2- 172.21.15.142:0/81804791 >> v2:172.21.15.148:3300/0 conn(0x7f130015ba70 0x7f13000cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f12feffd700 1 --2- 172.21.15.142:0/81804791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f130006a8d0 0x7f130015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f12fe7fc700 1 -- 172.21.15.142:0/81804791 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761423219 0 0) 0x7f130015be80 con 0x7f1300151f00 2023-09-30T22:59:07.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.842+0000 7f12fe7fc700 1 -- 172.21.15.142:0/81804791 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12e8003570 con 0x7f1300151f00 2023-09-30T22:59:07.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12feffd700 1 -- 172.21.15.142:0/81804791 >> v2:172.21.15.148:3300/0 conn(0x7f130015ba70 msgr2=0x7f13000cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:07.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12feffd700 1 --2- 172.21.15.142:0/81804791 >> v2:172.21.15.148:3300/0 conn(0x7f130015ba70 0x7f13000cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12feffd700 1 -- 172.21.15.142:0/81804791 >> v1:172.21.15.142:6789/0 conn(0x7f1300151f00 legacy=0x7f13000ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12feffd700 1 -- 172.21.15.142:0/81804791 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130006b1a0 con 0x7f130006a8d0 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12fffff700 1 --2- 172.21.15.142:0/81804791 >> v2:172.21.15.148:3300/0 conn(0x7f130015ba70 0x7f13000cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12feffd700 1 --2- 172.21.15.142:0/81804791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f130006a8d0 0x7f130015b530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12f40098e0 tx=0x7f12f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788fd6b77475bb74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12fe7fc700 1 -- 172.21.15.142:0/81804791 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4011630 con 0x7f130006a8d0 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12fe7fc700 1 -- 172.21.15.142:0/81804791 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f4011790 con 0x7f130006a8d0 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.843+0000 7f12fe7fc700 1 -- 172.21.15.142:0/81804791 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4011b30 con 0x7f130006a8d0 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 -- 172.21.15.142:0/81804791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f130006a8d0 msgr2=0x7f130015b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 --2- 172.21.15.142:0/81804791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f130006a8d0 0x7f130015b530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f12f40098e0 tx=0x7f12f40091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 -- 172.21.15.142:0/81804791 shutdown_connections 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 --2- 172.21.15.142:0/81804791 >> v2:172.21.15.148:3300/0 conn(0x7f130015ba70 0x7f13000cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 --2- 172.21.15.142:0/81804791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f130006a8d0 0x7f130015b530 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 -- 172.21.15.142:0/81804791 >> 172.21.15.142:0/81804791 conn(0x7f13000ce8e0 msgr2=0x7f13000cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:07.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 -- 172.21.15.142:0/81804791 shutdown_connections 2023-09-30T22:59:07.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.844+0000 7f1305fff700 1 -- 172.21.15.142:0/81804791 wait complete. 2023-09-30T22:59:07.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.846+0000 7f1305fff700 1 Processor -- start 2023-09-30T22:59:07.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.846+0000 7f1305fff700 1 -- start start 2023-09-30T22:59:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f1305fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130006a8d0 0x7f1300157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f1305fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1300151f00 0x7f13000c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f1305fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f130015ba70 0x7f130016df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f1305fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130016e470 con 0x7f130006a8d0 2023-09-30T22:59:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f1305fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c4df0 con 0x7f130015ba70 2023-09-30T22:59:07.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f1305fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c5040 con 0x7f1300151f00 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130006a8d0 0x7f1300157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130006a8d0 0x7f1300157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47740/0 (socket says 172.21.15.142:47740) 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.847+0000 7f12ff7fe700 1 -- 172.21.15.142:0/1250213011 learned_addr learned my addr 172.21.15.142:0/1250213011 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12ff7fe700 1 -- 172.21.15.142:0/1250213011 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1300151f00 msgr2=0x7f13000c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12ff7fe700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1300151f00 0x7f13000c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12ff7fe700 1 -- 172.21.15.142:0/1250213011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f130015ba70 msgr2=0x7f130016df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12ff7fe700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f130015ba70 0x7f130016df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12ff7fe700 1 -- 172.21.15.142:0/1250213011 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009a20 con 0x7f130006a8d0 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12ff7fe700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130006a8d0 0x7f1300157bc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c7c0 tx=0x7f12f0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12e77fe700 1 -- 172.21.15.142:0/1250213011 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0005b30 con 0x7f130006a8d0 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12e77fe700 1 -- 172.21.15.142:0/1250213011 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0005c90 con 0x7f130006a8d0 2023-09-30T22:59:07.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f4009420 con 0x7f130006a8d0 2023-09-30T22:59:07.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f12e77fe700 1 -- 172.21.15.142:0/1250213011 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0007320 con 0x7f130006a8d0 2023-09-30T22:59:07.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.848+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000c5600 con 0x7f130006a8d0 2023-09-30T22:59:07.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.849+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130006ea70 con 0x7f130006a8d0 2023-09-30T22:59:07.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.850+0000 7f12e77fe700 1 -- 172.21.15.142:0/1250213011 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f12f001b400 con 0x7f130006a8d0 2023-09-30T22:59:07.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.851+0000 7f12e77fe700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f12ec067330 0x7f12ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:07.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.851+0000 7f12e77fe700 1 -- 172.21.15.142:0/1250213011 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f12f0084380 con 0x7f130006a8d0 2023-09-30T22:59:07.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.851+0000 7f12feffd700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f12ec067330 0x7f12ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:07.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.852+0000 7f12feffd700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f12ec067330 0x7f12ec0697e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f12f40091e0 tx=0x7f12f4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:07.855+0000 7f12e77fe700 1 -- 172.21.15.142:0/1250213011 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f12f0051560 con 0x7f130006a8d0 2023-09-30T22:59:08.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.063+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f130006fc10 con 0x7f130006a8d0 2023-09-30T22:59:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.480+0000 7f12e77fe700 1 -- 172.21.15.142:0/1250213011 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) v1 ==== 97+0+0 (secure 0 0 0) 0x7f12f0054b80 con 0x7f130006a8d0 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.483+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f12ec067330 msgr2=0x7f12ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.483+0000 7f1305fff700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f12ec067330 0x7f12ec0697e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f12f40091e0 tx=0x7f12f4017000 comp rx=0 tx=0).stop 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.483+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130006a8d0 msgr2=0x7f1300157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.483+0000 7f1305fff700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130006a8d0 0x7f1300157bc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c7c0 tx=0x7f12f0007e00 comp rx=0 tx=0).stop 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.483+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 shutdown_connections 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.483+0000 7f1305fff700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f12ec067330 0x7f12ec0697e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.483+0000 7f1305fff700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f130015ba70 0x7f130016df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.484+0000 7f1305fff700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130006a8d0 0x7f1300157bc0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.484+0000 7f1305fff700 1 --2- 172.21.15.142:0/1250213011 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1300151f00 0x7f13000c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.484+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 >> 172.21.15.142:0/1250213011 conn(0x7f13000ce8e0 msgr2=0x7f130014f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.484+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 shutdown_connections 2023-09-30T22:59:08.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.484+0000 7f1305fff700 1 -- 172.21.15.142:0/1250213011 wait complete. 2023-09-30T22:59:08.485 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:59:08.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:59:08.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.691+0000 7fa524bff700 1 Processor -- start 2023-09-30T22:59:08.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.691+0000 7fa524bff700 1 -- start start 2023-09-30T22:59:08.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.692+0000 7fa524bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5201598e0 0x7fa520159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:08.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.692+0000 7fa524bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5200d03d0 0x7fa52015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:08.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.692+0000 7fa524bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52006b8d0 con 0x7fa5200cee50 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.692+0000 7fa524bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5200cff40 con 0x7fa5201598e0 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.692+0000 7fa524bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5200cf330 con 0x7fa5200d03d0 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.692+0000 7fa51e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5201598e0 0x7fa520159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5201598e0 0x7fa520159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47754/0 (socket says 172.21.15.142:47754) 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51e59c700 1 -- 172.21.15.142:0/2133844836 learned_addr learned my addr 172.21.15.142:0/2133844836 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51ed9d700 1 --2- 172.21.15.142:0/2133844836 >> v2:172.21.15.148:3300/0 conn(0x7fa5200d03d0 0x7fa52015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51e59c700 1 -- 172.21.15.142:0/2133844836 >> v2:172.21.15.148:3300/0 conn(0x7fa5200d03d0 msgr2=0x7fa52015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51e59c700 1 --2- 172.21.15.142:0/2133844836 >> v2:172.21.15.148:3300/0 conn(0x7fa5200d03d0 0x7fa52015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51e59c700 1 -- 172.21.15.142:0/2133844836 >> v1:172.21.15.148:6789/0 conn(0x7fa5200cee50 legacy=0x7fa52006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51e59c700 1 -- 172.21.15.142:0/2133844836 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5200cf610 con 0x7fa5201598e0 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51e59c700 1 --2- 172.21.15.142:0/2133844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa520159cb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa5200cfeb0 tx=0x7fa510009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1ef24076ea6d3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:08.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51d59a700 1 -- 172.21.15.142:0/2133844836 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510009e70 con 0x7fa5201598e0 2023-09-30T22:59:08.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51d59a700 1 -- 172.21.15.142:0/2133844836 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51000b860 con 0x7fa5201598e0 2023-09-30T22:59:08.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.693+0000 7fa51d59a700 1 -- 172.21.15.142:0/2133844836 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51000bc00 con 0x7fa5201598e0 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 -- 172.21.15.142:0/2133844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 msgr2=0x7fa520159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 --2- 172.21.15.142:0/2133844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa520159cb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa5200cfeb0 tx=0x7fa510009250 comp rx=0 tx=0).stop 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 -- 172.21.15.142:0/2133844836 shutdown_connections 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 --2- 172.21.15.142:0/2133844836 >> v2:172.21.15.148:3300/0 conn(0x7fa5200d03d0 0x7fa52015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 --2- 172.21.15.142:0/2133844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa520159cb0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 -- 172.21.15.142:0/2133844836 >> 172.21.15.142:0/2133844836 conn(0x7fa5200cd540 msgr2=0x7fa5200cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 -- 172.21.15.142:0/2133844836 shutdown_connections 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.694+0000 7fa524bff700 1 -- 172.21.15.142:0/2133844836 wait complete. 2023-09-30T22:59:08.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.696+0000 7fa524bff700 1 Processor -- start 2023-09-30T22:59:08.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.696+0000 7fa524bff700 1 -- start start 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa524bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5200cee50 0x7fa5200c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa524bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5200d03d0 0x7fa5200cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa524bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa5200c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa524bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200cad90 con 0x7fa5201598e0 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa524bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200ca180 con 0x7fa5200cee50 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa524bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200ca460 con 0x7fa5200d03d0 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa5200c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa5200c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47770/0 (socket says 172.21.15.142:47770) 2023-09-30T22:59:08.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 -- 172.21.15.142:0/2666129567 learned_addr learned my addr 172.21.15.142:0/2666129567 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51e59c700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5200cee50 0x7fa5200c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51dd9b700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5200d03d0 0x7fa5200cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 -- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5200d03d0 msgr2=0x7fa5200cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5200d03d0 0x7fa5200cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 -- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5200cee50 msgr2=0x7fa5200c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5200cee50 0x7fa5200c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 -- 172.21.15.142:0/2666129567 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100094f0 con 0x7fa5201598e0 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51dd9b700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5200d03d0 0x7fa5200cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.698+0000 7fa51ed9d700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa5200c9780 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa518009e90 tx=0x7fa51800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.699+0000 7fa50e7fc700 1 -- 172.21.15.142:0/2666129567 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800cc20 con 0x7fa5201598e0 2023-09-30T22:59:08.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.699+0000 7fa50e7fc700 1 -- 172.21.15.142:0/2666129567 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51800f040 con 0x7fa5201598e0 2023-09-30T22:59:08.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.699+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5200ca740 con 0x7fa5201598e0 2023-09-30T22:59:08.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.699+0000 7fa50e7fc700 1 -- 172.21.15.142:0/2666129567 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518014480 con 0x7fa5201598e0 2023-09-30T22:59:08.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.699+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5200c6fe0 con 0x7fa5201598e0 2023-09-30T22:59:08.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.700+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5200caf00 con 0x7fa5201598e0 2023-09-30T22:59:08.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.701+0000 7fa50e7fc700 1 -- 172.21.15.142:0/2666129567 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa518014830 con 0x7fa5201598e0 2023-09-30T22:59:08.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.702+0000 7fa50e7fc700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa500067330 0x7fa5000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:08.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.702+0000 7fa50e7fc700 1 -- 172.21.15.142:0/2666129567 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa518085550 con 0x7fa5201598e0 2023-09-30T22:59:08.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.702+0000 7fa51e59c700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa500067330 0x7fa5000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:08.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.703+0000 7fa51e59c700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa500067330 0x7fa5000697e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa5200cfeb0 tx=0x7fa510017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.706+0000 7fa50e7fc700 1 -- 172.21.15.142:0/2666129567 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa518056230 con 0x7fa5201598e0 2023-09-30T22:59:08.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.969+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa52006fc10 con 0x7fa5201598e0 2023-09-30T22:59:08.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.969+0000 7fa50e7fc700 1 -- 172.21.15.142:0/2666129567 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa518055dc0 con 0x7fa5201598e0 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:59:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:59:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:59:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:59:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:08.985 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:08.985 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa500067330 msgr2=0x7fa5000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa500067330 0x7fa5000697e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa5200cfeb0 tx=0x7fa510017000 comp rx=0 tx=0).stop 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 msgr2=0x7fa5200c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa5200c9780 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa518009e90 tx=0x7fa51800b040 comp rx=0 tx=0).stop 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 shutdown_connections 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa500067330 0x7fa5000697e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5201598e0 0x7fa5200c9780 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5200cee50 0x7fa5200c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 --2- 172.21.15.142:0/2666129567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5200d03d0 0x7fa5200cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 >> 172.21.15.142:0/2666129567 conn(0x7fa5200cd540 msgr2=0x7fa5201575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:08.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 shutdown_connections 2023-09-30T22:59:08.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:08.972+0000 7fa524bff700 1 -- 172.21.15.142:0/2666129567 wait complete. 2023-09-30T22:59:08.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:09.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.179+0000 7f5e6a9ff700 1 Processor -- start 2023-09-30T22:59:09.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.179+0000 7f5e6a9ff700 1 -- start start 2023-09-30T22:59:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.180+0000 7f5e6a9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e6406d3f0 0x7f5e6406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.180+0000 7f5e6a9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e6415e270 0x7f5e64159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.180+0000 7f5e6a9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6415dde0 con 0x7f5e640c6da0 2023-09-30T22:59:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.180+0000 7f5e6a9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6415e710 con 0x7f5e6406d3f0 2023-09-30T22:59:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.180+0000 7f5e6a9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6406b840 con 0x7f5e6415e270 2023-09-30T22:59:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.180+0000 7f5e63fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e6406d3f0 0x7f5e6406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e63fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e6406d3f0 0x7f5e6406d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47782/0 (socket says 172.21.15.142:47782) 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e63fff700 1 -- 172.21.15.142:0/1750678917 learned_addr learned my addr 172.21.15.142:0/1750678917 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e68f9c700 1 --2- 172.21.15.142:0/1750678917 >> v2:172.21.15.148:3300/0 conn(0x7f5e6415e270 0x7f5e64159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e63fff700 1 -- 172.21.15.142:0/1750678917 >> v2:172.21.15.148:3300/0 conn(0x7f5e6415e270 msgr2=0x7f5e64159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e63fff700 1 --2- 172.21.15.142:0/1750678917 >> v2:172.21.15.148:3300/0 conn(0x7f5e6415e270 0x7f5e64159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e63fff700 1 -- 172.21.15.142:0/1750678917 >> v1:172.21.15.148:6789/0 conn(0x7f5e640c6da0 legacy=0x7f5e6406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e63fff700 1 -- 172.21.15.142:0/1750678917 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6415d7d0 con 0x7f5e6406d3f0 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e63fff700 1 --2- 172.21.15.142:0/1750678917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e6406d3f0 0x7f5e6406d7c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5e540099b0 tx=0x7f5e54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d93fea3281d053 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e62ffd700 1 -- 172.21.15.142:0/1750678917 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400b7e0 con 0x7f5e6406d3f0 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e62ffd700 1 -- 172.21.15.142:0/1750678917 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5400b940 con 0x7f5e6406d3f0 2023-09-30T22:59:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.181+0000 7f5e62ffd700 1 -- 172.21.15.142:0/1750678917 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400bce0 con 0x7f5e6406d3f0 2023-09-30T22:59:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/1750678917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e6406d3f0 msgr2=0x7f5e6406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/1750678917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e6406d3f0 0x7f5e6406d7c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5e540099b0 tx=0x7f5e54009250 comp rx=0 tx=0).stop 2023-09-30T22:59:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/1750678917 shutdown_connections 2023-09-30T22:59:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/1750678917 >> v2:172.21.15.148:3300/0 conn(0x7f5e6415e270 0x7f5e64159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/1750678917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e6406d3f0 0x7f5e6406d7c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/1750678917 >> 172.21.15.142:0/1750678917 conn(0x7f5e64067e30 msgr2=0x7f5e64068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/1750678917 shutdown_connections 2023-09-30T22:59:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.182+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/1750678917 wait complete. 2023-09-30T22:59:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.184+0000 7f5e6a9ff700 1 Processor -- start 2023-09-30T22:59:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.184+0000 7f5e6a9ff700 1 -- start start 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e6a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e6406d3f0 0x7f5e6411afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e6a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e640c6da0 0x7f5e6406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e6a9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e6415e270 0x7f5e64144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e6a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640ce5f0 con 0x7f5e640c6da0 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e6a9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6411b500 con 0x7f5e6415e270 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e6a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640cd9e0 con 0x7f5e6406d3f0 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e640c6da0 0x7f5e6406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e640c6da0 0x7f5e6406da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47790/0 (socket says 172.21.15.142:47790) 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 -- 172.21.15.142:0/3401149413 learned_addr learned my addr 172.21.15.142:0/3401149413 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e63fff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e6406d3f0 0x7f5e6411afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e68f9c700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e6415e270 0x7f5e64144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 -- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e6406d3f0 msgr2=0x7f5e6411afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e6406d3f0 0x7f5e6411afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 -- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e6415e270 msgr2=0x7f5e64144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e6415e270 0x7f5e64144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e637fe700 1 -- 172.21.15.142:0/3401149413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540094f0 con 0x7f5e640c6da0 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.186+0000 7f5e68f9c700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e6415e270 0x7f5e64144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.187+0000 7f5e637fe700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e640c6da0 0x7f5e6406da10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c5d0 tx=0x7f5e58007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.187+0000 7f5e4bfff700 1 -- 172.21.15.142:0/3401149413 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58011590 con 0x7f5e640c6da0 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.187+0000 7f5e4bfff700 1 -- 172.21.15.142:0/3401149413 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58011710 con 0x7f5e640c6da0 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.187+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e640cdcc0 con 0x7f5e640c6da0 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.187+0000 7f5e4bfff700 1 -- 172.21.15.142:0/3401149413 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58011ad0 con 0x7f5e640c6da0 2023-09-30T22:59:09.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.187+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e640ce280 con 0x7f5e640c6da0 2023-09-30T22:59:09.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.188+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e640ce760 con 0x7f5e640c6da0 2023-09-30T22:59:09.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.189+0000 7f5e4bfff700 1 -- 172.21.15.142:0/3401149413 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5e5801c460 con 0x7f5e640c6da0 2023-09-30T22:59:09.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.189+0000 7f5e4bfff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e50067330 0x7f5e500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.190+0000 7f5e4bfff700 1 -- 172.21.15.142:0/3401149413 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5e58084630 con 0x7f5e640c6da0 2023-09-30T22:59:09.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.190+0000 7f5e63fff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e50067330 0x7f5e500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.190+0000 7f5e63fff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e50067330 0x7f5e500697e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e540099b0 tx=0x7f5e54016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:09.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.194+0000 7f5e4bfff700 1 -- 172.21.15.142:0/3401149413 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5e580517e0 con 0x7f5e640c6da0 2023-09-30T22:59:09.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.387+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e640c7230 con 0x7f5e640c6da0 2023-09-30T22:59:09.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.388+0000 7f5e4bfff700 1 -- 172.21.15.142:0/3401149413 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+13806 (secure 0 0 0) 0x7f5e58054e00 con 0x7f5e640c6da0 2023-09-30T22:59:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:09.388 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":140,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:08.484738+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:09.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e50067330 msgr2=0x7f5e500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e50067330 0x7f5e500697e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e540099b0 tx=0x7f5e54016000 comp rx=0 tx=0).stop 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e640c6da0 msgr2=0x7f5e6406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e640c6da0 0x7f5e6406da10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c5d0 tx=0x7f5e58007f60 comp rx=0 tx=0).stop 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 shutdown_connections 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e50067330 0x7f5e500697e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e6415e270 0x7f5e64144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e6406d3f0 0x7f5e6411afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 --2- 172.21.15.142:0/3401149413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e640c6da0 0x7f5e6406da10 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 >> 172.21.15.142:0/3401149413 conn(0x7f5e64067e30 msgr2=0x7f5e64157160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:09.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 shutdown_connections 2023-09-30T22:59:09.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.390+0000 7f5e6a9ff700 1 -- 172.21.15.142:0/3401149413 wait complete. 2023-09-30T22:59:09.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:59:09.408 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:59:09.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.601+0000 7f5aa19ff700 1 Processor -- start 2023-09-30T22:59:09.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.602+0000 7f5aa19ff700 1 -- start start 2023-09-30T22:59:09.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5aa19ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c141150 0x7f5a9c1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5aa19ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a9c0c40e0 0x7f5a9c0c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5aa19ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0c38d0 con 0x7f5a9c0c6270 2023-09-30T22:59:09.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5aa19ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0c4aa0 con 0x7f5a9c0c40e0 2023-09-30T22:59:09.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5aa19ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0c6aa0 con 0x7f5a9c141150 2023-09-30T22:59:09.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5a9b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a9c0c40e0 0x7f5a9c0c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5a9b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a9c0c40e0 0x7f5a9c0c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47802/0 (socket says 172.21.15.142:47802) 2023-09-30T22:59:09.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5a9b7fe700 1 -- 172.21.15.142:0/3919978458 learned_addr learned my addr 172.21.15.142:0/3919978458 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:09.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.603+0000 7f5a9affd700 1 --2- 172.21.15.142:0/3919978458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c141150 0x7f5a9c1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a9b7fe700 1 -- 172.21.15.142:0/3919978458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c141150 msgr2=0x7f5a9c1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:09.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a9b7fe700 1 --2- 172.21.15.142:0/3919978458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c141150 0x7f5a9c1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a9b7fe700 1 -- 172.21.15.142:0/3919978458 >> v1:172.21.15.148:6789/0 conn(0x7f5a9c0c6270 legacy=0x7f5a9c15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a9b7fe700 1 -- 172.21.15.142:0/3919978458 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c06a040 con 0x7f5a9c0c40e0 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a9b7fe700 1 --2- 172.21.15.142:0/3919978458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c40e0 0x7f5a9c0c4560 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009f20 tx=0x7f5a94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463883c7b7c67ccb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a99ffb700 1 -- 172.21.15.142:0/3919978458 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400e070 con 0x7f5a9c0c40e0 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a99ffb700 1 -- 172.21.15.142:0/3919978458 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400b9d0 con 0x7f5a9c0c40e0 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.604+0000 7f5a99ffb700 1 -- 172.21.15.142:0/3919978458 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940092e0 con 0x7f5a9c0c40e0 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3919978458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c40e0 msgr2=0x7f5a9c0c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3919978458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c40e0 0x7f5a9c0c4560 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009f20 tx=0x7f5a94009840 comp rx=0 tx=0).stop 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3919978458 shutdown_connections 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3919978458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c40e0 0x7f5a9c0c4560 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3919978458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c141150 0x7f5a9c1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3919978458 >> 172.21.15.142:0/3919978458 conn(0x7f5a9c0cc670 msgr2=0x7f5a9c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:09.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3919978458 shutdown_connections 2023-09-30T22:59:09.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.605+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3919978458 wait complete. 2023-09-30T22:59:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.607+0000 7f5aa19ff700 1 Processor -- start 2023-09-30T22:59:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.607+0000 7f5aa19ff700 1 -- start start 2023-09-30T22:59:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5aa19ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c0c40e0 0x7f5a9c1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5aa19ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c6270 0x7f5a9c168340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5aa19ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a9c141150 0x7f5a9c13e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5aa19ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c15ace0 con 0x7f5a9c0c6270 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5aa19ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0b7fe0 con 0x7f5a9c141150 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5aa19ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0b5740 con 0x7f5a9c0c40e0 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c6270 0x7f5a9c168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c0c40e0 0x7f5a9c1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9affd700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c0c40e0 0x7f5a9c1578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:39696/0 (socket says 172.21.15.142:39696) 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c6270 0x7f5a9c168340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47814/0 (socket says 172.21.15.142:47814) 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9affd700 1 -- 172.21.15.142:0/3719996238 learned_addr learned my addr 172.21.15.142:0/3719996238 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9b7fe700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a9c141150 0x7f5a9c13e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9a7fc700 1 -- 172.21.15.142:0/3719996238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c0c40e0 msgr2=0x7f5a9c1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9a7fc700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c0c40e0 0x7f5a9c1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9a7fc700 1 -- 172.21.15.142:0/3719996238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a9c141150 msgr2=0x7f5a9c13e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.608+0000 7f5a9a7fc700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a9c141150 0x7f5a9c13e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.609+0000 7f5a9a7fc700 1 -- 172.21.15.142:0/3719996238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94009ae0 con 0x7f5a9c0c6270 2023-09-30T22:59:09.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.609+0000 7f5a9a7fc700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c6270 0x7f5a9c168340 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000c590 tx=0x7f5a90007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:09.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.609+0000 7f5a82ffd700 1 -- 172.21.15.142:0/3719996238 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90011590 con 0x7f5a9c0c6270 2023-09-30T22:59:09.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.609+0000 7f5a82ffd700 1 -- 172.21.15.142:0/3719996238 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a90011710 con 0x7f5a9c0c6270 2023-09-30T22:59:09.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.609+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c0b4b30 con 0x7f5a9c0c6270 2023-09-30T22:59:09.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.609+0000 7f5a82ffd700 1 -- 172.21.15.142:0/3719996238 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90011ad0 con 0x7f5a9c0c6270 2023-09-30T22:59:09.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.609+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c0b50f0 con 0x7f5a9c0c6270 2023-09-30T22:59:09.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.610+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c069a50 con 0x7f5a9c0c6270 2023-09-30T22:59:09.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.611+0000 7f5a82ffd700 1 -- 172.21.15.142:0/3719996238 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5a9001b3b0 con 0x7f5a9c0c6270 2023-09-30T22:59:09.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.612+0000 7f5a82ffd700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a88067330 0x7f5a880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:09.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.612+0000 7f5a82ffd700 1 -- 172.21.15.142:0/3719996238 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5a90083c90 con 0x7f5a9c0c6270 2023-09-30T22:59:09.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.613+0000 7f5a9affd700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a88067330 0x7f5a880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:09.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.613+0000 7f5a9affd700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a88067330 0x7f5a880697e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009dd0 tx=0x7f5a8c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:09.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.617+0000 7f5a82ffd700 1 -- 172.21.15.142:0/3719996238 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5a90050e40 con 0x7f5a9c0c6270 2023-09-30T22:59:09.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.806+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a9c0b5880 con 0x7f5a9c0c6270 2023-09-30T22:59:09.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.807+0000 7f5a82ffd700 1 -- 172.21.15.142:0/3719996238 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a90017070 con 0x7f5a9c0c6270 2023-09-30T22:59:09.807 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:59:09.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a88067330 msgr2=0x7f5a880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a88067330 0x7f5a880697e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009dd0 tx=0x7f5a8c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c6270 msgr2=0x7f5a9c168340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c6270 0x7f5a9c168340 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000c590 tx=0x7f5a90007ec0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 shutdown_connections 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a88067330 0x7f5a880697e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a9c141150 0x7f5a9c13e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a9c0c40e0 0x7f5a9c1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 --2- 172.21.15.142:0/3719996238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a9c0c6270 0x7f5a9c168340 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 >> 172.21.15.142:0/3719996238 conn(0x7f5a9c0cc670 msgr2=0x7f5a9c0c7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 shutdown_connections 2023-09-30T22:59:09.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:09.809+0000 7f5aa19ff700 1 -- 172.21.15.142:0/3719996238 wait complete. 2023-09-30T22:59:09.827 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:59:10.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.020+0000 7f8ee9bff700 1 Processor -- start 2023-09-30T22:59:10.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.020+0000 7f8ee9bff700 1 -- start start 2023-09-30T22:59:10.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.021+0000 7f8ee9bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 0x7f8ee406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee9bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ee415a920 0x7f8ee4156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee9bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee41576e0 con 0x7f8ee41509d0 2023-09-30T22:59:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee9bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee40cc320 con 0x7f8ee415a920 2023-09-30T22:59:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee9bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415a490 con 0x7f8ee4150600 2023-09-30T22:59:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee2ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8ee41509d0 0x7f8ee4156710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47444/0 (socket says 172.21.15.142:47444) 2023-09-30T22:59:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/435185193 learned_addr learned my addr 172.21.15.142:0/435185193 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 0x7f8ee406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee3fff700 1 --2- 172.21.15.142:0/435185193 >> v2:172.21.15.148:3300/0 conn(0x7f8ee415a920 0x7f8ee4156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352037520 0 0) 0x7f8ee41576e0 con 0x7f8ee41509d0 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.022+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ecc003570 con 0x7f8ee41509d0 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 369764935 0 0) 0x7f8ecc003570 con 0x7f8ee41509d0 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 msgr2=0x7f8ee406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 0x7f8ee406a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 >> v2:172.21.15.148:3300/0 conn(0x7f8ee415a920 msgr2=0x7f8ee4156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 --2- 172.21.15.142:0/435185193 >> v2:172.21.15.148:3300/0 conn(0x7f8ee415a920 0x7f8ee4156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4157400 con 0x7f8ee41509d0 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f8ed8001470 con 0x7f8ee41509d0 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 >> v1:172.21.15.142:6789/0 conn(0x7f8ee41509d0 legacy=0x7f8ee4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc003ae0 0x7f8ecc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc004810 0x7f8ecc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 0x7f8ecc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40cc320 con 0x7f8ecc004810 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415a490 con 0x7f8ecc003ae0 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc00bb10 con 0x7f8ee4150600 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee2ffd700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc004810 0x7f8ecc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc003ae0 0x7f8ecc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee3fff700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 0x7f8ecc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 msgr2=0x7f8ecc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee2ffd700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee4150600 0x7f8ecc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc003ae0 msgr2=0x7f8ecc003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee2ffd700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc003ae0 0x7f8ecc003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.023+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/435185193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc003570 con 0x7f8ecc004810 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee2ffd700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc004810 0x7f8ecc004c80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c2d0 tx=0x7f8ed8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b25fc294928e82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800cba0 con 0x7f8ecc004810 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800cd20 con 0x7f8ecc004810 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee27fc700 1 -- 172.21.15.142:0/435185193 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8005b70 con 0x7f8ecc004810 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee9bff700 1 -- 172.21.15.142:0/435185193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc004810 msgr2=0x7f8ecc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee9bff700 1 --2- 172.21.15.142:0/435185193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc004810 0x7f8ecc004c80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c2d0 tx=0x7f8ed8001dc0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee3fff700 1 -- 172.21.15.142:0/435185193 reap_dead start 2023-09-30T22:59:10.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee9bff700 1 -- 172.21.15.142:0/435185193 shutdown_connections 2023-09-30T22:59:10.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee9bff700 1 -- 172.21.15.142:0/435185193 >> 172.21.15.142:0/435185193 conn(0x7f8ee40cc670 msgr2=0x7f8ee40cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:10.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.024+0000 7f8ee9bff700 1 -- 172.21.15.142:0/435185193 shutdown_connections 2023-09-30T22:59:10.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.025+0000 7f8ee9bff700 1 -- 172.21.15.142:0/435185193 wait complete. 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.026+0000 7f8ee9bff700 1 Processor -- start 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.026+0000 7f8ee9bff700 1 -- start start 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee9bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc004810 0x7f8ee40c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee9bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40c5fb0 0x7f8ee416b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee9bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee414dba0 0x7f8ee414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee9bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee416b770 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee9bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40c4f10 con 0x7f8ecc004810 2023-09-30T22:59:10.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee9bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40c51f0 con 0x7f8ee414dba0 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40c5fb0 0x7f8ee416b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40c5fb0 0x7f8ee416b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47826/0 (socket says 172.21.15.142:47826) 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/2514327163 learned_addr learned my addr 172.21.15.142:0/2514327163 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc004810 0x7f8ee40c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.027+0000 7f8ee3fff700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee414dba0 0x7f8ee414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee414dba0 msgr2=0x7f8ee414e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee2ffd700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee414dba0 0x7f8ee414e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc004810 msgr2=0x7f8ee40c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee2ffd700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc004810 0x7f8ee40c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee2ffd700 1 -- 172.21.15.142:0/2514327163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40c54d0 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee2ffd700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40c5fb0 0x7f8ee416b230 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00ba60 tx=0x7f8ed8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ecb7fe700 1 -- 172.21.15.142:0/2514327163 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8000f50 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ecb7fe700 1 -- 172.21.15.142:0/2514327163 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed80070d0 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee416b770 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ecb7fe700 1 -- 172.21.15.142:0/2514327163 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8007490 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.028+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee40c5a90 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.029+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee4069a50 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.030+0000 7f8ecb7fe700 1 -- 172.21.15.142:0/2514327163 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ed8019030 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.031+0000 7f8ecb7fe700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067320 0x7f8ed00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.031+0000 7f8ecb7fe700 1 -- 172.21.15.142:0/2514327163 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8ed8085fa0 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.031+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067320 0x7f8ed00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.032+0000 7f8ee37fe700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067320 0x7f8ed00697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4006f00 tx=0x7f8ed400a330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.036+0000 7f8ecb7fe700 1 -- 172.21.15.142:0/2514327163 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ed8053150 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.226+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8ee406fc10 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.227+0000 7f8ecb7fe700 1 -- 172.21.15.142:0/2514327163 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v140) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ed8017020 con 0x7f8ee40c5fb0 2023-09-30T22:59:10.227 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:59:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067320 msgr2=0x7f8ed00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067320 0x7f8ed00697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4006f00 tx=0x7f8ed400a330 comp rx=0 tx=0).stop 2023-09-30T22:59:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40c5fb0 msgr2=0x7f8ee416b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40c5fb0 0x7f8ee416b230 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00ba60 tx=0x7f8ed8012000 comp rx=0 tx=0).stop 2023-09-30T22:59:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 shutdown_connections 2023-09-30T22:59:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ed0067320 0x7f8ed00697d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ee414dba0 0x7f8ee414e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ecc004810 0x7f8ee40c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 --2- 172.21.15.142:0/2514327163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ee40c5fb0 0x7f8ee416b230 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 >> 172.21.15.142:0/2514327163 conn(0x7f8ee40cc670 msgr2=0x7f8ee4156310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:10.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 shutdown_connections 2023-09-30T22:59:10.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.229+0000 7f8ee9bff700 1 -- 172.21.15.142:0/2514327163 wait complete. 2023-09-30T22:59:10.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:59:10.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.435+0000 7f3b02fff700 1 Processor -- start 2023-09-30T22:59:10.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.435+0000 7f3b02fff700 1 -- start start 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3b02fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3afc06d3f0 0x7f3afc06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3b02fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3afc0c6da0 0x7f3afc15e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3b02fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc15dde0 con 0x7f3afc06b130 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3b02fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc15d7d0 con 0x7f3afc0c6da0 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3b02fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0c7230 con 0x7f3afc06d3f0 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3afbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3afc0c6da0 0x7f3afc15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3afbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3afc0c6da0 0x7f3afc15e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47836/0 (socket says 172.21.15.142:47836) 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3afbfff700 1 -- 172.21.15.142:0/444453004 learned_addr learned my addr 172.21.15.142:0/444453004 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:10.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.437+0000 7f3b00d9b700 1 --2- 172.21.15.142:0/444453004 >> v2:172.21.15.148:3300/0 conn(0x7f3afc06d3f0 0x7f3afc06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afbfff700 1 -- 172.21.15.142:0/444453004 >> v2:172.21.15.148:3300/0 conn(0x7f3afc06d3f0 msgr2=0x7f3afc06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afbfff700 1 --2- 172.21.15.142:0/444453004 >> v2:172.21.15.148:3300/0 conn(0x7f3afc06d3f0 0x7f3afc06d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afbfff700 1 -- 172.21.15.142:0/444453004 >> v1:172.21.15.148:6789/0 conn(0x7f3afc06b130 legacy=0x7f3afc069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afbfff700 1 -- 172.21.15.142:0/444453004 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc15da70 con 0x7f3afc0c6da0 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afbfff700 1 --2- 172.21.15.142:0/444453004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc0c6da0 0x7f3afc15e270 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80099b0 tx=0x7f3ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1add1f7eedc755 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afb7fe700 1 -- 172.21.15.142:0/444453004 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8009ea0 con 0x7f3afc0c6da0 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afb7fe700 1 -- 172.21.15.142:0/444453004 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae800b820 con 0x7f3afc0c6da0 2023-09-30T22:59:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.438+0000 7f3afb7fe700 1 -- 172.21.15.142:0/444453004 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800bbc0 con 0x7f3afc0c6da0 2023-09-30T22:59:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 -- 172.21.15.142:0/444453004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc0c6da0 msgr2=0x7f3afc15e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 --2- 172.21.15.142:0/444453004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc0c6da0 0x7f3afc15e270 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80099b0 tx=0x7f3ae8009250 comp rx=0 tx=0).stop 2023-09-30T22:59:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 -- 172.21.15.142:0/444453004 shutdown_connections 2023-09-30T22:59:10.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 --2- 172.21.15.142:0/444453004 >> v2:172.21.15.148:3300/0 conn(0x7f3afc06d3f0 0x7f3afc06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 --2- 172.21.15.142:0/444453004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc0c6da0 0x7f3afc15e270 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 -- 172.21.15.142:0/444453004 >> 172.21.15.142:0/444453004 conn(0x7f3afc067e30 msgr2=0x7f3afc068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 -- 172.21.15.142:0/444453004 shutdown_connections 2023-09-30T22:59:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.439+0000 7f3b02fff700 1 -- 172.21.15.142:0/444453004 wait complete. 2023-09-30T22:59:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.440+0000 7f3b02fff700 1 Processor -- start 2023-09-30T22:59:10.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.440+0000 7f3b02fff700 1 -- start start 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b02fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc06b130 0x7f3afc14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b02fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3afc06d3f0 0x7f3afc16ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b02fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3afc0c6da0 0x7f3afc14dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b02fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc14db20 con 0x7f3afc06b130 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b02fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0ca510 con 0x7f3afc06d3f0 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b02fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0cad40 con 0x7f3afc0c6da0 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b00d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc06b130 0x7f3afc14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b00d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc06b130 0x7f3afc14cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47840/0 (socket says 172.21.15.142:47840) 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.441+0000 7f3b00d9b700 1 -- 172.21.15.142:0/3194430233 learned_addr learned my addr 172.21.15.142:0/3194430233 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3afbfff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3afc06d3f0 0x7f3afc16ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b0159c700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3afc0c6da0 0x7f3afc14dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b00d9b700 1 -- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3afc0c6da0 msgr2=0x7f3afc14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b00d9b700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3afc0c6da0 0x7f3afc14dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b00d9b700 1 -- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3afc06d3f0 msgr2=0x7f3afc16ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b00d9b700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3afc06d3f0 0x7f3afc16ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b00d9b700 1 -- 172.21.15.142:0/3194430233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae80094f0 con 0x7f3afc06b130 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b0159c700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3afc0c6da0 0x7f3afc14dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b00d9b700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc06b130 0x7f3afc14cf70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3af000ece0 tx=0x7f3af00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3af8ff9700 1 -- 172.21.15.142:0/3194430233 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000c9d0 con 0x7f3afc06b130 2023-09-30T22:59:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3af8ff9700 1 -- 172.21.15.142:0/3194430233 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000cb30 con 0x7f3afc06b130 2023-09-30T22:59:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc16b340 con 0x7f3afc06b130 2023-09-30T22:59:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3af8ff9700 1 -- 172.21.15.142:0/3194430233 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000ced0 con 0x7f3afc06b130 2023-09-30T22:59:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.442+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc0caa60 con 0x7f3afc06b130 2023-09-30T22:59:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.443+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc069420 con 0x7f3afc06b130 2023-09-30T22:59:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.444+0000 7f3af8ff9700 1 -- 172.21.15.142:0/3194430233 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3af0013680 con 0x7f3afc06b130 2023-09-30T22:59:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.445+0000 7f3af8ff9700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ae0067330 0x7f3ae00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.445+0000 7f3af8ff9700 1 -- 172.21.15.142:0/3194430233 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3af0084c00 con 0x7f3afc06b130 2023-09-30T22:59:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.445+0000 7f3afbfff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ae0067330 0x7f3ae00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.446+0000 7f3afbfff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ae0067330 0x7f3ae00697e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80099b0 tx=0x7f3ae8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.449+0000 7f3af8ff9700 1 -- 172.21.15.142:0/3194430233 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3af008b080 con 0x7f3afc06b130 2023-09-30T22:59:10.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.648+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3afc0c7510 con 0x7f3afc06b130 2023-09-30T22:59:10.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.648+0000 7f3af8ff9700 1 -- 172.21.15.142:0/3194430233 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3af0021090 con 0x7f3afc06b130 2023-09-30T22:59:10.648 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:10.648 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T22:59:10.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:10.649 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ae0067330 msgr2=0x7f3ae00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ae0067330 0x7f3ae00697e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80099b0 tx=0x7f3ae8017000 comp rx=0 tx=0).stop 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc06b130 msgr2=0x7f3afc14cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc06b130 0x7f3afc14cf70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3af000ece0 tx=0x7f3af00091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 shutdown_connections 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3ae0067330 0x7f3ae00697e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3afc0c6da0 0x7f3afc14dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3afc06b130 0x7f3afc14cf70 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 --2- 172.21.15.142:0/3194430233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3afc06d3f0 0x7f3afc16ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.650+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 >> 172.21.15.142:0/3194430233 conn(0x7f3afc067e30 msgr2=0x7f3afc155380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:10.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.651+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 shutdown_connections 2023-09-30T22:59:10.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.651+0000 7f3b02fff700 1 -- 172.21.15.142:0/3194430233 wait complete. 2023-09-30T22:59:10.667 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:59:10.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:59:10.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.862+0000 7fca749ff700 1 Processor -- start 2023-09-30T22:59:10.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.862+0000 7fca749ff700 1 -- start start 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.863+0000 7fca749ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700ca240 0x7fca700c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.863+0000 7fca749ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fca701573d0 0x7fca70157830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.863+0000 7fca749ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca700c5970 con 0x7fca70157000 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.863+0000 7fca749ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca700ca6b0 con 0x7fca701573d0 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.863+0000 7fca749ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700c7d60 con 0x7fca700ca240 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6dd9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700ca240 0x7fca700c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fca701573d0 0x7fca70157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fca701573d0 0x7fca70157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:49880/0 (socket says 172.21.15.142:49880) 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6ed9d700 1 -- 172.21.15.142:0/3567534490 learned_addr learned my addr 172.21.15.142:0/3567534490 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:10.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6e59c700 1 --1- 172.21.15.142:0/3567534490 >> v1:172.21.15.148:6789/0 conn(0x7fca70157000 0x7fca700c3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:49118/0 (socket says 172.21.15.142:49118) 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6dd9b700 1 -- 172.21.15.142:0/3567534490 >> v2:172.21.15.148:3300/0 conn(0x7fca701573d0 msgr2=0x7fca70157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6dd9b700 1 --2- 172.21.15.142:0/3567534490 >> v2:172.21.15.148:3300/0 conn(0x7fca701573d0 0x7fca70157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6dd9b700 1 -- 172.21.15.142:0/3567534490 >> v1:172.21.15.148:6789/0 conn(0x7fca70157000 legacy=0x7fca700c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6dd9b700 1 -- 172.21.15.142:0/3567534490 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700c5320 con 0x7fca700ca240 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.864+0000 7fca6ed9d700 1 --2- 172.21.15.142:0/3567534490 >> v2:172.21.15.148:3300/0 conn(0x7fca701573d0 0x7fca70157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.865+0000 7fca6dd9b700 1 --2- 172.21.15.142:0/3567534490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700ca240 0x7fca700c76c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca640098e0 tx=0x7fca640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ad842f26d00c9f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.865+0000 7fca6d59a700 1 -- 172.21.15.142:0/3567534490 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400f6b0 con 0x7fca700ca240 2023-09-30T22:59:10.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.865+0000 7fca6d59a700 1 -- 172.21.15.142:0/3567534490 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400f810 con 0x7fca700ca240 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.865+0000 7fca6d59a700 1 -- 172.21.15.142:0/3567534490 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400fbb0 con 0x7fca700ca240 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.865+0000 7fca749ff700 1 -- 172.21.15.142:0/3567534490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700ca240 msgr2=0x7fca700c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.865+0000 7fca749ff700 1 --2- 172.21.15.142:0/3567534490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700ca240 0x7fca700c76c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca640098e0 tx=0x7fca640091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.866+0000 7fca749ff700 1 -- 172.21.15.142:0/3567534490 shutdown_connections 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.866+0000 7fca749ff700 1 --2- 172.21.15.142:0/3567534490 >> v2:172.21.15.148:3300/0 conn(0x7fca701573d0 0x7fca70157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.866+0000 7fca749ff700 1 --2- 172.21.15.142:0/3567534490 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700ca240 0x7fca700c76c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.866+0000 7fca749ff700 1 -- 172.21.15.142:0/3567534490 >> 172.21.15.142:0/3567534490 conn(0x7fca700cc670 msgr2=0x7fca700cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.866+0000 7fca749ff700 1 -- 172.21.15.142:0/3567534490 shutdown_connections 2023-09-30T22:59:10.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.866+0000 7fca749ff700 1 -- 172.21.15.142:0/3567534490 wait complete. 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.867+0000 7fca749ff700 1 Processor -- start 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.867+0000 7fca749ff700 1 -- start start 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca749ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700ca240 0x7fca70155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca749ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca70157000 0x7fca7016d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca749ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca701573d0 0x7fca700b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca749ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca70155ba0 con 0x7fca70157000 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca749ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca70155e80 con 0x7fca700ca240 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca749ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca70156160 con 0x7fca701573d0 2023-09-30T22:59:10.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca6dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca70157000 0x7fca7016d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca6dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca70157000 0x7fca7016d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47846/0 (socket says 172.21.15.142:47846) 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.868+0000 7fca6dd9b700 1 -- 172.21.15.142:0/2630048165 learned_addr learned my addr 172.21.15.142:0/2630048165 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6ed9d700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca701573d0 0x7fca700b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6e59c700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700ca240 0x7fca70155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6dd9b700 1 -- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca701573d0 msgr2=0x7fca700b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6dd9b700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca701573d0 0x7fca700b8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6dd9b700 1 -- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700ca240 msgr2=0x7fca70155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6dd9b700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700ca240 0x7fca70155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6dd9b700 1 -- 172.21.15.142:0/2630048165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009ae0 con 0x7fca70157000 2023-09-30T22:59:10.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca6dd9b700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca70157000 0x7fca7016d7f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fca640093f0 tx=0x7fca64019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.869+0000 7fca5e7fc700 1 -- 172.21.15.142:0/2630048165 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6401ac20 con 0x7fca70157000 2023-09-30T22:59:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.870+0000 7fca5e7fc700 1 -- 172.21.15.142:0/2630048165 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6401ada0 con 0x7fca70157000 2023-09-30T22:59:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.870+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca64009420 con 0x7fca70157000 2023-09-30T22:59:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.870+0000 7fca5e7fc700 1 -- 172.21.15.142:0/2630048165 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640106c0 con 0x7fca70157000 2023-09-30T22:59:10.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.870+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca70156720 con 0x7fca70157000 2023-09-30T22:59:10.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.871+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca70156910 con 0x7fca70157000 2023-09-30T22:59:10.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.872+0000 7fca5e7fc700 1 -- 172.21.15.142:0/2630048165 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fca640183e0 con 0x7fca70157000 2023-09-30T22:59:10.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.873+0000 7fca5e7fc700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.873+0000 7fca5e7fc700 1 -- 172.21.15.142:0/2630048165 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fca64014070 con 0x7fca70157000 2023-09-30T22:59:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.873+0000 7fca6e59c700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.873+0000 7fca6e59c700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fca700ba930 tx=0x7fca60007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:10.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:10.877+0000 7fca5e7fc700 1 -- 172.21.15.142:0/2630048165 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fca64053240 con 0x7fca70157000 2023-09-30T22:59:11.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.066+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fca70156910 con 0x7fca70157000 2023-09-30T22:59:11.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.495+0000 7fca5e7fc700 1 -- 172.21.15.142:0/2630048165 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v141) v1 ==== 138+0+0 (secure 0 0 0) 0x7fca64056860 con 0x7fca70157000 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.499+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 msgr2=0x7fca500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.499+0000 7fca749ff700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fca700ba930 tx=0x7fca60007eb0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.499+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca70157000 msgr2=0x7fca7016d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.499+0000 7fca749ff700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca70157000 0x7fca7016d7f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fca640093f0 tx=0x7fca64019000 comp rx=0 tx=0).stop 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.500+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 shutdown_connections 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.500+0000 7fca749ff700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.500+0000 7fca749ff700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca701573d0 0x7fca700b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.500+0000 7fca749ff700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700ca240 0x7fca70155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.500+0000 7fca749ff700 1 --2- 172.21.15.142:0/2630048165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca70157000 0x7fca7016d7f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.500+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 >> 172.21.15.142:0/2630048165 conn(0x7fca700cc670 msgr2=0x7fca7006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:11.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.500+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 shutdown_connections 2023-09-30T22:59:11.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.501+0000 7fca749ff700 1 -- 172.21.15.142:0/2630048165 wait complete. 2023-09-30T22:59:11.502 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T22:59:11.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:59:11.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.717+0000 7f4c477ff700 1 Processor -- start 2023-09-30T22:59:11.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.717+0000 7f4c477ff700 1 -- start start 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.718+0000 7f4c477ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4c4006aeb0 0x7f4c40156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.718+0000 7f4c477ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c401576e0 con 0x7f4c40150600 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.718+0000 7f4c477ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4015a490 con 0x7f4c401509d0 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.718+0000 7f4c477ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400cc320 con 0x7f4c4006aeb0 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.718+0000 7f4c4559b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4c40150600 0x7f4c4006a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46972/0 (socket says 172.21.15.142:46972) 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.718+0000 7f4c4559b700 1 -- 172.21.15.142:0/836194792 learned_addr learned my addr 172.21.15.142:0/836194792 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.719+0000 7f4c45d9c700 1 --2- 172.21.15.142:0/836194792 >> v2:172.21.15.148:3300/0 conn(0x7f4c4006aeb0 0x7f4c40156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:11.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.719+0000 7f4c37fff700 1 -- 172.21.15.142:0/836194792 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95619676 0 0) 0x7f4c401576e0 con 0x7f4c40150600 2023-09-30T22:59:11.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.719+0000 7f4c37fff700 1 -- 172.21.15.142:0/836194792 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c2c003570 con 0x7f4c40150600 2023-09-30T22:59:11.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.719+0000 7f4c45d9c700 1 -- 172.21.15.142:0/836194792 >> v1:172.21.15.148:6789/0 conn(0x7f4c401509d0 legacy=0x7f4c40156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:11.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.719+0000 7f4c45d9c700 1 -- 172.21.15.142:0/836194792 >> v1:172.21.15.142:6789/0 conn(0x7f4c40150600 legacy=0x7f4c4006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:11.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.719+0000 7f4c45d9c700 1 -- 172.21.15.142:0/836194792 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40157400 con 0x7f4c4006aeb0 2023-09-30T22:59:11.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.719+0000 7f4c45d9c700 1 --2- 172.21.15.142:0/836194792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 0x7f4c40156e20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800af70 tx=0x7f4c3800a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ec8c9ec855fbb46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:11.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c37fff700 1 -- 172.21.15.142:0/836194792 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800f070 con 0x7f4c4006aeb0 2023-09-30T22:59:11.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c37fff700 1 -- 172.21.15.142:0/836194792 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3800a2e0 con 0x7f4c4006aeb0 2023-09-30T22:59:11.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c37fff700 1 -- 172.21.15.142:0/836194792 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800cc70 con 0x7f4c4006aeb0 2023-09-30T22:59:11.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c477ff700 1 -- 172.21.15.142:0/836194792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 msgr2=0x7f4c40156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:11.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c477ff700 1 --2- 172.21.15.142:0/836194792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 0x7f4c40156e20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800af70 tx=0x7f4c3800a890 comp rx=0 tx=0).stop 2023-09-30T22:59:11.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c477ff700 1 -- 172.21.15.142:0/836194792 shutdown_connections 2023-09-30T22:59:11.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c477ff700 1 --2- 172.21.15.142:0/836194792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 0x7f4c40156e20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c477ff700 1 -- 172.21.15.142:0/836194792 >> 172.21.15.142:0/836194792 conn(0x7f4c400cc670 msgr2=0x7f4c400cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:11.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c477ff700 1 -- 172.21.15.142:0/836194792 shutdown_connections 2023-09-30T22:59:11.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.720+0000 7f4c477ff700 1 -- 172.21.15.142:0/836194792 wait complete. 2023-09-30T22:59:11.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.722+0000 7f4c477ff700 1 Processor -- start 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.722+0000 7f4c477ff700 1 -- start start 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c477ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 0x7f4c4015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c477ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c40150600 0x7f4c40169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c477ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c401509d0 0x7f4c400c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c477ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4015d700 con 0x7f4c401509d0 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c477ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400c2380 con 0x7f4c4006aeb0 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c477ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40169550 con 0x7f4c40150600 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c45d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c401509d0 0x7f4c400c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c45d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c401509d0 0x7f4c400c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41288/0 (socket says 172.21.15.142:41288) 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c45d9c700 1 -- 172.21.15.142:0/867797293 learned_addr learned my addr 172.21.15.142:0/867797293 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c4559b700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 0x7f4c4015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:11.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.723+0000 7f4c44d9a700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c40150600 0x7f4c40169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:11.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c45d9c700 1 -- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c40150600 msgr2=0x7f4c40169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:11.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c45d9c700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c40150600 0x7f4c40169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c45d9c700 1 -- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 msgr2=0x7f4c4015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:11.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c45d9c700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 0x7f4c4015bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:11.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c45d9c700 1 -- 172.21.15.142:0/867797293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3800ab30 con 0x7f4c401509d0 2023-09-30T22:59:11.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c45d9c700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c401509d0 0x7f4c400c2810 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800ab00 tx=0x7f4c38019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:11.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c357fa700 1 -- 172.21.15.142:0/867797293 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38009ad0 con 0x7f4c401509d0 2023-09-30T22:59:11.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c357fa700 1 -- 172.21.15.142:0/867797293 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c38009c70 con 0x7f4c401509d0 2023-09-30T22:59:11.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4015d420 con 0x7f4c401509d0 2023-09-30T22:59:11.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c357fa700 1 -- 172.21.15.142:0/867797293 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38027410 con 0x7f4c401509d0 2023-09-30T22:59:11.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.724+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c400c2010 con 0x7f4c401509d0 2023-09-30T22:59:11.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.725+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c40069a50 con 0x7f4c401509d0 2023-09-30T22:59:11.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.726+0000 7f4c357fa700 1 -- 172.21.15.142:0/867797293 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4c3801d410 con 0x7f4c401509d0 2023-09-30T22:59:11.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.727+0000 7f4c357fa700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4c24067330 0x7f4c240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:11.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.727+0000 7f4c357fa700 1 -- 172.21.15.142:0/867797293 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f4c38086750 con 0x7f4c401509d0 2023-09-30T22:59:11.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.728+0000 7f4c4559b700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4c24067330 0x7f4c240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:11.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.728+0000 7f4c4559b700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4c24067330 0x7f4c240697e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c007fd0 tx=0x7f4c3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:11.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.732+0000 7f4c357fa700 1 -- 172.21.15.142:0/867797293 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4c38053790 con 0x7f4c401509d0 2023-09-30T22:59:11.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:11.921+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4c4006fc10 con 0x7f4c401509d0 2023-09-30T22:59:12.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.507+0000 7f4c357fa700 1 -- 172.21.15.142:0/867797293 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v142) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4c38056db0 con 0x7f4c401509d0 2023-09-30T22:59:12.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.516+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4c24067330 msgr2=0x7f4c240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:12.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.516+0000 7f4c477ff700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4c24067330 0x7f4c240697e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c007fd0 tx=0x7f4c3c009040 comp rx=0 tx=0).stop 2023-09-30T22:59:12.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.516+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c401509d0 msgr2=0x7f4c400c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:12.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.516+0000 7f4c477ff700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c401509d0 0x7f4c400c2810 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800ab00 tx=0x7f4c38019000 comp rx=0 tx=0).stop 2023-09-30T22:59:12.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.517+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 shutdown_connections 2023-09-30T22:59:12.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.517+0000 7f4c477ff700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4c24067330 0x7f4c240697e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.517+0000 7f4c477ff700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c401509d0 0x7f4c400c2810 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.517+0000 7f4c477ff700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c4006aeb0 0x7f4c4015bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.517+0000 7f4c477ff700 1 --2- 172.21.15.142:0/867797293 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c40150600 0x7f4c40169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.517+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 >> 172.21.15.142:0/867797293 conn(0x7f4c400cc670 msgr2=0x7f4c4014bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:12.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.519+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 shutdown_connections 2023-09-30T22:59:12.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.519+0000 7f4c477ff700 1 -- 172.21.15.142:0/867797293 wait complete. 2023-09-30T22:59:12.523 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T22:59:12.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:59:12.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.737+0000 7fdb7ddff700 1 Processor -- start 2023-09-30T22:59:12.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.737+0000 7fdb7ddff700 1 -- start start 2023-09-30T22:59:12.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.738+0000 7fdb7ddff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdb780ca5e0 0x7fdb7806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:12.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.738+0000 7fdb7ddff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb78067d10 con 0x7fdb78159ba0 2023-09-30T22:59:12.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.738+0000 7fdb7ddff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7806af90 con 0x7fdb780b0de0 2023-09-30T22:59:12.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.738+0000 7fdb7ddff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780676c0 con 0x7fdb780ca5e0 2023-09-30T22:59:12.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb777fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdb78159ba0 0x7fdb780c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:46984/0 (socket says 172.21.15.142:46984) 2023-09-30T22:59:12.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb777fe700 1 -- 172.21.15.142:0/27724770 learned_addr learned my addr 172.21.15.142:0/27724770 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:12.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb76ffd700 1 --2- 172.21.15.142:0/27724770 >> v2:172.21.15.148:3300/0 conn(0x7fdb780ca5e0 0x7fdb7806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:12.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb767fc700 1 -- 172.21.15.142:0/27724770 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218676815 0 0) 0x7fdb78067d10 con 0x7fdb78159ba0 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb767fc700 1 -- 172.21.15.142:0/27724770 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb60003570 con 0x7fdb78159ba0 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb76ffd700 1 -- 172.21.15.142:0/27724770 >> v1:172.21.15.148:6789/0 conn(0x7fdb780b0de0 legacy=0x7fdb780681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb76ffd700 1 -- 172.21.15.142:0/27724770 >> v1:172.21.15.142:6789/0 conn(0x7fdb78159ba0 legacy=0x7fdb780c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.739+0000 7fdb76ffd700 1 -- 172.21.15.142:0/27724770 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780679a0 con 0x7fdb780ca5e0 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb76ffd700 1 --2- 172.21.15.142:0/27724770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780ca5e0 0x7fdb7806a8d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0098e0 tx=0x7fdb6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f4a89a5701dd69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb767fc700 1 -- 172.21.15.142:0/27724770 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00b640 con 0x7fdb780ca5e0 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb767fc700 1 -- 172.21.15.142:0/27724770 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c00b7a0 con 0x7fdb780ca5e0 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb767fc700 1 -- 172.21.15.142:0/27724770 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00bb40 con 0x7fdb780ca5e0 2023-09-30T22:59:12.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb7ddff700 1 -- 172.21.15.142:0/27724770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780ca5e0 msgr2=0x7fdb7806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:12.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/27724770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780ca5e0 0x7fdb7806a8d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0098e0 tx=0x7fdb6c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb7ddff700 1 -- 172.21.15.142:0/27724770 shutdown_connections 2023-09-30T22:59:12.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/27724770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780ca5e0 0x7fdb7806a8d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.740+0000 7fdb7ddff700 1 -- 172.21.15.142:0/27724770 >> 172.21.15.142:0/27724770 conn(0x7fdb780cb2f0 msgr2=0x7fdb780cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:12.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.741+0000 7fdb7ddff700 1 -- 172.21.15.142:0/27724770 shutdown_connections 2023-09-30T22:59:12.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.741+0000 7fdb7ddff700 1 -- 172.21.15.142:0/27724770 wait complete. 2023-09-30T22:59:12.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.742+0000 7fdb7ddff700 1 Processor -- start 2023-09-30T22:59:12.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.742+0000 7fdb7ddff700 1 -- start start 2023-09-30T22:59:12.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb7ddff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780b0de0 0x7fdb7815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb7ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb780ca5e0 0x7fdb780c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb7ddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb78159ba0 0x7fdb7816aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb7ddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7816afc0 con 0x7fdb78159ba0 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb7ddff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780c54b0 con 0x7fdb780b0de0 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb7ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780c48a0 con 0x7fdb780ca5e0 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb77fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb78159ba0 0x7fdb7816aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb77fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb78159ba0 0x7fdb7816aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41296/0 (socket says 172.21.15.142:41296) 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb77fff700 1 -- 172.21.15.142:0/118655586 learned_addr learned my addr 172.21.15.142:0/118655586 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.743+0000 7fdb777fe700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780b0de0 0x7fdb7815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:12.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb76ffd700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb780ca5e0 0x7fdb780c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb77fff700 1 -- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb780ca5e0 msgr2=0x7fdb780c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb77fff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb780ca5e0 0x7fdb780c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb77fff700 1 -- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780b0de0 msgr2=0x7fdb7815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb77fff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780b0de0 0x7fdb7815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb77fff700 1 -- 172.21.15.142:0/118655586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c009420 con 0x7fdb78159ba0 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb76ffd700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb780ca5e0 0x7fdb780c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb777fe700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780b0de0 0x7fdb7815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb77fff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb78159ba0 0x7fdb7816aa80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000c8e0 tx=0x7fdb70001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb5f7fe700 1 -- 172.21.15.142:0/118655586 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7000ce80 con 0x7fdb78159ba0 2023-09-30T22:59:12.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb5f7fe700 1 -- 172.21.15.142:0/118655586 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7000a7e0 con 0x7fdb78159ba0 2023-09-30T22:59:12.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb5f7fe700 1 -- 172.21.15.142:0/118655586 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7000ab80 con 0x7fdb78159ba0 2023-09-30T22:59:12.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb780c4b80 con 0x7fdb78159ba0 2023-09-30T22:59:12.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.744+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb780c5140 con 0x7fdb78159ba0 2023-09-30T22:59:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.745+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb780c5640 con 0x7fdb78159ba0 2023-09-30T22:59:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.746+0000 7fdb5f7fe700 1 -- 172.21.15.142:0/118655586 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdb70012420 con 0x7fdb78159ba0 2023-09-30T22:59:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.747+0000 7fdb5f7fe700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb64067330 0x7fdb640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.747+0000 7fdb5f7fe700 1 -- 172.21.15.142:0/118655586 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fdb70084f30 con 0x7fdb78159ba0 2023-09-30T22:59:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.747+0000 7fdb777fe700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb64067330 0x7fdb640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:12.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.748+0000 7fdb777fe700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb64067330 0x7fdb640697e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdb68007fd0 tx=0x7fdb68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:12.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.752+0000 7fdb5f7fe700 1 -- 172.21.15.142:0/118655586 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdb70051df0 con 0x7fdb78159ba0 2023-09-30T22:59:12.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:12.985+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdb780cac40 con 0x7fdb78159ba0 2023-09-30T22:59:13.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.509+0000 7fdb5f7fe700 1 -- 172.21.15.142:0/118655586 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdb70055410 con 0x7fdb78159ba0 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.523+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb64067330 msgr2=0x7fdb640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.523+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb64067330 0x7fdb640697e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdb68007fd0 tx=0x7fdb68009040 comp rx=0 tx=0).stop 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.523+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb78159ba0 msgr2=0x7fdb7816aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.523+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb78159ba0 0x7fdb7816aa80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000c8e0 tx=0x7fdb70001710 comp rx=0 tx=0).stop 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.524+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 shutdown_connections 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.524+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdb64067330 0x7fdb640697e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.524+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb78159ba0 0x7fdb7816aa80 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.524+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb780b0de0 0x7fdb7815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.524+0000 7fdb7ddff700 1 --2- 172.21.15.142:0/118655586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb780ca5e0 0x7fdb780c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.524+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 >> 172.21.15.142:0/118655586 conn(0x7fdb780cb2f0 msgr2=0x7fdb780cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:13.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.525+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 shutdown_connections 2023-09-30T22:59:13.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.525+0000 7fdb7ddff700 1 -- 172.21.15.142:0/118655586 wait complete. 2023-09-30T22:59:13.528 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 17 and data pool 18 2023-09-30T22:59:13.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:13.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.737+0000 7f236d9ff700 1 Processor -- start 2023-09-30T22:59:13.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.737+0000 7f236d9ff700 1 -- start start 2023-09-30T22:59:13.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.738+0000 7f236d9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23680af020 0x7f2368156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.738+0000 7f236d9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23680b00d0 0x7f236806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.738+0000 7f236d9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236806d3e0 con 0x7f236806e650 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.738+0000 7f236d9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236815b400 con 0x7f23680b00d0 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.738+0000 7f236d9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236806dc80 con 0x7f23680af020 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23680b00d0 0x7f236806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23680b00d0 0x7f236806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41310/0 (socket says 172.21.15.142:41310) 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 -- 172.21.15.142:0/2428149166 learned_addr learned my addr 172.21.15.142:0/2428149166 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23677fe700 1 --1- 172.21.15.142:0/2428149166 >> v1:172.21.15.142:6789/0 conn(0x7f236806e650 0x7f23680b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47000/0 (socket says 172.21.15.142:47000) 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f2366ffd700 1 --2- 172.21.15.142:0/2428149166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23680af020 0x7f2368156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 -- 172.21.15.142:0/2428149166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23680af020 msgr2=0x7f2368156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 --2- 172.21.15.142:0/2428149166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23680af020 0x7f2368156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 -- 172.21.15.142:0/2428149166 >> v1:172.21.15.142:6789/0 conn(0x7f236806e650 legacy=0x7f23680b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 -- 172.21.15.142:0/2428149166 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236806b790 con 0x7f23680b00d0 2023-09-30T22:59:13.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f2365ffb700 1 -- 172.21.15.142:0/2428149166 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882550266 0 0) 0x7f236806d3e0 con 0x7f236806e650 2023-09-30T22:59:13.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.739+0000 7f23667fc700 1 --2- 172.21.15.142:0/2428149166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680b00d0 0x7f236806e110 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f235c0099b0 tx=0x7f235c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a933bf86640d26d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:13.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f2365ffb700 1 -- 172.21.15.142:0/2428149166 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00b860 con 0x7f23680b00d0 2023-09-30T22:59:13.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f2365ffb700 1 -- 172.21.15.142:0/2428149166 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00b9c0 con 0x7f23680b00d0 2023-09-30T22:59:13.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f2365ffb700 1 -- 172.21.15.142:0/2428149166 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00bd60 con 0x7f23680b00d0 2023-09-30T22:59:13.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 -- 172.21.15.142:0/2428149166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680b00d0 msgr2=0x7f236806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 --2- 172.21.15.142:0/2428149166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680b00d0 0x7f236806e110 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f235c0099b0 tx=0x7f235c009250 comp rx=0 tx=0).stop 2023-09-30T22:59:13.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 -- 172.21.15.142:0/2428149166 shutdown_connections 2023-09-30T22:59:13.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 --2- 172.21.15.142:0/2428149166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23680af020 0x7f2368156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 --2- 172.21.15.142:0/2428149166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680b00d0 0x7f236806e110 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 -- 172.21.15.142:0/2428149166 >> 172.21.15.142:0/2428149166 conn(0x7f23680680c0 msgr2=0x7f23680c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:13.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 -- 172.21.15.142:0/2428149166 shutdown_connections 2023-09-30T22:59:13.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.740+0000 7f236d9ff700 1 -- 172.21.15.142:0/2428149166 wait complete. 2023-09-30T22:59:13.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.742+0000 7f236d9ff700 1 Processor -- start 2023-09-30T22:59:13.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.742+0000 7f236d9ff700 1 -- start start 2023-09-30T22:59:13.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f236d9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236806e650 0x7f236814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:13.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f236d9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680af020 0x7f2368157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:13.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f236d9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23680b00d0 0x7f2368157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:13.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f236d9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236815af80 con 0x7f23680af020 2023-09-30T22:59:13.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f236d9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368158400 con 0x7f23680b00d0 2023-09-30T22:59:13.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f236d9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236814db90 con 0x7f236806e650 2023-09-30T22:59:13.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f23667fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680af020 0x7f2368157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:13.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f23667fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680af020 0x7f2368157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41312/0 (socket says 172.21.15.142:41312) 2023-09-30T22:59:13.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f23667fc700 1 -- 172.21.15.142:0/1579992566 learned_addr learned my addr 172.21.15.142:0/1579992566 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:13.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f23677fe700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23680b00d0 0x7f2368157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.743+0000 7f2366ffd700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236806e650 0x7f236814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f23667fc700 1 -- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236806e650 msgr2=0x7f236814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f23667fc700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236806e650 0x7f236814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f23667fc700 1 -- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23680b00d0 msgr2=0x7f2368157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f23667fc700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23680b00d0 0x7f2368157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f23667fc700 1 -- 172.21.15.142:0/1579992566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c0094f0 con 0x7f23680af020 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f23677fe700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23680b00d0 0x7f2368157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f2366ffd700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236806e650 0x7f236814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f23667fc700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680af020 0x7f2368157980 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f235c006fd0 tx=0x7f235c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f234effd700 1 -- 172.21.15.142:0/1579992566 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c01a420 con 0x7f23680af020 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f234effd700 1 -- 172.21.15.142:0/1579992566 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c01a5a0 con 0x7f23680af020 2023-09-30T22:59:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f234effd700 1 -- 172.21.15.142:0/1579992566 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c01a960 con 0x7f23680af020 2023-09-30T22:59:13.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236815a6e0 con 0x7f23680af020 2023-09-30T22:59:13.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.744+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236815aca0 con 0x7f23680af020 2023-09-30T22:59:13.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.745+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23680695b0 con 0x7f23680af020 2023-09-30T22:59:13.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.746+0000 7f234effd700 1 -- 172.21.15.142:0/1579992566 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f235c01ad10 con 0x7f23680af020 2023-09-30T22:59:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.747+0000 7f234effd700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2354067330 0x7f23540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.747+0000 7f234effd700 1 -- 172.21.15.142:0/1579992566 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f235c086660 con 0x7f23680af020 2023-09-30T22:59:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.748+0000 7f2366ffd700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2354067330 0x7f23540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.748+0000 7f2366ffd700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2354067330 0x7f23540697e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2358006fd0 tx=0x7f2358008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:13.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.752+0000 7f234effd700 1 -- 172.21.15.142:0/1579992566 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f235c053560 con 0x7f23680af020 2023-09-30T22:59:13.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:13.900 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:13.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.952+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23680cbb30 con 0x7f23680af020 2023-09-30T22:59:13.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.954+0000 7f234effd700 1 -- 172.21.15.142:0/1579992566 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f235c056b80 con 0x7f23680af020 2023-09-30T22:59:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:13.954 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":143,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:12.987083+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:59:11.103746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-09-30T22:59:11.960192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:13.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2354067330 msgr2=0x7f23540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2354067330 0x7f23540697e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2358006fd0 tx=0x7f2358008040 comp rx=0 tx=0).stop 2023-09-30T22:59:13.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680af020 msgr2=0x7f2368157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:13.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680af020 0x7f2368157980 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f235c006fd0 tx=0x7f235c017000 comp rx=0 tx=0).stop 2023-09-30T22:59:13.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 shutdown_connections 2023-09-30T22:59:13.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2354067330 0x7f23540697e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23680b00d0 0x7f2368157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f236806e650 0x7f236814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 --2- 172.21.15.142:0/1579992566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23680af020 0x7f2368157980 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:13.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 >> 172.21.15.142:0/1579992566 conn(0x7f23680680c0 msgr2=0x7f236806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:13.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 shutdown_connections 2023-09-30T22:59:13.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:13.957+0000 7f236d9ff700 1 -- 172.21.15.142:0/1579992566 wait complete. 2023-09-30T22:59:13.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:14.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.165+0000 7f51227ff700 1 Processor -- start 2023-09-30T22:59:14.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.165+0000 7f51227ff700 1 -- start start 2023-09-30T22:59:14.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.166+0000 7f51227ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f511c06b7e0 0x7f511c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.166+0000 7f51227ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f511c0ac040 0x7f511c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.166+0000 7f51227ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c15e510 con 0x7f511c159a40 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.166+0000 7f51227ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c15e7f0 con 0x7f511c06b7e0 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.166+0000 7f51227ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c0aa430 con 0x7f511c0ac040 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f511c06b7e0 0x7f511c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f511c159a40 0x7f511c06b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47016/0 (socket says 172.21.15.142:47016) 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511bfff700 1 -- 172.21.15.142:0/2380053954 learned_addr learned my addr 172.21.15.142:0/2380053954 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f5120d9c700 1 --2- 172.21.15.142:0/2380053954 >> v2:172.21.15.148:3300/0 conn(0x7f511c0ac040 0x7f511c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511affd700 1 -- 172.21.15.142:0/2380053954 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391115759 0 0) 0x7f511c15e510 con 0x7f511c159a40 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511b7fe700 1 -- 172.21.15.142:0/2380053954 >> v2:172.21.15.148:3300/0 conn(0x7f511c0ac040 msgr2=0x7f511c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511b7fe700 1 --2- 172.21.15.142:0/2380053954 >> v2:172.21.15.148:3300/0 conn(0x7f511c0ac040 0x7f511c06d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511b7fe700 1 -- 172.21.15.142:0/2380053954 >> v1:172.21.15.142:6789/0 conn(0x7f511c159a40 legacy=0x7f511c06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511b7fe700 1 -- 172.21.15.142:0/2380053954 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0aa710 con 0x7f511c06b7e0 2023-09-30T22:59:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.167+0000 7f511b7fe700 1 --2- 172.21.15.142:0/2380053954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0a98c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f51100098e0 tx=0x7f51100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79473f740412782d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:14.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f511affd700 1 -- 172.21.15.142:0/2380053954 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110009e80 con 0x7f511c06b7e0 2023-09-30T22:59:14.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f511affd700 1 -- 172.21.15.142:0/2380053954 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000b820 con 0x7f511c06b7e0 2023-09-30T22:59:14.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f511affd700 1 -- 172.21.15.142:0/2380053954 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000bba0 con 0x7f511c06b7e0 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 -- 172.21.15.142:0/2380053954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 msgr2=0x7f511c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 --2- 172.21.15.142:0/2380053954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0a98c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f51100098e0 tx=0x7f51100091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 -- 172.21.15.142:0/2380053954 shutdown_connections 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 --2- 172.21.15.142:0/2380053954 >> v2:172.21.15.148:3300/0 conn(0x7f511c0ac040 0x7f511c06d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 --2- 172.21.15.142:0/2380053954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0a98c0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 -- 172.21.15.142:0/2380053954 >> 172.21.15.142:0/2380053954 conn(0x7f511c0680a0 msgr2=0x7f511c0ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 -- 172.21.15.142:0/2380053954 shutdown_connections 2023-09-30T22:59:14.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.168+0000 7f51227ff700 1 -- 172.21.15.142:0/2380053954 wait complete. 2023-09-30T22:59:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.170+0000 7f51227ff700 1 Processor -- start 2023-09-30T22:59:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.170+0000 7f51227ff700 1 -- start start 2023-09-30T22:59:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f51227ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f51227ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f511c0ac040 0x7f511c1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f51227ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f511c159a40 0x7f511c157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f51227ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c158c00 con 0x7f511c06b7e0 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f51227ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c157ff0 con 0x7f511c0ac040 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f51227ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1582d0 con 0x7f511c159a40 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41334/0 (socket says 172.21.15.142:41334) 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 -- 172.21.15.142:0/3144980222 learned_addr learned my addr 172.21.15.142:0/3144980222 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511b7fe700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f511c0ac040 0x7f511c1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f5120d9c700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f511c159a40 0x7f511c157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 -- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f511c159a40 msgr2=0x7f511c157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f511c159a40 0x7f511c157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 -- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f511c0ac040 msgr2=0x7f511c1410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f511c0ac040 0x7f511c1410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.171+0000 7f511bfff700 1 -- 172.21.15.142:0/3144980222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5110009420 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.172+0000 7f511bfff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0aefe0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c5b0 tx=0x7f510c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.172+0000 7f5103fff700 1 -- 172.21.15.142:0/3144980222 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c005b30 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.172+0000 7f5103fff700 1 -- 172.21.15.142:0/3144980222 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c005c90 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.172+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c1585b0 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.172+0000 7f5103fff700 1 -- 172.21.15.142:0/3144980222 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c007300 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.172+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c157c90 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.173+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c063a80 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.174+0000 7f5103fff700 1 -- 172.21.15.142:0/3144980222 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f510c01b3b0 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.175+0000 7f5103fff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5108067330 0x7f51080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.175+0000 7f5103fff700 1 -- 172.21.15.142:0/3144980222 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f510c084140 con 0x7f511c06b7e0 2023-09-30T22:59:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.175+0000 7f511b7fe700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5108067330 0x7f51080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.176+0000 7f511b7fe700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5108067330 0x7f51080697e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f511c06bbe0 tx=0x7f5110017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:14.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.179+0000 7f5103fff700 1 -- 172.21.15.142:0/3144980222 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f510c050fa0 con 0x7f511c06b7e0 2023-09-30T22:59:14.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.371+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f511c15e1e0 con 0x7f511c06b7e0 2023-09-30T22:59:14.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.372+0000 7f5103fff700 1 -- 172.21.15.142:0/3144980222 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f510c0545c0 con 0x7f511c06b7e0 2023-09-30T22:59:14.373 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:14.373 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":143,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:12.987083+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:59:11.103746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-09-30T22:59:11.960192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:14.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5108067330 msgr2=0x7f51080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5108067330 0x7f51080697e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f511c06bbe0 tx=0x7f5110017000 comp rx=0 tx=0).stop 2023-09-30T22:59:14.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 msgr2=0x7f511c0aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0aefe0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c5b0 tx=0x7f510c001070 comp rx=0 tx=0).stop 2023-09-30T22:59:14.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 shutdown_connections 2023-09-30T22:59:14.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5108067330 0x7f51080697e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f511c159a40 0x7f511c157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c06b7e0 0x7f511c0aefe0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 --2- 172.21.15.142:0/3144980222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f511c0ac040 0x7f511c1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 >> 172.21.15.142:0/3144980222 conn(0x7f511c0680a0 msgr2=0x7f511c153470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:14.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 shutdown_connections 2023-09-30T22:59:14.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.375+0000 7f51227ff700 1 -- 172.21.15.142:0/3144980222 wait complete. 2023-09-30T22:59:14.392 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:59:14.486 INFO:tasks.ceph.mds.a.smithi142.stderr:2023-09-30T22:59:14.487+0000 7fe3bc9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:59:14.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.588+0000 7f17097ff700 1 Processor -- start 2023-09-30T22:59:14.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.588+0000 7f17097ff700 1 -- start start 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.589+0000 7f17097ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 0x7f170406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.589+0000 7f17097ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1704067d10 con 0x7f17040b0de0 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.589+0000 7f17097ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170406af90 con 0x7f17040ca5e0 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.589+0000 7f17097ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17040676c0 con 0x7f1704159ba0 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f17027fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f17040b0de0 0x7f17040c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47020/0 (socket says 172.21.15.142:47020) 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f17027fc700 1 -- 172.21.15.142:0/3128317487 learned_addr learned my addr 172.21.15.142:0/3128317487 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1702ffd700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 0x7f170406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548149447 0 0) 0x7f1704067d10 con 0x7f17040b0de0 2023-09-30T22:59:14.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16ec003570 con 0x7f17040b0de0 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164378456 0 0) 0x7f170406af90 con 0x7f17040ca5e0 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1704067d10 con 0x7f17040ca5e0 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046428036 0 0) 0x7f16ec003570 con 0x7f17040b0de0 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 msgr2=0x7f170406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 0x7f170406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 >> v1:172.21.15.148:6789/0 conn(0x7f17040ca5e0 legacy=0x7f17040681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040679a0 con 0x7f17040b0de0 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f16f8001470 con 0x7f17040b0de0 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1702ffd700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 0x7f170406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.590+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 >> v1:172.21.15.142:6789/0 conn(0x7f17040b0de0 legacy=0x7f17040c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f1701ffb700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16ec003c20 0x7f16ec004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f1701ffb700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f16ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f1701ffb700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 0x7f16ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17040676c0 con 0x7f16ec004810 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec00bb10 con 0x7f16ec003c20 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec00bcd0 con 0x7f1704159ba0 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17027fc700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f16ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f1702ffd700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16ec003c20 0x7f16ec004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17037fe700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 0x7f16ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17027fc700 1 -- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 msgr2=0x7f16ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17027fc700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1704159ba0 0x7f16ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17027fc700 1 -- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16ec003c20 msgr2=0x7f16ec004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17027fc700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16ec003c20 0x7f16ec004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17027fc700 1 -- 172.21.15.142:0/3128317487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f4009420 con 0x7f16ec004810 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.591+0000 7f17027fc700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f16ec004c80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c2d0 tx=0x7f16f8001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e63257f44f58ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800cba0 con 0x7f16ec004810 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800cd00 con 0x7f16ec004810 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f1701ffb700 1 -- 172.21.15.142:0/3128317487 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8005b70 con 0x7f16ec004810 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f17097ff700 1 -- 172.21.15.142:0/3128317487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 msgr2=0x7f16ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f17097ff700 1 --2- 172.21.15.142:0/3128317487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f16ec004c80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c2d0 tx=0x7f16f8001e10 comp rx=0 tx=0).stop 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f17037fe700 1 -- 172.21.15.142:0/3128317487 reap_dead start 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f17097ff700 1 -- 172.21.15.142:0/3128317487 shutdown_connections 2023-09-30T22:59:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f17097ff700 1 -- 172.21.15.142:0/3128317487 >> 172.21.15.142:0/3128317487 conn(0x7f17040cb2f0 msgr2=0x7f17040cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f17097ff700 1 -- 172.21.15.142:0/3128317487 shutdown_connections 2023-09-30T22:59:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.592+0000 7f17097ff700 1 -- 172.21.15.142:0/3128317487 wait complete. 2023-09-30T22:59:14.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.594+0000 7f17097ff700 1 Processor -- start 2023-09-30T22:59:14.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.594+0000 7f17097ff700 1 -- start start 2023-09-30T22:59:14.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17097ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f17040c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17097ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1704146da0 0x7f170416aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17097ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f170406a400 0x7f170406a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17097ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170406ade0 con 0x7f16ec004810 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17097ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170416c530 con 0x7f1704146da0 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17097ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1704147210 con 0x7f170406a400 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f17040c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f17040c5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41344/0 (socket says 172.21.15.142:41344) 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 -- 172.21.15.142:0/1440038936 learned_addr learned my addr 172.21.15.142:0/1440038936 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17037fe700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f170406a400 0x7f170406a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17027fc700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1704146da0 0x7f170416aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 -- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f170406a400 msgr2=0x7f170406a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f170406a400 0x7f170406a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 -- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1704146da0 msgr2=0x7f170416aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1704146da0 0x7f170416aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f1702ffd700 1 -- 172.21.15.142:0/1440038936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170416b920 con 0x7f16ec004810 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17037fe700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f170406a400 0x7f170406a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.595+0000 7f17027fc700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1704146da0 0x7f170416aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.596+0000 7f1702ffd700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f17040c5a50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f16f4011d70 tx=0x7f16f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.596+0000 7f16eaffd700 1 -- 172.21.15.142:0/1440038936 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400fc70 con 0x7f16ec004810 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.596+0000 7f16eaffd700 1 -- 172.21.15.142:0/1440038936 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f400fdd0 con 0x7f16ec004810 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.596+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170416bc00 con 0x7f16ec004810 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.596+0000 7f16eaffd700 1 -- 172.21.15.142:0/1440038936 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4014670 con 0x7f16ec004810 2023-09-30T22:59:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.596+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170416c1c0 con 0x7f16ec004810 2023-09-30T22:59:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.597+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170416b3e0 con 0x7f16ec004810 2023-09-30T22:59:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.598+0000 7f16eaffd700 1 -- 172.21.15.142:0/1440038936 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f16f4014a60 con 0x7f16ec004810 2023-09-30T22:59:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.599+0000 7f16eaffd700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f16f0067330 0x7f16f00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.599+0000 7f16eaffd700 1 -- 172.21.15.142:0/1440038936 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f16f4018030 con 0x7f16ec004810 2023-09-30T22:59:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.599+0000 7f17027fc700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f16f0067330 0x7f16f00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.600+0000 7f17027fc700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f16f0067330 0x7f16f00697e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f16f8001e50 tx=0x7f16f8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:14.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.603+0000 7f16eaffd700 1 -- 172.21.15.142:0/1440038936 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f16f4052690 con 0x7f16ec004810 2023-09-30T22:59:14.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:14.840+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f17040cac40 con 0x7f16ec004810 2023-09-30T22:59:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.531+0000 7f16eaffd700 1 -- 172.21.15.142:0/1440038936 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7f16f4006cb0 con 0x7f16ec004810 2023-09-30T22:59:15.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.534+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f16f0067330 msgr2=0x7f16f00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.534+0000 7f17097ff700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f16f0067330 0x7f16f00697e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f16f8001e50 tx=0x7f16f8015000 comp rx=0 tx=0).stop 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.534+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 msgr2=0x7f17040c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.534+0000 7f17097ff700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f17040c5a50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f16f4011d70 tx=0x7f16f40091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 shutdown_connections 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f16f0067330 0x7f16f00697e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f170406a400 0x7f170406a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16ec004810 0x7f17040c5a50 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 --2- 172.21.15.142:0/1440038936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1704146da0 0x7f170416aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 >> 172.21.15.142:0/1440038936 conn(0x7f17040cb2f0 msgr2=0x7f17040b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 shutdown_connections 2023-09-30T22:59:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.535+0000 7f17097ff700 1 -- 172.21.15.142:0/1440038936 wait complete. 2023-09-30T22:59:15.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:59:15.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.752+0000 7ffbcddff700 1 Processor -- start 2023-09-30T22:59:15.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.752+0000 7ffbcddff700 1 -- start start 2023-09-30T22:59:15.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.753+0000 7ffbcddff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffbc8150600 0x7ffbc806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:15.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.753+0000 7ffbcddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc81509d0 0x7ffbc806ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:15.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.753+0000 7ffbcddff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbc815a920 0x7ffbc8156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:15.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.753+0000 7ffbcddff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80cc320 con 0x7ffbc815a920 2023-09-30T22:59:15.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.753+0000 7ffbcddff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc81576e0 con 0x7ffbc8150600 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.753+0000 7ffbcddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc815a490 con 0x7ffbc81509d0 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbc815a920 0x7ffbc8156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbc815a920 0x7ffbc8156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41358/0 (socket says 172.21.15.142:41358) 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 -- 172.21.15.142:0/562083807 learned_addr learned my addr 172.21.15.142:0/562083807 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc77fe700 1 --2- 172.21.15.142:0/562083807 >> v2:172.21.15.148:3300/0 conn(0x7ffbc8150600 0x7ffbc806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc6ffd700 1 --2- 172.21.15.142:0/562083807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc81509d0 0x7ffbc806ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 -- 172.21.15.142:0/562083807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc81509d0 msgr2=0x7ffbc806ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 --2- 172.21.15.142:0/562083807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc81509d0 0x7ffbc806ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 -- 172.21.15.142:0/562083807 >> v2:172.21.15.148:3300/0 conn(0x7ffbc8150600 msgr2=0x7ffbc806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 --2- 172.21.15.142:0/562083807 >> v2:172.21.15.148:3300/0 conn(0x7ffbc8150600 0x7ffbc806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.754+0000 7ffbc7fff700 1 -- 172.21.15.142:0/562083807 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8157400 con 0x7ffbc815a920 2023-09-30T22:59:15.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.755+0000 7ffbc7fff700 1 --2- 172.21.15.142:0/562083807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8156710 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ffbc806c190 tx=0x7ffbc000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4523d707539be4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:15.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.755+0000 7ffbc67fc700 1 -- 172.21.15.142:0/562083807 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0010070 con 0x7ffbc815a920 2023-09-30T22:59:15.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.755+0000 7ffbc67fc700 1 -- 172.21.15.142:0/562083807 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000dd30 con 0x7ffbc815a920 2023-09-30T22:59:15.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.755+0000 7ffbc67fc700 1 -- 172.21.15.142:0/562083807 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000dea0 con 0x7ffbc815a920 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.755+0000 7ffbcddff700 1 -- 172.21.15.142:0/562083807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 msgr2=0x7ffbc8156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.755+0000 7ffbcddff700 1 --2- 172.21.15.142:0/562083807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8156710 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ffbc806c190 tx=0x7ffbc000ba50 comp rx=0 tx=0).stop 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.756+0000 7ffbcddff700 1 -- 172.21.15.142:0/562083807 shutdown_connections 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.756+0000 7ffbcddff700 1 --2- 172.21.15.142:0/562083807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8156710 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.756+0000 7ffbcddff700 1 --2- 172.21.15.142:0/562083807 >> v2:172.21.15.148:3300/0 conn(0x7ffbc8150600 0x7ffbc806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.756+0000 7ffbcddff700 1 --2- 172.21.15.142:0/562083807 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc81509d0 0x7ffbc806ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.756+0000 7ffbcddff700 1 -- 172.21.15.142:0/562083807 >> 172.21.15.142:0/562083807 conn(0x7ffbc80cc670 msgr2=0x7ffbc80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.756+0000 7ffbcddff700 1 -- 172.21.15.142:0/562083807 shutdown_connections 2023-09-30T22:59:15.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.756+0000 7ffbcddff700 1 -- 172.21.15.142:0/562083807 wait complete. 2023-09-30T22:59:15.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.757+0000 7ffbcddff700 1 Processor -- start 2023-09-30T22:59:15.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.757+0000 7ffbcddff700 1 -- start start 2023-09-30T22:59:15.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.758+0000 7ffbcddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc8150600 0x7ffbc80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.758+0000 7ffbcddff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc81509d0 0x7ffbc816e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.758+0000 7ffbcddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.758+0000 7ffbcddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc816e870 con 0x7ffbc815a920 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.758+0000 7ffbcddff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80c18e0 con 0x7ffbc81509d0 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.758+0000 7ffbcddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80c2720 con 0x7ffbc8150600 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41364/0 (socket says 172.21.15.142:41364) 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 -- 172.21.15.142:0/3816480729 learned_addr learned my addr 172.21.15.142:0/3816480729 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc77fe700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc8150600 0x7ffbc80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc6ffd700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc81509d0 0x7ffbc816e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 -- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc8150600 msgr2=0x7ffbc80c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:15.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc8150600 0x7ffbc80c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 -- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc81509d0 msgr2=0x7ffbc816e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc81509d0 0x7ffbc816e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 -- 172.21.15.142:0/3816480729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc000bcf0 con 0x7ffbc815a920 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc6ffd700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc81509d0 0x7ffbc816e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbc7fff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8138ff0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000d760 tx=0x7ffbc001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbaf7fe700 1 -- 172.21.15.142:0/3816480729 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000aaa0 con 0x7ffbc815a920 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbaf7fe700 1 -- 172.21.15.142:0/3816480729 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000ac00 con 0x7ffbc815a920 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.759+0000 7ffbaf7fe700 1 -- 172.21.15.142:0/3816480729 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc001d430 con 0x7ffbc815a920 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.760+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc80c1b10 con 0x7ffbc815a920 2023-09-30T22:59:15.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.760+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc80c20d0 con 0x7ffbc815a920 2023-09-30T22:59:15.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.761+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc8069a50 con 0x7ffbc815a920 2023-09-30T22:59:15.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.761+0000 7ffbaf7fe700 1 -- 172.21.15.142:0/3816480729 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffbc0003040 con 0x7ffbc815a920 2023-09-30T22:59:15.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.763+0000 7ffbaf7fe700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbb4067330 0x7ffbb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:15.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.763+0000 7ffbaf7fe700 1 -- 172.21.15.142:0/3816480729 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffbc0086130 con 0x7ffbc815a920 2023-09-30T22:59:15.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.763+0000 7ffbc77fe700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbb4067330 0x7ffbb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:15.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.764+0000 7ffbc77fe700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbb4067330 0x7ffbb40697e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d40 tx=0x7ffbb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:15.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.767+0000 7ffbaf7fe700 1 -- 172.21.15.142:0/3816480729 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ffbc0052f90 con 0x7ffbc815a920 2023-09-30T22:59:15.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:15.997+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffbc80c2860 con 0x7ffbc815a920 2023-09-30T22:59:16.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.542+0000 7ffbaf7fe700 1 -- 172.21.15.142:0/3816480729 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffbc00565b0 con 0x7ffbc815a920 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbb4067330 msgr2=0x7ffbb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbb4067330 0x7ffbb40697e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d40 tx=0x7ffbb8008040 comp rx=0 tx=0).stop 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 msgr2=0x7ffbc8138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8138ff0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000d760 tx=0x7ffbc001a000 comp rx=0 tx=0).stop 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 shutdown_connections 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffbb4067330 0x7ffbb40697e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbc815a920 0x7ffbc8138ff0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:16.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbc8150600 0x7ffbc80c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:16.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 --2- 172.21.15.142:0/3816480729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbc81509d0 0x7ffbc816e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:16.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 >> 172.21.15.142:0/3816480729 conn(0x7ffbc80cc670 msgr2=0x7ffbc80c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:16.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 shutdown_connections 2023-09-30T22:59:16.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.545+0000 7ffbcddff700 1 -- 172.21.15.142:0/3816480729 wait complete. 2023-09-30T22:59:16.562 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:16.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.752+0000 7ff673bff700 1 Processor -- start 2023-09-30T22:59:16.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.752+0000 7ff673bff700 1 -- start start 2023-09-30T22:59:16.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.753+0000 7ff673bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff66c0aa9b0 0x7ff66c164870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:16.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.753+0000 7ff673bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c068000 con 0x7ff66c159b50 2023-09-30T22:59:16.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.753+0000 7ff673bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c068240 con 0x7ff66c0ac3a0 2023-09-30T22:59:16.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.753+0000 7ff673bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c069f10 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff67199b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff66c159b50 0x7ff66c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47036/0 (socket says 172.21.15.142:47036) 2023-09-30T22:59:16.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff67199b700 1 -- 172.21.15.142:0/200208056 learned_addr learned my addr 172.21.15.142:0/200208056 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:16.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff67219c700 1 --2- 172.21.15.142:0/200208056 >> v2:172.21.15.142:3300/0 conn(0x7ff66c0aa9b0 0x7ff66c164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff670999700 1 -- 172.21.15.142:0/200208056 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006831581 0 0) 0x7ff668001110 con 0x7ff66c159b50 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff670999700 1 -- 172.21.15.142:0/200208056 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff658003570 con 0x7ff66c159b50 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff67219c700 1 -- 172.21.15.142:0/200208056 >> v1:172.21.15.148:6789/0 conn(0x7ff66c0ac3a0 legacy=0x7ff66c0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff67219c700 1 -- 172.21.15.142:0/200208056 >> v1:172.21.15.142:6789/0 conn(0x7ff66c159b50 legacy=0x7ff66c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff67219c700 1 -- 172.21.15.142:0/200208056 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c068520 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.754+0000 7ff67219c700 1 --2- 172.21.15.142:0/200208056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c164870 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff664009e60 tx=0x7ff664009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd7f494369761a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff670999700 1 -- 172.21.15.142:0/200208056 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66400e070 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff670999700 1 -- 172.21.15.142:0/200208056 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66400bb60 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff670999700 1 -- 172.21.15.142:0/200208056 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664012430 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff673bff700 1 -- 172.21.15.142:0/200208056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 msgr2=0x7ff66c164870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:16.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff673bff700 1 --2- 172.21.15.142:0/200208056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c164870 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff664009e60 tx=0x7ff664009780 comp rx=0 tx=0).stop 2023-09-30T22:59:16.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff673bff700 1 -- 172.21.15.142:0/200208056 shutdown_connections 2023-09-30T22:59:16.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff673bff700 1 --2- 172.21.15.142:0/200208056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c164870 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:16.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff673bff700 1 -- 172.21.15.142:0/200208056 >> 172.21.15.142:0/200208056 conn(0x7ff66c06dab0 msgr2=0x7ff66c0aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:16.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff673bff700 1 -- 172.21.15.142:0/200208056 shutdown_connections 2023-09-30T22:59:16.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.755+0000 7ff673bff700 1 -- 172.21.15.142:0/200208056 wait complete. 2023-09-30T22:59:16.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.757+0000 7ff673bff700 1 Processor -- start 2023-09-30T22:59:16.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.757+0000 7ff673bff700 1 -- start start 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff673bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff673bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff66c0ac3a0 0x7ff66c0ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff673bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff66c159b50 0x7ff66c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff673bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0aeee0 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff673bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0b0d20 con 0x7ff66c159b50 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff673bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0b03f0 con 0x7ff66c0ac3a0 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff67199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff67199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c14d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41372/0 (socket says 172.21.15.142:41372) 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff67199b700 1 -- 172.21.15.142:0/319353610 learned_addr learned my addr 172.21.15.142:0/319353610 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff67119a700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff66c0ac3a0 0x7ff66c0ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.758+0000 7ff67219c700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff66c159b50 0x7ff66c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff67199b700 1 -- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff66c0ac3a0 msgr2=0x7ff66c0ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff67199b700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff66c0ac3a0 0x7ff66c0ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff67199b700 1 -- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff66c159b50 msgr2=0x7ff66c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff67199b700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff66c159b50 0x7ff66c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff67199b700 1 -- 172.21.15.142:0/319353610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664009a20 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff67199b700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c14d9a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff66800c7c0 tx=0x7ff668007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff661ffb700 1 -- 172.21.15.142:0/319353610 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668005c00 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff661ffb700 1 -- 172.21.15.142:0/319353610 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff668005d60 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff661ffb700 1 -- 172.21.15.142:0/319353610 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668007320 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c0b06d0 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.759+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c14dee0 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.760+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c06cfd0 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.761+0000 7ff661ffb700 1 -- 172.21.15.142:0/319353610 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff66801b3b0 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.762+0000 7ff661ffb700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff650067330 0x7ff6500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:16.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.762+0000 7ff661ffb700 1 -- 172.21.15.142:0/319353610 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff668084070 con 0x7ff66c0aa9b0 2023-09-30T22:59:16.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.762+0000 7ff67119a700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff650067330 0x7ff6500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:16.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.763+0000 7ff67119a700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff650067330 0x7ff6500697e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff66c152d50 tx=0x7ff65c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:16.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:16.766+0000 7ff661ffb700 1 -- 172.21.15.142:0/319353610 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff668050ed0 con 0x7ff66c0aa9b0 2023-09-30T22:59:17.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.002+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff66c068000 con 0x7ff66c0aa9b0 2023-09-30T22:59:17.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.002+0000 7ff661ffb700 1 -- 172.21.15.142:0/319353610 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7ff66c068000 con 0x7ff66c0aa9b0 2023-09-30T22:59:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:17.002 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:17.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.004+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff650067330 msgr2=0x7ff6500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.004+0000 7ff673bff700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff650067330 0x7ff6500697e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff66c152d50 tx=0x7ff65c007ec0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.004+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 msgr2=0x7ff66c14d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.004+0000 7ff673bff700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c14d9a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff66800c7c0 tx=0x7ff668007c70 comp rx=0 tx=0).stop 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 shutdown_connections 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff650067330 0x7ff6500697e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff66c159b50 0x7ff66c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c0aa9b0 0x7ff66c14d9a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 --2- 172.21.15.142:0/319353610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff66c0ac3a0 0x7ff66c0ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 >> 172.21.15.142:0/319353610 conn(0x7ff66c06dab0 msgr2=0x7ff66c14f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:17.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 shutdown_connections 2023-09-30T22:59:17.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.005+0000 7ff673bff700 1 -- 172.21.15.142:0/319353610 wait complete. 2023-09-30T22:59:17.006 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:17.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:17.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.212+0000 7fa45e1ff700 1 Processor -- start 2023-09-30T22:59:17.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.212+0000 7fa45e1ff700 1 -- start start 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.213+0000 7fa45e1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4580af020 0x7fa458156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.213+0000 7fa45e1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa45806e820 0x7fa45815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.213+0000 7fa45e1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45806d3e0 con 0x7fa4580b00d0 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.213+0000 7fa45e1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806dc80 con 0x7fa4580af020 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.213+0000 7fa45e1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806eca0 con 0x7fa45806e820 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4577fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4580af020 0x7fa458156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa456ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa4580b00d0 0x7fa45806e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47038/0 (socket says 172.21.15.142:47038) 2023-09-30T22:59:17.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa456ffd700 1 -- 172.21.15.142:0/2730239557 learned_addr learned my addr 172.21.15.142:0/2730239557 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:17.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4577fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4580af020 0x7fa458156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41386/0 (socket says 172.21.15.142:41386) 2023-09-30T22:59:17.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa457fff700 1 --2- 172.21.15.142:0/2730239557 >> v2:172.21.15.148:3300/0 conn(0x7fa45806e820 0x7fa45815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4577fe700 1 -- 172.21.15.142:0/2730239557 >> v2:172.21.15.148:3300/0 conn(0x7fa45806e820 msgr2=0x7fa45815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:17.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4577fe700 1 --2- 172.21.15.142:0/2730239557 >> v2:172.21.15.148:3300/0 conn(0x7fa45806e820 0x7fa45815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4577fe700 1 -- 172.21.15.142:0/2730239557 >> v1:172.21.15.142:6789/0 conn(0x7fa4580b00d0 legacy=0x7fa45806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4567fc700 1 -- 172.21.15.142:0/2730239557 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561868797 0 0) 0x7fa45806d3e0 con 0x7fa4580b00d0 2023-09-30T22:59:17.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4577fe700 1 -- 172.21.15.142:0/2730239557 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45806b790 con 0x7fa4580af020 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.214+0000 7fa4577fe700 1 --2- 172.21.15.142:0/2730239557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580af020 0x7fa458156d80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa4480098e0 tx=0x7fa4480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6fdd3c028c562c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa4567fc700 1 -- 172.21.15.142:0/2730239557 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800f6b0 con 0x7fa4580af020 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa4567fc700 1 -- 172.21.15.142:0/2730239557 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800f810 con 0x7fa4580af020 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa4567fc700 1 -- 172.21.15.142:0/2730239557 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800fbb0 con 0x7fa4580af020 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 -- 172.21.15.142:0/2730239557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580af020 msgr2=0x7fa458156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/2730239557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580af020 0x7fa458156d80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa4480098e0 tx=0x7fa4480091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 -- 172.21.15.142:0/2730239557 shutdown_connections 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/2730239557 >> v2:172.21.15.148:3300/0 conn(0x7fa45806e820 0x7fa45815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/2730239557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580af020 0x7fa458156d80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 -- 172.21.15.142:0/2730239557 >> 172.21.15.142:0/2730239557 conn(0x7fa4580680c0 msgr2=0x7fa4580c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 -- 172.21.15.142:0/2730239557 shutdown_connections 2023-09-30T22:59:17.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.215+0000 7fa45e1ff700 1 -- 172.21.15.142:0/2730239557 wait complete. 2023-09-30T22:59:17.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.217+0000 7fa45e1ff700 1 Processor -- start 2023-09-30T22:59:17.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.217+0000 7fa45e1ff700 1 -- start start 2023-09-30T22:59:17.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa45e1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa45806e820 0x7fa4580c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa45e1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4580af020 0x7fa4580a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa45e1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580b00d0 0x7fa45816cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa45e1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45816aee0 con 0x7fa4580b00d0 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa45e1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45816a540 con 0x7fa45806e820 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa45e1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45816a820 con 0x7fa4580af020 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580b00d0 0x7fa45816cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580b00d0 0x7fa45816cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41392/0 (socket says 172.21.15.142:41392) 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 -- 172.21.15.142:0/3919052951 learned_addr learned my addr 172.21.15.142:0/3919052951 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa4577fe700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa45806e820 0x7fa4580c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa456ffd700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4580af020 0x7fa4580a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 -- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4580af020 msgr2=0x7fa4580a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4580af020 0x7fa4580a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 -- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa45806e820 msgr2=0x7fa4580c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa45806e820 0x7fa4580c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.218+0000 7fa457fff700 1 -- 172.21.15.142:0/3919052951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448009420 con 0x7fa4580b00d0 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.219+0000 7fa457fff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580b00d0 0x7fa45816cb30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa450009e90 tx=0x7fa45000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.219+0000 7fa43f7fe700 1 -- 172.21.15.142:0/3919052951 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000caa0 con 0x7fa4580b00d0 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.219+0000 7fa43f7fe700 1 -- 172.21.15.142:0/3919052951 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000f040 con 0x7fa4580b00d0 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.219+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45816ab00 con 0x7fa4580b00d0 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.219+0000 7fa43f7fe700 1 -- 172.21.15.142:0/3919052951 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000ce50 con 0x7fa4580b00d0 2023-09-30T22:59:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.219+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4580a75a0 con 0x7fa4580b00d0 2023-09-30T22:59:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.220+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4580695b0 con 0x7fa4580b00d0 2023-09-30T22:59:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.221+0000 7fa43f7fe700 1 -- 172.21.15.142:0/3919052951 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa450014690 con 0x7fa4580b00d0 2023-09-30T22:59:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.222+0000 7fa43f7fe700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa444067330 0x7fa4440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.222+0000 7fa43f7fe700 1 -- 172.21.15.142:0/3919052951 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa450085880 con 0x7fa4580b00d0 2023-09-30T22:59:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.223+0000 7fa4577fe700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa444067330 0x7fa4440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.223+0000 7fa4577fe700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa444067330 0x7fa4440697e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa4480093f0 tx=0x7fa448019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:17.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.227+0000 7fa43f7fe700 1 -- 172.21.15.142:0/3919052951 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa450056170 con 0x7fa4580b00d0 2023-09-30T22:59:17.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.418+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa45806fc10 con 0x7fa4580b00d0 2023-09-30T22:59:17.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.419+0000 7fa43f7fe700 1 -- 172.21.15.142:0/3919052951 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+17026 (secure 0 0 0) 0x7fa450055d00 con 0x7fa4580b00d0 2023-09-30T22:59:17.419 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:17.419 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":144,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:14.504031+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:59:11.103746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-09-30T22:59:11.960192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.421+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa444067330 msgr2=0x7fa4440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.421+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa444067330 0x7fa4440697e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa4480093f0 tx=0x7fa448019000 comp rx=0 tx=0).stop 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.421+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580b00d0 msgr2=0x7fa45816cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.421+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580b00d0 0x7fa45816cb30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa450009e90 tx=0x7fa45000b040 comp rx=0 tx=0).stop 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 shutdown_connections 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa444067330 0x7fa4440697e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4580b00d0 0x7fa45816cb30 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa45806e820 0x7fa4580c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 --2- 172.21.15.142:0/3919052951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4580af020 0x7fa4580a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 >> 172.21.15.142:0/3919052951 conn(0x7fa4580680c0 msgr2=0x7fa458069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:17.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 shutdown_connections 2023-09-30T22:59:17.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.422+0000 7fa45e1ff700 1 -- 172.21.15.142:0/3919052951 wait complete. 2023-09-30T22:59:17.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:59:17.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:59:17.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.631+0000 7f76ad7ff700 1 Processor -- start 2023-09-30T22:59:17.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.631+0000 7f76ad7ff700 1 -- start start 2023-09-30T22:59:17.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.632+0000 7f76ad7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76a806b3d0 0x7f76a80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.632+0000 7f76ad7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a806d470 con 0x7f76a80b1f40 2023-09-30T22:59:17.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.632+0000 7f76ad7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a8157e60 con 0x7f76a8157a90 2023-09-30T22:59:17.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.632+0000 7f76ad7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a80b2380 con 0x7f76a806b3d0 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.632+0000 7f76a67fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76a806b3d0 0x7f76a80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a67fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76a806b3d0 0x7f76a80b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41396/0 (socket says 172.21.15.142:41396) 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a77fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f76a80b1f40 0x7f76a806d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47040/0 (socket says 172.21.15.142:47040) 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a67fc700 1 -- 172.21.15.142:0/2161674857 learned_addr learned my addr 172.21.15.142:0/2161674857 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a67fc700 1 -- 172.21.15.142:0/2161674857 >> v1:172.21.15.148:6789/0 conn(0x7f76a8157a90 legacy=0x7f76a815bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a67fc700 1 -- 172.21.15.142:0/2161674857 >> v1:172.21.15.142:6789/0 conn(0x7f76a80b1f40 legacy=0x7f76a806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a67fc700 1 -- 172.21.15.142:0/2161674857 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a80ae880 con 0x7f76a806b3d0 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a5ffb700 1 -- 172.21.15.142:0/2161674857 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647482239 0 0) 0x7f76a806d470 con 0x7f76a80b1f40 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a67fc700 1 --2- 172.21.15.142:0/2161674857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a80b1a00 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f769c0099b0 tx=0x7f769c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5147e48d48bdd360 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a5ffb700 1 -- 172.21.15.142:0/2161674857 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00b860 con 0x7f76a806b3d0 2023-09-30T22:59:17.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a5ffb700 1 -- 172.21.15.142:0/2161674857 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c00b9c0 con 0x7f76a806b3d0 2023-09-30T22:59:17.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.633+0000 7f76a5ffb700 1 -- 172.21.15.142:0/2161674857 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00bd60 con 0x7f76a806b3d0 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.634+0000 7f76ad7ff700 1 -- 172.21.15.142:0/2161674857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 msgr2=0x7f76a80b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.634+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/2161674857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a80b1a00 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f769c0099b0 tx=0x7f769c009250 comp rx=0 tx=0).stop 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.634+0000 7f76ad7ff700 1 -- 172.21.15.142:0/2161674857 shutdown_connections 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.634+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/2161674857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a80b1a00 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.634+0000 7f76ad7ff700 1 -- 172.21.15.142:0/2161674857 >> 172.21.15.142:0/2161674857 conn(0x7f76a80680c0 msgr2=0x7f76a80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.634+0000 7f76ad7ff700 1 -- 172.21.15.142:0/2161674857 shutdown_connections 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.634+0000 7f76ad7ff700 1 -- 172.21.15.142:0/2161674857 wait complete. 2023-09-30T22:59:17.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.636+0000 7f76ad7ff700 1 Processor -- start 2023-09-30T22:59:17.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.636+0000 7f76ad7ff700 1 -- start start 2023-09-30T22:59:17.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76ad7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a814be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76ad7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a80b1f40 0x7f76a80c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76ad7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76a8157a90 0x7f76a80c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76ad7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a814c3b0 con 0x7f76a806b3d0 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76ad7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a816b240 con 0x7f76a80b1f40 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76ad7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8158ff0 con 0x7f76a8157a90 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a814be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a814be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41398/0 (socket says 172.21.15.142:41398) 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 -- 172.21.15.142:0/1058127115 learned_addr learned my addr 172.21.15.142:0/1058127115 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a67fc700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a80b1f40 0x7f76a80c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a77fe700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76a8157a90 0x7f76a80c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 -- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76a8157a90 msgr2=0x7f76a80c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76a8157a90 0x7f76a80c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 -- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a80b1f40 msgr2=0x7f76a80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a80b1f40 0x7f76a80c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.637+0000 7f76a6ffd700 1 -- 172.21.15.142:0/1058127115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0094f0 con 0x7f76a806b3d0 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.638+0000 7f76a6ffd700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a814be70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f769800c4e0 tx=0x7f769800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.638+0000 7f768effd700 1 -- 172.21.15.142:0/1058127115 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698011590 con 0x7f76a806b3d0 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.638+0000 7f768effd700 1 -- 172.21.15.142:0/1058127115 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698011710 con 0x7f76a806b3d0 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.638+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a81592d0 con 0x7f76a806b3d0 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.638+0000 7f768effd700 1 -- 172.21.15.142:0/1058127115 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698011ad0 con 0x7f76a806b3d0 2023-09-30T22:59:17.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.638+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a8159890 con 0x7f76a806b3d0 2023-09-30T22:59:17.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.639+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a80695b0 con 0x7f76a806b3d0 2023-09-30T22:59:17.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.640+0000 7f768effd700 1 -- 172.21.15.142:0/1058127115 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f769801b3b0 con 0x7f76a806b3d0 2023-09-30T22:59:17.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.641+0000 7f768effd700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7694067330 0x7f76940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:17.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.641+0000 7f768effd700 1 -- 172.21.15.142:0/1058127115 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f76980840c0 con 0x7f76a806b3d0 2023-09-30T22:59:17.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.641+0000 7f76a67fc700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7694067330 0x7f76940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:17.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.641+0000 7f76a67fc700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7694067330 0x7f76940697e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f769c0099b0 tx=0x7f769c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:17.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.645+0000 7f768effd700 1 -- 172.21.15.142:0/1058127115 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7698050f20 con 0x7f76a806b3d0 2023-09-30T22:59:17.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.831+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76a806cff0 con 0x7f7694067330 2023-09-30T22:59:17.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.839+0000 7f768effd700 1 -- 172.21.15.142:0/1058127115 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294362 (secure 0 0 0) 0x7f76a806cff0 con 0x7f7694067330 2023-09-30T22:59:17.843 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.843+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7694067330 msgr2=0x7f76940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.843+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7694067330 0x7f76940697e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f769c0099b0 tx=0x7f769c017000 comp rx=0 tx=0).stop 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.843+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 msgr2=0x7f76a814be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.843+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a814be70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f769800c4e0 tx=0x7f769800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 shutdown_connections 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7694067330 0x7f76940697e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76a8157a90 0x7f76a80c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76a806b3d0 0x7f76a814be70 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 --2- 172.21.15.142:0/1058127115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a80b1f40 0x7f76a80c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 >> 172.21.15.142:0/1058127115 conn(0x7f76a80680c0 msgr2=0x7f76a80cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 shutdown_connections 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:17.844+0000 7f76ad7ff700 1 -- 172.21.15.142:0/1058127115 wait complete. 2023-09-30T22:59:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:59:17.861 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2023-09-30T22:59:16.193953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7633,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554866,"statfs":{"total":1600000000,"available":1592183654,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.698707"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.501896+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:50.352693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498675+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:37.330683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.499372+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:17:00.248808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498261+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:32.447363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498504+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:23:58.965098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.500137+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:38.602853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498028+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:50.887647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.497748+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:54.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498229+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:07.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498133+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:11:15.982523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.502285+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:36:03.894991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498121+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:58:52.254006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498465+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:49.823933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.499545+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:05.654132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.497372+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:39:49.467357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.501932+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:23.722636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.497944+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:57.137262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.501456+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:39:16.232042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.502478+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:32:13.415070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.497636+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:57:19.564333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.501506+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:39:57.669853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.499162+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:16.884628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.497517+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:55:31.001613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.501680+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:17.823101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.499074+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:07.994091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":116,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.958203+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:59:08.958203+0000","last_peered":"2023-09-30T22:59:08.958203+0000","last_clean":"2023-09-30T22:59:08.958203+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:59:08.958203+0000","last_undegraded":"2023-09-30T22:59:08.958203+0000","last_fullsized":"2023-09-30T22:59:08.958203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.500254+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:30:37.373636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.488490+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:59:08.488490+0000","last_peered":"2023-09-30T22:59:08.488490+0000","last_clean":"2023-09-30T22:59:08.488490+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:59:08.488490+0000","last_undegraded":"2023-09-30T22:59:08.488490+0000","last_fullsized":"2023-09-30T22:59:08.488490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.497219+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:40.155633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.490448+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:59:08.490448+0000","last_peered":"2023-09-30T22:59:08.490448+0000","last_clean":"2023-09-30T22:59:08.490448+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:59:08.490448+0000","last_undegraded":"2023-09-30T22:59:08.490448+0000","last_fullsized":"2023-09-30T22:59:08.490448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.499595+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:15:11.182941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.488455+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:59:08.488455+0000","last_peered":"2023-09-30T22:59:08.488455+0000","last_clean":"2023-09-30T22:59:08.488455+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:59:08.488455+0000","last_undegraded":"2023-09-30T22:59:08.488455+0000","last_fullsized":"2023-09-30T22:59:08.488455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":272,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.957624+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:59:08.957624+0000","last_peered":"2023-09-30T22:59:08.957624+0000","last_clean":"2023-09-30T22:59:08.957624+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:59:08.957624+0000","last_undegraded":"2023-09-30T22:59:08.957624+0000","last_fullsized":"2023-09-30T22:59:08.957624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.499759+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:36:49.247487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.488526+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:59:08.488526+0000","last_peered":"2023-09-30T22:59:08.488526+0000","last_clean":"2023-09-30T22:59:08.488526+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:59:08.488526+0000","last_undegraded":"2023-09-30T22:59:08.488526+0000","last_fullsized":"2023-09-30T22:59:08.488526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.499487+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:49.823933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.488455+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:59:08.488455+0000","last_peered":"2023-09-30T22:59:08.488455+0000","last_clean":"2023-09-30T22:59:08.488455+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:59:08.488455+0000","last_undegraded":"2023-09-30T22:59:08.488455+0000","last_fullsized":"2023-09-30T22:59:08.488455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498045+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:11:04.554219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.957882+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:59:08.957882+0000","last_peered":"2023-09-30T22:59:08.957882+0000","last_clean":"2023-09-30T22:59:08.957882+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:59:08.957882+0000","last_undegraded":"2023-09-30T22:59:08.957882+0000","last_fullsized":"2023-09-30T22:59:08.957882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:59:12.495567+0000","last_change":"2023-09-30T22:59:12.495567+0000","last_active":"2023-09-30T22:59:12.495567+0000","last_peered":"2023-09-30T22:59:12.495567+0000","last_clean":"2023-09-30T22:59:12.495567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:12.495567+0000","last_undegraded":"2023-09-30T22:59:12.495567+0000","last_fullsized":"2023-09-30T22:59:12.495567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:59:11.486882+0000","last_change":"2023-09-30T22:59:11.498009+0000","last_active":"2023-09-30T22:59:11.486882+0000","last_peered":"2023-09-30T22:59:11.486882+0000","last_clean":"2023-09-30T22:59:11.486882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:59:11.486882+0000","last_undegraded":"2023-09-30T22:59:11.486882+0000","last_fullsized":"2023-09-30T22:59:11.486882+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:45:11.840564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-09-30T22:59:08.488432+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:59:08.488432+0000","last_peered":"2023-09-30T22:59:08.488432+0000","last_clean":"2023-09-30T22:59:08.488432+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:59:08.488432+0000","last_undegraded":"2023-09-30T22:59:08.488432+0000","last_fullsized":"2023-09-30T22:59:08.488432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66300000000000003,"15min":0.63300000000000001},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76200000000000001,"5min":0.96599999999999997,"15min":1.0229999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89100000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56200000000000006}]},{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91800000000000004},"last":0.628},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70199999999999996,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.77100000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69399999999999995,"15min":0.67400000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73099999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83699999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78300000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.434},"max":{"1min":0.84199999999999997,"5min":1.056,"15min":1.056},"last":0.87}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61799999999999999,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.88},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.623,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65900000000000003,"15min":0.63100000000000001},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":1.135,"15min":1.135},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.004},"last":0.94899999999999995}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":1.056},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85699999999999998,"5min":1.071,"15min":1.071},"last":0.93100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.96499999999999997},"min":{"1min":0.52800000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":1.823,"15min":6.5190000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.51900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.5710000000000002,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.66200000000000003}]},{"osd":1,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.75700000000000001,"15min":0.82199999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94599999999999995,"5min":2.6230000000000002,"15min":3.6339999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.996},"min":{"1min":0.503,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0649999999999999,"5min":5.6749999999999998,"15min":8.4339999999999993},"last":0.69299999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.80500000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0029999999999999,"5min":3.2629999999999999,"15min":3.4580000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.73299999999999998,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.0429999999999999,"15min":6.5730000000000004},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.93999999999999995},"min":{"1min":0.58499999999999996,"5min":0.49299999999999999,"15min":0.44400000000000001},"max":{"1min":1.343,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.036,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.623}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.64200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.94199999999999995,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75900000000000001,"15min":0.68300000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2909999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.66200000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.996,"5min":1.321,"15min":1.321},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.754,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.69299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198579411,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44400000000000001,"15min":0.40799999999999997},"min":{"1min":0.30599999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.48799999999999999,"5min":1.083,"15min":1.083},"last":0.376},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.49099999999999999,"15min":0.45800000000000002},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.59099999999999997,"5min":0.745,"15min":0.745},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46100000000000002,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.47399999999999998},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":0.57199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56299999999999994,"15min":0.52100000000000002},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.313},"max":{"1min":0.65300000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.47499999999999998},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54300000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.57599999999999996,"5min":0.52000000000000002,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.45100000000000001},"max":{"1min":0.94499999999999995,"5min":1.22,"15min":1.22},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.72899999999999998},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.432},"max":{"1min":1.002,"5min":1.127,"15min":1.127},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89600000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79100000000000004,"15min":0.76300000000000001},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97799999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81899999999999995,"15min":0.76900000000000002},"min":{"1min":0.64700000000000002,"5min":0.54500000000000004,"15min":0.52900000000000003},"max":{"1min":0.97799999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.432,"15min":0.41799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53100000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.46500000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.61899999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61399999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.51500000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.879,"15min":0.879},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48699999999999999,"15min":0.46100000000000002},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65900000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.70699999999999996},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.141,"5min":1.27,"15min":1.27},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.006,"5min":1.171,"15min":1.171},"last":0.80700000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96899999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.78800000000000003,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.90100000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1200000000000001,"5min":0.84799999999999998,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.2610000000000001,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.81799999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.623,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.81699999999999995,"15min":0.77200000000000002},"min":{"1min":0.54200000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":804,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194507,"statfs":{"total":200000000,"available":199175937,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.23599999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.442},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.42999999999999999},"min":{"1min":0.311,"5min":0.251,"15min":0.249},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.32500000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.501},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79300000000000004,"5min":0.83999999999999997,"15min":1.0449999999999999},"last":0.499}]},{"osd":3,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.45300000000000001},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4910000000000001},"last":0.622}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.179},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.008,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.615},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.55200000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77000000000000002,"15min":0.73799999999999999},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.46000000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.497,"5min":0.495,"15min":0.439},"max":{"1min":1.113,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.56699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.63300000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.222},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.51100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73299999999999998,"5min":1.0700000000000001,"15min":1.919},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.53500000000000003,"5min":0.75800000000000001,"15min":1.254},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67900000000000005,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59099999999999997,"5min":0.72399999999999998,"15min":1.6020000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.96199999999999997,"5min":1.2190000000000001,"15min":1.5309999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.72699999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92500000000000004,"5min":1.242,"15min":1.401},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.76200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93999999999999995,"5min":3.306,"15min":3.306},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75,"15min":0.749},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.98199999999999998,"15min":1.508},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.755,"15min":0.746},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":0.92700000000000005,"5min":1.274,"15min":1.4910000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1870000000000001,"15min":1.5620000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0489999999999999,"5min":1.0960000000000001,"15min":1.3140000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":1.135,"5min":1.3440000000000001,"15min":1.3640000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97199999999999998,"5min":1.1970000000000001,"15min":1.573},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.022,"15min":1.022},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.59699999999999998},"min":{"1min":0.50700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.746,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.623}]},{"osd":1,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.61599999999999999},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.68300000000000005},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.877,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70099999999999996,"15min":0.65500000000000003},"min":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63400000000000001,"15min":0.65700000000000003},"min":{"1min":0.44,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.37},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.497},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.97099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98599999999999999,"5min":1.016,"15min":1.016},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.56399999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":1.044,"15min":1.044},"last":0.65400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198579411,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.623},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88400000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0369999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.27400000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94499999999999995,"5min":1.044,"15min":1.044},"last":0.46400000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.64000000000000001},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86799999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.53700000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.93700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.69899999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.37},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.748},"min":{"1min":0.64000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80400000000000005}]}]}],"pool_statfs":[]}} 2023-09-30T22:59:17.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:59:18.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.090+0000 7efe3e9ff700 1 Processor -- start 2023-09-30T22:59:18.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.090+0000 7efe3e9ff700 1 -- start start 2023-09-30T22:59:18.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.091+0000 7efe3e9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efe38143350 0x7efe380cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.091+0000 7efe3e9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe3815de20 0x7efe3806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.091+0000 7efe3e9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe380cc6b0 con 0x7efe380692f0 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.091+0000 7efe3e9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe380cb7d0 con 0x7efe3815de20 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.091+0000 7efe3e9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe380cbaa0 con 0x7efe38143350 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe377fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7efe380692f0 0x7efe3815d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47046/0 (socket says 172.21.15.142:47046) 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe377fe700 1 -- 172.21.15.142:0/3647532983 learned_addr learned my addr 172.21.15.142:0/3647532983 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe3cf9c700 1 --2- 172.21.15.142:0/3647532983 >> v2:172.21.15.142:3300/0 conn(0x7efe3815de20 0x7efe3806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe37fff700 1 --2- 172.21.15.142:0/3647532983 >> v2:172.21.15.148:3300/0 conn(0x7efe38143350 0x7efe380cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe36ffd700 1 -- 172.21.15.142:0/3647532983 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507060091 0 0) 0x7efe380cc6b0 con 0x7efe380692f0 2023-09-30T22:59:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe36ffd700 1 -- 172.21.15.142:0/3647532983 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe20003570 con 0x7efe380692f0 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe3cf9c700 1 -- 172.21.15.142:0/3647532983 >> v2:172.21.15.148:3300/0 conn(0x7efe38143350 msgr2=0x7efe380cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe3cf9c700 1 --2- 172.21.15.142:0/3647532983 >> v2:172.21.15.148:3300/0 conn(0x7efe38143350 0x7efe380cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe3cf9c700 1 -- 172.21.15.142:0/3647532983 >> v1:172.21.15.142:6789/0 conn(0x7efe380692f0 legacy=0x7efe3815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe3cf9c700 1 -- 172.21.15.142:0/3647532983 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380cbd80 con 0x7efe3815de20 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.092+0000 7efe3cf9c700 1 --2- 172.21.15.142:0/3647532983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe3815de20 0x7efe3806a0c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7efe38069cc0 tx=0x7efe30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b299639a1e515ce7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe36ffd700 1 -- 172.21.15.142:0/3647532983 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000e070 con 0x7efe3815de20 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe36ffd700 1 -- 172.21.15.142:0/3647532983 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3000bab0 con 0x7efe3815de20 2023-09-30T22:59:18.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe36ffd700 1 -- 172.21.15.142:0/3647532983 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000be70 con 0x7efe3815de20 2023-09-30T22:59:18.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3647532983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe3815de20 msgr2=0x7efe3806a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3647532983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe3815de20 0x7efe3806a0c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7efe38069cc0 tx=0x7efe30009780 comp rx=0 tx=0).stop 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3647532983 shutdown_connections 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3647532983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe3815de20 0x7efe3806a0c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3647532983 >> v2:172.21.15.148:3300/0 conn(0x7efe38143350 0x7efe380cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3647532983 >> 172.21.15.142:0/3647532983 conn(0x7efe380ce8e0 msgr2=0x7efe380cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3647532983 shutdown_connections 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.093+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3647532983 wait complete. 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.095+0000 7efe3e9ff700 1 Processor -- start 2023-09-30T22:59:18.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.096+0000 7efe3e9ff700 1 -- start start 2023-09-30T22:59:18.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe3e9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe380692f0 0x7efe3815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe3e9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe38143350 0x7efe38158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe3e9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe3815de20 0x7efe38069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe3e9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe380b3970 con 0x7efe38143350 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe3e9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe380b34e0 con 0x7efe380692f0 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe3e9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe380b28d0 con 0x7efe3815de20 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe38143350 0x7efe38158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe38143350 0x7efe38158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41418/0 (socket says 172.21.15.142:41418) 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 -- 172.21.15.142:0/3226907341 learned_addr learned my addr 172.21.15.142:0/3226907341 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe37fff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe380692f0 0x7efe3815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe3cf9c700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe3815de20 0x7efe38069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 -- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe3815de20 msgr2=0x7efe38069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe3815de20 0x7efe38069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 -- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe380692f0 msgr2=0x7efe3815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe380692f0 0x7efe3815a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.097+0000 7efe377fe700 1 -- 172.21.15.142:0/3226907341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30009a20 con 0x7efe38143350 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.098+0000 7efe3cf9c700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe3815de20 0x7efe38069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.098+0000 7efe377fe700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe38143350 0x7efe38158c90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c7c0 tx=0x7efe2c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.098+0000 7efe1ffff700 1 -- 172.21.15.142:0/3226907341 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c005b30 con 0x7efe38143350 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.098+0000 7efe1ffff700 1 -- 172.21.15.142:0/3226907341 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c005c90 con 0x7efe38143350 2023-09-30T22:59:18.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.098+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe380b2bb0 con 0x7efe38143350 2023-09-30T22:59:18.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.098+0000 7efe1ffff700 1 -- 172.21.15.142:0/3226907341 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c007340 con 0x7efe38143350 2023-09-30T22:59:18.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.098+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe380b3170 con 0x7efe38143350 2023-09-30T22:59:18.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.099+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe380b3670 con 0x7efe38143350 2023-09-30T22:59:18.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.100+0000 7efe1ffff700 1 -- 172.21.15.142:0/3226907341 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efe2c01b400 con 0x7efe38143350 2023-09-30T22:59:18.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.101+0000 7efe1ffff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe24067330 0x7efe240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.101+0000 7efe1ffff700 1 -- 172.21.15.142:0/3226907341 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efe2c084740 con 0x7efe38143350 2023-09-30T22:59:18.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.101+0000 7efe37fff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe24067330 0x7efe240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.102+0000 7efe37fff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe24067330 0x7efe240697e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efe3815ef60 tx=0x7efe28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:18.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.105+0000 7efe1ffff700 1 -- 172.21.15.142:0/3226907341 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efe2c051620 con 0x7efe38143350 2023-09-30T22:59:18.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.290+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe380cc060 con 0x7efe24067330 2023-09-30T22:59:18.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.299+0000 7efe1ffff700 1 -- 172.21.15.142:0/3226907341 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303601 (secure 0 0 0) 0x7efe380cc060 con 0x7efe24067330 2023-09-30T22:59:18.303 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:18.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe24067330 msgr2=0x7efe240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe24067330 0x7efe240697e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efe3815ef60 tx=0x7efe28008040 comp rx=0 tx=0).stop 2023-09-30T22:59:18.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe38143350 msgr2=0x7efe38158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe38143350 0x7efe38158c90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c7c0 tx=0x7efe2c007e00 comp rx=0 tx=0).stop 2023-09-30T22:59:18.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 shutdown_connections 2023-09-30T22:59:18.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efe24067330 0x7efe240697e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe3815de20 0x7efe38069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe380692f0 0x7efe3815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 --2- 172.21.15.142:0/3226907341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe38143350 0x7efe38158c90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 >> 172.21.15.142:0/3226907341 conn(0x7efe380ce8e0 msgr2=0x7efe380b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:18.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 shutdown_connections 2023-09-30T22:59:18.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.303+0000 7efe3e9ff700 1 -- 172.21.15.142:0/3226907341 wait complete. 2023-09-30T22:59:18.306 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T22:59:18.320 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2023-09-30T22:59:18.194391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554697,"statfs":{"total":1600000000,"available":1592009900,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001373"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.514530+0000","last_change":"2023-09-30T22:59:13.514416+0000","last_active":"2023-09-30T22:59:13.514530+0000","last_peered":"2023-09-30T22:59:13.514530+0000","last_clean":"2023-09-30T22:59:13.514530+0000","last_became_active":"2023-09-30T22:59:13.514191+0000","last_became_peered":"2023-09-30T22:59:13.514191+0000","last_unstale":"2023-09-30T22:59:13.514530+0000","last_undegraded":"2023-09-30T22:59:13.514530+0000","last_fullsized":"2023-09-30T22:59:13.514530+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:54.569116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517527+0000","last_change":"2023-09-30T22:59:13.517430+0000","last_active":"2023-09-30T22:59:13.517527+0000","last_peered":"2023-09-30T22:59:13.517527+0000","last_clean":"2023-09-30T22:59:13.517527+0000","last_became_active":"2023-09-30T22:59:13.517160+0000","last_became_peered":"2023-09-30T22:59:13.517160+0000","last_unstale":"2023-09-30T22:59:13.517527+0000","last_undegraded":"2023-09-30T22:59:13.517527+0000","last_fullsized":"2023-09-30T22:59:13.517527+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:14:38.686282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.515301+0000","last_change":"2023-09-30T22:59:13.515229+0000","last_active":"2023-09-30T22:59:13.515301+0000","last_peered":"2023-09-30T22:59:13.515301+0000","last_clean":"2023-09-30T22:59:13.515301+0000","last_became_active":"2023-09-30T22:59:13.514955+0000","last_became_peered":"2023-09-30T22:59:13.514955+0000","last_unstale":"2023-09-30T22:59:13.515301+0000","last_undegraded":"2023-09-30T22:59:13.515301+0000","last_fullsized":"2023-09-30T22:59:13.515301+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:41:36.758114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.524377+0000","last_change":"2023-09-30T22:59:13.524231+0000","last_active":"2023-09-30T22:59:13.524377+0000","last_peered":"2023-09-30T22:59:13.524377+0000","last_clean":"2023-09-30T22:59:13.524377+0000","last_became_active":"2023-09-30T22:59:13.523756+0000","last_became_peered":"2023-09-30T22:59:13.523756+0000","last_unstale":"2023-09-30T22:59:13.524377+0000","last_undegraded":"2023-09-30T22:59:13.524377+0000","last_fullsized":"2023-09-30T22:59:13.524377+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:17.893313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.524566+0000","last_change":"2023-09-30T22:59:13.524040+0000","last_active":"2023-09-30T22:59:13.524566+0000","last_peered":"2023-09-30T22:59:13.524566+0000","last_clean":"2023-09-30T22:59:13.524566+0000","last_became_active":"2023-09-30T22:59:13.523826+0000","last_became_peered":"2023-09-30T22:59:13.523826+0000","last_unstale":"2023-09-30T22:59:13.524566+0000","last_undegraded":"2023-09-30T22:59:13.524566+0000","last_fullsized":"2023-09-30T22:59:13.524566+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:38.339368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517661+0000","last_change":"2023-09-30T22:59:13.517555+0000","last_active":"2023-09-30T22:59:13.517661+0000","last_peered":"2023-09-30T22:59:13.517661+0000","last_clean":"2023-09-30T22:59:13.517661+0000","last_became_active":"2023-09-30T22:59:13.517221+0000","last_became_peered":"2023-09-30T22:59:13.517221+0000","last_unstale":"2023-09-30T22:59:13.517661+0000","last_undegraded":"2023-09-30T22:59:13.517661+0000","last_fullsized":"2023-09-30T22:59:13.517661+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:21:53.705436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.523077+0000","last_change":"2023-09-30T22:59:13.522683+0000","last_active":"2023-09-30T22:59:13.523077+0000","last_peered":"2023-09-30T22:59:13.523077+0000","last_clean":"2023-09-30T22:59:13.523077+0000","last_became_active":"2023-09-30T22:59:13.522407+0000","last_became_peered":"2023-09-30T22:59:13.522407+0000","last_unstale":"2023-09-30T22:59:13.523077+0000","last_undegraded":"2023-09-30T22:59:13.523077+0000","last_fullsized":"2023-09-30T22:59:13.523077+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:46:32.588741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.524330+0000","last_change":"2023-09-30T22:59:13.524257+0000","last_active":"2023-09-30T22:59:13.524330+0000","last_peered":"2023-09-30T22:59:13.524330+0000","last_clean":"2023-09-30T22:59:13.524330+0000","last_became_active":"2023-09-30T22:59:13.524009+0000","last_became_peered":"2023-09-30T22:59:13.524009+0000","last_unstale":"2023-09-30T22:59:13.524330+0000","last_undegraded":"2023-09-30T22:59:13.524330+0000","last_fullsized":"2023-09-30T22:59:13.524330+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:06.488991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.524974+0000","last_change":"2023-09-30T22:59:13.524904+0000","last_active":"2023-09-30T22:59:13.524974+0000","last_peered":"2023-09-30T22:59:13.524974+0000","last_clean":"2023-09-30T22:59:13.524974+0000","last_became_active":"2023-09-30T22:59:13.524600+0000","last_became_peered":"2023-09-30T22:59:13.524600+0000","last_unstale":"2023-09-30T22:59:13.524974+0000","last_undegraded":"2023-09-30T22:59:13.524974+0000","last_fullsized":"2023-09-30T22:59:13.524974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:17:01.257493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522237+0000","last_change":"2023-09-30T22:59:13.522055+0000","last_active":"2023-09-30T22:59:13.522237+0000","last_peered":"2023-09-30T22:59:13.522237+0000","last_clean":"2023-09-30T22:59:13.522237+0000","last_became_active":"2023-09-30T22:59:13.521605+0000","last_became_peered":"2023-09-30T22:59:13.521605+0000","last_unstale":"2023-09-30T22:59:13.522237+0000","last_undegraded":"2023-09-30T22:59:13.522237+0000","last_fullsized":"2023-09-30T22:59:13.522237+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:05:52.173881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518224+0000","last_change":"2023-09-30T22:59:13.518135+0000","last_active":"2023-09-30T22:59:13.518224+0000","last_peered":"2023-09-30T22:59:13.518224+0000","last_clean":"2023-09-30T22:59:13.518224+0000","last_became_active":"2023-09-30T22:59:13.517754+0000","last_became_peered":"2023-09-30T22:59:13.517754+0000","last_unstale":"2023-09-30T22:59:13.518224+0000","last_undegraded":"2023-09-30T22:59:13.518224+0000","last_fullsized":"2023-09-30T22:59:13.518224+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:21:48.466639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.513156+0000","last_change":"2023-09-30T22:59:13.513079+0000","last_active":"2023-09-30T22:59:13.513156+0000","last_peered":"2023-09-30T22:59:13.513156+0000","last_clean":"2023-09-30T22:59:13.513156+0000","last_became_active":"2023-09-30T22:59:13.512708+0000","last_became_peered":"2023-09-30T22:59:13.512708+0000","last_unstale":"2023-09-30T22:59:13.513156+0000","last_undegraded":"2023-09-30T22:59:13.513156+0000","last_fullsized":"2023-09-30T22:59:13.513156+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:10:31.494675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518961+0000","last_change":"2023-09-30T22:59:13.517858+0000","last_active":"2023-09-30T22:59:13.518961+0000","last_peered":"2023-09-30T22:59:13.518961+0000","last_clean":"2023-09-30T22:59:13.518961+0000","last_became_active":"2023-09-30T22:59:13.517618+0000","last_became_peered":"2023-09-30T22:59:13.517618+0000","last_unstale":"2023-09-30T22:59:13.518961+0000","last_undegraded":"2023-09-30T22:59:13.518961+0000","last_fullsized":"2023-09-30T22:59:13.518961+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:17.893313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.519050+0000","last_change":"2023-09-30T22:59:13.516476+0000","last_active":"2023-09-30T22:59:13.519050+0000","last_peered":"2023-09-30T22:59:13.519050+0000","last_clean":"2023-09-30T22:59:13.519050+0000","last_became_active":"2023-09-30T22:59:13.516223+0000","last_became_peered":"2023-09-30T22:59:13.516223+0000","last_unstale":"2023-09-30T22:59:13.519050+0000","last_undegraded":"2023-09-30T22:59:13.519050+0000","last_fullsized":"2023-09-30T22:59:13.519050+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:11:05.562904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.520811+0000","last_change":"2023-09-30T22:59:13.520511+0000","last_active":"2023-09-30T22:59:13.520811+0000","last_peered":"2023-09-30T22:59:13.520811+0000","last_clean":"2023-09-30T22:59:13.520811+0000","last_became_active":"2023-09-30T22:59:13.520269+0000","last_became_peered":"2023-09-30T22:59:13.520269+0000","last_unstale":"2023-09-30T22:59:13.520811+0000","last_undegraded":"2023-09-30T22:59:13.520811+0000","last_fullsized":"2023-09-30T22:59:13.520811+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:58:53.262691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518923+0000","last_change":"2023-09-30T22:59:13.514795+0000","last_active":"2023-09-30T22:59:13.518923+0000","last_peered":"2023-09-30T22:59:13.518923+0000","last_clean":"2023-09-30T22:59:13.518923+0000","last_became_active":"2023-09-30T22:59:13.514580+0000","last_became_peered":"2023-09-30T22:59:13.514580+0000","last_unstale":"2023-09-30T22:59:13.518923+0000","last_undegraded":"2023-09-30T22:59:13.518923+0000","last_fullsized":"2023-09-30T22:59:13.518923+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:00:20.711627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.513140+0000","last_change":"2023-09-30T22:59:13.512936+0000","last_active":"2023-09-30T22:59:13.513140+0000","last_peered":"2023-09-30T22:59:13.513140+0000","last_clean":"2023-09-30T22:59:13.513140+0000","last_became_active":"2023-09-30T22:59:13.512412+0000","last_became_peered":"2023-09-30T22:59:13.512412+0000","last_unstale":"2023-09-30T22:59:13.513140+0000","last_undegraded":"2023-09-30T22:59:13.513140+0000","last_fullsized":"2023-09-30T22:59:13.513140+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:27:37.824281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522365+0000","last_change":"2023-09-30T22:59:13.522123+0000","last_active":"2023-09-30T22:59:13.522365+0000","last_peered":"2023-09-30T22:59:13.522365+0000","last_clean":"2023-09-30T22:59:13.522365+0000","last_became_active":"2023-09-30T22:59:13.521897+0000","last_became_peered":"2023-09-30T22:59:13.521897+0000","last_unstale":"2023-09-30T22:59:13.522365+0000","last_undegraded":"2023-09-30T22:59:13.522365+0000","last_fullsized":"2023-09-30T22:59:13.522365+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:23:59.973783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.511119+0000","last_change":"2023-09-30T22:59:13.511046+0000","last_active":"2023-09-30T22:59:13.511119+0000","last_peered":"2023-09-30T22:59:13.511119+0000","last_clean":"2023-09-30T22:59:13.511119+0000","last_became_active":"2023-09-30T22:59:13.510793+0000","last_became_peered":"2023-09-30T22:59:13.510793+0000","last_unstale":"2023-09-30T22:59:13.511119+0000","last_undegraded":"2023-09-30T22:59:13.511119+0000","last_fullsized":"2023-09-30T22:59:13.511119+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:32:55.577778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522219+0000","last_change":"2023-09-30T22:59:13.521856+0000","last_active":"2023-09-30T22:59:13.522219+0000","last_peered":"2023-09-30T22:59:13.522219+0000","last_clean":"2023-09-30T22:59:13.522219+0000","last_became_active":"2023-09-30T22:59:13.521262+0000","last_became_peered":"2023-09-30T22:59:13.521262+0000","last_unstale":"2023-09-30T22:59:13.522219+0000","last_undegraded":"2023-09-30T22:59:13.522219+0000","last_fullsized":"2023-09-30T22:59:13.522219+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:04:01.196876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517069+0000","last_change":"2023-09-30T22:59:13.516965+0000","last_active":"2023-09-30T22:59:13.517069+0000","last_peered":"2023-09-30T22:59:13.517069+0000","last_clean":"2023-09-30T22:59:13.517069+0000","last_became_active":"2023-09-30T22:59:13.516516+0000","last_became_peered":"2023-09-30T22:59:13.516516+0000","last_unstale":"2023-09-30T22:59:13.517069+0000","last_undegraded":"2023-09-30T22:59:13.517069+0000","last_fullsized":"2023-09-30T22:59:13.517069+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:37.300381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.524294+0000","last_change":"2023-09-30T22:59:13.524224+0000","last_active":"2023-09-30T22:59:13.524294+0000","last_peered":"2023-09-30T22:59:13.524294+0000","last_clean":"2023-09-30T22:59:13.524294+0000","last_became_active":"2023-09-30T22:59:13.524001+0000","last_became_peered":"2023-09-30T22:59:13.524001+0000","last_unstale":"2023-09-30T22:59:13.524294+0000","last_undegraded":"2023-09-30T22:59:13.524294+0000","last_fullsized":"2023-09-30T22:59:13.524294+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:10.058525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.523389+0000","last_change":"2023-09-30T22:59:13.523111+0000","last_active":"2023-09-30T22:59:13.523389+0000","last_peered":"2023-09-30T22:59:13.523389+0000","last_clean":"2023-09-30T22:59:13.523389+0000","last_became_active":"2023-09-30T22:59:13.522891+0000","last_became_peered":"2023-09-30T22:59:13.522891+0000","last_unstale":"2023-09-30T22:59:13.523389+0000","last_undegraded":"2023-09-30T22:59:13.523389+0000","last_fullsized":"2023-09-30T22:59:13.523389+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:23:59.973783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522251+0000","last_change":"2023-09-30T22:59:13.522129+0000","last_active":"2023-09-30T22:59:13.522251+0000","last_peered":"2023-09-30T22:59:13.522251+0000","last_clean":"2023-09-30T22:59:13.522251+0000","last_became_active":"2023-09-30T22:59:13.521887+0000","last_became_peered":"2023-09-30T22:59:13.521887+0000","last_unstale":"2023-09-30T22:59:13.522251+0000","last_undegraded":"2023-09-30T22:59:13.522251+0000","last_fullsized":"2023-09-30T22:59:13.522251+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:49.769901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.513355+0000","last_change":"2023-09-30T22:59:13.513284+0000","last_active":"2023-09-30T22:59:13.513355+0000","last_peered":"2023-09-30T22:59:13.513355+0000","last_clean":"2023-09-30T22:59:13.513355+0000","last_became_active":"2023-09-30T22:59:13.512687+0000","last_became_peered":"2023-09-30T22:59:13.512687+0000","last_unstale":"2023-09-30T22:59:13.513355+0000","last_undegraded":"2023-09-30T22:59:13.513355+0000","last_fullsized":"2023-09-30T22:59:13.513355+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:25.565097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.520665+0000","last_change":"2023-09-30T22:59:13.520578+0000","last_active":"2023-09-30T22:59:13.520665+0000","last_peered":"2023-09-30T22:59:13.520665+0000","last_clean":"2023-09-30T22:59:13.520665+0000","last_became_active":"2023-09-30T22:59:13.520058+0000","last_became_peered":"2023-09-30T22:59:13.520058+0000","last_unstale":"2023-09-30T22:59:13.520665+0000","last_undegraded":"2023-09-30T22:59:13.520665+0000","last_fullsized":"2023-09-30T22:59:13.520665+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:18:52.469357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517023+0000","last_change":"2023-09-30T22:59:13.516726+0000","last_active":"2023-09-30T22:59:13.517023+0000","last_peered":"2023-09-30T22:59:13.517023+0000","last_clean":"2023-09-30T22:59:13.517023+0000","last_became_active":"2023-09-30T22:59:13.515490+0000","last_became_peered":"2023-09-30T22:59:13.515490+0000","last_unstale":"2023-09-30T22:59:13.517023+0000","last_undegraded":"2023-09-30T22:59:13.517023+0000","last_fullsized":"2023-09-30T22:59:13.517023+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:57:20.573018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.512725+0000","last_change":"2023-09-30T22:59:13.512255+0000","last_active":"2023-09-30T22:59:13.512725+0000","last_peered":"2023-09-30T22:59:13.512725+0000","last_clean":"2023-09-30T22:59:13.512725+0000","last_became_active":"2023-09-30T22:59:13.511919+0000","last_became_peered":"2023-09-30T22:59:13.511919+0000","last_unstale":"2023-09-30T22:59:13.512725+0000","last_undegraded":"2023-09-30T22:59:13.512725+0000","last_fullsized":"2023-09-30T22:59:13.512725+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:56:31.848337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.521573+0000","last_change":"2023-09-30T22:59:13.521486+0000","last_active":"2023-09-30T22:59:13.521573+0000","last_peered":"2023-09-30T22:59:13.521573+0000","last_clean":"2023-09-30T22:59:13.521573+0000","last_became_active":"2023-09-30T22:59:13.521223+0000","last_became_peered":"2023-09-30T22:59:13.521223+0000","last_unstale":"2023-09-30T22:59:13.521573+0000","last_undegraded":"2023-09-30T22:59:13.521573+0000","last_fullsized":"2023-09-30T22:59:13.521573+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:24:24.522359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.516559+0000","last_change":"2023-09-30T22:59:13.516474+0000","last_active":"2023-09-30T22:59:13.516559+0000","last_peered":"2023-09-30T22:59:13.516559+0000","last_clean":"2023-09-30T22:59:13.516559+0000","last_became_active":"2023-09-30T22:59:13.515736+0000","last_became_peered":"2023-09-30T22:59:13.515736+0000","last_unstale":"2023-09-30T22:59:13.516559+0000","last_undegraded":"2023-09-30T22:59:13.516559+0000","last_fullsized":"2023-09-30T22:59:13.516559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:34.443589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.510538+0000","last_change":"2023-09-30T22:59:13.510475+0000","last_active":"2023-09-30T22:59:13.510538+0000","last_peered":"2023-09-30T22:59:13.510538+0000","last_clean":"2023-09-30T22:59:13.510538+0000","last_became_active":"2023-09-30T22:59:13.510188+0000","last_became_peered":"2023-09-30T22:59:13.510188+0000","last_unstale":"2023-09-30T22:59:13.510538+0000","last_undegraded":"2023-09-30T22:59:13.510538+0000","last_fullsized":"2023-09-30T22:59:13.510538+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:49:48.736366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.520544+0000","last_change":"2023-09-30T22:59:13.520126+0000","last_active":"2023-09-30T22:59:13.520544+0000","last_peered":"2023-09-30T22:59:13.520544+0000","last_clean":"2023-09-30T22:59:13.520544+0000","last_became_active":"2023-09-30T22:59:13.519906+0000","last_became_peered":"2023-09-30T22:59:13.519906+0000","last_unstale":"2023-09-30T22:59:13.520544+0000","last_undegraded":"2023-09-30T22:59:13.520544+0000","last_fullsized":"2023-09-30T22:59:13.520544+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:15:12.191626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.514596+0000","last_change":"2023-09-30T22:59:13.513924+0000","last_active":"2023-09-30T22:59:13.514596+0000","last_peered":"2023-09-30T22:59:13.514596+0000","last_clean":"2023-09-30T22:59:13.514596+0000","last_became_active":"2023-09-30T22:59:13.513690+0000","last_became_peered":"2023-09-30T22:59:13.513690+0000","last_unstale":"2023-09-30T22:59:13.514596+0000","last_undegraded":"2023-09-30T22:59:13.514596+0000","last_fullsized":"2023-09-30T22:59:13.514596+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:29:02.957659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"143'4","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.528071+0000","last_change":"2023-09-30T22:59:12.517330+0000","last_active":"2023-09-30T22:59:13.528071+0000","last_peered":"2023-09-30T22:59:13.528071+0000","last_clean":"2023-09-30T22:59:13.528071+0000","last_became_active":"2023-09-30T22:59:12.517050+0000","last_became_peered":"2023-09-30T22:59:12.517050+0000","last_unstale":"2023-09-30T22:59:13.528071+0000","last_undegraded":"2023-09-30T22:59:13.528071+0000","last_fullsized":"2023-09-30T22:59:13.528071+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:35.309566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518993+0000","last_change":"2023-09-30T22:59:13.518765+0000","last_active":"2023-09-30T22:59:13.518993+0000","last_peered":"2023-09-30T22:59:13.518993+0000","last_clean":"2023-09-30T22:59:13.518993+0000","last_became_active":"2023-09-30T22:59:13.518497+0000","last_became_peered":"2023-09-30T22:59:13.518497+0000","last_unstale":"2023-09-30T22:59:13.518993+0000","last_undegraded":"2023-09-30T22:59:13.518993+0000","last_fullsized":"2023-09-30T22:59:13.518993+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:10:31.494675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.531749+0000","last_change":"2023-09-30T22:59:12.517315+0000","last_active":"2023-09-30T22:59:13.531749+0000","last_peered":"2023-09-30T22:59:13.531749+0000","last_clean":"2023-09-30T22:59:13.531749+0000","last_became_active":"2023-09-30T22:59:12.516933+0000","last_became_peered":"2023-09-30T22:59:12.516933+0000","last_unstale":"2023-09-30T22:59:13.531749+0000","last_undegraded":"2023-09-30T22:59:13.531749+0000","last_fullsized":"2023-09-30T22:59:13.531749+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:24:23.513674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.514097+0000","last_change":"2023-09-30T22:59:13.514033+0000","last_active":"2023-09-30T22:59:13.514097+0000","last_peered":"2023-09-30T22:59:13.514097+0000","last_clean":"2023-09-30T22:59:13.514097+0000","last_became_active":"2023-09-30T22:59:13.513774+0000","last_became_peered":"2023-09-30T22:59:13.513774+0000","last_unstale":"2023-09-30T22:59:13.514097+0000","last_undegraded":"2023-09-30T22:59:13.514097+0000","last_fullsized":"2023-09-30T22:59:13.514097+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:49:36.863788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.525980+0000","last_change":"2023-09-30T22:59:12.522152+0000","last_active":"2023-09-30T22:59:13.525980+0000","last_peered":"2023-09-30T22:59:13.525980+0000","last_clean":"2023-09-30T22:59:13.525980+0000","last_became_active":"2023-09-30T22:59:12.521844+0000","last_became_peered":"2023-09-30T22:59:12.521844+0000","last_unstale":"2023-09-30T22:59:13.525980+0000","last_undegraded":"2023-09-30T22:59:13.525980+0000","last_fullsized":"2023-09-30T22:59:13.525980+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:05:51.165196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.527230+0000","last_change":"2023-09-30T22:59:13.527163+0000","last_active":"2023-09-30T22:59:13.527230+0000","last_peered":"2023-09-30T22:59:13.527230+0000","last_clean":"2023-09-30T22:59:13.527230+0000","last_became_active":"2023-09-30T22:59:13.525790+0000","last_became_peered":"2023-09-30T22:59:13.525790+0000","last_unstale":"2023-09-30T22:59:13.527230+0000","last_undegraded":"2023-09-30T22:59:13.527230+0000","last_fullsized":"2023-09-30T22:59:13.527230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:28.682362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.525935+0000","last_change":"2023-09-30T22:59:12.513452+0000","last_active":"2023-09-30T22:59:13.525935+0000","last_peered":"2023-09-30T22:59:13.525935+0000","last_clean":"2023-09-30T22:59:13.525935+0000","last_became_active":"2023-09-30T22:59:12.513221+0000","last_became_peered":"2023-09-30T22:59:12.513221+0000","last_unstale":"2023-09-30T22:59:13.525935+0000","last_undegraded":"2023-09-30T22:59:13.525935+0000","last_fullsized":"2023-09-30T22:59:13.525935+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:53:04.386812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517710+0000","last_change":"2023-09-30T22:59:13.517003+0000","last_active":"2023-09-30T22:59:13.517710+0000","last_peered":"2023-09-30T22:59:13.517710+0000","last_clean":"2023-09-30T22:59:13.517710+0000","last_became_active":"2023-09-30T22:59:13.516759+0000","last_became_peered":"2023-09-30T22:59:13.516759+0000","last_unstale":"2023-09-30T22:59:13.517710+0000","last_undegraded":"2023-09-30T22:59:13.517710+0000","last_fullsized":"2023-09-30T22:59:13.517710+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:11.702252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.526614+0000","last_change":"2023-09-30T22:59:12.515199+0000","last_active":"2023-09-30T22:59:13.526614+0000","last_peered":"2023-09-30T22:59:13.526614+0000","last_clean":"2023-09-30T22:59:13.526614+0000","last_became_active":"2023-09-30T22:59:12.514950+0000","last_became_peered":"2023-09-30T22:59:12.514950+0000","last_unstale":"2023-09-30T22:59:13.526614+0000","last_undegraded":"2023-09-30T22:59:13.526614+0000","last_fullsized":"2023-09-30T22:59:13.526614+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:07:34.893641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.521294+0000","last_change":"2023-09-30T22:59:13.521230+0000","last_active":"2023-09-30T22:59:13.521294+0000","last_peered":"2023-09-30T22:59:13.521294+0000","last_clean":"2023-09-30T22:59:13.521294+0000","last_became_active":"2023-09-30T22:59:13.521018+0000","last_became_peered":"2023-09-30T22:59:13.521018+0000","last_unstale":"2023-09-30T22:59:13.521294+0000","last_undegraded":"2023-09-30T22:59:13.521294+0000","last_fullsized":"2023-09-30T22:59:13.521294+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:55:33.781137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.531825+0000","last_change":"2023-09-30T22:59:12.523609+0000","last_active":"2023-09-30T22:59:13.531825+0000","last_peered":"2023-09-30T22:59:13.531825+0000","last_clean":"2023-09-30T22:59:13.531825+0000","last_became_active":"2023-09-30T22:59:12.523387+0000","last_became_peered":"2023-09-30T22:59:12.523387+0000","last_unstale":"2023-09-30T22:59:13.531825+0000","last_undegraded":"2023-09-30T22:59:13.531825+0000","last_fullsized":"2023-09-30T22:59:13.531825+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:53.560431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.514855+0000","last_change":"2023-09-30T22:59:13.514517+0000","last_active":"2023-09-30T22:59:13.514855+0000","last_peered":"2023-09-30T22:59:13.514855+0000","last_clean":"2023-09-30T22:59:13.514855+0000","last_became_active":"2023-09-30T22:59:13.514297+0000","last_became_peered":"2023-09-30T22:59:13.514297+0000","last_unstale":"2023-09-30T22:59:13.514855+0000","last_undegraded":"2023-09-30T22:59:13.514855+0000","last_fullsized":"2023-09-30T22:59:13.514855+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:32:55.577778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.507250+0000","last_change":"2023-09-30T22:59:12.520392+0000","last_active":"2023-09-30T22:59:13.507250+0000","last_peered":"2023-09-30T22:59:13.507250+0000","last_clean":"2023-09-30T22:59:13.507250+0000","last_became_active":"2023-09-30T22:59:12.520131+0000","last_became_peered":"2023-09-30T22:59:12.520131+0000","last_unstale":"2023-09-30T22:59:13.507250+0000","last_undegraded":"2023-09-30T22:59:13.507250+0000","last_fullsized":"2023-09-30T22:59:13.507250+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:37.302129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.520134+0000","last_change":"2023-09-30T22:59:13.519970+0000","last_active":"2023-09-30T22:59:13.520134+0000","last_peered":"2023-09-30T22:59:13.520134+0000","last_clean":"2023-09-30T22:59:13.520134+0000","last_became_active":"2023-09-30T22:59:13.519742+0000","last_became_peered":"2023-09-30T22:59:13.519742+0000","last_unstale":"2023-09-30T22:59:13.520134+0000","last_undegraded":"2023-09-30T22:59:13.520134+0000","last_fullsized":"2023-09-30T22:59:13.520134+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:40:56.024976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.511193+0000","last_change":"2023-09-30T22:59:12.519642+0000","last_active":"2023-09-30T22:59:13.511193+0000","last_peered":"2023-09-30T22:59:13.511193+0000","last_clean":"2023-09-30T22:59:13.511193+0000","last_became_active":"2023-09-30T22:59:12.519067+0000","last_became_peered":"2023-09-30T22:59:12.519067+0000","last_unstale":"2023-09-30T22:59:13.511193+0000","last_undegraded":"2023-09-30T22:59:13.511193+0000","last_fullsized":"2023-09-30T22:59:13.511193+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:55:31.001613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.527929+0000","last_change":"2023-09-30T22:59:13.527723+0000","last_active":"2023-09-30T22:59:13.527929+0000","last_peered":"2023-09-30T22:59:13.527929+0000","last_clean":"2023-09-30T22:59:13.527929+0000","last_became_active":"2023-09-30T22:59:13.527389+0000","last_became_peered":"2023-09-30T22:59:13.527389+0000","last_unstale":"2023-09-30T22:59:13.527929+0000","last_undegraded":"2023-09-30T22:59:13.527929+0000","last_fullsized":"2023-09-30T22:59:13.527929+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:21:53.705436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.531652+0000","last_change":"2023-09-30T22:59:12.517172+0000","last_active":"2023-09-30T22:59:13.531652+0000","last_peered":"2023-09-30T22:59:13.531652+0000","last_clean":"2023-09-30T22:59:13.531652+0000","last_became_active":"2023-09-30T22:59:12.516642+0000","last_became_peered":"2023-09-30T22:59:12.516642+0000","last_unstale":"2023-09-30T22:59:13.531652+0000","last_undegraded":"2023-09-30T22:59:13.531652+0000","last_fullsized":"2023-09-30T22:59:13.531652+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:32:54.569093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518208+0000","last_change":"2023-09-30T22:59:13.518000+0000","last_active":"2023-09-30T22:59:13.518208+0000","last_peered":"2023-09-30T22:59:13.518208+0000","last_clean":"2023-09-30T22:59:13.518208+0000","last_became_active":"2023-09-30T22:59:13.517467+0000","last_became_peered":"2023-09-30T22:59:13.517467+0000","last_unstale":"2023-09-30T22:59:13.518208+0000","last_undegraded":"2023-09-30T22:59:13.518208+0000","last_fullsized":"2023-09-30T22:59:13.518208+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:28.144953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.529759+0000","last_change":"2023-09-30T22:59:12.518990+0000","last_active":"2023-09-30T22:59:13.529759+0000","last_peered":"2023-09-30T22:59:13.529759+0000","last_clean":"2023-09-30T22:59:13.529759+0000","last_became_active":"2023-09-30T22:59:12.518252+0000","last_became_peered":"2023-09-30T22:59:12.518252+0000","last_unstale":"2023-09-30T22:59:13.529759+0000","last_undegraded":"2023-09-30T22:59:13.529759+0000","last_fullsized":"2023-09-30T22:59:13.529759+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:36.291696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517106+0000","last_change":"2023-09-30T22:59:13.516881+0000","last_active":"2023-09-30T22:59:13.517106+0000","last_peered":"2023-09-30T22:59:13.517106+0000","last_clean":"2023-09-30T22:59:13.517106+0000","last_became_active":"2023-09-30T22:59:13.516665+0000","last_became_peered":"2023-09-30T22:59:13.516665+0000","last_unstale":"2023-09-30T22:59:13.517106+0000","last_undegraded":"2023-09-30T22:59:13.517106+0000","last_fullsized":"2023-09-30T22:59:13.517106+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:06.662817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.526381+0000","last_change":"2023-09-30T22:59:12.513633+0000","last_active":"2023-09-30T22:59:13.526381+0000","last_peered":"2023-09-30T22:59:13.526381+0000","last_clean":"2023-09-30T22:59:13.526381+0000","last_became_active":"2023-09-30T22:59:12.513374+0000","last_became_peered":"2023-09-30T22:59:12.513374+0000","last_unstale":"2023-09-30T22:59:13.526381+0000","last_undegraded":"2023-09-30T22:59:13.526381+0000","last_fullsized":"2023-09-30T22:59:13.526381+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:40.155633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.521107+0000","last_change":"2023-09-30T22:59:13.517063+0000","last_active":"2023-09-30T22:59:13.521107+0000","last_peered":"2023-09-30T22:59:13.521107+0000","last_clean":"2023-09-30T22:59:13.521107+0000","last_became_active":"2023-09-30T22:59:13.516778+0000","last_became_peered":"2023-09-30T22:59:13.516778+0000","last_unstale":"2023-09-30T22:59:13.521107+0000","last_undegraded":"2023-09-30T22:59:13.521107+0000","last_fullsized":"2023-09-30T22:59:13.521107+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:53:30.964161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.508040+0000","last_change":"2023-09-30T22:59:12.518032+0000","last_active":"2023-09-30T22:59:13.508040+0000","last_peered":"2023-09-30T22:59:13.508040+0000","last_clean":"2023-09-30T22:59:13.508040+0000","last_became_active":"2023-09-30T22:59:12.517808+0000","last_became_peered":"2023-09-30T22:59:12.517808+0000","last_unstale":"2023-09-30T22:59:13.508040+0000","last_undegraded":"2023-09-30T22:59:13.508040+0000","last_fullsized":"2023-09-30T22:59:13.508040+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:48.761216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518978+0000","last_change":"2023-09-30T22:59:13.518038+0000","last_active":"2023-09-30T22:59:13.518978+0000","last_peered":"2023-09-30T22:59:13.518978+0000","last_clean":"2023-09-30T22:59:13.518978+0000","last_became_active":"2023-09-30T22:59:13.517785+0000","last_became_peered":"2023-09-30T22:59:13.517785+0000","last_unstale":"2023-09-30T22:59:13.518978+0000","last_undegraded":"2023-09-30T22:59:13.518978+0000","last_fullsized":"2023-09-30T22:59:13.518978+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:17:01.257493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.529760+0000","last_change":"2023-09-30T22:59:12.521360+0000","last_active":"2023-09-30T22:59:13.529760+0000","last_peered":"2023-09-30T22:59:13.529760+0000","last_clean":"2023-09-30T22:59:13.529760+0000","last_became_active":"2023-09-30T22:59:12.520861+0000","last_became_peered":"2023-09-30T22:59:12.520861+0000","last_unstale":"2023-09-30T22:59:13.529760+0000","last_undegraded":"2023-09-30T22:59:13.529760+0000","last_fullsized":"2023-09-30T22:59:13.529760+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:53:29.955476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518958+0000","last_change":"2023-09-30T22:59:13.515683+0000","last_active":"2023-09-30T22:59:13.518958+0000","last_peered":"2023-09-30T22:59:13.518958+0000","last_clean":"2023-09-30T22:59:13.518958+0000","last_became_active":"2023-09-30T22:59:13.515037+0000","last_became_peered":"2023-09-30T22:59:13.515037+0000","last_unstale":"2023-09-30T22:59:13.518958+0000","last_undegraded":"2023-09-30T22:59:13.518958+0000","last_fullsized":"2023-09-30T22:59:13.518958+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:30.724192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.513340+0000","last_change":"2023-09-30T22:59:12.522311+0000","last_active":"2023-09-30T22:59:13.513340+0000","last_peered":"2023-09-30T22:59:13.513340+0000","last_clean":"2023-09-30T22:59:13.513340+0000","last_became_active":"2023-09-30T22:59:12.522043+0000","last_became_peered":"2023-09-30T22:59:12.522043+0000","last_unstale":"2023-09-30T22:59:13.513340+0000","last_undegraded":"2023-09-30T22:59:13.513340+0000","last_fullsized":"2023-09-30T22:59:13.513340+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:04:00.188191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.514821+0000","last_change":"2023-09-30T22:59:13.514055+0000","last_active":"2023-09-30T22:59:13.514821+0000","last_peered":"2023-09-30T22:59:13.514821+0000","last_clean":"2023-09-30T22:59:13.514821+0000","last_became_active":"2023-09-30T22:59:13.513763+0000","last_became_peered":"2023-09-30T22:59:13.513763+0000","last_unstale":"2023-09-30T22:59:13.514821+0000","last_undegraded":"2023-09-30T22:59:13.514821+0000","last_fullsized":"2023-09-30T22:59:13.514821+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:38.339368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.511280+0000","last_change":"2023-09-30T22:59:12.519878+0000","last_active":"2023-09-30T22:59:13.511280+0000","last_peered":"2023-09-30T22:59:13.511280+0000","last_clean":"2023-09-30T22:59:13.511280+0000","last_became_active":"2023-09-30T22:59:12.519369+0000","last_became_peered":"2023-09-30T22:59:12.519369+0000","last_unstale":"2023-09-30T22:59:13.511280+0000","last_undegraded":"2023-09-30T22:59:13.511280+0000","last_fullsized":"2023-09-30T22:59:13.511280+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:40:36.318760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517272+0000","last_change":"2023-09-30T22:59:13.517205+0000","last_active":"2023-09-30T22:59:13.517272+0000","last_peered":"2023-09-30T22:59:13.517272+0000","last_clean":"2023-09-30T22:59:13.517272+0000","last_became_active":"2023-09-30T22:59:13.516953+0000","last_became_peered":"2023-09-30T22:59:13.516953+0000","last_unstale":"2023-09-30T22:59:13.517272+0000","last_undegraded":"2023-09-30T22:59:13.517272+0000","last_fullsized":"2023-09-30T22:59:13.517272+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:01:07.735475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.509836+0000","last_change":"2023-09-30T22:59:12.510247+0000","last_active":"2023-09-30T22:59:13.509836+0000","last_peered":"2023-09-30T22:59:13.509836+0000","last_clean":"2023-09-30T22:59:13.509836+0000","last_became_active":"2023-09-30T22:59:12.508945+0000","last_became_peered":"2023-09-30T22:59:12.508945+0000","last_unstale":"2023-09-30T22:59:13.509836+0000","last_undegraded":"2023-09-30T22:59:13.509836+0000","last_fullsized":"2023-09-30T22:59:13.509836+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:33:01.482961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.519070+0000","last_change":"2023-09-30T22:59:13.518417+0000","last_active":"2023-09-30T22:59:13.519070+0000","last_peered":"2023-09-30T22:59:13.519070+0000","last_clean":"2023-09-30T22:59:13.519070+0000","last_became_active":"2023-09-30T22:59:13.518183+0000","last_became_peered":"2023-09-30T22:59:13.518183+0000","last_unstale":"2023-09-30T22:59:13.519070+0000","last_undegraded":"2023-09-30T22:59:13.519070+0000","last_fullsized":"2023-09-30T22:59:13.519070+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:51.896332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.528782+0000","last_change":"2023-09-30T22:59:12.521539+0000","last_active":"2023-09-30T22:59:13.528782+0000","last_peered":"2023-09-30T22:59:13.528782+0000","last_clean":"2023-09-30T22:59:13.528782+0000","last_became_active":"2023-09-30T22:59:12.521302+0000","last_became_peered":"2023-09-30T22:59:12.521302+0000","last_unstale":"2023-09-30T22:59:13.528782+0000","last_undegraded":"2023-09-30T22:59:13.528782+0000","last_fullsized":"2023-09-30T22:59:13.528782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:36:34.025381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.516732+0000","last_change":"2023-09-30T22:59:13.516656+0000","last_active":"2023-09-30T22:59:13.516732+0000","last_peered":"2023-09-30T22:59:13.516732+0000","last_clean":"2023-09-30T22:59:13.516732+0000","last_became_active":"2023-09-30T22:59:13.516403+0000","last_became_peered":"2023-09-30T22:59:13.516403+0000","last_unstale":"2023-09-30T22:59:13.516732+0000","last_undegraded":"2023-09-30T22:59:13.516732+0000","last_fullsized":"2023-09-30T22:59:13.516732+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:50.832618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.509577+0000","last_change":"2023-09-30T22:59:12.507521+0000","last_active":"2023-09-30T22:59:13.509577+0000","last_peered":"2023-09-30T22:59:13.509577+0000","last_clean":"2023-09-30T22:59:13.509577+0000","last_became_active":"2023-09-30T22:59:12.507199+0000","last_became_peered":"2023-09-30T22:59:12.507199+0000","last_unstale":"2023-09-30T22:59:13.509577+0000","last_undegraded":"2023-09-30T22:59:13.509577+0000","last_fullsized":"2023-09-30T22:59:13.509577+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:31:45.809369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.527013+0000","last_change":"2023-09-30T22:59:13.526008+0000","last_active":"2023-09-30T22:59:13.527013+0000","last_peered":"2023-09-30T22:59:13.527013+0000","last_clean":"2023-09-30T22:59:13.527013+0000","last_became_active":"2023-09-30T22:59:13.523380+0000","last_became_peered":"2023-09-30T22:59:13.523380+0000","last_unstale":"2023-09-30T22:59:13.527013+0000","last_undegraded":"2023-09-30T22:59:13.527013+0000","last_fullsized":"2023-09-30T22:59:13.527013+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:14:38.686282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.507377+0000","last_change":"2023-09-30T22:59:12.515151+0000","last_active":"2023-09-30T22:59:13.507377+0000","last_peered":"2023-09-30T22:59:13.507377+0000","last_clean":"2023-09-30T22:59:13.507377+0000","last_became_active":"2023-09-30T22:59:12.514856+0000","last_became_peered":"2023-09-30T22:59:12.514856+0000","last_unstale":"2023-09-30T22:59:13.507377+0000","last_undegraded":"2023-09-30T22:59:13.507377+0000","last_fullsized":"2023-09-30T22:59:13.507377+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:39:49.467357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.514839+0000","last_change":"2023-09-30T22:59:13.514119+0000","last_active":"2023-09-30T22:59:13.514839+0000","last_peered":"2023-09-30T22:59:13.514839+0000","last_clean":"2023-09-30T22:59:13.514839+0000","last_became_active":"2023-09-30T22:59:13.513816+0000","last_became_peered":"2023-09-30T22:59:13.513816+0000","last_unstale":"2023-09-30T22:59:13.514839+0000","last_undegraded":"2023-09-30T22:59:13.514839+0000","last_fullsized":"2023-09-30T22:59:13.514839+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:53:30.964161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.507566+0000","last_change":"2023-09-30T22:59:12.516793+0000","last_active":"2023-09-30T22:59:13.507566+0000","last_peered":"2023-09-30T22:59:13.507566+0000","last_clean":"2023-09-30T22:59:13.507566+0000","last_became_active":"2023-09-30T22:59:12.516585+0000","last_became_peered":"2023-09-30T22:59:12.516585+0000","last_unstale":"2023-09-30T22:59:13.507566+0000","last_undegraded":"2023-09-30T22:59:13.507566+0000","last_fullsized":"2023-09-30T22:59:13.507566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:33.434904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522383+0000","last_change":"2023-09-30T22:59:13.522255+0000","last_active":"2023-09-30T22:59:13.522383+0000","last_peered":"2023-09-30T22:59:13.522383+0000","last_clean":"2023-09-30T22:59:13.522383+0000","last_became_active":"2023-09-30T22:59:13.522031+0000","last_became_peered":"2023-09-30T22:59:13.522031+0000","last_unstale":"2023-09-30T22:59:13.522383+0000","last_undegraded":"2023-09-30T22:59:13.522383+0000","last_fullsized":"2023-09-30T22:59:13.522383+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:58:53.262691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.509924+0000","last_change":"2023-09-30T22:59:12.510403+0000","last_active":"2023-09-30T22:59:13.509924+0000","last_peered":"2023-09-30T22:59:13.509924+0000","last_clean":"2023-09-30T22:59:13.509924+0000","last_became_active":"2023-09-30T22:59:12.510013+0000","last_became_peered":"2023-09-30T22:59:12.510013+0000","last_unstale":"2023-09-30T22:59:13.509924+0000","last_undegraded":"2023-09-30T22:59:13.509924+0000","last_fullsized":"2023-09-30T22:59:13.509924+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:35.483828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522253+0000","last_change":"2023-09-30T22:59:13.522147+0000","last_active":"2023-09-30T22:59:13.522253+0000","last_peered":"2023-09-30T22:59:13.522253+0000","last_clean":"2023-09-30T22:59:13.522253+0000","last_became_active":"2023-09-30T22:59:13.521885+0000","last_became_peered":"2023-09-30T22:59:13.521885+0000","last_unstale":"2023-09-30T22:59:13.522253+0000","last_undegraded":"2023-09-30T22:59:13.522253+0000","last_fullsized":"2023-09-30T22:59:13.522253+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:28.682362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.513944+0000","last_change":"2023-09-30T22:59:12.516173+0000","last_active":"2023-09-30T22:59:13.513944+0000","last_peered":"2023-09-30T22:59:13.513944+0000","last_clean":"2023-09-30T22:59:13.513944+0000","last_became_active":"2023-09-30T22:59:12.515934+0000","last_became_peered":"2023-09-30T22:59:12.515934+0000","last_unstale":"2023-09-30T22:59:13.513944+0000","last_undegraded":"2023-09-30T22:59:13.513944+0000","last_fullsized":"2023-09-30T22:59:13.513944+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:10:30.485990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517053+0000","last_change":"2023-09-30T22:59:13.516880+0000","last_active":"2023-09-30T22:59:13.517053+0000","last_peered":"2023-09-30T22:59:13.517053+0000","last_clean":"2023-09-30T22:59:13.517053+0000","last_became_active":"2023-09-30T22:59:13.515797+0000","last_became_peered":"2023-09-30T22:59:13.515797+0000","last_unstale":"2023-09-30T22:59:13.517053+0000","last_undegraded":"2023-09-30T22:59:13.517053+0000","last_fullsized":"2023-09-30T22:59:13.517053+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:29:09.002776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.515117+0000","last_change":"2023-09-30T22:59:12.520530+0000","last_active":"2023-09-30T22:59:13.515117+0000","last_peered":"2023-09-30T22:59:13.515117+0000","last_clean":"2023-09-30T22:59:13.515117+0000","last_became_active":"2023-09-30T22:59:12.520056+0000","last_became_peered":"2023-09-30T22:59:12.520056+0000","last_unstale":"2023-09-30T22:59:13.515117+0000","last_undegraded":"2023-09-30T22:59:13.515117+0000","last_fullsized":"2023-09-30T22:59:13.515117+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:28:31.534876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.524858+0000","last_change":"2023-09-30T22:59:13.524784+0000","last_active":"2023-09-30T22:59:13.524858+0000","last_peered":"2023-09-30T22:59:13.524858+0000","last_clean":"2023-09-30T22:59:13.524858+0000","last_became_active":"2023-09-30T22:59:13.524486+0000","last_became_peered":"2023-09-30T22:59:13.524486+0000","last_unstale":"2023-09-30T22:59:13.524858+0000","last_undegraded":"2023-09-30T22:59:13.524858+0000","last_fullsized":"2023-09-30T22:59:13.524858+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:27.088226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.507464+0000","last_change":"2023-09-30T22:59:12.520921+0000","last_active":"2023-09-30T22:59:13.507464+0000","last_peered":"2023-09-30T22:59:13.507464+0000","last_clean":"2023-09-30T22:59:13.507464+0000","last_became_active":"2023-09-30T22:59:12.520680+0000","last_became_peered":"2023-09-30T22:59:12.520680+0000","last_unstale":"2023-09-30T22:59:13.507464+0000","last_undegraded":"2023-09-30T22:59:13.507464+0000","last_fullsized":"2023-09-30T22:59:13.507464+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:26:35.674779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522235+0000","last_change":"2023-09-30T22:59:13.521679+0000","last_active":"2023-09-30T22:59:13.522235+0000","last_peered":"2023-09-30T22:59:13.522235+0000","last_clean":"2023-09-30T22:59:13.522235+0000","last_became_active":"2023-09-30T22:59:13.521130+0000","last_became_peered":"2023-09-30T22:59:13.521130+0000","last_unstale":"2023-09-30T22:59:13.522235+0000","last_undegraded":"2023-09-30T22:59:13.522235+0000","last_fullsized":"2023-09-30T22:59:13.522235+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:11:05.562904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.518242+0000","last_change":"2023-09-30T22:59:12.518311+0000","last_active":"2023-09-30T22:59:13.518242+0000","last_peered":"2023-09-30T22:59:13.518242+0000","last_clean":"2023-09-30T22:59:13.518242+0000","last_became_active":"2023-09-30T22:59:12.518074+0000","last_became_peered":"2023-09-30T22:59:12.518074+0000","last_unstale":"2023-09-30T22:59:13.518242+0000","last_undegraded":"2023-09-30T22:59:13.518242+0000","last_fullsized":"2023-09-30T22:59:13.518242+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:37.330683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.514377+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:59:13.514377+0000","last_peered":"2023-09-30T22:59:13.514377+0000","last_clean":"2023-09-30T22:59:13.514377+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:59:13.514377+0000","last_undegraded":"2023-09-30T22:59:13.514377+0000","last_fullsized":"2023-09-30T22:59:13.514377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.522348+0000","last_change":"2023-09-30T22:59:13.522113+0000","last_active":"2023-09-30T22:59:13.522348+0000","last_peered":"2023-09-30T22:59:13.522348+0000","last_clean":"2023-09-30T22:59:13.522348+0000","last_became_active":"2023-09-30T22:59:13.521872+0000","last_became_peered":"2023-09-30T22:59:13.521872+0000","last_unstale":"2023-09-30T22:59:13.522348+0000","last_undegraded":"2023-09-30T22:59:13.522348+0000","last_fullsized":"2023-09-30T22:59:13.522348+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:32:41.672108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.519443+0000","last_change":"2023-09-30T22:59:12.518035+0000","last_active":"2023-09-30T22:59:13.519443+0000","last_peered":"2023-09-30T22:59:13.519443+0000","last_clean":"2023-09-30T22:59:13.519443+0000","last_became_active":"2023-09-30T22:59:12.517472+0000","last_became_peered":"2023-09-30T22:59:12.517472+0000","last_unstale":"2023-09-30T22:59:13.519443+0000","last_undegraded":"2023-09-30T22:59:13.519443+0000","last_fullsized":"2023-09-30T22:59:13.519443+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:03:58.696028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.508186+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:59:13.508186+0000","last_peered":"2023-09-30T22:59:13.508186+0000","last_clean":"2023-09-30T22:59:13.508186+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:59:13.508186+0000","last_undegraded":"2023-09-30T22:59:13.508186+0000","last_fullsized":"2023-09-30T22:59:13.508186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.519489+0000","last_change":"2023-09-30T22:59:13.519418+0000","last_active":"2023-09-30T22:59:13.519489+0000","last_peered":"2023-09-30T22:59:13.519489+0000","last_clean":"2023-09-30T22:59:13.519489+0000","last_became_active":"2023-09-30T22:59:13.519181+0000","last_became_peered":"2023-09-30T22:59:13.519181+0000","last_unstale":"2023-09-30T22:59:13.519489+0000","last_undegraded":"2023-09-30T22:59:13.519489+0000","last_fullsized":"2023-09-30T22:59:13.519489+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:28:08.766077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.509845+0000","last_change":"2023-09-30T22:59:12.522184+0000","last_active":"2023-09-30T22:59:13.509845+0000","last_peered":"2023-09-30T22:59:13.509845+0000","last_clean":"2023-09-30T22:59:13.509845+0000","last_became_active":"2023-09-30T22:59:12.521805+0000","last_became_peered":"2023-09-30T22:59:12.521805+0000","last_unstale":"2023-09-30T22:59:13.509845+0000","last_undegraded":"2023-09-30T22:59:13.509845+0000","last_fullsized":"2023-09-30T22:59:13.509845+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:48:02.403269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.511025+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:59:13.511025+0000","last_peered":"2023-09-30T22:59:13.511025+0000","last_clean":"2023-09-30T22:59:13.511025+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:59:13.511025+0000","last_undegraded":"2023-09-30T22:59:13.511025+0000","last_fullsized":"2023-09-30T22:59:13.511025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.516185+0000","last_change":"2023-09-30T22:59:13.515709+0000","last_active":"2023-09-30T22:59:13.516185+0000","last_peered":"2023-09-30T22:59:13.516185+0000","last_clean":"2023-09-30T22:59:13.516185+0000","last_became_active":"2023-09-30T22:59:13.515473+0000","last_became_peered":"2023-09-30T22:59:13.515473+0000","last_unstale":"2023-09-30T22:59:13.516185+0000","last_undegraded":"2023-09-30T22:59:13.516185+0000","last_fullsized":"2023-09-30T22:59:13.516185+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:11:16.991208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"143'8","reported_seq":18,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.531777+0000","last_change":"2023-09-30T22:59:12.516871+0000","last_active":"2023-09-30T22:59:13.531777+0000","last_peered":"2023-09-30T22:59:13.531777+0000","last_clean":"2023-09-30T22:59:13.531777+0000","last_became_active":"2023-09-30T22:59:12.516652+0000","last_became_peered":"2023-09-30T22:59:12.516652+0000","last_unstale":"2023-09-30T22:59:13.531777+0000","last_undegraded":"2023-09-30T22:59:13.531777+0000","last_fullsized":"2023-09-30T22:59:13.531777+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:59:30.457336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.508974+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:59:13.508974+0000","last_peered":"2023-09-30T22:59:13.508974+0000","last_clean":"2023-09-30T22:59:13.508974+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:59:13.508974+0000","last_undegraded":"2023-09-30T22:59:13.508974+0000","last_fullsized":"2023-09-30T22:59:13.508974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":275,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.513426+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:59:13.513426+0000","last_peered":"2023-09-30T22:59:13.513426+0000","last_clean":"2023-09-30T22:59:13.513426+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:59:13.513426+0000","last_undegraded":"2023-09-30T22:59:13.513426+0000","last_fullsized":"2023-09-30T22:59:13.513426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.516205+0000","last_change":"2023-09-30T22:59:13.516105+0000","last_active":"2023-09-30T22:59:13.516205+0000","last_peered":"2023-09-30T22:59:13.516205+0000","last_clean":"2023-09-30T22:59:13.516205+0000","last_became_active":"2023-09-30T22:59:13.515880+0000","last_became_peered":"2023-09-30T22:59:13.515880+0000","last_unstale":"2023-09-30T22:59:13.516205+0000","last_undegraded":"2023-09-30T22:59:13.516205+0000","last_fullsized":"2023-09-30T22:59:13.516205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:50.832618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.530843+0000","last_change":"2023-09-30T22:59:12.515513+0000","last_active":"2023-09-30T22:59:13.530843+0000","last_peered":"2023-09-30T22:59:13.530843+0000","last_clean":"2023-09-30T22:59:13.530843+0000","last_became_active":"2023-09-30T22:59:12.514995+0000","last_became_peered":"2023-09-30T22:59:12.514995+0000","last_unstale":"2023-09-30T22:59:13.530843+0000","last_undegraded":"2023-09-30T22:59:13.530843+0000","last_fullsized":"2023-09-30T22:59:13.530843+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:49:35.855103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.507408+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:59:13.507408+0000","last_peered":"2023-09-30T22:59:13.507408+0000","last_clean":"2023-09-30T22:59:13.507408+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:59:13.507408+0000","last_undegraded":"2023-09-30T22:59:13.507408+0000","last_fullsized":"2023-09-30T22:59:13.507408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.527214+0000","last_change":"2023-09-30T22:59:13.527024+0000","last_active":"2023-09-30T22:59:13.527214+0000","last_peered":"2023-09-30T22:59:13.527214+0000","last_clean":"2023-09-30T22:59:13.527214+0000","last_became_active":"2023-09-30T22:59:13.525404+0000","last_became_peered":"2023-09-30T22:59:13.525404+0000","last_unstale":"2023-09-30T22:59:13.527214+0000","last_undegraded":"2023-09-30T22:59:13.527214+0000","last_fullsized":"2023-09-30T22:59:13.527214+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:46:32.588741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.520449+0000","last_change":"2023-09-30T22:59:12.519022+0000","last_active":"2023-09-30T22:59:13.520449+0000","last_peered":"2023-09-30T22:59:13.520449+0000","last_clean":"2023-09-30T22:59:13.520449+0000","last_became_active":"2023-09-30T22:59:12.518815+0000","last_became_peered":"2023-09-30T22:59:12.518815+0000","last_unstale":"2023-09-30T22:59:13.520449+0000","last_undegraded":"2023-09-30T22:59:13.520449+0000","last_fullsized":"2023-09-30T22:59:13.520449+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:53:29.955476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.507332+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:59:13.507332+0000","last_peered":"2023-09-30T22:59:13.507332+0000","last_clean":"2023-09-30T22:59:13.507332+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:59:13.507332+0000","last_undegraded":"2023-09-30T22:59:13.507332+0000","last_fullsized":"2023-09-30T22:59:13.507332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517518+0000","last_change":"2023-09-30T22:59:13.517328+0000","last_active":"2023-09-30T22:59:13.517518+0000","last_peered":"2023-09-30T22:59:13.517518+0000","last_clean":"2023-09-30T22:59:13.517518+0000","last_became_active":"2023-09-30T22:59:13.516966+0000","last_became_peered":"2023-09-30T22:59:13.516966+0000","last_unstale":"2023-09-30T22:59:13.517518+0000","last_undegraded":"2023-09-30T22:59:13.517518+0000","last_fullsized":"2023-09-30T22:59:13.517518+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:17:37.300381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"143'3","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.527307+0000","last_change":"2023-09-30T22:59:12.514341+0000","last_active":"2023-09-30T22:59:13.527307+0000","last_peered":"2023-09-30T22:59:13.527307+0000","last_clean":"2023-09-30T22:59:13.527307+0000","last_became_active":"2023-09-30T22:59:12.514108+0000","last_became_peered":"2023-09-30T22:59:12.514108+0000","last_unstale":"2023-09-30T22:59:13.527307+0000","last_undegraded":"2023-09-30T22:59:13.527307+0000","last_fullsized":"2023-09-30T22:59:13.527307+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:23:09.049840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.509889+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:59:13.509889+0000","last_peered":"2023-09-30T22:59:13.509889+0000","last_clean":"2023-09-30T22:59:13.509889+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:59:13.509889+0000","last_undegraded":"2023-09-30T22:59:13.509889+0000","last_fullsized":"2023-09-30T22:59:13.509889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.517039+0000","last_change":"2023-09-30T22:59:13.516826+0000","last_active":"2023-09-30T22:59:13.517039+0000","last_peered":"2023-09-30T22:59:13.517039+0000","last_clean":"2023-09-30T22:59:13.517039+0000","last_became_active":"2023-09-30T22:59:13.516159+0000","last_became_peered":"2023-09-30T22:59:13.516159+0000","last_unstale":"2023-09-30T22:59:13.517039+0000","last_undegraded":"2023-09-30T22:59:13.517039+0000","last_fullsized":"2023-09-30T22:59:13.517039+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:12.495567+0000","last_clean_scrub_stamp":"2023-09-30T22:59:12.495567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:24:24.522359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"143'6","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.531159+0000","last_change":"2023-09-30T22:59:12.523068+0000","last_active":"2023-09-30T22:59:13.531159+0000","last_peered":"2023-09-30T22:59:13.531159+0000","last_clean":"2023-09-30T22:59:13.531159+0000","last_became_active":"2023-09-30T22:59:12.522829+0000","last_became_peered":"2023-09-30T22:59:12.522829+0000","last_unstale":"2023-09-30T22:59:13.531159+0000","last_undegraded":"2023-09-30T22:59:13.531159+0000","last_fullsized":"2023-09-30T22:59:13.531159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:59:11.486882+0000","last_clean_scrub_stamp":"2023-09-30T22:59:11.486882+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:37:35.377697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-09-30T22:59:13.508116+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:59:13.508116+0000","last_peered":"2023-09-30T22:59:13.508116+0000","last_clean":"2023-09-30T22:59:13.508116+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:59:13.508116+0000","last_undegraded":"2023-09-30T22:59:13.508116+0000","last_fullsized":"2023-09-30T22:59:13.508116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149406,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66300000000000003,"15min":0.63300000000000001},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76200000000000001,"5min":0.96599999999999997,"15min":1.0229999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89100000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66800000000000004,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.90400000000000003,"15min":0.91800000000000004},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70199999999999996,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.81699999999999995}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69399999999999995,"15min":0.67400000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73099999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83699999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71799999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78300000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.434},"max":{"1min":0.84199999999999997,"5min":1.056,"15min":1.056},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61799999999999999,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.623,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.78600000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65900000000000003,"15min":0.63100000000000001},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":1.135,"15min":1.135},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.004},"last":0.91900000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85699999999999998,"5min":1.071,"15min":1.071},"last":0.98799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149384,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.96499999999999997},"min":{"1min":0.52800000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":1.823,"15min":6.5190000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.80000000000000004},"min":{"1min":0.51900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.5710000000000002,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.76500000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.75700000000000001,"15min":0.82199999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94599999999999995,"5min":2.6230000000000002,"15min":3.6339999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.996},"min":{"1min":0.503,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0649999999999999,"5min":5.6749999999999998,"15min":8.4339999999999993},"last":0.505}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.80500000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0029999999999999,"5min":3.2629999999999999,"15min":3.4580000000000002},"last":0.628},{"interface":"front","average":{"1min":0.754,"5min":0.73299999999999998,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.0429999999999999,"15min":6.5730000000000004},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.93999999999999995},"min":{"1min":0.58499999999999996,"5min":0.49299999999999999,"15min":0.44400000000000001},"max":{"1min":1.343,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.036,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.64200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.94199999999999995,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75900000000000001,"15min":0.68300000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2909999999999999,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.66200000000000003},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.996,"5min":1.321,"15min":1.321},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.754,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.69299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1407,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193905,"statfs":{"total":200000000,"available":198558878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44400000000000001,"15min":0.40799999999999997},"min":{"1min":0.30599999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.48799999999999999,"5min":1.083,"15min":1.083},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.49099999999999999,"15min":0.45800000000000002},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.59099999999999997,"5min":0.745,"15min":0.745},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46100000000000002,"15min":0.437},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.47399999999999998},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.32200000000000001},"max":{"1min":0.57199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.499}]},{"osd":3,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56299999999999994,"15min":0.52100000000000002},"min":{"1min":0.42499999999999999,"5min":0.37,"15min":0.313},"max":{"1min":0.65300000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.47499999999999998},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54300000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.68899999999999995},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.57599999999999996,"5min":0.52000000000000002,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.45100000000000001},"max":{"1min":0.94499999999999995,"5min":1.22,"15min":1.22},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.72899999999999998},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.432},"max":{"1min":1.002,"5min":1.127,"15min":1.127},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.73199999999999998},"min":{"1min":0.624,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89600000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Sep 30 22:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79100000000000004,"15min":0.76300000000000001},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97799999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81899999999999995,"15min":0.76900000000000002},"min":{"1min":0.64700000000000002,"5min":0.54500000000000004,"15min":0.52900000000000003},"max":{"1min":0.97799999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.82299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199148748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.432,"15min":0.41799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53100000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.46500000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.61899999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.371}]},{"osd":2,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61399999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55000000000000004,"15min":0.51500000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.879,"15min":0.879},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48699999999999999,"15min":0.46100000000000002},"min":{"1min":0.35899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65900000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.70699999999999996},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.141,"5min":1.27,"15min":1.27},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.006,"5min":1.171,"15min":1.171},"last":0.71999999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.752,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96899999999999997,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.78800000000000003,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.70199999999999996}]},{"osd":6,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.53500000000000003,"5min":0.434,"15min":0.434},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":0.84799999999999998,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":7.2610000000000001,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.623,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.627},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.81699999999999995,"15min":0.77200000000000002},"min":{"1min":0.54200000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.61299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194479,"statfs":{"total":200000000,"available":199147316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.23599999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.42999999999999999},"min":{"1min":0.311,"5min":0.251,"15min":0.249},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.434}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.501},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79300000000000004,"5min":0.83999999999999997,"15min":1.0449999999999999},"last":0.55700000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.45300000000000001},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4910000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.179},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.008,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.89100000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.615},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.55200000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77000000000000002,"15min":0.73799999999999999},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.46000000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.877},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.497,"5min":0.495,"15min":0.439},"max":{"1min":1.113,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.63300000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.51100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73299999999999998,"5min":1.0700000000000001,"15min":1.919},"last":0.39300000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.53500000000000003,"5min":0.75800000000000001,"15min":1.254},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67900000000000005,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.498}]},{"osd":2,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59099999999999997,"5min":0.72399999999999998,"15min":1.6020000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.96199999999999997,"5min":1.2190000000000001,"15min":1.5309999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.72699999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92500000000000004,"5min":1.242,"15min":1.401},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.76200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93999999999999995,"5min":3.306,"15min":3.306},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75,"15min":0.749},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.98199999999999998,"15min":1.508},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.755,"15min":0.746},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":0.92700000000000005,"5min":1.274,"15min":1.4910000000000001},"last":0.86599999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96099999999999997,"5min":1.1870000000000001,"15min":1.5620000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0489999999999999,"5min":1.0960000000000001,"15min":1.3140000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":1.135,"5min":1.3440000000000001,"15min":1.3640000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97199999999999998,"5min":1.1970000000000001,"15min":1.573},"last":0.79800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.022,"15min":1.022},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.59699999999999998},"min":{"1min":0.50700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.746,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.61599999999999999},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60099999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.68300000000000005},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.877,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70099999999999996,"15min":0.65500000000000003},"min":{"1min":0.51000000000000001,"5min":0.47399999999999998,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63400000000000001,"15min":0.65700000000000003},"min":{"1min":0.44,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.37},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.97099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Sat Sep 30 22:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98599999999999999,"5min":1.016,"15min":1.016},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.56399999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":1.044,"15min":1.044},"last":0.73099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193903,"statfs":{"total":200000000,"available":198557502,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65300000000000002,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.63500000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88400000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.66100000000000003},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0369999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.27400000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94499999999999995,"5min":1.044,"15min":1.044},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68999999999999995,"15min":0.64000000000000001},"min":{"1min":0.48399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86799999999999999,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.93700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.58599999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.37},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.748},"min":{"1min":0.64000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66300000000000003}]}]}],"pool_statfs":[]}} 2023-09-30T22:59:18.328 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:59:18.328 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T22:59:18.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.558+0000 7f7d74fff700 1 Processor -- start 2023-09-30T22:59:18.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.558+0000 7f7d74fff700 1 -- start start 2023-09-30T22:59:18.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.559+0000 7f7d74fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d700c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.559+0000 7f7d74fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7d700cb350 0x7f7d701605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.559+0000 7f7d74fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700c7690 con 0x7f7d70069f10 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.559+0000 7f7d74fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d701406a0 con 0x7f7d700cb350 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.559+0000 7f7d74fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700c3a50 con 0x7f7d700c52a0 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6dd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7d70069f10 0x7f7d700c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47056/0 (socket says 172.21.15.142:47056) 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6dd9b700 1 -- 172.21.15.142:0/474224875 learned_addr learned my addr 172.21.15.142:0/474224875 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6e59c700 1 --2- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d700c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6ed9d700 1 --2- 172.21.15.142:0/474224875 >> v2:172.21.15.148:3300/0 conn(0x7f7d700cb350 0x7f7d701605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6d59a700 1 -- 172.21.15.142:0/474224875 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039213412 0 0) 0x7f7d64001110 con 0x7f7d70069f10 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6d59a700 1 -- 172.21.15.142:0/474224875 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d58003570 con 0x7f7d70069f10 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6ed9d700 1 -- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 msgr2=0x7f7d700c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6ed9d700 1 --2- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d700c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6ed9d700 1 -- 172.21.15.142:0/474224875 >> v1:172.21.15.142:6789/0 conn(0x7f7d70069f10 legacy=0x7f7d700c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6ed9d700 1 -- 172.21.15.142:0/474224875 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d700c7f20 con 0x7f7d700cb350 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.560+0000 7f7d6e59c700 1 --2- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d700c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.561+0000 7f7d6ed9d700 1 --2- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d701605e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009e90 tx=0x7f7d68009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8fc305865a5fd9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:18.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.561+0000 7f7d6d59a700 1 -- 172.21.15.142:0/474224875 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800e070 con 0x7f7d700cb350 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.561+0000 7f7d6d59a700 1 -- 172.21.15.142:0/474224875 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800bb40 con 0x7f7d700cb350 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.561+0000 7f7d6d59a700 1 -- 172.21.15.142:0/474224875 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68012430 con 0x7f7d700cb350 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.561+0000 7f7d74fff700 1 -- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 msgr2=0x7f7d701605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.561+0000 7f7d74fff700 1 --2- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d701605e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009e90 tx=0x7f7d68009780 comp rx=0 tx=0).stop 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.562+0000 7f7d74fff700 1 -- 172.21.15.142:0/474224875 shutdown_connections 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.562+0000 7f7d74fff700 1 --2- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d701605e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.562+0000 7f7d74fff700 1 --2- 172.21.15.142:0/474224875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d700c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.562+0000 7f7d74fff700 1 -- 172.21.15.142:0/474224875 >> 172.21.15.142:0/474224875 conn(0x7f7d700cc670 msgr2=0x7f7d700cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.562+0000 7f7d74fff700 1 -- 172.21.15.142:0/474224875 shutdown_connections 2023-09-30T22:59:18.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.562+0000 7f7d74fff700 1 -- 172.21.15.142:0/474224875 wait complete. 2023-09-30T22:59:18.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.563+0000 7f7d74fff700 1 Processor -- start 2023-09-30T22:59:18.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.563+0000 7f7d74fff700 1 -- start start 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d74fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d70069f10 0x7f7d70156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d74fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d7015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d74fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d7013a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d74fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70158b60 con 0x7f7d70069f10 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d74fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70156960 con 0x7f7d700cb350 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d74fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7015a7a0 con 0x7f7d700c52a0 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d6e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d70069f10 0x7f7d70156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d6e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d70069f10 0x7f7d70156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41434/0 (socket says 172.21.15.142:41434) 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.564+0000 7f7d6e59c700 1 -- 172.21.15.142:0/4104316142 learned_addr learned my addr 172.21.15.142:0/4104316142 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:18.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6dd9b700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d7015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6ed9d700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d7013a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6e59c700 1 -- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 msgr2=0x7f7d7015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6e59c700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d7015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6e59c700 1 -- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 msgr2=0x7f7d7013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6e59c700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d7013a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6e59c700 1 -- 172.21.15.142:0/4104316142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009420 con 0x7f7d70069f10 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6ed9d700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d7013a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d6e59c700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d70069f10 0x7f7d70156420 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000ecb0 tx=0x7f7d600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d5e7fc700 1 -- 172.21.15.142:0/4104316142 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000c950 con 0x7f7d70069f10 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d5e7fc700 1 -- 172.21.15.142:0/4104316142 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000cab0 con 0x7f7d70069f10 2023-09-30T22:59:18.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d68009a20 con 0x7f7d70069f10 2023-09-30T22:59:18.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.565+0000 7f7d5e7fc700 1 -- 172.21.15.142:0/4104316142 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000ce30 con 0x7f7d70069f10 2023-09-30T22:59:18.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.566+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7016b4b0 con 0x7f7d70069f10 2023-09-30T22:59:18.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.567+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d70069a50 con 0x7f7d70069f10 2023-09-30T22:59:18.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.567+0000 7f7d5e7fc700 1 -- 172.21.15.142:0/4104316142 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7d60013680 con 0x7f7d70069f10 2023-09-30T22:59:18.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.568+0000 7f7d5e7fc700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d50067330 0x7f7d500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:18.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.569+0000 7f7d5e7fc700 1 -- 172.21.15.142:0/4104316142 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d60084fc0 con 0x7f7d70069f10 2023-09-30T22:59:18.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.569+0000 7f7d6dd9b700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d50067330 0x7f7d500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:18.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.569+0000 7f7d6dd9b700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d50067330 0x7f7d500697e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7d7006e750 tx=0x7f7d64007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:18.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.573+0000 7f7d5e7fc700 1 -- 172.21.15.142:0/4104316142 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7d600558b0 con 0x7f7d70069f10 2023-09-30T22:59:18.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.839+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7d7006fc10 con 0x7f7d70069f10 2023-09-30T22:59:18.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.843+0000 7f7d5e7fc700 1 -- 172.21.15.142:0/4104316142 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7d600170e0 con 0x7f7d70069f10 2023-09-30T22:59:18.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d50067330 msgr2=0x7f7d500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d50067330 0x7f7d500697e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7d7006e750 tx=0x7f7d64007bf0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d70069f10 msgr2=0x7f7d70156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:18.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d70069f10 0x7f7d70156420 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000ecb0 tx=0x7f7d600091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 shutdown_connections 2023-09-30T22:59:18.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d50067330 0x7f7d500697e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d700cb350 0x7f7d7013a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d70069f10 0x7f7d70156420 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 --2- 172.21.15.142:0/4104316142 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d700c52a0 0x7f7d7015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:18.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 >> 172.21.15.142:0/4104316142 conn(0x7f7d700cc670 msgr2=0x7f7d7013bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:18.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 shutdown_connections 2023-09-30T22:59:18.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:18.846+0000 7f7d74fff700 1 -- 172.21.15.142:0/4104316142 wait complete. 2023-09-30T22:59:18.847 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T22:59:18.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:19.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.054+0000 7f43139ff700 1 Processor -- start 2023-09-30T22:59:19.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.054+0000 7f43139ff700 1 -- start start 2023-09-30T22:59:19.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.055+0000 7f43139ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f430c0692f0 0x7f430c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.055+0000 7f43139ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c0cc6b0 con 0x7f430c143350 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f43139ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c15e050 con 0x7f430c15dc50 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f43139ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0cbaa0 con 0x7f430c0692f0 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f431179b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f430c143350 0x7f430c0cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47070/0 (socket says 172.21.15.142:47070) 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f431179b700 1 -- 172.21.15.142:0/1268325510 learned_addr learned my addr 172.21.15.142:0/1268325510 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4310f9a700 1 --2- 172.21.15.142:0/1268325510 >> v2:172.21.15.148:3300/0 conn(0x7f430c0692f0 0x7f430c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4303fff700 1 -- 172.21.15.142:0/1268325510 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016989858 0 0) 0x7f430c0cc6b0 con 0x7f430c143350 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4303fff700 1 -- 172.21.15.142:0/1268325510 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f8003570 con 0x7f430c143350 2023-09-30T22:59:19.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4303fff700 1 -- 172.21.15.142:0/1268325510 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732172355 0 0) 0x7f430c15e050 con 0x7f430c15dc50 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4303fff700 1 -- 172.21.15.142:0/1268325510 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f430c0cc6b0 con 0x7f430c15dc50 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4310f9a700 1 -- 172.21.15.142:0/1268325510 >> v1:172.21.15.148:6789/0 conn(0x7f430c15dc50 legacy=0x7f430c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4310f9a700 1 -- 172.21.15.142:0/1268325510 >> v1:172.21.15.142:6789/0 conn(0x7f430c143350 legacy=0x7f430c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.056+0000 7f4310f9a700 1 -- 172.21.15.142:0/1268325510 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0cbd80 con 0x7f430c0692f0 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.057+0000 7f4310f9a700 1 --2- 172.21.15.142:0/1268325510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c15d710 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0098e0 tx=0x7f42fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=262e4c3c3a6567ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.057+0000 7f4303fff700 1 -- 172.21.15.142:0/1268325510 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc011630 con 0x7f430c0692f0 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.057+0000 7f4303fff700 1 -- 172.21.15.142:0/1268325510 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc011790 con 0x7f430c0692f0 2023-09-30T22:59:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.057+0000 7f4303fff700 1 -- 172.21.15.142:0/1268325510 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc011b30 con 0x7f430c0692f0 2023-09-30T22:59:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.057+0000 7f43139ff700 1 -- 172.21.15.142:0/1268325510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 msgr2=0x7f430c15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.057+0000 7f43139ff700 1 --2- 172.21.15.142:0/1268325510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c15d710 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0098e0 tx=0x7f42fc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.058+0000 7f43139ff700 1 -- 172.21.15.142:0/1268325510 shutdown_connections 2023-09-30T22:59:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.058+0000 7f43139ff700 1 --2- 172.21.15.142:0/1268325510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c15d710 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.058+0000 7f43139ff700 1 -- 172.21.15.142:0/1268325510 >> 172.21.15.142:0/1268325510 conn(0x7f430c0ce8e0 msgr2=0x7f430c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.058+0000 7f43139ff700 1 -- 172.21.15.142:0/1268325510 shutdown_connections 2023-09-30T22:59:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.058+0000 7f43139ff700 1 -- 172.21.15.142:0/1268325510 wait complete. 2023-09-30T22:59:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.059+0000 7f43139ff700 1 Processor -- start 2023-09-30T22:59:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.059+0000 7f43139ff700 1 -- start start 2023-09-30T22:59:19.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f43139ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f43139ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f430c143350 0x7f430c0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f43139ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f430c15dc50 0x7f430c0a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f43139ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0a64a0 con 0x7f430c143350 2023-09-30T22:59:19.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f43139ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0a6780 con 0x7f430c0692f0 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f43139ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0a6a60 con 0x7f430c15dc50 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f4310f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f430c143350 0x7f430c0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f4310f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f430c143350 0x7f430c0ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41450/0 (socket says 172.21.15.142:41450) 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.060+0000 7f4310f9a700 1 -- 172.21.15.142:0/2309997955 learned_addr learned my addr 172.21.15.142:0/2309997955 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f431179b700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4310f9a700 1 -- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f430c15dc50 msgr2=0x7f430c0a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4311f9c700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f430c15dc50 0x7f430c0a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4310f9a700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f430c15dc50 0x7f430c0a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4310f9a700 1 -- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 msgr2=0x7f430c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4310f9a700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c0cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4310f9a700 1 -- 172.21.15.142:0/2309997955 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc009420 con 0x7f430c143350 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f431179b700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4311f9c700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f430c15dc50 0x7f430c0a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f4310f9a700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f430c143350 0x7f430c0ce210 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f430c063f80 tx=0x7f42fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f43017fa700 1 -- 172.21.15.142:0/2309997955 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc01f070 con 0x7f430c143350 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f43017fa700 1 -- 172.21.15.142:0/2309997955 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc011b10 con 0x7f430c143350 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c0a6d40 con 0x7f430c143350 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.061+0000 7f43017fa700 1 -- 172.21.15.142:0/2309997955 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc023640 con 0x7f430c143350 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.062+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c0a5e70 con 0x7f430c143350 2023-09-30T22:59:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.063+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c06ea70 con 0x7f430c143350 2023-09-30T22:59:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.063+0000 7f43017fa700 1 -- 172.21.15.142:0/2309997955 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f42fc02c3b0 con 0x7f430c143350 2023-09-30T22:59:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.064+0000 7f43017fa700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f42f0067330 0x7f42f00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.064+0000 7f43017fa700 1 -- 172.21.15.142:0/2309997955 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f42fc085f80 con 0x7f430c143350 2023-09-30T22:59:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.064+0000 7f431179b700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f42f0067330 0x7f42f00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.065+0000 7f431179b700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f42f0067330 0x7f42f00697e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4308007fd0 tx=0x7f4308009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.069+0000 7f43017fa700 1 -- 172.21.15.142:0/2309997955 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f42fc052de0 con 0x7f430c143350 2023-09-30T22:59:19.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.300+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f430c0cc060 con 0x7f430c143350 2023-09-30T22:59:19.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.300+0000 7f43017fa700 1 -- 172.21.15.142:0/2309997955 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f42fc015090 con 0x7f430c143350 2023-09-30T22:59:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:19.300 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.302+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f42f0067330 msgr2=0x7f42f00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.302+0000 7f43139ff700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f42f0067330 0x7f42f00697e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4308007fd0 tx=0x7f4308009040 comp rx=0 tx=0).stop 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.302+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f430c143350 msgr2=0x7f430c0ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.302+0000 7f43139ff700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f430c143350 0x7f430c0ce210 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f430c063f80 tx=0x7f42fc017000 comp rx=0 tx=0).stop 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 shutdown_connections 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f42f0067330 0x7f42f00697e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f430c15dc50 0x7f430c0a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f430c0692f0 0x7f430c0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 --2- 172.21.15.142:0/2309997955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f430c143350 0x7f430c0ce210 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 >> 172.21.15.142:0/2309997955 conn(0x7f430c0ce8e0 msgr2=0x7f430c0c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 shutdown_connections 2023-09-30T22:59:19.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.303+0000 7f43139ff700 1 -- 172.21.15.142:0/2309997955 wait complete. 2023-09-30T22:59:19.304 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:19.722 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:59:12.987394+0000', 'modified': '2023-09-30T22:59:16.534775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6775}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6775': {'gid': 6775, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/997643438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 997643438}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 997643438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:59:19.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:59:19.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:59:19.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.913+0000 7f1f553ff700 1 Processor -- start 2023-09-30T22:59:19.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.914+0000 7f1f553ff700 1 -- start start 2023-09-30T22:59:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f553ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f500aebf0 0x7f1f5006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f553ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f50069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f553ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f500b0ee0 con 0x7f1f5006f190 2023-09-30T22:59:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f553ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f500aefc0 con 0x7f1f500aebf0 2023-09-30T22:59:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f553ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500b02d0 con 0x7f1f5015a2a0 2023-09-30T22:59:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f4effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f500aebf0 0x7f1f5006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f4e7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1f5006f190 0x7f1f50159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47076/0 (socket says 172.21.15.142:47076) 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.915+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/3389037396 learned_addr learned my addr 172.21.15.142:0/3389037396 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/3389037396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f50069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4effd700 1 -- 172.21.15.142:0/3389037396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 msgr2=0x7f1f50069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4effd700 1 --2- 172.21.15.142:0/3389037396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f50069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4effd700 1 -- 172.21.15.142:0/3389037396 >> v1:172.21.15.142:6789/0 conn(0x7f1f5006f190 legacy=0x7f1f50159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4dffb700 1 -- 172.21.15.142:0/3389037396 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133390386 0 0) 0x7f1f500b0ee0 con 0x7f1f5006f190 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4effd700 1 -- 172.21.15.142:0/3389037396 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500b05b0 con 0x7f1f500aebf0 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4effd700 1 --2- 172.21.15.142:0/3389037396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f500aebf0 0x7f1f5006ec50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000aa90 tx=0x7f1f4000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3df96d068d10f77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4dffb700 1 -- 172.21.15.142:0/3389037396 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000ca40 con 0x7f1f500aebf0 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4dffb700 1 -- 172.21.15.142:0/3389037396 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4000cba0 con 0x7f1f500aebf0 2023-09-30T22:59:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.916+0000 7f1f4dffb700 1 -- 172.21.15.142:0/3389037396 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40018400 con 0x7f1f500aebf0 2023-09-30T22:59:19.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 -- 172.21.15.142:0/3389037396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f500aebf0 msgr2=0x7f1f5006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 --2- 172.21.15.142:0/3389037396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f500aebf0 0x7f1f5006ec50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000aa90 tx=0x7f1f4000a330 comp rx=0 tx=0).stop 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 -- 172.21.15.142:0/3389037396 shutdown_connections 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 --2- 172.21.15.142:0/3389037396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f500aebf0 0x7f1f5006ec50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 --2- 172.21.15.142:0/3389037396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f50069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 -- 172.21.15.142:0/3389037396 >> 172.21.15.142:0/3389037396 conn(0x7f1f500680c0 msgr2=0x7f1f500c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 -- 172.21.15.142:0/3389037396 shutdown_connections 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.917+0000 7f1f553ff700 1 -- 172.21.15.142:0/3389037396 wait complete. 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.918+0000 7f1f553ff700 1 Processor -- start 2023-09-30T22:59:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.919+0000 7f1f553ff700 1 -- start start 2023-09-30T22:59:19.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.919+0000 7f1f553ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5006f190 0x7f1f500c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.919+0000 7f1f553ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f500aebf0 0x7f1f500c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f553ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f5014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f553ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c8ce0 con 0x7f1f5006f190 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f553ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c6180 con 0x7f1f500aebf0 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f553ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c6460 con 0x7f1f5015a2a0 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5006f190 0x7f1f500c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5006f190 0x7f1f500c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41466/0 (socket says 172.21.15.142:41466) 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 -- 172.21.15.142:0/2580237218 learned_addr learned my addr 172.21.15.142:0/2580237218 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f5014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f500aebf0 0x7f1f500c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 -- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 msgr2=0x7f1f5014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f5014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 -- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f500aebf0 msgr2=0x7f1f500c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f500aebf0 0x7f1f500c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4effd700 1 -- 172.21.15.142:0/2580237218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4000a5d0 con 0x7f1f5006f190 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.920+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f500aebf0 0x7f1f500c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.921+0000 7f1f4effd700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5006f190 0x7f1f500c5a80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000a5a0 tx=0x7f1f4001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.921+0000 7f1f36ffd700 1 -- 172.21.15.142:0/2580237218 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40010600 con 0x7f1f5006f190 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.921+0000 7f1f36ffd700 1 -- 172.21.15.142:0/2580237218 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40010760 con 0x7f1f5006f190 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.921+0000 7f1f36ffd700 1 -- 172.21.15.142:0/2580237218 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40010b00 con 0x7f1f5006f190 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.921+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f500c6740 con 0x7f1f5006f190 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.921+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f500c6d00 con 0x7f1f5006f190 2023-09-30T22:59:19.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.923+0000 7f1f36ffd700 1 -- 172.21.15.142:0/2580237218 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1f4002a3b0 con 0x7f1f5006f190 2023-09-30T22:59:19.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.924+0000 7f1f36ffd700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1f3c067330 0x7f1f3c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.924+0000 7f1f36ffd700 1 -- 172.21.15.142:0/2580237218 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f40086290 con 0x7f1f5006f190 2023-09-30T22:59:19.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.925+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1f3c067330 0x7f1f3c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.925+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1f3c067330 0x7f1f3c0697e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f500c7a10 tx=0x7f1f44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.926+0000 7f1f63ab2b80 1 Processor -- start 2023-09-30T22:59:19.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.926+0000 7f1f63ab2b80 1 -- start start 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf3cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf3d8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf2a2310 con 0x5653bf3cf450 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf2df130 con 0x5653bf3d84d0 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653bf2dcaf0 con 0x5653bf3b4f40 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f4effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf3cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f4effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf3cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41474/0 (socket says 172.21.15.142:41474) 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.927+0000 7f1f4effd700 1 -- 172.21.15.142:0/185104500 learned_addr learned my addr 172.21.15.142:0/185104500 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf3d8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4effd700 1 -- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 msgr2=0x5653bf3d7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4effd700 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4effd700 1 -- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 msgr2=0x5653bf3d8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4effd700 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf3d8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4effd700 1 -- 172.21.15.142:0/185104500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653bf0de790 con 0x5653bf3cf450 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf3d8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f4effd700 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf3cf820 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006d60 tx=0x7f1f4000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91af352ac5047ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f2ffff700 1 -- 172.21.15.142:0/185104500 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400860e0 con 0x5653bf3cf450 2023-09-30T22:59:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f2ffff700 1 -- 172.21.15.142:0/185104500 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4005c0d0 con 0x5653bf3cf450 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.928+0000 7f1f2ffff700 1 -- 172.21.15.142:0/185104500 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40056e60 con 0x5653bf3cf450 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/185104500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 msgr2=0x5653bf3cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf3cf820 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006d60 tx=0x7f1f4000c040 comp rx=0 tx=0).stop 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/185104500 shutdown_connections 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf3d8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf3cf820 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/185104500 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/185104500 >> 172.21.15.142:0/185104500 conn(0x5653bf3d2880 msgr2=0x5653bf3d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/185104500 shutdown_connections 2023-09-30T22:59:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.929+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/185104500 wait complete. 2023-09-30T22:59:19.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.930+0000 7f1f63ab2b80 1 -- start start 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.930+0000 7f1f63ab2b80 1 Processor -- start 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf389cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf38a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf2d88e0 con 0x5653bf3cf450 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf284980 con 0x5653bf3d84d0 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653bf284620 con 0x5653bf3b4f40 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f63ab2b80 10 client.0 _ll_register_callbacks cb 0x5653bf0e7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf389cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf389cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41482/0 (socket says 172.21.15.142:41482) 2023-09-30T22:59:19.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/3305796268 learned_addr learned my addr 172.21.15.142:0/3305796268 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4effd700 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf38a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 msgr2=0x5653bf3a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 msgr2=0x5653bf38a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf38a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.932+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/3305796268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f500c6d00 con 0x5653bf3cf450 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf389cc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1f44007480 tx=0x7f1f44017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1633b4cd6077c454 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f2d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/3305796268 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44007840 con 0x5653bf3cf450 2023-09-30T22:59:19.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/3305796268 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f4400ec70 con 0x5653bf3cf450 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653bf37cd60 con 0x5653bf3cf450 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/3305796268 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f44022430 con 0x5653bf3cf450 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f63ab2b80 10 client.7380 fetch_fsmap learned FSMap version 66 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x5653bf1cb0a0 con 0x5653bf3cf450 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/3305796268 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653bf37cd60 con 0x5653bf3cf450 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/3305796268 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1f44022590 con 0x5653bf3cf450 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.933+0000 7f1f63ab2b80 10 client.7380 fetch_fsmap finished waiting for FSMap version 66 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f63ab2b80 10 client.7380 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f63ab2b80 20 client.7380 populate_metadata read hostname 'smithi142' 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3d0f00 0x5653bf3ae650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f63ab2b80 4 client.7380 mds_command: new command op to 6775 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:59:19.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 --> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653bf359b30 con 0x5653bf3d0f00 2023-09-30T22:59:19.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f4effd700 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3d0f00 0x5653bf3ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f4effd700 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3d0f00 0x5653bf3ae650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffe2496ec300dfb2 server_cookie=a6949bb432a4d617 in_seq=0 out_seq=0 2023-09-30T22:59:19.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.934+0000 7f1f2d7fa700 10 client.7380 ms_handle_connect on v2:172.21.15.142:6835/997643438 2023-09-30T22:59:19.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/3305796268 <== mds.0 v2:172.21.15.142:6835/997643438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x5653bf359b30 con 0x5653bf3d0f00 2023-09-30T22:59:19.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f2d7fa700 10 client.7380 handle_command_reply: tid=0 2023-09-30T22:59:19.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 client.7380 shutdown 2023-09-30T22:59:19.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 msgr2=0x5653bf389cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf389cc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1f44007480 tx=0x7f1f44017040 comp rx=0 tx=0).stop 2023-09-30T22:59:19.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 shutdown_connections 2023-09-30T22:59:19.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3d0f00 0x5653bf3ae650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3d84d0 0x5653bf38a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/3305796268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf389cc0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f2d7fa700 0 client.7380 ms_handle_reset on v2:172.21.15.142:6835/997643438 2023-09-30T22:59:19.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.935+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 >> 172.21.15.142:0/3305796268 conn(0x5653bf3d2880 msgr2=0x5653bf384c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.936+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 shutdown_connections 2023-09-30T22:59:19.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.936+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/3305796268 wait complete. 2023-09-30T22:59:19.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.936+0000 7f1f63ab2b80 20 client.7380 trim_cache size 0 max 16384 2023-09-30T22:59:19.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.953+0000 7f1f63ab2b80 1 Processor -- start 2023-09-30T22:59:19.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.953+0000 7f1f63ab2b80 1 -- start start 2023-09-30T22:59:19.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3b4f40 0x5653bf389f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf387e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3d84d0 0x5653bf388360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf1701e0 con 0x5653bf3cf450 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf3b1610 con 0x5653bf3b4f40 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653bf386b00 con 0x5653bf3d84d0 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf387e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf387e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41496/0 (socket says 172.21.15.142:41496) 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/1845114910 learned_addr learned my addr 172.21.15.142:0/1845114910 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/1845114910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3d84d0 msgr2=0x5653bf388360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/1845114910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3d84d0 0x5653bf388360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/1845114910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3b4f40 msgr2=0x5653bf389f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/1845114910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3b4f40 0x5653bf389f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.954+0000 7f1f4e7fc700 1 -- 172.21.15.142:0/1845114910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653bf2a73c0 con 0x5653bf3cf450 2023-09-30T22:59:19.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/1845114910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf387e20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1f44007c40 tx=0x7f1f44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0d2cd6e5c3b6c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f34ff9700 1 -- 172.21.15.142:0/1845114910 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400ec70 con 0x5653bf3cf450 2023-09-30T22:59:19.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f34ff9700 1 -- 172.21.15.142:0/1845114910 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4401b050 con 0x5653bf3cf450 2023-09-30T22:59:19.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f34ff9700 1 -- 172.21.15.142:0/1845114910 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44000ed0 con 0x5653bf3cf450 2023-09-30T22:59:19.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1845114910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 msgr2=0x5653bf387e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1845114910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf387e20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1f44007c40 tx=0x7f1f44014000 comp rx=0 tx=0).stop 2023-09-30T22:59:19.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1845114910 shutdown_connections 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1845114910 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3d84d0 0x5653bf388360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1845114910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3b4f40 0x5653bf389f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1845114910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3cf450 0x5653bf387e20 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.955+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1845114910 >> 172.21.15.142:0/1845114910 conn(0x5653bf3d2880 msgr2=0x5653bf3cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.956+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1845114910 shutdown_connections 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.956+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1845114910 wait complete. 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.956+0000 7f1f63ab2b80 1 -- start start 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.956+0000 7f1f63ab2b80 1 Processor -- start 2023-09-30T22:59:19.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.957+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.957+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3cf450 0x5653bf3d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.957+0000 7f1f63ab2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3d84d0 0x5653bf3b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.957+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf4339f0 con 0x5653bf3d84d0 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.957+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653bf433be0 con 0x5653bf3cf450 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.957+0000 7f1f63ab2b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653bf433e80 con 0x5653bf3b4f40 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.957+0000 7f1f63ab2b80 10 client.0 _ll_register_callbacks cb 0x5653bf0e7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3d84d0 0x5653bf3b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3d84d0 0x5653bf3b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41512/0 (socket says 172.21.15.142:41512) 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 -- 172.21.15.142:0/1553339144 learned_addr learned my addr 172.21.15.142:0/1553339144 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:19.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4effd700 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4e7fc700 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3cf450 0x5653bf3d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 -- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 msgr2=0x5653bf3d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 -- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3cf450 msgr2=0x5653bf3d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:19.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3cf450 0x5653bf3d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.958+0000 7f1f4f7fe700 1 -- 172.21.15.142:0/1553339144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653bf1cb0a0 con 0x5653bf3d84d0 2023-09-30T22:59:19.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f4f7fe700 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3d84d0 0x5653bf3b03f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1f5006ce00 tx=0x7f1f4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e87bd73a941a53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:19.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f2d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T22:59:19.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/1553339144 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48017670 con 0x5653bf3d84d0 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/1553339144 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f480177d0 con 0x5653bf3d84d0 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f4005c0d0 con 0x5653bf3d84d0 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/1553339144 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f48017ba0 con 0x5653bf3d84d0 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f63ab2b80 10 client.7386 fetch_fsmap learned FSMap version 66 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x5653bf13f1d0 con 0x5653bf3d84d0 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.959+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/1553339144 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4005c0d0 con 0x5653bf3d84d0 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/1553339144 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1f48017d00 con 0x5653bf3d84d0 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f63ab2b80 10 client.7386 fetch_fsmap finished waiting for FSMap version 66 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f63ab2b80 10 client.7386 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f63ab2b80 20 client.7386 populate_metadata read hostname 'smithi142' 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3b0a20 0x5653bf3ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:19.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f63ab2b80 4 client.7386 mds_command: new command op to 6775 tid=0[{"prefix": "status"}] 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 --> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5653bf27b8d0 con 0x5653bf3b0a20 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f4effd700 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3b0a20 0x5653bf3ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f4effd700 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3b0a20 0x5653bf3ad130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d06623ea8210fd3 server_cookie=99bf41dacffe838e in_seq=0 out_seq=0 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f2d7fa700 10 client.7386 ms_handle_connect on v2:172.21.15.142:6835/997643438 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f2d7fa700 1 -- 172.21.15.142:0/1553339144 <== mds.0 v2:172.21.15.142:6835/997643438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5653bf27b8d0 con 0x5653bf3b0a20 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.960+0000 7f1f2d7fa700 10 client.7386 handle_command_reply: tid=0 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 client.7386 shutdown 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3d84d0 msgr2=0x5653bf3b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3d84d0 0x5653bf3b03f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1f5006ce00 tx=0x7f1f4800b040 comp rx=0 tx=0).stop 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 shutdown_connections 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:6835/997643438,v1:172.21.15.142:6837/997643438] conn(0x5653bf3b0a20 0x5653bf3ad130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653bf3d84d0 0x5653bf3b03f0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5653bf3b4f40 0x5653bf3d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 --2- 172.21.15.142:0/1553339144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653bf3cf450 0x5653bf3d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f2d7fa700 0 client.7386 ms_handle_reset on v2:172.21.15.142:6835/997643438 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 >> 172.21.15.142:0/1553339144 conn(0x5653bf3d2880 msgr2=0x5653bf3cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 shutdown_connections 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 1 -- 172.21.15.142:0/1553339144 wait complete. 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.961+0000 7f1f63ab2b80 20 client.7386 trim_cache size 0 max 16384 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 6775, 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 6.4559207010000002, 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 66, 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 144, 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 144, 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 12.180393293 2023-09-30T22:59:19.967 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:19.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1f3c067330 msgr2=0x7f1f3c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1f3c067330 0x7f1f3c0697e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f500c7a10 tx=0x7f1f44009040 comp rx=0 tx=0).stop 2023-09-30T22:59:19.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5006f190 msgr2=0x7f1f500c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5006f190 0x7f1f500c5a80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000a5a0 tx=0x7f1f4001a000 comp rx=0 tx=0).stop 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 shutdown_connections 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1f3c067330 0x7f1f3c0697e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f5015a2a0 0x7f1f5014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5006f190 0x7f1f500c5a80 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 --2- 172.21.15.142:0/2580237218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f500aebf0 0x7f1f500c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 >> 172.21.15.142:0/2580237218 conn(0x7f1f500680c0 msgr2=0x7f1f501541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 shutdown_connections 2023-09-30T22:59:19.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:19.962+0000 7f1f553ff700 1 -- 172.21.15.142:0/2580237218 wait complete. 2023-09-30T22:59:19.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:59:20.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.167+0000 7f3c307ff700 1 Processor -- start 2023-09-30T22:59:20.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.168+0000 7f3c307ff700 1 -- start start 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c307ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c280cc590 0x7f3c28164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c307ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2815d910 con 0x7f3c280b1180 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c307ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2815e490 con 0x7f3c28159ae0 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c307ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2815e920 con 0x7f3c280cc590 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c2ed9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c280cc590 0x7f3c28164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c2ed9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c280cc590 0x7f3c28164cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41520/0 (socket says 172.21.15.142:41520) 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c2ed9c700 1 -- 172.21.15.142:0/3672121130 learned_addr learned my addr 172.21.15.142:0/3672121130 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:20.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.169+0000 7f3c2dd9a700 1 --1- 172.21.15.142:0/3672121130 >> v1:172.21.15.142:6789/0 conn(0x7f3c280b1180 0x7f3c280cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47092/0 (socket says 172.21.15.142:47092) 2023-09-30T22:59:20.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.170+0000 7f3c2ed9c700 1 -- 172.21.15.142:0/3672121130 >> v1:172.21.15.148:6789/0 conn(0x7f3c28159ae0 legacy=0x7f3c280cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:20.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.170+0000 7f3c2ed9c700 1 -- 172.21.15.142:0/3672121130 >> v1:172.21.15.142:6789/0 conn(0x7f3c280b1180 legacy=0x7f3c280cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:20.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.170+0000 7f3c2ed9c700 1 -- 172.21.15.142:0/3672121130 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280ce5c0 con 0x7f3c280cc590 2023-09-30T22:59:20.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.170+0000 7f3c2ed9c700 1 --2- 172.21.15.142:0/3672121130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c28164cb0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009f20 tx=0x7f3c20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97de8ccfc8658b73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:20.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.170+0000 7f3c2d599700 1 -- 172.21.15.142:0/3672121130 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000e070 con 0x7f3c280cc590 2023-09-30T22:59:20.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.170+0000 7f3c2d599700 1 -- 172.21.15.142:0/3672121130 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2000ba80 con 0x7f3c280cc590 2023-09-30T22:59:20.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.170+0000 7f3c2d599700 1 -- 172.21.15.142:0/3672121130 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c200092e0 con 0x7f3c280cc590 2023-09-30T22:59:20.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.171+0000 7f3c307ff700 1 -- 172.21.15.142:0/3672121130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 msgr2=0x7f3c28164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:20.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.171+0000 7f3c307ff700 1 --2- 172.21.15.142:0/3672121130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c28164cb0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009f20 tx=0x7f3c20009840 comp rx=0 tx=0).stop 2023-09-30T22:59:20.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.171+0000 7f3c307ff700 1 -- 172.21.15.142:0/3672121130 shutdown_connections 2023-09-30T22:59:20.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.171+0000 7f3c307ff700 1 --2- 172.21.15.142:0/3672121130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c28164cb0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.171+0000 7f3c307ff700 1 -- 172.21.15.142:0/3672121130 >> 172.21.15.142:0/3672121130 conn(0x7f3c280ce8b0 msgr2=0x7f3c280cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:20.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.171+0000 7f3c307ff700 1 -- 172.21.15.142:0/3672121130 shutdown_connections 2023-09-30T22:59:20.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.171+0000 7f3c307ff700 1 -- 172.21.15.142:0/3672121130 wait complete. 2023-09-30T22:59:20.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.172+0000 7f3c307ff700 1 Processor -- start 2023-09-30T22:59:20.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.172+0000 7f3c307ff700 1 -- start start 2023-09-30T22:59:20.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c307ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c280b1180 0x7f3c2815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:20.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c307ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c280c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c307ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c28159ae0 0x7f3c280a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c307ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2816b720 con 0x7f3c280cc590 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c307ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2816b440 con 0x7f3c28159ae0 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c307ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28159fe0 con 0x7f3c280b1180 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c2dd9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c280c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c2dd9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c280c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41526/0 (socket says 172.21.15.142:41526) 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.173+0000 7f3c2dd9a700 1 -- 172.21.15.142:0/132346949 learned_addr learned my addr 172.21.15.142:0/132346949 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2e59b700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c280b1180 0x7f3c2815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2ed9c700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c28159ae0 0x7f3c280a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2dd9a700 1 -- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c280b1180 msgr2=0x7f3c2815aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2dd9a700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c280b1180 0x7f3c2815aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2dd9a700 1 -- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c28159ae0 msgr2=0x7f3c280a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2dd9a700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c28159ae0 0x7f3c280a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2dd9a700 1 -- 172.21.15.142:0/132346949 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20009ae0 con 0x7f3c280cc590 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2ed9c700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c28159ae0 0x7f3c280a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c2dd9a700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c280c9f10 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c790 tx=0x7f3c18007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c1e7fc700 1 -- 172.21.15.142:0/132346949 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18005a70 con 0x7f3c280cc590 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c1e7fc700 1 -- 172.21.15.142:0/132346949 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18005bf0 con 0x7f3c280cc590 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c1e7fc700 1 -- 172.21.15.142:0/132346949 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180070d0 con 0x7f3c280cc590 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.174+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2815a2c0 con 0x7f3c280cc590 2023-09-30T22:59:20.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.175+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c280ca450 con 0x7f3c280cc590 2023-09-30T22:59:20.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.176+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c280ca6d0 con 0x7f3c280cc590 2023-09-30T22:59:20.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.176+0000 7f3c1e7fc700 1 -- 172.21.15.142:0/132346949 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3c18007480 con 0x7f3c280cc590 2023-09-30T22:59:20.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.177+0000 7f3c1e7fc700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c0c067330 0x7f3c0c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:20.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.177+0000 7f3c1e7fc700 1 -- 172.21.15.142:0/132346949 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3c18084070 con 0x7f3c280cc590 2023-09-30T22:59:20.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.178+0000 7f3c2e59b700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c0c067330 0x7f3c0c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:20.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.178+0000 7f3c2e59b700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c0c067330 0x7f3c0c0697e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3c240039e0 tx=0x7f3c24007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:20.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.182+0000 7f3c1e7fc700 1 -- 172.21.15.142:0/132346949 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3c18050ed0 con 0x7f3c280cc590 2023-09-30T22:59:20.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.412+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c2815db60 con 0x7f3c280cc590 2023-09-30T22:59:20.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.413+0000 7f3c1e7fc700 1 -- 172.21.15.142:0/132346949 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3c18017020 con 0x7f3c280cc590 2023-09-30T22:59:20.413 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:59:20.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c0c067330 msgr2=0x7f3c0c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:20.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c0c067330 0x7f3c0c0697e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3c240039e0 tx=0x7f3c24007ec0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 msgr2=0x7f3c280c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:20.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c280c9f10 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c790 tx=0x7f3c18007f40 comp rx=0 tx=0).stop 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 shutdown_connections 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3c0c067330 0x7f3c0c0697e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c28159ae0 0x7f3c280a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3c280b1180 0x7f3c2815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 --2- 172.21.15.142:0/132346949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c280cc590 0x7f3c280c9f10 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 >> 172.21.15.142:0/132346949 conn(0x7f3c280ce8b0 msgr2=0x7f3c28156710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 shutdown_connections 2023-09-30T22:59:20.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:20.415+0000 7f3c307ff700 1 -- 172.21.15.142:0/132346949 wait complete. 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:59:20.433 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:59:20.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:20.434 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T22:59:20.481 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:59:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:59:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:59:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T22:59:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:20.481 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:59:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41897sec preferred_lft 41897sec 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:59:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T22:59:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:20.484 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:59:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T22:59:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T22:59:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:20.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:20.484 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:59:20.590 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T22:59:20.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:20.593 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T22:59:20.641 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T22:59:20.641 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:59:20.641 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:59:20.641 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:59:20.642 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:59:20.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:20.643 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T22:59:20.643 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T22:59:20.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:59:20.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:59:20.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:59:20.643 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T22:59:20.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:20.812 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T22:59:20.858 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T22:59:20.858 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:59:20.859 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:59:20.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:20.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T22:59:20.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:59:20.968 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:59:21.014 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:59:21.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:59:21.014 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:59:21.099 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:59:21.099 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:59:21.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:59:21.237 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:59:21.237 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:59:21.237 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:59:21.251 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:59:21.252 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:59:21.252 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:59:21.252 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:59:21.252 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:59:21.271 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:59:21.272 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T22:59:21.272 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T22:59:21.272 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:59:21.272 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:59:21.272 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:59:21.272 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:59:21.272 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:59:21.277 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:59:21.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:21.278 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:59:21.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:59:21.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.538+0000 7fc6d27ff700 1 Processor -- start 2023-09-30T22:59:21.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.539+0000 7fc6d27ff700 1 -- start start 2023-09-30T22:59:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6d27ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6cc0692f0 0x7fc6cc15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6d27ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0cc6b0 con 0x7fc6cc143350 2023-09-30T22:59:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6d27ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc15e090 con 0x7fc6cc0692f0 2023-09-30T22:59:21.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0cbaa0 con 0x7fc6cc15dc50 2023-09-30T22:59:21.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6cb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6cc0692f0 0x7fc6cc15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:21.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6cb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6cc0692f0 0x7fc6cc15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46126/0 (socket says 172.21.15.142:46126) 2023-09-30T22:59:21.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2735098535 learned_addr learned my addr 172.21.15.142:0/2735098535 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:21.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.540+0000 7fc6d0d9c700 1 --2- 172.21.15.142:0/2735098535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2735098535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 msgr2=0x7fc6cc06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:21.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6cb7fe700 1 --2- 172.21.15.142:0/2735098535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2735098535 >> v1:172.21.15.142:6789/0 conn(0x7fc6cc143350 legacy=0x7fc6cc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:21.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2735098535 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0cbd80 con 0x7fc6cc0692f0 2023-09-30T22:59:21.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6caffd700 1 -- 172.21.15.142:0/2735098535 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495134995 0 0) 0x7fc6cc0cc6b0 con 0x7fc6cc143350 2023-09-30T22:59:21.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6cb7fe700 1 --2- 172.21.15.142:0/2735098535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0692f0 0x7fc6cc15d710 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00099b0 tx=0x7fc6c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d5d055ef6b987a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:21.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6caffd700 1 -- 172.21.15.142:0/2735098535 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000b860 con 0x7fc6cc0692f0 2023-09-30T22:59:21.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6caffd700 1 -- 172.21.15.142:0/2735098535 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000b9c0 con 0x7fc6cc0692f0 2023-09-30T22:59:21.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.541+0000 7fc6caffd700 1 -- 172.21.15.142:0/2735098535 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000bd60 con 0x7fc6cc0692f0 2023-09-30T22:59:21.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2735098535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0692f0 msgr2=0x7fc6cc15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:21.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2735098535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0692f0 0x7fc6cc15d710 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00099b0 tx=0x7fc6c0009250 comp rx=0 tx=0).stop 2023-09-30T22:59:21.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2735098535 shutdown_connections 2023-09-30T22:59:21.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2735098535 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2735098535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0692f0 0x7fc6cc15d710 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2735098535 >> 172.21.15.142:0/2735098535 conn(0x7fc6cc0ce8e0 msgr2=0x7fc6cc0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:21.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2735098535 shutdown_connections 2023-09-30T22:59:21.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.542+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2735098535 wait complete. 2023-09-30T22:59:21.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.543+0000 7fc6d27ff700 1 Processor -- start 2023-09-30T22:59:21.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.543+0000 7fc6d27ff700 1 -- start start 2023-09-30T22:59:21.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc0692f0 0x7fc6cc16d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc143350 0x7fc6cc16deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc16b5d0 con 0x7fc6cc143350 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0b2870 con 0x7fc6cc0692f0 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0b2b50 con 0x7fc6cc15dc50 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6cb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc143350 0x7fc6cc16deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6cb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc143350 0x7fc6cc16deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46138/0 (socket says 172.21.15.142:46138) 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.544+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2711472388 learned_addr learned my addr 172.21.15.142:0/2711472388 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6cbfff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc0692f0 0x7fc6cc16d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:21.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6d0d9c700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 msgr2=0x7fc6cc0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6cb7fe700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc0b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc0692f0 msgr2=0x7fc6cc16d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6cb7fe700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc0692f0 0x7fc6cc16d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6cb7fe700 1 -- 172.21.15.142:0/2711472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00094f0 con 0x7fc6cc143350 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6cb7fe700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc143350 0x7fc6cc16deb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009fd0 tx=0x7fc6c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6b3fff700 1 -- 172.21.15.142:0/2711472388 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0024440 con 0x7fc6cc143350 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6b3fff700 1 -- 172.21.15.142:0/2711472388 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c00245a0 con 0x7fc6cc143350 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6b3fff700 1 -- 172.21.15.142:0/2711472388 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0024940 con 0x7fc6cc143350 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0b2e30 con 0x7fc6cc143350 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.545+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0b2000 con 0x7fc6cc143350 2023-09-30T22:59:21.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.547+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc16b740 con 0x7fc6cc143350 2023-09-30T22:59:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.547+0000 7fc6b3fff700 1 -- 172.21.15.142:0/2711472388 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc6c001a420 con 0x7fc6cc143350 2023-09-30T22:59:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.548+0000 7fc6b3fff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc6b8067330 0x7fc6b80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.548+0000 7fc6b3fff700 1 -- 172.21.15.142:0/2711472388 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6c0086b50 con 0x7fc6cc143350 2023-09-30T22:59:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.548+0000 7fc6cbfff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc6b8067330 0x7fc6b80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.549+0000 7fc6cbfff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc6b8067330 0x7fc6b80697e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0011e0 tx=0x7fc6bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.553+0000 7fc6b3fff700 1 -- 172.21.15.142:0/2711472388 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc6cc16b740 con 0x7fc6cc143350 2023-09-30T22:59:21.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.790+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc6cc16b710 con 0x7fc6cc143350 2023-09-30T22:59:21.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.790+0000 7fc6b3fff700 1 -- 172.21.15.142:0/2711472388 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc6c0015020 con 0x7fc6cc143350 2023-09-30T22:59:21.790 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:59:21.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc6b8067330 msgr2=0x7fc6b80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc6b8067330 0x7fc6b80697e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0011e0 tx=0x7fc6bc009040 comp rx=0 tx=0).stop 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc143350 msgr2=0x7fc6cc16deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc143350 0x7fc6cc16deb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009fd0 tx=0x7fc6c0017000 comp rx=0 tx=0).stop 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 shutdown_connections 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc6b8067330 0x7fc6b80697e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc15dc50 0x7fc6cc0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc0692f0 0x7fc6cc16d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 --2- 172.21.15.142:0/2711472388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc143350 0x7fc6cc16deb0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 >> 172.21.15.142:0/2711472388 conn(0x7fc6cc0ce8e0 msgr2=0x7fc6cc142610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:21.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 shutdown_connections 2023-09-30T22:59:21.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:21.792+0000 7fc6d27ff700 1 -- 172.21.15.142:0/2711472388 wait complete. 2023-09-30T22:59:21.809 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T22:59:21.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:59:21.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T22:59:21.809 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T22:59:21.809 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T22:59:21.809 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T22:59:21.809 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T22:59:21.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:59:21.810 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:59:21.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:21.810 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T22:59:21.863 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:59:21.863 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:59:21.863 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:59:21.863 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:21.863 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T22:59:21.863 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:21.864 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41927sec preferred_lft 41927sec 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:59:21.865 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T22:59:21.866 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T22:59:21.866 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:21.866 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T22:59:21.866 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T22:59:21.866 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T22:59:21.866 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:59:21.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:21.866 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:59:21.937 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T22:59:21.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:21.940 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T22:59:21.989 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T22:59:21.989 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:59:21.989 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:59:21.989 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:59:21.989 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:59:21.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:21.991 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T22:59:21.991 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T22:59:21.991 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:59:21.991 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:59:21.991 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:59:21.991 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T22:59:22.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:22.160 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T22:59:22.205 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T22:59:22.205 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T22:59:22.206 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:59:22.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:22.207 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T22:59:22.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:59:22.317 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T22:59:22.363 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T22:59:22.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:59:22.363 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:59:22.447 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:59:22.447 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T22:59:22.447 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:59:22.587 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:59:22.587 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:59:22.587 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:59:22.601 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:59:22.601 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:59:22.601 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:59:22.602 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:59:22.602 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:59:22.623 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T22:59:22.623 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T22:59:22.623 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T22:59:22.623 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T22:59:22.624 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T22:59:22.624 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T22:59:22.624 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T22:59:22.624 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T22:59:22.629 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:59:22.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:22.629 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T22:59:22.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:22.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.898+0000 7fdf4a1ff700 1 Processor -- start 2023-09-30T22:59:22.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.898+0000 7fdf4a1ff700 1 -- start start 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf4a1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdf440b1580 0x7fdf440adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf4a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440ae000 0x7fdf4406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf4a1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440ad630 con 0x7fdf440b1950 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf4a1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf44157c20 con 0x7fdf440b1580 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf4a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440b3360 con 0x7fdf440ae000 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf437fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdf440b1580 0x7fdf440adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf42ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdf440b1950 0x7fdf4415a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50602/0 (socket says 172.21.15.142:50602) 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf42ffd700 1 -- 172.21.15.142:0/613780690 learned_addr learned my addr 172.21.15.142:0/613780690 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf43fff700 1 --2- 172.21.15.142:0/613780690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440ae000 0x7fdf4406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf427fc700 1 -- 172.21.15.142:0/613780690 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994488610 0 0) 0x7fdf440ad630 con 0x7fdf440b1950 2023-09-30T22:59:22.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf427fc700 1 -- 172.21.15.142:0/613780690 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf2c003570 con 0x7fdf440b1950 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.900+0000 7fdf437fe700 1 -- 172.21.15.142:0/613780690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440ae000 msgr2=0x7fdf4406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf437fe700 1 --2- 172.21.15.142:0/613780690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440ae000 0x7fdf4406a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf437fe700 1 -- 172.21.15.142:0/613780690 >> v1:172.21.15.142:6789/0 conn(0x7fdf440b1950 legacy=0x7fdf4415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf437fe700 1 -- 172.21.15.142:0/613780690 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4415ad60 con 0x7fdf440b1580 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf43fff700 1 --2- 172.21.15.142:0/613780690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440ae000 0x7fdf4406a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf437fe700 1 --2- 172.21.15.142:0/613780690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440b1580 0x7fdf440adac0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fdf340098e0 tx=0x7fdf340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c042bce5ba10c3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf427fc700 1 -- 172.21.15.142:0/613780690 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400b640 con 0x7fdf440b1580 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf427fc700 1 -- 172.21.15.142:0/613780690 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400b7a0 con 0x7fdf440b1580 2023-09-30T22:59:22.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.901+0000 7fdf427fc700 1 -- 172.21.15.142:0/613780690 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400bb40 con 0x7fdf440b1580 2023-09-30T22:59:22.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/613780690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440b1580 msgr2=0x7fdf440adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:22.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/613780690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440b1580 0x7fdf440adac0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fdf340098e0 tx=0x7fdf340091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:22.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/613780690 shutdown_connections 2023-09-30T22:59:22.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/613780690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440b1580 0x7fdf440adac0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:22.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/613780690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440ae000 0x7fdf4406a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:22.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/613780690 >> 172.21.15.142:0/613780690 conn(0x7fdf440ce1f0 msgr2=0x7fdf44069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:22.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/613780690 shutdown_connections 2023-09-30T22:59:22.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.902+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/613780690 wait complete. 2023-09-30T22:59:22.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.904+0000 7fdf4a1ff700 1 Processor -- start 2023-09-30T22:59:22.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.904+0000 7fdf4a1ff700 1 -- start start 2023-09-30T22:59:22.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.905+0000 7fdf4a1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440ae000 0x7fdf4416aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.905+0000 7fdf4a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440b1580 0x7fdf44155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.905+0000 7fdf4a1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf440b1950 0x7fdf440ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.905+0000 7fdf4a1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44155850 con 0x7fdf440ae000 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.905+0000 7fdf4a1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440ca140 con 0x7fdf440b1950 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.905+0000 7fdf4a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440ca6c0 con 0x7fdf440b1580 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.905+0000 7fdf437fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440ae000 0x7fdf4416aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440ae000 0x7fdf4416aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46164/0 (socket says 172.21.15.142:46164) 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 -- 172.21.15.142:0/1139167757 learned_addr learned my addr 172.21.15.142:0/1139167757 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf42ffd700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440b1580 0x7fdf44155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf43fff700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf440b1950 0x7fdf440ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 -- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440b1580 msgr2=0x7fdf44155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:22.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440b1580 0x7fdf44155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 -- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf440b1950 msgr2=0x7fdf440ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf440b1950 0x7fdf440ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 -- 172.21.15.142:0/1139167757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009420 con 0x7fdf440ae000 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf42ffd700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440b1580 0x7fdf44155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf437fe700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440ae000 0x7fdf4416aaa0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fdf440706b0 tx=0x7fdf34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf2b7fe700 1 -- 172.21.15.142:0/1139167757 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3401bda0 con 0x7fdf440ae000 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf2b7fe700 1 -- 172.21.15.142:0/1139167757 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34011420 con 0x7fdf440ae000 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf440cd0d0 con 0x7fdf440ae000 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.906+0000 7fdf2b7fe700 1 -- 172.21.15.142:0/1139167757 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340117e0 con 0x7fdf440ae000 2023-09-30T22:59:22.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.907+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf440c9400 con 0x7fdf440ae000 2023-09-30T22:59:22.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.907+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440c95c0 con 0x7fdf440ae000 2023-09-30T22:59:22.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.908+0000 7fdf2b7fe700 1 -- 172.21.15.142:0/1139167757 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdf34011b90 con 0x7fdf440ae000 2023-09-30T22:59:22.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.910+0000 7fdf2b7fe700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf30067330 0x7fdf300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:22.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.910+0000 7fdf2b7fe700 1 -- 172.21.15.142:0/1139167757 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf340862a0 con 0x7fdf440ae000 2023-09-30T22:59:22.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.910+0000 7fdf42ffd700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf30067330 0x7fdf300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:22.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.910+0000 7fdf42ffd700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf30067330 0x7fdf300697e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdf4415bd00 tx=0x7fdf38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:22.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:22.914+0000 7fdf2b7fe700 1 -- 172.21.15.142:0/1139167757 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdf34053100 con 0x7fdf440ae000 2023-09-30T22:59:23.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.146+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf4415b040 con 0x7fdf440ae000 2023-09-30T22:59:23.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.147+0000 7fdf2b7fe700 1 -- 172.21.15.142:0/1139167757 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fdf34056720 con 0x7fdf440ae000 2023-09-30T22:59:23.147 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:23.147 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:23.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf30067330 msgr2=0x7fdf300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:23.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf30067330 0x7fdf300697e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdf4415bd00 tx=0x7fdf38009040 comp rx=0 tx=0).stop 2023-09-30T22:59:23.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440ae000 msgr2=0x7fdf4416aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440ae000 0x7fdf4416aaa0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fdf440706b0 tx=0x7fdf34017000 comp rx=0 tx=0).stop 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 shutdown_connections 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf30067330 0x7fdf300697e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf440b1950 0x7fdf440ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf440ae000 0x7fdf4416aaa0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 --2- 172.21.15.142:0/1139167757 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf440b1580 0x7fdf44155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 >> 172.21.15.142:0/1139167757 conn(0x7fdf440ce1f0 msgr2=0x7fdf440c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 shutdown_connections 2023-09-30T22:59:23.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.149+0000 7fdf4a1ff700 1 -- 172.21.15.142:0/1139167757 wait complete. 2023-09-30T22:59:23.151 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:23.166 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:59:23.378 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6775,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.8599251720000005,"mdsmap_epoch":66,"osdmap_epoch":144,"osdmap_epoch_barrier":144,"uptime":15.584400608999999} 2023-09-30T22:59:23.379 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6775, "mdsmap_epoch": 66, "osdmap_epoch": 144, "osdmap_epoch_barrier": 144, "rank_uptime": 9.859925172, "state": "up:active", "uptime": 15.584400609, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:59:23.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-30T22:59:23.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.573+0000 7f99effff700 1 Processor -- start 2023-09-30T22:59:23.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.573+0000 7f99effff700 1 -- start start 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.574+0000 7f99effff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99e815ac40 0x7f99e815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.574+0000 7f99effff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80d04e0 con 0x7f99e80cc280 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.574+0000 7f99effff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80cc8f0 con 0x7f99e80cf180 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.574+0000 7f99effff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80cf8d0 con 0x7f99e815ac40 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99ee59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f99e80cc280 0x7f99e806a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50614/0 (socket says 172.21.15.142:50614) 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99ee59c700 1 -- 172.21.15.142:0/1938369183 learned_addr learned my addr 172.21.15.142:0/1938369183 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99edd9b700 1 --2- 172.21.15.142:0/1938369183 >> v2:172.21.15.142:3300/0 conn(0x7f99e815ac40 0x7f99e815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:23.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99ecd99700 1 -- 172.21.15.142:0/1938369183 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179681058 0 0) 0x7f99e80d04e0 con 0x7f99e80cc280 2023-09-30T22:59:23.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99ecd99700 1 -- 172.21.15.142:0/1938369183 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d4003570 con 0x7f99e80cc280 2023-09-30T22:59:23.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99edd9b700 1 -- 172.21.15.142:0/1938369183 >> v1:172.21.15.148:6789/0 conn(0x7f99e80cf180 legacy=0x7f99e80cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:23.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99edd9b700 1 -- 172.21.15.142:0/1938369183 >> v1:172.21.15.142:6789/0 conn(0x7f99e80cc280 legacy=0x7f99e806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:23.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99edd9b700 1 -- 172.21.15.142:0/1938369183 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80cfbb0 con 0x7f99e815ac40 2023-09-30T22:59:23.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99edd9b700 1 --2- 172.21.15.142:0/1938369183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e815a220 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f99e40098e0 tx=0x7f99e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef002578293b03fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:23.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.575+0000 7f99ecd99700 1 -- 172.21.15.142:0/1938369183 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e400b640 con 0x7f99e815ac40 2023-09-30T22:59:23.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99ecd99700 1 -- 172.21.15.142:0/1938369183 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e400b7a0 con 0x7f99e815ac40 2023-09-30T22:59:23.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99ecd99700 1 -- 172.21.15.142:0/1938369183 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e400bb40 con 0x7f99e815ac40 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99effff700 1 -- 172.21.15.142:0/1938369183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 msgr2=0x7f99e815a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99effff700 1 --2- 172.21.15.142:0/1938369183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e815a220 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f99e40098e0 tx=0x7f99e40091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99effff700 1 -- 172.21.15.142:0/1938369183 shutdown_connections 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99effff700 1 --2- 172.21.15.142:0/1938369183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e815a220 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99effff700 1 -- 172.21.15.142:0/1938369183 >> 172.21.15.142:0/1938369183 conn(0x7f99e80d0a80 msgr2=0x7f99e80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99effff700 1 -- 172.21.15.142:0/1938369183 shutdown_connections 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.576+0000 7f99effff700 1 -- 172.21.15.142:0/1938369183 wait complete. 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.578+0000 7f99effff700 1 Processor -- start 2023-09-30T22:59:23.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.578+0000 7f99effff700 1 -- start start 2023-09-30T22:59:23.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99effff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99e80cc280 0x7f99e814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:23.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99effff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99e80cf180 0x7f99e8156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:23.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99effff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e8159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99effff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80c7000 con 0x7f99e815ac40 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99effff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8155490 con 0x7f99e80cf180 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99effff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8154880 con 0x7f99e80cc280 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e8159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e8159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46182/0 (socket says 172.21.15.142:46182) 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 -- 172.21.15.142:0/2691205947 learned_addr learned my addr 172.21.15.142:0/2691205947 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ed59a700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99e80cf180 0x7f99e8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99edd9b700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99e80cc280 0x7f99e814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 -- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99e80cc280 msgr2=0x7f99e814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:23.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99e80cc280 0x7f99e814f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 -- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99e80cf180 msgr2=0x7f99e8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99e80cf180 0x7f99e8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.579+0000 7f99ee59c700 1 -- 172.21.15.142:0/2691205947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4009420 con 0x7f99e815ac40 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.580+0000 7f99ee59c700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e8159230 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f99e000cc40 tx=0x7f99e0001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.580+0000 7f99ddffb700 1 -- 172.21.15.142:0/2691205947 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000a9c0 con 0x7f99e815ac40 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.580+0000 7f99ddffb700 1 -- 172.21.15.142:0/2691205947 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000ab20 con 0x7f99e815ac40 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.580+0000 7f99ddffb700 1 -- 172.21.15.142:0/2691205947 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000aea0 con 0x7f99e815ac40 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.580+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e8154b60 con 0x7f99e815ac40 2023-09-30T22:59:23.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.580+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e8155120 con 0x7f99e815ac40 2023-09-30T22:59:23.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.581+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e8155620 con 0x7f99e815ac40 2023-09-30T22:59:23.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.582+0000 7f99ddffb700 1 -- 172.21.15.142:0/2691205947 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f99e0007300 con 0x7f99e815ac40 2023-09-30T22:59:23.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.583+0000 7f99ddffb700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f99cc067330 0x7f99cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:23.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.583+0000 7f99ddffb700 1 -- 172.21.15.142:0/2691205947 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f99e00851b0 con 0x7f99e815ac40 2023-09-30T22:59:23.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.583+0000 7f99edd9b700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f99cc067330 0x7f99cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:23.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.584+0000 7f99edd9b700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f99cc067330 0x7f99cc0697e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f99e40093f0 tx=0x7f99e4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:23.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.588+0000 7f99ddffb700 1 -- 172.21.15.142:0/2691205947 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f99e0052000 con 0x7f99e815ac40 2023-09-30T22:59:23.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:23.780+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f99e80c78d0 con 0x7f99e815ac40 2023-09-30T22:59:24.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.567+0000 7f99ddffb700 1 -- 172.21.15.142:0/2691205947 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v145) v1 ==== 181+0+0 (secure 0 0 0) 0x7f99e0055620 con 0x7f99e815ac40 2023-09-30T22:59:24.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f99cc067330 msgr2=0x7f99cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f99cc067330 0x7f99cc0697e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f99e40093f0 tx=0x7f99e4017000 comp rx=0 tx=0).stop 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 msgr2=0x7f99e8159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e8159230 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f99e000cc40 tx=0x7f99e0001aa0 comp rx=0 tx=0).stop 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 shutdown_connections 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f99cc067330 0x7f99cc0697e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e815ac40 0x7f99e8159230 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99e80cc280 0x7f99e814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 --2- 172.21.15.142:0/2691205947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99e80cf180 0x7f99e8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.570+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 >> 172.21.15.142:0/2691205947 conn(0x7f99e80d0a80 msgr2=0x7f99e80c85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.571+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 shutdown_connections 2023-09-30T22:59:24.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:24.571+0000 7f99effff700 1 -- 172.21.15.142:0/2691205947 wait complete. 2023-09-30T22:59:24.573 INFO:teuthology.orchestra.run.smithi142.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-30T22:59:24.591 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T22:59:24.801 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T22:59:24.802 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T22:59:24.802 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-09-30T22:59:24.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:24.802 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-09-30T22:59:24.980 INFO:teuthology.orchestra.run.smithi142.stderr:16+0 records in 2023-09-30T22:59:24.980 INFO:teuthology.orchestra.run.smithi142.stderr:16+0 records out 2023-09-30T22:59:24.980 INFO:teuthology.orchestra.run.smithi142.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.128129 s, 131 MB/s 2023-09-30T22:59:24.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:24.981 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-09-30T22:59:25.166 INFO:teuthology.orchestra.run.smithi142.stderr:17+0 records in 2023-09-30T22:59:25.166 INFO:teuthology.orchestra.run.smithi142.stderr:17+0 records out 2023-09-30T22:59:25.166 INFO:teuthology.orchestra.run.smithi142.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.137117 s, 130 MB/s 2023-09-30T22:59:25.167 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-30T22:59:25.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:59:25.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.355+0000 7f91f7dff700 1 Processor -- start 2023-09-30T22:59:25.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.355+0000 7f91f7dff700 1 -- start start 2023-09-30T22:59:25.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.356+0000 7f91f7dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91f00aebf0 0x7f91f006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.356+0000 7f91f7dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f006f190 0x7f91f0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.356+0000 7f91f7dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91f015a0d0 0x7f91f0156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.356+0000 7f91f7dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f00aefc0 con 0x7f91f015a0d0 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.356+0000 7f91f7dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f015a550 con 0x7f91f00aebf0 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.356+0000 7f91f7dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00b0ee0 con 0x7f91f006f190 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91f015a0d0 0x7f91f0156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f539a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f006f190 0x7f91f0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f5b9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91f00aebf0 0x7f91f006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91f015a0d0 0x7f91f0156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46188/0 (socket says 172.21.15.142:46188) 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 -- 172.21.15.142:0/1172443050 learned_addr learned my addr 172.21.15.142:0/1172443050 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 -- 172.21.15.142:0/1172443050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f006f190 msgr2=0x7f91f0159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:25.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 --2- 172.21.15.142:0/1172443050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f006f190 0x7f91f0159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 -- 172.21.15.142:0/1172443050 >> v2:172.21.15.148:3300/0 conn(0x7f91f00aebf0 msgr2=0x7f91f006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:25.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 --2- 172.21.15.142:0/1172443050 >> v2:172.21.15.148:3300/0 conn(0x7f91f00aebf0 0x7f91f006ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.357+0000 7f91f639c700 1 -- 172.21.15.142:0/1172443050 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00b02d0 con 0x7f91f015a0d0 2023-09-30T22:59:25.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f639c700 1 --2- 172.21.15.142:0/1172443050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f015a0d0 0x7f91f0156590 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f91f0063d00 tx=0x7f91e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58733838873e57e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:25.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f4b99700 1 -- 172.21.15.142:0/1172443050 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800e070 con 0x7f91f015a0d0 2023-09-30T22:59:25.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f4b99700 1 -- 172.21.15.142:0/1172443050 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e800b930 con 0x7f91f015a0d0 2023-09-30T22:59:25.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f4b99700 1 -- 172.21.15.142:0/1172443050 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80092e0 con 0x7f91f015a0d0 2023-09-30T22:59:25.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 -- 172.21.15.142:0/1172443050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f015a0d0 msgr2=0x7f91f0156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:25.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1172443050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f015a0d0 0x7f91f0156590 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f91f0063d00 tx=0x7f91e8009840 comp rx=0 tx=0).stop 2023-09-30T22:59:25.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 -- 172.21.15.142:0/1172443050 shutdown_connections 2023-09-30T22:59:25.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1172443050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f015a0d0 0x7f91f0156590 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1172443050 >> v2:172.21.15.148:3300/0 conn(0x7f91f00aebf0 0x7f91f006ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1172443050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f006f190 0x7f91f0159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 -- 172.21.15.142:0/1172443050 >> 172.21.15.142:0/1172443050 conn(0x7f91f00680c0 msgr2=0x7f91f00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:25.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.358+0000 7f91f7dff700 1 -- 172.21.15.142:0/1172443050 shutdown_connections 2023-09-30T22:59:25.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.359+0000 7f91f7dff700 1 -- 172.21.15.142:0/1172443050 wait complete. 2023-09-30T22:59:25.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.360+0000 7f91f7dff700 1 Processor -- start 2023-09-30T22:59:25.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.360+0000 7f91f7dff700 1 -- start start 2023-09-30T22:59:25.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f7dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f006f190 0x7f91f00c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f7dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f00aebf0 0x7f91f00c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f7dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f015a0d0 0x7f91f0149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f7dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c7410 con 0x7f91f00aebf0 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f7dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c6980 con 0x7f91f006f190 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f7dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f01565b0 con 0x7f91f015a0d0 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f539a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f00aebf0 0x7f91f00c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f539a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f00aebf0 0x7f91f00c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46194/0 (socket says 172.21.15.142:46194) 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f539a700 1 -- 172.21.15.142:0/1707189663 learned_addr learned my addr 172.21.15.142:0/1707189663 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f5b9b700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f006f190 0x7f91f00c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.361+0000 7f91f639c700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f015a0d0 0x7f91f0149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:25.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f539a700 1 -- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f015a0d0 msgr2=0x7f91f0149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f539a700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f015a0d0 0x7f91f0149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f539a700 1 -- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f006f190 msgr2=0x7f91f00c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f539a700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f006f190 0x7f91f00c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f539a700 1 -- 172.21.15.142:0/1707189663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8009ae0 con 0x7f91f00aebf0 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f539a700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f00aebf0 0x7f91f00c6440 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f91e000ec50 tx=0x7f91e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91e5ffb700 1 -- 172.21.15.142:0/1707189663 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000c850 con 0x7f91f00aebf0 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91e5ffb700 1 -- 172.21.15.142:0/1707189663 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e000c9b0 con 0x7f91f00aebf0 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f00c6b70 con 0x7f91f00aebf0 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91e5ffb700 1 -- 172.21.15.142:0/1707189663 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000cd70 con 0x7f91f00aebf0 2023-09-30T22:59:25.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.362+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f00c7130 con 0x7f91f00aebf0 2023-09-30T22:59:25.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.363+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f00695b0 con 0x7f91f00aebf0 2023-09-30T22:59:25.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.364+0000 7f91e5ffb700 1 -- 172.21.15.142:0/1707189663 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f91e0013680 con 0x7f91f00aebf0 2023-09-30T22:59:25.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.365+0000 7f91e5ffb700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d4067330 0x7f91d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:25.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.365+0000 7f91e5ffb700 1 -- 172.21.15.142:0/1707189663 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f91e0084e60 con 0x7f91f00aebf0 2023-09-30T22:59:25.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.365+0000 7f91f5b9b700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d4067330 0x7f91d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:25.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.366+0000 7f91f5b9b700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d4067330 0x7f91d40697e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00b240 tx=0x7f91ec00b430 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:25.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.370+0000 7f91e5ffb700 1 -- 172.21.15.142:0/1707189663 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f91e0051cc0 con 0x7f91f00aebf0 2023-09-30T22:59:25.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.563+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f91f01566f0 con 0x7f91f00aebf0 2023-09-30T22:59:25.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.565+0000 7f91e5ffb700 1 -- 172.21.15.142:0/1707189663 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+34984 (secure 0 0 0) 0x7f91e00552e0 con 0x7f91f00aebf0 2023-09-30T22:59:25.566 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:25.566 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:25.566 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 145, 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:59:24.561296+0000", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:59:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 18, 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:59:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:59:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 17, 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.103746+0000", 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:59:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "143", 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:59:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 18, 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.960192+0000", 2023-09-30T22:59:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "145", 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.594 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:59:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:59:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:59:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:59:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:59:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:59:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.649 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:59:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:59:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:59:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:59:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:59:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:25.653 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:25.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d4067330 msgr2=0x7f91d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:25.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d4067330 0x7f91d40697e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00b240 tx=0x7f91ec00b430 comp rx=0 tx=0).stop 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f00aebf0 msgr2=0x7f91f00c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f00aebf0 0x7f91f00c6440 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f91e000ec50 tx=0x7f91e00091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 shutdown_connections 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f91d4067330 0x7f91d40697e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91f015a0d0 0x7f91f0149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91f006f190 0x7f91f00c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 --2- 172.21.15.142:0/1707189663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f00aebf0 0x7f91f00c6440 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.567+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 >> 172.21.15.142:0/1707189663 conn(0x7f91f00680c0 msgr2=0x7f91f00631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.568+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 shutdown_connections 2023-09-30T22:59:25.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:25.568+0000 7f91f7dff700 1 -- 172.21.15.142:0/1707189663 wait complete. 2023-09-30T22:59:25.656 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:59:30.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:59:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.854+0000 7ff85bbff700 1 Processor -- start 2023-09-30T22:59:30.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.854+0000 7ff85bbff700 1 -- start start 2023-09-30T22:59:30.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85bbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8540b1580 0x7ff8540adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85bbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8540ad630 con 0x7ff8540b1950 2023-09-30T22:59:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85bbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8540b3360 con 0x7ff8540ae000 2023-09-30T22:59:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85bbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff854157c20 con 0x7ff8540b1580 2023-09-30T22:59:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85999b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8540b1580 0x7ff8540adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85919a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff8540b1950 0x7ff85415a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50630/0 (socket says 172.21.15.142:50630) 2023-09-30T22:59:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85919a700 1 -- 172.21.15.142:0/2789735885 learned_addr learned my addr 172.21.15.142:0/2789735885 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff858999700 1 -- 172.21.15.142:0/2789735885 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904917910 0 0) 0x7ff8540ad630 con 0x7ff8540b1950 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85999b700 1 -- 172.21.15.142:0/2789735885 >> v1:172.21.15.148:6789/0 conn(0x7ff8540ae000 legacy=0x7ff85406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85999b700 1 -- 172.21.15.142:0/2789735885 >> v1:172.21.15.142:6789/0 conn(0x7ff8540b1950 legacy=0x7ff85415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.856+0000 7ff85999b700 1 -- 172.21.15.142:0/2789735885 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85415ad60 con 0x7ff8540b1580 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.857+0000 7ff85999b700 1 --2- 172.21.15.142:0/2789735885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1580 0x7ff8540adac0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff8500098e0 tx=0x7ff8500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a36a9b64ca63144 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.857+0000 7ff858999700 1 -- 172.21.15.142:0/2789735885 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850009e80 con 0x7ff8540b1580 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.857+0000 7ff858999700 1 -- 172.21.15.142:0/2789735885 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85000b860 con 0x7ff8540b1580 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.857+0000 7ff858999700 1 -- 172.21.15.142:0/2789735885 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000bbe0 con 0x7ff8540b1580 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.857+0000 7ff85bbff700 1 -- 172.21.15.142:0/2789735885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1580 msgr2=0x7ff8540adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.857+0000 7ff85bbff700 1 --2- 172.21.15.142:0/2789735885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1580 0x7ff8540adac0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff8500098e0 tx=0x7ff8500091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:30.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.858+0000 7ff85bbff700 1 -- 172.21.15.142:0/2789735885 shutdown_connections 2023-09-30T22:59:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.858+0000 7ff85bbff700 1 --2- 172.21.15.142:0/2789735885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1580 0x7ff8540adac0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.858+0000 7ff85bbff700 1 -- 172.21.15.142:0/2789735885 >> 172.21.15.142:0/2789735885 conn(0x7ff8540ce1f0 msgr2=0x7ff854069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.858+0000 7ff85bbff700 1 -- 172.21.15.142:0/2789735885 shutdown_connections 2023-09-30T22:59:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.858+0000 7ff85bbff700 1 -- 172.21.15.142:0/2789735885 wait complete. 2023-09-30T22:59:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.859+0000 7ff85bbff700 1 Processor -- start 2023-09-30T22:59:30.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.859+0000 7ff85bbff700 1 -- start start 2023-09-30T22:59:30.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.860+0000 7ff85bbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8540ae000 0x7ff8540cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:30.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.860+0000 7ff85bbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8540b1580 0x7ff85414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:30.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.860+0000 7ff85bbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1950 0x7ff85414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.860+0000 7ff85bbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540cc610 con 0x7ff8540b1950 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.860+0000 7ff85bbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff854158f10 con 0x7ff8540b1580 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.860+0000 7ff85bbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff854150550 con 0x7ff8540ae000 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1950 0x7ff85414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85999b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8540ae000 0x7ff8540cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85999b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8540ae000 0x7ff8540cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:47164/0 (socket says 172.21.15.142:47164) 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85999b700 1 -- 172.21.15.142:0/3631049603 learned_addr learned my addr 172.21.15.142:0/3631049603 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1950 0x7ff85414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46216/0 (socket says 172.21.15.142:46216) 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85919a700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8540b1580 0x7ff85414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 -- 172.21.15.142:0/3631049603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8540ae000 msgr2=0x7ff8540cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:30.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8540ae000 0x7ff8540cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 -- 172.21.15.142:0/3631049603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8540b1580 msgr2=0x7ff85414d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8540b1580 0x7ff85414d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 -- 172.21.15.142:0/3631049603 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850009420 con 0x7ff8540b1950 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.861+0000 7ff85a19c700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1950 0x7ff85414e490 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c860 tx=0x7ff84c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.862+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c012630 con 0x7ff8540b1950 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.862+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c012790 con 0x7ff8540b1950 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.862+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c012b50 con 0x7ff8540b1950 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.862+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff854150d90 con 0x7ff8540b1950 2023-09-30T22:59:30.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.862+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff854150ab0 con 0x7ff8540b1950 2023-09-30T22:59:30.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.863+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8541590c0 con 0x7ff8540b1950 2023-09-30T22:59:30.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.864+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff84c011380 con 0x7ff8540b1950 2023-09-30T22:59:30.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.865+0000 7ff849ffb700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff838067330 0x7ff8380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:30.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.865+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff84c084c40 con 0x7ff8540b1950 2023-09-30T22:59:30.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.865+0000 7ff85999b700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff838067330 0x7ff8380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:30.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.865+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7ff83806f4f0 con 0x7ff8540b1950 2023-09-30T22:59:30.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.865+0000 7ff85999b700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff838067330 0x7ff8380697e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff8500093c0 tx=0x7ff850017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:30.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:30.869+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff8541590c0 con 0x7ff8540b1950 2023-09-30T22:59:31.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.059+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff8541590c0 con 0x7ff8540b1950 2023-09-30T22:59:31.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.060+0000 7ff849ffb700 1 -- 172.21.15.142:0/3631049603 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+35003 (secure 0 0 0) 0x7ff8541590c0 con 0x7ff8540b1950 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 146, 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:59:29.327050+0000", 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:59:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:59:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 18, 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:59:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 17, 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.103746+0000", 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:59:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "143", 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 18, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.960192+0000", 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1027, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "146", 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:59:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.097 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.098 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:59:31.101 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:59:31.102 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.103 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.105 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.106 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.107 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:59:31.108 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.110 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:59:31.113 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:59:31.115 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.116 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:59:31.121 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.123 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:59:31.125 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.128 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.129 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:59:31.132 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:59:31.134 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.135 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:59:31.140 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.141 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:31.142 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.143 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.144 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.145 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.146 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.147 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.148 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.149 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:59:31.150 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:59:31.151 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:59:31.152 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:59:31.152 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:59:31.152 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:59:31.152 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.152 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:31.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff838067330 msgr2=0x7ff8380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff838067330 0x7ff8380697e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff8500093c0 tx=0x7ff850017000 comp rx=0 tx=0).stop 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1950 msgr2=0x7ff85414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1950 0x7ff85414e490 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c860 tx=0x7ff84c001690 comp rx=0 tx=0).stop 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 shutdown_connections 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff838067330 0x7ff8380697e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8540b1950 0x7ff85414e490 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8540ae000 0x7ff8540cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 --2- 172.21.15.142:0/3631049603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8540b1580 0x7ff85414d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 >> 172.21.15.142:0/3631049603 conn(0x7ff8540ce1f0 msgr2=0x7ff8540b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:31.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 shutdown_connections 2023-09-30T22:59:31.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.063+0000 7ff85bbff700 1 -- 172.21.15.142:0/3631049603 wait complete. 2023-09-30T22:59:31.155 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-30T22:59:31.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:31.155 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-09-30T22:59:31.493 INFO:teuthology.orchestra.run.smithi142.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-30T22:59:31.493 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T22:59:31.493 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T22:59:31.493 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.288274 s, 182 MB/s 2023-09-30T22:59:31.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:59:31.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:59:31.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.683+0000 7f92eedff700 1 Processor -- start 2023-09-30T22:59:31.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.684+0000 7f92eedff700 1 -- start start 2023-09-30T22:59:31.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92eedff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92e80b1580 0x7f92e80adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:31.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92eedff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92e80b1950 0x7f92e815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:31.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92eedff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e80ad630 con 0x7f92e80ae000 2023-09-30T22:59:31.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92eedff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e8157c20 con 0x7f92e80b1950 2023-09-30T22:59:31.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92eedff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e80b3360 con 0x7f92e80b1580 2023-09-30T22:59:31.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92e7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92e80b1950 0x7f92e815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:31.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92e7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92e80b1950 0x7f92e815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40436/0 (socket says 172.21.15.142:40436) 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.685+0000 7f92e7fff700 1 -- 172.21.15.142:0/68326828 learned_addr learned my addr 172.21.15.142:0/68326828 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92ecb9b700 1 --2- 172.21.15.142:0/68326828 >> v2:172.21.15.148:3300/0 conn(0x7f92e80b1580 0x7f92e80adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e7fff700 1 -- 172.21.15.142:0/68326828 >> v2:172.21.15.148:3300/0 conn(0x7f92e80b1580 msgr2=0x7f92e80adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e7fff700 1 --2- 172.21.15.142:0/68326828 >> v2:172.21.15.148:3300/0 conn(0x7f92e80b1580 0x7f92e80adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e7fff700 1 -- 172.21.15.142:0/68326828 >> v1:172.21.15.148:6789/0 conn(0x7f92e80ae000 legacy=0x7f92e806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e7fff700 1 -- 172.21.15.142:0/68326828 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e815ad60 con 0x7f92e80b1950 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92ecb9b700 1 --2- 172.21.15.142:0/68326828 >> v2:172.21.15.148:3300/0 conn(0x7f92e80b1580 0x7f92e80adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e7fff700 1 --2- 172.21.15.142:0/68326828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e815a180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f92e806c8a0 tx=0x7f92d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9ff72f2dbc3633 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e77fe700 1 -- 172.21.15.142:0/68326828 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400b820 con 0x7f92e80b1950 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e77fe700 1 -- 172.21.15.142:0/68326828 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d400b980 con 0x7f92e80b1950 2023-09-30T22:59:31.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.686+0000 7f92e77fe700 1 -- 172.21.15.142:0/68326828 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400bd20 con 0x7f92e80b1950 2023-09-30T22:59:31.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 -- 172.21.15.142:0/68326828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 msgr2=0x7f92e815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 --2- 172.21.15.142:0/68326828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e815a180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f92e806c8a0 tx=0x7f92d4009250 comp rx=0 tx=0).stop 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 -- 172.21.15.142:0/68326828 shutdown_connections 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 --2- 172.21.15.142:0/68326828 >> v2:172.21.15.148:3300/0 conn(0x7f92e80b1580 0x7f92e80adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 --2- 172.21.15.142:0/68326828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e815a180 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 -- 172.21.15.142:0/68326828 >> 172.21.15.142:0/68326828 conn(0x7f92e80ce1f0 msgr2=0x7f92e8069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 -- 172.21.15.142:0/68326828 shutdown_connections 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.687+0000 7f92eedff700 1 -- 172.21.15.142:0/68326828 wait complete. 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.688+0000 7f92eedff700 1 Processor -- start 2023-09-30T22:59:31.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.689+0000 7f92eedff700 1 -- start start 2023-09-30T22:59:31.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.689+0000 7f92eedff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92e80ae000 0x7f92e8140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:31.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92eedff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92e80b1580 0x7f92e8159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:31.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92eedff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e8159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:31.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92eedff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80ac430 con 0x7f92e80b1950 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92eedff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80ac710 con 0x7f92e80ae000 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92eedff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80ca140 con 0x7f92e80b1580 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e8159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e8159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40452/0 (socket says 172.21.15.142:40452) 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 -- 172.21.15.142:0/2806825783 learned_addr learned my addr 172.21.15.142:0/2806825783 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ecb9b700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92e80ae000 0x7f92e8140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92e7fff700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92e80b1580 0x7f92e8159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 -- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92e80b1580 msgr2=0x7f92e8159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92e80b1580 0x7f92e8159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 -- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92e80ae000 msgr2=0x7f92e8140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92e80ae000 0x7f92e8140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.690+0000 7f92ed39c700 1 -- 172.21.15.142:0/2806825783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40094f0 con 0x7f92e80b1950 2023-09-30T22:59:31.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.691+0000 7f92ed39c700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e8159780 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c930 tx=0x7f92e00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:31.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.691+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0012630 con 0x7f92e80b1950 2023-09-30T22:59:31.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.691+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e00127d0 con 0x7f92e80b1950 2023-09-30T22:59:31.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.691+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e80ca420 con 0x7f92e80b1950 2023-09-30T22:59:31.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.691+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0012b90 con 0x7f92e80b1950 2023-09-30T22:59:31.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.691+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e81408a0 con 0x7f92e80b1950 2023-09-30T22:59:31.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.692+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e80ca940 con 0x7f92e80b1950 2023-09-30T22:59:31.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.693+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f92e001b400 con 0x7f92e80b1950 2023-09-30T22:59:31.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.694+0000 7f92e4ff9700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f92cc067330 0x7f92cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:31.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.694+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f92e0084e30 con 0x7f92e80b1950 2023-09-30T22:59:31.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.694+0000 7f92ecb9b700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f92cc067330 0x7f92cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:31.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.694+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f92cc06f4f0 con 0x7f92e80b1950 2023-09-30T22:59:31.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.694+0000 7f92ecb9b700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f92cc067330 0x7f92cc0697e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92e8070d70 tx=0x7f92dc006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:31.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.698+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f92e80ca940 con 0x7f92e80b1950 2023-09-30T22:59:31.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.888+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f92e80ca940 con 0x7f92e80b1950 2023-09-30T22:59:31.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.889+0000 7f92e4ff9700 1 -- 172.21.15.142:0/2806825783 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+35003 (secure 0 0 0) 0x7f92e80ca940 con 0x7f92e80b1950 2023-09-30T22:59:31.890 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:31.890 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:31.890 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 146, 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:59:29.327050+0000", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:59:31.891 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 18, 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:59:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.894 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.895 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.896 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.897 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:59:31.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.899 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:59:31.900 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.901 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.902 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.903 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 17, 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.103746+0000", 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:31.905 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:59:31.906 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "143", 2023-09-30T22:59:31.907 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.908 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.909 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.910 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 18, 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.960192+0000", 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1027, 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:31.912 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:31.913 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "146", 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:31.914 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:31.915 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:31.916 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:59:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.920 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.921 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:59:31.922 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.923 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.925 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.926 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.929 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:59:31.930 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.931 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.932 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.935 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:59:31.936 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.938 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.939 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.940 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.942 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:59:31.943 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.944 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:59:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.947 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.948 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:59:31.949 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.950 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.951 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:59:31.952 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.953 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:59:31.955 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:59:31.956 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.958 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.959 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.961 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:59:31.963 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:59:31.964 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:31.965 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:59:31.966 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.967 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.969 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.970 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.971 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:31.972 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.973 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.974 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.975 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:31.977 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:59:31.978 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:59:31.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:31.981 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:31.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f92cc067330 msgr2=0x7f92cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:31.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f92cc067330 0x7f92cc0697e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92e8070d70 tx=0x7f92dc006f90 comp rx=0 tx=0).stop 2023-09-30T22:59:31.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 msgr2=0x7f92e8159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e8159780 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c930 tx=0x7f92e00026e0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 shutdown_connections 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f92cc067330 0x7f92cc0697e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80b1950 0x7f92e8159780 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92e80ae000 0x7f92e8140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 --2- 172.21.15.142:0/2806825783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92e80b1580 0x7f92e8159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 >> 172.21.15.142:0/2806825783 conn(0x7f92e80ce1f0 msgr2=0x7f92e806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 shutdown_connections 2023-09-30T22:59:31.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:31.891+0000 7f92eedff700 1 -- 172.21.15.142:0/2806825783 wait complete. 2023-09-30T22:59:31.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:32.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.174+0000 7f06a2dff700 1 Processor -- start 2023-09-30T22:59:32.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.174+0000 7f06a2dff700 1 -- start start 2023-09-30T22:59:32.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.175+0000 7f06a2dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f069c15dee0 0x7f069c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.175+0000 7f06a2dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c06b8d0 con 0x7f069c0cee50 2023-09-30T22:59:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.175+0000 7f06a2dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0cff40 con 0x7f069c1598e0 2023-09-30T22:59:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.175+0000 7f06a2dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c0cf330 con 0x7f069c15dee0 2023-09-30T22:59:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.176+0000 7f06a139c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f069c15dee0 0x7f069c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.176+0000 7f069bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f069c0cee50 0x7f069c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:38116/0 (socket says 172.21.15.142:38116) 2023-09-30T22:59:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.176+0000 7f069bfff700 1 -- 172.21.15.142:0/469450034 learned_addr learned my addr 172.21.15.142:0/469450034 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:32.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.176+0000 7f06a139c700 1 -- 172.21.15.142:0/469450034 >> v1:172.21.15.148:6789/0 conn(0x7f069c1598e0 legacy=0x7f069c06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:32.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.176+0000 7f06a139c700 1 -- 172.21.15.142:0/469450034 >> v1:172.21.15.142:6789/0 conn(0x7f069c0cee50 legacy=0x7f069c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.176+0000 7f06a139c700 1 -- 172.21.15.142:0/469450034 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0cf610 con 0x7f069c15dee0 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.176+0000 7f06a139c700 1 --2- 172.21.15.142:0/469450034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c15dee0 0x7f069c159cb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0694009e60 tx=0x7f0694009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca1708b63455da0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f069b7fe700 1 -- 172.21.15.142:0/469450034 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069400e070 con 0x7f069c15dee0 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f069b7fe700 1 -- 172.21.15.142:0/469450034 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400bbf0 con 0x7f069c15dee0 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f069b7fe700 1 -- 172.21.15.142:0/469450034 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694012430 con 0x7f069c15dee0 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f06a2dff700 1 -- 172.21.15.142:0/469450034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c15dee0 msgr2=0x7f069c159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f06a2dff700 1 --2- 172.21.15.142:0/469450034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c15dee0 0x7f069c159cb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0694009e60 tx=0x7f0694009780 comp rx=0 tx=0).stop 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f06a2dff700 1 -- 172.21.15.142:0/469450034 shutdown_connections 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f06a2dff700 1 --2- 172.21.15.142:0/469450034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c15dee0 0x7f069c159cb0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f06a2dff700 1 -- 172.21.15.142:0/469450034 >> 172.21.15.142:0/469450034 conn(0x7f069c0cd540 msgr2=0x7f069c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f06a2dff700 1 -- 172.21.15.142:0/469450034 shutdown_connections 2023-09-30T22:59:32.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.177+0000 7f06a2dff700 1 -- 172.21.15.142:0/469450034 wait complete. 2023-09-30T22:59:32.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.179+0000 7f06a2dff700 1 Processor -- start 2023-09-30T22:59:32.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.179+0000 7f06a2dff700 1 -- start start 2023-09-30T22:59:32.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a2dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069c0cee50 0x7f069c157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a2dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c1598e0 0x7f069c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a2dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f069c15dee0 0x7f069c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a2dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c15cf50 con 0x7f069c1598e0 2023-09-30T22:59:32.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a2dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0b2d40 con 0x7f069c0cee50 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a2dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0cb730 con 0x7f069c15dee0 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f069bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c1598e0 0x7f069c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f069bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c1598e0 0x7f069c15c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40474/0 (socket says 172.21.15.142:40474) 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f069bfff700 1 -- 172.21.15.142:0/1848896385 learned_addr learned my addr 172.21.15.142:0/1848896385 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a0b9b700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069c0cee50 0x7f069c157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.180+0000 7f06a139c700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f069c15dee0 0x7f069c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f069bfff700 1 -- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f069c15dee0 msgr2=0x7f069c158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f069bfff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f069c15dee0 0x7f069c158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f069bfff700 1 -- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069c0cee50 msgr2=0x7f069c157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f069bfff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069c0cee50 0x7f069c157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f069bfff700 1 -- 172.21.15.142:0/1848896385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694009a20 con 0x7f069c1598e0 2023-09-30T22:59:32.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f06a139c700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f069c15dee0 0x7f069c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:32.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f069bfff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c1598e0 0x7f069c15c200 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f068800c560 tx=0x7f0688001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:32.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688005b30 con 0x7f069c1598e0 2023-09-30T22:59:32.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688005cb0 con 0x7f069c1598e0 2023-09-30T22:59:32.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c0cba10 con 0x7f069c1598e0 2023-09-30T22:59:32.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688007320 con 0x7f069c1598e0 2023-09-30T22:59:32.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.181+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c0cb420 con 0x7f069c1598e0 2023-09-30T22:59:32.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.182+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c0cbf30 con 0x7f069c1598e0 2023-09-30T22:59:32.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.183+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0688007690 con 0x7f069c1598e0 2023-09-30T22:59:32.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.184+0000 7f0698ff9700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0680067330 0x7f06800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.184+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0688084090 con 0x7f069c1598e0 2023-09-30T22:59:32.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.184+0000 7f06a0b9b700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0680067330 0x7f06800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.184+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f068006f4f0 con 0x7f069c1598e0 2023-09-30T22:59:32.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.185+0000 7f06a0b9b700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0680067330 0x7f06800697e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0690003a30 tx=0x7f0690007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:32.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.188+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0688017060 con 0x7f069c1598e0 2023-09-30T22:59:32.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.417+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f069c0d08b0 con 0x7f069c1598e0 2023-09-30T22:59:32.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.418+0000 7f0698ff9700 1 -- 172.21.15.142:0/1848896385 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f069c0cbf30 con 0x7f069c1598e0 2023-09-30T22:59:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:32.419 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:32.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0680067330 msgr2=0x7f06800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0680067330 0x7f06800697e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0690003a30 tx=0x7f0690007ea0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c1598e0 msgr2=0x7f069c15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c1598e0 0x7f069c15c200 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f068800c560 tx=0x7f0688001020 comp rx=0 tx=0).stop 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 shutdown_connections 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0680067330 0x7f06800697e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f069c15dee0 0x7f069c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f069c0cee50 0x7f069c157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.420+0000 7f06a2dff700 1 --2- 172.21.15.142:0/1848896385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f069c1598e0 0x7f069c15c200 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.421+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 >> 172.21.15.142:0/1848896385 conn(0x7f069c0cd540 msgr2=0x7f069c0b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:32.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.421+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 shutdown_connections 2023-09-30T22:59:32.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.421+0000 7f06a2dff700 1 -- 172.21.15.142:0/1848896385 wait complete. 2023-09-30T22:59:32.423 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:32.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:59:32.654 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6775,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":19.136104804999999,"mdsmap_epoch":66,"osdmap_epoch":146,"osdmap_epoch_barrier":146,"uptime":24.860580476999999} 2023-09-30T22:59:32.655 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6775, "mdsmap_epoch": 66, "osdmap_epoch": 146, "osdmap_epoch_barrier": 146, "rank_uptime": 19.136104805, "state": "up:active", "uptime": 24.860580477, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:59:32.655 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:59:32.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:32.655 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-30T22:59:32.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:32.703 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-30T22:59:32.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:59:32.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.940+0000 7f07293ff700 1 Processor -- start 2023-09-30T22:59:32.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.941+0000 7f07293ff700 1 -- start start 2023-09-30T22:59:32.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f07293ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f07240b00d0 0x7f072406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f07293ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072406d3e0 con 0x7f07240af020 2023-09-30T22:59:32.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f07293ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072406dc80 con 0x7f072406e650 2023-09-30T22:59:32.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f07293ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072406b790 con 0x7f07240b00d0 2023-09-30T22:59:32.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f0722ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f07240af020 0x7f0724156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:38122/0 (socket says 172.21.15.142:38122) 2023-09-30T22:59:32.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f0722ffd700 1 -- 172.21.15.142:0/3956051583 learned_addr learned my addr 172.21.15.142:0/3956051583 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f07227fc700 1 --2- 172.21.15.142:0/3956051583 >> v2:172.21.15.148:3300/0 conn(0x7f07240b00d0 0x7f072406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.942+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261256754 0 0) 0x7f072406d3e0 con 0x7f07240af020 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f070c003570 con 0x7f07240af020 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494705012 0 0) 0x7f070c003570 con 0x7f07240af020 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 >> v2:172.21.15.148:3300/0 conn(0x7f07240b00d0 msgr2=0x7f072406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 --2- 172.21.15.142:0/3956051583 >> v2:172.21.15.148:3300/0 conn(0x7f07240b00d0 0x7f072406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 >> v1:172.21.15.148:6789/0 conn(0x7f072406e650 legacy=0x7f072415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240b0650 con 0x7f07240af020 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f0714001470 con 0x7f07240af020 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 >> v1:172.21.15.142:6789/0 conn(0x7f07240af020 legacy=0x7f0724156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070c003a60 0x7f070c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f070c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f070c0051c0 0x7f070c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072406b790 con 0x7f070c004810 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c00c050 con 0x7f070c0051c0 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c00c210 con 0x7f070c003a60 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.943+0000 7f07227fc700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f070c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f0722ffd700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070c003a60 0x7f070c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07237fe700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f070c0051c0 0x7f070c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07227fc700 1 -- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070c003a60 msgr2=0x7f070c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07227fc700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070c003a60 0x7f070c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07227fc700 1 -- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f070c0051c0 msgr2=0x7f070c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07227fc700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f070c0051c0 0x7f070c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07227fc700 1 -- 172.21.15.142:0/3956051583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c003570 con 0x7f070c004810 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07237fe700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f070c0051c0 0x7f070c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07237fe700 1 -- 172.21.15.142:0/3956051583 reap_dead start 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f07227fc700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f070c004c80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0718009be0 tx=0x7f07180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4582a249f25e14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800e710 con 0x7f070c004810 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071800e870 con 0x7f070c004810 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.944+0000 7f0721ffb700 1 -- 172.21.15.142:0/3956051583 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800ec30 con 0x7f070c004810 2023-09-30T22:59:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.945+0000 7f07293ff700 1 -- 172.21.15.142:0/3956051583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 msgr2=0x7f070c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.945+0000 7f07293ff700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f070c004c80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0718009be0 tx=0x7f07180091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.945+0000 7f07293ff700 1 -- 172.21.15.142:0/3956051583 shutdown_connections 2023-09-30T22:59:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.945+0000 7f07293ff700 1 --2- 172.21.15.142:0/3956051583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f070c004c80 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.945+0000 7f07293ff700 1 -- 172.21.15.142:0/3956051583 >> 172.21.15.142:0/3956051583 conn(0x7f07240680c0 msgr2=0x7f07240c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.945+0000 7f07293ff700 1 -- 172.21.15.142:0/3956051583 shutdown_connections 2023-09-30T22:59:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.945+0000 7f07293ff700 1 -- 172.21.15.142:0/3956051583 wait complete. 2023-09-30T22:59:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.946+0000 7f07293ff700 1 Processor -- start 2023-09-30T22:59:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.946+0000 7f07293ff700 1 -- start start 2023-09-30T22:59:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.947+0000 7f07293ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f072414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.947+0000 7f07293ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07240a98c0 0x7f07240a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.947+0000 7f07293ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07240c6350 0x7f07240c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.947+0000 7f07293ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240aad20 con 0x7f070c004810 2023-09-30T22:59:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.947+0000 7f07293ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240aa270 con 0x7f07240a98c0 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.947+0000 7f07293ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240c6d00 con 0x7f07240c6350 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f072414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f072414e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40484/0 (socket says 172.21.15.142:40484) 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 -- 172.21.15.142:0/3562259628 learned_addr learned my addr 172.21.15.142:0/3562259628 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 -- 172.21.15.142:0/3562259628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07240c6350 msgr2=0x7f07240c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07240c6350 0x7f07240c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 -- 172.21.15.142:0/3562259628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07240a98c0 msgr2=0x7f07240a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07240a98c0 0x7f07240a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 -- 172.21.15.142:0/3562259628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240ab1a0 con 0x7f070c004810 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f0722ffd700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f072414e300 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f071400eb90 tx=0x7f0714001c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400c7e0 con 0x7f070c004810 2023-09-30T22:59:32.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071400c960 con 0x7f070c004810 2023-09-30T22:59:32.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400cd20 con 0x7f070c004810 2023-09-30T22:59:32.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.948+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0724155090 con 0x7f070c004810 2023-09-30T22:59:32.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.949+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240aa760 con 0x7f070c004810 2023-09-30T22:59:32.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.950+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724064180 con 0x7f070c004810 2023-09-30T22:59:32.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.950+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0714013630 con 0x7f070c004810 2023-09-30T22:59:32.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.952+0000 7f070affd700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0710067330 0x7f07100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:32.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.952+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0714084d90 con 0x7f070c004810 2023-09-30T22:59:32.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.952+0000 7f07227fc700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0710067330 0x7f07100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:32.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.952+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f071006f4f0 con 0x7f070c004810 2023-09-30T22:59:32.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.953+0000 7f07227fc700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0710067330 0x7f07100697e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f07180091e0 tx=0x7f0718019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:32.956+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0714051bf0 con 0x7f070c004810 2023-09-30T22:59:33.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.151+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f072406fc10 con 0x7f070c004810 2023-09-30T22:59:33.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.152+0000 7f070affd700 1 -- 172.21.15.142:0/3562259628 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+35003 (secure 0 0 0) 0x7f0714055210 con 0x7f070c004810 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 146, 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:59:29.327050+0000", 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:59:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:59:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 18, 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:59:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:33.159 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:33.160 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:33.161 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:59:33.162 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:59:33.163 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.164 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:33.165 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:33.166 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:33.167 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 17, 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.103746+0000", 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:33.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:59:33.169 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:33.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "143", 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:33.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:33.173 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:33.174 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 18, 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.960192+0000", 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1027, 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:33.175 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:59:33.176 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "146", 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:33.177 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:33.178 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:33.179 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:59:33.180 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.181 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:59:33.185 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:59:33.187 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.188 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:59:33.189 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.191 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:33.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.195 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:59:33.196 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:59:33.199 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:59:33.200 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.201 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:59:33.206 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.207 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.210 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:59:33.212 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.213 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.215 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.217 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:33.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.220 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.221 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.222 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:59:33.225 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:33.226 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:59:33.227 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.228 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:33.230 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.231 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:33.232 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.233 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.234 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:59:33.235 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:33.237 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:33.238 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:59:33.239 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:59:33.240 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:59:33.241 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:59:33.241 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:59:33.241 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:59:33.241 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:59:33.241 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:59:33.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:33.241 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0710067330 msgr2=0x7f07100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0710067330 0x7f07100697e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f07180091e0 tx=0x7f0718019000 comp rx=0 tx=0).stop 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 msgr2=0x7f072414e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f072414e300 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f071400eb90 tx=0x7f0714001c90 comp rx=0 tx=0).stop 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 shutdown_connections 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0710067330 0x7f07100697e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07240c6350 0x7f07240c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f070c004810 0x7f072414e300 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 --2- 172.21.15.142:0/3562259628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07240a98c0 0x7f07240a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 >> 172.21.15.142:0/3562259628 conn(0x7f07240680c0 msgr2=0x7f07240af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 shutdown_connections 2023-09-30T22:59:33.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:33.155+0000 7f07293ff700 1 -- 172.21.15.142:0/3562259628 wait complete. 2023-09-30T22:59:33.244 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:59:38.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:59:38.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.445+0000 7fec2b7ff700 1 Processor -- start 2023-09-30T22:59:38.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.445+0000 7fec2b7ff700 1 -- start start 2023-09-30T22:59:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.446+0000 7fec2b7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fec2406b3d0 0x7fec240b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.446+0000 7fec2b7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 0x7fec2406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.446+0000 7fec2b7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2406d470 con 0x7fec24157a90 2023-09-30T22:59:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.446+0000 7fec2b7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240b23c0 con 0x7fec2406b3d0 2023-09-30T22:59:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.446+0000 7fec2b7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24157e60 con 0x7fec240b1f40 2023-09-30T22:59:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec2959b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fec24157a90 0x7fec2415bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:38124/0 (socket says 172.21.15.142:38124) 2023-09-30T22:59:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec2959b700 1 -- 172.21.15.142:0/126130696 learned_addr learned my addr 172.21.15.142:0/126130696 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:38.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec28d9a700 1 --2- 172.21.15.142:0/126130696 >> v2:172.21.15.148:3300/0 conn(0x7fec2406b3d0 0x7fec240b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec29d9c700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 0x7fec2406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968149055 0 0) 0x7fec2406d470 con 0x7fec24157a90 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec10003570 con 0x7fec24157a90 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001619069 0 0) 0x7fec10003570 con 0x7fec24157a90 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 msgr2=0x7fec2406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 0x7fec2406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 >> v2:172.21.15.148:3300/0 conn(0x7fec2406b3d0 msgr2=0x7fec240b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 --2- 172.21.15.142:0/126130696 >> v2:172.21.15.148:3300/0 conn(0x7fec2406b3d0 0x7fec240b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240ae880 con 0x7fec24157a90 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fec20001470 con 0x7fec24157a90 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 >> v1:172.21.15.142:6789/0 conn(0x7fec24157a90 legacy=0x7fec2415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10003ae0 0x7fec10003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.447+0000 7fec1bfff700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 0x7fec10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec1bfff700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec10004d50 0x7fec100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240b23c0 con 0x7fec10004d50 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24157e60 con 0x7fec10003ae0 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1000bb10 con 0x7fec240b1f40 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec29d9c700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec10004d50 0x7fec100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec2959b700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10003ae0 0x7fec10003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec28d9a700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 0x7fec10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec29d9c700 1 -- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 msgr2=0x7fec10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec29d9c700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240b1f40 0x7fec10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec29d9c700 1 -- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10003ae0 msgr2=0x7fec10003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec29d9c700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10003ae0 0x7fec10003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec29d9c700 1 -- 172.21.15.142:0/126130696 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10003570 con 0x7fec10004d50 2023-09-30T22:59:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.448+0000 7fec29d9c700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec10004d50 0x7fec100051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00e240 tx=0x7fec1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d3c7865054e920 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00eaf0 con 0x7fec10004d50 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c00f040 con 0x7fec10004d50 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec1bfff700 1 -- 172.21.15.142:0/126130696 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00eea0 con 0x7fec10004d50 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec2b7ff700 1 -- 172.21.15.142:0/126130696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec10004d50 msgr2=0x7fec100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec2b7ff700 1 --2- 172.21.15.142:0/126130696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec10004d50 0x7fec100051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00e240 tx=0x7fec1c00b040 comp rx=0 tx=0).stop 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec29d9c700 1 -- 172.21.15.142:0/126130696 reap_dead start 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec2b7ff700 1 -- 172.21.15.142:0/126130696 shutdown_connections 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec2b7ff700 1 -- 172.21.15.142:0/126130696 >> 172.21.15.142:0/126130696 conn(0x7fec240680c0 msgr2=0x7fec240c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec2b7ff700 1 -- 172.21.15.142:0/126130696 shutdown_connections 2023-09-30T22:59:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.449+0000 7fec2b7ff700 1 -- 172.21.15.142:0/126130696 wait complete. 2023-09-30T22:59:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.451+0000 7fec2b7ff700 1 Processor -- start 2023-09-30T22:59:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.452+0000 7fec2b7ff700 1 -- start start 2023-09-30T22:59:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec2b7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10004d50 0x7fec241689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec2b7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec24156350 0x7fec240c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec2b7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240c73c0 0x7fec240c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec2b7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240c8420 con 0x7fec24156350 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec2b7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240c2d30 con 0x7fec10004d50 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec2b7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24168f20 con 0x7fec240c73c0 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec24156350 0x7fec240c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec2959b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10004d50 0x7fec241689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec24156350 0x7fec240c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40504/0 (socket says 172.21.15.142:40504) 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 -- 172.21.15.142:0/932348217 learned_addr learned my addr 172.21.15.142:0/932348217 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec29d9c700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240c73c0 0x7fec240c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 -- 172.21.15.142:0/932348217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240c73c0 msgr2=0x7fec240c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240c73c0 0x7fec240c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 -- 172.21.15.142:0/932348217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10004d50 msgr2=0x7fec241689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10004d50 0x7fec241689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.453+0000 7fec28d9a700 1 -- 172.21.15.142:0/932348217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240c6b80 con 0x7fec24156350 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.454+0000 7fec28d9a700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec24156350 0x7fec240c6640 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fec14009fd0 tx=0x7fec140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.454+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400f790 con 0x7fec24156350 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.454+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400f8f0 con 0x7fec24156350 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.454+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400fc70 con 0x7fec24156350 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.454+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec241568c0 con 0x7fec24156350 2023-09-30T22:59:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.454+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec24156e80 con 0x7fec24156350 2023-09-30T22:59:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.455+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec240c2ee0 con 0x7fec24156350 2023-09-30T22:59:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.456+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fec14014440 con 0x7fec24156350 2023-09-30T22:59:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.457+0000 7fec197fa700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fec08067330 0x7fec080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.457+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fec14018030 con 0x7fec24156350 2023-09-30T22:59:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.457+0000 7fec2959b700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fec08067330 0x7fec080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.457+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7fec0806f4f0 con 0x7fec24156350 2023-09-30T22:59:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.458+0000 7fec2959b700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fec08067330 0x7fec080697e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fec20000e50 tx=0x7fec20001dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:38.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.461+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fec240c2ee0 con 0x7fec24156350 2023-09-30T22:59:38.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.653+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fec240c2ee0 con 0x7fec24156350 2023-09-30T22:59:38.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.654+0000 7fec197fa700 1 -- 172.21.15.142:0/932348217 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+35003 (secure 0 0 0) 0x7fec240c2ee0 con 0x7fec24156350 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 146, 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:59:29.327050+0000", 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:59:38.656 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:59:38.657 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 18, 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:59:38.658 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:38.659 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:38.660 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:38.661 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:38.662 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:38.663 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:38.665 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:38.666 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:38.667 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:38.668 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:38.669 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:38.670 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 17, 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.103746+0000", 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:38.671 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:38.672 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "143", 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:38.673 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:38.675 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:59:38.676 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 18, 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.960192+0000", 2023-09-30T22:59:38.677 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1027, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:38.678 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:38.679 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "146", 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:38.680 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:38.681 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:38.682 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.684 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:59:38.687 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.689 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.690 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.691 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.692 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:59:38.696 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.697 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.698 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:59:38.701 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.702 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:59:38.703 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.706 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.708 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:59:38.708 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.708 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.709 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:59:38.709 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.710 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.710 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.710 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.710 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.711 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:59:38.711 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.711 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.712 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:59:38.712 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:38.712 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.712 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.712 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.714 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:59:38.716 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.717 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.718 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:38.720 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.721 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.722 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.722 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.722 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.722 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:59:38.722 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.723 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.723 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:59:38.723 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.724 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.724 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.724 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.725 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.725 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:59:38.725 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.725 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.726 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:59:38.726 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.726 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.727 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.727 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.727 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.727 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:59:38.727 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.728 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:59:38.728 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.728 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.729 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.729 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.729 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.730 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.730 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:59:38.730 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.730 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.731 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:59:38.731 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:38.731 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.731 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.732 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:59:38.732 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:59:38.732 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:59:38.732 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:59:38.732 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.732 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.733 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.733 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.733 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:38.734 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.734 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.734 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.734 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.734 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.734 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.735 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.735 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.735 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.735 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.735 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:59:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.737 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.737 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:59:38.737 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.738 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.738 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.738 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:59:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.740 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.740 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:59:38.740 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.740 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.740 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.741 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.741 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.741 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.741 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:59:38.742 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.742 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.742 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:59:38.743 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.743 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.743 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.743 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.744 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.744 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.744 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:59:38.744 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.745 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.745 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:59:38.745 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:38.745 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.746 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.746 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:59:38.746 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:59:38.746 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:59:38.746 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:59:38.747 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.747 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.747 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.747 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.748 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:38.748 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:38.748 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:38.748 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:38.748 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:38.749 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:38.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:38.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:38.749 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:38.749 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:38.749 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:38.750 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:38.750 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:38.750 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.750 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.750 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:59:38.751 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.751 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.751 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:59:38.752 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.752 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.752 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.752 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:38.752 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.753 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:59:38.753 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.754 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.754 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:59:38.754 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.754 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.754 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.755 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:38.755 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.755 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.755 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:59:38.756 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.756 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.756 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:59:38.757 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.757 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.757 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.757 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:38.757 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:38.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.758 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:38.758 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:59:38.758 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.759 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:38.759 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:59:38.759 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:38.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.759 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.760 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:59:38.760 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:59:38.760 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:59:38.760 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:59:38.760 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:38.761 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:38.761 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:38.761 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:38.761 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.761 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:38.762 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:59:38.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.762 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:38.762 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.762 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.763 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.763 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.763 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.763 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:59:38.763 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.764 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:38.764 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.764 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.764 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.764 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.765 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.765 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:59:38.765 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.765 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:38.766 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.766 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.766 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.766 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.766 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.767 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:59:38.767 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.767 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:38.768 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.768 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.768 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.768 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.768 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.769 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:59:38.769 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.769 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:38.770 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.770 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.770 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.770 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.770 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:59:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:59:38.773 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:38.773 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.774 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.774 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.774 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.774 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.774 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:59:38.774 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:38.775 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:38.775 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:38.775 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:38.775 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:38.776 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:38.776 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:38.776 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:59:38.776 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:38.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.776 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:38.777 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:59:38.777 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:59:38.777 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:59:38.777 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:59:38.777 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:59:38.777 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:59:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:59:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:59:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:59:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:59:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:59:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:59:38.778 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:59:38.779 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:38.779 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:59:38.779 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:59:38.779 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:59:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:38.781 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:38.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fec08067330 msgr2=0x7fec080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:38.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fec08067330 0x7fec080697e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fec20000e50 tx=0x7fec20001dc0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec24156350 msgr2=0x7fec240c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec24156350 0x7fec240c6640 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fec14009fd0 tx=0x7fec140091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 shutdown_connections 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fec08067330 0x7fec080697e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fec240c73c0 0x7fec240c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec10004d50 0x7fec241689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 --2- 172.21.15.142:0/932348217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec24156350 0x7fec240c6640 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 >> 172.21.15.142:0/932348217 conn(0x7fec240680c0 msgr2=0x7fec240ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 shutdown_connections 2023-09-30T22:59:38.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:38.657+0000 7fec2b7ff700 1 -- 172.21.15.142:0/932348217 wait complete. 2023-09-30T22:59:38.784 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T22:59:43.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:59:43.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.983+0000 7f95c35ff700 1 Processor -- start 2023-09-30T22:59:43.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.983+0000 7f95c35ff700 1 -- start start 2023-09-30T22:59:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c35ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc0af020 0x7f95bc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c35ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95bc0b00d0 0x7f95bc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c35ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc06d3e0 con 0x7f95bc06e650 2023-09-30T22:59:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c35ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc15b400 con 0x7f95bc0b00d0 2023-09-30T22:59:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c35ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc06dc80 con 0x7f95bc0af020 2023-09-30T22:59:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c1b9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f95bc06e650 0x7f95bc0b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33604/0 (socket says 172.21.15.142:33604) 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c1b9c700 1 -- 172.21.15.142:0/3257931210 learned_addr learned my addr 172.21.15.142:0/3257931210 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.984+0000 7f95c0b9a700 1 --2- 172.21.15.142:0/3257931210 >> v2:172.21.15.142:3300/0 conn(0x7f95bc0b00d0 0x7f95bc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95c139b700 1 --2- 172.21.15.142:0/3257931210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc0af020 0x7f95bc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95b3fff700 1 -- 172.21.15.142:0/3257931210 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734116016 0 0) 0x7f95bc06d3e0 con 0x7f95bc06e650 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95b3fff700 1 -- 172.21.15.142:0/3257931210 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a8003570 con 0x7f95bc06e650 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95c0b9a700 1 -- 172.21.15.142:0/3257931210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc0af020 msgr2=0x7f95bc156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95c0b9a700 1 --2- 172.21.15.142:0/3257931210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc0af020 0x7f95bc156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95c0b9a700 1 -- 172.21.15.142:0/3257931210 >> v1:172.21.15.142:6789/0 conn(0x7f95bc06e650 legacy=0x7f95bc0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95c0b9a700 1 -- 172.21.15.142:0/3257931210 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc06b790 con 0x7f95bc0b00d0 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95c139b700 1 --2- 172.21.15.142:0/3257931210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc0af020 0x7f95bc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95c0b9a700 1 --2- 172.21.15.142:0/3257931210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0b00d0 0x7f95bc06e110 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0098e0 tx=0x7f95ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718f2fca98da2cc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:43.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95b3fff700 1 -- 172.21.15.142:0/3257931210 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00b640 con 0x7f95bc0b00d0 2023-09-30T22:59:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95b3fff700 1 -- 172.21.15.142:0/3257931210 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00b7a0 con 0x7f95bc0b00d0 2023-09-30T22:59:43.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.985+0000 7f95b3fff700 1 -- 172.21.15.142:0/3257931210 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00bb40 con 0x7f95bc0b00d0 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 -- 172.21.15.142:0/3257931210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0b00d0 msgr2=0x7f95bc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 --2- 172.21.15.142:0/3257931210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0b00d0 0x7f95bc06e110 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0098e0 tx=0x7f95ac0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 -- 172.21.15.142:0/3257931210 shutdown_connections 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 --2- 172.21.15.142:0/3257931210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc0af020 0x7f95bc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 --2- 172.21.15.142:0/3257931210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0b00d0 0x7f95bc06e110 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 -- 172.21.15.142:0/3257931210 >> 172.21.15.142:0/3257931210 conn(0x7f95bc0680c0 msgr2=0x7f95bc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 -- 172.21.15.142:0/3257931210 shutdown_connections 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.986+0000 7f95c35ff700 1 -- 172.21.15.142:0/3257931210 wait complete. 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.988+0000 7f95c35ff700 1 Processor -- start 2023-09-30T22:59:43.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.988+0000 7f95c35ff700 1 -- start start 2023-09-30T22:59:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c35ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc06e650 0x7f95bc0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c35ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0af020 0x7f95bc16a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c35ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95bc0b00d0 0x7f95bc13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:43.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c35ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc16da70 con 0x7f95bc0af020 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c35ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc16dd50 con 0x7f95bc0b00d0 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c35ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc16ac70 con 0x7f95bc06e650 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0af020 0x7f95bc16a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0af020 0x7f95bc16a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58782/0 (socket says 172.21.15.142:58782) 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 -- 172.21.15.142:0/2860592550 learned_addr learned my addr 172.21.15.142:0/2860592550 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c139b700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc06e650 0x7f95bc0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c1b9c700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95bc0b00d0 0x7f95bc13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 -- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc06e650 msgr2=0x7f95bc0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc06e650 0x7f95bc0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 -- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95bc0b00d0 msgr2=0x7f95bc13ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95bc0b00d0 0x7f95bc13ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:43.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c0b9a700 1 -- 172.21.15.142:0/2860592550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac009420 con 0x7f95bc0af020 2023-09-30T22:59:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.989+0000 7f95c1b9c700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95bc0b00d0 0x7f95bc13ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.990+0000 7f95c0b9a700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0af020 0x7f95bc16a430 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0093f0 tx=0x7f95ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.990+0000 7f95b17fa700 1 -- 172.21.15.142:0/2860592550 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac01f070 con 0x7f95bc0af020 2023-09-30T22:59:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.990+0000 7f95b17fa700 1 -- 172.21.15.142:0/2860592550 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac002f30 con 0x7f95bc0af020 2023-09-30T22:59:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.990+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc16af50 con 0x7f95bc0af020 2023-09-30T22:59:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.990+0000 7f95b17fa700 1 -- 172.21.15.142:0/2860592550 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac01ae40 con 0x7f95bc0af020 2023-09-30T22:59:43.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.990+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc16a970 con 0x7f95bc0af020 2023-09-30T22:59:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.991+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc16dec0 con 0x7f95bc0af020 2023-09-30T22:59:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.992+0000 7f95b17fa700 1 -- 172.21.15.142:0/2860592550 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f95ac011630 con 0x7f95bc0af020 2023-09-30T22:59:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.993+0000 7f95b17fa700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95a0067330 0x7f95a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.993+0000 7f95b17fa700 1 -- 172.21.15.142:0/2860592550 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f95ac085ed0 con 0x7f95bc0af020 2023-09-30T22:59:43.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.993+0000 7f95c139b700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95a0067330 0x7f95a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:43.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.994+0000 7f95c139b700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95a0067330 0x7f95a00697e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f95bc15fb10 tx=0x7f95b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:43.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:43.997+0000 7f95b17fa700 1 -- 172.21.15.142:0/2860592550 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f95ac052d30 con 0x7f95bc0af020 2023-09-30T22:59:44.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:44.009 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:44.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.198+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f95bc06fc10 con 0x7f95bc0af020 2023-09-30T22:59:44.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.199+0000 7f95b17fa700 1 -- 172.21.15.142:0/2860592550 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+34984 (secure 0 0 0) 0x7f95ac056350 con 0x7f95bc0af020 2023-09-30T22:59:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:44.201 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 147, 2023-09-30T22:59:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:59:39.329599+0000", 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:59:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 18, 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:59:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:59:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:59:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:59:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:59:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 17, 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.103746+0000", 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:59:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "143", 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 18, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.960192+0000", 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "147", 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:59:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:59:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:59:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:59:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:59:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:59:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:59:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:59:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:59:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:59:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:59:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:59:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:59:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.294 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95a0067330 msgr2=0x7f95a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95a0067330 0x7f95a00697e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f95bc15fb10 tx=0x7f95b8008040 comp rx=0 tx=0).stop 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0af020 msgr2=0x7f95bc16a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0af020 0x7f95bc16a430 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0093f0 tx=0x7f95ac017000 comp rx=0 tx=0).stop 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 shutdown_connections 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95a0067330 0x7f95a00697e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95bc0b00d0 0x7f95bc13ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95bc06e650 0x7f95bc0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 --2- 172.21.15.142:0/2860592550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95bc0af020 0x7f95bc16a430 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 >> 172.21.15.142:0/2860592550 conn(0x7f95bc0680c0 msgr2=0x7f95bc14df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 shutdown_connections 2023-09-30T22:59:44.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.202+0000 7f95c35ff700 1 -- 172.21.15.142:0/2860592550 wait complete. 2023-09-30T22:59:44.298 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-09-30T22:59:44.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T22:59:44.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.530+0000 7f0a447ff700 1 Processor -- start 2023-09-30T22:59:44.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.530+0000 7f0a447ff700 1 -- start start 2023-09-30T22:59:44.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.531+0000 7f0a447ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a3c0b1950 0x7f0a3c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:44.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.531+0000 7f0a447ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0ad630 con 0x7f0a3c15a6c0 2023-09-30T22:59:44.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.531+0000 7f0a447ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0b3360 con 0x7f0a3c0b1580 2023-09-30T22:59:44.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.531+0000 7f0a447ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c15ab60 con 0x7f0a3c0b1950 2023-09-30T22:59:44.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a42d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0a3c15a6c0 0x7f0a3c06a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33612/0 (socket says 172.21.15.142:33612) 2023-09-30T22:59:44.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a42d9c700 1 -- 172.21.15.142:0/3011180651 learned_addr learned my addr 172.21.15.142:0/3011180651 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:44.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41d9a700 1 --2- 172.21.15.142:0/3011180651 >> v2:172.21.15.148:3300/0 conn(0x7f0a3c0b1950 0x7f0a3c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41599700 1 -- 172.21.15.142:0/3011180651 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099315761 0 0) 0x7f0a3c0ad630 con 0x7f0a3c15a6c0 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41599700 1 -- 172.21.15.142:0/3011180651 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a28003570 con 0x7f0a3c15a6c0 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41599700 1 -- 172.21.15.142:0/3011180651 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020817824 0 0) 0x7f0a3c0b3360 con 0x7f0a3c0b1580 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41599700 1 -- 172.21.15.142:0/3011180651 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a3c0ad630 con 0x7f0a3c0b1580 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41d9a700 1 -- 172.21.15.142:0/3011180651 >> v1:172.21.15.148:6789/0 conn(0x7f0a3c0b1580 legacy=0x7f0a3c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41d9a700 1 -- 172.21.15.142:0/3011180651 >> v1:172.21.15.142:6789/0 conn(0x7f0a3c15a6c0 legacy=0x7f0a3c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.532+0000 7f0a41d9a700 1 -- 172.21.15.142:0/3011180651 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0ae1d0 con 0x7f0a3c0b1950 2023-09-30T22:59:44.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a41d9a700 1 --2- 172.21.15.142:0/3011180651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c0b1950 0x7f0a3c15a180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0098e0 tx=0x7f0a2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4778f3878dca9d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a41599700 1 -- 172.21.15.142:0/3011180651 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c011630 con 0x7f0a3c0b1950 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a41599700 1 -- 172.21.15.142:0/3011180651 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c011790 con 0x7f0a3c0b1950 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a41599700 1 -- 172.21.15.142:0/3011180651 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c011b30 con 0x7f0a3c0b1950 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a447ff700 1 -- 172.21.15.142:0/3011180651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c0b1950 msgr2=0x7f0a3c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a447ff700 1 --2- 172.21.15.142:0/3011180651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c0b1950 0x7f0a3c15a180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0098e0 tx=0x7f0a2c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a447ff700 1 -- 172.21.15.142:0/3011180651 shutdown_connections 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.533+0000 7f0a447ff700 1 --2- 172.21.15.142:0/3011180651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c0b1950 0x7f0a3c15a180 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.534+0000 7f0a447ff700 1 -- 172.21.15.142:0/3011180651 >> 172.21.15.142:0/3011180651 conn(0x7f0a3c0ce1f0 msgr2=0x7f0a3c069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.534+0000 7f0a447ff700 1 -- 172.21.15.142:0/3011180651 shutdown_connections 2023-09-30T22:59:44.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.534+0000 7f0a447ff700 1 -- 172.21.15.142:0/3011180651 wait complete. 2023-09-30T22:59:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.535+0000 7f0a447ff700 1 Processor -- start 2023-09-30T22:59:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.535+0000 7f0a447ff700 1 -- start start 2023-09-30T22:59:44.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a447ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a3c0b1580 0x7f0a3c150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a447ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c0b1950 0x7f0a3c158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a447ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c15a6c0 0x7f0a3c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a447ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c14ef30 con 0x7f0a3c0b1580 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a447ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c14e320 con 0x7f0a3c15a6c0 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a447ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c14e600 con 0x7f0a3c0b1950 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a4259b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a3c0b1580 0x7f0a3c150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a4259b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a3c0b1580 0x7f0a3c150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58792/0 (socket says 172.21.15.142:58792) 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.536+0000 7f0a4259b700 1 -- 172.21.15.142:0/1545090725 learned_addr learned my addr 172.21.15.142:0/1545090725 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a42d9c700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c15a6c0 0x7f0a3c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a41d9a700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c0b1950 0x7f0a3c158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a4259b700 1 -- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c0b1950 msgr2=0x7f0a3c158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a4259b700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c0b1950 0x7f0a3c158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a4259b700 1 -- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c15a6c0 msgr2=0x7f0a3c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a4259b700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c15a6c0 0x7f0a3c1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a4259b700 1 -- 172.21.15.142:0/1545090725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c009420 con 0x7f0a3c0b1580 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a41d9a700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c0b1950 0x7f0a3c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a4259b700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a3c0b1580 0x7f0a3c150800 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c790 tx=0x7f0a38007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a327fc700 1 -- 172.21.15.142:0/1545090725 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38010510 con 0x7f0a3c0b1580 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a327fc700 1 -- 172.21.15.142:0/1545090725 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38010670 con 0x7f0a3c0b1580 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a327fc700 1 -- 172.21.15.142:0/1545090725 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38010a10 con 0x7f0a3c0b1580 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.537+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c14e8e0 con 0x7f0a3c0b1580 2023-09-30T22:59:44.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.538+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c150d40 con 0x7f0a3c0b1580 2023-09-30T22:59:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.539+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c06d600 con 0x7f0a3c0b1580 2023-09-30T22:59:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.539+0000 7f0a327fc700 1 -- 172.21.15.142:0/1545090725 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0a3801b400 con 0x7f0a3c0b1580 2023-09-30T22:59:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.540+0000 7f0a327fc700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a20067330 0x7f0a200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.540+0000 7f0a327fc700 1 -- 172.21.15.142:0/1545090725 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a38084a00 con 0x7f0a3c0b1580 2023-09-30T22:59:44.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.540+0000 7f0a41d9a700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a20067330 0x7f0a200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:44.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.541+0000 7f0a41d9a700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a20067330 0x7f0a200697e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0cb4b0 tx=0x7f0a2c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:44.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.545+0000 7f0a327fc700 1 -- 172.21.15.142:0/1545090725 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0a38051860 con 0x7f0a3c0b1580 2023-09-30T22:59:44.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.735+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0a3c06fc10 con 0x7f0a3c0b1580 2023-09-30T22:59:44.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.736+0000 7f0a327fc700 1 -- 172.21.15.142:0/1545090725 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+34984 (secure 0 0 0) 0x7f0a38054e80 con 0x7f0a3c0b1580 2023-09-30T22:59:44.737 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:44.737 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 147, 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T22:59:39.329599+0000", 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T22:59:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 18, 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T22:59:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T22:59:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 17, 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.103746+0000", 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T22:59:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "143", 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 18, 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:59:11.960192+0000", 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T22:59:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T22:59:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "147", 2023-09-30T22:59:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T22:59:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T22:59:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T22:59:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T22:59:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T22:59:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T22:59:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T22:59:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T22:59:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T22:59:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T22:59:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T22:59:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 142, 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T22:59:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T22:59:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T22:59:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T22:59:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:44.832 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.738+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a20067330 msgr2=0x7f0a200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.738+0000 7f0a447ff700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a20067330 0x7f0a200697e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0cb4b0 tx=0x7f0a2c017000 comp rx=0 tx=0).stop 2023-09-30T22:59:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.738+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a3c0b1580 msgr2=0x7f0a3c150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.738+0000 7f0a447ff700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a3c0b1580 0x7f0a3c150800 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c790 tx=0x7f0a38007e10 comp rx=0 tx=0).stop 2023-09-30T22:59:44.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 shutdown_connections 2023-09-30T22:59:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0a20067330 0x7f0a200697e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c15a6c0 0x7f0a3c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a3c0b1580 0x7f0a3c150800 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 --2- 172.21.15.142:0/1545090725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c0b1950 0x7f0a3c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 >> 172.21.15.142:0/1545090725 conn(0x7f0a3c0ce1f0 msgr2=0x7f0a3c0694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 shutdown_connections 2023-09-30T22:59:44.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:44.739+0000 7f0a447ff700 1 -- 172.21.15.142:0/1545090725 wait complete. 2023-09-30T22:59:44.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.026+0000 7fca6a1ff700 1 Processor -- start 2023-09-30T22:59:45.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.027+0000 7fca6a1ff700 1 -- start start 2023-09-30T22:59:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca6a1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fca64143350 0x7fca640cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca6a1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fca640692f0 0x7fca6415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca6a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca6415dc50 0x7fca64068100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca6a1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca640cc6b0 con 0x7fca640692f0 2023-09-30T22:59:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca6a1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6415e090 con 0x7fca64143350 2023-09-30T22:59:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca6a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca640cb7d0 con 0x7fca6415dc50 2023-09-30T22:59:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca62ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fca640692f0 0x7fca6415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca62ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fca640692f0 0x7fca6415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58800/0 (socket says 172.21.15.142:58800) 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.028+0000 7fca62ffd700 1 -- 172.21.15.142:0/3122385906 learned_addr learned my addr 172.21.15.142:0/3122385906 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca63fff700 1 --2- 172.21.15.142:0/3122385906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca6415dc50 0x7fca64068100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca637fe700 1 --2- 172.21.15.142:0/3122385906 >> v2:172.21.15.148:3300/0 conn(0x7fca64143350 0x7fca640cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca62ffd700 1 -- 172.21.15.142:0/3122385906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca6415dc50 msgr2=0x7fca64068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca62ffd700 1 --2- 172.21.15.142:0/3122385906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca6415dc50 0x7fca64068100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca62ffd700 1 -- 172.21.15.142:0/3122385906 >> v2:172.21.15.148:3300/0 conn(0x7fca64143350 msgr2=0x7fca640cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca62ffd700 1 --2- 172.21.15.142:0/3122385906 >> v2:172.21.15.148:3300/0 conn(0x7fca64143350 0x7fca640cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca62ffd700 1 -- 172.21.15.142:0/3122385906 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640cbaa0 con 0x7fca640692f0 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca62ffd700 1 --2- 172.21.15.142:0/3122385906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca6415d710 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fca64069cc0 tx=0x7fca58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c08f764914dbc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca627fc700 1 -- 172.21.15.142:0/3122385906 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800b860 con 0x7fca640692f0 2023-09-30T22:59:45.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca627fc700 1 -- 172.21.15.142:0/3122385906 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5800b9c0 con 0x7fca640692f0 2023-09-30T22:59:45.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.029+0000 7fca627fc700 1 -- 172.21.15.142:0/3122385906 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800bd60 con 0x7fca640692f0 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 -- 172.21.15.142:0/3122385906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 msgr2=0x7fca6415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/3122385906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca6415d710 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fca64069cc0 tx=0x7fca58009250 comp rx=0 tx=0).stop 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 -- 172.21.15.142:0/3122385906 shutdown_connections 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/3122385906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca6415dc50 0x7fca64068100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/3122385906 >> v2:172.21.15.148:3300/0 conn(0x7fca64143350 0x7fca640cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/3122385906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca6415d710 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 -- 172.21.15.142:0/3122385906 >> 172.21.15.142:0/3122385906 conn(0x7fca640ce8e0 msgr2=0x7fca640cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 -- 172.21.15.142:0/3122385906 shutdown_connections 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.030+0000 7fca6a1ff700 1 -- 172.21.15.142:0/3122385906 wait complete. 2023-09-30T22:59:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.031+0000 7fca6a1ff700 1 Processor -- start 2023-09-30T22:59:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.032+0000 7fca6a1ff700 1 -- start start 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.032+0000 7fca6a1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca640a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca6a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca64143350 0x7fca640a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca6a1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca6415dc50 0x7fca6415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca6a1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6416b830 con 0x7fca640692f0 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca6a1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6415c590 con 0x7fca6415dc50 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca6a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6415c870 con 0x7fca64143350 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca640a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca640a8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58814/0 (socket says 172.21.15.142:58814) 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 -- 172.21.15.142:0/2643817548 learned_addr learned my addr 172.21.15.142:0/2643817548 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca62ffd700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca64143350 0x7fca640a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca63fff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca6415dc50 0x7fca6415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 -- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca64143350 msgr2=0x7fca640a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca64143350 0x7fca640a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 -- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca6415dc50 msgr2=0x7fca6415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca6415dc50 0x7fca6415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 -- 172.21.15.142:0/2643817548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580094f0 con 0x7fca640692f0 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca63fff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca6415dc50 0x7fca6415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.033+0000 7fca637fe700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca640a8300 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fca5400d890 tx=0x7fca54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.034+0000 7fca4b7fe700 1 -- 172.21.15.142:0/2643817548 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540125f0 con 0x7fca640692f0 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.034+0000 7fca4b7fe700 1 -- 172.21.15.142:0/2643817548 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca54012750 con 0x7fca640692f0 2023-09-30T22:59:45.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.034+0000 7fca4b7fe700 1 -- 172.21.15.142:0/2643817548 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54012ad0 con 0x7fca640692f0 2023-09-30T22:59:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.034+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6415cb50 con 0x7fca640692f0 2023-09-30T22:59:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.034+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6416aff0 con 0x7fca640692f0 2023-09-30T22:59:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.035+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6406ea70 con 0x7fca640692f0 2023-09-30T22:59:45.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.036+0000 7fca4b7fe700 1 -- 172.21.15.142:0/2643817548 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fca5401e460 con 0x7fca640692f0 2023-09-30T22:59:45.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.036+0000 7fca4b7fe700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:45.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.037+0000 7fca4b7fe700 1 -- 172.21.15.142:0/2643817548 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca54085280 con 0x7fca640692f0 2023-09-30T22:59:45.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.037+0000 7fca62ffd700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:45.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.037+0000 7fca62ffd700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fca64069cc0 tx=0x7fca58017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:45.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.041+0000 7fca4b7fe700 1 -- 172.21.15.142:0/2643817548 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fca540520e0 con 0x7fca640692f0 2023-09-30T22:59:45.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.272+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca640cbd80 con 0x7fca640692f0 2023-09-30T22:59:45.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.273+0000 7fca4b7fe700 1 -- 172.21.15.142:0/2643817548 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fca54055700 con 0x7fca640692f0 2023-09-30T22:59:45.274 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:45.274 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 msgr2=0x7fca500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fca64069cc0 tx=0x7fca58017000 comp rx=0 tx=0).stop 2023-09-30T22:59:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 msgr2=0x7fca640a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:45.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca640a8300 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fca5400d890 tx=0x7fca54008040 comp rx=0 tx=0).stop 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 shutdown_connections 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fca50067330 0x7fca500697e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca6415dc50 0x7fca6415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca640692f0 0x7fca640a8300 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 --2- 172.21.15.142:0/2643817548 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca64143350 0x7fca640a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 >> 172.21.15.142:0/2643817548 conn(0x7fca640ce8e0 msgr2=0x7fca640b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 shutdown_connections 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:45.275+0000 7fca6a1ff700 1 -- 172.21.15.142:0/2643817548 wait complete. 2023-09-30T22:59:45.277 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:45.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-30T22:59:45.505 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":6775,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.986084502000001,"mdsmap_epoch":66,"osdmap_epoch":147,"osdmap_epoch_barrier":146,"uptime":37.710561427000002} 2023-09-30T22:59:45.506 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 6775, "mdsmap_epoch": 66, "osdmap_epoch": 147, "osdmap_epoch_barrier": 146, "rank_uptime": 31.986084502, "state": "up:active", "uptime": 37.710561427, "want_state": "up:active", "whoami": 0 } 2023-09-30T22:59:45.506 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T22:59:45.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:45.506 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-30T22:59:45.957 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T22:59:45.957 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T22:59:45.957 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.401872 s, 130 MB/s 2023-09-30T22:59:45.958 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:59:45.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:59:46.055 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:59:46.165 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:59:46.165 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:59:46.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:46.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:59:46.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T22:59:46.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:46.285 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:59:46.332 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T22:59:46.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T22:59:46.332 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T22:59:46.417 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T22:59:46.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:59:46.418 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T22:59:46.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:46.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.655+0000 7f9617dff700 1 Processor -- start 2023-09-30T22:59:46.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.655+0000 7f9617dff700 1 -- start start 2023-09-30T22:59:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.656+0000 7f9617dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9610159ae0 0x7f96100cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.656+0000 7f9617dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96100cc590 0x7f9610069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.656+0000 7f9617dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961015d910 con 0x7f96100b1180 2023-09-30T22:59:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.656+0000 7f9617dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961015e920 con 0x7f96100cc590 2023-09-30T22:59:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.656+0000 7f9617dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961015e490 con 0x7f9610159ae0 2023-09-30T22:59:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961639c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96100cc590 0x7f9610069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f9615b9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9610159ae0 0x7f96100cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961639c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96100cc590 0x7f9610069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:56588/0 (socket says 172.21.15.142:56588) 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961639c700 1 -- 172.21.15.142:0/3188448873 learned_addr learned my addr 172.21.15.142:0/3188448873 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f9615b9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9610159ae0 0x7f96100cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:59950/0 (socket says 172.21.15.142:59950) 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961539a700 1 --1- 172.21.15.142:0/3188448873 >> v1:172.21.15.148:6789/0 conn(0x7f96100b1180 0x7f96100cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:43496/0 (socket says 172.21.15.142:43496) 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961639c700 1 -- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9610159ae0 msgr2=0x7f96100cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961639c700 1 --2- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9610159ae0 0x7f96100cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961639c700 1 -- 172.21.15.142:0/3188448873 >> v1:172.21.15.148:6789/0 conn(0x7f96100b1180 legacy=0x7f96100cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f961639c700 1 -- 172.21.15.142:0/3188448873 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961015db60 con 0x7f96100cc590 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f9614b99700 1 -- 172.21.15.142:0/3188448873 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091185064 0 0) 0x7f961015d910 con 0x7f96100b1180 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.657+0000 7f9615b9b700 1 --2- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9610159ae0 0x7f96100cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f961639c700 1 --2- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96100cc590 0x7f9610069f10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9608009f20 tx=0x7f9608009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea4792f258fce52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9614b99700 1 -- 172.21.15.142:0/3188448873 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800e070 con 0x7f96100cc590 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9614b99700 1 -- 172.21.15.142:0/3188448873 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800b9d0 con 0x7f96100cc590 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9614b99700 1 -- 172.21.15.142:0/3188448873 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080092e0 con 0x7f96100cc590 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 -- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96100cc590 msgr2=0x7f9610069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 --2- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96100cc590 0x7f9610069f10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9608009f20 tx=0x7f9608009840 comp rx=0 tx=0).stop 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 -- 172.21.15.142:0/3188448873 shutdown_connections 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 --2- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96100cc590 0x7f9610069f10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 --2- 172.21.15.142:0/3188448873 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9610159ae0 0x7f96100cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 -- 172.21.15.142:0/3188448873 >> 172.21.15.142:0/3188448873 conn(0x7f96100ce8b0 msgr2=0x7f96100cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 -- 172.21.15.142:0/3188448873 shutdown_connections 2023-09-30T22:59:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.658+0000 7f9617dff700 1 -- 172.21.15.142:0/3188448873 wait complete. 2023-09-30T22:59:46.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.660+0000 7f9617dff700 1 Processor -- start 2023-09-30T22:59:46.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.661+0000 7f9617dff700 1 -- start start 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9617dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96100b1180 0x7f961016e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9617dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96100cc590 0x7f96100c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9617dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9610159ae0 0x7f9610145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9617dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100c9ac0 con 0x7f96100cc590 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9617dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961016e5c0 con 0x7f9610159ae0 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9617dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96100c8eb0 con 0x7f96100b1180 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f961539a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96100cc590 0x7f96100c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9615b9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96100b1180 0x7f961016e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f961539a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96100cc590 0x7f96100c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58830/0 (socket says 172.21.15.142:58830) 2023-09-30T22:59:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f9615b9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96100b1180 0x7f961016e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:59958/0 (socket says 172.21.15.142:59958) 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f961539a700 1 -- 172.21.15.142:0/3069832951 learned_addr learned my addr 172.21.15.142:0/3069832951 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.662+0000 7f961639c700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9610159ae0 0x7f9610145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f961539a700 1 -- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96100b1180 msgr2=0x7f961016e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f961539a700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96100b1180 0x7f961016e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f961539a700 1 -- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9610159ae0 msgr2=0x7f9610145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f961539a700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9610159ae0 0x7f9610145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f961539a700 1 -- 172.21.15.142:0/3069832951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009420 con 0x7f96100cc590 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f9615b9b700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96100b1180 0x7f961016e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f961539a700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96100cc590 0x7f96100c9f50 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f96000011e0 tx=0x7f9600007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:46.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.663+0000 7f9605ffb700 1 -- 172.21.15.142:0/3069832951 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600005a70 con 0x7f96100cc590 2023-09-30T22:59:46.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.664+0000 7f9605ffb700 1 -- 172.21.15.142:0/3069832951 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600005bd0 con 0x7f96100cc590 2023-09-30T22:59:46.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.664+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9608009ae0 con 0x7f96100cc590 2023-09-30T22:59:46.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.664+0000 7f9605ffb700 1 -- 172.21.15.142:0/3069832951 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96000070d0 con 0x7f96100cc590 2023-09-30T22:59:46.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.664+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100c9470 con 0x7f96100cc590 2023-09-30T22:59:46.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.665+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96100c9c30 con 0x7f96100cc590 2023-09-30T22:59:46.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.665+0000 7f9605ffb700 1 -- 172.21.15.142:0/3069832951 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9600007480 con 0x7f96100cc590 2023-09-30T22:59:46.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.666+0000 7f9605ffb700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95f4067400 0x7f95f40698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:46.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.666+0000 7f9605ffb700 1 -- 172.21.15.142:0/3069832951 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9600084120 con 0x7f96100cc590 2023-09-30T22:59:46.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.667+0000 7f9615b9b700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95f4067400 0x7f95f40698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:46.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.667+0000 7f9615b9b700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95f4067400 0x7f95f40698b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f960c011560 tx=0x7f960c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:46.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.671+0000 7f9605ffb700 1 -- 172.21.15.142:0/3069832951 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9600051000 con 0x7f96100cc590 2023-09-30T22:59:46.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.903+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f961015de40 con 0x7f96100cc590 2023-09-30T22:59:46.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.904+0000 7f9605ffb700 1 -- 172.21.15.142:0/3069832951 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f9600054620 con 0x7f96100cc590 2023-09-30T22:59:46.904 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:46.904 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95f4067400 msgr2=0x7f95f40698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95f4067400 0x7f95f40698b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f960c011560 tx=0x7f960c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96100cc590 msgr2=0x7f96100c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96100cc590 0x7f96100c9f50 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f96000011e0 tx=0x7f9600007e10 comp rx=0 tx=0).stop 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 shutdown_connections 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95f4067400 0x7f95f40698b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9610159ae0 0x7f9610145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96100b1180 0x7f961016e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 --2- 172.21.15.142:0/3069832951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96100cc590 0x7f96100c9f50 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:46.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.906+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 >> 172.21.15.142:0/3069832951 conn(0x7f96100ce8b0 msgr2=0x7f96101546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.907+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 shutdown_connections 2023-09-30T22:59:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:46.907+0000 7f9617dff700 1 -- 172.21.15.142:0/3069832951 wait complete. 2023-09-30T22:59:46.908 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:46.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:47.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.112+0000 7f0575bff700 1 Processor -- start 2023-09-30T22:59:47.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.112+0000 7f0575bff700 1 -- start start 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f0575bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0570159b90 0x7f057015a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f0575bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570069f10 0x7f057006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f0575bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700b0ee0 con 0x7f05700aebf0 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f0575bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700aefc0 con 0x7f0570159b90 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f0575bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057015a550 con 0x7f0570069f10 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f05700aebf0 0x7f057006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33628/0 (socket says 172.21.15.142:33628) 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056f7fe700 1 -- 172.21.15.142:0/3339424865 learned_addr learned my addr 172.21.15.142:0/3339424865 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056effd700 1 --2- 172.21.15.142:0/3339424865 >> v2:172.21.15.148:3300/0 conn(0x7f0570159b90 0x7f057015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056ffff700 1 --2- 172.21.15.142:0/3339424865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570069f10 0x7f057006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056e7fc700 1 -- 172.21.15.142:0/3339424865 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682718060 0 0) 0x7f05700b0ee0 con 0x7f05700aebf0 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056e7fc700 1 -- 172.21.15.142:0/3339424865 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0558003570 con 0x7f05700aebf0 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056ffff700 1 -- 172.21.15.142:0/3339424865 >> v2:172.21.15.148:3300/0 conn(0x7f0570159b90 msgr2=0x7f057015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056ffff700 1 --2- 172.21.15.142:0/3339424865 >> v2:172.21.15.148:3300/0 conn(0x7f0570159b90 0x7f057015a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.114+0000 7f056ffff700 1 -- 172.21.15.142:0/3339424865 >> v1:172.21.15.142:6789/0 conn(0x7f05700aebf0 legacy=0x7f057006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.115+0000 7f056ffff700 1 -- 172.21.15.142:0/3339424865 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057006f360 con 0x7f0570069f10 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.115+0000 7f056ffff700 1 --2- 172.21.15.142:0/3339424865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570069f10 0x7f057006a390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0568009e60 tx=0x7f0568009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0e8f8a83abbacb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.115+0000 7f056e7fc700 1 -- 172.21.15.142:0/3339424865 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800e070 con 0x7f0570069f10 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.115+0000 7f056e7fc700 1 -- 172.21.15.142:0/3339424865 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056800bab0 con 0x7f0570069f10 2023-09-30T22:59:47.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.115+0000 7f056e7fc700 1 -- 172.21.15.142:0/3339424865 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800be70 con 0x7f0570069f10 2023-09-30T22:59:47.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 -- 172.21.15.142:0/3339424865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570069f10 msgr2=0x7f057006a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 --2- 172.21.15.142:0/3339424865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570069f10 0x7f057006a390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0568009e60 tx=0x7f0568009780 comp rx=0 tx=0).stop 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 -- 172.21.15.142:0/3339424865 shutdown_connections 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 --2- 172.21.15.142:0/3339424865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570069f10 0x7f057006a390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 --2- 172.21.15.142:0/3339424865 >> v2:172.21.15.148:3300/0 conn(0x7f0570159b90 0x7f057015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 -- 172.21.15.142:0/3339424865 >> 172.21.15.142:0/3339424865 conn(0x7f05700680c0 msgr2=0x7f05700c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 -- 172.21.15.142:0/3339424865 shutdown_connections 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.116+0000 7f0575bff700 1 -- 172.21.15.142:0/3339424865 wait complete. 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.117+0000 7f0575bff700 1 Processor -- start 2023-09-30T22:59:47.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.117+0000 7f0575bff700 1 -- start start 2023-09-30T22:59:47.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.118+0000 7f0575bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0570069f10 0x7f0570156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.118+0000 7f0575bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05700aebf0 0x7f05701478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.118+0000 7f0575bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570159b90 0x7f0570158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.118+0000 7f0575bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701491c0 con 0x7f0570069f10 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.118+0000 7f0575bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570149330 con 0x7f05700aebf0 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.118+0000 7f0575bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057014aa70 con 0x7f0570159b90 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.118+0000 7f056f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0570069f10 0x7f0570156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0570069f10 0x7f0570156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58834/0 (socket says 172.21.15.142:58834) 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 -- 172.21.15.142:0/3191065846 learned_addr learned my addr 172.21.15.142:0/3191065846 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056ffff700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570159b90 0x7f0570158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056effd700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05700aebf0 0x7f05701478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 -- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570159b90 msgr2=0x7f0570158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570159b90 0x7f0570158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 -- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05700aebf0 msgr2=0x7f05701478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05700aebf0 0x7f05701478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 -- 172.21.15.142:0/3191065846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009a20 con 0x7f0570069f10 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056effd700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05700aebf0 0x7f05701478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f056f7fe700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0570069f10 0x7f0570156db0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f056000c7c0 tx=0x7f0560007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f05577fe700 1 -- 172.21.15.142:0/3191065846 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560005b30 con 0x7f0570069f10 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.119+0000 7f05577fe700 1 -- 172.21.15.142:0/3191065846 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560005cb0 con 0x7f0570069f10 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.120+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05701489a0 con 0x7f0570069f10 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.120+0000 7f05577fe700 1 -- 172.21.15.142:0/3191065846 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560007320 con 0x7f0570069f10 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.120+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0570157770 con 0x7f0570069f10 2023-09-30T22:59:47.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.120+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05700695b0 con 0x7f0570069f10 2023-09-30T22:59:47.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.121+0000 7f05577fe700 1 -- 172.21.15.142:0/3191065846 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f056001b3b0 con 0x7f0570069f10 2023-09-30T22:59:47.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.122+0000 7f05577fe700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f055c067330 0x7f055c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.122+0000 7f05577fe700 1 -- 172.21.15.142:0/3191065846 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0560084140 con 0x7f0570069f10 2023-09-30T22:59:47.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.123+0000 7f056effd700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f055c067330 0x7f055c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.123+0000 7f056effd700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f055c067330 0x7f055c0697e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f057006b510 tx=0x7f0564008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.126+0000 7f05577fe700 1 -- 172.21.15.142:0/3191065846 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0560050fa0 con 0x7f0570069f10 2023-09-30T22:59:47.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.320+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f057006fc10 con 0x7f0570069f10 2023-09-30T22:59:47.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.321+0000 7f05577fe700 1 -- 172.21.15.142:0/3191065846 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+17033 (secure 0 0 0) 0x7f05600545c0 con 0x7f0570069f10 2023-09-30T22:59:47.322 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:47.322 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":147,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:39.329599+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:59:11.103746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-09-30T22:59:11.960192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f055c067330 msgr2=0x7f055c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f055c067330 0x7f055c0697e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f057006b510 tx=0x7f0564008040 comp rx=0 tx=0).stop 2023-09-30T22:59:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0570069f10 msgr2=0x7f0570156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0570069f10 0x7f0570156db0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f056000c7c0 tx=0x7f0560007e00 comp rx=0 tx=0).stop 2023-09-30T22:59:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 shutdown_connections 2023-09-30T22:59:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f055c067330 0x7f055c0697e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0570159b90 0x7f0570158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0570069f10 0x7f0570156db0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 --2- 172.21.15.142:0/3191065846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05700aebf0 0x7f05701478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 >> 172.21.15.142:0/3191065846 conn(0x7f05700680c0 msgr2=0x7f05700ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 shutdown_connections 2023-09-30T22:59:47.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.324+0000 7f0575bff700 1 -- 172.21.15.142:0/3191065846 wait complete. 2023-09-30T22:59:47.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:59:11.103746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:59:11.960192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:59:47.342 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:59:47.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.534+0000 7f12325ff700 1 Processor -- start 2023-09-30T22:59:47.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.534+0000 7f12325ff700 1 -- start start 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f12325ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f122c0ca5e0 0x7f122c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f12325ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f12325ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c067d10 con 0x7f122c159ba0 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f12325ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c06af90 con 0x7f122c0ca5e0 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f12325ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0676c0 con 0x7f122c0b0de0 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f122c0ca5e0 0x7f122c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f122c159ba0 0x7f122c0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33642/0 (socket says 172.21.15.142:33642) 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f122c0ca5e0 0x7f122c06a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58848/0 (socket says 172.21.15.142:58848) 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122bfff700 1 -- 172.21.15.142:0/1399352974 learned_addr learned my addr 172.21.15.142:0/1399352974 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f1230b9c700 1 --2- 172.21.15.142:0/1399352974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122b7fe700 1 -- 172.21.15.142:0/1399352974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 msgr2=0x7f122c0681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122b7fe700 1 --2- 172.21.15.142:0/1399352974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122b7fe700 1 -- 172.21.15.142:0/1399352974 >> v1:172.21.15.142:6789/0 conn(0x7f122c159ba0 legacy=0x7f122c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122b7fe700 1 -- 172.21.15.142:0/1399352974 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c0679a0 con 0x7f122c0ca5e0 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.536+0000 7f122affd700 1 -- 172.21.15.142:0/1399352974 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853215130 0 0) 0x7f122c067d10 con 0x7f122c159ba0 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f122b7fe700 1 --2- 172.21.15.142:0/1399352974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c0ca5e0 0x7f122c06a8d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f12200098e0 tx=0x7f12200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cd6af7f51e8f33 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f122affd700 1 -- 172.21.15.142:0/1399352974 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220009e80 con 0x7f122c0ca5e0 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f122affd700 1 -- 172.21.15.142:0/1399352974 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000b860 con 0x7f122c0ca5e0 2023-09-30T22:59:47.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f122affd700 1 -- 172.21.15.142:0/1399352974 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000bbe0 con 0x7f122c0ca5e0 2023-09-30T22:59:47.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f12325ff700 1 -- 172.21.15.142:0/1399352974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c0ca5e0 msgr2=0x7f122c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f12325ff700 1 --2- 172.21.15.142:0/1399352974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c0ca5e0 0x7f122c06a8d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f12200098e0 tx=0x7f12200091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f12325ff700 1 -- 172.21.15.142:0/1399352974 shutdown_connections 2023-09-30T22:59:47.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f12325ff700 1 --2- 172.21.15.142:0/1399352974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f12325ff700 1 --2- 172.21.15.142:0/1399352974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c0ca5e0 0x7f122c06a8d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.537+0000 7f12325ff700 1 -- 172.21.15.142:0/1399352974 >> 172.21.15.142:0/1399352974 conn(0x7f122c0cb2f0 msgr2=0x7f122c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.538+0000 7f12325ff700 1 -- 172.21.15.142:0/1399352974 shutdown_connections 2023-09-30T22:59:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.538+0000 7f12325ff700 1 -- 172.21.15.142:0/1399352974 wait complete. 2023-09-30T22:59:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.539+0000 7f12325ff700 1 Processor -- start 2023-09-30T22:59:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.539+0000 7f12325ff700 1 -- start start 2023-09-30T22:59:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f12325ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f12325ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122c0ca5e0 0x7f122c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f12325ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c159ba0 0x7f122c0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f12325ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c15abe0 con 0x7f122c159ba0 2023-09-30T22:59:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f12325ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c15a010 con 0x7f122c0ca5e0 2023-09-30T22:59:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f12325ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c15a2b0 con 0x7f122c0b0de0 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f1230b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c159ba0 0x7f122c0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f1230b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c159ba0 0x7f122c0cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58862/0 (socket says 172.21.15.142:58862) 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.540+0000 7f1230b9c700 1 -- 172.21.15.142:0/1706842959 learned_addr learned my addr 172.21.15.142:0/1706842959 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f122b7fe700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122c0ca5e0 0x7f122c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f122bfff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1230b9c700 1 -- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 msgr2=0x7f122c0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1230b9c700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1230b9c700 1 -- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122c0ca5e0 msgr2=0x7f122c0c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1230b9c700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122c0ca5e0 0x7f122c0c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1230b9c700 1 -- 172.21.15.142:0/1706842959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220009420 con 0x7f122c159ba0 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f122b7fe700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122c0ca5e0 0x7f122c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1230b9c700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c159ba0 0x7f122c0cc390 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f1224009fa0 tx=0x7f1224009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1213fff700 1 -- 172.21.15.142:0/1706842959 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400ed20 con 0x7f122c159ba0 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1213fff700 1 -- 172.21.15.142:0/1706842959 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122400ee80 con 0x7f122c159ba0 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f1213fff700 1 -- 172.21.15.142:0/1706842959 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224014670 con 0x7f122c159ba0 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122c15a590 con 0x7f122c159ba0 2023-09-30T22:59:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.541+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c0c8a00 con 0x7f122c159ba0 2023-09-30T22:59:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.542+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c15ad50 con 0x7f122c159ba0 2023-09-30T22:59:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.543+0000 7f1213fff700 1 -- 172.21.15.142:0/1706842959 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f12240149e0 con 0x7f122c159ba0 2023-09-30T22:59:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.544+0000 7f1213fff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1218067300 0x7f12180697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.544+0000 7f1213fff700 1 -- 172.21.15.142:0/1706842959 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1224085470 con 0x7f122c159ba0 2023-09-30T22:59:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.544+0000 7f122bfff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1218067300 0x7f12180697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.545+0000 7f122bfff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1218067300 0x7f12180697b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c8f0 tx=0x7f121c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.548+0000 7f1213fff700 1 -- 172.21.15.142:0/1706842959 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f12240522d0 con 0x7f122c159ba0 2023-09-30T22:59:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.739+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f122c0cac40 con 0x7f122c159ba0 2023-09-30T22:59:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.740+0000 7f1213fff700 1 -- 172.21.15.142:0/1706842959 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12240558f0 con 0x7f122c159ba0 2023-09-30T22:59:47.740 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T22:59:47.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1218067300 msgr2=0x7f12180697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1218067300 0x7f12180697b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c8f0 tx=0x7f121c009040 comp rx=0 tx=0).stop 2023-09-30T22:59:47.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c159ba0 msgr2=0x7f122c0cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c159ba0 0x7f122c0cc390 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f1224009fa0 tx=0x7f1224009900 comp rx=0 tx=0).stop 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 shutdown_connections 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1218067300 0x7f12180697b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f122c159ba0 0x7f122c0cc390 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f122c0b0de0 0x7f122c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 --2- 172.21.15.142:0/1706842959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f122c0ca5e0 0x7f122c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 >> 172.21.15.142:0/1706842959 conn(0x7f122c0cb2f0 msgr2=0x7f122c158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 shutdown_connections 2023-09-30T22:59:47.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.742+0000 7f12325ff700 1 -- 172.21.15.142:0/1706842959 wait complete. 2023-09-30T22:59:47.759 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:59:47.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.951+0000 7fe87c5ff700 1 Processor -- start 2023-09-30T22:59:47.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.951+0000 7fe87c5ff700 1 -- start start 2023-09-30T22:59:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.952+0000 7fe87c5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe874159ba0 0x7fe87406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.952+0000 7fe87c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 0x7fe8740681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.952+0000 7fe87c5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe874067d10 con 0x7fe8740b0de0 2023-09-30T22:59:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.952+0000 7fe87c5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87406af90 con 0x7fe874159ba0 2023-09-30T22:59:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.952+0000 7fe87c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740676c0 con 0x7fe8740ca5e0 2023-09-30T22:59:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.952+0000 7fe879b9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe8740b0de0 0x7fe8740c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33656/0 (socket says 172.21.15.142:33656) 2023-09-30T22:59:47.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.952+0000 7fe879b9a700 1 -- 172.21.15.142:0/1187503768 learned_addr learned my addr 172.21.15.142:0/1187503768 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe87ab9c700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 0x7fe8740681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe87a39b700 1 --2- 172.21.15.142:0/1187503768 >> v2:172.21.15.148:3300/0 conn(0x7fe874159ba0 0x7fe87406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477860117 0 0) 0x7fe874067d10 con 0x7fe8740b0de0 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe860003570 con 0x7fe8740b0de0 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1868674184 0 0) 0x7fe860003570 con 0x7fe8740b0de0 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 msgr2=0x7fe8740681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 0x7fe8740681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 >> v2:172.21.15.148:3300/0 conn(0x7fe874159ba0 msgr2=0x7fe87406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 --2- 172.21.15.142:0/1187503768 >> v2:172.21.15.148:3300/0 conn(0x7fe874159ba0 0x7fe87406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740679a0 con 0x7fe8740b0de0 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fe864001470 con 0x7fe8740b0de0 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe87a39b700 1 --2- 172.21.15.142:0/1187503768 >> v2:172.21.15.148:3300/0 conn(0x7fe874159ba0 0x7fe87406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 >> v1:172.21.15.142:6789/0 conn(0x7fe8740b0de0 legacy=0x7fe8740c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe860003ae0 0x7fe860003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 0x7fe860004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860004d50 0x7fe8600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87406af90 con 0x7fe860003ae0 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740676c0 con 0x7fe860004d50 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.953+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86000bb10 con 0x7fe8740ca5e0 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87a39b700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe860003ae0 0x7fe860003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe879b9a700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 0x7fe860004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87ab9c700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860004d50 0x7fe8600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87a39b700 1 -- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 msgr2=0x7fe860004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87a39b700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8740ca5e0 0x7fe860004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87a39b700 1 -- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860004d50 msgr2=0x7fe8600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87a39b700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860004d50 0x7fe8600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87a39b700 1 -- 172.21.15.142:0/1187503768 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe860003570 con 0x7fe860003ae0 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe87a39b700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe860003ae0 0x7fe860003ef0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe870009e20 tx=0x7fe8700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7d3b20f175ab79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000e920 con 0x7fe860003ae0 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87000ea80 con 0x7fe860003ae0 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.954+0000 7fe879399700 1 -- 172.21.15.142:0/1187503768 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000ee20 con 0x7fe860003ae0 2023-09-30T22:59:47.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.955+0000 7fe87c5ff700 1 -- 172.21.15.142:0/1187503768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe860003ae0 msgr2=0x7fe860003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.955+0000 7fe87c5ff700 1 --2- 172.21.15.142:0/1187503768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe860003ae0 0x7fe860003ef0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe870009e20 tx=0x7fe8700091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.955+0000 7fe87ab9c700 1 -- 172.21.15.142:0/1187503768 reap_dead start 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.955+0000 7fe87c5ff700 1 -- 172.21.15.142:0/1187503768 shutdown_connections 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.955+0000 7fe87c5ff700 1 -- 172.21.15.142:0/1187503768 >> 172.21.15.142:0/1187503768 conn(0x7fe8740cb2f0 msgr2=0x7fe8740cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.955+0000 7fe87c5ff700 1 -- 172.21.15.142:0/1187503768 shutdown_connections 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.955+0000 7fe87c5ff700 1 -- 172.21.15.142:0/1187503768 wait complete. 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.956+0000 7fe87c5ff700 1 Processor -- start 2023-09-30T22:59:47.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.957+0000 7fe87c5ff700 1 -- start start 2023-09-30T22:59:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.957+0000 7fe87c5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860003ae0 0x7fe87415a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.957+0000 7fe87c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8741459d0 0x7fe87415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.957+0000 7fe87c5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415d0c0 0x7fe87415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.957+0000 7fe87c5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874145fb0 con 0x7fe87415d0c0 2023-09-30T22:59:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.957+0000 7fe87c5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87415b480 con 0x7fe860003ae0 2023-09-30T22:59:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.957+0000 7fe87c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87415b760 con 0x7fe8741459d0 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415d0c0 0x7fe87415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415d0c0 0x7fe87415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58876/0 (socket says 172.21.15.142:58876) 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 -- 172.21.15.142:0/4065994342 learned_addr learned my addr 172.21.15.142:0/4065994342 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87a39b700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860003ae0 0x7fe87415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 -- 172.21.15.142:0/4065994342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8741459d0 msgr2=0x7fe87415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8741459d0 0x7fe87415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 -- 172.21.15.142:0/4065994342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860003ae0 msgr2=0x7fe87415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860003ae0 0x7fe87415a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 -- 172.21.15.142:0/4065994342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87415ba40 con 0x7fe87415d0c0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.958+0000 7fe87ab9c700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415d0c0 0x7fe87415d4f0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe87406f240 tx=0x7fe86c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.959+0000 7fe86a7fc700 1 -- 172.21.15.142:0/4065994342 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00e070 con 0x7fe87415d0c0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.959+0000 7fe86a7fc700 1 -- 172.21.15.142:0/4065994342 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c011d00 con 0x7fe87415d0c0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.959+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe874146200 con 0x7fe87415d0c0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.959+0000 7fe86a7fc700 1 -- 172.21.15.142:0/4065994342 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0166c0 con 0x7fe87415d0c0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.959+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87415da30 con 0x7fe87415d0c0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.960+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87406e4b0 con 0x7fe87415d0c0 2023-09-30T22:59:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.961+0000 7fe86a7fc700 1 -- 172.21.15.142:0/4065994342 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe86c016ab0 con 0x7fe87415d0c0 2023-09-30T22:59:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.961+0000 7fe86a7fc700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe858067330 0x7fe8580697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.962+0000 7fe86a7fc700 1 -- 172.21.15.142:0/4065994342 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe86c0857f0 con 0x7fe87415d0c0 2023-09-30T22:59:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.962+0000 7fe87a39b700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe858067330 0x7fe8580697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.962+0000 7fe87a39b700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe858067330 0x7fe8580697e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe8700093d0 tx=0x7fe87001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:47.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:47.966+0000 7fe86a7fc700 1 -- 172.21.15.142:0/4065994342 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe86c0560e0 con 0x7fe87415d0c0 2023-09-30T22:59:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.153+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe874064fb0 con 0x7fe87415d0c0 2023-09-30T22:59:48.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.154+0000 7fe86a7fc700 1 -- 172.21.15.142:0/4065994342 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe874064fb0 con 0x7fe87415d0c0 2023-09-30T22:59:48.154 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T22:59:48.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe858067330 msgr2=0x7fe8580697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe858067330 0x7fe8580697e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe8700093d0 tx=0x7fe87001a000 comp rx=0 tx=0).stop 2023-09-30T22:59:48.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415d0c0 msgr2=0x7fe87415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415d0c0 0x7fe87415d4f0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe87406f240 tx=0x7fe86c00b040 comp rx=0 tx=0).stop 2023-09-30T22:59:48.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 shutdown_connections 2023-09-30T22:59:48.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe858067330 0x7fe8580697e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe87415d0c0 0x7fe87415d4f0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe860003ae0 0x7fe87415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 --2- 172.21.15.142:0/4065994342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8741459d0 0x7fe87415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 >> 172.21.15.142:0/4065994342 conn(0x7fe8740cb2f0 msgr2=0x7fe8740b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:48.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 shutdown_connections 2023-09-30T22:59:48.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.156+0000 7fe87c5ff700 1 -- 172.21.15.142:0/4065994342 wait complete. 2023-09-30T22:59:48.173 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:59:48.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.366+0000 7f16397ff700 1 Processor -- start 2023-09-30T22:59:48.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.367+0000 7f16397ff700 1 -- start start 2023-09-30T22:59:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.368+0000 7f16397ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16340ca5e0 0x7f163406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.368+0000 7f16397ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1634067d10 con 0x7f16340b0de0 2023-09-30T22:59:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.368+0000 7f16397ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163406af90 con 0x7f1634159ba0 2023-09-30T22:59:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.368+0000 7f16397ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340676c0 con 0x7f16340ca5e0 2023-09-30T22:59:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.368+0000 7f16327fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16340ca5e0 0x7f163406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.368+0000 7f16337fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f16340b0de0 0x7f16340681a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33658/0 (socket says 172.21.15.142:33658) 2023-09-30T22:59:48.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.368+0000 7f16337fe700 1 -- 172.21.15.142:0/2220614770 learned_addr learned my addr 172.21.15.142:0/2220614770 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f1631ffb700 1 -- 172.21.15.142:0/2220614770 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899074613 0 0) 0x7f1634067d10 con 0x7f16340b0de0 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f1631ffb700 1 -- 172.21.15.142:0/2220614770 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f161c003570 con 0x7f16340b0de0 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f1631ffb700 1 -- 172.21.15.142:0/2220614770 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947219165 0 0) 0x7f163406af90 con 0x7f1634159ba0 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f16327fc700 1 -- 172.21.15.142:0/2220614770 >> v1:172.21.15.148:6789/0 conn(0x7f1634159ba0 legacy=0x7f16340c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f16327fc700 1 -- 172.21.15.142:0/2220614770 >> v1:172.21.15.142:6789/0 conn(0x7f16340b0de0 legacy=0x7f16340681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f16327fc700 1 -- 172.21.15.142:0/2220614770 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340679a0 con 0x7f16340ca5e0 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f16327fc700 1 --2- 172.21.15.142:0/2220614770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16340ca5e0 0x7f163406a8d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f16280098e0 tx=0x7f16280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f02a62f120a9aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:48.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f1631ffb700 1 -- 172.21.15.142:0/2220614770 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162800b640 con 0x7f16340ca5e0 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f1631ffb700 1 -- 172.21.15.142:0/2220614770 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162800b7a0 con 0x7f16340ca5e0 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.369+0000 7f1631ffb700 1 -- 172.21.15.142:0/2220614770 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162800bb40 con 0x7f16340ca5e0 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.370+0000 7f16397ff700 1 -- 172.21.15.142:0/2220614770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16340ca5e0 msgr2=0x7f163406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.370+0000 7f16397ff700 1 --2- 172.21.15.142:0/2220614770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16340ca5e0 0x7f163406a8d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f16280098e0 tx=0x7f16280091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.370+0000 7f16397ff700 1 -- 172.21.15.142:0/2220614770 shutdown_connections 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.370+0000 7f16397ff700 1 --2- 172.21.15.142:0/2220614770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16340ca5e0 0x7f163406a8d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.370+0000 7f16397ff700 1 -- 172.21.15.142:0/2220614770 >> 172.21.15.142:0/2220614770 conn(0x7f16340cb2f0 msgr2=0x7f16340cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.370+0000 7f16397ff700 1 -- 172.21.15.142:0/2220614770 shutdown_connections 2023-09-30T22:59:48.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.370+0000 7f16397ff700 1 -- 172.21.15.142:0/2220614770 wait complete. 2023-09-30T22:59:48.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.371+0000 7f16397ff700 1 Processor -- start 2023-09-30T22:59:48.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.372+0000 7f16397ff700 1 -- start start 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.372+0000 7f16397ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16340b0de0 0x7f163416e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.372+0000 7f16397ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16340ca5e0 0x7f16340aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.372+0000 7f16397ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1634159ba0 0x7f163415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16397ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163416eaa0 con 0x7f1634159ba0 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16397ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163415bab0 con 0x7f16340ca5e0 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16397ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163415bd90 con 0x7f16340b0de0 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1634159ba0 0x7f163415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1634159ba0 0x7f163415db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58892/0 (socket says 172.21.15.142:58892) 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 -- 172.21.15.142:0/1052446609 learned_addr learned my addr 172.21.15.142:0/1052446609 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f1632ffd700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16340b0de0 0x7f163416e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16327fc700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16340ca5e0 0x7f16340aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 -- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16340b0de0 msgr2=0x7f163416e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16340b0de0 0x7f163416e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 -- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16340ca5e0 msgr2=0x7f16340aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16340ca5e0 0x7f16340aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.373+0000 7f16337fe700 1 -- 172.21.15.142:0/1052446609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628009420 con 0x7f1634159ba0 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.374+0000 7f16337fe700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1634159ba0 0x7f163415db50 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f162c001460 tx=0x7f162c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.374+0000 7f161affd700 1 -- 172.21.15.142:0/1052446609 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c00a890 con 0x7f1634159ba0 2023-09-30T22:59:48.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.374+0000 7f161affd700 1 -- 172.21.15.142:0/1052446609 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c00a9f0 con 0x7f1634159ba0 2023-09-30T22:59:48.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.374+0000 7f161affd700 1 -- 172.21.15.142:0/1052446609 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c00ad70 con 0x7f1634159ba0 2023-09-30T22:59:48.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.374+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163415c070 con 0x7f1634159ba0 2023-09-30T22:59:48.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.374+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16340c4c80 con 0x7f1634159ba0 2023-09-30T22:59:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.375+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163406e4b0 con 0x7f1634159ba0 2023-09-30T22:59:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.376+0000 7f161affd700 1 -- 172.21.15.142:0/1052446609 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f162c007300 con 0x7f1634159ba0 2023-09-30T22:59:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.377+0000 7f161affd700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1620067330 0x7f16200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.377+0000 7f161affd700 1 -- 172.21.15.142:0/1052446609 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f162c084fa0 con 0x7f1634159ba0 2023-09-30T22:59:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.377+0000 7f1632ffd700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1620067330 0x7f16200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.378+0000 7f1632ffd700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1620067330 0x7f16200697e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1624003a40 tx=0x7f1624007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:48.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.381+0000 7f161affd700 1 -- 172.21.15.142:0/1052446609 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f162c051e80 con 0x7f1634159ba0 2023-09-30T22:59:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.569+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16340cac40 con 0x7f1634159ba0 2023-09-30T22:59:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.569+0000 7f161affd700 1 -- 172.21.15.142:0/1052446609 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v147) v1 ==== 104+0+11 (secure 0 0 0) 0x7f162c0554a0 con 0x7f1634159ba0 2023-09-30T22:59:48.569 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T22:59:48.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1620067330 msgr2=0x7f16200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1620067330 0x7f16200697e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1624003a40 tx=0x7f1624007ec0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1634159ba0 msgr2=0x7f163415db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1634159ba0 0x7f163415db50 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f162c001460 tx=0x7f162c001ae0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 shutdown_connections 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1620067330 0x7f16200697e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1634159ba0 0x7f163415db50 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16340b0de0 0x7f163416e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 --2- 172.21.15.142:0/1052446609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16340ca5e0 0x7f16340aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 >> 172.21.15.142:0/1052446609 conn(0x7f16340cb2f0 msgr2=0x7f1634069030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.571+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 shutdown_connections 2023-09-30T22:59:48.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.572+0000 7f16397ff700 1 -- 172.21.15.142:0/1052446609 wait complete. 2023-09-30T22:59:48.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:59:48.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.780+0000 7f231e5ff700 1 Processor -- start 2023-09-30T22:59:48.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.780+0000 7f231e5ff700 1 -- start start 2023-09-30T22:59:48.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f231e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f231806aeb0 0x7f2318156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f231e5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23181576e0 con 0x7f23181509d0 2023-09-30T22:59:48.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f231e5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231815a490 con 0x7f2318150600 2023-09-30T22:59:48.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f231e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180cc320 con 0x7f231806aeb0 2023-09-30T22:59:48.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f23177fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f23181509d0 0x7f2318156710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33662/0 (socket says 172.21.15.142:33662) 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f23177fe700 1 -- 172.21.15.142:0/1221888980 learned_addr learned my addr 172.21.15.142:0/1221888980 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f231cb9c700 1 --2- 172.21.15.142:0/1221888980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f231806aeb0 0x7f2318156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f2316ffd700 1 -- 172.21.15.142:0/1221888980 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370230798 0 0) 0x7f23181576e0 con 0x7f23181509d0 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.782+0000 7f2316ffd700 1 -- 172.21.15.142:0/1221888980 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2300003570 con 0x7f23181509d0 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f2316ffd700 1 -- 172.21.15.142:0/1221888980 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489362990 0 0) 0x7f231815a490 con 0x7f2318150600 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f2316ffd700 1 -- 172.21.15.142:0/1221888980 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23181576e0 con 0x7f2318150600 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f231cb9c700 1 -- 172.21.15.142:0/1221888980 >> v1:172.21.15.148:6789/0 conn(0x7f2318150600 legacy=0x7f231806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f231cb9c700 1 -- 172.21.15.142:0/1221888980 >> v1:172.21.15.142:6789/0 conn(0x7f23181509d0 legacy=0x7f2318156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f231cb9c700 1 -- 172.21.15.142:0/1221888980 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318157400 con 0x7f231806aeb0 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f231cb9c700 1 --2- 172.21.15.142:0/1221888980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f231806aeb0 0x7f2318156e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2310009e90 tx=0x7f2310009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fabb80c3ed1b57fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:48.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f2316ffd700 1 -- 172.21.15.142:0/1221888980 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000e070 con 0x7f231806aeb0 2023-09-30T22:59:48.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f2316ffd700 1 -- 172.21.15.142:0/1221888980 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000bb80 con 0x7f231806aeb0 2023-09-30T22:59:48.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.783+0000 7f2316ffd700 1 -- 172.21.15.142:0/1221888980 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310012430 con 0x7f231806aeb0 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.784+0000 7f231e5ff700 1 -- 172.21.15.142:0/1221888980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f231806aeb0 msgr2=0x7f2318156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.784+0000 7f231e5ff700 1 --2- 172.21.15.142:0/1221888980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f231806aeb0 0x7f2318156e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2310009e90 tx=0x7f2310009780 comp rx=0 tx=0).stop 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.784+0000 7f231e5ff700 1 -- 172.21.15.142:0/1221888980 shutdown_connections 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.784+0000 7f231e5ff700 1 --2- 172.21.15.142:0/1221888980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f231806aeb0 0x7f2318156e20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.784+0000 7f231e5ff700 1 -- 172.21.15.142:0/1221888980 >> 172.21.15.142:0/1221888980 conn(0x7f23180cc670 msgr2=0x7f23180cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.784+0000 7f231e5ff700 1 -- 172.21.15.142:0/1221888980 shutdown_connections 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.784+0000 7f231e5ff700 1 -- 172.21.15.142:0/1221888980 wait complete. 2023-09-30T22:59:48.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.786+0000 7f231e5ff700 1 Processor -- start 2023-09-30T22:59:48.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.786+0000 7f231e5ff700 1 -- start start 2023-09-30T22:59:48.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f231e5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f231806aeb0 0x7f2318146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f231e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318150600 0x7f23180c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f231e5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23181509d0 0x7f23181481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f231e5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181486e0 con 0x7f231806aeb0 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f231e5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318147d10 con 0x7f23181509d0 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f231e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23181466e0 con 0x7f2318150600 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f231806aeb0 0x7f2318146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f231806aeb0 0x7f2318146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58906/0 (socket says 172.21.15.142:58906) 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 -- 172.21.15.142:0/2330837271 learned_addr learned my addr 172.21.15.142:0/2330837271 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f231cb9c700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23181509d0 0x7f23181481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f23177fe700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318150600 0x7f23180c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 -- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318150600 msgr2=0x7f23180c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318150600 0x7f23180c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 -- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23181509d0 msgr2=0x7f23181481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23181509d0 0x7f23181481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.787+0000 7f2317fff700 1 -- 172.21.15.142:0/2330837271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009a20 con 0x7f231806aeb0 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.788+0000 7f2317fff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f231806aeb0 0x7f2318146a00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f230800c790 tx=0x7f2308007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.788+0000 7f22fffff700 1 -- 172.21.15.142:0/2330837271 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308010510 con 0x7f231806aeb0 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.788+0000 7f22fffff700 1 -- 172.21.15.142:0/2330837271 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308010670 con 0x7f231806aeb0 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.788+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318147100 con 0x7f231806aeb0 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.788+0000 7f22fffff700 1 -- 172.21.15.142:0/2330837271 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308010a10 con 0x7f231806aeb0 2023-09-30T22:59:48.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.788+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23181476c0 con 0x7f231806aeb0 2023-09-30T22:59:48.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.789+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318147ff0 con 0x7f231806aeb0 2023-09-30T22:59:48.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.790+0000 7f22fffff700 1 -- 172.21.15.142:0/2330837271 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f230801b400 con 0x7f231806aeb0 2023-09-30T22:59:48.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.790+0000 7f22fffff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:48.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.791+0000 7f22fffff700 1 -- 172.21.15.142:0/2330837271 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2308084a00 con 0x7f231806aeb0 2023-09-30T22:59:48.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.791+0000 7f23177fe700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:48.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.791+0000 7f23177fe700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f231816d8d0 tx=0x7f230c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:48.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.795+0000 7f22fffff700 1 -- 172.21.15.142:0/2330837271 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2308051860 con 0x7f231806aeb0 2023-09-30T22:59:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.984+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f231806fc10 con 0x7f231806aeb0 2023-09-30T22:59:48.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.984+0000 7f22fffff700 1 -- 172.21.15.142:0/2330837271 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v147) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2308054e80 con 0x7f231806aeb0 2023-09-30T22:59:48.984 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 msgr2=0x7f23040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f231816d8d0 tx=0x7f230c009040 comp rx=0 tx=0).stop 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f231806aeb0 msgr2=0x7f2318146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f231806aeb0 0x7f2318146a00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f230800c790 tx=0x7f2308007e10 comp rx=0 tx=0).stop 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 shutdown_connections 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2304067330 0x7f23040697e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23181509d0 0x7f23181481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f231806aeb0 0x7f2318146a00 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 --2- 172.21.15.142:0/2330837271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2318150600 0x7f23180c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:48.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 >> 172.21.15.142:0/2330837271 conn(0x7f23180cc670 msgr2=0x7f2318069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:48.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 shutdown_connections 2023-09-30T22:59:48.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:48.987+0000 7f231e5ff700 1 -- 172.21.15.142:0/2330837271 wait complete. 2023-09-30T22:59:49.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:49.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.192+0000 7fa3b83ff700 1 Processor -- start 2023-09-30T22:59:49.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.193+0000 7fa3b83ff700 1 -- start start 2023-09-30T22:59:49.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b83ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa3b00af020 0x7fa3b0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b83ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00b00d0 0x7fa3b006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b83ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b006d3e0 con 0x7fa3b006e650 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b83ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b015b400 con 0x7fa3b00af020 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b83ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b006dc80 con 0x7fa3b00b00d0 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b619b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa3b00af020 0x7fa3b0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b699c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa3b006e650 0x7fa3b00b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33668/0 (socket says 172.21.15.142:33668) 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b619b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa3b00af020 0x7fa3b0156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58916/0 (socket says 172.21.15.142:58916) 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.194+0000 7fa3b699c700 1 -- 172.21.15.142:0/3381180125 learned_addr learned my addr 172.21.15.142:0/3381180125 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b599a700 1 --2- 172.21.15.142:0/3381180125 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00b00d0 0x7fa3b006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b619b700 1 -- 172.21.15.142:0/3381180125 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00b00d0 msgr2=0x7fa3b006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:49.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b619b700 1 --2- 172.21.15.142:0/3381180125 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00b00d0 0x7fa3b006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b619b700 1 -- 172.21.15.142:0/3381180125 >> v1:172.21.15.142:6789/0 conn(0x7fa3b006e650 legacy=0x7fa3b00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b619b700 1 -- 172.21.15.142:0/3381180125 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b006b790 con 0x7fa3b00af020 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b5199700 1 -- 172.21.15.142:0/3381180125 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975021484 0 0) 0x7fa3b006d3e0 con 0x7fa3b006e650 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b619b700 1 --2- 172.21.15.142:0/3381180125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00af020 0x7fa3b0156d80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0098e0 tx=0x7fa3ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444ddec99784cf68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b5199700 1 -- 172.21.15.142:0/3381180125 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac009e80 con 0x7fa3b00af020 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b5199700 1 -- 172.21.15.142:0/3381180125 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac00b860 con 0x7fa3b00af020 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.195+0000 7fa3b5199700 1 -- 172.21.15.142:0/3381180125 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00bbe0 con 0x7fa3b00af020 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 -- 172.21.15.142:0/3381180125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00af020 msgr2=0x7fa3b0156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/3381180125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00af020 0x7fa3b0156d80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0098e0 tx=0x7fa3ac0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 -- 172.21.15.142:0/3381180125 shutdown_connections 2023-09-30T22:59:49.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/3381180125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00af020 0x7fa3b0156d80 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/3381180125 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00b00d0 0x7fa3b006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 -- 172.21.15.142:0/3381180125 >> 172.21.15.142:0/3381180125 conn(0x7fa3b00680c0 msgr2=0x7fa3b00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:49.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 -- 172.21.15.142:0/3381180125 shutdown_connections 2023-09-30T22:59:49.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.196+0000 7fa3b83ff700 1 -- 172.21.15.142:0/3381180125 wait complete. 2023-09-30T22:59:49.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.198+0000 7fa3b83ff700 1 Processor -- start 2023-09-30T22:59:49.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.198+0000 7fa3b83ff700 1 -- start start 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b83ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3b006e650 0x7fa3b014e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b83ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00af020 0x7fa3b01513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b83ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00b00d0 0x7fa3b01518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b83ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0151e20 con 0x7fa3b00b00d0 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b83ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b016e460 con 0x7fa3b006e650 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b83ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b016d850 con 0x7fa3b00af020 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00b00d0 0x7fa3b01518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00b00d0 0x7fa3b01518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58922/0 (socket says 172.21.15.142:58922) 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 -- 172.21.15.142:0/2564126623 learned_addr learned my addr 172.21.15.142:0/2564126623 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b599a700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00af020 0x7fa3b01513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b619b700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3b006e650 0x7fa3b014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 -- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00af020 msgr2=0x7fa3b01513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00af020 0x7fa3b01513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 -- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3b006e650 msgr2=0x7fa3b014e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3b006e650 0x7fa3b014e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b699c700 1 -- 172.21.15.142:0/2564126623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac009420 con 0x7fa3b00b00d0 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b619b700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3b006e650 0x7fa3b014e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.199+0000 7fa3b599a700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00af020 0x7fa3b01513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.200+0000 7fa3b699c700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00b00d0 0x7fa3b01518e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800cbf0 tx=0x7fa3a80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.200+0000 7fa3a67fc700 1 -- 172.21.15.142:0/2564126623 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800a9c0 con 0x7fa3b00b00d0 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.200+0000 7fa3a67fc700 1 -- 172.21.15.142:0/2564126623 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a800ab40 con 0x7fa3b00b00d0 2023-09-30T22:59:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.200+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b016db30 con 0x7fa3b00b00d0 2023-09-30T22:59:49.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.200+0000 7fa3a67fc700 1 -- 172.21.15.142:0/2564126623 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80070f0 con 0x7fa3b00b00d0 2023-09-30T22:59:49.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.200+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b016e170 con 0x7fa3b00b00d0 2023-09-30T22:59:49.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.201+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b014ef30 con 0x7fa3b00b00d0 2023-09-30T22:59:49.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.202+0000 7fa3a67fc700 1 -- 172.21.15.142:0/2564126623 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa3a8007520 con 0x7fa3b00b00d0 2023-09-30T22:59:49.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.203+0000 7fa3a67fc700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa394067330 0x7fa3940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.203+0000 7fa3a67fc700 1 -- 172.21.15.142:0/2564126623 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa3a8084fd0 con 0x7fa3b00b00d0 2023-09-30T22:59:49.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.203+0000 7fa3b619b700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa394067330 0x7fa3940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.204+0000 7fa3b619b700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa394067330 0x7fa3940697e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0091e0 tx=0x7fa3ac017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:49.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.207+0000 7fa3a67fc700 1 -- 172.21.15.142:0/2564126623 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa3a8051eb0 con 0x7fa3b00b00d0 2023-09-30T22:59:49.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.444+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3b006fc10 con 0x7fa3b00b00d0 2023-09-30T22:59:49.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.445+0000 7fa3a67fc700 1 -- 172.21.15.142:0/2564126623 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fa3a80554d0 con 0x7fa3b00b00d0 2023-09-30T22:59:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:49.445 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.447+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa394067330 msgr2=0x7fa3940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.447+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa394067330 0x7fa3940697e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0091e0 tx=0x7fa3ac017000 comp rx=0 tx=0).stop 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.447+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00b00d0 msgr2=0x7fa3b01518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.447+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00b00d0 0x7fa3b01518e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800cbf0 tx=0x7fa3a80019b0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 shutdown_connections 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa394067330 0x7fa3940697e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3b00b00d0 0x7fa3b01518e0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3b006e650 0x7fa3b014e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 --2- 172.21.15.142:0/2564126623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa3b00af020 0x7fa3b01513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 >> 172.21.15.142:0/2564126623 conn(0x7fa3b00680c0 msgr2=0x7fa3b006a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:49.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 shutdown_connections 2023-09-30T22:59:49.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.448+0000 7fa3b83ff700 1 -- 172.21.15.142:0/2564126623 wait complete. 2023-09-30T22:59:49.449 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:49.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:49.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.655+0000 7f1e70bff700 1 Processor -- start 2023-09-30T22:59:49.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.655+0000 7f1e70bff700 1 -- start start 2023-09-30T22:59:49.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.656+0000 7f1e70bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.656+0000 7f1e70bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e6c15de20 0x7f1e6c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.656+0000 7f1e70bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0cc6b0 con 0x7f1e6c0692f0 2023-09-30T22:59:49.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.656+0000 7f1e70bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0cb7d0 con 0x7f1e6c15de20 2023-09-30T22:59:49.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.656+0000 7f1e70bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0cbaa0 con 0x7f1e6c143350 2023-09-30T22:59:49.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.656+0000 7f1e6ad9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e6c15de20 0x7f1e6c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e69d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1e6c0692f0 0x7f1e6c15d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33680/0 (socket says 172.21.15.142:33680) 2023-09-30T22:59:49.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e69d9b700 1 -- 172.21.15.142:0/3254623714 learned_addr learned my addr 172.21.15.142:0/3254623714 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:49.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6ad9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e6c15de20 0x7f1e6c06a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58926/0 (socket says 172.21.15.142:58926) 2023-09-30T22:59:49.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6a59c700 1 --2- 172.21.15.142:0/3254623714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6ad9d700 1 -- 172.21.15.142:0/3254623714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 msgr2=0x7f1e6c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6ad9d700 1 --2- 172.21.15.142:0/3254623714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6ad9d700 1 -- 172.21.15.142:0/3254623714 >> v1:172.21.15.142:6789/0 conn(0x7f1e6c0692f0 legacy=0x7f1e6c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6ad9d700 1 -- 172.21.15.142:0/3254623714 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0cbd80 con 0x7f1e6c15de20 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6959a700 1 -- 172.21.15.142:0/3254623714 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733545800 0 0) 0x7f1e6c0cc6b0 con 0x7f1e6c0692f0 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6ad9d700 1 --2- 172.21.15.142:0/3254623714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c06a0c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009e60 tx=0x7f1e64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd08fee23f0a6411 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.657+0000 7f1e6959a700 1 -- 172.21.15.142:0/3254623714 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400e070 con 0x7f1e6c15de20 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e6959a700 1 -- 172.21.15.142:0/3254623714 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6400bc30 con 0x7f1e6c15de20 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e6959a700 1 -- 172.21.15.142:0/3254623714 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64012430 con 0x7f1e6c15de20 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 -- 172.21.15.142:0/3254623714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 msgr2=0x7f1e6c06a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 --2- 172.21.15.142:0/3254623714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c06a0c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009e60 tx=0x7f1e64009780 comp rx=0 tx=0).stop 2023-09-30T22:59:49.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 -- 172.21.15.142:0/3254623714 shutdown_connections 2023-09-30T22:59:49.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 --2- 172.21.15.142:0/3254623714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c06a0c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 --2- 172.21.15.142:0/3254623714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 -- 172.21.15.142:0/3254623714 >> 172.21.15.142:0/3254623714 conn(0x7f1e6c0ce8e0 msgr2=0x7f1e6c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:49.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 -- 172.21.15.142:0/3254623714 shutdown_connections 2023-09-30T22:59:49.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.658+0000 7f1e70bff700 1 -- 172.21.15.142:0/3254623714 wait complete. 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.660+0000 7f1e70bff700 1 Processor -- start 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.660+0000 7f1e70bff700 1 -- start start 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e70bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c0692f0 0x7f1e6c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e70bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e70bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c1424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e70bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15cac0 con 0x7f1e6c15de20 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e70bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15b880 con 0x7f1e6c0692f0 2023-09-30T22:59:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e70bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15b270 con 0x7f1e6c143350 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e6ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c1424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e6ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c1424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58938/0 (socket says 172.21.15.142:58938) 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e6ad9d700 1 -- 172.21.15.142:0/1702621655 learned_addr learned my addr 172.21.15.142:0/1702621655 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e69d9b700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e6a59c700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c0692f0 0x7f1e6c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e6ad9d700 1 -- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 msgr2=0x7f1e6c141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e6ad9d700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.661+0000 7f1e6ad9d700 1 -- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c0692f0 msgr2=0x7f1e6c15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e6ad9d700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c0692f0 0x7f1e6c15bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e6ad9d700 1 -- 172.21.15.142:0/1702621655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64009a20 con 0x7f1e6c15de20 2023-09-30T22:59:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e6a59c700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c0692f0 0x7f1e6c15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e6ad9d700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c1424a0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f1e640097c0 tx=0x7f1e64019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64027470 con 0x7f1e6c15de20 2023-09-30T22:59:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e640275d0 con 0x7f1e6c15de20 2023-09-30T22:59:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64027990 con 0x7f1e6c15de20 2023-09-30T22:59:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c16aab0 con 0x7f1e6c15de20 2023-09-30T22:59:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.662+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c16ad90 con 0x7f1e6c15de20 2023-09-30T22:59:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.663+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c06ea70 con 0x7f1e6c15de20 2023-09-30T22:59:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.664+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1e64024070 con 0x7f1e6c15de20 2023-09-30T22:59:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.665+0000 7f1e5a7fc700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e4c067330 0x7f1e4c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.665+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1e64087410 con 0x7f1e6c15de20 2023-09-30T22:59:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.665+0000 7f1e6a59c700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e4c067330 0x7f1e4c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.665+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f1e4c06f4f0 con 0x7f1e6c15de20 2023-09-30T22:59:49.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.666+0000 7f1e6a59c700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e4c067330 0x7f1e4c0697e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c006fd0 tx=0x7f1e5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:49.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.669+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1e64054270 con 0x7f1e6c15de20 2023-09-30T22:59:49.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.862+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e6c15b9c0 con 0x7f1e6c15de20 2023-09-30T22:59:49.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.863+0000 7f1e5a7fc700 1 -- 172.21.15.142:0/1702621655 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+17052 (secure 0 0 0) 0x7f1e6402c070 con 0x7f1e6c15de20 2023-09-30T22:59:49.864 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:49.864 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":148,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:49.331956+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:59:11.103746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-09-30T22:59:11.960192+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:49.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e4c067330 msgr2=0x7f1e4c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e4c067330 0x7f1e4c0697e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c006fd0 tx=0x7f1e5c008040 comp rx=0 tx=0).stop 2023-09-30T22:59:49.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 msgr2=0x7f1e6c1424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:49.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c1424a0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f1e640097c0 tx=0x7f1e64019000 comp rx=0 tx=0).stop 2023-09-30T22:59:49.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 shutdown_connections 2023-09-30T22:59:49.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1e4c067330 0x7f1e4c0697e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e6c15de20 0x7f1e6c1424a0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c0692f0 0x7f1e6c15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 --2- 172.21.15.142:0/1702621655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c143350 0x7f1e6c141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:49.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 >> 172.21.15.142:0/1702621655 conn(0x7f1e6c0ce8e0 msgr2=0x7f1e6c158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:49.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 shutdown_connections 2023-09-30T22:59:49.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:49.866+0000 7f1e70bff700 1 -- 172.21.15.142:0/1702621655 wait complete. 2023-09-30T22:59:49.883 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T22:59:49.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:50.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.073+0000 7f8f0adff700 1 Processor -- start 2023-09-30T22:59:50.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.073+0000 7f8f0adff700 1 -- start start 2023-09-30T22:59:50.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.074+0000 7f8f0adff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f040aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.074+0000 7f8f0adff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f0406b930 0x7f8f040aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.074+0000 7f8f0adff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f04068000 con 0x7f8f04159b50 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.074+0000 7f8f0adff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f04069f10 con 0x7f8f0406b930 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.074+0000 7f8f0adff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04068240 con 0x7f8f040ac3a0 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.074+0000 7f8f0939c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f0406b930 0x7f8f040aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f0939c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f0406b930 0x7f8f040aa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58942/0 (socket says 172.21.15.142:58942) 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f0939c700 1 -- 172.21.15.142:0/3381544915 learned_addr learned my addr 172.21.15.142:0/3381544915 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f03fff700 1 --2- 172.21.15.142:0/3381544915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f040aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f0939c700 1 -- 172.21.15.142:0/3381544915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 msgr2=0x7f8f040aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f0939c700 1 --2- 172.21.15.142:0/3381544915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f040aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f0939c700 1 -- 172.21.15.142:0/3381544915 >> v1:172.21.15.148:6789/0 conn(0x7f8f04159b50 legacy=0x7f8f040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f0939c700 1 -- 172.21.15.142:0/3381544915 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04068520 con 0x7f8f0406b930 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f0939c700 1 --2- 172.21.15.142:0/3381544915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f040aa7e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009f20 tx=0x7f8efc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd10d17e42141fc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.075+0000 7f8f037fe700 1 -- 172.21.15.142:0/3381544915 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00e070 con 0x7f8f0406b930 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f037fe700 1 -- 172.21.15.142:0/3381544915 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00b9d0 con 0x7f8f0406b930 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f037fe700 1 -- 172.21.15.142:0/3381544915 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0092e0 con 0x7f8f0406b930 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 -- 172.21.15.142:0/3381544915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 msgr2=0x7f8f040aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3381544915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f040aa7e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009f20 tx=0x7f8efc009840 comp rx=0 tx=0).stop 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 -- 172.21.15.142:0/3381544915 shutdown_connections 2023-09-30T22:59:50.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3381544915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f040aa7e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3381544915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f040aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 -- 172.21.15.142:0/3381544915 >> 172.21.15.142:0/3381544915 conn(0x7f8f0406dab0 msgr2=0x7f8f040aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:50.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 -- 172.21.15.142:0/3381544915 shutdown_connections 2023-09-30T22:59:50.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.076+0000 7f8f0adff700 1 -- 172.21.15.142:0/3381544915 wait complete. 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.078+0000 7f8f0adff700 1 Processor -- start 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.078+0000 7f8f0adff700 1 -- start start 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f0adff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f0415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f0adff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f04145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f0adff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04159b50 0x7f8f04145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f0adff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041604f0 con 0x7f8f0406b930 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f0adff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040b18a0 con 0x7f8f04159b50 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f0adff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040b1b80 con 0x7f8f040ac3a0 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f0415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f0415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58956/0 (socket says 172.21.15.142:58956) 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 -- 172.21.15.142:0/3134248158 learned_addr learned my addr 172.21.15.142:0/3134248158 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f03fff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f04145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f0939c700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04159b50 0x7f8f04145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 -- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 msgr2=0x7f8f04145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f04145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 -- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04159b50 msgr2=0x7f8f04145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04159b50 0x7f8f04145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.079+0000 7f8f08b9b700 1 -- 172.21.15.142:0/3134248158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009ae0 con 0x7f8f0406b930 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.080+0000 7f8f08b9b700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f0415d860 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c590 tx=0x7f8ef800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.080+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011590 con 0x7f8f0406b930 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.080+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef8011710 con 0x7f8f0406b930 2023-09-30T22:59:50.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.080+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011ad0 con 0x7f8f0406b930 2023-09-30T22:59:50.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.080+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f040b1e60 con 0x7f8f0406b930 2023-09-30T22:59:50.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.080+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f040b2660 con 0x7f8f0406b930 2023-09-30T22:59:50.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.081+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f040b2380 con 0x7f8f0406b930 2023-09-30T22:59:50.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.082+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ef801b3b0 con 0x7f8f0406b930 2023-09-30T22:59:50.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.083+0000 7f8f00ff9700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ee8067330 0x7f8ee80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.083+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ef8083f10 con 0x7f8f0406b930 2023-09-30T22:59:50.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.083+0000 7f8f03fff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ee8067330 0x7f8ee80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.083+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f8ee806f4f0 con 0x7f8f0406b930 2023-09-30T22:59:50.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.084+0000 7f8f03fff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ee8067330 0x7f8ee80697e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8f0414cd00 tx=0x7f8ef00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:50.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.087+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ef8017020 con 0x7f8f0406b930 2023-09-30T22:59:50.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.319+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f04068000 con 0x7f8f0406b930 2023-09-30T22:59:50.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.319+0000 7f8f00ff9700 1 -- 172.21.15.142:0/3134248158 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8f04068000 con 0x7f8f0406b930 2023-09-30T22:59:50.319 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:50.319 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:50.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ee8067330 msgr2=0x7f8ee80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ee8067330 0x7f8ee80697e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8f0414cd00 tx=0x7f8ef00091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 msgr2=0x7f8f0415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f0415d860 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c590 tx=0x7f8ef800c8a0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 shutdown_connections 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8ee8067330 0x7f8ee80697e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04159b50 0x7f8f04145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f0406b930 0x7f8f0415d860 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 --2- 172.21.15.142:0/3134248158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f040ac3a0 0x7f8f04145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 >> 172.21.15.142:0/3134248158 conn(0x7f8f0406dab0 msgr2=0x7f8f04157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 shutdown_connections 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.322+0000 7f8f0adff700 1 -- 172.21.15.142:0/3134248158 wait complete. 2023-09-30T22:59:50.323 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:50.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:50.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.529+0000 7f8d4e5ff700 1 Processor -- start 2023-09-30T22:59:50.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.529+0000 7f8d4e5ff700 1 -- start start 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d4e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d48157a90 0x7f8d4815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d4e5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d480b2110 0x7f8d4806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d4e5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4806d470 con 0x7f8d4806b3d0 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d4e5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d48157e60 con 0x7f8d480b2110 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d4e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4815c430 con 0x7f8d48157a90 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d4cb9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d480b2110 0x7f8d4806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d477fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8d4806b3d0 0x7f8d480b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:43546/0 (socket says 172.21.15.142:43546) 2023-09-30T22:59:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d477fe700 1 -- 172.21.15.142:0/2087782208 learned_addr learned my addr 172.21.15.142:0/2087782208 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:50.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.531+0000 7f8d47fff700 1 --2- 172.21.15.142:0/2087782208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d48157a90 0x7f8d4815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d46ffd700 1 -- 172.21.15.142:0/2087782208 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935467270 0 0) 0x7f8d4806d470 con 0x7f8d4806b3d0 2023-09-30T22:59:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d46ffd700 1 -- 172.21.15.142:0/2087782208 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d30003570 con 0x7f8d4806b3d0 2023-09-30T22:59:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d47fff700 1 -- 172.21.15.142:0/2087782208 >> v2:172.21.15.148:3300/0 conn(0x7f8d480b2110 msgr2=0x7f8d4806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d47fff700 1 --2- 172.21.15.142:0/2087782208 >> v2:172.21.15.148:3300/0 conn(0x7f8d480b2110 0x7f8d4806d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d47fff700 1 -- 172.21.15.142:0/2087782208 >> v1:172.21.15.148:6789/0 conn(0x7f8d4806b3d0 legacy=0x7f8d480b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d47fff700 1 -- 172.21.15.142:0/2087782208 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d480ae880 con 0x7f8d48157a90 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d47fff700 1 --2- 172.21.15.142:0/2087782208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d48157a90 0x7f8d4815bef0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098e0 tx=0x7f8d380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f096c91fb4850a86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d46ffd700 1 -- 172.21.15.142:0/2087782208 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38011630 con 0x7f8d48157a90 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d46ffd700 1 -- 172.21.15.142:0/2087782208 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d38011790 con 0x7f8d48157a90 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.532+0000 7f8d46ffd700 1 -- 172.21.15.142:0/2087782208 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38011b30 con 0x7f8d48157a90 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/2087782208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d48157a90 msgr2=0x7f8d4815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/2087782208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d48157a90 0x7f8d4815bef0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098e0 tx=0x7f8d380091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/2087782208 shutdown_connections 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/2087782208 >> v2:172.21.15.148:3300/0 conn(0x7f8d480b2110 0x7f8d4806d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/2087782208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d48157a90 0x7f8d4815bef0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/2087782208 >> 172.21.15.142:0/2087782208 conn(0x7f8d480680c0 msgr2=0x7f8d480c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/2087782208 shutdown_connections 2023-09-30T22:59:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.533+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/2087782208 wait complete. 2023-09-30T22:59:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.534+0000 7f8d4e5ff700 1 Processor -- start 2023-09-30T22:59:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.535+0000 7f8d4e5ff700 1 -- start start 2023-09-30T22:59:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4806b3d0 0x7f8d48169cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4e5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d480b2110 0x7f8d481592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4e5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48157a90 0x7f8d4814ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4e5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4816a230 con 0x7f8d48157a90 2023-09-30T22:59:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4e5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48158000 con 0x7f8d480b2110 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48158e60 con 0x7f8d4806b3d0 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48157a90 0x7f8d4814ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48157a90 0x7f8d4814ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58964/0 (socket says 172.21.15.142:58964) 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 -- 172.21.15.142:0/3467795351 learned_addr learned my addr 172.21.15.142:0/3467795351 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d47fff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4806b3d0 0x7f8d48169cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d477fe700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d480b2110 0x7f8d481592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 -- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4806b3d0 msgr2=0x7f8d48169cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4806b3d0 0x7f8d48169cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 -- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d480b2110 msgr2=0x7f8d481592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d480b2110 0x7f8d481592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d4cb9c700 1 -- 172.21.15.142:0/3467795351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009420 con 0x7f8d48157a90 2023-09-30T22:59:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.536+0000 7f8d477fe700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d480b2110 0x7f8d481592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.537+0000 7f8d4cb9c700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48157a90 0x7f8d4814ba90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009d40 tx=0x7f8d4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.537+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40009ea0 con 0x7f8d48157a90 2023-09-30T22:59:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.537+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000f040 con 0x7f8d48157a90 2023-09-30T22:59:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.537+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d48158250 con 0x7f8d48157a90 2023-09-30T22:59:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.537+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000cda0 con 0x7f8d48157a90 2023-09-30T22:59:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.537+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d481585e0 con 0x7f8d48157a90 2023-09-30T22:59:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.538+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d48158be0 con 0x7f8d48157a90 2023-09-30T22:59:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.539+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8d40014690 con 0x7f8d48157a90 2023-09-30T22:59:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.540+0000 7f8d2ffff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d34067330 0x7f8d340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.540+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d40085770 con 0x7f8d48157a90 2023-09-30T22:59:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.540+0000 7f8d47fff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d34067330 0x7f8d340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.541+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f8d3406f4f0 con 0x7f8d48157a90 2023-09-30T22:59:50.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.541+0000 7f8d47fff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d34067330 0x7f8d340697e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8d380091e0 tx=0x7f8d38017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:50.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.544+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8d40018060 con 0x7f8d48157a90 2023-09-30T22:59:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.775+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d48158fa0 con 0x7f8d48157a90 2023-09-30T22:59:50.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.776+0000 7f8d2ffff700 1 -- 172.21.15.142:0/3467795351 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8d400525d0 con 0x7f8d48157a90 2023-09-30T22:59:50.776 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:50.776 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:59:12.987394+0000","modified":"2023-09-30T22:59:16.534775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6775":{"gid":6775,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/997643438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":997643438},{"type":"v1","addr":"172.21.15.142:6837","nonce":997643438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-09-30T22:59:50.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d34067330 msgr2=0x7f8d340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d34067330 0x7f8d340697e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8d380091e0 tx=0x7f8d38017000 comp rx=0 tx=0).stop 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48157a90 msgr2=0x7f8d4814ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48157a90 0x7f8d4814ba90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009d40 tx=0x7f8d4000b040 comp rx=0 tx=0).stop 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 shutdown_connections 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8d34067330 0x7f8d340697e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48157a90 0x7f8d4814ba90 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8d4806b3d0 0x7f8d48169cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 --2- 172.21.15.142:0/3467795351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d480b2110 0x7f8d481592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.778+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 >> 172.21.15.142:0/3467795351 conn(0x7f8d480680c0 msgr2=0x7f8d480cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:50.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.779+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 shutdown_connections 2023-09-30T22:59:50.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.779+0000 7f8d4e5ff700 1 -- 172.21.15.142:0/3467795351 wait complete. 2023-09-30T22:59:50.780 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 66 2023-09-30T22:59:50.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.987+0000 7f1d3ffff700 1 Processor -- start 2023-09-30T22:59:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.987+0000 7f1d3ffff700 1 -- start start 2023-09-30T22:59:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1d38157a90 0x7f1d3815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d380b2110 0x7f1d3806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3806d470 con 0x7f1d3806b3d0 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d38157e60 con 0x7f1d380b2110 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3815c430 con 0x7f1d38157a90 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d380b2110 0x7f1d3806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d380b2110 0x7f1d3806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57404/0 (socket says 172.21.15.142:57404) 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3e59c700 1 -- 172.21.15.142:0/1011962010 learned_addr learned my addr 172.21.15.142:0/1011962010 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3d59a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1d3806b3d0 0x7f1d380b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41268/0 (socket says 172.21.15.142:41268) 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.988+0000 7f1d3dd9b700 1 --2- 172.21.15.142:0/1011962010 >> v2:172.21.15.148:3300/0 conn(0x7f1d38157a90 0x7f1d3815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3e59c700 1 -- 172.21.15.142:0/1011962010 >> v2:172.21.15.148:3300/0 conn(0x7f1d38157a90 msgr2=0x7f1d3815bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3e59c700 1 --2- 172.21.15.142:0/1011962010 >> v2:172.21.15.148:3300/0 conn(0x7f1d38157a90 0x7f1d3815bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3e59c700 1 -- 172.21.15.142:0/1011962010 >> v1:172.21.15.142:6789/0 conn(0x7f1d3806b3d0 legacy=0x7f1d380b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3e59c700 1 -- 172.21.15.142:0/1011962010 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380ae880 con 0x7f1d380b2110 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3dd9b700 1 --2- 172.21.15.142:0/1011962010 >> v2:172.21.15.148:3300/0 conn(0x7f1d38157a90 0x7f1d3815bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3cd99700 1 -- 172.21.15.142:0/1011962010 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162124694 0 0) 0x7f1d3806d470 con 0x7f1d3806b3d0 2023-09-30T22:59:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3e59c700 1 --2- 172.21.15.142:0/1011962010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380b2110 0x7f1d3806d900 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1d3806d1e0 tx=0x7f1d30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24ecf7b9ef79469 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3cd99700 1 -- 172.21.15.142:0/1011962010 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000e070 con 0x7f1d380b2110 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3cd99700 1 -- 172.21.15.142:0/1011962010 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3000ba50 con 0x7f1d380b2110 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.989+0000 7f1d3cd99700 1 -- 172.21.15.142:0/1011962010 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300092e0 con 0x7f1d380b2110 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 -- 172.21.15.142:0/1011962010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380b2110 msgr2=0x7f1d3806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/1011962010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380b2110 0x7f1d3806d900 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1d3806d1e0 tx=0x7f1d30009840 comp rx=0 tx=0).stop 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 -- 172.21.15.142:0/1011962010 shutdown_connections 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/1011962010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380b2110 0x7f1d3806d900 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/1011962010 >> v2:172.21.15.148:3300/0 conn(0x7f1d38157a90 0x7f1d3815bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 -- 172.21.15.142:0/1011962010 >> 172.21.15.142:0/1011962010 conn(0x7f1d380680c0 msgr2=0x7f1d380c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 -- 172.21.15.142:0/1011962010 shutdown_connections 2023-09-30T22:59:50.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.990+0000 7f1d3ffff700 1 -- 172.21.15.142:0/1011962010 wait complete. 2023-09-30T22:59:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.992+0000 7f1d3ffff700 1 Processor -- start 2023-09-30T22:59:50.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.992+0000 7f1d3ffff700 1 -- start start 2023-09-30T22:59:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d3806b3d0 0x7f1d3816ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d380b2110 0x7f1d3815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1d38157a90 0x7f1d3815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381584d0 con 0x7f1d3806b3d0 2023-09-30T22:59:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38159330 con 0x7f1d380b2110 2023-09-30T22:59:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3816b170 con 0x7f1d38157a90 2023-09-30T22:59:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d3806b3d0 0x7f1d3816ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d3806b3d0 0x7f1d3816ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57418/0 (socket says 172.21.15.142:57418) 2023-09-30T22:59:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3dd9b700 1 -- 172.21.15.142:0/699964099 learned_addr learned my addr 172.21.15.142:0/699964099 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3d59a700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d380b2110 0x7f1d3815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3e59c700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1d38157a90 0x7f1d3815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3dd9b700 1 -- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1d38157a90 msgr2=0x7f1d3815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3dd9b700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1d38157a90 0x7f1d3815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3dd9b700 1 -- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d380b2110 msgr2=0x7f1d3815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.993+0000 7f1d3dd9b700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d380b2110 0x7f1d3815a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.994+0000 7f1d3dd9b700 1 -- 172.21.15.142:0/699964099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30009ae0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.994+0000 7f1d3dd9b700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d3806b3d0 0x7f1d3816ac30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e900 tx=0x7f1d34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.994+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400eea0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.994+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400c5e0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.994+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d38158720 con 0x7f1d3806b3d0 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.994+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400c980 con 0x7f1d3806b3d0 2023-09-30T22:59:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.994+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d38158ce0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.995+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d380695b0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.996+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1d3400cd30 con 0x7f1d3806b3d0 2023-09-30T22:59:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.997+0000 7f1d2dffb700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1d1c067330 0x7f1d1c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.997+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1d340849d0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.997+0000 7f1d3d59a700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1d1c067330 0x7f1d1c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.997+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f1d1c06f4f0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:50.998+0000 7f1d3d59a700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1d1c067330 0x7f1d1c0697e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d28007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.001+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1d34020060 con 0x7f1d3806b3d0 2023-09-30T22:59:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.191+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d381582b0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.192+0000 7f1d2dffb700 1 -- 172.21.15.142:0/699964099 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+17052 (secure 0 0 0) 0x7f1d340552c0 con 0x7f1d3806b3d0 2023-09-30T22:59:51.194 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:51.195 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":148,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:49.331956+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:59:11.103746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-09-30T22:59:11.960192+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:51.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1d1c067330 msgr2=0x7f1d1c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1d1c067330 0x7f1d1c0697e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d28007e10 comp rx=0 tx=0).stop 2023-09-30T22:59:51.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d3806b3d0 msgr2=0x7f1d3816ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d3806b3d0 0x7f1d3816ac30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e900 tx=0x7f1d34008040 comp rx=0 tx=0).stop 2023-09-30T22:59:51.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 shutdown_connections 2023-09-30T22:59:51.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1d1c067330 0x7f1d1c0697e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1d38157a90 0x7f1d3815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d3806b3d0 0x7f1d3816ac30 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 --2- 172.21.15.142:0/699964099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d380b2110 0x7f1d3815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 >> 172.21.15.142:0/699964099 conn(0x7f1d380680c0 msgr2=0x7f1d3806d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:51.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 shutdown_connections 2023-09-30T22:59:51.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.194+0000 7f1d3ffff700 1 -- 172.21.15.142:0/699964099 wait complete. 2023-09-30T22:59:51.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T22:59:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.402+0000 7fdfa75ff700 1 Processor -- start 2023-09-30T22:59:51.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.402+0000 7fdfa75ff700 1 -- start start 2023-09-30T22:59:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.403+0000 7fdfa75ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfa0157a90 0x7fdfa015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.403+0000 7fdfa75ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdfa006b3d0 0x7fdfa00b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.403+0000 7fdfa75ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa006d470 con 0x7fdfa00b1f40 2023-09-30T22:59:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.403+0000 7fdfa75ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa0157e60 con 0x7fdfa006b3d0 2023-09-30T22:59:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.403+0000 7fdfa75ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa00b2380 con 0x7fdfa0157a90 2023-09-30T22:59:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa4b9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdfa006b3d0 0x7fdfa00b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa5b9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdfa00b1f40 0x7fdfa0069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41270/0 (socket says 172.21.15.142:41270) 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa5b9c700 1 -- 172.21.15.142:0/3339969288 learned_addr learned my addr 172.21.15.142:0/3339969288 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa539b700 1 --2- 172.21.15.142:0/3339969288 >> v2:172.21.15.148:3300/0 conn(0x7fdfa0157a90 0x7fdfa015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa4b9a700 1 -- 172.21.15.142:0/3339969288 >> v2:172.21.15.148:3300/0 conn(0x7fdfa0157a90 msgr2=0x7fdfa015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa4b9a700 1 --2- 172.21.15.142:0/3339969288 >> v2:172.21.15.148:3300/0 conn(0x7fdfa0157a90 0x7fdfa015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa4b9a700 1 -- 172.21.15.142:0/3339969288 >> v1:172.21.15.142:6789/0 conn(0x7fdfa00b1f40 legacy=0x7fdfa0069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa4b9a700 1 -- 172.21.15.142:0/3339969288 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa015c430 con 0x7fdfa006b3d0 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdf97fff700 1 -- 172.21.15.142:0/3339969288 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684815317 0 0) 0x7fdfa006d470 con 0x7fdfa00b1f40 2023-09-30T22:59:51.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.404+0000 7fdfa4b9a700 1 --2- 172.21.15.142:0/3339969288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa006b3d0 0x7fdfa00b1a00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fdfa006d1e0 tx=0x7fdf900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efb78a4436e857d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdf97fff700 1 -- 172.21.15.142:0/3339969288 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9000b6b0 con 0x7fdfa006b3d0 2023-09-30T22:59:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdf97fff700 1 -- 172.21.15.142:0/3339969288 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9000b810 con 0x7fdfa006b3d0 2023-09-30T22:59:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdf97fff700 1 -- 172.21.15.142:0/3339969288 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9000bbb0 con 0x7fdfa006b3d0 2023-09-30T22:59:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 -- 172.21.15.142:0/3339969288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa006b3d0 msgr2=0x7fdfa00b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/3339969288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa006b3d0 0x7fdfa00b1a00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fdfa006d1e0 tx=0x7fdf900091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 -- 172.21.15.142:0/3339969288 shutdown_connections 2023-09-30T22:59:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/3339969288 >> v2:172.21.15.148:3300/0 conn(0x7fdfa0157a90 0x7fdfa015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/3339969288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa006b3d0 0x7fdfa00b1a00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 -- 172.21.15.142:0/3339969288 >> 172.21.15.142:0/3339969288 conn(0x7fdfa00680c0 msgr2=0x7fdfa00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 -- 172.21.15.142:0/3339969288 shutdown_connections 2023-09-30T22:59:51.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.405+0000 7fdfa75ff700 1 -- 172.21.15.142:0/3339969288 wait complete. 2023-09-30T22:59:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.407+0000 7fdfa75ff700 1 Processor -- start 2023-09-30T22:59:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.408+0000 7fdfa75ff700 1 -- start start 2023-09-30T22:59:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa75ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa006b3d0 0x7fdfa0154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa75ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa00b1f40 0x7fdfa0156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa75ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfa0157a90 0x7fdfa00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa75ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01544c0 con 0x7fdfa00b1f40 2023-09-30T22:59:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa75ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01538b0 con 0x7fdfa006b3d0 2023-09-30T22:59:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa75ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa0153b90 con 0x7fdfa0157a90 2023-09-30T22:59:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa00b1f40 0x7fdfa0156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa00b1f40 0x7fdfa0156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57438/0 (socket says 172.21.15.142:57438) 2023-09-30T22:59:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 -- 172.21.15.142:0/2329963920 learned_addr learned my addr 172.21.15.142:0/2329963920 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa539b700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa006b3d0 0x7fdfa0154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa5b9c700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfa0157a90 0x7fdfa00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 -- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfa0157a90 msgr2=0x7fdfa00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfa0157a90 0x7fdfa00c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 -- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa006b3d0 msgr2=0x7fdfa0154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa006b3d0 0x7fdfa0154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa4b9a700 1 -- 172.21.15.142:0/2329963920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90009420 con 0x7fdfa00b1f40 2023-09-30T22:59:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.409+0000 7fdfa539b700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa006b3d0 0x7fdfa0154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.410+0000 7fdfa4b9a700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa00b1f40 0x7fdfa0156b50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fdf90013000 tx=0x7fdf90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.410+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90011420 con 0x7fdfa00b1f40 2023-09-30T22:59:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.410+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf90011580 con 0x7fdfa00b1f40 2023-09-30T22:59:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.410+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa0153e70 con 0x7fdfa00b1f40 2023-09-30T22:59:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.410+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90011940 con 0x7fdfa00b1f40 2023-09-30T22:59:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.410+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa0150ce0 con 0x7fdfa00b1f40 2023-09-30T22:59:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.411+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa0154630 con 0x7fdfa00b1f40 2023-09-30T22:59:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.412+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdf90011d30 con 0x7fdfa00b1f40 2023-09-30T22:59:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.413+0000 7fdf957fa700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf84067330 0x7fdf840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.413+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf900860e0 con 0x7fdfa00b1f40 2023-09-30T22:59:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.413+0000 7fdfa539b700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf84067330 0x7fdf840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.413+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7fdf8406f4f0 con 0x7fdfa00b1f40 2023-09-30T22:59:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.413+0000 7fdfa539b700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf84067330 0x7fdf840697e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c006fd0 tx=0x7fdf9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.417+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdf90015060 con 0x7fdfa00b1f40 2023-09-30T22:59:51.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.649+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdfa006fc10 con 0x7fdfa00b1f40 2023-09-30T22:59:51.650 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T22:59:51.650+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:59:51.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.652+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(149..149 src has 1..149) v4 ==== 366+0+0 (secure 0 0 0) 0x7fdf90057300 con 0x7fdfa00b1f40 2023-09-30T22:59:51.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.652+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fdf8406fe40 con 0x7fdfa00b1f40 2023-09-30T22:59:51.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.656+0000 7fdf957fa700 1 -- 172.21.15.142:0/2329963920 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdf90052f40 con 0x7fdfa00b1f40 2023-09-30T22:59:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.658+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf84067330 msgr2=0x7fdf840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.658+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf84067330 0x7fdf840697e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c006fd0 tx=0x7fdf9c008040 comp rx=0 tx=0).stop 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.658+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa00b1f40 msgr2=0x7fdfa0156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.658+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa00b1f40 0x7fdfa0156b50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fdf90013000 tx=0x7fdf90017000 comp rx=0 tx=0).stop 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 shutdown_connections 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf84067330 0x7fdf840697e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdfa0157a90 0x7fdfa00c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa006b3d0 0x7fdfa0154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 --2- 172.21.15.142:0/2329963920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfa00b1f40 0x7fdfa0156b50 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 >> 172.21.15.142:0/2329963920 conn(0x7fdfa00680c0 msgr2=0x7fdfa01515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 shutdown_connections 2023-09-30T22:59:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.659+0000 7fdfa75ff700 1 -- 172.21.15.142:0/2329963920 wait complete. 2023-09-30T22:59:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T22:59:51.667 INFO:tasks.ceph.mds.a.smithi142.stderr: -7762> 2023-09-30T22:59:14.487+0000 7fe3bc9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:59:51.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T22:59:51.715 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:59:51.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.870+0000 7fa4b59ff700 1 Processor -- start 2023-09-30T22:59:51.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.870+0000 7fa4b59ff700 1 -- start start 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4b59ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b00c52a0 0x7fa4b00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4b59ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4b0069f10 0x7fa4b00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4b59ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4b00c5bb0 0x7fa4b00ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4b59ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b01406a0 con 0x7fa4b00c5bb0 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4b59ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b00c3a50 con 0x7fa4b0069f10 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4b59ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b00c7690 con 0x7fa4b00c52a0 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4b00c5bb0 0x7fa4b00ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4b00c5bb0 0x7fa4b00ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57460/0 (socket says 172.21.15.142:57460) 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 -- 172.21.15.142:0/2390447890 learned_addr learned my addr 172.21.15.142:0/2390447890 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4a7fff700 1 --2- 172.21.15.142:0/2390447890 >> v2:172.21.15.148:3300/0 conn(0x7fa4b0069f10 0x7fa4b00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4aeffd700 1 --2- 172.21.15.142:0/2390447890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b00c52a0 0x7fa4b00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 -- 172.21.15.142:0/2390447890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b00c52a0 msgr2=0x7fa4b00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 --2- 172.21.15.142:0/2390447890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b00c52a0 0x7fa4b00c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 -- 172.21.15.142:0/2390447890 >> v2:172.21.15.148:3300/0 conn(0x7fa4b0069f10 msgr2=0x7fa4b00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 --2- 172.21.15.142:0/2390447890 >> v2:172.21.15.148:3300/0 conn(0x7fa4b0069f10 0x7fa4b00c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4af7fe700 1 -- 172.21.15.142:0/2390447890 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b00c7f20 con 0x7fa4b00c5bb0 2023-09-30T22:59:51.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.872+0000 7fa4aeffd700 1 --2- 172.21.15.142:0/2390447890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b00c52a0 0x7fa4b00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:51.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.873+0000 7fa4af7fe700 1 --2- 172.21.15.142:0/2390447890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c5bb0 0x7fa4b00ca340 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009f50 tx=0x7fa4a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60673f88335ca071 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.873+0000 7fa4ae7fc700 1 -- 172.21.15.142:0/2390447890 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a800e070 con 0x7fa4b00c5bb0 2023-09-30T22:59:51.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.873+0000 7fa4ae7fc700 1 -- 172.21.15.142:0/2390447890 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a800ba30 con 0x7fa4b00c5bb0 2023-09-30T22:59:51.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.873+0000 7fa4ae7fc700 1 -- 172.21.15.142:0/2390447890 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a80092e0 con 0x7fa4b00c5bb0 2023-09-30T22:59:51.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.873+0000 7fa4b59ff700 1 -- 172.21.15.142:0/2390447890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c5bb0 msgr2=0x7fa4b00ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.873+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/2390447890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c5bb0 0x7fa4b00ca340 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009f50 tx=0x7fa4a8009840 comp rx=0 tx=0).stop 2023-09-30T22:59:51.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.874+0000 7fa4b59ff700 1 -- 172.21.15.142:0/2390447890 shutdown_connections 2023-09-30T22:59:51.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.874+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/2390447890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c5bb0 0x7fa4b00ca340 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.874+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/2390447890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b00c52a0 0x7fa4b00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.874+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/2390447890 >> v2:172.21.15.148:3300/0 conn(0x7fa4b0069f10 0x7fa4b00c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.874+0000 7fa4b59ff700 1 -- 172.21.15.142:0/2390447890 >> 172.21.15.142:0/2390447890 conn(0x7fa4b00cc670 msgr2=0x7fa4b00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:51.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.874+0000 7fa4b59ff700 1 -- 172.21.15.142:0/2390447890 shutdown_connections 2023-09-30T22:59:51.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.874+0000 7fa4b59ff700 1 -- 172.21.15.142:0/2390447890 wait complete. 2023-09-30T22:59:51.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.876+0000 7fa4b59ff700 1 Processor -- start 2023-09-30T22:59:51.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.876+0000 7fa4b59ff700 1 -- start start 2023-09-30T22:59:51.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4b59ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b0069f10 0x7fa4b0157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4b59ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c52a0 0x7fa4b0159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4b59ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b00c5bb0 0x7fa4b0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4b59ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0159e40 con 0x7fa4b00c52a0 2023-09-30T22:59:51.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4b59ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b015acb0 con 0x7fa4b00c5bb0 2023-09-30T22:59:51.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4b59ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b015a030 con 0x7fa4b0069f10 2023-09-30T22:59:51.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c52a0 0x7fa4b0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c52a0 0x7fa4b0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57470/0 (socket says 172.21.15.142:57470) 2023-09-30T22:59:51.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.877+0000 7fa4a7fff700 1 -- 172.21.15.142:0/3966555590 learned_addr learned my addr 172.21.15.142:0/3966555590 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:51.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4af7fe700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b00c5bb0 0x7fa4b0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4aeffd700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b0069f10 0x7fa4b0157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a7fff700 1 -- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b0069f10 msgr2=0x7fa4b0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a7fff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b0069f10 0x7fa4b0157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a7fff700 1 -- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b00c5bb0 msgr2=0x7fa4b0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:51.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a7fff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b00c5bb0 0x7fa4b0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:51.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a7fff700 1 -- 172.21.15.142:0/3966555590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8009ae0 con 0x7fa4b00c52a0 2023-09-30T22:59:51.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4aeffd700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b0069f10 0x7fa4b0157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:51.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a7fff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c52a0 0x7fa4b0159900 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fa49800d860 tx=0x7fa498008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4980125f0 con 0x7fa4b00c52a0 2023-09-30T22:59:51.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498012750 con 0x7fa4b00c52a0 2023-09-30T22:59:51.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b015a3c0 con 0x7fa4b00c52a0 2023-09-30T22:59:51.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498012af0 con 0x7fa4b00c52a0 2023-09-30T22:59:51.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.878+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b015a660 con 0x7fa4b00c52a0 2023-09-30T22:59:51.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.879+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b0069a50 con 0x7fa4b00c52a0 2023-09-30T22:59:51.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.880+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa49801e460 con 0x7fa4b00c52a0 2023-09-30T22:59:51.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.881+0000 7fa4a6ffd700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa490067330 0x7fa4900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:51.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.881+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa498085280 con 0x7fa4b00c52a0 2023-09-30T22:59:51.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.881+0000 7fa4aeffd700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa490067330 0x7fa4900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:51.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.881+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fa49006f590 con 0x7fa4b00c52a0 2023-09-30T22:59:51.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.882+0000 7fa4aeffd700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa490067330 0x7fa4900697e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000ac10 tx=0x7fa4a0006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:51.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:51.886+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa4980520b0 con 0x7fa4b00c52a0 2023-09-30T22:59:52.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.116+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa4b006fc10 con 0x7fa4b00c52a0 2023-09-30T22:59:52.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.661+0000 7fa4a6ffd700 1 -- 172.21.15.142:0/3966555590 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa49805b0d0 con 0x7fa4b00c52a0 2023-09-30T22:59:52.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa490067330 msgr2=0x7fa4900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:52.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa490067330 0x7fa4900697e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000ac10 tx=0x7fa4a0006f90 comp rx=0 tx=0).stop 2023-09-30T22:59:52.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c52a0 msgr2=0x7fa4b0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:52.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c52a0 0x7fa4b0159900 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fa49800d860 tx=0x7fa498008040 comp rx=0 tx=0).stop 2023-09-30T22:59:52.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 shutdown_connections 2023-09-30T22:59:52.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa490067330 0x7fa4900697e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b00c5bb0 0x7fa4b0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4b0069f10 0x7fa4b0157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 --2- 172.21.15.142:0/3966555590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b00c52a0 0x7fa4b0159900 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 >> 172.21.15.142:0/3966555590 conn(0x7fa4b00cc670 msgr2=0x7fa4b00bf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:52.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 shutdown_connections 2023-09-30T22:59:52.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.664+0000 7fa4b59ff700 1 -- 172.21.15.142:0/3966555590 wait complete. 2023-09-30T22:59:52.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T22:59:52.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.918+0000 7f80315ff700 1 Processor -- start 2023-09-30T22:59:52.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.918+0000 7f80315ff700 1 -- start start 2023-09-30T22:59:52.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.919+0000 7f80315ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:52.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.919+0000 7f80315ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c068230 con 0x7f802c0b1aa0 2023-09-30T22:59:52.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.919+0000 7f80315ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c15e560 con 0x7f802c159de0 2023-09-30T22:59:52.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.919+0000 7f80315ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0696d0 con 0x7f802c159a10 2023-09-30T22:59:52.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f802b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f802c0b1aa0 0x7f802c15de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41280/0 (socket says 172.21.15.142:41280) 2023-09-30T22:59:52.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f802b7fe700 1 -- 172.21.15.142:0/2088948785 learned_addr learned my addr 172.21.15.142:0/2088948785 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:52.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f802affd700 1 --2- 172.21.15.142:0/2088948785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:52.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f8029ffb700 1 -- 172.21.15.142:0/2088948785 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962217580 0 0) 0x7f802c068230 con 0x7f802c0b1aa0 2023-09-30T22:59:52.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f8029ffb700 1 -- 172.21.15.142:0/2088948785 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8014003570 con 0x7f802c0b1aa0 2023-09-30T22:59:52.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f8029ffb700 1 -- 172.21.15.142:0/2088948785 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365413679 0 0) 0x7f802c15e560 con 0x7f802c159de0 2023-09-30T22:59:52.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f8029ffb700 1 -- 172.21.15.142:0/2088948785 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802c068230 con 0x7f802c159de0 2023-09-30T22:59:52.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f802affd700 1 -- 172.21.15.142:0/2088948785 >> v1:172.21.15.148:6789/0 conn(0x7f802c159de0 legacy=0x7f802c15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:52.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f802affd700 1 -- 172.21.15.142:0/2088948785 >> v1:172.21.15.142:6789/0 conn(0x7f802c0b1aa0 legacy=0x7f802c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:52.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.920+0000 7f802affd700 1 -- 172.21.15.142:0/2088948785 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c067620 con 0x7f802c159a10 2023-09-30T22:59:52.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.921+0000 7f802affd700 1 --2- 172.21.15.142:0/2088948785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ed0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f801c009910 tx=0x7f801c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31676be3b41b503c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:52.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.921+0000 7f8029ffb700 1 -- 172.21.15.142:0/2088948785 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c011630 con 0x7f802c159a10 2023-09-30T22:59:52.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.921+0000 7f8029ffb700 1 -- 172.21.15.142:0/2088948785 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c011790 con 0x7f802c159a10 2023-09-30T22:59:52.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.921+0000 7f8029ffb700 1 -- 172.21.15.142:0/2088948785 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c011b30 con 0x7f802c159a10 2023-09-30T22:59:52.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.921+0000 7f80315ff700 1 -- 172.21.15.142:0/2088948785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 msgr2=0x7f802c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:52.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.921+0000 7f80315ff700 1 --2- 172.21.15.142:0/2088948785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ed0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f801c009910 tx=0x7f801c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.922+0000 7f80315ff700 1 -- 172.21.15.142:0/2088948785 shutdown_connections 2023-09-30T22:59:52.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.922+0000 7f80315ff700 1 --2- 172.21.15.142:0/2088948785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ed0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.922+0000 7f80315ff700 1 -- 172.21.15.142:0/2088948785 >> 172.21.15.142:0/2088948785 conn(0x7f802c0cb2f0 msgr2=0x7f802c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:52.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.922+0000 7f80315ff700 1 -- 172.21.15.142:0/2088948785 shutdown_connections 2023-09-30T22:59:52.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.922+0000 7f80315ff700 1 -- 172.21.15.142:0/2088948785 wait complete. 2023-09-30T22:59:52.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.924+0000 7f80315ff700 1 Processor -- start 2023-09-30T22:59:52.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.924+0000 7f80315ff700 1 -- start start 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f80315ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f802c0b1aa0 0x7f802c0c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f80315ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f80315ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802c159de0 0x7f802c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f80315ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c16ec20 con 0x7f802c159de0 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f80315ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c16e010 con 0x7f802c0b1aa0 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f80315ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c16e2f0 con 0x7f802c159a10 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f802b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802c159de0 0x7f802c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f802b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802c159de0 0x7f802c156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57474/0 (socket says 172.21.15.142:57474) 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.925+0000 7f802b7fe700 1 -- 172.21.15.142:0/2588182216 learned_addr learned my addr 172.21.15.142:0/2588182216 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:52.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802affd700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f802c0b1aa0 0x7f802c0c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:52.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802a7fc700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:52.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802b7fe700 1 -- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 msgr2=0x7f802c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:52.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802b7fe700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802b7fe700 1 -- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f802c0b1aa0 msgr2=0x7f802c0c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:52.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802b7fe700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f802c0b1aa0 0x7f802c0c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:52.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802b7fe700 1 -- 172.21.15.142:0/2588182216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c009420 con 0x7f802c159de0 2023-09-30T22:59:52.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f802b7fe700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802c159de0 0x7f802c156990 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8024001460 tx=0x7f8024001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:52.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802400a8b0 con 0x7f802c159de0 2023-09-30T22:59:52.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802400aa10 con 0x7f802c159de0 2023-09-30T22:59:52.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.926+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c16e5d0 con 0x7f802c159de0 2023-09-30T22:59:52.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.927+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802400add0 con 0x7f802c159de0 2023-09-30T22:59:52.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.927+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c0c2100 con 0x7f802c159de0 2023-09-30T22:59:52.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.928+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c06e4b0 con 0x7f802c159de0 2023-09-30T22:59:52.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.929+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8024007300 con 0x7f802c159de0 2023-09-30T22:59:52.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.930+0000 7f8012ffd700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:52.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.930+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f8024084f60 con 0x7f802c159de0 2023-09-30T22:59:52.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.930+0000 7f802affd700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:52.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.930+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f801806f590 con 0x7f802c159de0 2023-09-30T22:59:52.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.931+0000 7f802affd700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f802c0b0750 tx=0x7f801c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:52.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:52.934+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8024051e10 con 0x7f802c159de0 2023-09-30T22:59:53.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.126+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f802c067900 con 0x7f802c159de0 2023-09-30T22:59:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.669+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(150..150 src has 1..150) v4 ==== 288+0+0 (secure 0 0 0) 0x7f80240561d0 con 0x7f802c159de0 2023-09-30T22:59:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.669+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f801806d9c0 con 0x7f802c159de0 2023-09-30T22:59:53.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.671+0000 7f8012ffd700 1 -- 172.21.15.142:0/2588182216 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v150) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8024055430 con 0x7f802c159de0 2023-09-30T22:59:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 msgr2=0x7f80180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f802c0b0750 tx=0x7f801c017000 comp rx=0 tx=0).stop 2023-09-30T22:59:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802c159de0 msgr2=0x7f802c156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802c159de0 0x7f802c156990 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8024001460 tx=0x7f8024001aa0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 shutdown_connections 2023-09-30T22:59:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8018067330 0x7f80180697e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802c159de0 0x7f802c156990 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f802c0b1aa0 0x7f802c0c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 --2- 172.21.15.142:0/2588182216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f802c159a10 0x7f802c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 >> 172.21.15.142:0/2588182216 conn(0x7f802c0cb2f0 msgr2=0x7f802c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 shutdown_connections 2023-09-30T22:59:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.674+0000 7f80315ff700 1 -- 172.21.15.142:0/2588182216 wait complete. 2023-09-30T22:59:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T22:59:53.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T22:59:53.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.886+0000 7f65741ff700 1 Processor -- start 2023-09-30T22:59:53.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.887+0000 7f65741ff700 1 -- start start 2023-09-30T22:59:53.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f65741ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f656c159a10 0x7f656c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:53.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f65741ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f656c0b1aa0 0x7f656c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f65741ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c068230 con 0x7f656c159de0 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f65741ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c0696d0 con 0x7f656c159a10 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f65741ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c067620 con 0x7f656c0b1aa0 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f6571f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f656c159a10 0x7f656c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f657179a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f656c159de0 0x7f656c15d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41284/0 (socket says 172.21.15.142:41284) 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f657179a700 1 -- 172.21.15.142:0/62112415 learned_addr learned my addr 172.21.15.142:0/62112415 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.888+0000 7f657279c700 1 --2- 172.21.15.142:0/62112415 >> v2:172.21.15.148:3300/0 conn(0x7f656c0b1aa0 0x7f656c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6570f99700 1 -- 172.21.15.142:0/62112415 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701546428 0 0) 0x7f656c068230 con 0x7f656c159de0 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6570f99700 1 -- 172.21.15.142:0/62112415 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6558003570 con 0x7f656c159de0 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6571f9b700 1 -- 172.21.15.142:0/62112415 >> v2:172.21.15.148:3300/0 conn(0x7f656c0b1aa0 msgr2=0x7f656c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:53.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6571f9b700 1 --2- 172.21.15.142:0/62112415 >> v2:172.21.15.148:3300/0 conn(0x7f656c0b1aa0 0x7f656c0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6571f9b700 1 -- 172.21.15.142:0/62112415 >> v1:172.21.15.142:6789/0 conn(0x7f656c159de0 legacy=0x7f656c15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:53.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6571f9b700 1 -- 172.21.15.142:0/62112415 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c067900 con 0x7f656c159a10 2023-09-30T22:59:53.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6571f9b700 1 --2- 172.21.15.142:0/62112415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159a10 0x7f656c0c9ed0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c8e30 tx=0x7f65680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc858ea576c1fa6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6570f99700 1 -- 172.21.15.142:0/62112415 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568011630 con 0x7f656c159a10 2023-09-30T22:59:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6570f99700 1 -- 172.21.15.142:0/62112415 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680117b0 con 0x7f656c159a10 2023-09-30T22:59:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.889+0000 7f6570f99700 1 -- 172.21.15.142:0/62112415 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568011b30 con 0x7f656c159a10 2023-09-30T22:59:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 -- 172.21.15.142:0/62112415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159a10 msgr2=0x7f656c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 --2- 172.21.15.142:0/62112415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159a10 0x7f656c0c9ed0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c8e30 tx=0x7f65680091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 -- 172.21.15.142:0/62112415 shutdown_connections 2023-09-30T22:59:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 --2- 172.21.15.142:0/62112415 >> v2:172.21.15.148:3300/0 conn(0x7f656c0b1aa0 0x7f656c0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 --2- 172.21.15.142:0/62112415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159a10 0x7f656c0c9ed0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 -- 172.21.15.142:0/62112415 >> 172.21.15.142:0/62112415 conn(0x7f656c0cb2f0 msgr2=0x7f656c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 -- 172.21.15.142:0/62112415 shutdown_connections 2023-09-30T22:59:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.890+0000 7f65741ff700 1 -- 172.21.15.142:0/62112415 wait complete. 2023-09-30T22:59:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.892+0000 7f65741ff700 1 Processor -- start 2023-09-30T22:59:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.892+0000 7f65741ff700 1 -- start start 2023-09-30T22:59:53.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.893+0000 7f65741ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f656c0b1aa0 0x7f656c16aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.893+0000 7f65741ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f656c159a10 0x7f656c0ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.893+0000 7f65741ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159de0 0x7f656c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.893+0000 7f65741ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c16b400 con 0x7f656c159de0 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.893+0000 7f65741ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c15b1c0 con 0x7f656c0b1aa0 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.893+0000 7f65741ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c15a5b0 con 0x7f656c159a10 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159de0 0x7f656c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159de0 0x7f656c0ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57492/0 (socket says 172.21.15.142:57492) 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 -- 172.21.15.142:0/1653373664 learned_addr learned my addr 172.21.15.142:0/1653373664 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657179a700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f656c159a10 0x7f656c0ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 -- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f656c159a10 msgr2=0x7f656c0ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f6571f9b700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f656c0b1aa0 0x7f656c16aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f656c159a10 0x7f656c0ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 -- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f656c0b1aa0 msgr2=0x7f656c16aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f656c0b1aa0 0x7f656c16aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 -- 172.21.15.142:0/1653373664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009420 con 0x7f656c159de0 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657179a700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f656c159a10 0x7f656c0ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f6571f9b700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f656c0b1aa0 0x7f656c16aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f657279c700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159de0 0x7f656c0ccaa0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f6564009e90 tx=0x7f656400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.894+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400cc20 con 0x7f656c159de0 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.895+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656400f040 con 0x7f656c159de0 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.895+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564014480 con 0x7f656c159de0 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.895+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c15a890 con 0x7f656c159de0 2023-09-30T22:59:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.895+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c15ae50 con 0x7f656c159de0 2023-09-30T22:59:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.896+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c06e4b0 con 0x7f656c159de0 2023-09-30T22:59:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.897+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6564014830 con 0x7f656c159de0 2023-09-30T22:59:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.898+0000 7f6561ffb700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6550067330 0x7f65500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:53.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.898+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f65640857e0 con 0x7f656c159de0 2023-09-30T22:59:53.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.898+0000 7f6571f9b700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6550067330 0x7f65500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:53.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.898+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f655006e710 con 0x7f656c159de0 2023-09-30T22:59:53.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.899+0000 7f6571f9b700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6550067330 0x7f65500697e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c8e30 tx=0x7f6568017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:53.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:53.902+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6564018060 con 0x7f656c159de0 2023-09-30T22:59:54.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.090+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f656c067be0 con 0x7f656c159de0 2023-09-30T22:59:54.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.670+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(151..151 src has 1..151) v4 ==== 288+0+0 (secure 0 0 0) 0x7f6564056b60 con 0x7f656c159de0 2023-09-30T22:59:54.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.670+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f655006d4a0 con 0x7f656c159de0 2023-09-30T22:59:54.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.671+0000 7f6561ffb700 1 -- 172.21.15.142:0/1653373664 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6564056230 con 0x7f656c159de0 2023-09-30T22:59:54.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.680+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6550067330 msgr2=0x7f65500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:54.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.680+0000 7f65741ff700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6550067330 0x7f65500697e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c8e30 tx=0x7f6568017000 comp rx=0 tx=0).stop 2023-09-30T22:59:54.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.680+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159de0 msgr2=0x7f656c0ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.680+0000 7f65741ff700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159de0 0x7f656c0ccaa0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f6564009e90 tx=0x7f656400b040 comp rx=0 tx=0).stop 2023-09-30T22:59:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.681+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 shutdown_connections 2023-09-30T22:59:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.681+0000 7f65741ff700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6550067330 0x7f65500697e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.681+0000 7f65741ff700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f656c159de0 0x7f656c0ccaa0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.681+0000 7f65741ff700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f656c0b1aa0 0x7f656c16aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.681+0000 7f65741ff700 1 --2- 172.21.15.142:0/1653373664 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f656c159a10 0x7f656c0ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.681+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 >> 172.21.15.142:0/1653373664 conn(0x7f656c0cb2f0 msgr2=0x7f656c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.683+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 shutdown_connections 2023-09-30T22:59:54.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.685+0000 7f65741ff700 1 -- 172.21.15.142:0/1653373664 wait complete. 2023-09-30T22:59:54.687 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T22:59:54.704 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T22:59:54.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.897+0000 7f2063dff700 1 Processor -- start 2023-09-30T22:59:54.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.897+0000 7f2063dff700 1 -- start start 2023-09-30T22:59:54.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.898+0000 7f2063dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f205c06aeb0 0x7f205c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:54.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.898+0000 7f2063dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c1576e0 con 0x7f205c1509d0 2023-09-30T22:59:54.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.898+0000 7f2063dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c15a490 con 0x7f205c150600 2023-09-30T22:59:54.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.898+0000 7f2063dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205c0cc320 con 0x7f205c06aeb0 2023-09-30T22:59:54.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.898+0000 7f206139a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f205c1509d0 0x7f205c156710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41286/0 (socket says 172.21.15.142:41286) 2023-09-30T22:59:54.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.898+0000 7f206139a700 1 -- 172.21.15.142:0/1984099223 learned_addr learned my addr 172.21.15.142:0/1984099223 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.898+0000 7f206239c700 1 --2- 172.21.15.142:0/1984099223 >> v2:172.21.15.148:3300/0 conn(0x7f205c06aeb0 0x7f205c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f2060b99700 1 -- 172.21.15.142:0/1984099223 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501405117 0 0) 0x7f205c1576e0 con 0x7f205c1509d0 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f2060b99700 1 -- 172.21.15.142:0/1984099223 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2048003570 con 0x7f205c1509d0 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f2060b99700 1 -- 172.21.15.142:0/1984099223 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375903328 0 0) 0x7f205c15a490 con 0x7f205c150600 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f2060b99700 1 -- 172.21.15.142:0/1984099223 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c1576e0 con 0x7f205c150600 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f206239c700 1 -- 172.21.15.142:0/1984099223 >> v1:172.21.15.148:6789/0 conn(0x7f205c150600 legacy=0x7f205c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f206239c700 1 -- 172.21.15.142:0/1984099223 >> v1:172.21.15.142:6789/0 conn(0x7f205c1509d0 legacy=0x7f205c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f206239c700 1 -- 172.21.15.142:0/1984099223 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c157400 con 0x7f205c06aeb0 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.899+0000 7f206239c700 1 --2- 172.21.15.142:0/1984099223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c06aeb0 0x7f205c156e20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2054009e60 tx=0x7f2054009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ef9ae49f85e09e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:54.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2060b99700 1 -- 172.21.15.142:0/1984099223 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205400e070 con 0x7f205c06aeb0 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2060b99700 1 -- 172.21.15.142:0/1984099223 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205400bab0 con 0x7f205c06aeb0 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2060b99700 1 -- 172.21.15.142:0/1984099223 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205400be70 con 0x7f205c06aeb0 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2063dff700 1 -- 172.21.15.142:0/1984099223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c06aeb0 msgr2=0x7f205c156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2063dff700 1 --2- 172.21.15.142:0/1984099223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c06aeb0 0x7f205c156e20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2054009e60 tx=0x7f2054009780 comp rx=0 tx=0).stop 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2063dff700 1 -- 172.21.15.142:0/1984099223 shutdown_connections 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2063dff700 1 --2- 172.21.15.142:0/1984099223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c06aeb0 0x7f205c156e20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2063dff700 1 -- 172.21.15.142:0/1984099223 >> 172.21.15.142:0/1984099223 conn(0x7f205c0cc670 msgr2=0x7f205c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2063dff700 1 -- 172.21.15.142:0/1984099223 shutdown_connections 2023-09-30T22:59:54.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.900+0000 7f2063dff700 1 -- 172.21.15.142:0/1984099223 wait complete. 2023-09-30T22:59:54.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.902+0000 7f2063dff700 1 Processor -- start 2023-09-30T22:59:54.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.902+0000 7f2063dff700 1 -- start start 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f2063dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f205c06aeb0 0x7f205c1379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f2063dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205c150600 0x7f205c14c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f2063dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c1509d0 0x7f205c14cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f2063dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c14f6d0 con 0x7f205c150600 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f2063dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c52d0 con 0x7f205c1509d0 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f2063dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c14fb60 con 0x7f205c06aeb0 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205c150600 0x7f205c14c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205c150600 0x7f205c14c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57504/0 (socket says 172.21.15.142:57504) 2023-09-30T22:59:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 -- 172.21.15.142:0/2899471297 learned_addr learned my addr 172.21.15.142:0/2899471297 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206239c700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c1509d0 0x7f205c14cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f2061b9b700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f205c06aeb0 0x7f205c1379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 -- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f205c06aeb0 msgr2=0x7f205c1379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f205c06aeb0 0x7f205c1379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 -- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c1509d0 msgr2=0x7f205c14cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c1509d0 0x7f205c14cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.903+0000 7f206139a700 1 -- 172.21.15.142:0/2899471297 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054009a20 con 0x7f205c150600 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.904+0000 7f206139a700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205c150600 0x7f205c14c570 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f204c0058d0 tx=0x7f204c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.904+0000 7f2051ffb700 1 -- 172.21.15.142:0/2899471297 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c005b30 con 0x7f205c150600 2023-09-30T22:59:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.904+0000 7f2051ffb700 1 -- 172.21.15.142:0/2899471297 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c005c90 con 0x7f205c150600 2023-09-30T22:59:54.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.904+0000 7f2051ffb700 1 -- 172.21.15.142:0/2899471297 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c007300 con 0x7f205c150600 2023-09-30T22:59:54.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.904+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c14eac0 con 0x7f205c150600 2023-09-30T22:59:54.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.904+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c14f080 con 0x7f205c150600 2023-09-30T22:59:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.905+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205c06ac00 con 0x7f205c150600 2023-09-30T22:59:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.906+0000 7f2051ffb700 1 -- 172.21.15.142:0/2899471297 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f204c01b3b0 con 0x7f205c150600 2023-09-30T22:59:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.907+0000 7f2051ffb700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2040067330 0x7f20400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.907+0000 7f2051ffb700 1 -- 172.21.15.142:0/2899471297 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f204c083cb0 con 0x7f205c150600 2023-09-30T22:59:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.907+0000 7f2061b9b700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2040067330 0x7f20400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.908+0000 7f2061b9b700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2040067330 0x7f20400697e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2058007fd0 tx=0x7f2058007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:54.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:54.911+0000 7f2051ffb700 1 -- 172.21.15.142:0/2899471297 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f204c050eb0 con 0x7f205c150600 2023-09-30T22:59:55.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.106+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f205c06fc10 con 0x7f205c150600 2023-09-30T22:59:55.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.112+0000 7f2051ffb700 1 -- 172.21.15.142:0/2899471297 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f204c0170a0 con 0x7f205c150600 2023-09-30T22:59:55.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2040067330 msgr2=0x7f20400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2040067330 0x7f20400697e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2058007fd0 tx=0x7f2058007d50 comp rx=0 tx=0).stop 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205c150600 msgr2=0x7f205c14c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205c150600 0x7f205c14c570 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f204c0058d0 tx=0x7f204c007e10 comp rx=0 tx=0).stop 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 shutdown_connections 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2040067330 0x7f20400697e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f205c1509d0 0x7f205c14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f205c06aeb0 0x7f205c1379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 --2- 172.21.15.142:0/2899471297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205c150600 0x7f205c14c570 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 >> 172.21.15.142:0/2899471297 conn(0x7f205c0cc670 msgr2=0x7f205c06e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 shutdown_connections 2023-09-30T22:59:55.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.114+0000 7f2063dff700 1 -- 172.21.15.142:0/2899471297 wait complete. 2023-09-30T22:59:55.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-09-30T22:59:55.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.322+0000 7f89b25ff700 1 Processor -- start 2023-09-30T22:59:55.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.323+0000 7f89b25ff700 1 -- start start 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89b25ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89b25ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89ac0b00d0 0x7f89ac06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89b25ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac06d3e0 con 0x7f89ac06e650 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89b25ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac15b400 con 0x7f89ac0b00d0 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89b25ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac06dc80 con 0x7f89ac0af020 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89ab7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89ac0b00d0 0x7f89ac06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89ab7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89ac0b00d0 0x7f89ac06e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57508/0 (socket says 172.21.15.142:57508) 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89ab7fe700 1 -- 172.21.15.142:0/3330425374 learned_addr learned my addr 172.21.15.142:0/3330425374 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89abfff700 1 --2- 172.21.15.142:0/3330425374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89ab7fe700 1 -- 172.21.15.142:0/3330425374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 msgr2=0x7f89ac156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:55.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.324+0000 7f89ab7fe700 1 --2- 172.21.15.142:0/3330425374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.325+0000 7f89ab7fe700 1 -- 172.21.15.142:0/3330425374 >> v1:172.21.15.148:6789/0 conn(0x7f89ac06e650 legacy=0x7f89ac0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:55.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.325+0000 7f89ab7fe700 1 -- 172.21.15.142:0/3330425374 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac06b790 con 0x7f89ac0b00d0 2023-09-30T22:59:55.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.325+0000 7f89abfff700 1 --2- 172.21.15.142:0/3330425374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:55.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.325+0000 7f89ab7fe700 1 --2- 172.21.15.142:0/3330425374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac06e110 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f89a00099b0 tx=0x7f89a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3420e7c9681fd584 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:55.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.325+0000 7f89aaffd700 1 -- 172.21.15.142:0/3330425374 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000b820 con 0x7f89ac0b00d0 2023-09-30T22:59:55.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.325+0000 7f89aaffd700 1 -- 172.21.15.142:0/3330425374 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000b980 con 0x7f89ac0b00d0 2023-09-30T22:59:55.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.325+0000 7f89aaffd700 1 -- 172.21.15.142:0/3330425374 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000bd20 con 0x7f89ac0b00d0 2023-09-30T22:59:55.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 -- 172.21.15.142:0/3330425374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 msgr2=0x7f89ac06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3330425374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac06e110 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f89a00099b0 tx=0x7f89a0009250 comp rx=0 tx=0).stop 2023-09-30T22:59:55.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 -- 172.21.15.142:0/3330425374 shutdown_connections 2023-09-30T22:59:55.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3330425374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3330425374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac06e110 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 -- 172.21.15.142:0/3330425374 >> 172.21.15.142:0/3330425374 conn(0x7f89ac0680c0 msgr2=0x7f89ac0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:55.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 -- 172.21.15.142:0/3330425374 shutdown_connections 2023-09-30T22:59:55.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.326+0000 7f89b25ff700 1 -- 172.21.15.142:0/3330425374 wait complete. 2023-09-30T22:59:55.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.327+0000 7f89b25ff700 1 Processor -- start 2023-09-30T22:59:55.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.327+0000 7f89b25ff700 1 -- start start 2023-09-30T22:59:55.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b25ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89ac06e650 0x7f89ac158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b25ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b25ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b25ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac159eb0 con 0x7f89ac0b00d0 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b25ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac159000 con 0x7f89ac06e650 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b25ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1592a0 con 0x7f89ac0af020 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b0b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b0b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac0c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57516/0 (socket says 172.21.15.142:57516) 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.328+0000 7f89b0b9c700 1 -- 172.21.15.142:0/3127005697 learned_addr learned my addr 172.21.15.142:0/3127005697 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89abfff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89ac06e650 0x7f89ac158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89ab7fe700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b0b9c700 1 -- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 msgr2=0x7f89ac0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b0b9c700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b0b9c700 1 -- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89ac06e650 msgr2=0x7f89ac158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b0b9c700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89ac06e650 0x7f89ac158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b0b9c700 1 -- 172.21.15.142:0/3127005697 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00094f0 con 0x7f89ac0b00d0 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89abfff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89ac06e650 0x7f89ac158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b0b9c700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac0c59a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f89a400bc30 tx=0x7f89a4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f8993fff700 1 -- 172.21.15.142:0/3127005697 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400c9b0 con 0x7f89ac0b00d0 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f8993fff700 1 -- 172.21.15.142:0/3127005697 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400cb50 con 0x7f89ac0b00d0 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f8993fff700 1 -- 172.21.15.142:0/3127005697 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4014410 con 0x7f89ac0b00d0 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac159580 con 0x7f89ac0b00d0 2023-09-30T22:59:55.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.329+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac159b40 con 0x7f89ac0b00d0 2023-09-30T22:59:55.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.331+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac15a060 con 0x7f89ac0b00d0 2023-09-30T22:59:55.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.331+0000 7f8993fff700 1 -- 172.21.15.142:0/3127005697 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f89a4014800 con 0x7f89ac0b00d0 2023-09-30T22:59:55.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.332+0000 7f8993fff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8998067330 0x7f89980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.332+0000 7f8993fff700 1 -- 172.21.15.142:0/3127005697 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f89a4084980 con 0x7f89ac0b00d0 2023-09-30T22:59:55.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.332+0000 7f89abfff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8998067330 0x7f89980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.333+0000 7f89abfff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8998067330 0x7f89980697e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0aebb0 tx=0x7f899c006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.336+0000 7f8993fff700 1 -- 172.21.15.142:0/3127005697 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f89a4051b80 con 0x7f89ac0b00d0 2023-09-30T22:59:55.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.604+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f89ac0cc400 con 0x7f89ac0b00d0 2023-09-30T22:59:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.670+0000 7f8993fff700 1 -- 172.21.15.142:0/3127005697 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v389) v1 ==== 140+0+0 (secure 0 0 0) 0x7f89a40551a0 con 0x7f89ac0b00d0 2023-09-30T22:59:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8998067330 msgr2=0x7f89980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8998067330 0x7f89980697e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0aebb0 tx=0x7f899c006f90 comp rx=0 tx=0).stop 2023-09-30T22:59:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 msgr2=0x7f89ac0c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac0c59a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f89a400bc30 tx=0x7f89a4009820 comp rx=0 tx=0).stop 2023-09-30T22:59:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 shutdown_connections 2023-09-30T22:59:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8998067330 0x7f89980697e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ac0b00d0 0x7f89ac0c59a0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89ac06e650 0x7f89ac158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 --2- 172.21.15.142:0/3127005697 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89ac0af020 0x7f89ac0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 >> 172.21.15.142:0/3127005697 conn(0x7f89ac0680c0 msgr2=0x7f89ac06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 shutdown_connections 2023-09-30T22:59:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.673+0000 7f89b25ff700 1 -- 172.21.15.142:0/3127005697 wait complete. 2023-09-30T22:59:55.690 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-09-30T22:59:55.690 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-09-30T22:59:55.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-09-30T22:59:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.880+0000 7f034cfff700 1 Processor -- start 2023-09-30T22:59:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.880+0000 7f034cfff700 1 -- start start 2023-09-30T22:59:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f034cfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0348159b90 0x7f034815a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f034cfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480b0ee0 con 0x7f0348069f10 2023-09-30T22:59:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f034cfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034806f360 con 0x7f03480aebf0 2023-09-30T22:59:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f034cfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480aefc0 con 0x7f0348159b90 2023-09-30T22:59:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f0345d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0348159b90 0x7f034815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f0346d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0348069f10 0x7f034806a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41302/0 (socket says 172.21.15.142:41302) 2023-09-30T22:59:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f0346d9d700 1 -- 172.21.15.142:0/1892403772 learned_addr learned my addr 172.21.15.142:0/1892403772 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f034559a700 1 -- 172.21.15.142:0/1892403772 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624612695 0 0) 0x7f03480b0ee0 con 0x7f0348069f10 2023-09-30T22:59:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.882+0000 7f034559a700 1 -- 172.21.15.142:0/1892403772 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0330003570 con 0x7f0348069f10 2023-09-30T22:59:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f0345d9b700 1 -- 172.21.15.142:0/1892403772 >> v1:172.21.15.148:6789/0 conn(0x7f03480aebf0 legacy=0x7f034806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f0345d9b700 1 -- 172.21.15.142:0/1892403772 >> v1:172.21.15.142:6789/0 conn(0x7f0348069f10 legacy=0x7f034806a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f034559a700 1 -- 172.21.15.142:0/1892403772 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921497827 0 0) 0x7f034806f360 con 0x7f03480aebf0 2023-09-30T22:59:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f0345d9b700 1 -- 172.21.15.142:0/1892403772 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480b02d0 con 0x7f0348159b90 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f0345d9b700 1 --2- 172.21.15.142:0/1892403772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348159b90 0x7f034815a010 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f033c00aa90 tx=0x7f033c00a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53da79b789717227 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f034559a700 1 -- 172.21.15.142:0/1892403772 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00c970 con 0x7f0348159b90 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f034559a700 1 -- 172.21.15.142:0/1892403772 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00cad0 con 0x7f0348159b90 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.883+0000 7f034559a700 1 -- 172.21.15.142:0/1892403772 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00ce70 con 0x7f0348159b90 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.884+0000 7f034cfff700 1 -- 172.21.15.142:0/1892403772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348159b90 msgr2=0x7f034815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.884+0000 7f034cfff700 1 --2- 172.21.15.142:0/1892403772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348159b90 0x7f034815a010 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f033c00aa90 tx=0x7f033c00a330 comp rx=0 tx=0).stop 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.884+0000 7f034cfff700 1 -- 172.21.15.142:0/1892403772 shutdown_connections 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.884+0000 7f034cfff700 1 --2- 172.21.15.142:0/1892403772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348159b90 0x7f034815a010 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.884+0000 7f034cfff700 1 -- 172.21.15.142:0/1892403772 >> 172.21.15.142:0/1892403772 conn(0x7f03480680c0 msgr2=0x7f03480c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.884+0000 7f034cfff700 1 -- 172.21.15.142:0/1892403772 shutdown_connections 2023-09-30T22:59:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.884+0000 7f034cfff700 1 -- 172.21.15.142:0/1892403772 wait complete. 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.885+0000 7f034cfff700 1 Processor -- start 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.885+0000 7f034cfff700 1 -- start start 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034cfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348069f10 0x7f0348145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034cfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03480aebf0 0x7f034816d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034cfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0348159b90 0x7f034816dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034cfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348147bc0 con 0x7f0348069f10 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034cfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348146fb0 con 0x7f0348159b90 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034cfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0348147290 con 0x7f03480aebf0 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348069f10 0x7f0348145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.886+0000 7f034659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348069f10 0x7f0348145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57538/0 (socket says 172.21.15.142:57538) 2023-09-30T22:59:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034659c700 1 -- 172.21.15.142:0/760092292 learned_addr learned my addr 172.21.15.142:0/760092292 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f0346d9d700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0348159b90 0x7f034816dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f0345d9b700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03480aebf0 0x7f034816d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034659c700 1 -- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03480aebf0 msgr2=0x7f034816d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034659c700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03480aebf0 0x7f034816d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034659c700 1 -- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0348159b90 msgr2=0x7f034816dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034659c700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0348159b90 0x7f034816dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034659c700 1 -- 172.21.15.142:0/760092292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c00a5d0 con 0x7f0348069f10 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f0346d9d700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0348159b90 0x7f034816dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034659c700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348069f10 0x7f0348145310 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f033800c7c0 tx=0x7f0338007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f03367fc700 1 -- 172.21.15.142:0/760092292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011590 con 0x7f0348069f10 2023-09-30T22:59:55.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f03367fc700 1 -- 172.21.15.142:0/760092292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338011710 con 0x7f0348069f10 2023-09-30T22:59:55.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0348147570 con 0x7f0348069f10 2023-09-30T22:59:55.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.887+0000 7f03367fc700 1 -- 172.21.15.142:0/760092292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011ad0 con 0x7f0348069f10 2023-09-30T22:59:55.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.888+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0348145850 con 0x7f0348069f10 2023-09-30T22:59:55.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.888+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03480695b0 con 0x7f0348069f10 2023-09-30T22:59:55.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.889+0000 7f03367fc700 1 -- 172.21.15.142:0/760092292 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f033801b3b0 con 0x7f0348069f10 2023-09-30T22:59:55.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.891+0000 7f03367fc700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0328067330 0x7f03280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:55.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.891+0000 7f03367fc700 1 -- 172.21.15.142:0/760092292 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0338083ec0 con 0x7f0348069f10 2023-09-30T22:59:55.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.891+0000 7f0345d9b700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0328067330 0x7f03280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:55.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.892+0000 7f0345d9b700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0328067330 0x7f03280697e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f03481581a0 tx=0x7f033c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:55.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:55.895+0000 7f03367fc700 1 -- 172.21.15.142:0/760092292 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f03380510a0 con 0x7f0348069f10 2023-09-30T22:59:56.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.161+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f034806fc10 con 0x7f0348069f10 2023-09-30T22:59:56.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.675+0000 7f03367fc700 1 -- 172.21.15.142:0/760092292 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v390) v1 ==== 135+0+0 (secure 0 0 0) 0x7f0338017020 con 0x7f0348069f10 2023-09-30T22:59:56.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0328067330 msgr2=0x7f03280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0328067330 0x7f03280697e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f03481581a0 tx=0x7f033c01a000 comp rx=0 tx=0).stop 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348069f10 msgr2=0x7f0348145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348069f10 0x7f0348145310 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f033800c7c0 tx=0x7f0338007da0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 shutdown_connections 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0328067330 0x7f03280697e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0348159b90 0x7f034816dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0348069f10 0x7f0348145310 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 --2- 172.21.15.142:0/760092292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03480aebf0 0x7f034816d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.678+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 >> 172.21.15.142:0/760092292 conn(0x7f03480680c0 msgr2=0x7f0348155aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.679+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 shutdown_connections 2023-09-30T22:59:56.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.679+0000 7f034cfff700 1 -- 172.21.15.142:0/760092292 wait complete. 2023-09-30T22:59:56.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T22:59:56.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.893+0000 7f2dc85ff700 1 Processor -- start 2023-09-30T22:59:56.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.893+0000 7f2dc85ff700 1 -- start start 2023-09-30T22:59:56.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.894+0000 7f2dc85ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:56.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.894+0000 7f2dc85ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2dc00cc3b0 0x7f2dc00cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.894+0000 7f2dc85ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc00d0550 con 0x7f2dc01573a0 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc85ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc00cf750 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc85ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00cf940 con 0x7f2dc00cbfe0 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc5b9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2dc00cc3b0 0x7f2dc00cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc6b9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2dc01573a0 0x7f2dc015d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41306/0 (socket says 172.21.15.142:41306) 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc5b9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2dc00cc3b0 0x7f2dc00cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57552/0 (socket says 172.21.15.142:57552) 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc6b9c700 1 -- 172.21.15.142:0/3666802244 learned_addr learned my addr 172.21.15.142:0/3666802244 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc639b700 1 --2- 172.21.15.142:0/3666802244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc5b9a700 1 -- 172.21.15.142:0/3666802244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 msgr2=0x7f2dc015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc5b9a700 1 --2- 172.21.15.142:0/3666802244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc5b9a700 1 -- 172.21.15.142:0/3666802244 >> v1:172.21.15.142:6789/0 conn(0x7f2dc01573a0 legacy=0x7f2dc015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc5b9a700 1 -- 172.21.15.142:0/3666802244 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00cfc20 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.895+0000 7f2dc5399700 1 -- 172.21.15.142:0/3666802244 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768070573 0 0) 0x7f2dc00d0550 con 0x7f2dc01573a0 2023-09-30T22:59:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc5b9a700 1 --2- 172.21.15.142:0/3666802244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc00cf210 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009910 tx=0x7f2db00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0f683e28cd3190 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc5399700 1 -- 172.21.15.142:0/3666802244 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000b640 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc5399700 1 -- 172.21.15.142:0/3666802244 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000b7a0 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc5399700 1 -- 172.21.15.142:0/3666802244 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000bb60 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 -- 172.21.15.142:0/3666802244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 msgr2=0x7f2dc00cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:56.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/3666802244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc00cf210 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009910 tx=0x7f2db00091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 -- 172.21.15.142:0/3666802244 shutdown_connections 2023-09-30T22:59:56.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/3666802244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/3666802244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc00cf210 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 -- 172.21.15.142:0/3666802244 >> 172.21.15.142:0/3666802244 conn(0x7f2dc00d0a80 msgr2=0x7f2dc00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 -- 172.21.15.142:0/3666802244 shutdown_connections 2023-09-30T22:59:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.896+0000 7f2dc85ff700 1 -- 172.21.15.142:0/3666802244 wait complete. 2023-09-30T22:59:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.898+0000 7f2dc85ff700 1 Processor -- start 2023-09-30T22:59:56.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.898+0000 7f2dc85ff700 1 -- start start 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc85ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc00c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc85ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc016ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc85ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc01573a0 0x7f2dc0159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc85ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00c4270 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc85ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc0159960 con 0x7f2dc01573a0 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc85ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc016b250 con 0x7f2dc00cbfe0 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc5b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc016ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc5b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc016ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57560/0 (socket says 172.21.15.142:57560) 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc5b9a700 1 -- 172.21.15.142:0/4157156792 learned_addr learned my addr 172.21.15.142:0/4157156792 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc639b700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc00c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:56.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.899+0000 7f2dc6b9c700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc01573a0 0x7f2dc0159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc5b9a700 1 -- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 msgr2=0x7f2dc00c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc5b9a700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc00c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc5b9a700 1 -- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc01573a0 msgr2=0x7f2dc0159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc5b9a700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc01573a0 0x7f2dc0159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc5b9a700 1 -- 172.21.15.142:0/4157156792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0009420 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc5b9a700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc016ad10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009fb0 tx=0x7f2db0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2db67fc700 1 -- 172.21.15.142:0/4157156792 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db001f070 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2db67fc700 1 -- 172.21.15.142:0/4157156792 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000b910 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2db67fc700 1 -- 172.21.15.142:0/4157156792 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0011420 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc0158d50 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.900+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc0159310 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.901+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc0159af0 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.902+0000 7f2db67fc700 1 -- 172.21.15.142:0/4157156792 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2db00117f0 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.903+0000 7f2db67fc700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2da4067330 0x7f2da40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:56.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.903+0000 7f2db67fc700 1 -- 172.21.15.142:0/4157156792 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2db0085b30 con 0x7f2dc00cc3b0 2023-09-30T22:59:56.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.903+0000 7f2dc639b700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2da4067330 0x7f2da40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:56.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.904+0000 7f2dc639b700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2da4067330 0x7f2da40697e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00c9420 tx=0x7f2dbc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:56.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:56.907+0000 7f2db67fc700 1 -- 172.21.15.142:0/4157156792 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2db0052c90 con 0x7f2dc00cc3b0 2023-09-30T22:59:57.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.097+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2dc006fc10 con 0x7f2dc00cc3b0 2023-09-30T22:59:57.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.103+0000 7f2db67fc700 1 -- 172.21.15.142:0/4157156792 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2db00150c0 con 0x7f2dc00cc3b0 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2da4067330 msgr2=0x7f2da40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2da4067330 0x7f2da40697e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00c9420 tx=0x7f2dbc0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 msgr2=0x7f2dc016ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc016ad10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009fb0 tx=0x7f2db0017000 comp rx=0 tx=0).stop 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 shutdown_connections 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2da4067330 0x7f2da40697e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc01573a0 0x7f2dc0159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2dc00cbfe0 0x7f2dc00c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 --2- 172.21.15.142:0/4157156792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dc00cc3b0 0x7f2dc016ad10 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 >> 172.21.15.142:0/4157156792 conn(0x7f2dc00d0a80 msgr2=0x7f2dc015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:57.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 shutdown_connections 2023-09-30T22:59:57.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.106+0000 7f2dc85ff700 1 -- 172.21.15.142:0/4157156792 wait complete. 2023-09-30T22:59:57.123 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T22:59:57.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:59:57.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T22:59:57.332 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T22:59:57.332 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T22:59:57.332 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:59:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.522+0000 7f24251ff700 1 Processor -- start 2023-09-30T22:59:57.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.522+0000 7f24251ff700 1 -- start start 2023-09-30T22:59:57.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.523+0000 7f24251ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f2420159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:57.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.523+0000 7f24251ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24200cee50 0x7f24200d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.523+0000 7f24251ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f242006b1c0 0x7f242015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.523+0000 7f24251ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200cff40 con 0x7f242006b1c0 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.523+0000 7f24251ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200d0910 con 0x7f24200cee50 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.523+0000 7f24251ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24200cf330 con 0x7f24201598e0 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f242006b1c0 0x7f242015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f242006b1c0 0x7f242015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57574/0 (socket says 172.21.15.142:57574) 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 -- 172.21.15.142:0/3430001789 learned_addr learned my addr 172.21.15.142:0/3430001789 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241e59c700 1 --2- 172.21.15.142:0/3430001789 >> v2:172.21.15.148:3300/0 conn(0x7f24200cee50 0x7f24200d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241ed9d700 1 --2- 172.21.15.142:0/3430001789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f2420159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:57.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 -- 172.21.15.142:0/3430001789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 msgr2=0x7f2420159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 --2- 172.21.15.142:0/3430001789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f2420159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 -- 172.21.15.142:0/3430001789 >> v2:172.21.15.148:3300/0 conn(0x7f24200cee50 msgr2=0x7f24200d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 --2- 172.21.15.142:0/3430001789 >> v2:172.21.15.148:3300/0 conn(0x7f24200cee50 0x7f24200d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 -- 172.21.15.142:0/3430001789 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200cf610 con 0x7f242006b1c0 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241ed9d700 1 --2- 172.21.15.142:0/3430001789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f2420159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241e59c700 1 --2- 172.21.15.142:0/3430001789 >> v2:172.21.15.148:3300/0 conn(0x7f24200cee50 0x7f24200d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.524+0000 7f241f59e700 1 --2- 172.21.15.142:0/3430001789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f242015d7d0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f2420064ea0 tx=0x7f2418009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd20c773b1e12 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:57.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f241dd9b700 1 -- 172.21.15.142:0/3430001789 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241800e070 con 0x7f242006b1c0 2023-09-30T22:59:57.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f241dd9b700 1 -- 172.21.15.142:0/3430001789 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241800ba50 con 0x7f242006b1c0 2023-09-30T22:59:57.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f241dd9b700 1 -- 172.21.15.142:0/3430001789 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24180092e0 con 0x7f242006b1c0 2023-09-30T22:59:57.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 -- 172.21.15.142:0/3430001789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 msgr2=0x7f242015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:57.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 --2- 172.21.15.142:0/3430001789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f242015d7d0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f2420064ea0 tx=0x7f2418009840 comp rx=0 tx=0).stop 2023-09-30T22:59:57.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 -- 172.21.15.142:0/3430001789 shutdown_connections 2023-09-30T22:59:57.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 --2- 172.21.15.142:0/3430001789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f242015d7d0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 --2- 172.21.15.142:0/3430001789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f2420159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 --2- 172.21.15.142:0/3430001789 >> v2:172.21.15.148:3300/0 conn(0x7f24200cee50 0x7f24200d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 -- 172.21.15.142:0/3430001789 >> 172.21.15.142:0/3430001789 conn(0x7f24200cd540 msgr2=0x7f24200cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 -- 172.21.15.142:0/3430001789 shutdown_connections 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.525+0000 7f24251ff700 1 -- 172.21.15.142:0/3430001789 wait complete. 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.527+0000 7f24251ff700 1 Processor -- start 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.527+0000 7f24251ff700 1 -- start start 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f24251ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f24200b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f24251ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200cee50 0x7f2420144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f24251ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f24200c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f24251ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200b5490 con 0x7f242006b1c0 2023-09-30T22:59:57.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f24251ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200b56c0 con 0x7f24200cee50 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f24251ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24200b59a0 con 0x7f24201598e0 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f241ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f24200b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f241ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f24200b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57580/0 (socket says 172.21.15.142:57580) 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f241ed9d700 1 -- 172.21.15.142:0/3950557124 learned_addr learned my addr 172.21.15.142:0/3950557124 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f241e59c700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200cee50 0x7f2420144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.528+0000 7f241f59e700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f24200c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f241ed9d700 1 -- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 msgr2=0x7f24200c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f241ed9d700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f24200c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f241ed9d700 1 -- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200cee50 msgr2=0x7f2420144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f241ed9d700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200cee50 0x7f2420144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f241ed9d700 1 -- 172.21.15.142:0/3950557124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418009ae0 con 0x7f242006b1c0 2023-09-30T22:59:57.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f241ed9d700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f24200b4f50 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f241000e850 tx=0x7f2410008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:57.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f2406ffd700 1 -- 172.21.15.142:0/3950557124 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410013410 con 0x7f242006b1c0 2023-09-30T22:59:57.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f2406ffd700 1 -- 172.21.15.142:0/3950557124 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410013570 con 0x7f242006b1c0 2023-09-30T22:59:57.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f2406ffd700 1 -- 172.21.15.142:0/3950557124 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410013910 con 0x7f242006b1c0 2023-09-30T22:59:57.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24200b5c80 con 0x7f242006b1c0 2023-09-30T22:59:57.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.529+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24200b6240 con 0x7f242006b1c0 2023-09-30T22:59:57.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.530+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24200697b0 con 0x7f242006b1c0 2023-09-30T22:59:57.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.531+0000 7f2406ffd700 1 -- 172.21.15.142:0/3950557124 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2410013d00 con 0x7f242006b1c0 2023-09-30T22:59:57.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.532+0000 7f2406ffd700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f240c067330 0x7f240c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:57.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.533+0000 7f2406ffd700 1 -- 172.21.15.142:0/3950557124 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2410084650 con 0x7f242006b1c0 2023-09-30T22:59:57.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.533+0000 7f241e59c700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f240c067330 0x7f240c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:57.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.533+0000 7f241e59c700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f240c067330 0x7f240c0697e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f24200c6490 tx=0x7f2414008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:57.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.537+0000 7f2406ffd700 1 -- 172.21.15.142:0/3950557124 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f24100517b0 con 0x7f242006b1c0 2023-09-30T22:59:57.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.768+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f242006fc10 con 0x7f242006b1c0 2023-09-30T22:59:57.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.769+0000 7f2406ffd700 1 -- 172.21.15.142:0/3950557124 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f2410020de0 con 0x7f242006b1c0 2023-09-30T22:59:57.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:57.769 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/179282358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":179282358},{"type":"v1","addr":"172.21.15.142:6836","nonce":179282358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3729425404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3729425404},{"type":"v1","addr":"172.21.15.148:6834","nonce":3729425404}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6146,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2613070544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2613070544},{"type":"v1","addr":"172.21.15.148:6835","nonce":2613070544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7581,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/812063863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":812063863},{"type":"v1","addr":"172.21.15.142:6837","nonce":812063863}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f240c067330 msgr2=0x7f240c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f240c067330 0x7f240c0697e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f24200c6490 tx=0x7f2414008040 comp rx=0 tx=0).stop 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 msgr2=0x7f24200b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f24200b4f50 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f241000e850 tx=0x7f2410008040 comp rx=0 tx=0).stop 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 shutdown_connections 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f240c067330 0x7f240c0697e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24201598e0 0x7f24200c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242006b1c0 0x7f24200b4f50 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 --2- 172.21.15.142:0/3950557124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200cee50 0x7f2420144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:57.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.771+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 >> 172.21.15.142:0/3950557124 conn(0x7f24200cd540 msgr2=0x7f24200b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:57.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.772+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 shutdown_connections 2023-09-30T22:59:57.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:57.772+0000 7f24251ff700 1 -- 172.21.15.142:0/3950557124 wait complete. 2023-09-30T22:59:57.773 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 68 2023-09-30T22:59:57.789 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:59:57.789 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T22:59:57.789 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:59:57.789 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:57.789 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T22:59:57.789 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T22:59:57.790 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T22:59:57.790 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:57.790 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T22:59:57.790 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T22:59:57.790 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T22:59:57.790 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:57.790 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T22:59:57.791 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T22:59:57.791 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T22:59:57.791 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:59:57.803 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:59:57.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:59:57.804 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T22:59:57.804 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T22:59:57.805 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T22:59:57.806 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T22:59:57.806 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T22:59:57.806 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T22:59:57.847 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:59:57.847 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:57.849 INFO:tasks.ceph.mds.c:Started 2023-09-30T22:59:57.850 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:57.851 INFO:tasks.ceph.mds.d:Started 2023-09-30T22:59:57.851 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:57.854 INFO:tasks.ceph.mds.b:Started 2023-09-30T22:59:57.854 DEBUG:teuthology.parallel:result is None 2023-09-30T22:59:57.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T22:59:57.990 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T22:59:57.991 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T22:59:57.999 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T22:59:57.999 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T22:59:58.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.054+0000 7ff4547ff700 1 Processor -- start 2023-09-30T22:59:58.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.054+0000 7ff4547ff700 1 -- start start 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff4547ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff44c06b3d0 0x7ff44c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff4547ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c06d470 con 0x7ff44c0b1f40 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff4547ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c157e60 con 0x7ff44c157a90 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff4547ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c0b2380 con 0x7ff44c06b3d0 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff451d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff44c06b3d0 0x7ff44c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff452d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff44c0b1f40 0x7ff44c06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41346/0 (socket says 172.21.15.142:41346) 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff452d9c700 1 -- 172.21.15.142:0/3214273407 learned_addr learned my addr 172.21.15.142:0/3214273407 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:58.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff451d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff44c06b3d0 0x7ff44c0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57610/0 (socket says 172.21.15.142:57610) 2023-09-30T22:59:58.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff451d9a700 1 -- 172.21.15.142:0/3214273407 >> v1:172.21.15.148:6789/0 conn(0x7ff44c157a90 legacy=0x7ff44c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff451d9a700 1 -- 172.21.15.142:0/3214273407 >> v1:172.21.15.142:6789/0 conn(0x7ff44c0b1f40 legacy=0x7ff44c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff451d9a700 1 -- 172.21.15.142:0/3214273407 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0ae880 con 0x7ff44c06b3d0 2023-09-30T22:59:58.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.056+0000 7ff451599700 1 -- 172.21.15.142:0/3214273407 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866596470 0 0) 0x7ff44c06d470 con 0x7ff44c0b1f40 2023-09-30T22:59:58.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.057+0000 7ff451d9a700 1 --2- 172.21.15.142:0/3214273407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c06b3d0 0x7ff44c0b1a00 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0098e0 tx=0x7ff43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a1a2db371126db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:58.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.057+0000 7ff451599700 1 -- 172.21.15.142:0/3214273407 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c009e80 con 0x7ff44c06b3d0 2023-09-30T22:59:58.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.057+0000 7ff451599700 1 -- 172.21.15.142:0/3214273407 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00b860 con 0x7ff44c06b3d0 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.057+0000 7ff451599700 1 -- 172.21.15.142:0/3214273407 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00bbe0 con 0x7ff44c06b3d0 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.057+0000 7ff4547ff700 1 -- 172.21.15.142:0/3214273407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c06b3d0 msgr2=0x7ff44c0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.057+0000 7ff4547ff700 1 --2- 172.21.15.142:0/3214273407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c06b3d0 0x7ff44c0b1a00 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0098e0 tx=0x7ff43c0091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.058+0000 7ff4547ff700 1 -- 172.21.15.142:0/3214273407 shutdown_connections 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.058+0000 7ff4547ff700 1 --2- 172.21.15.142:0/3214273407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c06b3d0 0x7ff44c0b1a00 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.058+0000 7ff4547ff700 1 -- 172.21.15.142:0/3214273407 >> 172.21.15.142:0/3214273407 conn(0x7ff44c0680c0 msgr2=0x7ff44c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.058+0000 7ff4547ff700 1 -- 172.21.15.142:0/3214273407 shutdown_connections 2023-09-30T22:59:58.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.058+0000 7ff4547ff700 1 -- 172.21.15.142:0/3214273407 wait complete. 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.059+0000 7ff4547ff700 1 Processor -- start 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.059+0000 7ff4547ff700 1 -- start start 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.060+0000 7ff4547ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c06b3d0 0x7ff44c1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.060+0000 7ff4547ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0b1f40 0x7ff44c0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.060+0000 7ff4547ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c157a90 0x7ff44c0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.060+0000 7ff4547ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c158230 con 0x7ff44c0b1f40 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.060+0000 7ff4547ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c159090 con 0x7ff44c06b3d0 2023-09-30T22:59:58.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.060+0000 7ff4547ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c1459e0 con 0x7ff44c157a90 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.060+0000 7ff451d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0b1f40 0x7ff44c0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0b1f40 0x7ff44c0b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57620/0 (socket says 172.21.15.142:57620) 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 -- 172.21.15.142:0/2211746914 learned_addr learned my addr 172.21.15.142:0/2211746914 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff452d9c700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c157a90 0x7ff44c0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff45259b700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c06b3d0 0x7ff44c1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 -- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c157a90 msgr2=0x7ff44c0b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c157a90 0x7ff44c0b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 -- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c06b3d0 msgr2=0x7ff44c1454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c06b3d0 0x7ff44c1454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 -- 172.21.15.142:0/2211746914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009420 con 0x7ff44c0b1f40 2023-09-30T22:59:58.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.061+0000 7ff451d9a700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0b1f40 0x7ff44c0b0820 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00b3c0 tx=0x7ff43c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:58.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.062+0000 7ff4427fc700 1 -- 172.21.15.142:0/2211746914 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c01f070 con 0x7ff44c0b1f40 2023-09-30T22:59:58.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.062+0000 7ff4427fc700 1 -- 172.21.15.142:0/2211746914 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c000c90 con 0x7ff44c0b1f40 2023-09-30T22:59:58.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.062+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c158480 con 0x7ff44c0b1f40 2023-09-30T22:59:58.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.062+0000 7ff4427fc700 1 -- 172.21.15.142:0/2211746914 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c025420 con 0x7ff44c0b1f40 2023-09-30T22:59:58.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.062+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c158a40 con 0x7ff44c0b1f40 2023-09-30T22:59:58.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.063+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c159220 con 0x7ff44c0b1f40 2023-09-30T22:59:58.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.064+0000 7ff4427fc700 1 -- 172.21.15.142:0/2211746914 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff43c023070 con 0x7ff44c0b1f40 2023-09-30T22:59:58.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.065+0000 7ff4427fc700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff430067330 0x7ff4300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.065+0000 7ff4427fc700 1 -- 172.21.15.142:0/2211746914 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff43c085d00 con 0x7ff44c0b1f40 2023-09-30T22:59:58.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.065+0000 7ff45259b700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff430067330 0x7ff4300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.066+0000 7ff45259b700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff430067330 0x7ff4300697e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff4480039e0 tx=0x7ff448007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:58.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.069+0000 7ff4427fc700 1 -- 172.21.15.142:0/2211746914 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff43c052ea0 con 0x7ff44c0b1f40 2023-09-30T22:59:58.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.276+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff44c06fc10 con 0x7ff44c0b1f40 2023-09-30T22:59:58.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.690+0000 7ff4427fc700 1 -- 172.21.15.142:0/2211746914 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v153) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff43c015070 con 0x7ff44c0b1f40 2023-09-30T22:59:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff430067330 msgr2=0x7ff4300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff430067330 0x7ff4300697e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff4480039e0 tx=0x7ff448007ec0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0b1f40 msgr2=0x7ff44c0b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0b1f40 0x7ff44c0b0820 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00b3c0 tx=0x7ff43c017000 comp rx=0 tx=0).stop 2023-09-30T22:59:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 shutdown_connections 2023-09-30T22:59:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff430067330 0x7ff4300697e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff44c157a90 0x7ff44c0b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c06b3d0 0x7ff44c1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 --2- 172.21.15.142:0/2211746914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44c0b1f40 0x7ff44c0b0820 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 >> 172.21.15.142:0/2211746914 conn(0x7ff44c0680c0 msgr2=0x7ff44c0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:58.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 shutdown_connections 2023-09-30T22:59:58.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.693+0000 7ff4547ff700 1 -- 172.21.15.142:0/2211746914 wait complete. 2023-09-30T22:59:58.694 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T22:59:58.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T22:59:58.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.903+0000 7f71431ff700 1 Processor -- start 2023-09-30T22:59:58.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.903+0000 7f71431ff700 1 -- start start 2023-09-30T22:59:58.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.904+0000 7f71431ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f713c15a2a0 0x7f713c161f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.904+0000 7f71431ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0b0ee0 con 0x7f713c0aebf0 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.904+0000 7f71431ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0b02d0 con 0x7f713c06ec50 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.904+0000 7f71431ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0aefc0 con 0x7f713c15a2a0 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.904+0000 7f7140f9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f713c0aebf0 0x7f713c0c9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41356/0 (socket says 172.21.15.142:41356) 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f7140f9b700 1 -- 172.21.15.142:0/305100649 learned_addr learned my addr 172.21.15.142:0/305100649 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f714179c700 1 --2- 172.21.15.142:0/305100649 >> v2:172.21.15.148:3300/0 conn(0x7f713c15a2a0 0x7f713c161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711203620 0 0) 0x7f713c0b0ee0 con 0x7f713c0aebf0 2023-09-30T22:59:58.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c003570 con 0x7f713c0aebf0 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288898718 0 0) 0x7f713c0b02d0 con 0x7f713c06ec50 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713c0b0ee0 con 0x7f713c06ec50 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572553956 0 0) 0x7f712c003570 con 0x7f713c0aebf0 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 >> v2:172.21.15.148:3300/0 conn(0x7f713c15a2a0 msgr2=0x7f713c161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 --2- 172.21.15.142:0/305100649 >> v2:172.21.15.148:3300/0 conn(0x7f713c15a2a0 0x7f713c161f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 >> v1:172.21.15.148:6789/0 conn(0x7f713c06ec50 legacy=0x7f713c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0b05b0 con 0x7f713c0aebf0 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f7130001470 con 0x7f713c0aebf0 2023-09-30T22:59:58.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 >> v1:172.21.15.142:6789/0 conn(0x7f713c0aebf0 legacy=0x7f713c0c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f712c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f712c004810 0x7f712c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.905+0000 7f713b7fe700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f712c0051c0 0x7f712c00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0aefc0 con 0x7f712c003bf0 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c00e2c0 con 0x7f712c004810 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c00e480 con 0x7f712c0051c0 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f7140f9b700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f712c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f713bfff700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f712c004810 0x7f712c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f714179c700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f712c0051c0 0x7f712c00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f7140f9b700 1 -- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f712c0051c0 msgr2=0x7f712c00dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:58.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f7140f9b700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f712c0051c0 0x7f712c00dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f7140f9b700 1 -- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f712c004810 msgr2=0x7f712c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f7140f9b700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f712c004810 0x7f712c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f7140f9b700 1 -- 172.21.15.142:0/305100649 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c003570 con 0x7f712c003bf0 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f713bfff700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f712c004810 0x7f712c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f714179c700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f712c0051c0 0x7f712c00dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f714179c700 1 -- 172.21.15.142:0/305100649 reap_dead start 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f7140f9b700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f712c003fe0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f713000c2d0 tx=0x7f7130001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40177662885de850 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.906+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713000cba0 con 0x7f712c003bf0 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713000cd00 con 0x7f712c003bf0 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f713b7fe700 1 -- 172.21.15.142:0/305100649 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130005b70 con 0x7f712c003bf0 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f71431ff700 1 -- 172.21.15.142:0/305100649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 msgr2=0x7f712c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f71431ff700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f712c003fe0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f713000c2d0 tx=0x7f7130001e10 comp rx=0 tx=0).stop 2023-09-30T22:59:58.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f71431ff700 1 -- 172.21.15.142:0/305100649 shutdown_connections 2023-09-30T22:59:58.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f71431ff700 1 --2- 172.21.15.142:0/305100649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f712c003fe0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f71431ff700 1 -- 172.21.15.142:0/305100649 >> 172.21.15.142:0/305100649 conn(0x7f713c0680c0 msgr2=0x7f713c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:58.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f71431ff700 1 -- 172.21.15.142:0/305100649 shutdown_connections 2023-09-30T22:59:58.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.907+0000 7f71431ff700 1 -- 172.21.15.142:0/305100649 wait complete. 2023-09-30T22:59:58.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.909+0000 7f71431ff700 1 Processor -- start 2023-09-30T22:59:58.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.909+0000 7f71431ff700 1 -- start start 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f71431ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f713c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f71431ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0c8540 0x7f713c0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f71431ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0c6540 0x7f713c0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f71431ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c8ed0 con 0x7f712c003bf0 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f71431ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c16a570 con 0x7f713c0c8540 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f71431ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c16a7f0 con 0x7f713c0c6540 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f713c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f713c157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57636/0 (socket says 172.21.15.142:57636) 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 -- 172.21.15.142:0/85792622 learned_addr learned my addr 172.21.15.142:0/85792622 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f713bfff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0c8540 0x7f713c0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f714179c700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0c6540 0x7f713c0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 -- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0c6540 msgr2=0x7f713c0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0c6540 0x7f713c0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 -- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0c8540 msgr2=0x7f713c0c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0c8540 0x7f713c0c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.910+0000 7f7140f9b700 1 -- 172.21.15.142:0/85792622 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c16aad0 con 0x7f712c003bf0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.911+0000 7f7140f9b700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f713c157610 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7130007c90 tx=0x7f7130015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.911+0000 7f7138ff9700 1 -- 172.21.15.142:0/85792622 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130004a40 con 0x7f712c003bf0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.911+0000 7f7138ff9700 1 -- 172.21.15.142:0/85792622 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130004ba0 con 0x7f712c003bf0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.911+0000 7f7138ff9700 1 -- 172.21.15.142:0/85792622 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300070d0 con 0x7f712c003bf0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.911+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c16adb0 con 0x7f712c003bf0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.911+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c16b370 con 0x7f712c003bf0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.912+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0695b0 con 0x7f712c003bf0 2023-09-30T22:59:58.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.913+0000 7f7138ff9700 1 -- 172.21.15.142:0/85792622 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7130007440 con 0x7f712c003bf0 2023-09-30T22:59:58.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.913+0000 7f7138ff9700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:58.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.914+0000 7f7138ff9700 1 -- 172.21.15.142:0/85792622 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f71300852d0 con 0x7f712c003bf0 2023-09-30T22:59:58.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.914+0000 7f713bfff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:58.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.914+0000 7f713bfff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f71280010e0 tx=0x7f7128009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:58.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:58.918+0000 7f7138ff9700 1 -- 172.21.15.142:0/85792622 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7130052480 con 0x7f712c003bf0 2023-09-30T22:59:59.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.182+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f713c0b0880 con 0x7f712c003bf0 2023-09-30T22:59:59.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.182+0000 7f7138ff9700 1 -- 172.21.15.142:0/85792622 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7130055aa0 con 0x7f712c003bf0 2023-09-30T22:59:59.182 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:59.182 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T22:59:59.182 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.183 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T22:59:59.184 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.185 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.186 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T22:59:59.188 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T22:59:59.191 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T22:59:59.193 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T22:59:59.194 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T22:59:59.196 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T22:59:59.197 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T22:59:59.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 msgr2=0x7f71200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f71280010e0 tx=0x7f7128009040 comp rx=0 tx=0).stop 2023-09-30T22:59:59.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 msgr2=0x7f713c157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f713c157610 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7130007c90 tx=0x7f7130015000 comp rx=0 tx=0).stop 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 shutdown_connections 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7120067330 0x7f71200697e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f713c0c6540 0x7f713c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c003bf0 0x7f713c157610 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 --2- 172.21.15.142:0/85792622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f713c0c8540 0x7f713c0c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 >> 172.21.15.142:0/85792622 conn(0x7f713c0680c0 msgr2=0x7f713c1553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 shutdown_connections 2023-09-30T22:59:59.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.185+0000 7f71431ff700 1 -- 172.21.15.142:0/85792622 wait complete. 2023-09-30T22:59:59.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:59:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.392+0000 7f51e9bff700 1 Processor -- start 2023-09-30T22:59:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.393+0000 7f51e9bff700 1 -- start start 2023-09-30T22:59:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e9bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51e40aebf0 0x7f51e406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e9bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51e406f190 0x7f51e4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e9bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40b0ee0 con 0x7f51e415a0d0 2023-09-30T22:59:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e9bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40aefc0 con 0x7f51e406f190 2023-09-30T22:59:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e9bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40c9f90 con 0x7f51e40aebf0 2023-09-30T22:59:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e2ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51e406f190 0x7f51e4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e2ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51e406f190 0x7f51e4159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57638/0 (socket says 172.21.15.142:57638) 2023-09-30T22:59:59.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e2ffd700 1 -- 172.21.15.142:0/199689803 learned_addr learned my addr 172.21.15.142:0/199689803 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:59.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.394+0000 7f51e37fe700 1 --2- 172.21.15.142:0/199689803 >> v2:172.21.15.148:3300/0 conn(0x7f51e40aebf0 0x7f51e406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e2ffd700 1 -- 172.21.15.142:0/199689803 >> v2:172.21.15.148:3300/0 conn(0x7f51e40aebf0 msgr2=0x7f51e406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:59.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e2ffd700 1 --2- 172.21.15.142:0/199689803 >> v2:172.21.15.148:3300/0 conn(0x7f51e40aebf0 0x7f51e406ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e2ffd700 1 -- 172.21.15.142:0/199689803 >> v1:172.21.15.148:6789/0 conn(0x7f51e415a0d0 legacy=0x7f51e40c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e2ffd700 1 -- 172.21.15.142:0/199689803 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e415a4d0 con 0x7f51e406f190 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e2ffd700 1 --2- 172.21.15.142:0/199689803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e4159b90 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f51e4063d00 tx=0x7f51d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb076332b80f3b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e27fc700 1 -- 172.21.15.142:0/199689803 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800b820 con 0x7f51e406f190 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e27fc700 1 -- 172.21.15.142:0/199689803 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800b980 con 0x7f51e406f190 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.395+0000 7f51e27fc700 1 -- 172.21.15.142:0/199689803 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800bd20 con 0x7f51e406f190 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 -- 172.21.15.142:0/199689803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 msgr2=0x7f51e4159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 --2- 172.21.15.142:0/199689803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e4159b90 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f51e4063d00 tx=0x7f51d8009250 comp rx=0 tx=0).stop 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 -- 172.21.15.142:0/199689803 shutdown_connections 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 --2- 172.21.15.142:0/199689803 >> v2:172.21.15.148:3300/0 conn(0x7f51e40aebf0 0x7f51e406ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 --2- 172.21.15.142:0/199689803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e4159b90 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 -- 172.21.15.142:0/199689803 >> 172.21.15.142:0/199689803 conn(0x7f51e40680c0 msgr2=0x7f51e40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:59.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 -- 172.21.15.142:0/199689803 shutdown_connections 2023-09-30T22:59:59.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.396+0000 7f51e9bff700 1 -- 172.21.15.142:0/199689803 wait complete. 2023-09-30T22:59:59.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.398+0000 7f51e9bff700 1 Processor -- start 2023-09-30T22:59:59.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.398+0000 7f51e9bff700 1 -- start start 2023-09-30T22:59:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.399+0000 7f51e9bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e41432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.399+0000 7f51e9bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e40aebf0 0x7f51e4154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.399+0000 7f51e9bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e415a0d0 0x7f51e40c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.399+0000 7f51e9bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e414f9e0 con 0x7f51e406f190 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.399+0000 7f51e9bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4151ed0 con 0x7f51e415a0d0 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.399+0000 7f51e9bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e41553f0 con 0x7f51e40aebf0 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e41432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e41432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57640/0 (socket says 172.21.15.142:57640) 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 -- 172.21.15.142:0/1290203623 learned_addr learned my addr 172.21.15.142:0/1290203623 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 -- 172.21.15.142:0/1290203623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e40aebf0 msgr2=0x7f51e4154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e40aebf0 0x7f51e4154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 -- 172.21.15.142:0/1290203623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e415a0d0 msgr2=0x7f51e40c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e415a0d0 0x7f51e40c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 -- 172.21.15.142:0/1290203623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80094f0 con 0x7f51e406f190 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e37fe700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e41432f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f51d400d890 tx=0x7f51d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51cb7fe700 1 -- 172.21.15.142:0/1290203623 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400b600 con 0x7f51e406f190 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51cb7fe700 1 -- 172.21.15.142:0/1290203623 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400b760 con 0x7f51e406f190 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51cb7fe700 1 -- 172.21.15.142:0/1290203623 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400bae0 con 0x7f51e406f190 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.400+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4155670 con 0x7f51e406f190 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.401+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4155c30 con 0x7f51e406f190 2023-09-30T22:59:59.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.402+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e40695b0 con 0x7f51e406f190 2023-09-30T22:59:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.402+0000 7f51cb7fe700 1 -- 172.21.15.142:0/1290203623 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f51d401e460 con 0x7f51e406f190 2023-09-30T22:59:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.403+0000 7f51cb7fe700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f51d0067330 0x7f51d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.403+0000 7f51cb7fe700 1 -- 172.21.15.142:0/1290203623 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f51d4084fb0 con 0x7f51e406f190 2023-09-30T22:59:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.403+0000 7f51e2ffd700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f51d0067330 0x7f51d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.404+0000 7f51e2ffd700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f51d0067330 0x7f51d00697e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f51e4063d00 tx=0x7f51d8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.408+0000 7f51cb7fe700 1 -- 172.21.15.142:0/1290203623 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f51d4052160 con 0x7f51e406f190 2023-09-30T22:59:59.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.598+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51e406fc10 con 0x7f51e406f190 2023-09-30T22:59:59.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.599+0000 7f51cb7fe700 1 -- 172.21.15.142:0/1290203623 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+13806 (secure 0 0 0) 0x7f51d4055780 con 0x7f51e406f190 2023-09-30T22:59:59.599 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T22:59:59.599 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":155,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T22:59:58.695162+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:59:59.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f51d0067330 msgr2=0x7f51d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f51d0067330 0x7f51d00697e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f51e4063d00 tx=0x7f51d8016000 comp rx=0 tx=0).stop 2023-09-30T22:59:59.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 msgr2=0x7f51e41432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e41432f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f51d400d890 tx=0x7f51d4008040 comp rx=0 tx=0).stop 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 shutdown_connections 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f51d0067330 0x7f51d00697e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e415a0d0 0x7f51e40c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51e406f190 0x7f51e41432f0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 --2- 172.21.15.142:0/1290203623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e40aebf0 0x7f51e4154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 >> 172.21.15.142:0/1290203623 conn(0x7f51e40680c0 msgr2=0x7f51e4069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 shutdown_connections 2023-09-30T22:59:59.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.601+0000 7f51e9bff700 1 -- 172.21.15.142:0/1290203623 wait complete. 2023-09-30T22:59:59.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:59:59.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:59:59.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.814+0000 7f95d81ff700 1 Processor -- start 2023-09-30T22:59:59.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.814+0000 7f95d81ff700 1 -- start start 2023-09-30T22:59:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d81ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95d00c6270 0x7f95d01580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d81ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f95d00c40e0 0x7f95d00c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d81ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00c38d0 con 0x7f95d0141150 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d81ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d00c6aa0 con 0x7f95d00c6270 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d81ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d00c4a30 con 0x7f95d00c40e0 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d579a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95d00c6270 0x7f95d01580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d5f9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f95d0141150 0x7f95d015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41368/0 (socket says 172.21.15.142:41368) 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.815+0000 7f95d5f9b700 1 -- 172.21.15.142:0/3038298992 learned_addr learned my addr 172.21.15.142:0/3038298992 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d679c700 1 --2- 172.21.15.142:0/3038298992 >> v2:172.21.15.148:3300/0 conn(0x7f95d00c40e0 0x7f95d00c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d579a700 1 -- 172.21.15.142:0/3038298992 >> v2:172.21.15.148:3300/0 conn(0x7f95d00c40e0 msgr2=0x7f95d00c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d579a700 1 --2- 172.21.15.142:0/3038298992 >> v2:172.21.15.148:3300/0 conn(0x7f95d00c40e0 0x7f95d00c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d579a700 1 -- 172.21.15.142:0/3038298992 >> v1:172.21.15.142:6789/0 conn(0x7f95d0141150 legacy=0x7f95d015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d579a700 1 -- 172.21.15.142:0/3038298992 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d006a040 con 0x7f95d00c6270 2023-09-30T22:59:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d4f99700 1 -- 172.21.15.142:0/3038298992 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772802074 0 0) 0x7f95d00c38d0 con 0x7f95d0141150 2023-09-30T22:59:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d579a700 1 --2- 172.21.15.142:0/3038298992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c6270 0x7f95d01580c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f95d00c7960 tx=0x7f95c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ff8bae2c591285 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d4f99700 1 -- 172.21.15.142:0/3038298992 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0011630 con 0x7f95d00c6270 2023-09-30T22:59:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d4f99700 1 -- 172.21.15.142:0/3038298992 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0011790 con 0x7f95d00c6270 2023-09-30T22:59:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.816+0000 7f95d4f99700 1 -- 172.21.15.142:0/3038298992 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0011b30 con 0x7f95d00c6270 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 -- 172.21.15.142:0/3038298992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c6270 msgr2=0x7f95d01580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 --2- 172.21.15.142:0/3038298992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c6270 0x7f95d01580c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f95d00c7960 tx=0x7f95c00091a0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 -- 172.21.15.142:0/3038298992 shutdown_connections 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 --2- 172.21.15.142:0/3038298992 >> v2:172.21.15.148:3300/0 conn(0x7f95d00c40e0 0x7f95d00c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 --2- 172.21.15.142:0/3038298992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c6270 0x7f95d01580c0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 -- 172.21.15.142:0/3038298992 >> 172.21.15.142:0/3038298992 conn(0x7f95d00cc670 msgr2=0x7f95d00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 -- 172.21.15.142:0/3038298992 shutdown_connections 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.817+0000 7f95d81ff700 1 -- 172.21.15.142:0/3038298992 wait complete. 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.818+0000 7f95d81ff700 1 Processor -- start 2023-09-30T22:59:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.819+0000 7f95d81ff700 1 -- start start 2023-09-30T22:59:59.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.819+0000 7f95d81ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c40e0 0x7f95d016b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d81ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95d00c6270 0x7f95d01570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d81ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95d0141150 0x7f95d0137aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d81ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00c3580 con 0x7f95d00c40e0 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d81ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00ca9f0 con 0x7f95d0141150 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d81ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00ca3e0 con 0x7f95d00c6270 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c40e0 0x7f95d016b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c40e0 0x7f95d016b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57648/0 (socket says 172.21.15.142:57648) 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 -- 172.21.15.142:0/946878911 learned_addr learned my addr 172.21.15.142:0/946878911 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d579a700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95d00c6270 0x7f95d01570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d679c700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95d0141150 0x7f95d0137aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 -- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95d00c6270 msgr2=0x7f95d01570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95d00c6270 0x7f95d01570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 -- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95d0141150 msgr2=0x7f95d0137aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95d0141150 0x7f95d0137aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d5f9b700 1 -- 172.21.15.142:0/946878911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c0009420 con 0x7f95d00c40e0 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.820+0000 7f95d679c700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95d0141150 0x7f95d0137aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.821+0000 7f95d5f9b700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c40e0 0x7f95d016b300 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c5b0 tx=0x7f95cc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.821+0000 7f95c5ffb700 1 -- 172.21.15.142:0/946878911 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc005b30 con 0x7f95d00c40e0 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.821+0000 7f95c5ffb700 1 -- 172.21.15.142:0/946878911 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc005c90 con 0x7f95d00c40e0 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.821+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d00c32a0 con 0x7f95d00c40e0 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.821+0000 7f95c5ffb700 1 -- 172.21.15.142:0/946878911 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc007300 con 0x7f95d00c40e0 2023-09-30T22:59:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.821+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d00c2ac0 con 0x7f95d00c40e0 2023-09-30T22:59:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.822+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d00ca240 con 0x7f95d00c40e0 2023-09-30T22:59:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.823+0000 7f95c5ffb700 1 -- 172.21.15.142:0/946878911 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f95cc0076b0 con 0x7f95d00c40e0 2023-09-30T22:59:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.824+0000 7f95c5ffb700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95b4067330 0x7f95b40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:59:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.824+0000 7f95c5ffb700 1 -- 172.21.15.142:0/946878911 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f95cc083dc0 con 0x7f95d00c40e0 2023-09-30T22:59:59.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.824+0000 7f95d579a700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95b4067330 0x7f95b40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:59:59.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.825+0000 7f95d579a700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95b4067330 0x7f95b40697e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f95d00c66f0 tx=0x7f95c0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:59:59.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T22:59:59.828+0000 7f95c5ffb700 1 -- 172.21.15.142:0/946878911 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f95d00ca240 con 0x7f95d00c40e0 2023-09-30T23:00:00.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.018+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95d00ca240 con 0x7f95d00c40e0 2023-09-30T23:00:00.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.019+0000 7f95c5ffb700 1 -- 172.21.15.142:0/946878911 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95d00ca240 con 0x7f95d00c40e0 2023-09-30T23:00:00.019 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T23:00:00.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.021+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95b4067330 msgr2=0x7f95b40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.021+0000 7f95d81ff700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95b4067330 0x7f95b40697e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f95d00c66f0 tx=0x7f95c0017000 comp rx=0 tx=0).stop 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.021+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c40e0 msgr2=0x7f95d016b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.021+0000 7f95d81ff700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c40e0 0x7f95d016b300 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c5b0 tx=0x7f95cc001070 comp rx=0 tx=0).stop 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 shutdown_connections 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f95b4067330 0x7f95b40697e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95d0141150 0x7f95d0137aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95d00c40e0 0x7f95d016b300 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 --2- 172.21.15.142:0/946878911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f95d00c6270 0x7f95d01570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 >> 172.21.15.142:0/946878911 conn(0x7f95d00cc670 msgr2=0x7f95d0140090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 shutdown_connections 2023-09-30T23:00:00.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.022+0000 7f95d81ff700 1 -- 172.21.15.142:0/946878911 wait complete. 2023-09-30T23:00:00.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T23:00:00.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.236+0000 7f7cafdff700 1 Processor -- start 2023-09-30T23:00:00.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.236+0000 7f7cafdff700 1 -- start start 2023-09-30T23:00:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.237+0000 7f7cafdff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ca80c47f0 0x7f7ca81580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.237+0000 7f7cafdff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80c38d0 con 0x7f7ca80c6270 2023-09-30T23:00:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.237+0000 7f7cafdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80c6aa0 con 0x7f7ca8141150 2023-09-30T23:00:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.237+0000 7f7cafdff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca806a040 con 0x7f7ca80c47f0 2023-09-30T23:00:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.237+0000 7f7cad39a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7ca80c6270 0x7f7ca80c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41384/0 (socket says 172.21.15.142:41384) 2023-09-30T23:00:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.237+0000 7f7cad39a700 1 -- 172.21.15.142:0/1722172375 learned_addr learned my addr 172.21.15.142:0/1722172375 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cae39c700 1 --2- 172.21.15.142:0/1722172375 >> v2:172.21.15.148:3300/0 conn(0x7f7ca80c47f0 0x7f7ca81580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773308784 0 0) 0x7f7ca80c38d0 con 0x7f7ca80c6270 2023-09-30T23:00:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c94003570 con 0x7f7ca80c6270 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1742847690 0 0) 0x7f7c94003570 con 0x7f7ca80c6270 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 >> v2:172.21.15.148:3300/0 conn(0x7f7ca80c47f0 msgr2=0x7f7ca81580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 --2- 172.21.15.142:0/1722172375 >> v2:172.21.15.148:3300/0 conn(0x7f7ca80c47f0 0x7f7ca81580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 >> v1:172.21.15.148:6789/0 conn(0x7f7ca8141150 legacy=0x7f7ca815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80c67c0 con 0x7f7ca80c6270 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f7c98001470 con 0x7f7ca80c6270 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 >> v1:172.21.15.142:6789/0 conn(0x7f7ca80c6270 legacy=0x7f7ca80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c94003ab0 0x7f7c94003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7c94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c94005210 0x7f7c9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca806a040 con 0x7f7c94004810 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9400c1b0 con 0x7f7c94003ab0 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.238+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9400c370 con 0x7f7c94005210 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cad39a700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7c94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cadb9b700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c94003ab0 0x7f7c94003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cae39c700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c94005210 0x7f7c9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cad39a700 1 -- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c94005210 msgr2=0x7f7c9400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cad39a700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c94005210 0x7f7c9400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cad39a700 1 -- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c94003ab0 msgr2=0x7f7c94003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cad39a700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c94003ab0 0x7f7c94003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cad39a700 1 -- 172.21.15.142:0/1722172375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94003570 con 0x7f7c94004810 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cae39c700 1 -- 172.21.15.142:0/1722172375 reap_dead start 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cad39a700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7c94004c80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800c2a0 tx=0x7f7c98001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1688037e9d1b16d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800cb70 con 0x7f7c94004810 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800ccf0 con 0x7f7c94004810 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.239+0000 7f7cacb99700 1 -- 172.21.15.142:0/1722172375 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98005b70 con 0x7f7c94004810 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.240+0000 7f7cafdff700 1 -- 172.21.15.142:0/1722172375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 msgr2=0x7f7c94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.240+0000 7f7cafdff700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7c94004c80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800c2a0 tx=0x7f7c98001d80 comp rx=0 tx=0).stop 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.240+0000 7f7cafdff700 1 -- 172.21.15.142:0/1722172375 shutdown_connections 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.240+0000 7f7cafdff700 1 --2- 172.21.15.142:0/1722172375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7c94004c80 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.240+0000 7f7cafdff700 1 -- 172.21.15.142:0/1722172375 >> 172.21.15.142:0/1722172375 conn(0x7f7ca80cc670 msgr2=0x7f7ca80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.240+0000 7f7cafdff700 1 -- 172.21.15.142:0/1722172375 shutdown_connections 2023-09-30T23:00:00.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.240+0000 7f7cafdff700 1 -- 172.21.15.142:0/1722172375 wait complete. 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.242+0000 7f7cafdff700 1 Processor -- start 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.242+0000 7f7cafdff700 1 -- start start 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cafdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7ca813ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cafdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ca8167290 0x7f7ca813f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cafdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ca80c2b30 0x7f7ca80c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cafdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca813e410 con 0x7f7c94004810 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cafdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80c34f0 con 0x7f7ca80c2b30 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cafdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca813d790 con 0x7f7ca8167290 2023-09-30T23:00:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7ca813ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7ca813ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57668/0 (socket says 172.21.15.142:57668) 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 -- 172.21.15.142:0/3717739508 learned_addr learned my addr 172.21.15.142:0/3717739508 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cad39a700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ca8167290 0x7f7ca813f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cae39c700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ca80c2b30 0x7f7ca80c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 -- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ca8167290 msgr2=0x7f7ca813f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ca8167290 0x7f7ca813f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 -- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ca80c2b30 msgr2=0x7f7ca80c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ca80c2b30 0x7f7ca80c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 -- 172.21.15.142:0/3717739508 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca813da70 con 0x7f7c94004810 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.243+0000 7f7cadb9b700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7ca813ce40 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4002950 tx=0x7f7ca4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:00.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.244+0000 7f7c9dffb700 1 -- 172.21.15.142:0/3717739508 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40033b0 con 0x7f7c94004810 2023-09-30T23:00:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.244+0000 7f7c9dffb700 1 -- 172.21.15.142:0/3717739508 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca4002e90 con 0x7f7c94004810 2023-09-30T23:00:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.244+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca813dd50 con 0x7f7c94004810 2023-09-30T23:00:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.244+0000 7f7c9dffb700 1 -- 172.21.15.142:0/3717739508 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4006c80 con 0x7f7c94004810 2023-09-30T23:00:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.244+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca813d380 con 0x7f7c94004810 2023-09-30T23:00:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.245+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca813e550 con 0x7f7c94004810 2023-09-30T23:00:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.246+0000 7f7c9dffb700 1 -- 172.21.15.142:0/3717739508 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7ca4007260 con 0x7f7c94004810 2023-09-30T23:00:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.247+0000 7f7c9dffb700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c8c067360 0x7f7c8c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.247+0000 7f7c9dffb700 1 -- 172.21.15.142:0/3717739508 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7ca4084990 con 0x7f7c94004810 2023-09-30T23:00:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.247+0000 7f7cad39a700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c8c067360 0x7f7c8c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.247+0000 7f7cad39a700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c8c067360 0x7f7c8c069810 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ca813c1b0 tx=0x7f7c98015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:00.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.251+0000 7f7c9dffb700 1 -- 172.21.15.142:0/3717739508 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7ca813e550 con 0x7f7c94004810 2023-09-30T23:00:00.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.440+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7ca813e550 con 0x7f7c94004810 2023-09-30T23:00:00.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.440+0000 7f7c9dffb700 1 -- 172.21.15.142:0/3717739508 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ca813e550 con 0x7f7c94004810 2023-09-30T23:00:00.440 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T23:00:00.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c8c067360 msgr2=0x7f7c8c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c8c067360 0x7f7c8c069810 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ca813c1b0 tx=0x7f7c98015000 comp rx=0 tx=0).stop 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 msgr2=0x7f7ca813ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7ca813ce40 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4002950 tx=0x7f7ca4007d30 comp rx=0 tx=0).stop 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 shutdown_connections 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c8c067360 0x7f7c8c069810 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ca80c2b30 0x7f7ca80c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c94004810 0x7f7ca813ce40 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 --2- 172.21.15.142:0/3717739508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ca8167290 0x7f7ca813f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 >> 172.21.15.142:0/3717739508 conn(0x7f7ca80cc670 msgr2=0x7f7ca80c3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.442+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 shutdown_connections 2023-09-30T23:00:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.443+0000 7f7cafdff700 1 -- 172.21.15.142:0/3717739508 wait complete. 2023-09-30T23:00:00.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T23:00:00.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.650+0000 7f7a829ff700 1 Processor -- start 2023-09-30T23:00:00.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.651+0000 7f7a829ff700 1 -- start start 2023-09-30T23:00:00.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.652+0000 7f7a829ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c159a70 0x7f7a7c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.652+0000 7f7a829ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a7c0c8e10 0x7f7a7c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.652+0000 7f7a829ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c068c10 con 0x7f7a7c0c9890 2023-09-30T23:00:00.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.652+0000 7f7a829ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0c9690 con 0x7f7a7c0c8e10 2023-09-30T23:00:00.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.652+0000 7f7a829ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0683d0 con 0x7f7a7c159a70 2023-09-30T23:00:00.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a7c0c8e10 0x7f7a7c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a7c0c8e10 0x7f7a7c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57672/0 (socket says 172.21.15.142:57672) 2023-09-30T23:00:00.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/2112457542 learned_addr learned my addr 172.21.15.142:0/2112457542 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:00.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a80f9c700 1 --1- 172.21.15.142:0/2112457542 >> v1:172.21.15.148:6789/0 conn(0x7f7a7c0c9890 0x7f7a7c0b1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:45278/0 (socket says 172.21.15.142:45278) 2023-09-30T23:00:00.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7bfff700 1 --2- 172.21.15.142:0/2112457542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c159a70 0x7f7a7c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/2112457542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c159a70 msgr2=0x7f7a7c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 --2- 172.21.15.142:0/2112457542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c159a70 0x7f7a7c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/2112457542 >> v1:172.21.15.148:6789/0 conn(0x7f7a7c0c9890 legacy=0x7f7a7c0b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/2112457542 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0c93b0 con 0x7f7a7c0c8e10 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.653+0000 7f7a7b7fe700 1 --2- 172.21.15.142:0/2112457542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c8e10 0x7f7a7c0690a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f7a700099b0 tx=0x7f7a70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a3dd6cd3aed762 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a7affd700 1 -- 172.21.15.142:0/2112457542 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70009ea0 con 0x7f7a7c0c8e10 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a7affd700 1 -- 172.21.15.142:0/2112457542 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000b860 con 0x7f7a7c0c8e10 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a7affd700 1 -- 172.21.15.142:0/2112457542 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000bc00 con 0x7f7a7c0c8e10 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 -- 172.21.15.142:0/2112457542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c8e10 msgr2=0x7f7a7c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 --2- 172.21.15.142:0/2112457542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c8e10 0x7f7a7c0690a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f7a700099b0 tx=0x7f7a70009250 comp rx=0 tx=0).stop 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 -- 172.21.15.142:0/2112457542 shutdown_connections 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 --2- 172.21.15.142:0/2112457542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c159a70 0x7f7a7c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 --2- 172.21.15.142:0/2112457542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c8e10 0x7f7a7c0690a0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 -- 172.21.15.142:0/2112457542 >> 172.21.15.142:0/2112457542 conn(0x7f7a7c0cb2e0 msgr2=0x7f7a7c0cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:00.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 -- 172.21.15.142:0/2112457542 shutdown_connections 2023-09-30T23:00:00.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.654+0000 7f7a829ff700 1 -- 172.21.15.142:0/2112457542 wait complete. 2023-09-30T23:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.656+0000 7f7a829ff700 1 Processor -- start 2023-09-30T23:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.656+0000 7f7a829ff700 1 -- start start 2023-09-30T23:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a829ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0c8e10 0x7f7a7c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a829ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c9890 0x7f7a7c169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a829ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c159a70 0x7f7a7c1697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a829ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c169d10 con 0x7f7a7c0c9890 2023-09-30T23:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a829ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c140a60 con 0x7f7a7c159a70 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a829ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c140d40 con 0x7f7a7c0c8e10 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c9890 0x7f7a7c169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c9890 0x7f7a7c169290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57688/0 (socket says 172.21.15.142:57688) 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/718503781 learned_addr learned my addr 172.21.15.142:0/718503781 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7bfff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0c8e10 0x7f7a7c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a80f9c700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c159a70 0x7f7a7c1697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0c8e10 msgr2=0x7f7a7c0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0c8e10 0x7f7a7c0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c159a70 msgr2=0x7f7a7c1697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c159a70 0x7f7a7c1697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.657+0000 7f7a7b7fe700 1 -- 172.21.15.142:0/718503781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700094f0 con 0x7f7a7c0c9890 2023-09-30T23:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.658+0000 7f7a7b7fe700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c9890 0x7f7a7c169290 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c06f650 tx=0x7f7a70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.658+0000 7f7a63fff700 1 -- 172.21.15.142:0/718503781 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70000d10 con 0x7f7a7c0c9890 2023-09-30T23:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.658+0000 7f7a63fff700 1 -- 172.21.15.142:0/718503781 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000bbe0 con 0x7f7a7c0c9890 2023-09-30T23:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.658+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c141020 con 0x7f7a7c0c9890 2023-09-30T23:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.658+0000 7f7a63fff700 1 -- 172.21.15.142:0/718503781 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70011670 con 0x7f7a7c0c9890 2023-09-30T23:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.658+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c1415e0 con 0x7f7a7c0c9890 2023-09-30T23:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.659+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c06e790 con 0x7f7a7c0c9890 2023-09-30T23:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.660+0000 7f7a63fff700 1 -- 172.21.15.142:0/718503781 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7a70011aa0 con 0x7f7a7c0c9890 2023-09-30T23:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.661+0000 7f7a63fff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.661+0000 7f7a63fff700 1 -- 172.21.15.142:0/718503781 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7a700860e0 con 0x7f7a7c0c9890 2023-09-30T23:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.661+0000 7f7a7bfff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.662+0000 7f7a7bfff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009d10 tx=0x7f7a6c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:00.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.665+0000 7f7a63fff700 1 -- 172.21.15.142:0/718503781 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7a70053290 con 0x7f7a7c0c9890 2023-09-30T23:00:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.862+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7a7c0685c0 con 0x7f7a7c0c9890 2023-09-30T23:00:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.862+0000 7f7a63fff700 1 -- 172.21.15.142:0/718503781 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v155) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7a700568b0 con 0x7f7a7c0c9890 2023-09-30T23:00:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:00.862 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T23:00:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:00:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T23:00:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T23:00:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:00:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:00:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T23:00:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T23:00:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:00:00.863 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T23:00:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 msgr2=0x7f7a680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009d10 tx=0x7f7a6c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c9890 msgr2=0x7f7a7c169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c9890 0x7f7a7c169290 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c06f650 tx=0x7f7a70017000 comp rx=0 tx=0).stop 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 shutdown_connections 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7a68067330 0x7f7a680697e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a7c159a70 0x7f7a7c1697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a7c0c8e10 0x7f7a7c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 --2- 172.21.15.142:0/718503781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7c0c9890 0x7f7a7c169290 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 >> 172.21.15.142:0/718503781 conn(0x7f7a7c0cb2e0 msgr2=0x7f7a7c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 shutdown_connections 2023-09-30T23:00:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:00.864+0000 7f7a829ff700 1 -- 172.21.15.142:0/718503781 wait complete. 2023-09-30T23:00:00.882 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T23:00:00.882 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T23:00:01.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.077+0000 7f02c41ff700 1 Processor -- start 2023-09-30T23:00:01.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.077+0000 7f02c41ff700 1 -- start start 2023-09-30T23:00:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c41ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f02bc0ca5e0 0x7f02bc0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c41ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02bc159de0 0x7f02bc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c41ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc068230 con 0x7f02bc159a10 2023-09-30T23:00:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c41ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc067620 con 0x7f02bc159de0 2023-09-30T23:00:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c41ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc067900 con 0x7f02bc0ca5e0 2023-09-30T23:00:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c279c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02bc159de0 0x7f02bc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c1f9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f02bc159a10 0x7f02bc0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34214/0 (socket says 172.21.15.142:34214) 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.078+0000 7f02c1f9b700 1 -- 172.21.15.142:0/1687775419 learned_addr learned my addr 172.21.15.142:0/1687775419 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c179a700 1 --2- 172.21.15.142:0/1687775419 >> v2:172.21.15.148:3300/0 conn(0x7f02bc0ca5e0 0x7f02bc0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c279c700 1 -- 172.21.15.142:0/1687775419 >> v2:172.21.15.148:3300/0 conn(0x7f02bc0ca5e0 msgr2=0x7f02bc0686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c279c700 1 --2- 172.21.15.142:0/1687775419 >> v2:172.21.15.148:3300/0 conn(0x7f02bc0ca5e0 0x7f02bc0686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c0f99700 1 -- 172.21.15.142:0/1687775419 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998409865 0 0) 0x7f02bc068230 con 0x7f02bc159a10 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c279c700 1 -- 172.21.15.142:0/1687775419 >> v1:172.21.15.142:6789/0 conn(0x7f02bc159a10 legacy=0x7f02bc0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c279c700 1 -- 172.21.15.142:0/1687775419 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc067be0 con 0x7f02bc159de0 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c179a700 1 --2- 172.21.15.142:0/1687775419 >> v2:172.21.15.148:3300/0 conn(0x7f02bc0ca5e0 0x7f02bc0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c279c700 1 --2- 172.21.15.142:0/1687775419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc068c00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f02bc06f7a0 tx=0x7f02b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123e35d49b87a14a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c0f99700 1 -- 172.21.15.142:0/1687775419 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b400e070 con 0x7f02bc159de0 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c0f99700 1 -- 172.21.15.142:0/1687775419 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b400bc30 con 0x7f02bc159de0 2023-09-30T23:00:01.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.079+0000 7f02c0f99700 1 -- 172.21.15.142:0/1687775419 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4012430 con 0x7f02bc159de0 2023-09-30T23:00:01.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 -- 172.21.15.142:0/1687775419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 msgr2=0x7f02bc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 --2- 172.21.15.142:0/1687775419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc068c00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f02bc06f7a0 tx=0x7f02b4009780 comp rx=0 tx=0).stop 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 -- 172.21.15.142:0/1687775419 shutdown_connections 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 --2- 172.21.15.142:0/1687775419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc068c00 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 --2- 172.21.15.142:0/1687775419 >> v2:172.21.15.148:3300/0 conn(0x7f02bc0ca5e0 0x7f02bc0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 -- 172.21.15.142:0/1687775419 >> 172.21.15.142:0/1687775419 conn(0x7f02bc0cb2f0 msgr2=0x7f02bc0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 -- 172.21.15.142:0/1687775419 shutdown_connections 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.080+0000 7f02c41ff700 1 -- 172.21.15.142:0/1687775419 wait complete. 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.081+0000 7f02c41ff700 1 Processor -- start 2023-09-30T23:00:01.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.082+0000 7f02c41ff700 1 -- start start 2023-09-30T23:00:01.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.082+0000 7f02c41ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc0ca5e0 0x7f02bc1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.082+0000 7f02c41ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02bc159a10 0x7f02bc15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c41ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c41ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc15b180 con 0x7f02bc159de0 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c41ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0c2bf0 con 0x7f02bc0ca5e0 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c41ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc15abc0 con 0x7f02bc159a10 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc0c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35782/0 (socket says 172.21.15.142:35782) 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 -- 172.21.15.142:0/4067452276 learned_addr learned my addr 172.21.15.142:0/4067452276 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:01.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c1f9b700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc0ca5e0 0x7f02bc1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c179a700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02bc159a10 0x7f02bc15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 -- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02bc159a10 msgr2=0x7f02bc15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02bc159a10 0x7f02bc15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 -- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc0ca5e0 msgr2=0x7f02bc1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc0ca5e0 0x7f02bc1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c279c700 1 -- 172.21.15.142:0/4067452276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4009a20 con 0x7f02bc159de0 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.083+0000 7f02c179a700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02bc159a10 0x7f02bc15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.084+0000 7f02c279c700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc0c3080 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f02bc06f980 tx=0x7f02b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.084+0000 7f02b1ffb700 1 -- 172.21.15.142:0/4067452276 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40032f0 con 0x7f02bc159de0 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.084+0000 7f02b1ffb700 1 -- 172.21.15.142:0/4067452276 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4027470 con 0x7f02bc159de0 2023-09-30T23:00:01.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.084+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc15aea0 con 0x7f02bc159de0 2023-09-30T23:00:01.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.084+0000 7f02b1ffb700 1 -- 172.21.15.142:0/4067452276 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4027810 con 0x7f02bc159de0 2023-09-30T23:00:01.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.084+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc0c4ef0 con 0x7f02bc159de0 2023-09-30T23:00:01.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.085+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc0c50e0 con 0x7f02bc159de0 2023-09-30T23:00:01.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.086+0000 7f02b1ffb700 1 -- 172.21.15.142:0/4067452276 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f02b4024070 con 0x7f02bc159de0 2023-09-30T23:00:01.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.087+0000 7f02b1ffb700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02a0067330 0x7f02a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.087+0000 7f02b1ffb700 1 -- 172.21.15.142:0/4067452276 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f02b4086fd0 con 0x7f02bc159de0 2023-09-30T23:00:01.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.087+0000 7f02c1f9b700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02a0067330 0x7f02a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.087+0000 7f02c1f9b700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02a0067330 0x7f02a00697e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f02b8007fd0 tx=0x7f02b8007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:01.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.091+0000 7f02b1ffb700 1 -- 172.21.15.142:0/4067452276 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f02bc0c50e0 con 0x7f02bc159de0 2023-09-30T23:00:01.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.281+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f02bc0c50e0 con 0x7f02bc159de0 2023-09-30T23:00:01.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.712+0000 7f02b1ffb700 1 -- 172.21.15.142:0/4067452276 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v156) v1 ==== 138+0+0 (secure 0 0 0) 0x7f02bc0c50e0 con 0x7f02bc159de0 2023-09-30T23:00:01.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02a0067330 msgr2=0x7f02a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02a0067330 0x7f02a00697e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f02b8007fd0 tx=0x7f02b8007d30 comp rx=0 tx=0).stop 2023-09-30T23:00:01.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 msgr2=0x7f02bc0c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc0c3080 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f02bc06f980 tx=0x7f02b4019000 comp rx=0 tx=0).stop 2023-09-30T23:00:01.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 shutdown_connections 2023-09-30T23:00:01.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f02a0067330 0x7f02a00697e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02bc159de0 0x7f02bc0c3080 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc0ca5e0 0x7f02bc1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 --2- 172.21.15.142:0/4067452276 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f02bc159a10 0x7f02bc15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 >> 172.21.15.142:0/4067452276 conn(0x7f02bc0cb2f0 msgr2=0x7f02bc1511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:01.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 shutdown_connections 2023-09-30T23:00:01.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.715+0000 7f02c41ff700 1 -- 172.21.15.142:0/4067452276 wait complete. 2023-09-30T23:00:01.716 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T23:00:01.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T23:00:01.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.929+0000 7f2decbff700 1 Processor -- start 2023-09-30T23:00:01.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.929+0000 7f2decbff700 1 -- start start 2023-09-30T23:00:01.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.930+0000 7f2decbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2de8141150 0x7f2de81580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.930+0000 7f2decbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2de80c6270 0x7f2de815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.930+0000 7f2decbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de80c40e0 0x7f2de80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.930+0000 7f2decbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80c4a60 con 0x7f2de80c6270 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.930+0000 7f2decbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80c38d0 con 0x7f2de8141150 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.930+0000 7f2decbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80c6aa0 con 0x7f2de80c40e0 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2de80c6270 0x7f2de815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2de80c6270 0x7f2de815c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35794/0 (socket says 172.21.15.142:35794) 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 -- 172.21.15.142:0/1968422 learned_addr learned my addr 172.21.15.142:0/1968422 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de6d9d700 1 --2- 172.21.15.142:0/1968422 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de80c40e0 0x7f2de80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de659c700 1 --2- 172.21.15.142:0/1968422 >> v2:172.21.15.148:3300/0 conn(0x7f2de8141150 0x7f2de81580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 -- 172.21.15.142:0/1968422 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de80c40e0 msgr2=0x7f2de80c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 --2- 172.21.15.142:0/1968422 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de80c40e0 0x7f2de80c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 -- 172.21.15.142:0/1968422 >> v2:172.21.15.148:3300/0 conn(0x7f2de8141150 msgr2=0x7f2de81580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 --2- 172.21.15.142:0/1968422 >> v2:172.21.15.148:3300/0 conn(0x7f2de8141150 0x7f2de81580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 -- 172.21.15.142:0/1968422 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de806a040 con 0x7f2de80c6270 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.931+0000 7f2de5d9b700 1 --2- 172.21.15.142:0/1968422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c6270 0x7f2de815c0d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2de806c230 tx=0x7f2ddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b38797724a7abc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2de559a700 1 -- 172.21.15.142:0/1968422 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00b640 con 0x7f2de80c6270 2023-09-30T23:00:01.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2de559a700 1 -- 172.21.15.142:0/1968422 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00b7a0 con 0x7f2de80c6270 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2de559a700 1 -- 172.21.15.142:0/1968422 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00bb60 con 0x7f2de80c6270 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 -- 172.21.15.142:0/1968422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c6270 msgr2=0x7f2de815c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 --2- 172.21.15.142:0/1968422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c6270 0x7f2de815c0d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2de806c230 tx=0x7f2ddc009250 comp rx=0 tx=0).stop 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 -- 172.21.15.142:0/1968422 shutdown_connections 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 --2- 172.21.15.142:0/1968422 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de80c40e0 0x7f2de80c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 --2- 172.21.15.142:0/1968422 >> v2:172.21.15.148:3300/0 conn(0x7f2de8141150 0x7f2de81580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 --2- 172.21.15.142:0/1968422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c6270 0x7f2de815c0d0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 -- 172.21.15.142:0/1968422 >> 172.21.15.142:0/1968422 conn(0x7f2de80cc670 msgr2=0x7f2de80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 -- 172.21.15.142:0/1968422 shutdown_connections 2023-09-30T23:00:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.932+0000 7f2decbff700 1 -- 172.21.15.142:0/1968422 wait complete. 2023-09-30T23:00:01.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.934+0000 7f2decbff700 1 Processor -- start 2023-09-30T23:00:01.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.934+0000 7f2decbff700 1 -- start start 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2decbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c40e0 0x7f2de813acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2decbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de80c6270 0x7f2de813dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2decbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de8141150 0x7f2de813bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2decbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de813ef70 con 0x7f2de80c40e0 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2decbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de813b200 con 0x7f2de80c6270 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2decbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de813e3f0 con 0x7f2de8141150 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2de659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c40e0 0x7f2de813acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2de659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c40e0 0x7f2de813acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35806/0 (socket says 172.21.15.142:35806) 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2de659c700 1 -- 172.21.15.142:0/1349296514 learned_addr learned my addr 172.21.15.142:0/1349296514 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2de5d9b700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de80c6270 0x7f2de813dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.935+0000 7f2de6d9d700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de8141150 0x7f2de813bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2de659c700 1 -- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de8141150 msgr2=0x7f2de813bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2de659c700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de8141150 0x7f2de813bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2de659c700 1 -- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de80c6270 msgr2=0x7f2de813dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2de659c700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de80c6270 0x7f2de813dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2de659c700 1 -- 172.21.15.142:0/1349296514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc0094f0 con 0x7f2de80c40e0 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2de659c700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c40e0 0x7f2de813acc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800e930 tx=0x7f2dd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2dd67fc700 1 -- 172.21.15.142:0/1349296514 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8013680 con 0x7f2de80c40e0 2023-09-30T23:00:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2dd67fc700 1 -- 172.21.15.142:0/1349296514 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80137e0 con 0x7f2de80c40e0 2023-09-30T23:00:01.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2dd67fc700 1 -- 172.21.15.142:0/1349296514 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8013b80 con 0x7f2de80c40e0 2023-09-30T23:00:01.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de813e6d0 con 0x7f2de80c40e0 2023-09-30T23:00:01.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.936+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de813ec90 con 0x7f2de80c40e0 2023-09-30T23:00:01.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.937+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80ca2e0 con 0x7f2de80c40e0 2023-09-30T23:00:01.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.938+0000 7f2dd67fc700 1 -- 172.21.15.142:0/1349296514 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2dd800c3e0 con 0x7f2de80c40e0 2023-09-30T23:00:01.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.939+0000 7f2dd67fc700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2dc8067330 0x7f2dc80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:01.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.940+0000 7f2dd67fc700 1 -- 172.21.15.142:0/1349296514 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f2dd8084b10 con 0x7f2de80c40e0 2023-09-30T23:00:01.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.940+0000 7f2de5d9b700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2dc8067330 0x7f2dc80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:01.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.940+0000 7f2de5d9b700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2dc8067330 0x7f2dc80697e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2de806c230 tx=0x7f2ddc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:01.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:01.944+0000 7f2dd67fc700 1 -- 172.21.15.142:0/1349296514 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2dd8051b50 con 0x7f2de80c40e0 2023-09-30T23:00:02.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.132+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2de80ca0b0 con 0x7f2de80c40e0 2023-09-30T23:00:02.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.716+0000 7f2dd67fc700 1 -- 172.21.15.142:0/1349296514 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v157) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2dd8055170 con 0x7f2de80c40e0 2023-09-30T23:00:02.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.719+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2dc8067330 msgr2=0x7f2dc80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:02.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.719+0000 7f2decbff700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2dc8067330 0x7f2dc80697e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2de806c230 tx=0x7f2ddc017000 comp rx=0 tx=0).stop 2023-09-30T23:00:02.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.719+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c40e0 msgr2=0x7f2de813acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:02.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.719+0000 7f2decbff700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c40e0 0x7f2de813acc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800e930 tx=0x7f2dd80091a0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.724+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 shutdown_connections 2023-09-30T23:00:02.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.724+0000 7f2decbff700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2dc8067330 0x7f2dc80697e0 secure :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2de806c230 tx=0x7f2ddc017000 comp rx=0 tx=0).stop 2023-09-30T23:00:02.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.724+0000 7f2decbff700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de8141150 0x7f2de813bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.724+0000 7f2decbff700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2de80c40e0 0x7f2de813acc0 secure :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800e930 tx=0x7f2dd80091a0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.724+0000 7f2decbff700 1 --2- 172.21.15.142:0/1349296514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de80c6270 0x7f2de813dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.724+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 >> 172.21.15.142:0/1349296514 conn(0x7f2de80cc670 msgr2=0x7f2de80c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:02.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.726+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 shutdown_connections 2023-09-30T23:00:02.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.728+0000 7f2decbff700 1 -- 172.21.15.142:0/1349296514 wait complete. 2023-09-30T23:00:02.733 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T23:00:02.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T23:00:02.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.945+0000 7fea611ff700 1 Processor -- start 2023-09-30T23:00:02.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.945+0000 7fea611ff700 1 -- start start 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea611ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea5c150600 0x7fea5c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea611ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c1509d0 0x7fea5c06ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea611ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea5c15a920 0x7fea5c156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea611ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c0cc320 con 0x7fea5c150600 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea611ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c1576e0 con 0x7fea5c15a920 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea611ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c15a490 con 0x7fea5c1509d0 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea5ad9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea5c150600 0x7fea5c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:02.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea5ad9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea5c150600 0x7fea5c06a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35818/0 (socket says 172.21.15.142:35818) 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea5ad9d700 1 -- 172.21.15.142:0/149637381 learned_addr learned my addr 172.21.15.142:0/149637381 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea5b59e700 1 --2- 172.21.15.142:0/149637381 >> v2:172.21.15.148:3300/0 conn(0x7fea5c15a920 0x7fea5c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.947+0000 7fea5a59c700 1 --2- 172.21.15.142:0/149637381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c1509d0 0x7fea5c06ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea5ad9d700 1 -- 172.21.15.142:0/149637381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c1509d0 msgr2=0x7fea5c06ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea5ad9d700 1 --2- 172.21.15.142:0/149637381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c1509d0 0x7fea5c06ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea5ad9d700 1 -- 172.21.15.142:0/149637381 >> v2:172.21.15.148:3300/0 conn(0x7fea5c15a920 msgr2=0x7fea5c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea5ad9d700 1 --2- 172.21.15.142:0/149637381 >> v2:172.21.15.148:3300/0 conn(0x7fea5c15a920 0x7fea5c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea5ad9d700 1 -- 172.21.15.142:0/149637381 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c157400 con 0x7fea5c150600 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea5a59c700 1 --2- 172.21.15.142:0/149637381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c1509d0 0x7fea5c06ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea5ad9d700 1 --2- 172.21.15.142:0/149637381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c150600 0x7fea5c06a7a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fea5c06c210 tx=0x7fea4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9573220e1db766e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea59d9b700 1 -- 172.21.15.142:0/149637381 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c009ea0 con 0x7fea5c150600 2023-09-30T23:00:02.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea59d9b700 1 -- 172.21.15.142:0/149637381 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00b820 con 0x7fea5c150600 2023-09-30T23:00:02.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.948+0000 7fea59d9b700 1 -- 172.21.15.142:0/149637381 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00bbc0 con 0x7fea5c150600 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 -- 172.21.15.142:0/149637381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c150600 msgr2=0x7fea5c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 --2- 172.21.15.142:0/149637381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c150600 0x7fea5c06a7a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fea5c06c210 tx=0x7fea4c009250 comp rx=0 tx=0).stop 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 -- 172.21.15.142:0/149637381 shutdown_connections 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 --2- 172.21.15.142:0/149637381 >> v2:172.21.15.148:3300/0 conn(0x7fea5c15a920 0x7fea5c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 --2- 172.21.15.142:0/149637381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c150600 0x7fea5c06a7a0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 --2- 172.21.15.142:0/149637381 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c1509d0 0x7fea5c06ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 -- 172.21.15.142:0/149637381 >> 172.21.15.142:0/149637381 conn(0x7fea5c0cc670 msgr2=0x7fea5c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 -- 172.21.15.142:0/149637381 shutdown_connections 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.949+0000 7fea611ff700 1 -- 172.21.15.142:0/149637381 wait complete. 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.950+0000 7fea611ff700 1 Processor -- start 2023-09-30T23:00:02.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.950+0000 7fea611ff700 1 -- start start 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.951+0000 7fea611ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c150600 0x7fea5c0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.951+0000 7fea611ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c1509d0 0x7fea5c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.951+0000 7fea611ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c15a920 0x7fea5c140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.951+0000 7fea611ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c15bda0 con 0x7fea5c1509d0 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.951+0000 7fea611ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c6150 con 0x7fea5c150600 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.951+0000 7fea611ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c15bac0 con 0x7fea5c15a920 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c1509d0 0x7fea5c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c1509d0 0x7fea5c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35834/0 (socket says 172.21.15.142:35834) 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 -- 172.21.15.142:0/3709392799 learned_addr learned my addr 172.21.15.142:0/3709392799 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5b59e700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c15a920 0x7fea5c140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:02.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5ad9d700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c150600 0x7fea5c0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 -- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c15a920 msgr2=0x7fea5c140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c15a920 0x7fea5c140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 -- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c150600 msgr2=0x7fea5c0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c150600 0x7fea5c0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 -- 172.21.15.142:0/3709392799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0094f0 con 0x7fea5c1509d0 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5b59e700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c15a920 0x7fea5c140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5ad9d700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c150600 0x7fea5c0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea5a59c700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c1509d0 0x7fea5c0c4920 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fea5000e900 tx=0x7fea50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.952+0000 7fea42ffd700 1 -- 172.21.15.142:0/3709392799 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000eea0 con 0x7fea5c1509d0 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.953+0000 7fea42ffd700 1 -- 172.21.15.142:0/3709392799 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000c5e0 con 0x7fea5c1509d0 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.953+0000 7fea42ffd700 1 -- 172.21.15.142:0/3709392799 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000c980 con 0x7fea5c1509d0 2023-09-30T23:00:02.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.953+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c0c5b00 con 0x7fea5c1509d0 2023-09-30T23:00:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.953+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c140580 con 0x7fea5c1509d0 2023-09-30T23:00:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.954+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c0c62e0 con 0x7fea5c1509d0 2023-09-30T23:00:02.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.955+0000 7fea42ffd700 1 -- 172.21.15.142:0/3709392799 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fea5000cd30 con 0x7fea5c1509d0 2023-09-30T23:00:02.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.956+0000 7fea42ffd700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fea48067330 0x7fea480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:02.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.956+0000 7fea42ffd700 1 -- 172.21.15.142:0/3709392799 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fea50084a30 con 0x7fea5c1509d0 2023-09-30T23:00:02.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.956+0000 7fea5ad9d700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fea48067330 0x7fea480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:02.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.957+0000 7fea5ad9d700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fea48067330 0x7fea480697e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fea5c06c210 tx=0x7fea4c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:02.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:02.960+0000 7fea42ffd700 1 -- 172.21.15.142:0/3709392799 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fea500518f0 con 0x7fea5c1509d0 2023-09-30T23:00:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.197+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fea5c06fc10 con 0x7fea5c1509d0 2023-09-30T23:00:03.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.717+0000 7fea42ffd700 1 -- 172.21.15.142:0/3709392799 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v71) v1 ==== 174+0+0 (secure 0 0 0) 0x7fea50054f10 con 0x7fea5c1509d0 2023-09-30T23:00:03.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fea48067330 msgr2=0x7fea480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:03.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fea48067330 0x7fea480697e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fea5c06c210 tx=0x7fea4c017000 comp rx=0 tx=0).stop 2023-09-30T23:00:03.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c1509d0 msgr2=0x7fea5c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c1509d0 0x7fea5c0c4920 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fea5000e900 tx=0x7fea50008040 comp rx=0 tx=0).stop 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 shutdown_connections 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fea48067330 0x7fea480697e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea5c15a920 0x7fea5c140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c150600 0x7fea5c0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 --2- 172.21.15.142:0/3709392799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5c1509d0 0x7fea5c0c4920 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.720+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 >> 172.21.15.142:0/3709392799 conn(0x7fea5c0cc670 msgr2=0x7fea5c1580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.721+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 shutdown_connections 2023-09-30T23:00:03.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.721+0000 7fea611ff700 1 -- 172.21.15.142:0/3709392799 wait complete. 2023-09-30T23:00:03.722 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 19 and data pool 20 2023-09-30T23:00:03.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:00:03.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.942+0000 7fa1bb5ff700 1 Processor -- start 2023-09-30T23:00:03.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.942+0000 7fa1bb5ff700 1 -- start start 2023-09-30T23:00:03.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.943+0000 7fa1bb5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40cee50 0x7fa1b4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:03.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.943+0000 7fa1bb5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b406b8d0 con 0x7fa1b41598e0 2023-09-30T23:00:03.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.943+0000 7fa1bb5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b40cff40 con 0x7fa1b40d03d0 2023-09-30T23:00:03.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.943+0000 7fa1bb5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40cf330 con 0x7fa1b40cee50 2023-09-30T23:00:03.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.943+0000 7fa1b939b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa1b41598e0 0x7fa1b406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34220/0 (socket says 172.21.15.142:34220) 2023-09-30T23:00:03.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.943+0000 7fa1b939b700 1 -- 172.21.15.142:0/3638953541 learned_addr learned my addr 172.21.15.142:0/3638953541 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:03.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.943+0000 7fa1b8b9a700 1 --2- 172.21.15.142:0/3638953541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40cee50 0x7fa1b4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:03.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1abfff700 1 -- 172.21.15.142:0/3638953541 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344686110 0 0) 0x7fa1b406b8d0 con 0x7fa1b41598e0 2023-09-30T23:00:03.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1abfff700 1 -- 172.21.15.142:0/3638953541 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a0003570 con 0x7fa1b41598e0 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1abfff700 1 -- 172.21.15.142:0/3638953541 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74748177 0 0) 0x7fa1b40cff40 con 0x7fa1b40d03d0 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1abfff700 1 -- 172.21.15.142:0/3638953541 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1b406b8d0 con 0x7fa1b40d03d0 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1b8b9a700 1 -- 172.21.15.142:0/3638953541 >> v1:172.21.15.148:6789/0 conn(0x7fa1b40d03d0 legacy=0x7fa1b415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1b8b9a700 1 -- 172.21.15.142:0/3638953541 >> v1:172.21.15.142:6789/0 conn(0x7fa1b41598e0 legacy=0x7fa1b406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1b8b9a700 1 -- 172.21.15.142:0/3638953541 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40cf610 con 0x7fa1b40cee50 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1b8b9a700 1 --2- 172.21.15.142:0/3638953541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40cee50 0x7fa1b4159cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009910 tx=0x7fa1a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=615889a57208e4ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.944+0000 7fa1abfff700 1 -- 172.21.15.142:0/3638953541 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4011630 con 0x7fa1b40cee50 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1abfff700 1 -- 172.21.15.142:0/3638953541 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4011790 con 0x7fa1b40cee50 2023-09-30T23:00:03.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1abfff700 1 -- 172.21.15.142:0/3638953541 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4011b30 con 0x7fa1b40cee50 2023-09-30T23:00:03.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/3638953541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40cee50 msgr2=0x7fa1b4159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:03.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/3638953541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40cee50 0x7fa1b4159cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009910 tx=0x7fa1a40091a0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/3638953541 shutdown_connections 2023-09-30T23:00:03.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/3638953541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40cee50 0x7fa1b4159cb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/3638953541 >> 172.21.15.142:0/3638953541 conn(0x7fa1b40cd540 msgr2=0x7fa1b40cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:03.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/3638953541 shutdown_connections 2023-09-30T23:00:03.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.945+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/3638953541 wait complete. 2023-09-30T23:00:03.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.947+0000 7fa1bb5ff700 1 Processor -- start 2023-09-30T23:00:03.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.947+0000 7fa1bb5ff700 1 -- start start 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1bb5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1b40cee50 0x7fa1b40c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1bb5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40d03d0 0x7fa1b415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1bb5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b41598e0 0x7fa1b40b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1bb5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c3d50 con 0x7fa1b41598e0 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1bb5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b415a400 con 0x7fa1b40cee50 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1bb5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b415a6e0 con 0x7fa1b40d03d0 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b41598e0 0x7fa1b40b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b41598e0 0x7fa1b40b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35836/0 (socket says 172.21.15.142:35836) 2023-09-30T23:00:03.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 -- 172.21.15.142:0/2261345517 learned_addr learned my addr 172.21.15.142:0/2261345517 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b8b9a700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40d03d0 0x7fa1b415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b939b700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1b40cee50 0x7fa1b40c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 -- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40d03d0 msgr2=0x7fa1b415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40d03d0 0x7fa1b415db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 -- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1b40cee50 msgr2=0x7fa1b40c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1b40cee50 0x7fa1b40c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.948+0000 7fa1b9b9c700 1 -- 172.21.15.142:0/2261345517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4009420 con 0x7fa1b41598e0 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.949+0000 7fa1b9b9c700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b41598e0 0x7fa1b40b4d50 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c910 tx=0x7fa1ac0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.949+0000 7fa1a97fa700 1 -- 172.21.15.142:0/2261345517 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac012630 con 0x7fa1b41598e0 2023-09-30T23:00:03.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.949+0000 7fa1a97fa700 1 -- 172.21.15.142:0/2261345517 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac0127b0 con 0x7fa1b41598e0 2023-09-30T23:00:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.949+0000 7fa1a97fa700 1 -- 172.21.15.142:0/2261345517 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac012b70 con 0x7fa1b41598e0 2023-09-30T23:00:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.949+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b415a9c0 con 0x7fa1b41598e0 2023-09-30T23:00:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.949+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b415af80 con 0x7fa1b41598e0 2023-09-30T23:00:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.950+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b40697b0 con 0x7fa1b41598e0 2023-09-30T23:00:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.951+0000 7fa1a97fa700 1 -- 172.21.15.142:0/2261345517 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa1ac01b400 con 0x7fa1b41598e0 2023-09-30T23:00:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.952+0000 7fa1a97fa700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa198067330 0x7fa1980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.952+0000 7fa1a97fa700 1 -- 172.21.15.142:0/2261345517 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa1ac084f10 con 0x7fa1b41598e0 2023-09-30T23:00:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.953+0000 7fa1b939b700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa198067330 0x7fa1980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.953+0000 7fa1b939b700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa198067330 0x7fa1980697e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0007fd0 tx=0x7fa1b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:03.957+0000 7fa1a97fa700 1 -- 172.21.15.142:0/2261345517 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa1ac051e10 con 0x7fa1b41598e0 2023-09-30T23:00:04.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.146+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1b406fc10 con 0x7fa1b41598e0 2023-09-30T23:00:04.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.147+0000 7fa1a97fa700 1 -- 172.21.15.142:0/2261345517 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+17039 (secure 0 0 0) 0x7fa1ac016020 con 0x7fa1b41598e0 2023-09-30T23:00:04.147 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:04.147 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":158,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:00:03.198816+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:00:01.319776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-09-30T23:00:02.170708+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:00:04.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.149+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa198067330 msgr2=0x7fa1980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.149+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa198067330 0x7fa1980697e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0007fd0 tx=0x7fa1b0009040 comp rx=0 tx=0).stop 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.149+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b41598e0 msgr2=0x7fa1b40b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.149+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b41598e0 0x7fa1b40b4d50 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c910 tx=0x7fa1ac0027a0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 shutdown_connections 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa198067330 0x7fa1980697e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1b41598e0 0x7fa1b40b4d50 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1b40cee50 0x7fa1b40c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 --2- 172.21.15.142:0/2261345517 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1b40d03d0 0x7fa1b415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 >> 172.21.15.142:0/2261345517 conn(0x7fa1b40cd540 msgr2=0x7fa1b4158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:04.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 shutdown_connections 2023-09-30T23:00:04.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.150+0000 7fa1bb5ff700 1 -- 172.21.15.142:0/2261345517 wait complete. 2023-09-30T23:00:04.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:00:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.361+0000 7f9bce5ff700 1 Processor -- start 2023-09-30T23:00:04.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.361+0000 7f9bce5ff700 1 -- start start 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.362+0000 7f9bce5ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bc80aebf0 0x7f9bc806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.362+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.362+0000 7f9bce5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc80b0ee0 con 0x7f9bc806f190 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.362+0000 7f9bce5ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc80aefc0 con 0x7f9bc80aebf0 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.362+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80b02d0 con 0x7f9bc815a2a0 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bc80aebf0 0x7f9bc806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bc80aebf0 0x7f9bc806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35850/0 (socket says 172.21.15.142:35850) 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 -- 172.21.15.142:0/3291236506 learned_addr learned my addr 172.21.15.142:0/3291236506 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bccb9c700 1 --2- 172.21.15.142:0/3291236506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 -- 172.21.15.142:0/3291236506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 msgr2=0x7f9bc8069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 --2- 172.21.15.142:0/3291236506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 -- 172.21.15.142:0/3291236506 >> v1:172.21.15.148:6789/0 conn(0x7f9bc806f190 legacy=0x7f9bc8159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 -- 172.21.15.142:0/3291236506 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80b05b0 con 0x7f9bc80aebf0 2023-09-30T23:00:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc7fff700 1 --2- 172.21.15.142:0/3291236506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80aebf0 0x7f9bc806ec50 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80099b0 tx=0x7f9bb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d774b579809d0f1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.363+0000 7f9bc6ffd700 1 -- 172.21.15.142:0/3291236506 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800b860 con 0x7f9bc80aebf0 2023-09-30T23:00:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bc6ffd700 1 -- 172.21.15.142:0/3291236506 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800b9c0 con 0x7f9bc80aebf0 2023-09-30T23:00:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bc6ffd700 1 -- 172.21.15.142:0/3291236506 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800bd60 con 0x7f9bc80aebf0 2023-09-30T23:00:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 -- 172.21.15.142:0/3291236506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80aebf0 msgr2=0x7f9bc806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/3291236506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80aebf0 0x7f9bc806ec50 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80099b0 tx=0x7f9bb8009250 comp rx=0 tx=0).stop 2023-09-30T23:00:04.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 -- 172.21.15.142:0/3291236506 shutdown_connections 2023-09-30T23:00:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/3291236506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/3291236506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80aebf0 0x7f9bc806ec50 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 -- 172.21.15.142:0/3291236506 >> 172.21.15.142:0/3291236506 conn(0x7f9bc80680c0 msgr2=0x7f9bc80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 -- 172.21.15.142:0/3291236506 shutdown_connections 2023-09-30T23:00:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.364+0000 7f9bce5ff700 1 -- 172.21.15.142:0/3291236506 wait complete. 2023-09-30T23:00:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.366+0000 7f9bce5ff700 1 Processor -- start 2023-09-30T23:00:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.366+0000 7f9bce5ff700 1 -- start start 2023-09-30T23:00:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc806f190 0x7f9bc8153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bc80aebf0 0x7f9bc816db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bce5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc8157c40 con 0x7f9bc806f190 2023-09-30T23:00:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc816e060 con 0x7f9bc80aebf0 2023-09-30T23:00:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bce5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc81578f0 con 0x7f9bc815a2a0 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc806f190 0x7f9bc8153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc806f190 0x7f9bc8153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35856/0 (socket says 172.21.15.142:35856) 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 -- 172.21.15.142:0/2677800780 learned_addr learned my addr 172.21.15.142:0/2677800780 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bccb9c700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc77fe700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bc80aebf0 0x7f9bc816db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 -- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 msgr2=0x7f9bc8142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 -- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bc80aebf0 msgr2=0x7f9bc816db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bc80aebf0 0x7f9bc816db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.367+0000 7f9bc7fff700 1 -- 172.21.15.142:0/2677800780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80094f0 con 0x7f9bc806f190 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.368+0000 7f9bc7fff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc806f190 0x7f9bc8153950 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80685b0 tx=0x7f9bb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.368+0000 7f9baffff700 1 -- 172.21.15.142:0/2677800780 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011e40 con 0x7f9bc806f190 2023-09-30T23:00:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.368+0000 7f9baffff700 1 -- 172.21.15.142:0/2677800780 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8024440 con 0x7f9bc806f190 2023-09-30T23:00:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.368+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc816e300 con 0x7f9bc806f190 2023-09-30T23:00:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.368+0000 7f9baffff700 1 -- 172.21.15.142:0/2677800780 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8024800 con 0x7f9bc806f190 2023-09-30T23:00:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.368+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc816e8c0 con 0x7f9bc806f190 2023-09-30T23:00:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.369+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc80695b0 con 0x7f9bc806f190 2023-09-30T23:00:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.370+0000 7f9baffff700 1 -- 172.21.15.142:0/2677800780 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9bb801a420 con 0x7f9bc806f190 2023-09-30T23:00:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.371+0000 7f9baffff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bb4067330 0x7f9bb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.371+0000 7f9baffff700 1 -- 172.21.15.142:0/2677800780 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9bb8086a50 con 0x7f9bc806f190 2023-09-30T23:00:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.371+0000 7f9bc77fe700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bb4067330 0x7f9bb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.371+0000 7f9bc77fe700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bb4067330 0x7f9bb40697e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bc814fcb0 tx=0x7f9bbc007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:04.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.375+0000 7f9baffff700 1 -- 172.21.15.142:0/2677800780 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9bb80538b0 con 0x7f9bc806f190 2023-09-30T23:00:04.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.568+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bc806fc10 con 0x7f9bc806f190 2023-09-30T23:00:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.569+0000 7f9baffff700 1 -- 172.21.15.142:0/2677800780 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f9bb8015020 con 0x7f9bc806f190 2023-09-30T23:00:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:04.569 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":158,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:00:03.198816+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:00:01.319776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-09-30T23:00:02.170708+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:00:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bb4067330 msgr2=0x7f9bb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bb4067330 0x7f9bb40697e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bc814fcb0 tx=0x7f9bbc007ec0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc806f190 msgr2=0x7f9bc8153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc806f190 0x7f9bc8153950 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80685b0 tx=0x7f9bb8017000 comp rx=0 tx=0).stop 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 shutdown_connections 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9bb4067330 0x7f9bb40697e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bc815a2a0 0x7f9bc8142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc806f190 0x7f9bc8153950 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 --2- 172.21.15.142:0/2677800780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bc80aebf0 0x7f9bc816db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 >> 172.21.15.142:0/2677800780 conn(0x7f9bc80680c0 msgr2=0x7f9bc8155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 shutdown_connections 2023-09-30T23:00:04.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.571+0000 7f9bce5ff700 1 -- 172.21.15.142:0/2677800780 wait complete. 2023-09-30T23:00:04.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T23:00:04.699 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-09-30T23:00:04.699+0000 7f328fbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T23:00:04.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.788+0000 7f777e1ff700 1 Processor -- start 2023-09-30T23:00:04.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.789+0000 7f777e1ff700 1 -- start start 2023-09-30T23:00:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f777e1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7778159ba0 0x7f777806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f777e1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77780ca5e0 0x7f77780681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f777e1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7778067d10 con 0x7f77780b0de0 2023-09-30T23:00:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f777e1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777806af90 con 0x7f7778159ba0 2023-09-30T23:00:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f777e1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780676c0 con 0x7f77780ca5e0 2023-09-30T23:00:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f77777fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7778159ba0 0x7f777806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f7776ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f77780b0de0 0x7f77780c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34234/0 (socket says 172.21.15.142:34234) 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f7776ffd700 1 -- 172.21.15.142:0/153304718 learned_addr learned my addr 172.21.15.142:0/153304718 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.790+0000 7f7777fff700 1 --2- 172.21.15.142:0/153304718 >> v2:172.21.15.148:3300/0 conn(0x7f77780ca5e0 0x7f77780681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77767fc700 1 -- 172.21.15.142:0/153304718 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629963897 0 0) 0x7f7778067d10 con 0x7f77780b0de0 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77777fe700 1 -- 172.21.15.142:0/153304718 >> v2:172.21.15.148:3300/0 conn(0x7f77780ca5e0 msgr2=0x7f77780681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77777fe700 1 --2- 172.21.15.142:0/153304718 >> v2:172.21.15.148:3300/0 conn(0x7f77780ca5e0 0x7f77780681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77777fe700 1 -- 172.21.15.142:0/153304718 >> v1:172.21.15.142:6789/0 conn(0x7f77780b0de0 legacy=0x7f77780c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77777fe700 1 -- 172.21.15.142:0/153304718 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77780679a0 con 0x7f7778159ba0 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77777fe700 1 --2- 172.21.15.142:0/153304718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778159ba0 0x7f777806a8d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f77780c5890 tx=0x7f77680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a79d29bfdfedd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77767fc700 1 -- 172.21.15.142:0/153304718 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768011630 con 0x7f7778159ba0 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77767fc700 1 -- 172.21.15.142:0/153304718 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768011790 con 0x7f7778159ba0 2023-09-30T23:00:04.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.791+0000 7f77767fc700 1 -- 172.21.15.142:0/153304718 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768011b30 con 0x7f7778159ba0 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 -- 172.21.15.142:0/153304718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778159ba0 msgr2=0x7f777806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 --2- 172.21.15.142:0/153304718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778159ba0 0x7f777806a8d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f77780c5890 tx=0x7f77680091a0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 -- 172.21.15.142:0/153304718 shutdown_connections 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 --2- 172.21.15.142:0/153304718 >> v2:172.21.15.148:3300/0 conn(0x7f77780ca5e0 0x7f77780681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 --2- 172.21.15.142:0/153304718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778159ba0 0x7f777806a8d0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 -- 172.21.15.142:0/153304718 >> 172.21.15.142:0/153304718 conn(0x7f77780cb2f0 msgr2=0x7f77780cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 -- 172.21.15.142:0/153304718 shutdown_connections 2023-09-30T23:00:04.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.792+0000 7f777e1ff700 1 -- 172.21.15.142:0/153304718 wait complete. 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.793+0000 7f777e1ff700 1 Processor -- start 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.793+0000 7f777e1ff700 1 -- start start 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.794+0000 7f777e1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77780b0de0 0x7f77780c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.794+0000 7f777e1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77780ca5e0 0x7f7778157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.794+0000 7f777e1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7778159ba0 0x7f77780cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.794+0000 7f777e1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780c8b70 con 0x7f77780ca5e0 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.794+0000 7f777e1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777815b970 con 0x7f77780b0de0 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.794+0000 7f777e1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77780c85b0 con 0x7f7778159ba0 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77780ca5e0 0x7f7778157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77780ca5e0 0x7f7778157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35876/0 (socket says 172.21.15.142:35876) 2023-09-30T23:00:04.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 -- 172.21.15.142:0/2850136145 learned_addr learned my addr 172.21.15.142:0/2850136145 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f77777fe700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77780b0de0 0x7f77780c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7777fff700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7778159ba0 0x7f77780cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 -- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7778159ba0 msgr2=0x7f77780cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7778159ba0 0x7f77780cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 -- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77780b0de0 msgr2=0x7f77780c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77780b0de0 0x7f77780c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 -- 172.21.15.142:0/2850136145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768009420 con 0x7f77780ca5e0 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.795+0000 7f7776ffd700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77780ca5e0 0x7f7778157370 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c7e0 tx=0x7f776c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.796+0000 7f775f7fe700 1 -- 172.21.15.142:0/2850136145 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c005b30 con 0x7f77780ca5e0 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.796+0000 7f775f7fe700 1 -- 172.21.15.142:0/2850136145 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c005c90 con 0x7f77780ca5e0 2023-09-30T23:00:04.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.796+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780c8890 con 0x7f77780ca5e0 2023-09-30T23:00:04.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.796+0000 7f775f7fe700 1 -- 172.21.15.142:0/2850136145 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c007300 con 0x7f77780ca5e0 2023-09-30T23:00:04.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.796+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780c5a10 con 0x7f77780ca5e0 2023-09-30T23:00:04.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.797+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77780b4870 con 0x7f77780ca5e0 2023-09-30T23:00:04.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.798+0000 7f775f7fe700 1 -- 172.21.15.142:0/2850136145 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f776c0076b0 con 0x7f77780ca5e0 2023-09-30T23:00:04.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.798+0000 7f775f7fe700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7764067360 0x7f7764069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:04.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.799+0000 7f775f7fe700 1 -- 172.21.15.142:0/2850136145 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f776c084030 con 0x7f77780ca5e0 2023-09-30T23:00:04.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.799+0000 7f77777fe700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7764067360 0x7f7764069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:04.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.799+0000 7f77777fe700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7764067360 0x7f7764069810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f77680093f0 tx=0x7f7768017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:04.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:04.803+0000 7f775f7fe700 1 -- 172.21.15.142:0/2850136145 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f776c050f10 con 0x7f77780ca5e0 2023-09-30T23:00:05.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.037+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f77780cac40 con 0x7f77780ca5e0 2023-09-30T23:00:05.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.756+0000 7f775f7fe700 1 -- 172.21.15.142:0/2850136145 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f776c001d60 con 0x7f77780ca5e0 2023-09-30T23:00:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7764067360 msgr2=0x7f7764069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:05.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7764067360 0x7f7764069810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f77680093f0 tx=0x7f7768017000 comp rx=0 tx=0).stop 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77780ca5e0 msgr2=0x7f7778157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77780ca5e0 0x7f7778157370 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c7e0 tx=0x7f776c007df0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 shutdown_connections 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7764067360 0x7f7764069810 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7778159ba0 0x7f77780cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77780b0de0 0x7f77780c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 --2- 172.21.15.142:0/2850136145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77780ca5e0 0x7f7778157370 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.759+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 >> 172.21.15.142:0/2850136145 conn(0x7f77780cb2f0 msgr2=0x7f7778158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.760+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 shutdown_connections 2023-09-30T23:00:05.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.760+0000 7f777e1ff700 1 -- 172.21.15.142:0/2850136145 wait complete. 2023-09-30T23:00:05.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T23:00:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.974+0000 7f5d343ff700 1 Processor -- start 2023-09-30T23:00:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.974+0000 7f5d343ff700 1 -- start start 2023-09-30T23:00:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.975+0000 7f5d343ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.975+0000 7f5d343ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d2c0cc3b0 0x7f5d2c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d343ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5d2c1573a0 0x7f5d2c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d343ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0cf750 con 0x7f5d2c0cc3b0 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d343ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0d0550 con 0x7f5d2c1573a0 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d343ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c157d60 con 0x7f5d2c0cbfe0 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d2c0cc3b0 0x7f5d2c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d2c0cc3b0 0x7f5d2c0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35886/0 (socket says 172.21.15.142:35886) 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 -- 172.21.15.142:0/2438165067 learned_addr learned my addr 172.21.15.142:0/2438165067 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3219b700 1 --2- 172.21.15.142:0/2438165067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3299c700 1 --2- 172.21.15.142:0/2438165067 >> v2:172.21.15.148:3300/0 conn(0x7f5d2c1573a0 0x7f5d2c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:05.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 -- 172.21.15.142:0/2438165067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 msgr2=0x7f5d2c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 --2- 172.21.15.142:0/2438165067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 -- 172.21.15.142:0/2438165067 >> v2:172.21.15.148:3300/0 conn(0x7f5d2c1573a0 msgr2=0x7f5d2c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 --2- 172.21.15.142:0/2438165067 >> v2:172.21.15.148:3300/0 conn(0x7f5d2c1573a0 0x7f5d2c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3199a700 1 -- 172.21.15.142:0/2438165067 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0cf940 con 0x7f5d2c0cc3b0 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3219b700 1 --2- 172.21.15.142:0/2438165067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.976+0000 7f5d3299c700 1 --2- 172.21.15.142:0/2438165067 >> v2:172.21.15.148:3300/0 conn(0x7f5d2c1573a0 0x7f5d2c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.977+0000 7f5d3199a700 1 --2- 172.21.15.142:0/2438165067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c0cc3b0 0x7f5d2c0cf210 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0099b0 tx=0x7f5d1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d95d8393af64d1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.977+0000 7f5d31199700 1 -- 172.21.15.142:0/2438165067 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00b820 con 0x7f5d2c0cc3b0 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.977+0000 7f5d31199700 1 -- 172.21.15.142:0/2438165067 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c00b980 con 0x7f5d2c0cc3b0 2023-09-30T23:00:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.977+0000 7f5d31199700 1 -- 172.21.15.142:0/2438165067 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00bd20 con 0x7f5d2c0cc3b0 2023-09-30T23:00:05.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.977+0000 7f5d343ff700 1 -- 172.21.15.142:0/2438165067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c0cc3b0 msgr2=0x7f5d2c0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:05.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.977+0000 7f5d343ff700 1 --2- 172.21.15.142:0/2438165067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c0cc3b0 0x7f5d2c0cf210 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0099b0 tx=0x7f5d1c009250 comp rx=0 tx=0).stop 2023-09-30T23:00:05.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.978+0000 7f5d343ff700 1 -- 172.21.15.142:0/2438165067 shutdown_connections 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.978+0000 7f5d343ff700 1 --2- 172.21.15.142:0/2438165067 >> v2:172.21.15.148:3300/0 conn(0x7f5d2c1573a0 0x7f5d2c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.978+0000 7f5d343ff700 1 --2- 172.21.15.142:0/2438165067 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.978+0000 7f5d343ff700 1 --2- 172.21.15.142:0/2438165067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c0cc3b0 0x7f5d2c0cf210 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.978+0000 7f5d343ff700 1 -- 172.21.15.142:0/2438165067 >> 172.21.15.142:0/2438165067 conn(0x7f5d2c0d0a80 msgr2=0x7f5d2c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.978+0000 7f5d343ff700 1 -- 172.21.15.142:0/2438165067 shutdown_connections 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.978+0000 7f5d343ff700 1 -- 172.21.15.142:0/2438165067 wait complete. 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.979+0000 7f5d343ff700 1 Processor -- start 2023-09-30T23:00:05.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.979+0000 7f5d343ff700 1 -- start start 2023-09-30T23:00:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d343ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d343ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d2c0cc3b0 0x7f5d2c1595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d343ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1573a0 0x7f5d2c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d343ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c16e170 con 0x7f5d2c1573a0 2023-09-30T23:00:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d343ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c145940 con 0x7f5d2c0cc3b0 2023-09-30T23:00:05.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d343ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c144d30 con 0x7f5d2c0cbfe0 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d3299c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1573a0 0x7f5d2c159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d3299c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1573a0 0x7f5d2c159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35902/0 (socket says 172.21.15.142:35902) 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.980+0000 7f5d3299c700 1 -- 172.21.15.142:0/1510864775 learned_addr learned my addr 172.21.15.142:0/1510864775 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3219b700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3199a700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d2c0cc3b0 0x7f5d2c1595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3299c700 1 -- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 msgr2=0x7f5d2c143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3299c700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3299c700 1 -- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d2c0cc3b0 msgr2=0x7f5d2c1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3299c700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d2c0cc3b0 0x7f5d2c1595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3299c700 1 -- 172.21.15.142:0/1510864775 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0094f0 con 0x7f5d2c1573a0 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d3299c700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1573a0 0x7f5d2c159b20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f5d24007f30 tx=0x7f5d24009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d227fc700 1 -- 172.21.15.142:0/1510864775 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400dc30 con 0x7f5d2c1573a0 2023-09-30T23:00:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d227fc700 1 -- 172.21.15.142:0/1510864775 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2400f040 con 0x7f5d2c1573a0 2023-09-30T23:00:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d227fc700 1 -- 172.21.15.142:0/1510864775 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24015440 con 0x7f5d2c1573a0 2023-09-30T23:00:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c145010 con 0x7f5d2c1573a0 2023-09-30T23:00:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.981+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c1455d0 con 0x7f5d2c1573a0 2023-09-30T23:00:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.982+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c145ab0 con 0x7f5d2c1573a0 2023-09-30T23:00:05.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.983+0000 7f5d227fc700 1 -- 172.21.15.142:0/1510864775 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5d2401e3b0 con 0x7f5d2c1573a0 2023-09-30T23:00:05.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.984+0000 7f5d227fc700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d10067330 0x7f5d100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:05.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.984+0000 7f5d227fc700 1 -- 172.21.15.142:0/1510864775 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d24084fe0 con 0x7f5d2c1573a0 2023-09-30T23:00:05.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.984+0000 7f5d3219b700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d10067330 0x7f5d100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:05.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.985+0000 7f5d3219b700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d10067330 0x7f5d100697e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5d28006f00 tx=0x7f5d28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:05.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:05.988+0000 7f5d227fc700 1 -- 172.21.15.142:0/1510864775 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5d24051e60 con 0x7f5d2c1573a0 2023-09-30T23:00:06.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.222+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d2c06fc10 con 0x7f5d2c1573a0 2023-09-30T23:00:06.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.759+0000 7f5d227fc700 1 -- 172.21.15.142:0/1510864775 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d2401a0c0 con 0x7f5d2c1573a0 2023-09-30T23:00:06.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d10067330 msgr2=0x7f5d100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:06.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d10067330 0x7f5d100697e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5d28006f00 tx=0x7f5d28008040 comp rx=0 tx=0).stop 2023-09-30T23:00:06.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1573a0 msgr2=0x7f5d2c159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:06.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1573a0 0x7f5d2c159b20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f5d24007f30 tx=0x7f5d24009930 comp rx=0 tx=0).stop 2023-09-30T23:00:06.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 shutdown_connections 2023-09-30T23:00:06.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d10067330 0x7f5d100697e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1573a0 0x7f5d2c159b20 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5d2c0cbfe0 0x7f5d2c143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 --2- 172.21.15.142:0/1510864775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d2c0cc3b0 0x7f5d2c1595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 >> 172.21.15.142:0/1510864775 conn(0x7f5d2c0d0a80 msgr2=0x7f5d2c06b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:06.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 shutdown_connections 2023-09-30T23:00:06.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.762+0000 7f5d343ff700 1 -- 172.21.15.142:0/1510864775 wait complete. 2023-09-30T23:00:06.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:00:06.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.972+0000 7fe1263ff700 1 Processor -- start 2023-09-30T23:00:06.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.972+0000 7fe1263ff700 1 -- start start 2023-09-30T23:00:06.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.973+0000 7fe1263ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1200aebf0 0x7fe12006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe1263ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe12006f190 0x7fe120159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe1263ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1200b0ee0 con 0x7fe12015a0d0 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe1263ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1200aefc0 con 0x7fe1200aebf0 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe1263ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12015a4d0 con 0x7fe12006f190 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1200aebf0 0x7fe12006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1200aebf0 0x7fe12006ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35916/0 (socket says 172.21.15.142:35916) 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11ffff700 1 -- 172.21.15.142:0/456356235 learned_addr learned my addr 172.21.15.142:0/456356235 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11f7fe700 1 --2- 172.21.15.142:0/456356235 >> v2:172.21.15.148:3300/0 conn(0x7fe12006f190 0x7fe120159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11ffff700 1 -- 172.21.15.142:0/456356235 >> v2:172.21.15.148:3300/0 conn(0x7fe12006f190 msgr2=0x7fe120159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:06.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11ffff700 1 --2- 172.21.15.142:0/456356235 >> v2:172.21.15.148:3300/0 conn(0x7fe12006f190 0x7fe120159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11ffff700 1 -- 172.21.15.142:0/456356235 >> v1:172.21.15.148:6789/0 conn(0x7fe12015a0d0 legacy=0x7fe120156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:06.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11ffff700 1 -- 172.21.15.142:0/456356235 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200b02d0 con 0x7fe1200aebf0 2023-09-30T23:00:06.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.974+0000 7fe11f7fe700 1 --2- 172.21.15.142:0/456356235 >> v2:172.21.15.148:3300/0 conn(0x7fe12006f190 0x7fe120159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:00:06.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe11ffff700 1 --2- 172.21.15.142:0/456356235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1200aebf0 0x7fe12006ec50 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe12006ce90 tx=0x7fe110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fd83b937b36909 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:06.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe11effd700 1 -- 172.21.15.142:0/456356235 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000b820 con 0x7fe1200aebf0 2023-09-30T23:00:06.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe11effd700 1 -- 172.21.15.142:0/456356235 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000b980 con 0x7fe1200aebf0 2023-09-30T23:00:06.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe11effd700 1 -- 172.21.15.142:0/456356235 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000bd20 con 0x7fe1200aebf0 2023-09-30T23:00:06.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe1263ff700 1 -- 172.21.15.142:0/456356235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1200aebf0 msgr2=0x7fe12006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:06.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe1263ff700 1 --2- 172.21.15.142:0/456356235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1200aebf0 0x7fe12006ec50 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe12006ce90 tx=0x7fe110009250 comp rx=0 tx=0).stop 2023-09-30T23:00:06.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe1263ff700 1 -- 172.21.15.142:0/456356235 shutdown_connections 2023-09-30T23:00:06.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe1263ff700 1 --2- 172.21.15.142:0/456356235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1200aebf0 0x7fe12006ec50 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe1263ff700 1 --2- 172.21.15.142:0/456356235 >> v2:172.21.15.148:3300/0 conn(0x7fe12006f190 0x7fe120159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.975+0000 7fe1263ff700 1 -- 172.21.15.142:0/456356235 >> 172.21.15.142:0/456356235 conn(0x7fe1200680c0 msgr2=0x7fe1200c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:06.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.976+0000 7fe1263ff700 1 -- 172.21.15.142:0/456356235 shutdown_connections 2023-09-30T23:00:06.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.976+0000 7fe1263ff700 1 -- 172.21.15.142:0/456356235 wait complete. 2023-09-30T23:00:06.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.977+0000 7fe1263ff700 1 Processor -- start 2023-09-30T23:00:06.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.977+0000 7fe1263ff700 1 -- start start 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe1263ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe12006f190 0x7fe1200c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe1263ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1200aebf0 0x7fe12016a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe1263ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe12015a0d0 0x7fe120158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe1263ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1201685b0 con 0x7fe12006f190 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe1263ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200c8610 con 0x7fe1200aebf0 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe1263ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1201679a0 con 0x7fe12015a0d0 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe11ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe12006f190 0x7fe1200c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:06.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe11ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe12006f190 0x7fe1200c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35932/0 (socket says 172.21.15.142:35932) 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.978+0000 7fe11ffff700 1 -- 172.21.15.142:0/916619211 learned_addr learned my addr 172.21.15.142:0/916619211 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe11f7fe700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1200aebf0 0x7fe12016a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe12499c700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe12015a0d0 0x7fe120158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe11ffff700 1 -- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe12015a0d0 msgr2=0x7fe120158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe11ffff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe12015a0d0 0x7fe120158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe11ffff700 1 -- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1200aebf0 msgr2=0x7fe12016a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe11ffff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1200aebf0 0x7fe12016a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe11ffff700 1 -- 172.21.15.142:0/916619211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100094f0 con 0x7fe12006f190 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe11ffff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe12006f190 0x7fe1200c80d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe1100030c0 tx=0x7fe110016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe107fff700 1 -- 172.21.15.142:0/916619211 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110011e60 con 0x7fe12006f190 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe107fff700 1 -- 172.21.15.142:0/916619211 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe110020070 con 0x7fe12006f190 2023-09-30T23:00:06.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe107fff700 1 -- 172.21.15.142:0/916619211 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11001b6a0 con 0x7fe12006f190 2023-09-30T23:00:06.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe120167c80 con 0x7fe12006f190 2023-09-30T23:00:06.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.979+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe120168240 con 0x7fe12006f190 2023-09-30T23:00:06.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.981+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1200695b0 con 0x7fe12006f190 2023-09-30T23:00:06.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.981+0000 7fe107fff700 1 -- 172.21.15.142:0/916619211 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe110022030 con 0x7fe12006f190 2023-09-30T23:00:06.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.982+0000 7fe107fff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe10c067330 0x7fe10c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:06.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.982+0000 7fe107fff700 1 -- 172.21.15.142:0/916619211 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe110086bb0 con 0x7fe12006f190 2023-09-30T23:00:06.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.982+0000 7fe11f7fe700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe10c067330 0x7fe10c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:06.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.983+0000 7fe11f7fe700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe10c067330 0x7fe10c0697e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe11400ac00 tx=0x7fe114006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:06.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:06.987+0000 7fe107fff700 1 -- 172.21.15.142:0/916619211 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe110053ab0 con 0x7fe12006f190 2023-09-30T23:00:07.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.224+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1200695b0 con 0x7fe12006f190 2023-09-30T23:00:07.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.224+0000 7fe107fff700 1 -- 172.21.15.142:0/916619211 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fe1100570d0 con 0x7fe12006f190 2023-09-30T23:00:07.224 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:07.224 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:00:03.199135+0000","modified":"2023-09-30T23:00:06.755986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/3293843450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3293843450},{"type":"v1","addr":"172.21.15.148:6834","nonce":3293843450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-09-30T23:00:07.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe10c067330 msgr2=0x7fe10c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe10c067330 0x7fe10c0697e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe11400ac00 tx=0x7fe114006f90 comp rx=0 tx=0).stop 2023-09-30T23:00:07.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe12006f190 msgr2=0x7fe1200c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe12006f190 0x7fe1200c80d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe1100030c0 tx=0x7fe110016000 comp rx=0 tx=0).stop 2023-09-30T23:00:07.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 shutdown_connections 2023-09-30T23:00:07.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe10c067330 0x7fe10c0697e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe12015a0d0 0x7fe120158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe12006f190 0x7fe1200c80d0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 --2- 172.21.15.142:0/916619211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1200aebf0 0x7fe12016a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 >> 172.21.15.142:0/916619211 conn(0x7fe1200680c0 msgr2=0x7fe1200ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:07.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 shutdown_connections 2023-09-30T23:00:07.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.227+0000 7fe1263ff700 1 -- 172.21.15.142:0/916619211 wait complete. 2023-09-30T23:00:07.228 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 74 2023-09-30T23:00:07.244 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:00:07.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.433+0000 7f5f4b3ff700 1 Processor -- start 2023-09-30T23:00:07.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.433+0000 7f5f4b3ff700 1 -- start start 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.434+0000 7f5f4b3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f440aebf0 0x7f5f4406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.434+0000 7f5f4b3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f4415a2a0 0x7f5f44069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.434+0000 7f5f4b3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f440b0ee0 con 0x7f5f4406f190 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.434+0000 7f5f4b3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440aefc0 con 0x7f5f440aebf0 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.434+0000 7f5f4b3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440b02d0 con 0x7f5f4415a2a0 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f440aebf0 0x7f5f4406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f440aebf0 0x7f5f4406ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35936/0 (socket says 172.21.15.142:35936) 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 -- 172.21.15.142:0/3196941659 learned_addr learned my addr 172.21.15.142:0/3196941659 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:07.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4899a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5f4406f190 0x7f5f44159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34238/0 (socket says 172.21.15.142:34238) 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4999c700 1 --2- 172.21.15.142:0/3196941659 >> v2:172.21.15.148:3300/0 conn(0x7f5f4415a2a0 0x7f5f44069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 -- 172.21.15.142:0/3196941659 >> v2:172.21.15.148:3300/0 conn(0x7f5f4415a2a0 msgr2=0x7f5f44069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 --2- 172.21.15.142:0/3196941659 >> v2:172.21.15.148:3300/0 conn(0x7f5f4415a2a0 0x7f5f44069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 -- 172.21.15.142:0/3196941659 >> v1:172.21.15.142:6789/0 conn(0x7f5f4406f190 legacy=0x7f5f44159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 -- 172.21.15.142:0/3196941659 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440b05b0 con 0x7f5f440aebf0 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4999c700 1 --2- 172.21.15.142:0/3196941659 >> v2:172.21.15.148:3300/0 conn(0x7f5f4415a2a0 0x7f5f44069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f3bfff700 1 -- 172.21.15.142:0/3196941659 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294955424 0 0) 0x7f5f440b0ee0 con 0x7f5f4406f190 2023-09-30T23:00:07.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.435+0000 7f5f4919b700 1 --2- 172.21.15.142:0/3196941659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f440aebf0 0x7f5f4406ec50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406d370 tx=0x7f5f40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4360ca3c01a5973 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f3bfff700 1 -- 172.21.15.142:0/3196941659 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000b860 con 0x7f5f440aebf0 2023-09-30T23:00:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f3bfff700 1 -- 172.21.15.142:0/3196941659 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4000b9c0 con 0x7f5f440aebf0 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f3bfff700 1 -- 172.21.15.142:0/3196941659 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000bd60 con 0x7f5f440aebf0 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/3196941659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f440aebf0 msgr2=0x7f5f4406ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/3196941659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f440aebf0 0x7f5f4406ec50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406d370 tx=0x7f5f40009250 comp rx=0 tx=0).stop 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/3196941659 shutdown_connections 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/3196941659 >> v2:172.21.15.148:3300/0 conn(0x7f5f4415a2a0 0x7f5f44069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/3196941659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f440aebf0 0x7f5f4406ec50 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/3196941659 >> 172.21.15.142:0/3196941659 conn(0x7f5f440680c0 msgr2=0x7f5f440c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/3196941659 shutdown_connections 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.436+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/3196941659 wait complete. 2023-09-30T23:00:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.438+0000 7f5f4b3ff700 1 Processor -- start 2023-09-30T23:00:07.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.438+0000 7f5f4b3ff700 1 -- start start 2023-09-30T23:00:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4b3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f4406f190 0x7f5f441551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4b3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f440aebf0 0x7f5f4415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4b3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f4415a2a0 0x7f5f44141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4b3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4416a310 con 0x7f5f4415a2a0 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4b3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4416a580 con 0x7f5f4406f190 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4b3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44160310 con 0x7f5f440aebf0 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f4415a2a0 0x7f5f44141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f4415a2a0 0x7f5f44141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35940/0 (socket says 172.21.15.142:35940) 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 -- 172.21.15.142:0/2191728440 learned_addr learned my addr 172.21.15.142:0/2191728440 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4919b700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f4406f190 0x7f5f441551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4899a700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f440aebf0 0x7f5f4415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 -- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f440aebf0 msgr2=0x7f5f4415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f440aebf0 0x7f5f4415eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 -- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f4406f190 msgr2=0x7f5f441551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f4406f190 0x7f5f441551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4999c700 1 -- 172.21.15.142:0/2191728440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400094f0 con 0x7f5f4415a2a0 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.439+0000 7f5f4899a700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f440aebf0 0x7f5f4415eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.440+0000 7f5f4999c700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f4415a2a0 0x7f5f44141d30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009fa0 tx=0x7f5f3c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.440+0000 7f5f397fa700 1 -- 172.21.15.142:0/2191728440 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c00dd10 con 0x7f5f4415a2a0 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.440+0000 7f5f397fa700 1 -- 172.21.15.142:0/2191728440 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c00f040 con 0x7f5f4415a2a0 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.440+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4415fa70 con 0x7f5f4415a2a0 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.440+0000 7f5f397fa700 1 -- 172.21.15.142:0/2191728440 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c015650 con 0x7f5f4415a2a0 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.440+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f440c1830 con 0x7f5f4415a2a0 2023-09-30T23:00:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.441+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440b22e0 con 0x7f5f4415a2a0 2023-09-30T23:00:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.442+0000 7f5f397fa700 1 -- 172.21.15.142:0/2191728440 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5f3c015a40 con 0x7f5f4415a2a0 2023-09-30T23:00:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.443+0000 7f5f397fa700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f28067330 0x7f5f280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.443+0000 7f5f397fa700 1 -- 172.21.15.142:0/2191728440 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f3c085440 con 0x7f5f4415a2a0 2023-09-30T23:00:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.443+0000 7f5f4919b700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f28067330 0x7f5f280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.444+0000 7f5f4919b700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f28067330 0x7f5f280697e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406d370 tx=0x7f5f40017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:07.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.447+0000 7f5f397fa700 1 -- 172.21.15.142:0/2191728440 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5f3c0522a0 con 0x7f5f4415a2a0 2023-09-30T23:00:07.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.641+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f4406fc10 con 0x7f5f4415a2a0 2023-09-30T23:00:07.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.642+0000 7f5f397fa700 1 -- 172.21.15.142:0/2191728440 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f5f3c0558c0 con 0x7f5f4415a2a0 2023-09-30T23:00:07.641 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":159,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:00:04.715460+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:00:01.319776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-09-30T23:00:02.170708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:00:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f28067330 msgr2=0x7f5f280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f28067330 0x7f5f280697e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406d370 tx=0x7f5f40017000 comp rx=0 tx=0).stop 2023-09-30T23:00:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f4415a2a0 msgr2=0x7f5f44141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f4415a2a0 0x7f5f44141d30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009fa0 tx=0x7f5f3c0099b0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 shutdown_connections 2023-09-30T23:00:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f28067330 0x7f5f280697e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f4415a2a0 0x7f5f44141d30 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f4406f190 0x7f5f441551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 --2- 172.21.15.142:0/2191728440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f440aebf0 0x7f5f4415eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 >> 172.21.15.142:0/2191728440 conn(0x7f5f440680c0 msgr2=0x7f5f4406b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:07.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 shutdown_connections 2023-09-30T23:00:07.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.644+0000 7f5f4b3ff700 1 -- 172.21.15.142:0/2191728440 wait complete. 2023-09-30T23:00:07.662 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T23:00:07.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:00:07.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.853+0000 7fda42fff700 1 Processor -- start 2023-09-30T23:00:07.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.854+0000 7fda42fff700 1 -- start start 2023-09-30T23:00:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.855+0000 7fda42fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c0aebf0 0x7fda3c06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.855+0000 7fda42fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c0b0ee0 con 0x7fda3c06f190 2023-09-30T23:00:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.855+0000 7fda42fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c0b02d0 con 0x7fda3c15a2a0 2023-09-30T23:00:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.855+0000 7fda42fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c0aefc0 con 0x7fda3c0aebf0 2023-09-30T23:00:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.855+0000 7fda3bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fda3c06f190 0x7fda3c159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34242/0 (socket says 172.21.15.142:34242) 2023-09-30T23:00:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.855+0000 7fda3bfff700 1 -- 172.21.15.142:0/2124773458 learned_addr learned my addr 172.21.15.142:0/2124773458 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:07.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.855+0000 7fda40d9b700 1 --2- 172.21.15.142:0/2124773458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c0aebf0 0x7fda3c06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda3b7fe700 1 -- 172.21.15.142:0/2124773458 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252683170 0 0) 0x7fda3c0b0ee0 con 0x7fda3c06f190 2023-09-30T23:00:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda3b7fe700 1 -- 172.21.15.142:0/2124773458 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda2c003570 con 0x7fda3c06f190 2023-09-30T23:00:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda3b7fe700 1 -- 172.21.15.142:0/2124773458 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072771609 0 0) 0x7fda3c0b02d0 con 0x7fda3c15a2a0 2023-09-30T23:00:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda3b7fe700 1 -- 172.21.15.142:0/2124773458 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda3c0b0ee0 con 0x7fda3c15a2a0 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda40d9b700 1 -- 172.21.15.142:0/2124773458 >> v1:172.21.15.148:6789/0 conn(0x7fda3c15a2a0 legacy=0x7fda3c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda40d9b700 1 -- 172.21.15.142:0/2124773458 >> v1:172.21.15.142:6789/0 conn(0x7fda3c06f190 legacy=0x7fda3c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda40d9b700 1 -- 172.21.15.142:0/2124773458 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c0b05b0 con 0x7fda3c0aebf0 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda40d9b700 1 --2- 172.21.15.142:0/2124773458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c0aebf0 0x7fda3c06ec50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda30009910 tx=0x7fda300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7691e65aef0ee92c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda3b7fe700 1 -- 172.21.15.142:0/2124773458 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30011630 con 0x7fda3c0aebf0 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda3b7fe700 1 -- 172.21.15.142:0/2124773458 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda30011790 con 0x7fda3c0aebf0 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.856+0000 7fda3b7fe700 1 -- 172.21.15.142:0/2124773458 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30011b30 con 0x7fda3c0aebf0 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.857+0000 7fda42fff700 1 -- 172.21.15.142:0/2124773458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c0aebf0 msgr2=0x7fda3c06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.857+0000 7fda42fff700 1 --2- 172.21.15.142:0/2124773458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c0aebf0 0x7fda3c06ec50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda30009910 tx=0x7fda300091a0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.857+0000 7fda42fff700 1 -- 172.21.15.142:0/2124773458 shutdown_connections 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.857+0000 7fda42fff700 1 --2- 172.21.15.142:0/2124773458 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c0aebf0 0x7fda3c06ec50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.857+0000 7fda42fff700 1 -- 172.21.15.142:0/2124773458 >> 172.21.15.142:0/2124773458 conn(0x7fda3c0680c0 msgr2=0x7fda3c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:07.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.857+0000 7fda42fff700 1 -- 172.21.15.142:0/2124773458 shutdown_connections 2023-09-30T23:00:07.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.857+0000 7fda42fff700 1 -- 172.21.15.142:0/2124773458 wait complete. 2023-09-30T23:00:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.858+0000 7fda42fff700 1 Processor -- start 2023-09-30T23:00:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.859+0000 7fda42fff700 1 -- start start 2023-09-30T23:00:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda42fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c06f190 0x7fda3c14de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda42fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda3c0aebf0 0x7fda3c0c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda42fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda3c15a2a0 0x7fda3c167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda42fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c151b60 con 0x7fda3c0aebf0 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda42fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c150f50 con 0x7fda3c15a2a0 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda42fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c151230 con 0x7fda3c06f190 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda3c0aebf0 0x7fda3c0c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda3c0aebf0 0x7fda3c0c1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35956/0 (socket says 172.21.15.142:35956) 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 -- 172.21.15.142:0/121824471 learned_addr learned my addr 172.21.15.142:0/121824471 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda40d9b700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c06f190 0x7fda3c14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda4159c700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda3c15a2a0 0x7fda3c167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 -- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c06f190 msgr2=0x7fda3c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c06f190 0x7fda3c14de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 -- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda3c15a2a0 msgr2=0x7fda3c167ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda3c15a2a0 0x7fda3c167ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 -- 172.21.15.142:0/121824471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30009420 con 0x7fda3c0aebf0 2023-09-30T23:00:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.860+0000 7fda3bfff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda3c0aebf0 0x7fda3c0c1670 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c580 tx=0x7fda28007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.861+0000 7fda38ff9700 1 -- 172.21.15.142:0/121824471 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28005b30 con 0x7fda3c0aebf0 2023-09-30T23:00:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.861+0000 7fda38ff9700 1 -- 172.21.15.142:0/121824471 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28005c90 con 0x7fda3c0aebf0 2023-09-30T23:00:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.861+0000 7fda38ff9700 1 -- 172.21.15.142:0/121824471 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280072e0 con 0x7fda3c0aebf0 2023-09-30T23:00:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.861+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c151510 con 0x7fda3c0aebf0 2023-09-30T23:00:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.861+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c14e380 con 0x7fda3c0aebf0 2023-09-30T23:00:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.862+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3c151d10 con 0x7fda3c0aebf0 2023-09-30T23:00:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.863+0000 7fda38ff9700 1 -- 172.21.15.142:0/121824471 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fda2801b3b0 con 0x7fda3c0aebf0 2023-09-30T23:00:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.864+0000 7fda38ff9700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fda20067330 0x7fda200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.864+0000 7fda38ff9700 1 -- 172.21.15.142:0/121824471 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fda28083f40 con 0x7fda3c0aebf0 2023-09-30T23:00:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.864+0000 7fda40d9b700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fda20067330 0x7fda200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.865+0000 7fda40d9b700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fda20067330 0x7fda200697e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fda30009860 tx=0x7fda30017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:07.868+0000 7fda38ff9700 1 -- 172.21.15.142:0/121824471 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fda2804b570 con 0x7fda3c0aebf0 2023-09-30T23:00:08.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.056+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda3c14e5a0 con 0x7fda20067330 2023-09-30T23:00:08.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.064+0000 7fda38ff9700 1 -- 172.21.15.142:0/121824471 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294592 (secure 0 0 0) 0x7fda3c14e5a0 con 0x7fda20067330 2023-09-30T23:00:08.068 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:08.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fda20067330 msgr2=0x7fda200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fda20067330 0x7fda200697e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fda30009860 tx=0x7fda30017000 comp rx=0 tx=0).stop 2023-09-30T23:00:08.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda3c0aebf0 msgr2=0x7fda3c0c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda3c0aebf0 0x7fda3c0c1670 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c580 tx=0x7fda28007e40 comp rx=0 tx=0).stop 2023-09-30T23:00:08.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 shutdown_connections 2023-09-30T23:00:08.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fda20067330 0x7fda200697e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda3c15a2a0 0x7fda3c167ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda3c06f190 0x7fda3c14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 --2- 172.21.15.142:0/121824471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda3c0aebf0 0x7fda3c0c1670 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 >> 172.21.15.142:0/121824471 conn(0x7fda3c0680c0 msgr2=0x7fda3c155590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:08.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 shutdown_connections 2023-09-30T23:00:08.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.068+0000 7fda42fff700 1 -- 172.21.15.142:0/121824471 wait complete. 2023-09-30T23:00:08.072 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:00:08.085 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2023-09-30T23:00:06.206120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8345,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554154,"statfs":{"total":1600000000,"available":1591454008,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.494500"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.711268+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:44:47.156741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.715017+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:35.471250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.711221+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:23:56.335092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.711126+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:25:14.240932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.711111+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:49.286076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.709584+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:49.286076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.716102+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:29:03.255767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710760+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:33:31.966891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.711814+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:47:35.359443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.711804+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:01:35.650459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.715786+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:58.041615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.716276+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:12:26.252734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.709682+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:38:09.834510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.715619+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:50:55.118311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710331+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:33:12.996416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.714414+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:39:18.608810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.715883+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:04.925543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.709315+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:04:21.325490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710702+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:19.500928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.714432+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:04:21.325490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710868+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:35:07.212527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710374+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:07:15.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.714387+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:30.205791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.709509+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:12:03.051959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710040+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:12:29.908172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.698004+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T22:59:58.698004+0000","last_peered":"2023-09-30T22:59:58.698004+0000","last_clean":"2023-09-30T22:59:58.698004+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T22:59:58.698004+0000","last_undegraded":"2023-09-30T22:59:58.698004+0000","last_fullsized":"2023-09-30T22:59:58.698004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.714948+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:12:29.908172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.735063+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T22:59:58.735063+0000","last_peered":"2023-09-30T22:59:58.735063+0000","last_clean":"2023-09-30T22:59:58.735063+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T22:59:58.735063+0000","last_undegraded":"2023-09-30T22:59:58.735063+0000","last_fullsized":"2023-09-30T22:59:58.735063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.714864+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:38:09.834510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.698004+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T22:59:58.698004+0000","last_peered":"2023-09-30T22:59:58.698004+0000","last_clean":"2023-09-30T22:59:58.698004+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T22:59:58.698004+0000","last_undegraded":"2023-09-30T22:59:58.698004+0000","last_fullsized":"2023-09-30T22:59:58.698004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710707+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:29:50.971907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.734891+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T22:59:58.734891+0000","last_peered":"2023-09-30T22:59:58.734891+0000","last_clean":"2023-09-30T22:59:58.734891+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T22:59:58.734891+0000","last_undegraded":"2023-09-30T22:59:58.734891+0000","last_fullsized":"2023-09-30T22:59:58.734891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":285,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.735020+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T22:59:58.735020+0000","last_peered":"2023-09-30T22:59:58.735020+0000","last_clean":"2023-09-30T22:59:58.735020+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T22:59:58.735020+0000","last_undegraded":"2023-09-30T22:59:58.735020+0000","last_fullsized":"2023-09-30T22:59:58.735020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710759+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:12:03.051959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.734958+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T22:59:58.734958+0000","last_peered":"2023-09-30T22:59:58.734958+0000","last_clean":"2023-09-30T22:59:58.734958+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T22:59:58.734958+0000","last_undegraded":"2023-09-30T22:59:58.734958+0000","last_fullsized":"2023-09-30T22:59:58.734958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.710203+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:41.325773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.734872+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T22:59:58.734872+0000","last_peered":"2023-09-30T22:59:58.734872+0000","last_clean":"2023-09-30T22:59:58.734872+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T22:59:58.734872+0000","last_undegraded":"2023-09-30T22:59:58.734872+0000","last_fullsized":"2023-09-30T22:59:58.734872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.711214+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:15:30.690173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.734740+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T22:59:58.734740+0000","last_peered":"2023-09-30T22:59:58.734740+0000","last_clean":"2023-09-30T22:59:58.734740+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T22:59:58.734740+0000","last_undegraded":"2023-09-30T22:59:58.734740+0000","last_fullsized":"2023-09-30T22:59:58.734740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T23:00:02.707716+0000","last_change":"2023-09-30T23:00:02.707716+0000","last_active":"2023-09-30T23:00:02.707716+0000","last_peered":"2023-09-30T23:00:02.707716+0000","last_clean":"2023-09-30T23:00:02.707716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:02.707716+0000","last_undegraded":"2023-09-30T23:00:02.707716+0000","last_fullsized":"2023-09-30T23:00:02.707716+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T23:00:01.697054+0000","last_change":"2023-09-30T23:00:01.716602+0000","last_active":"2023-09-30T23:00:01.697054+0000","last_peered":"2023-09-30T23:00:01.697054+0000","last_clean":"2023-09-30T23:00:01.697054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T23:00:01.697054+0000","last_undegraded":"2023-09-30T23:00:01.697054+0000","last_fullsized":"2023-09-30T23:00:01.697054+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:42:16.908676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-30T22:59:58.734994+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T22:59:58.734994+0000","last_peered":"2023-09-30T22:59:58.734994+0000","last_clean":"2023-09-30T22:59:58.734994+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T22:59:58.734994+0000","last_undegraded":"2023-09-30T22:59:58.734994+0000","last_fullsized":"2023-09-30T22:59:58.734994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":902,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194410,"statfs":{"total":200000000,"available":199076264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.63600000000000001},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88500000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77500000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.63400000000000001},"min":{"1min":0.42899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70499999999999996,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70199999999999996,"15min":0.67800000000000005},"min":{"1min":0.44,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.72399999999999998},"min":{"1min":0.54900000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98999999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.65300000000000002},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.46100000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.755},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72999999999999998,"15min":0.68700000000000006},"min":{"1min":0.52900000000000003,"5min":0.45200000000000001,"15min":0.434},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":1.056},"last":0.72599999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61899999999999999,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.94199999999999995,"15min":0.95999999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63300000000000001,"15min":0.60399999999999998},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89400000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.135,"15min":1.135},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.46899999999999997,"5min":0.44600000000000001,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.004},"last":0.85899999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.72999999999999998,"15min":0.69799999999999995},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98999999999999999,"5min":1.071,"15min":1.071},"last":0.879}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":896,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194416,"statfs":{"total":200000000,"available":199082422,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.69699999999999995,"15min":0.93500000000000005},"min":{"1min":0.40500000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80000000000000004,"5min":1.823,"15min":6.5190000000000001},"last":0.755},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.748,"15min":0.78800000000000003},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94199999999999995,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":2.6230000000000002,"15min":3.6339999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76500000000000001,"15min":0.96799999999999997},"min":{"1min":0.505,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.073,"5min":5.6749999999999998,"15min":8.4339999999999993},"last":0.62}]},{"osd":2,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.73199999999999998,"15min":0.79200000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":3.2629999999999999,"15min":3.4580000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.97399999999999998},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":1.0429999999999999,"15min":6.5730000000000004},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.92100000000000004},"min":{"1min":0.56299999999999994,"5min":0.49299999999999999,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.59799999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71099999999999997,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.99299999999999999,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.68899999999999995},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97799999999999998,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.66500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.05,"5min":1.321,"15min":1.321},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.71999999999999997},"min":{"1min":0.54100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0289999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.76700000000000002},"min":{"1min":0.59899999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.74299999999999999},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.52100000000000002},"max":{"1min":1.1140000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1472,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193839,"statfs":{"total":200000000,"available":198492054,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.434,"15min":0.40699999999999997},"min":{"1min":0.25700000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.49099999999999999,"5min":1.083,"15min":1.083},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.45700000000000002},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.63300000000000001,"5min":0.745,"15min":0.745},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.32300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52700000000000002,"5min":0.64700000000000002,"15min":0.65300000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.51100000000000001,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32200000000000001},"max":{"1min":0.55200000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56399999999999995,"15min":0.52300000000000002},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.313},"max":{"1min":0.69699999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.505,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54100000000000004,"5min":0.71899999999999997,"15min":0.71999999999999997},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71699999999999997,"15min":0.68799999999999994},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83699999999999997,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.73299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.76200000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73199999999999998,"15min":0.71299999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.84499999999999997,"5min":1.095,"15min":1.22},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.77000000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.749,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":1.127,"15min":1.127},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.48099999999999998},"max":{"1min":0.86099999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78200000000000003,"15min":0.76200000000000001},"min":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.51800000000000002},"max":{"1min":0.93300000000000005,"5min":1.0660000000000001,"15min":1.1240000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.76700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94499999999999995,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":902,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194410,"statfs":{"total":200000000,"available":199076264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42899999999999999,"15min":0.41799999999999998},"min":{"1min":0.29999999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.85699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.316,"5min":0.25,"15min":0.25},"max":{"1min":0.57399999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.38200000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.64500000000000002,"5min":0.75600000000000001,"15min":1.0289999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.51600000000000001},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.79300000000000004,"15min":0.879},"last":0.53400000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60399999999999998,"5min":0.76500000000000001,"15min":1.0029999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72799999999999998,"5min":0.96799999999999997,"15min":0.98899999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.70799999999999996},"min":{"1min":0.55300000000000005,"5min":0.436,"15min":0.436},"max":{"1min":0.94199999999999995,"5min":1.141,"15min":1.27},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72999999999999998},"min":{"1min":0.58399999999999996,"5min":0.48599999999999999,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":1.171,"15min":1.171},"last":0.70999999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.72199999999999998},"min":{"1min":0.56699999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79800000000000004,"15min":0.72999999999999998},"min":{"1min":0.57799999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.90100000000000002,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.61699999999999999}]},{"osd":6,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.73799999999999999},"min":{"1min":0.54600000000000004,"5min":0.47499999999999998,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.85699999999999998,"15min":0.76000000000000001},"min":{"1min":0.59699999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98199999999999998,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.81599999999999995,"15min":0.745},"min":{"1min":0.627,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.89000000000000001,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.81799999999999995,"15min":0.77100000000000002},"min":{"1min":0.54900000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91500000000000004,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.58799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":896,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194416,"statfs":{"total":200000000,"available":199082422,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.435,"15min":0.38600000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"max":{"1min":0.58699999999999997,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.47099999999999997,"15min":0.43099999999999999},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.249},"max":{"1min":0.56200000000000006,"5min":1.542,"15min":1.542},"last":0.503}]},{"osd":1,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.627,"5min":1.494,"15min":1.494},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29599999999999999},"max":{"1min":0.60199999999999998,"5min":0.83999999999999997,"15min":1.0449999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58799999999999997,"5min":1.649,"15min":1.649},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.57499999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.234,"15min":1.234},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.0640000000000001,"5min":1.1000000000000001,"15min":1.4910000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79200000000000004,"15min":0.77800000000000002},"min":{"1min":0.53100000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1.151,"15min":1.179},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94099999999999995,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":0.95999999999999996,"5min":1.05,"15min":1.615},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76100000000000001,"15min":0.73499999999999999},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90400000000000003,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.1200000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.495,"15min":0.439},"max":{"1min":0.89000000000000001,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.63100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":896,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194416,"statfs":{"total":200000000,"available":199082422,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42499999999999999,"15min":0.40300000000000002},"min":{"1min":0.222,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.627,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.46300000000000002,"15min":0.503},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52800000000000002,"5min":1.0700000000000001,"15min":1.919},"last":0.55300000000000005}]},{"osd":1,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52700000000000002,"5min":0.75800000000000001,"15min":1.254},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.49099999999999999,"15min":0.46899999999999997},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56200000000000006,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.495}]},{"osd":2,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.55700000000000005,"5min":0.72399999999999998,"15min":1.6020000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.35499999999999998},"max":{"1min":0.627,"5min":1.2190000000000001,"15min":1.5309999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90200000000000002,"5min":1.242,"15min":1.401},"last":0.627},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.57799999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.1539999999999999,"5min":3.306,"15min":3.306},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.746,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.508},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":1.04,"5min":1.274,"15min":1.4910000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71899999999999997,"15min":0.73199999999999998},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93200000000000005,"5min":1.1870000000000001,"15min":1.5620000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96499999999999997,"5min":1.0960000000000001,"15min":1.3140000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":1.0249999999999999,"5min":1.3440000000000001,"15min":1.3640000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.999,"5min":1.1970000000000001,"15min":1.573},"last":0.72799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":902,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194410,"statfs":{"total":200000000,"available":199076264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66300000000000003,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90600000000000003,"5min":1.022,"15min":1.022},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85599999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.623},"min":{"1min":0.50900000000000001,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":1.492,"15min":1.492},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.68799999999999994},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.97299999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64600000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.66000000000000003},"min":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.45700000000000002},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.69899999999999995},"min":{"1min":0.58199999999999996,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.84099999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63900000000000001,"15min":0.65600000000000003},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.372},"max":{"1min":0.89300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.37},"max":{"1min":0.875,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66600000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.45,"15min":1.45},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.95699999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.48799999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93000000000000005,"5min":1.016,"15min":1.016},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.503,"5min":0.42099999999999999,"15min":0.39100000000000001},"max":{"1min":0.94399999999999995,"5min":1.044,"15min":1.044},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1478,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193833,"statfs":{"total":200000000,"available":198485896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.60599999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67400000000000004,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.008,"15min":1.008},"last":0.72499999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69899999999999995,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0449999999999999},"last":0.748}]},{"osd":2,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68000000000000005,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.27400000000000002},"max":{"1min":0.876,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.044,"15min":1.044},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68100000000000005,"15min":0.64200000000000002},"min":{"1min":0.51400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.0189999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.65600000000000003},"min":{"1min":0.55400000000000005,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.58899999999999997},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":1.081,"15min":1.081},"last":0.77300000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.88400000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69899999999999995,"15min":0.67800000000000005},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":1.03,"15min":1.03},"last":0.78800000000000003}]},{"osd":7,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73299999999999998,"15min":0.71199999999999997},"min":{"1min":0.55200000000000005,"5min":0.48399999999999999,"15min":0.37},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.874},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.749},"min":{"1min":0.58699999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.84199999999999997}]}]}],"pool_statfs":[]}} 2023-09-30T23:00:08.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:00:08.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.315+0000 7f8cb3dff700 1 Processor -- start 2023-09-30T23:00:08.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.315+0000 7f8cb3dff700 1 -- start start 2023-09-30T23:00:08.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb3dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8cac0692f0 0x7f8cac15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb3dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac15dc50 0x7f8cac06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb3dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0cc6b0 con 0x7f8cac143350 2023-09-30T23:00:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb3dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac15e090 con 0x7f8cac0692f0 2023-09-30T23:00:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb3dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0cbaa0 con 0x7f8cac15dc50 2023-09-30T23:00:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb139a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8cac0692f0 0x7f8cac15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb139a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8cac0692f0 0x7f8cac15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35966/0 (socket says 172.21.15.142:35966) 2023-09-30T23:00:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.316+0000 7f8cb139a700 1 -- 172.21.15.142:0/1996446026 learned_addr learned my addr 172.21.15.142:0/1996446026 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.317+0000 7f8cb239c700 1 --2- 172.21.15.142:0/1996446026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac15dc50 0x7f8cac06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.317+0000 7f8cb139a700 1 -- 172.21.15.142:0/1996446026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac15dc50 msgr2=0x7f8cac06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.317+0000 7f8cb139a700 1 --2- 172.21.15.142:0/1996446026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac15dc50 0x7f8cac06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.317+0000 7f8cb139a700 1 -- 172.21.15.142:0/1996446026 >> v1:172.21.15.148:6789/0 conn(0x7f8cac143350 legacy=0x7f8cac0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.317+0000 7f8cb139a700 1 -- 172.21.15.142:0/1996446026 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0cbd80 con 0x7f8cac0692f0 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.317+0000 7f8cb139a700 1 --2- 172.21.15.142:0/1996446026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac0692f0 0x7f8cac15d710 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0099b0 tx=0x7f8c9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d026c64a032d37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.317+0000 7f8cb0b99700 1 -- 172.21.15.142:0/1996446026 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c009ea0 con 0x7f8cac0692f0 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb0b99700 1 -- 172.21.15.142:0/1996446026 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c00b860 con 0x7f8cac0692f0 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb0b99700 1 -- 172.21.15.142:0/1996446026 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00bc00 con 0x7f8cac0692f0 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 -- 172.21.15.142:0/1996446026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac0692f0 msgr2=0x7f8cac15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/1996446026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac0692f0 0x7f8cac15d710 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0099b0 tx=0x7f8c9c009250 comp rx=0 tx=0).stop 2023-09-30T23:00:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 -- 172.21.15.142:0/1996446026 shutdown_connections 2023-09-30T23:00:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/1996446026 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac15dc50 0x7f8cac06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/1996446026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac0692f0 0x7f8cac15d710 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 -- 172.21.15.142:0/1996446026 >> 172.21.15.142:0/1996446026 conn(0x7f8cac0ce8e0 msgr2=0x7f8cac0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 -- 172.21.15.142:0/1996446026 shutdown_connections 2023-09-30T23:00:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.318+0000 7f8cb3dff700 1 -- 172.21.15.142:0/1996446026 wait complete. 2023-09-30T23:00:08.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.320+0000 7f8cb3dff700 1 Processor -- start 2023-09-30T23:00:08.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.320+0000 7f8cb3dff700 1 -- start start 2023-09-30T23:00:08.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb3dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cac0692f0 0x7f8cac0a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb3dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac143350 0x7f8cac0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb3dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac15dc50 0x7f8cac0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb3dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac15b330 con 0x7f8cac15dc50 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb3dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac15b610 con 0x7f8cac0692f0 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb3dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac15b8f0 con 0x7f8cac143350 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac15dc50 0x7f8cac0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac15dc50 0x7f8cac0b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35970/0 (socket says 172.21.15.142:35970) 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 -- 172.21.15.142:0/978785339 learned_addr learned my addr 172.21.15.142:0/978785339 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb1b9b700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cac0692f0 0x7f8cac0a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb139a700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac143350 0x7f8cac0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 -- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac143350 msgr2=0x7f8cac0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac143350 0x7f8cac0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 -- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cac0692f0 msgr2=0x7f8cac0a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cac0692f0 0x7f8cac0a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.321+0000 7f8cb239c700 1 -- 172.21.15.142:0/978785339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0094f0 con 0x7f8cac15dc50 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.322+0000 7f8cb239c700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac15dc50 0x7f8cac0b3e70 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009df0 tx=0x7f8ca400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.322+0000 7f8ca1ffb700 1 -- 172.21.15.142:0/978785339 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400caa0 con 0x7f8cac15dc50 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.322+0000 7f8ca1ffb700 1 -- 172.21.15.142:0/978785339 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca400f040 con 0x7f8cac15dc50 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.322+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac15bbd0 con 0x7f8cac15dc50 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.322+0000 7f8ca1ffb700 1 -- 172.21.15.142:0/978785339 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400ce70 con 0x7f8cac15dc50 2023-09-30T23:00:08.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.322+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac0a8310 con 0x7f8cac15dc50 2023-09-30T23:00:08.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.323+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac06ea70 con 0x7f8cac15dc50 2023-09-30T23:00:08.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.324+0000 7f8ca1ffb700 1 -- 172.21.15.142:0/978785339 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ca4014690 con 0x7f8cac15dc50 2023-09-30T23:00:08.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.325+0000 7f8ca1ffb700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c90067330 0x7f8c900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.325+0000 7f8ca1ffb700 1 -- 172.21.15.142:0/978785339 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ca4085810 con 0x7f8cac15dc50 2023-09-30T23:00:08.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.325+0000 7f8cb1b9b700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c90067330 0x7f8c900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.326+0000 7f8cb1b9b700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c90067330 0x7f8c900697e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0ce720 tx=0x7f8ca8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:08.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.329+0000 7f8ca1ffb700 1 -- 172.21.15.142:0/978785339 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ca4056100 con 0x7f8cac15dc50 2023-09-30T23:00:08.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.514+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cac15c330 con 0x7f8c90067330 2023-09-30T23:00:08.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.523+0000 7f8ca1ffb700 1 -- 172.21.15.142:0/978785339 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303688 (secure 0 0 0) 0x7f8ca800f650 con 0x7f8c90067330 2023-09-30T23:00:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c90067330 msgr2=0x7f8c900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c90067330 0x7f8c900697e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0ce720 tx=0x7f8ca8009040 comp rx=0 tx=0).stop 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac15dc50 msgr2=0x7f8cac0b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac15dc50 0x7f8cac0b3e70 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009df0 tx=0x7f8ca400b040 comp rx=0 tx=0).stop 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 shutdown_connections 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c90067330 0x7f8c900697e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cac15dc50 0x7f8cac0b3e70 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cac0692f0 0x7f8cac0a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 --2- 172.21.15.142:0/978785339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cac143350 0x7f8cac0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.527+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 >> 172.21.15.142:0/978785339 conn(0x7f8cac0ce8e0 msgr2=0x7f8cac063330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:08.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.528+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 shutdown_connections 2023-09-30T23:00:08.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.528+0000 7f8cb3dff700 1 -- 172.21.15.142:0/978785339 wait complete. 2023-09-30T23:00:08.530 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:00:08.545 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2023-09-30T23:00:08.206425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553966,"statfs":{"total":1600000000,"available":1591261844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001005"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733929+0000","last_change":"2023-09-30T23:00:03.733870+0000","last_active":"2023-09-30T23:00:03.733929+0000","last_peered":"2023-09-30T23:00:03.733929+0000","last_clean":"2023-09-30T23:00:03.733929+0000","last_became_active":"2023-09-30T23:00:03.733314+0000","last_became_peered":"2023-09-30T23:00:03.733314+0000","last_unstale":"2023-09-30T23:00:03.733929+0000","last_undegraded":"2023-09-30T23:00:03.733929+0000","last_fullsized":"2023-09-30T23:00:03.733929+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:35.306344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.734264+0000","last_change":"2023-09-30T23:00:03.733960+0000","last_active":"2023-09-30T23:00:03.734264+0000","last_peered":"2023-09-30T23:00:03.734264+0000","last_clean":"2023-09-30T23:00:03.734264+0000","last_became_active":"2023-09-30T23:00:03.733758+0000","last_became_peered":"2023-09-30T23:00:03.733758+0000","last_unstale":"2023-09-30T23:00:03.734264+0000","last_undegraded":"2023-09-30T23:00:03.734264+0000","last_fullsized":"2023-09-30T23:00:03.734264+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:51.283793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744972+0000","last_change":"2023-09-30T23:00:03.744680+0000","last_active":"2023-09-30T23:00:03.744972+0000","last_peered":"2023-09-30T23:00:03.744972+0000","last_clean":"2023-09-30T23:00:03.744972+0000","last_became_active":"2023-09-30T23:00:03.743293+0000","last_became_peered":"2023-09-30T23:00:03.743293+0000","last_unstale":"2023-09-30T23:00:03.744972+0000","last_undegraded":"2023-09-30T23:00:03.744972+0000","last_fullsized":"2023-09-30T23:00:03.744972+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:18.863284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.734839+0000","last_change":"2023-09-30T23:00:03.734588+0000","last_active":"2023-09-30T23:00:03.734839+0000","last_peered":"2023-09-30T23:00:03.734839+0000","last_clean":"2023-09-30T23:00:03.734839+0000","last_became_active":"2023-09-30T23:00:03.734352+0000","last_became_peered":"2023-09-30T23:00:03.734352+0000","last_unstale":"2023-09-30T23:00:03.734839+0000","last_undegraded":"2023-09-30T23:00:03.734839+0000","last_fullsized":"2023-09-30T23:00:03.734839+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:56:14.839482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.730621+0000","last_change":"2023-09-30T23:00:03.730289+0000","last_active":"2023-09-30T23:00:03.730621+0000","last_peered":"2023-09-30T23:00:03.730621+0000","last_clean":"2023-09-30T23:00:03.730621+0000","last_became_active":"2023-09-30T23:00:03.730009+0000","last_became_peered":"2023-09-30T23:00:03.730009+0000","last_unstale":"2023-09-30T23:00:03.730621+0000","last_undegraded":"2023-09-30T23:00:03.730621+0000","last_fullsized":"2023-09-30T23:00:03.730621+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:59:59.052277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.742282+0000","last_change":"2023-09-30T23:00:03.742165+0000","last_active":"2023-09-30T23:00:03.742282+0000","last_peered":"2023-09-30T23:00:03.742282+0000","last_clean":"2023-09-30T23:00:03.742282+0000","last_became_active":"2023-09-30T23:00:03.741920+0000","last_became_peered":"2023-09-30T23:00:03.741920+0000","last_unstale":"2023-09-30T23:00:03.742282+0000","last_undegraded":"2023-09-30T23:00:03.742282+0000","last_fullsized":"2023-09-30T23:00:03.742282+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:13.709139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.741678+0000","last_change":"2023-09-30T23:00:03.741616+0000","last_active":"2023-09-30T23:00:03.741678+0000","last_peered":"2023-09-30T23:00:03.741678+0000","last_clean":"2023-09-30T23:00:03.741678+0000","last_became_active":"2023-09-30T23:00:03.741413+0000","last_became_peered":"2023-09-30T23:00:03.741413+0000","last_unstale":"2023-09-30T23:00:03.741678+0000","last_undegraded":"2023-09-30T23:00:03.741678+0000","last_fullsized":"2023-09-30T23:00:03.741678+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:30:33.089702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.745006+0000","last_change":"2023-09-30T23:00:03.744829+0000","last_active":"2023-09-30T23:00:03.745006+0000","last_peered":"2023-09-30T23:00:03.745006+0000","last_clean":"2023-09-30T23:00:03.745006+0000","last_became_active":"2023-09-30T23:00:03.744270+0000","last_became_peered":"2023-09-30T23:00:03.744270+0000","last_unstale":"2023-09-30T23:00:03.745006+0000","last_undegraded":"2023-09-30T23:00:03.745006+0000","last_fullsized":"2023-09-30T23:00:03.745006+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:46.178462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.727594+0000","last_change":"2023-09-30T23:00:03.727470+0000","last_active":"2023-09-30T23:00:03.727594+0000","last_peered":"2023-09-30T23:00:03.727594+0000","last_clean":"2023-09-30T23:00:03.727594+0000","last_became_active":"2023-09-30T23:00:03.727067+0000","last_became_peered":"2023-09-30T23:00:03.727067+0000","last_unstale":"2023-09-30T23:00:03.727594+0000","last_undegraded":"2023-09-30T23:00:03.727594+0000","last_fullsized":"2023-09-30T23:00:03.727594+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:57.294837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.728619+0000","last_change":"2023-09-30T23:00:03.728303+0000","last_active":"2023-09-30T23:00:03.728619+0000","last_peered":"2023-09-30T23:00:03.728619+0000","last_clean":"2023-09-30T23:00:03.728619+0000","last_became_active":"2023-09-30T23:00:03.728067+0000","last_became_peered":"2023-09-30T23:00:03.728067+0000","last_unstale":"2023-09-30T23:00:03.728619+0000","last_undegraded":"2023-09-30T23:00:03.728619+0000","last_fullsized":"2023-09-30T23:00:03.728619+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:36:58.767481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.741925+0000","last_change":"2023-09-30T23:00:03.739841+0000","last_active":"2023-09-30T23:00:03.741925+0000","last_peered":"2023-09-30T23:00:03.741925+0000","last_clean":"2023-09-30T23:00:03.741925+0000","last_became_active":"2023-09-30T23:00:03.739601+0000","last_became_peered":"2023-09-30T23:00:03.739601+0000","last_unstale":"2023-09-30T23:00:03.741925+0000","last_undegraded":"2023-09-30T23:00:03.741925+0000","last_fullsized":"2023-09-30T23:00:03.741925+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:38:10.845172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.735424+0000","last_change":"2023-09-30T23:00:03.735341+0000","last_active":"2023-09-30T23:00:03.735424+0000","last_peered":"2023-09-30T23:00:03.735424+0000","last_clean":"2023-09-30T23:00:03.735424+0000","last_became_active":"2023-09-30T23:00:03.735104+0000","last_became_peered":"2023-09-30T23:00:03.735104+0000","last_unstale":"2023-09-30T23:00:03.735424+0000","last_undegraded":"2023-09-30T23:00:03.735424+0000","last_fullsized":"2023-09-30T23:00:03.735424+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:46:31.638149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.731128+0000","last_change":"2023-09-30T23:00:03.731051+0000","last_active":"2023-09-30T23:00:03.731128+0000","last_peered":"2023-09-30T23:00:03.731128+0000","last_clean":"2023-09-30T23:00:03.731128+0000","last_became_active":"2023-09-30T23:00:03.730816+0000","last_became_peered":"2023-09-30T23:00:03.730816+0000","last_unstale":"2023-09-30T23:00:03.731128+0000","last_undegraded":"2023-09-30T23:00:03.731128+0000","last_fullsized":"2023-09-30T23:00:03.731128+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:30.363530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.741260+0000","last_change":"2023-09-30T23:00:03.741165+0000","last_active":"2023-09-30T23:00:03.741260+0000","last_peered":"2023-09-30T23:00:03.741260+0000","last_clean":"2023-09-30T23:00:03.741260+0000","last_became_active":"2023-09-30T23:00:03.740942+0000","last_became_peered":"2023-09-30T23:00:03.740942+0000","last_unstale":"2023-09-30T23:00:03.741260+0000","last_undegraded":"2023-09-30T23:00:03.741260+0000","last_fullsized":"2023-09-30T23:00:03.741260+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:16.360645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.729645+0000","last_change":"2023-09-30T23:00:03.729560+0000","last_active":"2023-09-30T23:00:03.729645+0000","last_peered":"2023-09-30T23:00:03.729645+0000","last_clean":"2023-09-30T23:00:03.729645+0000","last_became_active":"2023-09-30T23:00:03.729239+0000","last_became_peered":"2023-09-30T23:00:03.729239+0000","last_unstale":"2023-09-30T23:00:03.729645+0000","last_undegraded":"2023-09-30T23:00:03.729645+0000","last_fullsized":"2023-09-30T23:00:03.729645+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:30:33.089702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733893+0000","last_change":"2023-09-30T23:00:03.733732+0000","last_active":"2023-09-30T23:00:03.733893+0000","last_peered":"2023-09-30T23:00:03.733893+0000","last_clean":"2023-09-30T23:00:03.733893+0000","last_became_active":"2023-09-30T23:00:03.732988+0000","last_became_peered":"2023-09-30T23:00:03.732988+0000","last_unstale":"2023-09-30T23:00:03.733893+0000","last_undegraded":"2023-09-30T23:00:03.733893+0000","last_fullsized":"2023-09-30T23:00:03.733893+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:46.080735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733036+0000","last_change":"2023-09-30T23:00:03.732918+0000","last_active":"2023-09-30T23:00:03.733036+0000","last_peered":"2023-09-30T23:00:03.733036+0000","last_clean":"2023-09-30T23:00:03.733036+0000","last_became_active":"2023-09-30T23:00:03.732445+0000","last_became_peered":"2023-09-30T23:00:03.732445+0000","last_unstale":"2023-09-30T23:00:03.733036+0000","last_undegraded":"2023-09-30T23:00:03.733036+0000","last_fullsized":"2023-09-30T23:00:03.733036+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:12:30.918834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.740462+0000","last_change":"2023-09-30T23:00:03.740381+0000","last_active":"2023-09-30T23:00:03.740462+0000","last_peered":"2023-09-30T23:00:03.740462+0000","last_clean":"2023-09-30T23:00:03.740462+0000","last_became_active":"2023-09-30T23:00:03.740012+0000","last_became_peered":"2023-09-30T23:00:03.740012+0000","last_unstale":"2023-09-30T23:00:03.740462+0000","last_undegraded":"2023-09-30T23:00:03.740462+0000","last_fullsized":"2023-09-30T23:00:03.740462+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:31:50.330411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.747952+0000","last_change":"2023-09-30T23:00:03.747707+0000","last_active":"2023-09-30T23:00:03.747952+0000","last_peered":"2023-09-30T23:00:03.747952+0000","last_clean":"2023-09-30T23:00:03.747952+0000","last_became_active":"2023-09-30T23:00:03.747477+0000","last_became_peered":"2023-09-30T23:00:03.747477+0000","last_unstale":"2023-09-30T23:00:03.747952+0000","last_undegraded":"2023-09-30T23:00:03.747952+0000","last_fullsized":"2023-09-30T23:00:03.747952+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:29:51.982569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.736057+0000","last_change":"2023-09-30T23:00:03.735959+0000","last_active":"2023-09-30T23:00:03.736057+0000","last_peered":"2023-09-30T23:00:03.736057+0000","last_clean":"2023-09-30T23:00:03.736057+0000","last_became_active":"2023-09-30T23:00:03.735373+0000","last_became_peered":"2023-09-30T23:00:03.735373+0000","last_unstale":"2023-09-30T23:00:03.736057+0000","last_undegraded":"2023-09-30T23:00:03.736057+0000","last_fullsized":"2023-09-30T23:00:03.736057+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:26.225271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.735683+0000","last_change":"2023-09-30T23:00:03.735576+0000","last_active":"2023-09-30T23:00:03.735683+0000","last_peered":"2023-09-30T23:00:03.735683+0000","last_clean":"2023-09-30T23:00:03.735683+0000","last_became_active":"2023-09-30T23:00:03.735176+0000","last_became_peered":"2023-09-30T23:00:03.735176+0000","last_unstale":"2023-09-30T23:00:03.735683+0000","last_undegraded":"2023-09-30T23:00:03.735683+0000","last_fullsized":"2023-09-30T23:00:03.735683+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:56:32.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.730569+0000","last_change":"2023-09-30T23:00:03.730470+0000","last_active":"2023-09-30T23:00:03.730569+0000","last_peered":"2023-09-30T23:00:03.730569+0000","last_clean":"2023-09-30T23:00:03.730569+0000","last_became_active":"2023-09-30T23:00:03.730246+0000","last_became_peered":"2023-09-30T23:00:03.730246+0000","last_unstale":"2023-09-30T23:00:03.730569+0000","last_undegraded":"2023-09-30T23:00:03.730569+0000","last_fullsized":"2023-09-30T23:00:03.730569+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:04:11.835150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.747937+0000","last_change":"2023-09-30T23:00:03.747571+0000","last_active":"2023-09-30T23:00:03.747937+0000","last_peered":"2023-09-30T23:00:03.747937+0000","last_clean":"2023-09-30T23:00:03.747937+0000","last_became_active":"2023-09-30T23:00:03.747195+0000","last_became_peered":"2023-09-30T23:00:03.747195+0000","last_unstale":"2023-09-30T23:00:03.747937+0000","last_undegraded":"2023-09-30T23:00:03.747937+0000","last_fullsized":"2023-09-30T23:00:03.747937+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:31:20.511590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.727537+0000","last_change":"2023-09-30T23:00:03.727304+0000","last_active":"2023-09-30T23:00:03.727537+0000","last_peered":"2023-09-30T23:00:03.727537+0000","last_clean":"2023-09-30T23:00:03.727537+0000","last_became_active":"2023-09-30T23:00:03.726722+0000","last_became_peered":"2023-09-30T23:00:03.726722+0000","last_unstale":"2023-09-30T23:00:03.727537+0000","last_undegraded":"2023-09-30T23:00:03.727537+0000","last_fullsized":"2023-09-30T23:00:03.727537+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:06:28.385476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.745243+0000","last_change":"2023-09-30T23:00:03.745184+0000","last_active":"2023-09-30T23:00:03.745243+0000","last_peered":"2023-09-30T23:00:03.745243+0000","last_clean":"2023-09-30T23:00:03.745243+0000","last_became_active":"2023-09-30T23:00:03.744566+0000","last_became_peered":"2023-09-30T23:00:03.744566+0000","last_unstale":"2023-09-30T23:00:03.745243+0000","last_undegraded":"2023-09-30T23:00:03.745243+0000","last_fullsized":"2023-09-30T23:00:03.745243+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:46:44.233083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744327+0000","last_change":"2023-09-30T23:00:03.744108+0000","last_active":"2023-09-30T23:00:03.744327+0000","last_peered":"2023-09-30T23:00:03.744327+0000","last_clean":"2023-09-30T23:00:03.744327+0000","last_became_active":"2023-09-30T23:00:03.743663+0000","last_became_peered":"2023-09-30T23:00:03.743663+0000","last_unstale":"2023-09-30T23:00:03.744327+0000","last_undegraded":"2023-09-30T23:00:03.744327+0000","last_fullsized":"2023-09-30T23:00:03.744327+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:30:28.374568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.732122+0000","last_change":"2023-09-30T23:00:03.731285+0000","last_active":"2023-09-30T23:00:03.732122+0000","last_peered":"2023-09-30T23:00:03.732122+0000","last_clean":"2023-09-30T23:00:03.732122+0000","last_became_active":"2023-09-30T23:00:03.731064+0000","last_became_peered":"2023-09-30T23:00:03.731064+0000","last_unstale":"2023-09-30T23:00:03.732122+0000","last_undegraded":"2023-09-30T23:00:03.732122+0000","last_fullsized":"2023-09-30T23:00:03.732122+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:56:54.967170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.741217+0000","last_change":"2023-09-30T23:00:03.741133+0000","last_active":"2023-09-30T23:00:03.741217+0000","last_peered":"2023-09-30T23:00:03.741217+0000","last_clean":"2023-09-30T23:00:03.741217+0000","last_became_active":"2023-09-30T23:00:03.740864+0000","last_became_peered":"2023-09-30T23:00:03.740864+0000","last_unstale":"2023-09-30T23:00:03.741217+0000","last_undegraded":"2023-09-30T23:00:03.741217+0000","last_fullsized":"2023-09-30T23:00:03.741217+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:19.122018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.732811+0000","last_change":"2023-09-30T23:00:03.732053+0000","last_active":"2023-09-30T23:00:03.732811+0000","last_peered":"2023-09-30T23:00:03.732811+0000","last_clean":"2023-09-30T23:00:03.732811+0000","last_became_active":"2023-09-30T23:00:03.731806+0000","last_became_peered":"2023-09-30T23:00:03.731806+0000","last_unstale":"2023-09-30T23:00:03.732811+0000","last_undegraded":"2023-09-30T23:00:03.732811+0000","last_fullsized":"2023-09-30T23:00:03.732811+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:13:19.122018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.747883+0000","last_change":"2023-09-30T23:00:03.746215+0000","last_active":"2023-09-30T23:00:03.747883+0000","last_peered":"2023-09-30T23:00:03.747883+0000","last_clean":"2023-09-30T23:00:03.747883+0000","last_became_active":"2023-09-30T23:00:03.745969+0000","last_became_peered":"2023-09-30T23:00:03.745969+0000","last_unstale":"2023-09-30T23:00:03.747883+0000","last_undegraded":"2023-09-30T23:00:03.747883+0000","last_fullsized":"2023-09-30T23:00:03.747883+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:44:32.527357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.738648+0000","last_change":"2023-09-30T23:00:03.738012+0000","last_active":"2023-09-30T23:00:03.738648+0000","last_peered":"2023-09-30T23:00:03.738648+0000","last_clean":"2023-09-30T23:00:03.738648+0000","last_became_active":"2023-09-30T23:00:03.737750+0000","last_became_peered":"2023-09-30T23:00:03.737750+0000","last_unstale":"2023-09-30T23:00:03.738648+0000","last_undegraded":"2023-09-30T23:00:03.738648+0000","last_fullsized":"2023-09-30T23:00:03.738648+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:25:15.251594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733020+0000","last_change":"2023-09-30T23:00:03.732780+0000","last_active":"2023-09-30T23:00:03.733020+0000","last_peered":"2023-09-30T23:00:03.733020+0000","last_clean":"2023-09-30T23:00:03.733020+0000","last_became_active":"2023-09-30T23:00:03.731591+0000","last_became_peered":"2023-09-30T23:00:03.731591+0000","last_unstale":"2023-09-30T23:00:03.733020+0000","last_undegraded":"2023-09-30T23:00:03.733020+0000","last_fullsized":"2023-09-30T23:00:03.733020+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:38:10.845172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.745152+0000","last_change":"2023-09-30T23:00:03.745058+0000","last_active":"2023-09-30T23:00:03.745152+0000","last_peered":"2023-09-30T23:00:03.745152+0000","last_clean":"2023-09-30T23:00:03.745152+0000","last_became_active":"2023-09-30T23:00:03.744271+0000","last_became_peered":"2023-09-30T23:00:03.744271+0000","last_unstale":"2023-09-30T23:00:03.745152+0000","last_undegraded":"2023-09-30T23:00:03.745152+0000","last_fullsized":"2023-09-30T23:00:03.745152+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:54:27.294541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1f","version":"158'4","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.749194+0000","last_change":"2023-09-30T23:00:02.733243+0000","last_active":"2023-09-30T23:00:03.749194+0000","last_peered":"2023-09-30T23:00:03.749194+0000","last_clean":"2023-09-30T23:00:03.749194+0000","last_became_active":"2023-09-30T23:00:02.733024+0000","last_became_peered":"2023-09-30T23:00:02.733024+0000","last_unstale":"2023-09-30T23:00:03.749194+0000","last_undegraded":"2023-09-30T23:00:03.749194+0000","last_fullsized":"2023-09-30T23:00:03.749194+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:56:53.956508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.732144+0000","last_change":"2023-09-30T23:00:03.732014+0000","last_active":"2023-09-30T23:00:03.732144+0000","last_peered":"2023-09-30T23:00:03.732144+0000","last_clean":"2023-09-30T23:00:03.732144+0000","last_became_active":"2023-09-30T23:00:03.731766+0000","last_became_peered":"2023-09-30T23:00:03.731766+0000","last_unstale":"2023-09-30T23:00:03.732144+0000","last_undegraded":"2023-09-30T23:00:03.732144+0000","last_fullsized":"2023-09-30T23:00:03.732144+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:20:42.140501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.1e","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.743588+0000","last_change":"2023-09-30T23:00:02.722932+0000","last_active":"2023-09-30T23:00:03.743588+0000","last_peered":"2023-09-30T23:00:03.743588+0000","last_clean":"2023-09-30T23:00:03.743588+0000","last_became_active":"2023-09-30T23:00:02.722676+0000","last_became_peered":"2023-09-30T23:00:02.722676+0000","last_unstale":"2023-09-30T23:00:03.743588+0000","last_undegraded":"2023-09-30T23:00:03.743588+0000","last_fullsized":"2023-09-30T23:00:03.743588+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:02.939025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.747920+0000","last_change":"2023-09-30T23:00:03.747443+0000","last_active":"2023-09-30T23:00:03.747920+0000","last_peered":"2023-09-30T23:00:03.747920+0000","last_clean":"2023-09-30T23:00:03.747920+0000","last_became_active":"2023-09-30T23:00:03.746925+0000","last_became_peered":"2023-09-30T23:00:03.746925+0000","last_unstale":"2023-09-30T23:00:03.747920+0000","last_undegraded":"2023-09-30T23:00:03.747920+0000","last_fullsized":"2023-09-30T23:00:03.747920+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:03:42.091524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1d","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.737095+0000","last_change":"2023-09-30T23:00:02.726369+0000","last_active":"2023-09-30T23:00:03.737095+0000","last_peered":"2023-09-30T23:00:03.737095+0000","last_clean":"2023-09-30T23:00:03.737095+0000","last_became_active":"2023-09-30T23:00:02.726096+0000","last_became_peered":"2023-09-30T23:00:02.726096+0000","last_unstale":"2023-09-30T23:00:03.737095+0000","last_undegraded":"2023-09-30T23:00:03.737095+0000","last_fullsized":"2023-09-30T23:00:03.737095+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:01:35.650459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733179+0000","last_change":"2023-09-30T23:00:03.732997+0000","last_active":"2023-09-30T23:00:03.733179+0000","last_peered":"2023-09-30T23:00:03.733179+0000","last_clean":"2023-09-30T23:00:03.733179+0000","last_became_active":"2023-09-30T23:00:03.732693+0000","last_became_peered":"2023-09-30T23:00:03.732693+0000","last_unstale":"2023-09-30T23:00:03.733179+0000","last_undegraded":"2023-09-30T23:00:03.733179+0000","last_fullsized":"2023-09-30T23:00:03.733179+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:24.652631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1c","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.748883+0000","last_change":"2023-09-30T23:00:02.730644+0000","last_active":"2023-09-30T23:00:03.748883+0000","last_peered":"2023-09-30T23:00:03.748883+0000","last_clean":"2023-09-30T23:00:03.748883+0000","last_became_active":"2023-09-30T23:00:02.730416+0000","last_became_peered":"2023-09-30T23:00:02.730416+0000","last_unstale":"2023-09-30T23:00:03.748883+0000","last_undegraded":"2023-09-30T23:00:03.748883+0000","last_fullsized":"2023-09-30T23:00:03.748883+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:56.284175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744073+0000","last_change":"2023-09-30T23:00:03.743899+0000","last_active":"2023-09-30T23:00:03.744073+0000","last_peered":"2023-09-30T23:00:03.744073+0000","last_clean":"2023-09-30T23:00:03.744073+0000","last_became_active":"2023-09-30T23:00:03.743118+0000","last_became_peered":"2023-09-30T23:00:03.743118+0000","last_unstale":"2023-09-30T23:00:03.744073+0000","last_undegraded":"2023-09-30T23:00:03.744073+0000","last_fullsized":"2023-09-30T23:00:03.744073+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:21:49.509428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1b","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.741150+0000","last_change":"2023-09-30T23:00:02.726864+0000","last_active":"2023-09-30T23:00:03.741150+0000","last_peered":"2023-09-30T23:00:03.741150+0000","last_clean":"2023-09-30T23:00:03.741150+0000","last_became_active":"2023-09-30T23:00:02.726646+0000","last_became_peered":"2023-09-30T23:00:02.726646+0000","last_unstale":"2023-09-30T23:00:03.741150+0000","last_undegraded":"2023-09-30T23:00:03.741150+0000","last_fullsized":"2023-09-30T23:00:03.741150+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:54.672398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.745034+0000","last_change":"2023-09-30T23:00:03.744938+0000","last_active":"2023-09-30T23:00:03.745034+0000","last_peered":"2023-09-30T23:00:03.745034+0000","last_clean":"2023-09-30T23:00:03.745034+0000","last_became_active":"2023-09-30T23:00:03.743969+0000","last_became_peered":"2023-09-30T23:00:03.743969+0000","last_unstale":"2023-09-30T23:00:03.745034+0000","last_undegraded":"2023-09-30T23:00:03.745034+0000","last_fullsized":"2023-09-30T23:00:03.745034+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:38.784280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1a","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.732800+0000","last_change":"2023-09-30T23:00:02.733055+0000","last_active":"2023-09-30T23:00:03.732800+0000","last_peered":"2023-09-30T23:00:03.732800+0000","last_clean":"2023-09-30T23:00:03.732800+0000","last_became_active":"2023-09-30T23:00:02.732761+0000","last_became_peered":"2023-09-30T23:00:02.732761+0000","last_unstale":"2023-09-30T23:00:03.732800+0000","last_undegraded":"2023-09-30T23:00:03.732800+0000","last_fullsized":"2023-09-30T23:00:03.732800+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:23:56.335092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744601+0000","last_change":"2023-09-30T23:00:03.743925+0000","last_active":"2023-09-30T23:00:03.744601+0000","last_peered":"2023-09-30T23:00:03.744601+0000","last_clean":"2023-09-30T23:00:03.744601+0000","last_became_active":"2023-09-30T23:00:03.743406+0000","last_became_peered":"2023-09-30T23:00:03.743406+0000","last_unstale":"2023-09-30T23:00:03.744601+0000","last_undegraded":"2023-09-30T23:00:03.744601+0000","last_fullsized":"2023-09-30T23:00:03.744601+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:50:56.128973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.725906+0000","last_change":"2023-09-30T23:00:02.731629+0000","last_active":"2023-09-30T23:00:03.725906+0000","last_peered":"2023-09-30T23:00:03.725906+0000","last_clean":"2023-09-30T23:00:03.725906+0000","last_became_active":"2023-09-30T23:00:02.731376+0000","last_became_peered":"2023-09-30T23:00:02.731376+0000","last_unstale":"2023-09-30T23:00:03.725906+0000","last_undegraded":"2023-09-30T23:00:03.725906+0000","last_fullsized":"2023-09-30T23:00:03.725906+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:18.150648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744954+0000","last_change":"2023-09-30T23:00:03.744496+0000","last_active":"2023-09-30T23:00:03.744954+0000","last_peered":"2023-09-30T23:00:03.744954+0000","last_clean":"2023-09-30T23:00:03.744954+0000","last_became_active":"2023-09-30T23:00:03.742961+0000","last_became_peered":"2023-09-30T23:00:03.742961+0000","last_unstale":"2023-09-30T23:00:03.744954+0000","last_undegraded":"2023-09-30T23:00:03.744954+0000","last_fullsized":"2023-09-30T23:00:03.744954+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:51:19.161310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.727755+0000","last_change":"2023-09-30T23:00:02.728743+0000","last_active":"2023-09-30T23:00:03.727755+0000","last_peered":"2023-09-30T23:00:03.727755+0000","last_clean":"2023-09-30T23:00:03.727755+0000","last_became_active":"2023-09-30T23:00:02.728480+0000","last_became_peered":"2023-09-30T23:00:02.728480+0000","last_unstale":"2023-09-30T23:00:03.727755+0000","last_undegraded":"2023-09-30T23:00:03.727755+0000","last_fullsized":"2023-09-30T23:00:03.727755+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:47:35.359443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.738647+0000","last_change":"2023-09-30T23:00:03.738405+0000","last_active":"2023-09-30T23:00:03.738647+0000","last_peered":"2023-09-30T23:00:03.738647+0000","last_clean":"2023-09-30T23:00:03.738647+0000","last_became_active":"2023-09-30T23:00:03.738153+0000","last_became_peered":"2023-09-30T23:00:03.738153+0000","last_unstale":"2023-09-30T23:00:03.738647+0000","last_undegraded":"2023-09-30T23:00:03.738647+0000","last_fullsized":"2023-09-30T23:00:03.738647+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:12:30.918834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.f","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.738580+0000","last_change":"2023-09-30T23:00:02.731061+0000","last_active":"2023-09-30T23:00:03.738580+0000","last_peered":"2023-09-30T23:00:03.738580+0000","last_clean":"2023-09-30T23:00:03.738580+0000","last_became_active":"2023-09-30T23:00:02.730824+0000","last_became_peered":"2023-09-30T23:00:02.730824+0000","last_unstale":"2023-09-30T23:00:03.738580+0000","last_undegraded":"2023-09-30T23:00:03.738580+0000","last_fullsized":"2023-09-30T23:00:03.738580+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:29.352868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.734485+0000","last_change":"2023-09-30T23:00:03.733865+0000","last_active":"2023-09-30T23:00:03.734485+0000","last_peered":"2023-09-30T23:00:03.734485+0000","last_clean":"2023-09-30T23:00:03.734485+0000","last_became_active":"2023-09-30T23:00:03.733622+0000","last_became_peered":"2023-09-30T23:00:03.733622+0000","last_unstale":"2023-09-30T23:00:03.734485+0000","last_undegraded":"2023-09-30T23:00:03.734485+0000","last_fullsized":"2023-09-30T23:00:03.734485+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:39:19.619472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.e","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.736636+0000","last_change":"2023-09-30T23:00:02.725915+0000","last_active":"2023-09-30T23:00:03.736636+0000","last_peered":"2023-09-30T23:00:03.736636+0000","last_clean":"2023-09-30T23:00:03.736636+0000","last_became_active":"2023-09-30T23:00:02.725705+0000","last_became_peered":"2023-09-30T23:00:02.725705+0000","last_unstale":"2023-09-30T23:00:03.736636+0000","last_undegraded":"2023-09-30T23:00:03.736636+0000","last_fullsized":"2023-09-30T23:00:03.736636+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:21:34.857144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.735253+0000","last_change":"2023-09-30T23:00:03.735145+0000","last_active":"2023-09-30T23:00:03.735253+0000","last_peered":"2023-09-30T23:00:03.735253+0000","last_clean":"2023-09-30T23:00:03.735253+0000","last_became_active":"2023-09-30T23:00:03.734654+0000","last_became_peered":"2023-09-30T23:00:03.734654+0000","last_unstale":"2023-09-30T23:00:03.735253+0000","last_undegraded":"2023-09-30T23:00:03.735253+0000","last_fullsized":"2023-09-30T23:00:03.735253+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:04:22.336152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.d","version":"158'1","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.738586+0000","last_change":"2023-09-30T23:00:02.729572+0000","last_active":"2023-09-30T23:00:03.738586+0000","last_peered":"2023-09-30T23:00:03.738586+0000","last_clean":"2023-09-30T23:00:03.738586+0000","last_became_active":"2023-09-30T23:00:02.729307+0000","last_became_peered":"2023-09-30T23:00:02.729307+0000","last_unstale":"2023-09-30T23:00:03.738586+0000","last_undegraded":"2023-09-30T23:00:03.738586+0000","last_fullsized":"2023-09-30T23:00:03.738586+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:58:24.733669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.742913+0000","last_change":"2023-09-30T23:00:03.742802+0000","last_active":"2023-09-30T23:00:03.742913+0000","last_peered":"2023-09-30T23:00:03.742913+0000","last_clean":"2023-09-30T23:00:03.742913+0000","last_became_active":"2023-09-30T23:00:03.742547+0000","last_became_peered":"2023-09-30T23:00:03.742547+0000","last_unstale":"2023-09-30T23:00:03.742913+0000","last_undegraded":"2023-09-30T23:00:03.742913+0000","last_fullsized":"2023-09-30T23:00:03.742913+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:16:46.307788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.726483+0000","last_change":"2023-09-30T23:00:02.724945+0000","last_active":"2023-09-30T23:00:03.726483+0000","last_peered":"2023-09-30T23:00:03.726483+0000","last_clean":"2023-09-30T23:00:03.726483+0000","last_became_active":"2023-09-30T23:00:02.724079+0000","last_became_peered":"2023-09-30T23:00:02.724079+0000","last_unstale":"2023-09-30T23:00:03.726483+0000","last_undegraded":"2023-09-30T23:00:03.726483+0000","last_fullsized":"2023-09-30T23:00:03.726483+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:17.852622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.729629+0000","last_change":"2023-09-30T23:00:03.729065+0000","last_active":"2023-09-30T23:00:03.729629+0000","last_peered":"2023-09-30T23:00:03.729629+0000","last_clean":"2023-09-30T23:00:03.729629+0000","last_became_active":"2023-09-30T23:00:03.728558+0000","last_became_peered":"2023-09-30T23:00:03.728558+0000","last_unstale":"2023-09-30T23:00:03.729629+0000","last_undegraded":"2023-09-30T23:00:03.729629+0000","last_fullsized":"2023-09-30T23:00:03.729629+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:51.283793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.b","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.746640+0000","last_change":"2023-09-30T23:00:02.728810+0000","last_active":"2023-09-30T23:00:03.746640+0000","last_peered":"2023-09-30T23:00:03.746640+0000","last_clean":"2023-09-30T23:00:03.746640+0000","last_became_active":"2023-09-30T23:00:02.728283+0000","last_became_peered":"2023-09-30T23:00:02.728283+0000","last_unstale":"2023-09-30T23:00:03.746640+0000","last_undegraded":"2023-09-30T23:00:03.746640+0000","last_fullsized":"2023-09-30T23:00:03.746640+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:00.177989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733877+0000","last_change":"2023-09-30T23:00:03.733541+0000","last_active":"2023-09-30T23:00:03.733877+0000","last_peered":"2023-09-30T23:00:03.733877+0000","last_clean":"2023-09-30T23:00:03.733877+0000","last_became_active":"2023-09-30T23:00:03.732680+0000","last_became_peered":"2023-09-30T23:00:03.732680+0000","last_unstale":"2023-09-30T23:00:03.733877+0000","last_undegraded":"2023-09-30T23:00:03.733877+0000","last_fullsized":"2023-09-30T23:00:03.733877+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:31.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.726012+0000","last_change":"2023-09-30T23:00:02.722694+0000","last_active":"2023-09-30T23:00:03.726012+0000","last_peered":"2023-09-30T23:00:03.726012+0000","last_clean":"2023-09-30T23:00:03.726012+0000","last_became_active":"2023-09-30T23:00:02.722401+0000","last_became_peered":"2023-09-30T23:00:02.722401+0000","last_unstale":"2023-09-30T23:00:03.726012+0000","last_undegraded":"2023-09-30T23:00:03.726012+0000","last_fullsized":"2023-09-30T23:00:03.726012+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:32:38.699739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.736282+0000","last_change":"2023-09-30T23:00:03.736140+0000","last_active":"2023-09-30T23:00:03.736282+0000","last_peered":"2023-09-30T23:00:03.736282+0000","last_clean":"2023-09-30T23:00:03.736282+0000","last_became_active":"2023-09-30T23:00:03.735719+0000","last_became_peered":"2023-09-30T23:00:03.735719+0000","last_unstale":"2023-09-30T23:00:03.736282+0000","last_undegraded":"2023-09-30T23:00:03.736282+0000","last_fullsized":"2023-09-30T23:00:03.736282+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:48:31.043734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.727874+0000","last_change":"2023-09-30T23:00:02.731741+0000","last_active":"2023-09-30T23:00:03.727874+0000","last_peered":"2023-09-30T23:00:03.727874+0000","last_clean":"2023-09-30T23:00:03.727874+0000","last_became_active":"2023-09-30T23:00:02.731510+0000","last_became_peered":"2023-09-30T23:00:02.731510+0000","last_unstale":"2023-09-30T23:00:03.727874+0000","last_undegraded":"2023-09-30T23:00:03.727874+0000","last_fullsized":"2023-09-30T23:00:03.727874+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:25.526876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.735388+0000","last_change":"2023-09-30T23:00:03.735287+0000","last_active":"2023-09-30T23:00:03.735388+0000","last_peered":"2023-09-30T23:00:03.735388+0000","last_clean":"2023-09-30T23:00:03.735388+0000","last_became_active":"2023-09-30T23:00:03.734927+0000","last_became_peered":"2023-09-30T23:00:03.734927+0000","last_unstale":"2023-09-30T23:00:03.735388+0000","last_undegraded":"2023-09-30T23:00:03.735388+0000","last_fullsized":"2023-09-30T23:00:03.735388+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:31.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.718000+0000","last_change":"2023-09-30T23:00:02.730361+0000","last_active":"2023-09-30T23:00:03.718000+0000","last_peered":"2023-09-30T23:00:03.718000+0000","last_clean":"2023-09-30T23:00:03.718000+0000","last_became_active":"2023-09-30T23:00:02.730129+0000","last_became_peered":"2023-09-30T23:00:02.730129+0000","last_unstale":"2023-09-30T23:00:03.718000+0000","last_undegraded":"2023-09-30T23:00:03.718000+0000","last_fullsized":"2023-09-30T23:00:03.718000+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:15.349983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744579+0000","last_change":"2023-09-30T23:00:03.743772+0000","last_active":"2023-09-30T23:00:03.744579+0000","last_peered":"2023-09-30T23:00:03.744579+0000","last_clean":"2023-09-30T23:00:03.744579+0000","last_became_active":"2023-09-30T23:00:03.743057+0000","last_became_peered":"2023-09-30T23:00:03.743057+0000","last_unstale":"2023-09-30T23:00:03.744579+0000","last_undegraded":"2023-09-30T23:00:03.744579+0000","last_fullsized":"2023-09-30T23:00:03.744579+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:16:27.620236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.7","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.742465+0000","last_change":"2023-09-30T23:00:02.725100+0000","last_active":"2023-09-30T23:00:03.742465+0000","last_peered":"2023-09-30T23:00:03.742465+0000","last_clean":"2023-09-30T23:00:03.742465+0000","last_became_active":"2023-09-30T23:00:02.724403+0000","last_became_peered":"2023-09-30T23:00:02.724403+0000","last_unstale":"2023-09-30T23:00:03.742465+0000","last_undegraded":"2023-09-30T23:00:03.742465+0000","last_fullsized":"2023-09-30T23:00:03.742465+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:56:13.828820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.739041+0000","last_change":"2023-09-30T23:00:03.736962+0000","last_active":"2023-09-30T23:00:03.739041+0000","last_peered":"2023-09-30T23:00:03.739041+0000","last_clean":"2023-09-30T23:00:03.739041+0000","last_became_active":"2023-09-30T23:00:03.736447+0000","last_became_peered":"2023-09-30T23:00:03.736447+0000","last_unstale":"2023-09-30T23:00:03.739041+0000","last_undegraded":"2023-09-30T23:00:03.739041+0000","last_fullsized":"2023-09-30T23:00:03.739041+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:46.080735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.727738+0000","last_change":"2023-09-30T23:00:02.728680+0000","last_active":"2023-09-30T23:00:03.727738+0000","last_peered":"2023-09-30T23:00:03.727738+0000","last_clean":"2023-09-30T23:00:03.727738+0000","last_became_active":"2023-09-30T23:00:02.727980+0000","last_became_peered":"2023-09-30T23:00:02.727980+0000","last_unstale":"2023-09-30T23:00:03.727738+0000","last_undegraded":"2023-09-30T23:00:03.727738+0000","last_fullsized":"2023-09-30T23:00:03.727738+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:35.471250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.743817+0000","last_change":"2023-09-30T23:00:03.743747+0000","last_active":"2023-09-30T23:00:03.743817+0000","last_peered":"2023-09-30T23:00:03.743817+0000","last_clean":"2023-09-30T23:00:03.743817+0000","last_became_active":"2023-09-30T23:00:03.743472+0000","last_became_peered":"2023-09-30T23:00:03.743472+0000","last_unstale":"2023-09-30T23:00:03.743817+0000","last_undegraded":"2023-09-30T23:00:03.743817+0000","last_fullsized":"2023-09-30T23:00:03.743817+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:37:19.689786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733894+0000","last_change":"2023-09-30T23:00:02.733110+0000","last_active":"2023-09-30T23:00:03.733894+0000","last_peered":"2023-09-30T23:00:03.733894+0000","last_clean":"2023-09-30T23:00:03.733894+0000","last_became_active":"2023-09-30T23:00:02.732869+0000","last_became_peered":"2023-09-30T23:00:02.732869+0000","last_unstale":"2023-09-30T23:00:03.733894+0000","last_undegraded":"2023-09-30T23:00:03.733894+0000","last_fullsized":"2023-09-30T23:00:03.733894+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:38.033477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.729016+0000","last_change":"2023-09-30T23:00:03.728926+0000","last_active":"2023-09-30T23:00:03.729016+0000","last_peered":"2023-09-30T23:00:03.729016+0000","last_clean":"2023-09-30T23:00:03.729016+0000","last_became_active":"2023-09-30T23:00:03.728665+0000","last_became_peered":"2023-09-30T23:00:03.728665+0000","last_unstale":"2023-09-30T23:00:03.729016+0000","last_undegraded":"2023-09-30T23:00:03.729016+0000","last_fullsized":"2023-09-30T23:00:03.729016+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:41:15.841597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.718809+0000","last_change":"2023-09-30T23:00:02.720751+0000","last_active":"2023-09-30T23:00:03.718809+0000","last_peered":"2023-09-30T23:00:03.718809+0000","last_clean":"2023-09-30T23:00:03.718809+0000","last_became_active":"2023-09-30T23:00:02.720517+0000","last_became_peered":"2023-09-30T23:00:02.720517+0000","last_unstale":"2023-09-30T23:00:03.718809+0000","last_undegraded":"2023-09-30T23:00:03.718809+0000","last_fullsized":"2023-09-30T23:00:03.718809+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:54.816027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.731381+0000","last_change":"2023-09-30T23:00:03.731304+0000","last_active":"2023-09-30T23:00:03.731381+0000","last_peered":"2023-09-30T23:00:03.731381+0000","last_clean":"2023-09-30T23:00:03.731381+0000","last_became_active":"2023-09-30T23:00:03.731077+0000","last_became_peered":"2023-09-30T23:00:03.731077+0000","last_unstale":"2023-09-30T23:00:03.731381+0000","last_undegraded":"2023-09-30T23:00:03.731381+0000","last_fullsized":"2023-09-30T23:00:03.731381+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:36.481912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.727601+0000","last_change":"2023-09-30T23:00:02.729933+0000","last_active":"2023-09-30T23:00:03.727601+0000","last_peered":"2023-09-30T23:00:03.727601+0000","last_clean":"2023-09-30T23:00:03.727601+0000","last_became_active":"2023-09-30T23:00:02.729659+0000","last_became_peered":"2023-09-30T23:00:02.729659+0000","last_unstale":"2023-09-30T23:00:03.727601+0000","last_undegraded":"2023-09-30T23:00:03.727601+0000","last_fullsized":"2023-09-30T23:00:03.727601+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:48:20.766784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.735336+0000","last_change":"2023-09-30T23:00:03.735140+0000","last_active":"2023-09-30T23:00:03.735336+0000","last_peered":"2023-09-30T23:00:03.735336+0000","last_clean":"2023-09-30T23:00:03.735336+0000","last_became_active":"2023-09-30T23:00:03.734570+0000","last_became_peered":"2023-09-30T23:00:03.734570+0000","last_unstale":"2023-09-30T23:00:03.735336+0000","last_undegraded":"2023-09-30T23:00:03.735336+0000","last_fullsized":"2023-09-30T23:00:03.735336+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:39:19.619472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.728367+0000","last_change":"2023-09-30T23:00:02.725513+0000","last_active":"2023-09-30T23:00:03.728367+0000","last_peered":"2023-09-30T23:00:03.728367+0000","last_clean":"2023-09-30T23:00:03.728367+0000","last_became_active":"2023-09-30T23:00:02.725072+0000","last_became_peered":"2023-09-30T23:00:02.725072+0000","last_unstale":"2023-09-30T23:00:03.728367+0000","last_undegraded":"2023-09-30T23:00:03.728367+0000","last_fullsized":"2023-09-30T23:00:03.728367+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:09.404602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.726539+0000","last_change":"2023-09-30T23:00:03.726450+0000","last_active":"2023-09-30T23:00:03.726539+0000","last_peered":"2023-09-30T23:00:03.726539+0000","last_clean":"2023-09-30T23:00:03.726539+0000","last_became_active":"2023-09-30T23:00:03.726163+0000","last_became_peered":"2023-09-30T23:00:03.726163+0000","last_unstale":"2023-09-30T23:00:03.726539+0000","last_undegraded":"2023-09-30T23:00:03.726539+0000","last_fullsized":"2023-09-30T23:00:03.726539+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:27:05.692337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.717577+0000","last_change":"2023-09-30T23:00:02.728433+0000","last_active":"2023-09-30T23:00:03.717577+0000","last_peered":"2023-09-30T23:00:03.717577+0000","last_clean":"2023-09-30T23:00:03.717577+0000","last_became_active":"2023-09-30T23:00:02.728181+0000","last_became_peered":"2023-09-30T23:00:02.728181+0000","last_unstale":"2023-09-30T23:00:03.717577+0000","last_undegraded":"2023-09-30T23:00:03.717577+0000","last_fullsized":"2023-09-30T23:00:03.717577+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:00.177989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733337+0000","last_change":"2023-09-30T23:00:03.733059+0000","last_active":"2023-09-30T23:00:03.733337+0000","last_peered":"2023-09-30T23:00:03.733337+0000","last_clean":"2023-09-30T23:00:03.733337+0000","last_became_active":"2023-09-30T23:00:03.732818+0000","last_became_peered":"2023-09-30T23:00:03.732818+0000","last_unstale":"2023-09-30T23:00:03.733337+0000","last_undegraded":"2023-09-30T23:00:03.733337+0000","last_fullsized":"2023-09-30T23:00:03.733337+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:35.306344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.721455+0000","last_change":"2023-09-30T23:00:02.730336+0000","last_active":"2023-09-30T23:00:03.721455+0000","last_peered":"2023-09-30T23:00:03.721455+0000","last_clean":"2023-09-30T23:00:03.721455+0000","last_became_active":"2023-09-30T23:00:02.730107+0000","last_became_peered":"2023-09-30T23:00:02.730107+0000","last_unstale":"2023-09-30T23:00:03.721455+0000","last_undegraded":"2023-09-30T23:00:03.721455+0000","last_fullsized":"2023-09-30T23:00:03.721455+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:34:39.023011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.741232+0000","last_change":"2023-09-30T23:00:03.741055+0000","last_active":"2023-09-30T23:00:03.741232+0000","last_peered":"2023-09-30T23:00:03.741232+0000","last_clean":"2023-09-30T23:00:03.741232+0000","last_became_active":"2023-09-30T23:00:03.740745+0000","last_became_peered":"2023-09-30T23:00:03.740745+0000","last_unstale":"2023-09-30T23:00:03.741232+0000","last_undegraded":"2023-09-30T23:00:03.741232+0000","last_fullsized":"2023-09-30T23:00:03.741232+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:31.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.15","version":"158'3","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.739558+0000","last_change":"2023-09-30T23:00:02.728505+0000","last_active":"2023-09-30T23:00:03.739558+0000","last_peered":"2023-09-30T23:00:03.739558+0000","last_clean":"2023-09-30T23:00:03.739558+0000","last_became_active":"2023-09-30T23:00:02.727682+0000","last_became_peered":"2023-09-30T23:00:02.727682+0000","last_unstale":"2023-09-30T23:00:03.739558+0000","last_undegraded":"2023-09-30T23:00:03.739558+0000","last_fullsized":"2023-09-30T23:00:03.739558+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:15.349983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.725801+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:00:03.725801+0000","last_peered":"2023-09-30T23:00:03.725801+0000","last_clean":"2023-09-30T23:00:03.725801+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:00:03.725801+0000","last_undegraded":"2023-09-30T23:00:03.725801+0000","last_fullsized":"2023-09-30T23:00:03.725801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.735402+0000","last_change":"2023-09-30T23:00:03.735323+0000","last_active":"2023-09-30T23:00:03.735402+0000","last_peered":"2023-09-30T23:00:03.735402+0000","last_clean":"2023-09-30T23:00:03.735402+0000","last_became_active":"2023-09-30T23:00:03.734874+0000","last_became_peered":"2023-09-30T23:00:03.734874+0000","last_unstale":"2023-09-30T23:00:03.735402+0000","last_undegraded":"2023-09-30T23:00:03.735402+0000","last_fullsized":"2023-09-30T23:00:03.735402+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:04:22.336152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.13","version":"158'2","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.736994+0000","last_change":"2023-09-30T23:00:02.733065+0000","last_active":"2023-09-30T23:00:03.736994+0000","last_peered":"2023-09-30T23:00:03.736994+0000","last_clean":"2023-09-30T23:00:03.736994+0000","last_became_active":"2023-09-30T23:00:02.732822+0000","last_became_peered":"2023-09-30T23:00:02.732822+0000","last_unstale":"2023-09-30T23:00:03.736994+0000","last_undegraded":"2023-09-30T23:00:03.736994+0000","last_fullsized":"2023-09-30T23:00:03.736994+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:58:14.152133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":136,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.730505+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:00:03.730505+0000","last_peered":"2023-09-30T23:00:03.730505+0000","last_clean":"2023-09-30T23:00:03.730505+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:00:03.730505+0000","last_undegraded":"2023-09-30T23:00:03.730505+0000","last_fullsized":"2023-09-30T23:00:03.730505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.732119+0000","last_change":"2023-09-30T23:00:03.731604+0000","last_active":"2023-09-30T23:00:03.732119+0000","last_peered":"2023-09-30T23:00:03.732119+0000","last_clean":"2023-09-30T23:00:03.732119+0000","last_became_active":"2023-09-30T23:00:03.731359+0000","last_became_peered":"2023-09-30T23:00:03.731359+0000","last_unstale":"2023-09-30T23:00:03.732119+0000","last_undegraded":"2023-09-30T23:00:03.732119+0000","last_fullsized":"2023-09-30T23:00:03.732119+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:29:39.044139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"158'8","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744970+0000","last_change":"2023-09-30T23:00:02.724099+0000","last_active":"2023-09-30T23:00:03.744970+0000","last_peered":"2023-09-30T23:00:03.744970+0000","last_clean":"2023-09-30T23:00:03.744970+0000","last_became_active":"2023-09-30T23:00:02.723808+0000","last_became_peered":"2023-09-30T23:00:02.723808+0000","last_unstale":"2023-09-30T23:00:03.744970+0000","last_undegraded":"2023-09-30T23:00:03.744970+0000","last_fullsized":"2023-09-30T23:00:03.744970+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:23:36.826155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.722652+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:00:03.722652+0000","last_peered":"2023-09-30T23:00:03.722652+0000","last_clean":"2023-09-30T23:00:03.722652+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:00:03.722652+0000","last_undegraded":"2023-09-30T23:00:03.722652+0000","last_fullsized":"2023-09-30T23:00:03.722652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.739059+0000","last_change":"2023-09-30T23:00:03.737093+0000","last_active":"2023-09-30T23:00:03.739059+0000","last_peered":"2023-09-30T23:00:03.739059+0000","last_clean":"2023-09-30T23:00:03.739059+0000","last_became_active":"2023-09-30T23:00:03.736750+0000","last_became_peered":"2023-09-30T23:00:03.736750+0000","last_unstale":"2023-09-30T23:00:03.739059+0000","last_undegraded":"2023-09-30T23:00:03.739059+0000","last_fullsized":"2023-09-30T23:00:03.739059+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:14:35.306344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.731099+0000","last_change":"2023-09-30T23:00:02.733267+0000","last_active":"2023-09-30T23:00:03.731099+0000","last_peered":"2023-09-30T23:00:03.731099+0000","last_clean":"2023-09-30T23:00:03.731099+0000","last_became_active":"2023-09-30T23:00:02.732990+0000","last_became_peered":"2023-09-30T23:00:02.732990+0000","last_unstale":"2023-09-30T23:00:03.731099+0000","last_undegraded":"2023-09-30T23:00:03.731099+0000","last_fullsized":"2023-09-30T23:00:03.731099+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:06:27.374813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":136,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.731204+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:00:03.731204+0000","last_peered":"2023-09-30T23:00:03.731204+0000","last_clean":"2023-09-30T23:00:03.731204+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:00:03.731204+0000","last_undegraded":"2023-09-30T23:00:03.731204+0000","last_fullsized":"2023-09-30T23:00:03.731204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":288,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.732715+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:00:03.732715+0000","last_peered":"2023-09-30T23:00:03.732715+0000","last_clean":"2023-09-30T23:00:03.732715+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:00:03.732715+0000","last_undegraded":"2023-09-30T23:00:03.732715+0000","last_fullsized":"2023-09-30T23:00:03.732715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.738666+0000","last_change":"2023-09-30T23:00:03.738445+0000","last_active":"2023-09-30T23:00:03.738666+0000","last_peered":"2023-09-30T23:00:03.738666+0000","last_clean":"2023-09-30T23:00:03.738666+0000","last_became_active":"2023-09-30T23:00:03.738236+0000","last_became_peered":"2023-09-30T23:00:03.738236+0000","last_unstale":"2023-09-30T23:00:03.738666+0000","last_undegraded":"2023-09-30T23:00:03.738666+0000","last_fullsized":"2023-09-30T23:00:03.738666+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:44:48.167403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.728289+0000","last_change":"2023-09-30T23:00:02.728270+0000","last_active":"2023-09-30T23:00:03.728289+0000","last_peered":"2023-09-30T23:00:03.728289+0000","last_clean":"2023-09-30T23:00:03.728289+0000","last_became_active":"2023-09-30T23:00:02.728057+0000","last_became_peered":"2023-09-30T23:00:02.728057+0000","last_unstale":"2023-09-30T23:00:03.728289+0000","last_undegraded":"2023-09-30T23:00:03.728289+0000","last_fullsized":"2023-09-30T23:00:03.728289+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:15:30.690173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.734043+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:00:03.734043+0000","last_peered":"2023-09-30T23:00:03.734043+0000","last_clean":"2023-09-30T23:00:03.734043+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:00:03.734043+0000","last_undegraded":"2023-09-30T23:00:03.734043+0000","last_fullsized":"2023-09-30T23:00:03.734043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.744989+0000","last_change":"2023-09-30T23:00:03.744794+0000","last_active":"2023-09-30T23:00:03.744989+0000","last_peered":"2023-09-30T23:00:03.744989+0000","last_clean":"2023-09-30T23:00:03.744989+0000","last_became_active":"2023-09-30T23:00:03.743649+0000","last_became_peered":"2023-09-30T23:00:03.743649+0000","last_unstale":"2023-09-30T23:00:03.744989+0000","last_undegraded":"2023-09-30T23:00:03.744989+0000","last_fullsized":"2023-09-30T23:00:03.744989+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:12.108753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"158'6","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.742949+0000","last_change":"2023-09-30T23:00:02.730822+0000","last_active":"2023-09-30T23:00:03.742949+0000","last_peered":"2023-09-30T23:00:03.742949+0000","last_clean":"2023-09-30T23:00:03.742949+0000","last_became_active":"2023-09-30T23:00:02.730602+0000","last_became_peered":"2023-09-30T23:00:02.730602+0000","last_unstale":"2023-09-30T23:00:03.742949+0000","last_undegraded":"2023-09-30T23:00:03.742949+0000","last_fullsized":"2023-09-30T23:00:03.742949+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:34:39.023011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.733969+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:00:03.733969+0000","last_peered":"2023-09-30T23:00:03.733969+0000","last_clean":"2023-09-30T23:00:03.733969+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:00:03.733969+0000","last_undegraded":"2023-09-30T23:00:03.733969+0000","last_fullsized":"2023-09-30T23:00:03.733969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.737948+0000","last_change":"2023-09-30T23:00:03.737854+0000","last_active":"2023-09-30T23:00:03.737948+0000","last_peered":"2023-09-30T23:00:03.737948+0000","last_clean":"2023-09-30T23:00:03.737948+0000","last_became_active":"2023-09-30T23:00:03.737503+0000","last_became_peered":"2023-09-30T23:00:03.737503+0000","last_unstale":"2023-09-30T23:00:03.737948+0000","last_undegraded":"2023-09-30T23:00:03.737948+0000","last_fullsized":"2023-09-30T23:00:03.737948+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:51:38.784280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.725239+0000","last_change":"2023-09-30T23:00:02.731396+0000","last_active":"2023-09-30T23:00:03.725239+0000","last_peered":"2023-09-30T23:00:03.725239+0000","last_clean":"2023-09-30T23:00:03.725239+0000","last_became_active":"2023-09-30T23:00:02.730905+0000","last_became_peered":"2023-09-30T23:00:02.730905+0000","last_unstale":"2023-09-30T23:00:03.725239+0000","last_undegraded":"2023-09-30T23:00:03.725239+0000","last_fullsized":"2023-09-30T23:00:03.725239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:45:21.152265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.725698+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:00:03.725698+0000","last_peered":"2023-09-30T23:00:03.725698+0000","last_clean":"2023-09-30T23:00:03.725698+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:00:03.725698+0000","last_undegraded":"2023-09-30T23:00:03.725698+0000","last_fullsized":"2023-09-30T23:00:03.725698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.728998+0000","last_change":"2023-09-30T23:00:03.728833+0000","last_active":"2023-09-30T23:00:03.728998+0000","last_peered":"2023-09-30T23:00:03.728998+0000","last_clean":"2023-09-30T23:00:03.728998+0000","last_became_active":"2023-09-30T23:00:03.727616+0000","last_became_peered":"2023-09-30T23:00:03.727616+0000","last_unstale":"2023-09-30T23:00:03.728998+0000","last_undegraded":"2023-09-30T23:00:03.728998+0000","last_fullsized":"2023-09-30T23:00:03.728998+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:02.707716+0000","last_clean_scrub_stamp":"2023-09-30T23:00:02.707716+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:32:46.784685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.726386+0000","last_change":"2023-09-30T23:00:02.731139+0000","last_active":"2023-09-30T23:00:03.726386+0000","last_peered":"2023-09-30T23:00:03.726386+0000","last_clean":"2023-09-30T23:00:03.726386+0000","last_became_active":"2023-09-30T23:00:02.730884+0000","last_became_peered":"2023-09-30T23:00:02.730884+0000","last_unstale":"2023-09-30T23:00:03.726386+0000","last_undegraded":"2023-09-30T23:00:03.726386+0000","last_fullsized":"2023-09-30T23:00:03.726386+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:00:01.697054+0000","last_clean_scrub_stamp":"2023-09-30T23:00:01.697054+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:54:26.283879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-09-30T23:00:03.730428+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:00:03.730428+0000","last_peered":"2023-09-30T23:00:03.730428+0000","last_clean":"2023-09-30T23:00:03.730428+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:00:03.730428+0000","last_undegraded":"2023-09-30T23:00:03.730428+0000","last_fullsized":"2023-09-30T23:00:03.730428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055899,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.63600000000000001},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88500000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.81200000000000006}]},{"osd":1,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.63400000000000001},"min":{"1min":0.42899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70499999999999996,"15min":0.67000000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70199999999999996,"15min":0.67800000000000005},"min":{"1min":0.44,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.72399999999999998},"min":{"1min":0.54900000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98999999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.65300000000000002},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.46100000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72999999999999998,"15min":0.68700000000000006},"min":{"1min":0.52900000000000003,"5min":0.45200000000000001,"15min":0.434},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":1.056},"last":0.89300000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61899999999999999,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.94199999999999995,"15min":0.95999999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63300000000000001,"15min":0.60399999999999998},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89400000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79200000000000004}]},{"osd":5,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.135,"15min":1.135},"last":0.75},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.46899999999999997,"5min":0.44600000000000001,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.004},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.877},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.72999999999999998,"15min":0.69799999999999995},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98999999999999999,"5min":1.071,"15min":1.071},"last":0.86199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055865,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.69699999999999995,"15min":0.93500000000000005},"min":{"1min":0.40500000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80000000000000004,"5min":1.823,"15min":6.5190000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.748,"15min":0.78800000000000003},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94199999999999995,"5min":4.3680000000000003,"15min":4.3680000000000003},"last":0.58599999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":2.6230000000000002,"15min":3.6339999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76500000000000001,"15min":0.96799999999999997},"min":{"1min":0.505,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.073,"5min":5.6749999999999998,"15min":8.4339999999999993},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.73199999999999998,"15min":0.79200000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":3.2629999999999999,"15min":3.4580000000000002},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.97399999999999998},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":1.0429999999999999,"15min":6.5730000000000004},"last":0.56000000000000005}]},{"osd":3,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":0.92100000000000004},"min":{"1min":0.56299999999999994,"5min":0.49299999999999999,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":5.7110000000000003,"15min":5.7110000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71099999999999997,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.99299999999999999,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.68899999999999995},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97799999999999998,"5min":5.9279999999999999,"15min":5.9279999999999999},"last":0.97299999999999998}]},{"osd":5,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.66500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.05,"5min":1.321,"15min":1.321},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.71999999999999997},"min":{"1min":0.54100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0289999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.018}]},{"osd":7,"last update":"Sat Sep 30 22:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.76700000000000002},"min":{"1min":0.59899999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.74299999999999999},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.52100000000000002},"max":{"1min":1.1140000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1500,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193812,"statfs":{"total":200000000,"available":198463905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.434,"15min":0.40699999999999997},"min":{"1min":0.25700000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.49099999999999999,"5min":1.083,"15min":1.083},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.45700000000000002},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.63300000000000001,"5min":0.745,"15min":0.745},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.32300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52700000000000002,"5min":0.64700000000000002,"15min":0.65300000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.51100000000000001,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.32200000000000001},"max":{"1min":0.55200000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56399999999999995,"15min":0.52300000000000002},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.313},"max":{"1min":0.69699999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.443},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.505,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54100000000000004,"5min":0.71899999999999997,"15min":0.71999999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71699999999999997,"15min":0.68799999999999994},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83699999999999997,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.73299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.76200000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73199999999999998,"15min":0.71299999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.84499999999999997,"5min":1.095,"15min":1.22},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.77000000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.749,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":1.127,"15min":1.127},"last":0.745},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.48099999999999998},"max":{"1min":0.86099999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78200000000000003,"15min":0.76200000000000001},"min":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.51800000000000002},"max":{"1min":0.93300000000000005,"5min":1.0660000000000001,"15min":1.1240000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.76700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94499999999999995,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.76100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194388,"statfs":{"total":200000000,"available":199054273,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42899999999999999,"15min":0.41799999999999998},"min":{"1min":0.29999999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.85699999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.316,"5min":0.25,"15min":0.25},"max":{"1min":0.57399999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.437}]},{"osd":2,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.38200000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.64500000000000002,"5min":0.75600000000000001,"15min":1.0289999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.51600000000000001},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.79300000000000004,"15min":0.879},"last":0.51800000000000002}]},{"osd":3,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60399999999999998,"5min":0.76500000000000001,"15min":1.0029999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53700000000000003,"15min":0.503},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72799999999999998,"5min":0.96799999999999997,"15min":0.98899999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.70799999999999996},"min":{"1min":0.55300000000000005,"5min":0.436,"15min":0.436},"max":{"1min":0.94199999999999995,"5min":1.141,"15min":1.27},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72999999999999998},"min":{"1min":0.58399999999999996,"5min":0.48599999999999999,"15min":0.39800000000000002},"max":{"1min":0.93999999999999995,"5min":1.171,"15min":1.171},"last":0.623}]},{"osd":5,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.72199999999999998},"min":{"1min":0.56699999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92300000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.504},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79800000000000004,"15min":0.72999999999999998},"min":{"1min":0.57799999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.90100000000000002,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.73799999999999999},"min":{"1min":0.54600000000000004,"5min":0.47499999999999998,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.85699999999999998,"15min":0.76000000000000001},"min":{"1min":0.59699999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98199999999999998,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.81599999999999995,"15min":0.745},"min":{"1min":0.627,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.89000000000000001,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.81799999999999995,"15min":0.77100000000000002},"min":{"1min":0.54900000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91500000000000004,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055877,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.435,"15min":0.38600000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"max":{"1min":0.58699999999999997,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.47099999999999997,"15min":0.43099999999999999},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.249},"max":{"1min":0.56200000000000006,"5min":1.542,"15min":1.542},"last":0.51600000000000001}]},{"osd":1,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51700000000000002,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.627,"5min":1.494,"15min":1.494},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.501},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29599999999999999},"max":{"1min":0.60199999999999998,"5min":0.83999999999999997,"15min":1.0449999999999999},"last":0.46800000000000003}]},{"osd":3,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58799999999999997,"5min":1.649,"15min":1.649},"last":0.375},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.57499999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.234,"15min":1.234},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.0640000000000001,"5min":1.1000000000000001,"15min":1.4910000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79200000000000004,"15min":0.77800000000000002},"min":{"1min":0.53100000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1.151,"15min":1.179},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94099999999999995,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.751}]},{"osd":6,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":0.95999999999999996,"5min":1.05,"15min":1.615},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76100000000000001,"15min":0.73499999999999999},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90400000000000003,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Sep 30 22:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.1200000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.495,"15min":0.439},"max":{"1min":0.89000000000000001,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":38,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42499999999999999,"15min":0.40300000000000002},"min":{"1min":0.222,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.627,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.307},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.46300000000000002,"15min":0.503},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52800000000000002,"5min":1.0700000000000001,"15min":1.919},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52700000000000002,"5min":0.75800000000000001,"15min":1.254},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.49099999999999999,"15min":0.46899999999999997},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56200000000000006,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.55700000000000005,"5min":0.72399999999999998,"15min":1.6020000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.35499999999999998},"max":{"1min":0.627,"5min":1.2190000000000001,"15min":1.5309999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90200000000000002,"5min":1.242,"15min":1.401},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.57799999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.1539999999999999,"5min":3.306,"15min":3.306},"last":0.71599999999999997}]},{"osd":5,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.746,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.508},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":1.04,"5min":1.274,"15min":1.4910000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71899999999999997,"15min":0.73199999999999998},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93200000000000005,"5min":1.1870000000000001,"15min":1.5620000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96499999999999997,"5min":1.0960000000000001,"15min":1.3140000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Sep 30 22:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":1.0249999999999999,"5min":1.3440000000000001,"15min":1.3640000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.999,"5min":1.1970000000000001,"15min":1.573},"last":0.76900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66300000000000003,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90600000000000003,"5min":1.022,"15min":1.022},"last":0.872},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85599999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.627}]},{"osd":1,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.623},"min":{"1min":0.50900000000000001,"5min":0.441,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":1.492,"15min":1.492},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.68799999999999994},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.97299999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.66000000000000003},"min":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.45700000000000002},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73899999999999999,"15min":0.69899999999999995},"min":{"1min":0.58199999999999996,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.84099999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63900000000000001,"15min":0.65600000000000003},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.372},"max":{"1min":0.89300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.37},"max":{"1min":0.875,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66600000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.45,"15min":1.45},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.95699999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.48799999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93000000000000005,"5min":1.016,"15min":1.016},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.503,"5min":0.42099999999999999,"15min":0.39100000000000001},"max":{"1min":0.94399999999999995,"5min":1.044,"15min":1.044},"last":1.006}]}]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1499,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193813,"statfs":{"total":200000000,"available":198464851,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65000000000000002,"15min":0.60599999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.499},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67400000000000004,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82799999999999996,"5min":1.008,"15min":1.008},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69899999999999995,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0449999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68000000000000005,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.27400000000000002},"max":{"1min":0.876,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.044,"15min":1.044},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68100000000000005,"15min":0.64200000000000002},"min":{"1min":0.51400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.0189999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.65600000000000003},"min":{"1min":0.55400000000000005,"5min":0.442,"15min":0.442},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78600000000000003}]},{"osd":4,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.58899999999999997},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.63100000000000001},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":1.081,"15min":1.081},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.88400000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69899999999999995,"15min":0.67800000000000005},"min":{"1min":0.46899999999999997,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":1.03,"15min":1.03},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Sep 30 22:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73299999999999998,"15min":0.71199999999999997},"min":{"1min":0.55200000000000005,"5min":0.48399999999999999,"15min":0.37},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.749},"min":{"1min":0.58699999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81100000000000005}]}]}],"pool_statfs":[]}} 2023-09-30T23:00:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T23:00:08.551 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T23:00:08.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.782+0000 7f58c63ff700 1 Processor -- start 2023-09-30T23:00:08.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.783+0000 7f58c63ff700 1 -- start start 2023-09-30T23:00:08.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58c63ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58c00cbfe0 0x7f58c015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58c63ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58c63ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c00d0550 con 0x7f58c00cc3b0 2023-09-30T23:00:08.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58c63ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c00cf750 con 0x7f58c00cbfe0 2023-09-30T23:00:08.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58c63ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c00cf940 con 0x7f58c0157ab0 2023-09-30T23:00:08.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58bffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58c00cbfe0 0x7f58c015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58c499c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58bffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58c00cbfe0 0x7f58c015a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:53858/0 (socket says 172.21.15.142:53858) 2023-09-30T23:00:08.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58c499c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:46396/0 (socket says 172.21.15.142:46396) 2023-09-30T23:00:08.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58bffff700 1 -- 172.21.15.142:0/639326433 learned_addr learned my addr 172.21.15.142:0/639326433 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:08.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.784+0000 7f58bf7fe700 1 --1- 172.21.15.142:0/639326433 >> v1:172.21.15.148:6789/0 conn(0x7f58c00cc3b0 0x7f58c01573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:53638/0 (socket says 172.21.15.142:53638) 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58beffd700 1 -- 172.21.15.142:0/639326433 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197137235 0 0) 0x7f58c00d0550 con 0x7f58c00cc3b0 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58beffd700 1 -- 172.21.15.142:0/639326433 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a8003570 con 0x7f58c00cc3b0 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58bffff700 1 -- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 msgr2=0x7f58c00cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58bffff700 1 --2- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58bffff700 1 -- 172.21.15.142:0/639326433 >> v1:172.21.15.148:6789/0 conn(0x7f58c00cc3b0 legacy=0x7f58c01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58bffff700 1 -- 172.21.15.142:0/639326433 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c00cfc20 con 0x7f58c00cbfe0 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58c499c700 1 --2- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58bffff700 1 --2- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 0x7f58c015a2a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f58b00099b0 tx=0x7f58b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50baa2e5574fe03f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:08.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.785+0000 7f58beffd700 1 -- 172.21.15.142:0/639326433 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000b680 con 0x7f58c00cbfe0 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58beffd700 1 -- 172.21.15.142:0/639326433 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b000b7e0 con 0x7f58c00cbfe0 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58beffd700 1 -- 172.21.15.142:0/639326433 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000bb80 con 0x7f58c00cbfe0 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 -- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 msgr2=0x7f58c015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 --2- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 0x7f58c015a2a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f58b00099b0 tx=0x7f58b0009250 comp rx=0 tx=0).stop 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 -- 172.21.15.142:0/639326433 shutdown_connections 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 --2- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 --2- 172.21.15.142:0/639326433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 0x7f58c015a2a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 -- 172.21.15.142:0/639326433 >> 172.21.15.142:0/639326433 conn(0x7f58c00d0a80 msgr2=0x7f58c00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 -- 172.21.15.142:0/639326433 shutdown_connections 2023-09-30T23:00:08.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.786+0000 7f58c63ff700 1 -- 172.21.15.142:0/639326433 wait complete. 2023-09-30T23:00:08.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.788+0000 7f58c63ff700 1 Processor -- start 2023-09-30T23:00:08.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.788+0000 7f58c63ff700 1 -- start start 2023-09-30T23:00:08.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58c63ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 0x7f58c00c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58c63ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c00cc3b0 0x7f58c015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58c63ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58c63ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c00c64a0 con 0x7f58c00cc3b0 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58c63ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c00c6780 con 0x7f58c00cbfe0 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58c63ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c00c6a60 con 0x7f58c0157ab0 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c00cc3b0 0x7f58c015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c00cc3b0 0x7f58c015bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35974/0 (socket says 172.21.15.142:35974) 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58bf7fe700 1 -- 172.21.15.142:0/1228139759 learned_addr learned my addr 172.21.15.142:0/1228139759 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58c499c700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.789+0000 7f58bffff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 0x7f58c00c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58bf7fe700 1 -- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 msgr2=0x7f58c00c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58bf7fe700 1 -- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 msgr2=0x7f58c00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:08.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 0x7f58c00c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:08.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58bf7fe700 1 -- 172.21.15.142:0/1228139759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009a20 con 0x7f58c00cc3b0 2023-09-30T23:00:08.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c00cc3b0 0x7f58c015bfb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c7c0 tx=0x7f58b4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:08.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58a7fff700 1 -- 172.21.15.142:0/1228139759 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4005a70 con 0x7f58c00cc3b0 2023-09-30T23:00:08.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58a7fff700 1 -- 172.21.15.142:0/1228139759 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4005bf0 con 0x7f58c00cc3b0 2023-09-30T23:00:08.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58a7fff700 1 -- 172.21.15.142:0/1228139759 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40070d0 con 0x7f58c00cc3b0 2023-09-30T23:00:08.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b00094f0 con 0x7f58c00cc3b0 2023-09-30T23:00:08.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.790+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c00c7020 con 0x7f58c00cc3b0 2023-09-30T23:00:08.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.791+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c0069770 con 0x7f58c00cc3b0 2023-09-30T23:00:08.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.792+0000 7f58a7fff700 1 -- 172.21.15.142:0/1228139759 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f58b4007480 con 0x7f58c00cc3b0 2023-09-30T23:00:08.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.794+0000 7f58a7fff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f58ac067330 0x7f58ac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:08.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.794+0000 7f58a7fff700 1 -- 172.21.15.142:0/1228139759 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f58b40840f0 con 0x7f58c00cc3b0 2023-09-30T23:00:08.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.794+0000 7f58bffff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f58ac067330 0x7f58ac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:08.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.794+0000 7f58bffff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f58ac067330 0x7f58ac0697e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f58b00099b0 tx=0x7f58b0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:08.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:08.798+0000 7f58a7fff700 1 -- 172.21.15.142:0/1228139759 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f58b4051010 con 0x7f58c00cc3b0 2023-09-30T23:00:09.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.065+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f58c006fc10 con 0x7f58c00cc3b0 2023-09-30T23:00:09.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.071+0000 7f58a7fff700 1 -- 172.21.15.142:0/1228139759 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f58b4054630 con 0x7f58c00cc3b0 2023-09-30T23:00:09.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f58ac067330 msgr2=0x7f58ac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f58ac067330 0x7f58ac0697e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f58b00099b0 tx=0x7f58b0017000 comp rx=0 tx=0).stop 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c00cc3b0 msgr2=0x7f58c015bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c00cc3b0 0x7f58c015bfb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c7c0 tx=0x7f58b4007e00 comp rx=0 tx=0).stop 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 shutdown_connections 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f58ac067330 0x7f58ac0697e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58c0157ab0 0x7f58c00c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c00cbfe0 0x7f58c00c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 --2- 172.21.15.142:0/1228139759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c00cc3b0 0x7f58c015bfb0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.073+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 >> 172.21.15.142:0/1228139759 conn(0x7f58c00d0a80 msgr2=0x7f58c0156670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.074+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 shutdown_connections 2023-09-30T23:00:09.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.074+0000 7f58c63ff700 1 -- 172.21.15.142:0/1228139759 wait complete. 2023-09-30T23:00:09.075 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T23:00:09.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:00:09.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.282+0000 7f61c1dff700 1 Processor -- start 2023-09-30T23:00:09.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.282+0000 7f61c1dff700 1 -- start start 2023-09-30T23:00:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.283+0000 7f61c1dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61bc143350 0x7f61bc0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.283+0000 7f61c1dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f61bc15de20 0x7f61bc06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.283+0000 7f61c1dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc0cc6b0 con 0x7f61bc0692f0 2023-09-30T23:00:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.283+0000 7f61c1dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0cb7d0 con 0x7f61bc143350 2023-09-30T23:00:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.283+0000 7f61c1dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0cbaa0 con 0x7f61bc15de20 2023-09-30T23:00:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61bc143350 0x7f61bc0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61bc143350 0x7f61bc0cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35980/0 (socket says 172.21.15.142:35980) 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 -- 172.21.15.142:0/2022820338 learned_addr learned my addr 172.21.15.142:0/2022820338 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61baffd700 1 --1- 172.21.15.142:0/2022820338 >> v1:172.21.15.142:6789/0 conn(0x7f61bc0692f0 0x7f61bc15d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34248/0 (socket says 172.21.15.142:34248) 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bbfff700 1 --2- 172.21.15.142:0/2022820338 >> v2:172.21.15.148:3300/0 conn(0x7f61bc15de20 0x7f61bc06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 -- 172.21.15.142:0/2022820338 >> v2:172.21.15.148:3300/0 conn(0x7f61bc15de20 msgr2=0x7f61bc06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 --2- 172.21.15.142:0/2022820338 >> v2:172.21.15.148:3300/0 conn(0x7f61bc15de20 0x7f61bc06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 -- 172.21.15.142:0/2022820338 >> v1:172.21.15.142:6789/0 conn(0x7f61bc0692f0 legacy=0x7f61bc15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 -- 172.21.15.142:0/2022820338 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc0cbd80 con 0x7f61bc143350 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61ba7fc700 1 -- 172.21.15.142:0/2022820338 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118169074 0 0) 0x7f61bc0cc6b0 con 0x7f61bc0692f0 2023-09-30T23:00:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.284+0000 7f61bb7fe700 1 --2- 172.21.15.142:0/2022820338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc143350 0x7f61bc0cb290 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f61bc069cf0 tx=0x7f61ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b965a4629a8ec4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:09.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61ba7fc700 1 -- 172.21.15.142:0/2022820338 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac009e70 con 0x7f61bc143350 2023-09-30T23:00:09.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61ba7fc700 1 -- 172.21.15.142:0/2022820338 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac00b860 con 0x7f61bc143350 2023-09-30T23:00:09.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61ba7fc700 1 -- 172.21.15.142:0/2022820338 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00bc00 con 0x7f61bc143350 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 -- 172.21.15.142:0/2022820338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc143350 msgr2=0x7f61bc0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 --2- 172.21.15.142:0/2022820338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc143350 0x7f61bc0cb290 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f61bc069cf0 tx=0x7f61ac009250 comp rx=0 tx=0).stop 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 -- 172.21.15.142:0/2022820338 shutdown_connections 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 --2- 172.21.15.142:0/2022820338 >> v2:172.21.15.148:3300/0 conn(0x7f61bc15de20 0x7f61bc06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 --2- 172.21.15.142:0/2022820338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc143350 0x7f61bc0cb290 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 -- 172.21.15.142:0/2022820338 >> 172.21.15.142:0/2022820338 conn(0x7f61bc0ce8e0 msgr2=0x7f61bc0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 -- 172.21.15.142:0/2022820338 shutdown_connections 2023-09-30T23:00:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.285+0000 7f61c1dff700 1 -- 172.21.15.142:0/2022820338 wait complete. 2023-09-30T23:00:09.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.287+0000 7f61c1dff700 1 Processor -- start 2023-09-30T23:00:09.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.288+0000 7f61c1dff700 1 -- start start 2023-09-30T23:00:09.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61c1dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc0692f0 0x7f61bc0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:09.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61c1dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc143350 0x7f61bc158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:09.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61c1dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61bc15de20 0x7f61bc0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:09.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61c1dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0b3990 con 0x7f61bc0692f0 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61c1dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc13b650 con 0x7f61bc143350 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61c1dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc13b8f0 con 0x7f61bc15de20 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61bb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc0692f0 0x7f61bc0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61bb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc0692f0 0x7f61bc0b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35988/0 (socket says 172.21.15.142:35988) 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61bb7fe700 1 -- 172.21.15.142:0/3658290118 learned_addr learned my addr 172.21.15.142:0/3658290118 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61baffd700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc143350 0x7f61bc158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.289+0000 7f61bbfff700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61bc15de20 0x7f61bc0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61bb7fe700 1 -- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61bc15de20 msgr2=0x7f61bc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61bb7fe700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61bc15de20 0x7f61bc0cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61bb7fe700 1 -- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc143350 msgr2=0x7f61bc158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61bb7fe700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc143350 0x7f61bc158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61bb7fe700 1 -- 172.21.15.142:0/3658290118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0094f0 con 0x7f61bc0692f0 2023-09-30T23:00:09.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61baffd700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc143350 0x7f61bc158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:09.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61bb7fe700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc0692f0 0x7f61bc0b27f0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f61bc063f80 tx=0x7f61ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61a37fe700 1 -- 172.21.15.142:0/3658290118 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00bbe0 con 0x7f61bc0692f0 2023-09-30T23:00:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61a37fe700 1 -- 172.21.15.142:0/3658290118 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac011420 con 0x7f61bc0692f0 2023-09-30T23:00:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61a37fe700 1 -- 172.21.15.142:0/3658290118 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0117e0 con 0x7f61bc0692f0 2023-09-30T23:00:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc0b30f0 con 0x7f61bc0692f0 2023-09-30T23:00:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.290+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc0b36b0 con 0x7f61bc0692f0 2023-09-30T23:00:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.291+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc06ea70 con 0x7f61bc0692f0 2023-09-30T23:00:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.292+0000 7f61a37fe700 1 -- 172.21.15.142:0/3658290118 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f61ac011b90 con 0x7f61bc0692f0 2023-09-30T23:00:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.293+0000 7f61a37fe700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f61a8067330 0x7f61a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.293+0000 7f61a37fe700 1 -- 172.21.15.142:0/3658290118 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f61ac086590 con 0x7f61bc0692f0 2023-09-30T23:00:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.293+0000 7f61baffd700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f61a8067330 0x7f61a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.294+0000 7f61baffd700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f61a8067330 0x7f61a80697e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b15e0 tx=0x7f61b0007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:09.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.297+0000 7f61a37fe700 1 -- 172.21.15.142:0/3658290118 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f61ac0533f0 con 0x7f61bc0692f0 2023-09-30T23:00:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.531+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61bc06fc10 con 0x7f61bc0692f0 2023-09-30T23:00:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.532+0000 7f61a37fe700 1 -- 172.21.15.142:0/3658290118 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f61ac056a10 con 0x7f61bc0692f0 2023-09-30T23:00:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:09.532 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:00:03.199135+0000","modified":"2023-09-30T23:00:06.755986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/3293843450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3293843450},{"type":"v1","addr":"172.21.15.148:6834","nonce":3293843450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-09-30T23:00:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f61a8067330 msgr2=0x7f61a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f61a8067330 0x7f61a80697e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b15e0 tx=0x7f61b0007c90 comp rx=0 tx=0).stop 2023-09-30T23:00:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc0692f0 msgr2=0x7f61bc0b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc0692f0 0x7f61bc0b27f0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f61bc063f80 tx=0x7f61ac017000 comp rx=0 tx=0).stop 2023-09-30T23:00:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 shutdown_connections 2023-09-30T23:00:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f61a8067330 0x7f61a80697e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61bc15de20 0x7f61bc0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc0692f0 0x7f61bc0b27f0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 --2- 172.21.15.142:0/3658290118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc143350 0x7f61bc158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 >> 172.21.15.142:0/3658290118 conn(0x7f61bc0ce8e0 msgr2=0x7f61bc1403a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 shutdown_connections 2023-09-30T23:00:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:09.534+0000 7f61c1dff700 1 -- 172.21.15.142:0/3658290118 wait complete. 2023-09-30T23:00:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 74 2023-09-30T23:00:09.953 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T23:00:03.199135+0000', 'modified': '2023-09-30T23:00:06.755986+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7662}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7662': {'gid': 7662, 'name': 'd', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6834/3293843450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6832', 'nonce': 3293843450}, {'type': 'v1', 'addr': '172.21.15.148:6834', 'nonce': 3293843450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T23:00:09.953 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T23:00:09.954 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-30T23:00:10.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.145+0000 7f5a45fff700 1 Processor -- start 2023-09-30T23:00:10.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.145+0000 7f5a45fff700 1 -- start start 2023-09-30T23:00:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.147+0000 7f5a45fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a4015dee0 0x7f5a40159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.147+0000 7f5a45fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4006b8d0 con 0x7f5a401598e0 2023-09-30T23:00:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.147+0000 7f5a45fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400cff40 con 0x7f5a400cee50 2023-09-30T23:00:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.147+0000 7f5a45fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400cf330 con 0x7f5a4015dee0 2023-09-30T23:00:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.147+0000 7f5a3f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5a401598e0 0x7f5a4006b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34260/0 (socket says 172.21.15.142:34260) 2023-09-30T23:00:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.147+0000 7f5a3f7fe700 1 -- 172.21.15.142:0/422826628 learned_addr learned my addr 172.21.15.142:0/422826628 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441099382 0 0) 0x7f5a4006b8d0 con 0x7f5a401598e0 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a28003570 con 0x7f5a401598e0 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/422826628 >> v2:172.21.15.148:3300/0 conn(0x7f5a4015dee0 0x7f5a40159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1776437367 0 0) 0x7f5a28003570 con 0x7f5a401598e0 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 >> v2:172.21.15.148:3300/0 conn(0x7f5a4015dee0 msgr2=0x7f5a40159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 --2- 172.21.15.142:0/422826628 >> v2:172.21.15.148:3300/0 conn(0x7f5a4015dee0 0x7f5a40159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 >> v1:172.21.15.148:6789/0 conn(0x7f5a400cee50 legacy=0x7f5a4015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400cf610 con 0x7f5a401598e0 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f5a30001470 con 0x7f5a401598e0 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 >> v1:172.21.15.142:6789/0 conn(0x7f5a401598e0 legacy=0x7f5a4006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28003ab0 0x7f5a28003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a28004810 0x7f5a28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28005210 0x7f5a2800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400cf330 con 0x7f5a28004810 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2800c130 con 0x7f5a28005210 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2800c2f0 con 0x7f5a28003ab0 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.148+0000 7f5a3effd700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a28004810 0x7f5a28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28003ab0 0x7f5a28003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28005210 0x7f5a2800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3effd700 1 -- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28003ab0 msgr2=0x7f5a28003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3effd700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28003ab0 0x7f5a28003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3effd700 1 -- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28005210 msgr2=0x7f5a2800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3effd700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28005210 0x7f5a2800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3effd700 1 -- 172.21.15.142:0/422826628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28003570 con 0x7f5a28004810 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3ffff700 1 -- 172.21.15.142:0/422826628 reap_dead start 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28003ab0 0x7f5a28003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3effd700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a28004810 0x7f5a28004c80 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5a340018b0 tx=0x7f5a34007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a75cf7f2f46f8f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34012420 con 0x7f5a28004810 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340125a0 con 0x7f5a28004810 2023-09-30T23:00:10.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.149+0000 7f5a3e7fc700 1 -- 172.21.15.142:0/422826628 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34012960 con 0x7f5a28004810 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.150+0000 7f5a45fff700 1 -- 172.21.15.142:0/422826628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a28004810 msgr2=0x7f5a28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.150+0000 7f5a45fff700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a28004810 0x7f5a28004c80 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5a340018b0 tx=0x7f5a34007d30 comp rx=0 tx=0).stop 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.150+0000 7f5a45fff700 1 -- 172.21.15.142:0/422826628 shutdown_connections 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.150+0000 7f5a45fff700 1 --2- 172.21.15.142:0/422826628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a28004810 0x7f5a28004c80 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.150+0000 7f5a45fff700 1 -- 172.21.15.142:0/422826628 >> 172.21.15.142:0/422826628 conn(0x7f5a400cd540 msgr2=0x7f5a400cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.150+0000 7f5a45fff700 1 -- 172.21.15.142:0/422826628 shutdown_connections 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.150+0000 7f5a45fff700 1 -- 172.21.15.142:0/422826628 wait complete. 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.151+0000 7f5a45fff700 1 Processor -- start 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.152+0000 7f5a45fff700 1 -- start start 2023-09-30T23:00:10.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.152+0000 7f5a45fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28004810 0x7f5a4014fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.152+0000 7f5a45fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a40152c10 0x7f5a401698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.152+0000 7f5a45fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a40154640 0x7f5a40154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.152+0000 7f5a45fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40150100 con 0x7f5a40154640 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.152+0000 7f5a45fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4016da70 con 0x7f5a40152c10 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.152+0000 7f5a45fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4016dd50 con 0x7f5a28004810 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a40154640 0x7f5a40154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a40154640 0x7f5a40154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36004/0 (socket says 172.21.15.142:36004) 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 -- 172.21.15.142:0/4137183595 learned_addr learned my addr 172.21.15.142:0/4137183595 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 -- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28004810 msgr2=0x7f5a4014fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28004810 0x7f5a4014fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 -- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a40152c10 msgr2=0x7f5a401698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3effd700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a40152c10 0x7f5a401698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a40152c10 0x7f5a401698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 -- 172.21.15.142:0/4137183595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4016e030 con 0x7f5a40154640 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3effd700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a40152c10 0x7f5a401698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a40154640 0x7f5a40154ae0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5a400cec10 tx=0x7f5a3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.153+0000 7f5a277fe700 1 -- 172.21.15.142:0/4137183595 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800e070 con 0x7f5a40154640 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.154+0000 7f5a277fe700 1 -- 172.21.15.142:0/4137183595 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38011d00 con 0x7f5a40154640 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.154+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4016e310 con 0x7f5a40154640 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.154+0000 7f5a277fe700 1 -- 172.21.15.142:0/4137183595 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380166a0 con 0x7f5a40154640 2023-09-30T23:00:10.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.154+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4016d700 con 0x7f5a40154640 2023-09-30T23:00:10.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.156+0000 7f5a277fe700 1 -- 172.21.15.142:0/4137183595 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5a38016ad0 con 0x7f5a40154640 2023-09-30T23:00:10.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.157+0000 7f5a277fe700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a2c067330 0x7f5a2c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.157+0000 7f5a277fe700 1 -- 172.21.15.142:0/4137183595 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a380859b0 con 0x7f5a40154640 2023-09-30T23:00:10.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.157+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a2c067330 0x7f5a2c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.158+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a2c067330 0x7f5a2c0697e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5a30001b30 tx=0x7f5a30001aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.159+0000 7f5a546a3b80 1 Processor -- start 2023-09-30T23:00:10.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.159+0000 7f5a546a3b80 1 -- start start 2023-09-30T23:00:10.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e51114450 0x559e51114820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e510f9f40 0x559e5111cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e5111d4d0 0x559e5111d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e50fe7310 con 0x559e5111d4d0 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e51024130 con 0x559e51114450 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e51021af0 con 0x559e510f9f40 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a3ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e5111d4d0 0x559e5111d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a3ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e5111d4d0 0x559e5111d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36016/0 (socket says 172.21.15.142:36016) 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a3ffff700 1 -- 172.21.15.142:0/1149930226 learned_addr learned my addr 172.21.15.142:0/1149930226 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e51114450 0x559e51114820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.160+0000 7f5a3effd700 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e510f9f40 0x559e5111cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a3ffff700 1 -- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e510f9f40 msgr2=0x559e5111cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e510f9f40 0x559e5111cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a3ffff700 1 -- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e51114450 msgr2=0x559e51114820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e51114450 0x559e51114820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a3ffff700 1 -- 172.21.15.142:0/1149930226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e50e23790 con 0x559e5111d4d0 2023-09-30T23:00:10.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e51114450 0x559e51114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:10.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e5111d4d0 0x559e5111d940 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f5a38083d60 tx=0x7f5a38083c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb495435494cd754 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a24ff9700 1 -- 172.21.15.142:0/1149930226 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38085050 con 0x559e5111d4d0 2023-09-30T23:00:10.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a24ff9700 1 -- 172.21.15.142:0/1149930226 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38056550 con 0x559e5111d4d0 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.161+0000 7f5a24ff9700 1 -- 172.21.15.142:0/1149930226 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38059720 con 0x559e5111d4d0 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 -- 172.21.15.142:0/1149930226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e5111d4d0 msgr2=0x559e5111d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e5111d4d0 0x559e5111d940 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f5a38083d60 tx=0x7f5a38083c30 comp rx=0 tx=0).stop 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 -- 172.21.15.142:0/1149930226 shutdown_connections 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e5111d4d0 0x559e5111d940 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e51114450 0x559e51114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/1149930226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e510f9f40 0x559e5111cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 -- 172.21.15.142:0/1149930226 >> 172.21.15.142:0/1149930226 conn(0x559e51117880 msgr2=0x559e51117c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 -- 172.21.15.142:0/1149930226 shutdown_connections 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.162+0000 7f5a546a3b80 1 -- 172.21.15.142:0/1149930226 wait complete. 2023-09-30T23:00:10.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.163+0000 7f5a546a3b80 1 -- start start 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.163+0000 7f5a546a3b80 1 Processor -- start 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e510f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5101d8e0 con 0x559e51114450 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e50fc9980 con 0x559e510f9f40 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e50fc9620 con 0x559e5111d4d0 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a546a3b80 10 client.0 _ll_register_callbacks cb 0x559e50e2ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36020/0 (socket says 172.21.15.142:36020) 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 -- 172.21.15.142:0/2925912441 learned_addr learned my addr 172.21.15.142:0/2925912441 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:10.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e510f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 -- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 msgr2=0x559e510f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 -- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 msgr2=0x559e510f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e510f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.164+0000 7f5a3effd700 1 -- 172.21.15.142:0/2925912441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4016d700 con 0x559e51114450 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a3effd700 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f25e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f5a34012a40 tx=0x7f5a34015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119131a6e06122f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a1dffb700 1 -- 172.21.15.142:0/2925912441 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34012420 con 0x559e51114450 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a1dffb700 1 -- 172.21.15.142:0/2925912441 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a3401f620 con 0x559e51114450 2023-09-30T23:00:10.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e510c1d60 con 0x559e51114450 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a1dffb700 1 -- 172.21.15.142:0/2925912441 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a34001200 con 0x559e51114450 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a546a3b80 10 client.7806 fetch_fsmap learned FSMap version 74 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559e50f100a0 con 0x559e51114450 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.165+0000 7f5a1dffb700 1 -- 172.21.15.142:0/2925912441 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e510c1d60 con 0x559e51114450 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a1dffb700 1 -- 172.21.15.142:0/2925912441 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5a3401f7e0 con 0x559e51114450 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a546a3b80 10 client.7806 fetch_fsmap finished waiting for FSMap version 74 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a546a3b80 10 client.7806 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a546a3b80 20 client.7806 populate_metadata read hostname 'smithi142' 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e51115c80 0x559e51116050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a546a3b80 4 client.7806 mds_command: new command op to 7662 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 --> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e5109eb30 con 0x559e51115c80 2023-09-30T23:00:10.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.166+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e51115c80 0x559e51116050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.167+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e51115c80 0x559e51116050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb96b0c656088115 server_cookie=a60e1274b385aab2 in_seq=0 out_seq=0 2023-09-30T23:00:10.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.167+0000 7f5a1dffb700 10 client.7806 ms_handle_connect on v2:172.21.15.148:6832/3293843450 2023-09-30T23:00:10.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.167+0000 7f5a1dffb700 1 -- 172.21.15.142:0/2925912441 <== mds.0 v2:172.21.15.148:6832/3293843450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x559e5109eb30 con 0x559e51115c80 2023-09-30T23:00:10.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.167+0000 7f5a1dffb700 10 client.7806 handle_command_reply: tid=0 2023-09-30T23:00:10.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.167+0000 7f5a546a3b80 1 client.7806 shutdown 2023-09-30T23:00:10.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 msgr2=0x559e510f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f25e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f5a34012a40 tx=0x7f5a34015000 comp rx=0 tx=0).stop 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 shutdown_connections 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e51115c80 0x559e51116050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e510f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/2925912441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f25e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a1dffb700 0 client.7806 ms_handle_reset on v2:172.21.15.148:6832/3293843450 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 >> 172.21.15.142:0/2925912441 conn(0x559e51117880 msgr2=0x559e510c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 shutdown_connections 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 1 -- 172.21.15.142:0/2925912441 wait complete. 2023-09-30T23:00:10.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.168+0000 7f5a546a3b80 20 client.7806 trim_cache size 0 max 16384 2023-09-30T23:00:10.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.185+0000 7f5a546a3b80 1 Processor -- start 2023-09-30T23:00:10.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.185+0000 7f5a546a3b80 1 -- start start 2023-09-30T23:00:10.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e510f9f40 0x559e510eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e51114450 0x559e510f0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5111d4d0 0x559e510c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e50eb51e0 con 0x559e510f9f40 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e510ca3f0 con 0x559e5111d4d0 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e511258e0 con 0x559e51114450 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a3f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e510f9f40 0x559e510eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a3f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e510f9f40 0x559e510eedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36034/0 (socket says 172.21.15.142:36034) 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.186+0000 7f5a3f7fe700 1 -- 172.21.15.142:0/3069710162 learned_addr learned my addr 172.21.15.142:0/3069710162 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a3f7fe700 1 -- 172.21.15.142:0/3069710162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e51114450 msgr2=0x559e510f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/3069710162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e51114450 0x559e510f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a3f7fe700 1 -- 172.21.15.142:0/3069710162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5111d4d0 msgr2=0x559e510c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/3069710162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5111d4d0 0x559e510c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a3f7fe700 1 -- 172.21.15.142:0/3069710162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e50fec3c0 con 0x559e510f9f40 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/3069710162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e510f9f40 0x559e510eedf0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f5a400b3720 tx=0x7f5a30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26472299778596 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a257fa700 1 -- 172.21.15.142:0/3069710162 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30025e50 con 0x559e510f9f40 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a257fa700 1 -- 172.21.15.142:0/3069710162 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000e5b0 con 0x559e510f9f40 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.187+0000 7f5a257fa700 1 -- 172.21.15.142:0/3069710162 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000e720 con 0x559e510f9f40 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3069710162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e510f9f40 msgr2=0x559e510eedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3069710162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e510f9f40 0x559e510eedf0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f5a400b3720 tx=0x7f5a30013000 comp rx=0 tx=0).stop 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3069710162 shutdown_connections 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3069710162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5111d4d0 0x559e510c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3069710162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e510f9f40 0x559e510eedf0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3069710162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e51114450 0x559e510f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3069710162 >> 172.21.15.142:0/3069710162 conn(0x559e51117880 msgr2=0x559e51116050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3069710162 shutdown_connections 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.188+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3069710162 wait complete. 2023-09-30T23:00:10.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.189+0000 7f5a546a3b80 1 -- start start 2023-09-30T23:00:10.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.189+0000 7f5a546a3b80 1 Processor -- start 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e51168c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a546a3b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5117aa80 con 0x559e51114450 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e510f4670 con 0x559e510f9f40 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a546a3b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e51169160 con 0x559e5111d4d0 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a546a3b80 10 client.0 _ll_register_callbacks cb 0x559e50e2ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36046/0 (socket says 172.21.15.142:36046) 2023-09-30T23:00:10.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 -- 172.21.15.142:0/3632939112 learned_addr learned my addr 172.21.15.142:0/3632939112 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e51168c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3ffff700 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 -- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 msgr2=0x559e510ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 -- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 msgr2=0x559e51168c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e51168c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.190+0000 7f5a3effd700 1 -- 172.21.15.142:0/3632939112 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3001d040 con 0x559e51114450 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a3effd700 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f3e00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f5a34012a40 tx=0x7f5a34021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490a42f55d3c8eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a1dffb700 1 -- 172.21.15.142:0/3632939112 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34012420 con 0x559e51114450 2023-09-30T23:00:10.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a38056550 con 0x559e51114450 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a1dffb700 1 -- 172.21.15.142:0/3632939112 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a34007ca0 con 0x559e51114450 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a1dffb700 1 -- 172.21.15.142:0/3632939112 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a34001200 con 0x559e51114450 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a546a3b80 10 client.7812 fetch_fsmap learned FSMap version 74 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559e50e841d0 con 0x559e51114450 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a1dffb700 1 -- 172.21.15.142:0/3632939112 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38056550 con 0x559e51114450 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a1dffb700 1 -- 172.21.15.142:0/3632939112 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5a3401f620 con 0x559e51114450 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a546a3b80 10 client.7812 fetch_fsmap finished waiting for FSMap version 74 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a546a3b80 10 client.7812 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.191+0000 7f5a546a3b80 20 client.7812 populate_metadata read hostname 'smithi142' 2023-09-30T23:00:10.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.192+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e510cd200 0x559e510cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.192+0000 7f5a546a3b80 4 client.7812 mds_command: new command op to 7662 tid=0[{"prefix": "status"}] 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.192+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 --> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559e50fc08d0 con 0x559e510cd200 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.192+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e510cd200 0x559e510cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.192+0000 7f5a1dffb700 10 client.7812 ms_handle_connect on v2:172.21.15.148:6832/3293843450 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.192+0000 7f5a3f7fe700 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e510cd200 0x559e510cd5d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d30944ecbef69c78 server_cookie=57f2f457bf450a40 in_seq=0 out_seq=0 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a1dffb700 1 -- 172.21.15.142:0/3632939112 <== mds.0 v2:172.21.15.148:6832/3293843450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x559e50fc08d0 con 0x559e510cd200 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a1dffb700 10 client.7812 handle_command_reply: tid=0 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 client.7812 shutdown 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 msgr2=0x559e510f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f3e00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f5a34012a40 tx=0x7f5a34021070 comp rx=0 tx=0).stop 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 shutdown_connections 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559e5111d4d0 0x559e510ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:6832/3293843450,v1:172.21.15.148:6834/3293843450] conn(0x559e510cd200 0x559e510cd5d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e510f9f40 0x559e51168c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 --2- 172.21.15.142:0/3632939112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e51114450 0x559e510f3e00 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a1dffb700 0 client.7812 ms_handle_reset on v2:172.21.15.148:6832/3293843450 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 >> 172.21.15.142:0/3632939112 conn(0x559e51117880 msgr2=0x559e510f00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 shutdown_connections 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 1 -- 172.21.15.142:0/3632939112 wait complete. 2023-09-30T23:00:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.193+0000 7f5a546a3b80 20 client.7812 trim_cache size 0 max 16384 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 7662, 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 6.4772590790000004, 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 74, 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 159, 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 159, 2023-09-30T23:00:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 12.188884191 2023-09-30T23:00:10.201 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:00:10.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a2c067330 msgr2=0x7f5a2c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a2c067330 0x7f5a2c0697e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5a30001b30 tx=0x7f5a30001aa0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a40154640 msgr2=0x7f5a40154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a40154640 0x7f5a40154ae0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5a400cec10 tx=0x7f5a3800b040 comp rx=0 tx=0).stop 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 shutdown_connections 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5a2c067330 0x7f5a2c0697e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a40154640 0x7f5a40154ae0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a28004810 0x7f5a4014fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 --2- 172.21.15.142:0/4137183595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a40152c10 0x7f5a401698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 >> 172.21.15.142:0/4137183595 conn(0x7f5a400cd540 msgr2=0x7f5a40069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 shutdown_connections 2023-09-30T23:00:10.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.194+0000 7f5a45fff700 1 -- 172.21.15.142:0/4137183595 wait complete. 2023-09-30T23:00:10.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T23:00:10.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.399+0000 7fb1cfbff700 1 Processor -- start 2023-09-30T23:00:10.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.399+0000 7fb1cfbff700 1 -- start start 2023-09-30T23:00:10.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.400+0000 7fb1cfbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 0x7fb1c80cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.400+0000 7fb1cfbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1c80692f0 0x7fb1c815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.400+0000 7fb1cfbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c815e0b0 con 0x7fb1c815dc50 2023-09-30T23:00:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.400+0000 7fb1cfbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c80cc6b0 con 0x7fb1c80692f0 2023-09-30T23:00:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.400+0000 7fb1cfbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80cb7d0 con 0x7fb1c8143350 2023-09-30T23:00:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.401+0000 7fb1ce19c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb1c815dc50 0x7fb1c8068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34274/0 (socket says 172.21.15.142:34274) 2023-09-30T23:00:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.401+0000 7fb1ce19c700 1 -- 172.21.15.142:0/3790151204 learned_addr learned my addr 172.21.15.142:0/3790151204 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:10.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.401+0000 7fb1cd19a700 1 --2- 172.21.15.142:0/3790151204 >> v2:172.21.15.148:3300/0 conn(0x7fb1c80692f0 0x7fb1c815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.401+0000 7fb1cd99b700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 0x7fb1c80cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.401+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139369270 0 0) 0x7fb1c0001490 con 0x7fb1c815dc50 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.401+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b4003570 con 0x7fb1c815dc50 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 380234107 0 0) 0x7fb1b4003570 con 0x7fb1c815dc50 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 msgr2=0x7fb1c80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 0x7fb1c80cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 >> v2:172.21.15.148:3300/0 conn(0x7fb1c80692f0 msgr2=0x7fb1c815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 --2- 172.21.15.142:0/3790151204 >> v2:172.21.15.148:3300/0 conn(0x7fb1c80692f0 0x7fb1c815d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80cbaa0 con 0x7fb1c815dc50 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fb1c0001980 con 0x7fb1c815dc50 2023-09-30T23:00:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd19a700 1 --2- 172.21.15.142:0/3790151204 >> v2:172.21.15.148:3300/0 conn(0x7fb1c80692f0 0x7fb1c815d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 >> v1:172.21.15.142:6789/0 conn(0x7fb1c815dc50 legacy=0x7fb1c8068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b4003a60 0x7fb1b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b4004810 0x7fb1b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 0x7fb1b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80cc6b0 con 0x7fb1b4003a60 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80cb7d0 con 0x7fb1b4004810 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b400ba60 con 0x7fb1c8143350 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd99b700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b4003a60 0x7fb1b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd19a700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b4004810 0x7fb1b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1ce19c700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 0x7fb1b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd99b700 1 -- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 msgr2=0x7fb1b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd99b700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c8143350 0x7fb1b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd99b700 1 -- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b4004810 msgr2=0x7fb1b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd99b700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b4004810 0x7fb1b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd99b700 1 -- 172.21.15.142:0/3790151204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4003570 con 0x7fb1b4003a60 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.402+0000 7fb1cd19a700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1b4004810 0x7fb1b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cd99b700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b4003a60 0x7fb1b4003e70 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009c30 tx=0x7fb1c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2515b39cd330f26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400e710 con 0x7fb1b4003a60 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400e870 con 0x7fb1b4003a60 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cc999700 1 -- 172.21.15.142:0/3790151204 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400ec30 con 0x7fb1b4003a60 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3790151204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b4003a60 msgr2=0x7fb1b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cfbff700 1 --2- 172.21.15.142:0/3790151204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b4003a60 0x7fb1b4003e70 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009c30 tx=0x7fb1c40091a0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1ce19c700 1 -- 172.21.15.142:0/3790151204 reap_dead start 2023-09-30T23:00:10.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3790151204 shutdown_connections 2023-09-30T23:00:10.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.403+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3790151204 >> 172.21.15.142:0/3790151204 conn(0x7fb1c80ce8e0 msgr2=0x7fb1c80cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.404+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3790151204 shutdown_connections 2023-09-30T23:00:10.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.404+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3790151204 wait complete. 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.405+0000 7fb1cfbff700 1 Processor -- start 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.405+0000 7fb1cfbff700 1 -- start start 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cfbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4003a60 0x7fb1c80b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cfbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c815c970 0x7fb1c813f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cfbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c80a6f70 0x7fb1c80a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cfbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80a7950 con 0x7fb1c815c970 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cfbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80a6890 con 0x7fb1c80a6f70 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cfbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c815cde0 con 0x7fb1b4003a60 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c815c970 0x7fb1c813f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c815c970 0x7fb1c813f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36074/0 (socket says 172.21.15.142:36074) 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 -- 172.21.15.142:0/3154755284 learned_addr learned my addr 172.21.15.142:0/3154755284 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 -- 172.21.15.142:0/3154755284 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4003a60 msgr2=0x7fb1c80b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4003a60 0x7fb1c80b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 -- 172.21.15.142:0/3154755284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c80a6f70 msgr2=0x7fb1c80a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c80a6f70 0x7fb1c80a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.406+0000 7fb1cd19a700 1 -- 172.21.15.142:0/3154755284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80b1370 con 0x7fb1c815c970 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.407+0000 7fb1cd19a700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c815c970 0x7fb1c813f4b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009fd0 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.407+0000 7fb1bdffb700 1 -- 172.21.15.142:0/3154755284 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800f9b0 con 0x7fb1c815c970 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.407+0000 7fb1bdffb700 1 -- 172.21.15.142:0/3154755284 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800fb10 con 0x7fb1c815c970 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.407+0000 7fb1bdffb700 1 -- 172.21.15.142:0/3154755284 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800fe90 con 0x7fb1c815c970 2023-09-30T23:00:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.407+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c80a5f60 con 0x7fb1c815c970 2023-09-30T23:00:10.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.407+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80a6520 con 0x7fb1c815c970 2023-09-30T23:00:10.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.408+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c806ea70 con 0x7fb1c815c970 2023-09-30T23:00:10.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.409+0000 7fb1bdffb700 1 -- 172.21.15.142:0/3154755284 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb1b8015670 con 0x7fb1c815c970 2023-09-30T23:00:10.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.410+0000 7fb1bdffb700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb1ac067330 0x7fb1ac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:10.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.410+0000 7fb1bdffb700 1 -- 172.21.15.142:0/3154755284 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1b8085570 con 0x7fb1c815c970 2023-09-30T23:00:10.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.410+0000 7fb1cd99b700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb1ac067330 0x7fb1ac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:10.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.411+0000 7fb1cd99b700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb1ac067330 0x7fb1ac0697e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40091e0 tx=0x7fb1c401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:10.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.415+0000 7fb1bdffb700 1 -- 172.21.15.142:0/3154755284 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb1b80523d0 con 0x7fb1c815c970 2023-09-30T23:00:10.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.647+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1c80a6a00 con 0x7fb1c815c970 2023-09-30T23:00:10.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.648+0000 7fb1bdffb700 1 -- 172.21.15.142:0/3154755284 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb1b80559f0 con 0x7fb1c815c970 2023-09-30T23:00:10.648 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T23:00:10.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb1ac067330 msgr2=0x7fb1ac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb1ac067330 0x7fb1ac0697e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40091e0 tx=0x7fb1c401a000 comp rx=0 tx=0).stop 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c815c970 msgr2=0x7fb1c813f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c815c970 0x7fb1c813f4b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009fd0 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 shutdown_connections 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb1ac067330 0x7fb1ac0697e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c80a6f70 0x7fb1c80a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1b4003a60 0x7fb1c80b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 --2- 172.21.15.142:0/3154755284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c815c970 0x7fb1c813f4b0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 >> 172.21.15.142:0/3154755284 conn(0x7fb1c80ce8e0 msgr2=0x7fb1c8140390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 shutdown_connections 2023-09-30T23:00:10.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:10.650+0000 7fb1cfbff700 1 -- 172.21.15.142:0/3154755284 wait complete. 2023-09-30T23:00:10.667 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T23:00:10.667 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T23:00:10.668 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T23:00:10.668 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T23:00:10.668 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T23:00:10.668 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T23:00:10.668 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T23:00:10.668 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T23:00:10.668 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:00:10.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:10.668 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:10.715 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41847sec preferred_lft 41847sec 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:10.716 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T23:00:10.717 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T23:00:10.718 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:10.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:10.719 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T23:00:10.787 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T23:00:10.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:10.790 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T23:00:10.838 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T23:00:10.838 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T23:00:10.839 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T23:00:10.839 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T23:00:10.839 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T23:00:10.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:10.840 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T23:00:10.840 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T23:00:10.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T23:00:10.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T23:00:10.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T23:00:10.840 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T23:00:11.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:11.008 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T23:00:11.054 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T23:00:11.055 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T23:00:11.056 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:00:11.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:11.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T23:00:11.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:00:11.126 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T23:00:11.172 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:00:11.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:00:11.172 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T23:00:11.257 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T23:00:11.258 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T23:00:11.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:00:11.396 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:00:11.396 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:00:11.396 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:00:11.410 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:00:11.410 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:00:11.410 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:00:11.411 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:00:11.411 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T23:00:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T23:00:11.437 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T23:00:11.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:11.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T23:00:11.506 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T23:00:11.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.695+0000 7f66a31ff700 1 Processor -- start 2023-09-30T23:00:11.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.696+0000 7f66a31ff700 1 -- start start 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a31ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f669c06d3f0 0x7f669c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a31ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a31ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c15dde0 con 0x7f669c06b130 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a31ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c15d7d0 con 0x7f669c06d3f0 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a31ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0c7230 con 0x7f669c0c6da0 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a0f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f669c06d3f0 0x7f669c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a0f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f669c06d3f0 0x7f669c06d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56888/0 (socket says 172.21.15.142:56888) 2023-09-30T23:00:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a179c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f669c06b130 0x7f669c069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:57410/0 (socket says 172.21.15.142:57410) 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.697+0000 7f66a0f9b700 1 -- 172.21.15.142:0/2963440686 learned_addr learned my addr 172.21.15.142:0/2963440686 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f669bfff700 1 --2- 172.21.15.142:0/2963440686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f66a0f9b700 1 -- 172.21.15.142:0/2963440686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 msgr2=0x7f669c15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f66a0f9b700 1 --2- 172.21.15.142:0/2963440686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c15e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f66a0f9b700 1 -- 172.21.15.142:0/2963440686 >> v1:172.21.15.142:6789/0 conn(0x7f669c06b130 legacy=0x7f669c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f66a0f9b700 1 -- 172.21.15.142:0/2963440686 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c15da70 con 0x7f669c06d3f0 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f669b7fe700 1 -- 172.21.15.142:0/2963440686 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45240782 0 0) 0x7f669c15dde0 con 0x7f669c06b130 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f66a0f9b700 1 --2- 172.21.15.142:0/2963440686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06d3f0 0x7f669c06d7c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f66900099b0 tx=0x7f6690009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d49f4a3af9e8a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f669b7fe700 1 -- 172.21.15.142:0/2963440686 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000b860 con 0x7f669c06d3f0 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f669b7fe700 1 -- 172.21.15.142:0/2963440686 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669000b9c0 con 0x7f669c06d3f0 2023-09-30T23:00:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.698+0000 7f669b7fe700 1 -- 172.21.15.142:0/2963440686 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000bd60 con 0x7f669c06d3f0 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 -- 172.21.15.142:0/2963440686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06d3f0 msgr2=0x7f669c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 --2- 172.21.15.142:0/2963440686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06d3f0 0x7f669c06d7c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f66900099b0 tx=0x7f6690009250 comp rx=0 tx=0).stop 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 -- 172.21.15.142:0/2963440686 shutdown_connections 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 --2- 172.21.15.142:0/2963440686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06d3f0 0x7f669c06d7c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 --2- 172.21.15.142:0/2963440686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 -- 172.21.15.142:0/2963440686 >> 172.21.15.142:0/2963440686 conn(0x7f669c067e30 msgr2=0x7f669c068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 -- 172.21.15.142:0/2963440686 shutdown_connections 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.699+0000 7f66a31ff700 1 -- 172.21.15.142:0/2963440686 wait complete. 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.701+0000 7f66a31ff700 1 Processor -- start 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.701+0000 7f66a31ff700 1 -- start start 2023-09-30T23:00:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a31ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06b130 0x7f669c158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a31ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669c06d3f0 0x7f669c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a31ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c13eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a31ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c1585d0 con 0x7f669c06b130 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a31ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c14f5b0 con 0x7f669c06d3f0 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a31ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c156150 con 0x7f669c0c6da0 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06b130 0x7f669c158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06b130 0x7f669c158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56896/0 (socket says 172.21.15.142:56896) 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 -- 172.21.15.142:0/1755070439 learned_addr learned my addr 172.21.15.142:0/1755070439 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a179c700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c13eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f669bfff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669c06d3f0 0x7f669c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 -- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 msgr2=0x7f669c13eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c13eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 -- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669c06d3f0 msgr2=0x7f669c155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669c06d3f0 0x7f669c155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.702+0000 7f66a0f9b700 1 -- 172.21.15.142:0/1755070439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900094f0 con 0x7f669c06b130 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.703+0000 7f66a0f9b700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06b130 0x7f669c158090 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f669c067a40 tx=0x7f6690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.703+0000 7f6698ff9700 1 -- 172.21.15.142:0/1755070439 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690011d70 con 0x7f669c06b130 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.703+0000 7f6698ff9700 1 -- 172.21.15.142:0/1755070439 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690024440 con 0x7f669c06b130 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.703+0000 7f6698ff9700 1 -- 172.21.15.142:0/1755070439 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690024800 con 0x7f669c06b130 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.703+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c1587c0 con 0x7f669c06b130 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.703+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c14f240 con 0x7f669c06b130 2023-09-30T23:00:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.704+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c14f0a0 con 0x7f669c06b130 2023-09-30T23:00:11.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.705+0000 7f6698ff9700 1 -- 172.21.15.142:0/1755070439 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f669001a420 con 0x7f669c06b130 2023-09-30T23:00:11.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.706+0000 7f6698ff9700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6680067330 0x7f66800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:11.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.706+0000 7f6698ff9700 1 -- 172.21.15.142:0/1755070439 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6690086b90 con 0x7f669c06b130 2023-09-30T23:00:11.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.706+0000 7f669bfff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6680067330 0x7f66800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:11.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.706+0000 7f669bfff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6680067330 0x7f66800697e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f669c14f030 tx=0x7f6688008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:11.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.710+0000 7f6698ff9700 1 -- 172.21.15.142:0/1755070439 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f669c14f0a0 con 0x7f669c06b130 2023-09-30T23:00:11.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.951+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f669c14f0a0 con 0x7f669c06b130 2023-09-30T23:00:11.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.951+0000 7f6698ff9700 1 -- 172.21.15.142:0/1755070439 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f669c14f0a0 con 0x7f669c06b130 2023-09-30T23:00:11.951 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6680067330 msgr2=0x7f66800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6680067330 0x7f66800697e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f669c14f030 tx=0x7f6688008040 comp rx=0 tx=0).stop 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06b130 msgr2=0x7f669c158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06b130 0x7f669c158090 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f669c067a40 tx=0x7f6690017000 comp rx=0 tx=0).stop 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 shutdown_connections 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6680067330 0x7f66800697e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669c0c6da0 0x7f669c13eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c06b130 0x7f669c158090 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 --2- 172.21.15.142:0/1755070439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669c06d3f0 0x7f669c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:11.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 >> 172.21.15.142:0/1755070439 conn(0x7f669c067e30 msgr2=0x7f669c15ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:11.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 shutdown_connections 2023-09-30T23:00:11.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:11.954+0000 7f66a31ff700 1 -- 172.21.15.142:0/1755070439 wait complete. 2023-09-30T23:00:11.971 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T23:00:11.971 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T23:00:11.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T23:00:11.971 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T23:00:11.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T23:00:11.972 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T23:00:11.972 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T23:00:11.972 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T23:00:11.972 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:00:11.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:11.972 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T23:00:12.025 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T23:00:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T23:00:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T23:00:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T23:00:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41877sec preferred_lft 41877sec 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:00:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T23:00:12.028 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T23:00:12.028 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:12.028 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:00:12.028 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T23:00:12.028 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T23:00:12.028 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:00:12.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:12.029 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T23:00:12.101 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T23:00:12.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:12.104 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T23:00:12.154 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T23:00:12.155 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T23:00:12.155 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T23:00:12.155 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T23:00:12.155 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T23:00:12.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:12.156 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T23:00:12.156 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T23:00:12.156 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T23:00:12.156 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T23:00:12.156 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T23:00:12.156 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T23:00:12.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:12.327 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T23:00:12.373 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T23:00:12.373 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T23:00:12.374 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:00:12.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:12.374 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T23:00:12.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:00:12.445 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T23:00:12.491 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:00:12.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:00:12.493 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T23:00:12.577 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T23:00:12.577 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T23:00:12.577 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:00:12.717 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:00:12.717 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:00:12.718 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:00:12.732 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:00:12.732 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:00:12.732 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:00:12.732 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:00:12.732 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:00:12.752 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:00:12.752 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:00:12.752 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:00:12.752 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:00:12.752 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:00:12.752 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T23:00:12.753 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T23:00:12.753 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T23:00:12.757 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T23:00:12.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:00:12.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T23:00:12.826 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:00:13.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.021+0000 7f4fdd1ff700 1 Processor -- start 2023-09-30T23:00:13.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.021+0000 7f4fdd1ff700 1 -- start start 2023-09-30T23:00:13.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fdd1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fd80b00d0 0x7f4fd806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fdd1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 0x7f4fd815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fdd1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd806d3e0 con 0x7f4fd80af020 2023-09-30T23:00:13.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fdd1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd806dc80 con 0x7f4fd80b00d0 2023-09-30T23:00:13.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fdd1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd806b790 con 0x7f4fd806e650 2023-09-30T23:00:13.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fd6d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4fd80af020 0x7f4fd8156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:57418/0 (socket says 172.21.15.142:57418) 2023-09-30T23:00:13.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fd6d9d700 1 -- 172.21.15.142:0/1758469056 learned_addr learned my addr 172.21.15.142:0/1758469056 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:13.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fd759e700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 0x7f4fd815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247574134 0 0) 0x7f4fd806d3e0 con 0x7f4fd80af020 2023-09-30T23:00:13.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fd659c700 1 --2- 172.21.15.142:0/1758469056 >> v2:172.21.15.148:3300/0 conn(0x7f4fd80b00d0 0x7f4fd806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.023+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc0003570 con 0x7f4fd80af020 2023-09-30T23:00:13.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 642881324 0 0) 0x7f4fc0003570 con 0x7f4fd80af020 2023-09-30T23:00:13.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 msgr2=0x7f4fd815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:13.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 0x7f4fd815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 >> v2:172.21.15.148:3300/0 conn(0x7f4fd80b00d0 msgr2=0x7f4fd806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:13.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 --2- 172.21.15.142:0/1758469056 >> v2:172.21.15.148:3300/0 conn(0x7f4fd80b00d0 0x7f4fd806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80b0650 con 0x7f4fd80af020 2023-09-30T23:00:13.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f4fc8001470 con 0x7f4fd80af020 2023-09-30T23:00:13.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 >> v1:172.21.15.142:6789/0 conn(0x7f4fd80af020 legacy=0x7f4fd8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc0003a60 0x7f4fc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc0004810 0x7f4fc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 0x7f4fc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd806dc80 con 0x7f4fc0004810 2023-09-30T23:00:13.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd806b790 con 0x7f4fc0003a60 2023-09-30T23:00:13.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc000ba60 con 0x7f4fd806e650 2023-09-30T23:00:13.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd659c700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc0004810 0x7f4fc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd759e700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 0x7f4fc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.024+0000 7f4fd6d9d700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc0003a60 0x7f4fc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd659c700 1 -- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 msgr2=0x7f4fc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:13.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd659c700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 0x7f4fc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd659c700 1 -- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc0003a60 msgr2=0x7f4fc0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:00:13.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd659c700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc0003a60 0x7f4fc0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd659c700 1 -- 172.21.15.142:0/1758469056 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0003570 con 0x7f4fc0004810 2023-09-30T23:00:13.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd759e700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fd806e650 0x7f4fc00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:00:13.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd659c700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc0004810 0x7f4fc0004c80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc010240 tx=0x7f4fcc00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f698ebdf8c7391 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:13.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc010af0 con 0x7f4fc0004810 2023-09-30T23:00:13.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc011040 con 0x7f4fc0004810 2023-09-30T23:00:13.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.025+0000 7f4fd5d9b700 1 -- 172.21.15.142:0/1758469056 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc010ea0 con 0x7f4fc0004810 2023-09-30T23:00:13.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.026+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/1758469056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc0004810 msgr2=0x7f4fc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.026+0000 7f4fdd1ff700 1 --2- 172.21.15.142:0/1758469056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc0004810 0x7f4fc0004c80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc010240 tx=0x7f4fcc00d040 comp rx=0 tx=0).stop 2023-09-30T23:00:13.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.026+0000 7f4fd759e700 1 -- 172.21.15.142:0/1758469056 reap_dead start 2023-09-30T23:00:13.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.026+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/1758469056 shutdown_connections 2023-09-30T23:00:13.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.026+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/1758469056 >> 172.21.15.142:0/1758469056 conn(0x7f4fd80680c0 msgr2=0x7f4fd80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:13.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.026+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/1758469056 shutdown_connections 2023-09-30T23:00:13.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.026+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/1758469056 wait complete. 2023-09-30T23:00:13.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.027+0000 7f4fdd1ff700 1 Processor -- start 2023-09-30T23:00:13.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.027+0000 7f4fdd1ff700 1 -- start start 2023-09-30T23:00:13.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.028+0000 7f4fdd1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0004810 0x7f4fd813e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.028+0000 7f4fdd1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fd80a6590 0x7f4fd80a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.028+0000 7f4fdd1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fd80a9c10 0x7f4fd80aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.028+0000 7f4fdd1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80acc80 con 0x7f4fd80a6590 2023-09-30T23:00:13.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.028+0000 7f4fdd1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80aa5f0 con 0x7f4fd80a9c10 2023-09-30T23:00:13.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.028+0000 7f4fdd1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80ac070 con 0x7f4fc0004810 2023-09-30T23:00:13.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fd80a6590 0x7f4fd80a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0004810 0x7f4fd813e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0004810 0x7f4fd813e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:46260/0 (socket says 172.21.15.142:46260) 2023-09-30T23:00:13.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 -- 172.21.15.142:0/2925001495 learned_addr learned my addr 172.21.15.142:0/2925001495 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:13.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd659c700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fd80a6590 0x7f4fd80a6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56914/0 (socket says 172.21.15.142:56914) 2023-09-30T23:00:13.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd759e700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fd80a9c10 0x7f4fd80aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 -- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fd80a9c10 msgr2=0x7f4fd80aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fd80a9c10 0x7f4fd80aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 -- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fd80a6590 msgr2=0x7f4fd80a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fd80a6590 0x7f4fd80a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 -- 172.21.15.142:0/2925001495 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80ac350 con 0x7f4fc0004810 2023-09-30T23:00:13.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd659c700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fd80a6590 0x7f4fd80a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:00:13.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fd6d9d700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0004810 0x7f4fd813e900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8001c40 tx=0x7f4fd806dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:13.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fbeffd700 1 -- 172.21.15.142:0/2925001495 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8018030 con 0x7f4fc0004810 2023-09-30T23:00:13.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fbeffd700 1 -- 172.21.15.142:0/2925001495 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800f850 con 0x7f4fc0004810 2023-09-30T23:00:13.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fbeffd700 1 -- 172.21.15.142:0/2925001495 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8007800 con 0x7f4fc0004810 2023-09-30T23:00:13.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.029+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd80ac630 con 0x7f4fc0004810 2023-09-30T23:00:13.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.030+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80abc90 con 0x7f4fc0004810 2023-09-30T23:00:13.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.030+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd80695b0 con 0x7f4fc0004810 2023-09-30T23:00:13.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.031+0000 7f4fbeffd700 1 -- 172.21.15.142:0/2925001495 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4fc801b070 con 0x7f4fc0004810 2023-09-30T23:00:13.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.032+0000 7f4fbeffd700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4fc4067330 0x7f4fc40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.032+0000 7f4fbeffd700 1 -- 172.21.15.142:0/2925001495 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4fc8019070 con 0x7f4fc0004810 2023-09-30T23:00:13.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.033+0000 7f4fd659c700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4fc4067330 0x7f4fc40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.033+0000 7f4fd659c700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4fc4067330 0x7f4fc40697e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00bc30 tx=0x7f4fcc01c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:13.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.037+0000 7f4fbeffd700 1 -- 172.21.15.142:0/2925001495 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4fc8051970 con 0x7f4fc0004810 2023-09-30T23:00:13.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.268+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fd806fc10 con 0x7f4fc0004810 2023-09-30T23:00:13.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.269+0000 7f4fbeffd700 1 -- 172.21.15.142:0/2925001495 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f4fc8054f90 con 0x7f4fc0004810 2023-09-30T23:00:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:00:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:00:03.199135+0000","modified":"2023-09-30T23:00:06.755986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/3293843450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3293843450},{"type":"v1","addr":"172.21.15.148:6834","nonce":3293843450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.271+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4fc4067330 msgr2=0x7f4fc40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.271+0000 7f4fdd1ff700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4fc4067330 0x7f4fc40697e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00bc30 tx=0x7f4fcc01c000 comp rx=0 tx=0).stop 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.271+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0004810 msgr2=0x7f4fd813e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.271+0000 7f4fdd1ff700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0004810 0x7f4fd813e900 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8001c40 tx=0x7f4fd806dbf0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 shutdown_connections 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4fc4067330 0x7f4fc40697e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fd80a9c10 0x7f4fd80aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0004810 0x7f4fd813e900 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 --2- 172.21.15.142:0/2925001495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fd80a6590 0x7f4fd80a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 >> 172.21.15.142:0/2925001495 conn(0x7f4fd80680c0 msgr2=0x7f4fd8152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:13.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 shutdown_connections 2023-09-30T23:00:13.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.272+0000 7f4fdd1ff700 1 -- 172.21.15.142:0/2925001495 wait complete. 2023-09-30T23:00:13.273 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 74 2023-09-30T23:00:13.289 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-30T23:00:13.501 INFO:teuthology.orchestra.run.smithi148.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":7662,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.7716873930000006,"mdsmap_epoch":74,"osdmap_epoch":159,"osdmap_epoch_barrier":159,"uptime":15.483313665000001} 2023-09-30T23:00:13.502 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 7662, "mdsmap_epoch": 74, "osdmap_epoch": 159, "osdmap_epoch_barrier": 159, "rank_uptime": 9.771687393, "state": "up:active", "uptime": 15.483313665, "want_state": "up:active", "whoami": 0 } 2023-09-30T23:00:13.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-30T23:00:13.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.697+0000 7fb5d01ff700 1 Processor -- start 2023-09-30T23:00:13.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.697+0000 7fb5d01ff700 1 -- start start 2023-09-30T23:00:13.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.698+0000 7fb5d01ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5c815a220 0x7fb5c80cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.698+0000 7fb5d01ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c80d04e0 con 0x7fb5c815ac40 2023-09-30T23:00:13.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.698+0000 7fb5d01ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c80cc8f0 con 0x7fb5c80cc280 2023-09-30T23:00:13.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.698+0000 7fb5d01ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c815a680 con 0x7fb5c815a220 2023-09-30T23:00:13.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5cdf9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb5c815ac40 0x7fb5c80cbb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:57432/0 (socket says 172.21.15.142:57432) 2023-09-30T23:00:13.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5cdf9b700 1 -- 172.21.15.142:0/3037212494 learned_addr learned my addr 172.21.15.142:0/3037212494 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:00:13.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ce79c700 1 --2- 172.21.15.142:0/3037212494 >> v2:172.21.15.148:3300/0 conn(0x7fb5c815a220 0x7fb5c80cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ccf99700 1 -- 172.21.15.142:0/3037212494 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227803763 0 0) 0x7fb5c80d04e0 con 0x7fb5c815ac40 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ccf99700 1 -- 172.21.15.142:0/3037212494 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b4003570 con 0x7fb5c815ac40 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ccf99700 1 -- 172.21.15.142:0/3037212494 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728746944 0 0) 0x7fb5c80cc8f0 con 0x7fb5c80cc280 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ccf99700 1 -- 172.21.15.142:0/3037212494 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c80d04e0 con 0x7fb5c80cc280 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ce79c700 1 -- 172.21.15.142:0/3037212494 >> v1:172.21.15.148:6789/0 conn(0x7fb5c80cc280 legacy=0x7fb5c806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ce79c700 1 -- 172.21.15.142:0/3037212494 >> v1:172.21.15.142:6789/0 conn(0x7fb5c815ac40 legacy=0x7fb5c80cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ce79c700 1 -- 172.21.15.142:0/3037212494 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80cf8d0 con 0x7fb5c815a220 2023-09-30T23:00:13.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.699+0000 7fb5ce79c700 1 --2- 172.21.15.142:0/3037212494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c815a220 0x7fb5c80cf180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009e60 tx=0x7fb5c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ef370e525258b3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5ccf99700 1 -- 172.21.15.142:0/3037212494 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000e070 con 0x7fb5c815a220 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5ccf99700 1 -- 172.21.15.142:0/3037212494 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c000bab0 con 0x7fb5c815a220 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5ccf99700 1 -- 172.21.15.142:0/3037212494 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000be70 con 0x7fb5c815a220 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5d01ff700 1 -- 172.21.15.142:0/3037212494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c815a220 msgr2=0x7fb5c80cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/3037212494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c815a220 0x7fb5c80cf180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009e60 tx=0x7fb5c0009780 comp rx=0 tx=0).stop 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5d01ff700 1 -- 172.21.15.142:0/3037212494 shutdown_connections 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/3037212494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c815a220 0x7fb5c80cf180 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5d01ff700 1 -- 172.21.15.142:0/3037212494 >> 172.21.15.142:0/3037212494 conn(0x7fb5c80d0a80 msgr2=0x7fb5c80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.700+0000 7fb5d01ff700 1 -- 172.21.15.142:0/3037212494 shutdown_connections 2023-09-30T23:00:13.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.701+0000 7fb5d01ff700 1 -- 172.21.15.142:0/3037212494 wait complete. 2023-09-30T23:00:13.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.702+0000 7fb5d01ff700 1 Processor -- start 2023-09-30T23:00:13.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.702+0000 7fb5d01ff700 1 -- start start 2023-09-30T23:00:13.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5d01ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c80cc280 0x7fb5c8156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5d01ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c815a220 0x7fb5c814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5d01ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c815ac40 0x7fb5c81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5d01ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c8158840 con 0x7fb5c815ac40 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5d01ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c8158b20 con 0x7fb5c80cc280 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5d01ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c8158e00 con 0x7fb5c815a220 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5ce79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c815ac40 0x7fb5c81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5ce79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c815ac40 0x7fb5c81598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56918/0 (socket says 172.21.15.142:56918) 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5ce79c700 1 -- 172.21.15.142:0/1175956039 learned_addr learned my addr 172.21.15.142:0/1175956039 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5cdf9b700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c80cc280 0x7fb5c8156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.703+0000 7fb5cd79a700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c815a220 0x7fb5c814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5ce79c700 1 -- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c815a220 msgr2=0x7fb5c814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5ce79c700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c815a220 0x7fb5c814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5ce79c700 1 -- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c80cc280 msgr2=0x7fb5c8156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5ce79c700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c80cc280 0x7fb5c8156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5ce79c700 1 -- 172.21.15.142:0/1175956039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c0009a20 con 0x7fb5c815ac40 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5ce79c700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c815ac40 0x7fb5c81598e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb5c806cee0 tx=0x7fb5c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5bdffb700 1 -- 172.21.15.142:0/1175956039 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0012db0 con 0x7fb5c815ac40 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5bdffb700 1 -- 172.21.15.142:0/1175956039 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0026480 con 0x7fb5c815ac40 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5bdffb700 1 -- 172.21.15.142:0/1175956039 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0026840 con 0x7fb5c815ac40 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.704+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c81590e0 con 0x7fb5c815ac40 2023-09-30T23:00:13.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.705+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c8156e50 con 0x7fb5c815ac40 2023-09-30T23:00:13.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.705+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8069770 con 0x7fb5c815ac40 2023-09-30T23:00:13.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.706+0000 7fb5bdffb700 1 -- 172.21.15.142:0/1175956039 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb5c001c400 con 0x7fb5c815ac40 2023-09-30T23:00:13.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.707+0000 7fb5bdffb700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb5ac067330 0x7fb5ac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:00:13.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.707+0000 7fb5bdffb700 1 -- 172.21.15.142:0/1175956039 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb5c0086b30 con 0x7fb5c815ac40 2023-09-30T23:00:13.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.708+0000 7fb5cdf9b700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb5ac067330 0x7fb5ac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:00:13.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.708+0000 7fb5cdf9b700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb5ac067330 0x7fb5ac0697e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4007fd0 tx=0x7fb5c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:00:13.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.712+0000 7fb5bdffb700 1 -- 172.21.15.142:0/1175956039 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb5c0053990 con 0x7fb5c815ac40 2023-09-30T23:00:13.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:13.901+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fb5c80c84f0 con 0x7fb5c815ac40 2023-09-30T23:00:14.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.014+0000 7fb5bdffb700 1 -- 172.21.15.142:0/1175956039 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v160) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb5c002b0c0 con 0x7fb5c815ac40 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.016+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb5ac067330 msgr2=0x7fb5ac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.016+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb5ac067330 0x7fb5ac0697e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4007fd0 tx=0x7fb5c4009040 comp rx=0 tx=0).stop 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.016+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c815ac40 msgr2=0x7fb5c81598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.016+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c815ac40 0x7fb5c81598e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb5c806cee0 tx=0x7fb5c0019000 comp rx=0 tx=0).stop 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 shutdown_connections 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb5ac067330 0x7fb5ac0697e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c815ac40 0x7fb5c81598e0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5c80cc280 0x7fb5c8156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:14.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 --2- 172.21.15.142:0/1175956039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5c815a220 0x7fb5c814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:00:14.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 >> 172.21.15.142:0/1175956039 conn(0x7fb5c80d0a80 msgr2=0x7fb5c814fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:00:14.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 shutdown_connections 2023-09-30T23:00:14.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:00:14.017+0000 7fb5d01ff700 1 -- 172.21.15.142:0/1175956039 wait complete. 2023-09-30T23:00:14.018 INFO:teuthology.orchestra.run.smithi142.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-30T23:00:14.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T23:00:14.244 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T23:00:14.244 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T23:00:14.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-30T23:00:14.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:00:14.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:00:14.452 INFO:teuthology.orchestra.run.smithi142.stdout:{"mon_tick_interval":"5"} 2023-09-30T23:00:14.452 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-30T23:00:14.453 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> import time 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> import datetime 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> # Write some buffered data through before going full, all should be well 2023-09-30T23:00:14.453 DEBUG:teuthology.orchestra.run.smithi142:> print("writing some data through which we expect to succeed") 2023-09-30T23:00:14.454 DEBUG:teuthology.orchestra.run.smithi142:> bytes = 0 2023-09-30T23:00:14.454 DEBUG:teuthology.orchestra.run.smithi142:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-30T23:00:14.454 DEBUG:teuthology.orchestra.run.smithi142:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-30T23:00:14.454 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-09-30T23:00:14.454 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T23:00:14.454 DEBUG:teuthology.orchestra.run.smithi142:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-30T23:00:14.455 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.455 DEBUG:teuthology.orchestra.run.smithi142:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-30T23:00:14.455 DEBUG:teuthology.orchestra.run.smithi142:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-30T23:00:14.455 DEBUG:teuthology.orchestra.run.smithi142:> # buffered IO, the error should always only appear from fsync and not 2023-09-30T23:00:14.455 DEBUG:teuthology.orchestra.run.smithi142:> # from write 2023-09-30T23:00:14.455 DEBUG:teuthology.orchestra.run.smithi142:> full = False 2023-09-30T23:00:14.456 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.456 DEBUG:teuthology.orchestra.run.smithi142:> for n in range(0, int(32 * 0.9)): 2023-09-30T23:00:14.456 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-30T23:00:14.456 DEBUG:teuthology.orchestra.run.smithi142:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-09-30T23:00:14.456 DEBUG:teuthology.orchestra.run.smithi142:> print("done writing {0} bytes".format(bytes)) 2023-09-30T23:00:14.456 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.457 DEBUG:teuthology.orchestra.run.smithi142:> # OK, now we should sneak in under the full condition 2023-09-30T23:00:14.457 DEBUG:teuthology.orchestra.run.smithi142:> # due to the time it takes the OSDs to report to the 2023-09-30T23:00:14.457 DEBUG:teuthology.orchestra.run.smithi142:> # mons, and get a successful fsync on our full-making data 2023-09-30T23:00:14.457 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T23:00:14.457 DEBUG:teuthology.orchestra.run.smithi142:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-09-30T23:00:14.458 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.458 DEBUG:teuthology.orchestra.run.smithi142:> # buffered write, add more dirty data to the buffer 2023-09-30T23:00:14.458 DEBUG:teuthology.orchestra.run.smithi142:> print("starting buffered write") 2023-09-30T23:00:14.458 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T23:00:14.458 DEBUG:teuthology.orchestra.run.smithi142:> for n in range(0, int(32 * 0.2)): 2023-09-30T23:00:14.459 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-30T23:00:14.459 DEBUG:teuthology.orchestra.run.smithi142:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-30T23:00:14.459 DEBUG:teuthology.orchestra.run.smithi142:> time.sleep(15.0) 2023-09-30T23:00:14.459 DEBUG:teuthology.orchestra.run.smithi142:> except OSError: 2023-09-30T23:00:14.459 DEBUG:teuthology.orchestra.run.smithi142:> pass; 2023-09-30T23:00:14.459 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.460 DEBUG:teuthology.orchestra.run.smithi142:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-09-30T23:00:14.460 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.460 DEBUG:teuthology.orchestra.run.smithi142:> # Wait long enough for a background flush that should fail 2023-09-30T23:00:14.460 DEBUG:teuthology.orchestra.run.smithi142:> time.sleep(30) 2023-09-30T23:00:14.460 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.460 DEBUG:teuthology.orchestra.run.smithi142:> if False: 2023-09-30T23:00:14.461 DEBUG:teuthology.orchestra.run.smithi142:> # ...and check that the failed background flush is reflected in fclose 2023-09-30T23:00:14.461 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T23:00:14.461 DEBUG:teuthology.orchestra.run.smithi142:> os.close(f) 2023-09-30T23:00:14.461 DEBUG:teuthology.orchestra.run.smithi142:> except OSError: 2023-09-30T23:00:14.461 DEBUG:teuthology.orchestra.run.smithi142:> print("close() returned an error as expected") 2023-09-30T23:00:14.461 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T23:00:14.461 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("close() failed to raise error") 2023-09-30T23:00:14.462 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T23:00:14.462 DEBUG:teuthology.orchestra.run.smithi142:> # The kernel cephfs client does not raise errors on fclose 2023-09-30T23:00:14.462 DEBUG:teuthology.orchestra.run.smithi142:> os.close(f) 2023-09-30T23:00:14.462 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:00:14.462 DEBUG:teuthology.orchestra.run.smithi142:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-30T23:00:14.463 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T23:00:44.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:00:44.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:14.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:14.562 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:44.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:44.670 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:14.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:14.822 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:18.242 INFO:teuthology.orchestra.run.smithi142.stdout:writing some data through which we expect to succeed 2023-09-30T23:02:18.242 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-30T23:02:18.242 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-09-30T23:02:18.242 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-09-30T23:02:18.242 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-09-30T23:02:18.242 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-09-30T23:02:18.243 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-09-30T23:02:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:done writing 29884416 bytes 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:successfully fsync'ed prior to getting full state reported 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:starting buffered write 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:02:18.245 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:02:18.246 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:02:18.246 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:02:18.246 INFO:teuthology.orchestra.run.smithi142.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-09-30T23:02:18.375 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T23:02:18.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:02:18.477 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:02:18.586 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T23:02:18.586 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T23:02:18.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:02:18.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T23:02:18.679 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:02:18.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:18.679 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T23:02:18.727 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T23:02:18.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:02:18.727 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T23:02:18.818 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:02:18.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:18.819 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T23:02:18.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:19.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.061+0000 7f804b9ff700 1 Processor -- start 2023-09-30T23:02:19.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.061+0000 7f804b9ff700 1 -- start start 2023-09-30T23:02:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.062+0000 7f804b9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f804406e820 0x7f8044161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f804b9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804406d3e0 con 0x7f80440b00d0 2023-09-30T23:02:19.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f804b9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804406dc80 con 0x7f80440af020 2023-09-30T23:02:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f804b9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804415b400 con 0x7f804406e820 2023-09-30T23:02:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f8048f9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f80440b00d0 0x7f804406e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37890/0 (socket says 172.21.15.142:37890) 2023-09-30T23:02:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f8048f9a700 1 -- 172.21.15.142:0/2859390604 learned_addr learned my addr 172.21.15.142:0/2859390604 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:19.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f8049f9c700 1 --2- 172.21.15.142:0/2859390604 >> v2:172.21.15.148:3300/0 conn(0x7f804406e820 0x7f8044161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f803bfff700 1 -- 172.21.15.142:0/2859390604 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446835263 0 0) 0x7f804406d3e0 con 0x7f80440b00d0 2023-09-30T23:02:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f803bfff700 1 -- 172.21.15.142:0/2859390604 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8030003570 con 0x7f80440b00d0 2023-09-30T23:02:19.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f8049f9c700 1 -- 172.21.15.142:0/2859390604 >> v1:172.21.15.148:6789/0 conn(0x7f80440af020 legacy=0x7f8044156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.063+0000 7f8049f9c700 1 -- 172.21.15.142:0/2859390604 >> v1:172.21.15.142:6789/0 conn(0x7f80440b00d0 legacy=0x7f804406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.064+0000 7f8049f9c700 1 -- 172.21.15.142:0/2859390604 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804406eca0 con 0x7f804406e820 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.064+0000 7f8049f9c700 1 --2- 172.21.15.142:0/2859390604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804406e820 0x7f8044161790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f803c009e90 tx=0x7f803c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a59903892bc0dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.064+0000 7f803bfff700 1 -- 172.21.15.142:0/2859390604 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00e070 con 0x7f804406e820 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.064+0000 7f803bfff700 1 -- 172.21.15.142:0/2859390604 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00bc40 con 0x7f804406e820 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.064+0000 7f803bfff700 1 -- 172.21.15.142:0/2859390604 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c012430 con 0x7f804406e820 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.065+0000 7f804b9ff700 1 -- 172.21.15.142:0/2859390604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804406e820 msgr2=0x7f8044161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.065+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2859390604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804406e820 0x7f8044161790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f803c009e90 tx=0x7f803c009780 comp rx=0 tx=0).stop 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.065+0000 7f804b9ff700 1 -- 172.21.15.142:0/2859390604 shutdown_connections 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.065+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2859390604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804406e820 0x7f8044161790 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.065+0000 7f804b9ff700 1 -- 172.21.15.142:0/2859390604 >> 172.21.15.142:0/2859390604 conn(0x7f80440680c0 msgr2=0x7f80440c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:19.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.065+0000 7f804b9ff700 1 -- 172.21.15.142:0/2859390604 shutdown_connections 2023-09-30T23:02:19.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.065+0000 7f804b9ff700 1 -- 172.21.15.142:0/2859390604 wait complete. 2023-09-30T23:02:19.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.067+0000 7f804b9ff700 1 Processor -- start 2023-09-30T23:02:19.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.067+0000 7f804b9ff700 1 -- start start 2023-09-30T23:02:19.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.068+0000 7f804b9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f804406e820 0x7f8044157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.068+0000 7f804b9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80440af020 0x7f804416ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.068+0000 7f804b9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80440b00d0 0x7f8044169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.068+0000 7f804b9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804414dfa0 con 0x7f80440af020 2023-09-30T23:02:19.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.068+0000 7f804b9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804416b180 con 0x7f80440b00d0 2023-09-30T23:02:19.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.068+0000 7f804b9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804416e240 con 0x7f804406e820 2023-09-30T23:02:19.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.068+0000 7f8048f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80440af020 0x7f804416ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80440af020 0x7f804416ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44528/0 (socket says 172.21.15.142:44528) 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 -- 172.21.15.142:0/2374386821 learned_addr learned my addr 172.21.15.142:0/2374386821 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8049f9c700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80440b00d0 0x7f8044169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f804979b700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f804406e820 0x7f8044157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 -- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f804406e820 msgr2=0x7f8044157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f804406e820 0x7f8044157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 -- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80440b00d0 msgr2=0x7f8044169ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80440b00d0 0x7f8044169ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 -- 172.21.15.142:0/2374386821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c009a20 con 0x7f80440af020 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8049f9c700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80440b00d0 0x7f8044169ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f8048f9a700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80440af020 0x7f804416ac40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f803400c590 tx=0x7f8034007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034005b30 con 0x7f80440af020 2023-09-30T23:02:19.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034005cb0 con 0x7f80440af020 2023-09-30T23:02:19.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034007320 con 0x7f80440af020 2023-09-30T23:02:19.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.069+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8044157cd0 con 0x7f80440af020 2023-09-30T23:02:19.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.070+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804416ded0 con 0x7f80440af020 2023-09-30T23:02:19.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.071+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804416da60 con 0x7f80440af020 2023-09-30T23:02:19.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.071+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f803401b3b0 con 0x7f80440af020 2023-09-30T23:02:19.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.072+0000 7f80397fa700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8028067330 0x7f80280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.072+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f80340842f0 con 0x7f80440af020 2023-09-30T23:02:19.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.072+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f802806f6d0 con 0x7f80440af020 2023-09-30T23:02:19.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.072+0000 7f804979b700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8028067330 0x7f80280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.073+0000 7f804979b700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8028067330 0x7f80280697e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8040003860 tx=0x7f8040009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.077+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f80340510c0 con 0x7f80440af020 2023-09-30T23:02:19.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.309+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f804416e380 con 0x7f80440af020 2023-09-30T23:02:19.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.310+0000 7f80397fa700 1 -- 172.21.15.142:0/2374386821 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f8034017030 con 0x7f80440af020 2023-09-30T23:02:19.311 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:19.311 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:00:03.199135+0000","modified":"2023-09-30T23:00:06.755986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/3293843450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3293843450},{"type":"v1","addr":"172.21.15.148:6834","nonce":3293843450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-09-30T23:02:19.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.312+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8028067330 msgr2=0x7f80280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.312+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8028067330 0x7f80280697e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8040003860 tx=0x7f8040009040 comp rx=0 tx=0).stop 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.312+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80440af020 msgr2=0x7f804416ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.312+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80440af020 0x7f804416ac40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f803400c590 tx=0x7f8034007e00 comp rx=0 tx=0).stop 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 shutdown_connections 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8028067330 0x7f80280697e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80440b00d0 0x7f8044169ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f804406e820 0x7f8044157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 --2- 172.21.15.142:0/2374386821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80440af020 0x7f804416ac40 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 >> 172.21.15.142:0/2374386821 conn(0x7f80440680c0 msgr2=0x7f804415a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 shutdown_connections 2023-09-30T23:02:19.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.313+0000 7f804b9ff700 1 -- 172.21.15.142:0/2374386821 wait complete. 2023-09-30T23:02:19.315 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 74 2023-09-30T23:02:19.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:02:19.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.520+0000 7f8ced1ff700 1 Processor -- start 2023-09-30T23:02:19.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.520+0000 7f8ced1ff700 1 -- start start 2023-09-30T23:02:19.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ced1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ce8159ae0 0x7f8ce80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ced1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce815d910 con 0x7f8ce80b1180 2023-09-30T23:02:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ced1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce815e490 con 0x7f8ce80cc590 2023-09-30T23:02:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ced1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce815e920 con 0x7f8ce8159ae0 2023-09-30T23:02:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ce6d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ce8159ae0 0x7f8ce80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ce659c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8ce80b1180 0x7f8ce80cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37902/0 (socket says 172.21.15.142:37902) 2023-09-30T23:02:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ce659c700 1 -- 172.21.15.142:0/2393536467 learned_addr learned my addr 172.21.15.142:0/2393536467 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:19.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ce6d9d700 1 -- 172.21.15.142:0/2393536467 >> v1:172.21.15.148:6789/0 conn(0x7f8ce80cc590 legacy=0x7f8ce8069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ce6d9d700 1 -- 172.21.15.142:0/2393536467 >> v1:172.21.15.142:6789/0 conn(0x7f8ce80b1180 legacy=0x7f8ce80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.523+0000 7f8ce6d9d700 1 -- 172.21.15.142:0/2393536467 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce815db60 con 0x7f8ce8159ae0 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.522+0000 7f8ce5d9b700 1 -- 172.21.15.142:0/2393536467 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154972560 0 0) 0x7f8ce815d910 con 0x7f8ce80b1180 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.523+0000 7f8ce6d9d700 1 --2- 172.21.15.142:0/2393536467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80cdeb0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80098e0 tx=0x7f8cd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b225c20cd159d27 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.523+0000 7f8ce5d9b700 1 -- 172.21.15.142:0/2393536467 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8009e80 con 0x7f8ce8159ae0 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.523+0000 7f8ce5d9b700 1 -- 172.21.15.142:0/2393536467 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800b860 con 0x7f8ce8159ae0 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.523+0000 7f8ce5d9b700 1 -- 172.21.15.142:0/2393536467 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800bbe0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.523+0000 7f8ced1ff700 1 -- 172.21.15.142:0/2393536467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 msgr2=0x7f8ce80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.523+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/2393536467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80cdeb0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80098e0 tx=0x7f8cd80091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.524+0000 7f8ced1ff700 1 -- 172.21.15.142:0/2393536467 shutdown_connections 2023-09-30T23:02:19.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.524+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/2393536467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80cdeb0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.524+0000 7f8ced1ff700 1 -- 172.21.15.142:0/2393536467 >> 172.21.15.142:0/2393536467 conn(0x7f8ce80ce8b0 msgr2=0x7f8ce80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:19.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.524+0000 7f8ced1ff700 1 -- 172.21.15.142:0/2393536467 shutdown_connections 2023-09-30T23:02:19.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.524+0000 7f8ced1ff700 1 -- 172.21.15.142:0/2393536467 wait complete. 2023-09-30T23:02:19.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.525+0000 7f8ced1ff700 1 Processor -- start 2023-09-30T23:02:19.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.525+0000 7f8ced1ff700 1 -- start start 2023-09-30T23:02:19.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.526+0000 7f8ced1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ce80b1180 0x7f8ce816acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.526+0000 7f8ced1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ce80cc590 0x7f8ce80c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.526+0000 7f8ced1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.526+0000 7f8ced1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c8920 con 0x7f8ce8159ae0 2023-09-30T23:02:19.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.526+0000 7f8ced1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c7d10 con 0x7f8ce80cc590 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.526+0000 7f8ced1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c7ff0 con 0x7f8ce80b1180 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.526+0000 7f8ce759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44536/0 (socket says 172.21.15.142:44536) 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 -- 172.21.15.142:0/94187054 learned_addr learned my addr 172.21.15.142:0/94187054 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce659c700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ce80cc590 0x7f8ce80c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce6d9d700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ce80b1180 0x7f8ce816acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 -- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ce80b1180 msgr2=0x7f8ce816acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ce80b1180 0x7f8ce816acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 -- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ce80cc590 msgr2=0x7f8ce80c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ce80cc590 0x7f8ce80c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 -- 172.21.15.142:0/94187054 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8009420 con 0x7f8ce8159ae0 2023-09-30T23:02:19.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ce759e700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80b3ab0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c8e0 tx=0x7f8ce0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000ce80 con 0x7f8ce8159ae0 2023-09-30T23:02:19.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce000a7e0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce80c82d0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000ab80 con 0x7f8ce8159ae0 2023-09-30T23:02:19.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.527+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce80c8db0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.529+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce80c8a90 con 0x7f8ce8159ae0 2023-09-30T23:02:19.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.529+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8ce0012420 con 0x7f8ce8159ae0 2023-09-30T23:02:19.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.530+0000 7f8cceffd700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cd4067330 0x7f8cd40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.530+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f8ce0084fd0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.530+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f8cd406f6d0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.530+0000 7f8ce6d9d700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cd4067330 0x7f8cd40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.531+0000 7f8ce6d9d700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cd4067330 0x7f8cd40697e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80093f0 tx=0x7f8cd8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.535+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8ce0051da0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.726+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ce815de40 con 0x7f8ce8159ae0 2023-09-30T23:02:19.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.727+0000 7f8cceffd700 1 -- 172.21.15.142:0/94187054 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+17293 (secure 0 0 0) 0x7f8ce00553c0 con 0x7f8ce8159ae0 2023-09-30T23:02:19.728 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:19.728 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":163,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:01:39.360568+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:00:01.319776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-09-30T23:00:02.170708+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"20.2","mappings":[{"from":3,"to":7}]},{"pgid":"20.13","mappings":[{"from":3,"to":1}]},{"pgid":"20.22","mappings":[{"from":3,"to":7}]},{"pgid":"20.27","mappings":[{"from":3,"to":7}]},{"pgid":"20.2b","mappings":[{"from":3,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:02:19.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cd4067330 msgr2=0x7f8cd40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cd4067330 0x7f8cd40697e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80093f0 tx=0x7f8cd8017000 comp rx=0 tx=0).stop 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 msgr2=0x7f8ce80b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80b3ab0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c8e0 tx=0x7f8ce0001710 comp rx=0 tx=0).stop 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 shutdown_connections 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8cd4067330 0x7f8cd40697e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce8159ae0 0x7f8ce80b3ab0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ce80b1180 0x7f8ce816acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 --2- 172.21.15.142:0/94187054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ce80cc590 0x7f8ce80c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.729+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 >> 172.21.15.142:0/94187054 conn(0x7f8ce80ce8b0 msgr2=0x7f8ce80cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.730+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 shutdown_connections 2023-09-30T23:02:19.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.730+0000 7f8ced1ff700 1 -- 172.21.15.142:0/94187054 wait complete. 2023-09-30T23:02:19.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T23:00:01.319776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T23:00:02.170708+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T23:02:19.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T23:02:19.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.941+0000 7effb57ff700 1 Processor -- start 2023-09-30T23:02:19.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.941+0000 7effb57ff700 1 -- start start 2023-09-30T23:02:19.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effb57ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7effb00ca5e0 0x7effb006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effb57ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7effb00b0de0 0x7effb00681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effb57ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0067d10 con 0x7effb0159ba0 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effb57ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb006af90 con 0x7effb00b0de0 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effb57ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00676c0 con 0x7effb00ca5e0 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effaeffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7effb0159ba0 0x7effb00c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37904/0 (socket says 172.21.15.142:37904) 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effaeffd700 1 -- 172.21.15.142:0/4146067321 learned_addr learned my addr 172.21.15.142:0/4146067321 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effaf7fe700 1 --2- 172.21.15.142:0/4146067321 >> v2:172.21.15.142:3300/0 conn(0x7effb00b0de0 0x7effb00681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effae7fc700 1 --2- 172.21.15.142:0/4146067321 >> v2:172.21.15.148:3300/0 conn(0x7effb00ca5e0 0x7effb006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effadffb700 1 -- 172.21.15.142:0/4146067321 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67539880 0 0) 0x7effb0067d10 con 0x7effb0159ba0 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effadffb700 1 -- 172.21.15.142:0/4146067321 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff98003570 con 0x7effb0159ba0 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effaf7fe700 1 -- 172.21.15.142:0/4146067321 >> v2:172.21.15.148:3300/0 conn(0x7effb00ca5e0 msgr2=0x7effb006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effaf7fe700 1 --2- 172.21.15.142:0/4146067321 >> v2:172.21.15.148:3300/0 conn(0x7effb00ca5e0 0x7effb006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effaf7fe700 1 -- 172.21.15.142:0/4146067321 >> v1:172.21.15.142:6789/0 conn(0x7effb0159ba0 legacy=0x7effb00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.943+0000 7effaf7fe700 1 -- 172.21.15.142:0/4146067321 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00679a0 con 0x7effb00b0de0 2023-09-30T23:02:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.944+0000 7effaf7fe700 1 --2- 172.21.15.142:0/4146067321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb00681a0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7effb006f000 tx=0x7effa8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58399cdcfc2ad85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.944+0000 7effadffb700 1 -- 172.21.15.142:0/4146067321 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800e070 con 0x7effb00b0de0 2023-09-30T23:02:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.944+0000 7effadffb700 1 -- 172.21.15.142:0/4146067321 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800bab0 con 0x7effb00b0de0 2023-09-30T23:02:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.944+0000 7effadffb700 1 -- 172.21.15.142:0/4146067321 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800be70 con 0x7effb00b0de0 2023-09-30T23:02:19.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.944+0000 7effb57ff700 1 -- 172.21.15.142:0/4146067321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 msgr2=0x7effb00681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.944+0000 7effb57ff700 1 --2- 172.21.15.142:0/4146067321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb00681a0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7effb006f000 tx=0x7effa8009780 comp rx=0 tx=0).stop 2023-09-30T23:02:19.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.945+0000 7effb57ff700 1 -- 172.21.15.142:0/4146067321 shutdown_connections 2023-09-30T23:02:19.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.945+0000 7effb57ff700 1 --2- 172.21.15.142:0/4146067321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb00681a0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.945+0000 7effb57ff700 1 --2- 172.21.15.142:0/4146067321 >> v2:172.21.15.148:3300/0 conn(0x7effb00ca5e0 0x7effb006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.945+0000 7effb57ff700 1 -- 172.21.15.142:0/4146067321 >> 172.21.15.142:0/4146067321 conn(0x7effb00cb2f0 msgr2=0x7effb00cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:19.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.945+0000 7effb57ff700 1 -- 172.21.15.142:0/4146067321 shutdown_connections 2023-09-30T23:02:19.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.945+0000 7effb57ff700 1 -- 172.21.15.142:0/4146067321 wait complete. 2023-09-30T23:02:19.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.946+0000 7effb57ff700 1 Processor -- start 2023-09-30T23:02:19.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.946+0000 7effb57ff700 1 -- start start 2023-09-30T23:02:19.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effb57ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb0157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effb57ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effb00ca5e0 0x7effb00c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effb57ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb0159ba0 0x7effb014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effb57ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00c97d0 con 0x7effb00b0de0 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effb57ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb00c5d40 con 0x7effb0159ba0 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effb57ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00c4e00 con 0x7effb00ca5e0 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effaeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb0157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effaeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb0157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44550/0 (socket says 172.21.15.142:44550) 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.947+0000 7effaeffd700 1 -- 172.21.15.142:0/3944536837 learned_addr learned my addr 172.21.15.142:0/3944536837 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effaf7fe700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb0159ba0 0x7effb014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effae7fc700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effb00ca5e0 0x7effb00c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effaeffd700 1 -- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effb00ca5e0 msgr2=0x7effb00c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effaeffd700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effb00ca5e0 0x7effb00c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effaeffd700 1 -- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb0159ba0 msgr2=0x7effb014cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effaeffd700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb0159ba0 0x7effb014cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effaeffd700 1 -- 172.21.15.142:0/3944536837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa8009a20 con 0x7effb00b0de0 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effaeffd700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb0157df0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7effa000c590 tx=0x7effa0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0005cd0 con 0x7effb00b0de0 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0005e50 con 0x7effb00b0de0 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb00c50e0 con 0x7effb00b0de0 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0007320 con 0x7effb00b0de0 2023-09-30T23:02:19.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.948+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb00c59d0 con 0x7effb00b0de0 2023-09-30T23:02:19.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.949+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb006e4b0 con 0x7effb00b0de0 2023-09-30T23:02:19.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.950+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7effa001b3b0 con 0x7effb00b0de0 2023-09-30T23:02:19.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.951+0000 7eff96ffd700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff9c067330 0x7eff9c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:19.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.951+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7effa00843d0 con 0x7effb00b0de0 2023-09-30T23:02:19.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.951+0000 7effae7fc700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff9c067330 0x7eff9c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:19.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.951+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7eff9c06f6d0 con 0x7effb00b0de0 2023-09-30T23:02:19.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.952+0000 7effae7fc700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff9c067330 0x7eff9c0697e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7effb016d390 tx=0x7effa4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:19.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:19.955+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7effa0017060 con 0x7effb00b0de0 2023-09-30T23:02:20.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.144+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effb00cac40 con 0x7effb00b0de0 2023-09-30T23:02:20.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.145+0000 7eff96ffd700 1 -- 172.21.15.142:0/3944536837 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7effa00511a0 con 0x7effb00b0de0 2023-09-30T23:02:20.146 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff9c067330 msgr2=0x7eff9c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff9c067330 0x7eff9c0697e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7effb016d390 tx=0x7effa4008040 comp rx=0 tx=0).stop 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 msgr2=0x7effb0157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb0157df0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7effa000c590 tx=0x7effa0007e00 comp rx=0 tx=0).stop 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 shutdown_connections 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff9c067330 0x7eff9c0697e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb0159ba0 0x7effb014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb00b0de0 0x7effb0157df0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 --2- 172.21.15.142:0/3944536837 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7effb00ca5e0 0x7effb00c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 >> 172.21.15.142:0/3944536837 conn(0x7effb00cb2f0 msgr2=0x7effb006b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:20.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 shutdown_connections 2023-09-30T23:02:20.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.147+0000 7effb57ff700 1 -- 172.21.15.142:0/3944536837 wait complete. 2023-09-30T23:02:20.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T23:02:20.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.357+0000 7fe8017ff700 1 Processor -- start 2023-09-30T23:02:20.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.357+0000 7fe8017ff700 1 -- start start 2023-09-30T23:02:20.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.358+0000 7fe8017ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 0x7fe7fc15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe8017ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0c8460 con 0x7fe7fc1577b0 2023-09-30T23:02:20.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe8017ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc15b580 con 0x7fe7fc15c230 2023-09-30T23:02:20.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe8017ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06b840 con 0x7fe7fc157b80 2023-09-30T23:02:20.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe7faffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe7fc1577b0 0x7fe7fc06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37918/0 (socket says 172.21.15.142:37918) 2023-09-30T23:02:20.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe7faffd700 1 -- 172.21.15.142:0/186892401 learned_addr learned my addr 172.21.15.142:0/186892401 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe7fa7fc700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 0x7fe7fc15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280303114 0 0) 0x7fe7fc0c8460 con 0x7fe7fc1577b0 2023-09-30T23:02:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e4003570 con 0x7fe7fc1577b0 2023-09-30T23:02:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.359+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058881770 0 0) 0x7fe7e4003570 con 0x7fe7fc1577b0 2023-09-30T23:02:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 msgr2=0x7fe7fc15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 0x7fe7fc15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 >> v1:172.21.15.148:6789/0 conn(0x7fe7fc15c230 legacy=0x7fe7fc06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0c16f0 con 0x7fe7fc1577b0 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fe7ec001470 con 0x7fe7fc1577b0 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 >> v1:172.21.15.142:6789/0 conn(0x7fe7fc1577b0 legacy=0x7fe7fc06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7e4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e4004810 0x7fe7e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 0x7fe7e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06b840 con 0x7fe7e4003a90 2023-09-30T23:02:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e400bb10 con 0x7fe7e4004810 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e400bcd0 con 0x7fe7fc157b80 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7faffd700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7e4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7fa7fc700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e4004810 0x7fe7e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7fb7fe700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 0x7fe7e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7faffd700 1 -- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 msgr2=0x7fe7e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7faffd700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc157b80 0x7fe7e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7faffd700 1 -- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e4004810 msgr2=0x7fe7e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:20.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7faffd700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e4004810 0x7fe7e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.360+0000 7fe7faffd700 1 -- 172.21.15.142:0/186892401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4003570 con 0x7fe7e4003a90 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe7faffd700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7e4003e60 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c390 tx=0x7fe7fc0c1880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b3a8deb35a5f75 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00cc60 con 0x7fe7e4003a90 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec00cde0 con 0x7fe7e4003a90 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe7f9ffb700 1 -- 172.21.15.142:0/186892401 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec005b70 con 0x7fe7e4003a90 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe8017ff700 1 -- 172.21.15.142:0/186892401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 msgr2=0x7fe7e4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe8017ff700 1 --2- 172.21.15.142:0/186892401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7e4003e60 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c390 tx=0x7fe7fc0c1880 comp rx=0 tx=0).stop 2023-09-30T23:02:20.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe7fb7fe700 1 -- 172.21.15.142:0/186892401 reap_dead start 2023-09-30T23:02:20.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe8017ff700 1 -- 172.21.15.142:0/186892401 shutdown_connections 2023-09-30T23:02:20.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe8017ff700 1 -- 172.21.15.142:0/186892401 >> 172.21.15.142:0/186892401 conn(0x7fe7fc0680b0 msgr2=0x7fe7fc0cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:20.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.361+0000 7fe8017ff700 1 -- 172.21.15.142:0/186892401 shutdown_connections 2023-09-30T23:02:20.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.362+0000 7fe8017ff700 1 -- 172.21.15.142:0/186892401 wait complete. 2023-09-30T23:02:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.363+0000 7fe8017ff700 1 Processor -- start 2023-09-30T23:02:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.363+0000 7fe8017ff700 1 -- start start 2023-09-30T23:02:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe8017ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7fc150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe8017ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7fc0b0440 0x7fe7fc15ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe8017ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc15f2b0 0x7fe7fc16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe8017ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc16b070 con 0x7fe7e4003a90 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe8017ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0affb0 con 0x7fe7fc0b0440 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe8017ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc150da0 con 0x7fe7fc15f2b0 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe7faffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7fc150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe7faffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7fc150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44568/0 (socket says 172.21.15.142:44568) 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe7faffd700 1 -- 172.21.15.142:0/1536215336 learned_addr learned my addr 172.21.15.142:0/1536215336 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe7fa7fc700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7fc0b0440 0x7fe7fc15ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.364+0000 7fe7fb7fe700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc15f2b0 0x7fe7fc16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7faffd700 1 -- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc15f2b0 msgr2=0x7fe7fc16a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7faffd700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc15f2b0 0x7fe7fc16a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7faffd700 1 -- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7fc0b0440 msgr2=0x7fe7fc15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7faffd700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7fc0b0440 0x7fe7fc15ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7faffd700 1 -- 172.21.15.142:0/1536215336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc15f6e0 con 0x7fe7e4003a90 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7fb7fe700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc15f2b0 0x7fe7fc16a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7faffd700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7fc150860 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4004770 tx=0x7fe7ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0070d0 con 0x7fe7e4003a90 2023-09-30T23:02:20.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec007230 con 0x7fe7e4003a90 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0075f0 con 0x7fe7e4003a90 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc0af680 con 0x7fe7e4003a90 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.365+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc0afc40 con 0x7fe7e4003a90 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.366+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc0697b0 con 0x7fe7e4003a90 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.367+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe7ec019030 con 0x7fe7e4003a90 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.368+0000 7fe7e2ffd700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7e8067330 0x7fe7e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.368+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fe7ec085ff0 con 0x7fe7e4003a90 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.368+0000 7fe7fa7fc700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7e8067330 0x7fe7e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.368+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fe7e806f6d0 con 0x7fe7e4003a90 2023-09-30T23:02:20.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.369+0000 7fe7fa7fc700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7e8067330 0x7fe7e80697e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0b0830 tx=0x7fe7f00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:20.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.372+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe7ec017060 con 0x7fe7e4003a90 2023-09-30T23:02:20.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.560+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7fc16b070 con 0x7fe7e4003a90 2023-09-30T23:02:20.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.561+0000 7fe7e2ffd700 1 -- 172.21.15.142:0/1536215336 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe7ec02b0a0 con 0x7fe7e4003a90 2023-09-30T23:02:20.562 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7e8067330 msgr2=0x7fe7e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7e8067330 0x7fe7e80697e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0b0830 tx=0x7fe7f00091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 msgr2=0x7fe7fc150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7fc150860 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4004770 tx=0x7fe7ec015000 comp rx=0 tx=0).stop 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 shutdown_connections 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7e8067330 0x7fe7e80697e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7fc15f2b0 0x7fe7fc16a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7e4003a90 0x7fe7fc150860 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 --2- 172.21.15.142:0/1536215336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7fc0b0440 0x7fe7fc15ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 >> 172.21.15.142:0/1536215336 conn(0x7fe7fc0680b0 msgr2=0x7fe7fc0c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:20.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 shutdown_connections 2023-09-30T23:02:20.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.563+0000 7fe8017ff700 1 -- 172.21.15.142:0/1536215336 wait complete. 2023-09-30T23:02:20.581 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T23:02:20.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.772+0000 7fb8ee7ff700 1 Processor -- start 2023-09-30T23:02:20.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.772+0000 7fb8ee7ff700 1 -- start start 2023-09-30T23:02:20.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ee7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e8157ab0 0x7fb8e815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ee7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8e80cc3b0 0x7fb8e80cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ee7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80d0550 con 0x7fb8e80cbfe0 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ee7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80cf750 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ee7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80cf940 con 0x7fb8e8157ab0 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ecd9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8e80cc3b0 0x7fb8e80cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ecd9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8e80cc3b0 0x7fb8e80cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44574/0 (socket says 172.21.15.142:44574) 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ecd9c700 1 -- 172.21.15.142:0/281908340 learned_addr learned my addr 172.21.15.142:0/281908340 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8e77fe700 1 --2- 172.21.15.142:0/281908340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e8157ab0 0x7fb8e815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ecd9c700 1 -- 172.21.15.142:0/281908340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e8157ab0 msgr2=0x7fb8e815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:20.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ecd9c700 1 --2- 172.21.15.142:0/281908340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e8157ab0 0x7fb8e815a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ecd9c700 1 -- 172.21.15.142:0/281908340 >> v1:172.21.15.148:6789/0 conn(0x7fb8e80cbfe0 legacy=0x7fb8e81573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.774+0000 7fb8ecd9c700 1 -- 172.21.15.142:0/281908340 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80cfc20 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.775+0000 7fb8ecd9c700 1 --2- 172.21.15.142:0/281908340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e80cf210 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009f50 tx=0x7fb8e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f69e9b4292052 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.775+0000 7fb8e6ffd700 1 -- 172.21.15.142:0/281908340 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000e070 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.775+0000 7fb8e6ffd700 1 -- 172.21.15.142:0/281908340 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000b9c0 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.775+0000 7fb8e6ffd700 1 -- 172.21.15.142:0/281908340 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00092e0 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.775+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/281908340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 msgr2=0x7fb8e80cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.775+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/281908340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e80cf210 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009f50 tx=0x7fb8e0009840 comp rx=0 tx=0).stop 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.776+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/281908340 shutdown_connections 2023-09-30T23:02:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.776+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/281908340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e80cf210 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.776+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/281908340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e8157ab0 0x7fb8e815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.776+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/281908340 >> 172.21.15.142:0/281908340 conn(0x7fb8e80d0a80 msgr2=0x7fb8e80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.776+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/281908340 shutdown_connections 2023-09-30T23:02:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.776+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/281908340 wait complete. 2023-09-30T23:02:20.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.778+0000 7fb8ee7ff700 1 Processor -- start 2023-09-30T23:02:20.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.778+0000 7fb8ee7ff700 1 -- start start 2023-09-30T23:02:20.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8ee7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e80cbfe0 0x7fb8e8155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8ee7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8ee7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8e8157ab0 0x7fb8e806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8ee7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8155780 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8ee7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e816b200 con 0x7fb8e8157ab0 2023-09-30T23:02:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8ee7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e816a330 con 0x7fb8e80cbfe0 2023-09-30T23:02:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8e77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8e77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44576/0 (socket says 172.21.15.142:44576) 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.779+0000 7fb8e77fe700 1 -- 172.21.15.142:0/944283033 learned_addr learned my addr 172.21.15.142:0/944283033 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e7fff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e80cbfe0 0x7fb8e8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8ecd9c700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8e8157ab0 0x7fb8e806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e77fe700 1 -- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e80cbfe0 msgr2=0x7fb8e8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e77fe700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e80cbfe0 0x7fb8e8155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e77fe700 1 -- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8e8157ab0 msgr2=0x7fb8e806e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e77fe700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8e8157ab0 0x7fb8e806e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e77fe700 1 -- 172.21.15.142:0/944283033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0009ae0 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e7fff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e80cbfe0 0x7fb8e8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:20.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8e77fe700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e806e110 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00e900 tx=0x7fb8dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:20.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00eea0 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00c850 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00cc10 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e816a5f0 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.780+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e816abb0 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.781+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e8069770 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.782+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb8dc013470 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.783+0000 7fb8cffff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb8d4067330 0x7fb8d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:20.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.783+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fb8dc084e70 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.784+0000 7fb8e7fff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb8d4067330 0x7fb8d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:20.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.784+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fb8d406f6d0 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.784+0000 7fb8e7fff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb8d4067330 0x7fb8d40697e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8007fd0 tx=0x7fb8d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:20.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.788+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb8dc017060 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.977+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8e806fc10 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.978+0000 7fb8cffff700 1 -- 172.21.15.142:0/944283033 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8dc051c40 con 0x7fb8e80cc3b0 2023-09-30T23:02:20.979 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T23:02:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb8d4067330 msgr2=0x7fb8d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb8d4067330 0x7fb8d40697e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8007fd0 tx=0x7fb8d8009040 comp rx=0 tx=0).stop 2023-09-30T23:02:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 msgr2=0x7fb8e806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e806e110 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00e900 tx=0x7fb8dc0091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 shutdown_connections 2023-09-30T23:02:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb8d4067330 0x7fb8d40697e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8e8157ab0 0x7fb8e806e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8e80cbfe0 0x7fb8e8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 --2- 172.21.15.142:0/944283033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e80cc3b0 0x7fb8e806e110 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.980+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 >> 172.21.15.142:0/944283033 conn(0x7fb8e80d0a80 msgr2=0x7fb8e80ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:20.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.981+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 shutdown_connections 2023-09-30T23:02:20.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:20.981+0000 7fb8ee7ff700 1 -- 172.21.15.142:0/944283033 wait complete. 2023-09-30T23:02:20.999 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T23:02:21.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.189+0000 7f2a35dff700 1 Processor -- start 2023-09-30T23:02:21.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.189+0000 7f2a35dff700 1 -- start start 2023-09-30T23:02:21.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.190+0000 7f2a35dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a30141150 0x7f2a301580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.190+0000 7f2a35dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a300c38d0 con 0x7f2a300c6270 2023-09-30T23:02:21.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.190+0000 7f2a35dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a300c6aa0 con 0x7f2a300c40e0 2023-09-30T23:02:21.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.190+0000 7f2a35dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3006a040 con 0x7f2a30141150 2023-09-30T23:02:21.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.191+0000 7f2a2f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a30141150 0x7f2a301580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.191+0000 7f2a27fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2a300c6270 0x7f2a3015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51312/0 (socket says 172.21.15.142:51312) 2023-09-30T23:02:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.191+0000 7f2a27fff700 1 -- 172.21.15.142:0/3660850075 learned_addr learned my addr 172.21.15.142:0/3660850075 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.191+0000 7f2a2f7fe700 1 -- 172.21.15.142:0/3660850075 >> v1:172.21.15.148:6789/0 conn(0x7f2a300c40e0 legacy=0x7f2a300c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.191+0000 7f2a2f7fe700 1 -- 172.21.15.142:0/3660850075 >> v1:172.21.15.142:6789/0 conn(0x7f2a300c6270 legacy=0x7f2a3015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.191+0000 7f2a2f7fe700 1 -- 172.21.15.142:0/3660850075 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a300c67c0 con 0x7f2a30141150 2023-09-30T23:02:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.191+0000 7f2a2effd700 1 -- 172.21.15.142:0/3660850075 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760884151 0 0) 0x7f2a300c38d0 con 0x7f2a300c6270 2023-09-30T23:02:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a2f7fe700 1 --2- 172.21.15.142:0/3660850075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30141150 0x7f2a301580c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2a200098e0 tx=0x7f2a200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9057b3291a0a2474 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a2effd700 1 -- 172.21.15.142:0/3660850075 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20009e80 con 0x7f2a30141150 2023-09-30T23:02:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a2effd700 1 -- 172.21.15.142:0/3660850075 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2000b860 con 0x7f2a30141150 2023-09-30T23:02:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a2effd700 1 -- 172.21.15.142:0/3660850075 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000bbe0 con 0x7f2a30141150 2023-09-30T23:02:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a35dff700 1 -- 172.21.15.142:0/3660850075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30141150 msgr2=0x7f2a301580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a35dff700 1 --2- 172.21.15.142:0/3660850075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30141150 0x7f2a301580c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2a200098e0 tx=0x7f2a200091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a35dff700 1 -- 172.21.15.142:0/3660850075 shutdown_connections 2023-09-30T23:02:21.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a35dff700 1 --2- 172.21.15.142:0/3660850075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30141150 0x7f2a301580c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a35dff700 1 -- 172.21.15.142:0/3660850075 >> 172.21.15.142:0/3660850075 conn(0x7f2a300cc670 msgr2=0x7f2a300cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:21.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.192+0000 7f2a35dff700 1 -- 172.21.15.142:0/3660850075 shutdown_connections 2023-09-30T23:02:21.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.193+0000 7f2a35dff700 1 -- 172.21.15.142:0/3660850075 wait complete. 2023-09-30T23:02:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.194+0000 7f2a35dff700 1 Processor -- start 2023-09-30T23:02:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.194+0000 7f2a35dff700 1 -- start start 2023-09-30T23:02:21.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a35dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300c40e0 0x7f2a300bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a35dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a300c6270 0x7f2a300bca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a35dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a30141150 0x7f2a3016e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a35dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300cbbf0 con 0x7f2a300c40e0 2023-09-30T23:02:21.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a35dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300bcf70 con 0x7f2a30141150 2023-09-30T23:02:21.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a35dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300ba630 con 0x7f2a300c6270 2023-09-30T23:02:21.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a2f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300c40e0 0x7f2a300bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a2f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300c40e0 0x7f2a300bc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43936/0 (socket says 172.21.15.142:43936) 2023-09-30T23:02:21.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a2f7fe700 1 -- 172.21.15.142:0/298176604 learned_addr learned my addr 172.21.15.142:0/298176604 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:21.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a2f7fe700 1 -- 172.21.15.142:0/298176604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a300c6270 msgr2=0x7f2a300bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a2f7fe700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a300c6270 0x7f2a300bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.195+0000 7f2a2f7fe700 1 -- 172.21.15.142:0/298176604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a30141150 msgr2=0x7f2a3016e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a2f7fe700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a30141150 0x7f2a3016e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a2f7fe700 1 -- 172.21.15.142:0/298176604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20009420 con 0x7f2a300c40e0 2023-09-30T23:02:21.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a2f7fe700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300c40e0 0x7f2a300bc4f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2a300c3a80 tx=0x7f2a20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:21.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2001f070 con 0x7f2a300c40e0 2023-09-30T23:02:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2000b9d0 con 0x7f2a300c40e0 2023-09-30T23:02:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a300b9d00 con 0x7f2a300c40e0 2023-09-30T23:02:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20025670 con 0x7f2a300c40e0 2023-09-30T23:02:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.196+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a300ba2c0 con 0x7f2a300c40e0 2023-09-30T23:02:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.197+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a30069a50 con 0x7f2a300c40e0 2023-09-30T23:02:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.198+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2a20023070 con 0x7f2a300c40e0 2023-09-30T23:02:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.199+0000 7f2a277fe700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a10067330 0x7f2a100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.199+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f2a20086250 con 0x7f2a300c40e0 2023-09-30T23:02:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.199+0000 7f2a27fff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a10067330 0x7f2a100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.199+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f2a1006f6d0 con 0x7f2a300c40e0 2023-09-30T23:02:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.200+0000 7f2a27fff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a10067330 0x7f2a100697e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2a180011e0 tx=0x7f2a180079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.203+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2a20053020 con 0x7f2a300c40e0 2023-09-30T23:02:21.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.392+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a30157ea0 con 0x7f2a300c40e0 2023-09-30T23:02:21.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.392+0000 7f2a277fe700 1 -- 172.21.15.142:0/298176604 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a200150a0 con 0x7f2a300c40e0 2023-09-30T23:02:21.393 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T23:02:21.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a10067330 msgr2=0x7f2a100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a10067330 0x7f2a100697e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2a180011e0 tx=0x7f2a180079d0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300c40e0 msgr2=0x7f2a300bc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300c40e0 0x7f2a300bc4f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2a300c3a80 tx=0x7f2a20017000 comp rx=0 tx=0).stop 2023-09-30T23:02:21.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 shutdown_connections 2023-09-30T23:02:21.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2a10067330 0x7f2a100697e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a30141150 0x7f2a3016e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300c40e0 0x7f2a300bc4f0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 --2- 172.21.15.142:0/298176604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a300c6270 0x7f2a300bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 >> 172.21.15.142:0/298176604 conn(0x7f2a300cc670 msgr2=0x7f2a300cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:21.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 shutdown_connections 2023-09-30T23:02:21.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.395+0000 7f2a35dff700 1 -- 172.21.15.142:0/298176604 wait complete. 2023-09-30T23:02:21.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:21.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.605+0000 7f1b8ebff700 1 Processor -- start 2023-09-30T23:02:21.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.605+0000 7f1b8ebff700 1 -- start start 2023-09-30T23:02:21.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.606+0000 7f1b8ebff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b880b00d0 0x7f1b8806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.606+0000 7f1b8ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 0x7f1b8815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.606+0000 7f1b8ebff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8806d3e0 con 0x7f1b880af020 2023-09-30T23:02:21.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.606+0000 7f1b8ebff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8806dc80 con 0x7f1b880b00d0 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.606+0000 7f1b8ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8806b790 con 0x7f1b8806e650 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b8c99b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1b880af020 0x7f1b88156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51322/0 (socket says 172.21.15.142:51322) 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b8c99b700 1 -- 172.21.15.142:0/568739129 learned_addr learned my addr 172.21.15.142:0/568739129 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 0x7f1b8815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b87fff700 1 --2- 172.21.15.142:0/568739129 >> v2:172.21.15.148:3300/0 conn(0x7f1b880b00d0 0x7f1b8806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521156904 0 0) 0x7f1b8806d3e0 con 0x7f1b880af020 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b78003570 con 0x7f1b880af020 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2464109512 0 0) 0x7f1b78003570 con 0x7f1b880af020 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 msgr2=0x7f1b8815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 0x7f1b8815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 >> v2:172.21.15.148:3300/0 conn(0x7f1b880b00d0 msgr2=0x7f1b8806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:21.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 --2- 172.21.15.142:0/568739129 >> v2:172.21.15.148:3300/0 conn(0x7f1b880b00d0 0x7f1b8806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880b0650 con 0x7f1b880af020 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f1b7c001470 con 0x7f1b880af020 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 >> v1:172.21.15.142:6789/0 conn(0x7f1b880af020 legacy=0x7f1b88156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.607+0000 7f1b877fe700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78003a60 0x7f1b78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b877fe700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 0x7f1b78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b877fe700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b78004d50 0x7f1b780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8806dc80 con 0x7f1b78004d50 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8806b790 con 0x7f1b78003a60 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7800ba60 con 0x7f1b8806e650 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b78004d50 0x7f1b780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8c99b700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78003a60 0x7f1b78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b87fff700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 0x7f1b78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8d19c700 1 -- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 msgr2=0x7f1b78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b8806e650 0x7f1b78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8d19c700 1 -- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78003a60 msgr2=0x7f1b78003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78003a60 0x7f1b78003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8d19c700 1 -- 172.21.15.142:0/568739129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78003570 con 0x7f1b78004d50 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.608+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b78004d50 0x7f1b780051c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e210 tx=0x7f1b8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf6a01c093c70ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000ea60 con 0x7f1b78004d50 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8000f040 con 0x7f1b78004d50 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b877fe700 1 -- 172.21.15.142:0/568739129 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000ee10 con 0x7f1b78004d50 2023-09-30T23:02:21.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b8ebff700 1 -- 172.21.15.142:0/568739129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b78004d50 msgr2=0x7f1b780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b8ebff700 1 --2- 172.21.15.142:0/568739129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b78004d50 0x7f1b780051c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e210 tx=0x7f1b8000b040 comp rx=0 tx=0).stop 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b8d19c700 1 -- 172.21.15.142:0/568739129 reap_dead start 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b8ebff700 1 -- 172.21.15.142:0/568739129 shutdown_connections 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b8ebff700 1 -- 172.21.15.142:0/568739129 >> 172.21.15.142:0/568739129 conn(0x7f1b880680c0 msgr2=0x7f1b880c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b8ebff700 1 -- 172.21.15.142:0/568739129 shutdown_connections 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.609+0000 7f1b8ebff700 1 -- 172.21.15.142:0/568739129 wait complete. 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.611+0000 7f1b8ebff700 1 Processor -- start 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.611+0000 7f1b8ebff700 1 -- start start 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8ebff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78004d50 0x7f1b8816aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8ebff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b88153590 0x7f1b8815da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8815d540 0x7f1b8815dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88159050 con 0x7f1b8815d540 2023-09-30T23:02:21.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8ebff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8816b3e0 con 0x7f1b78004d50 2023-09-30T23:02:21.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8ebff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8816b640 con 0x7f1b88153590 2023-09-30T23:02:21.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8d19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8815d540 0x7f1b8815dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8d19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8815d540 0x7f1b8815dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43950/0 (socket says 172.21.15.142:43950) 2023-09-30T23:02:21.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8d19c700 1 -- 172.21.15.142:0/1076552932 learned_addr learned my addr 172.21.15.142:0/1076552932 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:21.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b8c99b700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78004d50 0x7f1b8816aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.612+0000 7f1b87fff700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b88153590 0x7f1b8815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8d19c700 1 -- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b88153590 msgr2=0x7f1b8815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b88153590 0x7f1b8815da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8d19c700 1 -- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78004d50 msgr2=0x7f1b8816aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78004d50 0x7f1b8816aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8d19c700 1 -- 172.21.15.142:0/1076552932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8815b290 con 0x7f1b8815d540 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8d19c700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8815d540 0x7f1b8815dfb0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f1b78004760 tx=0x7f1b8001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8001d630 con 0x7f1b8815d540 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8001d790 con 0x7f1b8815d540 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8815b570 con 0x7f1b8815d540 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8001db50 con 0x7f1b8815d540 2023-09-30T23:02:21.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.613+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8815ba80 con 0x7f1b8815d540 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.614+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b88158ea0 con 0x7f1b8815d540 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.615+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1b80003040 con 0x7f1b8815d540 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.616+0000 7f1b84ff9700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b6c067330 0x7f1b6c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.617+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f1b800860c0 con 0x7f1b8815d540 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.617+0000 7f1b8c99b700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b6c067330 0x7f1b6c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.617+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f1b6c06f6d0 con 0x7f1b8815d540 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.617+0000 7f1b8c99b700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b6c067330 0x7f1b6c0697e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c007a70 tx=0x7f1b8806dbf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:21.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.621+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1b80052f50 con 0x7f1b8815d540 2023-09-30T23:02:21.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.850+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b88159190 con 0x7f1b8815d540 2023-09-30T23:02:21.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.851+0000 7f1b84ff9700 1 -- 172.21.15.142:0/1076552932 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f1b80018070 con 0x7f1b8815d540 2023-09-30T23:02:21.852 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:21.852 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:00:03.199135+0000","modified":"2023-09-30T23:00:06.755986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/3293843450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3293843450},{"type":"v1","addr":"172.21.15.148:6834","nonce":3293843450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-09-30T23:02:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b6c067330 msgr2=0x7f1b6c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b6c067330 0x7f1b6c0697e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c007a70 tx=0x7f1b8806dbf0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8815d540 msgr2=0x7f1b8815dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8815d540 0x7f1b8815dfb0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f1b78004760 tx=0x7f1b8001a000 comp rx=0 tx=0).stop 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 shutdown_connections 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1b6c067330 0x7f1b6c0697e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b8815d540 0x7f1b8815dfb0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b78004d50 0x7f1b8816aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 --2- 172.21.15.142:0/1076552932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b88153590 0x7f1b8815da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 >> 172.21.15.142:0/1076552932 conn(0x7f1b880680c0 msgr2=0x7f1b88069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.853+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 shutdown_connections 2023-09-30T23:02:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:21.854+0000 7f1b8ebff700 1 -- 172.21.15.142:0/1076552932 wait complete. 2023-09-30T23:02:21.856 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 74 2023-09-30T23:02:21.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:02:22.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.061+0000 7f89f85ff700 1 Processor -- start 2023-09-30T23:02:22.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.061+0000 7f89f85ff700 1 -- start start 2023-09-30T23:02:22.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.062+0000 7f89f85ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f00cee50 0x7f89f0159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.062+0000 7f89f85ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89f00d03d0 0x7f89f015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.062+0000 7f89f85ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f006b8d0 con 0x7f89f01598e0 2023-09-30T23:02:22.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.062+0000 7f89f85ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f00cff40 con 0x7f89f00d03d0 2023-09-30T23:02:22.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.062+0000 7f89f85ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00cf330 con 0x7f89f00cee50 2023-09-30T23:02:22.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f639b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f89f01598e0 0x7f89f006b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51326/0 (socket says 172.21.15.142:51326) 2023-09-30T23:02:22.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f639b700 1 -- 172.21.15.142:0/4029675192 learned_addr learned my addr 172.21.15.142:0/4029675192 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:22.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f5b9a700 1 --2- 172.21.15.142:0/4029675192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f00cee50 0x7f89f0159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f6b9c700 1 --2- 172.21.15.142:0/4029675192 >> v2:172.21.15.148:3300/0 conn(0x7f89f00d03d0 0x7f89f015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f5399700 1 -- 172.21.15.142:0/4029675192 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843980744 0 0) 0x7f89f006b8d0 con 0x7f89f01598e0 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f5399700 1 -- 172.21.15.142:0/4029675192 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc003570 con 0x7f89f01598e0 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f5b9a700 1 -- 172.21.15.142:0/4029675192 >> v2:172.21.15.148:3300/0 conn(0x7f89f00d03d0 msgr2=0x7f89f015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f5b9a700 1 --2- 172.21.15.142:0/4029675192 >> v2:172.21.15.148:3300/0 conn(0x7f89f00d03d0 0x7f89f015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f5b9a700 1 -- 172.21.15.142:0/4029675192 >> v1:172.21.15.142:6789/0 conn(0x7f89f01598e0 legacy=0x7f89f006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.063+0000 7f89f5b9a700 1 -- 172.21.15.142:0/4029675192 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00cf610 con 0x7f89f00cee50 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.064+0000 7f89f5b9a700 1 --2- 172.21.15.142:0/4029675192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f00cee50 0x7f89f0159cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89e00098e0 tx=0x7f89e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6bd6cb3a1650534 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.064+0000 7f89f5399700 1 -- 172.21.15.142:0/4029675192 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011630 con 0x7f89f00cee50 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.064+0000 7f89f5399700 1 -- 172.21.15.142:0/4029675192 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0011790 con 0x7f89f00cee50 2023-09-30T23:02:22.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.064+0000 7f89f5399700 1 -- 172.21.15.142:0/4029675192 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011b30 con 0x7f89f00cee50 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.064+0000 7f89f85ff700 1 -- 172.21.15.142:0/4029675192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f00cee50 msgr2=0x7f89f0159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.065+0000 7f89f85ff700 1 --2- 172.21.15.142:0/4029675192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f00cee50 0x7f89f0159cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89e00098e0 tx=0x7f89e00091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.065+0000 7f89f85ff700 1 -- 172.21.15.142:0/4029675192 shutdown_connections 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.065+0000 7f89f85ff700 1 --2- 172.21.15.142:0/4029675192 >> v2:172.21.15.148:3300/0 conn(0x7f89f00d03d0 0x7f89f015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.065+0000 7f89f85ff700 1 --2- 172.21.15.142:0/4029675192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f00cee50 0x7f89f0159cb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.065+0000 7f89f85ff700 1 -- 172.21.15.142:0/4029675192 >> 172.21.15.142:0/4029675192 conn(0x7f89f00cd540 msgr2=0x7f89f00cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.065+0000 7f89f85ff700 1 -- 172.21.15.142:0/4029675192 shutdown_connections 2023-09-30T23:02:22.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.065+0000 7f89f85ff700 1 -- 172.21.15.142:0/4029675192 wait complete. 2023-09-30T23:02:22.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.066+0000 7f89f85ff700 1 Processor -- start 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.066+0000 7f89f85ff700 1 -- start start 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.067+0000 7f89f85ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f00cee50 0x7f89f0148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.067+0000 7f89f85ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89f00d03d0 0x7f89f00c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.067+0000 7f89f85ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f01598e0 0x7f89f00cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.067+0000 7f89f85ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00ca4b0 con 0x7f89f00cee50 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.067+0000 7f89f85ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00cad50 con 0x7f89f00d03d0 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.067+0000 7f89f85ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015e520 con 0x7f89f01598e0 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f00cee50 0x7f89f0148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f00cee50 0x7f89f0148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43962/0 (socket says 172.21.15.142:43962) 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 -- 172.21.15.142:0/3180066456 learned_addr learned my addr 172.21.15.142:0/3180066456 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:22.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f5b9a700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89f00d03d0 0x7f89f00c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f6b9c700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f01598e0 0x7f89f00cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 -- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f01598e0 msgr2=0x7f89f00cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f01598e0 0x7f89f00cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 -- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89f00d03d0 msgr2=0x7f89f00c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89f00d03d0 0x7f89f00c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 -- 172.21.15.142:0/3180066456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0009420 con 0x7f89f00cee50 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f5b9a700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89f00d03d0 0x7f89f00c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:22.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89f639b700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f00cee50 0x7f89f0148ed0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c7c0 tx=0x7f89ec007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.068+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec005b30 con 0x7f89f00cee50 2023-09-30T23:02:22.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.069+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec005c90 con 0x7f89f00cee50 2023-09-30T23:02:22.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.069+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f00ca700 con 0x7f89f00cee50 2023-09-30T23:02:22.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.069+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec007340 con 0x7f89f00cee50 2023-09-30T23:02:22.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.069+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0149410 con 0x7f89f00cee50 2023-09-30T23:02:22.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.070+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f00697b0 con 0x7f89f00cee50 2023-09-30T23:02:22.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.070+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f89ec01b400 con 0x7f89f00cee50 2023-09-30T23:02:22.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.071+0000 7f89e67fc700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89d4067330 0x7f89d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.071+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f89ec0847e0 con 0x7f89f00cee50 2023-09-30T23:02:22.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.072+0000 7f89f5b9a700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89d4067330 0x7f89d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.072+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f89d406f6d0 con 0x7f89f00cee50 2023-09-30T23:02:22.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.072+0000 7f89f5b9a700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89d4067330 0x7f89d40697e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f89f00cf260 tx=0x7f89e0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.076+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f89ec051630 con 0x7f89f00cee50 2023-09-30T23:02:22.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.268+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f006fc10 con 0x7f89f00cee50 2023-09-30T23:02:22.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.269+0000 7f89e67fc700 1 -- 172.21.15.142:0/3180066456 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+17293 (secure 0 0 0) 0x7f89ec054c50 con 0x7f89f00cee50 2023-09-30T23:02:22.270 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:22.271 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":163,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:01:39.360568+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:00:01.319776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-09-30T23:00:02.170708+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"20.2","mappings":[{"from":3,"to":7}]},{"pgid":"20.13","mappings":[{"from":3,"to":1}]},{"pgid":"20.22","mappings":[{"from":3,"to":7}]},{"pgid":"20.27","mappings":[{"from":3,"to":7}]},{"pgid":"20.2b","mappings":[{"from":3,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:02:22.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89d4067330 msgr2=0x7f89d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89d4067330 0x7f89d40697e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f89f00cf260 tx=0x7f89e0017000 comp rx=0 tx=0).stop 2023-09-30T23:02:22.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f00cee50 msgr2=0x7f89f0148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f00cee50 0x7f89f0148ed0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c7c0 tx=0x7f89ec007e00 comp rx=0 tx=0).stop 2023-09-30T23:02:22.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 shutdown_connections 2023-09-30T23:02:22.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f89d4067330 0x7f89d40697e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f89f01598e0 0x7f89f00cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f00cee50 0x7f89f0148ed0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 --2- 172.21.15.142:0/3180066456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89f00d03d0 0x7f89f00c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 >> 172.21.15.142:0/3180066456 conn(0x7f89f00cd540 msgr2=0x7f89f0158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:22.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 shutdown_connections 2023-09-30T23:02:22.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.271+0000 7f89f85ff700 1 -- 172.21.15.142:0/3180066456 wait complete. 2023-09-30T23:02:22.291 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T23:02:22.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:22.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.479+0000 7f04873ff700 1 Processor -- start 2023-09-30T23:02:22.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.480+0000 7f04873ff700 1 -- start start 2023-09-30T23:02:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.481+0000 7f04873ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f048006b3d0 0x7f04800b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.481+0000 7f04873ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048006d470 con 0x7f0480157a90 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.481+0000 7f04873ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0480157e60 con 0x7f04800b1f40 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.481+0000 7f04873ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04800b23e0 con 0x7f048006b3d0 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.481+0000 7f048519b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0480157a90 0x7f048015bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51340/0 (socket says 172.21.15.142:51340) 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.481+0000 7f048519b700 1 -- 172.21.15.142:0/2856022177 learned_addr learned my addr 172.21.15.142:0/2856022177 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.481+0000 7f048499a700 1 --2- 172.21.15.142:0/2856022177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f048006b3d0 0x7f04800b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f0477fff700 1 -- 172.21.15.142:0/2856022177 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865393942 0 0) 0x7f048006d470 con 0x7f0480157a90 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f0477fff700 1 -- 172.21.15.142:0/2856022177 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f046c003570 con 0x7f0480157a90 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f0477fff700 1 -- 172.21.15.142:0/2856022177 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744757978 0 0) 0x7f0480157e60 con 0x7f04800b1f40 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f0477fff700 1 -- 172.21.15.142:0/2856022177 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f048006d470 con 0x7f04800b1f40 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f048499a700 1 -- 172.21.15.142:0/2856022177 >> v1:172.21.15.148:6789/0 conn(0x7f04800b1f40 legacy=0x7f048006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f048499a700 1 -- 172.21.15.142:0/2856022177 >> v1:172.21.15.142:6789/0 conn(0x7f0480157a90 legacy=0x7f048015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f048499a700 1 -- 172.21.15.142:0/2856022177 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800ae880 con 0x7f048006b3d0 2023-09-30T23:02:22.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f048499a700 1 --2- 172.21.15.142:0/2856022177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f048006b3d0 0x7f04800b1a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0470009910 tx=0x7f04700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=824f04ad1a3e3237 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f0477fff700 1 -- 172.21.15.142:0/2856022177 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011630 con 0x7f048006b3d0 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f0477fff700 1 -- 172.21.15.142:0/2856022177 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470011790 con 0x7f048006b3d0 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.482+0000 7f0477fff700 1 -- 172.21.15.142:0/2856022177 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011b30 con 0x7f048006b3d0 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.483+0000 7f04873ff700 1 -- 172.21.15.142:0/2856022177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f048006b3d0 msgr2=0x7f04800b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.483+0000 7f04873ff700 1 --2- 172.21.15.142:0/2856022177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f048006b3d0 0x7f04800b1a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0470009910 tx=0x7f04700091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.483+0000 7f04873ff700 1 -- 172.21.15.142:0/2856022177 shutdown_connections 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.483+0000 7f04873ff700 1 --2- 172.21.15.142:0/2856022177 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f048006b3d0 0x7f04800b1a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.483+0000 7f04873ff700 1 -- 172.21.15.142:0/2856022177 >> 172.21.15.142:0/2856022177 conn(0x7f04800680c0 msgr2=0x7f04800c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.483+0000 7f04873ff700 1 -- 172.21.15.142:0/2856022177 shutdown_connections 2023-09-30T23:02:22.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.483+0000 7f04873ff700 1 -- 172.21.15.142:0/2856022177 wait complete. 2023-09-30T23:02:22.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.484+0000 7f04873ff700 1 Processor -- start 2023-09-30T23:02:22.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.485+0000 7f04873ff700 1 -- start start 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.485+0000 7f04873ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048006b3d0 0x7f0480141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.485+0000 7f04873ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04800b1f40 0x7f04800c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f04873ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0480157a90 0x7f04800c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f04873ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048016e9e0 con 0x7f04800b1f40 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f04873ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048016b7b0 con 0x7f048006b3d0 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f04873ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048016ba90 con 0x7f0480157a90 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04800b1f40 0x7f04800c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04800b1f40 0x7f04800c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43978/0 (socket says 172.21.15.142:43978) 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 -- 172.21.15.142:0/484953196 learned_addr learned my addr 172.21.15.142:0/484953196 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048519b700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048006b3d0 0x7f0480141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048599c700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0480157a90 0x7f04800c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 -- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0480157a90 msgr2=0x7f04800c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0480157a90 0x7f04800c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 -- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048006b3d0 msgr2=0x7f0480141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048006b3d0 0x7f0480141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048499a700 1 -- 172.21.15.142:0/484953196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009420 con 0x7f04800b1f40 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048519b700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048006b3d0 0x7f0480141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.486+0000 7f048599c700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0480157a90 0x7f04800c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.487+0000 7f048499a700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04800b1f40 0x7f04800c7100 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0480068600 tx=0x7f0470017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.487+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047001f070 con 0x7f04800b1f40 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.487+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470000bc0 con 0x7f04800b1f40 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.487+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048016bd70 con 0x7f04800b1f40 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.487+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011b30 con 0x7f04800b1f40 2023-09-30T23:02:22.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.487+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0480141e70 con 0x7f04800b1f40 2023-09-30T23:02:22.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.488+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04800695b0 con 0x7f04800b1f40 2023-09-30T23:02:22.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.489+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0470023070 con 0x7f04800b1f40 2023-09-30T23:02:22.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.490+0000 7f04757fa700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0464067330 0x7f04640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.490+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f0470085f90 con 0x7f04800b1f40 2023-09-30T23:02:22.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.490+0000 7f048519b700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0464067330 0x7f04640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.490+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f046406f6d0 con 0x7f04800b1f40 2023-09-30T23:02:22.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.490+0000 7f048519b700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0464067330 0x7f04640697e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f04800ae680 tx=0x7f047c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.494+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f047002a060 con 0x7f04800b1f40 2023-09-30T23:02:22.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.729+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04800c21a0 con 0x7f04800b1f40 2023-09-30T23:02:22.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.730+0000 7f04757fa700 1 -- 172.21.15.142:0/484953196 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f0470015020 con 0x7f04800b1f40 2023-09-30T23:02:22.731 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:22.731 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:00:03.199135+0000","modified":"2023-09-30T23:00:06.755986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/3293843450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3293843450},{"type":"v1","addr":"172.21.15.148:6834","nonce":3293843450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-09-30T23:02:22.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0464067330 msgr2=0x7f04640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0464067330 0x7f04640697e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f04800ae680 tx=0x7f047c009040 comp rx=0 tx=0).stop 2023-09-30T23:02:22.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04800b1f40 msgr2=0x7f04800c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04800b1f40 0x7f04800c7100 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0480068600 tx=0x7f0470017000 comp rx=0 tx=0).stop 2023-09-30T23:02:22.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 shutdown_connections 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0464067330 0x7f04640697e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0480157a90 0x7f04800c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f048006b3d0 0x7f0480141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 --2- 172.21.15.142:0/484953196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04800b1f40 0x7f04800c7100 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 >> 172.21.15.142:0/484953196 conn(0x7f04800680c0 msgr2=0x7f04800caae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 shutdown_connections 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.732+0000 7f04873ff700 1 -- 172.21.15.142:0/484953196 wait complete. 2023-09-30T23:02:22.734 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 74 2023-09-30T23:02:22.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:22.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.938+0000 7f9c7f9ff700 1 Processor -- start 2023-09-30T23:02:22.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.939+0000 7f9c7f9ff700 1 -- start start 2023-09-30T23:02:22.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7f9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9c780af020 0x7f9c78156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7f9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c7806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7f9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7806d3e0 con 0x7f9c7806e650 2023-09-30T23:02:22.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7f9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7815b400 con 0x7f9c780af020 2023-09-30T23:02:22.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7f9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7806dc80 con 0x7f9c780b00d0 2023-09-30T23:02:22.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7d79b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9c780af020 0x7f9c78156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7df9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9c7806e650 0x7f9c780b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51346/0 (socket says 172.21.15.142:51346) 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7d79b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9c780af020 0x7f9c78156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43990/0 (socket says 172.21.15.142:43990) 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7df9c700 1 -- 172.21.15.142:0/721736156 learned_addr learned my addr 172.21.15.142:0/721736156 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.940+0000 7f9c7cf9a700 1 --2- 172.21.15.142:0/721736156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c7806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c7d79b700 1 -- 172.21.15.142:0/721736156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 msgr2=0x7f9c7806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c7d79b700 1 --2- 172.21.15.142:0/721736156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c7806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c7d79b700 1 -- 172.21.15.142:0/721736156 >> v1:172.21.15.142:6789/0 conn(0x7f9c7806e650 legacy=0x7f9c780b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c7d79b700 1 -- 172.21.15.142:0/721736156 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7806b790 con 0x7f9c780af020 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c6ffff700 1 -- 172.21.15.142:0/721736156 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408877130 0 0) 0x7f9c7806d3e0 con 0x7f9c7806e650 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c7d79b700 1 --2- 172.21.15.142:0/721736156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c780af020 0x7f9c78156d80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9c740098e0 tx=0x7f9c740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e7decd240af2b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c6ffff700 1 -- 172.21.15.142:0/721736156 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400b640 con 0x7f9c780af020 2023-09-30T23:02:22.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c6ffff700 1 -- 172.21.15.142:0/721736156 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400b7a0 con 0x7f9c780af020 2023-09-30T23:02:22.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.941+0000 7f9c6ffff700 1 -- 172.21.15.142:0/721736156 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400bb40 con 0x7f9c780af020 2023-09-30T23:02:22.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/721736156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c780af020 msgr2=0x7f9c78156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/721736156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c780af020 0x7f9c78156d80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9c740098e0 tx=0x7f9c740091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/721736156 shutdown_connections 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/721736156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c780af020 0x7f9c78156d80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/721736156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c7806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/721736156 >> 172.21.15.142:0/721736156 conn(0x7f9c780680c0 msgr2=0x7f9c780c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/721736156 shutdown_connections 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.942+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/721736156 wait complete. 2023-09-30T23:02:22.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.943+0000 7f9c7f9ff700 1 Processor -- start 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.944+0000 7f9c7f9ff700 1 -- start start 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.944+0000 7f9c7f9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c7806e650 0x7f9c780cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.944+0000 7f9c7f9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c780af020 0x7f9c781592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.944+0000 7f9c7f9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c781597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.944+0000 7f9c7f9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78147c80 con 0x7f9c7806e650 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.944+0000 7f9c7f9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78159d20 con 0x7f9c780af020 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.944+0000 7f9c7f9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78147000 con 0x7f9c780b00d0 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c7806e650 0x7f9c780cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c7806e650 0x7f9c780cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43998/0 (socket says 172.21.15.142:43998) 2023-09-30T23:02:22.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 -- 172.21.15.142:0/4066768963 learned_addr learned my addr 172.21.15.142:0/4066768963 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7cf9a700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c780af020 0x7f9c781592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7df9c700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c781597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 -- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 msgr2=0x7f9c781597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c781597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 -- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c780af020 msgr2=0x7f9c781592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c780af020 0x7f9c781592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 -- 172.21.15.142:0/4066768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009420 con 0x7f9c7806e650 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7cf9a700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c780af020 0x7f9c781592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7df9c700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c781597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:22.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.945+0000 7f9c7d79b700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c7806e650 0x7f9c780cb950 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9c78068600 tx=0x7f9c74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.946+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7401f070 con 0x7f9c7806e650 2023-09-30T23:02:22.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.946+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74000bc0 con 0x7f9c7806e650 2023-09-30T23:02:22.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.946+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c781472e0 con 0x7f9c7806e650 2023-09-30T23:02:22.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.946+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74025420 con 0x7f9c7806e650 2023-09-30T23:02:22.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.946+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c781478a0 con 0x7f9c7806e650 2023-09-30T23:02:22.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.947+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c780695b0 con 0x7f9c7806e650 2023-09-30T23:02:22.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.948+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9c74023070 con 0x7f9c7806e650 2023-09-30T23:02:22.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.948+0000 7f9c6d7fa700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c5c067330 0x7f9c5c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:22.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.949+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f9c74086170 con 0x7f9c7806e650 2023-09-30T23:02:22.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.949+0000 7f9c7cf9a700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c5c067330 0x7f9c5c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:22.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.949+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f9c5c06f6d0 con 0x7f9c7806e650 2023-09-30T23:02:22.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.949+0000 7f9c7cf9a700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c5c067330 0x7f9c5c0697e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006f00 tx=0x7f9c68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:22.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:22.953+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9c74052f40 con 0x7f9c7806e650 2023-09-30T23:02:23.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.189+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c7806fc10 con 0x7f9c7806e650 2023-09-30T23:02:23.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.189+0000 7f9c6d7fa700 1 -- 172.21.15.142:0/4066768963 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f9c74056560 con 0x7f9c7806e650 2023-09-30T23:02:23.191 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:23.191 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:00:03.199135+0000","modified":"2023-09-30T23:00:06.755986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"d","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6834/3293843450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3293843450},{"type":"v1","addr":"172.21.15.148:6834","nonce":3293843450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-09-30T23:02:23.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c5c067330 msgr2=0x7f9c5c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c5c067330 0x7f9c5c0697e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006f00 tx=0x7f9c68008040 comp rx=0 tx=0).stop 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c7806e650 msgr2=0x7f9c780cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c7806e650 0x7f9c780cb950 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9c78068600 tx=0x7f9c74017000 comp rx=0 tx=0).stop 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 shutdown_connections 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9c5c067330 0x7f9c5c0697e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c780b00d0 0x7f9c781597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c7806e650 0x7f9c780cb950 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 --2- 172.21.15.142:0/4066768963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c780af020 0x7f9c781592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 >> 172.21.15.142:0/4066768963 conn(0x7f9c780680c0 msgr2=0x7f9c780cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:23.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 shutdown_connections 2023-09-30T23:02:23.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.192+0000 7f9c7f9ff700 1 -- 172.21.15.142:0/4066768963 wait complete. 2023-09-30T23:02:23.195 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 74 2023-09-30T23:02:23.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:02:23.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.398+0000 7f8290fff700 1 Processor -- start 2023-09-30T23:02:23.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.399+0000 7f8290fff700 1 -- start start 2023-09-30T23:02:23.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.400+0000 7f8290fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 0x7f828c1628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.400+0000 7f8290fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c06d470 con 0x7f828c157a90 2023-09-30T23:02:23.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.400+0000 7f8290fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c157e60 con 0x7f828c06b3d0 2023-09-30T23:02:23.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.400+0000 7f8290fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0ae880 con 0x7f828c0b2110 2023-09-30T23:02:23.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.400+0000 7f828a59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f828c157a90 0x7f828c15bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51352/0 (socket says 172.21.15.142:51352) 2023-09-30T23:02:23.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.400+0000 7f828a59c700 1 -- 172.21.15.142:0/1965226379 learned_addr learned my addr 172.21.15.142:0/1965226379 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:23.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.400+0000 7f828ad9d700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 0x7f828c1628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95930379 0 0) 0x7f828c06d470 con 0x7f828c157a90 2023-09-30T23:02:23.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8274003570 con 0x7f828c157a90 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430572173 0 0) 0x7f828c157e60 con 0x7f828c06b3d0 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f828c06d470 con 0x7f828c06b3d0 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4225400053 0 0) 0x7f8274003570 con 0x7f828c157a90 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 msgr2=0x7f828c1628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 0x7f828c1628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 >> v1:172.21.15.148:6789/0 conn(0x7f828c06b3d0 legacy=0x7f828c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0aeb60 con 0x7f828c157a90 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f827c001470 con 0x7f828c157a90 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 >> v1:172.21.15.142:6789/0 conn(0x7f828c157a90 legacy=0x7f828c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8274003c20 0x7f8274004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8274004810 0x7f8274004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 0x7f82740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0ae880 con 0x7f8274003c20 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827400bb40 con 0x7f8274004810 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827400bd00 con 0x7f828c0b2110 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828a59c700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8274003c20 0x7f8274004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f8289d9b700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8274004810 0x7f8274004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.401+0000 7f828ad9d700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 0x7f82740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828a59c700 1 -- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 msgr2=0x7f82740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828a59c700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f828c0b2110 0x7f82740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828a59c700 1 -- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8274004810 msgr2=0x7f8274004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828a59c700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8274004810 0x7f8274004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828a59c700 1 -- 172.21.15.142:0/1965226379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274003570 con 0x7f8274003c20 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828a59c700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8274003c20 0x7f8274004010 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c2d0 tx=0x7f827c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2acfcfa2b77d2bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00cbc0 con 0x7f8274003c20 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c00cd20 con 0x7f8274003c20 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.402+0000 7f828959a700 1 -- 172.21.15.142:0/1965226379 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c005b70 con 0x7f8274003c20 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.403+0000 7f8290fff700 1 -- 172.21.15.142:0/1965226379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8274003c20 msgr2=0x7f8274004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.403+0000 7f8290fff700 1 --2- 172.21.15.142:0/1965226379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8274003c20 0x7f8274004010 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c2d0 tx=0x7f827c001e10 comp rx=0 tx=0).stop 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.403+0000 7f828ad9d700 1 -- 172.21.15.142:0/1965226379 reap_dead start 2023-09-30T23:02:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.403+0000 7f8290fff700 1 -- 172.21.15.142:0/1965226379 shutdown_connections 2023-09-30T23:02:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.403+0000 7f8290fff700 1 -- 172.21.15.142:0/1965226379 >> 172.21.15.142:0/1965226379 conn(0x7f828c0680c0 msgr2=0x7f828c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.403+0000 7f8290fff700 1 -- 172.21.15.142:0/1965226379 shutdown_connections 2023-09-30T23:02:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.403+0000 7f8290fff700 1 -- 172.21.15.142:0/1965226379 wait complete. 2023-09-30T23:02:23.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.404+0000 7f8290fff700 1 Processor -- start 2023-09-30T23:02:23.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.404+0000 7f8290fff700 1 -- start start 2023-09-30T23:02:23.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.405+0000 7f8290fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8274003c20 0x7f828c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.405+0000 7f8290fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f828c0c7100 0x7f828c0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.405+0000 7f8290fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f828c16a810 0x7f828c16ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.405+0000 7f8290fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0c7ab0 con 0x7f828c16a810 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.405+0000 7f8290fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0af7f0 con 0x7f828c0c7100 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.405+0000 7f8290fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0b0370 con 0x7f8274003c20 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f828c16a810 0x7f828c16ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f828c16a810 0x7f828c16ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44020/0 (socket says 172.21.15.142:44020) 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 -- 172.21.15.142:0/2101989076 learned_addr learned my addr 172.21.15.142:0/2101989076 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828a59c700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8274003c20 0x7f828c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f8289d9b700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f828c0c7100 0x7f828c0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 -- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8274003c20 msgr2=0x7f828c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8274003c20 0x7f828c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 -- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f828c0c7100 msgr2=0x7f828c0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f828c0c7100 0x7f828c0c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 -- 172.21.15.142:0/2101989076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0afa40 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828a59c700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8274003c20 0x7f828c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f828ad9d700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f828c16a810 0x7f828c16ac80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f828c0b2510 tx=0x7f828400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.406+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400e040 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.407+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400f040 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.407+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c0afd20 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.407+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400fe40 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.407+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c156220 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.408+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c0c9bc0 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.409+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8284015640 con 0x7f828c16a810 2023-09-30T23:02:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.410+0000 7f827a7fc700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f826c067330 0x7f826c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.410+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f82840855f0 con 0x7f828c16a810 2023-09-30T23:02:23.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.410+0000 7f828a59c700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f826c067330 0x7f826c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.410+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f826c06f6d0 con 0x7f828c16a810 2023-09-30T23:02:23.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.410+0000 7f828a59c700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f826c067330 0x7f826c0697e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f827c008fd0 tx=0x7f827c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:23.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.414+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f828405b070 con 0x7f828c16a810 2023-09-30T23:02:23.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.609+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f828c06fc10 con 0x7f828c16a810 2023-09-30T23:02:23.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.610+0000 7f827a7fc700 1 -- 172.21.15.142:0/2101989076 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+17293 (secure 0 0 0) 0x7f8284023090 con 0x7f828c16a810 2023-09-30T23:02:23.611 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:23.611 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":163,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:01:39.360568+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:00:01.319776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-09-30T23:00:02.170708+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"20.2","mappings":[{"from":3,"to":7}]},{"pgid":"20.13","mappings":[{"from":3,"to":1}]},{"pgid":"20.22","mappings":[{"from":3,"to":7}]},{"pgid":"20.27","mappings":[{"from":3,"to":7}]},{"pgid":"20.2b","mappings":[{"from":3,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f826c067330 msgr2=0x7f826c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f826c067330 0x7f826c0697e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f827c008fd0 tx=0x7f827c015000 comp rx=0 tx=0).stop 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f828c16a810 msgr2=0x7f828c16ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f828c16a810 0x7f828c16ac80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f828c0b2510 tx=0x7f828400b040 comp rx=0 tx=0).stop 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 shutdown_connections 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f826c067330 0x7f826c0697e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f828c16a810 0x7f828c16ac80 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8274003c20 0x7f828c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 --2- 172.21.15.142:0/2101989076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f828c0c7100 0x7f828c0c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 >> 172.21.15.142:0/2101989076 conn(0x7f828c0680c0 msgr2=0x7f828c0cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:23.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 shutdown_connections 2023-09-30T23:02:23.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.612+0000 7f8290fff700 1 -- 172.21.15.142:0/2101989076 wait complete. 2023-09-30T23:02:23.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T23:02:23.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.820+0000 7fb0a13ff700 1 Processor -- start 2023-09-30T23:02:23.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.820+0000 7fb0a13ff700 1 -- start start 2023-09-30T23:02:23.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb0a13ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb09c1598e0 0x7fb09c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb0a13ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb09c0d03d0 0x7fb09c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb0a13ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c06b8d0 con 0x7fb09c0cee50 2023-09-30T23:02:23.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb0a13ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0cff40 con 0x7fb09c1598e0 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb0a13ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0cf330 con 0x7fb09c0d03d0 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb09affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb09c1598e0 0x7fb09c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb09affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb09c1598e0 0x7fb09c159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44026/0 (socket says 172.21.15.142:44026) 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb09affd700 1 -- 172.21.15.142:0/3289573066 learned_addr learned my addr 172.21.15.142:0/3289573066 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb09b7fe700 1 --2- 172.21.15.142:0/3289573066 >> v2:172.21.15.148:3300/0 conn(0x7fb09c0d03d0 0x7fb09c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb09affd700 1 -- 172.21.15.142:0/3289573066 >> v2:172.21.15.148:3300/0 conn(0x7fb09c0d03d0 msgr2=0x7fb09c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.822+0000 7fb09affd700 1 --2- 172.21.15.142:0/3289573066 >> v2:172.21.15.148:3300/0 conn(0x7fb09c0d03d0 0x7fb09c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.823+0000 7fb09affd700 1 -- 172.21.15.142:0/3289573066 >> v1:172.21.15.148:6789/0 conn(0x7fb09c0cee50 legacy=0x7fb09c06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.823+0000 7fb09affd700 1 -- 172.21.15.142:0/3289573066 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0cf610 con 0x7fb09c1598e0 2023-09-30T23:02:23.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.823+0000 7fb09affd700 1 --2- 172.21.15.142:0/3289573066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c1598e0 0x7fb09c159cb0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0cfeb0 tx=0x7fb08c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c711add217121163 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:23.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.823+0000 7fb099ffb700 1 -- 172.21.15.142:0/3289573066 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00b860 con 0x7fb09c1598e0 2023-09-30T23:02:23.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.823+0000 7fb099ffb700 1 -- 172.21.15.142:0/3289573066 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c00b9c0 con 0x7fb09c1598e0 2023-09-30T23:02:23.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.823+0000 7fb099ffb700 1 -- 172.21.15.142:0/3289573066 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00bd60 con 0x7fb09c1598e0 2023-09-30T23:02:23.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3289573066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c1598e0 msgr2=0x7fb09c159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3289573066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c1598e0 0x7fb09c159cb0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0cfeb0 tx=0x7fb08c009250 comp rx=0 tx=0).stop 2023-09-30T23:02:23.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3289573066 shutdown_connections 2023-09-30T23:02:23.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3289573066 >> v2:172.21.15.148:3300/0 conn(0x7fb09c0d03d0 0x7fb09c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3289573066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c1598e0 0x7fb09c159cb0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3289573066 >> 172.21.15.142:0/3289573066 conn(0x7fb09c0cd540 msgr2=0x7fb09c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:23.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3289573066 shutdown_connections 2023-09-30T23:02:23.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.824+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3289573066 wait complete. 2023-09-30T23:02:23.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.825+0000 7fb0a13ff700 1 Processor -- start 2023-09-30T23:02:23.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.825+0000 7fb0a13ff700 1 -- start start 2023-09-30T23:02:23.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.826+0000 7fb0a13ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c0cee50 0x7fb09c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.826+0000 7fb0a13ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb09c0d03d0 0x7fb09c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.826+0000 7fb0a13ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb09c1598e0 0x7fb09c0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.826+0000 7fb0a13ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15a5d0 con 0x7fb09c0cee50 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.826+0000 7fb0a13ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15a8b0 con 0x7fb09c1598e0 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.826+0000 7fb0a13ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15ab90 con 0x7fb09c0d03d0 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.826+0000 7fb09affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c0cee50 0x7fb09c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c0cee50 0x7fb09c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44042/0 (socket says 172.21.15.142:44042) 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 -- 172.21.15.142:0/3096018552 learned_addr learned my addr 172.21.15.142:0/3096018552 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09b7fe700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb09c1598e0 0x7fb09c0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09a7fc700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb09c0d03d0 0x7fb09c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 -- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb09c0d03d0 msgr2=0x7fb09c150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb09c0d03d0 0x7fb09c150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 -- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb09c1598e0 msgr2=0x7fb09c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:23.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb09c1598e0 0x7fb09c0b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 -- 172.21.15.142:0/3096018552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0094f0 con 0x7fb09c0cee50 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09a7fc700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb09c0d03d0 0x7fb09c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb09affd700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c0cee50 0x7fb09c0c5f10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0ce0a0 tx=0x7fb08c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011e60 con 0x7fb09c0cee50 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c01a630 con 0x7fb09c0cee50 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c01a9f0 con 0x7fb09c0cee50 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.827+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c15ae70 con 0x7fb09c0cee50 2023-09-30T23:02:23.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.828+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c0c6450 con 0x7fb09c0cee50 2023-09-30T23:02:23.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.829+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c15b6d0 con 0x7fb09c0cee50 2023-09-30T23:02:23.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.829+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb08c02d440 con 0x7fb09c0cee50 2023-09-30T23:02:23.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.830+0000 7fb082ffd700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb088067330 0x7fb0880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:23.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.830+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fb08c0867b0 con 0x7fb09c0cee50 2023-09-30T23:02:23.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.831+0000 7fb09a7fc700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb088067330 0x7fb0880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:23.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.831+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fb08806f6d0 con 0x7fb09c0cee50 2023-09-30T23:02:23.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.831+0000 7fb09a7fc700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb088067330 0x7fb0880697e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0b63a0 tx=0x7fb090009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:23.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:23.835+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb08c084e60 con 0x7fb09c0cee50 2023-09-30T23:02:24.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.069+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb09c06fc10 con 0x7fb09c0cee50 2023-09-30T23:02:24.070 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T23:02:24.070+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T23:02:24.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.072+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(164..164 src has 1..164) v4 ==== 366+0+0 (secure 0 0 0) 0x7fb08c057240 con 0x7fb09c0cee50 2023-09-30T23:02:24.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.072+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=165}) v3 -- 0x7fb088070060 con 0x7fb09c0cee50 2023-09-30T23:02:24.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.074+0000 7fb082ffd700 1 -- 172.21.15.142:0/3096018552 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb08c015070 con 0x7fb09c0cee50 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb088067330 msgr2=0x7fb0880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb088067330 0x7fb0880697e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0b63a0 tx=0x7fb090009040 comp rx=0 tx=0).stop 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c0cee50 msgr2=0x7fb09c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c0cee50 0x7fb09c0c5f10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0ce0a0 tx=0x7fb08c017000 comp rx=0 tx=0).stop 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 shutdown_connections 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb088067330 0x7fb0880697e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb09c1598e0 0x7fb09c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb09c0cee50 0x7fb09c0c5f10 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 --2- 172.21.15.142:0/3096018552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb09c0d03d0 0x7fb09c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 >> 172.21.15.142:0/3096018552 conn(0x7fb09c0cd540 msgr2=0x7fb09c158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:24.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 shutdown_connections 2023-09-30T23:02:24.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.079+0000 7fb0a13ff700 1 -- 172.21.15.142:0/3096018552 wait complete. 2023-09-30T23:02:24.081 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T23:02:24.087 INFO:tasks.ceph.mds.d.smithi148.stderr: -9246> 2023-09-30T23:00:04.699+0000 7f328fbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T23:02:24.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T23:02:24.137 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T23:02:24.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.290+0000 7fb14a3ff700 1 Processor -- start 2023-09-30T23:02:24.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.290+0000 7fb14a3ff700 1 -- start start 2023-09-30T23:02:24.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.291+0000 7fb14a3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1440ca5e0 0x7fb14406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:24.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.291+0000 7fb14a3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb144067d10 con 0x7fb144159ba0 2023-09-30T23:02:24.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.291+0000 7fb14a3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14406af90 con 0x7fb1440b0de0 2023-09-30T23:02:24.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.291+0000 7fb14a3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440676c0 con 0x7fb1440ca5e0 2023-09-30T23:02:24.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.291+0000 7fb143fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb144159ba0 0x7fb1440c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51356/0 (socket says 172.21.15.142:51356) 2023-09-30T23:02:24.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.291+0000 7fb143fff700 1 -- 172.21.15.142:0/2139628812 learned_addr learned my addr 172.21.15.142:0/2139628812 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:24.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb1437fe700 1 --2- 172.21.15.142:0/2139628812 >> v2:172.21.15.148:3300/0 conn(0x7fb1440ca5e0 0x7fb14406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:24.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb142ffd700 1 -- 172.21.15.142:0/2139628812 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116833199 0 0) 0x7fb144067d10 con 0x7fb144159ba0 2023-09-30T23:02:24.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb142ffd700 1 -- 172.21.15.142:0/2139628812 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12c003570 con 0x7fb144159ba0 2023-09-30T23:02:24.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb142ffd700 1 -- 172.21.15.142:0/2139628812 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719270887 0 0) 0x7fb14406af90 con 0x7fb1440b0de0 2023-09-30T23:02:24.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb142ffd700 1 -- 172.21.15.142:0/2139628812 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb144067d10 con 0x7fb1440b0de0 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb1437fe700 1 -- 172.21.15.142:0/2139628812 >> v1:172.21.15.148:6789/0 conn(0x7fb1440b0de0 legacy=0x7fb1440681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb1437fe700 1 -- 172.21.15.142:0/2139628812 >> v1:172.21.15.142:6789/0 conn(0x7fb144159ba0 legacy=0x7fb1440c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb1437fe700 1 -- 172.21.15.142:0/2139628812 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440679a0 con 0x7fb1440ca5e0 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.292+0000 7fb1437fe700 1 --2- 172.21.15.142:0/2139628812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1440ca5e0 0x7fb14406a8d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb1380098e0 tx=0x7fb1380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4580fb8297fdc91d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb142ffd700 1 -- 172.21.15.142:0/2139628812 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138011630 con 0x7fb1440ca5e0 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb142ffd700 1 -- 172.21.15.142:0/2139628812 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138011790 con 0x7fb1440ca5e0 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb142ffd700 1 -- 172.21.15.142:0/2139628812 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138011b30 con 0x7fb1440ca5e0 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb14a3ff700 1 -- 172.21.15.142:0/2139628812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1440ca5e0 msgr2=0x7fb14406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/2139628812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1440ca5e0 0x7fb14406a8d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb1380098e0 tx=0x7fb1380091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb14a3ff700 1 -- 172.21.15.142:0/2139628812 shutdown_connections 2023-09-30T23:02:24.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/2139628812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1440ca5e0 0x7fb14406a8d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb14a3ff700 1 -- 172.21.15.142:0/2139628812 >> 172.21.15.142:0/2139628812 conn(0x7fb1440cb2f0 msgr2=0x7fb1440cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:24.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb14a3ff700 1 -- 172.21.15.142:0/2139628812 shutdown_connections 2023-09-30T23:02:24.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.293+0000 7fb14a3ff700 1 -- 172.21.15.142:0/2139628812 wait complete. 2023-09-30T23:02:24.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.295+0000 7fb14a3ff700 1 Processor -- start 2023-09-30T23:02:24.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.296+0000 7fb14a3ff700 1 -- start start 2023-09-30T23:02:24.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb14a3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1440b0de0 0x7fb144158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:24.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb14a3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1440ca5e0 0x7fb1440c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:24.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb14a3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb144159ba0 0x7fb14415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:24.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb14a3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440c6d60 con 0x7fb1440b0de0 2023-09-30T23:02:24.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb14a3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14415cfc0 con 0x7fb144159ba0 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb14a3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14415d200 con 0x7fb1440ca5e0 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb143fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1440b0de0 0x7fb144158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb143fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1440b0de0 0x7fb144158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44050/0 (socket says 172.21.15.142:44050) 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb143fff700 1 -- 172.21.15.142:0/3296293654 learned_addr learned my addr 172.21.15.142:0/3296293654 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb1437fe700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1440ca5e0 0x7fb1440c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb14899c700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb144159ba0 0x7fb14415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb143fff700 1 -- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1440ca5e0 msgr2=0x7fb1440c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb143fff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1440ca5e0 0x7fb1440c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb143fff700 1 -- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb144159ba0 msgr2=0x7fb14415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.297+0000 7fb143fff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb144159ba0 0x7fb14415ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:24.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.298+0000 7fb143fff700 1 -- 172.21.15.142:0/3296293654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009420 con 0x7fb1440b0de0 2023-09-30T23:02:24.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.298+0000 7fb143fff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1440b0de0 0x7fb144158150 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c7c0 tx=0x7fb134007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:24.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.298+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134005b30 con 0x7fb1440b0de0 2023-09-30T23:02:24.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.298+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134005c90 con 0x7fb1440b0de0 2023-09-30T23:02:24.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.298+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1340072e0 con 0x7fb1440b0de0 2023-09-30T23:02:24.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.298+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440c5a60 con 0x7fb1440b0de0 2023-09-30T23:02:24.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.298+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1440c6020 con 0x7fb1440b0de0 2023-09-30T23:02:24.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.299+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14406e4b0 con 0x7fb1440b0de0 2023-09-30T23:02:24.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.300+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb134007690 con 0x7fb1440b0de0 2023-09-30T23:02:24.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.301+0000 7fb12bfff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb130067330 0x7fb1300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:24.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.301+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6289+0+0 (secure 0 0 0) 0x7fb134083fb0 con 0x7fb1440b0de0 2023-09-30T23:02:24.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.301+0000 7fb1437fe700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb130067330 0x7fb1300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:24.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.301+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=165}) v3 -- 0x7fb13006f790 con 0x7fb1440b0de0 2023-09-30T23:02:24.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.302+0000 7fb1437fe700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb130067330 0x7fb1300697e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb1440ca9e0 tx=0x7fb138017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:24.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.305+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb13404b570 con 0x7fb1440b0de0 2023-09-30T23:02:24.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.372+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(165..165 src has 1..165) v4 ==== 671+0+0 (secure 0 0 0) 0x7fb134054a90 con 0x7fb1440b0de0 2023-09-30T23:02:24.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.372+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=166}) v3 -- 0x7fb130070400 con 0x7fb1440b0de0 2023-09-30T23:02:24.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:24.544+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb1440cac40 con 0x7fb1440b0de0 2023-09-30T23:02:25.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.078+0000 7fb12bfff700 1 -- 172.21.15.142:0/3296293654 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb134017020 con 0x7fb1440b0de0 2023-09-30T23:02:25.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb130067330 msgr2=0x7fb1300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:25.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb130067330 0x7fb1300697e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb1440ca9e0 tx=0x7fb138017000 comp rx=0 tx=0).stop 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1440b0de0 msgr2=0x7fb144158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1440b0de0 0x7fb144158150 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c7c0 tx=0x7fb134007ea0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 shutdown_connections 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb130067330 0x7fb1300697e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb144159ba0 0x7fb14415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1440b0de0 0x7fb144158150 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.081+0000 7fb14a3ff700 1 --2- 172.21.15.142:0/3296293654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1440ca5e0 0x7fb1440c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.082+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 >> 172.21.15.142:0/3296293654 conn(0x7fb1440cb2f0 msgr2=0x7fb1440b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.082+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 shutdown_connections 2023-09-30T23:02:25.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.082+0000 7fb14a3ff700 1 -- 172.21.15.142:0/3296293654 wait complete. 2023-09-30T23:02:25.101 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T23:02:25.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.296+0000 7f0bd47ff700 1 Processor -- start 2023-09-30T23:02:25.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.296+0000 7f0bd47ff700 1 -- start start 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd47ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd47ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0bcc06aeb0 0x7f0bcc157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd47ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0ca790 con 0x7f0bcc0ca240 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd47ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0cc340 con 0x7f0bcc06aeb0 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd47ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0caa70 con 0x7f0bcc150730 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd1d9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0bcc0ca240 0x7f0bcc06a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51372/0 (socket says 172.21.15.142:51372) 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd1d9a700 1 -- 172.21.15.142:0/2072194020 learned_addr learned my addr 172.21.15.142:0/2072194020 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd2d9c700 1 --2- 172.21.15.142:0/2072194020 >> v2:172.21.15.142:3300/0 conn(0x7f0bcc06aeb0 0x7f0bcc157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd259b700 1 --2- 172.21.15.142:0/2072194020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.298+0000 7f0bd1599700 1 -- 172.21.15.142:0/2072194020 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517054698 0 0) 0x7f0bcc0ca790 con 0x7f0bcc0ca240 2023-09-30T23:02:25.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd1599700 1 -- 172.21.15.142:0/2072194020 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb8003570 con 0x7f0bcc0ca240 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd2d9c700 1 -- 172.21.15.142:0/2072194020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 msgr2=0x7f0bcc157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd2d9c700 1 --2- 172.21.15.142:0/2072194020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd2d9c700 1 -- 172.21.15.142:0/2072194020 >> v1:172.21.15.142:6789/0 conn(0x7f0bcc0ca240 legacy=0x7f0bcc06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd2d9c700 1 -- 172.21.15.142:0/2072194020 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0cad50 con 0x7f0bcc06aeb0 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd2d9c700 1 --2- 172.21.15.142:0/2072194020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc06aeb0 0x7f0bcc157fe0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009e60 tx=0x7f0bc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9de6273c6bd27c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd1599700 1 -- 172.21.15.142:0/2072194020 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400e070 con 0x7f0bcc06aeb0 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd1599700 1 -- 172.21.15.142:0/2072194020 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400bab0 con 0x7f0bcc06aeb0 2023-09-30T23:02:25.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.299+0000 7f0bd1599700 1 -- 172.21.15.142:0/2072194020 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400be70 con 0x7f0bcc06aeb0 2023-09-30T23:02:25.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 -- 172.21.15.142:0/2072194020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc06aeb0 msgr2=0x7f0bcc157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:25.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/2072194020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc06aeb0 0x7f0bcc157fe0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009e60 tx=0x7f0bc4009780 comp rx=0 tx=0).stop 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 -- 172.21.15.142:0/2072194020 shutdown_connections 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/2072194020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc06aeb0 0x7f0bcc157fe0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/2072194020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 -- 172.21.15.142:0/2072194020 >> 172.21.15.142:0/2072194020 conn(0x7f0bcc0cc670 msgr2=0x7f0bcc0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 -- 172.21.15.142:0/2072194020 shutdown_connections 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.300+0000 7f0bd47ff700 1 -- 172.21.15.142:0/2072194020 wait complete. 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.301+0000 7f0bd47ff700 1 Processor -- start 2023-09-30T23:02:25.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.302+0000 7f0bd47ff700 1 -- start start 2023-09-30T23:02:25.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.302+0000 7f0bd47ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bcc06aeb0 0x7f0bcc0c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:25.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.302+0000 7f0bd47ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc0ca240 0x7f0bcc154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:25.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.302+0000 7f0bd47ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:25.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.302+0000 7f0bd47ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c6810 con 0x7f0bcc0ca240 2023-09-30T23:02:25.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.302+0000 7f0bd47ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc141360 con 0x7f0bcc06aeb0 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.302+0000 7f0bd47ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c2e90 con 0x7f0bcc150730 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc0ca240 0x7f0bcc154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc0ca240 0x7f0bcc154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44062/0 (socket says 172.21.15.142:44062) 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 -- 172.21.15.142:0/1811367823 learned_addr learned my addr 172.21.15.142:0/1811367823 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd259b700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bcc06aeb0 0x7f0bcc0c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd2d9c700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 -- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 msgr2=0x7f0bcc155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 -- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bcc06aeb0 msgr2=0x7f0bcc0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:25.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bcc06aeb0 0x7f0bcc0c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 -- 172.21.15.142:0/1811367823 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009a20 con 0x7f0bcc0ca240 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.303+0000 7f0bd1d9a700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc0ca240 0x7f0bcc154f10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c7c0 tx=0x7f0bbc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.304+0000 7f0bc27fc700 1 -- 172.21.15.142:0/1811367823 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc005b30 con 0x7f0bcc0ca240 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.304+0000 7f0bc27fc700 1 -- 172.21.15.142:0/1811367823 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc005c90 con 0x7f0bcc0ca240 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.304+0000 7f0bc27fc700 1 -- 172.21.15.142:0/1811367823 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc007340 con 0x7f0bcc0ca240 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.304+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc140a30 con 0x7f0bcc0ca240 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.304+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc140ff0 con 0x7f0bcc0ca240 2023-09-30T23:02:25.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.305+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc069a50 con 0x7f0bcc0ca240 2023-09-30T23:02:25.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.306+0000 7f0bc27fc700 1 -- 172.21.15.142:0/1811367823 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0bbc01b400 con 0x7f0bcc0ca240 2023-09-30T23:02:25.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.306+0000 7f0bc27fc700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0bb0067330 0x7f0bb00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:25.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.307+0000 7f0bc27fc700 1 -- 172.21.15.142:0/1811367823 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f0bbc084840 con 0x7f0bcc0ca240 2023-09-30T23:02:25.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.307+0000 7f0bd259b700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0bb0067330 0x7f0bb00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:25.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.307+0000 7f0bd259b700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0bb0067330 0x7f0bb00697e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009ca0 tx=0x7f0bc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:25.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.311+0000 7f0bc27fc700 1 -- 172.21.15.142:0/1811367823 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0bbc051630 con 0x7f0bcc0ca240 2023-09-30T23:02:25.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:25.501+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0bcc1414a0 con 0x7f0bcc0ca240 2023-09-30T23:02:26.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.086+0000 7f0bc27fc700 1 -- 172.21.15.142:0/1811367823 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v166) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0bbc054c50 con 0x7f0bcc0ca240 2023-09-30T23:02:26.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0bb0067330 msgr2=0x7f0bb00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:26.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0bb0067330 0x7f0bb00697e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009ca0 tx=0x7f0bc8008040 comp rx=0 tx=0).stop 2023-09-30T23:02:26.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc0ca240 msgr2=0x7f0bcc154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:26.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc0ca240 0x7f0bcc154f10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c7c0 tx=0x7f0bbc007e00 comp rx=0 tx=0).stop 2023-09-30T23:02:26.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 shutdown_connections 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0bb0067330 0x7f0bb00697e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0bcc150730 0x7f0bcc155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bcc06aeb0 0x7f0bcc0c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 --2- 172.21.15.142:0/1811367823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bcc0ca240 0x7f0bcc154f10 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 >> 172.21.15.142:0/1811367823 conn(0x7f0bcc0cc670 msgr2=0x7f0bcc156aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 shutdown_connections 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.091+0000 7f0bd47ff700 1 -- 172.21.15.142:0/1811367823 wait complete. 2023-09-30T23:02:26.093 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T23:02:26.112 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T23:02:26.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.309+0000 7fbf159ff700 1 Processor -- start 2023-09-30T23:02:26.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.310+0000 7fbf159ff700 1 -- start start 2023-09-30T23:02:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf159ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbf10157000 0x7fbf100ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf159ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf100c76c0 0x7fbf100c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf159ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100c7b30 con 0x7fbf101573d0 2023-09-30T23:02:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf159ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf100c5970 con 0x7fbf10157000 2023-09-30T23:02:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf159ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100c7d60 con 0x7fbf100c76c0 2023-09-30T23:02:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf0effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbf10157000 0x7fbf100ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:26.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf07fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf100c76c0 0x7fbf100c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:26.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf0effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbf10157000 0x7fbf100ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:35656/0 (socket says 172.21.15.142:35656) 2023-09-30T23:02:26.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.311+0000 7fbf0effd700 1 -- 172.21.15.142:0/2294953467 learned_addr learned my addr 172.21.15.142:0/2294953467 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:26.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.312+0000 7fbf0effd700 1 -- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf100c76c0 msgr2=0x7fbf100c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:26.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.312+0000 7fbf0effd700 1 --2- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf100c76c0 0x7fbf100c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.312+0000 7fbf0effd700 1 -- 172.21.15.142:0/2294953467 >> v1:172.21.15.148:6789/0 conn(0x7fbf101573d0 legacy=0x7fbf10157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.312+0000 7fbf0effd700 1 -- 172.21.15.142:0/2294953467 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100c3cd0 con 0x7fbf10157000 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.312+0000 7fbf07fff700 1 --2- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf100c76c0 0x7fbf100c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.312+0000 7fbf0effd700 1 --2- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 0x7fbf100ca240 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbf000099b0 tx=0x7fbf00009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b57f4ae69cf442 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf0e7fc700 1 -- 172.21.15.142:0/2294953467 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00009ea0 con 0x7fbf10157000 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf0e7fc700 1 -- 172.21.15.142:0/2294953467 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0000b860 con 0x7fbf10157000 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf0e7fc700 1 -- 172.21.15.142:0/2294953467 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000bc00 con 0x7fbf10157000 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 -- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 msgr2=0x7fbf100ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 0x7fbf100ca240 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbf000099b0 tx=0x7fbf00009250 comp rx=0 tx=0).stop 2023-09-30T23:02:26.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 -- 172.21.15.142:0/2294953467 shutdown_connections 2023-09-30T23:02:26.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 0x7fbf100ca240 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2294953467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf100c76c0 0x7fbf100c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 -- 172.21.15.142:0/2294953467 >> 172.21.15.142:0/2294953467 conn(0x7fbf100cc670 msgr2=0x7fbf100cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:26.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 -- 172.21.15.142:0/2294953467 shutdown_connections 2023-09-30T23:02:26.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.313+0000 7fbf159ff700 1 -- 172.21.15.142:0/2294953467 wait complete. 2023-09-30T23:02:26.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.315+0000 7fbf159ff700 1 Processor -- start 2023-09-30T23:02:26.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.315+0000 7fbf159ff700 1 -- start start 2023-09-30T23:02:26.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf159ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100c76c0 0x7fbf101542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:26.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf159ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 0x7fbf10159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf159ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf101573d0 0x7fbf10159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf159ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1013f340 con 0x7fbf100c76c0 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf159ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1013f620 con 0x7fbf10157000 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf159ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1013f900 con 0x7fbf101573d0 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf0effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100c76c0 0x7fbf101542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf0effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100c76c0 0x7fbf101542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44064/0 (socket says 172.21.15.142:44064) 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf0effd700 1 -- 172.21.15.142:0/2789775257 learned_addr learned my addr 172.21.15.142:0/2789775257 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf07fff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 0x7fbf10159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.316+0000 7fbf0f7fe700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf101573d0 0x7fbf10159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf0effd700 1 -- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf101573d0 msgr2=0x7fbf10159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:26.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf0effd700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf101573d0 0x7fbf10159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf0effd700 1 -- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 msgr2=0x7fbf10159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf0effd700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 0x7fbf10159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf0effd700 1 -- 172.21.15.142:0/2789775257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8009420 con 0x7fbf100c76c0 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf0f7fe700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf101573d0 0x7fbf10159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf0effd700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100c76c0 0x7fbf101542e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbf1006c260 tx=0x7fbf00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf06ffd700 1 -- 172.21.15.142:0/2789775257 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000bbe0 con 0x7fbf100c76c0 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf06ffd700 1 -- 172.21.15.142:0/2789775257 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf00011420 con 0x7fbf100c76c0 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf000094f0 con 0x7fbf100c76c0 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.317+0000 7fbf06ffd700 1 -- 172.21.15.142:0/2789775257 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000117c0 con 0x7fbf100c76c0 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.318+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1013e5c0 con 0x7fbf100c76c0 2023-09-30T23:02:26.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.318+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1013dda0 con 0x7fbf100c76c0 2023-09-30T23:02:26.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.319+0000 7fbf06ffd700 1 -- 172.21.15.142:0/2789775257 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbf00011bf0 con 0x7fbf100c76c0 2023-09-30T23:02:26.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.320+0000 7fbf06ffd700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbef0067330 0x7fbef00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:26.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.320+0000 7fbf06ffd700 1 -- 172.21.15.142:0/2789775257 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5851+0+0 (secure 0 0 0) 0x7fbf000863f0 con 0x7fbf100c76c0 2023-09-30T23:02:26.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.320+0000 7fbf07fff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbef0067330 0x7fbef00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:26.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.321+0000 7fbf07fff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbef0067330 0x7fbef00697e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbf1013bf40 tx=0x7fbef80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:26.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.325+0000 7fbf06ffd700 1 -- 172.21.15.142:0/2789775257 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbf00053320 con 0x7fbf100c76c0 2023-09-30T23:02:26.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:26.517+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf101386d0 con 0x7fbf100c76c0 2023-09-30T23:02:27.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.088+0000 7fbf06ffd700 1 -- 172.21.15.142:0/2789775257 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v167) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbf00056940 con 0x7fbf100c76c0 2023-09-30T23:02:27.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbef0067330 msgr2=0x7fbef00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbef0067330 0x7fbef00697e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbf1013bf40 tx=0x7fbef80091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100c76c0 msgr2=0x7fbf101542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100c76c0 0x7fbf101542e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbf1006c260 tx=0x7fbf00017000 comp rx=0 tx=0).stop 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 shutdown_connections 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fbef0067330 0x7fbef00697e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbf101573d0 0x7fbf10159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100c76c0 0x7fbf101542e0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.092+0000 7fbf159ff700 1 --2- 172.21.15.142:0/2789775257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf10157000 0x7fbf10159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.093+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 >> 172.21.15.142:0/2789775257 conn(0x7fbf100cc670 msgr2=0x7fbf100c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.093+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 shutdown_connections 2023-09-30T23:02:27.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.093+0000 7fbf159ff700 1 -- 172.21.15.142:0/2789775257 wait complete. 2023-09-30T23:02:27.095 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T23:02:27.113 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T23:02:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.307+0000 7ff35a9ff700 1 Processor -- start 2023-09-30T23:02:27.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.307+0000 7ff35a9ff700 1 -- start start 2023-09-30T23:02:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.308+0000 7ff35a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.308+0000 7ff35a9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff3540cc3b0 0x7ff3540cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.308+0000 7ff35a9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3540d0550 con 0x7ff3540cbfe0 2023-09-30T23:02:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.308+0000 7ff35a9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3540cf750 con 0x7ff3540cc3b0 2023-09-30T23:02:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.308+0000 7ff35a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540cf940 con 0x7ff354157ab0 2023-09-30T23:02:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff3540cc3b0 0x7ff3540cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff3540cc3b0 0x7ff3540cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:35664/0 (socket says 172.21.15.142:35664) 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 -- 172.21.15.142:0/1689549567 learned_addr learned my addr 172.21.15.142:0/1689549567 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff3537fe700 1 --2- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 -- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 msgr2=0x7ff35415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 --2- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 -- 172.21.15.142:0/1689549567 >> v1:172.21.15.148:6789/0 conn(0x7ff3540cbfe0 legacy=0x7ff3541573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 -- 172.21.15.142:0/1689549567 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3540cfc20 con 0x7ff3540cc3b0 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.309+0000 7ff358f9c700 1 --2- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 0x7ff3540cf210 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009f50 tx=0x7ff34c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4ab7159f4929887 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff352ffd700 1 -- 172.21.15.142:0/1689549567 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c00e070 con 0x7ff3540cc3b0 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff352ffd700 1 -- 172.21.15.142:0/1689549567 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c00b9c0 con 0x7ff3540cc3b0 2023-09-30T23:02:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff352ffd700 1 -- 172.21.15.142:0/1689549567 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0092e0 con 0x7ff3540cc3b0 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 -- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 msgr2=0x7ff3540cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 0x7ff3540cf210 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009f50 tx=0x7ff34c009840 comp rx=0 tx=0).stop 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 -- 172.21.15.142:0/1689549567 shutdown_connections 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 0x7ff3540cf210 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/1689549567 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 -- 172.21.15.142:0/1689549567 >> 172.21.15.142:0/1689549567 conn(0x7ff3540d0a80 msgr2=0x7ff3540d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 -- 172.21.15.142:0/1689549567 shutdown_connections 2023-09-30T23:02:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.310+0000 7ff35a9ff700 1 -- 172.21.15.142:0/1689549567 wait complete. 2023-09-30T23:02:27.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.312+0000 7ff35a9ff700 1 Processor -- start 2023-09-30T23:02:27.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.312+0000 7ff35a9ff700 1 -- start start 2023-09-30T23:02:27.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff35a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3540cbfe0 0x7ff354155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff35a9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 0x7ff35406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff35a9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35406e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff35a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354155780 con 0x7ff3540cbfe0 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff35a9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35416b200 con 0x7ff3540cc3b0 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff35a9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35416a330 con 0x7ff354157ab0 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff353fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3540cbfe0 0x7ff354155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff3537fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 0x7ff35406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff353fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3540cbfe0 0x7ff354155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44076/0 (socket says 172.21.15.142:44076) 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff353fff700 1 -- 172.21.15.142:0/915479230 learned_addr learned my addr 172.21.15.142:0/915479230 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.313+0000 7ff358f9c700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff353fff700 1 -- 172.21.15.142:0/915479230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 msgr2=0x7ff35406e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff353fff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35406e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff353fff700 1 -- 172.21.15.142:0/915479230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 msgr2=0x7ff35406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff353fff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 0x7ff35406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff353fff700 1 -- 172.21.15.142:0/915479230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c009ae0 con 0x7ff3540cbfe0 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff353fff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3540cbfe0 0x7ff354155240 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c590 tx=0x7ff34400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff33bfff700 1 -- 172.21.15.142:0/915479230 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011590 con 0x7ff3540cbfe0 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff33bfff700 1 -- 172.21.15.142:0/915479230 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344011710 con 0x7ff3540cbfe0 2023-09-30T23:02:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff33bfff700 1 -- 172.21.15.142:0/915479230 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011ad0 con 0x7ff3540cbfe0 2023-09-30T23:02:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35416a5f0 con 0x7ff3540cbfe0 2023-09-30T23:02:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.314+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35416abb0 con 0x7ff3540cbfe0 2023-09-30T23:02:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.315+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff354069770 con 0x7ff3540cbfe0 2023-09-30T23:02:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.316+0000 7ff33bfff700 1 -- 172.21.15.142:0/915479230 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff34401b3b0 con 0x7ff3540cbfe0 2023-09-30T23:02:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.317+0000 7ff33bfff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff340067330 0x7ff3400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.317+0000 7ff33bfff700 1 -- 172.21.15.142:0/915479230 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff344083d90 con 0x7ff3540cbfe0 2023-09-30T23:02:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.317+0000 7ff3537fe700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff340067330 0x7ff3400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.318+0000 7ff3537fe700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff340067330 0x7ff3400697e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff3540c43f0 tx=0x7ff3480091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.321+0000 7ff33bfff700 1 -- 172.21.15.142:0/915479230 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff344050ef0 con 0x7ff3540cbfe0 2023-09-30T23:02:27.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.511+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff35406fc10 con 0x7ff3540cbfe0 2023-09-30T23:02:27.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.515+0000 7ff33bfff700 1 -- 172.21.15.142:0/915479230 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff344017020 con 0x7ff3540cbfe0 2023-09-30T23:02:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff340067330 msgr2=0x7ff3400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff340067330 0x7ff3400697e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff3540c43f0 tx=0x7ff3480091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3540cbfe0 msgr2=0x7ff354155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3540cbfe0 0x7ff354155240 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c590 tx=0x7ff34400c8a0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 shutdown_connections 2023-09-30T23:02:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff340067330 0x7ff3400697e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff354157ab0 0x7ff35406e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3540cbfe0 0x7ff354155240 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 --2- 172.21.15.142:0/915479230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3540cc3b0 0x7ff35406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 >> 172.21.15.142:0/915479230 conn(0x7ff3540d0a80 msgr2=0x7ff3540ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:27.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 shutdown_connections 2023-09-30T23:02:27.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.518+0000 7ff35a9ff700 1 -- 172.21.15.142:0/915479230 wait complete. 2023-09-30T23:02:27.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-09-30T23:02:27.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.726+0000 7fdd11dff700 1 Processor -- start 2023-09-30T23:02:27.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.726+0000 7fdd11dff700 1 -- start start 2023-09-30T23:02:27.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd11dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd0c0b00d0 0x7fdd0c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd11dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd0c06e650 0x7fdd0c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd11dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c06d3e0 con 0x7fdd0c0af020 2023-09-30T23:02:27.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd11dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c06dc80 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd11dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c06b790 con 0x7fdd0c06e650 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd0affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd0c0b00d0 0x7fdd0c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd0b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdd0c0af020 0x7fdd0c156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51374/0 (socket says 172.21.15.142:51374) 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd0b7fe700 1 -- 172.21.15.142:0/1776680250 learned_addr learned my addr 172.21.15.142:0/1776680250 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.728+0000 7fdd0bfff700 1 --2- 172.21.15.142:0/1776680250 >> v2:172.21.15.148:3300/0 conn(0x7fdd0c06e650 0x7fdd0c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0affd700 1 -- 172.21.15.142:0/1776680250 >> v2:172.21.15.148:3300/0 conn(0x7fdd0c06e650 msgr2=0x7fdd0c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0affd700 1 --2- 172.21.15.142:0/1776680250 >> v2:172.21.15.148:3300/0 conn(0x7fdd0c06e650 0x7fdd0c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0affd700 1 -- 172.21.15.142:0/1776680250 >> v1:172.21.15.142:6789/0 conn(0x7fdd0c0af020 legacy=0x7fdd0c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0affd700 1 -- 172.21.15.142:0/1776680250 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0b0650 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0affd700 1 --2- 172.21.15.142:0/1776680250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c06e110 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fdd000098e0 tx=0x7fdd000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89493282243b1db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0a7fc700 1 -- 172.21.15.142:0/1776680250 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00009e80 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0a7fc700 1 -- 172.21.15.142:0/1776680250 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0000b820 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.729+0000 7fdd0a7fc700 1 -- 172.21.15.142:0/1776680250 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000bba0 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 -- 172.21.15.142:0/1776680250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 msgr2=0x7fdd0c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 --2- 172.21.15.142:0/1776680250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c06e110 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fdd000098e0 tx=0x7fdd000091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 -- 172.21.15.142:0/1776680250 shutdown_connections 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 --2- 172.21.15.142:0/1776680250 >> v2:172.21.15.148:3300/0 conn(0x7fdd0c06e650 0x7fdd0c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 --2- 172.21.15.142:0/1776680250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c06e110 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 -- 172.21.15.142:0/1776680250 >> 172.21.15.142:0/1776680250 conn(0x7fdd0c0680c0 msgr2=0x7fdd0c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:27.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 -- 172.21.15.142:0/1776680250 shutdown_connections 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.730+0000 7fdd11dff700 1 -- 172.21.15.142:0/1776680250 wait complete. 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.731+0000 7fdd11dff700 1 Processor -- start 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.731+0000 7fdd11dff700 1 -- start start 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.732+0000 7fdd11dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd0c06e650 0x7fdd0c148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.732+0000 7fdd11dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd0c0af020 0x7fdd0c0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.732+0000 7fdd11dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.732+0000 7fdd11dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c16c180 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.732+0000 7fdd11dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c16b500 con 0x7fdd0c06e650 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.732+0000 7fdd11dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c16b7e0 con 0x7fdd0c0af020 2023-09-30T23:02:27.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c0c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44090/0 (socket says 172.21.15.142:44090) 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 -- 172.21.15.142:0/440599769 learned_addr learned my addr 172.21.15.142:0/440599769 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0b7fe700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd0c06e650 0x7fdd0c148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0affd700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd0c0af020 0x7fdd0c0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 -- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd0c0af020 msgr2=0x7fdd0c0c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd0c0af020 0x7fdd0c0c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 -- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd0c06e650 msgr2=0x7fdd0c148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd0c06e650 0x7fdd0c148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 -- 172.21.15.142:0/440599769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00009420 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.733+0000 7fdd0bfff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c0c7cd0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fdd04007f20 tx=0x7fdd04009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.734+0000 7fdcf37fe700 1 -- 172.21.15.142:0/440599769 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400eb90 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.734+0000 7fdcf37fe700 1 -- 172.21.15.142:0/440599769 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400ed10 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.734+0000 7fdcf37fe700 1 -- 172.21.15.142:0/440599769 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04014670 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.734+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c16bac0 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.734+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c148650 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.735+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c16c2c0 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.736+0000 7fdcf37fe700 1 -- 172.21.15.142:0/440599769 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdd040149e0 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.737+0000 7fdcf37fe700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcf8067330 0x7fdcf80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:27.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.737+0000 7fdcf37fe700 1 -- 172.21.15.142:0/440599769 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fdd04084f60 con 0x7fdd0c0b00d0 2023-09-30T23:02:27.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.737+0000 7fdd0b7fe700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcf8067330 0x7fdcf80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:27.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.738+0000 7fdd0b7fe700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcf8067330 0x7fdcf80697e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c156260 tx=0x7fdcfc007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:27.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:27.741+0000 7fdcf37fe700 1 -- 172.21.15.142:0/440599769 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdd0c16c2c0 con 0x7fdd0c0b00d0 2023-09-30T23:02:28.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.013+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fdd0c16c2c0 con 0x7fdd0c0b00d0 2023-09-30T23:02:28.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.089+0000 7fdcf37fe700 1 -- 172.21.15.142:0/440599769 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v480) v1 ==== 132+0+0 (secure 0 0 0) 0x7fdd0c16c2c0 con 0x7fdd0c0b00d0 2023-09-30T23:02:28.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcf8067330 msgr2=0x7fdcf80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:28.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcf8067330 0x7fdcf80697e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c156260 tx=0x7fdcfc007eb0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 msgr2=0x7fdd0c0c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:28.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c0c7cd0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fdd04007f20 tx=0x7fdd04009860 comp rx=0 tx=0).stop 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 shutdown_connections 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdcf8067330 0x7fdcf80697e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c0b00d0 0x7fdd0c0c7cd0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd0c06e650 0x7fdd0c148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 --2- 172.21.15.142:0/440599769 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd0c0af020 0x7fdd0c0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 >> 172.21.15.142:0/440599769 conn(0x7fdd0c0680c0 msgr2=0x7fdd0c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 shutdown_connections 2023-09-30T23:02:28.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.091+0000 7fdd11dff700 1 -- 172.21.15.142:0/440599769 wait complete. 2023-09-30T23:02:28.109 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-09-30T23:02:28.110 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-09-30T23:02:28.110 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-09-30T23:02:28.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-09-30T23:02:28.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.299+0000 7f26bd7ff700 1 Processor -- start 2023-09-30T23:02:28.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.300+0000 7f26bd7ff700 1 -- start start 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.301+0000 7f26bd7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f26b815de20 0x7f26b8164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.301+0000 7f26bd7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80cc6b0 con 0x7f26b80692f0 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.301+0000 7f26bd7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80cbaa0 con 0x7f26b8143350 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.301+0000 7f26bd7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b80cbd80 con 0x7f26b815de20 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.301+0000 7f26b67fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f26b80692f0 0x7f26b815d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51384/0 (socket says 172.21.15.142:51384) 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.301+0000 7f26b67fc700 1 -- 172.21.15.142:0/3012968553 learned_addr learned my addr 172.21.15.142:0/3012968553 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.301+0000 7f26b77fe700 1 --2- 172.21.15.142:0/3012968553 >> v2:172.21.15.148:3300/0 conn(0x7f26b815de20 0x7f26b8164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494626514 0 0) 0x7f26b80cc6b0 con 0x7f26b80692f0 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a0003570 con 0x7f26b80692f0 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378140003 0 0) 0x7f26b80cbaa0 con 0x7f26b8143350 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b80cc6b0 con 0x7f26b8143350 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979649288 0 0) 0x7f26a0003570 con 0x7f26b80692f0 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 >> v2:172.21.15.148:3300/0 conn(0x7f26b815de20 msgr2=0x7f26b8164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 --2- 172.21.15.142:0/3012968553 >> v2:172.21.15.148:3300/0 conn(0x7f26b815de20 0x7f26b8164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 >> v1:172.21.15.148:6789/0 conn(0x7f26b8143350 legacy=0x7f26b80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80cc060 con 0x7f26b80692f0 2023-09-30T23:02:28.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f26ac001470 con 0x7f26b80692f0 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 >> v1:172.21.15.142:6789/0 conn(0x7f26b80692f0 legacy=0x7f26b815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26a0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a0004810 0x7f26a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26a00051c0 0x7f26a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80cbd80 con 0x7f26a0003bf0 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a000c160 con 0x7f26a0004810 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a000c320 con 0x7f26a00051c0 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b6ffd700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26a0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.302+0000 7f26b67fc700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a0004810 0x7f26a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b77fe700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26a00051c0 0x7f26a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b6ffd700 1 -- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26a00051c0 msgr2=0x7f26a000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b6ffd700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26a00051c0 0x7f26a000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b6ffd700 1 -- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a0004810 msgr2=0x7f26a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b6ffd700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a0004810 0x7f26a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b6ffd700 1 -- 172.21.15.142:0/3012968553 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0003570 con 0x7f26a0003bf0 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b77fe700 1 -- 172.21.15.142:0/3012968553 reap_dead start 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b6ffd700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26a0003fe0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f26a80019e0 tx=0x7f26a8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6df2deb9126e7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a800c5d0 con 0x7f26a0003bf0 2023-09-30T23:02:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a800c730 con 0x7f26a0003bf0 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.303+0000 7f26b5ffb700 1 -- 172.21.15.142:0/3012968553 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a800caf0 con 0x7f26a0003bf0 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.304+0000 7f26bd7ff700 1 -- 172.21.15.142:0/3012968553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 msgr2=0x7f26a0003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.304+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26a0003fe0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f26a80019e0 tx=0x7f26a8007d30 comp rx=0 tx=0).stop 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.304+0000 7f26bd7ff700 1 -- 172.21.15.142:0/3012968553 shutdown_connections 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.304+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/3012968553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26a0003fe0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.304+0000 7f26bd7ff700 1 -- 172.21.15.142:0/3012968553 >> 172.21.15.142:0/3012968553 conn(0x7f26b80ce8e0 msgr2=0x7f26b80cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.304+0000 7f26bd7ff700 1 -- 172.21.15.142:0/3012968553 shutdown_connections 2023-09-30T23:02:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.304+0000 7f26bd7ff700 1 -- 172.21.15.142:0/3012968553 wait complete. 2023-09-30T23:02:28.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.305+0000 7f26bd7ff700 1 Processor -- start 2023-09-30T23:02:28.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.305+0000 7f26bd7ff700 1 -- start start 2023-09-30T23:02:28.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.306+0000 7f26bd7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26b80a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.306+0000 7f26bd7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26b815c660 0x7f26b80a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.306+0000 7f26bd7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26b8140340 0x7f26b80a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.306+0000 7f26bd7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80a7240 con 0x7f26a0003bf0 2023-09-30T23:02:28.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.306+0000 7f26bd7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80a7ba0 con 0x7f26b815c660 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.306+0000 7f26bd7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b815cad0 con 0x7f26b8140340 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26b80a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26b80a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44110/0 (socket says 172.21.15.142:44110) 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 -- 172.21.15.142:0/350862100 learned_addr learned my addr 172.21.15.142:0/350862100 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 -- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26b8140340 msgr2=0x7f26b80a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b77fe700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26b8140340 0x7f26b80a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b67fc700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26b815c660 0x7f26b80a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26b8140340 0x7f26b80a7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 -- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26b815c660 msgr2=0x7f26b80a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26b815c660 0x7f26b80a7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:28.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 -- 172.21.15.142:0/350862100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80a65c0 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b67fc700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26b815c660 0x7f26b80a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f26b6ffd700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26b80a5ec0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f26a000c130 tx=0x7f26a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.307+0000 7f269effd700 1 -- 172.21.15.142:0/350862100 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a800c5d0 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.308+0000 7f269effd700 1 -- 172.21.15.142:0/350862100 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a800cab0 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.308+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b80a68a0 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.308+0000 7f269effd700 1 -- 172.21.15.142:0/350862100 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8007b10 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.308+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b80a6e60 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.309+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b806ea70 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.309+0000 7f269effd700 1 -- 172.21.15.142:0/350862100 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f26a8019030 con 0x7f26a0003bf0 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.310+0000 7f269effd700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26a4067330 0x7f26a40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:28.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.310+0000 7f269effd700 1 -- 172.21.15.142:0/350862100 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f26a80861e0 con 0x7f26a0003bf0 2023-09-30T23:02:28.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.311+0000 7f26b67fc700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26a4067330 0x7f26a40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:28.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.311+0000 7f26b67fc700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26a4067330 0x7f26a40697e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f26ac001c80 tx=0x7f26ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:28.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.315+0000 7f269effd700 1 -- 172.21.15.142:0/350862100 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f26a8053340 con 0x7f26a0003bf0 2023-09-30T23:02:28.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:28.580+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f26b80cc340 con 0x7f26a0003bf0 2023-09-30T23:02:29.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.093+0000 7f269effd700 1 -- 172.21.15.142:0/350862100 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v481) v1 ==== 134+0+0 (secure 0 0 0) 0x7f26a8056960 con 0x7f26a0003bf0 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26a4067330 msgr2=0x7f26a40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26a4067330 0x7f26a40697e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f26ac001c80 tx=0x7f26ac009040 comp rx=0 tx=0).stop 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 msgr2=0x7f26b80a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26b80a5ec0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f26a000c130 tx=0x7f26a8015000 comp rx=0 tx=0).stop 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 shutdown_connections 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f26a4067330 0x7f26a40697e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f26b8140340 0x7f26b80a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26a0003bf0 0x7f26b80a5ec0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 --2- 172.21.15.142:0/350862100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26b815c660 0x7f26b80a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 >> 172.21.15.142:0/350862100 conn(0x7f26b80ce8e0 msgr2=0x7f26b81416c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:29.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 shutdown_connections 2023-09-30T23:02:29.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.096+0000 7f26bd7ff700 1 -- 172.21.15.142:0/350862100 wait complete. 2023-09-30T23:02:29.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T23:02:29.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.309+0000 7f827ddff700 1 Processor -- start 2023-09-30T23:02:29.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.309+0000 7f827ddff700 1 -- start start 2023-09-30T23:02:29.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.310+0000 7f827ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 0x7f827806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.310+0000 7f827ddff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8278067d10 con 0x7f82780b0de0 2023-09-30T23:02:29.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.310+0000 7f827ddff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827806af90 con 0x7f8278159ba0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.310+0000 7f827ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780676c0 con 0x7f82780ca5e0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f8277fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f82780b0de0 0x7f82780681a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:51400/0 (socket says 172.21.15.142:51400) 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f8277fff700 1 -- 172.21.15.142:0/255948468 learned_addr learned my addr 172.21.15.142:0/255948468 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f8276ffd700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 0x7f827806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501707654 0 0) 0x7f8278067d10 con 0x7f82780b0de0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8260003570 con 0x7f82780b0de0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130394060 0 0) 0x7f827806af90 con 0x7f8278159ba0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8278067d10 con 0x7f8278159ba0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548147030 0 0) 0x7f8260003570 con 0x7f82780b0de0 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 msgr2=0x7f827806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 0x7f827806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 >> v1:172.21.15.148:6789/0 conn(0x7f8278159ba0 legacy=0x7f82780c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780679a0 con 0x7f82780b0de0 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.311+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f82700017f0 con 0x7f82780b0de0 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 >> v1:172.21.15.142:6789/0 conn(0x7f82780b0de0 legacy=0x7f82780681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82767fc700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 0x7f8260003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82767fc700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004180 0x7f8260004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82767fc700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8260004d50 0x7f82600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780676c0 con 0x7f8260004d50 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826000bba0 con 0x7f8260004180 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826000bd60 con 0x7f82780ca5e0 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f8277fff700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8260004d50 0x7f82600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f82777fe700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 0x7f8260003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f8276ffd700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004180 0x7f8260004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f8277fff700 1 -- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 msgr2=0x7f8260003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f8277fff700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780ca5e0 0x7f8260003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f8277fff700 1 -- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004180 msgr2=0x7f8260004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f8277fff700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004180 0x7f8260004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.312+0000 7f8277fff700 1 -- 172.21.15.142:0/255948468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260003570 con 0x7f8260004d50 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f8277fff700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8260004d50 0x7f82600051c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f827000a8d0 tx=0x7f8270002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7ad6038b090bcc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700070d0 con 0x7f8260004d50 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270007230 con 0x7f8260004d50 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f82767fc700 1 -- 172.21.15.142:0/255948468 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700075f0 con 0x7f8260004d50 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f827ddff700 1 -- 172.21.15.142:0/255948468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8260004d50 msgr2=0x7f82600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f827ddff700 1 --2- 172.21.15.142:0/255948468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8260004d50 0x7f82600051c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f827000a8d0 tx=0x7f8270002190 comp rx=0 tx=0).stop 2023-09-30T23:02:29.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f8277fff700 1 -- 172.21.15.142:0/255948468 reap_dead start 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f827ddff700 1 -- 172.21.15.142:0/255948468 shutdown_connections 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f827ddff700 1 -- 172.21.15.142:0/255948468 >> 172.21.15.142:0/255948468 conn(0x7f82780cb2f0 msgr2=0x7f82780cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f827ddff700 1 -- 172.21.15.142:0/255948468 shutdown_connections 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.313+0000 7f827ddff700 1 -- 172.21.15.142:0/255948468 wait complete. 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.315+0000 7f827ddff700 1 Processor -- start 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.315+0000 7f827ddff700 1 -- start start 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f827ddff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004d50 0x7f827815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f827ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780c9b60 0x7f827814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f827ddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827814d080 0x7f82780c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f827ddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827815df90 con 0x7f827814d080 2023-09-30T23:02:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f827ddff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c7230 con 0x7f8260004d50 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f827ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c6470 con 0x7f82780c9b60 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8277fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827814d080 0x7f82780c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8277fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827814d080 0x7f82780c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44126/0 (socket says 172.21.15.142:44126) 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8277fff700 1 -- 172.21.15.142:0/3973786518 learned_addr learned my addr 172.21.15.142:0/3973786518 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8276ffd700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780c9b60 0x7f827814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f82777fe700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004d50 0x7f827815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8277fff700 1 -- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780c9b60 msgr2=0x7f827814cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8277fff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780c9b60 0x7f827814cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8277fff700 1 -- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004d50 msgr2=0x7f827815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.316+0000 7f8277fff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004d50 0x7f827815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.317+0000 7f8277fff700 1 -- 172.21.15.142:0/3973786518 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780c6750 con 0x7f827814d080 2023-09-30T23:02:29.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.317+0000 7f8277fff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827814d080 0x7f82780c7b50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f8270012000 tx=0x7f8270016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:29.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.317+0000 7f825f7fe700 1 -- 172.21.15.142:0/3973786518 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270023070 con 0x7f827814d080 2023-09-30T23:02:29.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.317+0000 7f825f7fe700 1 -- 172.21.15.142:0/3973786518 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270001360 con 0x7f827814d080 2023-09-30T23:02:29.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.317+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780c6a30 con 0x7f827814d080 2023-09-30T23:02:29.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.317+0000 7f825f7fe700 1 -- 172.21.15.142:0/3973786518 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827001e430 con 0x7f827814d080 2023-09-30T23:02:29.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.317+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780c9fb0 con 0x7f827814d080 2023-09-30T23:02:29.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.318+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827806e4b0 con 0x7f827814d080 2023-09-30T23:02:29.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.319+0000 7f825f7fe700 1 -- 172.21.15.142:0/3973786518 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f827001e880 con 0x7f827814d080 2023-09-30T23:02:29.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.320+0000 7f825f7fe700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8264067330 0x7f82640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.320+0000 7f825f7fe700 1 -- 172.21.15.142:0/3973786518 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8270086990 con 0x7f827814d080 2023-09-30T23:02:29.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.320+0000 7f82777fe700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8264067330 0x7f82640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.321+0000 7f82777fe700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8264067330 0x7f82640697e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8268007e40 tx=0x7f8268009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:29.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.324+0000 7f825f7fe700 1 -- 172.21.15.142:0/3973786518 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8270053b90 con 0x7f827814d080 2023-09-30T23:02:29.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.517+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f82780cac40 con 0x7f827814d080 2023-09-30T23:02:29.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.522+0000 7f825f7fe700 1 -- 172.21.15.142:0/3973786518 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f82700571b0 con 0x7f827814d080 2023-09-30T23:02:29.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8264067330 msgr2=0x7f82640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8264067330 0x7f82640697e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8268007e40 tx=0x7f8268009040 comp rx=0 tx=0).stop 2023-09-30T23:02:29.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827814d080 msgr2=0x7f82780c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827814d080 0x7f82780c7b50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f8270012000 tx=0x7f8270016000 comp rx=0 tx=0).stop 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 shutdown_connections 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8264067330 0x7f82640697e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827814d080 0x7f82780c7b50 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8260004d50 0x7f827815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 --2- 172.21.15.142:0/3973786518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f82780c9b60 0x7f827814cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 >> 172.21.15.142:0/3973786518 conn(0x7f82780cb2f0 msgr2=0x7f82780cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 shutdown_connections 2023-09-30T23:02:29.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.524+0000 7f827ddff700 1 -- 172.21.15.142:0/3973786518 wait complete. 2023-09-30T23:02:29.542 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T23:02:29.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:02:29.640 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:02:29.746 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T23:02:29.746 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T23:02:29.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.934+0000 7f1ec79ff700 1 Processor -- start 2023-09-30T23:02:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.934+0000 7f1ec79ff700 1 -- start start 2023-09-30T23:02:29.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec79ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ec00692f0 0x7f1ec015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec79ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec006a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec79ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec00cc6b0 con 0x7f1ec0143350 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec79ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec015e090 con 0x7f1ec00692f0 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec79ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00cbaa0 con 0x7f1ec015dc50 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec4f9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ec00692f0 0x7f1ec015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec4f9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ec00692f0 0x7f1ec015d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44136/0 (socket says 172.21.15.142:44136) 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/301882660 learned_addr learned my addr 172.21.15.142:0/301882660 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:29.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec5f9c700 1 --2- 172.21.15.142:0/301882660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec006a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/301882660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 msgr2=0x7f1ec006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec4f9a700 1 --2- 172.21.15.142:0/301882660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec006a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/301882660 >> v1:172.21.15.148:6789/0 conn(0x7f1ec0143350 legacy=0x7f1ec00cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.936+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/301882660 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00cbd80 con 0x7f1ec00692f0 2023-09-30T23:02:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.937+0000 7f1ec4f9a700 1 --2- 172.21.15.142:0/301882660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec00692f0 0x7f1ec015d710 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00099b0 tx=0x7f1eb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd4945b1d5e142d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:29.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.937+0000 7f1eb7fff700 1 -- 172.21.15.142:0/301882660 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0009ea0 con 0x7f1ec00692f0 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.937+0000 7f1eb7fff700 1 -- 172.21.15.142:0/301882660 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb000b860 con 0x7f1ec00692f0 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.937+0000 7f1eb7fff700 1 -- 172.21.15.142:0/301882660 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000bc00 con 0x7f1ec00692f0 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.937+0000 7f1ec79ff700 1 -- 172.21.15.142:0/301882660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec00692f0 msgr2=0x7f1ec015d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.937+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/301882660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec00692f0 0x7f1ec015d710 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00099b0 tx=0x7f1eb0009250 comp rx=0 tx=0).stop 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.938+0000 7f1ec79ff700 1 -- 172.21.15.142:0/301882660 shutdown_connections 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.938+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/301882660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec006a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.938+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/301882660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec00692f0 0x7f1ec015d710 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.938+0000 7f1ec79ff700 1 -- 172.21.15.142:0/301882660 >> 172.21.15.142:0/301882660 conn(0x7f1ec00ce8e0 msgr2=0x7f1ec00cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.938+0000 7f1ec79ff700 1 -- 172.21.15.142:0/301882660 shutdown_connections 2023-09-30T23:02:29.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.938+0000 7f1ec79ff700 1 -- 172.21.15.142:0/301882660 wait complete. 2023-09-30T23:02:29.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.939+0000 7f1ec79ff700 1 Processor -- start 2023-09-30T23:02:29.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.939+0000 7f1ec79ff700 1 -- start start 2023-09-30T23:02:29.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec79ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec00692f0 0x7f1ec00b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec79ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec0143350 0x7f1ec00a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec79ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec00a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec79ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec013fa80 con 0x7f1ec0143350 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec79ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec013ef00 con 0x7f1ec00692f0 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec79ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec013f1e0 con 0x7f1ec015dc50 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec4f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec0143350 0x7f1ec00a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec4f9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec0143350 0x7f1ec00a54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44146/0 (socket says 172.21.15.142:44146) 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.940+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/3423590881 learned_addr learned my addr 172.21.15.142:0/3423590881 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec579b700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec00692f0 0x7f1ec00b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec5f9c700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec00a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 msgr2=0x7f1ec00a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec4f9a700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec00a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec00692f0 msgr2=0x7f1ec00b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec4f9a700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec00692f0 0x7f1ec00b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec4f9a700 1 -- 172.21.15.142:0/3423590881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00094f0 con 0x7f1ec0143350 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec579b700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec00692f0 0x7f1ec00b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec5f9c700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec00a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec4f9a700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec0143350 0x7f1ec00a54b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0063f80 tx=0x7f1eb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1eb57fa700 1 -- 172.21.15.142:0/3423590881 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000bbe0 con 0x7f1ec0143350 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1eb57fa700 1 -- 172.21.15.142:0/3423590881 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0011420 con 0x7f1ec0143350 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1eb57fa700 1 -- 172.21.15.142:0/3423590881 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb00117c0 con 0x7f1ec0143350 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec013f4c0 con 0x7f1ec0143350 2023-09-30T23:02:29.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.941+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec013e1d0 con 0x7f1ec0143350 2023-09-30T23:02:29.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.942+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec006ea70 con 0x7f1ec0143350 2023-09-30T23:02:29.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.943+0000 7f1eb57fa700 1 -- 172.21.15.142:0/3423590881 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1eb0011bf0 con 0x7f1ec0143350 2023-09-30T23:02:29.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.944+0000 7f1eb57fa700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ea4067330 0x7f1ea40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:29.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.944+0000 7f1eb57fa700 1 -- 172.21.15.142:0/3423590881 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1eb0085f00 con 0x7f1ec0143350 2023-09-30T23:02:29.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.944+0000 7f1ec579b700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ea4067330 0x7f1ea40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:29.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.945+0000 7f1ec579b700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ea4067330 0x7f1ea40697e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc001840 tx=0x7f1ebc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:29.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:29.949+0000 7f1eb57fa700 1 -- 172.21.15.142:0/3423590881 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1eb00530e0 con 0x7f1ec0143350 2023-09-30T23:02:30.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.189+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ec00cc060 con 0x7f1ec0143350 2023-09-30T23:02:30.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.189+0000 7f1eb57fa700 1 -- 172.21.15.142:0/3423590881 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f1eb0015df0 con 0x7f1ec0143350 2023-09-30T23:02:30.191 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:30.191 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2444085582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2444085582},{"type":"v1","addr":"172.21.15.148:6835","nonce":2444085582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1092090307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1092090307},{"type":"v1","addr":"172.21.15.148:6834","nonce":1092090307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7650,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1714796422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1714796422},{"type":"v1","addr":"172.21.15.142:6836","nonce":1714796422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2312704881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2312704881},{"type":"v1","addr":"172.21.15.142:6837","nonce":2312704881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[]} 2023-09-30T23:02:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.191+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ea4067330 msgr2=0x7f1ea40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.191+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ea4067330 0x7f1ea40697e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc001840 tx=0x7f1ebc009040 comp rx=0 tx=0).stop 2023-09-30T23:02:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.191+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec0143350 msgr2=0x7f1ec00a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.191+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec0143350 0x7f1ec00a54b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0063f80 tx=0x7f1eb0017000 comp rx=0 tx=0).stop 2023-09-30T23:02:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 shutdown_connections 2023-09-30T23:02:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1ea4067330 0x7f1ea40697e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ec015dc50 0x7f1ec00a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ec00692f0 0x7f1ec00b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 --2- 172.21.15.142:0/3423590881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ec0143350 0x7f1ec00a54b0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 >> 172.21.15.142:0/3423590881 conn(0x7f1ec00ce8e0 msgr2=0x7f1ec00c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 shutdown_connections 2023-09-30T23:02:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.192+0000 7f1ec79ff700 1 -- 172.21.15.142:0/3423590881 wait complete. 2023-09-30T23:02:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 76 2023-09-30T23:02:30.210 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T23:02:30.210 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T23:02:30.211 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T23:02:30.211 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:02:30.211 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T23:02:30.211 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T23:02:30.211 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T23:02:30.212 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:02:30.212 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T23:02:30.212 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T23:02:30.212 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T23:02:30.213 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:02:30.213 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T23:02:30.213 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T23:02:30.213 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T23:02:30.213 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:02:30.228 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T23:02:30.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T23:02:30.229 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T23:02:30.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T23:02:30.230 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T23:02:30.230 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T23:02:30.231 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T23:02:30.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T23:02:30.272 INFO:tasks.ceph.mds.a:Started 2023-09-30T23:02:30.273 DEBUG:teuthology.parallel:result is None 2023-09-30T23:02:30.275 INFO:tasks.ceph.mds.c:Started 2023-09-30T23:02:30.275 DEBUG:teuthology.parallel:result is None 2023-09-30T23:02:30.276 INFO:tasks.ceph.mds.b:Started 2023-09-30T23:02:30.276 DEBUG:teuthology.parallel:result is None 2023-09-30T23:02:30.278 INFO:tasks.ceph.mds.d:Started 2023-09-30T23:02:30.278 DEBUG:teuthology.parallel:result is None 2023-09-30T23:02:30.279 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T23:02:30.415 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T23:02:30.417 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T23:02:30.426 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T23:02:30.427 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T23:02:30.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.481+0000 7f3daf9ff700 1 Processor -- start 2023-09-30T23:02:30.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.482+0000 7f3daf9ff700 1 -- start start 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.483+0000 7f3daf9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3da8159b50 0x7f3da80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.483+0000 7f3daf9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3da80ac3a0 0x7f3da80aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.483+0000 7f3daf9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80aa7e0 0x7f3da806a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.483+0000 7f3daf9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da8069f10 con 0x7f3da8159b50 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.483+0000 7f3daf9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da8068000 con 0x7f3da80ac3a0 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.483+0000 7f3daf9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80aac30 con 0x7f3da80aa7e0 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3da8159b50 0x7f3da80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3da8159b50 0x7f3da80a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44164/0 (socket says 172.21.15.142:44164) 2023-09-30T23:02:30.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 -- 172.21.15.142:0/3145970571 learned_addr learned my addr 172.21.15.142:0/3145970571 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dacf9a700 1 --2- 172.21.15.142:0/3145970571 >> v2:172.21.15.148:3300/0 conn(0x7f3da80ac3a0 0x7f3da80aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dadf9c700 1 --2- 172.21.15.142:0/3145970571 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80aa7e0 0x7f3da806a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 -- 172.21.15.142:0/3145970571 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80aa7e0 msgr2=0x7f3da806a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 --2- 172.21.15.142:0/3145970571 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80aa7e0 0x7f3da806a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 -- 172.21.15.142:0/3145970571 >> v2:172.21.15.148:3300/0 conn(0x7f3da80ac3a0 msgr2=0x7f3da80aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 --2- 172.21.15.142:0/3145970571 >> v2:172.21.15.148:3300/0 conn(0x7f3da80ac3a0 0x7f3da80aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 -- 172.21.15.142:0/3145970571 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80a9e00 con 0x7f3da8159b50 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dacf9a700 1 --2- 172.21.15.142:0/3145970571 >> v2:172.21.15.148:3300/0 conn(0x7f3da80ac3a0 0x7f3da80aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:30.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.484+0000 7f3dad79b700 1 --2- 172.21.15.142:0/3145970571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da80a98c0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3da806c300 tx=0x7f3da4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7284f0e921f1559 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:30.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3d9ffff700 1 -- 172.21.15.142:0/3145970571 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400b860 con 0x7f3da8159b50 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3d9ffff700 1 -- 172.21.15.142:0/3145970571 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400b9c0 con 0x7f3da8159b50 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3d9ffff700 1 -- 172.21.15.142:0/3145970571 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400bd60 con 0x7f3da8159b50 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 -- 172.21.15.142:0/3145970571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 msgr2=0x7f3da80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/3145970571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da80a98c0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3da806c300 tx=0x7f3da4009250 comp rx=0 tx=0).stop 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 -- 172.21.15.142:0/3145970571 shutdown_connections 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/3145970571 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80aa7e0 0x7f3da806a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/3145970571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da80a98c0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/3145970571 >> v2:172.21.15.148:3300/0 conn(0x7f3da80ac3a0 0x7f3da80aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 -- 172.21.15.142:0/3145970571 >> 172.21.15.142:0/3145970571 conn(0x7f3da806dab0 msgr2=0x7f3da80aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:30.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 -- 172.21.15.142:0/3145970571 shutdown_connections 2023-09-30T23:02:30.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.485+0000 7f3daf9ff700 1 -- 172.21.15.142:0/3145970571 wait complete. 2023-09-30T23:02:30.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.487+0000 7f3daf9ff700 1 Processor -- start 2023-09-30T23:02:30.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.487+0000 7f3daf9ff700 1 -- start start 2023-09-30T23:02:30.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3daf9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3da80aa7e0 0x7f3da80ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:30.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3daf9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80ac3a0 0x7f3da80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:30.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3daf9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da81576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:30.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3daf9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80c9cb0 con 0x7f3da8159b50 2023-09-30T23:02:30.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3daf9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80c9f50 con 0x7f3da80aa7e0 2023-09-30T23:02:30.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3daf9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80ca230 con 0x7f3da80ac3a0 2023-09-30T23:02:30.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3dad79b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3da80aa7e0 0x7f3da80ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3dadf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da81576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3dacf9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80ac3a0 0x7f3da80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3dad79b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3da80aa7e0 0x7f3da80ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:35806/0 (socket says 172.21.15.142:35806) 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.488+0000 7f3dad79b700 1 -- 172.21.15.142:0/1298989481 learned_addr learned my addr 172.21.15.142:0/1298989481 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3dad79b700 1 -- 172.21.15.142:0/1298989481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80ac3a0 msgr2=0x7f3da80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3dad79b700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80ac3a0 0x7f3da80c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3dad79b700 1 -- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 msgr2=0x7f3da81576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3dad79b700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da81576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3dad79b700 1 -- 172.21.15.142:0/1298989481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40094f0 con 0x7f3da80aa7e0 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3dadf9c700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da81576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3dad79b700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3da80aa7e0 0x7f3da80ae710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009290 tx=0x7f3da4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:30.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3d9d7fa700 1 -- 172.21.15.142:0/1298989481 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4011e40 con 0x7f3da80aa7e0 2023-09-30T23:02:30.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3d9d7fa700 1 -- 172.21.15.142:0/1298989481 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da401f070 con 0x7f3da80aa7e0 2023-09-30T23:02:30.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da80ca510 con 0x7f3da80aa7e0 2023-09-30T23:02:30.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3d9d7fa700 1 -- 172.21.15.142:0/1298989481 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da40266d0 con 0x7f3da80aa7e0 2023-09-30T23:02:30.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.489+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da80ca8a0 con 0x7f3da80aa7e0 2023-09-30T23:02:30.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.490+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da806cfd0 con 0x7f3da80aa7e0 2023-09-30T23:02:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.491+0000 7f3d9d7fa700 1 -- 172.21.15.142:0/1298989481 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3da4026a40 con 0x7f3da80aa7e0 2023-09-30T23:02:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.492+0000 7f3d9d7fa700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d8c067330 0x7f3d8c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.492+0000 7f3d9d7fa700 1 -- 172.21.15.142:0/1298989481 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3da4021070 con 0x7f3da80aa7e0 2023-09-30T23:02:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.492+0000 7f3dacf9a700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d8c067330 0x7f3d8c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:30.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.493+0000 7f3dacf9a700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d8c067330 0x7f3d8c0697e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3da816d630 tx=0x7f3d98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:30.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.497+0000 7f3d9d7fa700 1 -- 172.21.15.142:0/1298989481 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3da40538d0 con 0x7f3da80aa7e0 2023-09-30T23:02:30.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:30.703+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3da8156fb0 con 0x7f3da80aa7e0 2023-09-30T23:02:31.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.109+0000 7f3d9d7fa700 1 -- 172.21.15.142:0/1298989481 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v169) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3da4056ef0 con 0x7f3da80aa7e0 2023-09-30T23:02:31.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d8c067330 msgr2=0x7f3d8c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d8c067330 0x7f3d8c0697e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3da816d630 tx=0x7f3d98008040 comp rx=0 tx=0).stop 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3da80aa7e0 msgr2=0x7f3da80ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3da80aa7e0 0x7f3da80ae710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009290 tx=0x7f3da4017000 comp rx=0 tx=0).stop 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 shutdown_connections 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3d8c067330 0x7f3d8c0697e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da8159b50 0x7f3da81576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3da80aa7e0 0x7f3da80ae710 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 --2- 172.21.15.142:0/1298989481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3da80ac3a0 0x7f3da80c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 >> 172.21.15.142:0/1298989481 conn(0x7f3da806dab0 msgr2=0x7f3da806ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.111+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 shutdown_connections 2023-09-30T23:02:31.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.112+0000 7f3daf9ff700 1 -- 172.21.15.142:0/1298989481 wait complete. 2023-09-30T23:02:31.114 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T23:02:31.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T23:02:31.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.321+0000 7fcae83ff700 1 Processor -- start 2023-09-30T23:02:31.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.322+0000 7fcae83ff700 1 -- start start 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae83ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae00b1180 0x7fcae00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae83ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcae0159eb0 0x7fcae00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae83ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae015d910 con 0x7fcae0159ae0 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae83ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae015e920 con 0x7fcae0159eb0 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae83ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae015e490 con 0x7fcae00b1180 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae619b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcae0159ae0 0x7fcae00cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58908/0 (socket says 172.21.15.142:58908) 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae619b700 1 -- 172.21.15.142:0/3608306009 learned_addr learned my addr 172.21.15.142:0/3608306009 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae699c700 1 --2- 172.21.15.142:0/3608306009 >> v2:172.21.15.142:3300/0 conn(0x7fcae0159eb0 0x7fcae00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae599a700 1 --2- 172.21.15.142:0/3608306009 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae00b1180 0x7fcae00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.323+0000 7fcae5199700 1 -- 172.21.15.142:0/3608306009 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651110861 0 0) 0x7fcae015d910 con 0x7fcae0159ae0 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae5199700 1 -- 172.21.15.142:0/3608306009 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcacc003570 con 0x7fcae0159ae0 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae699c700 1 -- 172.21.15.142:0/3608306009 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae00b1180 msgr2=0x7fcae00cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae699c700 1 --2- 172.21.15.142:0/3608306009 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae00b1180 0x7fcae00cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae699c700 1 -- 172.21.15.142:0/3608306009 >> v1:172.21.15.142:6789/0 conn(0x7fcae0159ae0 legacy=0x7fcae00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae699c700 1 -- 172.21.15.142:0/3608306009 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00ce5c0 con 0x7fcae0159eb0 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae699c700 1 --2- 172.21.15.142:0/3608306009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae00cc3c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009e60 tx=0x7fcad8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435261099d7934e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae5199700 1 -- 172.21.15.142:0/3608306009 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800e070 con 0x7fcae0159eb0 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae5199700 1 -- 172.21.15.142:0/3608306009 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad800bab0 con 0x7fcae0159eb0 2023-09-30T23:02:31.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.324+0000 7fcae5199700 1 -- 172.21.15.142:0/3608306009 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800be70 con 0x7fcae0159eb0 2023-09-30T23:02:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 -- 172.21.15.142:0/3608306009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 msgr2=0x7fcae00cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 --2- 172.21.15.142:0/3608306009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae00cc3c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009e60 tx=0x7fcad8009780 comp rx=0 tx=0).stop 2023-09-30T23:02:31.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 -- 172.21.15.142:0/3608306009 shutdown_connections 2023-09-30T23:02:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 --2- 172.21.15.142:0/3608306009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae00cc3c0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 --2- 172.21.15.142:0/3608306009 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae00b1180 0x7fcae00cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 -- 172.21.15.142:0/3608306009 >> 172.21.15.142:0/3608306009 conn(0x7fcae00ce8b0 msgr2=0x7fcae00cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 -- 172.21.15.142:0/3608306009 shutdown_connections 2023-09-30T23:02:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.325+0000 7fcae83ff700 1 -- 172.21.15.142:0/3608306009 wait complete. 2023-09-30T23:02:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.326+0000 7fcae83ff700 1 Processor -- start 2023-09-30T23:02:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.326+0000 7fcae83ff700 1 -- start start 2023-09-30T23:02:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.327+0000 7fcae83ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae00b1180 0x7fcae0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.327+0000 7fcae83ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae0159ae0 0x7fcae015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.327+0000 7fcae83ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.327+0000 7fcae83ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00c8e20 con 0x7fcae0159eb0 2023-09-30T23:02:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.327+0000 7fcae83ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0153da0 con 0x7fcae00b1180 2023-09-30T23:02:31.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.327+0000 7fcae83ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0157770 con 0x7fcae0159ae0 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae015bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38882/0 (socket says 172.21.15.142:38882) 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 -- 172.21.15.142:0/1771647029 learned_addr learned my addr 172.21.15.142:0/1771647029 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae599a700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae0159ae0 0x7fcae015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae619b700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae00b1180 0x7fcae0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 -- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae0159ae0 msgr2=0x7fcae015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae0159ae0 0x7fcae015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 -- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae00b1180 msgr2=0x7fcae0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae00b1180 0x7fcae0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 -- 172.21.15.142:0/1771647029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009a20 con 0x7fcae0159eb0 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae619b700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae00b1180 0x7fcae0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:31.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcae699c700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae015bfa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fcae0063f90 tx=0x7fcad8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:31.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.328+0000 7fcad67fc700 1 -- 172.21.15.142:0/1771647029 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8027470 con 0x7fcae0159eb0 2023-09-30T23:02:31.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.329+0000 7fcad67fc700 1 -- 172.21.15.142:0/1771647029 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad80275f0 con 0x7fcae0159eb0 2023-09-30T23:02:31.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.329+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae00c8530 con 0x7fcae0159eb0 2023-09-30T23:02:31.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.329+0000 7fcad67fc700 1 -- 172.21.15.142:0/1771647029 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80279b0 con 0x7fcae0159eb0 2023-09-30T23:02:31.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.329+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae00c87d0 con 0x7fcae0159eb0 2023-09-30T23:02:31.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.330+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae01578e0 con 0x7fcae0159eb0 2023-09-30T23:02:31.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.331+0000 7fcad67fc700 1 -- 172.21.15.142:0/1771647029 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcad8024070 con 0x7fcae0159eb0 2023-09-30T23:02:31.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.331+0000 7fcad67fc700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcac4067330 0x7fcac40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.331+0000 7fcad67fc700 1 -- 172.21.15.142:0/1771647029 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcad80871b0 con 0x7fcae0159eb0 2023-09-30T23:02:31.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.332+0000 7fcae619b700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcac4067330 0x7fcac40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.332+0000 7fcae619b700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcac4067330 0x7fcac40697e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0058d0 tx=0x7fcadc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:31.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.336+0000 7fcad67fc700 1 -- 172.21.15.142:0/1771647029 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcae01578e0 con 0x7fcae0159eb0 2023-09-30T23:02:31.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.601+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcae01578e0 con 0x7fcae0159eb0 2023-09-30T23:02:31.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.602+0000 7fcad67fc700 1 -- 172.21.15.142:0/1771647029 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcae01578e0 con 0x7fcae0159eb0 2023-09-30T23:02:31.710 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:31.711 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:02:31.711 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T23:02:31.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.711 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T23:02:31.711 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T23:02:31.711 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.711 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T23:02:31.712 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T23:02:31.713 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.715 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.716 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T23:02:31.716 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T23:02:31.716 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.717 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T23:02:31.725 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T23:02:31.725 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.725 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.725 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.725 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.726 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T23:02:31.726 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T23:02:31.726 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.726 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.727 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.727 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.728 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T23:02:31.728 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T23:02:31.728 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.728 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.728 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.729 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.729 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T23:02:31.729 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T23:02:31.729 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.731 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.732 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T23:02:31.733 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T23:02:31.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:02:31.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:02:31.738 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcac4067330 msgr2=0x7fcac40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcac4067330 0x7fcac40697e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0058d0 tx=0x7fcadc009040 comp rx=0 tx=0).stop 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 msgr2=0x7fcae015bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae015bfa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fcae0063f90 tx=0x7fcad8019000 comp rx=0 tx=0).stop 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 shutdown_connections 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcac4067330 0x7fcac40697e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcae0159eb0 0x7fcae015bfa0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae00b1180 0x7fcae0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 --2- 172.21.15.142:0/1771647029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcae0159ae0 0x7fcae015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.604+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 >> 172.21.15.142:0/1771647029 conn(0x7fcae00ce8b0 msgr2=0x7fcae00b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:31.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.605+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 shutdown_connections 2023-09-30T23:02:31.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.605+0000 7fcae83ff700 1 -- 172.21.15.142:0/1771647029 wait complete. 2023-09-30T23:02:31.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:02:31.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.933+0000 7f83ee9ff700 1 Processor -- start 2023-09-30T23:02:31.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.933+0000 7f83ee9ff700 1 -- start start 2023-09-30T23:02:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.934+0000 7f83ee9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f83e80b1180 0x7f83e80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.934+0000 7f83ee9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e8159eb0 0x7f83e80cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.934+0000 7f83ee9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e815d910 con 0x7f83e8159ae0 2023-09-30T23:02:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.934+0000 7f83ee9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e815e920 con 0x7f83e80b1180 2023-09-30T23:02:31.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.934+0000 7f83ee9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e815e490 con 0x7f83e8159eb0 2023-09-30T23:02:31.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83ecf9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e8159eb0 0x7f83e80cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83e77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f83e80b1180 0x7f83e80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83ecf9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e8159eb0 0x7f83e80cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:51672/0 (socket says 172.21.15.142:51672) 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83ecf9c700 1 -- 172.21.15.142:0/2602238370 learned_addr learned my addr 172.21.15.142:0/2602238370 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83ecf9c700 1 -- 172.21.15.142:0/2602238370 >> v2:172.21.15.148:3300/0 conn(0x7f83e80b1180 msgr2=0x7f83e80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83ecf9c700 1 --2- 172.21.15.142:0/2602238370 >> v2:172.21.15.148:3300/0 conn(0x7f83e80b1180 0x7f83e80cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83ecf9c700 1 -- 172.21.15.142:0/2602238370 >> v1:172.21.15.148:6789/0 conn(0x7f83e8159ae0 legacy=0x7f83e80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83ecf9c700 1 -- 172.21.15.142:0/2602238370 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80ce5c0 con 0x7f83e8159eb0 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.935+0000 7f83e77fe700 1 --2- 172.21.15.142:0/2602238370 >> v2:172.21.15.148:3300/0 conn(0x7f83e80b1180 0x7f83e80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.936+0000 7f83ecf9c700 1 --2- 172.21.15.142:0/2602238370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e8159eb0 0x7f83e80cc3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009f20 tx=0x7f83e0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0903374d405fde server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.936+0000 7f83e6ffd700 1 -- 172.21.15.142:0/2602238370 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000e070 con 0x7f83e8159eb0 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.936+0000 7f83e6ffd700 1 -- 172.21.15.142:0/2602238370 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e000b9d0 con 0x7f83e8159eb0 2023-09-30T23:02:31.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.936+0000 7f83e6ffd700 1 -- 172.21.15.142:0/2602238370 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00092e0 con 0x7f83e8159eb0 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.936+0000 7f83ee9ff700 1 -- 172.21.15.142:0/2602238370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e8159eb0 msgr2=0x7f83e80cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.936+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/2602238370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e8159eb0 0x7f83e80cc3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009f20 tx=0x7f83e0009840 comp rx=0 tx=0).stop 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.937+0000 7f83ee9ff700 1 -- 172.21.15.142:0/2602238370 shutdown_connections 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.937+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/2602238370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e8159eb0 0x7f83e80cc3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.937+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/2602238370 >> v2:172.21.15.148:3300/0 conn(0x7f83e80b1180 0x7f83e80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.937+0000 7f83ee9ff700 1 -- 172.21.15.142:0/2602238370 >> 172.21.15.142:0/2602238370 conn(0x7f83e80ce8b0 msgr2=0x7f83e80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.937+0000 7f83ee9ff700 1 -- 172.21.15.142:0/2602238370 shutdown_connections 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.937+0000 7f83ee9ff700 1 -- 172.21.15.142:0/2602238370 wait complete. 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.938+0000 7f83ee9ff700 1 Processor -- start 2023-09-30T23:02:31.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.938+0000 7f83ee9ff700 1 -- start start 2023-09-30T23:02:31.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.939+0000 7f83ee9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e80b1180 0x7f83e813f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.939+0000 7f83ee9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e8159ae0 0x7f83e815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.939+0000 7f83ee9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83e8159eb0 0x7f83e815c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.939+0000 7f83ee9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8158ed0 con 0x7f83e8159ae0 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.939+0000 7f83ee9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e81582c0 con 0x7f83e8159eb0 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.939+0000 7f83ee9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e81585a0 con 0x7f83e80b1180 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.939+0000 7f83e77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e8159ae0 0x7f83e815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e8159ae0 0x7f83e815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38890/0 (socket says 172.21.15.142:38890) 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 -- 172.21.15.142:0/3560631523 learned_addr learned my addr 172.21.15.142:0/3560631523 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83ecf9c700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83e8159eb0 0x7f83e815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e7fff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e80b1180 0x7f83e813f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 -- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e80b1180 msgr2=0x7f83e813f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e80b1180 0x7f83e813f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 -- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83e8159eb0 msgr2=0x7f83e815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83e8159eb0 0x7f83e815c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 -- 172.21.15.142:0/3560631523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009420 con 0x7f83e8159ae0 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83e77fe700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e8159ae0 0x7f83e815be00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00ec80 tx=0x7f83dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83cffff700 1 -- 172.21.15.142:0/3560631523 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00c9d0 con 0x7f83e8159ae0 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83cffff700 1 -- 172.21.15.142:0/3560631523 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00cb30 con 0x7f83e8159ae0 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83cffff700 1 -- 172.21.15.142:0/3560631523 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc013470 con 0x7f83e8159ae0 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.940+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e0009ae0 con 0x7f83e8159ae0 2023-09-30T23:02:31.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.941+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e8158b60 con 0x7f83e8159ae0 2023-09-30T23:02:31.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.941+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e806ea70 con 0x7f83e8159ae0 2023-09-30T23:02:31.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.943+0000 7f83cffff700 1 -- 172.21.15.142:0/3560631523 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f83dc013820 con 0x7f83e8159ae0 2023-09-30T23:02:31.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.943+0000 7f83cffff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f83d4067330 0x7f83d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:31.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.943+0000 7f83cffff700 1 -- 172.21.15.142:0/3560631523 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f83dc084b70 con 0x7f83e8159ae0 2023-09-30T23:02:31.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.944+0000 7f83e7fff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f83d4067330 0x7f83d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:31.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.944+0000 7f83e7fff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f83d4067330 0x7f83d40697e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f83d8003860 tx=0x7f83d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:31.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:31.948+0000 7f83cffff700 1 -- 172.21.15.142:0/3560631523 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f83dc051d20 con 0x7f83e8159ae0 2023-09-30T23:02:32.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.143+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83e8159010 con 0x7f83e8159ae0 2023-09-30T23:02:32.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.144+0000 7f83cffff700 1 -- 172.21.15.142:0/3560631523 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+13806 (secure 0 0 0) 0x7f83e8159010 con 0x7f83e8159ae0 2023-09-30T23:02:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:32.145 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":171,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:02:31.119250+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:02:32.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f83d4067330 msgr2=0x7f83d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f83d4067330 0x7f83d40697e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f83d8003860 tx=0x7f83d8009040 comp rx=0 tx=0).stop 2023-09-30T23:02:32.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e8159ae0 msgr2=0x7f83e815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e8159ae0 0x7f83e815be00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00ec80 tx=0x7f83dc0091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 shutdown_connections 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f83d4067330 0x7f83d40697e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83e8159eb0 0x7f83e815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83e80b1180 0x7f83e813f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 --2- 172.21.15.142:0/3560631523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e8159ae0 0x7f83e815be00 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.146+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 >> 172.21.15.142:0/3560631523 conn(0x7f83e80ce8b0 msgr2=0x7f83e8069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.147+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 shutdown_connections 2023-09-30T23:02:32.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.147+0000 7f83ee9ff700 1 -- 172.21.15.142:0/3560631523 wait complete. 2023-09-30T23:02:32.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T23:02:32.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T23:02:32.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.357+0000 7f5f40bff700 1 Processor -- start 2023-09-30T23:02:32.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.357+0000 7f5f40bff700 1 -- start start 2023-09-30T23:02:32.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f40bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f3c0cbfe0 0x7f5f3c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f40bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cc3b0 0x7f5f3c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f40bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f3c1573a0 0x7f5f3c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f40bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cf750 con 0x7f5f3c1573a0 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f40bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0d0550 con 0x7f5f3c0cbfe0 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f40bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c157d60 con 0x7f5f3c0cc3b0 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f3c1573a0 0x7f5f3c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f3c1573a0 0x7f5f3c157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38904/0 (socket says 172.21.15.142:38904) 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/1625741494 learned_addr learned my addr 172.21.15.142:0/1625741494 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f39d9b700 1 --2- 172.21.15.142:0/1625741494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cc3b0 0x7f5f3c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3a59c700 1 --2- 172.21.15.142:0/1625741494 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c0cbfe0 0x7f5f3c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/1625741494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cc3b0 msgr2=0x7f5f3c0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 --2- 172.21.15.142:0/1625741494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cc3b0 0x7f5f3c0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/1625741494 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c0cbfe0 msgr2=0x7f5f3c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 --2- 172.21.15.142:0/1625741494 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c0cbfe0 0x7f5f3c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/1625741494 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0cf940 con 0x7f5f3c1573a0 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f39d9b700 1 --2- 172.21.15.142:0/1625741494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cc3b0 0x7f5f3c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.359+0000 7f5f3a59c700 1 --2- 172.21.15.142:0/1625741494 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c0cbfe0 0x7f5f3c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.360+0000 7f5f3ad9d700 1 --2- 172.21.15.142:0/1625741494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c157820 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009f20 tx=0x7f5f34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e06d1574b1a02e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.360+0000 7f5f3959a700 1 -- 172.21.15.142:0/1625741494 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400e070 con 0x7f5f3c1573a0 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.360+0000 7f5f3959a700 1 -- 172.21.15.142:0/1625741494 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400ba40 con 0x7f5f3c1573a0 2023-09-30T23:02:32.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.360+0000 7f5f3959a700 1 -- 172.21.15.142:0/1625741494 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340092e0 con 0x7f5f3c1573a0 2023-09-30T23:02:32.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.360+0000 7f5f40bff700 1 -- 172.21.15.142:0/1625741494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 msgr2=0x7f5f3c157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.360+0000 7f5f40bff700 1 --2- 172.21.15.142:0/1625741494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c157820 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009f20 tx=0x7f5f34009840 comp rx=0 tx=0).stop 2023-09-30T23:02:32.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.361+0000 7f5f40bff700 1 -- 172.21.15.142:0/1625741494 shutdown_connections 2023-09-30T23:02:32.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.361+0000 7f5f40bff700 1 --2- 172.21.15.142:0/1625741494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c157820 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.361+0000 7f5f40bff700 1 --2- 172.21.15.142:0/1625741494 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c0cbfe0 0x7f5f3c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.361+0000 7f5f40bff700 1 --2- 172.21.15.142:0/1625741494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cc3b0 0x7f5f3c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.361+0000 7f5f40bff700 1 -- 172.21.15.142:0/1625741494 >> 172.21.15.142:0/1625741494 conn(0x7f5f3c0d0a80 msgr2=0x7f5f3c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.361+0000 7f5f40bff700 1 -- 172.21.15.142:0/1625741494 shutdown_connections 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.361+0000 7f5f40bff700 1 -- 172.21.15.142:0/1625741494 wait complete. 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.362+0000 7f5f40bff700 1 Processor -- start 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.362+0000 7f5f40bff700 1 -- start start 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f40bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cbfe0 0x7f5f3c16a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f40bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c0cc3b0 0x7f5f3c1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f40bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f40bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b9100 con 0x7f5f3c1573a0 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f40bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b84f0 con 0x7f5f3c0cc3b0 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f40bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b87d0 con 0x7f5f3c0cbfe0 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f3ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f3ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38918/0 (socket says 172.21.15.142:38918) 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.363+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/2389910320 learned_addr learned my addr 172.21.15.142:0/2389910320 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f3a59c700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cbfe0 0x7f5f3c16a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f39d9b700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c0cc3b0 0x7f5f3c1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cbfe0 msgr2=0x7f5f3c16a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f3ad9d700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cbfe0 0x7f5f3c16a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c0cc3b0 msgr2=0x7f5f3c1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f3ad9d700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c0cc3b0 0x7f5f3c1588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f3ad9d700 1 -- 172.21.15.142:0/2389910320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34009ae0 con 0x7f5f3c1573a0 2023-09-30T23:02:32.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f3ad9d700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c149270 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c06cf30 tx=0x7f5f34018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:32.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f2a7fc700 1 -- 172.21.15.142:0/2389910320 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400be80 con 0x7f5f3c1573a0 2023-09-30T23:02:32.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f2a7fc700 1 -- 172.21.15.142:0/2389910320 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34008e40 con 0x7f5f3c1573a0 2023-09-30T23:02:32.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c0b8ab0 con 0x7f5f3c1573a0 2023-09-30T23:02:32.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f2a7fc700 1 -- 172.21.15.142:0/2389910320 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34025690 con 0x7f5f3c1573a0 2023-09-30T23:02:32.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.364+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c158e10 con 0x7f5f3c1573a0 2023-09-30T23:02:32.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.365+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c0b92b0 con 0x7f5f3c1573a0 2023-09-30T23:02:32.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.366+0000 7f5f2a7fc700 1 -- 172.21.15.142:0/2389910320 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5f34003040 con 0x7f5f3c1573a0 2023-09-30T23:02:32.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.367+0000 7f5f2a7fc700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f1c067360 0x7f5f1c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.368+0000 7f5f2a7fc700 1 -- 172.21.15.142:0/2389910320 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5f340866c0 con 0x7f5f3c1573a0 2023-09-30T23:02:32.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.368+0000 7f5f3a59c700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f1c067360 0x7f5f1c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.368+0000 7f5f3a59c700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f1c067360 0x7f5f1c069810 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00ab30 tx=0x7f5f2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:32.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.372+0000 7f5f2a7fc700 1 -- 172.21.15.142:0/2389910320 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5f3c0b92b0 con 0x7f5f3c1573a0 2023-09-30T23:02:32.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.560+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f3c0b9240 con 0x7f5f3c1573a0 2023-09-30T23:02:32.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.560+0000 7f5f2a7fc700 1 -- 172.21.15.142:0/2389910320 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v171) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f34053870 con 0x7f5f3c1573a0 2023-09-30T23:02:32.562 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T23:02:32.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f1c067360 msgr2=0x7f5f1c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f1c067360 0x7f5f1c069810 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00ab30 tx=0x7f5f2c008040 comp rx=0 tx=0).stop 2023-09-30T23:02:32.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 msgr2=0x7f5f3c149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c149270 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c06cf30 tx=0x7f5f34018000 comp rx=0 tx=0).stop 2023-09-30T23:02:32.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 shutdown_connections 2023-09-30T23:02:32.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f1c067360 0x7f5f1c069810 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f3c1573a0 0x7f5f3c149270 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0cbfe0 0x7f5f3c16a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 --2- 172.21.15.142:0/2389910320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c0cc3b0 0x7f5f3c1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 >> 172.21.15.142:0/2389910320 conn(0x7f5f3c0d0a80 msgr2=0x7f5f3c06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:32.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 shutdown_connections 2023-09-30T23:02:32.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.563+0000 7f5f40bff700 1 -- 172.21.15.142:0/2389910320 wait complete. 2023-09-30T23:02:32.581 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T23:02:32.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.771+0000 7f7cc01ff700 1 Processor -- start 2023-09-30T23:02:32.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.772+0000 7f7cc01ff700 1 -- start start 2023-09-30T23:02:32.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.773+0000 7f7cc01ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7cb8159ba0 0x7f7cb806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.773+0000 7f7cc01ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb8067d10 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.773+0000 7f7cc01ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb806af90 con 0x7f7cb80b0de0 2023-09-30T23:02:32.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.773+0000 7f7cc01ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80676c0 con 0x7f7cb8159ba0 2023-09-30T23:02:32.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.773+0000 7f7cbe79c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7cb80ca5e0 0x7f7cb80681a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58920/0 (socket says 172.21.15.142:58920) 2023-09-30T23:02:32.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.773+0000 7f7cbe79c700 1 -- 172.21.15.142:0/464633846 learned_addr learned my addr 172.21.15.142:0/464633846 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.773+0000 7f7cbdf9b700 1 --2- 172.21.15.142:0/464633846 >> v2:172.21.15.148:3300/0 conn(0x7f7cb8159ba0 0x7f7cb806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbcf99700 1 -- 172.21.15.142:0/464633846 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837721652 0 0) 0x7f7cb8067d10 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbcf99700 1 -- 172.21.15.142:0/464633846 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca4003570 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbdf9b700 1 -- 172.21.15.142:0/464633846 >> v1:172.21.15.148:6789/0 conn(0x7f7cb80b0de0 legacy=0x7f7cb80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbdf9b700 1 -- 172.21.15.142:0/464633846 >> v1:172.21.15.142:6789/0 conn(0x7f7cb80ca5e0 legacy=0x7f7cb80681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbdf9b700 1 -- 172.21.15.142:0/464633846 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80679a0 con 0x7f7cb8159ba0 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbdf9b700 1 --2- 172.21.15.142:0/464633846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb8159ba0 0x7f7cb806a8d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40098e0 tx=0x7f7cb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1bfaa8075a9ce29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:32.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbcf99700 1 -- 172.21.15.142:0/464633846 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400b640 con 0x7f7cb8159ba0 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbcf99700 1 -- 172.21.15.142:0/464633846 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400b7a0 con 0x7f7cb8159ba0 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.774+0000 7f7cbcf99700 1 -- 172.21.15.142:0/464633846 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400bb40 con 0x7f7cb8159ba0 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.775+0000 7f7cc01ff700 1 -- 172.21.15.142:0/464633846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb8159ba0 msgr2=0x7f7cb806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.775+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/464633846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb8159ba0 0x7f7cb806a8d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40098e0 tx=0x7f7cb40091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.775+0000 7f7cc01ff700 1 -- 172.21.15.142:0/464633846 shutdown_connections 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.775+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/464633846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb8159ba0 0x7f7cb806a8d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.775+0000 7f7cc01ff700 1 -- 172.21.15.142:0/464633846 >> 172.21.15.142:0/464633846 conn(0x7f7cb80cb2f0 msgr2=0x7f7cb80cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.775+0000 7f7cc01ff700 1 -- 172.21.15.142:0/464633846 shutdown_connections 2023-09-30T23:02:32.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.775+0000 7f7cc01ff700 1 -- 172.21.15.142:0/464633846 wait complete. 2023-09-30T23:02:32.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.776+0000 7f7cc01ff700 1 Processor -- start 2023-09-30T23:02:32.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.777+0000 7f7cc01ff700 1 -- start start 2023-09-30T23:02:32.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.777+0000 7f7cc01ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb80b0de0 0x7f7cb815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.777+0000 7f7cc01ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb80ca5e0 0x7f7cb80c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cc01ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb8159ba0 0x7f7cb80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cc01ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb816b9c0 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cc01ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb816ab40 con 0x7f7cb80b0de0 2023-09-30T23:02:32.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cc01ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb816ae20 con 0x7f7cb8159ba0 2023-09-30T23:02:32.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb80ca5e0 0x7f7cb80c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb80ca5e0 0x7f7cb80c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38928/0 (socket says 172.21.15.142:38928) 2023-09-30T23:02:32.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 -- 172.21.15.142:0/234289510 learned_addr learned my addr 172.21.15.142:0/234289510 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:32.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbe79c700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb8159ba0 0x7f7cb80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbdf9b700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb80b0de0 0x7f7cb815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 -- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb8159ba0 msgr2=0x7f7cb80c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb8159ba0 0x7f7cb80c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 -- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb80b0de0 msgr2=0x7f7cb815cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb80b0de0 0x7f7cb815cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbd79a700 1 -- 172.21.15.142:0/234289510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4009420 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.778+0000 7f7cbdf9b700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb80b0de0 0x7f7cb815cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.779+0000 7f7cbd79a700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb80ca5e0 0x7f7cb80c3cb0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c590 tx=0x7f7ca800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.779+0000 7f7cadffb700 1 -- 172.21.15.142:0/234289510 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8011590 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.779+0000 7f7cadffb700 1 -- 172.21.15.142:0/234289510 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8011710 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.779+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb816b100 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.779+0000 7f7cadffb700 1 -- 172.21.15.142:0/234289510 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8011ad0 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.779+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb80c41f0 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.780+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb816b620 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.781+0000 7f7cadffb700 1 -- 172.21.15.142:0/234289510 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7ca801b3b0 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.782+0000 7f7cadffb700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c9c067330 0x7f7c9c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:32.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.782+0000 7f7cadffb700 1 -- 172.21.15.142:0/234289510 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7ca8083e20 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.782+0000 7f7cbdf9b700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c9c067330 0x7f7c9c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:32.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.782+0000 7f7cbdf9b700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c9c067330 0x7f7c9c0697e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40093f0 tx=0x7f7cb4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:32.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.786+0000 7f7cadffb700 1 -- 172.21.15.142:0/234289510 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7cb816b620 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.974+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7cb816b620 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.974+0000 7f7cadffb700 1 -- 172.21.15.142:0/234289510 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v171) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7cb816b620 con 0x7f7cb80ca5e0 2023-09-30T23:02:32.975 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c9c067330 msgr2=0x7f7c9c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c9c067330 0x7f7c9c0697e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40093f0 tx=0x7f7cb4017000 comp rx=0 tx=0).stop 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb80ca5e0 msgr2=0x7f7cb80c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb80ca5e0 0x7f7cb80c3cb0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c590 tx=0x7f7ca800c8a0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 shutdown_connections 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c9c067330 0x7f7c9c0697e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cb8159ba0 0x7f7cb80c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cb80b0de0 0x7f7cb815cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 --2- 172.21.15.142:0/234289510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb80ca5e0 0x7f7cb80c3cb0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 >> 172.21.15.142:0/234289510 conn(0x7f7cb80cb2f0 msgr2=0x7f7cb80cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 shutdown_connections 2023-09-30T23:02:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:32.977+0000 7f7cc01ff700 1 -- 172.21.15.142:0/234289510 wait complete. 2023-09-30T23:02:32.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T23:02:33.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.185+0000 7f5da83ff700 1 Processor -- start 2023-09-30T23:02:33.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.185+0000 7f5da83ff700 1 -- start start 2023-09-30T23:02:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.186+0000 7f5da83ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5da0159b90 0x7f5da015a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.186+0000 7f5da83ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.186+0000 7f5da83ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da00b0ee0 con 0x7f5da00aebf0 2023-09-30T23:02:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.186+0000 7f5da83ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da00aefc0 con 0x7f5da0159b90 2023-09-30T23:02:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.186+0000 7f5da83ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da015a550 con 0x7f5da0069f10 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da619b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5da00aebf0 0x7f5da006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58930/0 (socket says 172.21.15.142:58930) 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da619b700 1 -- 172.21.15.142:0/2845207858 learned_addr learned my addr 172.21.15.142:0/2845207858 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da599a700 1 --2- 172.21.15.142:0/2845207858 >> v2:172.21.15.142:3300/0 conn(0x7f5da0159b90 0x7f5da015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da699c700 1 --2- 172.21.15.142:0/2845207858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da5199700 1 -- 172.21.15.142:0/2845207858 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676441261 0 0) 0x7f5da00b0ee0 con 0x7f5da00aebf0 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da5199700 1 -- 172.21.15.142:0/2845207858 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d8c004680 con 0x7f5da00aebf0 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da599a700 1 -- 172.21.15.142:0/2845207858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 msgr2=0x7f5da006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da599a700 1 --2- 172.21.15.142:0/2845207858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da599a700 1 -- 172.21.15.142:0/2845207858 >> v1:172.21.15.142:6789/0 conn(0x7f5da00aebf0 legacy=0x7f5da006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da599a700 1 -- 172.21.15.142:0/2845207858 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da006f360 con 0x7f5da0159b90 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da699c700 1 --2- 172.21.15.142:0/2845207858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.187+0000 7f5da599a700 1 --2- 172.21.15.142:0/2845207858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da015a010 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009910 tx=0x7f5d900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d51fb5bed65931 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da5199700 1 -- 172.21.15.142:0/2845207858 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000b640 con 0x7f5da0159b90 2023-09-30T23:02:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da5199700 1 -- 172.21.15.142:0/2845207858 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9000b7a0 con 0x7f5da0159b90 2023-09-30T23:02:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da5199700 1 -- 172.21.15.142:0/2845207858 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000bb60 con 0x7f5da0159b90 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 -- 172.21.15.142:0/2845207858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 msgr2=0x7f5da015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 --2- 172.21.15.142:0/2845207858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da015a010 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009910 tx=0x7f5d900091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 -- 172.21.15.142:0/2845207858 shutdown_connections 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 --2- 172.21.15.142:0/2845207858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 --2- 172.21.15.142:0/2845207858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da015a010 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 -- 172.21.15.142:0/2845207858 >> 172.21.15.142:0/2845207858 conn(0x7f5da00680c0 msgr2=0x7f5da00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 -- 172.21.15.142:0/2845207858 shutdown_connections 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.188+0000 7f5da83ff700 1 -- 172.21.15.142:0/2845207858 wait complete. 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.190+0000 7f5da83ff700 1 Processor -- start 2023-09-30T23:02:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.190+0000 7f5da83ff700 1 -- start start 2023-09-30T23:02:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da83ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da83ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5da00aebf0 0x7f5da00c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da83ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da0156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da83ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da016b200 con 0x7f5da0159b90 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da83ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da015d4a0 con 0x7f5da00aebf0 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da83ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da016a910 con 0x7f5da0069f10 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da0156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da0156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38960/0 (socket says 172.21.15.142:38960) 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da699c700 1 -- 172.21.15.142:0/4223441263 learned_addr learned my addr 172.21.15.142:0/4223441263 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da619b700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da599a700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5da00aebf0 0x7f5da00c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da699c700 1 -- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 msgr2=0x7f5da015cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da699c700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da015cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da699c700 1 -- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5da00aebf0 msgr2=0x7f5da00c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.191+0000 7f5da699c700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5da00aebf0 0x7f5da00c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5da699c700 1 -- 172.21.15.142:0/4223441263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d90009420 con 0x7f5da0159b90 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5da599a700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5da00aebf0 0x7f5da00c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5da699c700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da0156d40 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d180 tx=0x7f5d98009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5d967fc700 1 -- 172.21.15.142:0/4223441263 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800de20 con 0x7f5da0159b90 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5d967fc700 1 -- 172.21.15.142:0/4223441263 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9800f040 con 0x7f5da0159b90 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da016b690 con 0x7f5da0159b90 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5d967fc700 1 -- 172.21.15.142:0/4223441263 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98015690 con 0x7f5da0159b90 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.192+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da016ae90 con 0x7f5da0159b90 2023-09-30T23:02:33.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.193+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da016b370 con 0x7f5da0159b90 2023-09-30T23:02:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.194+0000 7f5d967fc700 1 -- 172.21.15.142:0/4223441263 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5d9801e3b0 con 0x7f5da0159b90 2023-09-30T23:02:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.195+0000 7f5d967fc700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d84067330 0x7f5d840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.196+0000 7f5d967fc700 1 -- 172.21.15.142:0/4223441263 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5d98084f00 con 0x7f5da0159b90 2023-09-30T23:02:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.196+0000 7f5da619b700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d84067330 0x7f5d840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.196+0000 7f5da619b700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d84067330 0x7f5d840697e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0058d0 tx=0x7f5d9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:33.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.200+0000 7f5d967fc700 1 -- 172.21.15.142:0/4223441263 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5d980520b0 con 0x7f5da0159b90 2023-09-30T23:02:33.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.392+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5da00b0570 con 0x7f5da0159b90 2023-09-30T23:02:33.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.392+0000 7f5d967fc700 1 -- 172.21.15.142:0/4223441263 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v171) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5d9801a090 con 0x7f5da0159b90 2023-09-30T23:02:33.392 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:33.392 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T23:02:33.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:33.392 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T23:02:33.392 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T23:02:33.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:02:33.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:02:33.393 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T23:02:33.393 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T23:02:33.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:02:33.393 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T23:02:33.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.394+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d84067330 msgr2=0x7f5d840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.394+0000 7f5da83ff700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d84067330 0x7f5d840697e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0058d0 tx=0x7f5d9c009040 comp rx=0 tx=0).stop 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.394+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 msgr2=0x7f5da0156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.394+0000 7f5da83ff700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da0156d40 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d180 tx=0x7f5d98009a50 comp rx=0 tx=0).stop 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 shutdown_connections 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5d84067330 0x7f5d840697e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5da0159b90 0x7f5da0156d40 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5da0069f10 0x7f5da015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 --2- 172.21.15.142:0/4223441263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5da00aebf0 0x7f5da00c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 >> 172.21.15.142:0/4223441263 conn(0x7f5da00680c0 msgr2=0x7f5da01501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 shutdown_connections 2023-09-30T23:02:33.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.395+0000 7f5da83ff700 1 -- 172.21.15.142:0/4223441263 wait complete. 2023-09-30T23:02:33.411 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T23:02:33.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T23:02:33.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.607+0000 7f6ffc9ff700 1 Processor -- start 2023-09-30T23:02:33.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.607+0000 7f6ffc9ff700 1 -- start start 2023-09-30T23:02:33.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.608+0000 7f6ffc9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ff80ca240 0x7f6ff806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.608+0000 7f6ffc9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff806b120 con 0x7f6ff8150730 2023-09-30T23:02:33.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.608+0000 7f6ffc9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80ca790 con 0x7f6ff806ace0 2023-09-30T23:02:33.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.608+0000 7f6ffc9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff80cc340 con 0x7f6ff80ca240 2023-09-30T23:02:33.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ff80ca240 0x7f6ff806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff5d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ff80ca240 0x7f6ff806a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38966/0 (socket says 172.21.15.142:38966) 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff5d9b700 1 -- 172.21.15.142:0/60001745 learned_addr learned my addr 172.21.15.142:0/60001745 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff5d9b700 1 -- 172.21.15.142:0/60001745 >> v1:172.21.15.148:6789/0 conn(0x7f6ff806ace0 legacy=0x7f6ff8157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff5d9b700 1 -- 172.21.15.142:0/60001745 >> v1:172.21.15.142:6789/0 conn(0x7f6ff8150730 legacy=0x7f6ff8157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff5d9b700 1 -- 172.21.15.142:0/60001745 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80caa70 con 0x7f6ff80ca240 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff5d9b700 1 --2- 172.21.15.142:0/60001745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff80ca240 0x7f6ff806a7a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0099b0 tx=0x7f6fec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7cf7ce4ef004b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.609+0000 7f6ff559a700 1 -- 172.21.15.142:0/60001745 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00b860 con 0x7f6ff80ca240 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ff559a700 1 -- 172.21.15.142:0/60001745 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00b9c0 con 0x7f6ff80ca240 2023-09-30T23:02:33.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ff559a700 1 -- 172.21.15.142:0/60001745 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00bd60 con 0x7f6ff80ca240 2023-09-30T23:02:33.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/60001745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff80ca240 msgr2=0x7f6ff806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/60001745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff80ca240 0x7f6ff806a7a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0099b0 tx=0x7f6fec009250 comp rx=0 tx=0).stop 2023-09-30T23:02:33.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/60001745 shutdown_connections 2023-09-30T23:02:33.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/60001745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff80ca240 0x7f6ff806a7a0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/60001745 >> 172.21.15.142:0/60001745 conn(0x7f6ff80cc670 msgr2=0x7f6ff80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:33.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/60001745 shutdown_connections 2023-09-30T23:02:33.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.610+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/60001745 wait complete. 2023-09-30T23:02:33.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.612+0000 7f6ffc9ff700 1 Processor -- start 2023-09-30T23:02:33.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.612+0000 7f6ffc9ff700 1 -- start start 2023-09-30T23:02:33.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ffc9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff806ace0 0x7f6ff8136670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ffc9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff80ca240 0x7f6ff8154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ffc9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ff8150730 0x7f6ff8155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ffc9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff816c660 con 0x7f6ff806ace0 2023-09-30T23:02:33.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ffc9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff816bdb0 con 0x7f6ff80ca240 2023-09-30T23:02:33.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ffc9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff816f000 con 0x7f6ff8150730 2023-09-30T23:02:33.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff806ace0 0x7f6ff8136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff806ace0 0x7f6ff8136670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38968/0 (socket says 172.21.15.142:38968) 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 -- 172.21.15.142:0/2758474353 learned_addr learned my addr 172.21.15.142:0/2758474353 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff5d9b700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff80ca240 0x7f6ff8154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 -- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ff8150730 msgr2=0x7f6ff8155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff6d9d700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ff8150730 0x7f6ff8155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ff8150730 0x7f6ff8155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 -- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff80ca240 msgr2=0x7f6ff8154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff80ca240 0x7f6ff8154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff659c700 1 -- 172.21.15.142:0/2758474353 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0094f0 con 0x7f6ff806ace0 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff6d9d700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ff8150730 0x7f6ff8155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:33.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.613+0000 7f6ff5d9b700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff80ca240 0x7f6ff8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:33.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.614+0000 7f6ff659c700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff806ace0 0x7f6ff8136670 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c4e0 tx=0x7f6fe800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:33.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.614+0000 7f6fe67fc700 1 -- 172.21.15.142:0/2758474353 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8011590 con 0x7f6ff806ace0 2023-09-30T23:02:33.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.614+0000 7f6fe67fc700 1 -- 172.21.15.142:0/2758474353 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe8011710 con 0x7f6ff806ace0 2023-09-30T23:02:33.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.614+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff816c010 con 0x7f6ff806ace0 2023-09-30T23:02:33.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.614+0000 7f6fe67fc700 1 -- 172.21.15.142:0/2758474353 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8011ad0 con 0x7f6ff806ace0 2023-09-30T23:02:33.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.614+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff8136bb0 con 0x7f6ff806ace0 2023-09-30T23:02:33.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.615+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff8069a50 con 0x7f6ff806ace0 2023-09-30T23:02:33.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.616+0000 7f6fe67fc700 1 -- 172.21.15.142:0/2758474353 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6fe801b3b0 con 0x7f6ff806ace0 2023-09-30T23:02:33.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.617+0000 7f6fe67fc700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6fd8067330 0x7f6fd80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:33.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.618+0000 7f6fe67fc700 1 -- 172.21.15.142:0/2758474353 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6fe8083e20 con 0x7f6ff806ace0 2023-09-30T23:02:33.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.618+0000 7f6ff5d9b700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6fd8067330 0x7f6fd80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:33.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.618+0000 7f6ff5d9b700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6fd8067330 0x7f6fd80697e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80ca6c0 tx=0x7f6fec018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:33.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.622+0000 7f6fe67fc700 1 -- 172.21.15.142:0/2758474353 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6fe8050fd0 con 0x7f6ff806ace0 2023-09-30T23:02:33.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:33.816+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6ff806fc10 con 0x7f6ff806ace0 2023-09-30T23:02:34.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.122+0000 7f6fe67fc700 1 -- 172.21.15.142:0/2758474353 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v172) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6fe8017020 con 0x7f6ff806ace0 2023-09-30T23:02:34.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6fd8067330 msgr2=0x7f6fd80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:34.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6fd8067330 0x7f6fd80697e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80ca6c0 tx=0x7f6fec018000 comp rx=0 tx=0).stop 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff806ace0 msgr2=0x7f6ff8136670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff806ace0 0x7f6ff8136670 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c4e0 tx=0x7f6fe800c8a0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 shutdown_connections 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6fd8067330 0x7f6fd80697e0 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80ca6c0 tx=0x7f6fec018000 comp rx=0 tx=0).stop 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ff8150730 0x7f6ff8155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff806ace0 0x7f6ff8136670 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 --2- 172.21.15.142:0/2758474353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff80ca240 0x7f6ff8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.127+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 >> 172.21.15.142:0/2758474353 conn(0x7f6ff80cc670 msgr2=0x7f6ff80c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.128+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 shutdown_connections 2023-09-30T23:02:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.128+0000 7f6ffc9ff700 1 -- 172.21.15.142:0/2758474353 wait complete. 2023-09-30T23:02:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T23:02:34.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T23:02:34.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.345+0000 7f2d7bdff700 1 Processor -- start 2023-09-30T23:02:34.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.345+0000 7f2d7bdff700 1 -- start start 2023-09-30T23:02:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.346+0000 7f2d7bdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 0x7f2d740cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.346+0000 7f2d7bdff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d740b0770 0x7f2d740b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.346+0000 7f2d7bdff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740b1120 con 0x7f2d7406b070 2023-09-30T23:02:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.346+0000 7f2d7bdff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740cc8a0 con 0x7f2d740b0770 2023-09-30T23:02:34.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.346+0000 7f2d7bdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740cbed0 con 0x7f2d74159d30 2023-09-30T23:02:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.346+0000 7f2d7a39c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2d7406b070 0x7f2d7406b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58954/0 (socket says 172.21.15.142:58954) 2023-09-30T23:02:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.346+0000 7f2d7a39c700 1 -- 172.21.15.142:0/1091046693 learned_addr learned my addr 172.21.15.142:0/1091046693 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d7939a700 1 --2- 172.21.15.142:0/1091046693 >> v2:172.21.15.148:3300/0 conn(0x7f2d740b0770 0x7f2d740b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d79b9b700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 0x7f2d740cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142533110 0 0) 0x7f2d740b1120 con 0x7f2d7406b070 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d60003570 con 0x7f2d7406b070 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3459872673 0 0) 0x7f2d60003570 con 0x7f2d7406b070 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 msgr2=0x7f2d740cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 0x7f2d740cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 >> v2:172.21.15.148:3300/0 conn(0x7f2d740b0770 msgr2=0x7f2d740b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 --2- 172.21.15.142:0/1091046693 >> v2:172.21.15.148:3300/0 conn(0x7f2d740b0770 0x7f2d740b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740cb2c0 con 0x7f2d7406b070 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f2d6c0017f0 con 0x7f2d7406b070 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 >> v1:172.21.15.142:6789/0 conn(0x7f2d7406b070 legacy=0x7f2d7406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60003a60 0x7f2d60003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 0x7f2d60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.347+0000 7f2d78b99700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740cc8a0 con 0x7f2d60004d50 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740cbed0 con 0x7f2d60003a60 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6000ba60 con 0x7f2d74159d30 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d79b9b700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60003a60 0x7f2d60003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7a39c700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7939a700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 0x7f2d60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7a39c700 1 -- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 msgr2=0x7f2d60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7a39c700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d74159d30 0x7f2d60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7a39c700 1 -- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60003a60 msgr2=0x7f2d60003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7a39c700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60003a60 0x7f2d60003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7a39c700 1 -- 172.21.15.142:0/1091046693 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60003570 con 0x7f2d60004d50 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d79b9b700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60003a60 0x7f2d60003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.348+0000 7f2d7a39c700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00a970 tx=0x7f2d6c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997253a8dbde12cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0070d0 con 0x7f2d60004d50 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c007270 con 0x7f2d60004d50 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d78b99700 1 -- 172.21.15.142:0/1091046693 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c007630 con 0x7f2d60004d50 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d7bdff700 1 -- 172.21.15.142:0/1091046693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d60004d50 msgr2=0x7f2d600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d7bdff700 1 --2- 172.21.15.142:0/1091046693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00a970 tx=0x7f2d6c002210 comp rx=0 tx=0).stop 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d7a39c700 1 -- 172.21.15.142:0/1091046693 reap_dead start 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d7bdff700 1 -- 172.21.15.142:0/1091046693 shutdown_connections 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d7bdff700 1 -- 172.21.15.142:0/1091046693 >> 172.21.15.142:0/1091046693 conn(0x7f2d740cf2e0 msgr2=0x7f2d740b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d7bdff700 1 -- 172.21.15.142:0/1091046693 shutdown_connections 2023-09-30T23:02:34.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.349+0000 7f2d7bdff700 1 -- 172.21.15.142:0/1091046693 wait complete. 2023-09-30T23:02:34.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.351+0000 7f2d7bdff700 1 Processor -- start 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.351+0000 7f2d7bdff700 1 -- start start 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7bdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60004d50 0x7f2d74153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7bdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7416b390 0x7f2d740c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7bdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ca1c0 0x7f2d7416a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7bdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740ca660 con 0x7f2d740ca1c0 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7bdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740b03f0 con 0x7f2d7416b390 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7bdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741571e0 con 0x7f2d60004d50 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7a39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ca1c0 0x7f2d7416a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7939a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7416b390 0x7f2d740c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d79b9b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60004d50 0x7f2d74153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7a39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ca1c0 0x7f2d7416a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38986/0 (socket says 172.21.15.142:38986) 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.352+0000 7f2d7a39c700 1 -- 172.21.15.142:0/4261736853 learned_addr learned my addr 172.21.15.142:0/4261736853 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7a39c700 1 -- 172.21.15.142:0/4261736853 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60004d50 msgr2=0x7f2d74153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7a39c700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60004d50 0x7f2d74153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7a39c700 1 -- 172.21.15.142:0/4261736853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7416b390 msgr2=0x7f2d740c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7a39c700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7416b390 0x7f2d740c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7a39c700 1 -- 172.21.15.142:0/4261736853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d741574c0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7a39c700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ca1c0 0x7f2d7416a500 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c012000 tx=0x7f2d6c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d69ffb700 1 -- 172.21.15.142:0/4261736853 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c023070 con 0x7f2d740ca1c0 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d69ffb700 1 -- 172.21.15.142:0/4261736853 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c0017b0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d69ffb700 1 -- 172.21.15.142:0/4261736853 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0070d0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d741577a0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.353+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7416b800 con 0x7f2d740ca1c0 2023-09-30T23:02:34.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.354+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d74157cc0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.355+0000 7f2d69ffb700 1 -- 172.21.15.142:0/4261736853 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2d6c004bb0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.356+0000 7f2d69ffb700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d58067330 0x7f2d580697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:34.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.356+0000 7f2d69ffb700 1 -- 172.21.15.142:0/4261736853 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f2d6c086ac0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.356+0000 7f2d79b9b700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d58067330 0x7f2d580697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:34.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.357+0000 7f2d79b9b700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d58067330 0x7f2d580697e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2d70006eb0 tx=0x7f2d700091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.361+0000 7f2d69ffb700 1 -- 172.21.15.142:0/4261736853 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2d74157cc0 con 0x7f2d740ca1c0 2023-09-30T23:02:34.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:34.554+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2d74157cc0 con 0x7f2d740ca1c0 2023-09-30T23:02:35.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.135+0000 7f2d69ffb700 1 -- 172.21.15.142:0/4261736853 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v173) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2d6c016070 con 0x7f2d740ca1c0 2023-09-30T23:02:35.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.140+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d58067330 msgr2=0x7f2d580697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:35.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.140+0000 7f2d7bdff700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d58067330 0x7f2d580697e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2d70006eb0 tx=0x7f2d700091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.140+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ca1c0 msgr2=0x7f2d7416a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:35.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.140+0000 7f2d7bdff700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ca1c0 0x7f2d7416a500 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c012000 tx=0x7f2d6c015000 comp rx=0 tx=0).stop 2023-09-30T23:02:35.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.142+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 shutdown_connections 2023-09-30T23:02:35.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.142+0000 7f2d7bdff700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2d58067330 0x7f2d580697e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.142+0000 7f2d7bdff700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ca1c0 0x7f2d7416a500 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.142+0000 7f2d7bdff700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d60004d50 0x7f2d74153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.142+0000 7f2d7bdff700 1 --2- 172.21.15.142:0/4261736853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d7416b390 0x7f2d740c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.142+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 >> 172.21.15.142:0/4261736853 conn(0x7f2d740cf2e0 msgr2=0x7f2d74067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:35.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.144+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 shutdown_connections 2023-09-30T23:02:35.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.145+0000 7f2d7bdff700 1 -- 172.21.15.142:0/4261736853 wait complete. 2023-09-30T23:02:35.149 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T23:02:35.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T23:02:35.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.360+0000 7fb778bff700 1 Processor -- start 2023-09-30T23:02:35.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.360+0000 7fb778bff700 1 -- start start 2023-09-30T23:02:35.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.361+0000 7fb778bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb77415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:35.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.361+0000 7fb778bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7740cc3b0 0x7fb7740cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:35.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.361+0000 7fb778bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7740d0550 con 0x7fb7741573a0 2023-09-30T23:02:35.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.361+0000 7fb778bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740cf750 con 0x7fb7740cc3b0 2023-09-30T23:02:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.361+0000 7fb778bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740cf940 con 0x7fb7740cbfe0 2023-09-30T23:02:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7740cc3b0 0x7fb7740cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7740cc3b0 0x7fb7740cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38990/0 (socket says 172.21.15.142:38990) 2023-09-30T23:02:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 -- 172.21.15.142:0/1186633754 learned_addr learned my addr 172.21.15.142:0/1186633754 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:35.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb77259c700 1 --2- 172.21.15.142:0/1186633754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb77415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 -- 172.21.15.142:0/1186633754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 msgr2=0x7fb77415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 --2- 172.21.15.142:0/1186633754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb77415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 -- 172.21.15.142:0/1186633754 >> v1:172.21.15.142:6789/0 conn(0x7fb7741573a0 legacy=0x7fb77415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 -- 172.21.15.142:0/1186633754 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740cfc20 con 0x7fb7740cc3b0 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb77259c700 1 --2- 172.21.15.142:0/1186633754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb77415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.362+0000 7fb771d9b700 1 --2- 172.21.15.142:0/1186633754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb7740cf210 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fb7680099e0 tx=0x7fb768009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97352a2fe9f72885 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb77159a700 1 -- 172.21.15.142:0/1186633754 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800b820 con 0x7fb7740cc3b0 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb77159a700 1 -- 172.21.15.142:0/1186633754 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76800b980 con 0x7fb7740cc3b0 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb77159a700 1 -- 172.21.15.142:0/1186633754 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800bd20 con 0x7fb7740cc3b0 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb778bff700 1 -- 172.21.15.142:0/1186633754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 msgr2=0x7fb7740cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb778bff700 1 --2- 172.21.15.142:0/1186633754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb7740cf210 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fb7680099e0 tx=0x7fb768009250 comp rx=0 tx=0).stop 2023-09-30T23:02:35.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb778bff700 1 -- 172.21.15.142:0/1186633754 shutdown_connections 2023-09-30T23:02:35.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb778bff700 1 --2- 172.21.15.142:0/1186633754 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb77415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb778bff700 1 --2- 172.21.15.142:0/1186633754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb7740cf210 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb778bff700 1 -- 172.21.15.142:0/1186633754 >> 172.21.15.142:0/1186633754 conn(0x7fb7740d0a80 msgr2=0x7fb7740d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:35.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.363+0000 7fb778bff700 1 -- 172.21.15.142:0/1186633754 shutdown_connections 2023-09-30T23:02:35.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.364+0000 7fb778bff700 1 -- 172.21.15.142:0/1186633754 wait complete. 2023-09-30T23:02:35.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.366+0000 7fb778bff700 1 Processor -- start 2023-09-30T23:02:35.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.366+0000 7fb778bff700 1 -- start start 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb778bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb7740b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb778bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb77416a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb778bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7741573a0 0x7fb7740c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb778bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740c9a20 con 0x7fb7740cc3b0 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb778bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740ca370 con 0x7fb7741573a0 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb778bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740c94c0 con 0x7fb7740cbfe0 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb771d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb77416a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:35.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb771d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb77416a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38998/0 (socket says 172.21.15.142:38998) 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.367+0000 7fb771d9b700 1 -- 172.21.15.142:0/1566448763 learned_addr learned my addr 172.21.15.142:0/1566448763 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb771d9b700 1 -- 172.21.15.142:0/1566448763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 msgr2=0x7fb7740b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb771d9b700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb7740b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb771d9b700 1 -- 172.21.15.142:0/1566448763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7741573a0 msgr2=0x7fb7740c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb771d9b700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7741573a0 0x7fb7740c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb771d9b700 1 -- 172.21.15.142:0/1566448763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680094f0 con 0x7fb7740cc3b0 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb771d9b700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb77416a620 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb768006fd0 tx=0x7fb768017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb7627fc700 1 -- 172.21.15.142:0/1566448763 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768024440 con 0x7fb7740cc3b0 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb7627fc700 1 -- 172.21.15.142:0/1566448763 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680245a0 con 0x7fb7740cc3b0 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7740c9740 con 0x7fb7740cc3b0 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb7627fc700 1 -- 172.21.15.142:0/1566448763 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768024960 con 0x7fb7740cc3b0 2023-09-30T23:02:35.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.368+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7740ca000 con 0x7fb7740cc3b0 2023-09-30T23:02:35.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.369+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7740c9b80 con 0x7fb7740cc3b0 2023-09-30T23:02:35.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.370+0000 7fb7627fc700 1 -- 172.21.15.142:0/1566448763 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb76801a420 con 0x7fb7740cc3b0 2023-09-30T23:02:35.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.371+0000 7fb7627fc700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb754067330 0x7fb7540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:35.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.371+0000 7fb7627fc700 1 -- 172.21.15.142:0/1566448763 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fb768086ab0 con 0x7fb7740cc3b0 2023-09-30T23:02:35.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.372+0000 7fb77259c700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb754067330 0x7fb7540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:35.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.372+0000 7fb77259c700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb754067330 0x7fb7540697e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb764007aa0 tx=0x7fb764008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:35.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.376+0000 7fb7627fc700 1 -- 172.21.15.142:0/1566448763 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb7740c9b80 con 0x7fb7740cc3b0 2023-09-30T23:02:35.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:35.607+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7740c9b80 con 0x7fb7740cc3b0 2023-09-30T23:02:36.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.137+0000 7fb7627fc700 1 -- 172.21.15.142:0/1566448763 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v79) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb7740c9b80 con 0x7fb7740cc3b0 2023-09-30T23:02:36.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.146+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb754067330 msgr2=0x7fb7540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.146+0000 7fb778bff700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb754067330 0x7fb7540697e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb764007aa0 tx=0x7fb764008040 comp rx=0 tx=0).stop 2023-09-30T23:02:36.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.146+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 msgr2=0x7fb77416a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.146+0000 7fb778bff700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb77416a620 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb768006fd0 tx=0x7fb768017000 comp rx=0 tx=0).stop 2023-09-30T23:02:36.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.152+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 shutdown_connections 2023-09-30T23:02:36.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.152+0000 7fb778bff700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb754067330 0x7fb7540697e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.152+0000 7fb778bff700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7741573a0 0x7fb7740c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.152+0000 7fb778bff700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb7740cbfe0 0x7fb7740b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.152+0000 7fb778bff700 1 --2- 172.21.15.142:0/1566448763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7740cc3b0 0x7fb77416a620 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.152+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 >> 172.21.15.142:0/1566448763 conn(0x7fb7740d0a80 msgr2=0x7fb7740cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:36.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.155+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 shutdown_connections 2023-09-30T23:02:36.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.155+0000 7fb778bff700 1 -- 172.21.15.142:0/1566448763 wait complete. 2023-09-30T23:02:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 21 and data pool 22 2023-09-30T23:02:36.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:02:36.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.371+0000 7f8c391ff700 1 Processor -- start 2023-09-30T23:02:36.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.371+0000 7f8c391ff700 1 -- start start 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c391ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c340b1180 0x7f8c340cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c391ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c34159eb0 0x7f8c340cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c391ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3415d910 con 0x7f8c34159ae0 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c391ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3415e920 con 0x7f8c34159eb0 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c391ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3415e490 con 0x7f8c340b1180 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c3359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c34159eb0 0x7f8c340cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c3359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c34159eb0 0x7f8c340cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39000/0 (socket says 172.21.15.142:39000) 2023-09-30T23:02:36.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.372+0000 7f8c3359e700 1 -- 172.21.15.142:0/458949388 learned_addr learned my addr 172.21.15.142:0/458949388 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c3259c700 1 --2- 172.21.15.142:0/458949388 >> v2:172.21.15.148:3300/0 conn(0x7f8c340b1180 0x7f8c340cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c3359e700 1 -- 172.21.15.142:0/458949388 >> v2:172.21.15.148:3300/0 conn(0x7f8c340b1180 msgr2=0x7f8c340cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c3359e700 1 --2- 172.21.15.142:0/458949388 >> v2:172.21.15.148:3300/0 conn(0x7f8c340b1180 0x7f8c340cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c3359e700 1 -- 172.21.15.142:0/458949388 >> v1:172.21.15.148:6789/0 conn(0x7f8c34159ae0 legacy=0x7f8c340cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c3359e700 1 -- 172.21.15.142:0/458949388 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c340ce5c0 con 0x7f8c34159eb0 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c3359e700 1 --2- 172.21.15.142:0/458949388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159eb0 0x7f8c340cc3c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f8c34067af0 tx=0x7f8c2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05c75b9aafaa5cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c31d9b700 1 -- 172.21.15.142:0/458949388 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c00e070 con 0x7f8c34159eb0 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c31d9b700 1 -- 172.21.15.142:0/458949388 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c00ba10 con 0x7f8c34159eb0 2023-09-30T23:02:36.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.373+0000 7f8c31d9b700 1 -- 172.21.15.142:0/458949388 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0092e0 con 0x7f8c34159eb0 2023-09-30T23:02:36.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 -- 172.21.15.142:0/458949388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159eb0 msgr2=0x7f8c340cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 --2- 172.21.15.142:0/458949388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159eb0 0x7f8c340cc3c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f8c34067af0 tx=0x7f8c2c009840 comp rx=0 tx=0).stop 2023-09-30T23:02:36.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 -- 172.21.15.142:0/458949388 shutdown_connections 2023-09-30T23:02:36.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 --2- 172.21.15.142:0/458949388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159eb0 0x7f8c340cc3c0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 --2- 172.21.15.142:0/458949388 >> v2:172.21.15.148:3300/0 conn(0x7f8c340b1180 0x7f8c340cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 -- 172.21.15.142:0/458949388 >> 172.21.15.142:0/458949388 conn(0x7f8c340ce8b0 msgr2=0x7f8c340cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:36.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 -- 172.21.15.142:0/458949388 shutdown_connections 2023-09-30T23:02:36.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.374+0000 7f8c391ff700 1 -- 172.21.15.142:0/458949388 wait complete. 2023-09-30T23:02:36.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.375+0000 7f8c391ff700 1 Processor -- start 2023-09-30T23:02:36.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.376+0000 7f8c391ff700 1 -- start start 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.376+0000 7f8c391ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c340b1180 0x7f8c340c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.376+0000 7f8c391ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159ae0 0x7f8c34158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.376+0000 7f8c391ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c34159eb0 0x7f8c340c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.376+0000 7f8c391ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340c80b0 con 0x7f8c34159ae0 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.376+0000 7f8c391ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340ca6e0 con 0x7f8c340b1180 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.376+0000 7f8c391ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340c82c0 con 0x7f8c34159eb0 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159ae0 0x7f8c34158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159ae0 0x7f8c34158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39004/0 (socket says 172.21.15.142:39004) 2023-09-30T23:02:36.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 -- 172.21.15.142:0/1411586936 learned_addr learned my addr 172.21.15.142:0/1411586936 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3359e700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c34159eb0 0x7f8c340c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c32d9d700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c340b1180 0x7f8c340c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 -- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c34159eb0 msgr2=0x7f8c340c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c34159eb0 0x7f8c340c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 -- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c340b1180 msgr2=0x7f8c340c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c340b1180 0x7f8c340c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 -- 172.21.15.142:0/1411586936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c009ae0 con 0x7f8c34159ae0 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.377+0000 7f8c3259c700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159ae0 0x7f8c34158b60 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800d890 tx=0x7f8c28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.378+0000 7f8c1affd700 1 -- 172.21.15.142:0/1411586936 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280125f0 con 0x7f8c34159ae0 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.378+0000 7f8c1affd700 1 -- 172.21.15.142:0/1411586936 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28012750 con 0x7f8c34159ae0 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.378+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c340c85a0 con 0x7f8c34159ae0 2023-09-30T23:02:36.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.378+0000 7f8c1affd700 1 -- 172.21.15.142:0/1411586936 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28012af0 con 0x7f8c34159ae0 2023-09-30T23:02:36.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.378+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c340c8b60 con 0x7f8c34159ae0 2023-09-30T23:02:36.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.379+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c34068230 con 0x7f8c34159ae0 2023-09-30T23:02:36.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.380+0000 7f8c1affd700 1 -- 172.21.15.142:0/1411586936 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8c2801e460 con 0x7f8c34159ae0 2023-09-30T23:02:36.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.381+0000 7f8c1affd700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c20067330 0x7f8c200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.381+0000 7f8c1affd700 1 -- 172.21.15.142:0/1411586936 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c280851a0 con 0x7f8c34159ae0 2023-09-30T23:02:36.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.382+0000 7f8c32d9d700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c20067330 0x7f8c200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.382+0000 7f8c32d9d700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c20067330 0x7f8c200697e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c24003a30 tx=0x7f8c24007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:36.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.386+0000 7f8c1affd700 1 -- 172.21.15.142:0/1411586936 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8c28055a90 con 0x7f8c34159ae0 2023-09-30T23:02:36.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.578+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c3406eb00 con 0x7f8c34159ae0 2023-09-30T23:02:36.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.579+0000 7f8c1affd700 1 -- 172.21.15.142:0/1411586936 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17039 (secure 0 0 0) 0x7f8c28055620 con 0x7f8c34159ae0 2023-09-30T23:02:36.578 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:36.579 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":174,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:02:35.608878+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:02:33.854527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-09-30T23:02:34.591957+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:02:36.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c20067330 msgr2=0x7f8c200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c20067330 0x7f8c200697e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c24003a30 tx=0x7f8c24007ea0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159ae0 msgr2=0x7f8c34158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159ae0 0x7f8c34158b60 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800d890 tx=0x7f8c28008040 comp rx=0 tx=0).stop 2023-09-30T23:02:36.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 shutdown_connections 2023-09-30T23:02:36.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8c20067330 0x7f8c200697e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c34159eb0 0x7f8c340c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c340b1180 0x7f8c340c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 --2- 172.21.15.142:0/1411586936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c34159ae0 0x7f8c34158b60 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 >> 172.21.15.142:0/1411586936 conn(0x7f8c340ce8b0 msgr2=0x7f8c34069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:36.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 shutdown_connections 2023-09-30T23:02:36.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.581+0000 7f8c391ff700 1 -- 172.21.15.142:0/1411586936 wait complete. 2023-09-30T23:02:36.598 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:02:36.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.795+0000 7fe4625ff700 1 Processor -- start 2023-09-30T23:02:36.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.795+0000 7fe4625ff700 1 -- start start 2023-09-30T23:02:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.796+0000 7fe4625ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe45c0b00d0 0x7fe45c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.796+0000 7fe4625ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c06d3e0 con 0x7fe45c0af020 2023-09-30T23:02:36.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.796+0000 7fe4625ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c06dc80 con 0x7fe45c06e650 2023-09-30T23:02:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.796+0000 7fe4625ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c06b790 con 0x7fe45c0b00d0 2023-09-30T23:02:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe45c0b00d0 0x7fe45c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe45c0af020 0x7fe45c156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58976/0 (socket says 172.21.15.142:58976) 2023-09-30T23:02:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe45c0b00d0 0x7fe45c06e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39012/0 (socket says 172.21.15.142:39012) 2023-09-30T23:02:36.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45bfff700 1 -- 172.21.15.142:0/577473600 learned_addr learned my addr 172.21.15.142:0/577473600 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:36.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45b7fe700 1 -- 172.21.15.142:0/577473600 >> v1:172.21.15.148:6789/0 conn(0x7fe45c06e650 legacy=0x7fe45c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45b7fe700 1 -- 172.21.15.142:0/577473600 >> v1:172.21.15.142:6789/0 conn(0x7fe45c0af020 legacy=0x7fe45c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45b7fe700 1 -- 172.21.15.142:0/577473600 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0b0650 con 0x7fe45c0b00d0 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45affd700 1 -- 172.21.15.142:0/577473600 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187050518 0 0) 0x7fe45c06d3e0 con 0x7fe45c0af020 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45b7fe700 1 --2- 172.21.15.142:0/577473600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0b00d0 0x7fe45c06e110 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe450009910 tx=0x7fe4500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118a2b8c4639cfc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.797+0000 7fe45affd700 1 -- 172.21.15.142:0/577473600 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000b7e0 con 0x7fe45c0b00d0 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe45affd700 1 -- 172.21.15.142:0/577473600 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000b940 con 0x7fe45c0b00d0 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe45affd700 1 -- 172.21.15.142:0/577473600 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000bce0 con 0x7fe45c0b00d0 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe4625ff700 1 -- 172.21.15.142:0/577473600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0b00d0 msgr2=0x7fe45c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe4625ff700 1 --2- 172.21.15.142:0/577473600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0b00d0 0x7fe45c06e110 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe450009910 tx=0x7fe4500091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe4625ff700 1 -- 172.21.15.142:0/577473600 shutdown_connections 2023-09-30T23:02:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe4625ff700 1 --2- 172.21.15.142:0/577473600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0b00d0 0x7fe45c06e110 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe4625ff700 1 -- 172.21.15.142:0/577473600 >> 172.21.15.142:0/577473600 conn(0x7fe45c0680c0 msgr2=0x7fe45c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe4625ff700 1 -- 172.21.15.142:0/577473600 shutdown_connections 2023-09-30T23:02:36.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.798+0000 7fe4625ff700 1 -- 172.21.15.142:0/577473600 wait complete. 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.800+0000 7fe4625ff700 1 Processor -- start 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.800+0000 7fe4625ff700 1 -- start start 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe4625ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe45c06e650 0x7fe45c14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe4625ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0af020 0x7fe45c1688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe4625ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45c0b00d0 0x7fe45c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe4625ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c15bfa0 con 0x7fe45c0af020 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe4625ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c15c280 con 0x7fe45c06e650 2023-09-30T23:02:36.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe4625ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c14eb70 con 0x7fe45c0b00d0 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0af020 0x7fe45c1688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0af020 0x7fe45c1688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39016/0 (socket says 172.21.15.142:39016) 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 -- 172.21.15.142:0/114877076 learned_addr learned my addr 172.21.15.142:0/114877076 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45bfff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe45c06e650 0x7fe45c14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe460b9c700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45c0b00d0 0x7fe45c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 -- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45c0b00d0 msgr2=0x7fe45c159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45c0b00d0 0x7fe45c159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 -- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe45c06e650 msgr2=0x7fe45c14e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe45c06e650 0x7fe45c14e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45b7fe700 1 -- 172.21.15.142:0/114877076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450009420 con 0x7fe45c0af020 2023-09-30T23:02:36.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.801+0000 7fe45bfff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe45c06e650 0x7fe45c14e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.802+0000 7fe45b7fe700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0af020 0x7fe45c1688a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe45c068600 tx=0x7fe450016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.802+0000 7fe443fff700 1 -- 172.21.15.142:0/114877076 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450011ea0 con 0x7fe45c0af020 2023-09-30T23:02:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.802+0000 7fe443fff700 1 -- 172.21.15.142:0/114877076 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe450020070 con 0x7fe45c0af020 2023-09-30T23:02:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.802+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c169180 con 0x7fe45c0af020 2023-09-30T23:02:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.802+0000 7fe443fff700 1 -- 172.21.15.142:0/114877076 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45001b680 con 0x7fe45c0af020 2023-09-30T23:02:36.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.802+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c169740 con 0x7fe45c0af020 2023-09-30T23:02:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.803+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c15c430 con 0x7fe45c0af020 2023-09-30T23:02:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.804+0000 7fe443fff700 1 -- 172.21.15.142:0/114877076 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe450022030 con 0x7fe45c0af020 2023-09-30T23:02:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.805+0000 7fe443fff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe448067330 0x7fe4480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.805+0000 7fe443fff700 1 -- 172.21.15.142:0/114877076 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe450086c00 con 0x7fe45c0af020 2023-09-30T23:02:36.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.806+0000 7fe45bfff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe448067330 0x7fe4480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:36.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.806+0000 7fe45bfff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe448067330 0x7fe4480697e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0011e0 tx=0x7fe44c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:36.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:36.810+0000 7fe443fff700 1 -- 172.21.15.142:0/114877076 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe45c15c430 con 0x7fe45c0af020 2023-09-30T23:02:37.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.002+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe45c15c430 con 0x7fe45c0af020 2023-09-30T23:02:37.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.003+0000 7fe443fff700 1 -- 172.21.15.142:0/114877076 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17039 (secure 0 0 0) 0x7fe45c15c430 con 0x7fe45c0af020 2023-09-30T23:02:37.003 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:37.004 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":174,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:02:35.608878+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:02:33.854527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-09-30T23:02:34.591957+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:02:37.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe448067330 msgr2=0x7fe4480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:37.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe448067330 0x7fe4480697e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0011e0 tx=0x7fe44c009040 comp rx=0 tx=0).stop 2023-09-30T23:02:37.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0af020 msgr2=0x7fe45c1688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:37.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0af020 0x7fe45c1688a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe45c068600 tx=0x7fe450016000 comp rx=0 tx=0).stop 2023-09-30T23:02:37.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 shutdown_connections 2023-09-30T23:02:37.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe448067330 0x7fe4480697e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45c0b00d0 0x7fe45c159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe45c06e650 0x7fe45c14e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 --2- 172.21.15.142:0/114877076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c0af020 0x7fe45c1688a0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 >> 172.21.15.142:0/114877076 conn(0x7fe45c0680c0 msgr2=0x7fe45c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:37.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 shutdown_connections 2023-09-30T23:02:37.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.006+0000 7fe4625ff700 1 -- 172.21.15.142:0/114877076 wait complete. 2023-09-30T23:02:37.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T23:02:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.223+0000 7fa63e5ff700 1 Processor -- start 2023-09-30T23:02:37.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.223+0000 7fa63e5ff700 1 -- start start 2023-09-30T23:02:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.224+0000 7fa63e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa638159ba0 0x7fa63806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.224+0000 7fa63e5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6380ca5e0 0x7fa6380681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.224+0000 7fa63e5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa638067d10 con 0x7fa6380b0de0 2023-09-30T23:02:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.224+0000 7fa63e5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63806af90 con 0x7fa6380ca5e0 2023-09-30T23:02:37.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.224+0000 7fa63e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380676c0 con 0x7fa638159ba0 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa63cb9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6380ca5e0 0x7fa6380681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa63cb9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6380ca5e0 0x7fa6380681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:46252/0 (socket says 172.21.15.142:46252) 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa63cb9c700 1 -- 172.21.15.142:0/3931834698 learned_addr learned my addr 172.21.15.142:0/3931834698 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa6377fe700 1 --1- 172.21.15.142:0/3931834698 >> v1:172.21.15.148:6789/0 conn(0x7fa6380b0de0 0x7fa6380c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:48286/0 (socket says 172.21.15.142:48286) 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa637fff700 1 --2- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa638159ba0 0x7fa63806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa63cb9c700 1 -- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa638159ba0 msgr2=0x7fa63806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa63cb9c700 1 --2- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa638159ba0 0x7fa63806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa63cb9c700 1 -- 172.21.15.142:0/3931834698 >> v1:172.21.15.148:6789/0 conn(0x7fa6380b0de0 legacy=0x7fa6380c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.225+0000 7fa63cb9c700 1 -- 172.21.15.142:0/3931834698 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6380679a0 con 0x7fa6380ca5e0 2023-09-30T23:02:37.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.226+0000 7fa63cb9c700 1 --2- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6380ca5e0 0x7fa6380681a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa630009f20 tx=0x7fa630009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e034696621196199 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.226+0000 7fa636ffd700 1 -- 172.21.15.142:0/3931834698 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000e070 con 0x7fa6380ca5e0 2023-09-30T23:02:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.226+0000 7fa636ffd700 1 -- 172.21.15.142:0/3931834698 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63000b9d0 con 0x7fa6380ca5e0 2023-09-30T23:02:37.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.226+0000 7fa636ffd700 1 -- 172.21.15.142:0/3931834698 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6300092e0 con 0x7fa6380ca5e0 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6380ca5e0 msgr2=0x7fa6380681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6380ca5e0 0x7fa6380681a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa630009f20 tx=0x7fa630009840 comp rx=0 tx=0).stop 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3931834698 shutdown_connections 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6380ca5e0 0x7fa6380681a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3931834698 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa638159ba0 0x7fa63806a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3931834698 >> 172.21.15.142:0/3931834698 conn(0x7fa6380cb2f0 msgr2=0x7fa6380cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3931834698 shutdown_connections 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.227+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3931834698 wait complete. 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.228+0000 7fa63e5ff700 1 Processor -- start 2023-09-30T23:02:37.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.228+0000 7fa63e5ff700 1 -- start start 2023-09-30T23:02:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.229+0000 7fa63e5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6380b0de0 0x7fa63816d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.229+0000 7fa63e5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380ca5e0 0x7fa6380c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.229+0000 7fa63e5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638159ba0 0x7fa638149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:37.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.229+0000 7fa63e5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380c59d0 con 0x7fa6380ca5e0 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.229+0000 7fa63e5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63816e2e0 con 0x7fa638159ba0 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.229+0000 7fa63e5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63816e5c0 con 0x7fa6380b0de0 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.229+0000 7fa6377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380ca5e0 0x7fa6380c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa6377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380ca5e0 0x7fa6380c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39020/0 (socket says 172.21.15.142:39020) 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa6377fe700 1 -- 172.21.15.142:0/3817108972 learned_addr learned my addr 172.21.15.142:0/3817108972 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa63cb9c700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638159ba0 0x7fa638149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa637fff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6380b0de0 0x7fa63816d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:37.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa63cb9c700 1 -- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6380b0de0 msgr2=0x7fa63816d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa63cb9c700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6380b0de0 0x7fa63816d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa63cb9c700 1 -- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380ca5e0 msgr2=0x7fa6380c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa63cb9c700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380ca5e0 0x7fa6380c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa63cb9c700 1 -- 172.21.15.142:0/3817108972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa630009ae0 con 0x7fa638159ba0 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa6377fe700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380ca5e0 0x7fa6380c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.230+0000 7fa63cb9c700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638159ba0 0x7fa638149850 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa630015000 tx=0x7fa630018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.231+0000 7fa61ffff700 1 -- 172.21.15.142:0/3817108972 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630008ad0 con 0x7fa638159ba0 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.231+0000 7fa61ffff700 1 -- 172.21.15.142:0/3817108972 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630008c30 con 0x7fa638159ba0 2023-09-30T23:02:37.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.231+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6380c5c70 con 0x7fa638159ba0 2023-09-30T23:02:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.231+0000 7fa61ffff700 1 -- 172.21.15.142:0/3817108972 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630026460 con 0x7fa638159ba0 2023-09-30T23:02:37.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.231+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63816def0 con 0x7fa638159ba0 2023-09-30T23:02:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.232+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6380c5eb0 con 0x7fa638159ba0 2023-09-30T23:02:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.233+0000 7fa61ffff700 1 -- 172.21.15.142:0/3817108972 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa630003040 con 0x7fa638159ba0 2023-09-30T23:02:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.234+0000 7fa61ffff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa624067330 0x7fa6240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.234+0000 7fa61ffff700 1 -- 172.21.15.142:0/3817108972 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa6300870e0 con 0x7fa638159ba0 2023-09-30T23:02:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.234+0000 7fa637fff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa624067330 0x7fa6240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:37.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.234+0000 7fa637fff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa624067330 0x7fa6240697e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa628009d10 tx=0x7fa6280091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:37.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.237+0000 7fa61ffff700 1 -- 172.21.15.142:0/3817108972 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa630053fc0 con 0x7fa638159ba0 2023-09-30T23:02:37.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:37.472+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa6380cac40 con 0x7fa638159ba0 2023-09-30T23:02:38.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.166+0000 7fa61ffff700 1 -- 172.21.15.142:0/3817108972 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa6300575e0 con 0x7fa638159ba0 2023-09-30T23:02:38.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.168+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa624067330 msgr2=0x7fa6240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa624067330 0x7fa6240697e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa628009d10 tx=0x7fa6280091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638159ba0 msgr2=0x7fa638149850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638159ba0 0x7fa638149850 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa630015000 tx=0x7fa630018000 comp rx=0 tx=0).stop 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 shutdown_connections 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa624067330 0x7fa6240697e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638159ba0 0x7fa638149850 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa6380b0de0 0x7fa63816d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 --2- 172.21.15.142:0/3817108972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380ca5e0 0x7fa6380c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 >> 172.21.15.142:0/3817108972 conn(0x7fa6380cb2f0 msgr2=0x7fa638158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:38.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 shutdown_connections 2023-09-30T23:02:38.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.169+0000 7fa63e5ff700 1 -- 172.21.15.142:0/3817108972 wait complete. 2023-09-30T23:02:38.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T23:02:38.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.386+0000 7febf5dff700 1 Processor -- start 2023-09-30T23:02:38.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.386+0000 7febf5dff700 1 -- start start 2023-09-30T23:02:38.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.387+0000 7febf5dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 0x7febf0150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:38.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febf5dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7febf0156710 0x7febf0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:38.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febf5dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7febf00ca240 0x7febf00ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febf5dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf00cc320 con 0x7febf00ca240 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febf5dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf01576e0 con 0x7febf0156710 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febf5dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf015a490 con 0x7febf015a920 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7febf00ca240 0x7febf00ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7febf00ca240 0x7febf00ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39034/0 (socket says 172.21.15.142:39034) 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 -- 172.21.15.142:0/2618548589 learned_addr learned my addr 172.21.15.142:0/2618548589 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febef7fe700 1 --2- 172.21.15.142:0/2618548589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 0x7febf0150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeeffd700 1 --2- 172.21.15.142:0/2618548589 >> v2:172.21.15.148:3300/0 conn(0x7febf0156710 0x7febf0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 -- 172.21.15.142:0/2618548589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 msgr2=0x7febf0150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 --2- 172.21.15.142:0/2618548589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 0x7febf0150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 -- 172.21.15.142:0/2618548589 >> v2:172.21.15.148:3300/0 conn(0x7febf0156710 msgr2=0x7febf0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:38.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 --2- 172.21.15.142:0/2618548589 >> v2:172.21.15.148:3300/0 conn(0x7febf0156710 0x7febf0156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.388+0000 7febeffff700 1 -- 172.21.15.142:0/2618548589 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0157400 con 0x7febf00ca240 2023-09-30T23:02:38.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febeffff700 1 --2- 172.21.15.142:0/2618548589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf00ca660 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7febf006c0f0 tx=0x7febe8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecc340145a7318c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:38.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febee7fc700 1 -- 172.21.15.142:0/2618548589 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800e070 con 0x7febf00ca240 2023-09-30T23:02:38.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febee7fc700 1 -- 172.21.15.142:0/2618548589 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800ba20 con 0x7febf00ca240 2023-09-30T23:02:38.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febee7fc700 1 -- 172.21.15.142:0/2618548589 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80092e0 con 0x7febf00ca240 2023-09-30T23:02:38.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 -- 172.21.15.142:0/2618548589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 msgr2=0x7febf00ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:38.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 --2- 172.21.15.142:0/2618548589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf00ca660 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7febf006c0f0 tx=0x7febe8009840 comp rx=0 tx=0).stop 2023-09-30T23:02:38.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 -- 172.21.15.142:0/2618548589 shutdown_connections 2023-09-30T23:02:38.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 --2- 172.21.15.142:0/2618548589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf00ca660 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 --2- 172.21.15.142:0/2618548589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 0x7febf0150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 --2- 172.21.15.142:0/2618548589 >> v2:172.21.15.148:3300/0 conn(0x7febf0156710 0x7febf0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 -- 172.21.15.142:0/2618548589 >> 172.21.15.142:0/2618548589 conn(0x7febf00cc670 msgr2=0x7febf00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:38.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.389+0000 7febf5dff700 1 -- 172.21.15.142:0/2618548589 shutdown_connections 2023-09-30T23:02:38.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.390+0000 7febf5dff700 1 -- 172.21.15.142:0/2618548589 wait complete. 2023-09-30T23:02:38.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.391+0000 7febf5dff700 1 Processor -- start 2023-09-30T23:02:38.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.391+0000 7febf5dff700 1 -- start start 2023-09-30T23:02:38.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febf5dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf014b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:38.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febf5dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febf0156710 0x7febf016a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:38.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febf5dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 0x7febf01379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:38.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febf5dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf014c7e0 con 0x7febf00ca240 2023-09-30T23:02:38.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febf5dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf014cac0 con 0x7febf0156710 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febf5dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf016aa90 con 0x7febf015a920 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febef7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf014b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febef7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf014b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39042/0 (socket says 172.21.15.142:39042) 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.392+0000 7febef7fe700 1 -- 172.21.15.142:0/16919336 learned_addr learned my addr 172.21.15.142:0/16919336 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febef7fe700 1 -- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 msgr2=0x7febf01379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febef7fe700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 0x7febf01379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febef7fe700 1 -- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febf0156710 msgr2=0x7febf016a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febeeffd700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febf0156710 0x7febf016a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febef7fe700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febf0156710 0x7febf016a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febef7fe700 1 -- 172.21.15.142:0/16919336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8009ae0 con 0x7febf00ca240 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febeeffd700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febf0156710 0x7febf016a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febef7fe700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf014b430 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7febe000e930 tx=0x7febe00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febd77fe700 1 -- 172.21.15.142:0/16919336 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000eed0 con 0x7febf00ca240 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febd77fe700 1 -- 172.21.15.142:0/16919336 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000c850 con 0x7febf00ca240 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf016ad30 con 0x7febf00ca240 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febd77fe700 1 -- 172.21.15.142:0/16919336 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000cbf0 con 0x7febf00ca240 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.393+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf016b2f0 con 0x7febf00ca240 2023-09-30T23:02:38.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.394+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf0069a50 con 0x7febf00ca240 2023-09-30T23:02:38.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.395+0000 7febd77fe700 1 -- 172.21.15.142:0/16919336 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7febe0013470 con 0x7febf00ca240 2023-09-30T23:02:38.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.396+0000 7febd77fe700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7febdc067330 0x7febdc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:38.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.396+0000 7febd77fe700 1 -- 172.21.15.142:0/16919336 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febe0084e30 con 0x7febf00ca240 2023-09-30T23:02:38.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.396+0000 7febeeffd700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7febdc067330 0x7febdc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:38.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.397+0000 7febeeffd700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7febdc067330 0x7febdc0697e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7febf00c1860 tx=0x7febe4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:38.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.400+0000 7febd77fe700 1 -- 172.21.15.142:0/16919336 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7febe0051c90 con 0x7febf00ca240 2023-09-30T23:02:38.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:38.635+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7febf00cb160 con 0x7febf00ca240 2023-09-30T23:02:39.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.172+0000 7febd77fe700 1 -- 172.21.15.142:0/16919336 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) v1 ==== 122+0+0 (secure 0 0 0) 0x7febe00552b0 con 0x7febf00ca240 2023-09-30T23:02:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7febdc067330 msgr2=0x7febdc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7febdc067330 0x7febdc0697e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7febf00c1860 tx=0x7febe4008040 comp rx=0 tx=0).stop 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 msgr2=0x7febf014b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf014b430 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7febe000e930 tx=0x7febe00091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 shutdown_connections 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7febdc067330 0x7febdc0697e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7febf015a920 0x7febf01379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febf00ca240 0x7febf014b430 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 --2- 172.21.15.142:0/16919336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febf0156710 0x7febf016a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 >> 172.21.15.142:0/16919336 conn(0x7febf00cc670 msgr2=0x7febf0155df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 shutdown_connections 2023-09-30T23:02:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.175+0000 7febf5dff700 1 -- 172.21.15.142:0/16919336 wait complete. 2023-09-30T23:02:39.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:39.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.802+0000 7fcb4adff700 1 Processor -- start 2023-09-30T23:02:39.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.802+0000 7fcb4adff700 1 -- start start 2023-09-30T23:02:39.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.803+0000 7fcb4adff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb441578c0 0x7fcb4406a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:39.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.803+0000 7fcb4adff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcb440b0e80 0x7fcb440ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:39.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.803+0000 7fcb4adff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb440cc4e0 con 0x7fcb4406ae60 2023-09-30T23:02:39.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.803+0000 7fcb4adff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb440cc7c0 con 0x7fcb441578c0 2023-09-30T23:02:39.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.803+0000 7fcb4adff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4406b300 con 0x7fcb440b0e80 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.803+0000 7fcb48b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb441578c0 0x7fcb4406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb48b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb441578c0 0x7fcb4406a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39052/0 (socket says 172.21.15.142:39052) 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb48b9b700 1 -- 172.21.15.142:0/3411396756 learned_addr learned my addr 172.21.15.142:0/3411396756 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb4939c700 1 --2- 172.21.15.142:0/3411396756 >> v2:172.21.15.148:3300/0 conn(0x7fcb440b0e80 0x7fcb440ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb48b9b700 1 -- 172.21.15.142:0/3411396756 >> v2:172.21.15.148:3300/0 conn(0x7fcb440b0e80 msgr2=0x7fcb440ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb48b9b700 1 --2- 172.21.15.142:0/3411396756 >> v2:172.21.15.148:3300/0 conn(0x7fcb440b0e80 0x7fcb440ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb48b9b700 1 -- 172.21.15.142:0/3411396756 >> v1:172.21.15.148:6789/0 conn(0x7fcb4406ae60 legacy=0x7fcb440b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:39.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb48b9b700 1 -- 172.21.15.142:0/3411396756 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4406b5e0 con 0x7fcb441578c0 2023-09-30T23:02:39.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb48b9b700 1 --2- 172.21.15.142:0/3411396756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4406a920 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fcb440cbc10 tx=0x7fcb38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52e4f5a7201fce1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:39.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb437fe700 1 -- 172.21.15.142:0/3411396756 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38009e70 con 0x7fcb441578c0 2023-09-30T23:02:39.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb437fe700 1 -- 172.21.15.142:0/3411396756 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3800b860 con 0x7fcb441578c0 2023-09-30T23:02:39.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.804+0000 7fcb437fe700 1 -- 172.21.15.142:0/3411396756 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3800bc00 con 0x7fcb441578c0 2023-09-30T23:02:39.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 -- 172.21.15.142:0/3411396756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 msgr2=0x7fcb4406a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 --2- 172.21.15.142:0/3411396756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4406a920 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fcb440cbc10 tx=0x7fcb38009250 comp rx=0 tx=0).stop 2023-09-30T23:02:40.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 -- 172.21.15.142:0/3411396756 shutdown_connections 2023-09-30T23:02:40.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 --2- 172.21.15.142:0/3411396756 >> v2:172.21.15.148:3300/0 conn(0x7fcb440b0e80 0x7fcb440ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 --2- 172.21.15.142:0/3411396756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4406a920 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 -- 172.21.15.142:0/3411396756 >> 172.21.15.142:0/3411396756 conn(0x7fcb440ce8b0 msgr2=0x7fcb440cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 -- 172.21.15.142:0/3411396756 shutdown_connections 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.805+0000 7fcb4adff700 1 -- 172.21.15.142:0/3411396756 wait complete. 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.807+0000 7fcb4adff700 1 Processor -- start 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.807+0000 7fcb4adff700 1 -- start start 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.808+0000 7fcb4adff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb4406ae60 0x7fcb4414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.808+0000 7fcb4adff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb440b0e80 0x7fcb441543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4adff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4413ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4adff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4414f850 con 0x7fcb441578c0 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4adff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4414e410 con 0x7fcb4406ae60 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4adff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4414e6f0 con 0x7fcb440b0e80 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4413ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4413ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39054/0 (socket says 172.21.15.142:39054) 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 -- 172.21.15.142:0/1852818822 learned_addr learned my addr 172.21.15.142:0/1852818822 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb48b9b700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb4406ae60 0x7fcb4414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb43fff700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb440b0e80 0x7fcb441543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 -- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb440b0e80 msgr2=0x7fcb441543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb440b0e80 0x7fcb441543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 -- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb4406ae60 msgr2=0x7fcb4414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb4406ae60 0x7fcb4414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 -- 172.21.15.142:0/1852818822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380094f0 con 0x7fcb441578c0 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.809+0000 7fcb4939c700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4413ef60 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009ec0 tx=0x7fcb3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.810+0000 7fcb40ff9700 1 -- 172.21.15.142:0/1852818822 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00cc20 con 0x7fcb441578c0 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.810+0000 7fcb40ff9700 1 -- 172.21.15.142:0/1852818822 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00f040 con 0x7fcb441578c0 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.810+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4414e9d0 con 0x7fcb441578c0 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.810+0000 7fcb40ff9700 1 -- 172.21.15.142:0/1852818822 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c014480 con 0x7fcb441578c0 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.810+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4414e070 con 0x7fcb441578c0 2023-09-30T23:02:40.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.811+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4414ec10 con 0x7fcb441578c0 2023-09-30T23:02:40.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.812+0000 7fcb40ff9700 1 -- 172.21.15.142:0/1852818822 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcb3c014810 con 0x7fcb441578c0 2023-09-30T23:02:40.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.813+0000 7fcb40ff9700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb28067330 0x7fcb280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.813+0000 7fcb40ff9700 1 -- 172.21.15.142:0/1852818822 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb3c085930 con 0x7fcb441578c0 2023-09-30T23:02:40.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.813+0000 7fcb48b9b700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb28067330 0x7fcb280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.813+0000 7fcb48b9b700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb28067330 0x7fcb280697e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcb440cbc10 tx=0x7fcb38017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:39.817+0000 7fcb40ff9700 1 -- 172.21.15.142:0/1852818822 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcb4414ec10 con 0x7fcb441578c0 2023-09-30T23:02:40.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.049+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb4414f620 con 0x7fcb441578c0 2023-09-30T23:02:40.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.049+0000 7fcb40ff9700 1 -- 172.21.15.142:0/1852818822 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4613 (secure 0 0 0) 0x7fcb4414f620 con 0x7fcb441578c0 2023-09-30T23:02:40.090 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:40.090 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:02:35.609202+0000","modified":"2023-09-30T23:02:39.164928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3571686386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3571686386},{"type":"v1","addr":"172.21.15.142:6837","nonce":3571686386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-09-30T23:02:40.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb28067330 msgr2=0x7fcb280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb28067330 0x7fcb280697e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcb440cbc10 tx=0x7fcb38017000 comp rx=0 tx=0).stop 2023-09-30T23:02:40.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 msgr2=0x7fcb4413ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4413ef60 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009ec0 tx=0x7fcb3c00b040 comp rx=0 tx=0).stop 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 shutdown_connections 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcb28067330 0x7fcb280697e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb441578c0 0x7fcb4413ef60 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb4406ae60 0x7fcb4414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 --2- 172.21.15.142:0/1852818822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcb440b0e80 0x7fcb441543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 >> 172.21.15.142:0/1852818822 conn(0x7fcb440ce8b0 msgr2=0x7fcb44155590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 shutdown_connections 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.052+0000 7fcb4adff700 1 -- 172.21.15.142:0/1852818822 wait complete. 2023-09-30T23:02:40.092 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 83 2023-09-30T23:02:40.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:02:40.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.283+0000 7f29f25ff700 1 Processor -- start 2023-09-30T23:02:40.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.283+0000 7f29f25ff700 1 -- start start 2023-09-30T23:02:40.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.284+0000 7f29f25ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.284+0000 7f29f25ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29ec0692f0 0x7f29ec15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.284+0000 7f29f25ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec15e0b0 con 0x7f29ec15dc50 2023-09-30T23:02:40.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.284+0000 7f29f25ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0cc6b0 con 0x7f29ec0692f0 2023-09-30T23:02:40.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.284+0000 7f29f25ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0cb7d0 con 0x7f29ec143350 2023-09-30T23:02:40.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29eb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29ec0692f0 0x7f29ec15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29f0b9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f29ec15dc50 0x7f29ec068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58980/0 (socket says 172.21.15.142:58980) 2023-09-30T23:02:40.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29f0b9c700 1 -- 172.21.15.142:0/1299340923 learned_addr learned my addr 172.21.15.142:0/1299340923 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:40.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29eb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29ec0692f0 0x7f29ec15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39070/0 (socket says 172.21.15.142:39070) 2023-09-30T23:02:40.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29ebfff700 1 --2- 172.21.15.142:0/1299340923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29eb7fe700 1 -- 172.21.15.142:0/1299340923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 msgr2=0x7f29ec0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29eb7fe700 1 --2- 172.21.15.142:0/1299340923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29eb7fe700 1 -- 172.21.15.142:0/1299340923 >> v1:172.21.15.142:6789/0 conn(0x7f29ec15dc50 legacy=0x7f29ec068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29eb7fe700 1 -- 172.21.15.142:0/1299340923 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0cbaa0 con 0x7f29ec0692f0 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.285+0000 7f29eb7fe700 1 --2- 172.21.15.142:0/1299340923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec0692f0 0x7f29ec15d710 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f29e00098e0 tx=0x7f29e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81332db1892f59e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29eaffd700 1 -- 172.21.15.142:0/1299340923 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0009e80 con 0x7f29ec0692f0 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29eaffd700 1 -- 172.21.15.142:0/1299340923 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e000b860 con 0x7f29ec0692f0 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29eaffd700 1 -- 172.21.15.142:0/1299340923 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e000bbe0 con 0x7f29ec0692f0 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 -- 172.21.15.142:0/1299340923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec0692f0 msgr2=0x7f29ec15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 --2- 172.21.15.142:0/1299340923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec0692f0 0x7f29ec15d710 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f29e00098e0 tx=0x7f29e00091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 -- 172.21.15.142:0/1299340923 shutdown_connections 2023-09-30T23:02:40.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 --2- 172.21.15.142:0/1299340923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 --2- 172.21.15.142:0/1299340923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec0692f0 0x7f29ec15d710 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 -- 172.21.15.142:0/1299340923 >> 172.21.15.142:0/1299340923 conn(0x7f29ec0ce8e0 msgr2=0x7f29ec0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:40.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 -- 172.21.15.142:0/1299340923 shutdown_connections 2023-09-30T23:02:40.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.286+0000 7f29f25ff700 1 -- 172.21.15.142:0/1299340923 wait complete. 2023-09-30T23:02:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.288+0000 7f29f25ff700 1 Processor -- start 2023-09-30T23:02:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.288+0000 7f29f25ff700 1 -- start start 2023-09-30T23:02:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.289+0000 7f29f25ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29ec0692f0 0x7f29ec0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.289+0000 7f29f25ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec16b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.289+0000 7f29f25ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec15dc50 0x7f29ec0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.289+0000 7f29f25ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec15c000 con 0x7f29ec15dc50 2023-09-30T23:02:40.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.289+0000 7f29f25ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0a54b0 con 0x7f29ec0692f0 2023-09-30T23:02:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.289+0000 7f29f25ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec16b600 con 0x7f29ec143350 2023-09-30T23:02:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.289+0000 7f29f0b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec15dc50 0x7f29ec0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29ebfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29ec0692f0 0x7f29ec0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec16b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec15dc50 0x7f29ec0cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39082/0 (socket says 172.21.15.142:39082) 2023-09-30T23:02:40.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 -- 172.21.15.142:0/2485416396 learned_addr learned my addr 172.21.15.142:0/2485416396 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:40.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 -- 172.21.15.142:0/2485416396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 msgr2=0x7f29ec16b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec16b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 -- 172.21.15.142:0/2485416396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29ec0692f0 msgr2=0x7f29ec0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29ec0692f0 0x7f29ec0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 -- 172.21.15.142:0/2485416396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0009420 con 0x7f29ec15dc50 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29ebfff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29ec0692f0 0x7f29ec0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29f0b9c700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec15dc50 0x7f29ec0cdcd0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f29e400cbc0 tx=0x7f29e40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29d3fff700 1 -- 172.21.15.142:0/2485416396 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400a7e0 con 0x7f29ec15dc50 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29d3fff700 1 -- 172.21.15.142:0/2485416396 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400a940 con 0x7f29ec15dc50 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.290+0000 7f29d3fff700 1 -- 172.21.15.142:0/2485416396 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400acc0 con 0x7f29ec15dc50 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.291+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec15a770 con 0x7f29ec15dc50 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.291+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec15ad30 con 0x7f29ec15dc50 2023-09-30T23:02:40.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.292+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec0a5660 con 0x7f29ec15dc50 2023-09-30T23:02:40.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.292+0000 7f29d3fff700 1 -- 172.21.15.142:0/2485416396 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f29e4007300 con 0x7f29ec15dc50 2023-09-30T23:02:40.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.293+0000 7f29d3fff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29d8067330 0x7f29d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.293+0000 7f29d3fff700 1 -- 172.21.15.142:0/2485416396 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f29e4084d80 con 0x7f29ec15dc50 2023-09-30T23:02:40.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.294+0000 7f29ebfff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29d8067330 0x7f29d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.294+0000 7f29ebfff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29d8067330 0x7f29d80697e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006fd0 tx=0x7f29dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.298+0000 7f29d3fff700 1 -- 172.21.15.142:0/2485416396 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f29ec0a5660 con 0x7f29ec15dc50 2023-09-30T23:02:40.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.490+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29ec15e0b0 con 0x7f29ec15dc50 2023-09-30T23:02:40.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.491+0000 7f29d3fff700 1 -- 172.21.15.142:0/2485416396 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f29ec15e0b0 con 0x7f29ec15dc50 2023-09-30T23:02:40.491 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:40.492 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":175,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:02:37.133343+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:02:33.854527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-09-30T23:02:34.591957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:02:40.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.493+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29d8067330 msgr2=0x7f29d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.493+0000 7f29f25ff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29d8067330 0x7f29d80697e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006fd0 tx=0x7f29dc008040 comp rx=0 tx=0).stop 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.493+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec15dc50 msgr2=0x7f29ec0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.493+0000 7f29f25ff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec15dc50 0x7f29ec0cdcd0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f29e400cbc0 tx=0x7f29e40019c0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 shutdown_connections 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29d8067330 0x7f29d80697e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29ec15dc50 0x7f29ec0cdcd0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29ec0692f0 0x7f29ec0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 --2- 172.21.15.142:0/2485416396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29ec143350 0x7f29ec16b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 >> 172.21.15.142:0/2485416396 conn(0x7f29ec0ce8e0 msgr2=0x7f29ec069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 shutdown_connections 2023-09-30T23:02:40.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.494+0000 7f29f25ff700 1 -- 172.21.15.142:0/2485416396 wait complete. 2023-09-30T23:02:40.511 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T23:02:40.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:02:40.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.701+0000 7f9356dff700 1 Processor -- start 2023-09-30T23:02:40.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.701+0000 7f9356dff700 1 -- start start 2023-09-30T23:02:40.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.702+0000 7f9356dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f93500b1950 0x7f935015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.702+0000 7f9356dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f935015a6c0 0x7f935006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.702+0000 7f9356dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93500ad630 con 0x7f93500b1580 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.702+0000 7f9356dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935015ab60 con 0x7f935015a6c0 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.702+0000 7f9356dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9350157c20 con 0x7f93500b1950 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.702+0000 7f935539c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f935015a6c0 0x7f935006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f9354b9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f93500b1580 0x7f93500adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:58992/0 (socket says 172.21.15.142:58992) 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f935539c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f935015a6c0 0x7f935006a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39094/0 (socket says 172.21.15.142:39094) 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f9354b9b700 1 -- 172.21.15.142:0/3800259069 learned_addr learned my addr 172.21.15.142:0/3800259069 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f934ffff700 1 --2- 172.21.15.142:0/3800259069 >> v2:172.21.15.148:3300/0 conn(0x7f93500b1950 0x7f935015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f935539c700 1 -- 172.21.15.142:0/3800259069 >> v2:172.21.15.148:3300/0 conn(0x7f93500b1950 msgr2=0x7f935015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f935539c700 1 --2- 172.21.15.142:0/3800259069 >> v2:172.21.15.148:3300/0 conn(0x7f93500b1950 0x7f935015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f935539c700 1 -- 172.21.15.142:0/3800259069 >> v1:172.21.15.142:6789/0 conn(0x7f93500b1580 legacy=0x7f93500adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f935539c700 1 -- 172.21.15.142:0/3800259069 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500b3360 con 0x7f935015a6c0 2023-09-30T23:02:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f934f7fe700 1 -- 172.21.15.142:0/3800259069 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434642533 0 0) 0x7f93500ad630 con 0x7f93500b1580 2023-09-30T23:02:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.703+0000 7f935539c700 1 --2- 172.21.15.142:0/3800259069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f935015a6c0 0x7f935006a7a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f935006e0b0 tx=0x7f9348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50915c35ac356134 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f934f7fe700 1 -- 172.21.15.142:0/3800259069 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800e070 con 0x7f935015a6c0 2023-09-30T23:02:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f934f7fe700 1 -- 172.21.15.142:0/3800259069 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800bb20 con 0x7f935015a6c0 2023-09-30T23:02:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f934f7fe700 1 -- 172.21.15.142:0/3800259069 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348012430 con 0x7f935015a6c0 2023-09-30T23:02:40.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 -- 172.21.15.142:0/3800259069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f935015a6c0 msgr2=0x7f935006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 --2- 172.21.15.142:0/3800259069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f935015a6c0 0x7f935006a7a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f935006e0b0 tx=0x7f9348009780 comp rx=0 tx=0).stop 2023-09-30T23:02:40.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 -- 172.21.15.142:0/3800259069 shutdown_connections 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 --2- 172.21.15.142:0/3800259069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f935015a6c0 0x7f935006a7a0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 --2- 172.21.15.142:0/3800259069 >> v2:172.21.15.148:3300/0 conn(0x7f93500b1950 0x7f935015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 -- 172.21.15.142:0/3800259069 >> 172.21.15.142:0/3800259069 conn(0x7f93500ce1f0 msgr2=0x7f9350069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 -- 172.21.15.142:0/3800259069 shutdown_connections 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.704+0000 7f9356dff700 1 -- 172.21.15.142:0/3800259069 wait complete. 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.706+0000 7f9356dff700 1 Processor -- start 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.706+0000 7f9356dff700 1 -- start start 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9356dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93500b1580 0x7f9350150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9356dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93500b1950 0x7f9350169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9356dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f935015a6c0 0x7f935015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9356dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500a9c90 con 0x7f93500b1950 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9356dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500a9960 con 0x7f93500b1580 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9356dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93501505d0 con 0x7f935015a6c0 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93500b1950 0x7f9350169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93500b1950 0x7f9350169d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39100/0 (socket says 172.21.15.142:39100) 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 -- 172.21.15.142:0/2505376521 learned_addr learned my addr 172.21.15.142:0/2505376521 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9354b9b700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93500b1580 0x7f9350150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f935539c700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f935015a6c0 0x7f935015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 -- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f935015a6c0 msgr2=0x7f935015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f935015a6c0 0x7f935015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 -- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93500b1580 msgr2=0x7f9350150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93500b1580 0x7f9350150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f934ffff700 1 -- 172.21.15.142:0/2505376521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348009a20 con 0x7f93500b1950 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.707+0000 7f9354b9b700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93500b1580 0x7f9350150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.708+0000 7f934ffff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93500b1950 0x7f9350169d80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f933c00ec80 tx=0x7f933c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.708+0000 7f934cff9700 1 -- 172.21.15.142:0/2505376521 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c00c9d0 con 0x7f93500b1950 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.708+0000 7f934cff9700 1 -- 172.21.15.142:0/2505376521 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c00cb30 con 0x7f93500b1950 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.708+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935016a740 con 0x7f93500b1950 2023-09-30T23:02:40.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.708+0000 7f934cff9700 1 -- 172.21.15.142:0/2505376521 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c013470 con 0x7f93500b1950 2023-09-30T23:02:40.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.708+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935016ad00 con 0x7f93500b1950 2023-09-30T23:02:40.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.709+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93500a9e00 con 0x7f93500b1950 2023-09-30T23:02:40.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.710+0000 7f934cff9700 1 -- 172.21.15.142:0/2505376521 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f933c013820 con 0x7f93500b1950 2023-09-30T23:02:40.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.711+0000 7f934cff9700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9334067330 0x7f93340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:40.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.711+0000 7f934cff9700 1 -- 172.21.15.142:0/2505376521 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f933c084fe0 con 0x7f93500b1950 2023-09-30T23:02:40.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.711+0000 7f9354b9b700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9334067330 0x7f93340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:40.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.712+0000 7f9354b9b700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9334067330 0x7f93340697e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f935015a690 tx=0x7f9344009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:40.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.715+0000 7f934cff9700 1 -- 172.21.15.142:0/2505376521 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f933c051e60 con 0x7f93500b1950 2023-09-30T23:02:40.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.900+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93500ae1d0 con 0x7f9334067330 2023-09-30T23:02:40.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.910+0000 7f934cff9700 1 -- 172.21.15.142:0/2505376521 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303612 (secure 0 0 0) 0x7f93500ae1d0 con 0x7f9334067330 2023-09-30T23:02:40.913 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:40.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9334067330 msgr2=0x7f93340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9334067330 0x7f93340697e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f935015a690 tx=0x7f9344009040 comp rx=0 tx=0).stop 2023-09-30T23:02:40.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93500b1950 msgr2=0x7f9350169d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:40.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93500b1950 0x7f9350169d80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f933c00ec80 tx=0x7f933c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 shutdown_connections 2023-09-30T23:02:40.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9334067330 0x7f93340697e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f935015a6c0 0x7f935015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93500b1580 0x7f9350150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 --2- 172.21.15.142:0/2505376521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93500b1950 0x7f9350169d80 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 >> 172.21.15.142:0/2505376521 conn(0x7f93500ce1f0 msgr2=0x7f93500adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 shutdown_connections 2023-09-30T23:02:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:40.914+0000 7f9356dff700 1 -- 172.21.15.142:0/2505376521 wait complete. 2023-09-30T23:02:40.917 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:02:40.932 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2023-09-30T23:02:40.247202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9267,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553232,"statfs":{"total":1600000000,"available":1590510364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001326"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153776+0000","last_change":"2023-09-30T23:02:36.153708+0000","last_active":"2023-09-30T23:02:36.153776+0000","last_peered":"2023-09-30T23:02:36.153776+0000","last_clean":"2023-09-30T23:02:36.153776+0000","last_became_active":"2023-09-30T23:02:36.153488+0000","last_became_peered":"2023-09-30T23:02:36.153488+0000","last_unstale":"2023-09-30T23:02:36.153776+0000","last_undegraded":"2023-09-30T23:02:36.153776+0000","last_fullsized":"2023-09-30T23:02:36.153776+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:06:25.757207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145847+0000","last_change":"2023-09-30T23:02:36.145847+0000","last_active":"2023-09-30T23:02:36.145847+0000","last_peered":"2023-09-30T23:02:36.145847+0000","last_clean":"2023-09-30T23:02:36.145847+0000","last_became_active":"2023-09-30T23:02:36.145602+0000","last_became_peered":"2023-09-30T23:02:36.145602+0000","last_unstale":"2023-09-30T23:02:36.145847+0000","last_undegraded":"2023-09-30T23:02:36.145847+0000","last_fullsized":"2023-09-30T23:02:36.145847+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:03:40.605545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148380+0000","last_change":"2023-09-30T23:02:36.148288+0000","last_active":"2023-09-30T23:02:36.148380+0000","last_peered":"2023-09-30T23:02:36.148380+0000","last_clean":"2023-09-30T23:02:36.148380+0000","last_became_active":"2023-09-30T23:02:36.148043+0000","last_became_peered":"2023-09-30T23:02:36.148043+0000","last_unstale":"2023-09-30T23:02:36.148380+0000","last_undegraded":"2023-09-30T23:02:36.148380+0000","last_fullsized":"2023-09-30T23:02:36.148380+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:57.404238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146897+0000","last_change":"2023-09-30T23:02:36.146897+0000","last_active":"2023-09-30T23:02:36.146897+0000","last_peered":"2023-09-30T23:02:36.146897+0000","last_clean":"2023-09-30T23:02:36.146897+0000","last_became_active":"2023-09-30T23:02:36.146658+0000","last_became_peered":"2023-09-30T23:02:36.146658+0000","last_unstale":"2023-09-30T23:02:36.146897+0000","last_undegraded":"2023-09-30T23:02:36.146897+0000","last_fullsized":"2023-09-30T23:02:36.146897+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:24.468576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151062+0000","last_change":"2023-09-30T23:02:36.151062+0000","last_active":"2023-09-30T23:02:36.151062+0000","last_peered":"2023-09-30T23:02:36.151062+0000","last_clean":"2023-09-30T23:02:36.151062+0000","last_became_active":"2023-09-30T23:02:36.150817+0000","last_became_peered":"2023-09-30T23:02:36.150817+0000","last_unstale":"2023-09-30T23:02:36.151062+0000","last_undegraded":"2023-09-30T23:02:36.151062+0000","last_fullsized":"2023-09-30T23:02:36.151062+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:47:23.042726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145655+0000","last_change":"2023-09-30T23:02:36.145576+0000","last_active":"2023-09-30T23:02:36.145655+0000","last_peered":"2023-09-30T23:02:36.145655+0000","last_clean":"2023-09-30T23:02:36.145655+0000","last_became_active":"2023-09-30T23:02:36.145368+0000","last_became_peered":"2023-09-30T23:02:36.145368+0000","last_unstale":"2023-09-30T23:02:36.145655+0000","last_undegraded":"2023-09-30T23:02:36.145655+0000","last_fullsized":"2023-09-30T23:02:36.145655+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:09.470757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151075+0000","last_change":"2023-09-30T23:02:36.150941+0000","last_active":"2023-09-30T23:02:36.151075+0000","last_peered":"2023-09-30T23:02:36.151075+0000","last_clean":"2023-09-30T23:02:36.151075+0000","last_became_active":"2023-09-30T23:02:36.150571+0000","last_became_peered":"2023-09-30T23:02:36.150571+0000","last_unstale":"2023-09-30T23:02:36.151075+0000","last_undegraded":"2023-09-30T23:02:36.151075+0000","last_fullsized":"2023-09-30T23:02:36.151075+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:09.470757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144102+0000","last_change":"2023-09-30T23:02:36.144102+0000","last_active":"2023-09-30T23:02:36.144102+0000","last_peered":"2023-09-30T23:02:36.144102+0000","last_clean":"2023-09-30T23:02:36.144102+0000","last_became_active":"2023-09-30T23:02:36.143804+0000","last_became_peered":"2023-09-30T23:02:36.143804+0000","last_unstale":"2023-09-30T23:02:36.144102+0000","last_undegraded":"2023-09-30T23:02:36.144102+0000","last_fullsized":"2023-09-30T23:02:36.144102+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:38:05.090968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145847+0000","last_change":"2023-09-30T23:02:36.145847+0000","last_active":"2023-09-30T23:02:36.145847+0000","last_peered":"2023-09-30T23:02:36.145847+0000","last_clean":"2023-09-30T23:02:36.145847+0000","last_became_active":"2023-09-30T23:02:36.145595+0000","last_became_peered":"2023-09-30T23:02:36.145595+0000","last_unstale":"2023-09-30T23:02:36.145847+0000","last_undegraded":"2023-09-30T23:02:36.145847+0000","last_fullsized":"2023-09-30T23:02:36.145847+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:09.974737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.139664+0000","last_change":"2023-09-30T23:02:36.139334+0000","last_active":"2023-09-30T23:02:36.139664+0000","last_peered":"2023-09-30T23:02:36.139664+0000","last_clean":"2023-09-30T23:02:36.139664+0000","last_became_active":"2023-09-30T23:02:36.138730+0000","last_became_peered":"2023-09-30T23:02:36.138730+0000","last_unstale":"2023-09-30T23:02:36.139664+0000","last_undegraded":"2023-09-30T23:02:36.139664+0000","last_fullsized":"2023-09-30T23:02:36.139664+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:44:03.614966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150937+0000","last_change":"2023-09-30T23:02:36.150937+0000","last_active":"2023-09-30T23:02:36.150937+0000","last_peered":"2023-09-30T23:02:36.150937+0000","last_clean":"2023-09-30T23:02:36.150937+0000","last_became_active":"2023-09-30T23:02:36.150644+0000","last_became_peered":"2023-09-30T23:02:36.150644+0000","last_unstale":"2023-09-30T23:02:36.150937+0000","last_undegraded":"2023-09-30T23:02:36.150937+0000","last_fullsized":"2023-09-30T23:02:36.150937+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:47:23.042726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153981+0000","last_change":"2023-09-30T23:02:36.153981+0000","last_active":"2023-09-30T23:02:36.153981+0000","last_peered":"2023-09-30T23:02:36.153981+0000","last_clean":"2023-09-30T23:02:36.153981+0000","last_became_active":"2023-09-30T23:02:36.153777+0000","last_became_peered":"2023-09-30T23:02:36.153777+0000","last_unstale":"2023-09-30T23:02:36.153981+0000","last_undegraded":"2023-09-30T23:02:36.153981+0000","last_fullsized":"2023-09-30T23:02:36.153981+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:54.130677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150230+0000","last_change":"2023-09-30T23:02:36.150230+0000","last_active":"2023-09-30T23:02:36.150230+0000","last_peered":"2023-09-30T23:02:36.150230+0000","last_clean":"2023-09-30T23:02:36.150230+0000","last_became_active":"2023-09-30T23:02:36.149553+0000","last_became_peered":"2023-09-30T23:02:36.149553+0000","last_unstale":"2023-09-30T23:02:36.150230+0000","last_undegraded":"2023-09-30T23:02:36.150230+0000","last_fullsized":"2023-09-30T23:02:36.150230+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:09:26.410286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150689+0000","last_change":"2023-09-30T23:02:36.150689+0000","last_active":"2023-09-30T23:02:36.150689+0000","last_peered":"2023-09-30T23:02:36.150689+0000","last_clean":"2023-09-30T23:02:36.150689+0000","last_became_active":"2023-09-30T23:02:36.150345+0000","last_became_peered":"2023-09-30T23:02:36.150345+0000","last_unstale":"2023-09-30T23:02:36.150689+0000","last_undegraded":"2023-09-30T23:02:36.150689+0000","last_fullsized":"2023-09-30T23:02:36.150689+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:58.838057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146747+0000","last_change":"2023-09-30T23:02:36.146747+0000","last_active":"2023-09-30T23:02:36.146747+0000","last_peered":"2023-09-30T23:02:36.146747+0000","last_clean":"2023-09-30T23:02:36.146747+0000","last_became_active":"2023-09-30T23:02:36.146525+0000","last_became_peered":"2023-09-30T23:02:36.146525+0000","last_unstale":"2023-09-30T23:02:36.146747+0000","last_undegraded":"2023-09-30T23:02:36.146747+0000","last_fullsized":"2023-09-30T23:02:36.146747+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:08.277234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146348+0000","last_change":"2023-09-30T23:02:36.146348+0000","last_active":"2023-09-30T23:02:36.146348+0000","last_peered":"2023-09-30T23:02:36.146348+0000","last_clean":"2023-09-30T23:02:36.146348+0000","last_became_active":"2023-09-30T23:02:36.145807+0000","last_became_peered":"2023-09-30T23:02:36.145807+0000","last_unstale":"2023-09-30T23:02:36.146348+0000","last_undegraded":"2023-09-30T23:02:36.146348+0000","last_fullsized":"2023-09-30T23:02:36.146348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T11:00:57.522008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153559+0000","last_change":"2023-09-30T23:02:36.153559+0000","last_active":"2023-09-30T23:02:36.153559+0000","last_peered":"2023-09-30T23:02:36.153559+0000","last_clean":"2023-09-30T23:02:36.153559+0000","last_became_active":"2023-09-30T23:02:36.153108+0000","last_became_peered":"2023-09-30T23:02:36.153108+0000","last_unstale":"2023-09-30T23:02:36.153559+0000","last_undegraded":"2023-09-30T23:02:36.153559+0000","last_fullsized":"2023-09-30T23:02:36.153559+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:53.317584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150372+0000","last_change":"2023-09-30T23:02:36.150372+0000","last_active":"2023-09-30T23:02:36.150372+0000","last_peered":"2023-09-30T23:02:36.150372+0000","last_clean":"2023-09-30T23:02:36.150372+0000","last_became_active":"2023-09-30T23:02:36.149963+0000","last_became_peered":"2023-09-30T23:02:36.149963+0000","last_unstale":"2023-09-30T23:02:36.150372+0000","last_undegraded":"2023-09-30T23:02:36.150372+0000","last_fullsized":"2023-09-30T23:02:36.150372+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:44:42.426565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.156265+0000","last_change":"2023-09-30T23:02:36.154193+0000","last_active":"2023-09-30T23:02:36.156265+0000","last_peered":"2023-09-30T23:02:36.156265+0000","last_clean":"2023-09-30T23:02:36.156265+0000","last_became_active":"2023-09-30T23:02:36.153394+0000","last_became_peered":"2023-09-30T23:02:36.153394+0000","last_unstale":"2023-09-30T23:02:36.156265+0000","last_undegraded":"2023-09-30T23:02:36.156265+0000","last_fullsized":"2023-09-30T23:02:36.156265+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:56.285242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144409+0000","last_change":"2023-09-30T23:02:36.144409+0000","last_active":"2023-09-30T23:02:36.144409+0000","last_peered":"2023-09-30T23:02:36.144409+0000","last_clean":"2023-09-30T23:02:36.144409+0000","last_became_active":"2023-09-30T23:02:36.143871+0000","last_became_peered":"2023-09-30T23:02:36.143871+0000","last_unstale":"2023-09-30T23:02:36.144409+0000","last_undegraded":"2023-09-30T23:02:36.144409+0000","last_fullsized":"2023-09-30T23:02:36.144409+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:12:45.373890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.147631+0000","last_change":"2023-09-30T23:02:36.147631+0000","last_active":"2023-09-30T23:02:36.147631+0000","last_peered":"2023-09-30T23:02:36.147631+0000","last_clean":"2023-09-30T23:02:36.147631+0000","last_became_active":"2023-09-30T23:02:36.147414+0000","last_became_peered":"2023-09-30T23:02:36.147414+0000","last_unstale":"2023-09-30T23:02:36.147631+0000","last_undegraded":"2023-09-30T23:02:36.147631+0000","last_fullsized":"2023-09-30T23:02:36.147631+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:48.095757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153279+0000","last_change":"2023-09-30T23:02:36.153178+0000","last_active":"2023-09-30T23:02:36.153279+0000","last_peered":"2023-09-30T23:02:36.153279+0000","last_clean":"2023-09-30T23:02:36.153279+0000","last_became_active":"2023-09-30T23:02:36.152964+0000","last_became_peered":"2023-09-30T23:02:36.152964+0000","last_unstale":"2023-09-30T23:02:36.153279+0000","last_undegraded":"2023-09-30T23:02:36.153279+0000","last_fullsized":"2023-09-30T23:02:36.153279+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:47:10.658640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153348+0000","last_change":"2023-09-30T23:02:36.153348+0000","last_active":"2023-09-30T23:02:36.153348+0000","last_peered":"2023-09-30T23:02:36.153348+0000","last_clean":"2023-09-30T23:02:36.153348+0000","last_became_active":"2023-09-30T23:02:36.152826+0000","last_became_peered":"2023-09-30T23:02:36.152826+0000","last_unstale":"2023-09-30T23:02:36.153348+0000","last_undegraded":"2023-09-30T23:02:36.153348+0000","last_fullsized":"2023-09-30T23:02:36.153348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:49:32.145505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.142473+0000","last_change":"2023-09-30T23:02:36.141732+0000","last_active":"2023-09-30T23:02:36.142473+0000","last_peered":"2023-09-30T23:02:36.142473+0000","last_clean":"2023-09-30T23:02:36.142473+0000","last_became_active":"2023-09-30T23:02:36.141506+0000","last_became_peered":"2023-09-30T23:02:36.141506+0000","last_unstale":"2023-09-30T23:02:36.142473+0000","last_undegraded":"2023-09-30T23:02:36.142473+0000","last_fullsized":"2023-09-30T23:02:36.142473+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:51.748488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151597+0000","last_change":"2023-09-30T23:02:36.151527+0000","last_active":"2023-09-30T23:02:36.151597+0000","last_peered":"2023-09-30T23:02:36.151597+0000","last_clean":"2023-09-30T23:02:36.151597+0000","last_became_active":"2023-09-30T23:02:36.151274+0000","last_became_peered":"2023-09-30T23:02:36.151274+0000","last_unstale":"2023-09-30T23:02:36.151597+0000","last_undegraded":"2023-09-30T23:02:36.151597+0000","last_fullsized":"2023-09-30T23:02:36.151597+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:32.569005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148544+0000","last_change":"2023-09-30T23:02:36.148544+0000","last_active":"2023-09-30T23:02:36.148544+0000","last_peered":"2023-09-30T23:02:36.148544+0000","last_clean":"2023-09-30T23:02:36.148544+0000","last_became_active":"2023-09-30T23:02:36.148311+0000","last_became_peered":"2023-09-30T23:02:36.148311+0000","last_unstale":"2023-09-30T23:02:36.148544+0000","last_undegraded":"2023-09-30T23:02:36.148544+0000","last_fullsized":"2023-09-30T23:02:36.148544+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:06:13.351627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.138822+0000","last_change":"2023-09-30T23:02:36.138571+0000","last_active":"2023-09-30T23:02:36.138822+0000","last_peered":"2023-09-30T23:02:36.138822+0000","last_clean":"2023-09-30T23:02:36.138822+0000","last_became_active":"2023-09-30T23:02:36.138331+0000","last_became_peered":"2023-09-30T23:02:36.138331+0000","last_unstale":"2023-09-30T23:02:36.138822+0000","last_undegraded":"2023-09-30T23:02:36.138822+0000","last_fullsized":"2023-09-30T23:02:36.138822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:24.468576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145654+0000","last_change":"2023-09-30T23:02:36.145654+0000","last_active":"2023-09-30T23:02:36.145654+0000","last_peered":"2023-09-30T23:02:36.145654+0000","last_clean":"2023-09-30T23:02:36.145654+0000","last_became_active":"2023-09-30T23:02:36.145352+0000","last_became_peered":"2023-09-30T23:02:36.145352+0000","last_unstale":"2023-09-30T23:02:36.145654+0000","last_undegraded":"2023-09-30T23:02:36.145654+0000","last_fullsized":"2023-09-30T23:02:36.145654+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:06:13.351627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.139854+0000","last_change":"2023-09-30T23:02:36.139854+0000","last_active":"2023-09-30T23:02:36.139854+0000","last_peered":"2023-09-30T23:02:36.139854+0000","last_clean":"2023-09-30T23:02:36.139854+0000","last_became_active":"2023-09-30T23:02:36.139565+0000","last_became_peered":"2023-09-30T23:02:36.139565+0000","last_unstale":"2023-09-30T23:02:36.139854+0000","last_undegraded":"2023-09-30T23:02:36.139854+0000","last_fullsized":"2023-09-30T23:02:36.139854+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:53:59.615825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.139681+0000","last_change":"2023-09-30T23:02:36.139599+0000","last_active":"2023-09-30T23:02:36.139681+0000","last_peered":"2023-09-30T23:02:36.139681+0000","last_clean":"2023-09-30T23:02:36.139681+0000","last_became_active":"2023-09-30T23:02:36.139071+0000","last_became_peered":"2023-09-30T23:02:36.139071+0000","last_unstale":"2023-09-30T23:02:36.139681+0000","last_undegraded":"2023-09-30T23:02:36.139681+0000","last_fullsized":"2023-09-30T23:02:36.139681+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:49:32.145505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145586+0000","last_change":"2023-09-30T23:02:36.145586+0000","last_active":"2023-09-30T23:02:36.145586+0000","last_peered":"2023-09-30T23:02:36.145586+0000","last_clean":"2023-09-30T23:02:36.145586+0000","last_became_active":"2023-09-30T23:02:36.144840+0000","last_became_peered":"2023-09-30T23:02:36.144840+0000","last_unstale":"2023-09-30T23:02:36.145586+0000","last_undegraded":"2023-09-30T23:02:36.145586+0000","last_fullsized":"2023-09-30T23:02:36.145586+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:39.801728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151166+0000","last_change":"2023-09-30T23:02:36.151166+0000","last_active":"2023-09-30T23:02:36.151166+0000","last_peered":"2023-09-30T23:02:36.151166+0000","last_clean":"2023-09-30T23:02:36.151166+0000","last_became_active":"2023-09-30T23:02:36.150936+0000","last_became_peered":"2023-09-30T23:02:36.150936+0000","last_unstale":"2023-09-30T23:02:36.151166+0000","last_undegraded":"2023-09-30T23:02:36.151166+0000","last_fullsized":"2023-09-30T23:02:36.151166+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:05.454017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146209+0000","last_change":"2023-09-30T23:02:36.146209+0000","last_active":"2023-09-30T23:02:36.146209+0000","last_peered":"2023-09-30T23:02:36.146209+0000","last_clean":"2023-09-30T23:02:36.146209+0000","last_became_active":"2023-09-30T23:02:36.145368+0000","last_became_peered":"2023-09-30T23:02:36.145368+0000","last_unstale":"2023-09-30T23:02:36.146209+0000","last_undegraded":"2023-09-30T23:02:36.146209+0000","last_fullsized":"2023-09-30T23:02:36.146209+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:58:08.891202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"174'4","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.159270+0000","last_change":"2023-09-30T23:02:35.149470+0000","last_active":"2023-09-30T23:02:36.159270+0000","last_peered":"2023-09-30T23:02:36.159270+0000","last_clean":"2023-09-30T23:02:36.159270+0000","last_became_active":"2023-09-30T23:02:35.148463+0000","last_became_peered":"2023-09-30T23:02:35.148463+0000","last_unstale":"2023-09-30T23:02:36.159270+0000","last_undegraded":"2023-09-30T23:02:36.159270+0000","last_fullsized":"2023-09-30T23:02:36.159270+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:27:57.561233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146843+0000","last_change":"2023-09-30T23:02:36.146843+0000","last_active":"2023-09-30T23:02:36.146843+0000","last_peered":"2023-09-30T23:02:36.146843+0000","last_clean":"2023-09-30T23:02:36.146843+0000","last_became_active":"2023-09-30T23:02:36.146625+0000","last_became_peered":"2023-09-30T23:02:36.146625+0000","last_unstale":"2023-09-30T23:02:36.146843+0000","last_undegraded":"2023-09-30T23:02:36.146843+0000","last_fullsized":"2023-09-30T23:02:36.146843+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:39.801728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.137051+0000","last_change":"2023-09-30T23:02:35.145445+0000","last_active":"2023-09-30T23:02:36.137051+0000","last_peered":"2023-09-30T23:02:36.137051+0000","last_clean":"2023-09-30T23:02:36.137051+0000","last_became_active":"2023-09-30T23:02:35.145230+0000","last_became_peered":"2023-09-30T23:02:35.145230+0000","last_unstale":"2023-09-30T23:02:36.137051+0000","last_undegraded":"2023-09-30T23:02:36.137051+0000","last_fullsized":"2023-09-30T23:02:36.137051+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:03:39.598647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.152250+0000","last_change":"2023-09-30T23:02:36.152250+0000","last_active":"2023-09-30T23:02:36.152250+0000","last_peered":"2023-09-30T23:02:36.152250+0000","last_clean":"2023-09-30T23:02:36.152250+0000","last_became_active":"2023-09-30T23:02:36.152010+0000","last_became_peered":"2023-09-30T23:02:36.152010+0000","last_unstale":"2023-09-30T23:02:36.152250+0000","last_undegraded":"2023-09-30T23:02:36.152250+0000","last_fullsized":"2023-09-30T23:02:36.152250+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:42:19.178874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1d","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.161084+0000","last_change":"2023-09-30T23:02:35.144882+0000","last_active":"2023-09-30T23:02:36.161084+0000","last_peered":"2023-09-30T23:02:36.161084+0000","last_clean":"2023-09-30T23:02:36.161084+0000","last_became_active":"2023-09-30T23:02:35.144627+0000","last_became_peered":"2023-09-30T23:02:35.144627+0000","last_unstale":"2023-09-30T23:02:36.161084+0000","last_undegraded":"2023-09-30T23:02:36.161084+0000","last_fullsized":"2023-09-30T23:02:36.161084+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:08:02.645462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145476+0000","last_change":"2023-09-30T23:02:36.145476+0000","last_active":"2023-09-30T23:02:36.145476+0000","last_peered":"2023-09-30T23:02:36.145476+0000","last_clean":"2023-09-30T23:02:36.145476+0000","last_became_active":"2023-09-30T23:02:36.145209+0000","last_became_peered":"2023-09-30T23:02:36.145209+0000","last_unstale":"2023-09-30T23:02:36.145476+0000","last_undegraded":"2023-09-30T23:02:36.145476+0000","last_fullsized":"2023-09-30T23:02:36.145476+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:13:11.552780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.158868+0000","last_change":"2023-09-30T23:02:35.137503+0000","last_active":"2023-09-30T23:02:36.158868+0000","last_peered":"2023-09-30T23:02:36.158868+0000","last_clean":"2023-09-30T23:02:36.158868+0000","last_became_active":"2023-09-30T23:02:35.136979+0000","last_became_peered":"2023-09-30T23:02:35.136979+0000","last_unstale":"2023-09-30T23:02:36.158868+0000","last_undegraded":"2023-09-30T23:02:36.158868+0000","last_fullsized":"2023-09-30T23:02:36.158868+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:44:41.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144549+0000","last_change":"2023-09-30T23:02:36.144549+0000","last_active":"2023-09-30T23:02:36.144549+0000","last_peered":"2023-09-30T23:02:36.144549+0000","last_clean":"2023-09-30T23:02:36.144549+0000","last_became_active":"2023-09-30T23:02:36.144197+0000","last_became_peered":"2023-09-30T23:02:36.144197+0000","last_unstale":"2023-09-30T23:02:36.144549+0000","last_undegraded":"2023-09-30T23:02:36.144549+0000","last_fullsized":"2023-09-30T23:02:36.144549+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:09:26.410286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1b","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.142475+0000","last_change":"2023-09-30T23:02:35.145771+0000","last_active":"2023-09-30T23:02:36.142475+0000","last_peered":"2023-09-30T23:02:36.142475+0000","last_clean":"2023-09-30T23:02:36.142475+0000","last_became_active":"2023-09-30T23:02:35.145092+0000","last_became_peered":"2023-09-30T23:02:35.145092+0000","last_unstale":"2023-09-30T23:02:36.142475+0000","last_undegraded":"2023-09-30T23:02:36.142475+0000","last_fullsized":"2023-09-30T23:02:36.142475+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:51:07.060366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.147439+0000","last_change":"2023-09-30T23:02:36.147439+0000","last_active":"2023-09-30T23:02:36.147439+0000","last_peered":"2023-09-30T23:02:36.147439+0000","last_clean":"2023-09-30T23:02:36.147439+0000","last_became_active":"2023-09-30T23:02:36.147231+0000","last_became_peered":"2023-09-30T23:02:36.147231+0000","last_unstale":"2023-09-30T23:02:36.147439+0000","last_undegraded":"2023-09-30T23:02:36.147439+0000","last_fullsized":"2023-09-30T23:02:36.147439+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:09.835622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140551+0000","last_change":"2023-09-30T23:02:35.143787+0000","last_active":"2023-09-30T23:02:36.140551+0000","last_peered":"2023-09-30T23:02:36.140551+0000","last_clean":"2023-09-30T23:02:36.140551+0000","last_became_active":"2023-09-30T23:02:35.143546+0000","last_became_peered":"2023-09-30T23:02:35.143546+0000","last_unstale":"2023-09-30T23:02:36.140551+0000","last_undegraded":"2023-09-30T23:02:36.140551+0000","last_fullsized":"2023-09-30T23:02:36.140551+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:53.123779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145639+0000","last_change":"2023-09-30T23:02:36.145426+0000","last_active":"2023-09-30T23:02:36.145639+0000","last_peered":"2023-09-30T23:02:36.145639+0000","last_clean":"2023-09-30T23:02:36.145639+0000","last_became_active":"2023-09-30T23:02:36.145179+0000","last_became_peered":"2023-09-30T23:02:36.145179+0000","last_unstale":"2023-09-30T23:02:36.145639+0000","last_undegraded":"2023-09-30T23:02:36.145639+0000","last_fullsized":"2023-09-30T23:02:36.145639+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:45:28.707651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.147742+0000","last_change":"2023-09-30T23:02:35.146407+0000","last_active":"2023-09-30T23:02:35.147742+0000","last_peered":"2023-09-30T23:02:35.147742+0000","last_clean":"2023-09-30T23:02:35.147742+0000","last_became_active":"2023-09-30T23:02:35.143539+0000","last_became_peered":"2023-09-30T23:02:35.143539+0000","last_unstale":"2023-09-30T23:02:35.147742+0000","last_undegraded":"2023-09-30T23:02:35.147742+0000","last_fullsized":"2023-09-30T23:02:35.147742+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:13.312340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.147318+0000","last_change":"2023-09-30T23:02:36.147318+0000","last_active":"2023-09-30T23:02:36.147318+0000","last_peered":"2023-09-30T23:02:36.147318+0000","last_clean":"2023-09-30T23:02:36.147318+0000","last_became_active":"2023-09-30T23:02:36.146634+0000","last_became_peered":"2023-09-30T23:02:36.146634+0000","last_unstale":"2023-09-30T23:02:36.147318+0000","last_undegraded":"2023-09-30T23:02:36.147318+0000","last_fullsized":"2023-09-30T23:02:36.147318+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:51.639858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.144494+0000","last_change":"2023-09-30T23:02:35.144410+0000","last_active":"2023-09-30T23:02:35.144494+0000","last_peered":"2023-09-30T23:02:35.144494+0000","last_clean":"2023-09-30T23:02:35.144494+0000","last_became_active":"2023-09-30T23:02:35.144045+0000","last_became_peered":"2023-09-30T23:02:35.144045+0000","last_unstale":"2023-09-30T23:02:35.144494+0000","last_undegraded":"2023-09-30T23:02:35.144494+0000","last_fullsized":"2023-09-30T23:02:35.144494+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:40.213645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151009+0000","last_change":"2023-09-30T23:02:36.150799+0000","last_active":"2023-09-30T23:02:36.151009+0000","last_peered":"2023-09-30T23:02:36.151009+0000","last_clean":"2023-09-30T23:02:36.151009+0000","last_became_active":"2023-09-30T23:02:36.150293+0000","last_became_peered":"2023-09-30T23:02:36.150293+0000","last_unstale":"2023-09-30T23:02:36.151009+0000","last_undegraded":"2023-09-30T23:02:36.151009+0000","last_fullsized":"2023-09-30T23:02:36.151009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:45:28.707651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.f","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140126+0000","last_change":"2023-09-30T23:02:35.146183+0000","last_active":"2023-09-30T23:02:36.140126+0000","last_peered":"2023-09-30T23:02:36.140126+0000","last_clean":"2023-09-30T23:02:36.140126+0000","last_became_active":"2023-09-30T23:02:35.145949+0000","last_became_peered":"2023-09-30T23:02:35.145949+0000","last_unstale":"2023-09-30T23:02:36.140126+0000","last_undegraded":"2023-09-30T23:02:36.140126+0000","last_fullsized":"2023-09-30T23:02:36.140126+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:52.310687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151550+0000","last_change":"2023-09-30T23:02:36.151550+0000","last_active":"2023-09-30T23:02:36.151550+0000","last_peered":"2023-09-30T23:02:36.151550+0000","last_clean":"2023-09-30T23:02:36.151550+0000","last_became_active":"2023-09-30T23:02:36.151307+0000","last_became_peered":"2023-09-30T23:02:36.151307+0000","last_unstale":"2023-09-30T23:02:36.151550+0000","last_undegraded":"2023-09-30T23:02:36.151550+0000","last_fullsized":"2023-09-30T23:02:36.151550+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:41:46.641869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.e","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.163179+0000","last_change":"2023-09-30T23:02:35.143095+0000","last_active":"2023-09-30T23:02:36.163179+0000","last_peered":"2023-09-30T23:02:36.163179+0000","last_clean":"2023-09-30T23:02:36.163179+0000","last_became_active":"2023-09-30T23:02:35.142821+0000","last_became_peered":"2023-09-30T23:02:35.142821+0000","last_unstale":"2023-09-30T23:02:36.163179+0000","last_undegraded":"2023-09-30T23:02:36.163179+0000","last_fullsized":"2023-09-30T23:02:36.163179+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:53.250747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.154090+0000","last_change":"2023-09-30T23:02:36.154090+0000","last_active":"2023-09-30T23:02:36.154090+0000","last_peered":"2023-09-30T23:02:36.154090+0000","last_clean":"2023-09-30T23:02:36.154090+0000","last_became_active":"2023-09-30T23:02:36.153831+0000","last_became_peered":"2023-09-30T23:02:36.153831+0000","last_unstale":"2023-09-30T23:02:36.154090+0000","last_undegraded":"2023-09-30T23:02:36.154090+0000","last_fullsized":"2023-09-30T23:02:36.154090+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:41.220543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.d","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.158994+0000","last_change":"2023-09-30T23:02:35.137657+0000","last_active":"2023-09-30T23:02:36.158994+0000","last_peered":"2023-09-30T23:02:36.158994+0000","last_clean":"2023-09-30T23:02:36.158994+0000","last_became_active":"2023-09-30T23:02:35.137281+0000","last_became_peered":"2023-09-30T23:02:35.137281+0000","last_unstale":"2023-09-30T23:02:36.158994+0000","last_undegraded":"2023-09-30T23:02:36.158994+0000","last_fullsized":"2023-09-30T23:02:36.158994+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:03:39.598647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148508+0000","last_change":"2023-09-30T23:02:36.148508+0000","last_active":"2023-09-30T23:02:36.148508+0000","last_peered":"2023-09-30T23:02:36.148508+0000","last_clean":"2023-09-30T23:02:36.148508+0000","last_became_active":"2023-09-30T23:02:36.148144+0000","last_became_peered":"2023-09-30T23:02:36.148144+0000","last_unstale":"2023-09-30T23:02:36.148508+0000","last_undegraded":"2023-09-30T23:02:36.148508+0000","last_fullsized":"2023-09-30T23:02:36.148508+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:51.748488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.144109+0000","last_change":"2023-09-30T23:02:35.144043+0000","last_active":"2023-09-30T23:02:35.144109+0000","last_peered":"2023-09-30T23:02:35.144109+0000","last_clean":"2023-09-30T23:02:35.144109+0000","last_became_active":"2023-09-30T23:02:35.143774+0000","last_became_peered":"2023-09-30T23:02:35.143774+0000","last_unstale":"2023-09-30T23:02:35.144109+0000","last_undegraded":"2023-09-30T23:02:35.144109+0000","last_fullsized":"2023-09-30T23:02:35.144109+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:38.794830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.152172+0000","last_change":"2023-09-30T23:02:36.152104+0000","last_active":"2023-09-30T23:02:36.152172+0000","last_peered":"2023-09-30T23:02:36.152172+0000","last_clean":"2023-09-30T23:02:36.152172+0000","last_became_active":"2023-09-30T23:02:36.151828+0000","last_became_peered":"2023-09-30T23:02:36.151828+0000","last_unstale":"2023-09-30T23:02:36.152172+0000","last_undegraded":"2023-09-30T23:02:36.152172+0000","last_fullsized":"2023-09-30T23:02:36.152172+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:35.593537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.b","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.162758+0000","last_change":"2023-09-30T23:02:35.147443+0000","last_active":"2023-09-30T23:02:36.162758+0000","last_peered":"2023-09-30T23:02:36.162758+0000","last_clean":"2023-09-30T23:02:36.162758+0000","last_became_active":"2023-09-30T23:02:35.146996+0000","last_became_peered":"2023-09-30T23:02:35.146996+0000","last_unstale":"2023-09-30T23:02:36.162758+0000","last_undegraded":"2023-09-30T23:02:36.162758+0000","last_fullsized":"2023-09-30T23:02:36.162758+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:42:18.171977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144403+0000","last_change":"2023-09-30T23:02:36.144322+0000","last_active":"2023-09-30T23:02:36.144403+0000","last_peered":"2023-09-30T23:02:36.144403+0000","last_clean":"2023-09-30T23:02:36.144403+0000","last_became_active":"2023-09-30T23:02:36.144092+0000","last_became_peered":"2023-09-30T23:02:36.144092+0000","last_unstale":"2023-09-30T23:02:36.144403+0000","last_undegraded":"2023-09-30T23:02:36.144403+0000","last_fullsized":"2023-09-30T23:02:36.144403+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:32.569005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.143388+0000","last_change":"2023-09-30T23:02:35.143301+0000","last_active":"2023-09-30T23:02:35.143388+0000","last_peered":"2023-09-30T23:02:35.143388+0000","last_clean":"2023-09-30T23:02:35.143388+0000","last_became_active":"2023-09-30T23:02:35.143085+0000","last_became_peered":"2023-09-30T23:02:35.143085+0000","last_unstale":"2023-09-30T23:02:35.143388+0000","last_undegraded":"2023-09-30T23:02:35.143388+0000","last_fullsized":"2023-09-30T23:02:35.143388+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:05:06.861005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150089+0000","last_change":"2023-09-30T23:02:36.149962+0000","last_active":"2023-09-30T23:02:36.150089+0000","last_peered":"2023-09-30T23:02:36.150089+0000","last_clean":"2023-09-30T23:02:36.150089+0000","last_became_active":"2023-09-30T23:02:36.149712+0000","last_became_peered":"2023-09-30T23:02:36.149712+0000","last_unstale":"2023-09-30T23:02:36.150089+0000","last_undegraded":"2023-09-30T23:02:36.150089+0000","last_fullsized":"2023-09-30T23:02:36.150089+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:31.240931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.147233+0000","last_change":"2023-09-30T23:02:35.147119+0000","last_active":"2023-09-30T23:02:35.147233+0000","last_peered":"2023-09-30T23:02:35.147233+0000","last_clean":"2023-09-30T23:02:35.147233+0000","last_became_active":"2023-09-30T23:02:35.146755+0000","last_became_peered":"2023-09-30T23:02:35.146755+0000","last_unstale":"2023-09-30T23:02:35.147233+0000","last_undegraded":"2023-09-30T23:02:35.147233+0000","last_fullsized":"2023-09-30T23:02:35.147233+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:51:19.966381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153391+0000","last_change":"2023-09-30T23:02:36.153391+0000","last_active":"2023-09-30T23:02:36.153391+0000","last_peered":"2023-09-30T23:02:36.153391+0000","last_clean":"2023-09-30T23:02:36.153391+0000","last_became_active":"2023-09-30T23:02:36.153155+0000","last_became_peered":"2023-09-30T23:02:36.153155+0000","last_unstale":"2023-09-30T23:02:36.153391+0000","last_undegraded":"2023-09-30T23:02:36.153391+0000","last_fullsized":"2023-09-30T23:02:36.153391+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:54.257645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.138542+0000","last_change":"2023-09-30T23:02:35.138397+0000","last_active":"2023-09-30T23:02:35.138542+0000","last_peered":"2023-09-30T23:02:35.138542+0000","last_clean":"2023-09-30T23:02:35.138542+0000","last_became_active":"2023-09-30T23:02:35.138127+0000","last_became_peered":"2023-09-30T23:02:35.138127+0000","last_unstale":"2023-09-30T23:02:35.138542+0000","last_undegraded":"2023-09-30T23:02:35.138542+0000","last_fullsized":"2023-09-30T23:02:35.138542+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:09:51.345340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150437+0000","last_change":"2023-09-30T23:02:36.150437+0000","last_active":"2023-09-30T23:02:36.150437+0000","last_peered":"2023-09-30T23:02:36.150437+0000","last_clean":"2023-09-30T23:02:36.150437+0000","last_became_active":"2023-09-30T23:02:36.150214+0000","last_became_peered":"2023-09-30T23:02:36.150214+0000","last_unstale":"2023-09-30T23:02:36.150437+0000","last_undegraded":"2023-09-30T23:02:36.150437+0000","last_fullsized":"2023-09-30T23:02:36.150437+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:09.974737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.7","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.160967+0000","last_change":"2023-09-30T23:02:35.145637+0000","last_active":"2023-09-30T23:02:36.160967+0000","last_peered":"2023-09-30T23:02:36.160967+0000","last_clean":"2023-09-30T23:02:36.160967+0000","last_became_active":"2023-09-30T23:02:35.144755+0000","last_became_peered":"2023-09-30T23:02:35.144755+0000","last_unstale":"2023-09-30T23:02:36.160967+0000","last_undegraded":"2023-09-30T23:02:36.160967+0000","last_fullsized":"2023-09-30T23:02:36.160967+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:54:48.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.149647+0000","last_change":"2023-09-30T23:02:36.149647+0000","last_active":"2023-09-30T23:02:36.149647+0000","last_peered":"2023-09-30T23:02:36.149647+0000","last_clean":"2023-09-30T23:02:36.149647+0000","last_became_active":"2023-09-30T23:02:36.149420+0000","last_became_peered":"2023-09-30T23:02:36.149420+0000","last_unstale":"2023-09-30T23:02:36.149647+0000","last_undegraded":"2023-09-30T23:02:36.149647+0000","last_fullsized":"2023-09-30T23:02:36.149647+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:04:19.557891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.149433+0000","last_change":"2023-09-30T23:02:35.149190+0000","last_active":"2023-09-30T23:02:35.149433+0000","last_peered":"2023-09-30T23:02:35.149433+0000","last_clean":"2023-09-30T23:02:35.149433+0000","last_became_active":"2023-09-30T23:02:35.148631+0000","last_became_peered":"2023-09-30T23:02:35.148631+0000","last_unstale":"2023-09-30T23:02:35.149433+0000","last_undegraded":"2023-09-30T23:02:35.149433+0000","last_fullsized":"2023-09-30T23:02:35.149433+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:51:06.105657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.156283+0000","last_change":"2023-09-30T23:02:36.154272+0000","last_active":"2023-09-30T23:02:36.156283+0000","last_peered":"2023-09-30T23:02:36.156283+0000","last_clean":"2023-09-30T23:02:36.156283+0000","last_became_active":"2023-09-30T23:02:36.153796+0000","last_became_peered":"2023-09-30T23:02:36.153796+0000","last_unstale":"2023-09-30T23:02:36.156283+0000","last_undegraded":"2023-09-30T23:02:36.156283+0000","last_fullsized":"2023-09-30T23:02:36.156283+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:03:21.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.137176+0000","last_change":"2023-09-30T23:02:35.143825+0000","last_active":"2023-09-30T23:02:36.137176+0000","last_peered":"2023-09-30T23:02:36.137176+0000","last_clean":"2023-09-30T23:02:36.137176+0000","last_became_active":"2023-09-30T23:02:35.143274+0000","last_became_peered":"2023-09-30T23:02:35.143274+0000","last_unstale":"2023-09-30T23:02:36.137176+0000","last_undegraded":"2023-09-30T23:02:36.137176+0000","last_fullsized":"2023-09-30T23:02:36.137176+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:17.050909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146319+0000","last_change":"2023-09-30T23:02:36.146319+0000","last_active":"2023-09-30T23:02:36.146319+0000","last_peered":"2023-09-30T23:02:36.146319+0000","last_clean":"2023-09-30T23:02:36.146319+0000","last_became_active":"2023-09-30T23:02:36.146077+0000","last_became_peered":"2023-09-30T23:02:36.146077+0000","last_unstale":"2023-09-30T23:02:36.146319+0000","last_undegraded":"2023-09-30T23:02:36.146319+0000","last_fullsized":"2023-09-30T23:02:36.146319+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T11:00:57.522008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.137621+0000","last_change":"2023-09-30T23:02:35.145968+0000","last_active":"2023-09-30T23:02:36.137621+0000","last_peered":"2023-09-30T23:02:36.137621+0000","last_clean":"2023-09-30T23:02:36.137621+0000","last_became_active":"2023-09-30T23:02:35.145253+0000","last_became_peered":"2023-09-30T23:02:35.145253+0000","last_unstale":"2023-09-30T23:02:36.137621+0000","last_undegraded":"2023-09-30T23:02:36.137621+0000","last_fullsized":"2023-09-30T23:02:36.137621+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:49.897393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150548+0000","last_change":"2023-09-30T23:02:36.150548+0000","last_active":"2023-09-30T23:02:36.150548+0000","last_peered":"2023-09-30T23:02:36.150548+0000","last_clean":"2023-09-30T23:02:36.150548+0000","last_became_active":"2023-09-30T23:02:36.150095+0000","last_became_peered":"2023-09-30T23:02:36.150095+0000","last_unstale":"2023-09-30T23:02:36.150548+0000","last_undegraded":"2023-09-30T23:02:36.150548+0000","last_fullsized":"2023-09-30T23:02:36.150548+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:42.007686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.148091+0000","last_change":"2023-09-30T23:02:35.148024+0000","last_active":"2023-09-30T23:02:35.148091+0000","last_peered":"2023-09-30T23:02:35.148091+0000","last_clean":"2023-09-30T23:02:35.148091+0000","last_became_active":"2023-09-30T23:02:35.147798+0000","last_became_peered":"2023-09-30T23:02:35.147798+0000","last_unstale":"2023-09-30T23:02:35.148091+0000","last_undegraded":"2023-09-30T23:02:35.148091+0000","last_fullsized":"2023-09-30T23:02:35.148091+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:56:28.459132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150075+0000","last_change":"2023-09-30T23:02:36.150075+0000","last_active":"2023-09-30T23:02:36.150075+0000","last_peered":"2023-09-30T23:02:36.150075+0000","last_clean":"2023-09-30T23:02:36.150075+0000","last_became_active":"2023-09-30T23:02:36.149709+0000","last_became_peered":"2023-09-30T23:02:36.149709+0000","last_unstale":"2023-09-30T23:02:36.150075+0000","last_undegraded":"2023-09-30T23:02:36.150075+0000","last_fullsized":"2023-09-30T23:02:36.150075+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:00.548995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.148256+0000","last_change":"2023-09-30T23:02:35.148178+0000","last_active":"2023-09-30T23:02:35.148256+0000","last_peered":"2023-09-30T23:02:35.148256+0000","last_clean":"2023-09-30T23:02:35.148256+0000","last_became_active":"2023-09-30T23:02:35.147932+0000","last_became_peered":"2023-09-30T23:02:35.147932+0000","last_unstale":"2023-09-30T23:02:35.148256+0000","last_undegraded":"2023-09-30T23:02:35.148256+0000","last_fullsized":"2023-09-30T23:02:35.148256+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:33.696023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148363+0000","last_change":"2023-09-30T23:02:36.148250+0000","last_active":"2023-09-30T23:02:36.148363+0000","last_peered":"2023-09-30T23:02:36.148363+0000","last_clean":"2023-09-30T23:02:36.148363+0000","last_became_active":"2023-09-30T23:02:36.147983+0000","last_became_peered":"2023-09-30T23:02:36.147983+0000","last_unstale":"2023-09-30T23:02:36.148363+0000","last_undegraded":"2023-09-30T23:02:36.148363+0000","last_fullsized":"2023-09-30T23:02:36.148363+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:04:19.557891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148026+0000","last_change":"2023-09-30T23:02:35.146886+0000","last_active":"2023-09-30T23:02:36.148026+0000","last_peered":"2023-09-30T23:02:36.148026+0000","last_clean":"2023-09-30T23:02:36.148026+0000","last_became_active":"2023-09-30T23:02:35.146558+0000","last_became_peered":"2023-09-30T23:02:35.146558+0000","last_unstale":"2023-09-30T23:02:36.148026+0000","last_undegraded":"2023-09-30T23:02:36.148026+0000","last_fullsized":"2023-09-30T23:02:36.148026+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:50.741591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140310+0000","last_change":"2023-09-30T23:02:36.140310+0000","last_active":"2023-09-30T23:02:36.140310+0000","last_peered":"2023-09-30T23:02:36.140310+0000","last_clean":"2023-09-30T23:02:36.140310+0000","last_became_active":"2023-09-30T23:02:36.140094+0000","last_became_peered":"2023-09-30T23:02:36.140094+0000","last_unstale":"2023-09-30T23:02:36.140310+0000","last_undegraded":"2023-09-30T23:02:36.140310+0000","last_fullsized":"2023-09-30T23:02:36.140310+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:11:44.288405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145735+0000","last_change":"2023-09-30T23:02:35.145220+0000","last_active":"2023-09-30T23:02:35.145735+0000","last_peered":"2023-09-30T23:02:35.145735+0000","last_clean":"2023-09-30T23:02:35.145735+0000","last_became_active":"2023-09-30T23:02:35.143255+0000","last_became_peered":"2023-09-30T23:02:35.143255+0000","last_unstale":"2023-09-30T23:02:35.145735+0000","last_undegraded":"2023-09-30T23:02:35.145735+0000","last_fullsized":"2023-09-30T23:02:35.145735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:42:18.171977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153530+0000","last_change":"2023-09-30T23:02:36.153530+0000","last_active":"2023-09-30T23:02:36.153530+0000","last_peered":"2023-09-30T23:02:36.153530+0000","last_clean":"2023-09-30T23:02:36.153530+0000","last_became_active":"2023-09-30T23:02:36.153126+0000","last_became_peered":"2023-09-30T23:02:36.153126+0000","last_unstale":"2023-09-30T23:02:36.153530+0000","last_undegraded":"2023-09-30T23:02:36.153530+0000","last_fullsized":"2023-09-30T23:02:36.153530+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:57.404238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.159268+0000","last_change":"2023-09-30T23:02:35.146120+0000","last_active":"2023-09-30T23:02:36.159268+0000","last_peered":"2023-09-30T23:02:36.159268+0000","last_clean":"2023-09-30T23:02:36.159268+0000","last_became_active":"2023-09-30T23:02:35.145626+0000","last_became_peered":"2023-09-30T23:02:35.145626+0000","last_unstale":"2023-09-30T23:02:36.159268+0000","last_undegraded":"2023-09-30T23:02:36.159268+0000","last_fullsized":"2023-09-30T23:02:36.159268+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:38.859936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":147,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.140952+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:02:35.140952+0000","last_peered":"2023-09-30T23:02:35.140952+0000","last_clean":"2023-09-30T23:02:35.140952+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:02:35.140952+0000","last_undegraded":"2023-09-30T23:02:35.140952+0000","last_fullsized":"2023-09-30T23:02:35.140952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.152283+0000","last_change":"2023-09-30T23:02:36.152283+0000","last_active":"2023-09-30T23:02:36.152283+0000","last_peered":"2023-09-30T23:02:36.152283+0000","last_clean":"2023-09-30T23:02:36.152283+0000","last_became_active":"2023-09-30T23:02:36.151819+0000","last_became_peered":"2023-09-30T23:02:36.151819+0000","last_unstale":"2023-09-30T23:02:36.152283+0000","last_undegraded":"2023-09-30T23:02:36.152283+0000","last_fullsized":"2023-09-30T23:02:36.152283+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:54.257645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"174'3","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.158804+0000","last_change":"2023-09-30T23:02:35.150005+0000","last_active":"2023-09-30T23:02:36.158804+0000","last_peered":"2023-09-30T23:02:36.158804+0000","last_clean":"2023-09-30T23:02:36.158804+0000","last_became_active":"2023-09-30T23:02:35.149729+0000","last_became_peered":"2023-09-30T23:02:35.149729+0000","last_unstale":"2023-09-30T23:02:36.158804+0000","last_undegraded":"2023-09-30T23:02:36.158804+0000","last_fullsized":"2023-09-30T23:02:36.158804+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:12:21.312291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.141561+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:02:36.141561+0000","last_peered":"2023-09-30T23:02:36.141561+0000","last_clean":"2023-09-30T23:02:36.141561+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:02:36.141561+0000","last_undegraded":"2023-09-30T23:02:36.141561+0000","last_fullsized":"2023-09-30T23:02:36.141561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145082+0000","last_change":"2023-09-30T23:02:36.145082+0000","last_active":"2023-09-30T23:02:36.145082+0000","last_peered":"2023-09-30T23:02:36.145082+0000","last_clean":"2023-09-30T23:02:36.145082+0000","last_became_active":"2023-09-30T23:02:36.144813+0000","last_became_peered":"2023-09-30T23:02:36.144813+0000","last_unstale":"2023-09-30T23:02:36.145082+0000","last_undegraded":"2023-09-30T23:02:36.145082+0000","last_fullsized":"2023-09-30T23:02:36.145082+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:14.319238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145784+0000","last_change":"2023-09-30T23:02:35.145485+0000","last_active":"2023-09-30T23:02:35.145784+0000","last_peered":"2023-09-30T23:02:35.145784+0000","last_clean":"2023-09-30T23:02:35.145784+0000","last_became_active":"2023-09-30T23:02:35.144417+0000","last_became_peered":"2023-09-30T23:02:35.144417+0000","last_unstale":"2023-09-30T23:02:35.145784+0000","last_undegraded":"2023-09-30T23:02:35.145784+0000","last_fullsized":"2023-09-30T23:02:35.145784+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:47.088859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":146,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.138623+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:02:35.138623+0000","last_peered":"2023-09-30T23:02:35.138623+0000","last_clean":"2023-09-30T23:02:35.138623+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:02:35.138623+0000","last_undegraded":"2023-09-30T23:02:35.138623+0000","last_fullsized":"2023-09-30T23:02:35.138623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145886+0000","last_change":"2023-09-30T23:02:36.145886+0000","last_active":"2023-09-30T23:02:36.145886+0000","last_peered":"2023-09-30T23:02:36.145886+0000","last_clean":"2023-09-30T23:02:36.145886+0000","last_became_active":"2023-09-30T23:02:36.145667+0000","last_became_peered":"2023-09-30T23:02:36.145667+0000","last_unstale":"2023-09-30T23:02:36.145886+0000","last_undegraded":"2023-09-30T23:02:36.145886+0000","last_fullsized":"2023-09-30T23:02:36.145886+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:44:29.614764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.14","version":"174'6","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.160692+0000","last_change":"2023-09-30T23:02:35.149658+0000","last_active":"2023-09-30T23:02:36.160692+0000","last_peered":"2023-09-30T23:02:36.160692+0000","last_clean":"2023-09-30T23:02:36.160692+0000","last_became_active":"2023-09-30T23:02:35.149418+0000","last_became_peered":"2023-09-30T23:02:35.149418+0000","last_unstale":"2023-09-30T23:02:36.160692+0000","last_undegraded":"2023-09-30T23:02:36.160692+0000","last_fullsized":"2023-09-30T23:02:36.160692+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:35.920814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144624+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:02:36.144624+0000","last_peered":"2023-09-30T23:02:36.144624+0000","last_clean":"2023-09-30T23:02:36.144624+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:02:36.144624+0000","last_undegraded":"2023-09-30T23:02:36.144624+0000","last_fullsized":"2023-09-30T23:02:36.144624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":301,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.139477+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:02:35.139477+0000","last_peered":"2023-09-30T23:02:35.139477+0000","last_clean":"2023-09-30T23:02:35.139477+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:02:35.139477+0000","last_undegraded":"2023-09-30T23:02:35.139477+0000","last_fullsized":"2023-09-30T23:02:35.139477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148381+0000","last_change":"2023-09-30T23:02:36.148381+0000","last_active":"2023-09-30T23:02:36.148381+0000","last_peered":"2023-09-30T23:02:36.148381+0000","last_clean":"2023-09-30T23:02:36.148381+0000","last_became_active":"2023-09-30T23:02:36.147860+0000","last_became_peered":"2023-09-30T23:02:36.147860+0000","last_unstale":"2023-09-30T23:02:36.148381+0000","last_undegraded":"2023-09-30T23:02:36.148381+0000","last_fullsized":"2023-09-30T23:02:36.148381+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:56.459330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.149584+0000","last_change":"2023-09-30T23:02:35.148323+0000","last_active":"2023-09-30T23:02:35.149584+0000","last_peered":"2023-09-30T23:02:35.149584+0000","last_clean":"2023-09-30T23:02:35.149584+0000","last_became_active":"2023-09-30T23:02:35.148107+0000","last_became_peered":"2023-09-30T23:02:35.148107+0000","last_unstale":"2023-09-30T23:02:35.149584+0000","last_undegraded":"2023-09-30T23:02:35.149584+0000","last_fullsized":"2023-09-30T23:02:35.149584+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:22.283843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144077+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:02:36.144077+0000","last_peered":"2023-09-30T23:02:36.144077+0000","last_clean":"2023-09-30T23:02:36.144077+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:02:36.144077+0000","last_undegraded":"2023-09-30T23:02:36.144077+0000","last_fullsized":"2023-09-30T23:02:36.144077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.149679+0000","last_change":"2023-09-30T23:02:36.149115+0000","last_active":"2023-09-30T23:02:36.149679+0000","last_peered":"2023-09-30T23:02:36.149679+0000","last_clean":"2023-09-30T23:02:36.149679+0000","last_became_active":"2023-09-30T23:02:36.148883+0000","last_became_peered":"2023-09-30T23:02:36.148883+0000","last_unstale":"2023-09-30T23:02:36.149679+0000","last_undegraded":"2023-09-30T23:02:36.149679+0000","last_fullsized":"2023-09-30T23:02:36.149679+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:09.835622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145752+0000","last_change":"2023-09-30T23:02:35.145261+0000","last_active":"2023-09-30T23:02:35.145752+0000","last_peered":"2023-09-30T23:02:35.145752+0000","last_clean":"2023-09-30T23:02:35.145752+0000","last_became_active":"2023-09-30T23:02:35.145026+0000","last_became_peered":"2023-09-30T23:02:35.145026+0000","last_unstale":"2023-09-30T23:02:35.145752+0000","last_undegraded":"2023-09-30T23:02:35.145752+0000","last_fullsized":"2023-09-30T23:02:35.145752+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:12:44.366992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144006+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:02:36.144006+0000","last_peered":"2023-09-30T23:02:36.144006+0000","last_clean":"2023-09-30T23:02:36.144006+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:02:36.144006+0000","last_undegraded":"2023-09-30T23:02:36.144006+0000","last_fullsized":"2023-09-30T23:02:36.144006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144559+0000","last_change":"2023-09-30T23:02:36.144559+0000","last_active":"2023-09-30T23:02:36.144559+0000","last_peered":"2023-09-30T23:02:36.144559+0000","last_clean":"2023-09-30T23:02:36.144559+0000","last_became_active":"2023-09-30T23:02:36.144329+0000","last_became_peered":"2023-09-30T23:02:36.144329+0000","last_unstale":"2023-09-30T23:02:36.144559+0000","last_undegraded":"2023-09-30T23:02:36.144559+0000","last_fullsized":"2023-09-30T23:02:36.144559+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:04:57.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145768+0000","last_change":"2023-09-30T23:02:35.145331+0000","last_active":"2023-09-30T23:02:35.145768+0000","last_peered":"2023-09-30T23:02:35.145768+0000","last_clean":"2023-09-30T23:02:35.145768+0000","last_became_active":"2023-09-30T23:02:35.144081+0000","last_became_peered":"2023-09-30T23:02:35.144081+0000","last_unstale":"2023-09-30T23:02:35.145768+0000","last_undegraded":"2023-09-30T23:02:35.145768+0000","last_fullsized":"2023-09-30T23:02:35.145768+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:07.270336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.136444+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:02:36.136444+0000","last_peered":"2023-09-30T23:02:36.136444+0000","last_clean":"2023-09-30T23:02:36.136444+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:02:36.136444+0000","last_undegraded":"2023-09-30T23:02:36.136444+0000","last_fullsized":"2023-09-30T23:02:36.136444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140377+0000","last_change":"2023-09-30T23:02:36.140286+0000","last_active":"2023-09-30T23:02:36.140377+0000","last_peered":"2023-09-30T23:02:36.140377+0000","last_clean":"2023-09-30T23:02:36.140377+0000","last_became_active":"2023-09-30T23:02:36.140067+0000","last_became_peered":"2023-09-30T23:02:36.140067+0000","last_unstale":"2023-09-30T23:02:36.140377+0000","last_undegraded":"2023-09-30T23:02:36.140377+0000","last_fullsized":"2023-09-30T23:02:36.140377+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:31.240931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.10","version":"174'8","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.162912+0000","last_change":"2023-09-30T23:02:35.149345+0000","last_active":"2023-09-30T23:02:36.162912+0000","last_peered":"2023-09-30T23:02:36.162912+0000","last_clean":"2023-09-30T23:02:36.162912+0000","last_became_active":"2023-09-30T23:02:35.148968+0000","last_became_peered":"2023-09-30T23:02:35.148968+0000","last_unstale":"2023-09-30T23:02:36.162912+0000","last_undegraded":"2023-09-30T23:02:36.162912+0000","last_fullsized":"2023-09-30T23:02:36.162912+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:48:29.008283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.141491+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:02:36.141491+0000","last_peered":"2023-09-30T23:02:36.141491+0000","last_clean":"2023-09-30T23:02:36.141491+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:02:36.141491+0000","last_undegraded":"2023-09-30T23:02:36.141491+0000","last_fullsized":"2023-09-30T23:02:36.141491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.33900000000000002,"15min":0.315},"max":{"1min":0.96199999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.52900000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.42099999999999999,"15min":0.36599999999999999},"max":{"1min":0.91500000000000004,"5min":1.004,"15min":1.004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.57399999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.44}]},{"osd":2,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.47099999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":0.99099999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73699999999999999,"15min":0.73199999999999998},"min":{"1min":0.60799999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.999,"5min":0.999,"15min":1.0209999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.53800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91100000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70999999999999996,"15min":0.69699999999999995},"min":{"1min":0.51300000000000001,"5min":0.50700000000000001,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":0.96599999999999997,"15min":1.056},"last":0.66200000000000003}]},{"osd":4,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.629,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.38600000000000001},"max":{"1min":0.92000000000000004,"5min":0.94199999999999995,"15min":0.95999999999999996},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.61399999999999999},"min":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.35999999999999999},"max":{"1min":0.878,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.59199999999999997}]},{"osd":5,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.443,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.135},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.41199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.004},"last":0.40100000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.99099999999999999,"5min":1.016,"15min":1.071},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961894,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.86399999999999999},"min":{"1min":0.58299999999999996,"5min":0.40500000000000003,"15min":0.29299999999999998},"max":{"1min":0.93700000000000006,"5min":0.99099999999999999,"15min":6.5190000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73699999999999999,"15min":0.77300000000000002},"min":{"1min":0.57999999999999996,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":1.0269999999999999,"5min":2.5710000000000002,"15min":4.3680000000000003},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72299999999999998,"15min":0.78900000000000003},"min":{"1min":0.67100000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.123,"5min":1.123,"15min":3.6339999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.72899999999999998,"15min":0.89400000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42099999999999999},"max":{"1min":0.91400000000000003,"5min":1.073,"15min":8.4339999999999993},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70499999999999996,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.0029999999999999,"15min":3.4580000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74399999999999999,"15min":0.89800000000000002},"min":{"1min":0.65000000000000002,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.89700000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0660000000000001,"5min":1.343,"15min":5.7110000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.96599999999999997,"5min":1.036,"15min":1.5249999999999999},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.876,"5min":0.99299999999999999,"15min":3.4670000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":1.2909999999999999,"15min":5.9279999999999999},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.88300000000000001,"5min":1.05,"15min":1.321},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98999999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.92300000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.48099999999999998},"max":{"1min":0.97699999999999998,"5min":1.018,"15min":6.0599999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.1140000000000001,"15min":1.3620000000000001},"last":0.88}]}]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1590,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193722,"statfs":{"total":200000000,"available":198371574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41699999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.65600000000000003,"15min":1.083},"last":0.371},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.46600000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.29999999999999999},"max":{"1min":0.67000000000000004,"5min":0.67100000000000004,"15min":0.745},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.438},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49399999999999999,"15min":0.48499999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.65600000000000003,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.40799999999999997,"5min":0.307,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.70299999999999996},"min":{"1min":0.503,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97199999999999998,"5min":1.091,"15min":1.091},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.01,"15min":1.1000000000000001},"last":0.70999999999999996}]},{"osd":5,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.72899999999999998},"min":{"1min":0.56599999999999995,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.1499999999999999,"15min":1.22},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.752,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.008,"5min":1.048,"15min":1.3560000000000001},"last":0.60599999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.497,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":1.1160000000000001,"15min":1.127},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.74399999999999999},"min":{"1min":0.57699999999999996,"5min":0.51000000000000001,"15min":0.48099999999999998},"max":{"1min":0.86499999999999999,"5min":1.0529999999999999,"15min":1.4059999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.59799999999999998,"5min":0.57299999999999995,"15min":0.51800000000000002},"max":{"1min":1.034,"5min":1.109,"15min":1.1240000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79800000000000004,"15min":0.78200000000000003},"min":{"1min":0.629,"5min":0.504,"15min":0.504},"max":{"1min":0.95199999999999996,"5min":1.022,"15min":1.3779999999999999},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.42299999999999999},"min":{"1min":0.33100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.68600000000000005,"15min":0.85699999999999998},"last":0.372},{"interface":"front","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.45500000000000002},"min":{"1min":0.38100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64800000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.26800000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.75600000000000001,"15min":1.0289999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.44500000000000001,"5min":0.34399999999999997,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":0.79300000000000004,"15min":0.879},"last":0.312}]},{"osd":3,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.40999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58099999999999996,"5min":0.76500000000000001,"15min":1.0029999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"min":{"1min":0.42699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72999999999999998,"5min":0.96799999999999997,"15min":0.98899999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.63100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.141,"15min":1.27},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60199999999999998,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0600000000000001,"15min":1.171},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.622,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98999999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.873},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":0.73899999999999999},"min":{"1min":0.59699999999999998,"5min":0.504,"15min":0.504},"max":{"1min":0.98399999999999999,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.434},"max":{"1min":0.96699999999999997,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.84799999999999998,"15min":0.76900000000000002},"min":{"1min":0.622,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94499999999999995,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79000000000000004,"15min":0.753},"min":{"1min":0.58199999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0129999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81200000000000006,"15min":0.77400000000000002},"min":{"1min":0.60499999999999998,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.0189999999999999,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.437,"15min":0.40200000000000002},"min":{"1min":0.29399999999999998,"5min":0.24199999999999999,"15min":0.23599999999999999},"max":{"1min":0.77400000000000002,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.45000000000000001},"min":{"1min":0.33800000000000002,"5min":0.30399999999999999,"15min":0.249},"max":{"1min":0.71899999999999997,"5min":1.542,"15min":1.542},"last":0.497}]},{"osd":1,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69999999999999996,"5min":1.494,"15min":1.494},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.52000000000000002},"min":{"1min":0.46300000000000002,"5min":0.35199999999999998,"15min":0.29599999999999999},"max":{"1min":0.746,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.46600000000000003},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72199999999999998,"5min":1.649,"15min":1.649},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.42599999999999999,"5min":0.35599999999999998,"15min":0.309},"max":{"1min":0.82399999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80400000000000005,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.0600000000000001,"5min":1.234,"15min":1.234},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.45900000000000002,"15min":0.38},"max":{"1min":1.1419999999999999,"5min":1.163,"15min":1.4910000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80800000000000005,"15min":0.78900000000000003},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.45200000000000001},"max":{"1min":1.0469999999999999,"5min":1.1459999999999999,"15min":1.179},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.075,"5min":1.117,"15min":2.7320000000000002},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.76500000000000001},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.0269999999999999,"5min":1.115,"15min":1.615},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.50800000000000001},"max":{"1min":1.109,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.746}]},{"osd":7,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.59299999999999997,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.0880000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.439},"max":{"1min":1.1279999999999999,"5min":1.1890000000000001,"15min":2.7730000000000001},"last":0.61899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198960428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.41099999999999998},"min":{"1min":0.32400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52500000000000002,"5min":0.63300000000000001,"15min":1.1519999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.41199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":1.919},"last":0.39300000000000002}]},{"osd":1,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.254},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.38600000000000001,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":0.748,"5min":0.748,"15min":1.9390000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.437,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":1.6020000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.35499999999999998},"max":{"1min":0.69899999999999995,"5min":0.96199999999999997,"15min":1.5309999999999999},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.53800000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91600000000000004,"5min":1.0569999999999999,"15min":1.401},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.96799999999999997,"5min":1.1539999999999999,"15min":3.306},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.752,"15min":0.753},"min":{"1min":0.55000000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":1.0880000000000001,"15min":1.508},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":0.93300000000000005,"5min":1.044,"15min":1.4910000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.57899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90300000000000002,"5min":0.96299999999999997,"15min":1.5620000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.61399999999999999,"5min":0.48399999999999999,"15min":0.48099999999999998},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.3140000000000001},"last":0.75}]},{"osd":7,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":0.94999999999999996,"5min":1.135,"15min":1.3640000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.69499999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89900000000000002,"5min":1.081,"15min":1.573},"last":0.85599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574974,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.60899999999999999},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":1.022},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66600000000000004,"15min":0.61899999999999999},"min":{"1min":0.45400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.93300000000000005},"last":0.67600000000000005}]},{"osd":1,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.64000000000000001},"min":{"1min":0.54100000000000004,"5min":0.44500000000000001,"15min":0.38800000000000001},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67000000000000004,"15min":0.64000000000000001},"min":{"1min":0.53700000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.55300000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98699999999999999,"5min":1.492,"15min":1.492},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.749,"15min":0.70399999999999996},"min":{"1min":0.63500000000000001,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.96599999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.67500000000000004},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.71199999999999997},"min":{"1min":0.56399999999999995,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":1.0620000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.624}]},{"osd":5,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66100000000000003,"15min":0.65400000000000003},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.84999999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.47199999999999998,"5min":0.371,"15min":0.37},"max":{"1min":0.91300000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":1.45,"15min":1.45},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.57499999999999996,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.82699999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.45700000000000002},"max":{"1min":0.872,"5min":0.98599999999999999,"15min":1.016},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.503,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65200000000000002,"15min":0.61799999999999999},"min":{"1min":0.50900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.877,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.57599999999999996,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88900000000000001,"5min":1.008,"15min":1.008},"last":0.753}]},{"osd":1,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.64200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88200000000000001,"5min":0.91300000000000003,"15min":0.97899999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68300000000000005,"15min":0.67000000000000004},"min":{"1min":0.59299999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91000000000000003,"5min":1.0369999999999999,"15min":1.0449999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68799999999999994,"15min":0.65300000000000002},"min":{"1min":0.63300000000000001,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.84199999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.54600000000000004,"5min":0.45900000000000002,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.95899999999999996,"15min":1.044},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.53800000000000003,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.95899999999999996,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70399999999999996,"15min":0.67000000000000004},"min":{"1min":0.57999999999999996,"5min":0.46800000000000003,"15min":0.442},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.97599999999999998},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75700000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84699999999999998,"5min":1.081,"15min":1.081},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.88300000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.45600000000000002,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":1.03,"15min":1.03},"last":0.86599999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73299999999999998,"15min":0.71399999999999997},"min":{"1min":0.55600000000000005,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":1.083,"15min":1.083},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.89100000000000001}]}]}],"pool_statfs":[]}} 2023-09-30T23:02:40.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:02:41.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.160+0000 7f3794dff700 1 Processor -- start 2023-09-30T23:02:41.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.161+0000 7f3794dff700 1 -- start start 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f3794dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900b1580 0x7f37900adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f3794dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37900b1950 0x7f379015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f3794dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37900ae000 0x7f379015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f3794dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3790157c20 con 0x7f37900ae000 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f3794dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900ad630 con 0x7f37900b1950 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f3794dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37900b3360 con 0x7f37900b1580 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f378ed9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37900ae000 0x7f379015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f378ed9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f37900ae000 0x7f379015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33208/0 (socket says 172.21.15.142:33208) 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.162+0000 7f378ed9d700 1 -- 172.21.15.142:0/1691370362 learned_addr learned my addr 172.21.15.142:0/1691370362 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378dd9b700 1 --2- 172.21.15.142:0/1691370362 >> v2:172.21.15.148:3300/0 conn(0x7f37900b1950 0x7f379015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378e59c700 1 --2- 172.21.15.142:0/1691370362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900b1580 0x7f37900adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378ed9d700 1 -- 172.21.15.142:0/1691370362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900b1580 msgr2=0x7f37900adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378ed9d700 1 --2- 172.21.15.142:0/1691370362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900b1580 0x7f37900adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378ed9d700 1 -- 172.21.15.142:0/1691370362 >> v2:172.21.15.148:3300/0 conn(0x7f37900b1950 msgr2=0x7f379015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378ed9d700 1 --2- 172.21.15.142:0/1691370362 >> v2:172.21.15.148:3300/0 conn(0x7f37900b1950 0x7f379015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378ed9d700 1 -- 172.21.15.142:0/1691370362 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379015ad60 con 0x7f37900ae000 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378dd9b700 1 --2- 172.21.15.142:0/1691370362 >> v2:172.21.15.148:3300/0 conn(0x7f37900b1950 0x7f379015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378ed9d700 1 --2- 172.21.15.142:0/1691370362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900ae000 0x7f379015a6c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f3790069d40 tx=0x7f3788009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb82866e9e88c8ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:41.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378d59a700 1 -- 172.21.15.142:0/1691370362 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800e070 con 0x7f37900ae000 2023-09-30T23:02:41.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378d59a700 1 -- 172.21.15.142:0/1691370362 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800ba50 con 0x7f37900ae000 2023-09-30T23:02:41.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.163+0000 7f378d59a700 1 -- 172.21.15.142:0/1691370362 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880092e0 con 0x7f37900ae000 2023-09-30T23:02:41.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 -- 172.21.15.142:0/1691370362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900ae000 msgr2=0x7f379015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 --2- 172.21.15.142:0/1691370362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900ae000 0x7f379015a6c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f3790069d40 tx=0x7f3788009840 comp rx=0 tx=0).stop 2023-09-30T23:02:41.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 -- 172.21.15.142:0/1691370362 shutdown_connections 2023-09-30T23:02:41.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 --2- 172.21.15.142:0/1691370362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900ae000 0x7f379015a6c0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 --2- 172.21.15.142:0/1691370362 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900b1580 0x7f37900adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 --2- 172.21.15.142:0/1691370362 >> v2:172.21.15.148:3300/0 conn(0x7f37900b1950 0x7f379015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 -- 172.21.15.142:0/1691370362 >> 172.21.15.142:0/1691370362 conn(0x7f37900ce1f0 msgr2=0x7f3790069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 -- 172.21.15.142:0/1691370362 shutdown_connections 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.164+0000 7f3794dff700 1 -- 172.21.15.142:0/1691370362 wait complete. 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.165+0000 7f3794dff700 1 Processor -- start 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.166+0000 7f3794dff700 1 -- start start 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.166+0000 7f3794dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900ae000 0x7f37900a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.166+0000 7f3794dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900b1580 0x7f3790142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f3794dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37900b1950 0x7f37900ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f3794dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900aa4a0 con 0x7f37900b1580 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f3794dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900acde0 con 0x7f37900b1950 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f3794dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37901432d0 con 0x7f37900ae000 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900b1580 0x7f3790142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900b1580 0x7f3790142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33220/0 (socket says 172.21.15.142:33220) 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 -- 172.21.15.142:0/1710488020 learned_addr learned my addr 172.21.15.142:0/1710488020 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378e59c700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900ae000 0x7f37900a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378ed9d700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37900b1950 0x7f37900ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 -- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900ae000 msgr2=0x7f37900a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900ae000 0x7f37900a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 -- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37900b1950 msgr2=0x7f37900ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37900b1950 0x7f37900ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 -- 172.21.15.142:0/1710488020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009ae0 con 0x7f37900b1580 2023-09-30T23:02:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378ed9d700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37900b1950 0x7f37900ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.167+0000 7f378dd9b700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900b1580 0x7f3790142d90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f378400d890 tx=0x7f3784008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.168+0000 7f377e7fc700 1 -- 172.21.15.142:0/1710488020 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400b600 con 0x7f37900b1580 2023-09-30T23:02:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.168+0000 7f377e7fc700 1 -- 172.21.15.142:0/1710488020 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400b760 con 0x7f37900b1580 2023-09-30T23:02:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.168+0000 7f377e7fc700 1 -- 172.21.15.142:0/1710488020 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400bb00 con 0x7f37900b1580 2023-09-30T23:02:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.168+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37900ac8a0 con 0x7f37900b1580 2023-09-30T23:02:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.168+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37900ca710 con 0x7f37900b1580 2023-09-30T23:02:41.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.169+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37900cb040 con 0x7f37900b1580 2023-09-30T23:02:41.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.170+0000 7f377e7fc700 1 -- 172.21.15.142:0/1710488020 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3784014430 con 0x7f37900b1580 2023-09-30T23:02:41.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.171+0000 7f377e7fc700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3770067330 0x7f37700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.171+0000 7f377e7fc700 1 -- 172.21.15.142:0/1710488020 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f37840850a0 con 0x7f37900b1580 2023-09-30T23:02:41.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.171+0000 7f378e59c700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3770067330 0x7f37700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.172+0000 7f378e59c700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3770067330 0x7f37700697e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3780006fd0 tx=0x7f3780008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:41.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.175+0000 7f377e7fc700 1 -- 172.21.15.142:0/1710488020 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3784051fb0 con 0x7f37900b1580 2023-09-30T23:02:41.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.362+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f379015b040 con 0x7f3770067330 2023-09-30T23:02:41.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.371+0000 7f377e7fc700 1 -- 172.21.15.142:0/1710488020 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303612 (secure 0 0 0) 0x7f379015b040 con 0x7f3770067330 2023-09-30T23:02:41.374 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3770067330 msgr2=0x7f37700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3770067330 0x7f37700697e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3780006fd0 tx=0x7f3780008040 comp rx=0 tx=0).stop 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900b1580 msgr2=0x7f3790142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900b1580 0x7f3790142d90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f378400d890 tx=0x7f3784008040 comp rx=0 tx=0).stop 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 shutdown_connections 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3770067330 0x7f37700697e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37900b1950 0x7f37900ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f37900ae000 0x7f37900a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 --2- 172.21.15.142:0/1710488020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37900b1580 0x7f3790142d90 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 >> 172.21.15.142:0/1710488020 conn(0x7f37900ce1f0 msgr2=0x7f37900aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 shutdown_connections 2023-09-30T23:02:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.375+0000 7f3794dff700 1 -- 172.21.15.142:0/1710488020 wait complete. 2023-09-30T23:02:41.378 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:02:41.393 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2023-09-30T23:02:40.247202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9267,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553232,"statfs":{"total":1600000000,"available":1590510364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001326"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153776+0000","last_change":"2023-09-30T23:02:36.153708+0000","last_active":"2023-09-30T23:02:36.153776+0000","last_peered":"2023-09-30T23:02:36.153776+0000","last_clean":"2023-09-30T23:02:36.153776+0000","last_became_active":"2023-09-30T23:02:36.153488+0000","last_became_peered":"2023-09-30T23:02:36.153488+0000","last_unstale":"2023-09-30T23:02:36.153776+0000","last_undegraded":"2023-09-30T23:02:36.153776+0000","last_fullsized":"2023-09-30T23:02:36.153776+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:06:25.757207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145847+0000","last_change":"2023-09-30T23:02:36.145847+0000","last_active":"2023-09-30T23:02:36.145847+0000","last_peered":"2023-09-30T23:02:36.145847+0000","last_clean":"2023-09-30T23:02:36.145847+0000","last_became_active":"2023-09-30T23:02:36.145602+0000","last_became_peered":"2023-09-30T23:02:36.145602+0000","last_unstale":"2023-09-30T23:02:36.145847+0000","last_undegraded":"2023-09-30T23:02:36.145847+0000","last_fullsized":"2023-09-30T23:02:36.145847+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:03:40.605545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148380+0000","last_change":"2023-09-30T23:02:36.148288+0000","last_active":"2023-09-30T23:02:36.148380+0000","last_peered":"2023-09-30T23:02:36.148380+0000","last_clean":"2023-09-30T23:02:36.148380+0000","last_became_active":"2023-09-30T23:02:36.148043+0000","last_became_peered":"2023-09-30T23:02:36.148043+0000","last_unstale":"2023-09-30T23:02:36.148380+0000","last_undegraded":"2023-09-30T23:02:36.148380+0000","last_fullsized":"2023-09-30T23:02:36.148380+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:57.404238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146897+0000","last_change":"2023-09-30T23:02:36.146897+0000","last_active":"2023-09-30T23:02:36.146897+0000","last_peered":"2023-09-30T23:02:36.146897+0000","last_clean":"2023-09-30T23:02:36.146897+0000","last_became_active":"2023-09-30T23:02:36.146658+0000","last_became_peered":"2023-09-30T23:02:36.146658+0000","last_unstale":"2023-09-30T23:02:36.146897+0000","last_undegraded":"2023-09-30T23:02:36.146897+0000","last_fullsized":"2023-09-30T23:02:36.146897+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:24.468576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151062+0000","last_change":"2023-09-30T23:02:36.151062+0000","last_active":"2023-09-30T23:02:36.151062+0000","last_peered":"2023-09-30T23:02:36.151062+0000","last_clean":"2023-09-30T23:02:36.151062+0000","last_became_active":"2023-09-30T23:02:36.150817+0000","last_became_peered":"2023-09-30T23:02:36.150817+0000","last_unstale":"2023-09-30T23:02:36.151062+0000","last_undegraded":"2023-09-30T23:02:36.151062+0000","last_fullsized":"2023-09-30T23:02:36.151062+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:47:23.042726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145655+0000","last_change":"2023-09-30T23:02:36.145576+0000","last_active":"2023-09-30T23:02:36.145655+0000","last_peered":"2023-09-30T23:02:36.145655+0000","last_clean":"2023-09-30T23:02:36.145655+0000","last_became_active":"2023-09-30T23:02:36.145368+0000","last_became_peered":"2023-09-30T23:02:36.145368+0000","last_unstale":"2023-09-30T23:02:36.145655+0000","last_undegraded":"2023-09-30T23:02:36.145655+0000","last_fullsized":"2023-09-30T23:02:36.145655+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:09.470757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151075+0000","last_change":"2023-09-30T23:02:36.150941+0000","last_active":"2023-09-30T23:02:36.151075+0000","last_peered":"2023-09-30T23:02:36.151075+0000","last_clean":"2023-09-30T23:02:36.151075+0000","last_became_active":"2023-09-30T23:02:36.150571+0000","last_became_peered":"2023-09-30T23:02:36.150571+0000","last_unstale":"2023-09-30T23:02:36.151075+0000","last_undegraded":"2023-09-30T23:02:36.151075+0000","last_fullsized":"2023-09-30T23:02:36.151075+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:11:09.470757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144102+0000","last_change":"2023-09-30T23:02:36.144102+0000","last_active":"2023-09-30T23:02:36.144102+0000","last_peered":"2023-09-30T23:02:36.144102+0000","last_clean":"2023-09-30T23:02:36.144102+0000","last_became_active":"2023-09-30T23:02:36.143804+0000","last_became_peered":"2023-09-30T23:02:36.143804+0000","last_unstale":"2023-09-30T23:02:36.144102+0000","last_undegraded":"2023-09-30T23:02:36.144102+0000","last_fullsized":"2023-09-30T23:02:36.144102+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:38:05.090968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145847+0000","last_change":"2023-09-30T23:02:36.145847+0000","last_active":"2023-09-30T23:02:36.145847+0000","last_peered":"2023-09-30T23:02:36.145847+0000","last_clean":"2023-09-30T23:02:36.145847+0000","last_became_active":"2023-09-30T23:02:36.145595+0000","last_became_peered":"2023-09-30T23:02:36.145595+0000","last_unstale":"2023-09-30T23:02:36.145847+0000","last_undegraded":"2023-09-30T23:02:36.145847+0000","last_fullsized":"2023-09-30T23:02:36.145847+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:09.974737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.139664+0000","last_change":"2023-09-30T23:02:36.139334+0000","last_active":"2023-09-30T23:02:36.139664+0000","last_peered":"2023-09-30T23:02:36.139664+0000","last_clean":"2023-09-30T23:02:36.139664+0000","last_became_active":"2023-09-30T23:02:36.138730+0000","last_became_peered":"2023-09-30T23:02:36.138730+0000","last_unstale":"2023-09-30T23:02:36.139664+0000","last_undegraded":"2023-09-30T23:02:36.139664+0000","last_fullsized":"2023-09-30T23:02:36.139664+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:44:03.614966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150937+0000","last_change":"2023-09-30T23:02:36.150937+0000","last_active":"2023-09-30T23:02:36.150937+0000","last_peered":"2023-09-30T23:02:36.150937+0000","last_clean":"2023-09-30T23:02:36.150937+0000","last_became_active":"2023-09-30T23:02:36.150644+0000","last_became_peered":"2023-09-30T23:02:36.150644+0000","last_unstale":"2023-09-30T23:02:36.150937+0000","last_undegraded":"2023-09-30T23:02:36.150937+0000","last_fullsized":"2023-09-30T23:02:36.150937+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:47:23.042726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153981+0000","last_change":"2023-09-30T23:02:36.153981+0000","last_active":"2023-09-30T23:02:36.153981+0000","last_peered":"2023-09-30T23:02:36.153981+0000","last_clean":"2023-09-30T23:02:36.153981+0000","last_became_active":"2023-09-30T23:02:36.153777+0000","last_became_peered":"2023-09-30T23:02:36.153777+0000","last_unstale":"2023-09-30T23:02:36.153981+0000","last_undegraded":"2023-09-30T23:02:36.153981+0000","last_fullsized":"2023-09-30T23:02:36.153981+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:54.130677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150230+0000","last_change":"2023-09-30T23:02:36.150230+0000","last_active":"2023-09-30T23:02:36.150230+0000","last_peered":"2023-09-30T23:02:36.150230+0000","last_clean":"2023-09-30T23:02:36.150230+0000","last_became_active":"2023-09-30T23:02:36.149553+0000","last_became_peered":"2023-09-30T23:02:36.149553+0000","last_unstale":"2023-09-30T23:02:36.150230+0000","last_undegraded":"2023-09-30T23:02:36.150230+0000","last_fullsized":"2023-09-30T23:02:36.150230+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:09:26.410286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150689+0000","last_change":"2023-09-30T23:02:36.150689+0000","last_active":"2023-09-30T23:02:36.150689+0000","last_peered":"2023-09-30T23:02:36.150689+0000","last_clean":"2023-09-30T23:02:36.150689+0000","last_became_active":"2023-09-30T23:02:36.150345+0000","last_became_peered":"2023-09-30T23:02:36.150345+0000","last_unstale":"2023-09-30T23:02:36.150689+0000","last_undegraded":"2023-09-30T23:02:36.150689+0000","last_fullsized":"2023-09-30T23:02:36.150689+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:54:58.838057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146747+0000","last_change":"2023-09-30T23:02:36.146747+0000","last_active":"2023-09-30T23:02:36.146747+0000","last_peered":"2023-09-30T23:02:36.146747+0000","last_clean":"2023-09-30T23:02:36.146747+0000","last_became_active":"2023-09-30T23:02:36.146525+0000","last_became_peered":"2023-09-30T23:02:36.146525+0000","last_unstale":"2023-09-30T23:02:36.146747+0000","last_undegraded":"2023-09-30T23:02:36.146747+0000","last_fullsized":"2023-09-30T23:02:36.146747+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:08.277234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146348+0000","last_change":"2023-09-30T23:02:36.146348+0000","last_active":"2023-09-30T23:02:36.146348+0000","last_peered":"2023-09-30T23:02:36.146348+0000","last_clean":"2023-09-30T23:02:36.146348+0000","last_became_active":"2023-09-30T23:02:36.145807+0000","last_became_peered":"2023-09-30T23:02:36.145807+0000","last_unstale":"2023-09-30T23:02:36.146348+0000","last_undegraded":"2023-09-30T23:02:36.146348+0000","last_fullsized":"2023-09-30T23:02:36.146348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T11:00:57.522008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153559+0000","last_change":"2023-09-30T23:02:36.153559+0000","last_active":"2023-09-30T23:02:36.153559+0000","last_peered":"2023-09-30T23:02:36.153559+0000","last_clean":"2023-09-30T23:02:36.153559+0000","last_became_active":"2023-09-30T23:02:36.153108+0000","last_became_peered":"2023-09-30T23:02:36.153108+0000","last_unstale":"2023-09-30T23:02:36.153559+0000","last_undegraded":"2023-09-30T23:02:36.153559+0000","last_fullsized":"2023-09-30T23:02:36.153559+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:53.317584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150372+0000","last_change":"2023-09-30T23:02:36.150372+0000","last_active":"2023-09-30T23:02:36.150372+0000","last_peered":"2023-09-30T23:02:36.150372+0000","last_clean":"2023-09-30T23:02:36.150372+0000","last_became_active":"2023-09-30T23:02:36.149963+0000","last_became_peered":"2023-09-30T23:02:36.149963+0000","last_unstale":"2023-09-30T23:02:36.150372+0000","last_undegraded":"2023-09-30T23:02:36.150372+0000","last_fullsized":"2023-09-30T23:02:36.150372+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:44:42.426565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.156265+0000","last_change":"2023-09-30T23:02:36.154193+0000","last_active":"2023-09-30T23:02:36.156265+0000","last_peered":"2023-09-30T23:02:36.156265+0000","last_clean":"2023-09-30T23:02:36.156265+0000","last_became_active":"2023-09-30T23:02:36.153394+0000","last_became_peered":"2023-09-30T23:02:36.153394+0000","last_unstale":"2023-09-30T23:02:36.156265+0000","last_undegraded":"2023-09-30T23:02:36.156265+0000","last_fullsized":"2023-09-30T23:02:36.156265+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:56.285242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144409+0000","last_change":"2023-09-30T23:02:36.144409+0000","last_active":"2023-09-30T23:02:36.144409+0000","last_peered":"2023-09-30T23:02:36.144409+0000","last_clean":"2023-09-30T23:02:36.144409+0000","last_became_active":"2023-09-30T23:02:36.143871+0000","last_became_peered":"2023-09-30T23:02:36.143871+0000","last_unstale":"2023-09-30T23:02:36.144409+0000","last_undegraded":"2023-09-30T23:02:36.144409+0000","last_fullsized":"2023-09-30T23:02:36.144409+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:12:45.373890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.147631+0000","last_change":"2023-09-30T23:02:36.147631+0000","last_active":"2023-09-30T23:02:36.147631+0000","last_peered":"2023-09-30T23:02:36.147631+0000","last_clean":"2023-09-30T23:02:36.147631+0000","last_became_active":"2023-09-30T23:02:36.147414+0000","last_became_peered":"2023-09-30T23:02:36.147414+0000","last_unstale":"2023-09-30T23:02:36.147631+0000","last_undegraded":"2023-09-30T23:02:36.147631+0000","last_fullsized":"2023-09-30T23:02:36.147631+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:48.095757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153279+0000","last_change":"2023-09-30T23:02:36.153178+0000","last_active":"2023-09-30T23:02:36.153279+0000","last_peered":"2023-09-30T23:02:36.153279+0000","last_clean":"2023-09-30T23:02:36.153279+0000","last_became_active":"2023-09-30T23:02:36.152964+0000","last_became_peered":"2023-09-30T23:02:36.152964+0000","last_unstale":"2023-09-30T23:02:36.153279+0000","last_undegraded":"2023-09-30T23:02:36.153279+0000","last_fullsized":"2023-09-30T23:02:36.153279+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:47:10.658640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153348+0000","last_change":"2023-09-30T23:02:36.153348+0000","last_active":"2023-09-30T23:02:36.153348+0000","last_peered":"2023-09-30T23:02:36.153348+0000","last_clean":"2023-09-30T23:02:36.153348+0000","last_became_active":"2023-09-30T23:02:36.152826+0000","last_became_peered":"2023-09-30T23:02:36.152826+0000","last_unstale":"2023-09-30T23:02:36.153348+0000","last_undegraded":"2023-09-30T23:02:36.153348+0000","last_fullsized":"2023-09-30T23:02:36.153348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:49:32.145505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.142473+0000","last_change":"2023-09-30T23:02:36.141732+0000","last_active":"2023-09-30T23:02:36.142473+0000","last_peered":"2023-09-30T23:02:36.142473+0000","last_clean":"2023-09-30T23:02:36.142473+0000","last_became_active":"2023-09-30T23:02:36.141506+0000","last_became_peered":"2023-09-30T23:02:36.141506+0000","last_unstale":"2023-09-30T23:02:36.142473+0000","last_undegraded":"2023-09-30T23:02:36.142473+0000","last_fullsized":"2023-09-30T23:02:36.142473+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:51.748488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151597+0000","last_change":"2023-09-30T23:02:36.151527+0000","last_active":"2023-09-30T23:02:36.151597+0000","last_peered":"2023-09-30T23:02:36.151597+0000","last_clean":"2023-09-30T23:02:36.151597+0000","last_became_active":"2023-09-30T23:02:36.151274+0000","last_became_peered":"2023-09-30T23:02:36.151274+0000","last_unstale":"2023-09-30T23:02:36.151597+0000","last_undegraded":"2023-09-30T23:02:36.151597+0000","last_fullsized":"2023-09-30T23:02:36.151597+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:32.569005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148544+0000","last_change":"2023-09-30T23:02:36.148544+0000","last_active":"2023-09-30T23:02:36.148544+0000","last_peered":"2023-09-30T23:02:36.148544+0000","last_clean":"2023-09-30T23:02:36.148544+0000","last_became_active":"2023-09-30T23:02:36.148311+0000","last_became_peered":"2023-09-30T23:02:36.148311+0000","last_unstale":"2023-09-30T23:02:36.148544+0000","last_undegraded":"2023-09-30T23:02:36.148544+0000","last_fullsized":"2023-09-30T23:02:36.148544+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:06:13.351627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.138822+0000","last_change":"2023-09-30T23:02:36.138571+0000","last_active":"2023-09-30T23:02:36.138822+0000","last_peered":"2023-09-30T23:02:36.138822+0000","last_clean":"2023-09-30T23:02:36.138822+0000","last_became_active":"2023-09-30T23:02:36.138331+0000","last_became_peered":"2023-09-30T23:02:36.138331+0000","last_unstale":"2023-09-30T23:02:36.138822+0000","last_undegraded":"2023-09-30T23:02:36.138822+0000","last_fullsized":"2023-09-30T23:02:36.138822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:35:24.468576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145654+0000","last_change":"2023-09-30T23:02:36.145654+0000","last_active":"2023-09-30T23:02:36.145654+0000","last_peered":"2023-09-30T23:02:36.145654+0000","last_clean":"2023-09-30T23:02:36.145654+0000","last_became_active":"2023-09-30T23:02:36.145352+0000","last_became_peered":"2023-09-30T23:02:36.145352+0000","last_unstale":"2023-09-30T23:02:36.145654+0000","last_undegraded":"2023-09-30T23:02:36.145654+0000","last_fullsized":"2023-09-30T23:02:36.145654+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:06:13.351627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.139854+0000","last_change":"2023-09-30T23:02:36.139854+0000","last_active":"2023-09-30T23:02:36.139854+0000","last_peered":"2023-09-30T23:02:36.139854+0000","last_clean":"2023-09-30T23:02:36.139854+0000","last_became_active":"2023-09-30T23:02:36.139565+0000","last_became_peered":"2023-09-30T23:02:36.139565+0000","last_unstale":"2023-09-30T23:02:36.139854+0000","last_undegraded":"2023-09-30T23:02:36.139854+0000","last_fullsized":"2023-09-30T23:02:36.139854+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:53:59.615825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.139681+0000","last_change":"2023-09-30T23:02:36.139599+0000","last_active":"2023-09-30T23:02:36.139681+0000","last_peered":"2023-09-30T23:02:36.139681+0000","last_clean":"2023-09-30T23:02:36.139681+0000","last_became_active":"2023-09-30T23:02:36.139071+0000","last_became_peered":"2023-09-30T23:02:36.139071+0000","last_unstale":"2023-09-30T23:02:36.139681+0000","last_undegraded":"2023-09-30T23:02:36.139681+0000","last_fullsized":"2023-09-30T23:02:36.139681+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:49:32.145505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145586+0000","last_change":"2023-09-30T23:02:36.145586+0000","last_active":"2023-09-30T23:02:36.145586+0000","last_peered":"2023-09-30T23:02:36.145586+0000","last_clean":"2023-09-30T23:02:36.145586+0000","last_became_active":"2023-09-30T23:02:36.144840+0000","last_became_peered":"2023-09-30T23:02:36.144840+0000","last_unstale":"2023-09-30T23:02:36.145586+0000","last_undegraded":"2023-09-30T23:02:36.145586+0000","last_fullsized":"2023-09-30T23:02:36.145586+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:39.801728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151166+0000","last_change":"2023-09-30T23:02:36.151166+0000","last_active":"2023-09-30T23:02:36.151166+0000","last_peered":"2023-09-30T23:02:36.151166+0000","last_clean":"2023-09-30T23:02:36.151166+0000","last_became_active":"2023-09-30T23:02:36.150936+0000","last_became_peered":"2023-09-30T23:02:36.150936+0000","last_unstale":"2023-09-30T23:02:36.151166+0000","last_undegraded":"2023-09-30T23:02:36.151166+0000","last_fullsized":"2023-09-30T23:02:36.151166+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:05.454017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146209+0000","last_change":"2023-09-30T23:02:36.146209+0000","last_active":"2023-09-30T23:02:36.146209+0000","last_peered":"2023-09-30T23:02:36.146209+0000","last_clean":"2023-09-30T23:02:36.146209+0000","last_became_active":"2023-09-30T23:02:36.145368+0000","last_became_peered":"2023-09-30T23:02:36.145368+0000","last_unstale":"2023-09-30T23:02:36.146209+0000","last_undegraded":"2023-09-30T23:02:36.146209+0000","last_fullsized":"2023-09-30T23:02:36.146209+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:58:08.891202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"174'4","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.159270+0000","last_change":"2023-09-30T23:02:35.149470+0000","last_active":"2023-09-30T23:02:36.159270+0000","last_peered":"2023-09-30T23:02:36.159270+0000","last_clean":"2023-09-30T23:02:36.159270+0000","last_became_active":"2023-09-30T23:02:35.148463+0000","last_became_peered":"2023-09-30T23:02:35.148463+0000","last_unstale":"2023-09-30T23:02:36.159270+0000","last_undegraded":"2023-09-30T23:02:36.159270+0000","last_fullsized":"2023-09-30T23:02:36.159270+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:27:57.561233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146843+0000","last_change":"2023-09-30T23:02:36.146843+0000","last_active":"2023-09-30T23:02:36.146843+0000","last_peered":"2023-09-30T23:02:36.146843+0000","last_clean":"2023-09-30T23:02:36.146843+0000","last_became_active":"2023-09-30T23:02:36.146625+0000","last_became_peered":"2023-09-30T23:02:36.146625+0000","last_unstale":"2023-09-30T23:02:36.146843+0000","last_undegraded":"2023-09-30T23:02:36.146843+0000","last_fullsized":"2023-09-30T23:02:36.146843+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:39.801728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.137051+0000","last_change":"2023-09-30T23:02:35.145445+0000","last_active":"2023-09-30T23:02:36.137051+0000","last_peered":"2023-09-30T23:02:36.137051+0000","last_clean":"2023-09-30T23:02:36.137051+0000","last_became_active":"2023-09-30T23:02:35.145230+0000","last_became_peered":"2023-09-30T23:02:35.145230+0000","last_unstale":"2023-09-30T23:02:36.137051+0000","last_undegraded":"2023-09-30T23:02:36.137051+0000","last_fullsized":"2023-09-30T23:02:36.137051+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:03:39.598647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.152250+0000","last_change":"2023-09-30T23:02:36.152250+0000","last_active":"2023-09-30T23:02:36.152250+0000","last_peered":"2023-09-30T23:02:36.152250+0000","last_clean":"2023-09-30T23:02:36.152250+0000","last_became_active":"2023-09-30T23:02:36.152010+0000","last_became_peered":"2023-09-30T23:02:36.152010+0000","last_unstale":"2023-09-30T23:02:36.152250+0000","last_undegraded":"2023-09-30T23:02:36.152250+0000","last_fullsized":"2023-09-30T23:02:36.152250+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:42:19.178874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1d","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.161084+0000","last_change":"2023-09-30T23:02:35.144882+0000","last_active":"2023-09-30T23:02:36.161084+0000","last_peered":"2023-09-30T23:02:36.161084+0000","last_clean":"2023-09-30T23:02:36.161084+0000","last_became_active":"2023-09-30T23:02:35.144627+0000","last_became_peered":"2023-09-30T23:02:35.144627+0000","last_unstale":"2023-09-30T23:02:36.161084+0000","last_undegraded":"2023-09-30T23:02:36.161084+0000","last_fullsized":"2023-09-30T23:02:36.161084+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:08:02.645462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145476+0000","last_change":"2023-09-30T23:02:36.145476+0000","last_active":"2023-09-30T23:02:36.145476+0000","last_peered":"2023-09-30T23:02:36.145476+0000","last_clean":"2023-09-30T23:02:36.145476+0000","last_became_active":"2023-09-30T23:02:36.145209+0000","last_became_peered":"2023-09-30T23:02:36.145209+0000","last_unstale":"2023-09-30T23:02:36.145476+0000","last_undegraded":"2023-09-30T23:02:36.145476+0000","last_fullsized":"2023-09-30T23:02:36.145476+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:13:11.552780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.158868+0000","last_change":"2023-09-30T23:02:35.137503+0000","last_active":"2023-09-30T23:02:36.158868+0000","last_peered":"2023-09-30T23:02:36.158868+0000","last_clean":"2023-09-30T23:02:36.158868+0000","last_became_active":"2023-09-30T23:02:35.136979+0000","last_became_peered":"2023-09-30T23:02:35.136979+0000","last_unstale":"2023-09-30T23:02:36.158868+0000","last_undegraded":"2023-09-30T23:02:36.158868+0000","last_fullsized":"2023-09-30T23:02:36.158868+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:44:41.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144549+0000","last_change":"2023-09-30T23:02:36.144549+0000","last_active":"2023-09-30T23:02:36.144549+0000","last_peered":"2023-09-30T23:02:36.144549+0000","last_clean":"2023-09-30T23:02:36.144549+0000","last_became_active":"2023-09-30T23:02:36.144197+0000","last_became_peered":"2023-09-30T23:02:36.144197+0000","last_unstale":"2023-09-30T23:02:36.144549+0000","last_undegraded":"2023-09-30T23:02:36.144549+0000","last_fullsized":"2023-09-30T23:02:36.144549+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:09:26.410286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1b","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.142475+0000","last_change":"2023-09-30T23:02:35.145771+0000","last_active":"2023-09-30T23:02:36.142475+0000","last_peered":"2023-09-30T23:02:36.142475+0000","last_clean":"2023-09-30T23:02:36.142475+0000","last_became_active":"2023-09-30T23:02:35.145092+0000","last_became_peered":"2023-09-30T23:02:35.145092+0000","last_unstale":"2023-09-30T23:02:36.142475+0000","last_undegraded":"2023-09-30T23:02:36.142475+0000","last_fullsized":"2023-09-30T23:02:36.142475+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:51:07.060366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.147439+0000","last_change":"2023-09-30T23:02:36.147439+0000","last_active":"2023-09-30T23:02:36.147439+0000","last_peered":"2023-09-30T23:02:36.147439+0000","last_clean":"2023-09-30T23:02:36.147439+0000","last_became_active":"2023-09-30T23:02:36.147231+0000","last_became_peered":"2023-09-30T23:02:36.147231+0000","last_unstale":"2023-09-30T23:02:36.147439+0000","last_undegraded":"2023-09-30T23:02:36.147439+0000","last_fullsized":"2023-09-30T23:02:36.147439+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:09.835622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140551+0000","last_change":"2023-09-30T23:02:35.143787+0000","last_active":"2023-09-30T23:02:36.140551+0000","last_peered":"2023-09-30T23:02:36.140551+0000","last_clean":"2023-09-30T23:02:36.140551+0000","last_became_active":"2023-09-30T23:02:35.143546+0000","last_became_peered":"2023-09-30T23:02:35.143546+0000","last_unstale":"2023-09-30T23:02:36.140551+0000","last_undegraded":"2023-09-30T23:02:36.140551+0000","last_fullsized":"2023-09-30T23:02:36.140551+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:53.123779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145639+0000","last_change":"2023-09-30T23:02:36.145426+0000","last_active":"2023-09-30T23:02:36.145639+0000","last_peered":"2023-09-30T23:02:36.145639+0000","last_clean":"2023-09-30T23:02:36.145639+0000","last_became_active":"2023-09-30T23:02:36.145179+0000","last_became_peered":"2023-09-30T23:02:36.145179+0000","last_unstale":"2023-09-30T23:02:36.145639+0000","last_undegraded":"2023-09-30T23:02:36.145639+0000","last_fullsized":"2023-09-30T23:02:36.145639+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:45:28.707651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.147742+0000","last_change":"2023-09-30T23:02:35.146407+0000","last_active":"2023-09-30T23:02:35.147742+0000","last_peered":"2023-09-30T23:02:35.147742+0000","last_clean":"2023-09-30T23:02:35.147742+0000","last_became_active":"2023-09-30T23:02:35.143539+0000","last_became_peered":"2023-09-30T23:02:35.143539+0000","last_unstale":"2023-09-30T23:02:35.147742+0000","last_undegraded":"2023-09-30T23:02:35.147742+0000","last_fullsized":"2023-09-30T23:02:35.147742+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:13.312340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.147318+0000","last_change":"2023-09-30T23:02:36.147318+0000","last_active":"2023-09-30T23:02:36.147318+0000","last_peered":"2023-09-30T23:02:36.147318+0000","last_clean":"2023-09-30T23:02:36.147318+0000","last_became_active":"2023-09-30T23:02:36.146634+0000","last_became_peered":"2023-09-30T23:02:36.146634+0000","last_unstale":"2023-09-30T23:02:36.147318+0000","last_undegraded":"2023-09-30T23:02:36.147318+0000","last_fullsized":"2023-09-30T23:02:36.147318+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:08:51.639858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.144494+0000","last_change":"2023-09-30T23:02:35.144410+0000","last_active":"2023-09-30T23:02:35.144494+0000","last_peered":"2023-09-30T23:02:35.144494+0000","last_clean":"2023-09-30T23:02:35.144494+0000","last_became_active":"2023-09-30T23:02:35.144045+0000","last_became_peered":"2023-09-30T23:02:35.144045+0000","last_unstale":"2023-09-30T23:02:35.144494+0000","last_undegraded":"2023-09-30T23:02:35.144494+0000","last_fullsized":"2023-09-30T23:02:35.144494+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:40.213645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151009+0000","last_change":"2023-09-30T23:02:36.150799+0000","last_active":"2023-09-30T23:02:36.151009+0000","last_peered":"2023-09-30T23:02:36.151009+0000","last_clean":"2023-09-30T23:02:36.151009+0000","last_became_active":"2023-09-30T23:02:36.150293+0000","last_became_peered":"2023-09-30T23:02:36.150293+0000","last_unstale":"2023-09-30T23:02:36.151009+0000","last_undegraded":"2023-09-30T23:02:36.151009+0000","last_fullsized":"2023-09-30T23:02:36.151009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:45:28.707651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.f","version":"174'1","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140126+0000","last_change":"2023-09-30T23:02:35.146183+0000","last_active":"2023-09-30T23:02:36.140126+0000","last_peered":"2023-09-30T23:02:36.140126+0000","last_clean":"2023-09-30T23:02:36.140126+0000","last_became_active":"2023-09-30T23:02:35.145949+0000","last_became_peered":"2023-09-30T23:02:35.145949+0000","last_unstale":"2023-09-30T23:02:36.140126+0000","last_undegraded":"2023-09-30T23:02:36.140126+0000","last_fullsized":"2023-09-30T23:02:36.140126+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:36:52.310687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.151550+0000","last_change":"2023-09-30T23:02:36.151550+0000","last_active":"2023-09-30T23:02:36.151550+0000","last_peered":"2023-09-30T23:02:36.151550+0000","last_clean":"2023-09-30T23:02:36.151550+0000","last_became_active":"2023-09-30T23:02:36.151307+0000","last_became_peered":"2023-09-30T23:02:36.151307+0000","last_unstale":"2023-09-30T23:02:36.151550+0000","last_undegraded":"2023-09-30T23:02:36.151550+0000","last_fullsized":"2023-09-30T23:02:36.151550+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:41:46.641869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.e","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.163179+0000","last_change":"2023-09-30T23:02:35.143095+0000","last_active":"2023-09-30T23:02:36.163179+0000","last_peered":"2023-09-30T23:02:36.163179+0000","last_clean":"2023-09-30T23:02:36.163179+0000","last_became_active":"2023-09-30T23:02:35.142821+0000","last_became_peered":"2023-09-30T23:02:35.142821+0000","last_unstale":"2023-09-30T23:02:36.163179+0000","last_undegraded":"2023-09-30T23:02:36.163179+0000","last_fullsized":"2023-09-30T23:02:36.163179+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:53.250747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.154090+0000","last_change":"2023-09-30T23:02:36.154090+0000","last_active":"2023-09-30T23:02:36.154090+0000","last_peered":"2023-09-30T23:02:36.154090+0000","last_clean":"2023-09-30T23:02:36.154090+0000","last_became_active":"2023-09-30T23:02:36.153831+0000","last_became_peered":"2023-09-30T23:02:36.153831+0000","last_unstale":"2023-09-30T23:02:36.154090+0000","last_undegraded":"2023-09-30T23:02:36.154090+0000","last_fullsized":"2023-09-30T23:02:36.154090+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:41.220543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.d","version":"174'1","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.158994+0000","last_change":"2023-09-30T23:02:35.137657+0000","last_active":"2023-09-30T23:02:36.158994+0000","last_peered":"2023-09-30T23:02:36.158994+0000","last_clean":"2023-09-30T23:02:36.158994+0000","last_became_active":"2023-09-30T23:02:35.137281+0000","last_became_peered":"2023-09-30T23:02:35.137281+0000","last_unstale":"2023-09-30T23:02:36.158994+0000","last_undegraded":"2023-09-30T23:02:36.158994+0000","last_fullsized":"2023-09-30T23:02:36.158994+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:03:39.598647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148508+0000","last_change":"2023-09-30T23:02:36.148508+0000","last_active":"2023-09-30T23:02:36.148508+0000","last_peered":"2023-09-30T23:02:36.148508+0000","last_clean":"2023-09-30T23:02:36.148508+0000","last_became_active":"2023-09-30T23:02:36.148144+0000","last_became_peered":"2023-09-30T23:02:36.148144+0000","last_unstale":"2023-09-30T23:02:36.148508+0000","last_undegraded":"2023-09-30T23:02:36.148508+0000","last_fullsized":"2023-09-30T23:02:36.148508+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:51.748488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.144109+0000","last_change":"2023-09-30T23:02:35.144043+0000","last_active":"2023-09-30T23:02:35.144109+0000","last_peered":"2023-09-30T23:02:35.144109+0000","last_clean":"2023-09-30T23:02:35.144109+0000","last_became_active":"2023-09-30T23:02:35.143774+0000","last_became_peered":"2023-09-30T23:02:35.143774+0000","last_unstale":"2023-09-30T23:02:35.144109+0000","last_undegraded":"2023-09-30T23:02:35.144109+0000","last_fullsized":"2023-09-30T23:02:35.144109+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:57:38.794830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.152172+0000","last_change":"2023-09-30T23:02:36.152104+0000","last_active":"2023-09-30T23:02:36.152172+0000","last_peered":"2023-09-30T23:02:36.152172+0000","last_clean":"2023-09-30T23:02:36.152172+0000","last_became_active":"2023-09-30T23:02:36.151828+0000","last_became_peered":"2023-09-30T23:02:36.151828+0000","last_unstale":"2023-09-30T23:02:36.152172+0000","last_undegraded":"2023-09-30T23:02:36.152172+0000","last_fullsized":"2023-09-30T23:02:36.152172+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:19:35.593537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.b","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.162758+0000","last_change":"2023-09-30T23:02:35.147443+0000","last_active":"2023-09-30T23:02:36.162758+0000","last_peered":"2023-09-30T23:02:36.162758+0000","last_clean":"2023-09-30T23:02:36.162758+0000","last_became_active":"2023-09-30T23:02:35.146996+0000","last_became_peered":"2023-09-30T23:02:35.146996+0000","last_unstale":"2023-09-30T23:02:36.162758+0000","last_undegraded":"2023-09-30T23:02:36.162758+0000","last_fullsized":"2023-09-30T23:02:36.162758+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:42:18.171977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144403+0000","last_change":"2023-09-30T23:02:36.144322+0000","last_active":"2023-09-30T23:02:36.144403+0000","last_peered":"2023-09-30T23:02:36.144403+0000","last_clean":"2023-09-30T23:02:36.144403+0000","last_became_active":"2023-09-30T23:02:36.144092+0000","last_became_peered":"2023-09-30T23:02:36.144092+0000","last_unstale":"2023-09-30T23:02:36.144403+0000","last_undegraded":"2023-09-30T23:02:36.144403+0000","last_fullsized":"2023-09-30T23:02:36.144403+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:49:32.569005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.143388+0000","last_change":"2023-09-30T23:02:35.143301+0000","last_active":"2023-09-30T23:02:35.143388+0000","last_peered":"2023-09-30T23:02:35.143388+0000","last_clean":"2023-09-30T23:02:35.143388+0000","last_became_active":"2023-09-30T23:02:35.143085+0000","last_became_peered":"2023-09-30T23:02:35.143085+0000","last_unstale":"2023-09-30T23:02:35.143388+0000","last_undegraded":"2023-09-30T23:02:35.143388+0000","last_fullsized":"2023-09-30T23:02:35.143388+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:05:06.861005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150089+0000","last_change":"2023-09-30T23:02:36.149962+0000","last_active":"2023-09-30T23:02:36.150089+0000","last_peered":"2023-09-30T23:02:36.150089+0000","last_clean":"2023-09-30T23:02:36.150089+0000","last_became_active":"2023-09-30T23:02:36.149712+0000","last_became_peered":"2023-09-30T23:02:36.149712+0000","last_unstale":"2023-09-30T23:02:36.150089+0000","last_undegraded":"2023-09-30T23:02:36.150089+0000","last_fullsized":"2023-09-30T23:02:36.150089+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:31.240931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.147233+0000","last_change":"2023-09-30T23:02:35.147119+0000","last_active":"2023-09-30T23:02:35.147233+0000","last_peered":"2023-09-30T23:02:35.147233+0000","last_clean":"2023-09-30T23:02:35.147233+0000","last_became_active":"2023-09-30T23:02:35.146755+0000","last_became_peered":"2023-09-30T23:02:35.146755+0000","last_unstale":"2023-09-30T23:02:35.147233+0000","last_undegraded":"2023-09-30T23:02:35.147233+0000","last_fullsized":"2023-09-30T23:02:35.147233+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:51:19.966381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153391+0000","last_change":"2023-09-30T23:02:36.153391+0000","last_active":"2023-09-30T23:02:36.153391+0000","last_peered":"2023-09-30T23:02:36.153391+0000","last_clean":"2023-09-30T23:02:36.153391+0000","last_became_active":"2023-09-30T23:02:36.153155+0000","last_became_peered":"2023-09-30T23:02:36.153155+0000","last_unstale":"2023-09-30T23:02:36.153391+0000","last_undegraded":"2023-09-30T23:02:36.153391+0000","last_fullsized":"2023-09-30T23:02:36.153391+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:54.257645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.138542+0000","last_change":"2023-09-30T23:02:35.138397+0000","last_active":"2023-09-30T23:02:35.138542+0000","last_peered":"2023-09-30T23:02:35.138542+0000","last_clean":"2023-09-30T23:02:35.138542+0000","last_became_active":"2023-09-30T23:02:35.138127+0000","last_became_peered":"2023-09-30T23:02:35.138127+0000","last_unstale":"2023-09-30T23:02:35.138542+0000","last_undegraded":"2023-09-30T23:02:35.138542+0000","last_fullsized":"2023-09-30T23:02:35.138542+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:09:51.345340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150437+0000","last_change":"2023-09-30T23:02:36.150437+0000","last_active":"2023-09-30T23:02:36.150437+0000","last_peered":"2023-09-30T23:02:36.150437+0000","last_clean":"2023-09-30T23:02:36.150437+0000","last_became_active":"2023-09-30T23:02:36.150214+0000","last_became_peered":"2023-09-30T23:02:36.150214+0000","last_unstale":"2023-09-30T23:02:36.150437+0000","last_undegraded":"2023-09-30T23:02:36.150437+0000","last_fullsized":"2023-09-30T23:02:36.150437+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:08:09.974737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.7","version":"174'2","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.160967+0000","last_change":"2023-09-30T23:02:35.145637+0000","last_active":"2023-09-30T23:02:36.160967+0000","last_peered":"2023-09-30T23:02:36.160967+0000","last_clean":"2023-09-30T23:02:36.160967+0000","last_became_active":"2023-09-30T23:02:35.144755+0000","last_became_peered":"2023-09-30T23:02:35.144755+0000","last_unstale":"2023-09-30T23:02:36.160967+0000","last_undegraded":"2023-09-30T23:02:36.160967+0000","last_fullsized":"2023-09-30T23:02:36.160967+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:54:48.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.149647+0000","last_change":"2023-09-30T23:02:36.149647+0000","last_active":"2023-09-30T23:02:36.149647+0000","last_peered":"2023-09-30T23:02:36.149647+0000","last_clean":"2023-09-30T23:02:36.149647+0000","last_became_active":"2023-09-30T23:02:36.149420+0000","last_became_peered":"2023-09-30T23:02:36.149420+0000","last_unstale":"2023-09-30T23:02:36.149647+0000","last_undegraded":"2023-09-30T23:02:36.149647+0000","last_fullsized":"2023-09-30T23:02:36.149647+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:04:19.557891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.149433+0000","last_change":"2023-09-30T23:02:35.149190+0000","last_active":"2023-09-30T23:02:35.149433+0000","last_peered":"2023-09-30T23:02:35.149433+0000","last_clean":"2023-09-30T23:02:35.149433+0000","last_became_active":"2023-09-30T23:02:35.148631+0000","last_became_peered":"2023-09-30T23:02:35.148631+0000","last_unstale":"2023-09-30T23:02:35.149433+0000","last_undegraded":"2023-09-30T23:02:35.149433+0000","last_fullsized":"2023-09-30T23:02:35.149433+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:51:06.105657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.156283+0000","last_change":"2023-09-30T23:02:36.154272+0000","last_active":"2023-09-30T23:02:36.156283+0000","last_peered":"2023-09-30T23:02:36.156283+0000","last_clean":"2023-09-30T23:02:36.156283+0000","last_became_active":"2023-09-30T23:02:36.153796+0000","last_became_peered":"2023-09-30T23:02:36.153796+0000","last_unstale":"2023-09-30T23:02:36.156283+0000","last_undegraded":"2023-09-30T23:02:36.156283+0000","last_fullsized":"2023-09-30T23:02:36.156283+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:03:21.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.137176+0000","last_change":"2023-09-30T23:02:35.143825+0000","last_active":"2023-09-30T23:02:36.137176+0000","last_peered":"2023-09-30T23:02:36.137176+0000","last_clean":"2023-09-30T23:02:36.137176+0000","last_became_active":"2023-09-30T23:02:35.143274+0000","last_became_peered":"2023-09-30T23:02:35.143274+0000","last_unstale":"2023-09-30T23:02:36.137176+0000","last_undegraded":"2023-09-30T23:02:36.137176+0000","last_fullsized":"2023-09-30T23:02:36.137176+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:07:17.050909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.146319+0000","last_change":"2023-09-30T23:02:36.146319+0000","last_active":"2023-09-30T23:02:36.146319+0000","last_peered":"2023-09-30T23:02:36.146319+0000","last_clean":"2023-09-30T23:02:36.146319+0000","last_became_active":"2023-09-30T23:02:36.146077+0000","last_became_peered":"2023-09-30T23:02:36.146077+0000","last_unstale":"2023-09-30T23:02:36.146319+0000","last_undegraded":"2023-09-30T23:02:36.146319+0000","last_fullsized":"2023-09-30T23:02:36.146319+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T11:00:57.522008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.137621+0000","last_change":"2023-09-30T23:02:35.145968+0000","last_active":"2023-09-30T23:02:36.137621+0000","last_peered":"2023-09-30T23:02:36.137621+0000","last_clean":"2023-09-30T23:02:36.137621+0000","last_became_active":"2023-09-30T23:02:35.145253+0000","last_became_peered":"2023-09-30T23:02:35.145253+0000","last_unstale":"2023-09-30T23:02:36.137621+0000","last_undegraded":"2023-09-30T23:02:36.137621+0000","last_fullsized":"2023-09-30T23:02:36.137621+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:49.897393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150548+0000","last_change":"2023-09-30T23:02:36.150548+0000","last_active":"2023-09-30T23:02:36.150548+0000","last_peered":"2023-09-30T23:02:36.150548+0000","last_clean":"2023-09-30T23:02:36.150548+0000","last_became_active":"2023-09-30T23:02:36.150095+0000","last_became_peered":"2023-09-30T23:02:36.150095+0000","last_unstale":"2023-09-30T23:02:36.150548+0000","last_undegraded":"2023-09-30T23:02:36.150548+0000","last_fullsized":"2023-09-30T23:02:36.150548+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:42.007686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.148091+0000","last_change":"2023-09-30T23:02:35.148024+0000","last_active":"2023-09-30T23:02:35.148091+0000","last_peered":"2023-09-30T23:02:35.148091+0000","last_clean":"2023-09-30T23:02:35.148091+0000","last_became_active":"2023-09-30T23:02:35.147798+0000","last_became_peered":"2023-09-30T23:02:35.147798+0000","last_unstale":"2023-09-30T23:02:35.148091+0000","last_undegraded":"2023-09-30T23:02:35.148091+0000","last_fullsized":"2023-09-30T23:02:35.148091+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:56:28.459132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.150075+0000","last_change":"2023-09-30T23:02:36.150075+0000","last_active":"2023-09-30T23:02:36.150075+0000","last_peered":"2023-09-30T23:02:36.150075+0000","last_clean":"2023-09-30T23:02:36.150075+0000","last_became_active":"2023-09-30T23:02:36.149709+0000","last_became_peered":"2023-09-30T23:02:36.149709+0000","last_unstale":"2023-09-30T23:02:36.150075+0000","last_undegraded":"2023-09-30T23:02:36.150075+0000","last_fullsized":"2023-09-30T23:02:36.150075+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:00.548995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.148256+0000","last_change":"2023-09-30T23:02:35.148178+0000","last_active":"2023-09-30T23:02:35.148256+0000","last_peered":"2023-09-30T23:02:35.148256+0000","last_clean":"2023-09-30T23:02:35.148256+0000","last_became_active":"2023-09-30T23:02:35.147932+0000","last_became_peered":"2023-09-30T23:02:35.147932+0000","last_unstale":"2023-09-30T23:02:35.148256+0000","last_undegraded":"2023-09-30T23:02:35.148256+0000","last_fullsized":"2023-09-30T23:02:35.148256+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:33.696023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148363+0000","last_change":"2023-09-30T23:02:36.148250+0000","last_active":"2023-09-30T23:02:36.148363+0000","last_peered":"2023-09-30T23:02:36.148363+0000","last_clean":"2023-09-30T23:02:36.148363+0000","last_became_active":"2023-09-30T23:02:36.147983+0000","last_became_peered":"2023-09-30T23:02:36.147983+0000","last_unstale":"2023-09-30T23:02:36.148363+0000","last_undegraded":"2023-09-30T23:02:36.148363+0000","last_fullsized":"2023-09-30T23:02:36.148363+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:04:19.557891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148026+0000","last_change":"2023-09-30T23:02:35.146886+0000","last_active":"2023-09-30T23:02:36.148026+0000","last_peered":"2023-09-30T23:02:36.148026+0000","last_clean":"2023-09-30T23:02:36.148026+0000","last_became_active":"2023-09-30T23:02:35.146558+0000","last_became_peered":"2023-09-30T23:02:35.146558+0000","last_unstale":"2023-09-30T23:02:36.148026+0000","last_undegraded":"2023-09-30T23:02:36.148026+0000","last_fullsized":"2023-09-30T23:02:36.148026+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:55:50.741591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140310+0000","last_change":"2023-09-30T23:02:36.140310+0000","last_active":"2023-09-30T23:02:36.140310+0000","last_peered":"2023-09-30T23:02:36.140310+0000","last_clean":"2023-09-30T23:02:36.140310+0000","last_became_active":"2023-09-30T23:02:36.140094+0000","last_became_peered":"2023-09-30T23:02:36.140094+0000","last_unstale":"2023-09-30T23:02:36.140310+0000","last_undegraded":"2023-09-30T23:02:36.140310+0000","last_fullsized":"2023-09-30T23:02:36.140310+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:11:44.288405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145735+0000","last_change":"2023-09-30T23:02:35.145220+0000","last_active":"2023-09-30T23:02:35.145735+0000","last_peered":"2023-09-30T23:02:35.145735+0000","last_clean":"2023-09-30T23:02:35.145735+0000","last_became_active":"2023-09-30T23:02:35.143255+0000","last_became_peered":"2023-09-30T23:02:35.143255+0000","last_unstale":"2023-09-30T23:02:35.145735+0000","last_undegraded":"2023-09-30T23:02:35.145735+0000","last_fullsized":"2023-09-30T23:02:35.145735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:42:18.171977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.153530+0000","last_change":"2023-09-30T23:02:36.153530+0000","last_active":"2023-09-30T23:02:36.153530+0000","last_peered":"2023-09-30T23:02:36.153530+0000","last_clean":"2023-09-30T23:02:36.153530+0000","last_became_active":"2023-09-30T23:02:36.153126+0000","last_became_peered":"2023-09-30T23:02:36.153126+0000","last_unstale":"2023-09-30T23:02:36.153530+0000","last_undegraded":"2023-09-30T23:02:36.153530+0000","last_fullsized":"2023-09-30T23:02:36.153530+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:01:57.404238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"174'2","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.159268+0000","last_change":"2023-09-30T23:02:35.146120+0000","last_active":"2023-09-30T23:02:36.159268+0000","last_peered":"2023-09-30T23:02:36.159268+0000","last_clean":"2023-09-30T23:02:36.159268+0000","last_became_active":"2023-09-30T23:02:35.145626+0000","last_became_peered":"2023-09-30T23:02:35.145626+0000","last_unstale":"2023-09-30T23:02:36.159268+0000","last_undegraded":"2023-09-30T23:02:36.159268+0000","last_fullsized":"2023-09-30T23:02:36.159268+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:38.859936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":147,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.140952+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:02:35.140952+0000","last_peered":"2023-09-30T23:02:35.140952+0000","last_clean":"2023-09-30T23:02:35.140952+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:02:35.140952+0000","last_undegraded":"2023-09-30T23:02:35.140952+0000","last_fullsized":"2023-09-30T23:02:35.140952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.152283+0000","last_change":"2023-09-30T23:02:36.152283+0000","last_active":"2023-09-30T23:02:36.152283+0000","last_peered":"2023-09-30T23:02:36.152283+0000","last_clean":"2023-09-30T23:02:36.152283+0000","last_became_active":"2023-09-30T23:02:36.151819+0000","last_became_peered":"2023-09-30T23:02:36.151819+0000","last_unstale":"2023-09-30T23:02:36.152283+0000","last_undegraded":"2023-09-30T23:02:36.152283+0000","last_fullsized":"2023-09-30T23:02:36.152283+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:54.257645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"174'3","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.158804+0000","last_change":"2023-09-30T23:02:35.150005+0000","last_active":"2023-09-30T23:02:36.158804+0000","last_peered":"2023-09-30T23:02:36.158804+0000","last_clean":"2023-09-30T23:02:36.158804+0000","last_became_active":"2023-09-30T23:02:35.149729+0000","last_became_peered":"2023-09-30T23:02:35.149729+0000","last_unstale":"2023-09-30T23:02:36.158804+0000","last_undegraded":"2023-09-30T23:02:36.158804+0000","last_fullsized":"2023-09-30T23:02:36.158804+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:12:21.312291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.141561+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:02:36.141561+0000","last_peered":"2023-09-30T23:02:36.141561+0000","last_clean":"2023-09-30T23:02:36.141561+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:02:36.141561+0000","last_undegraded":"2023-09-30T23:02:36.141561+0000","last_fullsized":"2023-09-30T23:02:36.141561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145082+0000","last_change":"2023-09-30T23:02:36.145082+0000","last_active":"2023-09-30T23:02:36.145082+0000","last_peered":"2023-09-30T23:02:36.145082+0000","last_clean":"2023-09-30T23:02:36.145082+0000","last_became_active":"2023-09-30T23:02:36.144813+0000","last_became_peered":"2023-09-30T23:02:36.144813+0000","last_unstale":"2023-09-30T23:02:36.145082+0000","last_undegraded":"2023-09-30T23:02:36.145082+0000","last_fullsized":"2023-09-30T23:02:36.145082+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:14.319238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145784+0000","last_change":"2023-09-30T23:02:35.145485+0000","last_active":"2023-09-30T23:02:35.145784+0000","last_peered":"2023-09-30T23:02:35.145784+0000","last_clean":"2023-09-30T23:02:35.145784+0000","last_became_active":"2023-09-30T23:02:35.144417+0000","last_became_peered":"2023-09-30T23:02:35.144417+0000","last_unstale":"2023-09-30T23:02:35.145784+0000","last_undegraded":"2023-09-30T23:02:35.145784+0000","last_fullsized":"2023-09-30T23:02:35.145784+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:47.088859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":146,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.138623+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:02:35.138623+0000","last_peered":"2023-09-30T23:02:35.138623+0000","last_clean":"2023-09-30T23:02:35.138623+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:02:35.138623+0000","last_undegraded":"2023-09-30T23:02:35.138623+0000","last_fullsized":"2023-09-30T23:02:35.138623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.145886+0000","last_change":"2023-09-30T23:02:36.145886+0000","last_active":"2023-09-30T23:02:36.145886+0000","last_peered":"2023-09-30T23:02:36.145886+0000","last_clean":"2023-09-30T23:02:36.145886+0000","last_became_active":"2023-09-30T23:02:36.145667+0000","last_became_peered":"2023-09-30T23:02:36.145667+0000","last_unstale":"2023-09-30T23:02:36.145886+0000","last_undegraded":"2023-09-30T23:02:36.145886+0000","last_fullsized":"2023-09-30T23:02:36.145886+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:44:29.614764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.14","version":"174'6","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.160692+0000","last_change":"2023-09-30T23:02:35.149658+0000","last_active":"2023-09-30T23:02:36.160692+0000","last_peered":"2023-09-30T23:02:36.160692+0000","last_clean":"2023-09-30T23:02:36.160692+0000","last_became_active":"2023-09-30T23:02:35.149418+0000","last_became_peered":"2023-09-30T23:02:35.149418+0000","last_unstale":"2023-09-30T23:02:36.160692+0000","last_undegraded":"2023-09-30T23:02:36.160692+0000","last_fullsized":"2023-09-30T23:02:36.160692+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:52:35.920814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144624+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:02:36.144624+0000","last_peered":"2023-09-30T23:02:36.144624+0000","last_clean":"2023-09-30T23:02:36.144624+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:02:36.144624+0000","last_undegraded":"2023-09-30T23:02:36.144624+0000","last_fullsized":"2023-09-30T23:02:36.144624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":301,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.139477+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:02:35.139477+0000","last_peered":"2023-09-30T23:02:35.139477+0000","last_clean":"2023-09-30T23:02:35.139477+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:02:35.139477+0000","last_undegraded":"2023-09-30T23:02:35.139477+0000","last_fullsized":"2023-09-30T23:02:35.139477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.148381+0000","last_change":"2023-09-30T23:02:36.148381+0000","last_active":"2023-09-30T23:02:36.148381+0000","last_peered":"2023-09-30T23:02:36.148381+0000","last_clean":"2023-09-30T23:02:36.148381+0000","last_became_active":"2023-09-30T23:02:36.147860+0000","last_became_peered":"2023-09-30T23:02:36.147860+0000","last_unstale":"2023-09-30T23:02:36.148381+0000","last_undegraded":"2023-09-30T23:02:36.148381+0000","last_fullsized":"2023-09-30T23:02:36.148381+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:56.459330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.149584+0000","last_change":"2023-09-30T23:02:35.148323+0000","last_active":"2023-09-30T23:02:35.149584+0000","last_peered":"2023-09-30T23:02:35.149584+0000","last_clean":"2023-09-30T23:02:35.149584+0000","last_became_active":"2023-09-30T23:02:35.148107+0000","last_became_peered":"2023-09-30T23:02:35.148107+0000","last_unstale":"2023-09-30T23:02:35.149584+0000","last_undegraded":"2023-09-30T23:02:35.149584+0000","last_fullsized":"2023-09-30T23:02:35.149584+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:34:22.283843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144077+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:02:36.144077+0000","last_peered":"2023-09-30T23:02:36.144077+0000","last_clean":"2023-09-30T23:02:36.144077+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:02:36.144077+0000","last_undegraded":"2023-09-30T23:02:36.144077+0000","last_fullsized":"2023-09-30T23:02:36.144077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.149679+0000","last_change":"2023-09-30T23:02:36.149115+0000","last_active":"2023-09-30T23:02:36.149679+0000","last_peered":"2023-09-30T23:02:36.149679+0000","last_clean":"2023-09-30T23:02:36.149679+0000","last_became_active":"2023-09-30T23:02:36.148883+0000","last_became_peered":"2023-09-30T23:02:36.148883+0000","last_unstale":"2023-09-30T23:02:36.149679+0000","last_undegraded":"2023-09-30T23:02:36.149679+0000","last_fullsized":"2023-09-30T23:02:36.149679+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:43:09.835622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145752+0000","last_change":"2023-09-30T23:02:35.145261+0000","last_active":"2023-09-30T23:02:35.145752+0000","last_peered":"2023-09-30T23:02:35.145752+0000","last_clean":"2023-09-30T23:02:35.145752+0000","last_became_active":"2023-09-30T23:02:35.145026+0000","last_became_peered":"2023-09-30T23:02:35.145026+0000","last_unstale":"2023-09-30T23:02:35.145752+0000","last_undegraded":"2023-09-30T23:02:35.145752+0000","last_fullsized":"2023-09-30T23:02:35.145752+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:12:44.366992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144006+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:02:36.144006+0000","last_peered":"2023-09-30T23:02:36.144006+0000","last_clean":"2023-09-30T23:02:36.144006+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:02:36.144006+0000","last_undegraded":"2023-09-30T23:02:36.144006+0000","last_fullsized":"2023-09-30T23:02:36.144006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.144559+0000","last_change":"2023-09-30T23:02:36.144559+0000","last_active":"2023-09-30T23:02:36.144559+0000","last_peered":"2023-09-30T23:02:36.144559+0000","last_clean":"2023-09-30T23:02:36.144559+0000","last_became_active":"2023-09-30T23:02:36.144329+0000","last_became_peered":"2023-09-30T23:02:36.144329+0000","last_unstale":"2023-09-30T23:02:36.144559+0000","last_undegraded":"2023-09-30T23:02:36.144559+0000","last_fullsized":"2023-09-30T23:02:36.144559+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:04:57.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-09-30T23:02:35.145768+0000","last_change":"2023-09-30T23:02:35.145331+0000","last_active":"2023-09-30T23:02:35.145768+0000","last_peered":"2023-09-30T23:02:35.145768+0000","last_clean":"2023-09-30T23:02:35.145768+0000","last_became_active":"2023-09-30T23:02:35.144081+0000","last_became_peered":"2023-09-30T23:02:35.144081+0000","last_unstale":"2023-09-30T23:02:35.145768+0000","last_undegraded":"2023-09-30T23:02:35.145768+0000","last_fullsized":"2023-09-30T23:02:35.145768+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:23:07.270336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.136444+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:02:36.136444+0000","last_peered":"2023-09-30T23:02:36.136444+0000","last_clean":"2023-09-30T23:02:36.136444+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:02:36.136444+0000","last_undegraded":"2023-09-30T23:02:36.136444+0000","last_fullsized":"2023-09-30T23:02:36.136444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.140377+0000","last_change":"2023-09-30T23:02:36.140286+0000","last_active":"2023-09-30T23:02:36.140377+0000","last_peered":"2023-09-30T23:02:36.140377+0000","last_clean":"2023-09-30T23:02:36.140377+0000","last_became_active":"2023-09-30T23:02:36.140067+0000","last_became_peered":"2023-09-30T23:02:36.140067+0000","last_unstale":"2023-09-30T23:02:36.140377+0000","last_undegraded":"2023-09-30T23:02:36.140377+0000","last_fullsized":"2023-09-30T23:02:36.140377+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:35.121800+0000","last_clean_scrub_stamp":"2023-09-30T23:02:35.121800+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:31.240931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.10","version":"174'8","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.162912+0000","last_change":"2023-09-30T23:02:35.149345+0000","last_active":"2023-09-30T23:02:36.162912+0000","last_peered":"2023-09-30T23:02:36.162912+0000","last_clean":"2023-09-30T23:02:36.162912+0000","last_became_active":"2023-09-30T23:02:35.148968+0000","last_became_peered":"2023-09-30T23:02:35.148968+0000","last_unstale":"2023-09-30T23:02:36.162912+0000","last_undegraded":"2023-09-30T23:02:36.162912+0000","last_fullsized":"2023-09-30T23:02:36.162912+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:02:34.114903+0000","last_clean_scrub_stamp":"2023-09-30T23:02:34.114903+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:48:29.008283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-09-30T23:02:36.141491+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:02:36.141491+0000","last_peered":"2023-09-30T23:02:36.141491+0000","last_clean":"2023-09-30T23:02:36.141491+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:02:36.141491+0000","last_undegraded":"2023-09-30T23:02:36.141491+0000","last_fullsized":"2023-09-30T23:02:36.141491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.499,"5min":0.33900000000000002,"15min":0.315},"max":{"1min":0.96199999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.52900000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.42099999999999999,"15min":0.36599999999999999},"max":{"1min":0.91500000000000004,"5min":1.004,"15min":1.004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.57399999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.44}]},{"osd":2,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.47099999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85999999999999999,"5min":0.98499999999999999,"15min":0.99099999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73699999999999999,"15min":0.73199999999999998},"min":{"1min":0.60799999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.999,"5min":0.999,"15min":1.0209999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.53800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91100000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70999999999999996,"15min":0.69699999999999995},"min":{"1min":0.51300000000000001,"5min":0.50700000000000001,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":0.96599999999999997,"15min":1.056},"last":0.66200000000000003}]},{"osd":4,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.629,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.38600000000000001},"max":{"1min":0.92000000000000004,"5min":0.94199999999999995,"15min":0.95999999999999996},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.61399999999999999},"min":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.35999999999999999},"max":{"1min":0.878,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.59199999999999997}]},{"osd":5,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.443,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.135},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.41199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.004},"last":0.40100000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.99099999999999999,"5min":1.016,"15min":1.071},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961894,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.86399999999999999},"min":{"1min":0.58299999999999996,"5min":0.40500000000000003,"15min":0.29299999999999998},"max":{"1min":0.93700000000000006,"5min":0.99099999999999999,"15min":6.5190000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73699999999999999,"15min":0.77300000000000002},"min":{"1min":0.57999999999999996,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":1.0269999999999999,"5min":2.5710000000000002,"15min":4.3680000000000003},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72299999999999998,"15min":0.78900000000000003},"min":{"1min":0.67100000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.123,"5min":1.123,"15min":3.6339999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.72899999999999998,"15min":0.89400000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42099999999999999},"max":{"1min":0.91400000000000003,"5min":1.073,"15min":8.4339999999999993},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70499999999999996,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.0029999999999999,"15min":3.4580000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74399999999999999,"15min":0.89800000000000002},"min":{"1min":0.65000000000000002,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.89700000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0660000000000001,"5min":1.343,"15min":5.7110000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.96599999999999997,"5min":1.036,"15min":1.5249999999999999},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.876,"5min":0.99299999999999999,"15min":3.4670000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":1.2909999999999999,"15min":5.9279999999999999},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.88300000000000001,"5min":1.05,"15min":1.321},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98999999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.92300000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.48099999999999998},"max":{"1min":0.97699999999999998,"5min":1.018,"15min":6.0599999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.1140000000000001,"15min":1.3620000000000001},"last":0.88}]}]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1590,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193722,"statfs":{"total":200000000,"available":198371574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41699999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.65600000000000003,"15min":1.083},"last":0.371},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.46600000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.29999999999999999},"max":{"1min":0.67000000000000004,"5min":0.67100000000000004,"15min":0.745},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.438},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49399999999999999,"15min":0.48499999999999999},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.65600000000000003,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.53500000000000003},"min":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.40799999999999997,"5min":0.307,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.70299999999999996},"min":{"1min":0.503,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97199999999999998,"5min":1.091,"15min":1.091},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.01,"15min":1.1000000000000001},"last":0.70999999999999996}]},{"osd":5,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.72899999999999998},"min":{"1min":0.56599999999999995,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.1499999999999999,"15min":1.22},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.752,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.008,"5min":1.048,"15min":1.3560000000000001},"last":0.60599999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.497,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":1.1160000000000001,"15min":1.127},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.74399999999999999},"min":{"1min":0.57699999999999996,"5min":0.51000000000000001,"15min":0.48099999999999998},"max":{"1min":0.86499999999999999,"5min":1.0529999999999999,"15min":1.4059999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Sep 30 23:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.59799999999999998,"5min":0.57299999999999995,"15min":0.51800000000000002},"max":{"1min":1.034,"5min":1.109,"15min":1.1240000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79800000000000004,"15min":0.78200000000000003},"min":{"1min":0.629,"5min":0.504,"15min":0.504},"max":{"1min":0.95199999999999996,"5min":1.022,"15min":1.3779999999999999},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.43099999999999999,"15min":0.42299999999999999},"min":{"1min":0.33100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.68600000000000005,"15min":0.85699999999999998},"last":0.372},{"interface":"front","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.45500000000000002},"min":{"1min":0.38100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64800000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.26800000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.75600000000000001,"15min":1.0289999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.44500000000000001,"5min":0.34399999999999997,"15min":0.30499999999999999},"max":{"1min":0.72599999999999998,"5min":0.79300000000000004,"15min":0.879},"last":0.312}]},{"osd":3,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.40999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58099999999999996,"5min":0.76500000000000001,"15min":1.0029999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.51300000000000001},"min":{"1min":0.42699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72999999999999998,"5min":0.96799999999999997,"15min":0.98899999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.63100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.141,"15min":1.27},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60199999999999998,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0600000000000001,"15min":1.171},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.622,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98999999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.873},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":0.73899999999999999},"min":{"1min":0.59699999999999998,"5min":0.504,"15min":0.504},"max":{"1min":0.98399999999999999,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.434},"max":{"1min":0.96699999999999997,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.84799999999999998,"15min":0.76900000000000002},"min":{"1min":0.622,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94499999999999995,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79000000000000004,"15min":0.753},"min":{"1min":0.58199999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0129999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81200000000000006,"15min":0.77400000000000002},"min":{"1min":0.60499999999999998,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.0189999999999999,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.437,"15min":0.40200000000000002},"min":{"1min":0.29399999999999998,"5min":0.24199999999999999,"15min":0.23599999999999999},"max":{"1min":0.77400000000000002,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.45000000000000001},"min":{"1min":0.33800000000000002,"5min":0.30399999999999999,"15min":0.249},"max":{"1min":0.71899999999999997,"5min":1.542,"15min":1.542},"last":0.497}]},{"osd":1,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69999999999999996,"5min":1.494,"15min":1.494},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.52000000000000002},"min":{"1min":0.46300000000000002,"5min":0.35199999999999998,"15min":0.29599999999999999},"max":{"1min":0.746,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.46600000000000003},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72199999999999998,"5min":1.649,"15min":1.649},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.42599999999999999,"5min":0.35599999999999998,"15min":0.309},"max":{"1min":0.82399999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80400000000000005,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.501,"15min":0.44400000000000001},"max":{"1min":1.0600000000000001,"5min":1.234,"15min":1.234},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.45900000000000002,"15min":0.38},"max":{"1min":1.1419999999999999,"5min":1.163,"15min":1.4910000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80800000000000005,"15min":0.78900000000000003},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.45200000000000001},"max":{"1min":1.0469999999999999,"5min":1.1459999999999999,"15min":1.179},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.075,"5min":1.117,"15min":2.7320000000000002},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.76500000000000001},"min":{"1min":0.57199999999999995,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.0269999999999999,"5min":1.115,"15min":1.615},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55200000000000005,"15min":0.50800000000000001},"max":{"1min":1.109,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.746}]},{"osd":7,"last update":"Sat Sep 30 23:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.59299999999999997,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.0880000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77500000000000002,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.439},"max":{"1min":1.1279999999999999,"5min":1.1890000000000001,"15min":2.7730000000000001},"last":0.61899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198960428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.41099999999999998},"min":{"1min":0.32400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52500000000000002,"5min":0.63300000000000001,"15min":1.1519999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.41199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":1.919},"last":0.39300000000000002}]},{"osd":1,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.254},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.38600000000000001,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":0.748,"5min":0.748,"15min":1.9390000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.437,"5min":0.36799999999999999,"15min":0.33500000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":1.6020000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.35499999999999998},"max":{"1min":0.69899999999999995,"5min":0.96199999999999997,"15min":1.5309999999999999},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.53800000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91600000000000004,"5min":1.0569999999999999,"15min":1.401},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.96799999999999997,"5min":1.1539999999999999,"15min":3.306},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.752,"15min":0.753},"min":{"1min":0.55000000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":1.0880000000000001,"15min":1.508},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":0.93300000000000005,"5min":1.044,"15min":1.4910000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.57899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90300000000000002,"5min":0.96299999999999997,"15min":1.5620000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.61399999999999999,"5min":0.48399999999999999,"15min":0.48099999999999998},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.3140000000000001},"last":0.75}]},{"osd":7,"last update":"Sat Sep 30 23:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.48799999999999999},"max":{"1min":0.94999999999999996,"5min":1.135,"15min":1.3640000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.69499999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89900000000000002,"5min":1.081,"15min":1.573},"last":0.85599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574974,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.60899999999999999},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":1.022},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66600000000000004,"15min":0.61899999999999999},"min":{"1min":0.45400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.93300000000000005},"last":0.67600000000000005}]},{"osd":1,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.64000000000000001},"min":{"1min":0.54100000000000004,"5min":0.44500000000000001,"15min":0.38800000000000001},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67000000000000004,"15min":0.64000000000000001},"min":{"1min":0.53700000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.55300000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98699999999999999,"5min":1.492,"15min":1.492},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.749,"15min":0.70399999999999996},"min":{"1min":0.63500000000000001,"5min":0.53400000000000003,"15min":0.442},"max":{"1min":0.96599999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.67500000000000004},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.71199999999999997},"min":{"1min":0.56399999999999995,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":1.0620000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.624}]},{"osd":5,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66100000000000003,"15min":0.65400000000000003},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.84999999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.47199999999999998,"5min":0.371,"15min":0.37},"max":{"1min":0.91300000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":1.45,"15min":1.45},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.57499999999999996,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.82699999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.45700000000000002},"max":{"1min":0.872,"5min":0.98599999999999999,"15min":1.016},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.503,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65200000000000002,"15min":0.61799999999999999},"min":{"1min":0.50900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.877,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.57599999999999996,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88900000000000001,"5min":1.008,"15min":1.008},"last":0.753}]},{"osd":1,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.64200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88200000000000001,"5min":0.91300000000000003,"15min":0.97899999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68300000000000005,"15min":0.67000000000000004},"min":{"1min":0.59299999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91000000000000003,"5min":1.0369999999999999,"15min":1.0449999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68799999999999994,"15min":0.65300000000000002},"min":{"1min":0.63300000000000001,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.84199999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.54600000000000004,"5min":0.45900000000000002,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.95899999999999996,"15min":1.044},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.53800000000000003,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.95899999999999996,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70399999999999996,"15min":0.67000000000000004},"min":{"1min":0.57999999999999996,"5min":0.46800000000000003,"15min":0.442},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":0.97599999999999998},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.42299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75700000000000001,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84699999999999998,"5min":1.081,"15min":1.081},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.35199999999999998},"max":{"1min":0.88300000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.45600000000000002,"5min":0.39200000000000002,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":1.03,"15min":1.03},"last":0.86599999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73299999999999998,"15min":0.71399999999999997},"min":{"1min":0.55600000000000005,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":1.083,"15min":1.083},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.89100000000000001}]}]}],"pool_statfs":[]}} 2023-09-30T23:02:41.400 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T23:02:41.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T23:02:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.629+0000 7fce913ff700 1 Processor -- start 2023-09-30T23:02:41.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.629+0000 7fce913ff700 1 -- start start 2023-09-30T23:02:41.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.630+0000 7fce913ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fce8c159ba0 0x7fce8c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.630+0000 7fce913ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce8c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.630+0000 7fce913ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c067d10 con 0x7fce8c0ca410 2023-09-30T23:02:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.630+0000 7fce913ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c0ca850 con 0x7fce8c159ba0 2023-09-30T23:02:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.630+0000 7fce913ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c06af90 con 0x7fce8c0b0de0 2023-09-30T23:02:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce8b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fce8c0ca410 0x7fce8c15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50172/0 (socket says 172.21.15.142:50172) 2023-09-30T23:02:41.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce8b7fe700 1 -- 172.21.15.142:0/3578962436 learned_addr learned my addr 172.21.15.142:0/3578962436 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce8affd700 1 --2- 172.21.15.142:0/3578962436 >> v2:172.21.15.148:3300/0 conn(0x7fce8c159ba0 0x7fce8c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce8a7fc700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce8c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750628949 0 0) 0x7fce8c067d10 con 0x7fce8c0ca410 2023-09-30T23:02:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce74003570 con 0x7fce8c0ca410 2023-09-30T23:02:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201974754 0 0) 0x7fce74003570 con 0x7fce8c0ca410 2023-09-30T23:02:41.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 msgr2=0x7fce8c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce8c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 >> v2:172.21.15.148:3300/0 conn(0x7fce8c159ba0 msgr2=0x7fce8c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 --2- 172.21.15.142:0/3578962436 >> v2:172.21.15.148:3300/0 conn(0x7fce8c159ba0 0x7fce8c06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0676c0 con 0x7fce8c0ca410 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.631+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fce840017f0 con 0x7fce8c0ca410 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 >> v1:172.21.15.142:6789/0 conn(0x7fce8c0ca410 legacy=0x7fce8c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce89ffb700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce74003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce89ffb700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce740040b0 0x7fce74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce89ffb700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74004d50 0x7fce740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0ca850 con 0x7fce74004d50 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c06af90 con 0x7fce740040b0 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7400bb60 con 0x7fce8c0b0de0 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8b7fe700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74004d50 0x7fce740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8affd700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce74003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8a7fc700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce740040b0 0x7fce74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8affd700 1 -- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce740040b0 msgr2=0x7fce74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8affd700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce740040b0 0x7fce74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8affd700 1 -- 172.21.15.142:0/3578962436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74004d50 msgr2=0x7fce740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:41.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8affd700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74004d50 0x7fce740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.632+0000 7fce8affd700 1 -- 172.21.15.142:0/3578962436 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74003570 con 0x7fce8c0b0de0 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce8affd700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce74003ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006f00 tx=0x7fce7c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9086bf8f3afbec20 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00e710 con 0x7fce8c0b0de0 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c00e870 con 0x7fce8c0b0de0 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce89ffb700 1 -- 172.21.15.142:0/3578962436 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00ec30 con 0x7fce8c0b0de0 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce913ff700 1 -- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 msgr2=0x7fce74003ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce913ff700 1 --2- 172.21.15.142:0/3578962436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce74003ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006f00 tx=0x7fce7c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce8b7fe700 1 -- 172.21.15.142:0/3578962436 reap_dead start 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce913ff700 1 -- 172.21.15.142:0/3578962436 shutdown_connections 2023-09-30T23:02:41.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce913ff700 1 -- 172.21.15.142:0/3578962436 >> 172.21.15.142:0/3578962436 conn(0x7fce8c0cb2f0 msgr2=0x7fce8c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.633+0000 7fce913ff700 1 -- 172.21.15.142:0/3578962436 shutdown_connections 2023-09-30T23:02:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.634+0000 7fce913ff700 1 -- 172.21.15.142:0/3578962436 wait complete. 2023-09-30T23:02:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.635+0000 7fce913ff700 1 Processor -- start 2023-09-30T23:02:41.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.635+0000 7fce913ff700 1 -- start start 2023-09-30T23:02:41.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce913ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce8c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce913ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c0aaea0 0x7fce8c0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce913ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c0c7fc0 0x7fce8c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce913ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c157710 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce913ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0c8460 con 0x7fce8c0aaea0 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce913ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15aea0 con 0x7fce8c0b0de0 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce8b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c0c7fc0 0x7fce8c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce8b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c0c7fc0 0x7fce8c15a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33238/0 (socket says 172.21.15.142:33238) 2023-09-30T23:02:41.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce8b7fe700 1 -- 172.21.15.142:0/523172455 learned_addr learned my addr 172.21.15.142:0/523172455 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce8affd700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce8c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.636+0000 7fce8a7fc700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c0aaea0 0x7fce8c0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce8b7fe700 1 -- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 msgr2=0x7fce8c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce8b7fe700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce8c1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce8b7fe700 1 -- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c0aaea0 msgr2=0x7fce8c0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce8b7fe700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c0aaea0 0x7fce8c0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce8b7fe700 1 -- 172.21.15.142:0/523172455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0aa0e0 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce8a7fc700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c0aaea0 0x7fce8c0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce8b7fe700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c0c7fc0 0x7fce8c15a130 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fce8c06c820 tx=0x7fce84002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:41.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce72ffd700 1 -- 172.21.15.142:0/523172455 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400ad80 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce72ffd700 1 -- 172.21.15.142:0/523172455 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840133f0 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c0aa3c0 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce72ffd700 1 -- 172.21.15.142:0/523172455 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840137b0 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.637+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c0aa980 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.638+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c0b3ae0 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.639+0000 7fce72ffd700 1 -- 172.21.15.142:0/523172455 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fce84013b60 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.640+0000 7fce72ffd700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce78067330 0x7fce780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.640+0000 7fce72ffd700 1 -- 172.21.15.142:0/523172455 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce84085790 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.640+0000 7fce8affd700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce78067330 0x7fce780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.641+0000 7fce8affd700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce78067330 0x7fce780697e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0091e0 tx=0x7fce7c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:41.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.644+0000 7fce72ffd700 1 -- 172.21.15.142:0/523172455 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fce840525f0 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.904+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fce8c0679a0 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.909+0000 7fce72ffd700 1 -- 172.21.15.142:0/523172455 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fce84055c10 con 0x7fce8c0c7fc0 2023-09-30T23:02:41.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.911+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce78067330 msgr2=0x7fce780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.911+0000 7fce913ff700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce78067330 0x7fce780697e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0091e0 tx=0x7fce7c01a000 comp rx=0 tx=0).stop 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.911+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c0c7fc0 msgr2=0x7fce8c15a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.911+0000 7fce913ff700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c0c7fc0 0x7fce8c15a130 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fce8c06c820 tx=0x7fce84002140 comp rx=0 tx=0).stop 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 shutdown_connections 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fce78067330 0x7fce780697e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c0c7fc0 0x7fce8c15a130 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce8c0b0de0 0x7fce8c1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 --2- 172.21.15.142:0/523172455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce8c0aaea0 0x7fce8c0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 >> 172.21.15.142:0/523172455 conn(0x7fce8c0cb2f0 msgr2=0x7fce8c0cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 shutdown_connections 2023-09-30T23:02:41.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:41.912+0000 7fce913ff700 1 -- 172.21.15.142:0/523172455 wait complete. 2023-09-30T23:02:41.913 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T23:02:41.929 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:42.108 INFO:tasks.ceph.mds.c.smithi142.stderr:2023-09-30T23:02:42.108+0000 7f52adbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T23:02:42.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.117+0000 7f809bdff700 1 Processor -- start 2023-09-30T23:02:42.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.118+0000 7f809bdff700 1 -- start start 2023-09-30T23:02:42.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809bdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80940b1180 0x7f80940cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809bdff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8094159eb0 0x7f80940cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809bdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809415d910 con 0x7f8094159ae0 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809bdff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809415e920 con 0x7f8094159eb0 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809bdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809415e490 con 0x7f80940b1180 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809a39c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8094159eb0 0x7f80940cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809a39c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8094159eb0 0x7f80940cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33250/0 (socket says 172.21.15.142:33250) 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809a39c700 1 -- 172.21.15.142:0/1659901227 learned_addr learned my addr 172.21.15.142:0/1659901227 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809939a700 1 --2- 172.21.15.142:0/1659901227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80940b1180 0x7f80940cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809a39c700 1 -- 172.21.15.142:0/1659901227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80940b1180 msgr2=0x7f80940cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:42.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809a39c700 1 --2- 172.21.15.142:0/1659901227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80940b1180 0x7f80940cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809a39c700 1 -- 172.21.15.142:0/1659901227 >> v1:172.21.15.148:6789/0 conn(0x7f8094159ae0 legacy=0x7f80940cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.119+0000 7f809a39c700 1 -- 172.21.15.142:0/1659901227 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940ce5c0 con 0x7f8094159eb0 2023-09-30T23:02:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.120+0000 7f809939a700 1 --2- 172.21.15.142:0/1659901227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80940b1180 0x7f80940cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.120+0000 7f809a39c700 1 --2- 172.21.15.142:0/1659901227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8094159eb0 0x7f80940cc3c0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f808c009f20 tx=0x7f808c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98906e0b0211d837 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.120+0000 7f8098b99700 1 -- 172.21.15.142:0/1659901227 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00e070 con 0x7f8094159eb0 2023-09-30T23:02:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.120+0000 7f8098b99700 1 -- 172.21.15.142:0/1659901227 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00ba80 con 0x7f8094159eb0 2023-09-30T23:02:42.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.120+0000 7f8098b99700 1 -- 172.21.15.142:0/1659901227 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0092e0 con 0x7f8094159eb0 2023-09-30T23:02:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.120+0000 7f809bdff700 1 -- 172.21.15.142:0/1659901227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8094159eb0 msgr2=0x7f80940cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.120+0000 7f809bdff700 1 --2- 172.21.15.142:0/1659901227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8094159eb0 0x7f80940cc3c0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f808c009f20 tx=0x7f808c009840 comp rx=0 tx=0).stop 2023-09-30T23:02:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.121+0000 7f809bdff700 1 -- 172.21.15.142:0/1659901227 shutdown_connections 2023-09-30T23:02:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.121+0000 7f809bdff700 1 --2- 172.21.15.142:0/1659901227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8094159eb0 0x7f80940cc3c0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.121+0000 7f809bdff700 1 --2- 172.21.15.142:0/1659901227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80940b1180 0x7f80940cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.121+0000 7f809bdff700 1 -- 172.21.15.142:0/1659901227 >> 172.21.15.142:0/1659901227 conn(0x7f80940ce8b0 msgr2=0x7f80940cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.121+0000 7f809bdff700 1 -- 172.21.15.142:0/1659901227 shutdown_connections 2023-09-30T23:02:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.121+0000 7f809bdff700 1 -- 172.21.15.142:0/1659901227 wait complete. 2023-09-30T23:02:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.122+0000 7f809bdff700 1 Processor -- start 2023-09-30T23:02:42.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.122+0000 7f809bdff700 1 -- start start 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f809bdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80940b1180 0x7f80940afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f809bdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8094159ae0 0x7f8094155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f809bdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8094159eb0 0x7f80940c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f809bdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80940c8cf0 con 0x7f80940b1180 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f809bdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80940c80e0 con 0x7f8094159ae0 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f809bdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80940c83c0 con 0x7f8094159eb0 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f8099b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80940b1180 0x7f80940afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f8099b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80940b1180 0x7f80940afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33254/0 (socket says 172.21.15.142:33254) 2023-09-30T23:02:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.123+0000 7f8099b9b700 1 -- 172.21.15.142:0/1944834336 learned_addr learned my addr 172.21.15.142:0/1944834336 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f809a39c700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8094159eb0 0x7f80940c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f809939a700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8094159ae0 0x7f8094155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8099b9b700 1 -- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8094159eb0 msgr2=0x7f80940c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8099b9b700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8094159eb0 0x7f80940c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8099b9b700 1 -- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8094159ae0 msgr2=0x7f8094155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8099b9b700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8094159ae0 0x7f8094155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8099b9b700 1 -- 172.21.15.142:0/1944834336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009ae0 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8099b9b700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80940b1180 0x7f80940afdd0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f809000c590 tx=0x7f809000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8089ffb700 1 -- 172.21.15.142:0/1944834336 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090011590 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8089ffb700 1 -- 172.21.15.142:0/1944834336 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80900116f0 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80940c86a0 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f8089ffb700 1 -- 172.21.15.142:0/1944834336 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090011ab0 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.124+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80940b0310 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.125+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80940c8fd0 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.126+0000 7f8089ffb700 1 -- 172.21.15.142:0/1944834336 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f809001b3b0 con 0x7f80940b1180 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.127+0000 7f8089ffb700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8078067330 0x7f80780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.127+0000 7f8089ffb700 1 -- 172.21.15.142:0/1944834336 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80900841c0 con 0x7f80940b1180 2023-09-30T23:02:42.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.128+0000 7f809939a700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8078067330 0x7f80780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.128+0000 7f809939a700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8078067330 0x7f80780697e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8084006f00 tx=0x7f8084008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:42.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.131+0000 7f8089ffb700 1 -- 172.21.15.142:0/1944834336 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8090051020 con 0x7f80940b1180 2023-09-30T23:02:42.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.365+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f809415db60 con 0x7f80940b1180 2023-09-30T23:02:42.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.365+0000 7f8089ffb700 1 -- 172.21.15.142:0/1944834336 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4613 (secure 0 0 0) 0x7f8090054640 con 0x7f80940b1180 2023-09-30T23:02:42.365 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:42.365 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:02:35.609202+0000","modified":"2023-09-30T23:02:39.164928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3571686386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3571686386},{"type":"v1","addr":"172.21.15.142:6837","nonce":3571686386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8078067330 msgr2=0x7f80780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8078067330 0x7f80780697e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8084006f00 tx=0x7f8084008040 comp rx=0 tx=0).stop 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80940b1180 msgr2=0x7f80940afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80940b1180 0x7f80940afdd0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f809000c590 tx=0x7f809000c950 comp rx=0 tx=0).stop 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 shutdown_connections 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8078067330 0x7f80780697e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8094159eb0 0x7f80940c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80940b1180 0x7f80940afdd0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 --2- 172.21.15.142:0/1944834336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8094159ae0 0x7f8094155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 >> 172.21.15.142:0/1944834336 conn(0x7f80940ce8b0 msgr2=0x7f80940b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 shutdown_connections 2023-09-30T23:02:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.368+0000 7f809bdff700 1 -- 172.21.15.142:0/1944834336 wait complete. 2023-09-30T23:02:42.369 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 83 2023-09-30T23:02:42.787 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T23:02:35.609202+0000', 'modified': '2023-09-30T23:02:39.164928+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7989}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7989': {'gid': 7989, 'name': 'c', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/3571686386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6836', 'nonce': 3571686386}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 3571686386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T23:02:42.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T23:02:42.788 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-30T23:02:42.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.978+0000 7f0e431ff700 1 Processor -- start 2023-09-30T23:02:42.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.978+0000 7f0e431ff700 1 -- start start 2023-09-30T23:02:42.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.979+0000 7f0e431ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.979+0000 7f0e431ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0b0ee0 con 0x7f0e3c15a2a0 2023-09-30T23:02:42.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.979+0000 7f0e431ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0b02d0 con 0x7f0e3c06f190 2023-09-30T23:02:42.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.979+0000 7f0e431ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0aefc0 con 0x7f0e3c0aebf0 2023-09-30T23:02:42.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.979+0000 7f0e4179c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0e3c15a2a0 0x7f0e3c069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50188/0 (socket says 172.21.15.142:50188) 2023-09-30T23:02:42.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.979+0000 7f0e4179c700 1 -- 172.21.15.142:0/507173186 learned_addr learned my addr 172.21.15.142:0/507173186 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:42.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/507173186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399699259 0 0) 0x7f0e3c0b0ee0 con 0x7f0e3c15a2a0 2023-09-30T23:02:42.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c003570 con 0x7f0e3c15a2a0 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737972911 0 0) 0x7f0e3c0b02d0 con 0x7f0e3c06f190 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e3c0b0ee0 con 0x7f0e3c06f190 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2626999707 0 0) 0x7f0e2c003570 con 0x7f0e3c15a2a0 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e40f9b700 1 -- 172.21.15.142:0/507173186 >> v1:172.21.15.148:6789/0 conn(0x7f0e3c06f190 legacy=0x7f0e3c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e40f9b700 1 -- 172.21.15.142:0/507173186 >> v1:172.21.15.142:6789/0 conn(0x7f0e3c15a2a0 legacy=0x7f0e3c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.980+0000 7f0e40f9b700 1 -- 172.21.15.142:0/507173186 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0b05b0 con 0x7f0e3c0aebf0 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.981+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/507173186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c06ec50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000aac0 tx=0x7f0e3000a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b66f1ee9991a709 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.981+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340017f0 con 0x7f0e3c0aebf0 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.981+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000c660 con 0x7f0e3c0aebf0 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.981+0000 7f0e3b7fe700 1 -- 172.21.15.142:0/507173186 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000c9e0 con 0x7f0e3c0aebf0 2023-09-30T23:02:42.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.981+0000 7f0e431ff700 1 -- 172.21.15.142:0/507173186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 msgr2=0x7f0e3c06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.981+0000 7f0e431ff700 1 --2- 172.21.15.142:0/507173186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c06ec50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000aac0 tx=0x7f0e3000a330 comp rx=0 tx=0).stop 2023-09-30T23:02:42.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.982+0000 7f0e431ff700 1 -- 172.21.15.142:0/507173186 shutdown_connections 2023-09-30T23:02:42.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.982+0000 7f0e431ff700 1 --2- 172.21.15.142:0/507173186 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c06ec50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.982+0000 7f0e431ff700 1 -- 172.21.15.142:0/507173186 >> 172.21.15.142:0/507173186 conn(0x7f0e3c0680c0 msgr2=0x7f0e3c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:42.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.982+0000 7f0e431ff700 1 -- 172.21.15.142:0/507173186 shutdown_connections 2023-09-30T23:02:42.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.982+0000 7f0e431ff700 1 -- 172.21.15.142:0/507173186 wait complete. 2023-09-30T23:02:42.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.983+0000 7f0e431ff700 1 Processor -- start 2023-09-30T23:02:42.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.983+0000 7f0e431ff700 1 -- start start 2023-09-30T23:02:42.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e431ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c06f190 0x7f0e3c165ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e431ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c168cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e431ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c14fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e431ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c166400 con 0x7f0e3c06f190 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e431ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c150d40 con 0x7f0e3c15a2a0 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e431ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c151020 con 0x7f0e3c0aebf0 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c06f190 0x7f0e3c165ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c06f190 0x7f0e3c165ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33270/0 (socket says 172.21.15.142:33270) 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.984+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2228523257 learned_addr learned my addr 172.21.15.142:0/2228523257 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e4179c700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c14fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c168cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 msgr2=0x7f0e3c168cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c168cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e3c15a2a0 msgr2=0x7f0e3c14fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c14fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2228523257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3000a5d0 con 0x7f0e3c06f190 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e4179c700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c14fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c168cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c06f190 0x7f0e3c165ec0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000aa10 tx=0x7f0e30019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e38ff9700 1 -- 172.21.15.142:0/2228523257 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000ce20 con 0x7f0e3c06f190 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e38ff9700 1 -- 172.21.15.142:0/2228523257 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000c7d0 con 0x7f0e3c06f190 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e38ff9700 1 -- 172.21.15.142:0/2228523257 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30022670 con 0x7f0e3c06f190 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c151300 con 0x7f0e3c06f190 2023-09-30T23:02:42.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.985+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c1518c0 con 0x7f0e3c06f190 2023-09-30T23:02:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.987+0000 7f0e38ff9700 1 -- 172.21.15.142:0/2228523257 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0e30020070 con 0x7f0e3c06f190 2023-09-30T23:02:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.988+0000 7f0e38ff9700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e20067330 0x7f0e200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.988+0000 7f0e38ff9700 1 -- 172.21.15.142:0/2228523257 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e30085860 con 0x7f0e3c06f190 2023-09-30T23:02:42.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.988+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e20067330 0x7f0e200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.989+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e20067330 0x7f0e200697e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0e28007fd0 tx=0x7f0e28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:42.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.990+0000 7f0e51913b80 1 Processor -- start 2023-09-30T23:02:42.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.990+0000 7f0e51913b80 1 -- start start 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633440ec930 0x56334411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344119920 0x5633440ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56334411c910 0x56334411d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e51913b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334400a310 con 0x56334411c910 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x563344047130 con 0x5633440ec930 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563344044af0 con 0x563344119920 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e4179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56334411c910 0x56334411d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e4179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56334411c910 0x56334411d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33278/0 (socket says 172.21.15.142:33278) 2023-09-30T23:02:42.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e4179c700 1 -- 172.21.15.142:0/249049138 learned_addr learned my addr 172.21.15.142:0/249049138 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633440ec930 0x56334411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.991+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344119920 0x5633440ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e4179c700 1 -- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344119920 msgr2=0x5633440ecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e4179c700 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344119920 0x5633440ecd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e4179c700 1 -- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633440ec930 msgr2=0x56334411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e4179c700 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633440ec930 0x56334411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e4179c700 1 -- 172.21.15.142:0/249049138 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563343e46790 con 0x56334411c910 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e4179c700 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56334411c910 0x56334411d640 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f0e34002200 tx=0x7f0e34009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc35163191b6ceb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e25ffb700 1 -- 172.21.15.142:0/249049138 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34004dc0 con 0x56334411c910 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e25ffb700 1 -- 172.21.15.142:0/249049138 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400db40 con 0x56334411c910 2023-09-30T23:02:42.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.992+0000 7f0e25ffb700 1 -- 172.21.15.142:0/249049138 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34007150 con 0x56334411c910 2023-09-30T23:02:42.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 -- 172.21.15.142:0/249049138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56334411c910 msgr2=0x56334411d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:42.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56334411c910 0x56334411d640 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f0e34002200 tx=0x7f0e34009040 comp rx=0 tx=0).stop 2023-09-30T23:02:42.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 -- 172.21.15.142:0/249049138 shutdown_connections 2023-09-30T23:02:42.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56334411c910 0x56334411d640 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633440ec930 0x56334411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 --2- 172.21.15.142:0/249049138 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344119920 0x5633440ecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 -- 172.21.15.142:0/249049138 >> 172.21.15.142:0/249049138 conn(0x56334413a880 msgr2=0x56334413ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 -- 172.21.15.142:0/249049138 shutdown_connections 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.993+0000 7f0e51913b80 1 -- 172.21.15.142:0/249049138 wait complete. 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.994+0000 7f0e51913b80 1 -- start start 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.994+0000 7f0e51913b80 1 Processor -- start 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344114120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x563344114660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x5633441161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e51913b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633440408e0 con 0x5633440ec930 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x563343fec980 con 0x56334411c910 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563343fec620 con 0x563344113570 2023-09-30T23:02:42.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e51913b80 10 client.0 _ll_register_callbacks cb 0x563343e4fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344114120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344114120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33290/0 (socket says 172.21.15.142:33290) 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2921517066 learned_addr learned my addr 172.21.15.142:0/2921517066 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e4179c700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x5633441161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x563344114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 msgr2=0x5633441161c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x5633441161c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 msgr2=0x563344114660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x563344114660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2921517066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e34001db0 con 0x5633440ec930 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e4179c700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x5633441161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:42.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.995+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x563344114660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344114120 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f0e30006d60 tx=0x7f0e30083ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4111153d8ccfe59e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e1affd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e1affd700 1 -- 172.21.15.142:0/2921517066 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300595d0 con 0x5633440ec930 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e1affd700 1 -- 172.21.15.142:0/2921517066 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e3005d320 con 0x5633440ec930 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633440e4d60 con 0x5633440ec930 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e1affd700 1 -- 172.21.15.142:0/2921517066 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3000c940 con 0x5633440ec930 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 10 client.8139 fetch_fsmap learned FSMap version 83 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x563343f330a0 con 0x5633440ec930 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e1affd700 1 -- 172.21.15.142:0/2921517066 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633440e4d60 con 0x5633440ec930 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e1affd700 1 -- 172.21.15.142:0/2921517066 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0e3005ce90 con 0x5633440ec930 2023-09-30T23:02:43.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 10 client.8139 fetch_fsmap finished waiting for FSMap version 83 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 10 client.8139 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 20 client.8139 populate_metadata read hostname 'smithi142' 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x5633441176d0 0x563344158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 4 client.8139 mds_command: new command op to 7989 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.996+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 --> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633440c1b30 con 0x5633441176d0 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.997+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x5633441176d0 0x563344158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.997+0000 7f0e1affd700 10 client.8139 ms_handle_connect on v2:172.21.15.142:6836/3571686386 2023-09-30T23:02:43.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.997+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x5633441176d0 0x563344158790 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34242d1995b39b6 server_cookie=ecbadc218cac8b25 in_seq=0 out_seq=0 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e1affd700 1 -- 172.21.15.142:0/2921517066 <== mds.0 v2:172.21.15.142:6836/3571686386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x5633440c1b30 con 0x5633441176d0 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e1affd700 10 client.8139 handle_command_reply: tid=0 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 client.8139 shutdown 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 msgr2=0x563344114120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344114120 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f0e30006d60 tx=0x7f0e30083ae0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 shutdown_connections 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x5633441176d0 0x563344158790 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x5633441161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e1affd700 0 client.8139 ms_handle_reset on v2:172.21.15.142:6836/3571686386 2023-09-30T23:02:43.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344114120 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2921517066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x563344114660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 >> 172.21.15.142:0/2921517066 conn(0x56334413a880 msgr2=0x56334413ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:43.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 shutdown_connections 2023-09-30T23:02:43.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.998+0000 7f0e51913b80 1 -- 172.21.15.142:0/2921517066 wait complete. 2023-09-30T23:02:43.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:42.999+0000 7f0e51913b80 20 client.8139 trim_cache size 0 max 16384 2023-09-30T23:02:43.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.016+0000 7f0e51913b80 1 Processor -- start 2023-09-30T23:02:43.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.016+0000 7f0e51913b80 1 -- start start 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x5633441161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563344113570 0x56334411cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56334411c910 0x5633440eced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e51913b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563343ed81e0 con 0x5633440ec930 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334414c0e0 con 0x563344113570 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563344119d00 con 0x56334411c910 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x5633441161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x5633441161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33304/0 (socket says 172.21.15.142:33304) 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 -- 172.21.15.142:0/1377738785 learned_addr learned my addr 172.21.15.142:0/1377738785 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563344113570 0x56334411cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e4179c700 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56334411c910 0x5633440eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 -- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56334411c910 msgr2=0x5633440eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56334411c910 0x5633440eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 -- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563344113570 msgr2=0x56334411cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563344113570 0x56334411cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e40f9b700 1 -- 172.21.15.142:0/1377738785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56334400f3c0 con 0x5633440ec930 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.017+0000 7f0e4179c700 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56334411c910 0x5633440eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x5633441161c0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0e30084fd0 tx=0x7f0e3006c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612ce542904cf8a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:43.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e267fc700 1 -- 172.21.15.142:0/1377738785 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300595d0 con 0x5633440ec930 2023-09-30T23:02:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e267fc700 1 -- 172.21.15.142:0/1377738785 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300526c0 con 0x5633440ec930 2023-09-30T23:02:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e267fc700 1 -- 172.21.15.142:0/1377738785 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30068e30 con 0x5633440ec930 2023-09-30T23:02:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e51913b80 1 -- 172.21.15.142:0/1377738785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 msgr2=0x5633441161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e51913b80 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x5633441161c0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0e30084fd0 tx=0x7f0e3006c000 comp rx=0 tx=0).stop 2023-09-30T23:02:43.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e51913b80 1 -- 172.21.15.142:0/1377738785 shutdown_connections 2023-09-30T23:02:43.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e51913b80 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56334411c910 0x5633440eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e51913b80 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x5633441161c0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e51913b80 1 --2- 172.21.15.142:0/1377738785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563344113570 0x56334411cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.018+0000 7f0e51913b80 1 -- 172.21.15.142:0/1377738785 >> 172.21.15.142:0/1377738785 conn(0x56334413a880 msgr2=0x5633440f2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:43.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.019+0000 7f0e51913b80 1 -- 172.21.15.142:0/1377738785 shutdown_connections 2023-09-30T23:02:43.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.019+0000 7f0e51913b80 1 -- 172.21.15.142:0/1377738785 wait complete. 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.019+0000 7f0e51913b80 1 -- start start 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.019+0000 7f0e51913b80 1 Processor -- start 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.020+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344189f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.020+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x56334411f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.020+0000 7f0e51913b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x56334411fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.020+0000 7f0e51913b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563344158f70 con 0x5633440ec930 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.020+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x563344115880 con 0x56334411c910 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.020+0000 7f0e51913b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563344115b60 con 0x563344113570 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.020+0000 7f0e51913b80 10 client.0 _ll_register_callbacks cb 0x563343e4fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344189f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344189f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33310/0 (socket says 172.21.15.142:33310) 2023-09-30T23:02:43.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2938917295 learned_addr learned my addr 172.21.15.142:0/2938917295 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e4179c700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x56334411fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x56334411f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 msgr2=0x56334411f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x56334411f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 msgr2=0x56334411fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x56334411fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 -- 172.21.15.142:0/2938917295 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563343f330a0 con 0x5633440ec930 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x56334411f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e40f9b700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344189f80 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0e30052830 tx=0x7f0e3002d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a734e63ce71e7d56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e1affd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T23:02:43.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e1affd700 1 -- 172.21.15.142:0/2938917295 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300595d0 con 0x5633440ec930 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e1affd700 1 -- 172.21.15.142:0/2938917295 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e3005d320 con 0x5633440ec930 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.021+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e3400db40 con 0x5633440ec930 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e1affd700 1 -- 172.21.15.142:0/2938917295 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3000ae30 con 0x5633440ec930 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 10 client.8145 fetch_fsmap learned FSMap version 83 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x563343ea71d0 con 0x5633440ec930 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e1affd700 1 -- 172.21.15.142:0/2938917295 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400db40 con 0x5633440ec930 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e1affd700 1 -- 172.21.15.142:0/2938917295 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0e3005ce90 con 0x5633440ec930 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 10 client.8145 fetch_fsmap finished waiting for FSMap version 83 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 10 client.8145 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 20 client.8145 populate_metadata read hostname 'smithi142' 2023-09-30T23:02:43.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x563344158790 0x5633441392f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 4 client.8145 mds_command: new command op to 7989 tid=0[{"prefix": "status"}] 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 --> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563343fe38d0 con 0x563344158790 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.022+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x563344158790 0x5633441392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e1affd700 10 client.8145 ms_handle_connect on v2:172.21.15.142:6836/3571686386 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e3bfff700 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x563344158790 0x5633441392f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a0c904a357893e1 server_cookie=290fa8ff620245c6 in_seq=0 out_seq=0 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e1affd700 1 -- 172.21.15.142:0/2938917295 <== mds.0 v2:172.21.15.142:6836/3571686386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563343fe38d0 con 0x563344158790 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e1affd700 10 client.8145 handle_command_reply: tid=0 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 client.8145 shutdown 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 msgr2=0x563344189f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344189f80 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0e30052830 tx=0x7f0e3002d000 comp rx=0 tx=0).stop 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 shutdown_connections 2023-09-30T23:02:43.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:6836/3571686386,v1:172.21.15.142:6837/3571686386] conn(0x563344158790 0x5633441392f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56334411c910 0x56334411fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5633440ec930 0x563344189f80 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 --2- 172.21.15.142:0/2938917295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x563344113570 0x56334411f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e1affd700 0 client.8145 ms_handle_reset on v2:172.21.15.142:6836/3571686386 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 >> 172.21.15.142:0/2938917295 conn(0x56334413a880 msgr2=0x5633440ec100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 shutdown_connections 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 1 -- 172.21.15.142:0/2938917295 wait complete. 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.023+0000 7f0e51913b80 20 client.8145 trim_cache size 0 max 16384 2023-09-30T23:02:43.029 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 7989, 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 6.8896975730000003, 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 83, 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 175, 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 175, 2023-09-30T23:02:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 12.601391344 2023-09-30T23:02:43.031 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:02:43.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e20067330 msgr2=0x7f0e200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e20067330 0x7f0e200697e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0e28007fd0 tx=0x7f0e28009040 comp rx=0 tx=0).stop 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c06f190 msgr2=0x7f0e3c165ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c06f190 0x7f0e3c165ec0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000aa10 tx=0x7f0e30019000 comp rx=0 tx=0).stop 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 shutdown_connections 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e20067330 0x7f0e200697e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e3c15a2a0 0x7f0e3c14fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c06f190 0x7f0e3c165ec0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 --2- 172.21.15.142:0/2228523257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e3c0aebf0 0x7f0e3c168cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 >> 172.21.15.142:0/2228523257 conn(0x7f0e3c0680c0 msgr2=0x7f0e3c0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 shutdown_connections 2023-09-30T23:02:43.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.024+0000 7f0e431ff700 1 -- 172.21.15.142:0/2228523257 wait complete. 2023-09-30T23:02:43.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T23:02:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.237+0000 7f7c535ff700 1 Processor -- start 2023-09-30T23:02:43.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.237+0000 7f7c535ff700 1 -- start start 2023-09-30T23:02:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.238+0000 7f7c535ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c4c143350 0x7f7c4c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c535ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c15de20 0x7f7c4c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c535ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c0cc6b0 con 0x7f7c4c0692f0 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c535ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0cb7d0 con 0x7f7c4c143350 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c535ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0cbaa0 con 0x7f7c4c15de20 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c5139b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c4c143350 0x7f7c4c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c5139b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c4c143350 0x7f7c4c0cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33322/0 (socket says 172.21.15.142:33322) 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c50b9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7c4c0692f0 0x7f7c4c15d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50198/0 (socket says 172.21.15.142:50198) 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c5139b700 1 -- 172.21.15.142:0/3182429452 learned_addr learned my addr 172.21.15.142:0/3182429452 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c51b9c700 1 --2- 172.21.15.142:0/3182429452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c15de20 0x7f7c4c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c5139b700 1 -- 172.21.15.142:0/3182429452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c15de20 msgr2=0x7f7c4c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c5139b700 1 --2- 172.21.15.142:0/3182429452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c15de20 0x7f7c4c06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c5139b700 1 -- 172.21.15.142:0/3182429452 >> v1:172.21.15.142:6789/0 conn(0x7f7c4c0692f0 legacy=0x7f7c4c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c5139b700 1 -- 172.21.15.142:0/3182429452 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0cbd80 con 0x7f7c4c143350 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c43fff700 1 -- 172.21.15.142:0/3182429452 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538444321 0 0) 0x7f7c4c0cc6b0 con 0x7f7c4c0692f0 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.239+0000 7f7c51b9c700 1 --2- 172.21.15.142:0/3182429452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c15de20 0x7f7c4c06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c5139b700 1 --2- 172.21.15.142:0/3182429452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c143350 0x7f7c4c0cb290 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7c480099b0 tx=0x7f7c48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591521d7106e2f1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c43fff700 1 -- 172.21.15.142:0/3182429452 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800b860 con 0x7f7c4c143350 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c43fff700 1 -- 172.21.15.142:0/3182429452 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800b9c0 con 0x7f7c4c143350 2023-09-30T23:02:43.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c43fff700 1 -- 172.21.15.142:0/3182429452 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800bd60 con 0x7f7c4c143350 2023-09-30T23:02:43.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c535ff700 1 -- 172.21.15.142:0/3182429452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c143350 msgr2=0x7f7c4c0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c535ff700 1 --2- 172.21.15.142:0/3182429452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c143350 0x7f7c4c0cb290 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7c480099b0 tx=0x7f7c48009250 comp rx=0 tx=0).stop 2023-09-30T23:02:43.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c535ff700 1 -- 172.21.15.142:0/3182429452 shutdown_connections 2023-09-30T23:02:43.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c535ff700 1 --2- 172.21.15.142:0/3182429452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c143350 0x7f7c4c0cb290 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c535ff700 1 --2- 172.21.15.142:0/3182429452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c15de20 0x7f7c4c06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.240+0000 7f7c535ff700 1 -- 172.21.15.142:0/3182429452 >> 172.21.15.142:0/3182429452 conn(0x7f7c4c0ce8e0 msgr2=0x7f7c4c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:43.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.241+0000 7f7c535ff700 1 -- 172.21.15.142:0/3182429452 shutdown_connections 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.241+0000 7f7c535ff700 1 -- 172.21.15.142:0/3182429452 wait complete. 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.242+0000 7f7c535ff700 1 Processor -- start 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.242+0000 7f7c535ff700 1 -- start start 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c535ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c0692f0 0x7f7c4c13f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c535ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c4c143350 0x7f7c4c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c535ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c15de20 0x7f7c4c06ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c535ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c16e3e0 con 0x7f7c4c15de20 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c535ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c16d620 con 0x7f7c4c143350 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c535ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c16d900 con 0x7f7c4c0692f0 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c51b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c15de20 0x7f7c4c06ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c51b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c15de20 0x7f7c4c06ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33326/0 (socket says 172.21.15.142:33326) 2023-09-30T23:02:43.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c51b9c700 1 -- 172.21.15.142:0/374965820 learned_addr learned my addr 172.21.15.142:0/374965820 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c50b9a700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c4c143350 0x7f7c4c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.243+0000 7f7c5139b700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c0692f0 0x7f7c4c13f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c51b9c700 1 -- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c0692f0 msgr2=0x7f7c4c13f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c51b9c700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c0692f0 0x7f7c4c13f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c51b9c700 1 -- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c4c143350 msgr2=0x7f7c4c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c51b9c700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c4c143350 0x7f7c4c15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c51b9c700 1 -- 172.21.15.142:0/374965820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480094f0 con 0x7f7c4c15de20 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c51b9c700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c15de20 0x7f7c4c06ab20 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009f90 tx=0x7f7c440099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c417fa700 1 -- 172.21.15.142:0/374965820 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400dbe0 con 0x7f7c4c15de20 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c417fa700 1 -- 172.21.15.142:0/374965820 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400f040 con 0x7f7c4c15de20 2023-09-30T23:02:43.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c417fa700 1 -- 172.21.15.142:0/374965820 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44015440 con 0x7f7c4c15de20 2023-09-30T23:02:43.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c16dbe0 con 0x7f7c4c15de20 2023-09-30T23:02:43.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.244+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c15cde0 con 0x7f7c4c15de20 2023-09-30T23:02:43.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.245+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c16d760 con 0x7f7c4c15de20 2023-09-30T23:02:43.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.246+0000 7f7c417fa700 1 -- 172.21.15.142:0/374965820 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7c4401e3b0 con 0x7f7c4c15de20 2023-09-30T23:02:43.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.247+0000 7f7c417fa700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c30067330 0x7f7c300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:43.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.247+0000 7f7c417fa700 1 -- 172.21.15.142:0/374965820 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c44084f90 con 0x7f7c4c15de20 2023-09-30T23:02:43.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.247+0000 7f7c5139b700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c30067330 0x7f7c300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:43.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.248+0000 7f7c5139b700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c30067330 0x7f7c300697e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7c480099b0 tx=0x7f7c48017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:43.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.252+0000 7f7c417fa700 1 -- 172.21.15.142:0/374965820 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7c4c16d760 con 0x7f7c4c15de20 2023-09-30T23:02:43.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.484+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c4c16e100 con 0x7f7c4c15de20 2023-09-30T23:02:43.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.484+0000 7f7c417fa700 1 -- 172.21.15.142:0/374965820 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7c4c16e100 con 0x7f7c4c15de20 2023-09-30T23:02:43.484 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T23:02:43.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.486+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c30067330 msgr2=0x7f7c300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.486+0000 7f7c535ff700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c30067330 0x7f7c300697e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7c480099b0 tx=0x7f7c48017000 comp rx=0 tx=0).stop 2023-09-30T23:02:43.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.486+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c15de20 msgr2=0x7f7c4c06ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.486+0000 7f7c535ff700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c15de20 0x7f7c4c06ab20 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009f90 tx=0x7f7c440099b0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.486+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 shutdown_connections 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.486+0000 7f7c535ff700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7c30067330 0x7f7c300697e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.487+0000 7f7c535ff700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c15de20 0x7f7c4c06ab20 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.487+0000 7f7c535ff700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c4c0692f0 0x7f7c4c13f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.487+0000 7f7c535ff700 1 --2- 172.21.15.142:0/374965820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c4c143350 0x7f7c4c15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.487+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 >> 172.21.15.142:0/374965820 conn(0x7f7c4c0ce8e0 msgr2=0x7f7c4c1425f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.487+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 shutdown_connections 2023-09-30T23:02:43.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:43.487+0000 7f7c535ff700 1 -- 172.21.15.142:0/374965820 wait complete. 2023-09-30T23:02:43.503 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T23:02:43.504 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:02:43.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:43.505 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:02:43.551 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41694sec preferred_lft 41694sec 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T23:02:43.552 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:02:43.553 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T23:02:43.554 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T23:02:43.554 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:43.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:43.555 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T23:02:43.622 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T23:02:43.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:43.625 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T23:02:43.674 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T23:02:43.674 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T23:02:43.674 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T23:02:43.675 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T23:02:43.675 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T23:02:43.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:43.675 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T23:02:43.675 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T23:02:43.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T23:02:43.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T23:02:43.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T23:02:43.676 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T23:02:43.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:43.844 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T23:02:43.890 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T23:02:43.890 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T23:02:43.890 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:02:43.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:43.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T23:02:44.001 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:02:44.001 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T23:02:44.047 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:02:44.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:02:44.048 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T23:02:44.132 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T23:02:44.133 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T23:02:44.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:02:44.271 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:02:44.271 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:02:44.272 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:02:44.286 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:02:44.286 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:02:44.286 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:02:44.287 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:02:44.287 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:02:44.307 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:02:44.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:02:44.307 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:02:44.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:02:44.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:02:44.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T23:02:44.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T23:02:44.308 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T23:02:44.311 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T23:02:44.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:44.311 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T23:02:44.382 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T23:02:44.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.572+0000 7fdf855ff700 1 Processor -- start 2023-09-30T23:02:44.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.572+0000 7fdf855ff700 1 -- start start 2023-09-30T23:02:44.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.573+0000 7fdf855ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdf800af020 0x7fdf80156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:44.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf855ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf8015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf855ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8006d3e0 con 0x7fdf800b00d0 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf855ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8006dc80 con 0x7fdf800af020 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf855ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8006eca0 con 0x7fdf8006e820 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdf800af020 0x7fdf80156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7e7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdf800b00d0 0x7fdf8006e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50208/0 (socket says 172.21.15.142:50208) 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7e7fc700 1 -- 172.21.15.142:0/402130768 learned_addr learned my addr 172.21.15.142:0/402130768 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7f7fe700 1 --2- 172.21.15.142:0/402130768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf8015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7effd700 1 -- 172.21.15.142:0/402130768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 msgr2=0x7fdf8015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7effd700 1 --2- 172.21.15.142:0/402130768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf8015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7effd700 1 -- 172.21.15.142:0/402130768 >> v1:172.21.15.142:6789/0 conn(0x7fdf800b00d0 legacy=0x7fdf8006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.574+0000 7fdf7effd700 1 -- 172.21.15.142:0/402130768 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8006b790 con 0x7fdf800af020 2023-09-30T23:02:44.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf7effd700 1 --2- 172.21.15.142:0/402130768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf80156d80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098e0 tx=0x7fdf700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5fd3c65d127bb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf7dffb700 1 -- 172.21.15.142:0/402130768 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70009e80 con 0x7fdf800af020 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf7dffb700 1 -- 172.21.15.142:0/402130768 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7000b860 con 0x7fdf800af020 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf7dffb700 1 -- 172.21.15.142:0/402130768 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000bbe0 con 0x7fdf800af020 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf855ff700 1 -- 172.21.15.142:0/402130768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 msgr2=0x7fdf80156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf855ff700 1 --2- 172.21.15.142:0/402130768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf80156d80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098e0 tx=0x7fdf700091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf855ff700 1 -- 172.21.15.142:0/402130768 shutdown_connections 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf855ff700 1 --2- 172.21.15.142:0/402130768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf80156d80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf855ff700 1 --2- 172.21.15.142:0/402130768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf8015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.575+0000 7fdf855ff700 1 -- 172.21.15.142:0/402130768 >> 172.21.15.142:0/402130768 conn(0x7fdf800680c0 msgr2=0x7fdf800c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.576+0000 7fdf855ff700 1 -- 172.21.15.142:0/402130768 shutdown_connections 2023-09-30T23:02:44.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.576+0000 7fdf855ff700 1 -- 172.21.15.142:0/402130768 wait complete. 2023-09-30T23:02:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.577+0000 7fdf855ff700 1 Processor -- start 2023-09-30T23:02:44.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.577+0000 7fdf855ff700 1 -- start start 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf855ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf80157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf855ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf8015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf855ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf800b00d0 0x7fdf80153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf855ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8015d3b0 con 0x7fdf800af020 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf855ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8015d650 con 0x7fdf800b00d0 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf855ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8015d930 con 0x7fdf8006e820 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf7e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf8015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf7e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf8015ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33334/0 (socket says 172.21.15.142:33334) 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf7e7fc700 1 -- 172.21.15.142:0/17105822 learned_addr learned my addr 172.21.15.142:0/17105822 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf7effd700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf80157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:44.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.578+0000 7fdf7f7fe700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf800b00d0 0x7fdf80153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf7e7fc700 1 -- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 msgr2=0x7fdf80157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf7e7fc700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf80157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf7e7fc700 1 -- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf800b00d0 msgr2=0x7fdf80153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf7e7fc700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf800b00d0 0x7fdf80153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf7e7fc700 1 -- 172.21.15.142:0/17105822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70009420 con 0x7fdf800af020 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf7e7fc700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf8015ce70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c560 tx=0x7fdf74001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf66ffd700 1 -- 172.21.15.142:0/17105822 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74005b30 con 0x7fdf800af020 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf66ffd700 1 -- 172.21.15.142:0/17105822 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74005c90 con 0x7fdf800af020 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf66ffd700 1 -- 172.21.15.142:0/17105822 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74007320 con 0x7fdf800af020 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8015dc10 con 0x7fdf800af020 2023-09-30T23:02:44.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.579+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8015e1d0 con 0x7fdf800af020 2023-09-30T23:02:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.580+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8006b9d0 con 0x7fdf800af020 2023-09-30T23:02:44.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.581+0000 7fdf66ffd700 1 -- 172.21.15.142:0/17105822 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdf7401b3b0 con 0x7fdf800af020 2023-09-30T23:02:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.583+0000 7fdf66ffd700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf6c067330 0x7fdf6c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.583+0000 7fdf66ffd700 1 -- 172.21.15.142:0/17105822 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf74083fe0 con 0x7fdf800af020 2023-09-30T23:02:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.583+0000 7fdf7effd700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf6c067330 0x7fdf6c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:44.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.584+0000 7fdf7effd700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf6c067330 0x7fdf6c0697e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdf700091e0 tx=0x7fdf70017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:44.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.588+0000 7fdf66ffd700 1 -- 172.21.15.142:0/17105822 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdf74050e60 con 0x7fdf800af020 2023-09-30T23:02:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.821+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf8015e3f0 con 0x7fdf800af020 2023-09-30T23:02:44.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.822+0000 7fdf66ffd700 1 -- 172.21.15.142:0/17105822 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdf74017070 con 0x7fdf800af020 2023-09-30T23:02:44.821 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T23:02:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf6c067330 msgr2=0x7fdf6c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:44.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf6c067330 0x7fdf6c0697e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdf700091e0 tx=0x7fdf70017000 comp rx=0 tx=0).stop 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 msgr2=0x7fdf8015ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf8015ce70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c560 tx=0x7fdf74001020 comp rx=0 tx=0).stop 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 shutdown_connections 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdf6c067330 0x7fdf6c0697e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf800b00d0 0x7fdf80153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf8006e820 0x7fdf80157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 --2- 172.21.15.142:0/17105822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf800af020 0x7fdf8015ce70 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 >> 172.21.15.142:0/17105822 conn(0x7fdf800680c0 msgr2=0x7fdf800ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 shutdown_connections 2023-09-30T23:02:44.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:44.824+0000 7fdf855ff700 1 -- 172.21.15.142:0/17105822 wait complete. 2023-09-30T23:02:44.840 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T23:02:44.841 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:02:44.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:44.841 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T23:02:44.893 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:44.894 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41724sec preferred_lft 41724sec 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T23:02:44.895 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:44.897 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T23:02:44.898 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:02:44.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:44.899 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T23:02:44.970 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T23:02:44.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:44.973 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T23:02:45.023 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T23:02:45.023 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T23:02:45.023 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T23:02:45.023 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T23:02:45.023 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T23:02:45.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:45.024 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T23:02:45.024 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T23:02:45.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T23:02:45.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T23:02:45.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T23:02:45.024 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T23:02:45.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:45.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:45.193 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T23:02:45.196 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:45.240 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T23:02:45.240 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T23:02:45.241 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:02:45.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:45.242 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T23:02:45.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:02:45.353 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T23:02:45.398 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:02:45.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:02:45.399 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T23:02:45.483 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T23:02:45.483 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T23:02:45.484 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:02:45.623 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:02:45.623 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:02:45.623 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:02:45.638 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:02:45.638 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:02:45.638 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:02:45.638 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:02:45.638 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T23:02:45.658 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T23:02:45.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T23:02:45.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:02:45.663 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T23:02:45.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:02:45.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.924+0000 7f39483ff700 1 Processor -- start 2023-09-30T23:02:45.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.924+0000 7f39483ff700 1 -- start start 2023-09-30T23:02:45.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.925+0000 7f39483ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3940143350 0x7f39400cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:45.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.925+0000 7f39483ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400cc6b0 con 0x7f394015de20 2023-09-30T23:02:45.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.925+0000 7f39483ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400cb7d0 con 0x7f39400692f0 2023-09-30T23:02:45.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.925+0000 7f39483ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400cbaa0 con 0x7f3940143350 2023-09-30T23:02:45.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f394699c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f394015de20 0x7f394006a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50212/0 (socket says 172.21.15.142:50212) 2023-09-30T23:02:45.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f394699c700 1 -- 172.21.15.142:0/2470602992 learned_addr learned my addr 172.21.15.142:0/2470602992 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:45.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f394619b700 1 --2- 172.21.15.142:0/2470602992 >> v2:172.21.15.148:3300/0 conn(0x7f3940143350 0x7f39400cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f3945199700 1 -- 172.21.15.142:0/2470602992 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742719036 0 0) 0x7f39400cc6b0 con 0x7f394015de20 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f3945199700 1 -- 172.21.15.142:0/2470602992 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f392c003570 con 0x7f394015de20 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f394619b700 1 -- 172.21.15.142:0/2470602992 >> v1:172.21.15.148:6789/0 conn(0x7f39400692f0 legacy=0x7f394015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f394619b700 1 -- 172.21.15.142:0/2470602992 >> v1:172.21.15.142:6789/0 conn(0x7f394015de20 legacy=0x7f394006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.926+0000 7f394619b700 1 -- 172.21.15.142:0/2470602992 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400cbd80 con 0x7f3940143350 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.927+0000 7f394619b700 1 --2- 172.21.15.142:0/2470602992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940143350 0x7f39400cb290 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f393c0098e0 tx=0x7f393c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71686aaf3703e04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.927+0000 7f3945199700 1 -- 172.21.15.142:0/2470602992 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00b640 con 0x7f3940143350 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.927+0000 7f3945199700 1 -- 172.21.15.142:0/2470602992 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c00b7a0 con 0x7f3940143350 2023-09-30T23:02:45.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.927+0000 7f3945199700 1 -- 172.21.15.142:0/2470602992 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00bb40 con 0x7f3940143350 2023-09-30T23:02:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.927+0000 7f39483ff700 1 -- 172.21.15.142:0/2470602992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940143350 msgr2=0x7f39400cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.927+0000 7f39483ff700 1 --2- 172.21.15.142:0/2470602992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940143350 0x7f39400cb290 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f393c0098e0 tx=0x7f393c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.928+0000 7f39483ff700 1 -- 172.21.15.142:0/2470602992 shutdown_connections 2023-09-30T23:02:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.928+0000 7f39483ff700 1 --2- 172.21.15.142:0/2470602992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940143350 0x7f39400cb290 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.928+0000 7f39483ff700 1 -- 172.21.15.142:0/2470602992 >> 172.21.15.142:0/2470602992 conn(0x7f39400ce8e0 msgr2=0x7f39400cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.928+0000 7f39483ff700 1 -- 172.21.15.142:0/2470602992 shutdown_connections 2023-09-30T23:02:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.928+0000 7f39483ff700 1 -- 172.21.15.142:0/2470602992 wait complete. 2023-09-30T23:02:45.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.929+0000 7f39483ff700 1 Processor -- start 2023-09-30T23:02:45.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.929+0000 7f39483ff700 1 -- start start 2023-09-30T23:02:45.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f39483ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39400692f0 0x7f394013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:45.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f39483ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3940143350 0x7f39400a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f39483ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394015de20 0x7f394015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f39483ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394015a190 con 0x7f394015de20 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f39483ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394015aff0 con 0x7f39400692f0 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f39483ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394015a3e0 con 0x7f3940143350 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f394699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394015de20 0x7f394015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f394699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394015de20 0x7f394015b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33342/0 (socket says 172.21.15.142:33342) 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.930+0000 7f394699c700 1 -- 172.21.15.142:0/4143870352 learned_addr learned my addr 172.21.15.142:0/4143870352 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394619b700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39400692f0 0x7f394013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394599a700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3940143350 0x7f39400a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:45.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394699c700 1 -- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3940143350 msgr2=0x7f39400a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394699c700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3940143350 0x7f39400a7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394699c700 1 -- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39400692f0 msgr2=0x7f394013f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394699c700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39400692f0 0x7f394013f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394699c700 1 -- 172.21.15.142:0/4143870352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c009420 con 0x7f394015de20 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394599a700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3940143350 0x7f39400a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394619b700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39400692f0 0x7f394013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f394699c700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394015de20 0x7f394015b480 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3938001460 tx=0x7f3938001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f39367fc700 1 -- 172.21.15.142:0/4143870352 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393800a950 con 0x7f394015de20 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f39367fc700 1 -- 172.21.15.142:0/4143870352 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393800aab0 con 0x7f394015de20 2023-09-30T23:02:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f39367fc700 1 -- 172.21.15.142:0/4143870352 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393800ae30 con 0x7f394015de20 2023-09-30T23:02:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394015a6c0 con 0x7f394015de20 2023-09-30T23:02:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.931+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394015ac80 con 0x7f394015de20 2023-09-30T23:02:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.932+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394015b1a0 con 0x7f394015de20 2023-09-30T23:02:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.933+0000 7f39367fc700 1 -- 172.21.15.142:0/4143870352 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3938007300 con 0x7f394015de20 2023-09-30T23:02:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.934+0000 7f39367fc700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3924067330 0x7f39240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.934+0000 7f39367fc700 1 -- 172.21.15.142:0/4143870352 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39380850c0 con 0x7f394015de20 2023-09-30T23:02:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.935+0000 7f394619b700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3924067330 0x7f39240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.935+0000 7f394619b700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3924067330 0x7f39240697e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f393c0093f0 tx=0x7f393c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:45.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:45.938+0000 7f39367fc700 1 -- 172.21.15.142:0/4143870352 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f394015b1a0 con 0x7f394015de20 2023-09-30T23:02:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.170+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f394015b160 con 0x7f394015de20 2023-09-30T23:02:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.171+0000 7f39367fc700 1 -- 172.21.15.142:0/4143870352 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4613 (secure 0 0 0) 0x7f3938051f10 con 0x7f394015de20 2023-09-30T23:02:46.171 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:02:46.171 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:02:35.609202+0000","modified":"2023-09-30T23:02:39.164928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3571686386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3571686386},{"type":"v1","addr":"172.21.15.142:6837","nonce":3571686386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-09-30T23:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3924067330 msgr2=0x7f39240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3924067330 0x7f39240697e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f393c0093f0 tx=0x7f393c017000 comp rx=0 tx=0).stop 2023-09-30T23:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394015de20 msgr2=0x7f394015b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394015de20 0x7f394015b480 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3938001460 tx=0x7f3938001a40 comp rx=0 tx=0).stop 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 shutdown_connections 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3924067330 0x7f39240697e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394015de20 0x7f394015b480 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39400692f0 0x7f394013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 --2- 172.21.15.142:0/4143870352 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3940143350 0x7f39400a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.173+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 >> 172.21.15.142:0/4143870352 conn(0x7f39400ce8e0 msgr2=0x7f39400c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.174+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 shutdown_connections 2023-09-30T23:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.174+0000 7f39483ff700 1 -- 172.21.15.142:0/4143870352 wait complete. 2023-09-30T23:02:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 83 2023-09-30T23:02:46.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-09-30T23:02:46.405 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":7989,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.257625121,"mdsmap_epoch":83,"osdmap_epoch":175,"osdmap_epoch_barrier":175,"uptime":15.969319964} 2023-09-30T23:02:46.405 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 7989, "mdsmap_epoch": 83, "osdmap_epoch": 175, "osdmap_epoch_barrier": 175, "rank_uptime": 10.257625121, "state": "up:active", "uptime": 15.969319964, "want_state": "up:active", "whoami": 0 } 2023-09-30T23:02:46.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-30T23:02:46.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.599+0000 7fe27ffff700 1 Processor -- start 2023-09-30T23:02:46.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.599+0000 7fe27ffff700 1 -- start start 2023-09-30T23:02:46.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.600+0000 7fe27ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2780ca5e0 0x7fe2780686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.600+0000 7fe27ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 0x7fe278068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.600+0000 7fe27ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe278068230 con 0x7fe278159a10 2023-09-30T23:02:46.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.600+0000 7fe27ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe278067620 con 0x7fe2780ca5e0 2023-09-30T23:02:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.600+0000 7fe27ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe278067900 con 0x7fe278159de0 2023-09-30T23:02:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27dd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe278159a10 0x7fe2780c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:50220/0 (socket says 172.21.15.142:50220) 2023-09-30T23:02:46.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27dd9b700 1 -- 172.21.15.142:0/3918058229 learned_addr learned my addr 172.21.15.142:0/3918058229 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674226557 0 0) 0x7fe278068230 con 0x7fe278159a10 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27e59c700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 0x7fe278068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27d59a700 1 --2- 172.21.15.142:0/3918058229 >> v2:172.21.15.148:3300/0 conn(0x7fe2780ca5e0 0x7fe2780686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe264003570 con 0x7fe278159a10 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809195618 0 0) 0x7fe264003570 con 0x7fe278159a10 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 msgr2=0x7fe278068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 0x7fe278068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 >> v2:172.21.15.148:3300/0 conn(0x7fe2780ca5e0 msgr2=0x7fe2780686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 --2- 172.21.15.142:0/3918058229 >> v2:172.21.15.148:3300/0 conn(0x7fe2780ca5e0 0x7fe2780686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278067be0 con 0x7fe278159a10 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fe274001470 con 0x7fe278159a10 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.601+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 >> v1:172.21.15.142:6789/0 conn(0x7fe278159a10 legacy=0x7fe2780c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27cd99700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264003ae0 0x7fe264003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27cd99700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 0x7fe264004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27cd99700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264004d50 0x7fe2640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe278067620 con 0x7fe264003ae0 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe278067900 con 0x7fe264004d50 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26400bb10 con 0x7fe278159de0 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27dd9b700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264003ae0 0x7fe264003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27d59a700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 0x7fe264004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27e59c700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264004d50 0x7fe2640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27dd9b700 1 -- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 msgr2=0x7fe264004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27dd9b700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe278159de0 0x7fe264004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27dd9b700 1 -- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264004d50 msgr2=0x7fe2640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27dd9b700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264004d50 0x7fe2640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27dd9b700 1 -- 172.21.15.142:0/3918058229 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264003570 con 0x7fe264003ae0 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.602+0000 7fe27dd9b700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264003ae0 0x7fe264003ef0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fe27400c300 tx=0x7fe274001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e387746a15c302d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27400cb90 con 0x7fe264003ae0 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27400ccf0 con 0x7fe264003ae0 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27cd99700 1 -- 172.21.15.142:0/3918058229 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274005b70 con 0x7fe264003ae0 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27ffff700 1 -- 172.21.15.142:0/3918058229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264003ae0 msgr2=0x7fe264003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27ffff700 1 --2- 172.21.15.142:0/3918058229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264003ae0 0x7fe264003ef0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fe27400c300 tx=0x7fe274001dc0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27e59c700 1 -- 172.21.15.142:0/3918058229 reap_dead start 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27ffff700 1 -- 172.21.15.142:0/3918058229 shutdown_connections 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27ffff700 1 -- 172.21.15.142:0/3918058229 >> 172.21.15.142:0/3918058229 conn(0x7fe2780cb2f0 msgr2=0x7fe2780cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27ffff700 1 -- 172.21.15.142:0/3918058229 shutdown_connections 2023-09-30T23:02:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.603+0000 7fe27ffff700 1 -- 172.21.15.142:0/3918058229 wait complete. 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.605+0000 7fe27ffff700 1 Processor -- start 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.606+0000 7fe27ffff700 1 -- start start 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe264003ae0 0x7fe27816b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780c5930 0x7fe27815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2780c6eb0 0x7fe2780c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27815ccd0 con 0x7fe2780c5930 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27816bd30 con 0x7fe2780c6eb0 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780c5e30 con 0x7fe264003ae0 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27d59a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780c5930 0x7fe27815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27d59a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780c5930 0x7fe27815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33356/0 (socket says 172.21.15.142:33356) 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27d59a700 1 -- 172.21.15.142:0/3033881425 learned_addr learned my addr 172.21.15.142:0/3033881425 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27dd9b700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe264003ae0 0x7fe27816b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27e59c700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2780c6eb0 0x7fe2780c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27d59a700 1 -- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe264003ae0 msgr2=0x7fe27816b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27d59a700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe264003ae0 0x7fe27816b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27d59a700 1 -- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2780c6eb0 msgr2=0x7fe2780c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.607+0000 7fe27d59a700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2780c6eb0 0x7fe2780c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.608+0000 7fe27d59a700 1 -- 172.21.15.142:0/3033881425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780c6110 con 0x7fe2780c5930 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.608+0000 7fe27d59a700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780c5930 0x7fe27815b800 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe268011d40 tx=0x7fe2680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.608+0000 7fe26dffb700 1 -- 172.21.15.142:0/3033881425 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800f930 con 0x7fe2780c5930 2023-09-30T23:02:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.608+0000 7fe26dffb700 1 -- 172.21.15.142:0/3033881425 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26800fa90 con 0x7fe2780c5930 2023-09-30T23:02:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.608+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2780c63f0 con 0x7fe2780c5930 2023-09-30T23:02:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.608+0000 7fe26dffb700 1 -- 172.21.15.142:0/3033881425 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800fe50 con 0x7fe2780c5930 2023-09-30T23:02:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.608+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2780c69b0 con 0x7fe2780c5930 2023-09-30T23:02:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.609+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27806e4b0 con 0x7fe2780c5930 2023-09-30T23:02:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.610+0000 7fe26dffb700 1 -- 172.21.15.142:0/3033881425 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe268014650 con 0x7fe2780c5930 2023-09-30T23:02:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.611+0000 7fe26dffb700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe25c067330 0x7fe25c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:02:46.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.611+0000 7fe26dffb700 1 -- 172.21.15.142:0/3033881425 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe268018030 con 0x7fe2780c5930 2023-09-30T23:02:46.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.611+0000 7fe27dd9b700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe25c067330 0x7fe25c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:02:46.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.612+0000 7fe27dd9b700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe25c067330 0x7fe25c0697e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe274015040 tx=0x7fe274012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:02:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.615+0000 7fe26dffb700 1 -- 172.21.15.142:0/3033881425 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe268052370 con 0x7fe2780c5930 2023-09-30T23:02:46.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:46.804+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fe278067ec0 con 0x7fe2780c5930 2023-09-30T23:02:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.398+0000 7fe26dffb700 1 -- 172.21.15.142:0/3033881425 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v176) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe268055990 con 0x7fe2780c5930 2023-09-30T23:02:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.400+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe25c067330 msgr2=0x7fe25c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.400+0000 7fe27ffff700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe25c067330 0x7fe25c0697e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe274015040 tx=0x7fe274012000 comp rx=0 tx=0).stop 2023-09-30T23:02:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.400+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780c5930 msgr2=0x7fe27815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:02:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.400+0000 7fe27ffff700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780c5930 0x7fe27815b800 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe268011d40 tx=0x7fe2680091a0 comp rx=0 tx=0).stop 2023-09-30T23:02:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 shutdown_connections 2023-09-30T23:02:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe25c067330 0x7fe25c0697e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2780c6eb0 0x7fe2780c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe264003ae0 0x7fe27816b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 --2- 172.21.15.142:0/3033881425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780c5930 0x7fe27815b800 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:02:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 >> 172.21.15.142:0/3033881425 conn(0x7fe2780cb2f0 msgr2=0x7fe2780cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:02:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 shutdown_connections 2023-09-30T23:02:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:02:47.401+0000 7fe27ffff700 1 -- 172.21.15.142:0/3033881425 wait complete. 2023-09-30T23:02:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-30T23:02:47.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T23:02:47.632 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T23:02:47.632 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T23:02:47.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-30T23:02:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:{"mon_tick_interval":"5"} 2023-09-30T23:02:47.834 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-30T23:02:47.834 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-09-30T23:02:47.834 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits daemon-helper kill python3 -c ' 2023-09-30T23:02:47.834 DEBUG:teuthology.orchestra.run.smithi142:> import time 2023-09-30T23:02:47.834 DEBUG:teuthology.orchestra.run.smithi142:> import datetime 2023-09-30T23:02:47.834 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> # Write some buffered data through before going full, all should be well 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> print("writing some data through which we expect to succeed") 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> bytes = 0 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.835 DEBUG:teuthology.orchestra.run.smithi142:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> # buffered IO, the error should always only appear from fsync and not 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> # from write 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> full = False 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> for n in range(0, int(32 * 1.1)): 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> print("wrote bytes via buffered write, moving on to fsync") 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> except OSError as e: 2023-09-30T23:02:47.836 DEBUG:teuthology.orchestra.run.smithi142:> if False: 2023-09-30T23:02:47.837 DEBUG:teuthology.orchestra.run.smithi142:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-09-30T23:02:47.837 DEBUG:teuthology.orchestra.run.smithi142:> raise 2023-09-30T23:02:47.837 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T23:02:47.837 DEBUG:teuthology.orchestra.run.smithi142:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-30T23:02:47.837 DEBUG:teuthology.orchestra.run.smithi142:> full = True 2023-09-30T23:02:47.837 DEBUG:teuthology.orchestra.run.smithi142:> break 2023-09-30T23:02:47.837 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.838 DEBUG:teuthology.orchestra.run.smithi142:> try: 2023-09-30T23:02:47.838 DEBUG:teuthology.orchestra.run.smithi142:> os.fsync(f) 2023-09-30T23:02:47.838 DEBUG:teuthology.orchestra.run.smithi142:> print("fsync'"'"'ed successfully") 2023-09-30T23:02:47.838 DEBUG:teuthology.orchestra.run.smithi142:> except OSError as e: 2023-09-30T23:02:47.838 DEBUG:teuthology.orchestra.run.smithi142:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-30T23:02:47.838 DEBUG:teuthology.orchestra.run.smithi142:> full = True 2023-09-30T23:02:47.839 DEBUG:teuthology.orchestra.run.smithi142:> break 2023-09-30T23:02:47.839 DEBUG:teuthology.orchestra.run.smithi142:> else: 2023-09-30T23:02:47.839 DEBUG:teuthology.orchestra.run.smithi142:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-30T23:02:47.839 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.839 DEBUG:teuthology.orchestra.run.smithi142:> if n > 32 * 0.9: 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> # Be cautious in the last region where we expect to hit 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> time.sleep(15.0) 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> if not full: 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-09-30T23:02:47.840 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> # close() should not raise an error because we already caught it in 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> # since then because all IOs got cancelled on the full flag. 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> print("calling close") 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> os.close(f) 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> print("close() did not raise error") 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> 2023-09-30T23:02:47.841 DEBUG:teuthology.orchestra.run.smithi142:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-30T23:02:47.842 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-09-30T23:03:15.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:15.308 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:45.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:45.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:50.782 INFO:teuthology.orchestra.run.smithi142.stdout:writing some data through which we expect to succeed 2023-09-30T23:03:50.782 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 1.00 MB 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 2.00 MB 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 3.00 MB 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.783 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 4.00 MB 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 5.00 MB 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 6.00 MB 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 7.00 MB 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.784 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 8.00 MB 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 9.00 MB 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 10.00 MB 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 11.00 MB 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.785 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 12.00 MB 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 13.00 MB 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 14.00 MB 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 15.00 MB 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.786 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 16.00 MB 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 17.00 MB 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 18.00 MB 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 19.00 MB 2023-09-30T23:03:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 20.00 MB 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 21.00 MB 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 22.00 MB 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 23.00 MB 2023-09-30T23:03:50.788 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 24.00 MB 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 25.00 MB 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 26.00 MB 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 27.00 MB 2023-09-30T23:03:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 28.00 MB 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 29.00 MB 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 30.00 MB 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 31.00 MB 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 32.00 MB 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:fsync'ed successfully 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:Not full yet after 33.00 MB 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:Reached fullness after 33.00 MB 2023-09-30T23:03:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:calling close 2023-09-30T23:03:50.792 INFO:teuthology.orchestra.run.smithi142.stdout:close() did not raise error 2023-09-30T23:03:50.842 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T23:03:50.842 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:03:50.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:03:51.059 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T23:03:51.059 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T23:03:51.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:03:51.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T23:03:51.157 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:03:51.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:03:51.157 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T23:03:51.211 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T23:03:51.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:03:51.211 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T23:03:51.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:03:51.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:03:51.300 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T23:03:51.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:03:51.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.537+0000 7faf365ff700 1 Processor -- start 2023-09-30T23:03:51.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.537+0000 7faf365ff700 1 -- start start 2023-09-30T23:03:51.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.538+0000 7faf365ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf300af020 0x7faf30156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:51.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.538+0000 7faf365ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300b00d0 0x7faf3006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:51.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.538+0000 7faf365ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3006d3e0 con 0x7faf3006e650 2023-09-30T23:03:51.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf365ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3015b400 con 0x7faf300af020 2023-09-30T23:03:51.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf365ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3006dc80 con 0x7faf300b00d0 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf300af020 0x7faf30156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf34b9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faf3006e650 0x7faf300b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39300/0 (socket says 172.21.15.142:39300) 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf34b9c700 1 -- 172.21.15.142:0/4186064600 learned_addr learned my addr 172.21.15.142:0/4186064600 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf300af020 0x7faf30156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42148/0 (socket says 172.21.15.142:42148) 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2f7fe700 1 --2- 172.21.15.142:0/4186064600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300b00d0 0x7faf3006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2ffff700 1 -- 172.21.15.142:0/4186064600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300b00d0 msgr2=0x7faf3006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2ffff700 1 --2- 172.21.15.142:0/4186064600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300b00d0 0x7faf3006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2ffff700 1 -- 172.21.15.142:0/4186064600 >> v1:172.21.15.142:6789/0 conn(0x7faf3006e650 legacy=0x7faf300b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2ffff700 1 -- 172.21.15.142:0/4186064600 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3006b790 con 0x7faf300af020 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2f7fe700 1 --2- 172.21.15.142:0/4186064600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300b00d0 0x7faf3006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:51.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.539+0000 7faf2effd700 1 -- 172.21.15.142:0/4186064600 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493200620 0 0) 0x7faf3006d3e0 con 0x7faf3006e650 2023-09-30T23:03:51.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf2ffff700 1 --2- 172.21.15.142:0/4186064600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf300af020 0x7faf30156d80 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7faf200098e0 tx=0x7faf200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e3c78cc4f8a10a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:51.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf2effd700 1 -- 172.21.15.142:0/4186064600 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20009e80 con 0x7faf300af020 2023-09-30T23:03:51.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf2effd700 1 -- 172.21.15.142:0/4186064600 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2000b860 con 0x7faf300af020 2023-09-30T23:03:51.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf2effd700 1 -- 172.21.15.142:0/4186064600 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000bbe0 con 0x7faf300af020 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 -- 172.21.15.142:0/4186064600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf300af020 msgr2=0x7faf30156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 --2- 172.21.15.142:0/4186064600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf300af020 0x7faf30156d80 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7faf200098e0 tx=0x7faf200091a0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 -- 172.21.15.142:0/4186064600 shutdown_connections 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 --2- 172.21.15.142:0/4186064600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf300af020 0x7faf30156d80 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 --2- 172.21.15.142:0/4186064600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300b00d0 0x7faf3006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 -- 172.21.15.142:0/4186064600 >> 172.21.15.142:0/4186064600 conn(0x7faf300680c0 msgr2=0x7faf300c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 -- 172.21.15.142:0/4186064600 shutdown_connections 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.540+0000 7faf365ff700 1 -- 172.21.15.142:0/4186064600 wait complete. 2023-09-30T23:03:51.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.542+0000 7faf365ff700 1 Processor -- start 2023-09-30T23:03:51.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.542+0000 7faf365ff700 1 -- start start 2023-09-30T23:03:51.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf365ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3006e650 0x7faf300c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:51.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf365ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300af020 0x7faf3014d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:51.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf365ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf300b00d0 0x7faf300c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf365ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300c8120 con 0x7faf3006e650 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf365ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300c7050 con 0x7faf300b00d0 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf365ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf300c27c0 con 0x7faf300af020 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3006e650 0x7faf300c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3006e650 0x7faf300c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42158/0 (socket says 172.21.15.142:42158) 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2ffff700 1 -- 172.21.15.142:0/2533363815 learned_addr learned my addr 172.21.15.142:0/2533363815 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2f7fe700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300af020 0x7faf3014d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf34b9c700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf300b00d0 0x7faf300c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2ffff700 1 -- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300af020 msgr2=0x7faf3014d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2ffff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300af020 0x7faf3014d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2ffff700 1 -- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf300b00d0 msgr2=0x7faf300c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.543+0000 7faf2ffff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf300b00d0 0x7faf300c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.544+0000 7faf2ffff700 1 -- 172.21.15.142:0/2533363815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf20009420 con 0x7faf3006e650 2023-09-30T23:03:51.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.544+0000 7faf2ffff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3006e650 0x7faf300c7be0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7faf30068600 tx=0x7faf20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:51.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.544+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2001f070 con 0x7faf3006e650 2023-09-30T23:03:51.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.544+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2000b9d0 con 0x7faf3006e650 2023-09-30T23:03:51.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.544+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20011670 con 0x7faf3006e650 2023-09-30T23:03:51.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.544+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf300c2aa0 con 0x7faf3006e650 2023-09-30T23:03:51.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.544+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf300c3060 con 0x7faf3006e650 2023-09-30T23:03:51.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.545+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf300695b0 con 0x7faf3006e650 2023-09-30T23:03:51.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.546+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7faf20011a60 con 0x7faf3006e650 2023-09-30T23:03:51.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.547+0000 7faf17fff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf1c067330 0x7faf1c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:51.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.547+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6087+0+0 (secure 0 0 0) 0x7faf200860c0 con 0x7faf3006e650 2023-09-30T23:03:51.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.547+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7faf1c06f550 con 0x7faf3006e650 2023-09-30T23:03:51.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.547+0000 7faf2f7fe700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf1c067330 0x7faf1c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:51.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.548+0000 7faf2f7fe700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf1c067330 0x7faf1c0697e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faf24006f00 tx=0x7faf24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:51.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.552+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faf20028060 con 0x7faf3006e650 2023-09-30T23:03:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.784+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf3006fc10 con 0x7faf3006e650 2023-09-30T23:03:51.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.785+0000 7faf17fff700 1 -- 172.21.15.142:0/2533363815 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4613 (secure 0 0 0) 0x7faf20052f00 con 0x7faf3006e650 2023-09-30T23:03:51.784 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:03:51.784 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:02:35.609202+0000","modified":"2023-09-30T23:02:39.164928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3571686386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3571686386},{"type":"v1","addr":"172.21.15.142:6837","nonce":3571686386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-09-30T23:03:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf1c067330 msgr2=0x7faf1c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf1c067330 0x7faf1c0697e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faf24006f00 tx=0x7faf24008040 comp rx=0 tx=0).stop 2023-09-30T23:03:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3006e650 msgr2=0x7faf300c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3006e650 0x7faf300c7be0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7faf30068600 tx=0x7faf20017000 comp rx=0 tx=0).stop 2023-09-30T23:03:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 shutdown_connections 2023-09-30T23:03:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faf1c067330 0x7faf1c0697e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf300b00d0 0x7faf300c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3006e650 0x7faf300c7be0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 --2- 172.21.15.142:0/2533363815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf300af020 0x7faf3014d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 >> 172.21.15.142:0/2533363815 conn(0x7faf300680c0 msgr2=0x7faf300cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 shutdown_connections 2023-09-30T23:03:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.787+0000 7faf365ff700 1 -- 172.21.15.142:0/2533363815 wait complete. 2023-09-30T23:03:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 83 2023-09-30T23:03:51.804 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:03:51.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.993+0000 7f7d521ff700 1 Processor -- start 2023-09-30T23:03:51.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.993+0000 7f7d521ff700 1 -- start start 2023-09-30T23:03:51.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.994+0000 7f7d521ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d4c15de20 0x7f7d4c164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:51.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.994+0000 7f7d521ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0cc6b0 con 0x7f7d4c143350 2023-09-30T23:03:51.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.994+0000 7f7d521ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0cbaa0 con 0x7f7d4c0692f0 2023-09-30T23:03:51.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.994+0000 7f7d521ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cbd80 con 0x7f7d4c15de20 2023-09-30T23:03:51.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d4c15de20 0x7f7d4c164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d4c15de20 0x7f7d4c164ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42170/0 (socket says 172.21.15.142:42170) 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4bfff700 1 -- 172.21.15.142:0/2693883342 learned_addr learned my addr 172.21.15.142:0/2693883342 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4b7fe700 1 --1- 172.21.15.142:0/2693883342 >> v1:172.21.15.142:6789/0 conn(0x7f7d4c143350 0x7f7d4c0cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39306/0 (socket says 172.21.15.142:39306) 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4bfff700 1 -- 172.21.15.142:0/2693883342 >> v1:172.21.15.148:6789/0 conn(0x7f7d4c0692f0 legacy=0x7f7d4c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4bfff700 1 -- 172.21.15.142:0/2693883342 >> v1:172.21.15.142:6789/0 conn(0x7f7d4c143350 legacy=0x7f7d4c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4bfff700 1 -- 172.21.15.142:0/2693883342 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0cc060 con 0x7f7d4c15de20 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.995+0000 7f7d4a7fc700 1 -- 172.21.15.142:0/2693883342 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200836283 0 0) 0x7f7d4c0cc6b0 con 0x7f7d4c143350 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d4bfff700 1 --2- 172.21.15.142:0/2693883342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c164ab0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009f20 tx=0x7f7d44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252a9b170bae4312 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d4a7fc700 1 -- 172.21.15.142:0/2693883342 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400e070 con 0x7f7d4c15de20 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d4a7fc700 1 -- 172.21.15.142:0/2693883342 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400ba80 con 0x7f7d4c15de20 2023-09-30T23:03:51.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d4a7fc700 1 -- 172.21.15.142:0/2693883342 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440092e0 con 0x7f7d4c15de20 2023-09-30T23:03:51.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d521ff700 1 -- 172.21.15.142:0/2693883342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 msgr2=0x7f7d4c164ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:51.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d521ff700 1 --2- 172.21.15.142:0/2693883342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c164ab0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009f20 tx=0x7f7d44009840 comp rx=0 tx=0).stop 2023-09-30T23:03:51.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d521ff700 1 -- 172.21.15.142:0/2693883342 shutdown_connections 2023-09-30T23:03:51.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d521ff700 1 --2- 172.21.15.142:0/2693883342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c164ab0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:51.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d521ff700 1 -- 172.21.15.142:0/2693883342 >> 172.21.15.142:0/2693883342 conn(0x7f7d4c0ce8e0 msgr2=0x7f7d4c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:51.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d521ff700 1 -- 172.21.15.142:0/2693883342 shutdown_connections 2023-09-30T23:03:51.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.996+0000 7f7d521ff700 1 -- 172.21.15.142:0/2693883342 wait complete. 2023-09-30T23:03:51.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.998+0000 7f7d521ff700 1 Processor -- start 2023-09-30T23:03:51.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.998+0000 7f7d521ff700 1 -- start start 2023-09-30T23:03:52.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d521ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d4c0692f0 0x7f7d4c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d521ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d4c143350 0x7f7d4c13f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d521ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d521ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0a7e10 con 0x7f7d4c15de20 2023-09-30T23:03:52.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d521ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0b1440 con 0x7f7d4c0692f0 2023-09-30T23:03:52.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d521ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c15b160 con 0x7f7d4c143350 2023-09-30T23:03:52.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42182/0 (socket says 172.21.15.142:42182) 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 -- 172.21.15.142:0/1222477680 learned_addr learned my addr 172.21.15.142:0/1222477680 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d4c0692f0 0x7f7d4c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4affd700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d4c143350 0x7f7d4c13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 -- 172.21.15.142:0/1222477680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d4c143350 msgr2=0x7f7d4c13f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d4c143350 0x7f7d4c13f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 -- 172.21.15.142:0/1222477680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d4c0692f0 msgr2=0x7f7d4c0b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d4c0692f0 0x7f7d4c0b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:51.999+0000 7f7d4bfff700 1 -- 172.21.15.142:0/1222477680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009ae0 con 0x7f7d4c15de20 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.000+0000 7f7d4bfff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c0b3830 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d44012000 tx=0x7f7d44018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.000+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44007cd0 con 0x7f7d4c15de20 2023-09-30T23:03:52.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.000+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d44007e70 con 0x7f7d4c15de20 2023-09-30T23:03:52.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.000+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c15b440 con 0x7f7d4c15de20 2023-09-30T23:03:52.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.000+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44025690 con 0x7f7d4c15de20 2023-09-30T23:03:52.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.000+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c15b7d0 con 0x7f7d4c15de20 2023-09-30T23:03:52.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.001+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c06ea70 con 0x7f7d4c15de20 2023-09-30T23:03:52.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.002+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7d4401c410 con 0x7f7d4c15de20 2023-09-30T23:03:52.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.003+0000 7f7d337fe700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d38067330 0x7f7d380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.003+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f7d44086890 con 0x7f7d4c15de20 2023-09-30T23:03:52.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.003+0000 7f7d4b7fe700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d38067330 0x7f7d380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.003+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f7d3806f550 con 0x7f7d4c15de20 2023-09-30T23:03:52.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.004+0000 7f7d4b7fe700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d38067330 0x7f7d380697e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007fd0 tx=0x7f7d3c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.007+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7d44053780 con 0x7f7d4c15de20 2023-09-30T23:03:52.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.199+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d4c06fc10 con 0x7f7d4c15de20 2023-09-30T23:03:52.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.200+0000 7f7d337fe700 1 -- 172.21.15.142:0/1222477680 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+17101 (secure 0 0 0) 0x7f7d4402a020 con 0x7f7d4c15de20 2023-09-30T23:03:52.200 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:03:52.201 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":179,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:03:24.385736+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:02:33.854527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-09-30T23:02:34.591957+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:03:52.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.202+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d38067330 msgr2=0x7f7d380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.202+0000 7f7d521ff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d38067330 0x7f7d380697e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007fd0 tx=0x7f7d3c007d30 comp rx=0 tx=0).stop 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.202+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 msgr2=0x7f7d4c0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.202+0000 7f7d521ff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c0b3830 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d44012000 tx=0x7f7d44018000 comp rx=0 tx=0).stop 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 shutdown_connections 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7d38067330 0x7f7d380697e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c15de20 0x7f7d4c0b3830 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d4c0692f0 0x7f7d4c0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 --2- 172.21.15.142:0/1222477680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d4c143350 0x7f7d4c13f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 >> 172.21.15.142:0/1222477680 conn(0x7f7d4c0ce8e0 msgr2=0x7f7d4c140040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:52.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 shutdown_connections 2023-09-30T23:03:52.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.203+0000 7f7d521ff700 1 -- 172.21.15.142:0/1222477680 wait complete. 2023-09-30T23:03:52.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T23:02:33.854527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T23:02:34.591957+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T23:03:52.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T23:03:52.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.415+0000 7f93f07ff700 1 Processor -- start 2023-09-30T23:03:52.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.415+0000 7f93f07ff700 1 -- start start 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.416+0000 7f93f07ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93e80cb350 0x7f93e81615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93f07ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e80c7690 con 0x7f93e8069f10 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93f07ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e80c7f20 con 0x7f93e80c52a0 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93f07ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e81406a0 con 0x7f93e80cb350 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93eed9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93e80cb350 0x7f93e81615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93eed9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93e80cb350 0x7f93e81615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42196/0 (socket says 172.21.15.142:42196) 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93eed9c700 1 -- 172.21.15.142:0/3528283383 learned_addr learned my addr 172.21.15.142:0/3528283383 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93eed9c700 1 -- 172.21.15.142:0/3528283383 >> v1:172.21.15.148:6789/0 conn(0x7f93e80c52a0 legacy=0x7f93e80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93eed9c700 1 -- 172.21.15.142:0/3528283383 >> v1:172.21.15.142:6789/0 conn(0x7f93e8069f10 legacy=0x7f93e80c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93eed9c700 1 -- 172.21.15.142:0/3528283383 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e806a3f0 con 0x7f93e80cb350 2023-09-30T23:03:52.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.417+0000 7f93eed9c700 1 --2- 172.21.15.142:0/3528283383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e81615f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009f20 tx=0x7f93e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c14f94639a13b77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93ed599700 1 -- 172.21.15.142:0/3528283383 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000e070 con 0x7f93e80cb350 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93ed599700 1 -- 172.21.15.142:0/3528283383 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000ba80 con 0x7f93e80cb350 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93ed599700 1 -- 172.21.15.142:0/3528283383 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00092e0 con 0x7f93e80cb350 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93f07ff700 1 -- 172.21.15.142:0/3528283383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 msgr2=0x7f93e81615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93f07ff700 1 --2- 172.21.15.142:0/3528283383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e81615f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009f20 tx=0x7f93e0009840 comp rx=0 tx=0).stop 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93f07ff700 1 -- 172.21.15.142:0/3528283383 shutdown_connections 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93f07ff700 1 --2- 172.21.15.142:0/3528283383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e81615f0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93f07ff700 1 -- 172.21.15.142:0/3528283383 >> 172.21.15.142:0/3528283383 conn(0x7f93e80cc670 msgr2=0x7f93e80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93f07ff700 1 -- 172.21.15.142:0/3528283383 shutdown_connections 2023-09-30T23:03:52.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.418+0000 7f93f07ff700 1 -- 172.21.15.142:0/3528283383 wait complete. 2023-09-30T23:03:52.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.420+0000 7f93f07ff700 1 Processor -- start 2023-09-30T23:03:52.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.420+0000 7f93f07ff700 1 -- start start 2023-09-30T23:03:52.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93f07ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e8069f10 0x7f93e81670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93f07ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93e80c52a0 0x7f93e8165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93f07ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e813e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93f07ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80b4040 con 0x7f93e80cb350 2023-09-30T23:03:52.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93f07ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80b6d40 con 0x7f93e8069f10 2023-09-30T23:03:52.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93f07ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80b7020 con 0x7f93e80c52a0 2023-09-30T23:03:52.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93eed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e813e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93eed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e813e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42204/0 (socket says 172.21.15.142:42204) 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93eed9c700 1 -- 172.21.15.142:0/881696025 learned_addr learned my addr 172.21.15.142:0/881696025 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93ee59b700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e8069f10 0x7f93e81670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.421+0000 7f93edd9a700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93e80c52a0 0x7f93e8165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93eed9c700 1 -- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93e80c52a0 msgr2=0x7f93e8165570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93eed9c700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93e80c52a0 0x7f93e8165570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93eed9c700 1 -- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e8069f10 msgr2=0x7f93e81670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93eed9c700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e8069f10 0x7f93e81670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93eed9c700 1 -- 172.21.15.142:0/881696025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0009ae0 con 0x7f93e80cb350 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93edd9a700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93e80c52a0 0x7f93e8165570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93eed9c700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e813e6f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f93e806c260 tx=0x7f93e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0012ea0 con 0x7f93e80cb350 2023-09-30T23:03:52.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e00092e0 con 0x7f93e80cb350 2023-09-30T23:03:52.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e001e660 con 0x7f93e80cb350 2023-09-30T23:03:52.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80b42b0 con 0x7f93e80cb350 2023-09-30T23:03:52.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.422+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e81675f0 con 0x7f93e80cb350 2023-09-30T23:03:52.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.423+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e80b47d0 con 0x7f93e80cb350 2023-09-30T23:03:52.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.424+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f93e001ea50 con 0x7f93e80cb350 2023-09-30T23:03:52.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.425+0000 7f93de7fc700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93cc067330 0x7f93cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.425+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f93e0086980 con 0x7f93e80cb350 2023-09-30T23:03:52.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.425+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f93cc06f550 con 0x7f93e80cb350 2023-09-30T23:03:52.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.425+0000 7f93ee59b700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93cc067330 0x7f93cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.426+0000 7f93ee59b700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93cc067330 0x7f93cc0697e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f93e813b790 tx=0x7f93e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.430+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f93e80b47d0 con 0x7f93e80cb350 2023-09-30T23:03:52.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.622+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93e80b47d0 con 0x7f93e80cb350 2023-09-30T23:03:52.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.622+0000 7f93de7fc700 1 -- 172.21.15.142:0/881696025 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93e80b47d0 con 0x7f93e80cb350 2023-09-30T23:03:52.623 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T23:03:52.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93cc067330 msgr2=0x7f93cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93cc067330 0x7f93cc0697e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f93e813b790 tx=0x7f93e4009040 comp rx=0 tx=0).stop 2023-09-30T23:03:52.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 msgr2=0x7f93e813e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e813e6f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f93e806c260 tx=0x7f93e0017000 comp rx=0 tx=0).stop 2023-09-30T23:03:52.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 shutdown_connections 2023-09-30T23:03:52.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f93cc067330 0x7f93cc0697e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e80cb350 0x7f93e813e6f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e8069f10 0x7f93e81670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 --2- 172.21.15.142:0/881696025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93e80c52a0 0x7f93e8165570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 >> 172.21.15.142:0/881696025 conn(0x7f93e80cc670 msgr2=0x7f93e806a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:52.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 shutdown_connections 2023-09-30T23:03:52.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.625+0000 7f93f07ff700 1 -- 172.21.15.142:0/881696025 wait complete. 2023-09-30T23:03:52.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T23:03:52.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.834+0000 7f78d75ff700 1 Processor -- start 2023-09-30T23:03:52.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.834+0000 7f78d75ff700 1 -- start start 2023-09-30T23:03:52.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.835+0000 7f78d75ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f78d0157ab0 0x7f78d015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.835+0000 7f78d75ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78d00cc3b0 0x7f78d00cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.835+0000 7f78d75ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d00d0550 con 0x7f78d00cbfe0 2023-09-30T23:03:52.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.835+0000 7f78d75ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d00cf750 con 0x7f78d00cc3b0 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.835+0000 7f78d75ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d00cf940 con 0x7f78d0157ab0 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d539b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f78d00cbfe0 0x7f78d01573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39334/0 (socket says 172.21.15.142:39334) 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d539b700 1 -- 172.21.15.142:0/2614086277 learned_addr learned my addr 172.21.15.142:0/2614086277 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d5b9c700 1 --2- 172.21.15.142:0/2614086277 >> v2:172.21.15.142:3300/0 conn(0x7f78d00cc3b0 0x7f78d00cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d4b9a700 1 --2- 172.21.15.142:0/2614086277 >> v2:172.21.15.148:3300/0 conn(0x7f78d0157ab0 0x7f78d015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78c7fff700 1 -- 172.21.15.142:0/2614086277 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839560957 0 0) 0x7f78d00d0550 con 0x7f78d00cbfe0 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78c7fff700 1 -- 172.21.15.142:0/2614086277 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc003570 con 0x7f78d00cbfe0 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d5b9c700 1 -- 172.21.15.142:0/2614086277 >> v2:172.21.15.148:3300/0 conn(0x7f78d0157ab0 msgr2=0x7f78d015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d5b9c700 1 --2- 172.21.15.142:0/2614086277 >> v2:172.21.15.148:3300/0 conn(0x7f78d0157ab0 0x7f78d015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d5b9c700 1 -- 172.21.15.142:0/2614086277 >> v1:172.21.15.142:6789/0 conn(0x7f78d00cbfe0 legacy=0x7f78d01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d5b9c700 1 -- 172.21.15.142:0/2614086277 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d00cfc20 con 0x7f78d00cc3b0 2023-09-30T23:03:52.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d4b9a700 1 --2- 172.21.15.142:0/2614086277 >> v2:172.21.15.148:3300/0 conn(0x7f78d0157ab0 0x7f78d015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:52.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.836+0000 7f78d5b9c700 1 --2- 172.21.15.142:0/2614086277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d00cc3b0 0x7f78d00cf210 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f78d00ced20 tx=0x7f78c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7a6979ff5da2c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78c7fff700 1 -- 172.21.15.142:0/2614086277 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c800e070 con 0x7f78d00cc3b0 2023-09-30T23:03:52.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78c7fff700 1 -- 172.21.15.142:0/2614086277 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c800bb60 con 0x7f78d00cc3b0 2023-09-30T23:03:52.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78c7fff700 1 -- 172.21.15.142:0/2614086277 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8012430 con 0x7f78d00cc3b0 2023-09-30T23:03:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 -- 172.21.15.142:0/2614086277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d00cc3b0 msgr2=0x7f78d00cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2614086277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d00cc3b0 0x7f78d00cf210 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f78d00ced20 tx=0x7f78c8009780 comp rx=0 tx=0).stop 2023-09-30T23:03:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 -- 172.21.15.142:0/2614086277 shutdown_connections 2023-09-30T23:03:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2614086277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d00cc3b0 0x7f78d00cf210 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2614086277 >> v2:172.21.15.148:3300/0 conn(0x7f78d0157ab0 0x7f78d015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 -- 172.21.15.142:0/2614086277 >> 172.21.15.142:0/2614086277 conn(0x7f78d00d0a80 msgr2=0x7f78d00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:52.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 -- 172.21.15.142:0/2614086277 shutdown_connections 2023-09-30T23:03:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.837+0000 7f78d75ff700 1 -- 172.21.15.142:0/2614086277 wait complete. 2023-09-30T23:03:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.839+0000 7f78d75ff700 1 Processor -- start 2023-09-30T23:03:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.839+0000 7f78d75ff700 1 -- start start 2023-09-30T23:03:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d75ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78d00cbfe0 0x7f78d00c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d75ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78d00cc3b0 0x7f78d00c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d75ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d0157ab0 0x7f78d0159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d75ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0159d20 con 0x7f78d0157ab0 2023-09-30T23:03:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d75ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d016a730 con 0x7f78d00cc3b0 2023-09-30T23:03:52.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d75ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d016aa10 con 0x7f78d00cbfe0 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d5b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d0157ab0 0x7f78d0159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d5b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d0157ab0 0x7f78d0159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42222/0 (socket says 172.21.15.142:42222) 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d5b9c700 1 -- 172.21.15.142:0/2197484809 learned_addr learned my addr 172.21.15.142:0/2197484809 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d539b700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78d00cbfe0 0x7f78d00c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.840+0000 7f78d4b9a700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78d00cc3b0 0x7f78d00c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d5b9c700 1 -- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78d00cbfe0 msgr2=0x7f78d00c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d5b9c700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78d00cbfe0 0x7f78d00c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d5b9c700 1 -- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78d00cc3b0 msgr2=0x7f78d00c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d5b9c700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78d00cc3b0 0x7f78d00c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:52.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d5b9c700 1 -- 172.21.15.142:0/2197484809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8009a20 con 0x7f78d0157ab0 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d4b9a700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78d00cc3b0 0x7f78d00c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d539b700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78d00cbfe0 0x7f78d00c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d5b9c700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d0157ab0 0x7f78d0159fc0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009fd0 tx=0x7f78c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8012e00 con 0x7f78d0157ab0 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c801d630 con 0x7f78d0157ab0 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d016acf0 con 0x7f78d0157ab0 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c801d9f0 con 0x7f78d0157ab0 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.841+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d00c4a90 con 0x7f78d0157ab0 2023-09-30T23:03:52.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.842+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d0069770 con 0x7f78d0157ab0 2023-09-30T23:03:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.843+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f78c8024070 con 0x7f78d0157ab0 2023-09-30T23:03:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.844+0000 7f78c57fa700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78b4067330 0x7f78b40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.844+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f78c8087380 con 0x7f78d0157ab0 2023-09-30T23:03:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.844+0000 7f78d539b700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78b4067330 0x7f78b40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:52.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.844+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f78b406f550 con 0x7f78d0157ab0 2023-09-30T23:03:52.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.845+0000 7f78d539b700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78b4067330 0x7f78b40697e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f78d015cec0 tx=0x7f78cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:52.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:52.848+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f78c80541c0 con 0x7f78d0157ab0 2023-09-30T23:03:53.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.037+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78d006fc10 con 0x7f78d0157ab0 2023-09-30T23:03:53.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.037+0000 7f78c57fa700 1 -- 172.21.15.142:0/2197484809 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v179) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78c80577e0 con 0x7f78d0157ab0 2023-09-30T23:03:53.037 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T23:03:53.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.039+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78b4067330 msgr2=0x7f78b40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.039+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78b4067330 0x7f78b40697e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f78d015cec0 tx=0x7f78cc009040 comp rx=0 tx=0).stop 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.039+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d0157ab0 msgr2=0x7f78d0159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.039+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d0157ab0 0x7f78d0159fc0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009fd0 tx=0x7f78c8019000 comp rx=0 tx=0).stop 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 shutdown_connections 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78b4067330 0x7f78b40697e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d0157ab0 0x7f78d0159fc0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78d00cbfe0 0x7f78d00c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 --2- 172.21.15.142:0/2197484809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78d00cc3b0 0x7f78d00c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 >> 172.21.15.142:0/2197484809 conn(0x7f78d00d0a80 msgr2=0x7f78d00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 shutdown_connections 2023-09-30T23:03:53.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.040+0000 7f78d75ff700 1 -- 172.21.15.142:0/2197484809 wait complete. 2023-09-30T23:03:53.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T23:03:53.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.248+0000 7f94d81ff700 1 Processor -- start 2023-09-30T23:03:53.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.248+0000 7f94d81ff700 1 -- start start 2023-09-30T23:03:53.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.249+0000 7f94d81ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 0x7f94d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.249+0000 7f94d81ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d01576e0 con 0x7f94d015a920 2023-09-30T23:03:53.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.249+0000 7f94d81ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d015a490 con 0x7f94d01509d0 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.249+0000 7f94d81ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00cc320 con 0x7f94d0150600 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d679c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f94d015a920 0x7f94d00ca240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39340/0 (socket says 172.21.15.142:39340) 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d679c700 1 -- 172.21.15.142:0/1455655539 learned_addr learned my addr 172.21.15.142:0/1455655539 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d5f9b700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 0x7f94d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375147860 0 0) 0x7f94d01576e0 con 0x7f94d015a920 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94bc004680 con 0x7f94d015a920 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263425069 0 0) 0x7f94d015a490 con 0x7f94d01509d0 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d01576e0 con 0x7f94d01509d0 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1958780221 0 0) 0x7f94bc004680 con 0x7f94d015a920 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 msgr2=0x7f94d006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:53.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 0x7f94d006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 >> v1:172.21.15.148:6789/0 conn(0x7f94d01509d0 legacy=0x7f94d0156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.250+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0157400 con 0x7f94d015a920 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f94c80017f0 con 0x7f94d015a920 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 >> v1:172.21.15.142:6789/0 conn(0x7f94d015a920 legacy=0x7f94d00ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc004d30 0x7f94bc005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94bc005920 0x7f94bc005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 0x7f94bc0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00cc320 con 0x7f94bc005920 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc003570 con 0x7f94bc004d30 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc003730 con 0x7f94d0150600 2023-09-30T23:03:53.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d579a700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94bc005920 0x7f94bc005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d5f9b700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc004d30 0x7f94bc005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d679c700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 0x7f94bc0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d579a700 1 -- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 msgr2=0x7f94bc0062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d579a700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d0150600 0x7f94bc0062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d579a700 1 -- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc004d30 msgr2=0x7f94bc005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d579a700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc004d30 0x7f94bc005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.251+0000 7f94d579a700 1 -- 172.21.15.142:0/1455655539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc004680 con 0x7f94bc005920 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d579a700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94bc005920 0x7f94bc005d90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f94c0001a10 tx=0x7f94c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa0aaf2e9ee2d65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000c5d0 con 0x7f94bc005920 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000c730 con 0x7f94bc005920 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d4f99700 1 -- 172.21.15.142:0/1455655539 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000cad0 con 0x7f94bc005920 2023-09-30T23:03:53.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d81ff700 1 -- 172.21.15.142:0/1455655539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94bc005920 msgr2=0x7f94bc005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d81ff700 1 --2- 172.21.15.142:0/1455655539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94bc005920 0x7f94bc005d90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f94c0001a10 tx=0x7f94c0007d30 comp rx=0 tx=0).stop 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d679c700 1 -- 172.21.15.142:0/1455655539 reap_dead start 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d81ff700 1 -- 172.21.15.142:0/1455655539 shutdown_connections 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d81ff700 1 -- 172.21.15.142:0/1455655539 >> 172.21.15.142:0/1455655539 conn(0x7f94d00cc670 msgr2=0x7f94d00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d81ff700 1 -- 172.21.15.142:0/1455655539 shutdown_connections 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.252+0000 7f94d81ff700 1 -- 172.21.15.142:0/1455655539 wait complete. 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.254+0000 7f94d81ff700 1 Processor -- start 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.254+0000 7f94d81ff700 1 -- start start 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d81ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc005920 0x7f94d01455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d81ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d014f790 0x7f94d016a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d81ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d016a8c0 0x7f94d00c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d81ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d016b300 con 0x7f94d016a8c0 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d81ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c4d40 con 0x7f94bc005920 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d81ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d016ad40 con 0x7f94d014f790 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d016a8c0 0x7f94d00c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d016a8c0 0x7f94d00c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42250/0 (socket says 172.21.15.142:42250) 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d679c700 1 -- 172.21.15.142:0/2088653872 learned_addr learned my addr 172.21.15.142:0/2088653872 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d5f9b700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc005920 0x7f94d01455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.255+0000 7f94d579a700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d014f790 0x7f94d016a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d679c700 1 -- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d014f790 msgr2=0x7f94d016a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d679c700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d014f790 0x7f94d016a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d679c700 1 -- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc005920 msgr2=0x7f94d01455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d679c700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc005920 0x7f94d01455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d679c700 1 -- 172.21.15.142:0/2088653872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d016b020 con 0x7f94d016a8c0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d679c700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d016a8c0 0x7f94d00c51d0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f94d015a400 tx=0x7f94c8002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c800ebc0 con 0x7f94d016a8c0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c800ed20 con 0x7f94d016a8c0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d00c49d0 con 0x7f94d016a8c0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8013670 con 0x7f94d016a8c0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.256+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d0145cf0 con 0x7f94d016a8c0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.257+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d00c4eb0 con 0x7f94d016a8c0 2023-09-30T23:03:53.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.258+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f94c80139e0 con 0x7f94d016a8c0 2023-09-30T23:03:53.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.259+0000 7f94c5ffb700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f94b4067330 0x7f94b40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.259+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f94c8085160 con 0x7f94d016a8c0 2023-09-30T23:03:53.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.259+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f94b406f550 con 0x7f94d016a8c0 2023-09-30T23:03:53.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.259+0000 7f94d5f9b700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f94b4067330 0x7f94b40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.260+0000 7f94d5f9b700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f94b4067330 0x7f94b40697e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94d014bc00 tx=0x7f94cc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:53.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.263+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f94c8051fa0 con 0x7f94d016a8c0 2023-09-30T23:03:53.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.450+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94d006fc10 con 0x7f94d016a8c0 2023-09-30T23:03:53.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.450+0000 7f94c5ffb700 1 -- 172.21.15.142:0/2088653872 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v179) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94c80555c0 con 0x7f94d016a8c0 2023-09-30T23:03:53.450 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T23:03:53.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f94b4067330 msgr2=0x7f94b40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f94b4067330 0x7f94b40697e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94d014bc00 tx=0x7f94cc0091a0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d016a8c0 msgr2=0x7f94d00c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d016a8c0 0x7f94d00c51d0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f94d015a400 tx=0x7f94c8002170 comp rx=0 tx=0).stop 2023-09-30T23:03:53.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 shutdown_connections 2023-09-30T23:03:53.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f94b4067330 0x7f94b40697e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d016a8c0 0x7f94d00c51d0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94bc005920 0x7f94d01455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 --2- 172.21.15.142:0/2088653872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94d014f790 0x7f94d016a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 >> 172.21.15.142:0/2088653872 conn(0x7f94d00cc670 msgr2=0x7f94d006d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:53.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 shutdown_connections 2023-09-30T23:03:53.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.453+0000 7f94d81ff700 1 -- 172.21.15.142:0/2088653872 wait complete. 2023-09-30T23:03:53.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T23:03:53.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.664+0000 7f2c523ff700 1 Processor -- start 2023-09-30T23:03:53.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.664+0000 7f2c523ff700 1 -- start start 2023-09-30T23:03:53.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c523ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c150600 0x7f2c4c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c523ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c4c1509d0 0x7f2c4c06ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c523ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c1576e0 con 0x7f2c4c15a920 2023-09-30T23:03:53.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c523ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cc320 con 0x7f2c4c1509d0 2023-09-30T23:03:53.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c523ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c15a490 con 0x7f2c4c150600 2023-09-30T23:03:53.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c4b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c4c1509d0 0x7f2c4c06ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c4bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c150600 0x7f2c4c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c4bfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c150600 0x7f2c4c06a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:52518/0 (socket says 172.21.15.142:52518) 2023-09-30T23:03:53.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c4bfff700 1 -- 172.21.15.142:0/359764842 learned_addr learned my addr 172.21.15.142:0/359764842 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:53.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.666+0000 7f2c5099c700 1 --1- 172.21.15.142:0/359764842 >> v1:172.21.15.148:6789/0 conn(0x7f2c4c15a920 0x7f2c4c156710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:34276/0 (socket says 172.21.15.142:34276) 2023-09-30T23:03:53.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.667+0000 7f2c4bfff700 1 -- 172.21.15.142:0/359764842 >> v2:172.21.15.148:3300/0 conn(0x7f2c4c1509d0 msgr2=0x7f2c4c06ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:53.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.667+0000 7f2c4affd700 1 -- 172.21.15.142:0/359764842 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945443330 0 0) 0x7f2c4c1576e0 con 0x7f2c4c15a920 2023-09-30T23:03:53.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.667+0000 7f2c4bfff700 1 --2- 172.21.15.142:0/359764842 >> v2:172.21.15.148:3300/0 conn(0x7f2c4c1509d0 0x7f2c4c06ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.667+0000 7f2c4bfff700 1 -- 172.21.15.142:0/359764842 >> v1:172.21.15.148:6789/0 conn(0x7f2c4c15a920 legacy=0x7f2c4c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.667+0000 7f2c4bfff700 1 -- 172.21.15.142:0/359764842 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c157400 con 0x7f2c4c150600 2023-09-30T23:03:53.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.667+0000 7f2c4bfff700 1 --2- 172.21.15.142:0/359764842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c150600 0x7f2c4c06a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0099b0 tx=0x7f2c3c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33167d9b46c964c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:53.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.667+0000 7f2c4affd700 1 -- 172.21.15.142:0/359764842 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c009ea0 con 0x7f2c4c150600 2023-09-30T23:03:53.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c4affd700 1 -- 172.21.15.142:0/359764842 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c00b860 con 0x7f2c4c150600 2023-09-30T23:03:53.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c4affd700 1 -- 172.21.15.142:0/359764842 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00bc00 con 0x7f2c4c150600 2023-09-30T23:03:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 -- 172.21.15.142:0/359764842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c150600 msgr2=0x7f2c4c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 --2- 172.21.15.142:0/359764842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c150600 0x7f2c4c06a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0099b0 tx=0x7f2c3c009250 comp rx=0 tx=0).stop 2023-09-30T23:03:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 -- 172.21.15.142:0/359764842 shutdown_connections 2023-09-30T23:03:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 --2- 172.21.15.142:0/359764842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c150600 0x7f2c4c06a7a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 --2- 172.21.15.142:0/359764842 >> v2:172.21.15.148:3300/0 conn(0x7f2c4c1509d0 0x7f2c4c06ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 -- 172.21.15.142:0/359764842 >> 172.21.15.142:0/359764842 conn(0x7f2c4c0cc670 msgr2=0x7f2c4c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:53.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 -- 172.21.15.142:0/359764842 shutdown_connections 2023-09-30T23:03:53.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.668+0000 7f2c523ff700 1 -- 172.21.15.142:0/359764842 wait complete. 2023-09-30T23:03:53.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.670+0000 7f2c523ff700 1 Processor -- start 2023-09-30T23:03:53.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.670+0000 7f2c523ff700 1 -- start start 2023-09-30T23:03:53.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c523ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c4c150600 0x7f2c4c148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c523ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c1509d0 0x7f2c4c16a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c523ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c4c15a920 0x7f2c4c0c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c523ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c14d720 con 0x7f2c4c150600 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c523ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c14c7c0 con 0x7f2c4c15a920 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c523ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c14caa0 con 0x7f2c4c1509d0 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c4c150600 0x7f2c4c148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c4c150600 0x7f2c4c148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42262/0 (socket says 172.21.15.142:42262) 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 -- 172.21.15.142:0/3287767482 learned_addr learned my addr 172.21.15.142:0/3287767482 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4b7fe700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c1509d0 0x7f2c4c16a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c5099c700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c4c15a920 0x7f2c4c0c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 -- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c1509d0 msgr2=0x7f2c4c16a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c1509d0 0x7f2c4c16a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 -- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c4c15a920 msgr2=0x7f2c4c0c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c4c15a920 0x7f2c4c0c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c4bfff700 1 -- 172.21.15.142:0/3287767482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0094f0 con 0x7f2c4c150600 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.671+0000 7f2c5099c700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c4c15a920 0x7f2c4c0c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.672+0000 7f2c4bfff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c4c150600 0x7f2c4c148030 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009290 tx=0x7f2c3c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.672+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c01c070 con 0x7f2c4c150600 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.672+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c00b9d0 con 0x7f2c4c150600 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.672+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c022400 con 0x7f2c4c150600 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.672+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c14cd80 con 0x7f2c4c150600 2023-09-30T23:03:53.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.672+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c14d340 con 0x7f2c4c150600 2023-09-30T23:03:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.673+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c069a50 con 0x7f2c4c150600 2023-09-30T23:03:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.674+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2c3c0103f0 con 0x7f2c4c150600 2023-09-30T23:03:53.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.675+0000 7f2c33fff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c38067330 0x7f2c380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.675+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f2c3c0861f0 con 0x7f2c4c150600 2023-09-30T23:03:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.675+0000 7f2c4b7fe700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c38067330 0x7f2c380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.675+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f2c3806f550 con 0x7f2c4c150600 2023-09-30T23:03:53.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.676+0000 7f2c4b7fe700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c38067330 0x7f2c380697e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0c7a30 tx=0x7f2c400091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:53.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.679+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2c3c053030 con 0x7f2c4c150600 2023-09-30T23:03:53.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.867+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c4c06e560 con 0x7f2c4c150600 2023-09-30T23:03:53.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.868+0000 7f2c33fff700 1 -- 172.21.15.142:0/3287767482 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v179) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c3c027030 con 0x7f2c4c150600 2023-09-30T23:03:53.867 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T23:03:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c38067330 msgr2=0x7f2c380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c38067330 0x7f2c380697e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0c7a30 tx=0x7f2c400091a0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c4c150600 msgr2=0x7f2c4c148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c4c150600 0x7f2c4c148030 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009290 tx=0x7f2c3c018000 comp rx=0 tx=0).stop 2023-09-30T23:03:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 shutdown_connections 2023-09-30T23:03:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2c38067330 0x7f2c380697e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c4c15a920 0x7f2c4c0c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c4c150600 0x7f2c4c148030 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 --2- 172.21.15.142:0/3287767482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c4c1509d0 0x7f2c4c16a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 >> 172.21.15.142:0/3287767482 conn(0x7f2c4c0cc670 msgr2=0x7f2c4c06e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 shutdown_connections 2023-09-30T23:03:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:53.870+0000 7f2c523ff700 1 -- 172.21.15.142:0/3287767482 wait complete. 2023-09-30T23:03:53.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:03:54.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.076+0000 7fd396dff700 1 Processor -- start 2023-09-30T23:03:54.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.076+0000 7fd396dff700 1 -- start start 2023-09-30T23:03:54.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd396dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd390159b50 0x7fd3900a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd396dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3900ac3a0 0x7fd3900aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd396dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd390068000 con 0x7fd3900aa7e0 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd396dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd390069f10 con 0x7fd3900ac3a0 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd396dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900aac30 con 0x7fd390159b50 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd38ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3900ac3a0 0x7fd3900aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd38ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3900ac3a0 0x7fd3900aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42274/0 (socket says 172.21.15.142:42274) 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd38ffff700 1 -- 172.21.15.142:0/2109743739 learned_addr learned my addr 172.21.15.142:0/2109743739 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd39539c700 1 --1- 172.21.15.142:0/2109743739 >> v1:172.21.15.142:6789/0 conn(0x7fd3900aa7e0 0x7fd39006a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39344/0 (socket says 172.21.15.142:39344) 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd394b9b700 1 --2- 172.21.15.142:0/2109743739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd390159b50 0x7fd3900a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd38ffff700 1 -- 172.21.15.142:0/2109743739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd390159b50 msgr2=0x7fd3900a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd38ffff700 1 --2- 172.21.15.142:0/2109743739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd390159b50 0x7fd3900a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd38ffff700 1 -- 172.21.15.142:0/2109743739 >> v1:172.21.15.142:6789/0 conn(0x7fd3900aa7e0 legacy=0x7fd39006a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.079+0000 7fd38ffff700 1 -- 172.21.15.142:0/2109743739 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900a9e00 con 0x7fd3900ac3a0 2023-09-30T23:03:54.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.078+0000 7fd38f7fe700 1 -- 172.21.15.142:0/2109743739 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109230629 0 0) 0x7fd388001490 con 0x7fd3900aa7e0 2023-09-30T23:03:54.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.079+0000 7fd38ffff700 1 --2- 172.21.15.142:0/2109743739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3900ac3a0 0x7fd3900aa2a0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0099b0 tx=0x7fd37c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b1cb5a3674d103 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.079+0000 7fd38f7fe700 1 -- 172.21.15.142:0/2109743739 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c009ea0 con 0x7fd3900ac3a0 2023-09-30T23:03:54.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.079+0000 7fd38f7fe700 1 -- 172.21.15.142:0/2109743739 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00b860 con 0x7fd3900ac3a0 2023-09-30T23:03:54.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.079+0000 7fd38f7fe700 1 -- 172.21.15.142:0/2109743739 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00bc00 con 0x7fd3900ac3a0 2023-09-30T23:03:54.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 -- 172.21.15.142:0/2109743739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3900ac3a0 msgr2=0x7fd3900aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 --2- 172.21.15.142:0/2109743739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3900ac3a0 0x7fd3900aa2a0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0099b0 tx=0x7fd37c009250 comp rx=0 tx=0).stop 2023-09-30T23:03:54.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 -- 172.21.15.142:0/2109743739 shutdown_connections 2023-09-30T23:03:54.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 --2- 172.21.15.142:0/2109743739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd390159b50 0x7fd3900a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 --2- 172.21.15.142:0/2109743739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3900ac3a0 0x7fd3900aa2a0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 -- 172.21.15.142:0/2109743739 >> 172.21.15.142:0/2109743739 conn(0x7fd39006dab0 msgr2=0x7fd3900aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 -- 172.21.15.142:0/2109743739 shutdown_connections 2023-09-30T23:03:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.080+0000 7fd396dff700 1 -- 172.21.15.142:0/2109743739 wait complete. 2023-09-30T23:03:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.081+0000 7fd396dff700 1 Processor -- start 2023-09-30T23:03:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.081+0000 7fd396dff700 1 -- start start 2023-09-30T23:03:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd396dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3900aa7e0 0x7fd3900ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd396dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3900ac3a0 0x7fd3900ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd396dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390159b50 0x7fd39015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd396dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39016b590 con 0x7fd390159b50 2023-09-30T23:03:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd396dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900ad0a0 con 0x7fd3900aa7e0 2023-09-30T23:03:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd396dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39016b2b0 con 0x7fd3900ac3a0 2023-09-30T23:03:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd39539c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390159b50 0x7fd39015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd39539c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390159b50 0x7fd39015dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42278/0 (socket says 172.21.15.142:42278) 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.082+0000 7fd39539c700 1 -- 172.21.15.142:0/691423711 learned_addr learned my addr 172.21.15.142:0/691423711 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd394b9b700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3900aa7e0 0x7fd3900ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd38ffff700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3900ac3a0 0x7fd3900ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd39539c700 1 -- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3900ac3a0 msgr2=0x7fd3900ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd39539c700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3900ac3a0 0x7fd3900ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd39539c700 1 -- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3900aa7e0 msgr2=0x7fd3900ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd39539c700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3900aa7e0 0x7fd3900ae460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd39539c700 1 -- 172.21.15.142:0/691423711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0094f0 con 0x7fd390159b50 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd39539c700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390159b50 0x7fd39015dfb0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd38800cd80 tx=0x7fd388001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388005df0 con 0x7fd390159b50 2023-09-30T23:03:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800a920 con 0x7fd390159b50 2023-09-30T23:03:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800ace0 con 0x7fd390159b50 2023-09-30T23:03:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3900aca50 con 0x7fd390159b50 2023-09-30T23:03:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.083+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3900ada70 con 0x7fd390159b50 2023-09-30T23:03:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.084+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3900ac8b0 con 0x7fd390159b50 2023-09-30T23:03:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.085+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd388007300 con 0x7fd390159b50 2023-09-30T23:03:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.086+0000 7fd38cff9700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd374067330 0x7fd3740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.086+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fd388084be0 con 0x7fd390159b50 2023-09-30T23:03:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.086+0000 7fd394b9b700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd374067330 0x7fd3740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.086+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fd37406f550 con 0x7fd390159b50 2023-09-30T23:03:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.087+0000 7fd394b9b700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd374067330 0x7fd3740697e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd384006f00 tx=0x7fd384008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.090+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd3900ac8b0 con 0x7fd390159b50 2023-09-30T23:03:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.323+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd390068000 con 0x7fd390159b50 2023-09-30T23:03:54.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.324+0000 7fd38cff9700 1 -- 172.21.15.142:0/691423711 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4613 (secure 0 0 0) 0x7fd390068000 con 0x7fd390159b50 2023-09-30T23:03:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:03:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:02:35.609202+0000","modified":"2023-09-30T23:02:39.164928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3571686386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3571686386},{"type":"v1","addr":"172.21.15.142:6837","nonce":3571686386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-09-30T23:03:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd374067330 msgr2=0x7fd3740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd374067330 0x7fd3740697e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd384006f00 tx=0x7fd384008040 comp rx=0 tx=0).stop 2023-09-30T23:03:54.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390159b50 msgr2=0x7fd39015dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390159b50 0x7fd39015dfb0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd38800cd80 tx=0x7fd388001b10 comp rx=0 tx=0).stop 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 shutdown_connections 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd374067330 0x7fd3740697e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390159b50 0x7fd39015dfb0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3900aa7e0 0x7fd3900ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 --2- 172.21.15.142:0/691423711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3900ac3a0 0x7fd3900ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.326+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 >> 172.21.15.142:0/691423711 conn(0x7fd39006dab0 msgr2=0x7fd390154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.327+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 shutdown_connections 2023-09-30T23:03:54.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.327+0000 7fd396dff700 1 -- 172.21.15.142:0/691423711 wait complete. 2023-09-30T23:03:54.328 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 83 2023-09-30T23:03:54.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:03:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.536+0000 7fe90fbff700 1 Processor -- start 2023-09-30T23:03:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.537+0000 7fe90fbff700 1 -- start start 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90fbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9080c6da0 0x7fe90806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90fbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe90815e270 0x7fe908159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90fbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90815dde0 con 0x7fe90806d3f0 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90fbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90815e710 con 0x7fe9080c6da0 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90fbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90806b840 con 0x7fe90815e270 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90d19a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9080c6da0 0x7fe90806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90d19a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9080c6da0 0x7fe90806d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42290/0 (socket says 172.21.15.142:42290) 2023-09-30T23:03:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90d19a700 1 -- 172.21.15.142:0/812193526 learned_addr learned my addr 172.21.15.142:0/812193526 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:54.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.538+0000 7fe90e19c700 1 --2- 172.21.15.142:0/812193526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe90815e270 0x7fe908159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90d19a700 1 -- 172.21.15.142:0/812193526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe90815e270 msgr2=0x7fe908159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:54.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90d19a700 1 --2- 172.21.15.142:0/812193526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe90815e270 0x7fe908159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90d19a700 1 -- 172.21.15.142:0/812193526 >> v1:172.21.15.148:6789/0 conn(0x7fe90806d3f0 legacy=0x7fe90806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90d19a700 1 -- 172.21.15.142:0/812193526 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90815d7d0 con 0x7fe9080c6da0 2023-09-30T23:03:54.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90d19a700 1 --2- 172.21.15.142:0/812193526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9080c6da0 0x7fe90806d7c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80099b0 tx=0x7fe8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3c3c4c304711e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90c999700 1 -- 172.21.15.142:0/812193526 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8009ea0 con 0x7fe9080c6da0 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90c999700 1 -- 172.21.15.142:0/812193526 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f800b860 con 0x7fe9080c6da0 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.539+0000 7fe90c999700 1 -- 172.21.15.142:0/812193526 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f800bc00 con 0x7fe9080c6da0 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 -- 172.21.15.142:0/812193526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9080c6da0 msgr2=0x7fe90806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 --2- 172.21.15.142:0/812193526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9080c6da0 0x7fe90806d7c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80099b0 tx=0x7fe8f8009250 comp rx=0 tx=0).stop 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 -- 172.21.15.142:0/812193526 shutdown_connections 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 --2- 172.21.15.142:0/812193526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe90815e270 0x7fe908159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 --2- 172.21.15.142:0/812193526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9080c6da0 0x7fe90806d7c0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 -- 172.21.15.142:0/812193526 >> 172.21.15.142:0/812193526 conn(0x7fe908067e30 msgr2=0x7fe908068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 -- 172.21.15.142:0/812193526 shutdown_connections 2023-09-30T23:03:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.540+0000 7fe90fbff700 1 -- 172.21.15.142:0/812193526 wait complete. 2023-09-30T23:03:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.541+0000 7fe90fbff700 1 Processor -- start 2023-09-30T23:03:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.542+0000 7fe90fbff700 1 -- start start 2023-09-30T23:03:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.542+0000 7fe90fbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe90806d3f0 0x7fe90816afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.542+0000 7fe90fbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9080c6da0 0x7fe90813c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.542+0000 7fe90fbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe90815e270 0x7fe908150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.542+0000 7fe90fbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90816a530 con 0x7fe90806d3f0 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90fbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908151120 con 0x7fe90815e270 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90fbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90816a7a0 con 0x7fe9080c6da0 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe90806d3f0 0x7fe90816afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe90806d3f0 0x7fe90816afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42300/0 (socket says 172.21.15.142:42300) 2023-09-30T23:03:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 -- 172.21.15.142:0/1259051528 learned_addr learned my addr 172.21.15.142:0/1259051528 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 -- 172.21.15.142:0/1259051528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9080c6da0 msgr2=0x7fe90813c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9080c6da0 0x7fe90813c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 -- 172.21.15.142:0/1259051528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe90815e270 msgr2=0x7fe908150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe90815e270 0x7fe908150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 -- 172.21.15.142:0/1259051528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f80094f0 con 0x7fe90806d3f0 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.543+0000 7fe90d99b700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe90806d3f0 0x7fe90816afa0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c590 tx=0x7fe90400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.544+0000 7fe8fdffb700 1 -- 172.21.15.142:0/1259051528 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904011590 con 0x7fe90806d3f0 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.544+0000 7fe8fdffb700 1 -- 172.21.15.142:0/1259051528 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9040116f0 con 0x7fe90806d3f0 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.544+0000 7fe8fdffb700 1 -- 172.21.15.142:0/1259051528 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904011ab0 con 0x7fe90806d3f0 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.544+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90816aa80 con 0x7fe90806d3f0 2023-09-30T23:03:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.544+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe908150d50 con 0x7fe90806d3f0 2023-09-30T23:03:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.545+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90816acc0 con 0x7fe90806d3f0 2023-09-30T23:03:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.546+0000 7fe8fdffb700 1 -- 172.21.15.142:0/1259051528 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe90401b3b0 con 0x7fe90806d3f0 2023-09-30T23:03:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.547+0000 7fe8fdffb700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8ec067330 0x7fe8ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.547+0000 7fe8fdffb700 1 -- 172.21.15.142:0/1259051528 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fe904084220 con 0x7fe90806d3f0 2023-09-30T23:03:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.547+0000 7fe90d19a700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8ec067330 0x7fe8ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.548+0000 7fe90d19a700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8ec067330 0x7fe8ec0697e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80099b0 tx=0x7fe8f8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.552+0000 7fe8fdffb700 1 -- 172.21.15.142:0/1259051528 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe90816acc0 con 0x7fe90806d3f0 2023-09-30T23:03:54.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.745+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe90816acc0 con 0x7fe90806d3f0 2023-09-30T23:03:54.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.745+0000 7fe8fdffb700 1 -- 172.21.15.142:0/1259051528 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17082 (secure 0 0 0) 0x7fe90816acc0 con 0x7fe90806d3f0 2023-09-30T23:03:54.745 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:03:54.745 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":180,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:03:54.392851+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:02:33.854527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-09-30T23:02:34.591957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:03:54.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8ec067330 msgr2=0x7fe8ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8ec067330 0x7fe8ec0697e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80099b0 tx=0x7fe8f8017000 comp rx=0 tx=0).stop 2023-09-30T23:03:54.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe90806d3f0 msgr2=0x7fe90816afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe90806d3f0 0x7fe90816afa0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c590 tx=0x7fe90400c950 comp rx=0 tx=0).stop 2023-09-30T23:03:54.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 shutdown_connections 2023-09-30T23:03:54.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8ec067330 0x7fe8ec0697e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe90815e270 0x7fe908150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe90806d3f0 0x7fe90816afa0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 --2- 172.21.15.142:0/1259051528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9080c6da0 0x7fe90813c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 >> 172.21.15.142:0/1259051528 conn(0x7fe908067e30 msgr2=0x7fe908153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:54.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 shutdown_connections 2023-09-30T23:03:54.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.748+0000 7fe90fbff700 1 -- 172.21.15.142:0/1259051528 wait complete. 2023-09-30T23:03:54.766 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T23:03:54.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:03:54.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.955+0000 7f73215ff700 1 Processor -- start 2023-09-30T23:03:54.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.955+0000 7f73215ff700 1 -- start start 2023-09-30T23:03:54.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.956+0000 7f73215ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1950 0x7f731c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.956+0000 7f73215ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.956+0000 7f73215ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c0ad630 con 0x7f731c0b1580 2023-09-30T23:03:54.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.956+0000 7f73215ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c157c20 con 0x7f731c15a6c0 2023-09-30T23:03:54.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.956+0000 7f73215ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c15ab10 con 0x7f731c0b1950 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42314/0 (socket says 172.21.15.142:42314) 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 -- 172.21.15.142:0/941776744 learned_addr learned my addr 172.21.15.142:0/941776744 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 -- 172.21.15.142:0/941776744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1950 msgr2=0x7f731c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731a7fc700 1 --2- 172.21.15.142:0/941776744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1950 0x7f731c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 --2- 172.21.15.142:0/941776744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1950 0x7f731c15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 -- 172.21.15.142:0/941776744 >> v1:172.21.15.148:6789/0 conn(0x7f731c0b1580 legacy=0x7f731c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 -- 172.21.15.142:0/941776744 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0b3360 con 0x7f731c15a6c0 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731a7fc700 1 --2- 172.21.15.142:0/941776744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1950 0x7f731c15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.957+0000 7f731b7fe700 1 --2- 172.21.15.142:0/941776744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f7314009f20 tx=0x7f7314009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c66ca5caf462fcc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f7319ffb700 1 -- 172.21.15.142:0/941776744 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400e070 con 0x7f731c15a6c0 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f7319ffb700 1 -- 172.21.15.142:0/941776744 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400ba40 con 0x7f731c15a6c0 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f7319ffb700 1 -- 172.21.15.142:0/941776744 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140092e0 con 0x7f731c15a6c0 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 -- 172.21.15.142:0/941776744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 msgr2=0x7f731c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 --2- 172.21.15.142:0/941776744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f7314009f20 tx=0x7f7314009840 comp rx=0 tx=0).stop 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 -- 172.21.15.142:0/941776744 shutdown_connections 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 --2- 172.21.15.142:0/941776744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 --2- 172.21.15.142:0/941776744 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1950 0x7f731c15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 -- 172.21.15.142:0/941776744 >> 172.21.15.142:0/941776744 conn(0x7f731c0ce1f0 msgr2=0x7f731c069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 -- 172.21.15.142:0/941776744 shutdown_connections 2023-09-30T23:03:54.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.958+0000 7f73215ff700 1 -- 172.21.15.142:0/941776744 wait complete. 2023-09-30T23:03:54.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.960+0000 7f73215ff700 1 Processor -- start 2023-09-30T23:03:54.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.961+0000 7f73215ff700 1 -- start start 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f73215ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1580 0x7f731c155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f73215ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f731c0b1950 0x7f731c0ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f73215ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f73215ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c155b80 con 0x7f731c15a6c0 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f73215ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0ab9b0 con 0x7f731c0b1950 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f73215ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0abc90 con 0x7f731c0b1580 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42326/0 (socket says 172.21.15.142:42326) 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731b7fe700 1 -- 172.21.15.142:0/1089707973 learned_addr learned my addr 172.21.15.142:0/1089707973 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731affd700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1580 0x7f731c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731a7fc700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f731c0b1950 0x7f731c0ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731b7fe700 1 -- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1580 msgr2=0x7f731c155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731b7fe700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1580 0x7f731c155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731b7fe700 1 -- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f731c0b1950 msgr2=0x7f731c0ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.962+0000 7f731b7fe700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f731c0b1950 0x7f731c0ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f731b7fe700 1 -- 172.21.15.142:0/1089707973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009ae0 con 0x7f731c15a6c0 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f731affd700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1580 0x7f731c155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f731a7fc700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f731c0b1950 0x7f731c0ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:03:54.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f731b7fe700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f731c0706b0 tx=0x7f7314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f7302ffd700 1 -- 172.21.15.142:0/1089707973 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140032f0 con 0x7f731c15a6c0 2023-09-30T23:03:54.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f7302ffd700 1 -- 172.21.15.142:0/1089707973 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314012e60 con 0x7f731c15a6c0 2023-09-30T23:03:54.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f7302ffd700 1 -- 172.21.15.142:0/1089707973 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731401e680 con 0x7f731c15a6c0 2023-09-30T23:03:54.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c0abf70 con 0x7f731c15a6c0 2023-09-30T23:03:54.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.963+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c16a1d0 con 0x7f731c15a6c0 2023-09-30T23:03:54.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.964+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c06d600 con 0x7f731c15a6c0 2023-09-30T23:03:54.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.965+0000 7f7302ffd700 1 -- 172.21.15.142:0/1089707973 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f731401ea70 con 0x7f731c15a6c0 2023-09-30T23:03:54.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.966+0000 7f7302ffd700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7308067330 0x7f73080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:54.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.966+0000 7f7302ffd700 1 -- 172.21.15.142:0/1089707973 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f73140868b0 con 0x7f731c15a6c0 2023-09-30T23:03:54.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.966+0000 7f731affd700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7308067330 0x7f73080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:54.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.967+0000 7f731affd700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7308067330 0x7f73080697e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f730c002880 tx=0x7f730c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:54.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:54.970+0000 7f7302ffd700 1 -- 172.21.15.142:0/1089707973 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7314053790 con 0x7f731c15a6c0 2023-09-30T23:03:55.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.204+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f731c0ae1d0 con 0x7f731c15a6c0 2023-09-30T23:03:55.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.205+0000 7f7302ffd700 1 -- 172.21.15.142:0/1089707973 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4613 (secure 0 0 0) 0x7f7314009420 con 0x7f731c15a6c0 2023-09-30T23:03:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:03:55.205 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:02:35.609202+0000","modified":"2023-09-30T23:02:39.164928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3571686386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3571686386},{"type":"v1","addr":"172.21.15.142:6837","nonce":3571686386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-09-30T23:03:55.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.207+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7308067330 msgr2=0x7f73080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.207+0000 7f73215ff700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7308067330 0x7f73080697e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f730c002880 tx=0x7f730c009040 comp rx=0 tx=0).stop 2023-09-30T23:03:55.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.207+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 msgr2=0x7f731c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.207+0000 7f73215ff700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f731c0706b0 tx=0x7f7314017000 comp rx=0 tx=0).stop 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.207+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 shutdown_connections 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.208+0000 7f73215ff700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7308067330 0x7f73080697e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.208+0000 7f73215ff700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f731c15a6c0 0x7f731c06a7a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.208+0000 7f73215ff700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f731c0b1580 0x7f731c155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.208+0000 7f73215ff700 1 --2- 172.21.15.142:0/1089707973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f731c0b1950 0x7f731c0ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.208+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 >> 172.21.15.142:0/1089707973 conn(0x7f731c0ce1f0 msgr2=0x7f731c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.208+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 shutdown_connections 2023-09-30T23:03:55.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.208+0000 7f73215ff700 1 -- 172.21.15.142:0/1089707973 wait complete. 2023-09-30T23:03:55.209 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 83 2023-09-30T23:03:55.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:03:55.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.415+0000 7fab633ff700 1 Processor -- start 2023-09-30T23:03:55.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.415+0000 7fab633ff700 1 -- start start 2023-09-30T23:03:55.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.416+0000 7fab633ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab5c0c6da0 0x7fab5c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.416+0000 7fab633ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c15dde0 con 0x7fab5c06d3f0 2023-09-30T23:03:55.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.416+0000 7fab633ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c06b840 con 0x7fab5c15e270 2023-09-30T23:03:55.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.416+0000 7fab633ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c15e710 con 0x7fab5c0c6da0 2023-09-30T23:03:55.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6099a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab5c0c6da0 0x7fab5c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6099a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab5c0c6da0 0x7fab5c06d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42332/0 (socket says 172.21.15.142:42332) 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6099a700 1 -- 172.21.15.142:0/2239622123 learned_addr learned my addr 172.21.15.142:0/2239622123 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6119b700 1 --1- 172.21.15.142:0/2239622123 >> v1:172.21.15.142:6789/0 conn(0x7fab5c06d3f0 0x7fab5c06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39358/0 (socket says 172.21.15.142:39358) 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6099a700 1 -- 172.21.15.142:0/2239622123 >> v1:172.21.15.148:6789/0 conn(0x7fab5c15e270 legacy=0x7fab5c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6099a700 1 -- 172.21.15.142:0/2239622123 >> v1:172.21.15.142:6789/0 conn(0x7fab5c06d3f0 legacy=0x7fab5c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6099a700 1 -- 172.21.15.142:0/2239622123 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c15d7d0 con 0x7fab5c0c6da0 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab53fff700 1 -- 172.21.15.142:0/2239622123 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722307195 0 0) 0x7fab5c15dde0 con 0x7fab5c06d3f0 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.417+0000 7fab6099a700 1 --2- 172.21.15.142:0/2239622123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c06d7c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0099e0 tx=0x7fab4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2fddad58468f54 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab53fff700 1 -- 172.21.15.142:0/2239622123 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00b820 con 0x7fab5c0c6da0 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab53fff700 1 -- 172.21.15.142:0/2239622123 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00b980 con 0x7fab5c0c6da0 2023-09-30T23:03:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab53fff700 1 -- 172.21.15.142:0/2239622123 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00bd20 con 0x7fab5c0c6da0 2023-09-30T23:03:55.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab633ff700 1 -- 172.21.15.142:0/2239622123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 msgr2=0x7fab5c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab633ff700 1 --2- 172.21.15.142:0/2239622123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c06d7c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0099e0 tx=0x7fab4c009250 comp rx=0 tx=0).stop 2023-09-30T23:03:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab633ff700 1 -- 172.21.15.142:0/2239622123 shutdown_connections 2023-09-30T23:03:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab633ff700 1 --2- 172.21.15.142:0/2239622123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c06d7c0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab633ff700 1 -- 172.21.15.142:0/2239622123 >> 172.21.15.142:0/2239622123 conn(0x7fab5c067e30 msgr2=0x7fab5c068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab633ff700 1 -- 172.21.15.142:0/2239622123 shutdown_connections 2023-09-30T23:03:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.418+0000 7fab633ff700 1 -- 172.21.15.142:0/2239622123 wait complete. 2023-09-30T23:03:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.420+0000 7fab633ff700 1 Processor -- start 2023-09-30T23:03:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.420+0000 7fab633ff700 1 -- start start 2023-09-30T23:03:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab633ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab5c06d3f0 0x7fab5c14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab633ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab633ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fab5c15e270 0x7fab5c16cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab633ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c154fe0 con 0x7fab5c0c6da0 2023-09-30T23:03:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab633ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c1552c0 con 0x7fab5c06d3f0 2023-09-30T23:03:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab633ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c1555a0 con 0x7fab5c15e270 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c14e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42348/0 (socket says 172.21.15.142:42348) 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 -- 172.21.15.142:0/571369872 learned_addr learned my addr 172.21.15.142:0/571369872 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6119b700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab5c06d3f0 0x7fab5c14ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6199c700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fab5c15e270 0x7fab5c16cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 -- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fab5c15e270 msgr2=0x7fab5c16cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fab5c15e270 0x7fab5c16cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 -- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab5c06d3f0 msgr2=0x7fab5c14ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab5c06d3f0 0x7fab5c14ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6099a700 1 -- 172.21.15.142:0/571369872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0094f0 con 0x7fab5c0c6da0 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.421+0000 7fab6199c700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fab5c15e270 0x7fab5c16cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.422+0000 7fab6099a700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c14e840 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0094c0 tx=0x7fab4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.422+0000 7fab517fa700 1 -- 172.21.15.142:0/571369872 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c01f070 con 0x7fab5c0c6da0 2023-09-30T23:03:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.422+0000 7fab517fa700 1 -- 172.21.15.142:0/571369872 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00baf0 con 0x7fab5c0c6da0 2023-09-30T23:03:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.422+0000 7fab517fa700 1 -- 172.21.15.142:0/571369872 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c025420 con 0x7fab5c0c6da0 2023-09-30T23:03:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.422+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c155880 con 0x7fab5c0c6da0 2023-09-30T23:03:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.422+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c1562d0 con 0x7fab5c0c6da0 2023-09-30T23:03:55.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.423+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c069420 con 0x7fab5c0c6da0 2023-09-30T23:03:55.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.424+0000 7fab517fa700 1 -- 172.21.15.142:0/571369872 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fab4c023070 con 0x7fab5c0c6da0 2023-09-30T23:03:55.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.425+0000 7fab517fa700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fab40067330 0x7fab400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.425+0000 7fab517fa700 1 -- 172.21.15.142:0/571369872 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fab4c086300 con 0x7fab5c0c6da0 2023-09-30T23:03:55.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.425+0000 7fab6119b700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fab40067330 0x7fab400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.426+0000 7fab6119b700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fab40067330 0x7fab400697e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fab58007fd0 tx=0x7fab58007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:55.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.429+0000 7fab517fa700 1 -- 172.21.15.142:0/571369872 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fab4c0531c0 con 0x7fab5c0c6da0 2023-09-30T23:03:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.663+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab5c0c7230 con 0x7fab5c0c6da0 2023-09-30T23:03:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.664+0000 7fab517fa700 1 -- 172.21.15.142:0/571369872 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4613 (secure 0 0 0) 0x7fab4c0567e0 con 0x7fab5c0c6da0 2023-09-30T23:03:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:03:55.664 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:02:35.609202+0000","modified":"2023-09-30T23:02:39.164928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/3571686386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3571686386},{"type":"v1","addr":"172.21.15.142:6837","nonce":3571686386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-09-30T23:03:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fab40067330 msgr2=0x7fab400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fab40067330 0x7fab400697e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fab58007fd0 tx=0x7fab58007d30 comp rx=0 tx=0).stop 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 msgr2=0x7fab5c14e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c14e840 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0094c0 tx=0x7fab4c017000 comp rx=0 tx=0).stop 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 shutdown_connections 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fab40067330 0x7fab400697e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fab5c15e270 0x7fab5c16cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab5c06d3f0 0x7fab5c14ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.666+0000 7fab633ff700 1 --2- 172.21.15.142:0/571369872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab5c0c6da0 0x7fab5c14e840 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.667+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 >> 172.21.15.142:0/571369872 conn(0x7fab5c067e30 msgr2=0x7fab5c153920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.667+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 shutdown_connections 2023-09-30T23:03:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.667+0000 7fab633ff700 1 -- 172.21.15.142:0/571369872 wait complete. 2023-09-30T23:03:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 83 2023-09-30T23:03:55.684 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:03:55.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.873+0000 7f9b943ff700 1 Processor -- start 2023-09-30T23:03:55.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.873+0000 7f9b943ff700 1 -- start start 2023-09-30T23:03:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.874+0000 7f9b943ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b8c159b50 0x7f9b8c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.874+0000 7f9b943ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c0aa9b0 0x7f9b8c163860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.874+0000 7f9b943ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c068000 con 0x7f9b8c0ac3a0 2023-09-30T23:03:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.874+0000 7f9b943ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8c069f10 con 0x7f9b8c159b50 2023-09-30T23:03:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.874+0000 7f9b943ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0a9e00 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.874+0000 7f9b9199a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9b8c0ac3a0 0x7f9b8c0aa2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39374/0 (socket says 172.21.15.142:39374) 2023-09-30T23:03:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.874+0000 7f9b9199a700 1 -- 172.21.15.142:0/2548241553 learned_addr learned my addr 172.21.15.142:0/2548241553 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:03:55.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b9299c700 1 --2- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c0aa9b0 0x7f9b8c163860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b9219b700 1 --2- 172.21.15.142:0/2548241553 >> v2:172.21.15.148:3300/0 conn(0x7f9b8c159b50 0x7f9b8c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b91199700 1 -- 172.21.15.142:0/2548241553 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147461360 0 0) 0x7f9b7c001110 con 0x7f9b8c0ac3a0 2023-09-30T23:03:55.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b91199700 1 -- 172.21.15.142:0/2548241553 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b78003570 con 0x7f9b8c0ac3a0 2023-09-30T23:03:55.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b9219b700 1 -- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c0aa9b0 msgr2=0x7f9b8c163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b9219b700 1 --2- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c0aa9b0 0x7f9b8c163860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b9219b700 1 -- 172.21.15.142:0/2548241553 >> v1:172.21.15.142:6789/0 conn(0x7f9b8c0ac3a0 legacy=0x7f9b8c0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b9219b700 1 -- 172.21.15.142:0/2548241553 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c068240 con 0x7f9b8c159b50 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.875+0000 7f9b9299c700 1 --2- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c0aa9b0 0x7f9b8c163860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b9219b700 1 --2- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c159b50 0x7f9b8c0a98c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9b880098e0 tx=0x7f9b880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1a2f1c51ad56b87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b91199700 1 -- 172.21.15.142:0/2548241553 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88011630 con 0x7f9b8c159b50 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b91199700 1 -- 172.21.15.142:0/2548241553 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b88011790 con 0x7f9b8c159b50 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b91199700 1 -- 172.21.15.142:0/2548241553 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88011b30 con 0x7f9b8c159b50 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b943ff700 1 -- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c159b50 msgr2=0x7f9b8c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c159b50 0x7f9b8c0a98c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9b880098e0 tx=0x7f9b880091a0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b943ff700 1 -- 172.21.15.142:0/2548241553 shutdown_connections 2023-09-30T23:03:55.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c159b50 0x7f9b8c0a98c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2548241553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c0aa9b0 0x7f9b8c163860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b943ff700 1 -- 172.21.15.142:0/2548241553 >> 172.21.15.142:0/2548241553 conn(0x7f9b8c06dab0 msgr2=0x7f9b8c0aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:55.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.876+0000 7f9b943ff700 1 -- 172.21.15.142:0/2548241553 shutdown_connections 2023-09-30T23:03:55.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.877+0000 7f9b943ff700 1 -- 172.21.15.142:0/2548241553 wait complete. 2023-09-30T23:03:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.878+0000 7f9b943ff700 1 Processor -- start 2023-09-30T23:03:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.878+0000 7f9b943ff700 1 -- start start 2023-09-30T23:03:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b943ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8c0aa9b0 0x7f9b8c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b943ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c0ac3a0 0x7f9b8c14c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b943ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c159b50 0x7f9b8c0aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b943ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c15d240 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b943ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c16a470 con 0x7f9b8c0ac3a0 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b943ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0af0d0 con 0x7f9b8c159b50 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b9219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8c0aa9b0 0x7f9b8c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b9219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8c0aa9b0 0x7f9b8c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42356/0 (socket says 172.21.15.142:42356) 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b9219b700 1 -- 172.21.15.142:0/2998101031 learned_addr learned my addr 172.21.15.142:0/2998101031 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b9199a700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c0ac3a0 0x7f9b8c14c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.879+0000 7f9b9299c700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c159b50 0x7f9b8c0aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b9219b700 1 -- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c159b50 msgr2=0x7f9b8c0aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b9219b700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c159b50 0x7f9b8c0aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b9219b700 1 -- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c0ac3a0 msgr2=0x7f9b8c14c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b9219b700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c0ac3a0 0x7f9b8c14c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b9219b700 1 -- 172.21.15.142:0/2998101031 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84009a20 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b9219b700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8c0aa9b0 0x7f9b8c15a1c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c06c8a0 tx=0x7f9b88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b827fc700 1 -- 172.21.15.142:0/2998101031 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88011b10 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b827fc700 1 -- 172.21.15.142:0/2998101031 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b88000cc0 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b827fc700 1 -- 172.21.15.142:0/2998101031 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88025620 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.880+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b88009420 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.881+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c0af350 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.882+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c06cfd0 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.882+0000 7f9b827fc700 1 -- 172.21.15.142:0/2998101031 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9b88025a10 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.883+0000 7f9b827fc700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:55.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.883+0000 7f9b827fc700 1 -- 172.21.15.142:0/2998101031 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f9b880863f0 con 0x7f9b8c0aa9b0 2023-09-30T23:03:55.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.884+0000 7f9b9199a700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.884+0000 7f9b9199a700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0b2d70 tx=0x7f9b7c007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:55.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:55.887+0000 7f9b827fc700 1 -- 172.21.15.142:0/2998101031 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9b880532f0 con 0x7f9b8c0aa9b0 2023-09-30T23:03:56.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.080+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b8c06fc10 con 0x7f9b8c0aa9b0 2023-09-30T23:03:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.081+0000 7f9b827fc700 1 -- 172.21.15.142:0/2998101031 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17082 (secure 0 0 0) 0x7f9b88056910 con 0x7f9b8c0aa9b0 2023-09-30T23:03:56.081 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:03:56.081 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":180,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:03:54.392851+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:02:33.854527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-09-30T23:02:34.591957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 msgr2=0x7f9b700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0b2d70 tx=0x7f9b7c007bf0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8c0aa9b0 msgr2=0x7f9b8c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8c0aa9b0 0x7f9b8c15a1c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c06c8a0 tx=0x7f9b88017000 comp rx=0 tx=0).stop 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 shutdown_connections 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9b70067330 0x7f9b700697e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b8c159b50 0x7f9b8c0aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8c0aa9b0 0x7f9b8c15a1c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 --2- 172.21.15.142:0/2998101031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8c0ac3a0 0x7f9b8c14c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 >> 172.21.15.142:0/2998101031 conn(0x7f9b8c06dab0 msgr2=0x7f9b8c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 shutdown_connections 2023-09-30T23:03:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.083+0000 7f9b943ff700 1 -- 172.21.15.142:0/2998101031 wait complete. 2023-09-30T23:03:56.100 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T23:03:56.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.294+0000 7f2822bff700 1 Processor -- start 2023-09-30T23:03:56.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.294+0000 7f2822bff700 1 -- start start 2023-09-30T23:03:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f2822bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c159ae0 0x7f281c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f2822bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f281c0cc590 0x7f281c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f2822bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c15d910 con 0x7f281c0b1180 2023-09-30T23:03:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f2822bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c15e920 con 0x7f281c0cc590 2023-09-30T23:03:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f2822bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c15e490 con 0x7f281c159ae0 2023-09-30T23:03:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f282119c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f281c0cc590 0x7f281c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f281bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f281c0b1180 0x7f281c0cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39382/0 (socket says 172.21.15.142:39382) 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f281bfff700 1 -- 172.21.15.142:0/1568269094 learned_addr learned my addr 172.21.15.142:0/1568269094 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f282099b700 1 --2- 172.21.15.142:0/1568269094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c159ae0 0x7f281c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f282119c700 1 -- 172.21.15.142:0/1568269094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c159ae0 msgr2=0x7f281c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f282119c700 1 --2- 172.21.15.142:0/1568269094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c159ae0 0x7f281c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f282119c700 1 -- 172.21.15.142:0/1568269094 >> v1:172.21.15.142:6789/0 conn(0x7f281c0b1180 legacy=0x7f281c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f282119c700 1 -- 172.21.15.142:0/1568269094 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c15db60 con 0x7f281c0cc590 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f282099b700 1 --2- 172.21.15.142:0/1568269094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c159ae0 0x7f281c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.296+0000 7f281b7fe700 1 -- 172.21.15.142:0/1568269094 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258163817 0 0) 0x7f281c15d910 con 0x7f281c0b1180 2023-09-30T23:03:56.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.297+0000 7f282119c700 1 --2- 172.21.15.142:0/1568269094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c069f10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2814009e60 tx=0x7f2814009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b492cfd752ce2135 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:56.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.297+0000 7f281b7fe700 1 -- 172.21.15.142:0/1568269094 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400e070 con 0x7f281c0cc590 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.297+0000 7f281b7fe700 1 -- 172.21.15.142:0/1568269094 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281400bc30 con 0x7f281c0cc590 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.297+0000 7f281b7fe700 1 -- 172.21.15.142:0/1568269094 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814012430 con 0x7f281c0cc590 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.297+0000 7f2822bff700 1 -- 172.21.15.142:0/1568269094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 msgr2=0x7f281c069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.297+0000 7f2822bff700 1 --2- 172.21.15.142:0/1568269094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c069f10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2814009e60 tx=0x7f2814009780 comp rx=0 tx=0).stop 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.298+0000 7f2822bff700 1 -- 172.21.15.142:0/1568269094 shutdown_connections 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.298+0000 7f2822bff700 1 --2- 172.21.15.142:0/1568269094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c069f10 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.298+0000 7f2822bff700 1 --2- 172.21.15.142:0/1568269094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c159ae0 0x7f281c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.298+0000 7f2822bff700 1 -- 172.21.15.142:0/1568269094 >> 172.21.15.142:0/1568269094 conn(0x7f281c0ce8b0 msgr2=0x7f281c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.298+0000 7f2822bff700 1 -- 172.21.15.142:0/1568269094 shutdown_connections 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.298+0000 7f2822bff700 1 -- 172.21.15.142:0/1568269094 wait complete. 2023-09-30T23:03:56.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.299+0000 7f2822bff700 1 Processor -- start 2023-09-30T23:03:56.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.299+0000 7f2822bff700 1 -- start start 2023-09-30T23:03:56.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.300+0000 7f2822bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c0b1180 0x7f281c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.300+0000 7f2822bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c1462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.300+0000 7f2822bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f281c159ae0 0x7f281c15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.300+0000 7f2822bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c157fd0 con 0x7f281c0cc590 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.300+0000 7f2822bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c1589a0 con 0x7f281c159ae0 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.300+0000 7f2822bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c1573c0 con 0x7f281c0b1180 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.300+0000 7f281bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c1462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c1462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42368/0 (socket says 172.21.15.142:42368) 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 -- 172.21.15.142:0/1034890292 learned_addr learned my addr 172.21.15.142:0/1034890292 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f282119c700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f281c159ae0 0x7f281c15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f282099b700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c0b1180 0x7f281c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 -- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c0b1180 msgr2=0x7f281c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c0b1180 0x7f281c158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 -- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f281c159ae0 msgr2=0x7f281c15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f281c159ae0 0x7f281c15d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 -- 172.21.15.142:0/1034890292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814009a20 con 0x7f281c0cc590 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f281bfff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c1462f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f280800c7e0 tx=0x7f2808007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f2818ff9700 1 -- 172.21.15.142:0/1034890292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808005b30 con 0x7f281c0cc590 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f2818ff9700 1 -- 172.21.15.142:0/1034890292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808005c90 con 0x7f281c0cc590 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c1576a0 con 0x7f281c0cc590 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.301+0000 7f2818ff9700 1 -- 172.21.15.142:0/1034890292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808007300 con 0x7f281c0cc590 2023-09-30T23:03:56.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.302+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c157c60 con 0x7f281c0cc590 2023-09-30T23:03:56.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.302+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c158140 con 0x7f281c0cc590 2023-09-30T23:03:56.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.303+0000 7f2818ff9700 1 -- 172.21.15.142:0/1034890292 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f280801b400 con 0x7f281c0cc590 2023-09-30T23:03:56.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.304+0000 7f2818ff9700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2800067330 0x7f28000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.304+0000 7f2818ff9700 1 -- 172.21.15.142:0/1034890292 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f2808084720 con 0x7f281c0cc590 2023-09-30T23:03:56.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.304+0000 7f282099b700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2800067330 0x7f28000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.305+0000 7f282099b700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2800067330 0x7f28000697e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2810006f00 tx=0x7f2810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:56.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.308+0000 7f2818ff9700 1 -- 172.21.15.142:0/1034890292 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2808051680 con 0x7f281c0cc590 2023-09-30T23:03:56.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.541+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f281c15de40 con 0x7f281c0cc590 2023-09-30T23:03:56.541 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T23:03:56.542+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T23:03:56.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.548+0000 7f2818ff9700 1 -- 172.21.15.142:0/1034890292 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2808054ca0 con 0x7f281c0cc590 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2800067330 msgr2=0x7f28000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2800067330 0x7f28000697e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2810006f00 tx=0x7f2810008040 comp rx=0 tx=0).stop 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 msgr2=0x7f281c1462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c1462f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f280800c7e0 tx=0x7f2808007df0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 shutdown_connections 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2800067330 0x7f28000697e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f281c159ae0 0x7f281c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f281c0b1180 0x7f281c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 --2- 172.21.15.142:0/1034890292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f281c0cc590 0x7f281c1462f0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 >> 172.21.15.142:0/1034890292 conn(0x7f281c0ce8b0 msgr2=0x7f281c0b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:56.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 shutdown_connections 2023-09-30T23:03:56.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.551+0000 7f2822bff700 1 -- 172.21.15.142:0/1034890292 wait complete. 2023-09-30T23:03:56.552 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T23:03:56.558 INFO:tasks.ceph.mds.c.smithi142.stderr: -8651> 2023-09-30T23:02:42.108+0000 7f52adbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T23:03:56.569 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T23:03:56.608 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T23:03:56.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.768+0000 7f0e2ddff700 1 Processor -- start 2023-09-30T23:03:56.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.768+0000 7f0e2ddff700 1 -- start start 2023-09-30T23:03:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.769+0000 7f0e2ddff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0e280cc3b0 0x7f0e2815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.769+0000 7f0e2ddff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e280d0550 con 0x7f0e28157ab0 2023-09-30T23:03:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.769+0000 7f0e2ddff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e280cf940 con 0x7f0e280cbfe0 2023-09-30T23:03:56.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.769+0000 7f0e2ddff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e280cfc20 con 0x7f0e280cc3b0 2023-09-30T23:03:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e26ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0e28157ab0 0x7f0e2806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39384/0 (socket says 172.21.15.142:39384) 2023-09-30T23:03:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e26ffd700 1 -- 172.21.15.142:0/1738163436 learned_addr learned my addr 172.21.15.142:0/1738163436 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:03:56.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e27fff700 1 --2- 172.21.15.142:0/1738163436 >> v2:172.21.15.148:3300/0 conn(0x7f0e280cc3b0 0x7f0e2815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474856570 0 0) 0x7f0e280d0550 con 0x7f0e28157ab0 2023-09-30T23:03:56.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e10003570 con 0x7f0e28157ab0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138508544 0 0) 0x7f0e280cf940 con 0x7f0e280cbfe0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e280d0550 con 0x7f0e280cbfe0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e27fff700 1 -- 172.21.15.142:0/1738163436 >> v1:172.21.15.148:6789/0 conn(0x7f0e280cbfe0 legacy=0x7f0e281573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1341075130 0 0) 0x7f0e10003570 con 0x7f0e28157ab0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e27fff700 1 -- 172.21.15.142:0/1738163436 >> v1:172.21.15.142:6789/0 conn(0x7f0e28157ab0 legacy=0x7f0e2806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.770+0000 7f0e27fff700 1 -- 172.21.15.142:0/1738163436 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280cff00 con 0x7f0e280cc3b0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.771+0000 7f0e27fff700 1 --2- 172.21.15.142:0/1738163436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e2815a2a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009e60 tx=0x7f0e20009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a09369d0d9c4f9ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.771+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000e070 con 0x7f0e280cc3b0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.771+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2000b7a0 con 0x7f0e280cc3b0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.771+0000 7f0e267fc700 1 -- 172.21.15.142:0/1738163436 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c001470 con 0x7f0e280cc3b0 2023-09-30T23:03:56.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.771+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1738163436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 msgr2=0x7f0e2815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.771+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1738163436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e2815a2a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009e60 tx=0x7f0e20009780 comp rx=0 tx=0).stop 2023-09-30T23:03:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.772+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1738163436 shutdown_connections 2023-09-30T23:03:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.772+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1738163436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e2815a2a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.772+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1738163436 >> 172.21.15.142:0/1738163436 conn(0x7f0e280d0a80 msgr2=0x7f0e280d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.772+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1738163436 shutdown_connections 2023-09-30T23:03:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.772+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1738163436 wait complete. 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.773+0000 7f0e2ddff700 1 Processor -- start 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.773+0000 7f0e2ddff700 1 -- start start 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e2ddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e280cbfe0 0x7f0e280c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e2ddff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e280c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e2ddff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e28157ab0 0x7f0e28155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e2ddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280c5990 con 0x7f0e280cbfe0 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e2ddff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280c71b0 con 0x7f0e280cc3b0 2023-09-30T23:03:56.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e2ddff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280b83d0 con 0x7f0e28157ab0 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e277fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e280cbfe0 0x7f0e280c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e277fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e280cbfe0 0x7f0e280c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42394/0 (socket says 172.21.15.142:42394) 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.774+0000 7f0e277fe700 1 -- 172.21.15.142:0/1235222662 learned_addr learned my addr 172.21.15.142:0/1235222662 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e26ffd700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e280c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e27fff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e28157ab0 0x7f0e28155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e277fe700 1 -- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e28157ab0 msgr2=0x7f0e28155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e277fe700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e28157ab0 0x7f0e28155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e277fe700 1 -- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 msgr2=0x7f0e280c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e277fe700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e280c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e277fe700 1 -- 172.21.15.142:0/1235222662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20009a20 con 0x7f0e280cbfe0 2023-09-30T23:03:56.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e26ffd700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e280c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:03:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e27fff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e28157ab0 0x7f0e28155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:03:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e277fe700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e280cbfe0 0x7f0e280c6bd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c790 tx=0x7f0e18007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e0f7fe700 1 -- 172.21.15.142:0/1235222662 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18010510 con 0x7f0e280cbfe0 2023-09-30T23:03:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e0f7fe700 1 -- 172.21.15.142:0/1235222662 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e18010670 con 0x7f0e280cbfe0 2023-09-30T23:03:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e280b86b0 con 0x7f0e280cbfe0 2023-09-30T23:03:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e0f7fe700 1 -- 172.21.15.142:0/1235222662 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18010a10 con 0x7f0e280cbfe0 2023-09-30T23:03:56.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.775+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e280c4bb0 con 0x7f0e280cbfe0 2023-09-30T23:03:56.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.776+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e28069770 con 0x7f0e280cbfe0 2023-09-30T23:03:56.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.777+0000 7f0e0f7fe700 1 -- 172.21.15.142:0/1235222662 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0e1801b400 con 0x7f0e280cbfe0 2023-09-30T23:03:56.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.778+0000 7f0e0f7fe700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e14067330 0x7f0e140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:56.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.778+0000 7f0e0f7fe700 1 -- 172.21.15.142:0/1235222662 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f0e18084ab0 con 0x7f0e280cbfe0 2023-09-30T23:03:56.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.778+0000 7f0e26ffd700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e14067330 0x7f0e140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:56.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.779+0000 7f0e26ffd700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e14067330 0x7f0e140697e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0015a0 tx=0x7f0e1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:56.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:56.782+0000 7f0e0f7fe700 1 -- 172.21.15.142:0/1235222662 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0e180518a0 con 0x7f0e280cbfe0 2023-09-30T23:03:57.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.014+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0e2806fc10 con 0x7f0e280cbfe0 2023-09-30T23:03:57.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.579+0000 7f0e0f7fe700 1 -- 172.21.15.142:0/1235222662 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0e18054ec0 con 0x7f0e280cbfe0 2023-09-30T23:03:57.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e14067330 msgr2=0x7f0e140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:57.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e14067330 0x7f0e140697e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0015a0 tx=0x7f0e1c009040 comp rx=0 tx=0).stop 2023-09-30T23:03:57.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e280cbfe0 msgr2=0x7f0e280c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:57.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e280cbfe0 0x7f0e280c6bd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c790 tx=0x7f0e18007e10 comp rx=0 tx=0).stop 2023-09-30T23:03:57.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 shutdown_connections 2023-09-30T23:03:57.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0e14067330 0x7f0e140697e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e28157ab0 0x7f0e28155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e280cbfe0 0x7f0e280c6bd0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 --2- 172.21.15.142:0/1235222662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e280cc3b0 0x7f0e280c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 >> 172.21.15.142:0/1235222662 conn(0x7f0e280d0a80 msgr2=0x7f0e28156670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:57.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 shutdown_connections 2023-09-30T23:03:57.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.583+0000 7f0e2ddff700 1 -- 172.21.15.142:0/1235222662 wait complete. 2023-09-30T23:03:57.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T23:03:57.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.837+0000 7fefd57ff700 1 Processor -- start 2023-09-30T23:03:57.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.837+0000 7fefd57ff700 1 -- start start 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.838+0000 7fefd57ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fefd00ca240 0x7fefd0150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.838+0000 7fefd57ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fefd0157150 0x7fefd0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.838+0000 7fefd57ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd015a260 0x7fefd015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.838+0000 7fefd57ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd00cc340 con 0x7fefd0157150 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.838+0000 7fefd57ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd015abe0 con 0x7fefd00ca240 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.838+0000 7fefd57ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0150c70 con 0x7fefd015a260 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.838+0000 7fefce7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fefd0157150 0x7fefd0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fefd0157150 0x7fefd0159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42400/0 (socket says 172.21.15.142:42400) 2023-09-30T23:03:57.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 -- 172.21.15.142:0/1504963110 learned_addr learned my addr 172.21.15.142:0/1504963110 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:57.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefceffd700 1 --2- 172.21.15.142:0/1504963110 >> v2:172.21.15.148:3300/0 conn(0x7fefd00ca240 0x7fefd0150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:57.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefcf7fe700 1 --2- 172.21.15.142:0/1504963110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd015a260 0x7fefd015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:57.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 -- 172.21.15.142:0/1504963110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd015a260 msgr2=0x7fefd015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:57.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 --2- 172.21.15.142:0/1504963110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd015a260 0x7fefd015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 -- 172.21.15.142:0/1504963110 >> v2:172.21.15.148:3300/0 conn(0x7fefd00ca240 msgr2=0x7fefd0150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 --2- 172.21.15.142:0/1504963110 >> v2:172.21.15.148:3300/0 conn(0x7fefd00ca240 0x7fefd0150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 -- 172.21.15.142:0/1504963110 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00ca790 con 0x7fefd0157150 2023-09-30T23:03:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefce7fc700 1 --2- 172.21.15.142:0/1504963110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd0157150 0x7fefd0159d20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fefd006c190 tx=0x7fefc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be70351c77d5dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefcdffb700 1 -- 172.21.15.142:0/1504963110 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc400b860 con 0x7fefd0157150 2023-09-30T23:03:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefcdffb700 1 -- 172.21.15.142:0/1504963110 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc400b9c0 con 0x7fefd0157150 2023-09-30T23:03:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.839+0000 7fefcdffb700 1 -- 172.21.15.142:0/1504963110 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc400bd60 con 0x7fefd0157150 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 -- 172.21.15.142:0/1504963110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd0157150 msgr2=0x7fefd0159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 --2- 172.21.15.142:0/1504963110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd0157150 0x7fefd0159d20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fefd006c190 tx=0x7fefc4009250 comp rx=0 tx=0).stop 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 -- 172.21.15.142:0/1504963110 shutdown_connections 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 --2- 172.21.15.142:0/1504963110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd015a260 0x7fefd015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 --2- 172.21.15.142:0/1504963110 >> v2:172.21.15.148:3300/0 conn(0x7fefd00ca240 0x7fefd0150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 --2- 172.21.15.142:0/1504963110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd0157150 0x7fefd0159d20 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 -- 172.21.15.142:0/1504963110 >> 172.21.15.142:0/1504963110 conn(0x7fefd00cc670 msgr2=0x7fefd00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 -- 172.21.15.142:0/1504963110 shutdown_connections 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.840+0000 7fefd57ff700 1 -- 172.21.15.142:0/1504963110 wait complete. 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.842+0000 7fefd57ff700 1 Processor -- start 2023-09-30T23:03:57.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.842+0000 7fefd57ff700 1 -- start start 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefd57ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd00ca240 0x7fefd0148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefd57ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0157150 0x7fefd016b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefd57ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd015a260 0x7fefd014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefd57ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0164b90 con 0x7fefd00ca240 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefd57ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0149010 con 0x7fefd015a260 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefd57ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00c6690 con 0x7fefd0157150 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd00ca240 0x7fefd0148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd00ca240 0x7fefd0148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42404/0 (socket says 172.21.15.142:42404) 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 -- 172.21.15.142:0/2243507787 learned_addr learned my addr 172.21.15.142:0/2243507787 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefcf7fe700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd015a260 0x7fefd014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:57.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefce7fc700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0157150 0x7fefd016b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 -- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0157150 msgr2=0x7fefd016b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0157150 0x7fefd016b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 -- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd015a260 msgr2=0x7fefd014f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd015a260 0x7fefd014f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 -- 172.21.15.142:0/2243507787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc40094f0 con 0x7fefd00ca240 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.843+0000 7fefceffd700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd00ca240 0x7fefd0148ad0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fefc000d890 tx=0x7fefc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.844+0000 7fefb6ffd700 1 -- 172.21.15.142:0/2243507787 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00125f0 con 0x7fefd00ca240 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.844+0000 7fefb6ffd700 1 -- 172.21.15.142:0/2243507787 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc0012750 con 0x7fefd00ca240 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.844+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd014e210 con 0x7fefd00ca240 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.844+0000 7fefb6ffd700 1 -- 172.21.15.142:0/2243507787 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0012af0 con 0x7fefd00ca240 2023-09-30T23:03:57.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.844+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd014e7d0 con 0x7fefd00ca240 2023-09-30T23:03:57.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.845+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd0069a50 con 0x7fefd00ca240 2023-09-30T23:03:57.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.846+0000 7fefb6ffd700 1 -- 172.21.15.142:0/2243507787 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fefc001e460 con 0x7fefd00ca240 2023-09-30T23:03:57.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.847+0000 7fefb6ffd700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefbc067330 0x7fefbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:57.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.847+0000 7fefb6ffd700 1 -- 172.21.15.142:0/2243507787 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6173+0+0 (secure 0 0 0) 0x7fefc0085170 con 0x7fefd00ca240 2023-09-30T23:03:57.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.847+0000 7fefce7fc700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefbc067330 0x7fefbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:57.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.848+0000 7fefce7fc700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefbc067330 0x7fefbc0697e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fefd006c190 tx=0x7fefc4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:57.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:57.851+0000 7fefb6ffd700 1 -- 172.21.15.142:0/2243507787 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fefc0052000 con 0x7fefd00ca240 2023-09-30T23:03:58.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.039+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fefd006fc10 con 0x7fefd00ca240 2023-09-30T23:03:58.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.589+0000 7fefb6ffd700 1 -- 172.21.15.142:0/2243507787 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) v1 ==== 181+0+0 (secure 0 0 0) 0x7fefc0055620 con 0x7fefd00ca240 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefbc067330 msgr2=0x7fefbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefbc067330 0x7fefbc0697e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fefd006c190 tx=0x7fefc4017000 comp rx=0 tx=0).stop 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd00ca240 msgr2=0x7fefd0148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd00ca240 0x7fefd0148ad0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fefc000d890 tx=0x7fefc0008040 comp rx=0 tx=0).stop 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 shutdown_connections 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fefbc067330 0x7fefbc0697e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefd015a260 0x7fefd014f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefd00ca240 0x7fefd0148ad0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 --2- 172.21.15.142:0/2243507787 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefd0157150 0x7fefd016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 >> 172.21.15.142:0/2243507787 conn(0x7fefd00cc670 msgr2=0x7fefd00c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:58.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 shutdown_connections 2023-09-30T23:03:58.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.592+0000 7fefd57ff700 1 -- 172.21.15.142:0/2243507787 wait complete. 2023-09-30T23:03:58.593 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T23:03:58.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T23:03:58.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.805+0000 7fe8d55ff700 1 Processor -- start 2023-09-30T23:03:58.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.806+0000 7fe8d55ff700 1 -- start start 2023-09-30T23:03:58.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.807+0000 7fe8d55ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d0157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:58.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.807+0000 7fe8d55ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe8d00ca240 0x7fe8d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:58.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.807+0000 7fe8d55ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d006b140 con 0x7fe8d006ace0 2023-09-30T23:03:58.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.807+0000 7fe8d55ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00cc340 con 0x7fe8d00ca240 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8d55ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00ca790 con 0x7fe8d0150730 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe8d00ca240 0x7fe8d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe8d00ca240 0x7fe8d006a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42420/0 (socket says 172.21.15.142:42420) 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/989696934 learned_addr learned my addr 172.21.15.142:0/989696934 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ceffd700 1 --2- 172.21.15.142:0/989696934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d0157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/989696934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 msgr2=0x7fe8d0157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 --2- 172.21.15.142:0/989696934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d0157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/989696934 >> v1:172.21.15.148:6789/0 conn(0x7fe8d006ace0 legacy=0x7fe8d0159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/989696934 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00caa70 con 0x7fe8d00ca240 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ceffd700 1 --2- 172.21.15.142:0/989696934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d0157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.808+0000 7fe8ce7fc700 1 --2- 172.21.15.142:0/989696934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d006a7a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40099b0 tx=0x7fe8c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6679efe585037a33 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:58.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8cdffb700 1 -- 172.21.15.142:0/989696934 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400b820 con 0x7fe8d00ca240 2023-09-30T23:03:58.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8cdffb700 1 -- 172.21.15.142:0/989696934 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c400b980 con 0x7fe8d00ca240 2023-09-30T23:03:58.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8cdffb700 1 -- 172.21.15.142:0/989696934 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400bd20 con 0x7fe8d00ca240 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 -- 172.21.15.142:0/989696934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 msgr2=0x7fe8d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/989696934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d006a7a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40099b0 tx=0x7fe8c4009250 comp rx=0 tx=0).stop 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 -- 172.21.15.142:0/989696934 shutdown_connections 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/989696934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d0157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/989696934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d006a7a0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 -- 172.21.15.142:0/989696934 >> 172.21.15.142:0/989696934 conn(0x7fe8d00cc670 msgr2=0x7fe8d00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 -- 172.21.15.142:0/989696934 shutdown_connections 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.809+0000 7fe8d55ff700 1 -- 172.21.15.142:0/989696934 wait complete. 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.811+0000 7fe8d55ff700 1 Processor -- start 2023-09-30T23:03:58.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.811+0000 7fe8d55ff700 1 -- start start 2023-09-30T23:03:58.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8d55ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d006ace0 0x7fe8d00c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:58.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8d55ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d00c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8d55ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d00c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8d55ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0158f60 con 0x7fe8d00ca240 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8d55ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d01592b0 con 0x7fe8d006ace0 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8d55ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0159590 con 0x7fe8d0150730 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8ce7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d00c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8ce7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d00c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42424/0 (socket says 172.21.15.142:42424) 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/4155168721 learned_addr learned my addr 172.21.15.142:0/4155168721 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8ceffd700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d006ace0 0x7fe8d00c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.812+0000 7fe8cf7fe700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d00c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:58.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 msgr2=0x7fe8d00c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8ce7fc700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d00c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d006ace0 msgr2=0x7fe8d00c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8ce7fc700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d006ace0 0x7fe8d00c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8ce7fc700 1 -- 172.21.15.142:0/4155168721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40094f0 con 0x7fe8d00ca240 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8ce7fc700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d00c5970 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009290 tx=0x7fe8c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8b6ffd700 1 -- 172.21.15.142:0/4155168721 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4011d70 con 0x7fe8d00ca240 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8b6ffd700 1 -- 172.21.15.142:0/4155168721 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4020070 con 0x7fe8d00ca240 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d0159870 con 0x7fe8d00ca240 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8b6ffd700 1 -- 172.21.15.142:0/4155168721 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c401b6a0 con 0x7fe8d00ca240 2023-09-30T23:03:58.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.813+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d00c2e90 con 0x7fe8d00ca240 2023-09-30T23:03:58.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.814+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d00c3020 con 0x7fe8d00ca240 2023-09-30T23:03:58.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.815+0000 7fe8b6ffd700 1 -- 172.21.15.142:0/4155168721 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe8c4022030 con 0x7fe8d00ca240 2023-09-30T23:03:58.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.816+0000 7fe8b6ffd700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8bc067330 0x7fe8bc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:58.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.816+0000 7fe8b6ffd700 1 -- 172.21.15.142:0/4155168721 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fe8c40868c0 con 0x7fe8d00ca240 2023-09-30T23:03:58.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.816+0000 7fe8ceffd700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8bc067330 0x7fe8bc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:58.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.817+0000 7fe8ceffd700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8bc067330 0x7fe8bc0697e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0006fd0 tx=0x7fe8c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:58.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:58.820+0000 7fe8b6ffd700 1 -- 172.21.15.142:0/4155168721 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe8d00c3020 con 0x7fe8d00ca240 2023-09-30T23:03:59.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.010+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8d0159d90 con 0x7fe8d00ca240 2023-09-30T23:03:59.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.600+0000 7fe8b6ffd700 1 -- 172.21.15.142:0/4155168721 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe8d0159d90 con 0x7fe8d00ca240 2023-09-30T23:03:59.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.604+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8bc067330 msgr2=0x7fe8bc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:59.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.604+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8bc067330 0x7fe8bc0697e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0006fd0 tx=0x7fe8c0008040 comp rx=0 tx=0).stop 2023-09-30T23:03:59.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.604+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 msgr2=0x7fe8d00c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.604+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d00c5970 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009290 tx=0x7fe8c4016000 comp rx=0 tx=0).stop 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 shutdown_connections 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe8bc067330 0x7fe8bc0697e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d0150730 0x7fe8d00c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d006ace0 0x7fe8d00c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 --2- 172.21.15.142:0/4155168721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d00ca240 0x7fe8d00c5970 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 >> 172.21.15.142:0/4155168721 conn(0x7fe8d00cc670 msgr2=0x7fe8d0147fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 shutdown_connections 2023-09-30T23:03:59.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.605+0000 7fe8d55ff700 1 -- 172.21.15.142:0/4155168721 wait complete. 2023-09-30T23:03:59.606 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T23:03:59.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T23:03:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.821+0000 7faadd3ff700 1 Processor -- start 2023-09-30T23:03:59.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.821+0000 7faadd3ff700 1 -- start start 2023-09-30T23:03:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.822+0000 7faadd3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faad80c52a0 0x7faad80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.822+0000 7faadd3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad80c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.822+0000 7faadd3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80c7690 con 0x7faad80c5bb0 2023-09-30T23:03:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.822+0000 7faadd3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad81406a0 con 0x7faad80c52a0 2023-09-30T23:03:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.822+0000 7faadd3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad80c3a50 con 0x7faad8069f10 2023-09-30T23:03:59.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faad80c52a0 0x7faad80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad67fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad80c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faad80c52a0 0x7faad80c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:43722/0 (socket says 172.21.15.142:43722) 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad67fc700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad80c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:52710/0 (socket says 172.21.15.142:52710) 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad77fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faad80c5bb0 0x7faad80ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:34316/0 (socket says 172.21.15.142:34316) 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad6ffd700 1 -- 172.21.15.142:0/1614615398 learned_addr learned my addr 172.21.15.142:0/1614615398 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad67fc700 1 -- 172.21.15.142:0/1614615398 >> v2:172.21.15.148:3300/0 conn(0x7faad80c52a0 msgr2=0x7faad80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad67fc700 1 --2- 172.21.15.142:0/1614615398 >> v2:172.21.15.148:3300/0 conn(0x7faad80c52a0 0x7faad80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad67fc700 1 -- 172.21.15.142:0/1614615398 >> v1:172.21.15.148:6789/0 conn(0x7faad80c5bb0 legacy=0x7faad80ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad67fc700 1 -- 172.21.15.142:0/1614615398 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80c7f20 con 0x7faad8069f10 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.823+0000 7faad6ffd700 1 --2- 172.21.15.142:0/1614615398 >> v2:172.21.15.148:3300/0 conn(0x7faad80c52a0 0x7faad80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:03:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.824+0000 7faad67fc700 1 --2- 172.21.15.142:0/1614615398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad80c5670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faacc009910 tx=0x7faacc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84eded71ad4a0b34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:59.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.824+0000 7faad5ffb700 1 -- 172.21.15.142:0/1614615398 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00b640 con 0x7faad8069f10 2023-09-30T23:03:59.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.824+0000 7faad5ffb700 1 -- 172.21.15.142:0/1614615398 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc00b7a0 con 0x7faad8069f10 2023-09-30T23:03:59.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.824+0000 7faad5ffb700 1 -- 172.21.15.142:0/1614615398 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00bb60 con 0x7faad8069f10 2023-09-30T23:03:59.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 -- 172.21.15.142:0/1614615398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 msgr2=0x7faad80c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:59.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 --2- 172.21.15.142:0/1614615398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad80c5670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faacc009910 tx=0x7faacc0091a0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 -- 172.21.15.142:0/1614615398 shutdown_connections 2023-09-30T23:03:59.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 --2- 172.21.15.142:0/1614615398 >> v2:172.21.15.148:3300/0 conn(0x7faad80c52a0 0x7faad80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 --2- 172.21.15.142:0/1614615398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad80c5670 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 -- 172.21.15.142:0/1614615398 >> 172.21.15.142:0/1614615398 conn(0x7faad80cc670 msgr2=0x7faad80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:03:59.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 -- 172.21.15.142:0/1614615398 shutdown_connections 2023-09-30T23:03:59.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.825+0000 7faadd3ff700 1 -- 172.21.15.142:0/1614615398 wait complete. 2023-09-30T23:03:59.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.826+0000 7faadd3ff700 1 Processor -- start 2023-09-30T23:03:59.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.826+0000 7faadd3ff700 1 -- start start 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.827+0000 7faadd3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad813a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.827+0000 7faadd3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faad80c52a0 0x7faad80c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.827+0000 7faadd3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad80c5bb0 0x7faad816a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.827+0000 7faadd3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad813a620 con 0x7faad80c5bb0 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.827+0000 7faadd3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad813a850 con 0x7faad80c52a0 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.827+0000 7faadd3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad813ab30 con 0x7faad8069f10 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad80c5bb0 0x7faad816a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad80c5bb0 0x7faad816a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42438/0 (socket says 172.21.15.142:42438) 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 -- 172.21.15.142:0/3158515922 learned_addr learned my addr 172.21.15.142:0/3158515922 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:03:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad6ffd700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad813a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad67fc700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faad80c52a0 0x7faad80c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 -- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 msgr2=0x7faad813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad813a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 -- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faad80c52a0 msgr2=0x7faad80c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faad80c52a0 0x7faad80c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad77fe700 1 -- 172.21.15.142:0/3158515922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac800b790 con 0x7faad80c5bb0 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad67fc700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faad80c52a0 0x7faad80c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.828+0000 7faad6ffd700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.829+0000 7faad77fe700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad80c5bb0 0x7faad816a740 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7faad000cc70 tx=0x7faad0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.829+0000 7faabeffd700 1 -- 172.21.15.142:0/3158515922 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0004bb0 con 0x7faad80c5bb0 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.829+0000 7faabeffd700 1 -- 172.21.15.142:0/3158515922 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad0004d10 con 0x7faad80c5bb0 2023-09-30T23:03:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.829+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc009420 con 0x7faad80c5bb0 2023-09-30T23:03:59.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.829+0000 7faabeffd700 1 -- 172.21.15.142:0/3158515922 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000ab90 con 0x7faad80c5bb0 2023-09-30T23:03:59.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.829+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad813b0f0 con 0x7faad80c5bb0 2023-09-30T23:03:59.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.830+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad8069a50 con 0x7faad80c5bb0 2023-09-30T23:03:59.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.831+0000 7faabeffd700 1 -- 172.21.15.142:0/3158515922 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7faad00070f0 con 0x7faad80c5bb0 2023-09-30T23:03:59.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.832+0000 7faabeffd700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faac4067330 0x7faac40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:03:59.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.832+0000 7faabeffd700 1 -- 172.21.15.142:0/3158515922 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faad00842b0 con 0x7faad80c5bb0 2023-09-30T23:03:59.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.832+0000 7faad6ffd700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faac4067330 0x7faac40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:03:59.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.833+0000 7faad6ffd700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faac4067330 0x7faac40697e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faac800b240 tx=0x7faac800b4f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:03:59.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:03:59.837+0000 7faabeffd700 1 -- 172.21.15.142:0/3158515922 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faad0051490 con 0x7faad80c5bb0 2023-09-30T23:04:00.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.028+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faad80c7690 con 0x7faad80c5bb0 2023-09-30T23:04:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.033+0000 7faabeffd700 1 -- 172.21.15.142:0/3158515922 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7faad80c7690 con 0x7faad80c5bb0 2023-09-30T23:04:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faac4067330 msgr2=0x7faac40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faac4067330 0x7faac40697e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faac800b240 tx=0x7faac800b4f0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad80c5bb0 msgr2=0x7faad816a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad80c5bb0 0x7faad816a740 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7faad000cc70 tx=0x7faad0001a70 comp rx=0 tx=0).stop 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 shutdown_connections 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7faac4067330 0x7faac40697e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faad80c5bb0 0x7faad816a740 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faad8069f10 0x7faad813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 --2- 172.21.15.142:0/3158515922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faad80c52a0 0x7faad80c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 >> 172.21.15.142:0/3158515922 conn(0x7faad80cc670 msgr2=0x7faad806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 shutdown_connections 2023-09-30T23:04:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.036+0000 7faadd3ff700 1 -- 172.21.15.142:0/3158515922 wait complete. 2023-09-30T23:04:00.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-09-30T23:04:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.244+0000 7ffaf25ff700 1 Processor -- start 2023-09-30T23:04:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.244+0000 7ffaf25ff700 1 -- start start 2023-09-30T23:04:00.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf25ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffaec0b1580 0x7ffaec0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf25ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffaec0ae000 0x7ffaec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf25ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec0ad630 con 0x7ffaec0b1950 2023-09-30T23:04:00.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf25ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec157c20 con 0x7ffaec0ae000 2023-09-30T23:04:00.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf25ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec0b3360 con 0x7ffaec0b1580 2023-09-30T23:04:00.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf0b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffaec0ae000 0x7ffaec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf0b9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffaec0ae000 0x7ffaec06a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42442/0 (socket says 172.21.15.142:42442) 2023-09-30T23:04:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaeb7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ffaec0b1950 0x7ffaec15a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39392/0 (socket says 172.21.15.142:39392) 2023-09-30T23:04:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.245+0000 7ffaf0b9c700 1 -- 172.21.15.142:0/1955575502 learned_addr learned my addr 172.21.15.142:0/1955575502 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:00.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaebfff700 1 --2- 172.21.15.142:0/1955575502 >> v2:172.21.15.148:3300/0 conn(0x7ffaec0b1580 0x7ffaec0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaf0b9c700 1 -- 172.21.15.142:0/1955575502 >> v2:172.21.15.148:3300/0 conn(0x7ffaec0b1580 msgr2=0x7ffaec0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaf0b9c700 1 --2- 172.21.15.142:0/1955575502 >> v2:172.21.15.148:3300/0 conn(0x7ffaec0b1580 0x7ffaec0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaf0b9c700 1 -- 172.21.15.142:0/1955575502 >> v1:172.21.15.142:6789/0 conn(0x7ffaec0b1950 legacy=0x7ffaec15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaf0b9c700 1 -- 172.21.15.142:0/1955575502 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec15ad60 con 0x7ffaec0ae000 2023-09-30T23:04:00.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaeaffd700 1 -- 172.21.15.142:0/1955575502 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822889151 0 0) 0x7ffaec0ad630 con 0x7ffaec0b1950 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaf0b9c700 1 --2- 172.21.15.142:0/1955575502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec06a7a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ffaec06c8a0 tx=0x7ffae4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990065a56e237ad3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaeaffd700 1 -- 172.21.15.142:0/1955575502 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae400e070 con 0x7ffaec0ae000 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaeaffd700 1 -- 172.21.15.142:0/1955575502 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae400ba20 con 0x7ffaec0ae000 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.246+0000 7ffaeaffd700 1 -- 172.21.15.142:0/1955575502 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40092e0 con 0x7ffaec0ae000 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 -- 172.21.15.142:0/1955575502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 msgr2=0x7ffaec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/1955575502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec06a7a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ffaec06c8a0 tx=0x7ffae4009840 comp rx=0 tx=0).stop 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 -- 172.21.15.142:0/1955575502 shutdown_connections 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/1955575502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec06a7a0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/1955575502 >> v2:172.21.15.148:3300/0 conn(0x7ffaec0b1580 0x7ffaec0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 -- 172.21.15.142:0/1955575502 >> 172.21.15.142:0/1955575502 conn(0x7ffaec0ce1f0 msgr2=0x7ffaec069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 -- 172.21.15.142:0/1955575502 shutdown_connections 2023-09-30T23:04:00.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.247+0000 7ffaf25ff700 1 -- 172.21.15.142:0/1955575502 wait complete. 2023-09-30T23:04:00.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.249+0000 7ffaf25ff700 1 Processor -- start 2023-09-30T23:04:00.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.249+0000 7ffaf25ff700 1 -- start start 2023-09-30T23:04:00.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaf25ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaf25ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffaec0b1580 0x7ffaec0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaf25ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaec0b1950 0x7ffaec155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaf25ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec1564b0 con 0x7ffaec0ae000 2023-09-30T23:04:00.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaf25ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0cbdf0 con 0x7ffaec0b1950 2023-09-30T23:04:00.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaf25ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0cb1e0 con 0x7ffaec0b1580 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec0cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec0cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42444/0 (socket says 172.21.15.142:42444) 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 -- 172.21.15.142:0/4243828396 learned_addr learned my addr 172.21.15.142:0/4243828396 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaf0b9c700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaec0b1950 0x7ffaec155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaeb7fe700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffaec0b1580 0x7ffaec0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 -- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffaec0b1580 msgr2=0x7ffaec0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffaec0b1580 0x7ffaec0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 -- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaec0b1950 msgr2=0x7ffaec155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaec0b1950 0x7ffaec155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.250+0000 7ffaebfff700 1 -- 172.21.15.142:0/4243828396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4009ae0 con 0x7ffaec0ae000 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.251+0000 7ffaebfff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec0cc280 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00ec80 tx=0x7ffadc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.251+0000 7ffad3fff700 1 -- 172.21.15.142:0/4243828396 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00c9d0 con 0x7ffaec0ae000 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.251+0000 7ffad3fff700 1 -- 172.21.15.142:0/4243828396 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc00cb30 con 0x7ffaec0ae000 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.251+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec0cb4c0 con 0x7ffaec0ae000 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.251+0000 7ffad3fff700 1 -- 172.21.15.142:0/4243828396 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc013470 con 0x7ffaec0ae000 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.251+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec0cba80 con 0x7ffaec0ae000 2023-09-30T23:04:00.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.252+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec06d600 con 0x7ffaec0ae000 2023-09-30T23:04:00.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.253+0000 7ffad3fff700 1 -- 172.21.15.142:0/4243828396 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffadc013820 con 0x7ffaec0ae000 2023-09-30T23:04:00.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.254+0000 7ffad3fff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffad8067330 0x7ffad80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.254+0000 7ffad3fff700 1 -- 172.21.15.142:0/4243828396 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ffadc084d50 con 0x7ffaec0ae000 2023-09-30T23:04:00.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.254+0000 7ffaeb7fe700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffad8067330 0x7ffad80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.254+0000 7ffaeb7fe700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffad8067330 0x7ffad80697e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffae0007fd0 tx=0x7ffae0007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:00.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.258+0000 7ffad3fff700 1 -- 172.21.15.142:0/4243828396 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ffadc051eb0 con 0x7ffaec0ae000 2023-09-30T23:04:00.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.524+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7ffaec15b040 con 0x7ffaec0ae000 2023-09-30T23:04:00.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.601+0000 7ffad3fff700 1 -- 172.21.15.142:0/4243828396 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v544) v1 ==== 131+0+0 (secure 0 0 0) 0x7ffadc0170c0 con 0x7ffaec0ae000 2023-09-30T23:04:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffad8067330 msgr2=0x7ffad80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffad8067330 0x7ffad80697e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffae0007fd0 tx=0x7ffae0007e10 comp rx=0 tx=0).stop 2023-09-30T23:04:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 msgr2=0x7ffaec0cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec0cc280 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00ec80 tx=0x7ffadc0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 shutdown_connections 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffad8067330 0x7ffad80697e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaec0b1950 0x7ffaec155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaec0ae000 0x7ffaec0cc280 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 --2- 172.21.15.142:0/4243828396 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffaec0b1580 0x7ffaec0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 >> 172.21.15.142:0/4243828396 conn(0x7ffaec0ce1f0 msgr2=0x7ffaec159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 shutdown_connections 2023-09-30T23:04:00.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.604+0000 7ffaf25ff700 1 -- 172.21.15.142:0/4243828396 wait complete. 2023-09-30T23:04:00.622 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-09-30T23:04:00.623 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-09-30T23:04:00.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-09-30T23:04:00.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.813+0000 7ffb3c7ff700 1 Processor -- start 2023-09-30T23:04:00.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.813+0000 7ffb3c7ff700 1 -- start start 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3c7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffb34159ae0 0x7ffb340cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3c7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb340cc590 0x7ffb34069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3c7ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3415d910 con 0x7ffb340b1180 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3c7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3415e920 con 0x7ffb340cc590 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3c7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3415e490 con 0x7ffb34159ae0 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3ad9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb340cc590 0x7ffb34069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3ad9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb340cc590 0x7ffb34069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42446/0 (socket says 172.21.15.142:42446) 2023-09-30T23:04:00.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/898809152 learned_addr learned my addr 172.21.15.142:0/898809152 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:00.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.814+0000 7ffb39d9a700 1 --1- 172.21.15.142:0/898809152 >> v1:172.21.15.142:6789/0 conn(0x7ffb340b1180 0x7ffb340cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39406/0 (socket says 172.21.15.142:39406) 2023-09-30T23:04:00.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb3a59b700 1 --2- 172.21.15.142:0/898809152 >> v2:172.21.15.148:3300/0 conn(0x7ffb34159ae0 0x7ffb340cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/898809152 >> v2:172.21.15.148:3300/0 conn(0x7ffb34159ae0 msgr2=0x7ffb340cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb3ad9c700 1 --2- 172.21.15.142:0/898809152 >> v2:172.21.15.148:3300/0 conn(0x7ffb34159ae0 0x7ffb340cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/898809152 >> v1:172.21.15.142:6789/0 conn(0x7ffb340b1180 legacy=0x7ffb340cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/898809152 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3415db60 con 0x7ffb340cc590 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb3ad9c700 1 --2- 172.21.15.142:0/898809152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340cc590 0x7ffb34069f10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ffb340cb650 tx=0x7ffb2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba05f4c2d202004 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb39599700 1 -- 172.21.15.142:0/898809152 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00e070 con 0x7ffb340cc590 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb39599700 1 -- 172.21.15.142:0/898809152 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00ba50 con 0x7ffb340cc590 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.815+0000 7ffb39599700 1 -- 172.21.15.142:0/898809152 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0092e0 con 0x7ffb340cc590 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/898809152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340cc590 msgr2=0x7ffb34069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/898809152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340cc590 0x7ffb34069f10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ffb340cb650 tx=0x7ffb2c009840 comp rx=0 tx=0).stop 2023-09-30T23:04:00.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/898809152 shutdown_connections 2023-09-30T23:04:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/898809152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340cc590 0x7ffb34069f10 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/898809152 >> v2:172.21.15.148:3300/0 conn(0x7ffb34159ae0 0x7ffb340cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/898809152 >> 172.21.15.142:0/898809152 conn(0x7ffb340ce8b0 msgr2=0x7ffb340cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/898809152 shutdown_connections 2023-09-30T23:04:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.816+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/898809152 wait complete. 2023-09-30T23:04:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.818+0000 7ffb3c7ff700 1 Processor -- start 2023-09-30T23:04:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.818+0000 7ffb3c7ff700 1 -- start start 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.819+0000 7ffb3c7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb340b1180 0x7ffb34147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.819+0000 7ffb3c7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb340cc590 0x7ffb340b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.819+0000 7ffb3c7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb34159ae0 0x7ffb340b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.819+0000 7ffb3c7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3416ae90 con 0x7ffb34159ae0 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.819+0000 7ffb3c7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3416a000 con 0x7ffb340cc590 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.819+0000 7ffb3c7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341478a0 con 0x7ffb340b1180 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb34159ae0 0x7ffb340b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb34159ae0 0x7ffb340b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42456/0 (socket says 172.21.15.142:42456) 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/24427383 learned_addr learned my addr 172.21.15.142:0/24427383 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3a59b700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb340b1180 0x7ffb34147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb39d9a700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb340cc590 0x7ffb340b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb340b1180 msgr2=0x7ffb34147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb340b1180 0x7ffb34147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb340cc590 msgr2=0x7ffb340b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb340cc590 0x7ffb340b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 -- 172.21.15.142:0/24427383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009ae0 con 0x7ffb34159ae0 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.820+0000 7ffb3ad9c700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb34159ae0 0x7ffb340b1da0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ffb34063f90 tx=0x7ffb2c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.821+0000 7ffb2a7fc700 1 -- 172.21.15.142:0/24427383 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0094e0 con 0x7ffb34159ae0 2023-09-30T23:04:00.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.821+0000 7ffb2a7fc700 1 -- 172.21.15.142:0/24427383 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c008e80 con 0x7ffb34159ae0 2023-09-30T23:04:00.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.821+0000 7ffb2a7fc700 1 -- 172.21.15.142:0/24427383 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0266b0 con 0x7ffb34159ae0 2023-09-30T23:04:00.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.821+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3416a280 con 0x7ffb34159ae0 2023-09-30T23:04:00.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.821+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3416a840 con 0x7ffb34159ae0 2023-09-30T23:04:00.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.822+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3416afd0 con 0x7ffb34159ae0 2023-09-30T23:04:00.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.823+0000 7ffb2a7fc700 1 -- 172.21.15.142:0/24427383 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffb2c003040 con 0x7ffb34159ae0 2023-09-30T23:04:00.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.823+0000 7ffb2a7fc700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffb18067330 0x7ffb180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:00.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.824+0000 7ffb2a7fc700 1 -- 172.21.15.142:0/24427383 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ffb2c086910 con 0x7ffb34159ae0 2023-09-30T23:04:00.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.824+0000 7ffb3a59b700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffb18067330 0x7ffb180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:00.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.824+0000 7ffb3a59b700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffb18067330 0x7ffb180697e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ffb30006fd0 tx=0x7ffb30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:00.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:00.828+0000 7ffb2a7fc700 1 -- 172.21.15.142:0/24427383 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ffb2c053b20 con 0x7ffb34159ae0 2023-09-30T23:04:01.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.093+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7ffb3415de40 con 0x7ffb34159ae0 2023-09-30T23:04:01.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.600+0000 7ffb2a7fc700 1 -- 172.21.15.142:0/24427383 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v545) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffb2c009940 con 0x7ffb34159ae0 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffb18067330 msgr2=0x7ffb180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffb18067330 0x7ffb180697e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ffb30006fd0 tx=0x7ffb30008040 comp rx=0 tx=0).stop 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb34159ae0 msgr2=0x7ffb340b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb34159ae0 0x7ffb340b1da0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ffb34063f90 tx=0x7ffb2c018000 comp rx=0 tx=0).stop 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 shutdown_connections 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ffb18067330 0x7ffb180697e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb34159ae0 0x7ffb340b1da0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb340b1180 0x7ffb34147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 --2- 172.21.15.142:0/24427383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb340cc590 0x7ffb340b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 >> 172.21.15.142:0/24427383 conn(0x7ffb340ce8b0 msgr2=0x7ffb341532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:01.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 shutdown_connections 2023-09-30T23:04:01.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.603+0000 7ffb3c7ff700 1 -- 172.21.15.142:0/24427383 wait complete. 2023-09-30T23:04:01.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T23:04:01.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.815+0000 7fb86d9ff700 1 Processor -- start 2023-09-30T23:04:01.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.815+0000 7fb86d9ff700 1 -- start start 2023-09-30T23:04:01.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb86d9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb868141150 0x7fb8681580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:01.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb86d9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8680c38d0 con 0x7fb8680c6270 2023-09-30T23:04:01.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb86d9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8680c6aa0 con 0x7fb8680c40e0 2023-09-30T23:04:01.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb86d9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86806a040 con 0x7fb868141150 2023-09-30T23:04:01.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb866ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb868141150 0x7fb8681580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:01.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb8667fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb8680c6270 0x7fb86815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39220/0 (socket says 172.21.15.142:39220) 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb8667fc700 1 -- 172.21.15.142:0/2568669876 learned_addr learned my addr 172.21.15.142:0/2568669876 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb866ffd700 1 -- 172.21.15.142:0/2568669876 >> v1:172.21.15.148:6789/0 conn(0x7fb8680c40e0 legacy=0x7fb8680c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb866ffd700 1 -- 172.21.15.142:0/2568669876 >> v1:172.21.15.142:6789/0 conn(0x7fb8680c6270 legacy=0x7fb86815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.818+0000 7fb866ffd700 1 -- 172.21.15.142:0/2568669876 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8680c67c0 con 0x7fb868141150 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.817+0000 7fb865ffb700 1 -- 172.21.15.142:0/2568669876 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325969418 0 0) 0x7fb8680c38d0 con 0x7fb8680c6270 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.818+0000 7fb866ffd700 1 --2- 172.21.15.142:0/2568669876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8681580c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fb8580098e0 tx=0x7fb8580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2138e0b5b5f499 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.818+0000 7fb865ffb700 1 -- 172.21.15.142:0/2568669876 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858009e80 con 0x7fb868141150 2023-09-30T23:04:01.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.818+0000 7fb865ffb700 1 -- 172.21.15.142:0/2568669876 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800b820 con 0x7fb868141150 2023-09-30T23:04:01.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.818+0000 7fb865ffb700 1 -- 172.21.15.142:0/2568669876 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800bba0 con 0x7fb868141150 2023-09-30T23:04:01.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.818+0000 7fb86d9ff700 1 -- 172.21.15.142:0/2568669876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 msgr2=0x7fb8681580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:01.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.818+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/2568669876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8681580c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fb8580098e0 tx=0x7fb8580091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.819+0000 7fb86d9ff700 1 -- 172.21.15.142:0/2568669876 shutdown_connections 2023-09-30T23:04:01.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.819+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/2568669876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8681580c0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.819+0000 7fb86d9ff700 1 -- 172.21.15.142:0/2568669876 >> 172.21.15.142:0/2568669876 conn(0x7fb8680cc670 msgr2=0x7fb8680cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:01.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.819+0000 7fb86d9ff700 1 -- 172.21.15.142:0/2568669876 shutdown_connections 2023-09-30T23:04:01.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.819+0000 7fb86d9ff700 1 -- 172.21.15.142:0/2568669876 wait complete. 2023-09-30T23:04:01.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.820+0000 7fb86d9ff700 1 Processor -- start 2023-09-30T23:04:01.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.820+0000 7fb86d9ff700 1 -- start start 2023-09-30T23:04:01.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.821+0000 7fb86d9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8680c40e0 0x7fb8680ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:01.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.821+0000 7fb86d9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8680c6270 0x7fb8680bc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:01.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.821+0000 7fb86d9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8680cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:01.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.821+0000 7fb86d9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680b9340 con 0x7fb868141150 2023-09-30T23:04:01.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.821+0000 7fb86d9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680bb6f0 con 0x7fb8680c6270 2023-09-30T23:04:01.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.821+0000 7fb86d9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680bb9d0 con 0x7fb8680c40e0 2023-09-30T23:04:01.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.821+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8680cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:01.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8680cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59418/0 (socket says 172.21.15.142:59418) 2023-09-30T23:04:01.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 -- 172.21.15.142:0/1624454139 learned_addr learned my addr 172.21.15.142:0/1624454139 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:01.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8667fc700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8680c6270 0x7fb8680bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:01.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb866ffd700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8680c40e0 0x7fb8680ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:01.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 -- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8680c40e0 msgr2=0x7fb8680ba9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:01.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8680c40e0 0x7fb8680ba9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 -- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8680c6270 msgr2=0x7fb8680bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:01.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8680c6270 0x7fb8680bc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:01.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 -- 172.21.15.142:0/1624454139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009420 con 0x7fb868141150 2023-09-30T23:04:01.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb866ffd700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8680c40e0 0x7fb8680ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:01.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb8677fe700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8680cafc0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb86000bbb0 tx=0x7fb860009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:01.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb84effd700 1 -- 172.21.15.142:0/1624454139 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600092e0 con 0x7fb868141150 2023-09-30T23:04:01.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb84effd700 1 -- 172.21.15.142:0/1624454139 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86000c7a0 con 0x7fb868141150 2023-09-30T23:04:01.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8680bbcb0 con 0x7fb868141150 2023-09-30T23:04:01.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.822+0000 7fb84effd700 1 -- 172.21.15.142:0/1624454139 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000cb40 con 0x7fb868141150 2023-09-30T23:04:01.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.823+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8680baf90 con 0x7fb868141150 2023-09-30T23:04:01.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.824+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8680bc300 con 0x7fb868141150 2023-09-30T23:04:01.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.824+0000 7fb84effd700 1 -- 172.21.15.142:0/1624454139 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb860012070 con 0x7fb868141150 2023-09-30T23:04:01.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.825+0000 7fb84effd700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb854067330 0x7fb8540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:01.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.825+0000 7fb84effd700 1 -- 172.21.15.142:0/1624454139 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb860084620 con 0x7fb868141150 2023-09-30T23:04:01.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.826+0000 7fb866ffd700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb854067330 0x7fb8540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:01.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.826+0000 7fb866ffd700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb854067330 0x7fb8540697e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb8580098e0 tx=0x7fb858016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:01.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:01.829+0000 7fb84effd700 1 -- 172.21.15.142:0/1624454139 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb860051780 con 0x7fb868141150 2023-09-30T23:04:02.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.020+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb86806fc10 con 0x7fb868141150 2023-09-30T23:04:02.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.026+0000 7fb84effd700 1 -- 172.21.15.142:0/1624454139 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb86001a0c0 con 0x7fb868141150 2023-09-30T23:04:02.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb854067330 msgr2=0x7fb8540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb854067330 0x7fb8540697e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb8580098e0 tx=0x7fb858016000 comp rx=0 tx=0).stop 2023-09-30T23:04:02.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 msgr2=0x7fb8680cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8680cafc0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb86000bbb0 tx=0x7fb860009840 comp rx=0 tx=0).stop 2023-09-30T23:04:02.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 shutdown_connections 2023-09-30T23:04:02.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb854067330 0x7fb8540697e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb868141150 0x7fb8680cafc0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb8680c40e0 0x7fb8680ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 --2- 172.21.15.142:0/1624454139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8680c6270 0x7fb8680bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 >> 172.21.15.142:0/1624454139 conn(0x7fb8680cc670 msgr2=0x7fb8680c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 shutdown_connections 2023-09-30T23:04:02.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.028+0000 7fb86d9ff700 1 -- 172.21.15.142:0/1624454139 wait complete. 2023-09-30T23:04:02.047 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T23:04:02.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:04:02.152 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:04:02.256 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T23:04:02.256 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T23:04:02.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.446+0000 7efd93dff700 1 Processor -- start 2023-09-30T23:04:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.446+0000 7efd93dff700 1 -- start start 2023-09-30T23:04:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.447+0000 7efd93dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c0aebf0 0x7efd8c06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.447+0000 7efd93dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a2a0 0x7efd8c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.447+0000 7efd93dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c0b0ee0 con 0x7efd8c06f190 2023-09-30T23:04:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.447+0000 7efd93dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0aefc0 con 0x7efd8c15a2a0 2023-09-30T23:04:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.447+0000 7efd93dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0b02d0 con 0x7efd8c0aebf0 2023-09-30T23:04:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.447+0000 7efd9139a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7efd8c06f190 0x7efd8c159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39232/0 (socket says 172.21.15.142:39232) 2023-09-30T23:04:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd9139a700 1 -- 172.21.15.142:0/3441451165 learned_addr learned my addr 172.21.15.142:0/3441451165 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd91b9b700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c0aebf0 0x7efd8c06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd9239c700 1 --2- 172.21.15.142:0/3441451165 >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a2a0 0x7efd8c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688460568 0 0) 0x7efd8c0b0ee0 con 0x7efd8c06f190 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd78003570 con 0x7efd8c06f190 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1705143561 0 0) 0x7efd78003570 con 0x7efd8c06f190 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c0aebf0 msgr2=0x7efd8c06ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c0aebf0 0x7efd8c06ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a2a0 msgr2=0x7efd8c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 --2- 172.21.15.142:0/3441451165 >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a2a0 0x7efd8c069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0b05b0 con 0x7efd8c06f190 2023-09-30T23:04:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7efd7c001470 con 0x7efd8c06f190 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd9239c700 1 --2- 172.21.15.142:0/3441451165 >> v2:172.21.15.148:3300/0 conn(0x7efd8c15a2a0 0x7efd8c069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 >> v1:172.21.15.142:6789/0 conn(0x7efd8c06f190 legacy=0x7efd8c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd78003a60 0x7efd78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd78004810 0x7efd78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.448+0000 7efd90b99700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780051c0 0x7efd7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0aefc0 con 0x7efd780051c0 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0b02d0 con 0x7efd78004810 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7800bfa0 con 0x7efd78003a60 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd91b9b700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c0aebf0 0x7efd8c06ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9239c700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780051c0 0x7efd7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9139a700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd78004810 0x7efd78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd91b9b700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd78003a60 0x7efd78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9239c700 1 -- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd78003a60 msgr2=0x7efd78003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9239c700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd78003a60 0x7efd78003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9239c700 1 -- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd78004810 msgr2=0x7efd78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9239c700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd78004810 0x7efd78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9239c700 1 -- 172.21.15.142:0/3441451165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78003570 con 0x7efd780051c0 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd91b9b700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd78003a60 0x7efd78003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.449+0000 7efd9239c700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780051c0 0x7efd7800ba60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7efd8c15a6a0 tx=0x7efd8400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54c93fad7dfa2d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400fd60 con 0x7efd780051c0 2023-09-30T23:04:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd84010040 con 0x7efd780051c0 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd90b99700 1 -- 172.21.15.142:0/3441451165 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400a320 con 0x7efd780051c0 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd93dff700 1 -- 172.21.15.142:0/3441451165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780051c0 msgr2=0x7efd7800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd93dff700 1 --2- 172.21.15.142:0/3441451165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780051c0 0x7efd7800ba60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7efd8c15a6a0 tx=0x7efd8400c040 comp rx=0 tx=0).stop 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd9239c700 1 -- 172.21.15.142:0/3441451165 reap_dead start 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd93dff700 1 -- 172.21.15.142:0/3441451165 shutdown_connections 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd93dff700 1 -- 172.21.15.142:0/3441451165 >> 172.21.15.142:0/3441451165 conn(0x7efd8c0680c0 msgr2=0x7efd8c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd93dff700 1 -- 172.21.15.142:0/3441451165 shutdown_connections 2023-09-30T23:04:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.450+0000 7efd93dff700 1 -- 172.21.15.142:0/3441451165 wait complete. 2023-09-30T23:04:02.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.452+0000 7efd93dff700 1 Processor -- start 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.453+0000 7efd93dff700 1 -- start start 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd93dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd780051c0 0x7efd8c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd93dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c156db0 0x7efd8c157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd93dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c169090 0x7efd8c169530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd93dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c169a70 con 0x7efd8c169090 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd93dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c157850 con 0x7efd780051c0 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd93dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c157b30 con 0x7efd8c156db0 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9239c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c169090 0x7efd8c169530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9239c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c169090 0x7efd8c169530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59442/0 (socket says 172.21.15.142:59442) 2023-09-30T23:04:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9239c700 1 -- 172.21.15.142:0/699813747 learned_addr learned my addr 172.21.15.142:0/699813747 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9139a700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c156db0 0x7efd8c157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd91b9b700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd780051c0 0x7efd8c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9239c700 1 -- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c156db0 msgr2=0x7efd8c157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9239c700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c156db0 0x7efd8c157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9239c700 1 -- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd780051c0 msgr2=0x7efd8c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.454+0000 7efd9239c700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd780051c0 0x7efd8c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd9239c700 1 -- 172.21.15.142:0/699813747 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c157e10 con 0x7efd8c169090 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd91b9b700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd780051c0 0x7efd8c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:02.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd9239c700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c169090 0x7efd8c169530 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7efd78004650 tx=0x7efd8401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:02.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd81ffb700 1 -- 172.21.15.142:0/699813747 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84014ea0 con 0x7efd8c169090 2023-09-30T23:04:02.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd81ffb700 1 -- 172.21.15.142:0/699813747 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd84008450 con 0x7efd8c169090 2023-09-30T23:04:02.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd81ffb700 1 -- 172.21.15.142:0/699813747 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84008830 con 0x7efd8c169090 2023-09-30T23:04:02.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c1580f0 con 0x7efd8c169090 2023-09-30T23:04:02.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.455+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c151ce0 con 0x7efd8c169090 2023-09-30T23:04:02.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.456+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c0695b0 con 0x7efd8c169090 2023-09-30T23:04:02.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.457+0000 7efd81ffb700 1 -- 172.21.15.142:0/699813747 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efd84008c20 con 0x7efd8c169090 2023-09-30T23:04:02.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.458+0000 7efd81ffb700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd70067330 0x7efd700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.458+0000 7efd81ffb700 1 -- 172.21.15.142:0/699813747 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5292+0+0 (secure 0 0 0) 0x7efd84017030 con 0x7efd8c169090 2023-09-30T23:04:02.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.458+0000 7efd91b9b700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd70067330 0x7efd700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.459+0000 7efd91b9b700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd70067330 0x7efd700697e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efd880093f0 tx=0x7efd88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:02.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.462+0000 7efd81ffb700 1 -- 172.21.15.142:0/699813747 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efd84054b10 con 0x7efd8c169090 2023-09-30T23:04:02.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.693+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd8c06fc10 con 0x7efd8c169090 2023-09-30T23:04:02.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.694+0000 7efd81ffb700 1 -- 172.21.15.142:0/699813747 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3541 (secure 0 0 0) 0x7efd84058130 con 0x7efd8c169090 2023-09-30T23:04:02.695 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:02.695 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6572,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2502980181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2502980181},{"type":"v1","addr":"172.21.15.142:6835","nonce":2502980181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1050885328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1050885328},{"type":"v1","addr":"172.21.15.148:6834","nonce":1050885328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3830382652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3830382652},{"type":"v1","addr":"172.21.15.148:6835","nonce":3830382652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8277,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3791216357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3791216357},{"type":"v1","addr":"172.21.15.142:6837","nonce":3791216357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[]} 2023-09-30T23:04:02.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd70067330 msgr2=0x7efd700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd70067330 0x7efd700697e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efd880093f0 tx=0x7efd88008040 comp rx=0 tx=0).stop 2023-09-30T23:04:02.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c169090 msgr2=0x7efd8c169530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c169090 0x7efd8c169530 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7efd78004650 tx=0x7efd8401b000 comp rx=0 tx=0).stop 2023-09-30T23:04:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 shutdown_connections 2023-09-30T23:04:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efd70067330 0x7efd700697e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c169090 0x7efd8c169530 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd780051c0 0x7efd8c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 --2- 172.21.15.142:0/699813747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efd8c156db0 0x7efd8c157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 >> 172.21.15.142:0/699813747 conn(0x7efd8c0680c0 msgr2=0x7efd8c0cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:02.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 shutdown_connections 2023-09-30T23:04:02.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.696+0000 7efd93dff700 1 -- 172.21.15.142:0/699813747 wait complete. 2023-09-30T23:04:02.699 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 85 2023-09-30T23:04:02.714 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T23:04:02.714 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T23:04:02.715 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T23:04:02.715 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:04:02.715 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T23:04:02.715 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T23:04:02.715 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T23:04:02.715 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:04:02.716 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T23:04:02.716 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T23:04:02.716 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T23:04:02.716 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:04:02.716 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T23:04:02.717 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T23:04:02.717 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T23:04:02.717 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:04:02.727 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T23:04:02.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T23:04:02.729 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T23:04:02.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T23:04:02.733 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T23:04:02.734 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T23:04:02.734 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T23:04:02.735 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T23:04:02.774 INFO:tasks.ceph.mds.a:Started 2023-09-30T23:04:02.774 DEBUG:teuthology.parallel:result is None 2023-09-30T23:04:02.777 INFO:tasks.ceph.mds.c:Started 2023-09-30T23:04:02.778 DEBUG:teuthology.parallel:result is None 2023-09-30T23:04:02.779 INFO:tasks.ceph.mds.d:Started 2023-09-30T23:04:02.779 DEBUG:teuthology.parallel:result is None 2023-09-30T23:04:02.782 INFO:tasks.ceph.mds.b:Started 2023-09-30T23:04:02.782 DEBUG:teuthology.parallel:result is None 2023-09-30T23:04:02.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T23:04:02.918 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2023-09-30T23:04:02.919 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2023-09-30T23:04:02.928 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T23:04:02.928 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-09-30T23:04:02.930 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-09-30T23:04:02.929+0000 7f72d0ffd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-09-30T23:04:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.983+0000 7f3ce75ff700 1 Processor -- start 2023-09-30T23:04:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.983+0000 7f3ce75ff700 1 -- start start 2023-09-30T23:04:02.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce75ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ce0143350 0x7f3ce00cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce75ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce00692f0 0x7f3ce015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce75ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce015e0b0 con 0x7f3ce015dc50 2023-09-30T23:04:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce75ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00cc6b0 con 0x7f3ce0143350 2023-09-30T23:04:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce75ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00cb7d0 con 0x7f3ce00692f0 2023-09-30T23:04:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce539b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ce0143350 0x7f3ce00cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce539b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ce0143350 0x7f3ce00cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59500/0 (socket says 172.21.15.142:59500) 2023-09-30T23:04:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce539b700 1 -- 172.21.15.142:0/72788840 learned_addr learned my addr 172.21.15.142:0/72788840 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce4b9a700 1 --2- 172.21.15.142:0/72788840 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce00692f0 0x7f3ce015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce539b700 1 -- 172.21.15.142:0/72788840 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce00692f0 msgr2=0x7f3ce015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce539b700 1 --2- 172.21.15.142:0/72788840 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce00692f0 0x7f3ce015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3cd7fff700 1 -- 172.21.15.142:0/72788840 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74954614 0 0) 0x7f3cd8001490 con 0x7f3ce015dc50 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce539b700 1 -- 172.21.15.142:0/72788840 >> v1:172.21.15.148:6789/0 conn(0x7f3ce015dc50 legacy=0x7f3ce0068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce539b700 1 -- 172.21.15.142:0/72788840 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00cbaa0 con 0x7f3ce0143350 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.985+0000 7f3ce4b9a700 1 --2- 172.21.15.142:0/72788840 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce00692f0 0x7f3ce015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:02.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3ce539b700 1 --2- 172.21.15.142:0/72788840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce00cb290 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0099b0 tx=0x7f3cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18575c26bd68f2e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:02.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3cd7fff700 1 -- 172.21.15.142:0/72788840 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc009ea0 con 0x7f3ce0143350 2023-09-30T23:04:02.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3cd7fff700 1 -- 172.21.15.142:0/72788840 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00b860 con 0x7f3ce0143350 2023-09-30T23:04:02.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3cd7fff700 1 -- 172.21.15.142:0/72788840 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00bc00 con 0x7f3ce0143350 2023-09-30T23:04:02.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3ce75ff700 1 -- 172.21.15.142:0/72788840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 msgr2=0x7f3ce00cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/72788840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce00cb290 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0099b0 tx=0x7f3cdc009250 comp rx=0 tx=0).stop 2023-09-30T23:04:02.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3ce75ff700 1 -- 172.21.15.142:0/72788840 shutdown_connections 2023-09-30T23:04:02.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/72788840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce00cb290 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/72788840 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce00692f0 0x7f3ce015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.986+0000 7f3ce75ff700 1 -- 172.21.15.142:0/72788840 >> 172.21.15.142:0/72788840 conn(0x7f3ce00ce8e0 msgr2=0x7f3ce00cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:02.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.987+0000 7f3ce75ff700 1 -- 172.21.15.142:0/72788840 shutdown_connections 2023-09-30T23:04:02.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.987+0000 7f3ce75ff700 1 -- 172.21.15.142:0/72788840 wait complete. 2023-09-30T23:04:02.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.988+0000 7f3ce75ff700 1 Processor -- start 2023-09-30T23:04:02.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.988+0000 7f3ce75ff700 1 -- start start 2023-09-30T23:04:02.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce75ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce00692f0 0x7f3ce00a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce75ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce75ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce015dc50 0x7f3ce00a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce75ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce015d0e0 con 0x7f3ce0143350 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce75ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00a5650 con 0x7f3ce00692f0 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce75ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00a5930 con 0x7f3ce015dc50 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce4b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce4b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce015c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59516/0 (socket says 172.21.15.142:59516) 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.989+0000 7f3ce4b9a700 1 -- 172.21.15.142:0/2313985654 learned_addr learned my addr 172.21.15.142:0/2313985654 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:02.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce4b9a700 1 -- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce015dc50 msgr2=0x7f3ce00a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce5b9c700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce015dc50 0x7f3ce00a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce539b700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce00692f0 0x7f3ce00a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce4b9a700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce015dc50 0x7f3ce00a7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce4b9a700 1 -- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce00692f0 msgr2=0x7f3ce00a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:02.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce4b9a700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce00692f0 0x7f3ce00a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:02.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce4b9a700 1 -- 172.21.15.142:0/2313985654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0009420 con 0x7f3ce0143350 2023-09-30T23:04:02.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce539b700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce00692f0 0x7f3ce00a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:02.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce5b9c700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce015dc50 0x7f3ce00a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:02.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce4b9a700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce015c890 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000ec80 tx=0x7f3cd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:02.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3cd57fa700 1 -- 172.21.15.142:0/2313985654 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000c9d0 con 0x7f3ce0143350 2023-09-30T23:04:02.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3cd57fa700 1 -- 172.21.15.142:0/2313985654 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd000cb30 con 0x7f3ce0143350 2023-09-30T23:04:02.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3cd57fa700 1 -- 172.21.15.142:0/2313985654 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000ceb0 con 0x7f3ce0143350 2023-09-30T23:04:02.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0094f0 con 0x7f3ce0143350 2023-09-30T23:04:02.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.990+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce00a5ef0 con 0x7f3ce0143350 2023-09-30T23:04:02.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.992+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce006ea70 con 0x7f3ce0143350 2023-09-30T23:04:02.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.992+0000 7f3cd57fa700 1 -- 172.21.15.142:0/2313985654 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3cd0013680 con 0x7f3ce0143350 2023-09-30T23:04:02.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.993+0000 7f3cd57fa700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3cc4067330 0x7f3cc40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:02.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.993+0000 7f3cd57fa700 1 -- 172.21.15.142:0/2313985654 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3cd0084d70 con 0x7f3ce0143350 2023-09-30T23:04:02.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.994+0000 7f3ce539b700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3cc4067330 0x7f3cc40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:02.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.994+0000 7f3ce539b700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3cc4067330 0x7f3cc40697e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0099b0 tx=0x7f3cdc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:03.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:02.997+0000 7f3cd57fa700 1 -- 172.21.15.142:0/2313985654 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3cd0051ed0 con 0x7f3ce0143350 2023-09-30T23:04:03.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:03.209+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3ce00cbd80 con 0x7f3ce0143350 2023-09-30T23:04:04.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.050+0000 7f3cd57fa700 1 -- 172.21.15.142:0/2313985654 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v188) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3cd0017080 con 0x7f3ce0143350 2023-09-30T23:04:04.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3cc4067330 msgr2=0x7f3cc40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3cc4067330 0x7f3cc40697e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0099b0 tx=0x7f3cdc017000 comp rx=0 tx=0).stop 2023-09-30T23:04:04.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 msgr2=0x7f3ce015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce015c890 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000ec80 tx=0x7f3cd00091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 shutdown_connections 2023-09-30T23:04:04.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f3cc4067330 0x7f3cc40697e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce015dc50 0x7f3ce00a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce00692f0 0x7f3ce00a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 --2- 172.21.15.142:0/2313985654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ce0143350 0x7f3ce015c890 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.053+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 >> 172.21.15.142:0/2313985654 conn(0x7f3ce00ce8e0 msgr2=0x7f3ce00c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:04.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.054+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 shutdown_connections 2023-09-30T23:04:04.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.054+0000 7f3ce75ff700 1 -- 172.21.15.142:0/2313985654 wait complete. 2023-09-30T23:04:04.057 INFO:teuthology.orchestra.run.smithi142.stderr: removed all blocklist entries 2023-09-30T23:04:04.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T23:04:04.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.266+0000 7f845c1ff700 1 Processor -- start 2023-09-30T23:04:04.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.266+0000 7f845c1ff700 1 -- start start 2023-09-30T23:04:04.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f845c1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f84540aebf0 0x7f845406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f845c1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540b0ee0 con 0x7f845415a2a0 2023-09-30T23:04:04.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f845c1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540b02d0 con 0x7f845406f190 2023-09-30T23:04:04.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f845c1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540aefc0 con 0x7f84540aebf0 2023-09-30T23:04:04.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f845a79c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f845415a2a0 0x7f8454069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39254/0 (socket says 172.21.15.142:39254) 2023-09-30T23:04:04.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f845a79c700 1 -- 172.21.15.142:0/1822456365 learned_addr learned my addr 172.21.15.142:0/1822456365 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:04.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f8459f9b700 1 --2- 172.21.15.142:0/1822456365 >> v2:172.21.15.148:3300/0 conn(0x7f84540aebf0 0x7f845406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746218171 0 0) 0x7f84540b0ee0 con 0x7f845415a2a0 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.268+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8440003570 con 0x7f845415a2a0 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3249381232 0 0) 0x7f8440003570 con 0x7f845415a2a0 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 >> v2:172.21.15.148:3300/0 conn(0x7f84540aebf0 msgr2=0x7f845406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 --2- 172.21.15.142:0/1822456365 >> v2:172.21.15.148:3300/0 conn(0x7f84540aebf0 0x7f845406ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 >> v1:172.21.15.148:6789/0 conn(0x7f845406f190 legacy=0x7f8454159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540b05b0 con 0x7f845415a2a0 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f844c0017f0 con 0x7f845415a2a0 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 >> v1:172.21.15.142:6789/0 conn(0x7f845415a2a0 legacy=0x7f8454069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8440003a60 0x7f8440003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8440004810 0x7f8440004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84400051c0 0x7f844000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540aefc0 con 0x7f84400051c0 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844000c050 con 0x7f8440003a60 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844000c210 con 0x7f8440004810 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f845a79c700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84400051c0 0x7f844000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f8459f9b700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8440003a60 0x7f8440003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.269+0000 7f845979a700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8440004810 0x7f8440004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f845a79c700 1 -- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8440004810 msgr2=0x7f8440004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f845a79c700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8440004810 0x7f8440004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f845a79c700 1 -- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8440003a60 msgr2=0x7f8440003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:04.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f845a79c700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8440003a60 0x7f8440003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f845a79c700 1 -- 172.21.15.142:0/1822456365 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440003570 con 0x7f84400051c0 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f845a79c700 1 -- 172.21.15.142:0/1822456365 reap_dead start 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f845a79c700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84400051c0 0x7f844000ba60 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f844c00a370 tx=0x7f84540b0e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1124195c6da1e4e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0104a0 con 0x7f84400051c0 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c010600 con 0x7f84400051c0 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.270+0000 7f8458f99700 1 -- 172.21.15.142:0/1822456365 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0109a0 con 0x7f84400051c0 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.271+0000 7f845c1ff700 1 -- 172.21.15.142:0/1822456365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84400051c0 msgr2=0x7f844000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.271+0000 7f845c1ff700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84400051c0 0x7f844000ba60 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f844c00a370 tx=0x7f84540b0e50 comp rx=0 tx=0).stop 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.271+0000 7f845c1ff700 1 -- 172.21.15.142:0/1822456365 shutdown_connections 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.271+0000 7f845c1ff700 1 --2- 172.21.15.142:0/1822456365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84400051c0 0x7f844000ba60 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.271+0000 7f845c1ff700 1 -- 172.21.15.142:0/1822456365 >> 172.21.15.142:0/1822456365 conn(0x7f84540680c0 msgr2=0x7f84540c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:04.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.271+0000 7f845c1ff700 1 -- 172.21.15.142:0/1822456365 shutdown_connections 2023-09-30T23:04:04.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.271+0000 7f845c1ff700 1 -- 172.21.15.142:0/1822456365 wait complete. 2023-09-30T23:04:04.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.272+0000 7f845c1ff700 1 Processor -- start 2023-09-30T23:04:04.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.272+0000 7f845c1ff700 1 -- start start 2023-09-30T23:04:04.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.273+0000 7f845c1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84400051c0 0x7f845414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.273+0000 7f845c1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845414e9e0 0x7f8454158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.273+0000 7f845c1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845414ef20 0x7f8454158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.273+0000 7f845c1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8454157c40 con 0x7f845414e9e0 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.273+0000 7f845c1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541511d0 con 0x7f84400051c0 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.273+0000 7f845c1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845414e7c0 con 0x7f845414ef20 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845414e9e0 0x7f8454158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845414e9e0 0x7f8454158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59540/0 (socket says 172.21.15.142:59540) 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 -- 172.21.15.142:0/609326079 learned_addr learned my addr 172.21.15.142:0/609326079 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f8459f9b700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84400051c0 0x7f845414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845a79c700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845414ef20 0x7f8454158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 -- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845414ef20 msgr2=0x7f8454158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845414ef20 0x7f8454158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 -- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84400051c0 msgr2=0x7f845414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84400051c0 0x7f845414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 -- 172.21.15.142:0/609326079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84541573a0 con 0x7f845414e9e0 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f845979a700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845414e9e0 0x7f8454158790 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f844400f8d0 tx=0x7f8444007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f8449ffb700 1 -- 172.21.15.142:0/609326079 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440024b0 con 0x7f845414e9e0 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.274+0000 7f8449ffb700 1 -- 172.21.15.142:0/609326079 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444013600 con 0x7f845414e9e0 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.275+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8454157680 con 0x7f845414e9e0 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.275+0000 7f8449ffb700 1 -- 172.21.15.142:0/609326079 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440139c0 con 0x7f845414e9e0 2023-09-30T23:04:04.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.275+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8454157000 con 0x7f845414e9e0 2023-09-30T23:04:04.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.276+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540695b0 con 0x7f845414e9e0 2023-09-30T23:04:04.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.276+0000 7f8449ffb700 1 -- 172.21.15.142:0/609326079 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f844401c400 con 0x7f845414e9e0 2023-09-30T23:04:04.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.277+0000 7f8449ffb700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8438067330 0x7f84380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.277+0000 7f8449ffb700 1 -- 172.21.15.142:0/609326079 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8444084b40 con 0x7f845414e9e0 2023-09-30T23:04:04.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.277+0000 7f8459f9b700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8438067330 0x7f84380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.278+0000 7f8459f9b700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8438067330 0x7f84380697e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f84540c9070 tx=0x7f84500091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:04.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.282+0000 7f8449ffb700 1 -- 172.21.15.142:0/609326079 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8444051cf0 con 0x7f845414e9e0 2023-09-30T23:04:04.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.547+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8454151310 con 0x7f845414e9e0 2023-09-30T23:04:04.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.548+0000 7f8449ffb700 1 -- 172.21.15.142:0/609326079 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8444017020 con 0x7f845414e9e0 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_dump": [ 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.a", 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhleX/3ChAAdiQ/MpxR944q31sOU2GHKw==", 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:04:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.b", 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhlEGKmIRAAT8fRsQdBhBOabqGWcn1zSg==", 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.c", 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl2zE5FhAASLCyKom/Z8Nh6YP3jxe4Tg==", 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:04:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mds.d", 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl4kYPLRAATltLGvkEvuCueJ+TEmWzOg==", 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.0", 2023-09-30T23:04:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhlk67NLBAApKZXQi8jik7hcgj7P0jbsg==", 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.1", 2023-09-30T23:04:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCFphhl8OrDNxAAvjkCp+rXKTtccQpk2kwA/Q==", 2023-09-30T23:04:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.2", 2023-09-30T23:04:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlq+r7BhAAwYBRKKAgiRBcP9pBRS2nDw==", 2023-09-30T23:04:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.3", 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCGphhlb5LhERAAkoO8bDmaGCfXb9bUMmJ/8w==", 2023-09-30T23:04:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.4", 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhl1mYpMBAAJd9oIA4Pl28xGcGroYmoLg==", 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.5", 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCJphhlV91AOxAA3dIT2bDfF7WCz3JrYyBYag==", 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.6", 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhl4JaKChAA/PHs0oaMqf9/jWxwZybJIg==", 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "osd.7", 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCKphhloJSOFRAAKeSK6DGg3y1Ho36K/slpBw==", 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow profile osd", 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile osd", 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.0", 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhllF78NhAAaQ4ta3rgjE7sCGa3UICSaw==", 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow r", 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.1", 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlE5bOCRAAACeyMoaRDDgpQVoDsjANYw==", 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.2", 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhlUGOHAhAALbdqxZxHLSsXCRkJ0caSbw==", 2023-09-30T23:04:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.3", 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCCphhl+vv6EBAAy9vB1dpLsypyyLmr9MFXHQ==", 2023-09-30T23:04:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow", 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow r", 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow rw", 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow rwx" 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "client.admin", 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhl59tjEBAAVCj0uaqdXPkxKVJmWrRM1w==", 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T23:04:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": "allow *", 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow *", 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.x", 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCBphhl9fHBAxAAQ0I6skzE+eWFtQMi+hndvA==", 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "entity": "mgr.y", 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "AQCAphhlMT7HNxAAbXPzZ18qCS/kC3EAXGpo6A==", 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": { 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": "allow *", 2023-09-30T23:04:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": "allow profile mgr", 2023-09-30T23:04:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": "allow *" 2023-09-30T23:04:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:04.568 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:04.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8438067330 msgr2=0x7f84380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8438067330 0x7f84380697e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f84540c9070 tx=0x7f84500091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845414e9e0 msgr2=0x7f8454158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845414e9e0 0x7f8454158790 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f844400f8d0 tx=0x7f8444007d30 comp rx=0 tx=0).stop 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 shutdown_connections 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8438067330 0x7f84380697e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f845414ef20 0x7f8454158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84400051c0 0x7f845414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 --2- 172.21.15.142:0/609326079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845414e9e0 0x7f8454158790 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 >> 172.21.15.142:0/609326079 conn(0x7f84540680c0 msgr2=0x7f8454154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.550+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 shutdown_connections 2023-09-30T23:04:04.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.551+0000 7f845c1ff700 1 -- 172.21.15.142:0/609326079 wait complete. 2023-09-30T23:04:04.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:04.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.761+0000 7fe546dff700 1 Processor -- start 2023-09-30T23:04:04.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.761+0000 7fe546dff700 1 -- start start 2023-09-30T23:04:04.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.762+0000 7fe546dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 0x7fe54015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.762+0000 7fe546dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe54015dc50 0x7fe54006a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.762+0000 7fe546dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54015e0b0 con 0x7fe540143350 2023-09-30T23:04:04.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.762+0000 7fe546dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400cc6b0 con 0x7fe54015dc50 2023-09-30T23:04:04.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.762+0000 7fe546dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400cbaa0 con 0x7fe5400692f0 2023-09-30T23:04:04.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe544b9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe540143350 0x7fe5400cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39264/0 (socket says 172.21.15.142:39264) 2023-09-30T23:04:04.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe544b9b700 1 -- 172.21.15.142:0/426231463 learned_addr learned my addr 172.21.15.142:0/426231463 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:04.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53ffff700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 0x7fe54015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe54539c700 1 --2- 172.21.15.142:0/426231463 >> v2:172.21.15.148:3300/0 conn(0x7fe54015dc50 0x7fe54006a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455100998 0 0) 0x7fe534001110 con 0x7fe540143350 2023-09-30T23:04:04.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe530003570 con 0x7fe540143350 2023-09-30T23:04:04.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258020230 0 0) 0x7fe530003570 con 0x7fe540143350 2023-09-30T23:04:04.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 msgr2=0x7fe54015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 0x7fe54015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 >> v2:172.21.15.148:3300/0 conn(0x7fe54015dc50 msgr2=0x7fe54006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 --2- 172.21.15.142:0/426231463 >> v2:172.21.15.148:3300/0 conn(0x7fe54015dc50 0x7fe54006a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400cbd80 con 0x7fe540143350 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.763+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fe534001600 con 0x7fe540143350 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 >> v1:172.21.15.142:6789/0 conn(0x7fe540143350 legacy=0x7fe5400cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53f7fe700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 0x7fe530003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53f7fe700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe530004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53f7fe700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530004d50 0x7fe5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400cc6b0 con 0x7fe530003fe0 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400cbaa0 con 0x7fe530004d50 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53000ba90 con 0x7fe5400692f0 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53ffff700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe530004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe544b9b700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 0x7fe530003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe54539c700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530004d50 0x7fe5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53ffff700 1 -- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 msgr2=0x7fe530003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53ffff700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5400692f0 0x7fe530003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53ffff700 1 -- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530004d50 msgr2=0x7fe5300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53ffff700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe530004d50 0x7fe5300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.764+0000 7fe53ffff700 1 -- 172.21.15.142:0/426231463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530003570 con 0x7fe530003fe0 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe53ffff700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe530004810 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009c00 tx=0x7fe52c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbfe44c6b4de307 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:04.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00e6b0 con 0x7fe530003fe0 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00e810 con 0x7fe530003fe0 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe53f7fe700 1 -- 172.21.15.142:0/426231463 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00ebd0 con 0x7fe530003fe0 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe546dff700 1 -- 172.21.15.142:0/426231463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 msgr2=0x7fe530004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe546dff700 1 --2- 172.21.15.142:0/426231463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe530004810 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009c00 tx=0x7fe52c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe54539c700 1 -- 172.21.15.142:0/426231463 reap_dead start 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe546dff700 1 -- 172.21.15.142:0/426231463 shutdown_connections 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe546dff700 1 -- 172.21.15.142:0/426231463 >> 172.21.15.142:0/426231463 conn(0x7fe5400ce8e0 msgr2=0x7fe5400cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe546dff700 1 -- 172.21.15.142:0/426231463 shutdown_connections 2023-09-30T23:04:04.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.765+0000 7fe546dff700 1 -- 172.21.15.142:0/426231463 wait complete. 2023-09-30T23:04:04.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.767+0000 7fe546dff700 1 Processor -- start 2023-09-30T23:04:04.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.767+0000 7fe546dff700 1 -- start start 2023-09-30T23:04:04.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe546dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe5400b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe546dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5400a5f70 0x7fe5400a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe546dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe54016b700 0x7fe54016bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe546dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400b1460 con 0x7fe530003fe0 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe546dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015b0b0 con 0x7fe5400a5f70 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe546dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015a1c0 con 0x7fe54016b700 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe544b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe5400b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe544b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe5400b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59562/0 (socket says 172.21.15.142:59562) 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe544b9b700 1 -- 172.21.15.142:0/2521511022 learned_addr learned my addr 172.21.15.142:0/2521511022 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe53ffff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5400a5f70 0x7fe5400a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.768+0000 7fe54539c700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe54016b700 0x7fe54016bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53ffff700 1 -- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe54016b700 msgr2=0x7fe54016bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53ffff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe54016b700 0x7fe54016bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53ffff700 1 -- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 msgr2=0x7fe5400b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53ffff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe5400b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53ffff700 1 -- 172.21.15.142:0/2521511022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54015a4a0 con 0x7fe5400a5f70 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe544b9b700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe5400b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53ffff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5400a5f70 0x7fe5400a63e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006f00 tx=0x7fe52c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53cff9700 1 -- 172.21.15.142:0/2521511022 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c022070 con 0x7fe5400a5f70 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53cff9700 1 -- 172.21.15.142:0/2521511022 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00e980 con 0x7fe5400a5f70 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe53cff9700 1 -- 172.21.15.142:0/2521511022 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00e6b0 con 0x7fe5400a5f70 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54015a780 con 0x7fe5400a5f70 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.769+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54015ad40 con 0x7fe5400a5f70 2023-09-30T23:04:04.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.770+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54015b220 con 0x7fe5400a5f70 2023-09-30T23:04:04.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.771+0000 7fe53cff9700 1 -- 172.21.15.142:0/2521511022 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe52c027680 con 0x7fe5400a5f70 2023-09-30T23:04:04.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.772+0000 7fe53cff9700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe524067330 0x7fe5240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:04.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.772+0000 7fe53cff9700 1 -- 172.21.15.142:0/2521511022 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe52c04ae40 con 0x7fe5400a5f70 2023-09-30T23:04:04.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.773+0000 7fe544b9b700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe524067330 0x7fe5240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:04.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.773+0000 7fe544b9b700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe524067330 0x7fe5240697e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe534001390 tx=0x7fe534007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:04.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.776+0000 7fe53cff9700 1 -- 172.21.15.142:0/2521511022 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe52c053820 con 0x7fe5400a5f70 2023-09-30T23:04:04.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.966+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5400cc060 con 0x7fe5400a5f70 2023-09-30T23:04:04.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.967+0000 7fe53cff9700 1 -- 172.21.15.142:0/2521511022 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+13806 (secure 0 0 0) 0x7fe52c02c090 con 0x7fe5400a5f70 2023-09-30T23:04:04.968 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:04.968 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":188,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:04.047838+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:04.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe524067330 msgr2=0x7fe5240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe524067330 0x7fe5240697e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe534001390 tx=0x7fe534007a80 comp rx=0 tx=0).stop 2023-09-30T23:04:04.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5400a5f70 msgr2=0x7fe5400a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:04.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5400a5f70 0x7fe5400a63e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006f00 tx=0x7fe52c01a000 comp rx=0 tx=0).stop 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 shutdown_connections 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe524067330 0x7fe5240697e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe54016b700 0x7fe54016bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe530003fe0 0x7fe5400b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 --2- 172.21.15.142:0/2521511022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5400a5f70 0x7fe5400a63e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 >> 172.21.15.142:0/2521511022 conn(0x7fe5400ce8e0 msgr2=0x7fe5400c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 shutdown_connections 2023-09-30T23:04:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:04.969+0000 7fe546dff700 1 -- 172.21.15.142:0/2521511022 wait complete. 2023-09-30T23:04:04.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T23:04:04.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T23:04:05.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.179+0000 7fe99b3ff700 1 Processor -- start 2023-09-30T23:04:05.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.179+0000 7fe99b3ff700 1 -- start start 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.180+0000 7fe99b3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9940ca5e0 0x7fe99406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99b3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe994067d10 con 0x7fe9940b0de0 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99b3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99406af90 con 0x7fe994159ba0 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99b3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9940676c0 con 0x7fe9940ca5e0 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99899a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9940ca5e0 0x7fe99406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99999c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe9940b0de0 0x7fe9940681a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39274/0 (socket says 172.21.15.142:39274) 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99999c700 1 -- 172.21.15.142:0/315626087 learned_addr learned my addr 172.21.15.142:0/315626087 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99899a700 1 -- 172.21.15.142:0/315626087 >> v1:172.21.15.148:6789/0 conn(0x7fe994159ba0 legacy=0x7fe9940c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99899a700 1 -- 172.21.15.142:0/315626087 >> v1:172.21.15.142:6789/0 conn(0x7fe9940b0de0 legacy=0x7fe9940681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe99899a700 1 -- 172.21.15.142:0/315626087 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940679a0 con 0x7fe9940ca5e0 2023-09-30T23:04:05.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.181+0000 7fe98bfff700 1 -- 172.21.15.142:0/315626087 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511113717 0 0) 0x7fe994067d10 con 0x7fe9940b0de0 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe99899a700 1 --2- 172.21.15.142:0/315626087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940ca5e0 0x7fe99406a8d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098e0 tx=0x7fe9840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563e71b5e23e5fac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe98bfff700 1 -- 172.21.15.142:0/315626087 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984009e80 con 0x7fe9940ca5e0 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe98bfff700 1 -- 172.21.15.142:0/315626087 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98400b820 con 0x7fe9940ca5e0 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe98bfff700 1 -- 172.21.15.142:0/315626087 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98400bba0 con 0x7fe9940ca5e0 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe99b3ff700 1 -- 172.21.15.142:0/315626087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940ca5e0 msgr2=0x7fe99406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/315626087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940ca5e0 0x7fe99406a8d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098e0 tx=0x7fe9840091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe99b3ff700 1 -- 172.21.15.142:0/315626087 shutdown_connections 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/315626087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940ca5e0 0x7fe99406a8d0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe99b3ff700 1 -- 172.21.15.142:0/315626087 >> 172.21.15.142:0/315626087 conn(0x7fe9940cb2f0 msgr2=0x7fe9940cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.182+0000 7fe99b3ff700 1 -- 172.21.15.142:0/315626087 shutdown_connections 2023-09-30T23:04:05.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.183+0000 7fe99b3ff700 1 -- 172.21.15.142:0/315626087 wait complete. 2023-09-30T23:04:05.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.184+0000 7fe99b3ff700 1 Processor -- start 2023-09-30T23:04:05.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.184+0000 7fe99b3ff700 1 -- start start 2023-09-30T23:04:05.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99b3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940b0de0 0x7fe9940c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99b3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9940ca5e0 0x7fe9941574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99b3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe994159ba0 0x7fe9940c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99b3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940c4ea0 con 0x7fe9940b0de0 2023-09-30T23:04:05.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99b3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99416a320 con 0x7fe994159ba0 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99b3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940c2280 con 0x7fe9940ca5e0 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99919b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940b0de0 0x7fe9940c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99919b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940b0de0 0x7fe9940c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59586/0 (socket says 172.21.15.142:59586) 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99919b700 1 -- 172.21.15.142:0/4019134479 learned_addr learned my addr 172.21.15.142:0/4019134479 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99899a700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9940ca5e0 0x7fe9941574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.185+0000 7fe99999c700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe994159ba0 0x7fe9940c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99919b700 1 -- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9940ca5e0 msgr2=0x7fe9941574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99919b700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9940ca5e0 0x7fe9941574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99919b700 1 -- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe994159ba0 msgr2=0x7fe9940c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99919b700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe994159ba0 0x7fe9940c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99919b700 1 -- 172.21.15.142:0/4019134479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984009420 con 0x7fe9940b0de0 2023-09-30T23:04:05.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99919b700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940b0de0 0x7fe9940c9e80 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe99000c4e0 tx=0x7fe99000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe9897fa700 1 -- 172.21.15.142:0/4019134479 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990011590 con 0x7fe9940b0de0 2023-09-30T23:04:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe9897fa700 1 -- 172.21.15.142:0/4019134479 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990011710 con 0x7fe9940b0de0 2023-09-30T23:04:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9940c5320 con 0x7fe9940b0de0 2023-09-30T23:04:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe9897fa700 1 -- 172.21.15.142:0/4019134479 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990011ad0 con 0x7fe9940b0de0 2023-09-30T23:04:05.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.186+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9940c24d0 con 0x7fe9940b0de0 2023-09-30T23:04:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.187+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99406e4b0 con 0x7fe9940b0de0 2023-09-30T23:04:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.188+0000 7fe9897fa700 1 -- 172.21.15.142:0/4019134479 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe990002020 con 0x7fe9940b0de0 2023-09-30T23:04:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.189+0000 7fe9897fa700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe978067330 0x7fe9780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.189+0000 7fe9897fa700 1 -- 172.21.15.142:0/4019134479 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe990083f80 con 0x7fe9940b0de0 2023-09-30T23:04:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.189+0000 7fe99899a700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe978067330 0x7fe9780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.190+0000 7fe99899a700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe978067330 0x7fe9780697e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe9940ca9e0 tx=0x7fe984016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:05.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.193+0000 7fe9897fa700 1 -- 172.21.15.142:0/4019134479 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe990051130 con 0x7fe9940b0de0 2023-09-30T23:04:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.383+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9940cac40 con 0x7fe9940b0de0 2023-09-30T23:04:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.383+0000 7fe9897fa700 1 -- 172.21.15.142:0/4019134479 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v188) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe990054750 con 0x7fe9940b0de0 2023-09-30T23:04:05.384 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T23:04:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe978067330 msgr2=0x7fe9780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe978067330 0x7fe9780697e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe9940ca9e0 tx=0x7fe984016000 comp rx=0 tx=0).stop 2023-09-30T23:04:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940b0de0 msgr2=0x7fe9940c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940b0de0 0x7fe9940c9e80 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe99000c4e0 tx=0x7fe99000c8a0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 shutdown_connections 2023-09-30T23:04:05.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe978067330 0x7fe9780697e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe994159ba0 0x7fe9940c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9940b0de0 0x7fe9940c9e80 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 --2- 172.21.15.142:0/4019134479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9940ca5e0 0x7fe9941574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 >> 172.21.15.142:0/4019134479 conn(0x7fe9940cb2f0 msgr2=0x7fe9940cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.385+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 shutdown_connections 2023-09-30T23:04:05.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.386+0000 7fe99b3ff700 1 -- 172.21.15.142:0/4019134479 wait complete. 2023-09-30T23:04:05.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T23:04:05.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.594+0000 7fada57ff700 1 Processor -- start 2023-09-30T23:04:05.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.594+0000 7fada57ff700 1 -- start start 2023-09-30T23:04:05.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.595+0000 7fada57ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fada00c52a0 0x7fada00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.595+0000 7fada57ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada01605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.595+0000 7fada57ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada00c7690 con 0x7fada0069f10 2023-09-30T23:04:05.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.595+0000 7fada57ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada01406a0 con 0x7fada00c52a0 2023-09-30T23:04:05.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.595+0000 7fada57ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada00c3a50 con 0x7fada00cb350 2023-09-30T23:04:05.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.595+0000 7fad9e7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fada0069f10 0x7fada00c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39288/0 (socket says 172.21.15.142:39288) 2023-09-30T23:04:05.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.595+0000 7fad9e7fc700 1 -- 172.21.15.142:0/4194013617 learned_addr learned my addr 172.21.15.142:0/4194013617 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:05.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9effd700 1 --2- 172.21.15.142:0/4194013617 >> v2:172.21.15.148:3300/0 conn(0x7fada00c52a0 0x7fada00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9f7fe700 1 --2- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada01605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9dffb700 1 -- 172.21.15.142:0/4194013617 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826186436 0 0) 0x7fad94001110 con 0x7fada0069f10 2023-09-30T23:04:05.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9dffb700 1 -- 172.21.15.142:0/4194013617 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad88003570 con 0x7fada0069f10 2023-09-30T23:04:05.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9effd700 1 -- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 msgr2=0x7fada01605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9effd700 1 --2- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada01605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9effd700 1 -- 172.21.15.142:0/4194013617 >> v1:172.21.15.142:6789/0 conn(0x7fada0069f10 legacy=0x7fada00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9effd700 1 -- 172.21.15.142:0/4194013617 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00c7f20 con 0x7fada00c52a0 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.596+0000 7fad9effd700 1 --2- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada00c52a0 0x7fada00c88d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fad90009910 tx=0x7fad900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac7d06c2569c39d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fad9dffb700 1 -- 172.21.15.142:0/4194013617 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90011630 con 0x7fada00c52a0 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fad9dffb700 1 -- 172.21.15.142:0/4194013617 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad90011790 con 0x7fada00c52a0 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fad9dffb700 1 -- 172.21.15.142:0/4194013617 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90011b30 con 0x7fada00c52a0 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 -- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada00c52a0 msgr2=0x7fada00c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 --2- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada00c52a0 0x7fada00c88d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fad90009910 tx=0x7fad900091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 -- 172.21.15.142:0/4194013617 shutdown_connections 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 --2- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada00c52a0 0x7fada00c88d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 --2- 172.21.15.142:0/4194013617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada01605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 -- 172.21.15.142:0/4194013617 >> 172.21.15.142:0/4194013617 conn(0x7fada00cc670 msgr2=0x7fada00cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:05.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 -- 172.21.15.142:0/4194013617 shutdown_connections 2023-09-30T23:04:05.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.597+0000 7fada57ff700 1 -- 172.21.15.142:0/4194013617 wait complete. 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.599+0000 7fada57ff700 1 Processor -- start 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.599+0000 7fada57ff700 1 -- start start 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fada57ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada0069f10 0x7fada013abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fada57ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fada00c52a0 0x7fada013cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fada57ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada00c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fada57ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada013da90 con 0x7fada00c52a0 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fada57ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada013df50 con 0x7fada0069f10 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fada57ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada016a610 con 0x7fada00cb350 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fad9e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fada00c52a0 0x7fada013cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fad9e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fada00c52a0 0x7fada013cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59588/0 (socket says 172.21.15.142:59588) 2023-09-30T23:04:05.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fad9e7fc700 1 -- 172.21.15.142:0/2210967254 learned_addr learned my addr 172.21.15.142:0/2210967254 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fad9f7fe700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada00c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.600+0000 7fad9effd700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada0069f10 0x7fada013abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad9e7fc700 1 -- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 msgr2=0x7fada00c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad9e7fc700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada00c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad9e7fc700 1 -- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada0069f10 msgr2=0x7fada013abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad9e7fc700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada0069f10 0x7fada013abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad9e7fc700 1 -- 172.21.15.142:0/2210967254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009420 con 0x7fada00c52a0 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad9e7fc700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fada00c52a0 0x7fada013cb60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c7c0 tx=0x7fad94007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad86ffd700 1 -- 172.21.15.142:0/2210967254 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94005b30 con 0x7fada00c52a0 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad86ffd700 1 -- 172.21.15.142:0/2210967254 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad94005c90 con 0x7fada00c52a0 2023-09-30T23:04:05.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada016a310 con 0x7fada00c52a0 2023-09-30T23:04:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fad86ffd700 1 -- 172.21.15.142:0/2210967254 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94007300 con 0x7fada00c52a0 2023-09-30T23:04:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.601+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada013d4d0 con 0x7fada00c52a0 2023-09-30T23:04:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.602+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0069a50 con 0x7fada00c52a0 2023-09-30T23:04:05.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.603+0000 7fad86ffd700 1 -- 172.21.15.142:0/2210967254 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad9401b3b0 con 0x7fada00c52a0 2023-09-30T23:04:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.604+0000 7fad86ffd700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad8c067330 0x7fad8c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.604+0000 7fad86ffd700 1 -- 172.21.15.142:0/2210967254 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fad94083ba0 con 0x7fada00c52a0 2023-09-30T23:04:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.604+0000 7fad9effd700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad8c067330 0x7fad8c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.605+0000 7fad9effd700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad8c067330 0x7fad8c0697e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fad900091e0 tx=0x7fad90017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:05.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.608+0000 7fad86ffd700 1 -- 172.21.15.142:0/2210967254 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad94050d90 con 0x7fada00c52a0 2023-09-30T23:04:05.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.795+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fada00c7690 con 0x7fada00c52a0 2023-09-30T23:04:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.795+0000 7fad86ffd700 1 -- 172.21.15.142:0/2210967254 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v188) v1 ==== 92+0+10 (secure 0 0 0) 0x7fada00c7690 con 0x7fada00c52a0 2023-09-30T23:04:05.796 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad8c067330 msgr2=0x7fad8c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad8c067330 0x7fad8c0697e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fad900091e0 tx=0x7fad90017000 comp rx=0 tx=0).stop 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fada00c52a0 msgr2=0x7fada013cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fada00c52a0 0x7fada013cb60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c7c0 tx=0x7fad94007c50 comp rx=0 tx=0).stop 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 shutdown_connections 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fad8c067330 0x7fad8c0697e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fada00cb350 0x7fada00c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fada0069f10 0x7fada013abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 --2- 172.21.15.142:0/2210967254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fada00c52a0 0x7fada013cb60 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:05.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 >> 172.21.15.142:0/2210967254 conn(0x7fada00cc670 msgr2=0x7fada00ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:05.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 shutdown_connections 2023-09-30T23:04:05.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:05.798+0000 7fada57ff700 1 -- 172.21.15.142:0/2210967254 wait complete. 2023-09-30T23:04:05.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T23:04:06.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.004+0000 7f61031ff700 1 Processor -- start 2023-09-30T23:04:06.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.004+0000 7f61031ff700 1 -- start start 2023-09-30T23:04:06.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.005+0000 7f61031ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60fc0af020 0x7f60fc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.005+0000 7f61031ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc06d3e0 con 0x7f60fc06e820 2023-09-30T23:04:06.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.005+0000 7f61031ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc06dc80 con 0x7f60fc0b00d0 2023-09-30T23:04:06.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.005+0000 7f61031ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc06eca0 con 0x7f60fc0af020 2023-09-30T23:04:06.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f6100f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60fc0af020 0x7f60fc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f6100f9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60fc0af020 0x7f60fc156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59604/0 (socket says 172.21.15.142:59604) 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f610179c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f60fc06e820 0x7f60fc15a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39302/0 (socket says 172.21.15.142:39302) 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f6100f9b700 1 -- 172.21.15.142:0/4000179363 learned_addr learned my addr 172.21.15.142:0/4000179363 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f6100f9b700 1 -- 172.21.15.142:0/4000179363 >> v1:172.21.15.148:6789/0 conn(0x7f60fc0b00d0 legacy=0x7f60fc06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f6100f9b700 1 -- 172.21.15.142:0/4000179363 >> v1:172.21.15.142:6789/0 conn(0x7f60fc06e820 legacy=0x7f60fc15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f6100f9b700 1 -- 172.21.15.142:0/4000179363 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc06b790 con 0x7f60fc0af020 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f60fb7fe700 1 -- 172.21.15.142:0/4000179363 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926534879 0 0) 0x7f60fc06d3e0 con 0x7f60fc06e820 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.006+0000 7f6100f9b700 1 --2- 172.21.15.142:0/4000179363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0af020 0x7f60fc156d80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f60f000bc80 tx=0x7f60f000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cf1bf5473306f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f60fb7fe700 1 -- 172.21.15.142:0/4000179363 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000be90 con 0x7f60fc0af020 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f60fb7fe700 1 -- 172.21.15.142:0/4000179363 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000ddc0 con 0x7f60fc0af020 2023-09-30T23:04:06.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f60fb7fe700 1 -- 172.21.15.142:0/4000179363 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00196b0 con 0x7f60fc0af020 2023-09-30T23:04:06.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f61031ff700 1 -- 172.21.15.142:0/4000179363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0af020 msgr2=0x7f60fc156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f61031ff700 1 --2- 172.21.15.142:0/4000179363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0af020 0x7f60fc156d80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f60f000bc80 tx=0x7f60f000b4f0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f61031ff700 1 -- 172.21.15.142:0/4000179363 shutdown_connections 2023-09-30T23:04:06.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f61031ff700 1 --2- 172.21.15.142:0/4000179363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0af020 0x7f60fc156d80 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f61031ff700 1 -- 172.21.15.142:0/4000179363 >> 172.21.15.142:0/4000179363 conn(0x7f60fc0680c0 msgr2=0x7f60fc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:06.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f61031ff700 1 -- 172.21.15.142:0/4000179363 shutdown_connections 2023-09-30T23:04:06.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.007+0000 7f61031ff700 1 -- 172.21.15.142:0/4000179363 wait complete. 2023-09-30T23:04:06.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.009+0000 7f61031ff700 1 Processor -- start 2023-09-30T23:04:06.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.010+0000 7f61031ff700 1 -- start start 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f61031ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60fc06e820 0x7f60fc13bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f61031ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60fc0af020 0x7f60fc152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f61031ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0b00d0 0x7f60fc159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f61031ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc1686e0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f61031ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc167ad0 con 0x7f60fc0af020 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f61031ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc167db0 con 0x7f60fc06e820 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f610179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0b00d0 0x7f60fc159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f610179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0b00d0 0x7f60fc159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59618/0 (socket says 172.21.15.142:59618) 2023-09-30T23:04:06.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f610179c700 1 -- 172.21.15.142:0/2947840498 learned_addr learned my addr 172.21.15.142:0/2947840498 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f6100f9b700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60fc06e820 0x7f60fc13bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.011+0000 7f60fbfff700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60fc0af020 0x7f60fc152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f610179c700 1 -- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60fc06e820 msgr2=0x7f60fc13bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f610179c700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60fc06e820 0x7f60fc13bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f610179c700 1 -- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60fc0af020 msgr2=0x7f60fc152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f610179c700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60fc0af020 0x7f60fc152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f610179c700 1 -- 172.21.15.142:0/2947840498 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f000b790 con 0x7f60fc0b00d0 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f610179c700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0b00d0 0x7f60fc159a80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f60f400cd50 tx=0x7f60f4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:06.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f60f8ff9700 1 -- 172.21.15.142:0/2947840498 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4005df0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f60f8ff9700 1 -- 172.21.15.142:0/2947840498 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f400a8b0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f60f8ff9700 1 -- 172.21.15.142:0/2947840498 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400ac70 con 0x7f60fc0b00d0 2023-09-30T23:04:06.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc168090 con 0x7f60fc0b00d0 2023-09-30T23:04:06.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.012+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc1677a0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.013+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc168850 con 0x7f60fc0b00d0 2023-09-30T23:04:06.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.014+0000 7f60f8ff9700 1 -- 172.21.15.142:0/2947840498 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f60f4007300 con 0x7f60fc0b00d0 2023-09-30T23:04:06.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.015+0000 7f60f8ff9700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f60e0067330 0x7f60e00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.015+0000 7f60f8ff9700 1 -- 172.21.15.142:0/2947840498 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f60f40848f0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.015+0000 7f6100f9b700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f60e0067330 0x7f60e00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.016+0000 7f6100f9b700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f60e0067330 0x7f60e00697e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f60f000bc80 tx=0x7f60f001b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:06.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.019+0000 7f60f8ff9700 1 -- 172.21.15.142:0/2947840498 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f60f4051bc0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.214+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60fc0c8ea0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.214+0000 7f60f8ff9700 1 -- 172.21.15.142:0/2947840498 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v188) v1 ==== 84+0+126 (secure 0 0 0) 0x7f60f40551e0 con 0x7f60fc0b00d0 2023-09-30T23:04:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:06.215 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-30T23:04:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-30T23:04:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-30T23:04:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2023-09-30T23:04:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2023-09-30T23:04:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:06.216 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-30T23:04:06.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.216+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f60e0067330 msgr2=0x7f60e00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f60e0067330 0x7f60e00697e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f60f000bc80 tx=0x7f60f001b000 comp rx=0 tx=0).stop 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0b00d0 msgr2=0x7f60fc159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0b00d0 0x7f60fc159a80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f60f400cd50 tx=0x7f60f4001b10 comp rx=0 tx=0).stop 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 shutdown_connections 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f60e0067330 0x7f60e00697e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60fc0b00d0 0x7f60fc159a80 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60fc06e820 0x7f60fc13bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 --2- 172.21.15.142:0/2947840498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60fc0af020 0x7f60fc152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 >> 172.21.15.142:0/2947840498 conn(0x7f60fc0680c0 msgr2=0x7f60fc0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:06.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 shutdown_connections 2023-09-30T23:04:06.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.217+0000 7f61031ff700 1 -- 172.21.15.142:0/2947840498 wait complete. 2023-09-30T23:04:06.235 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T23:04:06.235 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T23:04:06.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.428+0000 7f1c523ff700 1 Processor -- start 2023-09-30T23:04:06.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.428+0000 7f1c523ff700 1 -- start start 2023-09-30T23:04:06.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c523ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1c4c0ca5e0 0x7f1c4c0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c523ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1c4c159de0 0x7f1c4c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c523ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c068230 con 0x7f1c4c159a10 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c523ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c067620 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c523ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c067900 con 0x7f1c4c159de0 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1c4c0ca5e0 0x7f1c4c0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1c4c159a10 0x7f1c4c0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39316/0 (socket says 172.21.15.142:39316) 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1c4c0ca5e0 0x7f1c4c0686c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59634/0 (socket says 172.21.15.142:59634) 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4bfff700 1 -- 172.21.15.142:0/2300076855 learned_addr learned my addr 172.21.15.142:0/2300076855 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c5099c700 1 --2- 172.21.15.142:0/2300076855 >> v2:172.21.15.148:3300/0 conn(0x7f1c4c159de0 0x7f1c4c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4b7fe700 1 -- 172.21.15.142:0/2300076855 >> v2:172.21.15.148:3300/0 conn(0x7f1c4c159de0 msgr2=0x7f1c4c068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4b7fe700 1 --2- 172.21.15.142:0/2300076855 >> v2:172.21.15.148:3300/0 conn(0x7f1c4c159de0 0x7f1c4c068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4b7fe700 1 -- 172.21.15.142:0/2300076855 >> v1:172.21.15.142:6789/0 conn(0x7f1c4c159a10 legacy=0x7f1c4c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4b7fe700 1 -- 172.21.15.142:0/2300076855 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c067be0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.430+0000 7f1c4affd700 1 -- 172.21.15.142:0/2300076855 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178373932 0 0) 0x7f1c4c068230 con 0x7f1c4c159a10 2023-09-30T23:04:06.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c4b7fe700 1 --2- 172.21.15.142:0/2300076855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c0686c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0c8e30 tx=0x7f1c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56102fd8a92b3e9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:06.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c4affd700 1 -- 172.21.15.142:0/2300076855 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000b6b0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c4affd700 1 -- 172.21.15.142:0/2300076855 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4000b810 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c4affd700 1 -- 172.21.15.142:0/2300076855 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000bbb0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c523ff700 1 -- 172.21.15.142:0/2300076855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 msgr2=0x7f1c4c0686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c523ff700 1 --2- 172.21.15.142:0/2300076855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c0686c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0c8e30 tx=0x7f1c400091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c523ff700 1 -- 172.21.15.142:0/2300076855 shutdown_connections 2023-09-30T23:04:06.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c523ff700 1 --2- 172.21.15.142:0/2300076855 >> v2:172.21.15.148:3300/0 conn(0x7f1c4c159de0 0x7f1c4c068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c523ff700 1 --2- 172.21.15.142:0/2300076855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c0686c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.431+0000 7f1c523ff700 1 -- 172.21.15.142:0/2300076855 >> 172.21.15.142:0/2300076855 conn(0x7f1c4c0cb2f0 msgr2=0x7f1c4c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:06.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.432+0000 7f1c523ff700 1 -- 172.21.15.142:0/2300076855 shutdown_connections 2023-09-30T23:04:06.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.432+0000 7f1c523ff700 1 -- 172.21.15.142:0/2300076855 wait complete. 2023-09-30T23:04:06.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.433+0000 7f1c523ff700 1 Processor -- start 2023-09-30T23:04:06.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.433+0000 7f1c523ff700 1 -- start start 2023-09-30T23:04:06.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c523ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c523ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c4c159a10 0x7f1c4c0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c523ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c4c159de0 0x7f1c4c16ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c523ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c154640 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c523ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0c7360 con 0x7f1c4c159de0 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c523ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0c6e00 con 0x7f1c4c159a10 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59644/0 (socket says 172.21.15.142:59644) 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c4bfff700 1 -- 172.21.15.142:0/3782865228 learned_addr learned my addr 172.21.15.142:0/3782865228 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c4b7fe700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c4c159a10 0x7f1c4c0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.434+0000 7f1c5099c700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c4c159de0 0x7f1c4c16ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c4bfff700 1 -- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c4c159a10 msgr2=0x7f1c4c0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c4bfff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c4c159a10 0x7f1c4c0c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c4bfff700 1 -- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c4c159de0 msgr2=0x7f1c4c16ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c4bfff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c4c159de0 0x7f1c4c16ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c4bfff700 1 -- 172.21.15.142:0/3782865228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40009420 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c4bfff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c15adb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c810 tx=0x7f1c3c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c33fff700 1 -- 172.21.15.142:0/3782865228 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c005b30 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c33fff700 1 -- 172.21.15.142:0/3782865228 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c005c90 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c0c7080 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c33fff700 1 -- 172.21.15.142:0/3782865228 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c007300 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.435+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c15a5b0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.436+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c06e4b0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.437+0000 7f1c33fff700 1 -- 172.21.15.142:0/3782865228 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1c3c01b3b0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.438+0000 7f1c33fff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c38067330 0x7f1c380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:06.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.438+0000 7f1c33fff700 1 -- 172.21.15.142:0/3782865228 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1c3c083db0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.438+0000 7f1c4b7fe700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c38067330 0x7f1c380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:06.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.439+0000 7f1c4b7fe700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c38067330 0x7f1c380697e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1c400093f0 tx=0x7f1c40017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:06.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.442+0000 7f1c33fff700 1 -- 172.21.15.142:0/3782865228 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1c3c088070 con 0x7f1c4c0ca5e0 2023-09-30T23:04:06.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:06.634+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1c4c067ec0 con 0x7f1c4c0ca5e0 2023-09-30T23:04:07.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.631+0000 7f1c33fff700 1 -- 172.21.15.142:0/3782865228 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v189) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1c3c050f60 con 0x7f1c4c0ca5e0 2023-09-30T23:04:07.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.634+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c38067330 msgr2=0x7f1c380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.634+0000 7f1c523ff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c38067330 0x7f1c380697e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1c400093f0 tx=0x7f1c40017000 comp rx=0 tx=0).stop 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 msgr2=0x7f1c4c15adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c15adb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c810 tx=0x7f1c3c007df0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 shutdown_connections 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1c38067330 0x7f1c380697e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c4c159de0 0x7f1c4c16ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c4c0ca5e0 0x7f1c4c15adb0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 --2- 172.21.15.142:0/3782865228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1c4c159a10 0x7f1c4c0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 >> 172.21.15.142:0/3782865228 conn(0x7f1c4c0cb2f0 msgr2=0x7f1c4c0cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 shutdown_connections 2023-09-30T23:04:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.635+0000 7f1c523ff700 1 -- 172.21.15.142:0/3782865228 wait complete. 2023-09-30T23:04:07.637 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-30T23:04:07.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T23:04:07.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.855+0000 7fc0fc9ff700 1 Processor -- start 2023-09-30T23:04:07.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.856+0000 7fc0fc9ff700 1 -- start start 2023-09-30T23:04:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0fc9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc0f8159ba0 0x7fc0f806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0fc9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f8067d10 con 0x7fc0f80ca5e0 2023-09-30T23:04:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0fc9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f806af90 con 0x7fc0f80b0de0 2023-09-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0fc9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f80676c0 con 0x7fc0f8159ba0 2023-09-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0f6d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc0f80ca5e0 0x7fc0f80681a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39330/0 (socket says 172.21.15.142:39330) 2023-09-30T23:04:07.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0f6d9d700 1 -- 172.21.15.142:0/554130469 learned_addr learned my addr 172.21.15.142:0/554130469 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0f659c700 1 --2- 172.21.15.142:0/554130469 >> v2:172.21.15.148:3300/0 conn(0x7fc0f8159ba0 0x7fc0f806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.857+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499421525 0 0) 0x7fc0f8067d10 con 0x7fc0f80ca5e0 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e0003570 con 0x7fc0f80ca5e0 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429587175 0 0) 0x7fc0f806af90 con 0x7fc0f80b0de0 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f8067d10 con 0x7fc0f80b0de0 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993739723 0 0) 0x7fc0e0003570 con 0x7fc0f80ca5e0 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 >> v2:172.21.15.148:3300/0 conn(0x7fc0f8159ba0 msgr2=0x7fc0f806a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:07.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 --2- 172.21.15.142:0/554130469 >> v2:172.21.15.148:3300/0 conn(0x7fc0f8159ba0 0x7fc0f806a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 >> v1:172.21.15.148:6789/0 conn(0x7fc0f80b0de0 legacy=0x7fc0f80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80679a0 con 0x7fc0f80ca5e0 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fc0f00017f0 con 0x7fc0f80ca5e0 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 >> v1:172.21.15.142:6789/0 conn(0x7fc0f80ca5e0 legacy=0x7fc0f80681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0e0003bf0 0x7fc0e0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0e00051c0 0x7fc0e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80676c0 con 0x7fc0e0004810 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e000c0b0 con 0x7fc0e00051c0 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e000c270 con 0x7fc0e0003bf0 2023-09-30T23:04:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f6d9d700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0e00051c0 0x7fc0e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.858+0000 7fc0f659c700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0e0003bf0 0x7fc0e0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f5d9b700 1 -- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0e0003bf0 msgr2=0x7fc0e0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0e0003bf0 0x7fc0e0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f5d9b700 1 -- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0e00051c0 msgr2=0x7fc0e000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0e00051c0 0x7fc0e000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f5d9b700 1 -- 172.21.15.142:0/554130469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e0003570 con 0x7fc0e0004810 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f6d9d700 1 -- 172.21.15.142:0/554130469 reap_dead start 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0e0004c80 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec001a10 tx=0x7fc0ec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4999aa16e879d8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00c5d0 con 0x7fc0e0004810 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec00c730 con 0x7fc0e0004810 2023-09-30T23:04:07.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.859+0000 7fc0f559a700 1 -- 172.21.15.142:0/554130469 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00cad0 con 0x7fc0e0004810 2023-09-30T23:04:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.860+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/554130469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 msgr2=0x7fc0e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.860+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0e0004c80 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec001a10 tx=0x7fc0ec007d30 comp rx=0 tx=0).stop 2023-09-30T23:04:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.860+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/554130469 shutdown_connections 2023-09-30T23:04:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.860+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/554130469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0e0004c80 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.860+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/554130469 >> 172.21.15.142:0/554130469 conn(0x7fc0f80cb2f0 msgr2=0x7fc0f80cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.860+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/554130469 shutdown_connections 2023-09-30T23:04:07.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.860+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/554130469 wait complete. 2023-09-30T23:04:07.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.861+0000 7fc0fc9ff700 1 Processor -- start 2023-09-30T23:04:07.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.861+0000 7fc0fc9ff700 1 -- start start 2023-09-30T23:04:07.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.862+0000 7fc0fc9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0f815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.862+0000 7fc0fc9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0f815a930 0x7fc0f816a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.862+0000 7fc0fc9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0f816aa30 0x7fc0f816aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.862+0000 7fc0fc9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f816d900 con 0x7fc0e0004810 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.862+0000 7fc0fc9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f816b3f0 con 0x7fc0f816aa30 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.862+0000 7fc0fc9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f816b6c0 con 0x7fc0f815a930 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0f815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0f815c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59660/0 (socket says 172.21.15.142:59660) 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 -- 172.21.15.142:0/4162760164 learned_addr learned my addr 172.21.15.142:0/4162760164 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0f815a930 0x7fc0f816a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f6d9d700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0f816aa30 0x7fc0f816aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 -- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0f815a930 msgr2=0x7fc0f816a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0f815a930 0x7fc0f816a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 -- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0f816aa30 msgr2=0x7fc0f816aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0f816aa30 0x7fc0f816aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 -- 172.21.15.142:0/4162760164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f815aef0 con 0x7fc0e0004810 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0f815a930 0x7fc0f816a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f6d9d700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0f816aa30 0x7fc0f816aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.863+0000 7fc0f659c700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0f815c400 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8011a40 tx=0x7fc0e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.864+0000 7fc0e67fc700 1 -- 172.21.15.142:0/4162760164 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e800f8e0 con 0x7fc0e0004810 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.864+0000 7fc0e67fc700 1 -- 172.21.15.142:0/4162760164 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e800fa40 con 0x7fc0e0004810 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.864+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f815b1d0 con 0x7fc0e0004810 2023-09-30T23:04:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.864+0000 7fc0e67fc700 1 -- 172.21.15.142:0/4162760164 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e800fdc0 con 0x7fc0e0004810 2023-09-30T23:04:07.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.864+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f815b790 con 0x7fc0e0004810 2023-09-30T23:04:07.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.865+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f806e4b0 con 0x7fc0e0004810 2023-09-30T23:04:07.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.866+0000 7fc0e67fc700 1 -- 172.21.15.142:0/4162760164 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc0e8014650 con 0x7fc0e0004810 2023-09-30T23:04:07.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.867+0000 7fc0e67fc700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0d8067330 0x7fc0d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:07.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.867+0000 7fc0e67fc700 1 -- 172.21.15.142:0/4162760164 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fc0e8018030 con 0x7fc0e0004810 2023-09-30T23:04:07.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.867+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0d8067330 0x7fc0d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:07.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.868+0000 7fc0f5d9b700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0d8067330 0x7fc0d80697e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec000c00 tx=0x7fc0ec015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:07.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:07.871+0000 7fc0e67fc700 1 -- 172.21.15.142:0/4162760164 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc0e8052330 con 0x7fc0e0004810 2023-09-30T23:04:08.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.061+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc0f80cac40 con 0x7fc0e0004810 2023-09-30T23:04:08.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.635+0000 7fc0e67fc700 1 -- 172.21.15.142:0/4162760164 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v190) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc0e8055950 con 0x7fc0e0004810 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0d8067330 msgr2=0x7fc0d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0d8067330 0x7fc0d80697e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec000c00 tx=0x7fc0ec015000 comp rx=0 tx=0).stop 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 msgr2=0x7fc0f815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0f815c400 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8011a40 tx=0x7fc0e80091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 shutdown_connections 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc0d8067330 0x7fc0d80697e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0f816aa30 0x7fc0f816aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e0004810 0x7fc0f815c400 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 --2- 172.21.15.142:0/4162760164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc0f815a930 0x7fc0f816a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 >> 172.21.15.142:0/4162760164 conn(0x7fc0f80cb2f0 msgr2=0x7fc0f8158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 shutdown_connections 2023-09-30T23:04:08.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.638+0000 7fc0fc9ff700 1 -- 172.21.15.142:0/4162760164 wait complete. 2023-09-30T23:04:08.647 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-30T23:04:08.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T23:04:08.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.858+0000 7f2999dff700 1 Processor -- start 2023-09-30T23:04:08.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.858+0000 7f2999dff700 1 -- start start 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f2999dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940ca5e0 0x7f299406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f2999dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29940b0de0 0x7f29940681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f2999dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2994067d10 con 0x7f2994159ba0 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f2999dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299406af90 con 0x7f29940b0de0 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f2999dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940676c0 con 0x7f29940ca5e0 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f29937fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2994159ba0 0x7f29940c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39342/0 (socket says 172.21.15.142:39342) 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f29937fe700 1 -- 172.21.15.142:0/1890654419 learned_addr learned my addr 172.21.15.142:0/1890654419 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f2993fff700 1 --2- 172.21.15.142:0/1890654419 >> v2:172.21.15.142:3300/0 conn(0x7f29940b0de0 0x7f29940681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.859+0000 7f2992ffd700 1 --2- 172.21.15.142:0/1890654419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940ca5e0 0x7f299406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f29927fc700 1 -- 172.21.15.142:0/1890654419 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49164322 0 0) 0x7f2994067d10 con 0x7f2994159ba0 2023-09-30T23:04:08.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f29927fc700 1 -- 172.21.15.142:0/1890654419 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297c003570 con 0x7f2994159ba0 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f2993fff700 1 -- 172.21.15.142:0/1890654419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940ca5e0 msgr2=0x7f299406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f2993fff700 1 --2- 172.21.15.142:0/1890654419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940ca5e0 0x7f299406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f2993fff700 1 -- 172.21.15.142:0/1890654419 >> v1:172.21.15.142:6789/0 conn(0x7f2994159ba0 legacy=0x7f29940c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f2993fff700 1 -- 172.21.15.142:0/1890654419 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940679a0 con 0x7f29940b0de0 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f2993fff700 1 --2- 172.21.15.142:0/1890654419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940b0de0 0x7f29940681a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f298c009e60 tx=0x7f298c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e65a8fbcede7c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f29927fc700 1 -- 172.21.15.142:0/1890654419 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00e070 con 0x7f29940b0de0 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f29927fc700 1 -- 172.21.15.142:0/1890654419 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00bab0 con 0x7f29940b0de0 2023-09-30T23:04:08.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.860+0000 7f29927fc700 1 -- 172.21.15.142:0/1890654419 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00be70 con 0x7f29940b0de0 2023-09-30T23:04:08.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 -- 172.21.15.142:0/1890654419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940b0de0 msgr2=0x7f29940681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:08.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 --2- 172.21.15.142:0/1890654419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940b0de0 0x7f29940681a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f298c009e60 tx=0x7f298c009780 comp rx=0 tx=0).stop 2023-09-30T23:04:08.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 -- 172.21.15.142:0/1890654419 shutdown_connections 2023-09-30T23:04:08.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 --2- 172.21.15.142:0/1890654419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940b0de0 0x7f29940681a0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 --2- 172.21.15.142:0/1890654419 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940ca5e0 0x7f299406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 -- 172.21.15.142:0/1890654419 >> 172.21.15.142:0/1890654419 conn(0x7f29940cb2f0 msgr2=0x7f29940cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:08.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 -- 172.21.15.142:0/1890654419 shutdown_connections 2023-09-30T23:04:08.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.861+0000 7f2999dff700 1 -- 172.21.15.142:0/1890654419 wait complete. 2023-09-30T23:04:08.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.863+0000 7f2999dff700 1 Processor -- start 2023-09-30T23:04:08.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.863+0000 7f2999dff700 1 -- start start 2023-09-30T23:04:08.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2999dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940b0de0 0x7f29940c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:08.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2999dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940ca5e0 0x7f299416a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:08.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2999dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2994159ba0 0x7f299414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:08.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2999dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940c5930 con 0x7f29940ca5e0 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2999dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940c4ab0 con 0x7f2994159ba0 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2999dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299414d1d0 con 0x7f29940b0de0 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940ca5e0 0x7f299416a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940ca5e0 0x7f299416a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59682/0 (socket says 172.21.15.142:59682) 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 -- 172.21.15.142:0/2391090220 learned_addr learned my addr 172.21.15.142:0/2391090220 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2993fff700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2994159ba0 0x7f299414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 -- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940b0de0 msgr2=0x7f29940c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f29937fe700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940b0de0 0x7f29940c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940b0de0 0x7f29940c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 -- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2994159ba0 msgr2=0x7f299414cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:08.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2994159ba0 0x7f299414cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.864+0000 7f2992ffd700 1 -- 172.21.15.142:0/2391090220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c009a20 con 0x7f29940ca5e0 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.865+0000 7f2992ffd700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940ca5e0 0x7f299416a8e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f298800ec80 tx=0x7f29880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.865+0000 7f297b7fe700 1 -- 172.21.15.142:0/2391090220 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800c9d0 con 0x7f29940ca5e0 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.865+0000 7f297b7fe700 1 -- 172.21.15.142:0/2391090220 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800cb30 con 0x7f29940ca5e0 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.865+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29940c9c10 con 0x7f29940ca5e0 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.865+0000 7f297b7fe700 1 -- 172.21.15.142:0/2391090220 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988013470 con 0x7f29940ca5e0 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.865+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29940c4fa0 con 0x7f29940ca5e0 2023-09-30T23:04:08.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.866+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29940c5aa0 con 0x7f29940ca5e0 2023-09-30T23:04:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.867+0000 7f297b7fe700 1 -- 172.21.15.142:0/2391090220 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2988013820 con 0x7f29940ca5e0 2023-09-30T23:04:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.868+0000 7f297b7fe700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2980067330 0x7f29800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.868+0000 7f297b7fe700 1 -- 172.21.15.142:0/2391090220 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f2988084f00 con 0x7f29940ca5e0 2023-09-30T23:04:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.869+0000 7f29937fe700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2980067330 0x7f29800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:08.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.869+0000 7f29937fe700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2980067330 0x7f29800697e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f29840058d0 tx=0x7f2984009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:08.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:08.873+0000 7f297b7fe700 1 -- 172.21.15.142:0/2391090220 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f29940c5aa0 con 0x7f29940ca5e0 2023-09-30T23:04:09.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.111+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f29940c5aa0 con 0x7f29940ca5e0 2023-09-30T23:04:09.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.636+0000 7f297b7fe700 1 -- 172.21.15.142:0/2391090220 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v87) v1 ==== 174+0+0 (secure 0 0 0) 0x7f29940c5aa0 con 0x7f29940ca5e0 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2980067330 msgr2=0x7f29800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2980067330 0x7f29800697e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f29840058d0 tx=0x7f2984009040 comp rx=0 tx=0).stop 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940ca5e0 msgr2=0x7f299416a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940ca5e0 0x7f299416a8e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f298800ec80 tx=0x7f29880091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 shutdown_connections 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2980067330 0x7f29800697e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2994159ba0 0x7f299414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f29940b0de0 0x7f29940c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 --2- 172.21.15.142:0/2391090220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29940ca5e0 0x7f299416a8e0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 >> 172.21.15.142:0/2391090220 conn(0x7f29940cb2f0 msgr2=0x7f2994158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 shutdown_connections 2023-09-30T23:04:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.639+0000 7f2999dff700 1 -- 172.21.15.142:0/2391090220 wait complete. 2023-09-30T23:04:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 23 and data pool 24 2023-09-30T23:04:09.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:09.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.848+0000 7fdd25bff700 1 Processor -- start 2023-09-30T23:04:09.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.848+0000 7fdd25bff700 1 -- start start 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.849+0000 7fdd25bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd200b1950 0x7fdd2015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.849+0000 7fdd25bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd200ad630 con 0x7fdd2015a6c0 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.849+0000 7fdd25bff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd200b3360 con 0x7fdd200b1580 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.849+0000 7fdd25bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2015ab60 con 0x7fdd200b1950 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.850+0000 7fdd1ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdd2015a6c0 0x7fdd2006a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39346/0 (socket says 172.21.15.142:39346) 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.850+0000 7fdd1ffff700 1 -- 172.21.15.142:0/3176681950 learned_addr learned my addr 172.21.15.142:0/3176681950 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.850+0000 7fdd1effd700 1 --2- 172.21.15.142:0/3176681950 >> v2:172.21.15.148:3300/0 conn(0x7fdd200b1950 0x7fdd2015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.850+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810526901 0 0) 0x7fdd200ad630 con 0x7fdd2015a6c0 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.850+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd08003570 con 0x7fdd2015a6c0 2023-09-30T23:04:09.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.850+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176484642 0 0) 0x7fdd200b3360 con 0x7fdd200b1580 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.850+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd200ad630 con 0x7fdd200b1580 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3994904465 0 0) 0x7fdd08003570 con 0x7fdd2015a6c0 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 >> v2:172.21.15.148:3300/0 conn(0x7fdd200b1950 msgr2=0x7fdd2015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 --2- 172.21.15.142:0/3176681950 >> v2:172.21.15.148:3300/0 conn(0x7fdd200b1950 0x7fdd2015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 >> v1:172.21.15.148:6789/0 conn(0x7fdd200b1580 legacy=0x7fdd200adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200ae1d0 con 0x7fdd2015a6c0 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fdd180017f0 con 0x7fdd2015a6c0 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 >> v1:172.21.15.142:6789/0 conn(0x7fdd2015a6c0 legacy=0x7fdd2006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd08003bf0 0x7fdd08003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08004810 0x7fdd08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd080051c0 0x7fdd0800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2015ab60 con 0x7fdd080051c0 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0800c0b0 con 0x7fdd08003bf0 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0800c270 con 0x7fdd08004810 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1ffff700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd080051c0 0x7fdd0800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1effd700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08004810 0x7fdd08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1f7fe700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd08003bf0 0x7fdd08003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1ffff700 1 -- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08004810 msgr2=0x7fdd08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1ffff700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08004810 0x7fdd08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1ffff700 1 -- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd08003bf0 msgr2=0x7fdd08003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1ffff700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd08003bf0 0x7fdd08003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.851+0000 7fdd1ffff700 1 -- 172.21.15.142:0/3176681950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08003570 con 0x7fdd080051c0 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd1ffff700 1 -- 172.21.15.142:0/3176681950 reap_dead start 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd1ffff700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd080051c0 0x7fdd0800ba60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800a8d0 tx=0x7fdd18002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8923924ad8a1d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180070d0 con 0x7fdd080051c0 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18007270 con 0x7fdd080051c0 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd1e7fc700 1 -- 172.21.15.142:0/3176681950 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18007630 con 0x7fdd080051c0 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd25bff700 1 -- 172.21.15.142:0/3176681950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd080051c0 msgr2=0x7fdd0800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd25bff700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd080051c0 0x7fdd0800ba60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800a8d0 tx=0x7fdd18002190 comp rx=0 tx=0).stop 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd25bff700 1 -- 172.21.15.142:0/3176681950 shutdown_connections 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd25bff700 1 --2- 172.21.15.142:0/3176681950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd080051c0 0x7fdd0800ba60 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd25bff700 1 -- 172.21.15.142:0/3176681950 >> 172.21.15.142:0/3176681950 conn(0x7fdd200ce1f0 msgr2=0x7fdd20069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.852+0000 7fdd25bff700 1 -- 172.21.15.142:0/3176681950 shutdown_connections 2023-09-30T23:04:09.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.853+0000 7fdd25bff700 1 -- 172.21.15.142:0/3176681950 wait complete. 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.855+0000 7fdd25bff700 1 Processor -- start 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.855+0000 7fdd25bff700 1 -- start start 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd25bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080051c0 0x7fdd200cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd25bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd200cd0d0 0x7fdd20155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd25bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd20068c60 0x7fdd200690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd25bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2016a6c0 con 0x7fdd200cd0d0 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd25bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200695f0 con 0x7fdd080051c0 2023-09-30T23:04:09.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd25bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200cd540 con 0x7fdd20068c60 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd1effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd200cd0d0 0x7fdd20155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd1effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd200cd0d0 0x7fdd20155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59700/0 (socket says 172.21.15.142:59700) 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd1effd700 1 -- 172.21.15.142:0/587621467 learned_addr learned my addr 172.21.15.142:0/587621467 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd1f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080051c0 0x7fdd200cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.856+0000 7fdd1ffff700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd20068c60 0x7fdd200690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd1effd700 1 -- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd20068c60 msgr2=0x7fdd200690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd1effd700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd20068c60 0x7fdd200690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd1effd700 1 -- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080051c0 msgr2=0x7fdd200cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd1effd700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080051c0 0x7fdd200cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd1effd700 1 -- 172.21.15.142:0/587621467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200cb9f0 con 0x7fdd200cd0d0 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd1f7fe700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080051c0 0x7fdd200cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:09.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd1effd700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd200cd0d0 0x7fdd20155640 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fdd14011b10 tx=0x7fdd140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:09.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd077fe700 1 -- 172.21.15.142:0/587621467 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400f940 con 0x7fdd200cd0d0 2023-09-30T23:04:09.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd077fe700 1 -- 172.21.15.142:0/587621467 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1400faa0 con 0x7fdd200cd0d0 2023-09-30T23:04:09.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd200cbcd0 con 0x7fdd200cd0d0 2023-09-30T23:04:09.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd077fe700 1 -- 172.21.15.142:0/587621467 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400fe20 con 0x7fdd200cd0d0 2023-09-30T23:04:09.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.857+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd200cc290 con 0x7fdd200cd0d0 2023-09-30T23:04:09.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.858+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2016a830 con 0x7fdd200cd0d0 2023-09-30T23:04:09.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.859+0000 7fdd077fe700 1 -- 172.21.15.142:0/587621467 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdd14014650 con 0x7fdd200cd0d0 2023-09-30T23:04:09.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.860+0000 7fdd077fe700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd0c067360 0x7fdd0c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:09.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.860+0000 7fdd077fe700 1 -- 172.21.15.142:0/587621467 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd14018030 con 0x7fdd200cd0d0 2023-09-30T23:04:09.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.861+0000 7fdd1f7fe700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd0c067360 0x7fdd0c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:09.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.861+0000 7fdd1f7fe700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd0c067360 0x7fdd0c069810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000c00 tx=0x7fdd10007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:09.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:09.865+0000 7fdd077fe700 1 -- 172.21.15.142:0/587621467 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdd14052310 con 0x7fdd200cd0d0 2023-09-30T23:04:10.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.055+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd2006dc30 con 0x7fdd200cd0d0 2023-09-30T23:04:10.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.056+0000 7fdd077fe700 1 -- 172.21.15.142:0/587621467 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+17039 (secure 0 0 0) 0x7fdd14055930 con 0x7fdd200cd0d0 2023-09-30T23:04:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:10.057 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":191,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:09.112994+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:04:06.673268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-09-30T23:04:08.101636+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:10.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd0c067360 msgr2=0x7fdd0c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd0c067360 0x7fdd0c069810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000c00 tx=0x7fdd10007d30 comp rx=0 tx=0).stop 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd200cd0d0 msgr2=0x7fdd20155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd200cd0d0 0x7fdd20155640 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fdd14011b10 tx=0x7fdd140091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 shutdown_connections 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdd0c067360 0x7fdd0c069810 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd20068c60 0x7fdd200690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080051c0 0x7fdd200cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 --2- 172.21.15.142:0/587621467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd200cd0d0 0x7fdd20155640 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 >> 172.21.15.142:0/587621467 conn(0x7fdd200ce1f0 msgr2=0x7fdd20067b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 shutdown_connections 2023-09-30T23:04:10.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.059+0000 7fdd25bff700 1 -- 172.21.15.142:0/587621467 wait complete. 2023-09-30T23:04:10.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.267+0000 7fa15d3ff700 1 Processor -- start 2023-09-30T23:04:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.267+0000 7fa15d3ff700 1 -- start start 2023-09-30T23:04:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.268+0000 7fa15d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa1580cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.268+0000 7fa15d3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa1580cc590 0x7fa158069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.268+0000 7fa15d3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15815d910 con 0x7fa1580b1180 2023-09-30T23:04:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.268+0000 7fa15d3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15815e920 con 0x7fa1580cc590 2023-09-30T23:04:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.268+0000 7fa15d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15815e490 con 0x7fa158159ae0 2023-09-30T23:04:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa1567fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa1580b1180 0x7fa1580cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39354/0 (socket says 172.21.15.142:39354) 2023-09-30T23:04:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa1567fc700 1 -- 172.21.15.142:0/1206524171 learned_addr learned my addr 172.21.15.142:0/1206524171 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa156ffd700 1 --2- 172.21.15.142:0/1206524171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa1580cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa1577fe700 1 --2- 172.21.15.142:0/1206524171 >> v2:172.21.15.148:3300/0 conn(0x7fa1580cc590 0x7fa158069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa155ffb700 1 -- 172.21.15.142:0/1206524171 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273471656 0 0) 0x7fa15815d910 con 0x7fa1580b1180 2023-09-30T23:04:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa155ffb700 1 -- 172.21.15.142:0/1206524171 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa140003570 con 0x7fa1580b1180 2023-09-30T23:04:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa156ffd700 1 -- 172.21.15.142:0/1206524171 >> v2:172.21.15.148:3300/0 conn(0x7fa1580cc590 msgr2=0x7fa158069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa156ffd700 1 --2- 172.21.15.142:0/1206524171 >> v2:172.21.15.148:3300/0 conn(0x7fa1580cc590 0x7fa158069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa156ffd700 1 -- 172.21.15.142:0/1206524171 >> v1:172.21.15.142:6789/0 conn(0x7fa1580b1180 legacy=0x7fa1580cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.269+0000 7fa156ffd700 1 -- 172.21.15.142:0/1206524171 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15815db60 con 0x7fa158159ae0 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa156ffd700 1 --2- 172.21.15.142:0/1206524171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa1580cdeb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa1480098e0 tx=0x7fa1480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53be7b86ae46e4e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa155ffb700 1 -- 172.21.15.142:0/1206524171 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148011630 con 0x7fa158159ae0 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa155ffb700 1 -- 172.21.15.142:0/1206524171 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148011790 con 0x7fa158159ae0 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa155ffb700 1 -- 172.21.15.142:0/1206524171 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148011b10 con 0x7fa158159ae0 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa15d3ff700 1 -- 172.21.15.142:0/1206524171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 msgr2=0x7fa1580cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/1206524171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa1580cdeb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa1480098e0 tx=0x7fa1480091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa15d3ff700 1 -- 172.21.15.142:0/1206524171 shutdown_connections 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/1206524171 >> v2:172.21.15.148:3300/0 conn(0x7fa1580cc590 0x7fa158069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/1206524171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa1580cdeb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.270+0000 7fa15d3ff700 1 -- 172.21.15.142:0/1206524171 >> 172.21.15.142:0/1206524171 conn(0x7fa1580ce8b0 msgr2=0x7fa1580cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:10.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.271+0000 7fa15d3ff700 1 -- 172.21.15.142:0/1206524171 shutdown_connections 2023-09-30T23:04:10.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.271+0000 7fa15d3ff700 1 -- 172.21.15.142:0/1206524171 wait complete. 2023-09-30T23:04:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.272+0000 7fa15d3ff700 1 Processor -- start 2023-09-30T23:04:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.272+0000 7fa15d3ff700 1 -- start start 2023-09-30T23:04:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa15d3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1580b1180 0x7fa158141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa15d3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1580cc590 0x7fa15816d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa15d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa15816deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa15d3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581421c0 con 0x7fa1580cc590 2023-09-30T23:04:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa15d3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15816bd40 con 0x7fa1580b1180 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa15d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15816b480 con 0x7fa158159ae0 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa1567fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1580cc590 0x7fa15816d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa1567fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1580cc590 0x7fa15816d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59714/0 (socket says 172.21.15.142:59714) 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.273+0000 7fa1567fc700 1 -- 172.21.15.142:0/2782984921 learned_addr learned my addr 172.21.15.142:0/2782984921 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1577fe700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa15816deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa156ffd700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1580b1180 0x7fa158141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1567fc700 1 -- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 msgr2=0x7fa15816deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1567fc700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa15816deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1567fc700 1 -- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1580b1180 msgr2=0x7fa158141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1567fc700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1580b1180 0x7fa158141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1567fc700 1 -- 172.21.15.142:0/2782984921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148009420 con 0x7fa1580cc590 2023-09-30T23:04:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1577fe700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa15816deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa156ffd700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1580b1180 0x7fa158141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa1567fc700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1580cc590 0x7fa15816d970 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c790 tx=0x7fa14c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa13effd700 1 -- 172.21.15.142:0/2782984921 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c005b30 con 0x7fa1580cc590 2023-09-30T23:04:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa13effd700 1 -- 172.21.15.142:0/2782984921 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c005c90 con 0x7fa1580cc590 2023-09-30T23:04:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa13effd700 1 -- 172.21.15.142:0/2782984921 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c007300 con 0x7fa1580cc590 2023-09-30T23:04:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15815c750 con 0x7fa1580cc590 2023-09-30T23:04:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.274+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15816b9d0 con 0x7fa1580cc590 2023-09-30T23:04:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.275+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15816bed0 con 0x7fa1580cc590 2023-09-30T23:04:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.276+0000 7fa13effd700 1 -- 172.21.15.142:0/2782984921 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa14c007670 con 0x7fa1580cc590 2023-09-30T23:04:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.277+0000 7fa13effd700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa144067330 0x7fa1440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.278+0000 7fa13effd700 1 -- 172.21.15.142:0/2782984921 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa14c084140 con 0x7fa1580cc590 2023-09-30T23:04:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.278+0000 7fa156ffd700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa144067330 0x7fa1440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.278+0000 7fa156ffd700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa144067330 0x7fa1440697e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa1480091e0 tx=0x7fa148017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:10.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.281+0000 7fa13effd700 1 -- 172.21.15.142:0/2782984921 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa14c051040 con 0x7fa1580cc590 2023-09-30T23:04:10.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.472+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa15815de40 con 0x7fa1580cc590 2023-09-30T23:04:10.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.473+0000 7fa13effd700 1 -- 172.21.15.142:0/2782984921 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+17026 (secure 0 0 0) 0x7fa14c054660 con 0x7fa1580cc590 2023-09-30T23:04:10.474 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:10.474 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":192,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:10.398790+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:04:06.673268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-09-30T23:04:08.101636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa144067330 msgr2=0x7fa1440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa144067330 0x7fa1440697e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa1480091e0 tx=0x7fa148017000 comp rx=0 tx=0).stop 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1580cc590 msgr2=0x7fa15816d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1580cc590 0x7fa15816d970 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c790 tx=0x7fa14c007df0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 shutdown_connections 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa144067330 0x7fa1440697e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa158159ae0 0x7fa15816deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1580b1180 0x7fa158141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 --2- 172.21.15.142:0/2782984921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1580cc590 0x7fa15816d970 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 >> 172.21.15.142:0/2782984921 conn(0x7fa1580ce8b0 msgr2=0x7fa15815d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:10.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 shutdown_connections 2023-09-30T23:04:10.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.476+0000 7fa15d3ff700 1 -- 172.21.15.142:0/2782984921 wait complete. 2023-09-30T23:04:10.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T23:04:10.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.688+0000 7eff167ff700 1 Processor -- start 2023-09-30T23:04:10.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.688+0000 7eff167ff700 1 -- start start 2023-09-30T23:04:10.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff167ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff10159ba0 0x7eff1006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff167ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff100ca5e0 0x7eff100681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff167ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff10067d10 con 0x7eff100b0de0 2023-09-30T23:04:10.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff167ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1006af90 con 0x7eff100ca5e0 2023-09-30T23:04:10.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff167ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100676c0 con 0x7eff10159ba0 2023-09-30T23:04:10.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff14d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff100ca5e0 0x7eff100681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff14d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff100ca5e0 0x7eff100681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59726/0 (socket says 172.21.15.142:59726) 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff14d9c700 1 -- 172.21.15.142:0/1048771866 learned_addr learned my addr 172.21.15.142:0/1048771866 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.689+0000 7eff0ffff700 1 --2- 172.21.15.142:0/1048771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff10159ba0 0x7eff1006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff14d9c700 1 -- 172.21.15.142:0/1048771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff10159ba0 msgr2=0x7eff1006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff14d9c700 1 --2- 172.21.15.142:0/1048771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff10159ba0 0x7eff1006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff14d9c700 1 -- 172.21.15.142:0/1048771866 >> v1:172.21.15.148:6789/0 conn(0x7eff100b0de0 legacy=0x7eff100c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff14d9c700 1 -- 172.21.15.142:0/1048771866 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100679a0 con 0x7eff100ca5e0 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff14d9c700 1 --2- 172.21.15.142:0/1048771866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff100ca5e0 0x7eff100681a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7eff08009f20 tx=0x7eff08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71355b6407325346 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:10.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff0effd700 1 -- 172.21.15.142:0/1048771866 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800e070 con 0x7eff100ca5e0 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff0effd700 1 -- 172.21.15.142:0/1048771866 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800b9d0 con 0x7eff100ca5e0 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.690+0000 7eff0effd700 1 -- 172.21.15.142:0/1048771866 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080092e0 con 0x7eff100ca5e0 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 -- 172.21.15.142:0/1048771866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff100ca5e0 msgr2=0x7eff100681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 --2- 172.21.15.142:0/1048771866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff100ca5e0 0x7eff100681a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7eff08009f20 tx=0x7eff08009840 comp rx=0 tx=0).stop 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 -- 172.21.15.142:0/1048771866 shutdown_connections 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 --2- 172.21.15.142:0/1048771866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff100ca5e0 0x7eff100681a0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 --2- 172.21.15.142:0/1048771866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff10159ba0 0x7eff1006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 -- 172.21.15.142:0/1048771866 >> 172.21.15.142:0/1048771866 conn(0x7eff100cb2f0 msgr2=0x7eff100cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:10.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 -- 172.21.15.142:0/1048771866 shutdown_connections 2023-09-30T23:04:10.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.691+0000 7eff167ff700 1 -- 172.21.15.142:0/1048771866 wait complete. 2023-09-30T23:04:10.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.692+0000 7eff167ff700 1 Processor -- start 2023-09-30T23:04:10.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.693+0000 7eff167ff700 1 -- start start 2023-09-30T23:04:10.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.693+0000 7eff167ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff100b0de0 0x7eff100c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.693+0000 7eff167ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff100ca5e0 0x7eff1015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.693+0000 7eff167ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff10159ba0 0x7eff1014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.693+0000 7eff167ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015ba80 con 0x7eff10159ba0 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.693+0000 7eff167ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015bd60 con 0x7eff100ca5e0 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.693+0000 7eff167ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015c040 con 0x7eff100b0de0 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff10159ba0 0x7eff1014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff10159ba0 0x7eff1014c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59738/0 (socket says 172.21.15.142:59738) 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 -- 172.21.15.142:0/2543445888 learned_addr learned my addr 172.21.15.142:0/2543445888 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:10.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff0ffff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff100b0de0 0x7eff100c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff0f7fe700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff100ca5e0 0x7eff1015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 -- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff100b0de0 msgr2=0x7eff100c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff100b0de0 0x7eff100c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 -- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff100ca5e0 msgr2=0x7eff1015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff100ca5e0 0x7eff1015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 -- 172.21.15.142:0/2543445888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009ae0 con 0x7eff10159ba0 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff0ffff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff100b0de0 0x7eff100c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:10.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.694+0000 7eff14d9c700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff10159ba0 0x7eff1014c8f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7eff1006c8d0 tx=0x7eff08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:10.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.695+0000 7efef7fff700 1 -- 172.21.15.142:0/2543445888 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08008c30 con 0x7eff10159ba0 2023-09-30T23:04:10.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.695+0000 7efef7fff700 1 -- 172.21.15.142:0/2543445888 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08008d90 con 0x7eff10159ba0 2023-09-30T23:04:10.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.695+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1015c320 con 0x7eff10159ba0 2023-09-30T23:04:10.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.695+0000 7efef7fff700 1 -- 172.21.15.142:0/2543445888 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080266b0 con 0x7eff10159ba0 2023-09-30T23:04:10.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.695+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff100c6ea0 con 0x7eff10159ba0 2023-09-30T23:04:10.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.696+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1006e4b0 con 0x7eff10159ba0 2023-09-30T23:04:10.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.697+0000 7efef7fff700 1 -- 172.21.15.142:0/2543445888 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff08003040 con 0x7eff10159ba0 2023-09-30T23:04:10.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.698+0000 7efef7fff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:10.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.698+0000 7efef7fff700 1 -- 172.21.15.142:0/2543445888 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff08086540 con 0x7eff10159ba0 2023-09-30T23:04:10.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.698+0000 7eff0ffff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:10.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.698+0000 7eff0ffff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7eff100c9c50 tx=0x7eff00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:10.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.702+0000 7efef7fff700 1 -- 172.21.15.142:0/2543445888 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff08053440 con 0x7eff10159ba0 2023-09-30T23:04:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:10.935+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff100cac40 con 0x7eff10159ba0 2023-09-30T23:04:11.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.655+0000 7efef7fff700 1 -- 172.21.15.142:0/2543445888 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v90) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff08056a60 con 0x7eff10159ba0 2023-09-30T23:04:11.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 msgr2=0x7efefc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:11.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7eff100c9c50 tx=0x7eff00008040 comp rx=0 tx=0).stop 2023-09-30T23:04:11.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff10159ba0 msgr2=0x7eff1014c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:11.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff10159ba0 0x7eff1014c8f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7eff1006c8d0 tx=0x7eff08018000 comp rx=0 tx=0).stop 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 shutdown_connections 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7efefc067330 0x7efefc0697e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff10159ba0 0x7eff1014c8f0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff100b0de0 0x7eff100c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 --2- 172.21.15.142:0/2543445888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff100ca5e0 0x7eff1015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.658+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 >> 172.21.15.142:0/2543445888 conn(0x7eff100cb2f0 msgr2=0x7eff10158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.659+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 shutdown_connections 2023-09-30T23:04:11.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.659+0000 7eff167ff700 1 -- 172.21.15.142:0/2543445888 wait complete. 2023-09-30T23:04:11.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T23:04:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.869+0000 7faddc9ff700 1 Processor -- start 2023-09-30T23:04:11.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.870+0000 7faddc9ff700 1 -- start start 2023-09-30T23:04:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7faddc9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd8069f10 0x7fadd80c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7faddc9ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fadd80cb350 0x7fadd80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7faddc9ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80c7690 con 0x7fadd80c52a0 2023-09-30T23:04:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7faddc9ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd81406a0 con 0x7fadd80cb350 2023-09-30T23:04:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7faddc9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c3a50 con 0x7fadd8069f10 2023-09-30T23:04:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7fadd659c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fadd80c52a0 0x7fadd80c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37240/0 (socket says 172.21.15.142:37240) 2023-09-30T23:04:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7fadd659c700 1 -- 172.21.15.142:0/3674171423 learned_addr learned my addr 172.21.15.142:0/3674171423 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/3674171423 >> v2:172.21.15.148:3300/0 conn(0x7fadd80cb350 0x7fadd80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.871+0000 7fadcffff700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd8069f10 0x7fadd80c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865313533 0 0) 0x7fadc8001110 con 0x7fadd80c52a0 2023-09-30T23:04:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc4003570 con 0x7fadd80c52a0 2023-09-30T23:04:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3986700594 0 0) 0x7fadc4003570 con 0x7fadd80c52a0 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd8069f10 msgr2=0x7fadd80c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd8069f10 0x7fadd80c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 >> v2:172.21.15.148:3300/0 conn(0x7fadd80cb350 msgr2=0x7fadd80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 --2- 172.21.15.142:0/3674171423 >> v2:172.21.15.148:3300/0 conn(0x7fadd80cb350 0x7fadd80c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80c7f20 con 0x7fadd80c52a0 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fadc8001600 con 0x7fadd80c52a0 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 >> v1:172.21.15.142:6789/0 conn(0x7fadd80c52a0 legacy=0x7fadd80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc4003a90 0x7fadc4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc4004810 0x7fadc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc40051c0 0x7fadc400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81406a0 con 0x7fadc40051c0 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c3a50 con 0x7fadc4003a90 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc400e1b0 con 0x7fadc4004810 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadcffff700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd8069f10 0x7fadd80c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/3674171423 >> v2:172.21.15.148:3300/0 conn(0x7fadd80cb350 0x7fadd80c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.872+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc40051c0 0x7fadc400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd659c700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc4003a90 0x7fadc4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadcffff700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc4004810 0x7fadc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd6d9d700 1 -- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc4004810 msgr2=0x7fadc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc4004810 0x7fadc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd6d9d700 1 -- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc4003a90 msgr2=0x7fadc4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc4003a90 0x7fadc4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd6d9d700 1 -- 172.21.15.142:0/3674171423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4003570 con 0x7fadc40051c0 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadcffff700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc4004810 0x7fadc4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc40051c0 0x7fadc400dc70 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e3f0 tx=0x7fadd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b49160e09a2733 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000eca0 con 0x7fadc40051c0 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000f040 con 0x7fadc40051c0 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.873+0000 7fadd5d9b700 1 -- 172.21.15.142:0/3674171423 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0014480 con 0x7fadc40051c0 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.874+0000 7faddc9ff700 1 -- 172.21.15.142:0/3674171423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc40051c0 msgr2=0x7fadc400dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.874+0000 7faddc9ff700 1 --2- 172.21.15.142:0/3674171423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc40051c0 0x7fadc400dc70 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e3f0 tx=0x7fadd000b040 comp rx=0 tx=0).stop 2023-09-30T23:04:11.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.874+0000 7fadd6d9d700 1 -- 172.21.15.142:0/3674171423 reap_dead start 2023-09-30T23:04:11.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.874+0000 7faddc9ff700 1 -- 172.21.15.142:0/3674171423 shutdown_connections 2023-09-30T23:04:11.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.874+0000 7faddc9ff700 1 -- 172.21.15.142:0/3674171423 >> 172.21.15.142:0/3674171423 conn(0x7fadd80cc670 msgr2=0x7fadd80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:11.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.874+0000 7faddc9ff700 1 -- 172.21.15.142:0/3674171423 shutdown_connections 2023-09-30T23:04:11.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.874+0000 7faddc9ff700 1 -- 172.21.15.142:0/3674171423 wait complete. 2023-09-30T23:04:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.875+0000 7faddc9ff700 1 Processor -- start 2023-09-30T23:04:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.876+0000 7faddc9ff700 1 -- start start 2023-09-30T23:04:11.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.876+0000 7faddc9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40051c0 0x7fadd81663c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.876+0000 7faddc9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd813f030 0x7fadd8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.876+0000 7faddc9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd813f4a0 0x7fadd8156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7faddc9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd813c840 con 0x7fadd813f4a0 2023-09-30T23:04:11.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7faddc9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd813cb20 con 0x7fadc40051c0 2023-09-30T23:04:11.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7faddc9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd813ce00 con 0x7fadd813f030 2023-09-30T23:04:11.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd813f4a0 0x7fadd8156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd813f4a0 0x7fadd8156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37260/0 (socket says 172.21.15.142:37260) 2023-09-30T23:04:11.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 -- 172.21.15.142:0/1163117700 learned_addr learned my addr 172.21.15.142:0/1163117700 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:11.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd659c700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40051c0 0x7fadd81663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadcffff700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd813f030 0x7fadd8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 -- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd813f030 msgr2=0x7fadd8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd813f030 0x7fadd8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 -- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40051c0 msgr2=0x7fadd81663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40051c0 0x7fadd81663c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 -- 172.21.15.142:0/1163117700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd813d0e0 con 0x7fadd813f4a0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.877+0000 7fadd6d9d700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd813f4a0 0x7fadd8156340 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fadd0003000 tx=0x7fadd0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.878+0000 7fadce7fc700 1 -- 172.21.15.142:0/1163117700 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000ee70 con 0x7fadd813f4a0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.878+0000 7fadce7fc700 1 -- 172.21.15.142:0/1163117700 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd001f660 con 0x7fadd813f4a0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.878+0000 7fadce7fc700 1 -- 172.21.15.142:0/1163117700 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd001fa20 con 0x7fadd813f4a0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.878+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd813d3c0 con 0x7fadd813f4a0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.878+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd813d8e0 con 0x7fadd813f4a0 2023-09-30T23:04:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.879+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd8069a50 con 0x7fadd813f4a0 2023-09-30T23:04:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.879+0000 7fadce7fc700 1 -- 172.21.15.142:0/1163117700 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fadd0025070 con 0x7fadd813f4a0 2023-09-30T23:04:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.880+0000 7fadce7fc700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadb8067330 0x7fadb80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.880+0000 7fadce7fc700 1 -- 172.21.15.142:0/1163117700 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fadd0086d30 con 0x7fadd813f4a0 2023-09-30T23:04:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.881+0000 7fadd659c700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadb8067330 0x7fadb80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.881+0000 7fadd659c700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadb8067330 0x7fadb80697e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fadc8001730 tx=0x7fadc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:11.885+0000 7fadce7fc700 1 -- 172.21.15.142:0/1163117700 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fadd0053b90 con 0x7fadd813f4a0 2023-09-30T23:04:12.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.118+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fadd806fc10 con 0x7fadd813f4a0 2023-09-30T23:04:12.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.665+0000 7fadce7fc700 1 -- 172.21.15.142:0/1163117700 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v91) v1 ==== 122+0+0 (secure 0 0 0) 0x7fadd00571b0 con 0x7fadd813f4a0 2023-09-30T23:04:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadb8067330 msgr2=0x7fadb80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadb8067330 0x7fadb80697e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fadc8001730 tx=0x7fadc8009040 comp rx=0 tx=0).stop 2023-09-30T23:04:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd813f4a0 msgr2=0x7fadd8156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd813f4a0 0x7fadd8156340 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fadd0003000 tx=0x7fadd0019000 comp rx=0 tx=0).stop 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 shutdown_connections 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fadb8067330 0x7fadb80697e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd813f4a0 0x7fadd8156340 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.668+0000 7faddc9ff700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40051c0 0x7fadd81663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.669+0000 7faddc9ff700 1 --2- 172.21.15.142:0/1163117700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadd813f030 0x7fadd8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.669+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 >> 172.21.15.142:0/1163117700 conn(0x7fadd80cc670 msgr2=0x7fadd80c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.669+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 shutdown_connections 2023-09-30T23:04:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.669+0000 7faddc9ff700 1 -- 172.21.15.142:0/1163117700 wait complete. 2023-09-30T23:04:12.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:12.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.878+0000 7fb63abff700 1 Processor -- start 2023-09-30T23:04:12.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.878+0000 7fb63abff700 1 -- start start 2023-09-30T23:04:12.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.879+0000 7fb63abff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb6340cc590 0x7fb634164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.879+0000 7fb63abff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63415d910 con 0x7fb634159ae0 2023-09-30T23:04:12.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.879+0000 7fb63abff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63415e490 con 0x7fb6340b1180 2023-09-30T23:04:12.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.879+0000 7fb63abff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63415e920 con 0x7fb6340cc590 2023-09-30T23:04:12.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb63899b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb634159ae0 0x7fb6340cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37250/0 (socket says 172.21.15.142:37250) 2023-09-30T23:04:12.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb63899b700 1 -- 172.21.15.142:0/3647515127 learned_addr learned my addr 172.21.15.142:0/3647515127 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160322032 0 0) 0x7fb63415d910 con 0x7fb634159ae0 2023-09-30T23:04:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb624003570 con 0x7fb634159ae0 2023-09-30T23:04:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb63919c700 1 --2- 172.21.15.142:0/3647515127 >> v2:172.21.15.148:3300/0 conn(0x7fb6340cc590 0x7fb634164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3712208653 0 0) 0x7fb624003570 con 0x7fb634159ae0 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 >> v2:172.21.15.148:3300/0 conn(0x7fb6340cc590 msgr2=0x7fb634164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 --2- 172.21.15.142:0/3647515127 >> v2:172.21.15.148:3300/0 conn(0x7fb6340cc590 0x7fb634164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 >> v1:172.21.15.148:6789/0 conn(0x7fb6340b1180 legacy=0x7fb6340cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340ce5c0 con 0x7fb634159ae0 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fb628001470 con 0x7fb634159ae0 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.880+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 >> v1:172.21.15.142:6789/0 conn(0x7fb634159ae0 legacy=0x7fb6340cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb6337fe700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624003a60 0x7fb624003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb6337fe700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624004810 0x7fb624004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb6337fe700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6240051c0 0x7fb62400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62400c130 con 0x7fb624003a60 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62400c2a0 con 0x7fb6240051c0 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62400c460 con 0x7fb624004810 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63899b700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624003a60 0x7fb624003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63919c700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6240051c0 0x7fb62400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb633fff700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624004810 0x7fb624004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63899b700 1 -- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624004810 msgr2=0x7fb624004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63899b700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624004810 0x7fb624004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63899b700 1 -- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6240051c0 msgr2=0x7fb62400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63899b700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6240051c0 0x7fb62400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63899b700 1 -- 172.21.15.142:0/3647515127 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624003570 con 0x7fb624003a60 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.881+0000 7fb63919c700 1 -- 172.21.15.142:0/3647515127 reap_dead start 2023-09-30T23:04:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63899b700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624003a60 0x7fb624003e70 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c3c0 tx=0x7fb628001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d9b96428d0129e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800cc10 con 0x7fb624003a60 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800cd70 con 0x7fb624003a60 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb6337fe700 1 -- 172.21.15.142:0/3647515127 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628005b70 con 0x7fb624003a60 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63abff700 1 -- 172.21.15.142:0/3647515127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624003a60 msgr2=0x7fb624003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63abff700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624003a60 0x7fb624003e70 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c3c0 tx=0x7fb628001e50 comp rx=0 tx=0).stop 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63abff700 1 -- 172.21.15.142:0/3647515127 shutdown_connections 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63abff700 1 --2- 172.21.15.142:0/3647515127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624003a60 0x7fb624003e70 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63abff700 1 -- 172.21.15.142:0/3647515127 >> 172.21.15.142:0/3647515127 conn(0x7fb6340ce8b0 msgr2=0x7fb6340cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63abff700 1 -- 172.21.15.142:0/3647515127 shutdown_connections 2023-09-30T23:04:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.882+0000 7fb63abff700 1 -- 172.21.15.142:0/3647515127 wait complete. 2023-09-30T23:04:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.884+0000 7fb63abff700 1 Processor -- start 2023-09-30T23:04:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.884+0000 7fb63abff700 1 -- start start 2023-09-30T23:04:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63abff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624003a60 0x7fb634153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63abff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63416bab0 0x7fb6340cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63abff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6340cbde0 0x7fb63416ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63abff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6341538d0 con 0x7fb6340cbde0 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63abff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6340cc250 con 0x7fb63416bab0 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63abff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63416b8b0 con 0x7fb624003a60 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63919c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6340cbde0 0x7fb63416ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63919c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6340cbde0 0x7fb63416ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37288/0 (socket says 172.21.15.142:37288) 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63919c700 1 -- 172.21.15.142:0/1935992820 learned_addr learned my addr 172.21.15.142:0/1935992820 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb63899b700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624003a60 0x7fb634153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.885+0000 7fb633fff700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63416bab0 0x7fb6340cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63919c700 1 -- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624003a60 msgr2=0x7fb634153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63919c700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624003a60 0x7fb634153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63919c700 1 -- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63416bab0 msgr2=0x7fb6340cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63919c700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63416bab0 0x7fb6340cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63919c700 1 -- 172.21.15.142:0/1935992820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340c7ca0 con 0x7fb6340cbde0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63919c700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6340cbde0 0x7fb63416ab80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0094d0 tx=0x7fb62c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb630ff9700 1 -- 172.21.15.142:0/1935992820 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00e040 con 0x7fb6340cbde0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb630ff9700 1 -- 172.21.15.142:0/1935992820 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00f040 con 0x7fb6340cbde0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6340c7f80 con 0x7fb6340cbde0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb630ff9700 1 -- 172.21.15.142:0/1935992820 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00fda0 con 0x7fb6340cbde0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.886+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6340c8540 con 0x7fb6340cbde0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.887+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63406ea70 con 0x7fb6340cbde0 2023-09-30T23:04:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.888+0000 7fb630ff9700 1 -- 172.21.15.142:0/1935992820 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb62c015640 con 0x7fb6340cbde0 2023-09-30T23:04:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.889+0000 7fb630ff9700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb618067330 0x7fb6180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.890+0000 7fb630ff9700 1 -- 172.21.15.142:0/1935992820 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb62c0852b0 con 0x7fb6340cbde0 2023-09-30T23:04:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.890+0000 7fb63899b700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb618067330 0x7fb6180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.890+0000 7fb63899b700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb618067330 0x7fb6180697e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb628001e90 tx=0x7fb628015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:12.894+0000 7fb630ff9700 1 -- 172.21.15.142:0/1935992820 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb62c052110 con 0x7fb6340cbde0 2023-09-30T23:04:13.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.127+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb63415db60 con 0x7fb6340cbde0 2023-09-30T23:04:13.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.127+0000 7fb630ff9700 1 -- 172.21.15.142:0/1935992820 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fb62c055730 con 0x7fb6340cbde0 2023-09-30T23:04:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:13.128 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb618067330 msgr2=0x7fb6180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb618067330 0x7fb6180697e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb628001e90 tx=0x7fb628015000 comp rx=0 tx=0).stop 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6340cbde0 msgr2=0x7fb63416ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6340cbde0 0x7fb63416ab80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0094d0 tx=0x7fb62c00b040 comp rx=0 tx=0).stop 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 shutdown_connections 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb618067330 0x7fb6180697e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6340cbde0 0x7fb63416ab80 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb624003a60 0x7fb634153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 --2- 172.21.15.142:0/1935992820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63416bab0 0x7fb6340cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 >> 172.21.15.142:0/1935992820 conn(0x7fb6340ce8b0 msgr2=0x7fb6340b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:13.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 shutdown_connections 2023-09-30T23:04:13.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.130+0000 7fb63abff700 1 -- 172.21.15.142:0/1935992820 wait complete. 2023-09-30T23:04:13.132 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:13.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.338+0000 7f8e0f3ff700 1 Processor -- start 2023-09-30T23:04:13.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.338+0000 7f8e0f3ff700 1 -- start start 2023-09-30T23:04:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.339+0000 7f8e0f3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e0815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.339+0000 7f8e0f3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e0815a6c0 0x7f8e0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.339+0000 7f8e0f3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e080ad630 con 0x7f8e080b1580 2023-09-30T23:04:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.339+0000 7f8e0f3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e08157c20 con 0x7f8e0815a6c0 2023-09-30T23:04:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.339+0000 7f8e0f3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0815ab10 con 0x7f8e080b1950 2023-09-30T23:04:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.339+0000 7f8e0d19b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8e080b1580 0x7f8e080adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37264/0 (socket says 172.21.15.142:37264) 2023-09-30T23:04:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.339+0000 7f8e0d19b700 1 -- 172.21.15.142:0/4025446800 learned_addr learned my addr 172.21.15.142:0/4025446800 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8e0c99a700 1 --2- 172.21.15.142:0/4025446800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e0815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8e0d99c700 1 --2- 172.21.15.142:0/4025446800 >> v2:172.21.15.148:3300/0 conn(0x7f8e0815a6c0 0x7f8e0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8dfffff700 1 -- 172.21.15.142:0/4025446800 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040791963 0 0) 0x7f8e080ad630 con 0x7f8e080b1580 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8dfffff700 1 -- 172.21.15.142:0/4025446800 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df4003570 con 0x7f8e080b1580 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8e0c99a700 1 -- 172.21.15.142:0/4025446800 >> v2:172.21.15.148:3300/0 conn(0x7f8e0815a6c0 msgr2=0x7f8e0806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8e0c99a700 1 --2- 172.21.15.142:0/4025446800 >> v2:172.21.15.148:3300/0 conn(0x7f8e0815a6c0 0x7f8e0806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8e0c99a700 1 -- 172.21.15.142:0/4025446800 >> v1:172.21.15.142:6789/0 conn(0x7f8e080b1580 legacy=0x7f8e080adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8e0c99a700 1 -- 172.21.15.142:0/4025446800 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080b3360 con 0x7f8e080b1950 2023-09-30T23:04:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.340+0000 7f8e0c99a700 1 --2- 172.21.15.142:0/4025446800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e0815a180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8df80098e0 tx=0x7f8df80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611e964d39c2851f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8dfffff700 1 -- 172.21.15.142:0/4025446800 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8011630 con 0x7f8e080b1950 2023-09-30T23:04:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8dfffff700 1 -- 172.21.15.142:0/4025446800 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df8011790 con 0x7f8e080b1950 2023-09-30T23:04:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8dfffff700 1 -- 172.21.15.142:0/4025446800 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8011b30 con 0x7f8e080b1950 2023-09-30T23:04:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/4025446800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 msgr2=0x7f8e0815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/4025446800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e0815a180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8df80098e0 tx=0x7f8df80091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/4025446800 shutdown_connections 2023-09-30T23:04:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/4025446800 >> v2:172.21.15.148:3300/0 conn(0x7f8e0815a6c0 0x7f8e0806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/4025446800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e0815a180 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/4025446800 >> 172.21.15.142:0/4025446800 conn(0x7f8e080ce1f0 msgr2=0x7f8e08069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:13.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/4025446800 shutdown_connections 2023-09-30T23:04:13.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.341+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/4025446800 wait complete. 2023-09-30T23:04:13.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.343+0000 7f8e0f3ff700 1 Processor -- start 2023-09-30T23:04:13.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.343+0000 7f8e0f3ff700 1 -- start start 2023-09-30T23:04:13.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0f3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b1580 0x7f8e08146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0f3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e08155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0f3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e0815a6c0 0x7f8e08156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0f3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e08155a20 con 0x7f8e080b1580 2023-09-30T23:04:13.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0f3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0816b4f0 con 0x7f8e0815a6c0 2023-09-30T23:04:13.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0f3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0816b210 con 0x7f8e080b1950 2023-09-30T23:04:13.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0d19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b1580 0x7f8e08146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0d19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b1580 0x7f8e08146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37300/0 (socket says 172.21.15.142:37300) 2023-09-30T23:04:13.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0d19b700 1 -- 172.21.15.142:0/2059191257 learned_addr learned my addr 172.21.15.142:0/2059191257 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0d99c700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e0815a6c0 0x7f8e08156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.344+0000 7f8e0c99a700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e08155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0d19b700 1 -- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 msgr2=0x7f8e08155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0d19b700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e08155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0d19b700 1 -- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e0815a6c0 msgr2=0x7f8e08156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0d19b700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e0815a6c0 0x7f8e08156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0d19b700 1 -- 172.21.15.142:0/2059191257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df8009420 con 0x7f8e080b1580 2023-09-30T23:04:13.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0d99c700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e0815a6c0 0x7f8e08156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:13.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0d19b700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b1580 0x7f8e08146120 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c7f0 tx=0x7f8e04007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:13.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8dfd7fa700 1 -- 172.21.15.142:0/2059191257 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04005b30 con 0x7f8e080b1580 2023-09-30T23:04:13.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8dfd7fa700 1 -- 172.21.15.142:0/2059191257 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04005c90 con 0x7f8e080b1580 2023-09-30T23:04:13.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0816dcc0 con 0x7f8e080b1580 2023-09-30T23:04:13.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8dfd7fa700 1 -- 172.21.15.142:0/2059191257 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04007340 con 0x7f8e080b1580 2023-09-30T23:04:13.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.345+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0816e280 con 0x7f8e080b1580 2023-09-30T23:04:13.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.346+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0816db20 con 0x7f8e080b1580 2023-09-30T23:04:13.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.347+0000 7f8dfd7fa700 1 -- 172.21.15.142:0/2059191257 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8e0401b400 con 0x7f8e080b1580 2023-09-30T23:04:13.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.348+0000 7f8dfd7fa700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dec067330 0x7f8dec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.348+0000 7f8dfd7fa700 1 -- 172.21.15.142:0/2059191257 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e040846b0 con 0x7f8e080b1580 2023-09-30T23:04:13.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.348+0000 7f8e0c99a700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dec067330 0x7f8dec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.349+0000 7f8e0c99a700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dec067330 0x7f8dec0697e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8df80091e0 tx=0x7f8df8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:13.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.352+0000 7f8dfd7fa700 1 -- 172.21.15.142:0/2059191257 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8e0816db20 con 0x7f8e080b1580 2023-09-30T23:04:13.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.544+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e0816db20 con 0x7f8e080b1580 2023-09-30T23:04:13.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.545+0000 7f8dfd7fa700 1 -- 172.21.15.142:0/2059191257 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f8e0816db20 con 0x7f8e080b1580 2023-09-30T23:04:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:13.546 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":192,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:10.398790+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:04:06.673268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-09-30T23:04:08.101636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:13.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dec067330 msgr2=0x7f8dec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dec067330 0x7f8dec0697e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8df80091e0 tx=0x7f8df8017000 comp rx=0 tx=0).stop 2023-09-30T23:04:13.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b1580 msgr2=0x7f8e08146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b1580 0x7f8e08146120 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c7f0 tx=0x7f8e04007e00 comp rx=0 tx=0).stop 2023-09-30T23:04:13.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 shutdown_connections 2023-09-30T23:04:13.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f8dec067330 0x7f8dec0697e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e0815a6c0 0x7f8e08156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e080b1580 0x7f8e08146120 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 --2- 172.21.15.142:0/2059191257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8e080b1950 0x7f8e08155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 >> 172.21.15.142:0/2059191257 conn(0x7f8e080ce1f0 msgr2=0x7f8e080aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:13.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 shutdown_connections 2023-09-30T23:04:13.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.547+0000 7f8e0f3ff700 1 -- 172.21.15.142:0/2059191257 wait complete. 2023-09-30T23:04:13.566 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T23:04:13.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:04:13.613 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-09-30T23:04:13.613+0000 7f72caff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T23:04:13.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.757+0000 7f5f43fff700 1 Processor -- start 2023-09-30T23:04:13.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.757+0000 7f5f43fff700 1 -- start start 2023-09-30T23:04:13.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.758+0000 7f5f43fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f3c143350 0x7f5f3c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.758+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 0x7f5f3c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.758+0000 7f5f43fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c15e0b0 con 0x7f5f3c15dc50 2023-09-30T23:04:13.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.758+0000 7f5f43fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cc6b0 con 0x7f5f3c143350 2023-09-30T23:04:13.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.758+0000 7f5f43fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cb7d0 con 0x7f5f3c0692f0 2023-09-30T23:04:13.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.758+0000 7f5f4259c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5f3c15dc50 0x7f5f3c068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37278/0 (socket says 172.21.15.142:37278) 2023-09-30T23:04:13.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.758+0000 7f5f4259c700 1 -- 172.21.15.142:0/2488329595 learned_addr learned my addr 172.21.15.142:0/2488329595 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:13.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f41d9b700 1 --2- 172.21.15.142:0/2488329595 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c143350 0x7f5f3c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f4159a700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 0x7f5f3c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351572878 0 0) 0x7f5f34001490 con 0x7f5f3c15dc50 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f28003570 con 0x7f5f3c15dc50 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279079703 0 0) 0x7f5f28003570 con 0x7f5f3c15dc50 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 msgr2=0x7f5f3c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 0x7f5f3c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c143350 msgr2=0x7f5f3c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 --2- 172.21.15.142:0/2488329595 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c143350 0x7f5f3c0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0cbaa0 con 0x7f5f3c15dc50 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f5f34001980 con 0x7f5f3c15dc50 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f41d9b700 1 --2- 172.21.15.142:0/2488329595 >> v2:172.21.15.148:3300/0 conn(0x7f5f3c143350 0x7f5f3c0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:13.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 >> v1:172.21.15.142:6789/0 conn(0x7f5f3c15dc50 legacy=0x7f5f3c068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 0x7f5f28003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f28003fe0 0x7f5f28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cc6b0 con 0x7f5f28004d50 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cb7d0 con 0x7f5f28003fe0 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.759+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2800ba90 con 0x7f5f3c0692f0 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4259c700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4159a700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f28003fe0 0x7f5f28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f41d9b700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 0x7f5f28003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4259c700 1 -- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 msgr2=0x7f5f28003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4259c700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c0692f0 0x7f5f28003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4259c700 1 -- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f28003fe0 msgr2=0x7f5f28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:13.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4259c700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f28003fe0 0x7f5f28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4259c700 1 -- 172.21.15.142:0/2488329595 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28003570 con 0x7f5f28004d50 2023-09-30T23:04:13.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4159a700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f28003fe0 0x7f5f28004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:13.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f4259c700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f280051c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400ab00 tx=0x7f5f3400a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859e86d3bed3883d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:13.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400a490 con 0x7f5f28004d50 2023-09-30T23:04:13.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400c570 con 0x7f5f28004d50 2023-09-30T23:04:13.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.760+0000 7f5f40d99700 1 -- 172.21.15.142:0/2488329595 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400c930 con 0x7f5f28004d50 2023-09-30T23:04:13.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.761+0000 7f5f43fff700 1 -- 172.21.15.142:0/2488329595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 msgr2=0x7f5f280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.761+0000 7f5f43fff700 1 --2- 172.21.15.142:0/2488329595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f280051c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400ab00 tx=0x7f5f3400a1a0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.761+0000 7f5f4259c700 1 -- 172.21.15.142:0/2488329595 reap_dead start 2023-09-30T23:04:13.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.761+0000 7f5f43fff700 1 -- 172.21.15.142:0/2488329595 shutdown_connections 2023-09-30T23:04:13.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.761+0000 7f5f43fff700 1 -- 172.21.15.142:0/2488329595 >> 172.21.15.142:0/2488329595 conn(0x7f5f3c0ce8e0 msgr2=0x7f5f3c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:13.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.761+0000 7f5f43fff700 1 -- 172.21.15.142:0/2488329595 shutdown_connections 2023-09-30T23:04:13.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.761+0000 7f5f43fff700 1 -- 172.21.15.142:0/2488329595 wait complete. 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.763+0000 7f5f43fff700 1 Processor -- start 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.763+0000 7f5f43fff700 1 -- start start 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f3c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c15a590 0x7f5f3c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f43fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c15b460 0x7f5f3c13cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f43fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c13b530 con 0x7f5f28004d50 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f43fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c13dfb0 con 0x7f5f3c15a590 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f43fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c13e290 con 0x7f5f3c15b460 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f3c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f3c0b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37312/0 (socket says 172.21.15.142:37312) 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 -- 172.21.15.142:0/50104463 learned_addr learned my addr 172.21.15.142:0/50104463 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f4259c700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c15b460 0x7f5f3c13cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f4159a700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c15a590 0x7f5f3c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 -- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c15b460 msgr2=0x7f5f3c13cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c15b460 0x7f5f3c13cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 -- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c15a590 msgr2=0x7f5f3c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c15a590 0x7f5f3c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f41d9b700 1 -- 172.21.15.142:0/50104463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0b3200 con 0x7f5f28004d50 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f4159a700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c15a590 0x7f5f3c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.764+0000 7f5f4259c700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c15b460 0x7f5f3c13cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.765+0000 7f5f41d9b700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f3c0b3ce0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5f38011d70 tx=0x7f5f380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:13.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.765+0000 7f5f31ffb700 1 -- 172.21.15.142:0/50104463 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3800fcd0 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.765+0000 7f5f31ffb700 1 -- 172.21.15.142:0/50104463 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3800fe30 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.765+0000 7f5f31ffb700 1 -- 172.21.15.142:0/50104463 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3801d6d0 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.765+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c0b34e0 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.765+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c16a030 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.766+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c06ea70 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.767+0000 7f5f31ffb700 1 -- 172.21.15.142:0/50104463 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5f3801dac0 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.768+0000 7f5f31ffb700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f20067330 0x7f5f200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.768+0000 7f5f31ffb700 1 -- 172.21.15.142:0/50104463 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f38018070 con 0x7f5f28004d50 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.768+0000 7f5f4159a700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f20067330 0x7f5f200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:13.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.769+0000 7f5f4159a700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f20067330 0x7f5f200697e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c006eb0 tx=0x7f5f2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:13.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.772+0000 7f5f31ffb700 1 -- 172.21.15.142:0/50104463 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5f380529c0 con 0x7f5f28004d50 2023-09-30T23:04:13.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.957+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f3c0cbd80 con 0x7f5f20067330 2023-09-30T23:04:13.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.966+0000 7f5f31ffb700 1 -- 172.21.15.142:0/50104463 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303460 (secure 0 0 0) 0x7f5f3c0cbd80 con 0x7f5f20067330 2023-09-30T23:04:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:13.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.970+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f20067330 msgr2=0x7f5f200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.970+0000 7f5f43fff700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f20067330 0x7f5f200697e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c006eb0 tx=0x7f5f2c008040 comp rx=0 tx=0).stop 2023-09-30T23:04:13.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.970+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 msgr2=0x7f5f3c0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.970+0000 7f5f43fff700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f3c0b3ce0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5f38011d70 tx=0x7f5f380091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 shutdown_connections 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5f20067330 0x7f5f200697e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f3c15b460 0x7f5f3c13cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f28004d50 0x7f5f3c0b3ce0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 --2- 172.21.15.142:0/50104463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f3c15a590 0x7f5f3c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 >> 172.21.15.142:0/50104463 conn(0x7f5f3c0ce8e0 msgr2=0x7f5f3c0cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 shutdown_connections 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:13.971+0000 7f5f43fff700 1 -- 172.21.15.142:0/50104463 wait complete. 2023-09-30T23:04:13.974 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:04:13.989 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-09-30T23:04:12.271197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552358,"statfs":{"total":1600000000,"available":1589615532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.641370"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414218+0000","last_change":"2023-09-30T23:04:09.414150+0000","last_active":"2023-09-30T23:04:09.414218+0000","last_peered":"2023-09-30T23:04:09.414218+0000","last_clean":"2023-09-30T23:04:09.414218+0000","last_became_active":"2023-09-30T23:04:09.413812+0000","last_became_peered":"2023-09-30T23:04:09.413812+0000","last_unstale":"2023-09-30T23:04:09.414218+0000","last_undegraded":"2023-09-30T23:04:09.414218+0000","last_fullsized":"2023-09-30T23:04:09.414218+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:32.396294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414432+0000","last_change":"2023-09-30T23:04:09.414022+0000","last_active":"2023-09-30T23:04:09.414432+0000","last_peered":"2023-09-30T23:04:09.414432+0000","last_clean":"2023-09-30T23:04:09.414432+0000","last_became_active":"2023-09-30T23:04:09.413171+0000","last_became_peered":"2023-09-30T23:04:09.413171+0000","last_unstale":"2023-09-30T23:04:09.414432+0000","last_undegraded":"2023-09-30T23:04:09.414432+0000","last_fullsized":"2023-09-30T23:04:09.414432+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:58.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417979+0000","last_change":"2023-09-30T23:04:09.417916+0000","last_active":"2023-09-30T23:04:09.417979+0000","last_peered":"2023-09-30T23:04:09.417979+0000","last_clean":"2023-09-30T23:04:09.417979+0000","last_became_active":"2023-09-30T23:04:09.417679+0000","last_became_peered":"2023-09-30T23:04:09.417679+0000","last_unstale":"2023-09-30T23:04:09.417979+0000","last_undegraded":"2023-09-30T23:04:09.417979+0000","last_fullsized":"2023-09-30T23:04:09.417979+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:31.738197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414701+0000","last_change":"2023-09-30T23:04:09.412712+0000","last_active":"2023-09-30T23:04:09.414701+0000","last_peered":"2023-09-30T23:04:09.414701+0000","last_clean":"2023-09-30T23:04:09.414701+0000","last_became_active":"2023-09-30T23:04:09.412176+0000","last_became_peered":"2023-09-30T23:04:09.412176+0000","last_unstale":"2023-09-30T23:04:09.414701+0000","last_undegraded":"2023-09-30T23:04:09.414701+0000","last_fullsized":"2023-09-30T23:04:09.414701+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:38.779767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.407706+0000","last_change":"2023-09-30T23:04:09.407634+0000","last_active":"2023-09-30T23:04:09.407706+0000","last_peered":"2023-09-30T23:04:09.407706+0000","last_clean":"2023-09-30T23:04:09.407706+0000","last_became_active":"2023-09-30T23:04:09.407407+0000","last_became_peered":"2023-09-30T23:04:09.407407+0000","last_unstale":"2023-09-30T23:04:09.407706+0000","last_undegraded":"2023-09-30T23:04:09.407706+0000","last_fullsized":"2023-09-30T23:04:09.407706+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:31:47.435628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.412185+0000","last_change":"2023-09-30T23:04:09.412123+0000","last_active":"2023-09-30T23:04:09.412185+0000","last_peered":"2023-09-30T23:04:09.412185+0000","last_clean":"2023-09-30T23:04:09.412185+0000","last_became_active":"2023-09-30T23:04:09.411869+0000","last_became_peered":"2023-09-30T23:04:09.411869+0000","last_unstale":"2023-09-30T23:04:09.412185+0000","last_undegraded":"2023-09-30T23:04:09.412185+0000","last_fullsized":"2023-09-30T23:04:09.412185+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:30.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414690+0000","last_change":"2023-09-30T23:04:09.413857+0000","last_active":"2023-09-30T23:04:09.414690+0000","last_peered":"2023-09-30T23:04:09.414690+0000","last_clean":"2023-09-30T23:04:09.414690+0000","last_became_active":"2023-09-30T23:04:09.412987+0000","last_became_peered":"2023-09-30T23:04:09.412987+0000","last_unstale":"2023-09-30T23:04:09.414690+0000","last_undegraded":"2023-09-30T23:04:09.414690+0000","last_fullsized":"2023-09-30T23:04:09.414690+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:30.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410682+0000","last_change":"2023-09-30T23:04:09.410574+0000","last_active":"2023-09-30T23:04:09.410682+0000","last_peered":"2023-09-30T23:04:09.410682+0000","last_clean":"2023-09-30T23:04:09.410682+0000","last_became_active":"2023-09-30T23:04:09.410329+0000","last_became_peered":"2023-09-30T23:04:09.410329+0000","last_unstale":"2023-09-30T23:04:09.410682+0000","last_undegraded":"2023-09-30T23:04:09.410682+0000","last_fullsized":"2023-09-30T23:04:09.410682+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:05.009729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404737+0000","last_change":"2023-09-30T23:04:09.404463+0000","last_active":"2023-09-30T23:04:09.404737+0000","last_peered":"2023-09-30T23:04:09.404737+0000","last_clean":"2023-09-30T23:04:09.404737+0000","last_became_active":"2023-09-30T23:04:09.404154+0000","last_became_peered":"2023-09-30T23:04:09.404154+0000","last_unstale":"2023-09-30T23:04:09.404737+0000","last_undegraded":"2023-09-30T23:04:09.404737+0000","last_fullsized":"2023-09-30T23:04:09.404737+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:01.048507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413353+0000","last_change":"2023-09-30T23:04:09.412464+0000","last_active":"2023-09-30T23:04:09.413353+0000","last_peered":"2023-09-30T23:04:09.413353+0000","last_clean":"2023-09-30T23:04:09.413353+0000","last_became_active":"2023-09-30T23:04:09.412209+0000","last_became_peered":"2023-09-30T23:04:09.412209+0000","last_unstale":"2023-09-30T23:04:09.413353+0000","last_undegraded":"2023-09-30T23:04:09.413353+0000","last_fullsized":"2023-09-30T23:04:09.413353+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:11:05.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410105+0000","last_change":"2023-09-30T23:04:09.410040+0000","last_active":"2023-09-30T23:04:09.410105+0000","last_peered":"2023-09-30T23:04:09.410105+0000","last_clean":"2023-09-30T23:04:09.410105+0000","last_became_active":"2023-09-30T23:04:09.409802+0000","last_became_peered":"2023-09-30T23:04:09.409802+0000","last_unstale":"2023-09-30T23:04:09.410105+0000","last_undegraded":"2023-09-30T23:04:09.410105+0000","last_fullsized":"2023-09-30T23:04:09.410105+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:56.950149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415373+0000","last_change":"2023-09-30T23:04:09.415247+0000","last_active":"2023-09-30T23:04:09.415373+0000","last_peered":"2023-09-30T23:04:09.415373+0000","last_clean":"2023-09-30T23:04:09.415373+0000","last_became_active":"2023-09-30T23:04:09.414919+0000","last_became_peered":"2023-09-30T23:04:09.414919+0000","last_unstale":"2023-09-30T23:04:09.415373+0000","last_undegraded":"2023-09-30T23:04:09.415373+0000","last_fullsized":"2023-09-30T23:04:09.415373+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:59:38.353793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415188+0000","last_change":"2023-09-30T23:04:09.415115+0000","last_active":"2023-09-30T23:04:09.415188+0000","last_peered":"2023-09-30T23:04:09.415188+0000","last_clean":"2023-09-30T23:04:09.415188+0000","last_became_active":"2023-09-30T23:04:09.414869+0000","last_became_peered":"2023-09-30T23:04:09.414869+0000","last_unstale":"2023-09-30T23:04:09.415188+0000","last_undegraded":"2023-09-30T23:04:09.415188+0000","last_fullsized":"2023-09-30T23:04:09.415188+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:32:48.515916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406748+0000","last_change":"2023-09-30T23:04:09.405719+0000","last_active":"2023-09-30T23:04:09.406748+0000","last_peered":"2023-09-30T23:04:09.406748+0000","last_clean":"2023-09-30T23:04:09.406748+0000","last_became_active":"2023-09-30T23:04:09.405436+0000","last_became_peered":"2023-09-30T23:04:09.405436+0000","last_unstale":"2023-09-30T23:04:09.406748+0000","last_undegraded":"2023-09-30T23:04:09.406748+0000","last_fullsized":"2023-09-30T23:04:09.406748+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:50.985545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409082+0000","last_change":"2023-09-30T23:04:09.408484+0000","last_active":"2023-09-30T23:04:09.409082+0000","last_peered":"2023-09-30T23:04:09.409082+0000","last_clean":"2023-09-30T23:04:09.409082+0000","last_became_active":"2023-09-30T23:04:09.408274+0000","last_became_peered":"2023-09-30T23:04:09.408274+0000","last_unstale":"2023-09-30T23:04:09.409082+0000","last_undegraded":"2023-09-30T23:04:09.409082+0000","last_fullsized":"2023-09-30T23:04:09.409082+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:58.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409111+0000","last_change":"2023-09-30T23:04:09.409022+0000","last_active":"2023-09-30T23:04:09.409111+0000","last_peered":"2023-09-30T23:04:09.409111+0000","last_clean":"2023-09-30T23:04:09.409111+0000","last_became_active":"2023-09-30T23:04:09.408812+0000","last_became_peered":"2023-09-30T23:04:09.408812+0000","last_unstale":"2023-09-30T23:04:09.409111+0000","last_undegraded":"2023-09-30T23:04:09.409111+0000","last_fullsized":"2023-09-30T23:04:09.409111+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:01.446880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404767+0000","last_change":"2023-09-30T23:04:09.404606+0000","last_active":"2023-09-30T23:04:09.404767+0000","last_peered":"2023-09-30T23:04:09.404767+0000","last_clean":"2023-09-30T23:04:09.404767+0000","last_became_active":"2023-09-30T23:04:09.404025+0000","last_became_peered":"2023-09-30T23:04:09.404025+0000","last_unstale":"2023-09-30T23:04:09.404767+0000","last_undegraded":"2023-09-30T23:04:09.404767+0000","last_fullsized":"2023-09-30T23:04:09.404767+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:49.655153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.408839+0000","last_change":"2023-09-30T23:04:09.408094+0000","last_active":"2023-09-30T23:04:09.408839+0000","last_peered":"2023-09-30T23:04:09.408839+0000","last_clean":"2023-09-30T23:04:09.408839+0000","last_became_active":"2023-09-30T23:04:09.407823+0000","last_became_peered":"2023-09-30T23:04:09.407823+0000","last_unstale":"2023-09-30T23:04:09.408839+0000","last_undegraded":"2023-09-30T23:04:09.408839+0000","last_fullsized":"2023-09-30T23:04:09.408839+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:17.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415033+0000","last_change":"2023-09-30T23:04:09.414940+0000","last_active":"2023-09-30T23:04:09.415033+0000","last_peered":"2023-09-30T23:04:09.415033+0000","last_clean":"2023-09-30T23:04:09.415033+0000","last_became_active":"2023-09-30T23:04:09.414568+0000","last_became_peered":"2023-09-30T23:04:09.414568+0000","last_unstale":"2023-09-30T23:04:09.415033+0000","last_undegraded":"2023-09-30T23:04:09.415033+0000","last_fullsized":"2023-09-30T23:04:09.415033+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:56.950149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409183+0000","last_change":"2023-09-30T23:04:09.408825+0000","last_active":"2023-09-30T23:04:09.409183+0000","last_peered":"2023-09-30T23:04:09.409183+0000","last_clean":"2023-09-30T23:04:09.409183+0000","last_became_active":"2023-09-30T23:04:09.408588+0000","last_became_peered":"2023-09-30T23:04:09.408588+0000","last_unstale":"2023-09-30T23:04:09.409183+0000","last_undegraded":"2023-09-30T23:04:09.409183+0000","last_fullsized":"2023-09-30T23:04:09.409183+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:07.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415277+0000","last_change":"2023-09-30T23:04:09.415196+0000","last_active":"2023-09-30T23:04:09.415277+0000","last_peered":"2023-09-30T23:04:09.415277+0000","last_clean":"2023-09-30T23:04:09.415277+0000","last_became_active":"2023-09-30T23:04:09.414945+0000","last_became_peered":"2023-09-30T23:04:09.414945+0000","last_unstale":"2023-09-30T23:04:09.415277+0000","last_undegraded":"2023-09-30T23:04:09.415277+0000","last_fullsized":"2023-09-30T23:04:09.415277+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:02.662728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415109+0000","last_change":"2023-09-30T23:04:09.415039+0000","last_active":"2023-09-30T23:04:09.415109+0000","last_peered":"2023-09-30T23:04:09.415109+0000","last_clean":"2023-09-30T23:04:09.415109+0000","last_became_active":"2023-09-30T23:04:09.414683+0000","last_became_peered":"2023-09-30T23:04:09.414683+0000","last_unstale":"2023-09-30T23:04:09.415109+0000","last_undegraded":"2023-09-30T23:04:09.415109+0000","last_fullsized":"2023-09-30T23:04:09.415109+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:19.498286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413377+0000","last_change":"2023-09-30T23:04:09.413276+0000","last_active":"2023-09-30T23:04:09.413377+0000","last_peered":"2023-09-30T23:04:09.413377+0000","last_clean":"2023-09-30T23:04:09.413377+0000","last_became_active":"2023-09-30T23:04:09.411917+0000","last_became_peered":"2023-09-30T23:04:09.411917+0000","last_unstale":"2023-09-30T23:04:09.413377+0000","last_undegraded":"2023-09-30T23:04:09.413377+0000","last_fullsized":"2023-09-30T23:04:09.413377+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:26.850603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415017+0000","last_change":"2023-09-30T23:04:09.414795+0000","last_active":"2023-09-30T23:04:09.415017+0000","last_peered":"2023-09-30T23:04:09.415017+0000","last_clean":"2023-09-30T23:04:09.415017+0000","last_became_active":"2023-09-30T23:04:09.414235+0000","last_became_peered":"2023-09-30T23:04:09.414235+0000","last_unstale":"2023-09-30T23:04:09.415017+0000","last_undegraded":"2023-09-30T23:04:09.415017+0000","last_fullsized":"2023-09-30T23:04:09.415017+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:10.392690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414722+0000","last_change":"2023-09-30T23:04:09.414247+0000","last_active":"2023-09-30T23:04:09.414722+0000","last_peered":"2023-09-30T23:04:09.414722+0000","last_clean":"2023-09-30T23:04:09.414722+0000","last_became_active":"2023-09-30T23:04:09.413981+0000","last_became_peered":"2023-09-30T23:04:09.413981+0000","last_unstale":"2023-09-30T23:04:09.414722+0000","last_undegraded":"2023-09-30T23:04:09.414722+0000","last_fullsized":"2023-09-30T23:04:09.414722+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:54:48.858457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.411216+0000","last_change":"2023-09-30T23:04:09.410700+0000","last_active":"2023-09-30T23:04:09.411216+0000","last_peered":"2023-09-30T23:04:09.411216+0000","last_clean":"2023-09-30T23:04:09.411216+0000","last_became_active":"2023-09-30T23:04:09.410442+0000","last_became_peered":"2023-09-30T23:04:09.410442+0000","last_unstale":"2023-09-30T23:04:09.411216+0000","last_undegraded":"2023-09-30T23:04:09.411216+0000","last_fullsized":"2023-09-30T23:04:09.411216+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:55.014714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414467+0000","last_change":"2023-09-30T23:04:09.414288+0000","last_active":"2023-09-30T23:04:09.414467+0000","last_peered":"2023-09-30T23:04:09.414467+0000","last_clean":"2023-09-30T23:04:09.414467+0000","last_became_active":"2023-09-30T23:04:09.413789+0000","last_became_peered":"2023-09-30T23:04:09.413789+0000","last_unstale":"2023-09-30T23:04:09.414467+0000","last_undegraded":"2023-09-30T23:04:09.414467+0000","last_fullsized":"2023-09-30T23:04:09.414467+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:30.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414633+0000","last_change":"2023-09-30T23:04:09.412652+0000","last_active":"2023-09-30T23:04:09.414633+0000","last_peered":"2023-09-30T23:04:09.414633+0000","last_clean":"2023-09-30T23:04:09.414633+0000","last_became_active":"2023-09-30T23:04:09.412091+0000","last_became_peered":"2023-09-30T23:04:09.412091+0000","last_unstale":"2023-09-30T23:04:09.414633+0000","last_undegraded":"2023-09-30T23:04:09.414633+0000","last_fullsized":"2023-09-30T23:04:09.414633+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:47:50.550095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.418922+0000","last_change":"2023-09-30T23:04:09.418864+0000","last_active":"2023-09-30T23:04:09.418922+0000","last_peered":"2023-09-30T23:04:09.418922+0000","last_clean":"2023-09-30T23:04:09.418922+0000","last_became_active":"2023-09-30T23:04:09.418545+0000","last_became_peered":"2023-09-30T23:04:09.418545+0000","last_unstale":"2023-09-30T23:04:09.418922+0000","last_undegraded":"2023-09-30T23:04:09.418922+0000","last_fullsized":"2023-09-30T23:04:09.418922+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:01.048507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.412950+0000","last_change":"2023-09-30T23:04:09.412888+0000","last_active":"2023-09-30T23:04:09.412950+0000","last_peered":"2023-09-30T23:04:09.412950+0000","last_clean":"2023-09-30T23:04:09.412950+0000","last_became_active":"2023-09-30T23:04:09.412668+0000","last_became_peered":"2023-09-30T23:04:09.412668+0000","last_unstale":"2023-09-30T23:04:09.412950+0000","last_undegraded":"2023-09-30T23:04:09.412950+0000","last_fullsized":"2023-09-30T23:04:09.412950+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:47:50.550095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409503+0000","last_change":"2023-09-30T23:04:09.409398+0000","last_active":"2023-09-30T23:04:09.409503+0000","last_peered":"2023-09-30T23:04:09.409503+0000","last_clean":"2023-09-30T23:04:09.409503+0000","last_became_active":"2023-09-30T23:04:09.409054+0000","last_became_peered":"2023-09-30T23:04:09.409054+0000","last_unstale":"2023-09-30T23:04:09.409503+0000","last_undegraded":"2023-09-30T23:04:09.409503+0000","last_fullsized":"2023-09-30T23:04:09.409503+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:10.324874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414452+0000","last_change":"2023-09-30T23:04:09.414164+0000","last_active":"2023-09-30T23:04:09.414452+0000","last_peered":"2023-09-30T23:04:09.414452+0000","last_clean":"2023-09-30T23:04:09.414452+0000","last_became_active":"2023-09-30T23:04:09.413447+0000","last_became_peered":"2023-09-30T23:04:09.413447+0000","last_unstale":"2023-09-30T23:04:09.414452+0000","last_undegraded":"2023-09-30T23:04:09.414452+0000","last_fullsized":"2023-09-30T23:04:09.414452+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:01.446880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413307+0000","last_change":"2023-09-30T23:04:09.413201+0000","last_active":"2023-09-30T23:04:09.413307+0000","last_peered":"2023-09-30T23:04:09.413307+0000","last_clean":"2023-09-30T23:04:09.413307+0000","last_became_active":"2023-09-30T23:04:09.412979+0000","last_became_peered":"2023-09-30T23:04:09.412979+0000","last_unstale":"2023-09-30T23:04:09.413307+0000","last_undegraded":"2023-09-30T23:04:09.413307+0000","last_fullsized":"2023-09-30T23:04:09.413307+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:32.396294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649273+0000","last_change":"2023-09-30T23:04:08.650447+0000","last_active":"2023-09-30T23:04:09.649273+0000","last_peered":"2023-09-30T23:04:09.649273+0000","last_clean":"2023-09-30T23:04:09.649273+0000","last_became_active":"2023-09-30T23:04:08.650239+0000","last_became_peered":"2023-09-30T23:04:08.650239+0000","last_unstale":"2023-09-30T23:04:09.649273+0000","last_undegraded":"2023-09-30T23:04:09.649273+0000","last_fullsized":"2023-09-30T23:04:09.649273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:55:09.836272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.416720+0000","last_change":"2023-09-30T23:04:09.416357+0000","last_active":"2023-09-30T23:04:09.416720+0000","last_peered":"2023-09-30T23:04:09.416720+0000","last_clean":"2023-09-30T23:04:09.416720+0000","last_became_active":"2023-09-30T23:04:09.413639+0000","last_became_peered":"2023-09-30T23:04:09.413639+0000","last_unstale":"2023-09-30T23:04:09.416720+0000","last_undegraded":"2023-09-30T23:04:09.416720+0000","last_fullsized":"2023-09-30T23:04:09.416720+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:45.094761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646829+0000","last_change":"2023-09-30T23:04:08.646440+0000","last_active":"2023-09-30T23:04:09.646829+0000","last_peered":"2023-09-30T23:04:09.646829+0000","last_clean":"2023-09-30T23:04:09.646829+0000","last_became_active":"2023-09-30T23:04:08.645271+0000","last_became_peered":"2023-09-30T23:04:08.645271+0000","last_unstale":"2023-09-30T23:04:09.646829+0000","last_undegraded":"2023-09-30T23:04:09.646829+0000","last_fullsized":"2023-09-30T23:04:09.646829+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:21.785949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413777+0000","last_change":"2023-09-30T23:04:09.413676+0000","last_active":"2023-09-30T23:04:09.413777+0000","last_peered":"2023-09-30T23:04:09.413777+0000","last_clean":"2023-09-30T23:04:09.413777+0000","last_became_active":"2023-09-30T23:04:09.412729+0000","last_became_peered":"2023-09-30T23:04:09.412729+0000","last_unstale":"2023-09-30T23:04:09.413777+0000","last_undegraded":"2023-09-30T23:04:09.413777+0000","last_fullsized":"2023-09-30T23:04:09.413777+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:49:22.756017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1d","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646263+0000","last_change":"2023-09-30T23:04:08.645041+0000","last_active":"2023-09-30T23:04:09.646263+0000","last_peered":"2023-09-30T23:04:09.646263+0000","last_clean":"2023-09-30T23:04:09.646263+0000","last_became_active":"2023-09-30T23:04:08.644786+0000","last_became_peered":"2023-09-30T23:04:08.644786+0000","last_unstale":"2023-09-30T23:04:09.646263+0000","last_undegraded":"2023-09-30T23:04:09.646263+0000","last_fullsized":"2023-09-30T23:04:09.646263+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:09:58.786780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409472+0000","last_change":"2023-09-30T23:04:09.408604+0000","last_active":"2023-09-30T23:04:09.409472+0000","last_peered":"2023-09-30T23:04:09.409472+0000","last_clean":"2023-09-30T23:04:09.409472+0000","last_became_active":"2023-09-30T23:04:09.408319+0000","last_became_peered":"2023-09-30T23:04:09.408319+0000","last_unstale":"2023-09-30T23:04:09.409472+0000","last_undegraded":"2023-09-30T23:04:09.409472+0000","last_fullsized":"2023-09-30T23:04:09.409472+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:09:24.460016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649569+0000","last_change":"2023-09-30T23:04:08.654310+0000","last_active":"2023-09-30T23:04:09.649569+0000","last_peered":"2023-09-30T23:04:09.649569+0000","last_clean":"2023-09-30T23:04:09.649569+0000","last_became_active":"2023-09-30T23:04:08.653542+0000","last_became_peered":"2023-09-30T23:04:08.653542+0000","last_unstale":"2023-09-30T23:04:09.649569+0000","last_undegraded":"2023-09-30T23:04:09.649569+0000","last_fullsized":"2023-09-30T23:04:09.649569+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:16:59.525035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.419587+0000","last_change":"2023-09-30T23:04:09.419490+0000","last_active":"2023-09-30T23:04:09.419587+0000","last_peered":"2023-09-30T23:04:09.419587+0000","last_clean":"2023-09-30T23:04:09.419587+0000","last_became_active":"2023-09-30T23:04:09.419205+0000","last_became_peered":"2023-09-30T23:04:09.419205+0000","last_unstale":"2023-09-30T23:04:09.419587+0000","last_undegraded":"2023-09-30T23:04:09.419587+0000","last_fullsized":"2023-09-30T23:04:09.419587+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:56.950149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649864+0000","last_change":"2023-09-30T23:04:08.654341+0000","last_active":"2023-09-30T23:04:09.649864+0000","last_peered":"2023-09-30T23:04:09.649864+0000","last_clean":"2023-09-30T23:04:09.649864+0000","last_became_active":"2023-09-30T23:04:08.653787+0000","last_became_peered":"2023-09-30T23:04:08.653787+0000","last_unstale":"2023-09-30T23:04:09.649864+0000","last_undegraded":"2023-09-30T23:04:09.649864+0000","last_fullsized":"2023-09-30T23:04:09.649864+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:50.147954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417875+0000","last_change":"2023-09-30T23:04:09.417296+0000","last_active":"2023-09-30T23:04:09.417875+0000","last_peered":"2023-09-30T23:04:09.417875+0000","last_clean":"2023-09-30T23:04:09.417875+0000","last_became_active":"2023-09-30T23:04:09.416568+0000","last_became_peered":"2023-09-30T23:04:09.416568+0000","last_unstale":"2023-09-30T23:04:09.417875+0000","last_undegraded":"2023-09-30T23:04:09.417875+0000","last_fullsized":"2023-09-30T23:04:09.417875+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:32.396294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1a","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646113+0000","last_change":"2023-09-30T23:04:08.641729+0000","last_active":"2023-09-30T23:04:09.646113+0000","last_peered":"2023-09-30T23:04:09.646113+0000","last_clean":"2023-09-30T23:04:09.646113+0000","last_became_active":"2023-09-30T23:04:08.641477+0000","last_became_peered":"2023-09-30T23:04:08.641477+0000","last_unstale":"2023-09-30T23:04:09.646113+0000","last_undegraded":"2023-09-30T23:04:09.646113+0000","last_fullsized":"2023-09-30T23:04:09.646113+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:55.452822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405158+0000","last_change":"2023-09-30T23:04:09.404763+0000","last_active":"2023-09-30T23:04:09.405158+0000","last_peered":"2023-09-30T23:04:09.405158+0000","last_clean":"2023-09-30T23:04:09.405158+0000","last_became_active":"2023-09-30T23:04:09.404371+0000","last_became_peered":"2023-09-30T23:04:09.404371+0000","last_unstale":"2023-09-30T23:04:09.405158+0000","last_undegraded":"2023-09-30T23:04:09.405158+0000","last_fullsized":"2023-09-30T23:04:09.405158+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:34:57.616092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406235+0000","last_change":"2023-09-30T23:04:08.646585+0000","last_active":"2023-09-30T23:04:09.406235+0000","last_peered":"2023-09-30T23:04:09.406235+0000","last_clean":"2023-09-30T23:04:09.406235+0000","last_became_active":"2023-09-30T23:04:08.645625+0000","last_became_peered":"2023-09-30T23:04:08.645625+0000","last_unstale":"2023-09-30T23:04:09.406235+0000","last_undegraded":"2023-09-30T23:04:09.406235+0000","last_fullsized":"2023-09-30T23:04:09.406235+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:16.336767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410020+0000","last_change":"2023-09-30T23:04:09.409956+0000","last_active":"2023-09-30T23:04:09.410020+0000","last_peered":"2023-09-30T23:04:09.410020+0000","last_clean":"2023-09-30T23:04:09.410020+0000","last_became_active":"2023-09-30T23:04:09.409724+0000","last_became_peered":"2023-09-30T23:04:09.409724+0000","last_unstale":"2023-09-30T23:04:09.410020+0000","last_undegraded":"2023-09-30T23:04:09.410020+0000","last_fullsized":"2023-09-30T23:04:09.410020+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:22.796815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.402679+0000","last_change":"2023-09-30T23:04:08.648876+0000","last_active":"2023-09-30T23:04:09.402679+0000","last_peered":"2023-09-30T23:04:09.402679+0000","last_clean":"2023-09-30T23:04:09.402679+0000","last_became_active":"2023-09-30T23:04:08.648643+0000","last_became_peered":"2023-09-30T23:04:08.648643+0000","last_unstale":"2023-09-30T23:04:09.402679+0000","last_undegraded":"2023-09-30T23:04:09.402679+0000","last_fullsized":"2023-09-30T23:04:09.402679+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:28:28.962255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.408573+0000","last_change":"2023-09-30T23:04:09.408502+0000","last_active":"2023-09-30T23:04:09.408573+0000","last_peered":"2023-09-30T23:04:09.408573+0000","last_clean":"2023-09-30T23:04:09.408573+0000","last_became_active":"2023-09-30T23:04:09.408271+0000","last_became_peered":"2023-09-30T23:04:09.408271+0000","last_unstale":"2023-09-30T23:04:09.408573+0000","last_undegraded":"2023-09-30T23:04:09.408573+0000","last_fullsized":"2023-09-30T23:04:09.408573+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:54:13.538114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646320+0000","last_change":"2023-09-30T23:04:08.651753+0000","last_active":"2023-09-30T23:04:09.646320+0000","last_peered":"2023-09-30T23:04:09.646320+0000","last_clean":"2023-09-30T23:04:09.646320+0000","last_became_active":"2023-09-30T23:04:08.651426+0000","last_became_peered":"2023-09-30T23:04:08.651426+0000","last_unstale":"2023-09-30T23:04:09.646320+0000","last_undegraded":"2023-09-30T23:04:09.646320+0000","last_fullsized":"2023-09-30T23:04:09.646320+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:46:32.070477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415476+0000","last_change":"2023-09-30T23:04:09.415245+0000","last_active":"2023-09-30T23:04:09.415476+0000","last_peered":"2023-09-30T23:04:09.415476+0000","last_clean":"2023-09-30T23:04:09.415476+0000","last_became_active":"2023-09-30T23:04:09.415024+0000","last_became_peered":"2023-09-30T23:04:09.415024+0000","last_unstale":"2023-09-30T23:04:09.415476+0000","last_undegraded":"2023-09-30T23:04:09.415476+0000","last_fullsized":"2023-09-30T23:04:09.415476+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:10.392690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.648998+0000","last_change":"2023-09-30T23:04:08.648943+0000","last_active":"2023-09-30T23:04:09.648998+0000","last_peered":"2023-09-30T23:04:09.648998+0000","last_clean":"2023-09-30T23:04:09.648998+0000","last_became_active":"2023-09-30T23:04:08.648245+0000","last_became_peered":"2023-09-30T23:04:08.648245+0000","last_unstale":"2023-09-30T23:04:09.648998+0000","last_undegraded":"2023-09-30T23:04:09.648998+0000","last_fullsized":"2023-09-30T23:04:09.648998+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:31.385429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415093+0000","last_change":"2023-09-30T23:04:09.414905+0000","last_active":"2023-09-30T23:04:09.415093+0000","last_peered":"2023-09-30T23:04:09.415093+0000","last_clean":"2023-09-30T23:04:09.415093+0000","last_became_active":"2023-09-30T23:04:09.414317+0000","last_became_peered":"2023-09-30T23:04:09.414317+0000","last_unstale":"2023-09-30T23:04:09.415093+0000","last_undegraded":"2023-09-30T23:04:09.415093+0000","last_fullsized":"2023-09-30T23:04:09.415093+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:10:06.080599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649791+0000","last_change":"2023-09-30T23:04:08.651073+0000","last_active":"2023-09-30T23:04:09.649791+0000","last_peered":"2023-09-30T23:04:09.649791+0000","last_clean":"2023-09-30T23:04:09.649791+0000","last_became_active":"2023-09-30T23:04:08.650832+0000","last_became_peered":"2023-09-30T23:04:08.650832+0000","last_unstale":"2023-09-30T23:04:09.649791+0000","last_undegraded":"2023-09-30T23:04:09.649791+0000","last_fullsized":"2023-09-30T23:04:09.649791+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:37:25.770548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414202+0000","last_change":"2023-09-30T23:04:09.414014+0000","last_active":"2023-09-30T23:04:09.414202+0000","last_peered":"2023-09-30T23:04:09.414202+0000","last_clean":"2023-09-30T23:04:09.414202+0000","last_became_active":"2023-09-30T23:04:09.413136+0000","last_became_peered":"2023-09-30T23:04:09.413136+0000","last_unstale":"2023-09-30T23:04:09.414202+0000","last_undegraded":"2023-09-30T23:04:09.414202+0000","last_fullsized":"2023-09-30T23:04:09.414202+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:31.738197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.411420+0000","last_change":"2023-09-30T23:04:08.643197+0000","last_active":"2023-09-30T23:04:09.411420+0000","last_peered":"2023-09-30T23:04:09.411420+0000","last_clean":"2023-09-30T23:04:09.411420+0000","last_became_active":"2023-09-30T23:04:08.642967+0000","last_became_peered":"2023-09-30T23:04:08.642967+0000","last_unstale":"2023-09-30T23:04:09.411420+0000","last_undegraded":"2023-09-30T23:04:09.411420+0000","last_fullsized":"2023-09-30T23:04:09.411420+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:20.255104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417914+0000","last_change":"2023-09-30T23:04:09.417574+0000","last_active":"2023-09-30T23:04:09.417914+0000","last_peered":"2023-09-30T23:04:09.417914+0000","last_clean":"2023-09-30T23:04:09.417914+0000","last_became_active":"2023-09-30T23:04:09.417071+0000","last_became_peered":"2023-09-30T23:04:09.417071+0000","last_unstale":"2023-09-30T23:04:09.417914+0000","last_undegraded":"2023-09-30T23:04:09.417914+0000","last_fullsized":"2023-09-30T23:04:09.417914+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:58.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.b","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649886+0000","last_change":"2023-09-30T23:04:08.646492+0000","last_active":"2023-09-30T23:04:09.649886+0000","last_peered":"2023-09-30T23:04:09.649886+0000","last_clean":"2023-09-30T23:04:09.649886+0000","last_became_active":"2023-09-30T23:04:08.646037+0000","last_became_peered":"2023-09-30T23:04:08.646037+0000","last_unstale":"2023-09-30T23:04:09.649886+0000","last_undegraded":"2023-09-30T23:04:09.649886+0000","last_fullsized":"2023-09-30T23:04:09.649886+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:43:05.907881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404543+0000","last_change":"2023-09-30T23:04:09.404476+0000","last_active":"2023-09-30T23:04:09.404543+0000","last_peered":"2023-09-30T23:04:09.404543+0000","last_clean":"2023-09-30T23:04:09.404543+0000","last_became_active":"2023-09-30T23:04:09.404250+0000","last_became_peered":"2023-09-30T23:04:09.404250+0000","last_unstale":"2023-09-30T23:04:09.404543+0000","last_undegraded":"2023-09-30T23:04:09.404543+0000","last_fullsized":"2023-09-30T23:04:09.404543+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:18.130583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410335+0000","last_change":"2023-09-30T23:04:08.651302+0000","last_active":"2023-09-30T23:04:09.410335+0000","last_peered":"2023-09-30T23:04:09.410335+0000","last_clean":"2023-09-30T23:04:09.410335+0000","last_became_active":"2023-09-30T23:04:08.651081+0000","last_became_peered":"2023-09-30T23:04:08.651081+0000","last_unstale":"2023-09-30T23:04:09.410335+0000","last_undegraded":"2023-09-30T23:04:09.410335+0000","last_fullsized":"2023-09-30T23:04:09.410335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:51:03.522141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405063+0000","last_change":"2023-09-30T23:04:09.404985+0000","last_active":"2023-09-30T23:04:09.405063+0000","last_peered":"2023-09-30T23:04:09.405063+0000","last_clean":"2023-09-30T23:04:09.405063+0000","last_became_active":"2023-09-30T23:04:09.404596+0000","last_became_peered":"2023-09-30T23:04:09.404596+0000","last_unstale":"2023-09-30T23:04:09.405063+0000","last_undegraded":"2023-09-30T23:04:09.405063+0000","last_fullsized":"2023-09-30T23:04:09.405063+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:38:13.212432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.401019+0000","last_change":"2023-09-30T23:04:08.651306+0000","last_active":"2023-09-30T23:04:09.401019+0000","last_peered":"2023-09-30T23:04:09.401019+0000","last_clean":"2023-09-30T23:04:09.401019+0000","last_became_active":"2023-09-30T23:04:08.651035+0000","last_became_peered":"2023-09-30T23:04:08.651035+0000","last_unstale":"2023-09-30T23:04:09.401019+0000","last_undegraded":"2023-09-30T23:04:09.401019+0000","last_fullsized":"2023-09-30T23:04:09.401019+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:57.648150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417338+0000","last_change":"2023-09-30T23:04:09.417145+0000","last_active":"2023-09-30T23:04:09.417338+0000","last_peered":"2023-09-30T23:04:09.417338+0000","last_clean":"2023-09-30T23:04:09.417338+0000","last_became_active":"2023-09-30T23:04:09.416421+0000","last_became_peered":"2023-09-30T23:04:09.416421+0000","last_unstale":"2023-09-30T23:04:09.417338+0000","last_undegraded":"2023-09-30T23:04:09.417338+0000","last_fullsized":"2023-09-30T23:04:09.417338+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:21.265969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409058+0000","last_change":"2023-09-30T23:04:08.649642+0000","last_active":"2023-09-30T23:04:09.409058+0000","last_peered":"2023-09-30T23:04:09.409058+0000","last_clean":"2023-09-30T23:04:09.409058+0000","last_became_active":"2023-09-30T23:04:08.649297+0000","last_became_peered":"2023-09-30T23:04:08.649297+0000","last_unstale":"2023-09-30T23:04:09.409058+0000","last_undegraded":"2023-09-30T23:04:09.409058+0000","last_fullsized":"2023-09-30T23:04:09.409058+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:49.974680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415860+0000","last_change":"2023-09-30T23:04:09.414269+0000","last_active":"2023-09-30T23:04:09.415860+0000","last_peered":"2023-09-30T23:04:09.415860+0000","last_clean":"2023-09-30T23:04:09.415860+0000","last_became_active":"2023-09-30T23:04:09.413780+0000","last_became_peered":"2023-09-30T23:04:09.413780+0000","last_unstale":"2023-09-30T23:04:09.415860+0000","last_undegraded":"2023-09-30T23:04:09.415860+0000","last_fullsized":"2023-09-30T23:04:09.415860+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:26.850603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646919+0000","last_change":"2023-09-30T23:04:08.646678+0000","last_active":"2023-09-30T23:04:09.646919+0000","last_peered":"2023-09-30T23:04:09.646919+0000","last_clean":"2023-09-30T23:04:09.646919+0000","last_became_active":"2023-09-30T23:04:08.646404+0000","last_became_peered":"2023-09-30T23:04:08.646404+0000","last_unstale":"2023-09-30T23:04:09.646919+0000","last_undegraded":"2023-09-30T23:04:09.646919+0000","last_fullsized":"2023-09-30T23:04:09.646919+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:32:47.505050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415234+0000","last_change":"2023-09-30T23:04:09.414137+0000","last_active":"2023-09-30T23:04:09.415234+0000","last_peered":"2023-09-30T23:04:09.415234+0000","last_clean":"2023-09-30T23:04:09.415234+0000","last_became_active":"2023-09-30T23:04:09.413915+0000","last_became_peered":"2023-09-30T23:04:09.413915+0000","last_unstale":"2023-09-30T23:04:09.415234+0000","last_undegraded":"2023-09-30T23:04:09.415234+0000","last_fullsized":"2023-09-30T23:04:09.415234+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:51.774720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.403299+0000","last_change":"2023-09-30T23:04:08.652990+0000","last_active":"2023-09-30T23:04:09.403299+0000","last_peered":"2023-09-30T23:04:09.403299+0000","last_clean":"2023-09-30T23:04:09.403299+0000","last_became_active":"2023-09-30T23:04:08.652752+0000","last_became_peered":"2023-09-30T23:04:08.652752+0000","last_unstale":"2023-09-30T23:04:09.403299+0000","last_undegraded":"2023-09-30T23:04:09.403299+0000","last_fullsized":"2023-09-30T23:04:09.403299+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:16.562516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413120+0000","last_change":"2023-09-30T23:04:09.412880+0000","last_active":"2023-09-30T23:04:09.413120+0000","last_peered":"2023-09-30T23:04:09.413120+0000","last_clean":"2023-09-30T23:04:09.413120+0000","last_became_active":"2023-09-30T23:04:09.412648+0000","last_became_peered":"2023-09-30T23:04:09.412648+0000","last_unstale":"2023-09-30T23:04:09.413120+0000","last_undegraded":"2023-09-30T23:04:09.413120+0000","last_fullsized":"2023-09-30T23:04:09.413120+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:02.462735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406352+0000","last_change":"2023-09-30T23:04:08.645842+0000","last_active":"2023-09-30T23:04:09.406352+0000","last_peered":"2023-09-30T23:04:09.406352+0000","last_clean":"2023-09-30T23:04:09.406352+0000","last_became_active":"2023-09-30T23:04:08.644768+0000","last_became_peered":"2023-09-30T23:04:08.644768+0000","last_unstale":"2023-09-30T23:04:09.406352+0000","last_undegraded":"2023-09-30T23:04:09.406352+0000","last_fullsized":"2023-09-30T23:04:09.406352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:54:47.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414655+0000","last_change":"2023-09-30T23:04:09.412794+0000","last_active":"2023-09-30T23:04:09.414655+0000","last_peered":"2023-09-30T23:04:09.414655+0000","last_clean":"2023-09-30T23:04:09.414655+0000","last_became_active":"2023-09-30T23:04:09.412412+0000","last_became_peered":"2023-09-30T23:04:09.412412+0000","last_unstale":"2023-09-30T23:04:09.414655+0000","last_undegraded":"2023-09-30T23:04:09.414655+0000","last_fullsized":"2023-09-30T23:04:09.414655+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:31.738197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.407264+0000","last_change":"2023-09-30T23:04:08.649528+0000","last_active":"2023-09-30T23:04:09.407264+0000","last_peered":"2023-09-30T23:04:09.407264+0000","last_clean":"2023-09-30T23:04:09.407264+0000","last_became_active":"2023-09-30T23:04:08.649299+0000","last_became_peered":"2023-09-30T23:04:08.649299+0000","last_unstale":"2023-09-30T23:04:09.407264+0000","last_undegraded":"2023-09-30T23:04:09.407264+0000","last_fullsized":"2023-09-30T23:04:09.407264+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:55.939283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417354+0000","last_change":"2023-09-30T23:04:09.417281+0000","last_active":"2023-09-30T23:04:09.417354+0000","last_peered":"2023-09-30T23:04:09.417354+0000","last_clean":"2023-09-30T23:04:09.417354+0000","last_became_active":"2023-09-30T23:04:09.416918+0000","last_became_peered":"2023-09-30T23:04:09.416918+0000","last_unstale":"2023-09-30T23:04:09.417354+0000","last_undegraded":"2023-09-30T23:04:09.417354+0000","last_fullsized":"2023-09-30T23:04:09.417354+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:56.463688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409152+0000","last_change":"2023-09-30T23:04:08.651961+0000","last_active":"2023-09-30T23:04:09.409152+0000","last_peered":"2023-09-30T23:04:09.409152+0000","last_clean":"2023-09-30T23:04:09.409152+0000","last_became_active":"2023-09-30T23:04:08.651742+0000","last_became_peered":"2023-09-30T23:04:08.651742+0000","last_unstale":"2023-09-30T23:04:09.409152+0000","last_undegraded":"2023-09-30T23:04:09.409152+0000","last_fullsized":"2023-09-30T23:04:09.409152+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:38:12.201566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415878+0000","last_change":"2023-09-30T23:04:09.414403+0000","last_active":"2023-09-30T23:04:09.415878+0000","last_peered":"2023-09-30T23:04:09.415878+0000","last_clean":"2023-09-30T23:04:09.415878+0000","last_became_active":"2023-09-30T23:04:09.414061+0000","last_became_peered":"2023-09-30T23:04:09.414061+0000","last_unstale":"2023-09-30T23:04:09.415878+0000","last_undegraded":"2023-09-30T23:04:09.415878+0000","last_fullsized":"2023-09-30T23:04:09.415878+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:11:05.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.408743+0000","last_change":"2023-09-30T23:04:08.654495+0000","last_active":"2023-09-30T23:04:09.408743+0000","last_peered":"2023-09-30T23:04:09.408743+0000","last_clean":"2023-09-30T23:04:09.408743+0000","last_became_active":"2023-09-30T23:04:08.654133+0000","last_became_peered":"2023-09-30T23:04:08.654133+0000","last_unstale":"2023-09-30T23:04:09.408743+0000","last_undegraded":"2023-09-30T23:04:09.408743+0000","last_fullsized":"2023-09-30T23:04:09.408743+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.394446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410991+0000","last_change":"2023-09-30T23:04:09.410923+0000","last_active":"2023-09-30T23:04:09.410991+0000","last_peered":"2023-09-30T23:04:09.410991+0000","last_clean":"2023-09-30T23:04:09.410991+0000","last_became_active":"2023-09-30T23:04:09.410618+0000","last_became_peered":"2023-09-30T23:04:09.410618+0000","last_unstale":"2023-09-30T23:04:09.410991+0000","last_undegraded":"2023-09-30T23:04:09.410991+0000","last_fullsized":"2023-09-30T23:04:09.410991+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:14:28.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410755+0000","last_change":"2023-09-30T23:04:08.653864+0000","last_active":"2023-09-30T23:04:09.410755+0000","last_peered":"2023-09-30T23:04:09.410755+0000","last_clean":"2023-09-30T23:04:09.410755+0000","last_became_active":"2023-09-30T23:04:08.653619+0000","last_became_peered":"2023-09-30T23:04:08.653619+0000","last_unstale":"2023-09-30T23:04:09.410755+0000","last_undegraded":"2023-09-30T23:04:09.410755+0000","last_fullsized":"2023-09-30T23:04:09.410755+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:54.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417858+0000","last_change":"2023-09-30T23:04:09.417115+0000","last_active":"2023-09-30T23:04:09.417858+0000","last_peered":"2023-09-30T23:04:09.417858+0000","last_clean":"2023-09-30T23:04:09.417858+0000","last_became_active":"2023-09-30T23:04:09.416881+0000","last_became_peered":"2023-09-30T23:04:09.416881+0000","last_unstale":"2023-09-30T23:04:09.417858+0000","last_undegraded":"2023-09-30T23:04:09.417858+0000","last_fullsized":"2023-09-30T23:04:09.417858+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:10:06.080599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400522+0000","last_change":"2023-09-30T23:04:08.644649+0000","last_active":"2023-09-30T23:04:09.400522+0000","last_peered":"2023-09-30T23:04:09.400522+0000","last_clean":"2023-09-30T23:04:09.400522+0000","last_became_active":"2023-09-30T23:04:08.644205+0000","last_became_peered":"2023-09-30T23:04:08.644205+0000","last_unstale":"2023-09-30T23:04:09.400522+0000","last_undegraded":"2023-09-30T23:04:09.400522+0000","last_fullsized":"2023-09-30T23:04:09.400522+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:00.436015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.407351+0000","last_change":"2023-09-30T23:04:09.406390+0000","last_active":"2023-09-30T23:04:09.407351+0000","last_peered":"2023-09-30T23:04:09.407351+0000","last_clean":"2023-09-30T23:04:09.407351+0000","last_became_active":"2023-09-30T23:04:09.406186+0000","last_became_peered":"2023-09-30T23:04:09.406186+0000","last_unstale":"2023-09-30T23:04:09.407351+0000","last_undegraded":"2023-09-30T23:04:09.407351+0000","last_fullsized":"2023-09-30T23:04:09.407351+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:52:59.618133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.403199+0000","last_change":"2023-09-30T23:04:08.647293+0000","last_active":"2023-09-30T23:04:09.403199+0000","last_peered":"2023-09-30T23:04:09.403199+0000","last_clean":"2023-09-30T23:04:09.403199+0000","last_became_active":"2023-09-30T23:04:08.647073+0000","last_became_peered":"2023-09-30T23:04:08.647073+0000","last_unstale":"2023-09-30T23:04:09.403199+0000","last_undegraded":"2023-09-30T23:04:09.403199+0000","last_fullsized":"2023-09-30T23:04:09.403199+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:31:48.115952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.402858+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:04:09.402858+0000","last_peered":"2023-09-30T23:04:09.402858+0000","last_clean":"2023-09-30T23:04:09.402858+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:04:09.402858+0000","last_undegraded":"2023-09-30T23:04:09.402858+0000","last_fullsized":"2023-09-30T23:04:09.402858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.416758+0000","last_change":"2023-09-30T23:04:09.416693+0000","last_active":"2023-09-30T23:04:09.416758+0000","last_peered":"2023-09-30T23:04:09.416758+0000","last_clean":"2023-09-30T23:04:09.416758+0000","last_became_active":"2023-09-30T23:04:09.416472+0000","last_became_peered":"2023-09-30T23:04:09.416472+0000","last_unstale":"2023-09-30T23:04:09.416758+0000","last_undegraded":"2023-09-30T23:04:09.416758+0000","last_fullsized":"2023-09-30T23:04:09.416758+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:47:50.550095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400602+0000","last_change":"2023-09-30T23:04:08.650433+0000","last_active":"2023-09-30T23:04:09.400602+0000","last_peered":"2023-09-30T23:04:09.400602+0000","last_clean":"2023-09-30T23:04:09.400602+0000","last_became_active":"2023-09-30T23:04:08.649702+0000","last_became_peered":"2023-09-30T23:04:08.649702+0000","last_unstale":"2023-09-30T23:04:09.400602+0000","last_undegraded":"2023-09-30T23:04:09.400602+0000","last_fullsized":"2023-09-30T23:04:09.400602+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:30.727331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405569+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:04:09.405569+0000","last_peered":"2023-09-30T23:04:09.405569+0000","last_clean":"2023-09-30T23:04:09.405569+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:04:09.405569+0000","last_undegraded":"2023-09-30T23:04:09.405569+0000","last_fullsized":"2023-09-30T23:04:09.405569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414706+0000","last_change":"2023-09-30T23:04:09.414007+0000","last_active":"2023-09-30T23:04:09.414706+0000","last_peered":"2023-09-30T23:04:09.414706+0000","last_clean":"2023-09-30T23:04:09.414706+0000","last_became_active":"2023-09-30T23:04:09.413297+0000","last_became_peered":"2023-09-30T23:04:09.413297+0000","last_unstale":"2023-09-30T23:04:09.414706+0000","last_undegraded":"2023-09-30T23:04:09.414706+0000","last_fullsized":"2023-09-30T23:04:09.414706+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:19.498286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"191'6","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.651991+0000","last_change":"2023-09-30T23:04:08.653009+0000","last_active":"2023-09-30T23:04:09.651991+0000","last_peered":"2023-09-30T23:04:09.651991+0000","last_clean":"2023-09-30T23:04:09.651991+0000","last_became_active":"2023-09-30T23:04:08.652768+0000","last_became_peered":"2023-09-30T23:04:08.652768+0000","last_unstale":"2023-09-30T23:04:09.651991+0000","last_undegraded":"2023-09-30T23:04:09.651991+0000","last_fullsized":"2023-09-30T23:04:09.651991+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:55.939283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409073+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:04:09.409073+0000","last_peered":"2023-09-30T23:04:09.409073+0000","last_clean":"2023-09-30T23:04:09.409073+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:04:09.409073+0000","last_undegraded":"2023-09-30T23:04:09.409073+0000","last_fullsized":"2023-09-30T23:04:09.409073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414720+0000","last_change":"2023-09-30T23:04:09.412851+0000","last_active":"2023-09-30T23:04:09.414720+0000","last_peered":"2023-09-30T23:04:09.414720+0000","last_clean":"2023-09-30T23:04:09.414720+0000","last_became_active":"2023-09-30T23:04:09.412492+0000","last_became_peered":"2023-09-30T23:04:09.412492+0000","last_unstale":"2023-09-30T23:04:09.414720+0000","last_undegraded":"2023-09-30T23:04:09.414720+0000","last_fullsized":"2023-09-30T23:04:09.414720+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:57:51.381570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400891+0000","last_change":"2023-09-30T23:04:08.644040+0000","last_active":"2023-09-30T23:04:09.400891+0000","last_peered":"2023-09-30T23:04:09.400891+0000","last_clean":"2023-09-30T23:04:09.400891+0000","last_became_active":"2023-09-30T23:04:08.642633+0000","last_became_peered":"2023-09-30T23:04:08.642633+0000","last_unstale":"2023-09-30T23:04:09.400891+0000","last_undegraded":"2023-09-30T23:04:09.400891+0000","last_fullsized":"2023-09-30T23:04:09.400891+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:09.381824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":167,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406482+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:04:09.406482+0000","last_peered":"2023-09-30T23:04:09.406482+0000","last_clean":"2023-09-30T23:04:09.406482+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:04:09.406482+0000","last_undegraded":"2023-09-30T23:04:09.406482+0000","last_fullsized":"2023-09-30T23:04:09.406482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404921+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:04:09.404921+0000","last_peered":"2023-09-30T23:04:09.404921+0000","last_clean":"2023-09-30T23:04:09.404921+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:04:09.404921+0000","last_undegraded":"2023-09-30T23:04:09.404921+0000","last_fullsized":"2023-09-30T23:04:09.404921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417890+0000","last_change":"2023-09-30T23:04:09.417448+0000","last_active":"2023-09-30T23:04:09.417890+0000","last_peered":"2023-09-30T23:04:09.417890+0000","last_clean":"2023-09-30T23:04:09.417890+0000","last_became_active":"2023-09-30T23:04:09.417015+0000","last_became_peered":"2023-09-30T23:04:09.417015+0000","last_unstale":"2023-09-30T23:04:09.417890+0000","last_undegraded":"2023-09-30T23:04:09.417890+0000","last_fullsized":"2023-09-30T23:04:09.417890+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:10.392690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.648047+0000","last_change":"2023-09-30T23:04:08.650001+0000","last_active":"2023-09-30T23:04:09.648047+0000","last_peered":"2023-09-30T23:04:09.648047+0000","last_clean":"2023-09-30T23:04:09.648047+0000","last_became_active":"2023-09-30T23:04:08.649737+0000","last_became_peered":"2023-09-30T23:04:08.649737+0000","last_unstale":"2023-09-30T23:04:09.648047+0000","last_undegraded":"2023-09-30T23:04:09.648047+0000","last_fullsized":"2023-09-30T23:04:09.648047+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:28:00.078072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405006+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:04:09.405006+0000","last_peered":"2023-09-30T23:04:09.405006+0000","last_clean":"2023-09-30T23:04:09.405006+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:04:09.405006+0000","last_undegraded":"2023-09-30T23:04:09.405006+0000","last_fullsized":"2023-09-30T23:04:09.405006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405047+0000","last_change":"2023-09-30T23:04:09.404829+0000","last_active":"2023-09-30T23:04:09.405047+0000","last_peered":"2023-09-30T23:04:09.405047+0000","last_clean":"2023-09-30T23:04:09.405047+0000","last_became_active":"2023-09-30T23:04:09.404291+0000","last_became_peered":"2023-09-30T23:04:09.404291+0000","last_unstale":"2023-09-30T23:04:09.405047+0000","last_undegraded":"2023-09-30T23:04:09.405047+0000","last_fullsized":"2023-09-30T23:04:09.405047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:05:10.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.10","version":"191'8","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.650604+0000","last_change":"2023-09-30T23:04:08.655186+0000","last_active":"2023-09-30T23:04:09.650604+0000","last_peered":"2023-09-30T23:04:09.650604+0000","last_clean":"2023-09-30T23:04:09.650604+0000","last_became_active":"2023-09-30T23:04:08.653980+0000","last_became_peered":"2023-09-30T23:04:08.653980+0000","last_unstale":"2023-09-30T23:04:09.650604+0000","last_undegraded":"2023-09-30T23:04:09.650604+0000","last_fullsized":"2023-09-30T23:04:09.650604+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:37:25.770548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404930+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:04:09.404930+0000","last_peered":"2023-09-30T23:04:09.404930+0000","last_clean":"2023-09-30T23:04:09.404930+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:04:09.404930+0000","last_undegraded":"2023-09-30T23:04:09.404930+0000","last_fullsized":"2023-09-30T23:04:09.404930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409489+0000","last_change":"2023-09-30T23:04:09.409263+0000","last_active":"2023-09-30T23:04:09.409489+0000","last_peered":"2023-09-30T23:04:09.409489+0000","last_clean":"2023-09-30T23:04:09.409489+0000","last_became_active":"2023-09-30T23:04:09.408764+0000","last_became_peered":"2023-09-30T23:04:09.408764+0000","last_unstale":"2023-09-30T23:04:09.409489+0000","last_undegraded":"2023-09-30T23:04:09.409489+0000","last_fullsized":"2023-09-30T23:04:09.409489+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:30.291009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.13","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.648976+0000","last_change":"2023-09-30T23:04:08.648183+0000","last_active":"2023-09-30T23:04:09.648976+0000","last_peered":"2023-09-30T23:04:09.648976+0000","last_clean":"2023-09-30T23:04:09.648976+0000","last_became_active":"2023-09-30T23:04:08.647764+0000","last_became_peered":"2023-09-30T23:04:08.647764+0000","last_unstale":"2023-09-30T23:04:09.648976+0000","last_undegraded":"2023-09-30T23:04:09.648976+0000","last_fullsized":"2023-09-30T23:04:09.648976+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:41:09.233388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406390+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:04:09.406390+0000","last_peered":"2023-09-30T23:04:09.406390+0000","last_clean":"2023-09-30T23:04:09.406390+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:04:09.406390+0000","last_undegraded":"2023-09-30T23:04:09.406390+0000","last_fullsized":"2023-09-30T23:04:09.406390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414673+0000","last_change":"2023-09-30T23:04:09.413308+0000","last_active":"2023-09-30T23:04:09.414673+0000","last_peered":"2023-09-30T23:04:09.414673+0000","last_clean":"2023-09-30T23:04:09.414673+0000","last_became_active":"2023-09-30T23:04:09.413082+0000","last_became_peered":"2023-09-30T23:04:09.413082+0000","last_unstale":"2023-09-30T23:04:09.414673+0000","last_undegraded":"2023-09-30T23:04:09.414673+0000","last_fullsized":"2023-09-30T23:04:09.414673+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:01.446880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400717+0000","last_change":"2023-09-30T23:04:08.650175+0000","last_active":"2023-09-30T23:04:09.400717+0000","last_peered":"2023-09-30T23:04:09.400717+0000","last_clean":"2023-09-30T23:04:09.400717+0000","last_became_active":"2023-09-30T23:04:08.649179+0000","last_became_peered":"2023-09-30T23:04:08.649179+0000","last_unstale":"2023-09-30T23:04:09.400717+0000","last_undegraded":"2023-09-30T23:04:09.400717+0000","last_fullsized":"2023-09-30T23:04:09.400717+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:29.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405496+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:04:09.405496+0000","last_peered":"2023-09-30T23:04:09.405496+0000","last_clean":"2023-09-30T23:04:09.405496+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:04:09.405496+0000","last_undegraded":"2023-09-30T23:04:09.405496+0000","last_fullsized":"2023-09-30T23:04:09.405496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194188,"statfs":{"total":200000000,"available":198848574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.65400000000000003},"min":{"1min":0.57199999999999995,"5min":0.38200000000000001,"15min":0.315},"max":{"1min":0.871,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.70399999999999996,"15min":0.67100000000000004},"min":{"1min":0.441,"5min":0.378,"15min":0.378},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79600000000000004}]},{"osd":1,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.65700000000000003},"min":{"1min":0.54700000000000004,"5min":0.42899999999999999,"15min":0.36599999999999999},"max":{"1min":0.95699999999999996,"5min":1.004,"15min":1.004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94599999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71399999999999997,"15min":0.69099999999999995},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.60799999999999998,"5min":0.54900000000000004,"15min":0.46700000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.67200000000000004},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93799999999999994,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.877},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.57499999999999996,"5min":0.51300000000000001,"15min":0.434},"max":{"1min":1.004,"5min":1.004,"15min":1.056},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.95999999999999996},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.62},"min":{"1min":0.504,"5min":0.432,"15min":0.35999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.82099999999999995}]},{"osd":5,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97199999999999998,"5min":1.03,"15min":1.135},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.67700000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95799999999999996,"5min":1.002,"15min":1.004},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.998,"5min":1.147,"15min":1.147},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.71799999999999997},"min":{"1min":0.57999999999999996,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.93999999999999995,"5min":1.016,"15min":1.071},"last":0.92800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194188,"statfs":{"total":200000000,"available":198848574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.83899999999999997},"min":{"1min":0.52700000000000002,"5min":0.40500000000000003,"15min":0.29299999999999998},"max":{"1min":0.91800000000000004,"5min":0.96699999999999997,"15min":6.5190000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71399999999999997,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":4.3680000000000003},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.77900000000000003},"min":{"1min":0.5,"5min":0.45900000000000002,"15min":0.42699999999999999},"max":{"1min":0.97799999999999998,"5min":1.123,"15min":3.6339999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72899999999999998,"15min":0.86799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":1.034,"5min":1.073,"15min":8.4339999999999993},"last":0.75}]},{"osd":2,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.76000000000000001},"min":{"1min":0.51000000000000001,"5min":0.44900000000000001,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.92000000000000004,"15min":3.4580000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.74299999999999999,"15min":0.871},"min":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.40500000000000003},"max":{"1min":1.0680000000000001,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.753,"15min":0.85199999999999998},"min":{"1min":0.53800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":5.7110000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.87,"5min":0.96599999999999997,"15min":1.5249999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.309},"max":{"1min":0.80500000000000005,"5min":0.99299999999999999,"15min":3.4670000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.999,"5min":0.999,"15min":5.9279999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89800000000000002,"5min":1.05,"15min":1.321},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.52200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.91000000000000003,"5min":1.0289999999999999,"15min":1.4590000000000001},"last":0.82099999999999995}]},{"osd":7,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73799999999999999,"15min":0.76200000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.874,"5min":1.018,"15min":6.0599999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.753,"15min":0.748},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.022,"5min":1.1140000000000001,"15min":1.3620000000000001},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193612,"statfs":{"total":200000000,"available":198259652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.083},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.46999999999999997},"min":{"1min":0.34200000000000003,"5min":0.32200000000000001,"15min":0.29999999999999999},"max":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.745},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.45000000000000001},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.64800000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.44900000000000001,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.73099999999999998,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.433},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.49099999999999999},"min":{"1min":0.41199999999999998,"5min":0.307,"15min":0.27400000000000002},"max":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.70599999999999996},"min":{"1min":0.56699999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89400000000000002,"5min":1.091,"15min":1.091},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.746,"15min":0.73799999999999999},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98599999999999999,"5min":1.01,"15min":1.1000000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":1.1499999999999999,"15min":1.22},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.746,"15min":0.746},"min":{"1min":0.58099999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0369999999999999,"5min":1.048,"15min":1.3560000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":1.1160000000000001,"15min":1.127},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.55200000000000005,"5min":0.51000000000000001,"15min":0.48099999999999998},"max":{"1min":1.002,"5min":1.0529999999999999,"15min":1.4059999999999999},"last":0.753}]},{"osd":7,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.51800000000000002},"max":{"1min":0.94099999999999995,"5min":1.109,"15min":1.1240000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79500000000000004,"15min":0.78600000000000003},"min":{"1min":0.622,"5min":0.504,"15min":0.504},"max":{"1min":0.93400000000000005,"5min":1.022,"15min":1.3779999999999999},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194189,"statfs":{"total":200000000,"available":198850110,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.85699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":0.63800000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.39200000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":0.68200000000000005,"5min":0.747,"15min":1.0289999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.42599999999999999,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.77000000000000002,"15min":0.879},"last":0.49299999999999999}]},{"osd":3,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":1.0029999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79300000000000004,"15min":0.98899999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.27},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":1.006,"5min":1.024,"15min":1.171},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.41099999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.2649999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.091,"5min":1.091,"15min":4.0419999999999998},"last":0.90600000000000003}]},{"osd":6,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.50900000000000001,"15min":0.434},"max":{"1min":1.05,"5min":1.05,"15min":2.6059999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.48399999999999999},"max":{"1min":1.04,"5min":1.0669999999999999,"15min":7.2610000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.4569999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.016,"5min":1.05,"15min":4.0220000000000002},"last":0.91400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1123,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194188,"statfs":{"total":200000000,"available":198849374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23599999999999999},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":1.4630000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48099999999999998,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.30399999999999999,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.876,"15min":1.542},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52300000000000002,"15min":0.496},"min":{"1min":0.32100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.494},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.52600000000000002},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.29599999999999999},"max":{"1min":0.81499999999999995,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48499999999999999,"15min":0.46999999999999997},"min":{"1min":0.42299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.94399999999999995,"15min":1.649},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":0.98099999999999998,"15min":1.3220000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.77900000000000003},"min":{"1min":0.66800000000000004,"5min":0.55000000000000004,"15min":0.44400000000000001},"max":{"1min":1.137,"5min":1.1819999999999999,"15min":1.234},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.45900000000000002,"15min":0.38},"max":{"1min":1.167,"5min":1.167,"15min":1.4910000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80300000000000005,"15min":0.79000000000000004},"min":{"1min":0.66100000000000003,"5min":0.53100000000000003,"15min":0.45200000000000001},"max":{"1min":1.0900000000000001,"5min":1.1459999999999999,"15min":1.179},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58099999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.22,"5min":1.22,"15min":2.7320000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.615},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77400000000000002,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.55300000000000005,"15min":0.50800000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4199999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79500000000000004,"15min":0.76200000000000001},"min":{"1min":0.623,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.439},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":2.7730000000000001},"last":0.52100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194189,"statfs":{"total":200000000,"available":198850076,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.41399999999999998},"min":{"1min":0.316,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":1.1519999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47999999999999998,"15min":0.49299999999999999},"min":{"1min":0.376,"5min":0.308,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":0.69899999999999995,"15min":1.919},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":1.254},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.373,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":0.71199999999999997,"5min":0.748,"15min":1.9390000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.6020000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.36599999999999999,"15min":0.35499999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.5309999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.47199999999999998,"15min":0.35999999999999999},"max":{"1min":1.014,"5min":1.0569999999999999,"15min":1.401},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.77500000000000002},"min":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.443},"max":{"1min":1.1439999999999999,"5min":1.1539999999999999,"15min":3.306},"last":0.751}]},{"osd":5,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76400000000000001,"15min":0.754},"min":{"1min":0.51300000000000001,"5min":0.49399999999999999,"15min":0.46200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0880000000000001,"15min":1.508},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.65100000000000002,"5min":0.55200000000000005,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.044,"15min":1.4910000000000001},"last":0.84799999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.49099999999999999},"max":{"1min":0.92300000000000004,"5min":0.96299999999999997,"15min":1.5620000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48099999999999998},"max":{"1min":0.93999999999999995,"5min":0.99299999999999999,"15min":1.3140000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.60899999999999999,"5min":0.54100000000000004,"15min":0.48799999999999999},"max":{"1min":1.0649999999999999,"5min":1.1040000000000001,"15min":1.3640000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.77700000000000002},"min":{"1min":0.64100000000000001,"5min":0.57399999999999995,"15min":0.47999999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.573},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194189,"statfs":{"total":200000000,"available":198850088,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68300000000000005,"15min":0.628},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85499999999999998,"5min":0.98199999999999998,"15min":1.022},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70599999999999996,"15min":0.65700000000000003},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.54600000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.98699999999999999,"15min":1.492},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77500000000000002,"15min":0.72199999999999998},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.0149999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.72399999999999998},"min":{"1min":0.63800000000000001,"5min":0.56399999999999995,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.5149999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.871,"5min":0.98299999999999998,"15min":1.0429999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.37},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0209999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.90200000000000002,"5min":1.0409999999999999,"15min":1.45},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.57599999999999996,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.91700000000000004,"5min":1.028,"15min":1.0649999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47999999999999998,"15min":0.45700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.016},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.93300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.88400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1700,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193612,"statfs":{"total":200000000,"available":198259084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.67400000000000004,"15min":0.63500000000000001},"min":{"1min":0.45600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68100000000000005,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92200000000000004,"5min":0.94499999999999995,"15min":1.008},"last":0.65700000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73099999999999998,"15min":0.69299999999999995},"min":{"1min":0.51700000000000002,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97899999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.71799999999999997,"15min":0.68600000000000005},"min":{"1min":0.57999999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.0449999999999999},"last":0.752}]},{"osd":2,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.54500000000000004,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69999999999999996,"15min":0.67700000000000005},"min":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.38200000000000001},"max":{"1min":0.93400000000000005,"5min":0.95899999999999996,"15min":1.044},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.59599999999999997,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72899999999999998,"15min":0.68700000000000006},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.442},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.97599999999999998},"last":0.63600000000000001}]},{"osd":4,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.40699999999999997,"15min":0.34899999999999998},"max":{"1min":0.89100000000000001,"5min":0.91600000000000004,"15min":0.95299999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.081},"last":0.45700000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.504},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.03},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.72399999999999998},"min":{"1min":0.51300000000000001,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.93899999999999995,"5min":1.083,"15min":1.083},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.76400000000000001},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.45900000000000002},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0700000000000001},"last":0.59599999999999997}]}]}],"pool_statfs":[]}} 2023-09-30T23:04:13.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:04:14.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.219+0000 7fe7be9ff700 1 Processor -- start 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.219+0000 7fe7be9ff700 1 -- start start 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.220+0000 7fe7be9ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7b80af020 0x7fe7b8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.220+0000 7fe7be9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80b00d0 0x7fe7b806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7be9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b806d3e0 con 0x7fe7b806e650 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7be9ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b815b400 con 0x7fe7b80af020 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7be9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b806dc80 con 0x7fe7b80b00d0 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7b80af020 0x7fe7b8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7b80af020 0x7fe7b8156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37328/0 (socket says 172.21.15.142:37328) 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b7fff700 1 -- 172.21.15.142:0/223198663 learned_addr learned my addr 172.21.15.142:0/223198663 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b7fff700 1 -- 172.21.15.142:0/223198663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80b00d0 msgr2=0x7fe7b806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:14.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b77fe700 1 --2- 172.21.15.142:0/223198663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80b00d0 0x7fe7b806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b7fff700 1 --2- 172.21.15.142:0/223198663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80b00d0 0x7fe7b806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b7fff700 1 -- 172.21.15.142:0/223198663 >> v1:172.21.15.148:6789/0 conn(0x7fe7b806e650 legacy=0x7fe7b80b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b7fff700 1 -- 172.21.15.142:0/223198663 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b806b790 con 0x7fe7b80af020 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.221+0000 7fe7b77fe700 1 --2- 172.21.15.142:0/223198663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80b00d0 0x7fe7b806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.222+0000 7fe7b7fff700 1 --2- 172.21.15.142:0/223198663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80af020 0x7fe7b8156d80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099b0 tx=0x7fe7a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec5ef5d2eb5f4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.222+0000 7fe7b6ffd700 1 -- 172.21.15.142:0/223198663 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800b860 con 0x7fe7b80af020 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.222+0000 7fe7b6ffd700 1 -- 172.21.15.142:0/223198663 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a800b9c0 con 0x7fe7b80af020 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.222+0000 7fe7b6ffd700 1 -- 172.21.15.142:0/223198663 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800bd60 con 0x7fe7b80af020 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.222+0000 7fe7be9ff700 1 -- 172.21.15.142:0/223198663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80af020 msgr2=0x7fe7b8156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.222+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/223198663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80af020 0x7fe7b8156d80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099b0 tx=0x7fe7a8009250 comp rx=0 tx=0).stop 2023-09-30T23:04:14.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.223+0000 7fe7be9ff700 1 -- 172.21.15.142:0/223198663 shutdown_connections 2023-09-30T23:04:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.223+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/223198663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80af020 0x7fe7b8156d80 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.223+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/223198663 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80b00d0 0x7fe7b806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.223+0000 7fe7be9ff700 1 -- 172.21.15.142:0/223198663 >> 172.21.15.142:0/223198663 conn(0x7fe7b80680c0 msgr2=0x7fe7b80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.223+0000 7fe7be9ff700 1 -- 172.21.15.142:0/223198663 shutdown_connections 2023-09-30T23:04:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.223+0000 7fe7be9ff700 1 -- 172.21.15.142:0/223198663 wait complete. 2023-09-30T23:04:14.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.224+0000 7fe7be9ff700 1 Processor -- start 2023-09-30T23:04:14.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.224+0000 7fe7be9ff700 1 -- start start 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7be9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b806e650 0x7fe7b814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7be9ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80af020 0x7fe7b80c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7be9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80b00d0 0x7fe7b816d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7be9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80c5430 con 0x7fe7b80b00d0 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7be9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b816e700 con 0x7fe7b806e650 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7be9ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80c4820 con 0x7fe7b80af020 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7bcf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80b00d0 0x7fe7b816d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7bcf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80b00d0 0x7fe7b816d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37338/0 (socket says 172.21.15.142:37338) 2023-09-30T23:04:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.225+0000 7fe7bcf9c700 1 -- 172.21.15.142:0/195724101 learned_addr learned my addr 172.21.15.142:0/195724101 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7b7fff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b806e650 0x7fe7b814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7b77fe700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80af020 0x7fe7b80c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7bcf9c700 1 -- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80af020 msgr2=0x7fe7b80c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7bcf9c700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80af020 0x7fe7b80c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7bcf9c700 1 -- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b806e650 msgr2=0x7fe7b814f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7bcf9c700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b806e650 0x7fe7b814f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7bcf9c700 1 -- 172.21.15.142:0/195724101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80094f0 con 0x7fe7b80b00d0 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7bcf9c700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80b00d0 0x7fe7b816d930 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c840 tx=0x7fe7b0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe79ffff700 1 -- 172.21.15.142:0/195724101 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0012630 con 0x7fe7b80b00d0 2023-09-30T23:04:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe79ffff700 1 -- 172.21.15.142:0/195724101 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b00127b0 con 0x7fe7b80b00d0 2023-09-30T23:04:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b80c4b00 con 0x7fe7b80b00d0 2023-09-30T23:04:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.226+0000 7fe79ffff700 1 -- 172.21.15.142:0/195724101 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0012b70 con 0x7fe7b80b00d0 2023-09-30T23:04:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.227+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b80c50c0 con 0x7fe7b80b00d0 2023-09-30T23:04:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.228+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b80695b0 con 0x7fe7b80b00d0 2023-09-30T23:04:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.228+0000 7fe79ffff700 1 -- 172.21.15.142:0/195724101 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe7b001a3a0 con 0x7fe7b80b00d0 2023-09-30T23:04:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.229+0000 7fe79ffff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a4067330 0x7fe7a40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.229+0000 7fe79ffff700 1 -- 172.21.15.142:0/195724101 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7b0084d50 con 0x7fe7b80b00d0 2023-09-30T23:04:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.230+0000 7fe7b7fff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a4067330 0x7fe7a40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.230+0000 7fe7b7fff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a4067330 0x7fe7a40697e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099b0 tx=0x7fe7a8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:14.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.233+0000 7fe79ffff700 1 -- 172.21.15.142:0/195724101 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe7b0051bb0 con 0x7fe7b80b00d0 2023-09-30T23:04:14.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.421+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7b80c5570 con 0x7fe7a4067330 2023-09-30T23:04:14.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.430+0000 7fe79ffff700 1 -- 172.21.15.142:0/195724101 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303460 (secure 0 0 0) 0x7fe7b80c5570 con 0x7fe7a4067330 2023-09-30T23:04:14.434 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:14.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a4067330 msgr2=0x7fe7a40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a4067330 0x7fe7a40697e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099b0 tx=0x7fe7a8017000 comp rx=0 tx=0).stop 2023-09-30T23:04:14.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80b00d0 msgr2=0x7fe7b816d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80b00d0 0x7fe7b816d930 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c840 tx=0x7fe7b0001670 comp rx=0 tx=0).stop 2023-09-30T23:04:14.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 shutdown_connections 2023-09-30T23:04:14.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a4067330 0x7fe7a40697e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7b80b00d0 0x7fe7b816d930 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7b806e650 0x7fe7b814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 --2- 172.21.15.142:0/195724101 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7b80af020 0x7fe7b80c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 >> 172.21.15.142:0/195724101 conn(0x7fe7b80680c0 msgr2=0x7fe7b80cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:14.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 shutdown_connections 2023-09-30T23:04:14.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.434+0000 7fe7be9ff700 1 -- 172.21.15.142:0/195724101 wait complete. 2023-09-30T23:04:14.438 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:04:14.452 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2023-09-30T23:04:14.271572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552358,"statfs":{"total":1600000000,"available":1589615532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001119"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414218+0000","last_change":"2023-09-30T23:04:09.414150+0000","last_active":"2023-09-30T23:04:09.414218+0000","last_peered":"2023-09-30T23:04:09.414218+0000","last_clean":"2023-09-30T23:04:09.414218+0000","last_became_active":"2023-09-30T23:04:09.413812+0000","last_became_peered":"2023-09-30T23:04:09.413812+0000","last_unstale":"2023-09-30T23:04:09.414218+0000","last_undegraded":"2023-09-30T23:04:09.414218+0000","last_fullsized":"2023-09-30T23:04:09.414218+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:32.396294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414432+0000","last_change":"2023-09-30T23:04:09.414022+0000","last_active":"2023-09-30T23:04:09.414432+0000","last_peered":"2023-09-30T23:04:09.414432+0000","last_clean":"2023-09-30T23:04:09.414432+0000","last_became_active":"2023-09-30T23:04:09.413171+0000","last_became_peered":"2023-09-30T23:04:09.413171+0000","last_unstale":"2023-09-30T23:04:09.414432+0000","last_undegraded":"2023-09-30T23:04:09.414432+0000","last_fullsized":"2023-09-30T23:04:09.414432+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:58.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417979+0000","last_change":"2023-09-30T23:04:09.417916+0000","last_active":"2023-09-30T23:04:09.417979+0000","last_peered":"2023-09-30T23:04:09.417979+0000","last_clean":"2023-09-30T23:04:09.417979+0000","last_became_active":"2023-09-30T23:04:09.417679+0000","last_became_peered":"2023-09-30T23:04:09.417679+0000","last_unstale":"2023-09-30T23:04:09.417979+0000","last_undegraded":"2023-09-30T23:04:09.417979+0000","last_fullsized":"2023-09-30T23:04:09.417979+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:31.738197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414701+0000","last_change":"2023-09-30T23:04:09.412712+0000","last_active":"2023-09-30T23:04:09.414701+0000","last_peered":"2023-09-30T23:04:09.414701+0000","last_clean":"2023-09-30T23:04:09.414701+0000","last_became_active":"2023-09-30T23:04:09.412176+0000","last_became_peered":"2023-09-30T23:04:09.412176+0000","last_unstale":"2023-09-30T23:04:09.414701+0000","last_undegraded":"2023-09-30T23:04:09.414701+0000","last_fullsized":"2023-09-30T23:04:09.414701+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:38.779767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.407706+0000","last_change":"2023-09-30T23:04:09.407634+0000","last_active":"2023-09-30T23:04:09.407706+0000","last_peered":"2023-09-30T23:04:09.407706+0000","last_clean":"2023-09-30T23:04:09.407706+0000","last_became_active":"2023-09-30T23:04:09.407407+0000","last_became_peered":"2023-09-30T23:04:09.407407+0000","last_unstale":"2023-09-30T23:04:09.407706+0000","last_undegraded":"2023-09-30T23:04:09.407706+0000","last_fullsized":"2023-09-30T23:04:09.407706+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:31:47.435628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.412185+0000","last_change":"2023-09-30T23:04:09.412123+0000","last_active":"2023-09-30T23:04:09.412185+0000","last_peered":"2023-09-30T23:04:09.412185+0000","last_clean":"2023-09-30T23:04:09.412185+0000","last_became_active":"2023-09-30T23:04:09.411869+0000","last_became_peered":"2023-09-30T23:04:09.411869+0000","last_unstale":"2023-09-30T23:04:09.412185+0000","last_undegraded":"2023-09-30T23:04:09.412185+0000","last_fullsized":"2023-09-30T23:04:09.412185+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:30.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414690+0000","last_change":"2023-09-30T23:04:09.413857+0000","last_active":"2023-09-30T23:04:09.414690+0000","last_peered":"2023-09-30T23:04:09.414690+0000","last_clean":"2023-09-30T23:04:09.414690+0000","last_became_active":"2023-09-30T23:04:09.412987+0000","last_became_peered":"2023-09-30T23:04:09.412987+0000","last_unstale":"2023-09-30T23:04:09.414690+0000","last_undegraded":"2023-09-30T23:04:09.414690+0000","last_fullsized":"2023-09-30T23:04:09.414690+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:30.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410682+0000","last_change":"2023-09-30T23:04:09.410574+0000","last_active":"2023-09-30T23:04:09.410682+0000","last_peered":"2023-09-30T23:04:09.410682+0000","last_clean":"2023-09-30T23:04:09.410682+0000","last_became_active":"2023-09-30T23:04:09.410329+0000","last_became_peered":"2023-09-30T23:04:09.410329+0000","last_unstale":"2023-09-30T23:04:09.410682+0000","last_undegraded":"2023-09-30T23:04:09.410682+0000","last_fullsized":"2023-09-30T23:04:09.410682+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:05.009729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404737+0000","last_change":"2023-09-30T23:04:09.404463+0000","last_active":"2023-09-30T23:04:09.404737+0000","last_peered":"2023-09-30T23:04:09.404737+0000","last_clean":"2023-09-30T23:04:09.404737+0000","last_became_active":"2023-09-30T23:04:09.404154+0000","last_became_peered":"2023-09-30T23:04:09.404154+0000","last_unstale":"2023-09-30T23:04:09.404737+0000","last_undegraded":"2023-09-30T23:04:09.404737+0000","last_fullsized":"2023-09-30T23:04:09.404737+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:01.048507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413353+0000","last_change":"2023-09-30T23:04:09.412464+0000","last_active":"2023-09-30T23:04:09.413353+0000","last_peered":"2023-09-30T23:04:09.413353+0000","last_clean":"2023-09-30T23:04:09.413353+0000","last_became_active":"2023-09-30T23:04:09.412209+0000","last_became_peered":"2023-09-30T23:04:09.412209+0000","last_unstale":"2023-09-30T23:04:09.413353+0000","last_undegraded":"2023-09-30T23:04:09.413353+0000","last_fullsized":"2023-09-30T23:04:09.413353+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:11:05.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410105+0000","last_change":"2023-09-30T23:04:09.410040+0000","last_active":"2023-09-30T23:04:09.410105+0000","last_peered":"2023-09-30T23:04:09.410105+0000","last_clean":"2023-09-30T23:04:09.410105+0000","last_became_active":"2023-09-30T23:04:09.409802+0000","last_became_peered":"2023-09-30T23:04:09.409802+0000","last_unstale":"2023-09-30T23:04:09.410105+0000","last_undegraded":"2023-09-30T23:04:09.410105+0000","last_fullsized":"2023-09-30T23:04:09.410105+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:56.950149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415373+0000","last_change":"2023-09-30T23:04:09.415247+0000","last_active":"2023-09-30T23:04:09.415373+0000","last_peered":"2023-09-30T23:04:09.415373+0000","last_clean":"2023-09-30T23:04:09.415373+0000","last_became_active":"2023-09-30T23:04:09.414919+0000","last_became_peered":"2023-09-30T23:04:09.414919+0000","last_unstale":"2023-09-30T23:04:09.415373+0000","last_undegraded":"2023-09-30T23:04:09.415373+0000","last_fullsized":"2023-09-30T23:04:09.415373+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:59:38.353793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415188+0000","last_change":"2023-09-30T23:04:09.415115+0000","last_active":"2023-09-30T23:04:09.415188+0000","last_peered":"2023-09-30T23:04:09.415188+0000","last_clean":"2023-09-30T23:04:09.415188+0000","last_became_active":"2023-09-30T23:04:09.414869+0000","last_became_peered":"2023-09-30T23:04:09.414869+0000","last_unstale":"2023-09-30T23:04:09.415188+0000","last_undegraded":"2023-09-30T23:04:09.415188+0000","last_fullsized":"2023-09-30T23:04:09.415188+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:32:48.515916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406748+0000","last_change":"2023-09-30T23:04:09.405719+0000","last_active":"2023-09-30T23:04:09.406748+0000","last_peered":"2023-09-30T23:04:09.406748+0000","last_clean":"2023-09-30T23:04:09.406748+0000","last_became_active":"2023-09-30T23:04:09.405436+0000","last_became_peered":"2023-09-30T23:04:09.405436+0000","last_unstale":"2023-09-30T23:04:09.406748+0000","last_undegraded":"2023-09-30T23:04:09.406748+0000","last_fullsized":"2023-09-30T23:04:09.406748+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:50.985545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409082+0000","last_change":"2023-09-30T23:04:09.408484+0000","last_active":"2023-09-30T23:04:09.409082+0000","last_peered":"2023-09-30T23:04:09.409082+0000","last_clean":"2023-09-30T23:04:09.409082+0000","last_became_active":"2023-09-30T23:04:09.408274+0000","last_became_peered":"2023-09-30T23:04:09.408274+0000","last_unstale":"2023-09-30T23:04:09.409082+0000","last_undegraded":"2023-09-30T23:04:09.409082+0000","last_fullsized":"2023-09-30T23:04:09.409082+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:58.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409111+0000","last_change":"2023-09-30T23:04:09.409022+0000","last_active":"2023-09-30T23:04:09.409111+0000","last_peered":"2023-09-30T23:04:09.409111+0000","last_clean":"2023-09-30T23:04:09.409111+0000","last_became_active":"2023-09-30T23:04:09.408812+0000","last_became_peered":"2023-09-30T23:04:09.408812+0000","last_unstale":"2023-09-30T23:04:09.409111+0000","last_undegraded":"2023-09-30T23:04:09.409111+0000","last_fullsized":"2023-09-30T23:04:09.409111+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:01.446880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404767+0000","last_change":"2023-09-30T23:04:09.404606+0000","last_active":"2023-09-30T23:04:09.404767+0000","last_peered":"2023-09-30T23:04:09.404767+0000","last_clean":"2023-09-30T23:04:09.404767+0000","last_became_active":"2023-09-30T23:04:09.404025+0000","last_became_peered":"2023-09-30T23:04:09.404025+0000","last_unstale":"2023-09-30T23:04:09.404767+0000","last_undegraded":"2023-09-30T23:04:09.404767+0000","last_fullsized":"2023-09-30T23:04:09.404767+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:49.655153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.408839+0000","last_change":"2023-09-30T23:04:09.408094+0000","last_active":"2023-09-30T23:04:09.408839+0000","last_peered":"2023-09-30T23:04:09.408839+0000","last_clean":"2023-09-30T23:04:09.408839+0000","last_became_active":"2023-09-30T23:04:09.407823+0000","last_became_peered":"2023-09-30T23:04:09.407823+0000","last_unstale":"2023-09-30T23:04:09.408839+0000","last_undegraded":"2023-09-30T23:04:09.408839+0000","last_fullsized":"2023-09-30T23:04:09.408839+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:17.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415033+0000","last_change":"2023-09-30T23:04:09.414940+0000","last_active":"2023-09-30T23:04:09.415033+0000","last_peered":"2023-09-30T23:04:09.415033+0000","last_clean":"2023-09-30T23:04:09.415033+0000","last_became_active":"2023-09-30T23:04:09.414568+0000","last_became_peered":"2023-09-30T23:04:09.414568+0000","last_unstale":"2023-09-30T23:04:09.415033+0000","last_undegraded":"2023-09-30T23:04:09.415033+0000","last_fullsized":"2023-09-30T23:04:09.415033+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:56.950149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409183+0000","last_change":"2023-09-30T23:04:09.408825+0000","last_active":"2023-09-30T23:04:09.409183+0000","last_peered":"2023-09-30T23:04:09.409183+0000","last_clean":"2023-09-30T23:04:09.409183+0000","last_became_active":"2023-09-30T23:04:09.408588+0000","last_became_peered":"2023-09-30T23:04:09.408588+0000","last_unstale":"2023-09-30T23:04:09.409183+0000","last_undegraded":"2023-09-30T23:04:09.409183+0000","last_fullsized":"2023-09-30T23:04:09.409183+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:12:07.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415277+0000","last_change":"2023-09-30T23:04:09.415196+0000","last_active":"2023-09-30T23:04:09.415277+0000","last_peered":"2023-09-30T23:04:09.415277+0000","last_clean":"2023-09-30T23:04:09.415277+0000","last_became_active":"2023-09-30T23:04:09.414945+0000","last_became_peered":"2023-09-30T23:04:09.414945+0000","last_unstale":"2023-09-30T23:04:09.415277+0000","last_undegraded":"2023-09-30T23:04:09.415277+0000","last_fullsized":"2023-09-30T23:04:09.415277+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:02.662728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415109+0000","last_change":"2023-09-30T23:04:09.415039+0000","last_active":"2023-09-30T23:04:09.415109+0000","last_peered":"2023-09-30T23:04:09.415109+0000","last_clean":"2023-09-30T23:04:09.415109+0000","last_became_active":"2023-09-30T23:04:09.414683+0000","last_became_peered":"2023-09-30T23:04:09.414683+0000","last_unstale":"2023-09-30T23:04:09.415109+0000","last_undegraded":"2023-09-30T23:04:09.415109+0000","last_fullsized":"2023-09-30T23:04:09.415109+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:19.498286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413377+0000","last_change":"2023-09-30T23:04:09.413276+0000","last_active":"2023-09-30T23:04:09.413377+0000","last_peered":"2023-09-30T23:04:09.413377+0000","last_clean":"2023-09-30T23:04:09.413377+0000","last_became_active":"2023-09-30T23:04:09.411917+0000","last_became_peered":"2023-09-30T23:04:09.411917+0000","last_unstale":"2023-09-30T23:04:09.413377+0000","last_undegraded":"2023-09-30T23:04:09.413377+0000","last_fullsized":"2023-09-30T23:04:09.413377+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:26.850603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415017+0000","last_change":"2023-09-30T23:04:09.414795+0000","last_active":"2023-09-30T23:04:09.415017+0000","last_peered":"2023-09-30T23:04:09.415017+0000","last_clean":"2023-09-30T23:04:09.415017+0000","last_became_active":"2023-09-30T23:04:09.414235+0000","last_became_peered":"2023-09-30T23:04:09.414235+0000","last_unstale":"2023-09-30T23:04:09.415017+0000","last_undegraded":"2023-09-30T23:04:09.415017+0000","last_fullsized":"2023-09-30T23:04:09.415017+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:10.392690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414722+0000","last_change":"2023-09-30T23:04:09.414247+0000","last_active":"2023-09-30T23:04:09.414722+0000","last_peered":"2023-09-30T23:04:09.414722+0000","last_clean":"2023-09-30T23:04:09.414722+0000","last_became_active":"2023-09-30T23:04:09.413981+0000","last_became_peered":"2023-09-30T23:04:09.413981+0000","last_unstale":"2023-09-30T23:04:09.414722+0000","last_undegraded":"2023-09-30T23:04:09.414722+0000","last_fullsized":"2023-09-30T23:04:09.414722+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:54:48.858457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.411216+0000","last_change":"2023-09-30T23:04:09.410700+0000","last_active":"2023-09-30T23:04:09.411216+0000","last_peered":"2023-09-30T23:04:09.411216+0000","last_clean":"2023-09-30T23:04:09.411216+0000","last_became_active":"2023-09-30T23:04:09.410442+0000","last_became_peered":"2023-09-30T23:04:09.410442+0000","last_unstale":"2023-09-30T23:04:09.411216+0000","last_undegraded":"2023-09-30T23:04:09.411216+0000","last_fullsized":"2023-09-30T23:04:09.411216+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:55.014714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414467+0000","last_change":"2023-09-30T23:04:09.414288+0000","last_active":"2023-09-30T23:04:09.414467+0000","last_peered":"2023-09-30T23:04:09.414467+0000","last_clean":"2023-09-30T23:04:09.414467+0000","last_became_active":"2023-09-30T23:04:09.413789+0000","last_became_peered":"2023-09-30T23:04:09.413789+0000","last_unstale":"2023-09-30T23:04:09.414467+0000","last_undegraded":"2023-09-30T23:04:09.414467+0000","last_fullsized":"2023-09-30T23:04:09.414467+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:30.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414633+0000","last_change":"2023-09-30T23:04:09.412652+0000","last_active":"2023-09-30T23:04:09.414633+0000","last_peered":"2023-09-30T23:04:09.414633+0000","last_clean":"2023-09-30T23:04:09.414633+0000","last_became_active":"2023-09-30T23:04:09.412091+0000","last_became_peered":"2023-09-30T23:04:09.412091+0000","last_unstale":"2023-09-30T23:04:09.414633+0000","last_undegraded":"2023-09-30T23:04:09.414633+0000","last_fullsized":"2023-09-30T23:04:09.414633+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:47:50.550095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.418922+0000","last_change":"2023-09-30T23:04:09.418864+0000","last_active":"2023-09-30T23:04:09.418922+0000","last_peered":"2023-09-30T23:04:09.418922+0000","last_clean":"2023-09-30T23:04:09.418922+0000","last_became_active":"2023-09-30T23:04:09.418545+0000","last_became_peered":"2023-09-30T23:04:09.418545+0000","last_unstale":"2023-09-30T23:04:09.418922+0000","last_undegraded":"2023-09-30T23:04:09.418922+0000","last_fullsized":"2023-09-30T23:04:09.418922+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:46:01.048507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.412950+0000","last_change":"2023-09-30T23:04:09.412888+0000","last_active":"2023-09-30T23:04:09.412950+0000","last_peered":"2023-09-30T23:04:09.412950+0000","last_clean":"2023-09-30T23:04:09.412950+0000","last_became_active":"2023-09-30T23:04:09.412668+0000","last_became_peered":"2023-09-30T23:04:09.412668+0000","last_unstale":"2023-09-30T23:04:09.412950+0000","last_undegraded":"2023-09-30T23:04:09.412950+0000","last_fullsized":"2023-09-30T23:04:09.412950+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:47:50.550095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409503+0000","last_change":"2023-09-30T23:04:09.409398+0000","last_active":"2023-09-30T23:04:09.409503+0000","last_peered":"2023-09-30T23:04:09.409503+0000","last_clean":"2023-09-30T23:04:09.409503+0000","last_became_active":"2023-09-30T23:04:09.409054+0000","last_became_peered":"2023-09-30T23:04:09.409054+0000","last_unstale":"2023-09-30T23:04:09.409503+0000","last_undegraded":"2023-09-30T23:04:09.409503+0000","last_fullsized":"2023-09-30T23:04:09.409503+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:03:10.324874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414452+0000","last_change":"2023-09-30T23:04:09.414164+0000","last_active":"2023-09-30T23:04:09.414452+0000","last_peered":"2023-09-30T23:04:09.414452+0000","last_clean":"2023-09-30T23:04:09.414452+0000","last_became_active":"2023-09-30T23:04:09.413447+0000","last_became_peered":"2023-09-30T23:04:09.413447+0000","last_unstale":"2023-09-30T23:04:09.414452+0000","last_undegraded":"2023-09-30T23:04:09.414452+0000","last_fullsized":"2023-09-30T23:04:09.414452+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:01.446880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413307+0000","last_change":"2023-09-30T23:04:09.413201+0000","last_active":"2023-09-30T23:04:09.413307+0000","last_peered":"2023-09-30T23:04:09.413307+0000","last_clean":"2023-09-30T23:04:09.413307+0000","last_became_active":"2023-09-30T23:04:09.412979+0000","last_became_peered":"2023-09-30T23:04:09.412979+0000","last_unstale":"2023-09-30T23:04:09.413307+0000","last_undegraded":"2023-09-30T23:04:09.413307+0000","last_fullsized":"2023-09-30T23:04:09.413307+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:32.396294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649273+0000","last_change":"2023-09-30T23:04:08.650447+0000","last_active":"2023-09-30T23:04:09.649273+0000","last_peered":"2023-09-30T23:04:09.649273+0000","last_clean":"2023-09-30T23:04:09.649273+0000","last_became_active":"2023-09-30T23:04:08.650239+0000","last_became_peered":"2023-09-30T23:04:08.650239+0000","last_unstale":"2023-09-30T23:04:09.649273+0000","last_undegraded":"2023-09-30T23:04:09.649273+0000","last_fullsized":"2023-09-30T23:04:09.649273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:55:09.836272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.416720+0000","last_change":"2023-09-30T23:04:09.416357+0000","last_active":"2023-09-30T23:04:09.416720+0000","last_peered":"2023-09-30T23:04:09.416720+0000","last_clean":"2023-09-30T23:04:09.416720+0000","last_became_active":"2023-09-30T23:04:09.413639+0000","last_became_peered":"2023-09-30T23:04:09.413639+0000","last_unstale":"2023-09-30T23:04:09.416720+0000","last_undegraded":"2023-09-30T23:04:09.416720+0000","last_fullsized":"2023-09-30T23:04:09.416720+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:54:45.094761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646829+0000","last_change":"2023-09-30T23:04:08.646440+0000","last_active":"2023-09-30T23:04:09.646829+0000","last_peered":"2023-09-30T23:04:09.646829+0000","last_clean":"2023-09-30T23:04:09.646829+0000","last_became_active":"2023-09-30T23:04:08.645271+0000","last_became_peered":"2023-09-30T23:04:08.645271+0000","last_unstale":"2023-09-30T23:04:09.646829+0000","last_undegraded":"2023-09-30T23:04:09.646829+0000","last_fullsized":"2023-09-30T23:04:09.646829+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:21.785949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413777+0000","last_change":"2023-09-30T23:04:09.413676+0000","last_active":"2023-09-30T23:04:09.413777+0000","last_peered":"2023-09-30T23:04:09.413777+0000","last_clean":"2023-09-30T23:04:09.413777+0000","last_became_active":"2023-09-30T23:04:09.412729+0000","last_became_peered":"2023-09-30T23:04:09.412729+0000","last_unstale":"2023-09-30T23:04:09.413777+0000","last_undegraded":"2023-09-30T23:04:09.413777+0000","last_fullsized":"2023-09-30T23:04:09.413777+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:49:22.756017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1d","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646263+0000","last_change":"2023-09-30T23:04:08.645041+0000","last_active":"2023-09-30T23:04:09.646263+0000","last_peered":"2023-09-30T23:04:09.646263+0000","last_clean":"2023-09-30T23:04:09.646263+0000","last_became_active":"2023-09-30T23:04:08.644786+0000","last_became_peered":"2023-09-30T23:04:08.644786+0000","last_unstale":"2023-09-30T23:04:09.646263+0000","last_undegraded":"2023-09-30T23:04:09.646263+0000","last_fullsized":"2023-09-30T23:04:09.646263+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:09:58.786780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409472+0000","last_change":"2023-09-30T23:04:09.408604+0000","last_active":"2023-09-30T23:04:09.409472+0000","last_peered":"2023-09-30T23:04:09.409472+0000","last_clean":"2023-09-30T23:04:09.409472+0000","last_became_active":"2023-09-30T23:04:09.408319+0000","last_became_peered":"2023-09-30T23:04:09.408319+0000","last_unstale":"2023-09-30T23:04:09.409472+0000","last_undegraded":"2023-09-30T23:04:09.409472+0000","last_fullsized":"2023-09-30T23:04:09.409472+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:09:24.460016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649569+0000","last_change":"2023-09-30T23:04:08.654310+0000","last_active":"2023-09-30T23:04:09.649569+0000","last_peered":"2023-09-30T23:04:09.649569+0000","last_clean":"2023-09-30T23:04:09.649569+0000","last_became_active":"2023-09-30T23:04:08.653542+0000","last_became_peered":"2023-09-30T23:04:08.653542+0000","last_unstale":"2023-09-30T23:04:09.649569+0000","last_undegraded":"2023-09-30T23:04:09.649569+0000","last_fullsized":"2023-09-30T23:04:09.649569+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:16:59.525035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.419587+0000","last_change":"2023-09-30T23:04:09.419490+0000","last_active":"2023-09-30T23:04:09.419587+0000","last_peered":"2023-09-30T23:04:09.419587+0000","last_clean":"2023-09-30T23:04:09.419587+0000","last_became_active":"2023-09-30T23:04:09.419205+0000","last_became_peered":"2023-09-30T23:04:09.419205+0000","last_unstale":"2023-09-30T23:04:09.419587+0000","last_undegraded":"2023-09-30T23:04:09.419587+0000","last_fullsized":"2023-09-30T23:04:09.419587+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:56.950149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649864+0000","last_change":"2023-09-30T23:04:08.654341+0000","last_active":"2023-09-30T23:04:09.649864+0000","last_peered":"2023-09-30T23:04:09.649864+0000","last_clean":"2023-09-30T23:04:09.649864+0000","last_became_active":"2023-09-30T23:04:08.653787+0000","last_became_peered":"2023-09-30T23:04:08.653787+0000","last_unstale":"2023-09-30T23:04:09.649864+0000","last_undegraded":"2023-09-30T23:04:09.649864+0000","last_fullsized":"2023-09-30T23:04:09.649864+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:50.147954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417875+0000","last_change":"2023-09-30T23:04:09.417296+0000","last_active":"2023-09-30T23:04:09.417875+0000","last_peered":"2023-09-30T23:04:09.417875+0000","last_clean":"2023-09-30T23:04:09.417875+0000","last_became_active":"2023-09-30T23:04:09.416568+0000","last_became_peered":"2023-09-30T23:04:09.416568+0000","last_unstale":"2023-09-30T23:04:09.417875+0000","last_undegraded":"2023-09-30T23:04:09.417875+0000","last_fullsized":"2023-09-30T23:04:09.417875+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:32.396294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1a","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646113+0000","last_change":"2023-09-30T23:04:08.641729+0000","last_active":"2023-09-30T23:04:09.646113+0000","last_peered":"2023-09-30T23:04:09.646113+0000","last_clean":"2023-09-30T23:04:09.646113+0000","last_became_active":"2023-09-30T23:04:08.641477+0000","last_became_peered":"2023-09-30T23:04:08.641477+0000","last_unstale":"2023-09-30T23:04:09.646113+0000","last_undegraded":"2023-09-30T23:04:09.646113+0000","last_fullsized":"2023-09-30T23:04:09.646113+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:55.452822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405158+0000","last_change":"2023-09-30T23:04:09.404763+0000","last_active":"2023-09-30T23:04:09.405158+0000","last_peered":"2023-09-30T23:04:09.405158+0000","last_clean":"2023-09-30T23:04:09.405158+0000","last_became_active":"2023-09-30T23:04:09.404371+0000","last_became_peered":"2023-09-30T23:04:09.404371+0000","last_unstale":"2023-09-30T23:04:09.405158+0000","last_undegraded":"2023-09-30T23:04:09.405158+0000","last_fullsized":"2023-09-30T23:04:09.405158+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:34:57.616092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406235+0000","last_change":"2023-09-30T23:04:08.646585+0000","last_active":"2023-09-30T23:04:09.406235+0000","last_peered":"2023-09-30T23:04:09.406235+0000","last_clean":"2023-09-30T23:04:09.406235+0000","last_became_active":"2023-09-30T23:04:08.645625+0000","last_became_peered":"2023-09-30T23:04:08.645625+0000","last_unstale":"2023-09-30T23:04:09.406235+0000","last_undegraded":"2023-09-30T23:04:09.406235+0000","last_fullsized":"2023-09-30T23:04:09.406235+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:06:16.336767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410020+0000","last_change":"2023-09-30T23:04:09.409956+0000","last_active":"2023-09-30T23:04:09.410020+0000","last_peered":"2023-09-30T23:04:09.410020+0000","last_clean":"2023-09-30T23:04:09.410020+0000","last_became_active":"2023-09-30T23:04:09.409724+0000","last_became_peered":"2023-09-30T23:04:09.409724+0000","last_unstale":"2023-09-30T23:04:09.410020+0000","last_undegraded":"2023-09-30T23:04:09.410020+0000","last_fullsized":"2023-09-30T23:04:09.410020+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:36:22.796815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.402679+0000","last_change":"2023-09-30T23:04:08.648876+0000","last_active":"2023-09-30T23:04:09.402679+0000","last_peered":"2023-09-30T23:04:09.402679+0000","last_clean":"2023-09-30T23:04:09.402679+0000","last_became_active":"2023-09-30T23:04:08.648643+0000","last_became_peered":"2023-09-30T23:04:08.648643+0000","last_unstale":"2023-09-30T23:04:09.402679+0000","last_undegraded":"2023-09-30T23:04:09.402679+0000","last_fullsized":"2023-09-30T23:04:09.402679+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:28:28.962255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.408573+0000","last_change":"2023-09-30T23:04:09.408502+0000","last_active":"2023-09-30T23:04:09.408573+0000","last_peered":"2023-09-30T23:04:09.408573+0000","last_clean":"2023-09-30T23:04:09.408573+0000","last_became_active":"2023-09-30T23:04:09.408271+0000","last_became_peered":"2023-09-30T23:04:09.408271+0000","last_unstale":"2023-09-30T23:04:09.408573+0000","last_undegraded":"2023-09-30T23:04:09.408573+0000","last_fullsized":"2023-09-30T23:04:09.408573+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:54:13.538114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646320+0000","last_change":"2023-09-30T23:04:08.651753+0000","last_active":"2023-09-30T23:04:09.646320+0000","last_peered":"2023-09-30T23:04:09.646320+0000","last_clean":"2023-09-30T23:04:09.646320+0000","last_became_active":"2023-09-30T23:04:08.651426+0000","last_became_peered":"2023-09-30T23:04:08.651426+0000","last_unstale":"2023-09-30T23:04:09.646320+0000","last_undegraded":"2023-09-30T23:04:09.646320+0000","last_fullsized":"2023-09-30T23:04:09.646320+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:46:32.070477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415476+0000","last_change":"2023-09-30T23:04:09.415245+0000","last_active":"2023-09-30T23:04:09.415476+0000","last_peered":"2023-09-30T23:04:09.415476+0000","last_clean":"2023-09-30T23:04:09.415476+0000","last_became_active":"2023-09-30T23:04:09.415024+0000","last_became_peered":"2023-09-30T23:04:09.415024+0000","last_unstale":"2023-09-30T23:04:09.415476+0000","last_undegraded":"2023-09-30T23:04:09.415476+0000","last_fullsized":"2023-09-30T23:04:09.415476+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:10.392690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.648998+0000","last_change":"2023-09-30T23:04:08.648943+0000","last_active":"2023-09-30T23:04:09.648998+0000","last_peered":"2023-09-30T23:04:09.648998+0000","last_clean":"2023-09-30T23:04:09.648998+0000","last_became_active":"2023-09-30T23:04:08.648245+0000","last_became_peered":"2023-09-30T23:04:08.648245+0000","last_unstale":"2023-09-30T23:04:09.648998+0000","last_undegraded":"2023-09-30T23:04:09.648998+0000","last_fullsized":"2023-09-30T23:04:09.648998+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:14:31.385429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415093+0000","last_change":"2023-09-30T23:04:09.414905+0000","last_active":"2023-09-30T23:04:09.415093+0000","last_peered":"2023-09-30T23:04:09.415093+0000","last_clean":"2023-09-30T23:04:09.415093+0000","last_became_active":"2023-09-30T23:04:09.414317+0000","last_became_peered":"2023-09-30T23:04:09.414317+0000","last_unstale":"2023-09-30T23:04:09.415093+0000","last_undegraded":"2023-09-30T23:04:09.415093+0000","last_fullsized":"2023-09-30T23:04:09.415093+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:10:06.080599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649791+0000","last_change":"2023-09-30T23:04:08.651073+0000","last_active":"2023-09-30T23:04:09.649791+0000","last_peered":"2023-09-30T23:04:09.649791+0000","last_clean":"2023-09-30T23:04:09.649791+0000","last_became_active":"2023-09-30T23:04:08.650832+0000","last_became_peered":"2023-09-30T23:04:08.650832+0000","last_unstale":"2023-09-30T23:04:09.649791+0000","last_undegraded":"2023-09-30T23:04:09.649791+0000","last_fullsized":"2023-09-30T23:04:09.649791+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:37:25.770548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414202+0000","last_change":"2023-09-30T23:04:09.414014+0000","last_active":"2023-09-30T23:04:09.414202+0000","last_peered":"2023-09-30T23:04:09.414202+0000","last_clean":"2023-09-30T23:04:09.414202+0000","last_became_active":"2023-09-30T23:04:09.413136+0000","last_became_peered":"2023-09-30T23:04:09.413136+0000","last_unstale":"2023-09-30T23:04:09.414202+0000","last_undegraded":"2023-09-30T23:04:09.414202+0000","last_fullsized":"2023-09-30T23:04:09.414202+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:31.738197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.411420+0000","last_change":"2023-09-30T23:04:08.643197+0000","last_active":"2023-09-30T23:04:09.411420+0000","last_peered":"2023-09-30T23:04:09.411420+0000","last_clean":"2023-09-30T23:04:09.411420+0000","last_became_active":"2023-09-30T23:04:08.642967+0000","last_became_peered":"2023-09-30T23:04:08.642967+0000","last_unstale":"2023-09-30T23:04:09.411420+0000","last_undegraded":"2023-09-30T23:04:09.411420+0000","last_fullsized":"2023-09-30T23:04:09.411420+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:20.255104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417914+0000","last_change":"2023-09-30T23:04:09.417574+0000","last_active":"2023-09-30T23:04:09.417914+0000","last_peered":"2023-09-30T23:04:09.417914+0000","last_clean":"2023-09-30T23:04:09.417914+0000","last_became_active":"2023-09-30T23:04:09.417071+0000","last_became_peered":"2023-09-30T23:04:09.417071+0000","last_unstale":"2023-09-30T23:04:09.417914+0000","last_undegraded":"2023-09-30T23:04:09.417914+0000","last_fullsized":"2023-09-30T23:04:09.417914+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:58.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.b","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.649886+0000","last_change":"2023-09-30T23:04:08.646492+0000","last_active":"2023-09-30T23:04:09.649886+0000","last_peered":"2023-09-30T23:04:09.649886+0000","last_clean":"2023-09-30T23:04:09.649886+0000","last_became_active":"2023-09-30T23:04:08.646037+0000","last_became_peered":"2023-09-30T23:04:08.646037+0000","last_unstale":"2023-09-30T23:04:09.649886+0000","last_undegraded":"2023-09-30T23:04:09.649886+0000","last_fullsized":"2023-09-30T23:04:09.649886+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:43:05.907881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404543+0000","last_change":"2023-09-30T23:04:09.404476+0000","last_active":"2023-09-30T23:04:09.404543+0000","last_peered":"2023-09-30T23:04:09.404543+0000","last_clean":"2023-09-30T23:04:09.404543+0000","last_became_active":"2023-09-30T23:04:09.404250+0000","last_became_peered":"2023-09-30T23:04:09.404250+0000","last_unstale":"2023-09-30T23:04:09.404543+0000","last_undegraded":"2023-09-30T23:04:09.404543+0000","last_fullsized":"2023-09-30T23:04:09.404543+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:18.130583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410335+0000","last_change":"2023-09-30T23:04:08.651302+0000","last_active":"2023-09-30T23:04:09.410335+0000","last_peered":"2023-09-30T23:04:09.410335+0000","last_clean":"2023-09-30T23:04:09.410335+0000","last_became_active":"2023-09-30T23:04:08.651081+0000","last_became_peered":"2023-09-30T23:04:08.651081+0000","last_unstale":"2023-09-30T23:04:09.410335+0000","last_undegraded":"2023-09-30T23:04:09.410335+0000","last_fullsized":"2023-09-30T23:04:09.410335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:51:03.522141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405063+0000","last_change":"2023-09-30T23:04:09.404985+0000","last_active":"2023-09-30T23:04:09.405063+0000","last_peered":"2023-09-30T23:04:09.405063+0000","last_clean":"2023-09-30T23:04:09.405063+0000","last_became_active":"2023-09-30T23:04:09.404596+0000","last_became_peered":"2023-09-30T23:04:09.404596+0000","last_unstale":"2023-09-30T23:04:09.405063+0000","last_undegraded":"2023-09-30T23:04:09.405063+0000","last_fullsized":"2023-09-30T23:04:09.405063+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:38:13.212432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.401019+0000","last_change":"2023-09-30T23:04:08.651306+0000","last_active":"2023-09-30T23:04:09.401019+0000","last_peered":"2023-09-30T23:04:09.401019+0000","last_clean":"2023-09-30T23:04:09.401019+0000","last_became_active":"2023-09-30T23:04:08.651035+0000","last_became_peered":"2023-09-30T23:04:08.651035+0000","last_unstale":"2023-09-30T23:04:09.401019+0000","last_undegraded":"2023-09-30T23:04:09.401019+0000","last_fullsized":"2023-09-30T23:04:09.401019+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:02:57.648150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417338+0000","last_change":"2023-09-30T23:04:09.417145+0000","last_active":"2023-09-30T23:04:09.417338+0000","last_peered":"2023-09-30T23:04:09.417338+0000","last_clean":"2023-09-30T23:04:09.417338+0000","last_became_active":"2023-09-30T23:04:09.416421+0000","last_became_peered":"2023-09-30T23:04:09.416421+0000","last_unstale":"2023-09-30T23:04:09.417338+0000","last_undegraded":"2023-09-30T23:04:09.417338+0000","last_fullsized":"2023-09-30T23:04:09.417338+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:35:21.265969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409058+0000","last_change":"2023-09-30T23:04:08.649642+0000","last_active":"2023-09-30T23:04:09.409058+0000","last_peered":"2023-09-30T23:04:09.409058+0000","last_clean":"2023-09-30T23:04:09.409058+0000","last_became_active":"2023-09-30T23:04:08.649297+0000","last_became_peered":"2023-09-30T23:04:08.649297+0000","last_unstale":"2023-09-30T23:04:09.409058+0000","last_undegraded":"2023-09-30T23:04:09.409058+0000","last_fullsized":"2023-09-30T23:04:09.409058+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:49.974680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415860+0000","last_change":"2023-09-30T23:04:09.414269+0000","last_active":"2023-09-30T23:04:09.415860+0000","last_peered":"2023-09-30T23:04:09.415860+0000","last_clean":"2023-09-30T23:04:09.415860+0000","last_became_active":"2023-09-30T23:04:09.413780+0000","last_became_peered":"2023-09-30T23:04:09.413780+0000","last_unstale":"2023-09-30T23:04:09.415860+0000","last_undegraded":"2023-09-30T23:04:09.415860+0000","last_fullsized":"2023-09-30T23:04:09.415860+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:26.850603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.646919+0000","last_change":"2023-09-30T23:04:08.646678+0000","last_active":"2023-09-30T23:04:09.646919+0000","last_peered":"2023-09-30T23:04:09.646919+0000","last_clean":"2023-09-30T23:04:09.646919+0000","last_became_active":"2023-09-30T23:04:08.646404+0000","last_became_peered":"2023-09-30T23:04:08.646404+0000","last_unstale":"2023-09-30T23:04:09.646919+0000","last_undegraded":"2023-09-30T23:04:09.646919+0000","last_fullsized":"2023-09-30T23:04:09.646919+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:32:47.505050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415234+0000","last_change":"2023-09-30T23:04:09.414137+0000","last_active":"2023-09-30T23:04:09.415234+0000","last_peered":"2023-09-30T23:04:09.415234+0000","last_clean":"2023-09-30T23:04:09.415234+0000","last_became_active":"2023-09-30T23:04:09.413915+0000","last_became_peered":"2023-09-30T23:04:09.413915+0000","last_unstale":"2023-09-30T23:04:09.415234+0000","last_undegraded":"2023-09-30T23:04:09.415234+0000","last_fullsized":"2023-09-30T23:04:09.415234+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:51.774720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.403299+0000","last_change":"2023-09-30T23:04:08.652990+0000","last_active":"2023-09-30T23:04:09.403299+0000","last_peered":"2023-09-30T23:04:09.403299+0000","last_clean":"2023-09-30T23:04:09.403299+0000","last_became_active":"2023-09-30T23:04:08.652752+0000","last_became_peered":"2023-09-30T23:04:08.652752+0000","last_unstale":"2023-09-30T23:04:09.403299+0000","last_undegraded":"2023-09-30T23:04:09.403299+0000","last_fullsized":"2023-09-30T23:04:09.403299+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:16.562516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.413120+0000","last_change":"2023-09-30T23:04:09.412880+0000","last_active":"2023-09-30T23:04:09.413120+0000","last_peered":"2023-09-30T23:04:09.413120+0000","last_clean":"2023-09-30T23:04:09.413120+0000","last_became_active":"2023-09-30T23:04:09.412648+0000","last_became_peered":"2023-09-30T23:04:09.412648+0000","last_unstale":"2023-09-30T23:04:09.413120+0000","last_undegraded":"2023-09-30T23:04:09.413120+0000","last_fullsized":"2023-09-30T23:04:09.413120+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:09:02.462735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406352+0000","last_change":"2023-09-30T23:04:08.645842+0000","last_active":"2023-09-30T23:04:09.406352+0000","last_peered":"2023-09-30T23:04:09.406352+0000","last_clean":"2023-09-30T23:04:09.406352+0000","last_became_active":"2023-09-30T23:04:08.644768+0000","last_became_peered":"2023-09-30T23:04:08.644768+0000","last_unstale":"2023-09-30T23:04:09.406352+0000","last_undegraded":"2023-09-30T23:04:09.406352+0000","last_fullsized":"2023-09-30T23:04:09.406352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:54:47.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414655+0000","last_change":"2023-09-30T23:04:09.412794+0000","last_active":"2023-09-30T23:04:09.414655+0000","last_peered":"2023-09-30T23:04:09.414655+0000","last_clean":"2023-09-30T23:04:09.414655+0000","last_became_active":"2023-09-30T23:04:09.412412+0000","last_became_peered":"2023-09-30T23:04:09.412412+0000","last_unstale":"2023-09-30T23:04:09.414655+0000","last_undegraded":"2023-09-30T23:04:09.414655+0000","last_fullsized":"2023-09-30T23:04:09.414655+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:31.738197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.407264+0000","last_change":"2023-09-30T23:04:08.649528+0000","last_active":"2023-09-30T23:04:09.407264+0000","last_peered":"2023-09-30T23:04:09.407264+0000","last_clean":"2023-09-30T23:04:09.407264+0000","last_became_active":"2023-09-30T23:04:08.649299+0000","last_became_peered":"2023-09-30T23:04:08.649299+0000","last_unstale":"2023-09-30T23:04:09.407264+0000","last_undegraded":"2023-09-30T23:04:09.407264+0000","last_fullsized":"2023-09-30T23:04:09.407264+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:55.939283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417354+0000","last_change":"2023-09-30T23:04:09.417281+0000","last_active":"2023-09-30T23:04:09.417354+0000","last_peered":"2023-09-30T23:04:09.417354+0000","last_clean":"2023-09-30T23:04:09.417354+0000","last_became_active":"2023-09-30T23:04:09.416918+0000","last_became_peered":"2023-09-30T23:04:09.416918+0000","last_unstale":"2023-09-30T23:04:09.417354+0000","last_undegraded":"2023-09-30T23:04:09.417354+0000","last_fullsized":"2023-09-30T23:04:09.417354+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:56.463688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409152+0000","last_change":"2023-09-30T23:04:08.651961+0000","last_active":"2023-09-30T23:04:09.409152+0000","last_peered":"2023-09-30T23:04:09.409152+0000","last_clean":"2023-09-30T23:04:09.409152+0000","last_became_active":"2023-09-30T23:04:08.651742+0000","last_became_peered":"2023-09-30T23:04:08.651742+0000","last_unstale":"2023-09-30T23:04:09.409152+0000","last_undegraded":"2023-09-30T23:04:09.409152+0000","last_fullsized":"2023-09-30T23:04:09.409152+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T10:38:12.201566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.415878+0000","last_change":"2023-09-30T23:04:09.414403+0000","last_active":"2023-09-30T23:04:09.415878+0000","last_peered":"2023-09-30T23:04:09.415878+0000","last_clean":"2023-09-30T23:04:09.415878+0000","last_became_active":"2023-09-30T23:04:09.414061+0000","last_became_peered":"2023-09-30T23:04:09.414061+0000","last_unstale":"2023-09-30T23:04:09.415878+0000","last_undegraded":"2023-09-30T23:04:09.415878+0000","last_fullsized":"2023-09-30T23:04:09.415878+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:11:05.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.408743+0000","last_change":"2023-09-30T23:04:08.654495+0000","last_active":"2023-09-30T23:04:09.408743+0000","last_peered":"2023-09-30T23:04:09.408743+0000","last_clean":"2023-09-30T23:04:09.408743+0000","last_became_active":"2023-09-30T23:04:08.654133+0000","last_became_peered":"2023-09-30T23:04:08.654133+0000","last_unstale":"2023-09-30T23:04:09.408743+0000","last_undegraded":"2023-09-30T23:04:09.408743+0000","last_fullsized":"2023-09-30T23:04:09.408743+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:24.394446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410991+0000","last_change":"2023-09-30T23:04:09.410923+0000","last_active":"2023-09-30T23:04:09.410991+0000","last_peered":"2023-09-30T23:04:09.410991+0000","last_clean":"2023-09-30T23:04:09.410991+0000","last_became_active":"2023-09-30T23:04:09.410618+0000","last_became_peered":"2023-09-30T23:04:09.410618+0000","last_unstale":"2023-09-30T23:04:09.410991+0000","last_undegraded":"2023-09-30T23:04:09.410991+0000","last_fullsized":"2023-09-30T23:04:09.410991+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:14:28.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.410755+0000","last_change":"2023-09-30T23:04:08.653864+0000","last_active":"2023-09-30T23:04:09.410755+0000","last_peered":"2023-09-30T23:04:09.410755+0000","last_clean":"2023-09-30T23:04:09.410755+0000","last_became_active":"2023-09-30T23:04:08.653619+0000","last_became_peered":"2023-09-30T23:04:08.653619+0000","last_unstale":"2023-09-30T23:04:09.410755+0000","last_undegraded":"2023-09-30T23:04:09.410755+0000","last_fullsized":"2023-09-30T23:04:09.410755+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:54.003848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417858+0000","last_change":"2023-09-30T23:04:09.417115+0000","last_active":"2023-09-30T23:04:09.417858+0000","last_peered":"2023-09-30T23:04:09.417858+0000","last_clean":"2023-09-30T23:04:09.417858+0000","last_became_active":"2023-09-30T23:04:09.416881+0000","last_became_peered":"2023-09-30T23:04:09.416881+0000","last_unstale":"2023-09-30T23:04:09.417858+0000","last_undegraded":"2023-09-30T23:04:09.417858+0000","last_fullsized":"2023-09-30T23:04:09.417858+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:10:06.080599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400522+0000","last_change":"2023-09-30T23:04:08.644649+0000","last_active":"2023-09-30T23:04:09.400522+0000","last_peered":"2023-09-30T23:04:09.400522+0000","last_clean":"2023-09-30T23:04:09.400522+0000","last_became_active":"2023-09-30T23:04:08.644205+0000","last_became_peered":"2023-09-30T23:04:08.644205+0000","last_unstale":"2023-09-30T23:04:09.400522+0000","last_undegraded":"2023-09-30T23:04:09.400522+0000","last_fullsized":"2023-09-30T23:04:09.400522+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:00.436015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.407351+0000","last_change":"2023-09-30T23:04:09.406390+0000","last_active":"2023-09-30T23:04:09.407351+0000","last_peered":"2023-09-30T23:04:09.407351+0000","last_clean":"2023-09-30T23:04:09.407351+0000","last_became_active":"2023-09-30T23:04:09.406186+0000","last_became_peered":"2023-09-30T23:04:09.406186+0000","last_unstale":"2023-09-30T23:04:09.407351+0000","last_undegraded":"2023-09-30T23:04:09.407351+0000","last_fullsized":"2023-09-30T23:04:09.407351+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:52:59.618133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.403199+0000","last_change":"2023-09-30T23:04:08.647293+0000","last_active":"2023-09-30T23:04:09.403199+0000","last_peered":"2023-09-30T23:04:09.403199+0000","last_clean":"2023-09-30T23:04:09.403199+0000","last_became_active":"2023-09-30T23:04:08.647073+0000","last_became_peered":"2023-09-30T23:04:08.647073+0000","last_unstale":"2023-09-30T23:04:09.403199+0000","last_undegraded":"2023-09-30T23:04:09.403199+0000","last_fullsized":"2023-09-30T23:04:09.403199+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:31:48.115952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.402858+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:04:09.402858+0000","last_peered":"2023-09-30T23:04:09.402858+0000","last_clean":"2023-09-30T23:04:09.402858+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:04:09.402858+0000","last_undegraded":"2023-09-30T23:04:09.402858+0000","last_fullsized":"2023-09-30T23:04:09.402858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.416758+0000","last_change":"2023-09-30T23:04:09.416693+0000","last_active":"2023-09-30T23:04:09.416758+0000","last_peered":"2023-09-30T23:04:09.416758+0000","last_clean":"2023-09-30T23:04:09.416758+0000","last_became_active":"2023-09-30T23:04:09.416472+0000","last_became_peered":"2023-09-30T23:04:09.416472+0000","last_unstale":"2023-09-30T23:04:09.416758+0000","last_undegraded":"2023-09-30T23:04:09.416758+0000","last_fullsized":"2023-09-30T23:04:09.416758+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:47:50.550095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400602+0000","last_change":"2023-09-30T23:04:08.650433+0000","last_active":"2023-09-30T23:04:09.400602+0000","last_peered":"2023-09-30T23:04:09.400602+0000","last_clean":"2023-09-30T23:04:09.400602+0000","last_became_active":"2023-09-30T23:04:08.649702+0000","last_became_peered":"2023-09-30T23:04:08.649702+0000","last_unstale":"2023-09-30T23:04:09.400602+0000","last_undegraded":"2023-09-30T23:04:09.400602+0000","last_fullsized":"2023-09-30T23:04:09.400602+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:59:30.727331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405569+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:04:09.405569+0000","last_peered":"2023-09-30T23:04:09.405569+0000","last_clean":"2023-09-30T23:04:09.405569+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:04:09.405569+0000","last_undegraded":"2023-09-30T23:04:09.405569+0000","last_fullsized":"2023-09-30T23:04:09.405569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414706+0000","last_change":"2023-09-30T23:04:09.414007+0000","last_active":"2023-09-30T23:04:09.414706+0000","last_peered":"2023-09-30T23:04:09.414706+0000","last_clean":"2023-09-30T23:04:09.414706+0000","last_became_active":"2023-09-30T23:04:09.413297+0000","last_became_peered":"2023-09-30T23:04:09.413297+0000","last_unstale":"2023-09-30T23:04:09.414706+0000","last_undegraded":"2023-09-30T23:04:09.414706+0000","last_fullsized":"2023-09-30T23:04:09.414706+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:19.498286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"191'6","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.651991+0000","last_change":"2023-09-30T23:04:08.653009+0000","last_active":"2023-09-30T23:04:09.651991+0000","last_peered":"2023-09-30T23:04:09.651991+0000","last_clean":"2023-09-30T23:04:09.651991+0000","last_became_active":"2023-09-30T23:04:08.652768+0000","last_became_peered":"2023-09-30T23:04:08.652768+0000","last_unstale":"2023-09-30T23:04:09.651991+0000","last_undegraded":"2023-09-30T23:04:09.651991+0000","last_fullsized":"2023-09-30T23:04:09.651991+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:41:55.939283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409073+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:04:09.409073+0000","last_peered":"2023-09-30T23:04:09.409073+0000","last_clean":"2023-09-30T23:04:09.409073+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:04:09.409073+0000","last_undegraded":"2023-09-30T23:04:09.409073+0000","last_fullsized":"2023-09-30T23:04:09.409073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414720+0000","last_change":"2023-09-30T23:04:09.412851+0000","last_active":"2023-09-30T23:04:09.414720+0000","last_peered":"2023-09-30T23:04:09.414720+0000","last_clean":"2023-09-30T23:04:09.414720+0000","last_became_active":"2023-09-30T23:04:09.412492+0000","last_became_peered":"2023-09-30T23:04:09.412492+0000","last_unstale":"2023-09-30T23:04:09.414720+0000","last_undegraded":"2023-09-30T23:04:09.414720+0000","last_fullsized":"2023-09-30T23:04:09.414720+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:57:51.381570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400891+0000","last_change":"2023-09-30T23:04:08.644040+0000","last_active":"2023-09-30T23:04:09.400891+0000","last_peered":"2023-09-30T23:04:09.400891+0000","last_clean":"2023-09-30T23:04:09.400891+0000","last_became_active":"2023-09-30T23:04:08.642633+0000","last_became_peered":"2023-09-30T23:04:08.642633+0000","last_unstale":"2023-09-30T23:04:09.400891+0000","last_undegraded":"2023-09-30T23:04:09.400891+0000","last_fullsized":"2023-09-30T23:04:09.400891+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:09.381824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":167,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406482+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:04:09.406482+0000","last_peered":"2023-09-30T23:04:09.406482+0000","last_clean":"2023-09-30T23:04:09.406482+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:04:09.406482+0000","last_undegraded":"2023-09-30T23:04:09.406482+0000","last_fullsized":"2023-09-30T23:04:09.406482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404921+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:04:09.404921+0000","last_peered":"2023-09-30T23:04:09.404921+0000","last_clean":"2023-09-30T23:04:09.404921+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:04:09.404921+0000","last_undegraded":"2023-09-30T23:04:09.404921+0000","last_fullsized":"2023-09-30T23:04:09.404921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.417890+0000","last_change":"2023-09-30T23:04:09.417448+0000","last_active":"2023-09-30T23:04:09.417890+0000","last_peered":"2023-09-30T23:04:09.417890+0000","last_clean":"2023-09-30T23:04:09.417890+0000","last_became_active":"2023-09-30T23:04:09.417015+0000","last_became_peered":"2023-09-30T23:04:09.417015+0000","last_unstale":"2023-09-30T23:04:09.417890+0000","last_undegraded":"2023-09-30T23:04:09.417890+0000","last_fullsized":"2023-09-30T23:04:09.417890+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:35:10.392690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.648047+0000","last_change":"2023-09-30T23:04:08.650001+0000","last_active":"2023-09-30T23:04:09.648047+0000","last_peered":"2023-09-30T23:04:09.648047+0000","last_clean":"2023-09-30T23:04:09.648047+0000","last_became_active":"2023-09-30T23:04:08.649737+0000","last_became_peered":"2023-09-30T23:04:08.649737+0000","last_unstale":"2023-09-30T23:04:09.648047+0000","last_undegraded":"2023-09-30T23:04:09.648047+0000","last_fullsized":"2023-09-30T23:04:09.648047+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:28:00.078072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405006+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:04:09.405006+0000","last_peered":"2023-09-30T23:04:09.405006+0000","last_clean":"2023-09-30T23:04:09.405006+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:04:09.405006+0000","last_undegraded":"2023-09-30T23:04:09.405006+0000","last_fullsized":"2023-09-30T23:04:09.405006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405047+0000","last_change":"2023-09-30T23:04:09.404829+0000","last_active":"2023-09-30T23:04:09.405047+0000","last_peered":"2023-09-30T23:04:09.405047+0000","last_clean":"2023-09-30T23:04:09.405047+0000","last_became_active":"2023-09-30T23:04:09.404291+0000","last_became_peered":"2023-09-30T23:04:09.404291+0000","last_unstale":"2023-09-30T23:04:09.405047+0000","last_undegraded":"2023-09-30T23:04:09.405047+0000","last_fullsized":"2023-09-30T23:04:09.405047+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:05:10.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.10","version":"191'8","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.650604+0000","last_change":"2023-09-30T23:04:08.655186+0000","last_active":"2023-09-30T23:04:09.650604+0000","last_peered":"2023-09-30T23:04:09.650604+0000","last_clean":"2023-09-30T23:04:09.650604+0000","last_became_active":"2023-09-30T23:04:08.653980+0000","last_became_peered":"2023-09-30T23:04:08.653980+0000","last_unstale":"2023-09-30T23:04:09.650604+0000","last_undegraded":"2023-09-30T23:04:09.650604+0000","last_fullsized":"2023-09-30T23:04:09.650604+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:37:25.770548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.404930+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:04:09.404930+0000","last_peered":"2023-09-30T23:04:09.404930+0000","last_clean":"2023-09-30T23:04:09.404930+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:04:09.404930+0000","last_undegraded":"2023-09-30T23:04:09.404930+0000","last_fullsized":"2023-09-30T23:04:09.404930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.409489+0000","last_change":"2023-09-30T23:04:09.409263+0000","last_active":"2023-09-30T23:04:09.409489+0000","last_peered":"2023-09-30T23:04:09.409489+0000","last_clean":"2023-09-30T23:04:09.409489+0000","last_became_active":"2023-09-30T23:04:09.408764+0000","last_became_peered":"2023-09-30T23:04:09.408764+0000","last_unstale":"2023-09-30T23:04:09.409489+0000","last_undegraded":"2023-09-30T23:04:09.409489+0000","last_fullsized":"2023-09-30T23:04:09.409489+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:44:30.291009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.13","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.648976+0000","last_change":"2023-09-30T23:04:08.648183+0000","last_active":"2023-09-30T23:04:09.648976+0000","last_peered":"2023-09-30T23:04:09.648976+0000","last_clean":"2023-09-30T23:04:09.648976+0000","last_became_active":"2023-09-30T23:04:08.647764+0000","last_became_peered":"2023-09-30T23:04:08.647764+0000","last_unstale":"2023-09-30T23:04:09.648976+0000","last_undegraded":"2023-09-30T23:04:09.648976+0000","last_fullsized":"2023-09-30T23:04:09.648976+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:41:09.233388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.406390+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:04:09.406390+0000","last_peered":"2023-09-30T23:04:09.406390+0000","last_clean":"2023-09-30T23:04:09.406390+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:04:09.406390+0000","last_undegraded":"2023-09-30T23:04:09.406390+0000","last_fullsized":"2023-09-30T23:04:09.406390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.414673+0000","last_change":"2023-09-30T23:04:09.413308+0000","last_active":"2023-09-30T23:04:09.414673+0000","last_peered":"2023-09-30T23:04:09.414673+0000","last_clean":"2023-09-30T23:04:09.414673+0000","last_became_active":"2023-09-30T23:04:09.413082+0000","last_became_peered":"2023-09-30T23:04:09.413082+0000","last_unstale":"2023-09-30T23:04:09.414673+0000","last_undegraded":"2023-09-30T23:04:09.414673+0000","last_fullsized":"2023-09-30T23:04:09.414673+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:08.627593+0000","last_clean_scrub_stamp":"2023-09-30T23:04:08.627593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:01.446880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.400717+0000","last_change":"2023-09-30T23:04:08.650175+0000","last_active":"2023-09-30T23:04:09.400717+0000","last_peered":"2023-09-30T23:04:09.400717+0000","last_clean":"2023-09-30T23:04:09.400717+0000","last_became_active":"2023-09-30T23:04:08.649179+0000","last_became_peered":"2023-09-30T23:04:08.649179+0000","last_unstale":"2023-09-30T23:04:09.400717+0000","last_undegraded":"2023-09-30T23:04:09.400717+0000","last_fullsized":"2023-09-30T23:04:09.400717+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:07.616727+0000","last_clean_scrub_stamp":"2023-09-30T23:04:07.616727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:37:29.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-30T23:04:09.405496+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:04:09.405496+0000","last_peered":"2023-09-30T23:04:09.405496+0000","last_clean":"2023-09-30T23:04:09.405496+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:04:09.405496+0000","last_undegraded":"2023-09-30T23:04:09.405496+0000","last_fullsized":"2023-09-30T23:04:09.405496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194188,"statfs":{"total":200000000,"available":198848574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.65400000000000003},"min":{"1min":0.57199999999999995,"5min":0.38200000000000001,"15min":0.315},"max":{"1min":0.871,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.70399999999999996,"15min":0.67100000000000004},"min":{"1min":0.441,"5min":0.378,"15min":0.378},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79600000000000004}]},{"osd":1,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.65700000000000003},"min":{"1min":0.54700000000000004,"5min":0.42899999999999999,"15min":0.36599999999999999},"max":{"1min":0.95699999999999996,"5min":1.004,"15min":1.004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69999999999999996,"15min":0.68500000000000005},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94599999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71399999999999997,"15min":0.69099999999999995},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.60799999999999998,"5min":0.54900000000000004,"15min":0.46700000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.67200000000000004},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93799999999999994,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.877},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.57499999999999996,"5min":0.51300000000000001,"15min":0.434},"max":{"1min":1.004,"5min":1.004,"15min":1.056},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.95999999999999996},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.62},"min":{"1min":0.504,"5min":0.432,"15min":0.35999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.82099999999999995}]},{"osd":5,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97199999999999998,"5min":1.03,"15min":1.135},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.67700000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95799999999999996,"5min":1.002,"15min":1.004},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Sep 30 23:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.998,"5min":1.147,"15min":1.147},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.71799999999999997},"min":{"1min":0.57999999999999996,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.93999999999999995,"5min":1.016,"15min":1.071},"last":0.92800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194188,"statfs":{"total":200000000,"available":198848574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.83899999999999997},"min":{"1min":0.52700000000000002,"5min":0.40500000000000003,"15min":0.29299999999999998},"max":{"1min":0.91800000000000004,"5min":0.96699999999999997,"15min":6.5190000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71399999999999997,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":4.3680000000000003},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.77900000000000003},"min":{"1min":0.5,"5min":0.45900000000000002,"15min":0.42699999999999999},"max":{"1min":0.97799999999999998,"5min":1.123,"15min":3.6339999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72899999999999998,"15min":0.86799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":1.034,"5min":1.073,"15min":8.4339999999999993},"last":0.75}]},{"osd":2,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.76000000000000001},"min":{"1min":0.51000000000000001,"5min":0.44900000000000001,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.92000000000000004,"15min":3.4580000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.746,"5min":0.74299999999999999,"15min":0.871},"min":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.40500000000000003},"max":{"1min":1.0680000000000001,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.753,"15min":0.85199999999999998},"min":{"1min":0.53800000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":5.7110000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.87,"5min":0.96599999999999997,"15min":1.5249999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.309},"max":{"1min":0.80500000000000005,"5min":0.99299999999999999,"15min":3.4670000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.999,"5min":0.999,"15min":5.9279999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89800000000000002,"5min":1.05,"15min":1.321},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.52200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.91000000000000003,"5min":1.0289999999999999,"15min":1.4590000000000001},"last":0.82099999999999995}]},{"osd":7,"last update":"Sat Sep 30 23:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73799999999999999,"15min":0.76200000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.874,"5min":1.018,"15min":6.0599999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.753,"15min":0.748},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.022,"5min":1.1140000000000001,"15min":1.3620000000000001},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193612,"statfs":{"total":200000000,"available":198259652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.251},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.083},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.46999999999999997},"min":{"1min":0.34200000000000003,"5min":0.32200000000000001,"15min":0.29999999999999999},"max":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.745},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.45000000000000001},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.28399999999999997},"max":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.64800000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.44900000000000001,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.73099999999999998,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.433},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.49099999999999999},"min":{"1min":0.41199999999999998,"5min":0.307,"15min":0.27400000000000002},"max":{"1min":0.69199999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.70599999999999996},"min":{"1min":0.56699999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89400000000000002,"5min":1.091,"15min":1.091},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.746,"15min":0.73799999999999999},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98599999999999999,"5min":1.01,"15min":1.1000000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":1.1499999999999999,"15min":1.22},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.746,"15min":0.746},"min":{"1min":0.58099999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0369999999999999,"5min":1.048,"15min":1.3560000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":1.1160000000000001,"15min":1.127},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.55200000000000005,"5min":0.51000000000000001,"15min":0.48099999999999998},"max":{"1min":1.002,"5min":1.0529999999999999,"15min":1.4059999999999999},"last":0.753}]},{"osd":7,"last update":"Sat Sep 30 23:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.51800000000000002},"max":{"1min":0.94099999999999995,"5min":1.109,"15min":1.1240000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79500000000000004,"15min":0.78600000000000003},"min":{"1min":0.622,"5min":0.504,"15min":0.504},"max":{"1min":0.93400000000000005,"5min":1.022,"15min":1.3779999999999999},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194189,"statfs":{"total":200000000,"available":198850110,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.85699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":0.63800000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.39200000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":0.68200000000000005,"5min":0.747,"15min":1.0289999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.42599999999999999,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.77000000000000002,"15min":0.879},"last":0.49299999999999999}]},{"osd":3,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.71999999999999997,"5min":0.749,"15min":1.0029999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79300000000000004,"15min":0.98899999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.27},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":1.006,"5min":1.024,"15min":1.171},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.41099999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.2649999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.091,"5min":1.091,"15min":4.0419999999999998},"last":0.90600000000000003}]},{"osd":6,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.50900000000000001,"15min":0.434},"max":{"1min":1.05,"5min":1.05,"15min":2.6059999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.48399999999999999},"max":{"1min":1.04,"5min":1.0669999999999999,"15min":7.2610000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.4569999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.016,"5min":1.05,"15min":4.0220000000000002},"last":0.91400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1123,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194188,"statfs":{"total":200000000,"available":198849374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23599999999999999},"max":{"1min":0.749,"5min":0.77500000000000002,"15min":1.4630000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48099999999999998,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.30399999999999999,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.876,"15min":1.542},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52300000000000002,"15min":0.496},"min":{"1min":0.32100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.494},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.52600000000000002},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.29599999999999999},"max":{"1min":0.81499999999999995,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48499999999999999,"15min":0.46999999999999997},"min":{"1min":0.42299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68700000000000006,"5min":0.94399999999999995,"15min":1.649},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":0.98099999999999998,"15min":1.3220000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.77900000000000003},"min":{"1min":0.66800000000000004,"5min":0.55000000000000004,"15min":0.44400000000000001},"max":{"1min":1.137,"5min":1.1819999999999999,"15min":1.234},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.45900000000000002,"15min":0.38},"max":{"1min":1.167,"5min":1.167,"15min":1.4910000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80300000000000005,"15min":0.79000000000000004},"min":{"1min":0.66100000000000003,"5min":0.53100000000000003,"15min":0.45200000000000001},"max":{"1min":1.0900000000000001,"5min":1.1459999999999999,"15min":1.179},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58099999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.22,"5min":1.22,"15min":2.7320000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.615},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77400000000000002,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.55300000000000005,"15min":0.50800000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4199999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Sat Sep 30 23:03:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79500000000000004,"15min":0.76200000000000001},"min":{"1min":0.623,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.61299999999999999,"5min":0.48899999999999999,"15min":0.439},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":2.7730000000000001},"last":0.52100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194189,"statfs":{"total":200000000,"available":198850076,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.41399999999999998},"min":{"1min":0.316,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":1.1519999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47999999999999998,"15min":0.49299999999999999},"min":{"1min":0.376,"5min":0.308,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":0.69899999999999995,"15min":1.919},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":1.254},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.373,"5min":0.29899999999999999,"15min":0.27300000000000002},"max":{"1min":0.71199999999999997,"5min":0.748,"15min":1.9390000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.6020000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.36599999999999999,"15min":0.35499999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":1.5309999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.47199999999999998,"15min":0.35999999999999999},"max":{"1min":1.014,"5min":1.0569999999999999,"15min":1.401},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.77500000000000002},"min":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.443},"max":{"1min":1.1439999999999999,"5min":1.1539999999999999,"15min":3.306},"last":0.751}]},{"osd":5,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76400000000000001,"15min":0.754},"min":{"1min":0.51300000000000001,"5min":0.49399999999999999,"15min":0.46200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0880000000000001,"15min":1.508},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.65100000000000002,"5min":0.55200000000000005,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.044,"15min":1.4910000000000001},"last":0.84799999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.49099999999999999},"max":{"1min":0.92300000000000004,"5min":0.96299999999999997,"15min":1.5620000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48099999999999998},"max":{"1min":0.93999999999999995,"5min":0.99299999999999999,"15min":1.3140000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.60899999999999999,"5min":0.54100000000000004,"15min":0.48799999999999999},"max":{"1min":1.0649999999999999,"5min":1.1040000000000001,"15min":1.3640000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.77700000000000002},"min":{"1min":0.64100000000000001,"5min":0.57399999999999995,"15min":0.47999999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.573},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194189,"statfs":{"total":200000000,"available":198850088,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68300000000000005,"15min":0.628},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85499999999999998,"5min":0.98199999999999998,"15min":1.022},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70599999999999996,"15min":0.65700000000000003},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.54600000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.98699999999999999,"15min":1.492},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77500000000000002,"15min":0.72199999999999998},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.0149999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.72399999999999998},"min":{"1min":0.63800000000000001,"5min":0.56399999999999995,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.5149999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.871,"5min":0.98299999999999998,"15min":1.0429999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.37},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0209999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.90200000000000002,"5min":1.0409999999999999,"15min":1.45},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.57599999999999996,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.91700000000000004,"5min":1.028,"15min":1.0649999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47999999999999998,"15min":0.45700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.016},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.93300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.88400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1700,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193612,"statfs":{"total":200000000,"available":198259084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.67400000000000004,"15min":0.63500000000000001},"min":{"1min":0.45600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68100000000000005,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92200000000000004,"5min":0.94499999999999995,"15min":1.008},"last":0.65700000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73099999999999998,"15min":0.69299999999999995},"min":{"1min":0.51700000000000002,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97899999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.71799999999999997,"15min":0.68600000000000005},"min":{"1min":0.57999999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.0449999999999999},"last":0.752}]},{"osd":2,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.54500000000000004,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69999999999999996,"15min":0.67700000000000005},"min":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.38200000000000001},"max":{"1min":0.93400000000000005,"5min":0.95899999999999996,"15min":1.044},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.59599999999999997,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72899999999999998,"15min":0.68700000000000006},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.442},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.97599999999999998},"last":0.63600000000000001}]},{"osd":4,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.41499999999999998,"5min":0.40699999999999997,"15min":0.34899999999999998},"max":{"1min":0.89100000000000001,"5min":0.91600000000000004,"15min":0.95299999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.081},"last":0.45700000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.504},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68600000000000005,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.03},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Sep 30 23:03:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.72399999999999998},"min":{"1min":0.51300000000000001,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.93899999999999995,"5min":1.083,"15min":1.083},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.76400000000000001},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.45900000000000002},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0700000000000001},"last":0.59599999999999997}]}]}],"pool_statfs":[]}} 2023-09-30T23:04:14.459 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T23:04:14.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T23:04:14.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.689+0000 7f24ae3ff700 1 Processor -- start 2023-09-30T23:04:14.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.689+0000 7f24ae3ff700 1 -- start start 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24ae3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80c52a0 0x7f24a80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24ae3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24a80cb350 0x7f24a81605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24ae3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a80c7690 con 0x7f24a8069f10 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24ae3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a81406a0 con 0x7f24a80cb350 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24ae3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c3a50 con 0x7f24a80c52a0 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24a77fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f24a8069f10 0x7f24a80c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37284/0 (socket says 172.21.15.142:37284) 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24a77fe700 1 -- 172.21.15.142:0/317552489 learned_addr learned my addr 172.21.15.142:0/317552489 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.690+0000 7f24ac99c700 1 --2- 172.21.15.142:0/317552489 >> v2:172.21.15.142:3300/0 conn(0x7f24a80cb350 0x7f24a81605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24a7fff700 1 --2- 172.21.15.142:0/317552489 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80c52a0 0x7f24a80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24a6ffd700 1 -- 172.21.15.142:0/317552489 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171958902 0 0) 0x7f249c001110 con 0x7f24a8069f10 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24a6ffd700 1 -- 172.21.15.142:0/317552489 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2490003570 con 0x7f24a8069f10 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24ac99c700 1 -- 172.21.15.142:0/317552489 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80c52a0 msgr2=0x7f24a80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24ac99c700 1 --2- 172.21.15.142:0/317552489 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80c52a0 0x7f24a80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24ac99c700 1 -- 172.21.15.142:0/317552489 >> v1:172.21.15.142:6789/0 conn(0x7f24a8069f10 legacy=0x7f24a80c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24ac99c700 1 -- 172.21.15.142:0/317552489 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80c7f20 con 0x7f24a80cb350 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24ac99c700 1 --2- 172.21.15.142:0/317552489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a80cb350 0x7f24a81605e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009e90 tx=0x7f24a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cb043c05ddaa2a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.691+0000 7f24a6ffd700 1 -- 172.21.15.142:0/317552489 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000bb40 con 0x7f24a80cb350 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24a6ffd700 1 -- 172.21.15.142:0/317552489 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000bca0 con 0x7f24a80cb350 2023-09-30T23:04:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24a6ffd700 1 -- 172.21.15.142:0/317552489 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00116b0 con 0x7f24a80cb350 2023-09-30T23:04:14.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 -- 172.21.15.142:0/317552489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a80cb350 msgr2=0x7f24a81605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/317552489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a80cb350 0x7f24a81605e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009e90 tx=0x7f24a0009780 comp rx=0 tx=0).stop 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 -- 172.21.15.142:0/317552489 shutdown_connections 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/317552489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a80cb350 0x7f24a81605e0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/317552489 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80c52a0 0x7f24a80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 -- 172.21.15.142:0/317552489 >> 172.21.15.142:0/317552489 conn(0x7f24a80cc670 msgr2=0x7f24a80cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 -- 172.21.15.142:0/317552489 shutdown_connections 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.692+0000 7f24ae3ff700 1 -- 172.21.15.142:0/317552489 wait complete. 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.694+0000 7f24ae3ff700 1 Processor -- start 2023-09-30T23:04:14.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.694+0000 7f24ae3ff700 1 -- start start 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ae3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8069f10 0x7f24a813ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ae3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24a80c52a0 0x7f24a80b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ae3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80cb350 0x7f24a80bb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ae3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80bae40 con 0x7f24a8069f10 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ae3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80ba230 con 0x7f24a80c52a0 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ae3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80ba510 con 0x7f24a80cb350 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8069f10 0x7f24a813ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8069f10 0x7f24a813ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37346/0 (socket says 172.21.15.142:37346) 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 -- 172.21.15.142:0/4266305133 learned_addr learned my addr 172.21.15.142:0/4266305133 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 -- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80cb350 msgr2=0x7f24a80bb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ac99c700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80cb350 0x7f24a80bb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a77fe700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24a80c52a0 0x7f24a80b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80cb350 0x7f24a80bb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 -- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24a80c52a0 msgr2=0x7f24a80b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24a80c52a0 0x7f24a80b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a7fff700 1 -- 172.21.15.142:0/4266305133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0009a20 con 0x7f24a8069f10 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24ac99c700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80cb350 0x7f24a80bb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.695+0000 7f24a77fe700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24a80c52a0 0x7f24a80b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.696+0000 7f24a7fff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8069f10 0x7f24a813ecd0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f249800ec80 tx=0x7f24980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.696+0000 7f248ffff700 1 -- 172.21.15.142:0/4266305133 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800c9d0 con 0x7f24a8069f10 2023-09-30T23:04:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.696+0000 7f248ffff700 1 -- 172.21.15.142:0/4266305133 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800cb30 con 0x7f24a8069f10 2023-09-30T23:04:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.696+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a80ba7f0 con 0x7f24a8069f10 2023-09-30T23:04:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.696+0000 7f248ffff700 1 -- 172.21.15.142:0/4266305133 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498013470 con 0x7f24a8069f10 2023-09-30T23:04:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.696+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80b8a00 con 0x7f24a8069f10 2023-09-30T23:04:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.697+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a8069a50 con 0x7f24a8069f10 2023-09-30T23:04:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.698+0000 7f248ffff700 1 -- 172.21.15.142:0/4266305133 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2498013820 con 0x7f24a8069f10 2023-09-30T23:04:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.699+0000 7f248ffff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2494067330 0x7f24940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.699+0000 7f248ffff700 1 -- 172.21.15.142:0/4266305133 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2498085050 con 0x7f24a8069f10 2023-09-30T23:04:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.699+0000 7f24a77fe700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2494067330 0x7f24940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.700+0000 7f24a77fe700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2494067330 0x7f24940697e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f249c0058d0 tx=0x7f249c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:14.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.703+0000 7f248ffff700 1 -- 172.21.15.142:0/4266305133 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2498051eb0 con 0x7f24a8069f10 2023-09-30T23:04:14.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.969+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f24a806fc10 con 0x7f24a8069f10 2023-09-30T23:04:14.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.974+0000 7f248ffff700 1 -- 172.21.15.142:0/4266305133 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f24980170e0 con 0x7f24a8069f10 2023-09-30T23:04:14.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2494067330 msgr2=0x7f24940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2494067330 0x7f24940697e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f249c0058d0 tx=0x7f249c009040 comp rx=0 tx=0).stop 2023-09-30T23:04:14.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8069f10 msgr2=0x7f24a813ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:14.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8069f10 0x7f24a813ecd0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f249800ec80 tx=0x7f24980091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 shutdown_connections 2023-09-30T23:04:14.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2494067330 0x7f24940697e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f24a80cb350 0x7f24a80bb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24a8069f10 0x7f24a813ecd0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 --2- 172.21.15.142:0/4266305133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24a80c52a0 0x7f24a80b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:14.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 >> 172.21.15.142:0/4266305133 conn(0x7f24a80cc670 msgr2=0x7f24a80c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:14.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 shutdown_connections 2023-09-30T23:04:14.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:14.977+0000 7f24ae3ff700 1 -- 172.21.15.142:0/4266305133 wait complete. 2023-09-30T23:04:14.980 INFO:teuthology.orchestra.run.smithi142.stderr:updated caps for client.0 2023-09-30T23:04:14.995 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:15.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.184+0000 7fdc73dff700 1 Processor -- start 2023-09-30T23:04:15.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.184+0000 7fdc73dff700 1 -- start start 2023-09-30T23:04:15.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.186+0000 7fdc73dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c15ac70 0x7fdc6c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:15.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.186+0000 7fdc73dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c15dde0 con 0x7fdc6c06d3f0 2023-09-30T23:04:15.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.186+0000 7fdc73dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c06b840 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.186+0000 7fdc73dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c15d7d0 con 0x7fdc6c15ac70 2023-09-30T23:04:15.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.186+0000 7fdc71b9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdc6c06d3f0 0x7fdc6c06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37294/0 (socket says 172.21.15.142:37294) 2023-09-30T23:04:15.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.186+0000 7fdc71b9b700 1 -- 172.21.15.142:0/3186735590 learned_addr learned my addr 172.21.15.142:0/3186735590 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:15.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.186+0000 7fdc7239c700 1 --2- 172.21.15.142:0/3186735590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c15ac70 0x7fdc6c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc70b99700 1 -- 172.21.15.142:0/3186735590 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821766268 0 0) 0x7fdc6c15dde0 con 0x7fdc6c06d3f0 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc70b99700 1 -- 172.21.15.142:0/3186735590 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc58003570 con 0x7fdc6c06d3f0 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc70b99700 1 -- 172.21.15.142:0/3186735590 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935816835 0 0) 0x7fdc6c06b840 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc70b99700 1 -- 172.21.15.142:0/3186735590 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc6c15dde0 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc7239c700 1 -- 172.21.15.142:0/3186735590 >> v1:172.21.15.148:6789/0 conn(0x7fdc6c0c6da0 legacy=0x7fdc6c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc7239c700 1 -- 172.21.15.142:0/3186735590 >> v1:172.21.15.142:6789/0 conn(0x7fdc6c06d3f0 legacy=0x7fdc6c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc7239c700 1 -- 172.21.15.142:0/3186735590 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0c7230 con 0x7fdc6c15ac70 2023-09-30T23:04:15.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc7239c700 1 --2- 172.21.15.142:0/3186735590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c15ac70 0x7fdc6c06d7c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009e90 tx=0x7fdc64009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e75c8825ba6e4acb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc70b99700 1 -- 172.21.15.142:0/3186735590 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400e070 con 0x7fdc6c15ac70 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc70b99700 1 -- 172.21.15.142:0/3186735590 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400bb80 con 0x7fdc6c15ac70 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.187+0000 7fdc70b99700 1 -- 172.21.15.142:0/3186735590 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64012430 con 0x7fdc6c15ac70 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.188+0000 7fdc73dff700 1 -- 172.21.15.142:0/3186735590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c15ac70 msgr2=0x7fdc6c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.188+0000 7fdc73dff700 1 --2- 172.21.15.142:0/3186735590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c15ac70 0x7fdc6c06d7c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009e90 tx=0x7fdc64009780 comp rx=0 tx=0).stop 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.188+0000 7fdc73dff700 1 -- 172.21.15.142:0/3186735590 shutdown_connections 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.188+0000 7fdc73dff700 1 --2- 172.21.15.142:0/3186735590 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c15ac70 0x7fdc6c06d7c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.188+0000 7fdc73dff700 1 -- 172.21.15.142:0/3186735590 >> 172.21.15.142:0/3186735590 conn(0x7fdc6c067e30 msgr2=0x7fdc6c068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.188+0000 7fdc73dff700 1 -- 172.21.15.142:0/3186735590 shutdown_connections 2023-09-30T23:04:15.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.188+0000 7fdc73dff700 1 -- 172.21.15.142:0/3186735590 wait complete. 2023-09-30T23:04:15.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.189+0000 7fdc73dff700 1 Processor -- start 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.190+0000 7fdc73dff700 1 -- start start 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc73dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c06d3f0 0x7fdc6c14e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc73dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c0c6da0 0x7fdc6c16cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc73dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c16d050 0x7fdc6c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc73dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c16a5a0 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc73dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c157e70 con 0x7fdc6c16d050 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc73dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c158150 con 0x7fdc6c06d3f0 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c0c6da0 0x7fdc6c16cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c0c6da0 0x7fdc6c16cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37352/0 (socket says 172.21.15.142:37352) 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 -- 172.21.15.142:0/1977125421 learned_addr learned my addr 172.21.15.142:0/1977125421 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc71b9b700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c06d3f0 0x7fdc6c14e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:15.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7239c700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c16d050 0x7fdc6c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 -- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c06d3f0 msgr2=0x7fdc6c14e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c06d3f0 0x7fdc6c14e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 -- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c16d050 msgr2=0x7fdc6c1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c16d050 0x7fdc6c1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.191+0000 7fdc7139a700 1 -- 172.21.15.142:0/1977125421 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc64009a20 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.192+0000 7fdc7139a700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c0c6da0 0x7fdc6c16cb10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00c790 tx=0x7fdc5c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.192+0000 7fdc61ffb700 1 -- 172.21.15.142:0/1977125421 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c010510 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.192+0000 7fdc61ffb700 1 -- 172.21.15.142:0/1977125421 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c010670 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.192+0000 7fdc61ffb700 1 -- 172.21.15.142:0/1977125421 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c010a10 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.192+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6c158430 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.192+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c1589f0 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.193+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c15cfb0 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.194+0000 7fdc61ffb700 1 -- 172.21.15.142:0/1977125421 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdc5c01b3b0 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.195+0000 7fdc61ffb700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:15.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.195+0000 7fdc61ffb700 1 -- 172.21.15.142:0/1977125421 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc5c0844c0 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.195+0000 7fdc71b9b700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:15.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.196+0000 7fdc71b9b700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc68007fd0 tx=0x7fdc68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:15.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.199+0000 7fdc61ffb700 1 -- 172.21.15.142:0/1977125421 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdc5c051320 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.433+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc6c158c10 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.433+0000 7fdc61ffb700 1 -- 172.21.15.142:0/1977125421 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fdc5c054940 con 0x7fdc6c0c6da0 2023-09-30T23:04:15.434 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:15.434 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 msgr2=0x7fdc500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc68007fd0 tx=0x7fdc68009040 comp rx=0 tx=0).stop 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c0c6da0 msgr2=0x7fdc6c16cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c0c6da0 0x7fdc6c16cb10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00c790 tx=0x7fdc5c007e10 comp rx=0 tx=0).stop 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 shutdown_connections 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c16d050 0x7fdc6c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c06d3f0 0x7fdc6c14e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:15.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 --2- 172.21.15.142:0/1977125421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c0c6da0 0x7fdc6c16cb10 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:15.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 >> 172.21.15.142:0/1977125421 conn(0x7fdc6c067e30 msgr2=0x7fdc6c15c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:15.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 shutdown_connections 2023-09-30T23:04:15.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:15.436+0000 7fdc73dff700 1 -- 172.21.15.142:0/1977125421 wait complete. 2023-09-30T23:04:15.438 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:15.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:15.641 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:15.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T23:04:09.113309+0000', 'modified': '2023-09-30T23:04:12.656438+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8355}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8355': {'gid': 8355, 'name': 'd', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6835/3975475300', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6833', 'nonce': 3975475300}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 3975475300}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T23:04:15.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T23:04:15.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-30T23:04:16.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.049+0000 7f43931ff700 1 Processor -- start 2023-09-30T23:04:16.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.049+0000 7f43931ff700 1 -- start start 2023-09-30T23:04:16.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.050+0000 7f43931ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f438c0b1580 0x7f438c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.050+0000 7f43931ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0b1950 0x7f438c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.050+0000 7f43931ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f438c0ae000 0x7f438c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.050+0000 7f43931ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c157c20 con 0x7f438c0ae000 2023-09-30T23:04:16.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.050+0000 7f43931ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c0ad630 con 0x7f438c0b1580 2023-09-30T23:04:16.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.050+0000 7f43931ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0b3360 con 0x7f438c0b1950 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f438c0ae000 0x7f438c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f438c0ae000 0x7f438c15a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37358/0 (socket says 172.21.15.142:37358) 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 -- 172.21.15.142:0/10562457 learned_addr learned my addr 172.21.15.142:0/10562457 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f438bfff700 1 --2- 172.21.15.142:0/10562457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0b1950 0x7f438c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f4390f9b700 1 --2- 172.21.15.142:0/10562457 >> v2:172.21.15.148:3300/0 conn(0x7f438c0b1580 0x7f438c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 -- 172.21.15.142:0/10562457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0b1950 msgr2=0x7f438c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 --2- 172.21.15.142:0/10562457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0b1950 0x7f438c15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 -- 172.21.15.142:0/10562457 >> v2:172.21.15.148:3300/0 conn(0x7f438c0b1580 msgr2=0x7f438c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 --2- 172.21.15.142:0/10562457 >> v2:172.21.15.148:3300/0 conn(0x7f438c0b1580 0x7f438c0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 -- 172.21.15.142:0/10562457 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c15ad60 con 0x7f438c0ae000 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.051+0000 7f439179c700 1 --2- 172.21.15.142:0/10562457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0ae000 0x7f438c15a6c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f438c06c8a0 tx=0x7f4384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c2457a3bb6d585 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f438b7fe700 1 -- 172.21.15.142:0/10562457 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438400e070 con 0x7f438c0ae000 2023-09-30T23:04:16.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f438b7fe700 1 -- 172.21.15.142:0/10562457 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438400ba50 con 0x7f438c0ae000 2023-09-30T23:04:16.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f438b7fe700 1 -- 172.21.15.142:0/10562457 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43840092e0 con 0x7f438c0ae000 2023-09-30T23:04:16.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 -- 172.21.15.142:0/10562457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0ae000 msgr2=0x7f438c15a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 --2- 172.21.15.142:0/10562457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0ae000 0x7f438c15a6c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f438c06c8a0 tx=0x7f4384009840 comp rx=0 tx=0).stop 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 -- 172.21.15.142:0/10562457 shutdown_connections 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 --2- 172.21.15.142:0/10562457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0ae000 0x7f438c15a6c0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 --2- 172.21.15.142:0/10562457 >> v2:172.21.15.148:3300/0 conn(0x7f438c0b1580 0x7f438c0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 --2- 172.21.15.142:0/10562457 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0b1950 0x7f438c15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 -- 172.21.15.142:0/10562457 >> 172.21.15.142:0/10562457 conn(0x7f438c0ce1f0 msgr2=0x7f438c069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.052+0000 7f43931ff700 1 -- 172.21.15.142:0/10562457 shutdown_connections 2023-09-30T23:04:16.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.053+0000 7f43931ff700 1 -- 172.21.15.142:0/10562457 wait complete. 2023-09-30T23:04:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.054+0000 7f43931ff700 1 Processor -- start 2023-09-30T23:04:16.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.055+0000 7f43931ff700 1 -- start start 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f43931ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0ae000 0x7f438c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f43931ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0b1580 0x7f438c15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f43931ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f438c0b1950 0x7f438c14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f43931ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15f090 con 0x7f438c0b1580 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f43931ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15e7f0 con 0x7f438c0b1950 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f43931ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15ead0 con 0x7f438c0ae000 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f438bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0b1580 0x7f438c15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f438bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0b1580 0x7f438c15e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37370/0 (socket says 172.21.15.142:37370) 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f438bfff700 1 -- 172.21.15.142:0/2665606380 learned_addr learned my addr 172.21.15.142:0/2665606380 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f4390f9b700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0ae000 0x7f438c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.056+0000 7f439179c700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f438c0b1950 0x7f438c14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f438bfff700 1 -- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0ae000 msgr2=0x7f438c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f438bfff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0ae000 0x7f438c0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f438bfff700 1 -- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f438c0b1950 msgr2=0x7f438c14ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f438bfff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f438c0b1950 0x7f438c14ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f438bfff700 1 -- 172.21.15.142:0/2665606380 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4384009ae0 con 0x7f438c0b1580 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f438bfff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0b1580 0x7f438c15e0f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f437800d860 tx=0x7f4378008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f4388ff9700 1 -- 172.21.15.142:0/2665606380 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780125f0 con 0x7f438c0b1580 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f4388ff9700 1 -- 172.21.15.142:0/2665606380 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378012770 con 0x7f438c0b1580 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c15edb0 con 0x7f438c0b1580 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f4388ff9700 1 -- 172.21.15.142:0/2665606380 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378012b30 con 0x7f438c0b1580 2023-09-30T23:04:16.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.057+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c14d410 con 0x7f438c0b1580 2023-09-30T23:04:16.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.059+0000 7f4388ff9700 1 -- 172.21.15.142:0/2665606380 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4378013480 con 0x7f438c0b1580 2023-09-30T23:04:16.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.060+0000 7f4388ff9700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4370067330 0x7f43700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.060+0000 7f4388ff9700 1 -- 172.21.15.142:0/2665606380 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4378084fc0 con 0x7f438c0b1580 2023-09-30T23:04:16.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.060+0000 7f4390f9b700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4370067330 0x7f43700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.061+0000 7f4390f9b700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4370067330 0x7f43700697e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4380006fd0 tx=0x7f4380008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.062+0000 7f43a1888b80 1 Processor -- start 2023-09-30T23:04:16.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.062+0000 7f43a1888b80 1 -- start start 2023-09-30T23:04:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5ec820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5d1f40 0x55c34e5f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5f54d0 0x55c34e5f5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f43a1888b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e4bf310 con 0x55c34e5f54d0 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e4fc130 con 0x55c34e5ec450 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c34e4f9af0 con 0x55c34e5d1f40 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5f54d0 0x55c34e5f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5f54d0 0x55c34e5f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37380/0 (socket says 172.21.15.142:37380) 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 -- 172.21.15.142:0/385672882 learned_addr learned my addr 172.21.15.142:0/385672882 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f438bfff700 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5d1f40 0x55c34e5f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f4390f9b700 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5ec820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 -- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5d1f40 msgr2=0x55c34e5f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5d1f40 0x55c34e5f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 -- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 msgr2=0x55c34e5ec820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5ec820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f439179c700 1 -- 172.21.15.142:0/385672882 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c34e2fb790 con 0x55c34e5f54d0 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.064+0000 7f4390f9b700 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5ec820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.063+0000 7f438bfff700 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5d1f40 0x55c34e5f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.064+0000 7f439179c700 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5f54d0 0x55c34e5f5940 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f438c0706b0 tx=0x7f4384018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58c45864222b3cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.064+0000 7f4375ffb700 1 -- 172.21.15.142:0/385672882 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384007240 con 0x55c34e5f54d0 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.064+0000 7f4375ffb700 1 -- 172.21.15.142:0/385672882 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438400bbc0 con 0x55c34e5f54d0 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.064+0000 7f4375ffb700 1 -- 172.21.15.142:0/385672882 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384007610 con 0x55c34e5f54d0 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 -- 172.21.15.142:0/385672882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5f54d0 msgr2=0x55c34e5f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5f54d0 0x55c34e5f5940 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f438c0706b0 tx=0x7f4384018000 comp rx=0 tx=0).stop 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 -- 172.21.15.142:0/385672882 shutdown_connections 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5f54d0 0x55c34e5f5940 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5ec820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 --2- 172.21.15.142:0/385672882 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5d1f40 0x55c34e5f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 -- 172.21.15.142:0/385672882 >> 172.21.15.142:0/385672882 conn(0x55c34e5ef880 msgr2=0x55c34e5efc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 -- 172.21.15.142:0/385672882 shutdown_connections 2023-09-30T23:04:16.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.065+0000 7f43a1888b80 1 -- 172.21.15.142:0/385672882 wait complete. 2023-09-30T23:04:16.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.066+0000 7f43a1888b80 1 -- start start 2023-09-30T23:04:16.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.066+0000 7f43a1888b80 1 Processor -- start 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e5a7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f43a1888b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e4f58e0 con 0x55c34e5ec450 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e4a1980 con 0x55c34e5d1f40 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c34e4a1620 con 0x55c34e5f54d0 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f43a1888b80 10 client.0 _ll_register_callbacks cb 0x55c34e304a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37396/0 (socket says 172.21.15.142:37396) 2023-09-30T23:04:16.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 -- 172.21.15.142:0/3719151992 learned_addr learned my addr 172.21.15.142:0/3719151992 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f4390f9b700 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e5a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f439179c700 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 -- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 msgr2=0x55c34e5c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 -- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 msgr2=0x55c34e5a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e5a7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.067+0000 7f438bfff700 1 -- 172.21.15.142:0/3719151992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c15ad60 con 0x55c34e5ec450 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f438bfff700 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5cbd10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f4378006fd0 tx=0x7f4378083240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9f8d3ed569d717 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f436affd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f436affd700 1 -- 172.21.15.142:0/3719151992 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378058db0 con 0x55c34e5ec450 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f436affd700 1 -- 172.21.15.142:0/3719151992 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f437805ca80 con 0x55c34e5ec450 2023-09-30T23:04:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c34e599d60 con 0x55c34e5ec450 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f436affd700 1 -- 172.21.15.142:0/3719151992 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4378055f50 con 0x55c34e5ec450 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 10 client.8496 fetch_fsmap learned FSMap version 91 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55c34e3e80a0 con 0x55c34e5ec450 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f436affd700 1 -- 172.21.15.142:0/3719151992 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c34e599d60 con 0x55c34e5ec450 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f436affd700 1 -- 172.21.15.142:0/3719151992 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 91) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4378054fd0 con 0x55c34e5ec450 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 10 client.8496 fetch_fsmap finished waiting for FSMap version 91 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 10 client.8496 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 20 client.8496 populate_metadata read hostname 'smithi142' 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e5eda10 0x55c34e5edde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 4 client.8496 mds_command: new command op to 8355 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.068+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 --> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c34e576b30 con 0x55c34e5eda10 2023-09-30T23:04:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.069+0000 7f4390f9b700 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e5eda10 0x55c34e5edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.069+0000 7f436affd700 10 client.8496 ms_handle_connect on v2:172.21.15.148:6833/3975475300 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.069+0000 7f4390f9b700 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e5eda10 0x55c34e5edde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d0f72a2ee213da3 server_cookie=dc78131c2c808e60 in_seq=0 out_seq=0 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.070+0000 7f436affd700 1 -- 172.21.15.142:0/3719151992 <== mds.0 v2:172.21.15.148:6833/3975475300 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (crc 0 0 0) 0x55c34e576b30 con 0x55c34e5eda10 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.070+0000 7f436affd700 10 client.8496 handle_command_reply: tid=0 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.070+0000 7f43a1888b80 1 client.8496 shutdown 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 msgr2=0x55c34e5cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5cbd10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f4378006fd0 tx=0x7f4378083240 comp rx=0 tx=0).stop 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 shutdown_connections 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e5eda10 0x55c34e5edde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e5a7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f436affd700 0 client.8496 ms_handle_reset on v2:172.21.15.148:6833/3975475300 2023-09-30T23:04:16.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3719151992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5cbd10 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 >> 172.21.15.142:0/3719151992 conn(0x55c34e5ef880 msgr2=0x55c34e5a1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 shutdown_connections 2023-09-30T23:04:16.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 1 -- 172.21.15.142:0/3719151992 wait complete. 2023-09-30T23:04:16.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.071+0000 7f43a1888b80 20 client.8496 trim_cache size 0 max 16384 2023-09-30T23:04:16.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.088+0000 7f43a1888b80 1 Processor -- start 2023-09-30T23:04:16.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.088+0000 7f43a1888b80 1 -- start start 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5d1f40 0x55c34e5a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5a8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f43a1888b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e38d1e0 con 0x55c34e5d1f40 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e5cf970 con 0x55c34e5ec450 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c34e5a8b40 con 0x55c34e5f54d0 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f4390f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5d1f40 0x55c34e5a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f4390f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5d1f40 0x55c34e5a27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37402/0 (socket says 172.21.15.142:37402) 2023-09-30T23:04:16.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.089+0000 7f4390f9b700 1 -- 172.21.15.142:0/2400402437 learned_addr learned my addr 172.21.15.142:0/2400402437 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f439179c700 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5a8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f438bfff700 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f4390f9b700 1 -- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 msgr2=0x55c34e5a8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f4390f9b700 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5a8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f4390f9b700 1 -- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 msgr2=0x55c34e5cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f4390f9b700 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f4390f9b700 1 -- 172.21.15.142:0/2400402437 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c34e4c43c0 con 0x55c34e5d1f40 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f438bfff700 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f4390f9b700 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5d1f40 0x55c34e5a27b0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x55c34e5ee7b0 tx=0x7f438001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56702f1c648b580 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f43767fc700 1 -- 172.21.15.142:0/2400402437 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380027ac0 con 0x55c34e5d1f40 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f43767fc700 1 -- 172.21.15.142:0/2400402437 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438001d040 con 0x55c34e5d1f40 2023-09-30T23:04:16.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.090+0000 7f43767fc700 1 -- 172.21.15.142:0/2400402437 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380027e30 con 0x55c34e5d1f40 2023-09-30T23:04:16.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 -- 172.21.15.142:0/2400402437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5d1f40 msgr2=0x55c34e5a27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5d1f40 0x55c34e5a27b0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x55c34e5ee7b0 tx=0x7f438001a040 comp rx=0 tx=0).stop 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 -- 172.21.15.142:0/2400402437 shutdown_connections 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5d1f40 0x55c34e5a27b0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 --2- 172.21.15.142:0/2400402437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5ec450 0x55c34e5cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 -- 172.21.15.142:0/2400402437 >> 172.21.15.142:0/2400402437 conn(0x55c34e5ef880 msgr2=0x55c34e5cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 -- 172.21.15.142:0/2400402437 shutdown_connections 2023-09-30T23:04:16.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.091+0000 7f43a1888b80 1 -- 172.21.15.142:0/2400402437 wait complete. 2023-09-30T23:04:16.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.092+0000 7f43a1888b80 1 -- start start 2023-09-30T23:04:16.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.092+0000 7f43a1888b80 1 Processor -- start 2023-09-30T23:04:16.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e654660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f43a1888b80 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f43a1888b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e651b70 con 0x55c34e5ec450 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c34e5a1c90 con 0x55c34e5d1f40 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f43a1888b80 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c34e5a1ee0 con 0x55c34e5f54d0 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f43a1888b80 10 client.0 _ll_register_callbacks cb 0x55c34e304a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37418/0 (socket says 172.21.15.142:37418) 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 -- 172.21.15.142:0/3211496095 learned_addr learned my addr 172.21.15.142:0/3211496095 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f4390f9b700 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e654660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f439179c700 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 -- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 msgr2=0x55c34e5c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 -- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 msgr2=0x55c34e654660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e654660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.093+0000 7f438bfff700 1 -- 172.21.15.142:0/3211496095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438000e040 con 0x55c34e5ec450 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f438bfff700 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5c31f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4378006fd0 tx=0x7f4378080000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dc775ae4d18a7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f436affd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f436affd700 1 -- 172.21.15.142:0/3211496095 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378056af0 con 0x55c34e5ec450 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f438400bbc0 con 0x55c34e5ec450 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f436affd700 1 -- 172.21.15.142:0/3211496095 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f437805ca80 con 0x55c34e5ec450 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f436affd700 1 -- 172.21.15.142:0/3211496095 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4378058d30 con 0x55c34e5ec450 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 10 client.8502 fetch_fsmap learned FSMap version 91 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55c34e35c1d0 con 0x55c34e5ec450 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f436affd700 1 -- 172.21.15.142:0/3211496095 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438400bbc0 con 0x55c34e5ec450 2023-09-30T23:04:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f436affd700 1 -- 172.21.15.142:0/3211496095 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 91) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4378071b70 con 0x55c34e5ec450 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 10 client.8502 fetch_fsmap finished waiting for FSMap version 91 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 10 client.8502 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 20 client.8502 populate_metadata read hostname 'smithi142' 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e6396a0 0x55c34e639a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 4 client.8502 mds_command: new command op to 8355 tid=0[{"prefix": "status"}] 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.094+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 --> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c34e4988d0 con 0x55c34e6396a0 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.095+0000 7f4390f9b700 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e6396a0 0x55c34e639a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.095+0000 7f436affd700 10 client.8502 ms_handle_connect on v2:172.21.15.148:6833/3975475300 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.095+0000 7f4390f9b700 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e6396a0 0x55c34e639a70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed744ec6a7f21e95 server_cookie=4f8595b5d83ac0c7 in_seq=0 out_seq=0 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.095+0000 7f436affd700 1 -- 172.21.15.142:0/3211496095 <== mds.0 v2:172.21.15.148:6833/3975475300 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55c34e4988d0 con 0x55c34e6396a0 2023-09-30T23:04:16.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.095+0000 7f436affd700 10 client.8502 handle_command_reply: tid=0 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 client.8502 shutdown 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 msgr2=0x55c34e5c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5c31f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4378006fd0 tx=0x7f4378080000 comp rx=0 tx=0).stop 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 shutdown_connections 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:6833/3975475300,v1:172.21.15.148:6835/3975475300] conn(0x55c34e6396a0 0x55c34e639a70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x55c34e5f54d0 0x55c34e5c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c34e5d1f40 0x55c34e654660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f436affd700 0 client.8502 ms_handle_reset on v2:172.21.15.148:6833/3975475300 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 --2- 172.21.15.142:0/3211496095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c34e5ec450 0x55c34e5c31f0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 >> 172.21.15.142:0/3211496095 conn(0x55c34e5ef880 msgr2=0x55c34e5eccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 shutdown_connections 2023-09-30T23:04:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 1 -- 172.21.15.142:0/3211496095 wait complete. 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.096+0000 7f43a1888b80 20 client.8502 trim_cache size 0 max 16384 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 8355, 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-30T23:04:16.103 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-30T23:04:16.104 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 6.4603076819999998, 2023-09-30T23:04:16.104 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 91, 2023-09-30T23:04:16.104 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 192, 2023-09-30T23:04:16.104 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 192, 2023-09-30T23:04:16.104 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 13.163929311 2023-09-30T23:04:16.104 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4370067330 msgr2=0x7f43700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4370067330 0x7f43700697e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4380006fd0 tx=0x7f4380008040 comp rx=0 tx=0).stop 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0b1580 msgr2=0x7f438c15e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0b1580 0x7f438c15e0f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f437800d860 tx=0x7f4378008040 comp rx=0 tx=0).stop 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 shutdown_connections 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4370067330 0x7f43700697e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f438c0b1950 0x7f438c14ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f438c0ae000 0x7f438c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 --2- 172.21.15.142:0/2665606380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f438c0b1580 0x7f438c15e0f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 >> 172.21.15.142:0/2665606380 conn(0x7f438c0ce1f0 msgr2=0x7f438c0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 shutdown_connections 2023-09-30T23:04:16.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.097+0000 7f43931ff700 1 -- 172.21.15.142:0/2665606380 wait complete. 2023-09-30T23:04:16.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T23:04:16.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.304+0000 7feed73ff700 1 Processor -- start 2023-09-30T23:04:16.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.304+0000 7feed73ff700 1 -- start start 2023-09-30T23:04:16.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed73ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feed006d3f0 0x7feed006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed73ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feed00c6da0 0x7feed015e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed73ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed015dde0 con 0x7feed006b130 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed73ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed015d7d0 con 0x7feed006d3f0 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed73ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed00c7230 con 0x7feed00c6da0 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed519b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feed006d3f0 0x7feed006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed519b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feed006d3f0 0x7feed006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37422/0 (socket says 172.21.15.142:37422) 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed599c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7feed006b130 0x7feed0069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37298/0 (socket says 172.21.15.142:37298) 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed519b700 1 -- 172.21.15.142:0/3955708477 learned_addr learned my addr 172.21.15.142:0/3955708477 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed499a700 1 --2- 172.21.15.142:0/3955708477 >> v2:172.21.15.148:3300/0 conn(0x7feed00c6da0 0x7feed015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed519b700 1 -- 172.21.15.142:0/3955708477 >> v2:172.21.15.148:3300/0 conn(0x7feed00c6da0 msgr2=0x7feed015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:16.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed519b700 1 --2- 172.21.15.142:0/3955708477 >> v2:172.21.15.148:3300/0 conn(0x7feed00c6da0 0x7feed015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed519b700 1 -- 172.21.15.142:0/3955708477 >> v1:172.21.15.142:6789/0 conn(0x7feed006b130 legacy=0x7feed0069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feed519b700 1 -- 172.21.15.142:0/3955708477 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed015da70 con 0x7feed006d3f0 2023-09-30T23:04:16.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.306+0000 7feec7fff700 1 -- 172.21.15.142:0/3955708477 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020658610 0 0) 0x7feed015dde0 con 0x7feed006b130 2023-09-30T23:04:16.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.307+0000 7feed519b700 1 --2- 172.21.15.142:0/3955708477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006d3f0 0x7feed006d7c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7feecc0099b0 tx=0x7feecc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba0125565a97864 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.307+0000 7feec7fff700 1 -- 172.21.15.142:0/3955708477 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc009ea0 con 0x7feed006d3f0 2023-09-30T23:04:16.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.307+0000 7feec7fff700 1 -- 172.21.15.142:0/3955708477 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc00b820 con 0x7feed006d3f0 2023-09-30T23:04:16.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.307+0000 7feec7fff700 1 -- 172.21.15.142:0/3955708477 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00bbc0 con 0x7feed006d3f0 2023-09-30T23:04:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.307+0000 7feed73ff700 1 -- 172.21.15.142:0/3955708477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006d3f0 msgr2=0x7feed006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.307+0000 7feed73ff700 1 --2- 172.21.15.142:0/3955708477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006d3f0 0x7feed006d7c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7feecc0099b0 tx=0x7feecc009250 comp rx=0 tx=0).stop 2023-09-30T23:04:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.308+0000 7feed73ff700 1 -- 172.21.15.142:0/3955708477 shutdown_connections 2023-09-30T23:04:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.308+0000 7feed73ff700 1 --2- 172.21.15.142:0/3955708477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006d3f0 0x7feed006d7c0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.308+0000 7feed73ff700 1 --2- 172.21.15.142:0/3955708477 >> v2:172.21.15.148:3300/0 conn(0x7feed00c6da0 0x7feed015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.308+0000 7feed73ff700 1 -- 172.21.15.142:0/3955708477 >> 172.21.15.142:0/3955708477 conn(0x7feed0067e30 msgr2=0x7feed0068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.308+0000 7feed73ff700 1 -- 172.21.15.142:0/3955708477 shutdown_connections 2023-09-30T23:04:16.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.308+0000 7feed73ff700 1 -- 172.21.15.142:0/3955708477 wait complete. 2023-09-30T23:04:16.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.309+0000 7feed73ff700 1 Processor -- start 2023-09-30T23:04:16.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.309+0000 7feed73ff700 1 -- start start 2023-09-30T23:04:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.310+0000 7feed73ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006b130 0x7feed016a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed73ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed006d3f0 0x7feed013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed73ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed00c6da0 0x7feed014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed73ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01590b0 con 0x7feed006b130 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed73ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0155ab0 con 0x7feed006d3f0 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed73ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed0155180 con 0x7feed00c6da0 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006b130 0x7feed016a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006b130 0x7feed016a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37424/0 (socket says 172.21.15.142:37424) 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 -- 172.21.15.142:0/3735713711 learned_addr learned my addr 172.21.15.142:0/3735713711 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed499a700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed006d3f0 0x7feed013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed599c700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed00c6da0 0x7feed014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 -- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed00c6da0 msgr2=0x7feed014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed00c6da0 0x7feed014cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 -- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed006d3f0 msgr2=0x7feed013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed006d3f0 0x7feed013ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 -- 172.21.15.142:0/3735713711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0094f0 con 0x7feed006b130 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.311+0000 7feed519b700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006b130 0x7feed016a1b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7feed0067a40 tx=0x7feecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.312+0000 7feec57fa700 1 -- 172.21.15.142:0/3735713711 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00bba0 con 0x7feed006b130 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.312+0000 7feec57fa700 1 -- 172.21.15.142:0/3735713711 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc011420 con 0x7feed006b130 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.312+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed0155460 con 0x7feed006b130 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.312+0000 7feec57fa700 1 -- 172.21.15.142:0/3735713711 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc0117c0 con 0x7feed006b130 2023-09-30T23:04:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.312+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed013ef90 con 0x7feed006b130 2023-09-30T23:04:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.313+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed0069420 con 0x7feed006b130 2023-09-30T23:04:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.314+0000 7feec57fa700 1 -- 172.21.15.142:0/3735713711 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7feecc011b30 con 0x7feed006b130 2023-09-30T23:04:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.315+0000 7feec57fa700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7feeb4067330 0x7feeb40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.315+0000 7feec57fa700 1 -- 172.21.15.142:0/3735713711 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feecc086590 con 0x7feed006b130 2023-09-30T23:04:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.315+0000 7feed499a700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7feeb4067330 0x7feeb40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.315+0000 7feed499a700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7feeb4067330 0x7feeb40697e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7feed0153410 tx=0x7feec0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:16.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.319+0000 7feec57fa700 1 -- 172.21.15.142:0/3735713711 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7feecc053490 con 0x7feed006b130 2023-09-30T23:04:16.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.556+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feed00c7510 con 0x7feed006b130 2023-09-30T23:04:16.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.556+0000 7feec57fa700 1 -- 172.21.15.142:0/3735713711 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7feecc056ab0 con 0x7feed006b130 2023-09-30T23:04:16.557 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T23:04:16.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7feeb4067330 msgr2=0x7feeb40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7feeb4067330 0x7feeb40697e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7feed0153410 tx=0x7feec0008040 comp rx=0 tx=0).stop 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006b130 msgr2=0x7feed016a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006b130 0x7feed016a1b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7feed0067a40 tx=0x7feecc017000 comp rx=0 tx=0).stop 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 shutdown_connections 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7feeb4067330 0x7feeb40697e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feed00c6da0 0x7feed014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed006b130 0x7feed016a1b0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 --2- 172.21.15.142:0/3735713711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feed006d3f0 0x7feed013ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 >> 172.21.15.142:0/3735713711 conn(0x7feed0067e30 msgr2=0x7feed0159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:16.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 shutdown_connections 2023-09-30T23:04:16.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:16.559+0000 7feed73ff700 1 -- 172.21.15.142:0/3735713711 wait complete. 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T23:04:16.577 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:04:16.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:16.578 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:04:16.625 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41601sec preferred_lft 41601sec 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:16.626 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::34c2:6aff:fe00:781f/64 scope link 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 7e:83:c1:9c:21:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7c83:c1ff:fe9c:21e5/64 scope link 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:04:16.627 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ce:6f:90:59:55:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T23:04:16.628 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::cc6f:90ff:fe59:5574/64 scope link 2023-09-30T23:04:16.628 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:16.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:16.628 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T23:04:16.696 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-30T23:04:16.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:16.699 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-30T23:04:16.748 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-30T23:04:16.748 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T23:04:16.748 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T23:04:16.748 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T23:04:16.748 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T23:04:16.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:16.749 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-30T23:04:16.749 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-30T23:04:16.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T23:04:16.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T23:04:16.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T23:04:16.750 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-30T23:04:16.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:16.918 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T23:04:16.964 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T23:04:16.964 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T23:04:16.965 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:04:16.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:16.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-30T23:04:17.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:04:17.075 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T23:04:17.121 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T23:04:17.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:04:17.121 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T23:04:17.207 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T23:04:17.207 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T23:04:17.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:04:17.346 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:04:17.346 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:04:17.346 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:04:17.360 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:04:17.360 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:04:17.361 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:04:17.361 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:04:17.361 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:04:17.382 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T23:04:17.382 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-30T23:04:17.382 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-09-30T23:04:17.382 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:04:17.382 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:04:17.382 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T23:04:17.382 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T23:04:17.383 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T23:04:17.387 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T23:04:17.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:17.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T23:04:17.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T23:04:17.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.650+0000 7f70e71ff700 1 Processor -- start 2023-09-30T23:04:17.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.650+0000 7f70e71ff700 1 -- start start 2023-09-30T23:04:17.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.651+0000 7f70e71ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f70e00692f0 0x7f70e015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:17.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.651+0000 7f70e71ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00cc6b0 con 0x7f70e0143350 2023-09-30T23:04:17.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.651+0000 7f70e71ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e015e050 con 0x7f70e015dc50 2023-09-30T23:04:17.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.651+0000 7f70e71ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e00cbaa0 con 0x7f70e00692f0 2023-09-30T23:04:17.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.652+0000 7f70dffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f70e00692f0 0x7f70e015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:17.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.652+0000 7f70e4f9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f70e0143350 0x7f70e00cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37312/0 (socket says 172.21.15.142:37312) 2023-09-30T23:04:17.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.652+0000 7f70e4f9b700 1 -- 172.21.15.142:0/3484937392 learned_addr learned my addr 172.21.15.142:0/3484937392 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:17.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.652+0000 7f70df7fe700 1 -- 172.21.15.142:0/3484937392 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062352055 0 0) 0x7f70e00cc6b0 con 0x7f70e0143350 2023-09-30T23:04:17.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.652+0000 7f70df7fe700 1 -- 172.21.15.142:0/3484937392 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d0003570 con 0x7f70e0143350 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70dffff700 1 -- 172.21.15.142:0/3484937392 >> v1:172.21.15.148:6789/0 conn(0x7f70e015dc50 legacy=0x7f70e006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70df7fe700 1 -- 172.21.15.142:0/3484937392 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245205971 0 0) 0x7f70e015e050 con 0x7f70e015dc50 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70dffff700 1 -- 172.21.15.142:0/3484937392 >> v1:172.21.15.142:6789/0 conn(0x7f70e0143350 legacy=0x7f70e00cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70dffff700 1 -- 172.21.15.142:0/3484937392 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00cbd80 con 0x7f70e00692f0 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70dffff700 1 --2- 172.21.15.142:0/3484937392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e015d710 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0098e0 tx=0x7f70cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1235d426cf1fde5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70df7fe700 1 -- 172.21.15.142:0/3484937392 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00b640 con 0x7f70e00692f0 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70df7fe700 1 -- 172.21.15.142:0/3484937392 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00b7a0 con 0x7f70e00692f0 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.653+0000 7f70df7fe700 1 -- 172.21.15.142:0/3484937392 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00bb40 con 0x7f70e00692f0 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.654+0000 7f70e71ff700 1 -- 172.21.15.142:0/3484937392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 msgr2=0x7f70e015d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.654+0000 7f70e71ff700 1 --2- 172.21.15.142:0/3484937392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e015d710 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0098e0 tx=0x7f70cc0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.654+0000 7f70e71ff700 1 -- 172.21.15.142:0/3484937392 shutdown_connections 2023-09-30T23:04:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.654+0000 7f70e71ff700 1 --2- 172.21.15.142:0/3484937392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e015d710 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.654+0000 7f70e71ff700 1 -- 172.21.15.142:0/3484937392 >> 172.21.15.142:0/3484937392 conn(0x7f70e00ce8e0 msgr2=0x7f70e00cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.654+0000 7f70e71ff700 1 -- 172.21.15.142:0/3484937392 shutdown_connections 2023-09-30T23:04:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.654+0000 7f70e71ff700 1 -- 172.21.15.142:0/3484937392 wait complete. 2023-09-30T23:04:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.655+0000 7f70e71ff700 1 Processor -- start 2023-09-30T23:04:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.655+0000 7f70e71ff700 1 -- start start 2023-09-30T23:04:17.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.656+0000 7f70e71ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e00a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:17.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.656+0000 7f70e71ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e0143350 0x7f70e016a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:17.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.656+0000 7f70e71ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70e015dc50 0x7f70e016a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.656+0000 7f70e71ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00a7170 con 0x7f70e0143350 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.656+0000 7f70e71ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00b13e0 con 0x7f70e00692f0 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.656+0000 7f70e71ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00a6560 con 0x7f70e015dc50 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e0143350 0x7f70e016a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e0143350 0x7f70e016a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37440/0 (socket says 172.21.15.142:37440) 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 -- 172.21.15.142:0/2774351572 learned_addr learned my addr 172.21.15.142:0/2774351572 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70e4f9b700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e00a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70e579c700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70e015dc50 0x7f70e016a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 -- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70e015dc50 msgr2=0x7f70e016a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70e015dc50 0x7f70e016a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 -- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 msgr2=0x7f70e00a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e00a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 -- 172.21.15.142:0/2774351572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc009420 con 0x7f70e0143350 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70e579c700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70e015dc50 0x7f70e016a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70e4f9b700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e00a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.657+0000 7f70dffff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e0143350 0x7f70e016a1f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f70e0063f80 tx=0x7f70cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.658+0000 7f70dcff9700 1 -- 172.21.15.142:0/2774351572 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc01f070 con 0x7f70e0143350 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.658+0000 7f70dcff9700 1 -- 172.21.15.142:0/2774351572 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00bb20 con 0x7f70e0143350 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.658+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e00a6840 con 0x7f70e0143350 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.658+0000 7f70dcff9700 1 -- 172.21.15.142:0/2774351572 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc011650 con 0x7f70e0143350 2023-09-30T23:04:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.658+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e00a6e00 con 0x7f70e0143350 2023-09-30T23:04:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.659+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e015da60 con 0x7f70e0143350 2023-09-30T23:04:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.660+0000 7f70dcff9700 1 -- 172.21.15.142:0/2774351572 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f70cc011a40 con 0x7f70e0143350 2023-09-30T23:04:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.660+0000 7f70dcff9700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f70c4067360 0x7f70c4069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.660+0000 7f70dcff9700 1 -- 172.21.15.142:0/2774351572 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70cc086070 con 0x7f70e0143350 2023-09-30T23:04:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.661+0000 7f70e4f9b700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f70c4067360 0x7f70c4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:17.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.661+0000 7f70e4f9b700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f70c4067360 0x7f70c4069810 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70d40058d0 tx=0x7f70d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:17.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.665+0000 7f70dcff9700 1 -- 172.21.15.142:0/2774351572 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f70cc0b7570 con 0x7f70e0143350 2023-09-30T23:04:17.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.896+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f70e00cc060 con 0x7f70e0143350 2023-09-30T23:04:17.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.897+0000 7f70dcff9700 1 -- 172.21.15.142:0/2774351572 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7f70cc052ed0 con 0x7f70e0143350 2023-09-30T23:04:17.898 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T23:04:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f70c4067360 msgr2=0x7f70c4069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f70c4067360 0x7f70c4069810 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70d40058d0 tx=0x7f70d4009040 comp rx=0 tx=0).stop 2023-09-30T23:04:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e0143350 msgr2=0x7f70e016a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e0143350 0x7f70e016a1f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f70e0063f80 tx=0x7f70cc017000 comp rx=0 tx=0).stop 2023-09-30T23:04:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 shutdown_connections 2023-09-30T23:04:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f70c4067360 0x7f70c4069810 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f70e015dc50 0x7f70e016a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70e00692f0 0x7f70e00a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 --2- 172.21.15.142:0/2774351572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e0143350 0x7f70e016a1f0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:17.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 >> 172.21.15.142:0/2774351572 conn(0x7f70e00ce8e0 msgr2=0x7f70e00c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:17.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 shutdown_connections 2023-09-30T23:04:17.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:17.899+0000 7f70e71ff700 1 -- 172.21.15.142:0/2774351572 wait complete. 2023-09-30T23:04:17.917 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T23:04:17.917 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T23:04:17.917 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-09-30T23:04:17.917 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T23:04:17.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T23:04:17.917 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T23:04:17.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-30T23:04:17.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T23:04:17.918 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:04:17.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:17.918 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-09-30T23:04:17.970 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T23:04:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T23:04:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T23:04:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-09-30T23:04:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T23:04:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41631sec preferred_lft 41631sec 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::2036:f5ff:fe25:f837/64 scope link 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 56:2f:51:b8:14:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::542f:51ff:feb8:1441/64 scope link 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:17.972 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T23:04:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 4a:17:94:14:b0:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T23:04:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::4817:94ff:fe14:b03b/64 scope link 2023-09-30T23:04:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-09-30T23:04:17.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:17.974 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T23:04:18.044 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-09-30T23:04:18.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:18.047 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-09-30T23:04:18.096 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-09-30T23:04:18.096 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T23:04:18.096 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T23:04:18.096 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T23:04:18.096 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T23:04:18.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:18.098 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-09-30T23:04:18.098 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-09-30T23:04:18.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T23:04:18.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T23:04:18.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T23:04:18.098 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-09-30T23:04:18.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:18.267 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T23:04:18.313 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T23:04:18.313 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T23:04:18.314 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:04:18.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:18.315 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-09-30T23:04:18.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:04:18.385 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T23:04:18.432 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T23:04:18.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T23:04:18.433 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T23:04:18.518 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T23:04:18.518 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-09-30T23:04:18.518 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:04:18.657 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:04:18.658 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:04:18.658 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:04:18.672 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:04:18.672 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:04:18.672 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:04:18.672 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:04:18.672 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:04:18.691 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-30T23:04:18.691 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-30T23:04:18.691 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2023-09-30T23:04:18.691 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-09-30T23:04:18.691 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-30T23:04:18.692 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790" 2023-09-30T23:04:18.692 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.142:6789,172.21.15.148:6789,172.21.15.148:6790:/ 2023-09-30T23:04:18.692 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=45159191-1b2c-47ed-b172-96c0a1a05709" will pass to kernel 2023-09-30T23:04:18.696 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T23:04:18.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:18.697 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T23:04:18.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:18.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.965+0000 7f27ebfff700 1 Processor -- start 2023-09-30T23:04:18.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.965+0000 7f27ebfff700 1 -- start start 2023-09-30T23:04:18.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.966+0000 7f27ebfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27e41598e0 0x7f27e4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:18.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.966+0000 7f27ebfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e406b8d0 con 0x7f27e40cee50 2023-09-30T23:04:18.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.966+0000 7f27ebfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40cff40 con 0x7f27e40d03d0 2023-09-30T23:04:18.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.966+0000 7f27ebfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40cf330 con 0x7f27e41598e0 2023-09-30T23:04:18.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e959a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f27e40cee50 0x7f27e406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:37318/0 (socket says 172.21.15.142:37318) 2023-09-30T23:04:18.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e959a700 1 -- 172.21.15.142:0/742811148 learned_addr learned my addr 172.21.15.142:0/742811148 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:18.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e9d9b700 1 --2- 172.21.15.142:0/742811148 >> v2:172.21.15.148:3300/0 conn(0x7f27e41598e0 0x7f27e4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:18.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e8d99700 1 -- 172.21.15.142:0/742811148 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494775066 0 0) 0x7f27e406b8d0 con 0x7f27e40cee50 2023-09-30T23:04:18.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e8d99700 1 -- 172.21.15.142:0/742811148 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d0003570 con 0x7f27e40cee50 2023-09-30T23:04:18.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e9d9b700 1 -- 172.21.15.142:0/742811148 >> v1:172.21.15.148:6789/0 conn(0x7f27e40d03d0 legacy=0x7f27e415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e8d99700 1 -- 172.21.15.142:0/742811148 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197142355 0 0) 0x7f27e40cff40 con 0x7f27e40d03d0 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e9d9b700 1 -- 172.21.15.142:0/742811148 >> v1:172.21.15.142:6789/0 conn(0x7f27e40cee50 legacy=0x7f27e406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.967+0000 7f27e9d9b700 1 -- 172.21.15.142:0/742811148 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40cf610 con 0x7f27e41598e0 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.968+0000 7f27e9d9b700 1 --2- 172.21.15.142:0/742811148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e41598e0 0x7f27e4159cb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f27e00098e0 tx=0x7f27e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7343af2b7435a38d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.968+0000 7f27e8d99700 1 -- 172.21.15.142:0/742811148 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000b640 con 0x7f27e41598e0 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.968+0000 7f27e8d99700 1 -- 172.21.15.142:0/742811148 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e000b7a0 con 0x7f27e41598e0 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.968+0000 7f27e8d99700 1 -- 172.21.15.142:0/742811148 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000bb40 con 0x7f27e41598e0 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.968+0000 7f27ebfff700 1 -- 172.21.15.142:0/742811148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e41598e0 msgr2=0x7f27e4159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.968+0000 7f27ebfff700 1 --2- 172.21.15.142:0/742811148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e41598e0 0x7f27e4159cb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f27e00098e0 tx=0x7f27e00091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.969+0000 7f27ebfff700 1 -- 172.21.15.142:0/742811148 shutdown_connections 2023-09-30T23:04:18.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.969+0000 7f27ebfff700 1 --2- 172.21.15.142:0/742811148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e41598e0 0x7f27e4159cb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:18.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.969+0000 7f27ebfff700 1 -- 172.21.15.142:0/742811148 >> 172.21.15.142:0/742811148 conn(0x7f27e40cd540 msgr2=0x7f27e40cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:18.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.969+0000 7f27ebfff700 1 -- 172.21.15.142:0/742811148 shutdown_connections 2023-09-30T23:04:18.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.969+0000 7f27ebfff700 1 -- 172.21.15.142:0/742811148 wait complete. 2023-09-30T23:04:18.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.970+0000 7f27ebfff700 1 Processor -- start 2023-09-30T23:04:18.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.970+0000 7f27ebfff700 1 -- start start 2023-09-30T23:04:18.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27ebfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40cee50 0x7f27e4147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:18.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27ebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27e40d03d0 0x7f27e40c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27ebfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e41598e0 0x7f27e40c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27ebfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40c4ee0 con 0x7f27e40d03d0 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27ebfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40c9c50 con 0x7f27e40cee50 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27ebfff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40caa90 con 0x7f27e41598e0 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27e959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27e40d03d0 0x7f27e40c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27e959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27e40d03d0 0x7f27e40c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37450/0 (socket says 172.21.15.142:37450) 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27e959a700 1 -- 172.21.15.142:0/2799012730 learned_addr learned my addr 172.21.15.142:0/2799012730 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27e9d9b700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40cee50 0x7f27e4147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.971+0000 7f27ea59c700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e41598e0 0x7f27e40c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:18.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27e959a700 1 -- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e41598e0 msgr2=0x7f27e40c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27e959a700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e41598e0 0x7f27e40c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27e959a700 1 -- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40cee50 msgr2=0x7f27e4147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27e959a700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40cee50 0x7f27e4147e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27e959a700 1 -- 172.21.15.142:0/2799012730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009420 con 0x7f27e40d03d0 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27e959a700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27e40d03d0 0x7f27e40c7b80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f27d40011e0 tx=0x7f27d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27d9ffb700 1 -- 172.21.15.142:0/2799012730 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4005b30 con 0x7f27e40d03d0 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27d9ffb700 1 -- 172.21.15.142:0/2799012730 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4005c90 con 0x7f27e40d03d0 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e40c9e80 con 0x7f27e40d03d0 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27d9ffb700 1 -- 172.21.15.142:0/2799012730 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4007320 con 0x7f27e40d03d0 2023-09-30T23:04:18.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.972+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40ca440 con 0x7f27e40d03d0 2023-09-30T23:04:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.973+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e415a030 con 0x7f27e40d03d0 2023-09-30T23:04:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.974+0000 7f27d9ffb700 1 -- 172.21.15.142:0/2799012730 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f27d4007690 con 0x7f27e40d03d0 2023-09-30T23:04:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.975+0000 7f27d9ffb700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f27c8067330 0x7f27c80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.975+0000 7f27d9ffb700 1 -- 172.21.15.142:0/2799012730 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27d4083ff0 con 0x7f27e40d03d0 2023-09-30T23:04:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.975+0000 7f27e9d9b700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f27c8067330 0x7f27c80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.976+0000 7f27e9d9b700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f27c8067330 0x7f27c80697e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f27e00093f0 tx=0x7f27e0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:18.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:18.979+0000 7f27d9ffb700 1 -- 172.21.15.142:0/2799012730 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f27d4050e50 con 0x7f27e40d03d0 2023-09-30T23:04:19.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.208+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27e40cac00 con 0x7f27e40d03d0 2023-09-30T23:04:19.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.209+0000 7f27d9ffb700 1 -- 172.21.15.142:0/2799012730 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f27d4017020 con 0x7f27e40d03d0 2023-09-30T23:04:19.210 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:19.210 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:19.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f27c8067330 msgr2=0x7f27c80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:19.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f27c8067330 0x7f27c80697e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f27e00093f0 tx=0x7f27e0017000 comp rx=0 tx=0).stop 2023-09-30T23:04:19.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27e40d03d0 msgr2=0x7f27e40c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:19.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27e40d03d0 0x7f27e40c7b80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f27d40011e0 tx=0x7f27d4007df0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 shutdown_connections 2023-09-30T23:04:19.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f27c8067330 0x7f27c80697e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e41598e0 0x7f27e40c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40cee50 0x7f27e4147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 --2- 172.21.15.142:0/2799012730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27e40d03d0 0x7f27e40c7b80 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 >> 172.21.15.142:0/2799012730 conn(0x7f27e40cd540 msgr2=0x7f27e40b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:19.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 shutdown_connections 2023-09-30T23:04:19.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.211+0000 7f27ebfff700 1 -- 172.21.15.142:0/2799012730 wait complete. 2023-09-30T23:04:19.213 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:19.230 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-30T23:04:19.448 INFO:teuthology.orchestra.run.smithi148.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":8355,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.7973696110000006,"mdsmap_epoch":91,"osdmap_epoch":192,"osdmap_epoch_barrier":192,"uptime":16.500993165000001} 2023-09-30T23:04:19.448 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 8355, "mdsmap_epoch": 91, "osdmap_epoch": 192, "osdmap_epoch_barrier": 192, "rank_uptime": 9.797369611, "state": "up:active", "uptime": 16.500993165, "want_state": "up:active", "whoami": 0 } 2023-09-30T23:04:19.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-30T23:04:19.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.640+0000 7fc8b29ff700 1 Processor -- start 2023-09-30T23:04:19.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.641+0000 7fc8b29ff700 1 -- start start 2023-09-30T23:04:19.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b29ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8ac0ca5e0 0x7fc8ac0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:19.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b29ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8ac159de0 0x7fc8ac068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b29ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac068230 con 0x7fc8ac159a10 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b29ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ac067620 con 0x7fc8ac159de0 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b29ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ac067900 con 0x7fc8ac0ca5e0 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b0f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8ac159de0 0x7fc8ac068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8ab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8ac0ca5e0 0x7fc8ac0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b0f9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8ac159de0 0x7fc8ac068c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37464/0 (socket says 172.21.15.142:37464) 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/4148228914 learned_addr learned my addr 172.21.15.142:0/4148228914 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.642+0000 7fc8abfff700 1 --1- 172.21.15.142:0/4148228914 >> v1:172.21.15.148:6789/0 conn(0x7fc8ac159a10 0x7fc8ac0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:40568/0 (socket says 172.21.15.142:40568) 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/4148228914 >> v2:172.21.15.148:3300/0 conn(0x7fc8ac0ca5e0 msgr2=0x7fc8ac0686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8b0f9c700 1 --2- 172.21.15.142:0/4148228914 >> v2:172.21.15.148:3300/0 conn(0x7fc8ac0ca5e0 0x7fc8ac0686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/4148228914 >> v1:172.21.15.148:6789/0 conn(0x7fc8ac159a10 legacy=0x7fc8ac0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/4148228914 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac067be0 con 0x7fc8ac159de0 2023-09-30T23:04:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8b0f9c700 1 --2- 172.21.15.142:0/4148228914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac068c00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac06f7a0 tx=0x7fc8a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8aae49214981e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8aaffd700 1 -- 172.21.15.142:0/4148228914 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400e070 con 0x7fc8ac159de0 2023-09-30T23:04:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8aaffd700 1 -- 172.21.15.142:0/4148228914 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a400ba20 con 0x7fc8ac159de0 2023-09-30T23:04:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.643+0000 7fc8aaffd700 1 -- 172.21.15.142:0/4148228914 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40092e0 con 0x7fc8ac159de0 2023-09-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 -- 172.21.15.142:0/4148228914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 msgr2=0x7fc8ac068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/4148228914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac068c00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac06f7a0 tx=0x7fc8a4009840 comp rx=0 tx=0).stop 2023-09-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 -- 172.21.15.142:0/4148228914 shutdown_connections 2023-09-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/4148228914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac068c00 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/4148228914 >> v2:172.21.15.148:3300/0 conn(0x7fc8ac0ca5e0 0x7fc8ac0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 -- 172.21.15.142:0/4148228914 >> 172.21.15.142:0/4148228914 conn(0x7fc8ac0cb2f0 msgr2=0x7fc8ac0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 -- 172.21.15.142:0/4148228914 shutdown_connections 2023-09-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.644+0000 7fc8b29ff700 1 -- 172.21.15.142:0/4148228914 wait complete. 2023-09-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.645+0000 7fc8b29ff700 1 Processor -- start 2023-09-30T23:04:19.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.645+0000 7fc8b29ff700 1 -- start start 2023-09-30T23:04:19.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.646+0000 7fc8b29ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ac0ca5e0 0x7fc8ac16a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.646+0000 7fc8b29ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ac159a10 0x7fc8ac16aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.646+0000 7fc8b29ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac16b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.646+0000 7fc8b29ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac0c30b0 con 0x7fc8ac159de0 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.646+0000 7fc8b29ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac15bb60 con 0x7fc8ac159a10 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.646+0000 7fc8b29ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac15be40 con 0x7fc8ac0ca5e0 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac16b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8abfff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ac0ca5e0 0x7fc8ac16a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8ab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ac159a10 0x7fc8ac16aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac16b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37468/0 (socket says 172.21.15.142:37468) 2023-09-30T23:04:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/1696650030 learned_addr learned my addr 172.21.15.142:0/1696650030 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/1696650030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ac0ca5e0 msgr2=0x7fc8ac16a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ac0ca5e0 0x7fc8ac16a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/1696650030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ac159a10 msgr2=0x7fc8ac16aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ac159a10 0x7fc8ac16aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 -- 172.21.15.142:0/1696650030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4009ae0 con 0x7fc8ac159de0 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8ab7fe700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ac159a10 0x7fc8ac16aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.647+0000 7fc8b0f9c700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac16b010 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009880 tx=0x7fc8a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.648+0000 7fc893fff700 1 -- 172.21.15.142:0/1696650030 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4008a80 con 0x7fc8ac159de0 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.648+0000 7fc893fff700 1 -- 172.21.15.142:0/1696650030 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4008be0 con 0x7fc8ac159de0 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.648+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac15c120 con 0x7fc8ac159de0 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.648+0000 7fc893fff700 1 -- 172.21.15.142:0/1696650030 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4025460 con 0x7fc8ac159de0 2023-09-30T23:04:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.648+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac1558a0 con 0x7fc8ac159de0 2023-09-30T23:04:19.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.649+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ac15c5c0 con 0x7fc8ac159de0 2023-09-30T23:04:19.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.650+0000 7fc893fff700 1 -- 172.21.15.142:0/1696650030 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc8a4003040 con 0x7fc8ac159de0 2023-09-30T23:04:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.651+0000 7fc893fff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc898067330 0x7fc8980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.651+0000 7fc893fff700 1 -- 172.21.15.142:0/1696650030 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8a40867b0 con 0x7fc8ac159de0 2023-09-30T23:04:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.651+0000 7fc8abfff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc898067330 0x7fc8980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.652+0000 7fc8abfff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc898067330 0x7fc8980697e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc89c004fd0 tx=0x7fc89c007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:19.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.656+0000 7fc893fff700 1 -- 172.21.15.142:0/1696650030 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc8ac15c5c0 con 0x7fc8ac159de0 2023-09-30T23:04:19.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:19.846+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fc8ac15c5c0 con 0x7fc8ac159de0 2023-09-30T23:04:20.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.431+0000 7fc893fff700 1 -- 172.21.15.142:0/1696650030 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v193) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc8ac15c5c0 con 0x7fc8ac159de0 2023-09-30T23:04:20.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.433+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc898067330 msgr2=0x7fc8980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:20.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.433+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc898067330 0x7fc8980697e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc89c004fd0 tx=0x7fc89c007eb0 comp rx=0 tx=0).stop 2023-09-30T23:04:20.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 msgr2=0x7fc8ac16b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac16b010 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009880 tx=0x7fc8a4018000 comp rx=0 tx=0).stop 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 shutdown_connections 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc898067330 0x7fc8980697e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac159de0 0x7fc8ac16b010 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8ac0ca5e0 0x7fc8ac16a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 --2- 172.21.15.142:0/1696650030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8ac159a10 0x7fc8ac16aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 >> 172.21.15.142:0/1696650030 conn(0x7fc8ac0cb2f0 msgr2=0x7fc8ac0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 shutdown_connections 2023-09-30T23:04:20.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:20.434+0000 7fc8b29ff700 1 -- 172.21.15.142:0/1696650030 wait complete. 2023-09-30T23:04:20.437 INFO:teuthology.orchestra.run.smithi142.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-30T23:04:20.453 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-30T23:04:20.665 INFO:teuthology.orchestra.run.smithi142.stdout:{"osd_mon_report_interval":"5"} 2023-09-30T23:04:20.665 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-30T23:04:20.665 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-09-30T23:04:20.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:20.666 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-09-30T23:04:20.851 INFO:teuthology.orchestra.run.smithi142.stderr:16+0 records in 2023-09-30T23:04:20.851 INFO:teuthology.orchestra.run.smithi142.stderr:16+0 records out 2023-09-30T23:04:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.134662 s, 125 MB/s 2023-09-30T23:04:20.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:20.853 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-09-30T23:04:21.044 INFO:teuthology.orchestra.run.smithi142.stderr:17+0 records in 2023-09-30T23:04:21.045 INFO:teuthology.orchestra.run.smithi142.stderr:17+0 records out 2023-09-30T23:04:21.045 INFO:teuthology.orchestra.run.smithi142.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.142812 s, 125 MB/s 2023-09-30T23:04:21.046 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-30T23:04:21.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T23:04:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.236+0000 7f119efff700 1 Processor -- start 2023-09-30T23:04:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.236+0000 7f119efff700 1 -- start start 2023-09-30T23:04:21.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.237+0000 7f119efff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1198143350 0x7f11980cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:21.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.237+0000 7f119efff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11980692f0 0x7f119815d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:21.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.237+0000 7f119efff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119815e0b0 con 0x7f119815dc50 2023-09-30T23:04:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.237+0000 7f119efff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11980cc6b0 con 0x7f11980692f0 2023-09-30T23:04:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.237+0000 7f119efff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980cb7d0 con 0x7f1198143350 2023-09-30T23:04:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f1197fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11980692f0 0x7f119815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f1197fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11980692f0 0x7f119815d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36340/0 (socket says 172.21.15.142:36340) 2023-09-30T23:04:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f1197fff700 1 -- 172.21.15.142:0/2518874413 learned_addr learned my addr 172.21.15.142:0/2518874413 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f119cd9b700 1 --2- 172.21.15.142:0/2518874413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1198143350 0x7f11980cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:21.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f1197fff700 1 -- 172.21.15.142:0/2518874413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1198143350 msgr2=0x7f11980cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f1197fff700 1 --2- 172.21.15.142:0/2518874413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1198143350 0x7f11980cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f1197fff700 1 -- 172.21.15.142:0/2518874413 >> v1:172.21.15.148:6789/0 conn(0x7f119815dc50 legacy=0x7f1198068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f1197fff700 1 -- 172.21.15.142:0/2518874413 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980cbaa0 con 0x7f11980692f0 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.238+0000 7f119cd9b700 1 --2- 172.21.15.142:0/2518874413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1198143350 0x7f11980cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f1197fff700 1 --2- 172.21.15.142:0/2518874413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11980692f0 0x7f119815d710 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f11840099b0 tx=0x7f1184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1404d98444e8ca7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f11977fe700 1 -- 172.21.15.142:0/2518874413 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400b860 con 0x7f11980692f0 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f11977fe700 1 -- 172.21.15.142:0/2518874413 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400b9c0 con 0x7f11980692f0 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f11977fe700 1 -- 172.21.15.142:0/2518874413 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400bd60 con 0x7f11980692f0 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f119efff700 1 -- 172.21.15.142:0/2518874413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11980692f0 msgr2=0x7f119815d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f119efff700 1 --2- 172.21.15.142:0/2518874413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11980692f0 0x7f119815d710 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f11840099b0 tx=0x7f1184009250 comp rx=0 tx=0).stop 2023-09-30T23:04:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f119efff700 1 -- 172.21.15.142:0/2518874413 shutdown_connections 2023-09-30T23:04:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f119efff700 1 --2- 172.21.15.142:0/2518874413 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1198143350 0x7f11980cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f119efff700 1 --2- 172.21.15.142:0/2518874413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11980692f0 0x7f119815d710 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.239+0000 7f119efff700 1 -- 172.21.15.142:0/2518874413 >> 172.21.15.142:0/2518874413 conn(0x7f11980ce8e0 msgr2=0x7f11980cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.240+0000 7f119efff700 1 -- 172.21.15.142:0/2518874413 shutdown_connections 2023-09-30T23:04:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.240+0000 7f119efff700 1 -- 172.21.15.142:0/2518874413 wait complete. 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.241+0000 7f119efff700 1 Processor -- start 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.241+0000 7f119efff700 1 -- start start 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119efff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980692f0 0x7f1198158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119efff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1198143350 0x7f119815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119efff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119815dc50 0x7f11980b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119efff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815b2e0 con 0x7f119815dc50 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119efff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815a6d0 con 0x7f1198143350 2023-09-30T23:04:21.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119efff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119815a9b0 con 0x7f11980692f0 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119d59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119815dc50 0x7f11980b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119d59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119815dc50 0x7f11980b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36346/0 (socket says 172.21.15.142:36346) 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119d59c700 1 -- 172.21.15.142:0/293935162 learned_addr learned my addr 172.21.15.142:0/293935162 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f119cd9b700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980692f0 0x7f1198158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.242+0000 7f1197fff700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1198143350 0x7f119815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119d59c700 1 -- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980692f0 msgr2=0x7f1198158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119d59c700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980692f0 0x7f1198158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119d59c700 1 -- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1198143350 msgr2=0x7f119815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119d59c700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1198143350 0x7f119815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119d59c700 1 -- 172.21.15.142:0/293935162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11840094f0 con 0x7f119815dc50 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119d59c700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119815dc50 0x7f11980b27f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f119000c840 tx=0x7f1190001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:21.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f1194ff9700 1 -- 172.21.15.142:0/293935162 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190012630 con 0x7f119815dc50 2023-09-30T23:04:21.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f1194ff9700 1 -- 172.21.15.142:0/293935162 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11900127b0 con 0x7f119815dc50 2023-09-30T23:04:21.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f1194ff9700 1 -- 172.21.15.142:0/293935162 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190012b70 con 0x7f119815dc50 2023-09-30T23:04:21.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119815ac90 con 0x7f119815dc50 2023-09-30T23:04:21.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.243+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11981594d0 con 0x7f119815dc50 2023-09-30T23:04:21.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.244+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119806ea70 con 0x7f119815dc50 2023-09-30T23:04:21.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.245+0000 7f1194ff9700 1 -- 172.21.15.142:0/293935162 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f119001a3a0 con 0x7f119815dc50 2023-09-30T23:04:21.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.246+0000 7f1194ff9700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:21.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.246+0000 7f1194ff9700 1 -- 172.21.15.142:0/293935162 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1190084bb0 con 0x7f119815dc50 2023-09-30T23:04:21.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.246+0000 7f119cd9b700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:21.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.247+0000 7f119cd9b700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f118c006f00 tx=0x7f118c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:21.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.250+0000 7f1194ff9700 1 -- 172.21.15.142:0/293935162 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1190051a10 con 0x7f119815dc50 2023-09-30T23:04:21.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.444+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f119815e0b0 con 0x7f119815dc50 2023-09-30T23:04:21.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.445+0000 7f1194ff9700 1 -- 172.21.15.142:0/293935162 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+34984 (secure 0 0 0) 0x7f119815e0b0 con 0x7f119815dc50 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 193, 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T23:04:20.425734+0000", 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T23:04:21.446 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T23:04:21.447 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 24, 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T23:04:21.448 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:21.449 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:21.450 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:21.451 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:21.452 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:21.453 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:21.454 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T23:04:21.455 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:21.456 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T23:04:21.457 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.458 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:21.459 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:21.460 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:21.461 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:21.462 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 23, 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:06.673268+0000", 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:21.463 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T23:04:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "191", 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:21.468 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:21.469 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 24, 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:08.101636+0000", 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:21.470 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T23:04:21.471 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "193", 2023-09-30T23:04:21.472 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:21.473 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:21.474 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:21.475 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T23:04:21.479 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.480 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.481 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T23:04:21.489 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T23:04:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.495 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.497 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.498 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T23:04:21.500 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.502 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.503 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.504 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.505 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.507 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T23:04:21.509 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T23:04:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.511 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.512 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.518 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T23:04:21.520 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.521 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.522 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.524 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:21.525 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T23:04:21.526 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T23:04:21.528 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:21.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.530 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.531 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:21.532 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.533 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.534 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:21.537 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T23:04:21.538 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T23:04:21.539 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T23:04:21.540 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:21.541 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:21.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 msgr2=0x7f117c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:21.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f118c006f00 tx=0x7f118c008040 comp rx=0 tx=0).stop 2023-09-30T23:04:21.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119815dc50 msgr2=0x7f11980b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:21.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119815dc50 0x7f11980b27f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f119000c840 tx=0x7f1190001670 comp rx=0 tx=0).stop 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 shutdown_connections 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119815dc50 0x7f11980b27f0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980692f0 0x7f1198158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 --2- 172.21.15.142:0/293935162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1198143350 0x7f119815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 >> 172.21.15.142:0/293935162 conn(0x7f11980ce8e0 msgr2=0x7f1198140380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 shutdown_connections 2023-09-30T23:04:21.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:21.447+0000 7f119efff700 1 -- 172.21.15.142:0/293935162 wait complete. 2023-09-30T23:04:21.544 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T23:04:26.546 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T23:04:26.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.747+0000 7fe7c4fff700 1 Processor -- start 2023-09-30T23:04:26.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.747+0000 7fe7c4fff700 1 -- start start 2023-09-30T23:04:26.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.748+0000 7fe7c4fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7c00af020 0x7fe7c0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:26.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.748+0000 7fe7c4fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7c00b00d0 0x7fe7c006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:26.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.748+0000 7fe7c4fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c006d3e0 con 0x7fe7c006e650 2023-09-30T23:04:26.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.748+0000 7fe7c4fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c015b400 con 0x7fe7c00af020 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.748+0000 7fe7c4fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c006dc80 con 0x7fe7c00b00d0 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7c00af020 0x7fe7c0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7bdd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7c00b00d0 0x7fe7c006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7c00af020 0x7fe7c0156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36362/0 (socket says 172.21.15.142:36362) 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 -- 172.21.15.142:0/1808243235 learned_addr learned my addr 172.21.15.142:0/1808243235 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 -- 172.21.15.142:0/1808243235 >> v2:172.21.15.148:3300/0 conn(0x7fe7c00b00d0 msgr2=0x7fe7c006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 --2- 172.21.15.142:0/1808243235 >> v2:172.21.15.148:3300/0 conn(0x7fe7c00b00d0 0x7fe7c006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 -- 172.21.15.142:0/1808243235 >> v1:172.21.15.148:6789/0 conn(0x7fe7c006e650 legacy=0x7fe7c00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 -- 172.21.15.142:0/1808243235 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c006b790 con 0x7fe7c00af020 2023-09-30T23:04:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.749+0000 7fe7be59c700 1 --2- 172.21.15.142:0/1808243235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c00af020 0x7fe7c0156d80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00099b0 tx=0x7fe7b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c477383dced670 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:26.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7bd59a700 1 -- 172.21.15.142:0/1808243235 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0009ea0 con 0x7fe7c00af020 2023-09-30T23:04:26.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7bd59a700 1 -- 172.21.15.142:0/1808243235 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000b820 con 0x7fe7c00af020 2023-09-30T23:04:26.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7bd59a700 1 -- 172.21.15.142:0/1808243235 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000bbc0 con 0x7fe7c00af020 2023-09-30T23:04:26.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 -- 172.21.15.142:0/1808243235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c00af020 msgr2=0x7fe7c0156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:26.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/1808243235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c00af020 0x7fe7c0156d80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00099b0 tx=0x7fe7b0009250 comp rx=0 tx=0).stop 2023-09-30T23:04:26.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 -- 172.21.15.142:0/1808243235 shutdown_connections 2023-09-30T23:04:26.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/1808243235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c00af020 0x7fe7c0156d80 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:26.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/1808243235 >> v2:172.21.15.148:3300/0 conn(0x7fe7c00b00d0 0x7fe7c006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:26.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 -- 172.21.15.142:0/1808243235 >> 172.21.15.142:0/1808243235 conn(0x7fe7c00680c0 msgr2=0x7fe7c00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:26.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 -- 172.21.15.142:0/1808243235 shutdown_connections 2023-09-30T23:04:26.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.750+0000 7fe7c4fff700 1 -- 172.21.15.142:0/1808243235 wait complete. 2023-09-30T23:04:26.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.752+0000 7fe7c4fff700 1 Processor -- start 2023-09-30T23:04:26.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.753+0000 7fe7c4fff700 1 -- start start 2023-09-30T23:04:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7c4fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c006e650 0x7fe7c00c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7c4fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7c00af020 0x7fe7c00c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7c4fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7c00b00d0 0x7fe7c01586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7c4fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c015a110 con 0x7fe7c006e650 2023-09-30T23:04:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7c4fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00c65d0 con 0x7fe7c00af020 2023-09-30T23:04:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7c4fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00c68b0 con 0x7fe7c00b00d0 2023-09-30T23:04:26.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c006e650 0x7fe7c00c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c006e650 0x7fe7c00c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36366/0 (socket says 172.21.15.142:36366) 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 -- 172.21.15.142:0/3716753349 learned_addr learned my addr 172.21.15.142:0/3716753349 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7bdd9b700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7c00af020 0x7fe7c00c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7bed9d700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7c00b00d0 0x7fe7c01586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 -- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7c00b00d0 msgr2=0x7fe7c01586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7c00b00d0 0x7fe7c01586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 -- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7c00af020 msgr2=0x7fe7c00c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7c00af020 0x7fe7c00c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7be59c700 1 -- 172.21.15.142:0/3716753349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00094f0 con 0x7fe7c006e650 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7bed9d700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7c00b00d0 0x7fe7c01586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.754+0000 7fe7bdd9b700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7c00af020 0x7fe7c00c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.755+0000 7fe7be59c700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c006e650 0x7fe7c00c7670 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009290 tx=0x7fe7b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.755+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b001e070 con 0x7fe7c006e650 2023-09-30T23:04:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.755+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000b990 con 0x7fe7c006e650 2023-09-30T23:04:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.755+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c00c6b90 con 0x7fe7c006e650 2023-09-30T23:04:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.755+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0010470 con 0x7fe7c006e650 2023-09-30T23:04:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.755+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c00c7150 con 0x7fe7c006e650 2023-09-30T23:04:26.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.756+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c00695b0 con 0x7fe7c006e650 2023-09-30T23:04:26.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.757+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe7b0022070 con 0x7fe7c006e650 2023-09-30T23:04:26.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.759+0000 7fe7ae7fc700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a0067330 0x7fe7a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:26.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.759+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7b0014070 con 0x7fe7c006e650 2023-09-30T23:04:26.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.759+0000 7fe7bdd9b700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a0067330 0x7fe7a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:26.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.759+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fe7a006f4f0 con 0x7fe7c006e650 2023-09-30T23:04:26.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.760+0000 7fe7bdd9b700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a0067330 0x7fe7a00697e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe7c015ab60 tx=0x7fe7b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.764+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe7b0029060 con 0x7fe7c006e650 2023-09-30T23:04:26.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.957+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe7c006fc10 con 0x7fe7c006e650 2023-09-30T23:04:26.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.958+0000 7fe7ae7fc700 1 -- 172.21.15.142:0/3716753349 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v194) v1 ==== 81+0+35003 (secure 0 0 0) 0x7fe7b0089e60 con 0x7fe7c006e650 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 194, 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T23:04:24.400039+0000", 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T23:04:26.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 24, 2023-09-30T23:04:26.960 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:26.961 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:26.962 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:26.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:26.964 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:26.965 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:26.966 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.967 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:26.968 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:26.969 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:26.970 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:26.970 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:26.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.970 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:26.970 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:26.970 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:26.970 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:26.971 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:26.973 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 23, 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:06.673268+0000", 2023-09-30T23:04:26.974 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:26.975 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:26.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "191", 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:26.977 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:26.978 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:26.979 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:26.980 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 24, 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:08.101636+0000", 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1027, 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T23:04:26.982 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "194", 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:26.983 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:26.984 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.985 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:26.986 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.987 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:26.988 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.991 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T23:04:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:26.994 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.995 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.997 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T23:04:26.998 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:26.999 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.000 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.001 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T23:04:27.003 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.004 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.006 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.008 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.010 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.011 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T23:04:27.013 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.014 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T23:04:27.016 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.017 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.018 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.019 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:27.020 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.021 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.022 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.023 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T23:04:27.025 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T23:04:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.027 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T23:04:27.028 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T23:04:27.031 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.033 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.034 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:27.034 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.034 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.034 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.034 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.035 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.037 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.038 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.040 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.041 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.042 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.043 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.044 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T23:04:27.045 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:27.047 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T23:04:27.048 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T23:04:27.049 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.050 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:27.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a0067330 msgr2=0x7fe7a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a0067330 0x7fe7a00697e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe7c015ab60 tx=0x7fe7b4008040 comp rx=0 tx=0).stop 2023-09-30T23:04:27.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c006e650 msgr2=0x7fe7c00c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c006e650 0x7fe7c00c7670 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009290 tx=0x7fe7b0019000 comp rx=0 tx=0).stop 2023-09-30T23:04:27.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 shutdown_connections 2023-09-30T23:04:27.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fe7a0067330 0x7fe7a00697e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7c00b00d0 0x7fe7c01586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7c006e650 0x7fe7c00c7670 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 --2- 172.21.15.142:0/3716753349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7c00af020 0x7fe7c00c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 >> 172.21.15.142:0/3716753349 conn(0x7fe7c00680c0 msgr2=0x7fe7c0069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:27.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 shutdown_connections 2023-09-30T23:04:27.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:26.961+0000 7fe7c4fff700 1 -- 172.21.15.142:0/3716753349 wait complete. 2023-09-30T23:04:27.054 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-30T23:04:27.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:27.054 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-09-30T23:04:27.420 INFO:teuthology.orchestra.run.smithi142.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-30T23:04:27.421 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T23:04:27.421 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T23:04:27.421 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.316315 s, 166 MB/s 2023-09-30T23:04:27.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T23:04:27.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T23:04:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.613+0000 7fa2447ff700 1 Processor -- start 2023-09-30T23:04:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.613+0000 7fa2447ff700 1 -- start start 2023-09-30T23:04:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.614+0000 7fa2447ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa23c0af020 0x7fa23c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.614+0000 7fa2447ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c06d3e0 con 0x7fa23c0b00d0 2023-09-30T23:04:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa2447ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c06dc80 con 0x7fa23c06e820 2023-09-30T23:04:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa2447ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c06eca0 con 0x7fa23c0af020 2023-09-30T23:04:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa24259b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa23c0af020 0x7fa23c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa24259b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa23c0af020 0x7fa23c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36374/0 (socket says 172.21.15.142:36374) 2023-09-30T23:04:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa241d9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa23c0b00d0 0x7fa23c06e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60814/0 (socket says 172.21.15.142:60814) 2023-09-30T23:04:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa24259b700 1 -- 172.21.15.142:0/2774409519 learned_addr learned my addr 172.21.15.142:0/2774409519 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:27.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa24259b700 1 -- 172.21.15.142:0/2774409519 >> v1:172.21.15.148:6789/0 conn(0x7fa23c06e820 legacy=0x7fa23c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:27.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa24259b700 1 -- 172.21.15.142:0/2774409519 >> v1:172.21.15.142:6789/0 conn(0x7fa23c0b00d0 legacy=0x7fa23c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa24259b700 1 -- 172.21.15.142:0/2774409519 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c06b790 con 0x7fa23c0af020 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa241599700 1 -- 172.21.15.142:0/2774409519 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236845087 0 0) 0x7fa23c06d3e0 con 0x7fa23c0b00d0 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.615+0000 7fa24259b700 1 --2- 172.21.15.142:0/2774409519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c156d80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa2380099e0 tx=0x7fa238009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4568735303361cc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa241599700 1 -- 172.21.15.142:0/2774409519 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800b7e0 con 0x7fa23c0af020 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa241599700 1 -- 172.21.15.142:0/2774409519 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800b940 con 0x7fa23c0af020 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa241599700 1 -- 172.21.15.142:0/2774409519 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800bce0 con 0x7fa23c0af020 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa2447ff700 1 -- 172.21.15.142:0/2774409519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 msgr2=0x7fa23c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa2447ff700 1 --2- 172.21.15.142:0/2774409519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c156d80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa2380099e0 tx=0x7fa238009250 comp rx=0 tx=0).stop 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa2447ff700 1 -- 172.21.15.142:0/2774409519 shutdown_connections 2023-09-30T23:04:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa2447ff700 1 --2- 172.21.15.142:0/2774409519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c156d80 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa2447ff700 1 -- 172.21.15.142:0/2774409519 >> 172.21.15.142:0/2774409519 conn(0x7fa23c0680c0 msgr2=0x7fa23c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:27.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa2447ff700 1 -- 172.21.15.142:0/2774409519 shutdown_connections 2023-09-30T23:04:27.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.616+0000 7fa2447ff700 1 -- 172.21.15.142:0/2774409519 wait complete. 2023-09-30T23:04:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.618+0000 7fa2447ff700 1 Processor -- start 2023-09-30T23:04:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.618+0000 7fa2447ff700 1 -- start start 2023-09-30T23:04:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa2447ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa23c06e820 0x7fa23c1431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa2447ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c0c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa2447ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa23c0b00d0 0x7fa23c15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa2447ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c15e9a0 con 0x7fa23c0af020 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa2447ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c15c060 con 0x7fa23c06e820 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa2447ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c143700 con 0x7fa23c0b00d0 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c0c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c0c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36384/0 (socket says 172.21.15.142:36384) 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 -- 172.21.15.142:0/4071943928 learned_addr learned my addr 172.21.15.142:0/4071943928 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa24259b700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa23c06e820 0x7fa23c1431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa242d9c700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa23c0b00d0 0x7fa23c15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 -- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa23c0b00d0 msgr2=0x7fa23c15c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa23c0b00d0 0x7fa23c15c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 -- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa23c06e820 msgr2=0x7fa23c1431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa23c06e820 0x7fa23c1431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.619+0000 7fa241d9a700 1 -- 172.21.15.142:0/4071943928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380094f0 con 0x7fa23c0af020 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.620+0000 7fa241d9a700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c0c25e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c5e0 tx=0x7fa22c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.620+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c005a70 con 0x7fa23c0af020 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.620+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c005bd0 con 0x7fa23c0af020 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.620+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c15e6c0 con 0x7fa23c0af020 2023-09-30T23:04:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.620+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0070d0 con 0x7fa23c0af020 2023-09-30T23:04:27.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.620+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c15bcf0 con 0x7fa23c0af020 2023-09-30T23:04:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.621+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0695b0 con 0x7fa23c0af020 2023-09-30T23:04:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.622+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa22c007480 con 0x7fa23c0af020 2023-09-30T23:04:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.623+0000 7fa2327fc700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa220067330 0x7fa2200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.623+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa22c084100 con 0x7fa23c0af020 2023-09-30T23:04:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.623+0000 7fa24259b700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa220067330 0x7fa2200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.623+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fa22006f4f0 con 0x7fa23c0af020 2023-09-30T23:04:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.624+0000 7fa24259b700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa220067330 0x7fa2200697e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa2380099e0 tx=0x7fa238016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:27.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.627+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa22c050f60 con 0x7fa23c0af020 2023-09-30T23:04:27.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.819+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa23c15c1a0 con 0x7fa23c0af020 2023-09-30T23:04:27.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.820+0000 7fa2327fc700 1 -- 172.21.15.142:0/4071943928 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v194) v1 ==== 81+0+35003 (secure 0 0 0) 0x7fa22c017070 con 0x7fa23c0af020 2023-09-30T23:04:27.820 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:27.820 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:27.820 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 194, 2023-09-30T23:04:27.820 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:04:27.820 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T23:04:24.400039+0000", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:27.821 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 24, 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T23:04:27.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:27.823 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:27.824 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:27.825 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:27.826 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.827 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:27.828 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:27.829 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T23:04:27.830 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:27.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:27.833 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 23, 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T23:04:27.835 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:06.673268+0000", 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:27.836 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:27.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "191", 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:27.838 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T23:04:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 24, 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:08.101636+0000", 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1027, 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "194", 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:27.846 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T23:04:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.848 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.851 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T23:04:27.852 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.853 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.855 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.856 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T23:04:27.858 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.859 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T23:04:27.860 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.861 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.862 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.863 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.865 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.866 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.867 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.868 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.869 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.871 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.872 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.873 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.874 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.875 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.876 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.880 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.881 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.884 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.885 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T23:04:27.886 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.887 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.888 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.890 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.891 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T23:04:27.892 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:27.894 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.896 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T23:04:27.898 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T23:04:27.899 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.900 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T23:04:27.902 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:27.904 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.905 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:27.906 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T23:04:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T23:04:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:27.909 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa220067330 msgr2=0x7fa2200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa220067330 0x7fa2200697e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa2380099e0 tx=0x7fa238016000 comp rx=0 tx=0).stop 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 msgr2=0x7fa23c0c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c0c25e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c5e0 tx=0x7fa22c001040 comp rx=0 tx=0).stop 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 shutdown_connections 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa220067330 0x7fa2200697e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa23c0b00d0 0x7fa23c15c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa23c06e820 0x7fa23c1431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 --2- 172.21.15.142:0/4071943928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23c0af020 0x7fa23c0c25e0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:27.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.822+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 >> 172.21.15.142:0/4071943928 conn(0x7fa23c0680c0 msgr2=0x7fa23c155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:27.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.823+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 shutdown_connections 2023-09-30T23:04:27.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:27.823+0000 7fa2447ff700 1 -- 172.21.15.142:0/4071943928 wait complete. 2023-09-30T23:04:27.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:28.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.102+0000 7f304f3ff700 1 Processor -- start 2023-09-30T23:04:28.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.102+0000 7f304f3ff700 1 -- start start 2023-09-30T23:04:28.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.103+0000 7f304f3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3048159ae0 0x7f30480cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.103+0000 7f304f3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30480cc590 0x7f3048069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.103+0000 7f304f3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304815d910 con 0x7f30480b1180 2023-09-30T23:04:28.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.103+0000 7f304f3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304815e920 con 0x7f3048159ae0 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.103+0000 7f304f3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304815e490 con 0x7f30480cc590 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3048159ae0 0x7f30480cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3048159ae0 0x7f30480cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36392/0 (socket says 172.21.15.142:36392) 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 -- 172.21.15.142:0/1375839586 learned_addr learned my addr 172.21.15.142:0/1375839586 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d99c700 1 --2- 172.21.15.142:0/1375839586 >> v2:172.21.15.148:3300/0 conn(0x7f30480cc590 0x7f3048069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 -- 172.21.15.142:0/1375839586 >> v2:172.21.15.148:3300/0 conn(0x7f30480cc590 msgr2=0x7f3048069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 --2- 172.21.15.142:0/1375839586 >> v2:172.21.15.148:3300/0 conn(0x7f30480cc590 0x7f3048069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 -- 172.21.15.142:0/1375839586 >> v1:172.21.15.148:6789/0 conn(0x7f30480b1180 legacy=0x7f30480cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 -- 172.21.15.142:0/1375839586 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304815db60 con 0x7f3048159ae0 2023-09-30T23:04:28.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.104+0000 7f304d19b700 1 --2- 172.21.15.142:0/1375839586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f30480cdeb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f30480cb3d0 tx=0x7f3044009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2cde885ad9f493 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:28.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f303ffff700 1 -- 172.21.15.142:0/1375839586 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400b820 con 0x7f3048159ae0 2023-09-30T23:04:28.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f303ffff700 1 -- 172.21.15.142:0/1375839586 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400b980 con 0x7f3048159ae0 2023-09-30T23:04:28.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f303ffff700 1 -- 172.21.15.142:0/1375839586 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400bd20 con 0x7f3048159ae0 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 -- 172.21.15.142:0/1375839586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 msgr2=0x7f30480cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 --2- 172.21.15.142:0/1375839586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f30480cdeb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f30480cb3d0 tx=0x7f3044009250 comp rx=0 tx=0).stop 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 -- 172.21.15.142:0/1375839586 shutdown_connections 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 --2- 172.21.15.142:0/1375839586 >> v2:172.21.15.148:3300/0 conn(0x7f30480cc590 0x7f3048069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 --2- 172.21.15.142:0/1375839586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f30480cdeb0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 -- 172.21.15.142:0/1375839586 >> 172.21.15.142:0/1375839586 conn(0x7f30480ce8b0 msgr2=0x7f30480cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 -- 172.21.15.142:0/1375839586 shutdown_connections 2023-09-30T23:04:28.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.105+0000 7f304f3ff700 1 -- 172.21.15.142:0/1375839586 wait complete. 2023-09-30T23:04:28.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.107+0000 7f304f3ff700 1 Processor -- start 2023-09-30T23:04:28.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.107+0000 7f304f3ff700 1 -- start start 2023-09-30T23:04:28.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304f3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30480b1180 0x7f30480aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304f3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30480cc590 0x7f304815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304f3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f304816c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304f3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304815a840 con 0x7f3048159ae0 2023-09-30T23:04:28.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304f3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304815c8c0 con 0x7f30480b1180 2023-09-30T23:04:28.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304f3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304815cba0 con 0x7f30480cc590 2023-09-30T23:04:28.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304d99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f304816c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304d99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f304816c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36398/0 (socket says 172.21.15.142:36398) 2023-09-30T23:04:28.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304d99c700 1 -- 172.21.15.142:0/240857271 learned_addr learned my addr 172.21.15.142:0/240857271 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:28.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304c99a700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30480cc590 0x7f304815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304d19b700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30480b1180 0x7f30480aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304d99c700 1 -- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30480cc590 msgr2=0x7f304815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.108+0000 7f304d99c700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30480cc590 0x7f304815bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f304d99c700 1 -- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30480b1180 msgr2=0x7f30480aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f304d99c700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30480b1180 0x7f30480aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f304d99c700 1 -- 172.21.15.142:0/240857271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440094f0 con 0x7f3048159ae0 2023-09-30T23:04:28.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f304d19b700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30480b1180 0x7f30480aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:28.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f304d99c700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f304816c120 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3040009fa0 tx=0x7f3040009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:28.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000ed20 con 0x7f3048159ae0 2023-09-30T23:04:28.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000ee80 con 0x7f3048159ae0 2023-09-30T23:04:28.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304815ce80 con 0x7f3048159ae0 2023-09-30T23:04:28.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040014670 con 0x7f3048159ae0 2023-09-30T23:04:28.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.109+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304815c500 con 0x7f3048159ae0 2023-09-30T23:04:28.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.110+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304815a320 con 0x7f3048159ae0 2023-09-30T23:04:28.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.111+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f30400149e0 con 0x7f3048159ae0 2023-09-30T23:04:28.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.112+0000 7f303d7fa700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f302c067330 0x7f302c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.112+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3040085490 con 0x7f3048159ae0 2023-09-30T23:04:28.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.112+0000 7f304d19b700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f302c067330 0x7f302c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.113+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f302c06f4f0 con 0x7f3048159ae0 2023-09-30T23:04:28.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.113+0000 7f304d19b700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f302c067330 0x7f302c0697e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f30480cb3d0 tx=0x7f3044016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:28.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.117+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f30400522f0 con 0x7f3048159ae0 2023-09-30T23:04:28.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.348+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30480b0470 con 0x7f3048159ae0 2023-09-30T23:04:28.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.348+0000 7f303d7fa700 1 -- 172.21.15.142:0/240857271 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f3040055910 con 0x7f3048159ae0 2023-09-30T23:04:28.348 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:28.348 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:28.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f302c067330 msgr2=0x7f302c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f302c067330 0x7f302c0697e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f30480cb3d0 tx=0x7f3044016000 comp rx=0 tx=0).stop 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 msgr2=0x7f304816c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f304816c120 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3040009fa0 tx=0x7f3040009900 comp rx=0 tx=0).stop 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 shutdown_connections 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f302c067330 0x7f302c0697e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3048159ae0 0x7f304816c120 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30480b1180 0x7f30480aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 --2- 172.21.15.142:0/240857271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f30480cc590 0x7f304815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 >> 172.21.15.142:0/240857271 conn(0x7f30480ce8b0 msgr2=0x7f3048158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 shutdown_connections 2023-09-30T23:04:28.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.351+0000 7f304f3ff700 1 -- 172.21.15.142:0/240857271 wait complete. 2023-09-30T23:04:28.352 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:28.368 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-30T23:04:28.590 INFO:teuthology.orchestra.run.smithi148.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":8355,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.939670682999999,"mdsmap_epoch":91,"osdmap_epoch":194,"osdmap_epoch_barrier":194,"uptime":25.643299043999999} 2023-09-30T23:04:28.590 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 8355, "mdsmap_epoch": 91, "osdmap_epoch": 194, "osdmap_epoch_barrier": 194, "rank_uptime": 18.939670683, "state": "up:active", "uptime": 25.643299044, "want_state": "up:active", "whoami": 0 } 2023-09-30T23:04:28.590 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T23:04:28.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:28.591 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-30T23:04:28.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:28.639 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-30T23:04:28.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T23:04:28.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.892+0000 7f2a1b3ff700 1 Processor -- start 2023-09-30T23:04:28.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.892+0000 7f2a1b3ff700 1 -- start start 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.893+0000 7f2a1b3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a14143350 0x7f2a140cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.893+0000 7f2a1b3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a1415de20 0x7f2a1406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.893+0000 7f2a1b3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140cc6b0 con 0x7f2a140692f0 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.893+0000 7f2a1b3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a140cb7d0 con 0x7f2a14143350 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.893+0000 7f2a1b3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a140cbaa0 con 0x7f2a1415de20 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1919b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a14143350 0x7f2a140cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1899a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2a140692f0 0x7f2a1415d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:60816/0 (socket says 172.21.15.142:60816) 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1919b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a14143350 0x7f2a140cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36406/0 (socket says 172.21.15.142:36406) 2023-09-30T23:04:28.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1899a700 1 -- 172.21.15.142:0/3618507972 learned_addr learned my addr 172.21.15.142:0/3618507972 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1999c700 1 --2- 172.21.15.142:0/3618507972 >> v2:172.21.15.148:3300/0 conn(0x7f2a1415de20 0x7f2a1406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1919b700 1 -- 172.21.15.142:0/3618507972 >> v2:172.21.15.148:3300/0 conn(0x7f2a1415de20 msgr2=0x7f2a1406a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1919b700 1 --2- 172.21.15.142:0/3618507972 >> v2:172.21.15.148:3300/0 conn(0x7f2a1415de20 0x7f2a1406a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1919b700 1 -- 172.21.15.142:0/3618507972 >> v1:172.21.15.142:6789/0 conn(0x7f2a140692f0 legacy=0x7f2a1415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1919b700 1 -- 172.21.15.142:0/3618507972 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140cbd80 con 0x7f2a14143350 2023-09-30T23:04:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a0bfff700 1 -- 172.21.15.142:0/3618507972 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724333308 0 0) 0x7f2a140cc6b0 con 0x7f2a140692f0 2023-09-30T23:04:28.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.894+0000 7f2a1919b700 1 --2- 172.21.15.142:0/3618507972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a14143350 0x7f2a140cb290 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f2a14069cf0 tx=0x7f2a100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b237fdc42b0d6aa7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a0bfff700 1 -- 172.21.15.142:0/3618507972 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011630 con 0x7f2a14143350 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a0bfff700 1 -- 172.21.15.142:0/3618507972 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10011790 con 0x7f2a14143350 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a0bfff700 1 -- 172.21.15.142:0/3618507972 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011b30 con 0x7f2a14143350 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/3618507972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a14143350 msgr2=0x7f2a140cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/3618507972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a14143350 0x7f2a140cb290 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f2a14069cf0 tx=0x7f2a100091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/3618507972 shutdown_connections 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/3618507972 >> v2:172.21.15.148:3300/0 conn(0x7f2a1415de20 0x7f2a1406a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/3618507972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a14143350 0x7f2a140cb290 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/3618507972 >> 172.21.15.142:0/3618507972 conn(0x7f2a140ce8e0 msgr2=0x7f2a140cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/3618507972 shutdown_connections 2023-09-30T23:04:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.895+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/3618507972 wait complete. 2023-09-30T23:04:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.897+0000 7f2a1b3ff700 1 Processor -- start 2023-09-30T23:04:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.897+0000 7f2a1b3ff700 1 -- start start 2023-09-30T23:04:28.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1b3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a140692f0 0x7f2a140b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1b3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a14143350 0x7f2a14158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1b3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1415de20 0x7f2a140cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1b3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b3990 con 0x7f2a140692f0 2023-09-30T23:04:28.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1b3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1413b650 con 0x7f2a14143350 2023-09-30T23:04:28.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1b3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1413b8f0 con 0x7f2a1415de20 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a140692f0 0x7f2a140b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a140692f0 0x7f2a140b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36410/0 (socket says 172.21.15.142:36410) 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 -- 172.21.15.142:0/1582046327 learned_addr learned my addr 172.21.15.142:0/1582046327 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1899a700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a14143350 0x7f2a14158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1999c700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1415de20 0x7f2a140cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 -- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1415de20 msgr2=0x7f2a140cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1415de20 0x7f2a140cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 -- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a14143350 msgr2=0x7f2a14158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a14143350 0x7f2a14158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1919b700 1 -- 172.21.15.142:0/1582046327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10009420 con 0x7f2a140692f0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.898+0000 7f2a1999c700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1415de20 0x7f2a140cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.899+0000 7f2a1919b700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a140692f0 0x7f2a140b27f0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2a14063f80 tx=0x7f2a10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.899+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011b10 con 0x7f2a140692f0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.899+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a100253f0 con 0x7f2a140692f0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.899+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a140b30f0 con 0x7f2a140692f0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.899+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10025790 con 0x7f2a140692f0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.899+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a140b36b0 con 0x7f2a140692f0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.900+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1406ea70 con 0x7f2a140692f0 2023-09-30T23:04:28.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.901+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2a10025b40 con 0x7f2a140692f0 2023-09-30T23:04:28.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.902+0000 7f2a097fa700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29f8067330 0x7f29f80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:28.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.902+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a10086490 con 0x7f2a140692f0 2023-09-30T23:04:28.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.902+0000 7f2a1899a700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29f8067330 0x7f29f80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:28.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.902+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f29f806f4f0 con 0x7f2a140692f0 2023-09-30T23:04:28.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.902+0000 7f2a1899a700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29f8067330 0x7f29f80697e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2a140b15e0 tx=0x7f2a04007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:28.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:28.906+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2a100532f0 con 0x7f2a140692f0 2023-09-30T23:04:29.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.098+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2a1406fc10 con 0x7f2a140692f0 2023-09-30T23:04:29.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.099+0000 7f2a097fa700 1 -- 172.21.15.142:0/1582046327 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v194) v1 ==== 81+0+35003 (secure 0 0 0) 0x7f2a10015020 con 0x7f2a140692f0 2023-09-30T23:04:29.099 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:29.099 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 194, 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T23:04:24.400039+0000", 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T23:04:29.100 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 24, 2023-09-30T23:04:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T23:04:29.102 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:29.103 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:29.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:29.105 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:29.106 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:29.107 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T23:04:29.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:29.109 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:29.110 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:29.111 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:29.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.113 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:29.114 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 23, 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:06.673268+0000", 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:29.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T23:04:29.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "191", 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:29.118 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:29.119 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:29.120 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T23:04:29.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 24, 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:08.101636+0000", 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1027, 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:29.122 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T23:04:29.123 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "194", 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:29.124 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:29.125 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:29.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:29.127 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.128 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.129 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.130 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T23:04:29.132 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T23:04:29.139 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.140 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.141 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.142 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:29.148 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T23:04:29.151 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T23:04:29.154 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T23:04:29.160 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.166 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.167 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T23:04:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:29.177 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T23:04:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T23:04:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T23:04:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T23:04:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:29.193 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29f8067330 msgr2=0x7f29f80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29f8067330 0x7f29f80697e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2a140b15e0 tx=0x7f2a04007d30 comp rx=0 tx=0).stop 2023-09-30T23:04:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a140692f0 msgr2=0x7f2a140b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a140692f0 0x7f2a140b27f0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f2a14063f80 tx=0x7f2a10017000 comp rx=0 tx=0).stop 2023-09-30T23:04:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 shutdown_connections 2023-09-30T23:04:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f29f8067330 0x7f29f80697e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a1415de20 0x7f2a140cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a140692f0 0x7f2a140b27f0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 --2- 172.21.15.142:0/1582046327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a14143350 0x7f2a14158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 >> 172.21.15.142:0/1582046327 conn(0x7f2a140ce8e0 msgr2=0x7f2a141403a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 shutdown_connections 2023-09-30T23:04:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:29.102+0000 7f2a1b3ff700 1 -- 172.21.15.142:0/1582046327 wait complete. 2023-09-30T23:04:29.198 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-30T23:04:34.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T23:04:34.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.399+0000 7f119fbff700 1 Processor -- start 2023-09-30T23:04:34.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.399+0000 7f119fbff700 1 -- start start 2023-09-30T23:04:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.400+0000 7f119fbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f119806ec50 0x7f1198159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.400+0000 7f119fbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11980b0ee0 con 0x7f119806f0a0 2023-09-30T23:04:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.400+0000 7f119fbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11980b02d0 con 0x7f11980aebf0 2023-09-30T23:04:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.400+0000 7f119fbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980aefc0 con 0x7f119806ec50 2023-09-30T23:04:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.401+0000 7f119e19c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f119806f0a0 0x7f1198160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40096/0 (socket says 172.21.15.142:40096) 2023-09-30T23:04:34.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.401+0000 7f119e19c700 1 -- 172.21.15.142:0/256123852 learned_addr learned my addr 172.21.15.142:0/256123852 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.401+0000 7f119d19a700 1 --2- 172.21.15.142:0/256123852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f119806ec50 0x7f1198159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.401+0000 7f119c999700 1 -- 172.21.15.142:0/256123852 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523514279 0 0) 0x7f11980b0ee0 con 0x7f119806f0a0 2023-09-30T23:04:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.401+0000 7f119c999700 1 -- 172.21.15.142:0/256123852 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1184003570 con 0x7f119806f0a0 2023-09-30T23:04:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.401+0000 7f119c999700 1 -- 172.21.15.142:0/256123852 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763168273 0 0) 0x7f11980b02d0 con 0x7f11980aebf0 2023-09-30T23:04:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.401+0000 7f119c999700 1 -- 172.21.15.142:0/256123852 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11980b0ee0 con 0x7f11980aebf0 2023-09-30T23:04:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.402+0000 7f119d19a700 1 -- 172.21.15.142:0/256123852 >> v1:172.21.15.148:6789/0 conn(0x7f11980aebf0 legacy=0x7f11980c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.402+0000 7f119d19a700 1 -- 172.21.15.142:0/256123852 >> v1:172.21.15.142:6789/0 conn(0x7f119806f0a0 legacy=0x7f1198160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.402+0000 7f119d19a700 1 -- 172.21.15.142:0/256123852 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980b05b0 con 0x7f119806ec50 2023-09-30T23:04:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.402+0000 7f119d19a700 1 --2- 172.21.15.142:0/256123852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f119806ec50 0x7f1198159b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1188009910 tx=0x7f11880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4deae77bba89d68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.402+0000 7f119c999700 1 -- 172.21.15.142:0/256123852 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011630 con 0x7f119806ec50 2023-09-30T23:04:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119c999700 1 -- 172.21.15.142:0/256123852 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188011790 con 0x7f119806ec50 2023-09-30T23:04:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119c999700 1 -- 172.21.15.142:0/256123852 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011b10 con 0x7f119806ec50 2023-09-30T23:04:34.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119fbff700 1 -- 172.21.15.142:0/256123852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f119806ec50 msgr2=0x7f1198159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119fbff700 1 --2- 172.21.15.142:0/256123852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f119806ec50 0x7f1198159b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1188009910 tx=0x7f11880091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119fbff700 1 -- 172.21.15.142:0/256123852 shutdown_connections 2023-09-30T23:04:34.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119fbff700 1 --2- 172.21.15.142:0/256123852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f119806ec50 0x7f1198159b90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119fbff700 1 -- 172.21.15.142:0/256123852 >> 172.21.15.142:0/256123852 conn(0x7f11980680c0 msgr2=0x7f11980c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:34.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119fbff700 1 -- 172.21.15.142:0/256123852 shutdown_connections 2023-09-30T23:04:34.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.403+0000 7f119fbff700 1 -- 172.21.15.142:0/256123852 wait complete. 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.406+0000 7f119fbff700 1 Processor -- start 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.406+0000 7f119fbff700 1 -- start start 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.407+0000 7f119fbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119806ec50 0x7f1198151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.407+0000 7f119fbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f119806f0a0 0x7f1198159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.407+0000 7f119fbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980aebf0 0x7f119816a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.407+0000 7f119fbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11981523f0 con 0x7f119806ec50 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.407+0000 7f119fbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11981517e0 con 0x7f119806f0a0 2023-09-30T23:04:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.407+0000 7f119fbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1198151ac0 con 0x7f11980aebf0 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119806ec50 0x7f1198151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119806ec50 0x7f1198151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57344/0 (socket says 172.21.15.142:57344) 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 -- 172.21.15.142:0/383671733 learned_addr learned my addr 172.21.15.142:0/383671733 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119e19c700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980aebf0 0x7f119816a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d19a700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f119806f0a0 0x7f1198159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 -- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980aebf0 msgr2=0x7f119816a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980aebf0 0x7f119816a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 -- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f119806f0a0 msgr2=0x7f1198159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f119806f0a0 0x7f1198159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 -- 172.21.15.142:0/383671733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188009420 con 0x7f119806ec50 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.408+0000 7f119d99b700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119806ec50 0x7f1198151200 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f119400c580 tx=0x7f1194007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.409+0000 7f118dffb700 1 -- 172.21.15.142:0/383671733 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194010510 con 0x7f119806ec50 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.409+0000 7f118dffb700 1 -- 172.21.15.142:0/383671733 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1194010670 con 0x7f119806ec50 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.409+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1198151da0 con 0x7f119806ec50 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.409+0000 7f118dffb700 1 -- 172.21.15.142:0/383671733 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194010a30 con 0x7f119806ec50 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.409+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119814f600 con 0x7f119806ec50 2023-09-30T23:04:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.410+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11980695b0 con 0x7f119806ec50 2023-09-30T23:04:34.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.412+0000 7f118dffb700 1 -- 172.21.15.142:0/383671733 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1194025430 con 0x7f119806ec50 2023-09-30T23:04:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.413+0000 7f118dffb700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.413+0000 7f118dffb700 1 -- 172.21.15.142:0/383671733 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1194085220 con 0x7f119806ec50 2023-09-30T23:04:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.414+0000 7f119d19a700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.414+0000 7f119d19a700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1188009860 tx=0x7f1188017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:34.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.416+0000 7f118dffb700 1 -- 172.21.15.142:0/383671733 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1194052100 con 0x7f119806ec50 2023-09-30T23:04:34.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.610+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f119806fc10 con 0x7f119806ec50 2023-09-30T23:04:34.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.611+0000 7f118dffb700 1 -- 172.21.15.142:0/383671733 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v195) v1 ==== 81+0+34984 (secure 0 0 0) 0x7f1194055720 con 0x7f119806ec50 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 195, 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T23:04:34.402448+0000", 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T23:04:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T23:04:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 24, 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T23:04:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 23, 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:06.673268+0000", 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T23:04:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "191", 2023-09-30T23:04:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 24, 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:08.101636+0000", 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T23:04:34.635 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "195", 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:34.636 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:34.637 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:34.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T23:04:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T23:04:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T23:04:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T23:04:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.653 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.654 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T23:04:34.656 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.658 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.659 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.660 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.661 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.662 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T23:04:34.663 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T23:04:34.666 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.667 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T23:04:34.668 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.670 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:34.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.673 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.674 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.675 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.676 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.678 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T23:04:34.679 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.680 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.681 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.683 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T23:04:34.685 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:34.687 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T23:04:34.688 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:34.691 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T23:04:34.692 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.693 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.694 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.695 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:34.698 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:34.699 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T23:04:34.700 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T23:04:34.701 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T23:04:34.702 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T23:04:34.702 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T23:04:34.702 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T23:04:34.702 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T23:04:34.702 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T23:04:34.702 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T23:04:34.702 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T23:04:34.705 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T23:04:34.705 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T23:04:34.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:34.705 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 msgr2=0x7f117c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1188009860 tx=0x7f1188017000 comp rx=0 tx=0).stop 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119806ec50 msgr2=0x7f1198151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119806ec50 0x7f1198151200 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f119400c580 tx=0x7f1194007e10 comp rx=0 tx=0).stop 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 shutdown_connections 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f117c067330 0x7f117c0697e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11980aebf0 0x7f119816a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f119806ec50 0x7f1198151200 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 --2- 172.21.15.142:0/383671733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f119806f0a0 0x7f1198159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 >> 172.21.15.142:0/383671733 conn(0x7f11980680c0 msgr2=0x7f11980ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:34.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 shutdown_connections 2023-09-30T23:04:34.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.614+0000 7f119fbff700 1 -- 172.21.15.142:0/383671733 wait complete. 2023-09-30T23:04:34.708 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-30T23:04:34.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-30T23:04:34.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.899+0000 7f9372fff700 1 Processor -- start 2023-09-30T23:04:34.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.899+0000 7f9372fff700 1 -- start start 2023-09-30T23:04:34.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.900+0000 7f9372fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f936c0692f0 0x7f936c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.900+0000 7f9372fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.900+0000 7f9372fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c0cc6b0 con 0x7f936c143350 2023-09-30T23:04:34.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.900+0000 7f9372fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c15e090 con 0x7f936c0692f0 2023-09-30T23:04:34.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.900+0000 7f9372fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0cbaa0 con 0x7f936c15dc50 2023-09-30T23:04:34.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f936bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f936c0692f0 0x7f936c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f937159c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f937159c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c06a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:35466/0 (socket says 172.21.15.142:35466) 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f936bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f936c0692f0 0x7f936c15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:39744/0 (socket says 172.21.15.142:39744) 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f937159c700 1 -- 172.21.15.142:0/1868419981 learned_addr learned my addr 172.21.15.142:0/1868419981 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f936bfff700 1 -- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 msgr2=0x7f936c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f936bfff700 1 --2- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f936bfff700 1 -- 172.21.15.142:0/1868419981 >> v1:172.21.15.148:6789/0 conn(0x7f936c143350 legacy=0x7f936c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f936bfff700 1 -- 172.21.15.142:0/1868419981 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0cbd80 con 0x7f936c0692f0 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.901+0000 7f937159c700 1 --2- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.902+0000 7f936bfff700 1 --2- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c0692f0 0x7f936c15d710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f93580098e0 tx=0x7f93580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0ef90af1c55d08 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.902+0000 7f936b7fe700 1 -- 172.21.15.142:0/1868419981 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800b640 con 0x7f936c0692f0 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.902+0000 7f936b7fe700 1 -- 172.21.15.142:0/1868419981 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935800b7a0 con 0x7f936c0692f0 2023-09-30T23:04:34.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.902+0000 7f936b7fe700 1 -- 172.21.15.142:0/1868419981 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800bb40 con 0x7f936c0692f0 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.902+0000 7f9372fff700 1 -- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c0692f0 msgr2=0x7f936c15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.902+0000 7f9372fff700 1 --2- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c0692f0 0x7f936c15d710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f93580098e0 tx=0x7f93580091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.903+0000 7f9372fff700 1 -- 172.21.15.142:0/1868419981 shutdown_connections 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.903+0000 7f9372fff700 1 --2- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.903+0000 7f9372fff700 1 --2- 172.21.15.142:0/1868419981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c0692f0 0x7f936c15d710 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.903+0000 7f9372fff700 1 -- 172.21.15.142:0/1868419981 >> 172.21.15.142:0/1868419981 conn(0x7f936c0ce8e0 msgr2=0x7f936c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.903+0000 7f9372fff700 1 -- 172.21.15.142:0/1868419981 shutdown_connections 2023-09-30T23:04:34.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.903+0000 7f9372fff700 1 -- 172.21.15.142:0/1868419981 wait complete. 2023-09-30T23:04:34.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.904+0000 7f9372fff700 1 Processor -- start 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.904+0000 7f9372fff700 1 -- start start 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9372fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f936c0692f0 0x7f936c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9372fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c143350 0x7f936c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9372fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9372fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c12d980 con 0x7f936c0692f0 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9372fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c12dc60 con 0x7f936c143350 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9372fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c12df40 con 0x7f936c15dc50 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9370d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f936c0692f0 0x7f936c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9370d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f936c0692f0 0x7f936c0b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57356/0 (socket says 172.21.15.142:57356) 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.905+0000 7f9370d9b700 1 -- 172.21.15.142:0/3017349878 learned_addr learned my addr 172.21.15.142:0/3017349878 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:34.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f937159c700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f936bfff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c143350 0x7f936c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9370d9b700 1 -- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 msgr2=0x7f936c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9370d9b700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9370d9b700 1 -- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c143350 msgr2=0x7f936c0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9370d9b700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c143350 0x7f936c0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9370d9b700 1 -- 172.21.15.142:0/3017349878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364009ae0 con 0x7f936c0692f0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9370d9b700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f936c0692f0 0x7f936c0b0d00 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f936000c590 tx=0x7f936000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9368ff9700 1 -- 172.21.15.142:0/3017349878 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360011590 con 0x7f936c0692f0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9368ff9700 1 -- 172.21.15.142:0/3017349878 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360011710 con 0x7f936c0692f0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9358009420 con 0x7f936c0692f0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.906+0000 7f9368ff9700 1 -- 172.21.15.142:0/3017349878 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360011ad0 con 0x7f936c0692f0 2023-09-30T23:04:34.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.907+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c12e500 con 0x7f936c0692f0 2023-09-30T23:04:34.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.907+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c06ea70 con 0x7f936c0692f0 2023-09-30T23:04:34.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.908+0000 7f9368ff9700 1 -- 172.21.15.142:0/3017349878 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f936001b3b0 con 0x7f936c0692f0 2023-09-30T23:04:34.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.909+0000 7f9368ff9700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9350067330 0x7f93500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:34.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.909+0000 7f9368ff9700 1 -- 172.21.15.142:0/3017349878 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f93600840c0 con 0x7f936c0692f0 2023-09-30T23:04:34.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.909+0000 7f936bfff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9350067330 0x7f93500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:34.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.910+0000 7f936bfff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9350067330 0x7f93500697e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f93580093f0 tx=0x7f9358017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:34.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:34.913+0000 7f9368ff9700 1 -- 172.21.15.142:0/3017349878 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9360050f20 con 0x7f936c0692f0 2023-09-30T23:04:35.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.105+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f936c0cc060 con 0x7f936c0692f0 2023-09-30T23:04:35.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.106+0000 7f9368ff9700 1 -- 172.21.15.142:0/3017349878 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v195) v1 ==== 81+0+34984 (secure 0 0 0) 0x7f9360017090 con 0x7f936c0692f0 2023-09-30T23:04:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:35.106 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 195, 2023-09-30T23:04:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", 2023-09-30T23:04:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2023-09-30T22:52:09.454789+0000", 2023-09-30T23:04:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2023-09-30T23:04:34.402448+0000", 2023-09-30T23:04:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2023-09-30T22:52:15.884868+0000", 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2023-09-30T22:52:12.869187+0000", 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 4, 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.69999998807907104, 2023-09-30T23:04:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 24, 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "luminous", 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "quincy", 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": ".mgr", 2023-09-30T23:04:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:16.153348+0000", 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 1, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 1, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 1, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 1, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 1, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_max": 32, 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 1 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": {} 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 2, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "rbd", 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T22:52:22.038262+0000", 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 8, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 8, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 8, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 8, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 8, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "118", 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:35.118 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:35.119 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd": {} 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 23, 2023-09-30T23:04:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_metadata", 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:06.673268+0000", 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:35.121 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 32, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 32, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 32, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 32, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 32, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "191", 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_bias": 4, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 16, 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_priority": 5 2023-09-30T23:04:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": "cephfs" 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 24, 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "cephfs_data", 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2023-09-30T23:04:08.101636+0000", 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-30T23:04:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool", 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 1, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 2, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 1, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 0, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_count": 0, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_target": 0, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T23:04:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 64, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 64, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 64, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 64, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 64, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2023-09-30T23:04:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "195", 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 0, 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 0, 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2023-09-30T23:04:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 33554432, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T23:04:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "", 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2023-09-30T23:04:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 0, 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "options": { 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_min": 64, 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "cephfs": { 2023-09-30T23:04:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "data": "cephfs" 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2023-09-30T23:04:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109694 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6809/109694", 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6811/109694", 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6819/109694", 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/109694", 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109693 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6801/109693", 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6803/109693", 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6807/109693", 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6805/109693", 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109702 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6823/109702", 2023-09-30T23:04:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6827/109702", 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6831/109702", 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6829/109702", 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109696 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6814/109696", 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6818/109696", 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6826/109696", 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6822/109696", 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6800", 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6801", 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6802", 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6803", 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6806", 2023-09-30T23:04:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6807", 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6804", 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6805", 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109934 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6801/109934", 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6803/109934", 2023-09-30T23:04:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6807/109934", 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6805/109934", 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6808", 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6809", 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6810", 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6811", 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6814", 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6817", 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6812", 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6813", 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109935 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6809/109935", 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6811/109935", 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6817/109935", 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6813/109935", 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6815", 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6816", 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6818", 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6819", 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6822", 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6823", 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6820", 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6821", 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109936 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6816/109936", 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6819/109936", 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6823/109936", 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6821/109936", 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2023-09-30T23:04:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 190, 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6824", 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6825", 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6826", 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6827", 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6830", 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6831", 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6828", 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.148:6829", 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 109961 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.148:6825/109961", 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.148:6827/109961", 2023-09-30T23:04:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.148:6831/109961", 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.148:6829/109961", 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.101471+0000", 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.153799+0000", 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.166580+0000", 2023-09-30T23:04:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.171976+0000", 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.124458+0000", 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.179023+0000", 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.116494+0000", 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138320759226367, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2023-09-30T23:04:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2023-09-30T22:52:14.195003+0000", 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklist": {}, 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "range_blocklist": {}, 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2023-09-30T23:04:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {}, 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode": { 2023-09-30T23:04:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_enabled": false, 2023-09-30T23:04:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_bucket_count": 0, 2023-09-30T23:04:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "degraded_stretch_mode": 0, 2023-09-30T23:04:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "recovering_stretch_mode": 0, 2023-09-30T23:04:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "stretch_mode_bucket": 0 2023-09-30T23:04:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-30T23:04:35.194 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:35.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9350067330 msgr2=0x7f93500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9350067330 0x7f93500697e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f93580093f0 tx=0x7f9358017000 comp rx=0 tx=0).stop 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f936c0692f0 msgr2=0x7f936c0b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f936c0692f0 0x7f936c0b0d00 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f936000c590 tx=0x7f936000c8a0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 shutdown_connections 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9350067330 0x7f93500697e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f936c15dc50 0x7f936c0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f936c0692f0 0x7f936c0b0d00 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 --2- 172.21.15.142:0/3017349878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f936c143350 0x7f936c0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.108+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 >> 172.21.15.142:0/3017349878 conn(0x7f936c0ce8e0 msgr2=0x7f936c0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.109+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 shutdown_connections 2023-09-30T23:04:35.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.109+0000 7f9372fff700 1 -- 172.21.15.142:0/3017349878 wait complete. 2023-09-30T23:04:35.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:35.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.387+0000 7fa5cd1ff700 1 Processor -- start 2023-09-30T23:04:35.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.388+0000 7fa5cd1ff700 1 -- start start 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5cd1ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5c806b3d0 0x7fa5c80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5cd1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5c80b1f40 0x7fa5c806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5cd1ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c806d470 con 0x7fa5c8157a90 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5cd1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c8157e60 con 0x7fa5c80b1f40 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5cd1ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c80b2380 con 0x7fa5c806b3d0 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5c759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5c80b1f40 0x7fa5c806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5c759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5c80b1f40 0x7fa5c806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57372/0 (socket says 172.21.15.142:57372) 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5c759e700 1 -- 172.21.15.142:0/2152479949 learned_addr learned my addr 172.21.15.142:0/2152479949 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:35.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.389+0000 7fa5c659c700 1 --2- 172.21.15.142:0/2152479949 >> v2:172.21.15.148:3300/0 conn(0x7fa5c806b3d0 0x7fa5c80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c759e700 1 -- 172.21.15.142:0/2152479949 >> v2:172.21.15.148:3300/0 conn(0x7fa5c806b3d0 msgr2=0x7fa5c80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c759e700 1 --2- 172.21.15.142:0/2152479949 >> v2:172.21.15.148:3300/0 conn(0x7fa5c806b3d0 0x7fa5c80b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c759e700 1 -- 172.21.15.142:0/2152479949 >> v1:172.21.15.148:6789/0 conn(0x7fa5c8157a90 legacy=0x7fa5c815bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c759e700 1 -- 172.21.15.142:0/2152479949 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80ae880 con 0x7fa5c80b1f40 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c759e700 1 --2- 172.21.15.142:0/2152479949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c80b1f40 0x7fa5c806d900 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806bac0 tx=0x7fa5c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521bb4d0698a5097 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c5d9b700 1 -- 172.21.15.142:0/2152479949 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000e070 con 0x7fa5c80b1f40 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c5d9b700 1 -- 172.21.15.142:0/2152479949 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c000ba20 con 0x7fa5c80b1f40 2023-09-30T23:04:35.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.390+0000 7fa5c5d9b700 1 -- 172.21.15.142:0/2152479949 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00092e0 con 0x7fa5c80b1f40 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/2152479949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c80b1f40 msgr2=0x7fa5c806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/2152479949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c80b1f40 0x7fa5c806d900 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806bac0 tx=0x7fa5c0009840 comp rx=0 tx=0).stop 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/2152479949 shutdown_connections 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/2152479949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c80b1f40 0x7fa5c806d900 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/2152479949 >> v2:172.21.15.148:3300/0 conn(0x7fa5c806b3d0 0x7fa5c80b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/2152479949 >> 172.21.15.142:0/2152479949 conn(0x7fa5c80680c0 msgr2=0x7fa5c80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/2152479949 shutdown_connections 2023-09-30T23:04:35.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.391+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/2152479949 wait complete. 2023-09-30T23:04:35.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.393+0000 7fa5cd1ff700 1 Processor -- start 2023-09-30T23:04:35.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.393+0000 7fa5cd1ff700 1 -- start start 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5cd1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c806b3d0 0x7fa5c8150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5cd1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5c80b1f40 0x7fa5c815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5cd1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5c8157a90 0x7fa5c815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5cd1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80c2cf0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5cd1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8157330 con 0x7fa5c80b1f40 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5cd1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8169030 con 0x7fa5c8157a90 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c806b3d0 0x7fa5c8150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c806b3d0 0x7fa5c8150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57382/0 (socket says 172.21.15.142:57382) 2023-09-30T23:04:35.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 -- 172.21.15.142:0/4183904655 learned_addr learned my addr 172.21.15.142:0/4183904655 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c659c700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5c80b1f40 0x7fa5c815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c759e700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5c8157a90 0x7fa5c815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 -- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5c8157a90 msgr2=0x7fa5c815ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5c8157a90 0x7fa5c815ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 -- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5c80b1f40 msgr2=0x7fa5c815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5c80b1f40 0x7fa5c815a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c6d9d700 1 -- 172.21.15.142:0/4183904655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009ae0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.394+0000 7fa5c659c700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5c80b1f40 0x7fa5c815a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.395+0000 7fa5c6d9d700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c806b3d0 0x7fa5c8150650 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c4e0 tx=0x7fa5b800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.395+0000 7fa5aeffd700 1 -- 172.21.15.142:0/4183904655 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8011590 con 0x7fa5c806b3d0 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.395+0000 7fa5aeffd700 1 -- 172.21.15.142:0/4183904655 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8011710 con 0x7fa5c806b3d0 2023-09-30T23:04:35.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.395+0000 7fa5aeffd700 1 -- 172.21.15.142:0/4183904655 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8011ad0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.395+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c8168270 con 0x7fa5c806b3d0 2023-09-30T23:04:35.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.395+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c8168830 con 0x7fa5c806b3d0 2023-09-30T23:04:35.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.396+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c80695b0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.397+0000 7fa5aeffd700 1 -- 172.21.15.142:0/4183904655 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa5b801b3b0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.398+0000 7fa5aeffd700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa5b4067330 0x7fa5b40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:35.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.398+0000 7fa5aeffd700 1 -- 172.21.15.142:0/4183904655 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5b80840d0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.398+0000 7fa5c659c700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa5b4067330 0x7fa5b40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:35.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.399+0000 7fa5c659c700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa5b4067330 0x7fa5b40697e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006f00 tx=0x7fa5bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:35.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.402+0000 7fa5aeffd700 1 -- 172.21.15.142:0/4183904655 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa5b8050fd0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.637+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5c806ef50 con 0x7fa5c806b3d0 2023-09-30T23:04:35.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.637+0000 7fa5aeffd700 1 -- 172.21.15.142:0/4183904655 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fa5b80545f0 con 0x7fa5c806b3d0 2023-09-30T23:04:35.646 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:35.647 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:35.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa5b4067330 msgr2=0x7fa5b40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa5b4067330 0x7fa5b40697e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006f00 tx=0x7fa5bc008040 comp rx=0 tx=0).stop 2023-09-30T23:04:35.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c806b3d0 msgr2=0x7fa5c8150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:35.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c806b3d0 0x7fa5c8150650 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c4e0 tx=0x7fa5b800c8a0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 shutdown_connections 2023-09-30T23:04:35.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa5b4067330 0x7fa5b40697e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5c8157a90 0x7fa5c815ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c806b3d0 0x7fa5c8150650 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 --2- 172.21.15.142:0/4183904655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5c80b1f40 0x7fa5c815a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:35.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 >> 172.21.15.142:0/4183904655 conn(0x7fa5c80680c0 msgr2=0x7fa5c80cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:35.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 shutdown_connections 2023-09-30T23:04:35.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:35.640+0000 7fa5cd1ff700 1 -- 172.21.15.142:0/4183904655 wait complete. 2023-09-30T23:04:35.652 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:35.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-30T23:04:35.880 INFO:teuthology.orchestra.run.smithi148.stdout:{"cluster_fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","whoami":0,"id":8355,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.229318511999999,"mdsmap_epoch":91,"osdmap_epoch":195,"osdmap_epoch_barrier":194,"uptime":32.932942417} 2023-09-30T23:04:35.880 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "45159191-1b2c-47ed-b172-96c0a1a05709", "fs_name": "cephfs", "id": 8355, "mdsmap_epoch": 91, "osdmap_epoch": 195, "osdmap_epoch_barrier": 194, "rank_uptime": 26.229318512, "state": "up:active", "uptime": 32.932942417, "want_state": "up:active", "whoami": 0 } 2023-09-30T23:04:35.880 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-30T23:04:35.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:35.881 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-30T23:04:36.393 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records in 2023-09-30T23:04:36.394 INFO:teuthology.orchestra.run.smithi142.stderr:50+0 records out 2023-09-30T23:04:36.394 INFO:teuthology.orchestra.run.smithi142.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.463678 s, 113 MB/s 2023-09-30T23:04:36.395 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T23:04:36.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:04:36.500 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T23:04:36.602 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T23:04:36.603 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T23:04:36.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:36.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T23:04:36.730 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:04:36.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:36.731 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T23:04:36.780 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-30T23:04:36.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-09-30T23:04:36.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-30T23:04:36.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:04:36.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:36.874 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T23:04:36.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:37.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.112+0000 7f11365ff700 1 Processor -- start 2023-09-30T23:04:37.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.112+0000 7f11365ff700 1 -- start start 2023-09-30T23:04:37.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.113+0000 7f11365ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11300aebf0 0x7f113006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.113+0000 7f11365ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11300b0ee0 con 0x7f113006f190 2023-09-30T23:04:37.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.113+0000 7f11365ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11300b02d0 con 0x7f113015a2a0 2023-09-30T23:04:37.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.113+0000 7f11365ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11300aefc0 con 0x7f11300aebf0 2023-09-30T23:04:37.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11300aebf0 0x7f113006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11300aebf0 0x7f113006ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57394/0 (socket says 172.21.15.142:57394) 2023-09-30T23:04:37.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112ffff700 1 -- 172.21.15.142:0/2289099404 learned_addr learned my addr 172.21.15.142:0/2289099404 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:37.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112f7fe700 1 --1- 172.21.15.142:0/2289099404 >> v1:172.21.15.142:6789/0 conn(0x7f113006f190 0x7f1130159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40104/0 (socket says 172.21.15.142:40104) 2023-09-30T23:04:37.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112ffff700 1 -- 172.21.15.142:0/2289099404 >> v1:172.21.15.148:6789/0 conn(0x7f113015a2a0 legacy=0x7f1130069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112ffff700 1 -- 172.21.15.142:0/2289099404 >> v1:172.21.15.142:6789/0 conn(0x7f113006f190 legacy=0x7f1130159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112ffff700 1 -- 172.21.15.142:0/2289099404 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300b05b0 con 0x7f11300aebf0 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112effd700 1 -- 172.21.15.142:0/2289099404 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905424421 0 0) 0x7f11300b0ee0 con 0x7f113006f190 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.114+0000 7f112ffff700 1 --2- 172.21.15.142:0/2289099404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11300aebf0 0x7f113006ec50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f11200099b0 tx=0x7f1120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939cb8685dad2aaa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f112effd700 1 -- 172.21.15.142:0/2289099404 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000b860 con 0x7f11300aebf0 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f112effd700 1 -- 172.21.15.142:0/2289099404 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112000b9c0 con 0x7f11300aebf0 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f112effd700 1 -- 172.21.15.142:0/2289099404 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000bd60 con 0x7f11300aebf0 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f11365ff700 1 -- 172.21.15.142:0/2289099404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11300aebf0 msgr2=0x7f113006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f11365ff700 1 --2- 172.21.15.142:0/2289099404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11300aebf0 0x7f113006ec50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f11200099b0 tx=0x7f1120009250 comp rx=0 tx=0).stop 2023-09-30T23:04:37.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f11365ff700 1 -- 172.21.15.142:0/2289099404 shutdown_connections 2023-09-30T23:04:37.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f11365ff700 1 --2- 172.21.15.142:0/2289099404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11300aebf0 0x7f113006ec50 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f11365ff700 1 -- 172.21.15.142:0/2289099404 >> 172.21.15.142:0/2289099404 conn(0x7f11300680c0 msgr2=0x7f11300c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:37.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f11365ff700 1 -- 172.21.15.142:0/2289099404 shutdown_connections 2023-09-30T23:04:37.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.115+0000 7f11365ff700 1 -- 172.21.15.142:0/2289099404 wait complete. 2023-09-30T23:04:37.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.117+0000 7f11365ff700 1 Processor -- start 2023-09-30T23:04:37.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.117+0000 7f11365ff700 1 -- start start 2023-09-30T23:04:37.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f11365ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f113006f190 0x7f113014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f11365ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11300aebf0 0x7f1130151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f11365ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f113015a2a0 0x7f1130144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f11365ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1130152300 con 0x7f113006f190 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f11365ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1130153100 con 0x7f11300aebf0 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f11365ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11301524f0 con 0x7f113015a2a0 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f112ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f113006f190 0x7f113014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f112ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f113006f190 0x7f113014e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57410/0 (socket says 172.21.15.142:57410) 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f112ffff700 1 -- 172.21.15.142:0/921404844 learned_addr learned my addr 172.21.15.142:0/921404844 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f112f7fe700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11300aebf0 0x7f1130151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f1134b9c700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f113015a2a0 0x7f1130144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f112ffff700 1 -- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f113015a2a0 msgr2=0x7f1130144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.118+0000 7f112ffff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f113015a2a0 0x7f1130144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f112ffff700 1 -- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11300aebf0 msgr2=0x7f1130151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f112ffff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11300aebf0 0x7f1130151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f112ffff700 1 -- 172.21.15.142:0/921404844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200094f0 con 0x7f113006f190 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f112f7fe700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11300aebf0 0x7f1130151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f112ffff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f113006f190 0x7f113014e6a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f11200094c0 tx=0x7f1120017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f1117fff700 1 -- 172.21.15.142:0/921404844 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112001f070 con 0x7f113006f190 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f1117fff700 1 -- 172.21.15.142:0/921404844 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120011c40 con 0x7f113006f190 2023-09-30T23:04:37.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f1117fff700 1 -- 172.21.15.142:0/921404844 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120025420 con 0x7f113006f190 2023-09-30T23:04:37.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11301527d0 con 0x7f113006f190 2023-09-30T23:04:37.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.119+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1130152d90 con 0x7f113006f190 2023-09-30T23:04:37.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.120+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11301533e0 con 0x7f113006f190 2023-09-30T23:04:37.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.121+0000 7f1117fff700 1 -- 172.21.15.142:0/921404844 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1120023070 con 0x7f113006f190 2023-09-30T23:04:37.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.122+0000 7f1117fff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f111c067330 0x7f111c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.122+0000 7f1117fff700 1 -- 172.21.15.142:0/921404844 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1120085d90 con 0x7f113006f190 2023-09-30T23:04:37.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.122+0000 7f112f7fe700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f111c067330 0x7f111c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.123+0000 7f112f7fe700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f111c067330 0x7f111c0697e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1124007fd0 tx=0x7f1124007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.126+0000 7f1117fff700 1 -- 172.21.15.142:0/921404844 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1120052d20 con 0x7f113006f190 2023-09-30T23:04:37.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.359+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f113006fc10 con 0x7f113006f190 2023-09-30T23:04:37.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.359+0000 7f1117fff700 1 -- 172.21.15.142:0/921404844 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f112002a090 con 0x7f113006f190 2023-09-30T23:04:37.359 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:37.359 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:37.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f111c067330 msgr2=0x7f111c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f111c067330 0x7f111c0697e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1124007fd0 tx=0x7f1124007e50 comp rx=0 tx=0).stop 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f113006f190 msgr2=0x7f113014e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f113006f190 0x7f113014e6a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f11200094c0 tx=0x7f1120017000 comp rx=0 tx=0).stop 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 shutdown_connections 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f111c067330 0x7f111c0697e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f113015a2a0 0x7f1130144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f113006f190 0x7f113014e6a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 --2- 172.21.15.142:0/921404844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11300aebf0 0x7f1130151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 >> 172.21.15.142:0/921404844 conn(0x7f11300680c0 msgr2=0x7f1130155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:37.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 shutdown_connections 2023-09-30T23:04:37.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.362+0000 7f11365ff700 1 -- 172.21.15.142:0/921404844 wait complete. 2023-09-30T23:04:37.363 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:37.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:37.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.571+0000 7f58805ff700 1 Processor -- start 2023-09-30T23:04:37.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.571+0000 7f58805ff700 1 -- start start 2023-09-30T23:04:37.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.572+0000 7f58805ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5878159ae0 0x7f58780cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.572+0000 7f58805ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f5878069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.572+0000 7f58805ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587815d910 con 0x7f58780b1180 2023-09-30T23:04:37.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.572+0000 7f58805ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587815e920 con 0x7f5878159ae0 2023-09-30T23:04:37.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.572+0000 7f58805ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587815e490 con 0x7f58780cc590 2023-09-30T23:04:37.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587db9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f58780b1180 0x7f58780cbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40114/0 (socket says 172.21.15.142:40114) 2023-09-30T23:04:37.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587db9a700 1 -- 172.21.15.142:0/146974245 learned_addr learned my addr 172.21.15.142:0/146974245 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:37.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587e39b700 1 --2- 172.21.15.142:0/146974245 >> v2:172.21.15.148:3300/0 conn(0x7f5878159ae0 0x7f58780cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587eb9c700 1 --2- 172.21.15.142:0/146974245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f5878069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587d399700 1 -- 172.21.15.142:0/146974245 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115647377 0 0) 0x7f587815d910 con 0x7f58780b1180 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587d399700 1 -- 172.21.15.142:0/146974245 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5864003570 con 0x7f58780b1180 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587eb9c700 1 -- 172.21.15.142:0/146974245 >> v2:172.21.15.148:3300/0 conn(0x7f5878159ae0 msgr2=0x7f58780cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587eb9c700 1 --2- 172.21.15.142:0/146974245 >> v2:172.21.15.148:3300/0 conn(0x7f5878159ae0 0x7f58780cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587eb9c700 1 -- 172.21.15.142:0/146974245 >> v1:172.21.15.142:6789/0 conn(0x7f58780b1180 legacy=0x7f58780cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587eb9c700 1 -- 172.21.15.142:0/146974245 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587815db60 con 0x7f58780cc590 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.573+0000 7f587e39b700 1 --2- 172.21.15.142:0/146974245 >> v2:172.21.15.148:3300/0 conn(0x7f5878159ae0 0x7f58780cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f587eb9c700 1 --2- 172.21.15.142:0/146974245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f5878069f10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5870009e60 tx=0x7f5870009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac5660f68498e8b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f587d399700 1 -- 172.21.15.142:0/146974245 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000e070 con 0x7f58780cc590 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f587d399700 1 -- 172.21.15.142:0/146974245 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587000bab0 con 0x7f58780cc590 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f587d399700 1 -- 172.21.15.142:0/146974245 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000be70 con 0x7f58780cc590 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f58805ff700 1 -- 172.21.15.142:0/146974245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 msgr2=0x7f5878069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f58805ff700 1 --2- 172.21.15.142:0/146974245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f5878069f10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5870009e60 tx=0x7f5870009780 comp rx=0 tx=0).stop 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f58805ff700 1 -- 172.21.15.142:0/146974245 shutdown_connections 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f58805ff700 1 --2- 172.21.15.142:0/146974245 >> v2:172.21.15.148:3300/0 conn(0x7f5878159ae0 0x7f58780cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f58805ff700 1 --2- 172.21.15.142:0/146974245 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f5878069f10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.574+0000 7f58805ff700 1 -- 172.21.15.142:0/146974245 >> 172.21.15.142:0/146974245 conn(0x7f58780ce8b0 msgr2=0x7f58780cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.575+0000 7f58805ff700 1 -- 172.21.15.142:0/146974245 shutdown_connections 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.575+0000 7f58805ff700 1 -- 172.21.15.142:0/146974245 wait complete. 2023-09-30T23:04:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.576+0000 7f58805ff700 1 Processor -- start 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.576+0000 7f58805ff700 1 -- start start 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f58805ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58780b1180 0x7f58781483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f58805ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f587816d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f58805ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5878159ae0 0x7f587815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f58805ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878148920 con 0x7f58780b1180 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f58805ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58780c7f10 con 0x7f5878159ae0 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f58805ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58780c7c10 con 0x7f58780cc590 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f587e39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58780b1180 0x7f58781483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f587e39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58780b1180 0x7f58781483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57416/0 (socket says 172.21.15.142:57416) 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.577+0000 7f587e39b700 1 -- 172.21.15.142:0/459485962 learned_addr learned my addr 172.21.15.142:0/459485962 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587db9a700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f587816d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587e39b700 1 -- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 msgr2=0x7f587816d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587eb9c700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5878159ae0 0x7f587815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587e39b700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f587816d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587e39b700 1 -- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5878159ae0 msgr2=0x7f587815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587e39b700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5878159ae0 0x7f587815ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587e39b700 1 -- 172.21.15.142:0/459485962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009420 con 0x7f58780b1180 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587db9a700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f587816d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587eb9c700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5878159ae0 0x7f587815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f587e39b700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58780b1180 0x7f58781483e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f587400ecb0 tx=0x7f58740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f586e7fc700 1 -- 172.21.15.142:0/459485962 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400c9d0 con 0x7f58780b1180 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f586e7fc700 1 -- 172.21.15.142:0/459485962 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400cb30 con 0x7f58780b1180 2023-09-30T23:04:37.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f586e7fc700 1 -- 172.21.15.142:0/459485962 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400ceb0 con 0x7f58780b1180 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870009a20 con 0x7f58780b1180 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.578+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587816e1b0 con 0x7f58780b1180 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.579+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587806ea70 con 0x7f58780b1180 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.580+0000 7f586e7fc700 1 -- 172.21.15.142:0/459485962 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5874013680 con 0x7f58780b1180 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.581+0000 7f586e7fc700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f585c067330 0x7f585c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.581+0000 7f586e7fc700 1 -- 172.21.15.142:0/459485962 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5874084fc0 con 0x7f58780b1180 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.581+0000 7f587db9a700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f585c067330 0x7f585c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.582+0000 7f587db9a700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f585c067330 0x7f585c0697e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5868007fd0 tx=0x7f5868009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.585+0000 7f586e7fc700 1 -- 172.21.15.142:0/459485962 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f58740558b0 con 0x7f58780b1180 2023-09-30T23:04:37.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.776+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f587815de40 con 0x7f58780b1180 2023-09-30T23:04:37.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.777+0000 7f586e7fc700 1 -- 172.21.15.142:0/459485962 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+17033 (secure 0 0 0) 0x7f5874017090 con 0x7f58780b1180 2023-09-30T23:04:37.777 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:37.777 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":195,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:34.402448+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:04:06.673268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-09-30T23:04:08.101636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:37.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f585c067330 msgr2=0x7f585c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f585c067330 0x7f585c0697e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5868007fd0 tx=0x7f5868009040 comp rx=0 tx=0).stop 2023-09-30T23:04:37.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58780b1180 msgr2=0x7f58781483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58780b1180 0x7f58781483e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f587400ecb0 tx=0x7f58740091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 shutdown_connections 2023-09-30T23:04:37.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f585c067330 0x7f585c0697e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5878159ae0 0x7f587815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58780b1180 0x7f58781483e0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 --2- 172.21.15.142:0/459485962 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58780cc590 0x7f587816d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 >> 172.21.15.142:0/459485962 conn(0x7f58780ce8b0 msgr2=0x7f587815fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:37.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 shutdown_connections 2023-09-30T23:04:37.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.780+0000 7f58805ff700 1 -- 172.21.15.142:0/459485962 wait complete. 2023-09-30T23:04:37.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:52:16.153348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:52:22.038262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T23:04:06.673268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T23:04:08.101636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T23:04:37.797 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T23:04:37.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.989+0000 7fcc897ff700 1 Processor -- start 2023-09-30T23:04:37.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.989+0000 7fcc897ff700 1 -- start start 2023-09-30T23:04:37.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc897ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcc84159b40 0x7fcc8406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc897ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcc84067620 0x7fcc84067a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc897ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8406b650 con 0x7fcc84159f10 2023-09-30T23:04:37.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc897ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc84067f80 con 0x7fcc84067620 2023-09-30T23:04:37.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc897ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8406aa40 con 0x7fcc84159b40 2023-09-30T23:04:37.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc837fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcc84067620 0x7fcc84067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc837fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcc84067620 0x7fcc84067a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57428/0 (socket says 172.21.15.142:57428) 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.990+0000 7fcc837fe700 1 -- 172.21.15.142:0/2600695116 learned_addr learned my addr 172.21.15.142:0/2600695116 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc82ffd700 1 --2- 172.21.15.142:0/2600695116 >> v2:172.21.15.148:3300/0 conn(0x7fcc84159b40 0x7fcc8406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc837fe700 1 -- 172.21.15.142:0/2600695116 >> v2:172.21.15.148:3300/0 conn(0x7fcc84159b40 msgr2=0x7fcc8406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc837fe700 1 --2- 172.21.15.142:0/2600695116 >> v2:172.21.15.148:3300/0 conn(0x7fcc84159b40 0x7fcc8406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc837fe700 1 -- 172.21.15.142:0/2600695116 >> v1:172.21.15.148:6789/0 conn(0x7fcc84159f10 legacy=0x7fcc840683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc837fe700 1 -- 172.21.15.142:0/2600695116 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8406ad20 con 0x7fcc84067620 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc82ffd700 1 --2- 172.21.15.142:0/2600695116 >> v2:172.21.15.148:3300/0 conn(0x7fcc84159b40 0x7fcc8406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc837fe700 1 --2- 172.21.15.142:0/2600695116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84067620 0x7fcc84067a40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fcc8406f650 tx=0x7fcc7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f1e1634a42d070 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc81ffb700 1 -- 172.21.15.142:0/2600695116 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00e070 con 0x7fcc84067620 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc81ffb700 1 -- 172.21.15.142:0/2600695116 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c00ba10 con 0x7fcc84067620 2023-09-30T23:04:37.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.991+0000 7fcc81ffb700 1 -- 172.21.15.142:0/2600695116 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0092e0 con 0x7fcc84067620 2023-09-30T23:04:37.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 -- 172.21.15.142:0/2600695116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84067620 msgr2=0x7fcc84067a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 --2- 172.21.15.142:0/2600695116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84067620 0x7fcc84067a40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fcc8406f650 tx=0x7fcc7c009840 comp rx=0 tx=0).stop 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 -- 172.21.15.142:0/2600695116 shutdown_connections 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 --2- 172.21.15.142:0/2600695116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84067620 0x7fcc84067a40 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 --2- 172.21.15.142:0/2600695116 >> v2:172.21.15.148:3300/0 conn(0x7fcc84159b40 0x7fcc8406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 -- 172.21.15.142:0/2600695116 >> 172.21.15.142:0/2600695116 conn(0x7fcc840c9950 msgr2=0x7fcc840c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 -- 172.21.15.142:0/2600695116 shutdown_connections 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.992+0000 7fcc897ff700 1 -- 172.21.15.142:0/2600695116 wait complete. 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.994+0000 7fcc897ff700 1 Processor -- start 2023-09-30T23:04:37.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.994+0000 7fcc897ff700 1 -- start start 2023-09-30T23:04:37.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc897ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc84067620 0x7fcc84150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc897ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc84159b40 0x7fcc8415c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc897ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84159f10 0x7fcc841587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc897ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840afd20 con 0x7fcc84159f10 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc897ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840b0b40 con 0x7fcc84067620 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc897ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840aff30 con 0x7fcc84159b40 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84159f10 0x7fcc841587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84159f10 0x7fcc841587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57436/0 (socket says 172.21.15.142:57436) 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 -- 172.21.15.142:0/1598953562 learned_addr learned my addr 172.21.15.142:0/1598953562 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc82ffd700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc84067620 0x7fcc84150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc827fc700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc84159b40 0x7fcc8415c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 -- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc84159b40 msgr2=0x7fcc8415c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc84159b40 0x7fcc8415c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 -- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc84067620 msgr2=0x7fcc84150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc84067620 0x7fcc84150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc837fe700 1 -- 172.21.15.142:0/1598953562 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c009ae0 con 0x7fcc84159f10 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc827fc700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc84159b40 0x7fcc8415c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.995+0000 7fcc82ffd700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc84067620 0x7fcc84150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.996+0000 7fcc837fe700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84159f10 0x7fcc841587f0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcc84063b20 tx=0x7fcc7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.996+0000 7fcc6affd700 1 -- 172.21.15.142:0/1598953562 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0032f0 con 0x7fcc84159f10 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.996+0000 7fcc6affd700 1 -- 172.21.15.142:0/1598953562 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c012e60 con 0x7fcc84159f10 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.996+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc840b0210 con 0x7fcc84159f10 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.996+0000 7fcc6affd700 1 -- 172.21.15.142:0/1598953562 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c01d670 con 0x7fcc84159f10 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.996+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc840b07d0 con 0x7fcc84159f10 2023-09-30T23:04:37.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.997+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc840b0cf0 con 0x7fcc84159f10 2023-09-30T23:04:37.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.998+0000 7fcc6affd700 1 -- 172.21.15.142:0/1598953562 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcc7c01daa0 con 0x7fcc84159f10 2023-09-30T23:04:37.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.999+0000 7fcc6affd700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcc70067330 0x7fcc700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:37.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.999+0000 7fcc6affd700 1 -- 172.21.15.142:0/1598953562 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcc7c086530 con 0x7fcc84159f10 2023-09-30T23:04:38.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:37.999+0000 7fcc82ffd700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcc70067330 0x7fcc700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.000+0000 7fcc82ffd700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcc70067330 0x7fcc700697e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400ac10 tx=0x7fcc74006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:38.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.003+0000 7fcc6affd700 1 -- 172.21.15.142:0/1598953562 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcc840b0cf0 con 0x7fcc84159f10 2023-09-30T23:04:38.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.192+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc840b0cb0 con 0x7fcc84159f10 2023-09-30T23:04:38.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.192+0000 7fcc6affd700 1 -- 172.21.15.142:0/1598953562 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v195) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc7c053430 con 0x7fcc84159f10 2023-09-30T23:04:38.195 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcc70067330 msgr2=0x7fcc700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcc70067330 0x7fcc700697e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400ac10 tx=0x7fcc74006f90 comp rx=0 tx=0).stop 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84159f10 msgr2=0x7fcc841587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84159f10 0x7fcc841587f0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcc84063b20 tx=0x7fcc7c017000 comp rx=0 tx=0).stop 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 shutdown_connections 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fcc70067330 0x7fcc700697e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84159f10 0x7fcc841587f0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc84067620 0x7fcc84150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 --2- 172.21.15.142:0/1598953562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc84159b40 0x7fcc8415c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.194+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 >> 172.21.15.142:0/1598953562 conn(0x7fcc840c9950 msgr2=0x7fcc84150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:38.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.195+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 shutdown_connections 2023-09-30T23:04:38.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.195+0000 7fcc897ff700 1 -- 172.21.15.142:0/1598953562 wait complete. 2023-09-30T23:04:38.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T23:04:38.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.406+0000 7fb2937ff700 1 Processor -- start 2023-09-30T23:04:38.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.406+0000 7fb2937ff700 1 -- start start 2023-09-30T23:04:38.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.407+0000 7fb2937ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb28c0b0de0 0x7fb28c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.407+0000 7fb2937ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c067d10 con 0x7fb28c159ba0 2023-09-30T23:04:38.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.407+0000 7fb2937ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c06af90 con 0x7fb28c0ca5e0 2023-09-30T23:04:38.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.407+0000 7fb2937ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c0676c0 con 0x7fb28c0b0de0 2023-09-30T23:04:38.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.407+0000 7fb29159b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb28c159ba0 0x7fb28c0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40116/0 (socket says 172.21.15.142:40116) 2023-09-30T23:04:38.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.407+0000 7fb29159b700 1 -- 172.21.15.142:0/3036602700 learned_addr learned my addr 172.21.15.142:0/3036602700 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:38.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.407+0000 7fb291d9c700 1 --2- 172.21.15.142:0/3036602700 >> v2:172.21.15.148:3300/0 conn(0x7fb28c0b0de0 0x7fb28c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449080104 0 0) 0x7fb28c067d10 con 0x7fb28c159ba0 2023-09-30T23:04:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb278003570 con 0x7fb28c159ba0 2023-09-30T23:04:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 65697332 0 0) 0x7fb278003570 con 0x7fb28c159ba0 2023-09-30T23:04:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 >> v2:172.21.15.148:3300/0 conn(0x7fb28c0b0de0 msgr2=0x7fb28c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 --2- 172.21.15.142:0/3036602700 >> v2:172.21.15.148:3300/0 conn(0x7fb28c0b0de0 0x7fb28c06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 >> v1:172.21.15.148:6789/0 conn(0x7fb28c0ca5e0 legacy=0x7fb28c0681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0679a0 con 0x7fb28c159ba0 2023-09-30T23:04:38.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fb288001470 con 0x7fb28c159ba0 2023-09-30T23:04:38.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 >> v1:172.21.15.142:6789/0 conn(0x7fb28c159ba0 legacy=0x7fb28c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278003ab0 0x7fb278003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278004810 0x7fb278004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278005210 0x7fb27800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0676c0 con 0x7fb278003ab0 2023-09-30T23:04:38.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27800c130 con 0x7fb278004810 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27800c2f0 con 0x7fb278005210 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.408+0000 7fb29159b700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278003ab0 0x7fb278003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb290d9a700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278004810 0x7fb278004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb291d9c700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278005210 0x7fb27800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb29159b700 1 -- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278005210 msgr2=0x7fb27800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb29159b700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb278005210 0x7fb27800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb29159b700 1 -- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278004810 msgr2=0x7fb278004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:38.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb29159b700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278004810 0x7fb278004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb29159b700 1 -- 172.21.15.142:0/3036602700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278003570 con 0x7fb278003ab0 2023-09-30T23:04:38.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb291d9c700 1 -- 172.21.15.142:0/3036602700 reap_dead start 2023-09-30T23:04:38.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb29159b700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278003ab0 0x7fb278003ec0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb28800c2d0 tx=0x7fb288001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a16703f05f895d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:38.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800cba0 con 0x7fb278003ab0 2023-09-30T23:04:38.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800cd20 con 0x7fb278003ab0 2023-09-30T23:04:38.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.409+0000 7fb283fff700 1 -- 172.21.15.142:0/3036602700 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288005b70 con 0x7fb278003ab0 2023-09-30T23:04:38.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.410+0000 7fb2937ff700 1 -- 172.21.15.142:0/3036602700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278003ab0 msgr2=0x7fb278003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.410+0000 7fb2937ff700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278003ab0 0x7fb278003ec0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb28800c2d0 tx=0x7fb288001d80 comp rx=0 tx=0).stop 2023-09-30T23:04:38.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.410+0000 7fb2937ff700 1 -- 172.21.15.142:0/3036602700 shutdown_connections 2023-09-30T23:04:38.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.410+0000 7fb2937ff700 1 --2- 172.21.15.142:0/3036602700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb278003ab0 0x7fb278003ec0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.410+0000 7fb2937ff700 1 -- 172.21.15.142:0/3036602700 >> 172.21.15.142:0/3036602700 conn(0x7fb28c0cb2f0 msgr2=0x7fb28c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:38.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.410+0000 7fb2937ff700 1 -- 172.21.15.142:0/3036602700 shutdown_connections 2023-09-30T23:04:38.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.410+0000 7fb2937ff700 1 -- 172.21.15.142:0/3036602700 wait complete. 2023-09-30T23:04:38.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.411+0000 7fb2937ff700 1 Processor -- start 2023-09-30T23:04:38.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.411+0000 7fb2937ff700 1 -- start start 2023-09-30T23:04:38.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.412+0000 7fb2937ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278003ab0 0x7fb28c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.412+0000 7fb2937ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb28c0c8130 0x7fb28c0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.412+0000 7fb2937ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb28c0c39f0 0x7fb28c0c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.412+0000 7fb2937ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c158530 con 0x7fb28c0c39f0 2023-09-30T23:04:38.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.412+0000 7fb2937ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0c8ae0 con 0x7fb278003ab0 2023-09-30T23:04:38.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.412+0000 7fb2937ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0c43a0 con 0x7fb28c0c8130 2023-09-30T23:04:38.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb28c0c39f0 0x7fb28c0c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb28c0c39f0 0x7fb28c0c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57462/0 (socket says 172.21.15.142:57462) 2023-09-30T23:04:38.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 -- 172.21.15.142:0/477966662 learned_addr learned my addr 172.21.15.142:0/477966662 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:38.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb290d9a700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb28c0c8130 0x7fb28c0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb29159b700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278003ab0 0x7fb28c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 -- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb28c0c8130 msgr2=0x7fb28c0c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb28c0c8130 0x7fb28c0c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 -- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278003ab0 msgr2=0x7fb28c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278003ab0 0x7fb28c0afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 -- 172.21.15.142:0/477966662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0c4670 con 0x7fb28c0c39f0 2023-09-30T23:04:38.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb290d9a700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb28c0c8130 0x7fb28c0c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:38.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb29159b700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278003ab0 0x7fb28c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:38.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb291d9c700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb28c0c39f0 0x7fb28c0c3e60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06efd0 tx=0x7fb28400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.413+0000 7fb2817fa700 1 -- 172.21.15.142:0/477966662 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400e070 con 0x7fb28c0c39f0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.414+0000 7fb2817fa700 1 -- 172.21.15.142:0/477966662 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284011ca0 con 0x7fb28c0c39f0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.414+0000 7fb2817fa700 1 -- 172.21.15.142:0/477966662 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284016470 con 0x7fb28c0c39f0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.414+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c0c4950 con 0x7fb28c0c39f0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.414+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c0c5d90 con 0x7fb28c0c39f0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.415+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c0c5910 con 0x7fb28c0c39f0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.416+0000 7fb2817fa700 1 -- 172.21.15.142:0/477966662 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb284016860 con 0x7fb28c0c39f0 2023-09-30T23:04:38.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.416+0000 7fb2817fa700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb270067330 0x7fb2700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.416+0000 7fb2817fa700 1 -- 172.21.15.142:0/477966662 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb284085720 con 0x7fb28c0c39f0 2023-09-30T23:04:38.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.417+0000 7fb29159b700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb270067330 0x7fb2700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.417+0000 7fb29159b700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb270067330 0x7fb2700697e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb288007c00 tx=0x7fb288015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:38.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.421+0000 7fb2817fa700 1 -- 172.21.15.142:0/477966662 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb28c0c5910 con 0x7fb28c0c39f0 2023-09-30T23:04:38.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.609+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb28c0c5910 con 0x7fb28c0c39f0 2023-09-30T23:04:38.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.609+0000 7fb2817fa700 1 -- 172.21.15.142:0/477966662 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v195) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb28c0c5910 con 0x7fb28c0c39f0 2023-09-30T23:04:38.609 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2023-09-30T23:04:38.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.611+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb270067330 msgr2=0x7fb2700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.611+0000 7fb2937ff700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb270067330 0x7fb2700697e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb288007c00 tx=0x7fb288015000 comp rx=0 tx=0).stop 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.611+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb28c0c39f0 msgr2=0x7fb28c0c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.611+0000 7fb2937ff700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb28c0c39f0 0x7fb28c0c3e60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06efd0 tx=0x7fb28400b040 comp rx=0 tx=0).stop 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 shutdown_connections 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb270067330 0x7fb2700697e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb28c0c39f0 0x7fb28c0c3e60 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb278003ab0 0x7fb28c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 --2- 172.21.15.142:0/477966662 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb28c0c8130 0x7fb28c0c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 >> 172.21.15.142:0/477966662 conn(0x7fb28c0cb2f0 msgr2=0x7fb28c15bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 shutdown_connections 2023-09-30T23:04:38.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.612+0000 7fb2937ff700 1 -- 172.21.15.142:0/477966662 wait complete. 2023-09-30T23:04:38.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T23:04:38.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.822+0000 7f113c5ff700 1 Processor -- start 2023-09-30T23:04:38.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.822+0000 7f113c5ff700 1 -- start start 2023-09-30T23:04:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.823+0000 7f113c5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11340c52a0 0x7f11340c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f113c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11341605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f113c5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11340c7690 con 0x7f1134069f10 2023-09-30T23:04:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f113c5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11341406a0 con 0x7f11340c52a0 2023-09-30T23:04:38.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f113c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11340c3a50 con 0x7f11340cb350 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f113ab9c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11341605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f1139b9a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1134069f10 0x7f11340c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:42628/0 (socket says 172.21.15.142:42628) 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f1139b9a700 1 -- 172.21.15.142:0/3509254154 learned_addr learned my addr 172.21.15.142:0/3509254154 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.824+0000 7f113a39b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f11340c52a0 0x7f11340c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f1139399700 1 -- 172.21.15.142:0/3509254154 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115469537 0 0) 0x7f1124001110 con 0x7f1134069f10 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f1139399700 1 -- 172.21.15.142:0/3509254154 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1120003570 con 0x7f1134069f10 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f113ab9c700 1 -- 172.21.15.142:0/3509254154 >> v2:172.21.15.148:3300/0 conn(0x7f11340c52a0 msgr2=0x7f11340c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:38.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f113ab9c700 1 --2- 172.21.15.142:0/3509254154 >> v2:172.21.15.148:3300/0 conn(0x7f11340c52a0 0x7f11340c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f113ab9c700 1 -- 172.21.15.142:0/3509254154 >> v1:172.21.15.148:6789/0 conn(0x7f1134069f10 legacy=0x7f11340c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f113ab9c700 1 -- 172.21.15.142:0/3509254154 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11340c7f20 con 0x7f11340cb350 2023-09-30T23:04:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f113a39b700 1 --2- 172.21.15.142:0/3509254154 >> v2:172.21.15.148:3300/0 conn(0x7f11340c52a0 0x7f11340c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f113ab9c700 1 --2- 172.21.15.142:0/3509254154 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11341605e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f112c009e60 tx=0x7f112c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be504c461a49ea0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f1139399700 1 -- 172.21.15.142:0/3509254154 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c00e070 con 0x7f11340cb350 2023-09-30T23:04:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f1139399700 1 -- 172.21.15.142:0/3509254154 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c00bab0 con 0x7f11340cb350 2023-09-30T23:04:38.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.825+0000 7f1139399700 1 -- 172.21.15.142:0/3509254154 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c00be70 con 0x7f11340cb350 2023-09-30T23:04:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 -- 172.21.15.142:0/3509254154 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 msgr2=0x7f11341605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 --2- 172.21.15.142:0/3509254154 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11341605e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f112c009e60 tx=0x7f112c009780 comp rx=0 tx=0).stop 2023-09-30T23:04:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 -- 172.21.15.142:0/3509254154 shutdown_connections 2023-09-30T23:04:38.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 --2- 172.21.15.142:0/3509254154 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11341605e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 --2- 172.21.15.142:0/3509254154 >> v2:172.21.15.148:3300/0 conn(0x7f11340c52a0 0x7f11340c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 -- 172.21.15.142:0/3509254154 >> 172.21.15.142:0/3509254154 conn(0x7f11340cc670 msgr2=0x7f11340cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 -- 172.21.15.142:0/3509254154 shutdown_connections 2023-09-30T23:04:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.826+0000 7f113c5ff700 1 -- 172.21.15.142:0/3509254154 wait complete. 2023-09-30T23:04:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.827+0000 7f113c5ff700 1 Processor -- start 2023-09-30T23:04:38.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.828+0000 7f113c5ff700 1 -- start start 2023-09-30T23:04:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.828+0000 7f113c5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1134069f10 0x7f11341561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.828+0000 7f113c5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11340c52a0 0x7f113413f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113c5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11340b9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113c5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113416d620 con 0x7f1134069f10 2023-09-30T23:04:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113c5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113416d8c0 con 0x7f11340c52a0 2023-09-30T23:04:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113c5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113416dba0 con 0x7f11340cb350 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1134069f10 0x7f11341561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1134069f10 0x7f11341561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57472/0 (socket says 172.21.15.142:57472) 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 -- 172.21.15.142:0/924733921 learned_addr learned my addr 172.21.15.142:0/924733921 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113ab9c700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11340b9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f1139b9a700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11340c52a0 0x7f113413f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 -- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 msgr2=0x7f11340b9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11340b9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 -- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11340c52a0 msgr2=0x7f113413f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11340c52a0 0x7f113413f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113a39b700 1 -- 172.21.15.142:0/924733921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1130009420 con 0x7f1134069f10 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.829+0000 7f113ab9c700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11340b9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:38.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.830+0000 7f113a39b700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1134069f10 0x7f11341561a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f113000ec80 tx=0x7f11300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.830+0000 7f112a7fc700 1 -- 172.21.15.142:0/924733921 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000c8f0 con 0x7f1134069f10 2023-09-30T23:04:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.830+0000 7f112a7fc700 1 -- 172.21.15.142:0/924733921 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000ca50 con 0x7f1134069f10 2023-09-30T23:04:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.830+0000 7f112a7fc700 1 -- 172.21.15.142:0/924733921 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000cdd0 con 0x7f1134069f10 2023-09-30T23:04:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.830+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c009a20 con 0x7f1134069f10 2023-09-30T23:04:38.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.830+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113416e160 con 0x7f1134069f10 2023-09-30T23:04:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.831+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1134069a50 con 0x7f1134069f10 2023-09-30T23:04:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.832+0000 7f112a7fc700 1 -- 172.21.15.142:0/924733921 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1130013680 con 0x7f1134069f10 2023-09-30T23:04:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.833+0000 7f112a7fc700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1118067330 0x7f11180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.833+0000 7f112a7fc700 1 -- 172.21.15.142:0/924733921 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1130084fd0 con 0x7f1134069f10 2023-09-30T23:04:38.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.833+0000 7f1139b9a700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1118067330 0x7f11180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:38.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.833+0000 7f1139b9a700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1118067330 0x7f11180697e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1124007fd0 tx=0x7f1124007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:38.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:38.837+0000 7f112a7fc700 1 -- 172.21.15.142:0/924733921 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1130051e30 con 0x7f1134069f10 2023-09-30T23:04:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.026+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f113406fc10 con 0x7f1134069f10 2023-09-30T23:04:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.026+0000 7f112a7fc700 1 -- 172.21.15.142:0/924733921 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v195) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1130055450 con 0x7f1134069f10 2023-09-30T23:04:39.026 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1118067330 msgr2=0x7f11180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1118067330 0x7f11180697e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1124007fd0 tx=0x7f1124007bf0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1134069f10 msgr2=0x7f11341561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1134069f10 0x7f11341561a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f113000ec80 tx=0x7f11300091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 shutdown_connections 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1118067330 0x7f11180697e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f11340cb350 0x7f11340b9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1134069f10 0x7f11341561a0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 --2- 172.21.15.142:0/924733921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f11340c52a0 0x7f113413f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 >> 172.21.15.142:0/924733921 conn(0x7f11340cc670 msgr2=0x7f11340c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:39.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 shutdown_connections 2023-09-30T23:04:39.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.029+0000 7f113c5ff700 1 -- 172.21.15.142:0/924733921 wait complete. 2023-09-30T23:04:39.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T23:04:39.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.238+0000 7f96531ff700 1 Processor -- start 2023-09-30T23:04:39.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.238+0000 7f96531ff700 1 -- start start 2023-09-30T23:04:39.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.239+0000 7f96531ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f964c0cb350 0x7f964c1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.239+0000 7f96531ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0c7690 con 0x7f964c0c52a0 2023-09-30T23:04:39.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.239+0000 7f96531ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0c7f20 con 0x7f964c069f10 2023-09-30T23:04:39.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.239+0000 7f96531ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c1406a0 con 0x7f964c0cb350 2023-09-30T23:04:39.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f9650f9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f964c0c52a0 0x7f964c0c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40122/0 (socket says 172.21.15.142:40122) 2023-09-30T23:04:39.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f9650f9b700 1 -- 172.21.15.142:0/1855174921 learned_addr learned my addr 172.21.15.142:0/1855174921 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:39.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f965179c700 1 --2- 172.21.15.142:0/1855174921 >> v2:172.21.15.148:3300/0 conn(0x7f964c0cb350 0x7f964c1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f964b7fe700 1 -- 172.21.15.142:0/1855174921 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540634747 0 0) 0x7f9640001110 con 0x7f964c0c52a0 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f964b7fe700 1 -- 172.21.15.142:0/1855174921 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f963c003570 con 0x7f964c0c52a0 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f964b7fe700 1 -- 172.21.15.142:0/1855174921 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141969150 0 0) 0x7f964c0c7f20 con 0x7f964c069f10 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f964b7fe700 1 -- 172.21.15.142:0/1855174921 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9640001110 con 0x7f964c069f10 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f965179c700 1 -- 172.21.15.142:0/1855174921 >> v1:172.21.15.148:6789/0 conn(0x7f964c069f10 legacy=0x7f964c0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f965179c700 1 -- 172.21.15.142:0/1855174921 >> v1:172.21.15.142:6789/0 conn(0x7f964c0c52a0 legacy=0x7f964c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.240+0000 7f965179c700 1 -- 172.21.15.142:0/1855174921 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c06a3f0 con 0x7f964c0cb350 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f965179c700 1 --2- 172.21.15.142:0/1855174921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0cb350 0x7f964c1615f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9644009e60 tx=0x7f9644009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ccd4deb2239d0d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f964b7fe700 1 -- 172.21.15.142:0/1855174921 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400bab0 con 0x7f964c0cb350 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f964b7fe700 1 -- 172.21.15.142:0/1855174921 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400bc10 con 0x7f964c0cb350 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f964b7fe700 1 -- 172.21.15.142:0/1855174921 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644011460 con 0x7f964c0cb350 2023-09-30T23:04:39.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f96531ff700 1 -- 172.21.15.142:0/1855174921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0cb350 msgr2=0x7f964c1615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f96531ff700 1 --2- 172.21.15.142:0/1855174921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0cb350 0x7f964c1615f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9644009e60 tx=0x7f9644009780 comp rx=0 tx=0).stop 2023-09-30T23:04:39.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f96531ff700 1 -- 172.21.15.142:0/1855174921 shutdown_connections 2023-09-30T23:04:39.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f96531ff700 1 --2- 172.21.15.142:0/1855174921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0cb350 0x7f964c1615f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f96531ff700 1 -- 172.21.15.142:0/1855174921 >> 172.21.15.142:0/1855174921 conn(0x7f964c0cc670 msgr2=0x7f964c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:39.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f96531ff700 1 -- 172.21.15.142:0/1855174921 shutdown_connections 2023-09-30T23:04:39.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.241+0000 7f96531ff700 1 -- 172.21.15.142:0/1855174921 wait complete. 2023-09-30T23:04:39.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.243+0000 7f96531ff700 1 Processor -- start 2023-09-30T23:04:39.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.244+0000 7f96531ff700 1 -- start start 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f96531ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f964c069f10 0x7f964c1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f96531ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0c52a0 0x7f964c1388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f96531ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0cb350 0x7f964c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f96531ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c139a30 con 0x7f964c0cb350 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f96531ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c139190 con 0x7f964c0c52a0 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f96531ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c139470 con 0x7f964c069f10 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f965179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0cb350 0x7f964c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f965179c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0cb350 0x7f964c1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57488/0 (socket says 172.21.15.142:57488) 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f965179c700 1 -- 172.21.15.142:0/760847218 learned_addr learned my addr 172.21.15.142:0/760847218 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f9650f9b700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f964c069f10 0x7f964c1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.245+0000 7f964bfff700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0c52a0 0x7f964c1388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f965179c700 1 -- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f964c069f10 msgr2=0x7f964c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f965179c700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f964c069f10 0x7f964c1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f965179c700 1 -- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0c52a0 msgr2=0x7f964c1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f965179c700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0c52a0 0x7f964c1388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f965179c700 1 -- 172.21.15.142:0/760847218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644009a20 con 0x7f964c0cb350 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f9650f9b700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f964c069f10 0x7f964c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f965179c700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0cb350 0x7f964c1560e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f964c06c260 tx=0x7f964401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:39.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f9648ff9700 1 -- 172.21.15.142:0/760847218 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440196e0 con 0x7f964c0cb350 2023-09-30T23:04:39.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f9648ff9700 1 -- 172.21.15.142:0/760847218 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96440198a0 con 0x7f964c0cb350 2023-09-30T23:04:39.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c139750 con 0x7f964c0cb350 2023-09-30T23:04:39.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f9648ff9700 1 -- 172.21.15.142:0/760847218 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644019c60 con 0x7f964c0cb350 2023-09-30T23:04:39.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.246+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c1585e0 con 0x7f964c0cb350 2023-09-30T23:04:39.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.247+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c069a50 con 0x7f964c0cb350 2023-09-30T23:04:39.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.248+0000 7f9648ff9700 1 -- 172.21.15.142:0/760847218 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f964402c3b0 con 0x7f964c0cb350 2023-09-30T23:04:39.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.249+0000 7f9648ff9700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9630067330 0x7f96300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.249+0000 7f9648ff9700 1 -- 172.21.15.142:0/760847218 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9644086950 con 0x7f964c0cb350 2023-09-30T23:04:39.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.249+0000 7f9650f9b700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9630067330 0x7f96300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.250+0000 7f9650f9b700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9630067330 0x7f96300697e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f964c13b900 tx=0x7f9640009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:39.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.254+0000 7f9648ff9700 1 -- 172.21.15.142:0/760847218 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9644053900 con 0x7f964c0cb350 2023-09-30T23:04:39.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.451+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f964c06fc10 con 0x7f964c0cb350 2023-09-30T23:04:39.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.452+0000 7f9648ff9700 1 -- 172.21.15.142:0/760847218 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v196) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96440280a0 con 0x7f964c0cb350 2023-09-30T23:04:39.452 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-30T23:04:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9630067330 msgr2=0x7f96300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9630067330 0x7f96300697e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f964c13b900 tx=0x7f9640009040 comp rx=0 tx=0).stop 2023-09-30T23:04:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0cb350 msgr2=0x7f964c1560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0cb350 0x7f964c1560e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f964c06c260 tx=0x7f964401b000 comp rx=0 tx=0).stop 2023-09-30T23:04:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 shutdown_connections 2023-09-30T23:04:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9630067330 0x7f96300697e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0cb350 0x7f964c1560e0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f964c069f10 0x7f964c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 --2- 172.21.15.142:0/760847218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0c52a0 0x7f964c1388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 >> 172.21.15.142:0/760847218 conn(0x7f964c0cc670 msgr2=0x7f964c13c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.454+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 shutdown_connections 2023-09-30T23:04:39.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.455+0000 7f96531ff700 1 -- 172.21.15.142:0/760847218 wait complete. 2023-09-30T23:04:39.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:39.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.662+0000 7f4e1a3ff700 1 Processor -- start 2023-09-30T23:04:39.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.662+0000 7f4e1a3ff700 1 -- start start 2023-09-30T23:04:39.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.663+0000 7f4e1a3ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4e140af020 0x7f4e14156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.663+0000 7f4e1a3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1406d3e0 con 0x7f4e1406e820 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.663+0000 7f4e1a3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1406dc80 con 0x7f4e140b00d0 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.663+0000 7f4e1a3ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1406eca0 con 0x7f4e140af020 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e1899c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4e1406e820 0x7f4e1415a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40126/0 (socket says 172.21.15.142:40126) 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e1899c700 1 -- 172.21.15.142:0/3821758021 learned_addr learned my addr 172.21.15.142:0/3821758021 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e13fff700 1 --2- 172.21.15.142:0/3821758021 >> v2:172.21.15.148:3300/0 conn(0x7f4e140af020 0x7f4e14156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826521340 0 0) 0x7f4e1406d3e0 con 0x7f4e1406e820 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dfc003570 con 0x7f4e1406e820 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929809265 0 0) 0x7f4e1406dc80 con 0x7f4e140b00d0 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e1406d3e0 con 0x7f4e140b00d0 2023-09-30T23:04:39.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3908770351 0 0) 0x7f4dfc003570 con 0x7f4e1406e820 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 >> v2:172.21.15.148:3300/0 conn(0x7f4e140af020 msgr2=0x7f4e14156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 --2- 172.21.15.142:0/3821758021 >> v2:172.21.15.148:3300/0 conn(0x7f4e140af020 0x7f4e14156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 >> v1:172.21.15.148:6789/0 conn(0x7f4e140b00d0 legacy=0x7f4e1406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1406b790 con 0x7f4e1406e820 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f4e0c0017f0 con 0x7f4e1406e820 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.664+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 >> v1:172.21.15.142:6789/0 conn(0x7f4e1406e820 legacy=0x7f4e1415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e12ffd700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc003c40 0x7f4dfc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e12ffd700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc004810 0x7f4dfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e12ffd700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc005210 0x7f4dfc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1406eca0 con 0x7f4dfc003c40 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc00c130 con 0x7f4dfc004810 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc00c2c0 con 0x7f4dfc005210 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e13fff700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc003c40 0x7f4dfc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e1899c700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc005210 0x7f4dfc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e137fe700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc004810 0x7f4dfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e13fff700 1 -- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc005210 msgr2=0x7f4dfc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e13fff700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc005210 0x7f4dfc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e13fff700 1 -- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc004810 msgr2=0x7f4dfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e13fff700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc004810 0x7f4dfc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e13fff700 1 -- 172.21.15.142:0/3821758021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc003570 con 0x7f4dfc003c40 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e1899c700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc005210 0x7f4dfc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e1899c700 1 -- 172.21.15.142:0/3821758021 reap_dead start 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.665+0000 7f4e13fff700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc003c40 0x7f4dfc004030 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009c30 tx=0x7f4e040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8dee2ce1eb52bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e040095b0 con 0x7f4dfc003c40 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400e710 con 0x7f4dfc003c40 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e12ffd700 1 -- 172.21.15.142:0/3821758021 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400ead0 con 0x7f4dfc003c40 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/3821758021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc003c40 msgr2=0x7f4dfc004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc003c40 0x7f4dfc004030 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009c30 tx=0x7f4e040091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/3821758021 shutdown_connections 2023-09-30T23:04:39.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/3821758021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc003c40 0x7f4dfc004030 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/3821758021 >> 172.21.15.142:0/3821758021 conn(0x7f4e140680c0 msgr2=0x7f4e140c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:39.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/3821758021 shutdown_connections 2023-09-30T23:04:39.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.666+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/3821758021 wait complete. 2023-09-30T23:04:39.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.668+0000 7f4e1a3ff700 1 Processor -- start 2023-09-30T23:04:39.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.668+0000 7f4e1a3ff700 1 -- start start 2023-09-30T23:04:39.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e1a3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc003c40 0x7f4e14166670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e1a3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1415fb20 0x7f4e141525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e1a3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e14152b20 0x7f4e140c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e1a3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1414ff60 con 0x7f4e1415fb20 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e1a3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c34a0 con 0x7f4dfc003c40 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e1a3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14152f70 con 0x7f4e14152b20 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1415fb20 0x7f4e141525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1415fb20 0x7f4e141525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57496/0 (socket says 172.21.15.142:57496) 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 -- 172.21.15.142:0/495388091 learned_addr learned my addr 172.21.15.142:0/495388091 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e13fff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc003c40 0x7f4e14166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e1899c700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e14152b20 0x7f4e140c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 -- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e14152b20 msgr2=0x7f4e140c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e14152b20 0x7f4e140c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 -- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc003c40 msgr2=0x7f4e14166670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc003c40 0x7f4e14166670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.669+0000 7f4e137fe700 1 -- 172.21.15.142:0/495388091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14166bb0 con 0x7f4e1415fb20 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.670+0000 7f4e137fe700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1415fb20 0x7f4e141525e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800e810 tx=0x7f4e08009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.670+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08012660 con 0x7f4e1415fb20 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.670+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080127c0 con 0x7f4e1415fb20 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.670+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140c2890 con 0x7f4e1415fb20 2023-09-30T23:04:39.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.670+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08012b60 con 0x7f4e1415fb20 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.670+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140c2e50 con 0x7f4e1415fb20 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.671+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e140c3630 con 0x7f4e1415fb20 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.672+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4e0801d460 con 0x7f4e1415fb20 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.673+0000 7f4dfbfff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4e00067330 0x7f4e000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.673+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4e08084ef0 con 0x7f4e1415fb20 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.673+0000 7f4e13fff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4e00067330 0x7f4e000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.673+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7f4e0006f4f0 con 0x7f4e1415fb20 2023-09-30T23:04:39.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.673+0000 7f4e13fff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4e00067330 0x7f4e000697e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4e040091e0 tx=0x7f4e0401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:39.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.677+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4e08051d50 con 0x7f4e1415fb20 2023-09-30T23:04:39.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.907+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e1406fc10 con 0x7f4e1415fb20 2023-09-30T23:04:39.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.907+0000 7f4dfbfff700 1 -- 172.21.15.142:0/495388091 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f4e08012ed0 con 0x7f4e1415fb20 2023-09-30T23:04:39.907 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:39.907 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4e00067330 msgr2=0x7f4e000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4e00067330 0x7f4e000697e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4e040091e0 tx=0x7f4e0401a000 comp rx=0 tx=0).stop 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1415fb20 msgr2=0x7f4e141525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1415fb20 0x7f4e141525e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800e810 tx=0x7f4e08009040 comp rx=0 tx=0).stop 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 shutdown_connections 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4e00067330 0x7f4e000697e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e14152b20 0x7f4e140c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc003c40 0x7f4e14166670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 --2- 172.21.15.142:0/495388091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1415fb20 0x7f4e141525e0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:39.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 >> 172.21.15.142:0/495388091 conn(0x7f4e140680c0 msgr2=0x7f4e14069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:39.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 shutdown_connections 2023-09-30T23:04:39.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:39.910+0000 7f4e1a3ff700 1 -- 172.21.15.142:0/495388091 wait complete. 2023-09-30T23:04:39.911 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:39.927 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:40.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.117+0000 7f9f2ffff700 1 Processor -- start 2023-09-30T23:04:40.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.117+0000 7f9f2ffff700 1 -- start start 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f280b1950 0x7f9f2815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f280ad630 con 0x7f9f280b1580 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2815ab60 con 0x7f9f280b1950 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28157c20 con 0x7f9f2815a6c0 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2d59a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f280b1950 0x7f9f2815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2dd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9f280b1580 0x7f9f280adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40138/0 (socket says 172.21.15.142:40138) 2023-09-30T23:04:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2dd9b700 1 -- 172.21.15.142:0/3754746262 learned_addr learned my addr 172.21.15.142:0/3754746262 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.118+0000 7f9f2d59a700 1 --2- 172.21.15.142:0/3754746262 >> v2:172.21.15.142:3300/0 conn(0x7f9f280b1950 0x7f9f2815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57500/0 (socket says 172.21.15.142:57500) 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2e59c700 1 --2- 172.21.15.142:0/3754746262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2d59a700 1 -- 172.21.15.142:0/3754746262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 msgr2=0x7f9f2806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2d59a700 1 --2- 172.21.15.142:0/3754746262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f2806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2d59a700 1 -- 172.21.15.142:0/3754746262 >> v1:172.21.15.142:6789/0 conn(0x7f9f280b1580 legacy=0x7f9f280adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2d59a700 1 -- 172.21.15.142:0/3754746262 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280b3360 con 0x7f9f280b1950 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2e59c700 1 --2- 172.21.15.142:0/3754746262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f2806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2cd99700 1 -- 172.21.15.142:0/3754746262 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119247696 0 0) 0x7f9f280ad630 con 0x7f9f280b1580 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2d59a700 1 --2- 172.21.15.142:0/3754746262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1950 0x7f9f2815a180 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009910 tx=0x7f9f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4500b5494f350aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2cd99700 1 -- 172.21.15.142:0/3754746262 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800b820 con 0x7f9f280b1950 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2cd99700 1 -- 172.21.15.142:0/3754746262 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1800b980 con 0x7f9f280b1950 2023-09-30T23:04:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.119+0000 7f9f2cd99700 1 -- 172.21.15.142:0/3754746262 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800bd20 con 0x7f9f280b1950 2023-09-30T23:04:40.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3754746262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1950 msgr2=0x7f9f2815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3754746262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1950 0x7f9f2815a180 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009910 tx=0x7f9f180091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3754746262 shutdown_connections 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3754746262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f2806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3754746262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1950 0x7f9f2815a180 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3754746262 >> 172.21.15.142:0/3754746262 conn(0x7f9f280ce1f0 msgr2=0x7f9f28069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3754746262 shutdown_connections 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.120+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3754746262 wait complete. 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.121+0000 7f9f2ffff700 1 Processor -- start 2023-09-30T23:04:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.122+0000 7f9f2ffff700 1 -- start start 2023-09-30T23:04:40.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.122+0000 7f9f2ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1580 0x7f9f2816af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f280b1950 0x7f9f280cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2ffff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f280cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28148b30 con 0x7f9f280b1580 2023-09-30T23:04:40.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2816a680 con 0x7f9f280b1950 2023-09-30T23:04:40.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2ffff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f280cbc80 con 0x7f9f2815a6c0 2023-09-30T23:04:40.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1580 0x7f9f2816af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1580 0x7f9f2816af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57502/0 (socket says 172.21.15.142:57502) 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 -- 172.21.15.142:0/3752616232 learned_addr learned my addr 172.21.15.142:0/3752616232 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2d59a700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f280b1950 0x7f9f280cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2e59c700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f280cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 -- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 msgr2=0x7f9f280cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f280cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 -- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f280b1950 msgr2=0x7f9f280cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f280b1950 0x7f9f280cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 -- 172.21.15.142:0/3752616232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18009420 con 0x7f9f280b1580 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.123+0000 7f9f2dd9b700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1580 0x7f9f2816af40 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c7e0 tx=0x7f9f24007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.124+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24005b30 con 0x7f9f280b1580 2023-09-30T23:04:40.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.124+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24005c90 con 0x7f9f280b1580 2023-09-30T23:04:40.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.124+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f280cbf60 con 0x7f9f280b1580 2023-09-30T23:04:40.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.124+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24007300 con 0x7f9f280b1580 2023-09-30T23:04:40.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.124+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f280cc520 con 0x7f9f280b1580 2023-09-30T23:04:40.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.125+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2806d600 con 0x7f9f280b1580 2023-09-30T23:04:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.126+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9f2401b3b0 con 0x7f9f280b1580 2023-09-30T23:04:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.127+0000 7f9f1dffb700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f0c067330 0x7f9f0c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.127+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f24084190 con 0x7f9f280b1580 2023-09-30T23:04:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.127+0000 7f9f2d59a700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f0c067330 0x7f9f0c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.127+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7f9f0c06f4f0 con 0x7f9f280b1580 2023-09-30T23:04:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.127+0000 7f9f2d59a700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f0c067330 0x7f9f0c0697e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9f180091e0 tx=0x7f9f18017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:40.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.131+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9f24050ff0 con 0x7f9f280b1580 2023-09-30T23:04:40.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.324+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f280ae1d0 con 0x7f9f280b1580 2023-09-30T23:04:40.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.325+0000 7f9f1dffb700 1 -- 172.21.15.142:0/3752616232 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+17052 (secure 0 0 0) 0x7f9f24017070 con 0x7f9f280b1580 2023-09-30T23:04:40.325 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:40.325 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":196,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:39.403740+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:04:06.673268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-09-30T23:04:08.101636+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:40.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f0c067330 msgr2=0x7f9f0c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f0c067330 0x7f9f0c0697e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9f180091e0 tx=0x7f9f18017000 comp rx=0 tx=0).stop 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1580 msgr2=0x7f9f2816af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1580 0x7f9f2816af40 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c7e0 tx=0x7f9f24007df0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 shutdown_connections 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f9f0c067330 0x7f9f0c0697e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f2815a6c0 0x7f9f280cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f280b1580 0x7f9f2816af40 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 --2- 172.21.15.142:0/3752616232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f280b1950 0x7f9f280cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 >> 172.21.15.142:0/3752616232 conn(0x7f9f280ce1f0 msgr2=0x7f9f28159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 shutdown_connections 2023-09-30T23:04:40.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.328+0000 7f9f2ffff700 1 -- 172.21.15.142:0/3752616232 wait complete. 2023-09-30T23:04:40.345 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T23:04:40.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:40.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.538+0000 7fc1ae5ff700 1 Processor -- start 2023-09-30T23:04:40.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.538+0000 7fc1ae5ff700 1 -- start start 2023-09-30T23:04:40.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.539+0000 7fc1ae5ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1a815de20 0x7fc1a8164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.539+0000 7fc1ae5ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a80cc6b0 con 0x7fc1a8143350 2023-09-30T23:04:40.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.539+0000 7fc1ae5ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a80cbaa0 con 0x7fc1a80692f0 2023-09-30T23:04:40.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.539+0000 7fc1ae5ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a80cbd80 con 0x7fc1a815de20 2023-09-30T23:04:40.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.539+0000 7fc1a7fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc1a8143350 0x7fc1a80cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:40150/0 (socket says 172.21.15.142:40150) 2023-09-30T23:04:40.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.539+0000 7fc1a7fff700 1 -- 172.21.15.142:0/3612918205 learned_addr learned my addr 172.21.15.142:0/3612918205 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:40.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1acb9c700 1 --2- 172.21.15.142:0/3612918205 >> v2:172.21.15.148:3300/0 conn(0x7fc1a815de20 0x7fc1a8164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978936533 0 0) 0x7fc1a80cc6b0 con 0x7fc1a8143350 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc190003570 con 0x7fc1a8143350 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245191086 0 0) 0x7fc190003570 con 0x7fc1a8143350 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 >> v2:172.21.15.148:3300/0 conn(0x7fc1a815de20 msgr2=0x7fc1a8164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 --2- 172.21.15.142:0/3612918205 >> v2:172.21.15.148:3300/0 conn(0x7fc1a815de20 0x7fc1a8164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 >> v1:172.21.15.148:6789/0 conn(0x7fc1a80692f0 legacy=0x7fc1a815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a80cc060 con 0x7fc1a8143350 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fc198001470 con 0x7fc1a8143350 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 >> v1:172.21.15.142:6789/0 conn(0x7fc1a8143350 legacy=0x7fc1a80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc190003a60 0x7fc190003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc190004810 0x7fc190004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc19000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a80cbd80 con 0x7fc1900051c0 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19000c190 con 0x7fc190004810 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.540+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19000c350 con 0x7fc190003a60 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1a77fe700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc190004810 0x7fc190004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc19000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1a7fff700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc190003a60 0x7fc190003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 -- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc190003a60 msgr2=0x7fc190003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc190003a60 0x7fc190003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 -- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc190004810 msgr2=0x7fc190004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc190004810 0x7fc190004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 -- 172.21.15.142:0/3612918205 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc190003570 con 0x7fc1900051c0 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1a77fe700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc190004810 0x7fc190004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 -- 172.21.15.142:0/3612918205 reap_dead start 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1acb9c700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc19000ba60 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fc1a815e220 tx=0x7fc1a0009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da90728118731e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.541+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0009a40 con 0x7fc1900051c0 2023-09-30T23:04:40.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0007c90 con 0x7fc1900051c0 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1a6ffd700 1 -- 172.21.15.142:0/3612918205 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0014690 con 0x7fc1900051c0 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/3612918205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 msgr2=0x7fc19000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc19000ba60 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fc1a815e220 tx=0x7fc1a0009730 comp rx=0 tx=0).stop 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/3612918205 shutdown_connections 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/3612918205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc19000ba60 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/3612918205 >> 172.21.15.142:0/3612918205 conn(0x7fc1a80ce8e0 msgr2=0x7fc1a80cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/3612918205 shutdown_connections 2023-09-30T23:04:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.542+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/3612918205 wait complete. 2023-09-30T23:04:40.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.544+0000 7fc1ae5ff700 1 Processor -- start 2023-09-30T23:04:40.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.544+0000 7fc1ae5ff700 1 -- start start 2023-09-30T23:04:40.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1ae5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc1a816aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1ae5ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1a815b190 0x7fc1a815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1ae5ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a80a7c60 0x7fc1a80a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1ae5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a816a450 con 0x7fc1900051c0 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1ae5ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a815bb40 con 0x7fc1a80a7c60 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1ae5ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a80a8600 con 0x7fc1a815b190 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc1a816aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc1a816aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57514/0 (socket says 172.21.15.142:57514) 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 -- 172.21.15.142:0/2188814712 learned_addr learned my addr 172.21.15.142:0/2188814712 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:40.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a77fe700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1a815b190 0x7fc1a815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1acb9c700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a80a7c60 0x7fc1a80a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 -- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1a815b190 msgr2=0x7fc1a815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1a815b190 0x7fc1a815b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 -- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a80a7c60 msgr2=0x7fc1a80a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a80a7c60 0x7fc1a80a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 -- 172.21.15.142:0/2188814712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a815c980 con 0x7fc1900051c0 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.545+0000 7fc1a7fff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc1a816aab0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fc198000e10 tx=0x7fc198001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.546+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198018030 con 0x7fc1900051c0 2023-09-30T23:04:40.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.546+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19800f870 con 0x7fc1900051c0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.546+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800fc30 con 0x7fc1900051c0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.546+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a815bd70 con 0x7fc1900051c0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.546+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a815c330 con 0x7fc1900051c0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.547+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a806ea70 con 0x7fc1900051c0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.548+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc19801b070 con 0x7fc1900051c0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.549+0000 7fc18ffff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc194067330 0x7fc1940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.549+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc198019070 con 0x7fc1900051c0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.549+0000 7fc1a77fe700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc194067330 0x7fc1940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:40.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.549+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7fc19406f4f0 con 0x7fc1900051c0 2023-09-30T23:04:40.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.550+0000 7fc1a77fe700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc194067330 0x7fc1940697e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc19c007e20 tx=0x7fc19c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:40.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.553+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc1980518e0 con 0x7fc1900051c0 2023-09-30T23:04:40.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.789+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1a80cc340 con 0x7fc1900051c0 2023-09-30T23:04:40.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.790+0000 7fc18ffff700 1 -- 172.21.15.142:0/2188814712 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fc198054f00 con 0x7fc1900051c0 2023-09-30T23:04:40.790 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:40.790 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:40.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc194067330 msgr2=0x7fc1940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc194067330 0x7fc1940697e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc19c007e20 tx=0x7fc19c009040 comp rx=0 tx=0).stop 2023-09-30T23:04:40.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 msgr2=0x7fc1a816aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:40.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc1a816aab0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fc198000e10 tx=0x7fc198001e70 comp rx=0 tx=0).stop 2023-09-30T23:04:40.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 shutdown_connections 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc194067330 0x7fc1940697e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a80a7c60 0x7fc1a80a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1900051c0 0x7fc1a816aab0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 --2- 172.21.15.142:0/2188814712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1a815b190 0x7fc1a815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 >> 172.21.15.142:0/2188814712 conn(0x7fc1a80ce8e0 msgr2=0x7fc1a806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.792+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 shutdown_connections 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.793+0000 7fc1ae5ff700 1 -- 172.21.15.142:0/2188814712 wait complete. 2023-09-30T23:04:40.793 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:40.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:04:40.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.999+0000 7f79069ff700 1 Processor -- start 2023-09-30T23:04:40.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:40.999+0000 7f79069ff700 1 -- start start 2023-09-30T23:04:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.000+0000 7f79069ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.000+0000 7f79069ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79000b0ee0 con 0x7f790015a2a0 2023-09-30T23:04:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.000+0000 7f79069ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79000b02d0 con 0x7f790006f190 2023-09-30T23:04:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.000+0000 7f79069ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79000aefc0 con 0x7f79000aebf0 2023-09-30T23:04:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.000+0000 7f7904f9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f790015a2a0 0x7f7900069f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42752/0 (socket says 172.21.15.142:42752) 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.000+0000 7f7904f9c700 1 -- 172.21.15.142:0/1710850568 learned_addr learned my addr 172.21.15.142:0/1710850568 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78fffff700 1 --2- 172.21.15.142:0/1710850568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78feffd700 1 -- 172.21.15.142:0/1710850568 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729990543 0 0) 0x7f79000b0ee0 con 0x7f790015a2a0 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78feffd700 1 -- 172.21.15.142:0/1710850568 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e8003570 con 0x7f790015a2a0 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78feffd700 1 -- 172.21.15.142:0/1710850568 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945647302 0 0) 0x7f79000b02d0 con 0x7f790006f190 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78feffd700 1 -- 172.21.15.142:0/1710850568 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79000b0ee0 con 0x7f790006f190 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78fffff700 1 -- 172.21.15.142:0/1710850568 >> v1:172.21.15.148:6789/0 conn(0x7f790006f190 legacy=0x7f7900159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78fffff700 1 -- 172.21.15.142:0/1710850568 >> v1:172.21.15.142:6789/0 conn(0x7f790015a2a0 legacy=0x7f7900069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78fffff700 1 -- 172.21.15.142:0/1710850568 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000b05b0 con 0x7f79000aebf0 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.001+0000 7f78fffff700 1 --2- 172.21.15.142:0/1710850568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790006ec50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009910 tx=0x7f78f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2128fb7b0e8947de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f78feffd700 1 -- 172.21.15.142:0/1710850568 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0011630 con 0x7f79000aebf0 2023-09-30T23:04:41.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f78feffd700 1 -- 172.21.15.142:0/1710850568 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0011790 con 0x7f79000aebf0 2023-09-30T23:04:41.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f78feffd700 1 -- 172.21.15.142:0/1710850568 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0011b30 con 0x7f79000aebf0 2023-09-30T23:04:41.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f79069ff700 1 -- 172.21.15.142:0/1710850568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 msgr2=0x7f790006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f79069ff700 1 --2- 172.21.15.142:0/1710850568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790006ec50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009910 tx=0x7f78f00091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f79069ff700 1 -- 172.21.15.142:0/1710850568 shutdown_connections 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f79069ff700 1 --2- 172.21.15.142:0/1710850568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790006ec50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f79069ff700 1 -- 172.21.15.142:0/1710850568 >> 172.21.15.142:0/1710850568 conn(0x7f79000680c0 msgr2=0x7f79000c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f79069ff700 1 -- 172.21.15.142:0/1710850568 shutdown_connections 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.002+0000 7f79069ff700 1 -- 172.21.15.142:0/1710850568 wait complete. 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.004+0000 7f79069ff700 1 Processor -- start 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.004+0000 7f79069ff700 1 -- start start 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f79069ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790006f190 0x7f790014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f79069ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f79069ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a2a0 0x7f79000c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f79069ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790015b060 con 0x7f790015a2a0 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f79069ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790015ec30 con 0x7f790006f190 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f79069ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790015e670 con 0x7f79000aebf0 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a2a0 0x7f79000c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a2a0 0x7f79000c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45696/0 (socket says 172.21.15.142:45696) 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 -- 172.21.15.142:0/3029515714 learned_addr learned my addr 172.21.15.142:0/3029515714 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f78fffff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790006f190 0x7f790014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f78ff7fe700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 -- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 msgr2=0x7f790015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 -- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790006f190 msgr2=0x7f790014f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790006f190 0x7f790014f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.005+0000 7f7904f9c700 1 -- 172.21.15.142:0/3029515714 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0009420 con 0x7f790015a2a0 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.006+0000 7f7904f9c700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a2a0 0x7f79000c22b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f78f800cb70 tx=0x7f78f80019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.006+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f800a7e0 con 0x7f790015a2a0 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.006+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f800a960 con 0x7f790015a2a0 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.006+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790015e950 con 0x7f790015a2a0 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.006+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f800ad20 con 0x7f790015a2a0 2023-09-30T23:04:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.006+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790014fb80 con 0x7f790015a2a0 2023-09-30T23:04:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.007+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79000695b0 con 0x7f790015a2a0 2023-09-30T23:04:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.008+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f78f8007300 con 0x7f790015a2a0 2023-09-30T23:04:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.009+0000 7f78e7fff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78ec067330 0x7f78ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.009+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f78f8084e90 con 0x7f790015a2a0 2023-09-30T23:04:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.009+0000 7f78fffff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78ec067330 0x7f78ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.009+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7f78ec06f4f0 con 0x7f790015a2a0 2023-09-30T23:04:41.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.010+0000 7f78fffff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78ec067330 0x7f78ec0697e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009860 tx=0x7f78f0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.013+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f78f8086020 con 0x7f790015a2a0 2023-09-30T23:04:41.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.247+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79000af880 con 0x7f790015a2a0 2023-09-30T23:04:41.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.247+0000 7f78e7fff700 1 -- 172.21.15.142:0/3029515714 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f78f8051d70 con 0x7f790015a2a0 2023-09-30T23:04:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:41.247 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T23:04:09.113309+0000","modified":"2023-09-30T23:04:12.656438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8355":{"gid":8355,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/3975475300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3975475300},{"type":"v1","addr":"172.21.15.148:6835","nonce":3975475300}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78ec067330 msgr2=0x7f78ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78ec067330 0x7f78ec0697e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009860 tx=0x7f78f0017000 comp rx=0 tx=0).stop 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a2a0 msgr2=0x7f79000c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a2a0 0x7f79000c22b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f78f800cb70 tx=0x7f78f80019e0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 shutdown_connections 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f78ec067330 0x7f78ec0697e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a2a0 0x7f79000c22b0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f790006f190 0x7f790014f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 --2- 172.21.15.142:0/3029515714 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79000aebf0 0x7f790015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 >> 172.21.15.142:0/3029515714 conn(0x7f79000680c0 msgr2=0x7f790006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:41.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 shutdown_connections 2023-09-30T23:04:41.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.250+0000 7f79069ff700 1 -- 172.21.15.142:0/3029515714 wait complete. 2023-09-30T23:04:41.251 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 91 2023-09-30T23:04:41.267 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.460+0000 7fb477dff700 1 Processor -- start 2023-09-30T23:04:41.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.461+0000 7fb477dff700 1 -- start start 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb477dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb4700af020 0x7fb470156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb477dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700b00d0 0x7fb47006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb477dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47006d3e0 con 0x7fb47006e650 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb477dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47015b400 con 0x7fb4700af020 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb477dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47006dc80 con 0x7fb4700b00d0 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb47539a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700b00d0 0x7fb47006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb47639c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb47006e650 0x7fb4700b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:35518/0 (socket says 172.21.15.142:35518) 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb47639c700 1 -- 172.21.15.142:0/567206581 learned_addr learned my addr 172.21.15.142:0/567206581 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.462+0000 7fb475b9b700 1 --2- 172.21.15.142:0/567206581 >> v2:172.21.15.148:3300/0 conn(0x7fb4700af020 0x7fb470156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb475b9b700 1 -- 172.21.15.142:0/567206581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700b00d0 msgr2=0x7fb47006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb475b9b700 1 --2- 172.21.15.142:0/567206581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700b00d0 0x7fb47006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb475b9b700 1 -- 172.21.15.142:0/567206581 >> v1:172.21.15.148:6789/0 conn(0x7fb47006e650 legacy=0x7fb4700b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb475b9b700 1 -- 172.21.15.142:0/567206581 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47006b790 con 0x7fb4700af020 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb475b9b700 1 --2- 172.21.15.142:0/567206581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4700af020 0x7fb470156d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098e0 tx=0x7fb46c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6addca4663cf5f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb474b99700 1 -- 172.21.15.142:0/567206581 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00b640 con 0x7fb4700af020 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb474b99700 1 -- 172.21.15.142:0/567206581 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c00b7a0 con 0x7fb4700af020 2023-09-30T23:04:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.463+0000 7fb474b99700 1 -- 172.21.15.142:0/567206581 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00bb40 con 0x7fb4700af020 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 -- 172.21.15.142:0/567206581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4700af020 msgr2=0x7fb470156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 --2- 172.21.15.142:0/567206581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4700af020 0x7fb470156d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098e0 tx=0x7fb46c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 -- 172.21.15.142:0/567206581 shutdown_connections 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 --2- 172.21.15.142:0/567206581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4700af020 0x7fb470156d80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 --2- 172.21.15.142:0/567206581 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700b00d0 0x7fb47006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 -- 172.21.15.142:0/567206581 >> 172.21.15.142:0/567206581 conn(0x7fb4700680c0 msgr2=0x7fb4700c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 -- 172.21.15.142:0/567206581 shutdown_connections 2023-09-30T23:04:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.464+0000 7fb477dff700 1 -- 172.21.15.142:0/567206581 wait complete. 2023-09-30T23:04:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.465+0000 7fb477dff700 1 Processor -- start 2023-09-30T23:04:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.466+0000 7fb477dff700 1 -- start start 2023-09-30T23:04:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.466+0000 7fb477dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb47006e650 0x7fb4700addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.466+0000 7fb477dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700af020 0x7fb47016b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb477dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4700b00d0 0x7fb4700a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb477dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb470159290 con 0x7fb4700b00d0 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb477dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb470159b30 con 0x7fb47006e650 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb477dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47016bd90 con 0x7fb4700af020 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4700b00d0 0x7fb4700a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4700b00d0 0x7fb4700a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45708/0 (socket says 172.21.15.142:45708) 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 -- 172.21.15.142:0/211335926 learned_addr learned my addr 172.21.15.142:0/211335926 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb475b9b700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb47006e650 0x7fb4700addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47539a700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700af020 0x7fb47016b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 -- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700af020 msgr2=0x7fb47016b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700af020 0x7fb47016b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 -- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb47006e650 msgr2=0x7fb4700addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb47006e650 0x7fb4700addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb47639c700 1 -- 172.21.15.142:0/211335926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c009420 con 0x7fb4700b00d0 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.467+0000 7fb475b9b700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb47006e650 0x7fb4700addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.468+0000 7fb47639c700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4700b00d0 0x7fb4700a63d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb46800cbc0 tx=0x7fb4680019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.468+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800a7e0 con 0x7fb4700b00d0 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.468+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46800a940 con 0x7fb4700b00d0 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.468+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800acc0 con 0x7fb4700b00d0 2023-09-30T23:04:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.468+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4700a6d40 con 0x7fb4700b00d0 2023-09-30T23:04:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.468+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4701597c0 con 0x7fb4700b00d0 2023-09-30T23:04:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.469+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb470159ca0 con 0x7fb4700b00d0 2023-09-30T23:04:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.470+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb468007300 con 0x7fb4700b00d0 2023-09-30T23:04:41.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.471+0000 7fb465ffb700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb454067330 0x7fb4540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.471+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb468084e90 con 0x7fb4700b00d0 2023-09-30T23:04:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.471+0000 7fb475b9b700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb454067330 0x7fb4540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.471+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7fb45406f4f0 con 0x7fb4700b00d0 2023-09-30T23:04:41.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.472+0000 7fb475b9b700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb454067330 0x7fb4540697e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0093f0 tx=0x7fb46c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.475+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb468086070 con 0x7fb4700b00d0 2023-09-30T23:04:41.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.668+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb47006fc10 con 0x7fb4700b00d0 2023-09-30T23:04:41.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.669+0000 7fb465ffb700 1 -- 172.21.15.142:0/211335926 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+17052 (secure 0 0 0) 0x7fb468051ce0 con 0x7fb4700b00d0 2023-09-30T23:04:41.669 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:41.669 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":196,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:39.403740+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-09-30T23:04:06.673268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-09-30T23:04:08.101636+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:41.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb454067330 msgr2=0x7fb4540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb454067330 0x7fb4540697e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0093f0 tx=0x7fb46c017000 comp rx=0 tx=0).stop 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4700b00d0 msgr2=0x7fb4700a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4700b00d0 0x7fb4700a63d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb46800cbc0 tx=0x7fb4680019c0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 shutdown_connections 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb454067330 0x7fb4540697e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4700b00d0 0x7fb4700a63d0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb47006e650 0x7fb4700addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 --2- 172.21.15.142:0/211335926 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb4700af020 0x7fb47016b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 >> 172.21.15.142:0/211335926 conn(0x7fb4700680c0 msgr2=0x7fb4700ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 shutdown_connections 2023-09-30T23:04:41.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.672+0000 7fb477dff700 1 -- 172.21.15.142:0/211335926 wait complete. 2023-09-30T23:04:41.689 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T23:04:41.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.880+0000 7eff9a1ff700 1 Processor -- start 2023-09-30T23:04:41.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.880+0000 7eff9a1ff700 1 -- start start 2023-09-30T23:04:41.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.881+0000 7eff9a1ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff94159b50 0x7eff940a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff9a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940ac3a0 0x7eff940aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff9a1ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff94068000 con 0x7eff940aa7e0 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff9a1ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff94069f10 con 0x7eff94159b50 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff9a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940aac30 con 0x7eff940ac3a0 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff937fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff94159b50 0x7eff940a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff937fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff94159b50 0x7eff940a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45722/0 (socket says 172.21.15.142:45722) 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff93fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7eff940aa7e0 0x7eff9406a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42756/0 (socket says 172.21.15.142:42756) 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff937fe700 1 -- 172.21.15.142:0/4246075906 learned_addr learned my addr 172.21.15.142:0/4246075906 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff92ffd700 1 --2- 172.21.15.142:0/4246075906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940ac3a0 0x7eff940aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff937fe700 1 -- 172.21.15.142:0/4246075906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940ac3a0 msgr2=0x7eff940aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff937fe700 1 --2- 172.21.15.142:0/4246075906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940ac3a0 0x7eff940aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff937fe700 1 -- 172.21.15.142:0/4246075906 >> v1:172.21.15.142:6789/0 conn(0x7eff940aa7e0 legacy=0x7eff9406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff937fe700 1 -- 172.21.15.142:0/4246075906 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940a9e00 con 0x7eff94159b50 2023-09-30T23:04:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff927fc700 1 -- 172.21.15.142:0/4246075906 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359831800 0 0) 0x7eff8c001490 con 0x7eff940aa7e0 2023-09-30T23:04:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.882+0000 7eff92ffd700 1 --2- 172.21.15.142:0/4246075906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940ac3a0 0x7eff940aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff937fe700 1 --2- 172.21.15.142:0/4246075906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff94159b50 0x7eff940a98c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7eff840099b0 tx=0x7eff84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc0cf4657ce66b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff927fc700 1 -- 172.21.15.142:0/4246075906 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400b860 con 0x7eff94159b50 2023-09-30T23:04:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff927fc700 1 -- 172.21.15.142:0/4246075906 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400b9c0 con 0x7eff94159b50 2023-09-30T23:04:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff927fc700 1 -- 172.21.15.142:0/4246075906 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400bd60 con 0x7eff94159b50 2023-09-30T23:04:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff9a1ff700 1 -- 172.21.15.142:0/4246075906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff94159b50 msgr2=0x7eff940a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/4246075906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff94159b50 0x7eff940a98c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7eff840099b0 tx=0x7eff84009250 comp rx=0 tx=0).stop 2023-09-30T23:04:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff9a1ff700 1 -- 172.21.15.142:0/4246075906 shutdown_connections 2023-09-30T23:04:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/4246075906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff94159b50 0x7eff940a98c0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/4246075906 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940ac3a0 0x7eff940aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.883+0000 7eff9a1ff700 1 -- 172.21.15.142:0/4246075906 >> 172.21.15.142:0/4246075906 conn(0x7eff9406dab0 msgr2=0x7eff940aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.884+0000 7eff9a1ff700 1 -- 172.21.15.142:0/4246075906 shutdown_connections 2023-09-30T23:04:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.884+0000 7eff9a1ff700 1 -- 172.21.15.142:0/4246075906 wait complete. 2023-09-30T23:04:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.886+0000 7eff9a1ff700 1 Processor -- start 2023-09-30T23:04:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.886+0000 7eff9a1ff700 1 -- start start 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff9a1ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940aa7e0 0x7eff9414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff9a1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff940ac3a0 0x7eff9416df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff9a1ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff94159b50 0x7eff9415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff9a1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940ae550 con 0x7eff940ac3a0 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff9a1ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940ad9d0 con 0x7eff94159b50 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff9a1ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940adcb0 con 0x7eff940aa7e0 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff92ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff940ac3a0 0x7eff9416df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff92ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff940ac3a0 0x7eff9416df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45724/0 (socket says 172.21.15.142:45724) 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff92ffd700 1 -- 172.21.15.142:0/2089190298 learned_addr learned my addr 172.21.15.142:0/2089190298 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff93fff700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff94159b50 0x7eff9415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.887+0000 7eff937fe700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940aa7e0 0x7eff9414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff92ffd700 1 -- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940aa7e0 msgr2=0x7eff9414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff92ffd700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940aa7e0 0x7eff9414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff92ffd700 1 -- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff94159b50 msgr2=0x7eff9415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff92ffd700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff94159b50 0x7eff9415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff92ffd700 1 -- 172.21.15.142:0/2089190298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840094f0 con 0x7eff940ac3a0 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff92ffd700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff940ac3a0 0x7eff9416df10 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c830 tx=0x7eff88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011600 con 0x7eff940ac3a0 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88011760 con 0x7eff940ac3a0 2023-09-30T23:04:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011b20 con 0x7eff940ac3a0 2023-09-30T23:04:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff940adf90 con 0x7eff940ac3a0 2023-09-30T23:04:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.888+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9416d9f0 con 0x7eff940ac3a0 2023-09-30T23:04:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.889+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9416d850 con 0x7eff940ac3a0 2023-09-30T23:04:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.890+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff8800a3e0 con 0x7eff940ac3a0 2023-09-30T23:04:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.891+0000 7eff7b7fe700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff80067330 0x7eff800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.891+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff880850c0 con 0x7eff940ac3a0 2023-09-30T23:04:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.891+0000 7eff937fe700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff80067330 0x7eff800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.891+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7eff8006f4f0 con 0x7eff940ac3a0 2023-09-30T23:04:41.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.892+0000 7eff937fe700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff80067330 0x7eff800697e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7eff840099b0 tx=0x7eff84017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:41.895+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7eff9416d850 con 0x7eff940ac3a0 2023-09-30T23:04:42.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.125+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7eff9416d850 con 0x7eff940ac3a0 2023-09-30T23:04:42.125 INFO:tasks.ceph.mon.a.smithi142.stderr:2023-09-30T23:04:42.125+0000 7fdac25f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T23:04:42.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.130+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(197..197 src has 1..197) v4 ==== 366+0+0 (secure 0 0 0) 0x7eff88055be0 con 0x7eff940ac3a0 2023-09-30T23:04:42.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.130+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7eff8006fe40 con 0x7eff940ac3a0 2023-09-30T23:04:42.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.132+0000 7eff7b7fe700 1 -- 172.21.15.142:0/2089190298 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) v1 ==== 161+0+0 (secure 0 0 0) 0x7eff8801f020 con 0x7eff940ac3a0 2023-09-30T23:04:42.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff80067330 msgr2=0x7eff800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:42.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff80067330 0x7eff800697e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7eff840099b0 tx=0x7eff84017000 comp rx=0 tx=0).stop 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff940ac3a0 msgr2=0x7eff9416df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff940ac3a0 0x7eff9416df10 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c830 tx=0x7eff88008040 comp rx=0 tx=0).stop 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 shutdown_connections 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7eff80067330 0x7eff800697e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff94159b50 0x7eff9415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff940aa7e0 0x7eff9414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 --2- 172.21.15.142:0/2089190298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff940ac3a0 0x7eff9416df10 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 >> 172.21.15.142:0/2089190298 conn(0x7eff9406dab0 msgr2=0x7eff9414e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 shutdown_connections 2023-09-30T23:04:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.136+0000 7eff9a1ff700 1 -- 172.21.15.142:0/2089190298 wait complete. 2023-09-30T23:04:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T23:04:42.140 INFO:tasks.ceph.mds.d.smithi148.stderr: -8603> 2023-09-30T23:04:02.929+0000 7f72d0ffd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-09-30T23:04:42.143 INFO:tasks.ceph.mds.d.smithi148.stderr: -7456> 2023-09-30T23:04:13.613+0000 7f72caff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T23:04:42.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T23:04:42.193 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-09-30T23:04:42.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.346+0000 7fdc73bff700 1 Processor -- start 2023-09-30T23:04:42.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.346+0000 7fdc73bff700 1 -- start start 2023-09-30T23:04:42.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc73bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c150600 0x7fdc6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:42.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc73bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc6c1509d0 0x7fdc6c06ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:42.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc73bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdc6c15a920 0x7fdc6c156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:42.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc73bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c0cc320 con 0x7fdc6c1509d0 2023-09-30T23:04:42.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc73bff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c1576e0 con 0x7fdc6c15a920 2023-09-30T23:04:42.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc73bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c15a490 con 0x7fdc6c150600 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc7119a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc6c1509d0 0x7fdc6c06ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc7199b700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c150600 0x7fdc6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc7119a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc6c1509d0 0x7fdc6c06ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45738/0 (socket says 172.21.15.142:45738) 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc7119a700 1 -- 172.21.15.142:0/2337799439 learned_addr learned my addr 172.21.15.142:0/2337799439 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc7219c700 1 --2- 172.21.15.142:0/2337799439 >> v2:172.21.15.148:3300/0 conn(0x7fdc6c15a920 0x7fdc6c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc7219c700 1 -- 172.21.15.142:0/2337799439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c150600 msgr2=0x7fdc6c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.348+0000 7fdc7219c700 1 --2- 172.21.15.142:0/2337799439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c150600 0x7fdc6c06a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc7219c700 1 -- 172.21.15.142:0/2337799439 >> v2:172.21.15.142:3300/0 conn(0x7fdc6c1509d0 msgr2=0x7fdc6c06ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc7219c700 1 --2- 172.21.15.142:0/2337799439 >> v2:172.21.15.142:3300/0 conn(0x7fdc6c1509d0 0x7fdc6c06ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc7219c700 1 -- 172.21.15.142:0/2337799439 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c157400 con 0x7fdc6c15a920 2023-09-30T23:04:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc7119a700 1 --2- 172.21.15.142:0/2337799439 >> v2:172.21.15.142:3300/0 conn(0x7fdc6c1509d0 0x7fdc6c06ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:42.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc7219c700 1 --2- 172.21.15.142:0/2337799439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 0x7fdc6c156710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c06ba00 tx=0x7fdc64009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=272a20ad60e6a47a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc70999700 1 -- 172.21.15.142:0/2337799439 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400e070 con 0x7fdc6c15a920 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc70999700 1 -- 172.21.15.142:0/2337799439 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400bab0 con 0x7fdc6c15a920 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.349+0000 7fdc70999700 1 -- 172.21.15.142:0/2337799439 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400be70 con 0x7fdc6c15a920 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 -- 172.21.15.142:0/2337799439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 msgr2=0x7fdc6c156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 --2- 172.21.15.142:0/2337799439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 0x7fdc6c156710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c06ba00 tx=0x7fdc64009780 comp rx=0 tx=0).stop 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 -- 172.21.15.142:0/2337799439 shutdown_connections 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 --2- 172.21.15.142:0/2337799439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 0x7fdc6c156710 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 --2- 172.21.15.142:0/2337799439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c150600 0x7fdc6c06a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 --2- 172.21.15.142:0/2337799439 >> v2:172.21.15.142:3300/0 conn(0x7fdc6c1509d0 0x7fdc6c06ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 -- 172.21.15.142:0/2337799439 >> 172.21.15.142:0/2337799439 conn(0x7fdc6c0cc670 msgr2=0x7fdc6c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 -- 172.21.15.142:0/2337799439 shutdown_connections 2023-09-30T23:04:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.350+0000 7fdc73bff700 1 -- 172.21.15.142:0/2337799439 wait complete. 2023-09-30T23:04:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.352+0000 7fdc73bff700 1 Processor -- start 2023-09-30T23:04:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.352+0000 7fdc73bff700 1 -- start start 2023-09-30T23:04:42.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.353+0000 7fdc73bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c150600 0x7fdc6c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:42.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.353+0000 7fdc73bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c1509d0 0x7fdc6c140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:42.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.353+0000 7fdc73bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 0x7fdc6c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:42.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.353+0000 7fdc73bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c1406a0 con 0x7fdc6c150600 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.353+0000 7fdc73bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c140fc0 con 0x7fdc6c15a920 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.353+0000 7fdc73bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c1412a0 con 0x7fdc6c1509d0 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c150600 0x7fdc6c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c150600 0x7fdc6c0c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45742/0 (socket says 172.21.15.142:45742) 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 -- 172.21.15.142:0/570584403 learned_addr learned my addr 172.21.15.142:0/570584403 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7219c700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 0x7fdc6c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7119a700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c1509d0 0x7fdc6c140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 -- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c1509d0 msgr2=0x7fdc6c140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c1509d0 0x7fdc6c140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 -- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 msgr2=0x7fdc6c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 0x7fdc6c0c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 -- 172.21.15.142:0/570584403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c00b790 con 0x7fdc6c150600 2023-09-30T23:04:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc7199b700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c150600 0x7fdc6c0c60a0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800ec80 tx=0x7fdc680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.354+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800c850 con 0x7fdc6c150600 2023-09-30T23:04:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.355+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800c9b0 con 0x7fdc6c150600 2023-09-30T23:04:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.355+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc64009a20 con 0x7fdc6c150600 2023-09-30T23:04:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.355+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800cd50 con 0x7fdc6c150600 2023-09-30T23:04:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.355+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c141860 con 0x7fdc6c150600 2023-09-30T23:04:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.356+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c141eb0 con 0x7fdc6c150600 2023-09-30T23:04:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.357+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdc68013680 con 0x7fdc6c150600 2023-09-30T23:04:42.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.358+0000 7fdc61ffb700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.358+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fdc68085670 con 0x7fdc6c150600 2023-09-30T23:04:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.358+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7fdc5006f590 con 0x7fdc6c150600 2023-09-30T23:04:42.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.358+0000 7fdc7119a700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.359+0000 7fdc7119a700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00b240 tx=0x7fdc5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:42.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.361+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdc6805b030 con 0x7fdc6c150600 2023-09-30T23:04:42.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:42.597+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdc6c06fc10 con 0x7fdc6c150600 2023-09-30T23:04:43.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.138+0000 7fdc61ffb700 1 -- 172.21.15.142:0/570584403 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc680210a0 con 0x7fdc6c150600 2023-09-30T23:04:43.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 msgr2=0x7fdc500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:43.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00b240 tx=0x7fdc5c008040 comp rx=0 tx=0).stop 2023-09-30T23:04:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c150600 msgr2=0x7fdc6c0c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c150600 0x7fdc6c0c60a0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800ec80 tx=0x7fdc680091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 shutdown_connections 2023-09-30T23:04:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fdc50067330 0x7fdc500697e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc6c15a920 0x7fdc6c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6c150600 0x7fdc6c0c60a0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 --2- 172.21.15.142:0/570584403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc6c1509d0 0x7fdc6c140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 >> 172.21.15.142:0/570584403 conn(0x7fdc6c0cc670 msgr2=0x7fdc6c0c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 shutdown_connections 2023-09-30T23:04:43.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.141+0000 7fdc73bff700 1 -- 172.21.15.142:0/570584403 wait complete. 2023-09-30T23:04:43.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T23:04:43.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.353+0000 7fa4ab7ff700 1 Processor -- start 2023-09-30T23:04:43.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.353+0000 7fa4ab7ff700 1 -- start start 2023-09-30T23:04:43.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.354+0000 7fa4ab7ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4a40ca5e0 0x7fa4a40686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:43.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.354+0000 7fa4ab7ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4a4159de0 0x7fa4a4068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:43.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.354+0000 7fa4ab7ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a4068230 con 0x7fa4a4159a10 2023-09-30T23:04:43.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.354+0000 7fa4ab7ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a4067620 con 0x7fa4a40ca5e0 2023-09-30T23:04:43.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.354+0000 7fa4ab7ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a4067900 con 0x7fa4a4159de0 2023-09-30T23:04:43.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4a40ca5e0 0x7fa4a40686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:43.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4a40ca5e0 0x7fa4a40686c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45744/0 (socket says 172.21.15.142:45744) 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/148119281 learned_addr learned my addr 172.21.15.142:0/148119281 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/148119281 >> v2:172.21.15.148:3300/0 conn(0x7fa4a4159de0 msgr2=0x7fa4a4068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a9d9c700 1 --2- 172.21.15.142:0/148119281 >> v2:172.21.15.148:3300/0 conn(0x7fa4a4159de0 0x7fa4a4068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 --2- 172.21.15.142:0/148119281 >> v2:172.21.15.148:3300/0 conn(0x7fa4a4159de0 0x7fa4a4068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/148119281 >> v1:172.21.15.148:6789/0 conn(0x7fa4a4159a10 legacy=0x7fa4a40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/148119281 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4067be0 con 0x7fa4a40ca5e0 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a9d9c700 1 --2- 172.21.15.142:0/148119281 >> v2:172.21.15.148:3300/0 conn(0x7fa4a4159de0 0x7fa4a4068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.355+0000 7fa4a8d9a700 1 --2- 172.21.15.142:0/148119281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a40ca5e0 0x7fa4a40686c0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40c8e30 tx=0x7fa494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e4cd3597286431 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa49bfff700 1 -- 172.21.15.142:0/148119281 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400b820 con 0x7fa4a40ca5e0 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa49bfff700 1 -- 172.21.15.142:0/148119281 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49400b980 con 0x7fa4a40ca5e0 2023-09-30T23:04:43.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa49bfff700 1 -- 172.21.15.142:0/148119281 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400bd20 con 0x7fa4a40ca5e0 2023-09-30T23:04:43.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/148119281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a40ca5e0 msgr2=0x7fa4a40686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:43.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/148119281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a40ca5e0 0x7fa4a40686c0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40c8e30 tx=0x7fa494009250 comp rx=0 tx=0).stop 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/148119281 shutdown_connections 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/148119281 >> v2:172.21.15.148:3300/0 conn(0x7fa4a4159de0 0x7fa4a4068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/148119281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a40ca5e0 0x7fa4a40686c0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/148119281 >> 172.21.15.142:0/148119281 conn(0x7fa4a40cb2f0 msgr2=0x7fa4a40cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/148119281 shutdown_connections 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.356+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/148119281 wait complete. 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.358+0000 7fa4ab7ff700 1 Processor -- start 2023-09-30T23:04:43.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.358+0000 7fa4ab7ff700 1 -- start start 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4ab7ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4a40ca5e0 0x7fa4a41458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4ab7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a4159a10 0x7fa4a40c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4ab7ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a4159de0 0x7fa4a40c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4ab7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a40c6ee0 con 0x7fa4a4159a10 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4ab7ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a40c65f0 con 0x7fa4a4159de0 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4ab7ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a40c6890 con 0x7fa4a40ca5e0 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a4159a10 0x7fa4a40c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a4159a10 0x7fa4a40c2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45754/0 (socket says 172.21.15.142:45754) 2023-09-30T23:04:43.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/753641505 learned_addr learned my addr 172.21.15.142:0/753641505 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/753641505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4a40ca5e0 msgr2=0x7fa4a41458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4a40ca5e0 0x7fa4a41458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/753641505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a4159de0 msgr2=0x7fa4a40c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a4159de0 0x7fa4a40c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.359+0000 7fa4a8d9a700 1 -- 172.21.15.142:0/753641505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940094f0 con 0x7fa4a4159a10 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.360+0000 7fa4a8d9a700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a4159a10 0x7fa4a40c2100 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa4940030c0 tx=0x7fa494016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.360+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494011e60 con 0x7fa4a4159a10 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.360+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494020070 con 0x7fa4a4159a10 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.360+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49401b6a0 con 0x7fa4a4159a10 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.360+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a40c6b70 con 0x7fa4a4159a10 2023-09-30T23:04:43.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.360+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a4145e10 con 0x7fa4a4159a10 2023-09-30T23:04:43.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.361+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a406e4b0 con 0x7fa4a4159a10 2023-09-30T23:04:43.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.362+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa494022030 con 0x7fa4a4159a10 2023-09-30T23:04:43.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.363+0000 7fa4997fa700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa488067330 0x7fa4880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:43.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.363+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa494086ca0 con 0x7fa4a4159a10 2023-09-30T23:04:43.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.363+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7fa48806f590 con 0x7fa4a4159a10 2023-09-30T23:04:43.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.363+0000 7fa4a959b700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa488067330 0x7fa4880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:43.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.363+0000 7fa4a959b700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa488067330 0x7fa4880697e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0007fd0 tx=0x7fa4a0007b20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:43.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.367+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa494053ad0 con 0x7fa4a4159a10 2023-09-30T23:04:43.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:43.559+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4a406e4b0 con 0x7fa4a4159a10 2023-09-30T23:04:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.515+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(198..198 src has 1..198) v4 ==== 288+0+0 (secure 0 0 0) 0x7fa494057e90 con 0x7fa4a4159a10 2023-09-30T23:04:44.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.515+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7fa48806d9c0 con 0x7fa4a4159a10 2023-09-30T23:04:44.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.517+0000 7fa4997fa700 1 -- 172.21.15.142:0/753641505 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v198) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa4940570f0 con 0x7fa4a4159a10 2023-09-30T23:04:44.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.520+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa488067330 msgr2=0x7fa4880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:44.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.520+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa488067330 0x7fa4880697e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0007fd0 tx=0x7fa4a0007b20 comp rx=0 tx=0).stop 2023-09-30T23:04:44.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.520+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a4159a10 msgr2=0x7fa4a40c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:44.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.520+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a4159a10 0x7fa4a40c2100 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa4940030c0 tx=0x7fa494016000 comp rx=0 tx=0).stop 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 shutdown_connections 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa488067330 0x7fa4880697e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a4159de0 0x7fa4a40c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4a40ca5e0 0x7fa4a41458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 --2- 172.21.15.142:0/753641505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a4159a10 0x7fa4a40c2100 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 >> 172.21.15.142:0/753641505 conn(0x7fa4a40cb2f0 msgr2=0x7fa4a40b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 shutdown_connections 2023-09-30T23:04:44.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.521+0000 7fa4ab7ff700 1 -- 172.21.15.142:0/753641505 wait complete. 2023-09-30T23:04:44.525 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-30T23:04:44.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T23:04:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.743+0000 7fa5857ff700 1 Processor -- start 2023-09-30T23:04:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.743+0000 7fa5857ff700 1 -- start start 2023-09-30T23:04:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.744+0000 7fa5857ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa580159a10 0x7fa5800c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.744+0000 7fa5857ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa580159de0 0x7fa5800ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.744+0000 7fa5857ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa580068230 con 0x7fa5800b1aa0 2023-09-30T23:04:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.744+0000 7fa5857ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5800696d0 con 0x7fa580159de0 2023-09-30T23:04:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.744+0000 7fa5857ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa580067620 con 0x7fa580159a10 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa580159de0 0x7fa5800ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa580159de0 0x7fa5800ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45766/0 (socket says 172.21.15.142:45766) 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 -- 172.21.15.142:0/160369978 learned_addr learned my addr 172.21.15.142:0/160369978 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57effd700 1 --2- 172.21.15.142:0/160369978 >> v2:172.21.15.148:3300/0 conn(0x7fa580159a10 0x7fa5800c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 -- 172.21.15.142:0/160369978 >> v2:172.21.15.148:3300/0 conn(0x7fa580159a10 msgr2=0x7fa5800c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 --2- 172.21.15.142:0/160369978 >> v2:172.21.15.148:3300/0 conn(0x7fa580159a10 0x7fa5800c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 -- 172.21.15.142:0/160369978 >> v1:172.21.15.148:6789/0 conn(0x7fa5800b1aa0 legacy=0x7fa58015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 -- 172.21.15.142:0/160369978 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580067900 con 0x7fa580159de0 2023-09-30T23:04:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57dffb700 1 -- 172.21.15.142:0/160369978 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000563711 0 0) 0x7fa580068230 con 0x7fa5800b1aa0 2023-09-30T23:04:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.745+0000 7fa57e7fc700 1 --2- 172.21.15.142:0/160369978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159de0 0x7fa5800ca410 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa58006c820 tx=0x7fa574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7e52537ea85ed8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa57dffb700 1 -- 172.21.15.142:0/160369978 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574009e70 con 0x7fa580159de0 2023-09-30T23:04:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa57dffb700 1 -- 172.21.15.142:0/160369978 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57400b860 con 0x7fa580159de0 2023-09-30T23:04:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa57dffb700 1 -- 172.21.15.142:0/160369978 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400bc00 con 0x7fa580159de0 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 -- 172.21.15.142:0/160369978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159de0 msgr2=0x7fa5800ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 --2- 172.21.15.142:0/160369978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159de0 0x7fa5800ca410 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa58006c820 tx=0x7fa574009250 comp rx=0 tx=0).stop 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 -- 172.21.15.142:0/160369978 shutdown_connections 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 --2- 172.21.15.142:0/160369978 >> v2:172.21.15.148:3300/0 conn(0x7fa580159a10 0x7fa5800c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 --2- 172.21.15.142:0/160369978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159de0 0x7fa5800ca410 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 -- 172.21.15.142:0/160369978 >> 172.21.15.142:0/160369978 conn(0x7fa5800cb2f0 msgr2=0x7fa5800cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 -- 172.21.15.142:0/160369978 shutdown_connections 2023-09-30T23:04:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.746+0000 7fa5857ff700 1 -- 172.21.15.142:0/160369978 wait complete. 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.748+0000 7fa5857ff700 1 Processor -- start 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.748+0000 7fa5857ff700 1 -- start start 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa5857ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5800b1aa0 0x7fa58015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa5857ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159a10 0x7fa58016e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa5857ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa580159de0 0x7fa580157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa5857ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800a9b70 con 0x7fa580159a10 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa5857ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58016eaa0 con 0x7fa580159de0 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa5857ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58015cac0 con 0x7fa5800b1aa0 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa57e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159a10 0x7fa58016e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa57e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159a10 0x7fa58016e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45774/0 (socket says 172.21.15.142:45774) 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa57e7fc700 1 -- 172.21.15.142:0/2928026221 learned_addr learned my addr 172.21.15.142:0/2928026221 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa57effd700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5800b1aa0 0x7fa58015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.749+0000 7fa57f7fe700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa580159de0 0x7fa580157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa57e7fc700 1 -- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5800b1aa0 msgr2=0x7fa58015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa57e7fc700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5800b1aa0 0x7fa58015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa57e7fc700 1 -- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa580159de0 msgr2=0x7fa580157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa57e7fc700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa580159de0 0x7fa580157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa57e7fc700 1 -- 172.21.15.142:0/2928026221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740094f0 con 0x7fa580159a10 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa57f7fe700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa580159de0 0x7fa580157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa57e7fc700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159a10 0x7fa58016e560 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fa5740094c0 tx=0x7fa574017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400b9d0 con 0x7fa580159a10 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57400bb30 con 0x7fa580159a10 2023-09-30T23:04:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58015cda0 con 0x7fa580159a10 2023-09-30T23:04:44.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574025670 con 0x7fa580159a10 2023-09-30T23:04:44.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.750+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58015d360 con 0x7fa580159a10 2023-09-30T23:04:44.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.751+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58006e4b0 con 0x7fa580159a10 2023-09-30T23:04:44.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.752+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa574023070 con 0x7fa580159a10 2023-09-30T23:04:44.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.753+0000 7fa566ffd700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa56c067330 0x7fa56c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.753+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fa574085f70 con 0x7fa580159a10 2023-09-30T23:04:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.753+0000 7fa57effd700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa56c067330 0x7fa56c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.753+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7fa56c06e710 con 0x7fa580159a10 2023-09-30T23:04:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.754+0000 7fa57effd700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa56c067330 0x7fa56c0697e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa570009db0 tx=0x7fa5700091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.758+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa574052f30 con 0x7fa580159a10 2023-09-30T23:04:44.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:44.950+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa580067be0 con 0x7fa580159a10 2023-09-30T23:04:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.517+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 7 ==== osd_map(199..199 src has 1..199) v4 ==== 288+0+0 (secure 0 0 0) 0x7fa5740572f0 con 0x7fa580159a10 2023-09-30T23:04:45.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.517+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7fa56c06d4a0 con 0x7fa580159a10 2023-09-30T23:04:45.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.519+0000 7fa566ffd700 1 -- 172.21.15.142:0/2928026221 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v199) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa57402a020 con 0x7fa580159a10 2023-09-30T23:04:45.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.533+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa56c067330 msgr2=0x7fa56c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.533+0000 7fa5857ff700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa56c067330 0x7fa56c0697e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa570009db0 tx=0x7fa5700091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.533+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159a10 msgr2=0x7fa58016e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.533+0000 7fa5857ff700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159a10 0x7fa58016e560 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fa5740094c0 tx=0x7fa574017000 comp rx=0 tx=0).stop 2023-09-30T23:04:45.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.535+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 shutdown_connections 2023-09-30T23:04:45.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.535+0000 7fa5857ff700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa56c067330 0x7fa56c0697e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.535+0000 7fa5857ff700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa580159de0 0x7fa580157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.535+0000 7fa5857ff700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5800b1aa0 0x7fa58015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.535+0000 7fa5857ff700 1 --2- 172.21.15.142:0/2928026221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa580159a10 0x7fa58016e560 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.535+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 >> 172.21.15.142:0/2928026221 conn(0x7fa5800cb2f0 msgr2=0x7fa5800cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.536+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 shutdown_connections 2023-09-30T23:04:45.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.536+0000 7fa5857ff700 1 -- 172.21.15.142:0/2928026221 wait complete. 2023-09-30T23:04:45.537 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-30T23:04:45.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T23:04:45.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.750+0000 7f4892bff700 1 Processor -- start 2023-09-30T23:04:45.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.750+0000 7f4892bff700 1 -- start start 2023-09-30T23:04:45.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.751+0000 7f4892bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 0x7f488c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:45.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.751+0000 7f4892bff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f488c157ab0 0x7f488c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:45.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.751+0000 7f4892bff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0d0550 con 0x7f488c0cc3b0 2023-09-30T23:04:45.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.751+0000 7f4892bff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0cf750 con 0x7f488c157ab0 2023-09-30T23:04:45.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.751+0000 7f4892bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0cf940 con 0x7f488c0cbfe0 2023-09-30T23:04:45.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f488bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f488c0cc3b0 0x7f488c1573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42762/0 (socket says 172.21.15.142:42762) 2023-09-30T23:04:45.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f489119c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f488c157ab0 0x7f488c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f488bfff700 1 -- 172.21.15.142:0/4136122654 learned_addr learned my addr 172.21.15.142:0/4136122654 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f489099b700 1 --2- 172.21.15.142:0/4136122654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 0x7f488c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f489119c700 1 -- 172.21.15.142:0/4136122654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 msgr2=0x7f488c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f489119c700 1 --2- 172.21.15.142:0/4136122654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 0x7f488c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f489119c700 1 -- 172.21.15.142:0/4136122654 >> v1:172.21.15.142:6789/0 conn(0x7f488c0cc3b0 legacy=0x7f488c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f488b7fe700 1 -- 172.21.15.142:0/4136122654 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523666007 0 0) 0x7f488c0d0550 con 0x7f488c0cc3b0 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f489119c700 1 -- 172.21.15.142:0/4136122654 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0cfc20 con 0x7f488c157ab0 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.752+0000 7f489119c700 1 --2- 172.21.15.142:0/4136122654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c0cf210 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f4884009e90 tx=0x7f4884009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8579248492b6b041 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f488b7fe700 1 -- 172.21.15.142:0/4136122654 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400e070 con 0x7f488c157ab0 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f488b7fe700 1 -- 172.21.15.142:0/4136122654 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488400bbf0 con 0x7f488c157ab0 2023-09-30T23:04:45.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f488b7fe700 1 -- 172.21.15.142:0/4136122654 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884012430 con 0x7f488c157ab0 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 -- 172.21.15.142:0/4136122654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 msgr2=0x7f488c0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 --2- 172.21.15.142:0/4136122654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c0cf210 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f4884009e90 tx=0x7f4884009780 comp rx=0 tx=0).stop 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 -- 172.21.15.142:0/4136122654 shutdown_connections 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 --2- 172.21.15.142:0/4136122654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c0cf210 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 --2- 172.21.15.142:0/4136122654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 0x7f488c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 -- 172.21.15.142:0/4136122654 >> 172.21.15.142:0/4136122654 conn(0x7f488c0d0a80 msgr2=0x7f488c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 -- 172.21.15.142:0/4136122654 shutdown_connections 2023-09-30T23:04:45.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.753+0000 7f4892bff700 1 -- 172.21.15.142:0/4136122654 wait complete. 2023-09-30T23:04:45.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.755+0000 7f4892bff700 1 Processor -- start 2023-09-30T23:04:45.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.755+0000 7f4892bff700 1 -- start start 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.756+0000 7f4892bff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 0x7f488c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.756+0000 7f4892bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c0cc3b0 0x7f488c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.756+0000 7f4892bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.756+0000 7f4892bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0c8570 con 0x7f488c157ab0 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.756+0000 7f4892bff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0c8e10 con 0x7f488c0cc3b0 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.756+0000 7f4892bff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c155870 con 0x7f488c0cbfe0 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c1590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45790/0 (socket says 172.21.15.142:45790) 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 -- 172.21.15.142:0/3103529733 learned_addr learned my addr 172.21.15.142:0/3103529733 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 -- 172.21.15.142:0/3103529733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 msgr2=0x7f488c154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 0x7f488c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 -- 172.21.15.142:0/3103529733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c0cc3b0 msgr2=0x7f488c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c0cc3b0 0x7f488c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 -- 172.21.15.142:0/3103529733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009a20 con 0x7f488c157ab0 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f489119c700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c1590a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f488c06cf30 tx=0x7f4884019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f4888ff9700 1 -- 172.21.15.142:0/3103529733 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884009420 con 0x7f488c157ab0 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.757+0000 7f4888ff9700 1 -- 172.21.15.142:0/3103529733 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488401d630 con 0x7f488c157ab0 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.758+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c0c87c0 con 0x7f488c157ab0 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.758+0000 7f4888ff9700 1 -- 172.21.15.142:0/3103529733 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488401d9d0 con 0x7f488c157ab0 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.758+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c155550 con 0x7f488c157ab0 2023-09-30T23:04:45.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.759+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c069770 con 0x7f488c157ab0 2023-09-30T23:04:45.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.760+0000 7f4888ff9700 1 -- 172.21.15.142:0/3103529733 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4884024070 con 0x7f488c157ab0 2023-09-30T23:04:45.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.760+0000 7f4888ff9700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4870067330 0x7f48700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:45.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.761+0000 7f4888ff9700 1 -- 172.21.15.142:0/3103529733 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4884087140 con 0x7f488c157ab0 2023-09-30T23:04:45.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.761+0000 7f489099b700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4870067330 0x7f48700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:45.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.761+0000 7f489099b700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4870067330 0x7f48700697e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4880009bb0 tx=0x7f48800091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:45.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.765+0000 7f4888ff9700 1 -- 172.21.15.142:0/3103529733 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f48840542a0 con 0x7f488c157ab0 2023-09-30T23:04:45.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:45.931 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:45.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.955+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f488c06fc10 con 0x7f488c157ab0 2023-09-30T23:04:45.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.959+0000 7f4888ff9700 1 -- 172.21.15.142:0/3103529733 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f48840578c0 con 0x7f488c157ab0 2023-09-30T23:04:45.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4870067330 msgr2=0x7f48700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4870067330 0x7f48700697e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4880009bb0 tx=0x7f48800091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 msgr2=0x7f488c1590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c1590a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f488c06cf30 tx=0x7f4884019000 comp rx=0 tx=0).stop 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 shutdown_connections 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4870067330 0x7f48700697e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488c157ab0 0x7f488c1590a0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f488c0cbfe0 0x7f488c154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 --2- 172.21.15.142:0/3103529733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c0cc3b0 0x7f488c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 >> 172.21.15.142:0/3103529733 conn(0x7f488c0d0a80 msgr2=0x7f488c155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:45.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 shutdown_connections 2023-09-30T23:04:45.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:45.962+0000 7f4892bff700 1 -- 172.21.15.142:0/3103529733 wait complete. 2023-09-30T23:04:45.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-09-30T23:04:46.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.209+0000 7fa8605ff700 1 Processor -- start 2023-09-30T23:04:46.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.210+0000 7fa8605ff700 1 -- start start 2023-09-30T23:04:46.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa8605ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa858157440 0x7fa858157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa8605ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa8580addb0 0x7fa8580b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa8605ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580ad4a0 con 0x7fa8580ad930 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa8605ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8580ad150 con 0x7fa858157440 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa8605ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85815ac40 con 0x7fa8580addb0 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa85e39b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa858157440 0x7fa858157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa85e39b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa858157440 0x7fa858157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45806/0 (socket says 172.21.15.142:45806) 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa85e39b700 1 -- 172.21.15.142:0/2193219798 learned_addr learned my addr 172.21.15.142:0/2193219798 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.211+0000 7fa85eb9c700 1 --2- 172.21.15.142:0/2193219798 >> v2:172.21.15.148:3300/0 conn(0x7fa8580addb0 0x7fa8580b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85e39b700 1 -- 172.21.15.142:0/2193219798 >> v2:172.21.15.148:3300/0 conn(0x7fa8580addb0 msgr2=0x7fa8580b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85e39b700 1 --2- 172.21.15.142:0/2193219798 >> v2:172.21.15.148:3300/0 conn(0x7fa8580addb0 0x7fa8580b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85e39b700 1 -- 172.21.15.142:0/2193219798 >> v1:172.21.15.148:6789/0 conn(0x7fa8580ad930 legacy=0x7fa85815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85e39b700 1 -- 172.21.15.142:0/2193219798 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85815af20 con 0x7fa858157440 2023-09-30T23:04:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85eb9c700 1 --2- 172.21.15.142:0/2193219798 >> v2:172.21.15.148:3300/0 conn(0x7fa8580addb0 0x7fa8580b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85e39b700 1 --2- 172.21.15.142:0/2193219798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa858157440 0x7fa858157810 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa858069e90 tx=0x7fa854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7d4046941bb80f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85d399700 1 -- 172.21.15.142:0/2193219798 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400b860 con 0x7fa858157440 2023-09-30T23:04:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85d399700 1 -- 172.21.15.142:0/2193219798 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400b9c0 con 0x7fa858157440 2023-09-30T23:04:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.212+0000 7fa85d399700 1 -- 172.21.15.142:0/2193219798 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400bd60 con 0x7fa858157440 2023-09-30T23:04:46.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 -- 172.21.15.142:0/2193219798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa858157440 msgr2=0x7fa858157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:46.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 --2- 172.21.15.142:0/2193219798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa858157440 0x7fa858157810 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa858069e90 tx=0x7fa854009250 comp rx=0 tx=0).stop 2023-09-30T23:04:46.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 -- 172.21.15.142:0/2193219798 shutdown_connections 2023-09-30T23:04:46.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 --2- 172.21.15.142:0/2193219798 >> v2:172.21.15.148:3300/0 conn(0x7fa8580addb0 0x7fa8580b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 --2- 172.21.15.142:0/2193219798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa858157440 0x7fa858157810 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 -- 172.21.15.142:0/2193219798 >> 172.21.15.142:0/2193219798 conn(0x7fa8580ce2c0 msgr2=0x7fa858069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 -- 172.21.15.142:0/2193219798 shutdown_connections 2023-09-30T23:04:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.213+0000 7fa8605ff700 1 -- 172.21.15.142:0/2193219798 wait complete. 2023-09-30T23:04:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.215+0000 7fa8605ff700 1 Processor -- start 2023-09-30T23:04:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.215+0000 7fa8605ff700 1 -- start start 2023-09-30T23:04:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.216+0000 7fa8605ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8580ad930 0x7fa85816a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.216+0000 7fa8605ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8580addb0 0x7fa85816d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.216+0000 7fa8605ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa858157440 0x7fa8581586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.216+0000 7fa8605ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85816a9f0 con 0x7fa8580ad930 2023-09-30T23:04:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.216+0000 7fa8605ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580aa600 con 0x7fa8580addb0 2023-09-30T23:04:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.216+0000 7fa8605ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85816d7b0 con 0x7fa858157440 2023-09-30T23:04:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.216+0000 7fa85e39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8580ad930 0x7fa85816a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8580ad930 0x7fa85816a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45814/0 (socket says 172.21.15.142:45814) 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 -- 172.21.15.142:0/4220349848 learned_addr learned my addr 172.21.15.142:0/4220349848 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85eb9c700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa858157440 0x7fa8581586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85db9a700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8580addb0 0x7fa85816d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 -- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa858157440 msgr2=0x7fa8581586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa858157440 0x7fa8581586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 -- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8580addb0 msgr2=0x7fa85816d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8580addb0 0x7fa85816d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 -- 172.21.15.142:0/4220349848 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540094f0 con 0x7fa8580ad930 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85eb9c700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa858157440 0x7fa8581586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa85e39b700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8580ad930 0x7fa85816a4b0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fa854009290 tx=0x7fa854017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa84e7fc700 1 -- 172.21.15.142:0/4220349848 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854011e60 con 0x7fa8580ad930 2023-09-30T23:04:46.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa84e7fc700 1 -- 172.21.15.142:0/4220349848 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85401a660 con 0x7fa8580ad930 2023-09-30T23:04:46.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa84e7fc700 1 -- 172.21.15.142:0/4220349848 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85401aa20 con 0x7fa8580ad930 2023-09-30T23:04:46.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.217+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa858157ab0 con 0x7fa8580ad930 2023-09-30T23:04:46.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.218+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8580a9cd0 con 0x7fa8580ad930 2023-09-30T23:04:46.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.219+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85806d320 con 0x7fa8580ad930 2023-09-30T23:04:46.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.219+0000 7fa84e7fc700 1 -- 172.21.15.142:0/4220349848 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa85401b430 con 0x7fa8580ad930 2023-09-30T23:04:46.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.221+0000 7fa84e7fc700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa83c067330 0x7fa83c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:46.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.221+0000 7fa84e7fc700 1 -- 172.21.15.142:0/4220349848 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa854086110 con 0x7fa8580ad930 2023-09-30T23:04:46.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.221+0000 7fa85db9a700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa83c067330 0x7fa83c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:46.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.221+0000 7fa85db9a700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa83c067330 0x7fa83c0697e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa8580c26d0 tx=0x7fa848009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:46.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.225+0000 7fa84e7fc700 1 -- 172.21.15.142:0/4220349848 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa854053270 con 0x7fa8580ad930 2023-09-30T23:04:46.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.495+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fa8580b3510 con 0x7fa8580ad930 2023-09-30T23:04:46.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.538+0000 7fa84e7fc700 1 -- 172.21.15.142:0/4220349848 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v586) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa854056890 con 0x7fa8580ad930 2023-09-30T23:04:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa83c067330 msgr2=0x7fa83c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa83c067330 0x7fa83c0697e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa8580c26d0 tx=0x7fa848009040 comp rx=0 tx=0).stop 2023-09-30T23:04:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8580ad930 msgr2=0x7fa85816a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8580ad930 0x7fa85816a4b0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fa854009290 tx=0x7fa854017000 comp rx=0 tx=0).stop 2023-09-30T23:04:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 shutdown_connections 2023-09-30T23:04:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa83c067330 0x7fa83c0697e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa858157440 0x7fa8581586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8580ad930 0x7fa85816a4b0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 --2- 172.21.15.142:0/4220349848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8580addb0 0x7fa85816d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 >> 172.21.15.142:0/4220349848 conn(0x7fa8580ce2c0 msgr2=0x7fa8580af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 shutdown_connections 2023-09-30T23:04:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:46.540+0000 7fa8605ff700 1 -- 172.21.15.142:0/4220349848 wait complete. 2023-09-30T23:04:46.557 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-09-30T23:04:46.558 INFO:tasks.cephfs_test_runner: 2023-09-30T23:04:46.558 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-30T23:04:46.558 INFO:tasks.cephfs_test_runner:Ran 10 tests in 699.317s 2023-09-30T23:04:46.558 INFO:tasks.cephfs_test_runner: 2023-09-30T23:04:46.558 INFO:tasks.cephfs_test_runner:OK 2023-09-30T23:04:46.558 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-09-30T23:04:46.567 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-30T23:04:46.577 INFO:tasks.kclient:Unmounting kernel clients... 2023-09-30T23:04:46.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:46.577 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T23:04:46.624 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T23:04:46.624 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T23:04:46.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:46.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T23:04:46.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:46.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T23:04:46.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:46.769 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-09-30T23:04:46.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:46.886 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-30T23:04:46.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:46.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-09-30T23:04:47.010 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-09-30T23:04:47.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T23:04:47.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:47.013 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T23:04:47.066 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T23:04:47.066 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T23:04:47.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:47.066 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T23:04:47.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:47.142 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T23:04:47.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:47.215 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-09-30T23:04:47.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:47.328 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-09-30T23:04:47.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T23:04:47.381 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-09-30T23:04:47.455 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-09-30T23:04:47.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T23:04:47.458 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T23:04:47.467 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-30T23:04:47.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.659+0000 7fb96bbff700 1 Processor -- start 2023-09-30T23:04:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.659+0000 7fb96bbff700 1 -- start start 2023-09-30T23:04:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.660+0000 7fb96bbff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb96406e820 0x7fb964161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.660+0000 7fb96bbff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96406d3e0 con 0x7fb9640af020 2023-09-30T23:04:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.660+0000 7fb96bbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96406dc80 con 0x7fb9640b00d0 2023-09-30T23:04:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.660+0000 7fb96bbff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96415b400 con 0x7fb96406e820 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb96999b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb9640af020 0x7fb964156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42766/0 (socket says 172.21.15.142:42766) 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb96999b700 1 -- 172.21.15.142:0/3531720374 learned_addr learned my addr 172.21.15.142:0/3531720374 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb96a19c700 1 --2- 172.21.15.142:0/3531720374 >> v2:172.21.15.148:3300/0 conn(0x7fb96406e820 0x7fb964161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016974126 0 0) 0x7fb96406d3e0 con 0x7fb9640af020 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb950003570 con 0x7fb9640af020 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168807660 0 0) 0x7fb96406dc80 con 0x7fb9640b00d0 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb96406d3e0 con 0x7fb9640b00d0 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574667687 0 0) 0x7fb950003570 con 0x7fb9640af020 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 >> v2:172.21.15.148:3300/0 conn(0x7fb96406e820 msgr2=0x7fb964161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 --2- 172.21.15.142:0/3531720374 >> v2:172.21.15.148:3300/0 conn(0x7fb96406e820 0x7fb964161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 >> v1:172.21.15.148:6789/0 conn(0x7fb9640b00d0 legacy=0x7fb96406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96406eca0 con 0x7fb9640af020 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.661+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fb960001470 con 0x7fb9640af020 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 >> v1:172.21.15.142:6789/0 conn(0x7fb9640af020 legacy=0x7fb964156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb968999700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb950003c70 0x7fb950004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb968999700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb950004810 0x7fb950004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb968999700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950005210 0x7fb95000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000c130 con 0x7fb950004810 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000c270 con 0x7fb950005210 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000c430 con 0x7fb950003c70 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96919a700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb950004810 0x7fb950004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96999b700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb950003c70 0x7fb950004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96a19c700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950005210 0x7fb95000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96999b700 1 -- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950005210 msgr2=0x7fb95000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96999b700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950005210 0x7fb95000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96999b700 1 -- 172.21.15.142:0/3531720374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb950004810 msgr2=0x7fb950004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96999b700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb950004810 0x7fb950004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96999b700 1 -- 172.21.15.142:0/3531720374 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950003570 con 0x7fb950003c70 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96a19c700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950005210 0x7fb95000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96919a700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb950004810 0x7fb950004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.662+0000 7fb96a19c700 1 -- 172.21.15.142:0/3531720374 reap_dead start 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb96999b700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb950003c70 0x7fb950004060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb960007b90 tx=0x7fb960001d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64547a6e3b135cf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96000cbb0 con 0x7fb950003c70 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96000cd10 con 0x7fb950003c70 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb968999700 1 -- 172.21.15.142:0/3531720374 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960005b70 con 0x7fb950003c70 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb96bbff700 1 -- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb950003c70 msgr2=0x7fb950004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb96bbff700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb950003c70 0x7fb950004060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb960007b90 tx=0x7fb960001d40 comp rx=0 tx=0).stop 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb96bbff700 1 -- 172.21.15.142:0/3531720374 shutdown_connections 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb96bbff700 1 --2- 172.21.15.142:0/3531720374 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb950003c70 0x7fb950004060 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.663+0000 7fb96bbff700 1 -- 172.21.15.142:0/3531720374 >> 172.21.15.142:0/3531720374 conn(0x7fb9640680c0 msgr2=0x7fb9640c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.664+0000 7fb96bbff700 1 -- 172.21.15.142:0/3531720374 shutdown_connections 2023-09-30T23:04:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.664+0000 7fb96bbff700 1 -- 172.21.15.142:0/3531720374 wait complete. 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.665+0000 7fb96bbff700 1 Processor -- start 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.665+0000 7fb96bbff700 1 -- start start 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96bbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950003c70 0x7fb96413c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96bbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96413c5e0 0x7fb9640c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96bbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9640c78d0 0x7fb964152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96bbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640c5fe0 con 0x7fb96413c5e0 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96bbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640c53d0 con 0x7fb950003c70 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96bbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640c56b0 con 0x7fb9640c78d0 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96919a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96413c5e0 0x7fb9640c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96919a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96413c5e0 0x7fb9640c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45832/0 (socket says 172.21.15.142:45832) 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96919a700 1 -- 172.21.15.142:0/231527645 learned_addr learned my addr 172.21.15.142:0/231527645 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96999b700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950003c70 0x7fb96413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.666+0000 7fb96a19c700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9640c78d0 0x7fb964152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96919a700 1 -- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9640c78d0 msgr2=0x7fb964152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96919a700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9640c78d0 0x7fb964152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96919a700 1 -- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950003c70 msgr2=0x7fb96413c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96919a700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950003c70 0x7fb96413c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96919a700 1 -- 172.21.15.142:0/231527645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640c5990 con 0x7fb96413c5e0 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96919a700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96413c5e0 0x7fb9640c7390 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb95400f9b0 tx=0x7fb954007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb959ffb700 1 -- 172.21.15.142:0/231527645 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954006820 con 0x7fb96413c5e0 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb959ffb700 1 -- 172.21.15.142:0/231527645 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954006980 con 0x7fb96413c5e0 2023-09-30T23:04:47.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9640c5c70 con 0x7fb96413c5e0 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb959ffb700 1 -- 172.21.15.142:0/231527645 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954006d40 con 0x7fb96413c5e0 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.667+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9641530e0 con 0x7fb96413c5e0 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.668+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9640695b0 con 0x7fb96413c5e0 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.669+0000 7fb959ffb700 1 -- 172.21.15.142:0/231527645 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb954007230 con 0x7fb96413c5e0 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.670+0000 7fb959ffb700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb948067330 0x7fb9480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.670+0000 7fb959ffb700 1 -- 172.21.15.142:0/231527645 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb9540847d0 con 0x7fb96413c5e0 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.670+0000 7fb96999b700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb948067330 0x7fb9480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.671+0000 7fb96999b700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb948067330 0x7fb9480697e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb960001120 tx=0x7fb960017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.674+0000 7fb959ffb700 1 -- 172.21.15.142:0/231527645 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb954051930 con 0x7fb96413c5e0 2023-09-30T23:04:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.865+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb96406fc10 con 0x7fb96413c5e0 2023-09-30T23:04:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.866+0000 7fb959ffb700 1 -- 172.21.15.142:0/231527645 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+13937 (secure 0 0 0) 0x7fb954017090 con 0x7fb96413c5e0 2023-09-30T23:04:47.866 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:47.866 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":199,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:45.515854+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:6835/3975475300":"2023-10-01T23:04:42.126280+0000","172.21.15.148:6833/3975475300":"2023-10-01T23:04:42.126280+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:47.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb948067330 msgr2=0x7fb9480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:47.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb948067330 0x7fb9480697e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb960001120 tx=0x7fb960017000 comp rx=0 tx=0).stop 2023-09-30T23:04:47.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96413c5e0 msgr2=0x7fb9640c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:47.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96413c5e0 0x7fb9640c7390 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb95400f9b0 tx=0x7fb954007d30 comp rx=0 tx=0).stop 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 shutdown_connections 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb948067330 0x7fb9480697e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9640c78d0 0x7fb964152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb950003c70 0x7fb96413c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 --2- 172.21.15.142:0/231527645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96413c5e0 0x7fb9640c7390 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.868+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 >> 172.21.15.142:0/231527645 conn(0x7fb9640680c0 msgr2=0x7fb964069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.869+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 shutdown_connections 2023-09-30T23:04:47.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:47.869+0000 7fb96bbff700 1 -- 172.21.15.142:0/231527645 wait complete. 2023-09-30T23:04:47.887 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T23:04:47.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:04:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.078+0000 7f257cbff700 1 Processor -- start 2023-09-30T23:04:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.078+0000 7f257cbff700 1 -- start start 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f257cbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f257cbff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2578069f10 0x7f257806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f257cbff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25780b0ee0 con 0x7f25780aebf0 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f257cbff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25780aefc0 con 0x7f2578069f10 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f257cbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257815a520 con 0x7f2578159b90 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f2576d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2578069f10 0x7f257806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f2576d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2578069f10 0x7f257806a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45846/0 (socket says 172.21.15.142:45846) 2023-09-30T23:04:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f2576d9d700 1 -- 172.21.15.142:0/64126004 learned_addr learned my addr 172.21.15.142:0/64126004 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f2575d9b700 1 --2- 172.21.15.142:0/64126004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.080+0000 7f2576d9d700 1 -- 172.21.15.142:0/64126004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 msgr2=0x7f2578159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.081+0000 7f2576d9d700 1 --2- 172.21.15.142:0/64126004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.081+0000 7f2576d9d700 1 -- 172.21.15.142:0/64126004 >> v1:172.21.15.148:6789/0 conn(0x7f25780aebf0 legacy=0x7f257806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.081+0000 7f2576d9d700 1 -- 172.21.15.142:0/64126004 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257806f360 con 0x7f2578069f10 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.081+0000 7f2576d9d700 1 --2- 172.21.15.142:0/64126004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2578069f10 0x7f257806a390 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f2570009f20 tx=0x7f2570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f354058855d2ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.081+0000 7f257559a700 1 -- 172.21.15.142:0/64126004 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700092e0 con 0x7f2578069f10 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.081+0000 7f257559a700 1 -- 172.21.15.142:0/64126004 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257000b9d0 con 0x7f2578069f10 2023-09-30T23:04:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.081+0000 7f257559a700 1 -- 172.21.15.142:0/64126004 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000bd90 con 0x7f2578069f10 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 -- 172.21.15.142:0/64126004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2578069f10 msgr2=0x7f257806a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 --2- 172.21.15.142:0/64126004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2578069f10 0x7f257806a390 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f2570009f20 tx=0x7f2570009840 comp rx=0 tx=0).stop 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 -- 172.21.15.142:0/64126004 shutdown_connections 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 --2- 172.21.15.142:0/64126004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2578069f10 0x7f257806a390 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 --2- 172.21.15.142:0/64126004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 -- 172.21.15.142:0/64126004 >> 172.21.15.142:0/64126004 conn(0x7f25780680c0 msgr2=0x7f25780c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 -- 172.21.15.142:0/64126004 shutdown_connections 2023-09-30T23:04:48.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.082+0000 7f257cbff700 1 -- 172.21.15.142:0/64126004 wait complete. 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.083+0000 7f257cbff700 1 Processor -- start 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.083+0000 7f257cbff700 1 -- start start 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.084+0000 7f257cbff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578069f10 0x7f2578158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.084+0000 7f257cbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25780aebf0 0x7f25781472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.084+0000 7f257cbff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.084+0000 7f257cbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25781592a0 con 0x7f25780aebf0 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.084+0000 7f257cbff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578148be0 con 0x7f2578069f10 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.084+0000 7f257cbff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2578147fd0 con 0x7f2578159b90 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25780aebf0 0x7f25781472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25780aebf0 0x7f25781472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45858/0 (socket says 172.21.15.142:45858) 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 -- 172.21.15.142:0/2001083763 learned_addr learned my addr 172.21.15.142:0/2001083763 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f257659c700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578069f10 0x7f2578158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2576d9d700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 -- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 msgr2=0x7f2578149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 -- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578069f10 msgr2=0x7f2578158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578069f10 0x7f2578158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 -- 172.21.15.142:0/2001083763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009ae0 con 0x7f25780aebf0 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f2575d9b700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25780aebf0 0x7f25781472b0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f256c00e930 tx=0x7f256c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f25667fc700 1 -- 172.21.15.142:0/2001083763 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c013680 con 0x7f25780aebf0 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.085+0000 7f25667fc700 1 -- 172.21.15.142:0/2001083763 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c0137e0 con 0x7f25780aebf0 2023-09-30T23:04:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.086+0000 7f25667fc700 1 -- 172.21.15.142:0/2001083763 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c013b80 con 0x7f25780aebf0 2023-09-30T23:04:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.086+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25781482b0 con 0x7f25780aebf0 2023-09-30T23:04:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.086+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2578148870 con 0x7f25780aebf0 2023-09-30T23:04:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.087+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25780695b0 con 0x7f25780aebf0 2023-09-30T23:04:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.087+0000 7f25667fc700 1 -- 172.21.15.142:0/2001083763 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f256c00c3e0 con 0x7f25780aebf0 2023-09-30T23:04:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.088+0000 7f25667fc700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2558067330 0x7f25580697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.089+0000 7f25667fc700 1 -- 172.21.15.142:0/2001083763 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f256c084a10 con 0x7f25780aebf0 2023-09-30T23:04:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.089+0000 7f257659c700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2558067330 0x7f25580697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.089+0000 7f257659c700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2558067330 0x7f25580697e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2568003a80 tx=0x7f2568007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.092+0000 7f25667fc700 1 -- 172.21.15.142:0/2001083763 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f256c051b70 con 0x7f25780aebf0 2023-09-30T23:04:48.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.279+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25780ca5c0 con 0x7f2558067330 2023-09-30T23:04:48.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.282+0000 7f25667fc700 1 -- 172.21.15.142:0/2001083763 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69979 (secure 0 0 0) 0x7f25780ca5c0 con 0x7f2558067330 2023-09-30T23:04:48.283 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:48.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2558067330 msgr2=0x7f25580697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2558067330 0x7f25580697e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2568003a80 tx=0x7f2568007ec0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25780aebf0 msgr2=0x7f25781472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25780aebf0 0x7f25781472b0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f256c00e930 tx=0x7f256c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 shutdown_connections 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f2558067330 0x7f25580697e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2578159b90 0x7f2578149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578069f10 0x7f2578158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 --2- 172.21.15.142:0/2001083763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25780aebf0 0x7f25781472b0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 >> 172.21.15.142:0/2001083763 conn(0x7f25780680c0 msgr2=0x7f25780cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 shutdown_connections 2023-09-30T23:04:48.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.285+0000 7f257cbff700 1 -- 172.21.15.142:0/2001083763 wait complete. 2023-09-30T23:04:48.286 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:04:48.302 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":565,"stamp":"2023-09-30T23:04:48.279440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10489,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552010,"statfs":{"total":1600000000,"available":1589258256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489347,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-119,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.148562"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.522920+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:04:44.522920+0000","last_peered":"2023-09-30T23:04:44.522920+0000","last_clean":"2023-09-30T23:04:44.522920+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:04:44.522920+0000","last_undegraded":"2023-09-30T23:04:44.522920+0000","last_fullsized":"2023-09-30T23:04:44.522920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520779+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:04:44.520779+0000","last_peered":"2023-09-30T23:04:44.520779+0000","last_clean":"2023-09-30T23:04:44.520779+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:04:44.520779+0000","last_undegraded":"2023-09-30T23:04:44.520779+0000","last_fullsized":"2023-09-30T23:04:44.520779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.526291+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:04:44.526291+0000","last_peered":"2023-09-30T23:04:44.526291+0000","last_clean":"2023-09-30T23:04:44.526291+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:04:44.526291+0000","last_undegraded":"2023-09-30T23:04:44.526291+0000","last_fullsized":"2023-09-30T23:04:44.526291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.521592+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:04:44.521592+0000","last_peered":"2023-09-30T23:04:44.521592+0000","last_clean":"2023-09-30T23:04:44.521592+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:04:44.521592+0000","last_undegraded":"2023-09-30T23:04:44.521592+0000","last_fullsized":"2023-09-30T23:04:44.521592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":324,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519406+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:04:44.519406+0000","last_peered":"2023-09-30T23:04:44.519406+0000","last_clean":"2023-09-30T23:04:44.519406+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:04:44.519406+0000","last_undegraded":"2023-09-30T23:04:44.519406+0000","last_fullsized":"2023-09-30T23:04:44.519406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519573+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:04:44.519573+0000","last_peered":"2023-09-30T23:04:44.519573+0000","last_clean":"2023-09-30T23:04:44.519573+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:04:44.519573+0000","last_undegraded":"2023-09-30T23:04:44.519573+0000","last_fullsized":"2023-09-30T23:04:44.519573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519496+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:04:44.519496+0000","last_peered":"2023-09-30T23:04:44.519496+0000","last_clean":"2023-09-30T23:04:44.519496+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:04:44.519496+0000","last_undegraded":"2023-09-30T23:04:44.519496+0000","last_fullsized":"2023-09-30T23:04:44.519496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.525759+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:04:44.525759+0000","last_peered":"2023-09-30T23:04:44.525759+0000","last_clean":"2023-09-30T23:04:44.525759+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:04:44.525759+0000","last_undegraded":"2023-09-30T23:04:44.525759+0000","last_fullsized":"2023-09-30T23:04:44.525759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520700+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:04:44.520700+0000","last_peered":"2023-09-30T23:04:44.520700+0000","last_clean":"2023-09-30T23:04:44.520700+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:04:44.520700+0000","last_undegraded":"2023-09-30T23:04:44.520700+0000","last_fullsized":"2023-09-30T23:04:44.520700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.315},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.0309999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.86699999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.95699999999999996,"15min":1.004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52600000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.43099999999999999},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89700000000000002,"5min":1.028,"15min":1.028},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.93999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.434},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.056},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.44,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.35999999999999999},"max":{"1min":0.82599999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90800000000000003,"5min":1.03,"15min":1.135},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.004},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.147,"15min":1.147},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.754,"15min":0.72299999999999998},"min":{"1min":0.53900000000000003,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.071},"last":0.49099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71699999999999997,"15min":0.81000000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.85299999999999998,"5min":0.96699999999999997,"15min":6.5190000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.752},"min":{"1min":0.435,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.89300000000000002,"5min":1.0269999999999999,"15min":4.3680000000000003},"last":0.497}]},{"osd":1,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.77000000000000002},"min":{"1min":0.48799999999999999,"5min":0.45900000000000002,"15min":0.42699999999999999},"max":{"1min":0.876,"5min":1.123,"15min":3.6339999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.83899999999999997},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.034,"15min":8.4339999999999993},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40799999999999997},"max":{"1min":0.82399999999999995,"5min":0.92000000000000004,"15min":3.4580000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.83499999999999996},"min":{"1min":0.57399999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":5.7110000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.55800000000000005,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.86299999999999999,"5min":0.96599999999999997,"15min":1.5249999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.65800000000000003},"min":{"1min":0.441,"5min":0.41399999999999998,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.4670000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93899999999999995,"5min":0.999,"15min":5.9279999999999999},"last":0.746}]},{"osd":5,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.321},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":1.018,"15min":1.4590000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.999,"5min":0.999,"15min":6.0599999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.98799999999999999,"5min":1.0469999999999999,"15min":1.3620000000000001},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.61099999999999999,"5min":0.69699999999999995,"15min":1.083},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.745},"last":0.44}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":0.61799999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.40400000000000003,"5min":0.35899999999999999,"15min":0.27400000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.70899999999999996},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":1.091,"15min":1.091},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.73999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48399999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1499999999999999,"15min":1.22},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.75},"min":{"1min":0.59599999999999997,"5min":0.53900000000000003,"15min":0.53100000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.3560000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.1160000000000001,"15min":1.127},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.48099999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.4059999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1240000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.79100000000000004},"min":{"1min":0.64900000000000002,"5min":0.53900000000000003,"15min":0.504},"max":{"1min":1.153,"5min":1.153,"15min":1.3779999999999999},"last":0.69699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":0.748,"15min":0.85699999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":0.63700000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.0289999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.879},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.749,"15min":1.0029999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.98899999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.27},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.171},"last":0.627}]},{"osd":5,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.75,"15min":0.73599999999999999},"min":{"1min":0.57799999999999996,"5min":0.502,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.099,"15min":1.2649999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.752},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91700000000000004,"5min":1.091,"15min":4.0419999999999998},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.434},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.6059999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.48399999999999999},"max":{"1min":1.032,"5min":1.0669999999999999,"15min":7.2610000000000001},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.65700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0660000000000001,"15min":2.4569999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.149,"5min":1.149,"15min":4.0220000000000002},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.77500000000000002,"15min":1.4630000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.48199999999999998,"15min":0.45500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.249},"max":{"1min":0.62,"5min":0.876,"15min":1.542},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.627,"5min":1.0109999999999999,"15min":1.494},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38900000000000001,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48599999999999999,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.28999999999999998},"max":{"1min":0.51000000000000001,"5min":0.94399999999999995,"15min":1.649},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.309},"max":{"1min":0.58899999999999997,"5min":0.98099999999999998,"15min":1.3220000000000001},"last":0.504}]},{"osd":4,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.44400000000000001},"max":{"1min":0.93799999999999994,"5min":1.1819999999999999,"15min":1.234},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.38},"max":{"1min":1.0049999999999999,"5min":1.167,"15min":1.4910000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.179},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":1.22,"15min":2.7320000000000002},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":1.161,"15min":1.615},"last":0.753},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77200000000000002,"15min":0.752},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.1879999999999999,"15min":1.4199999999999999},"last":0.628}]},{"osd":7,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.46000000000000002},"max":{"1min":0.92000000000000004,"5min":1.206,"15min":1.206},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":1.2330000000000001,"15min":2.7730000000000001},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.21199999999999999},"max":{"1min":0.57799999999999996,"5min":0.66900000000000004,"15min":1.1519999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.69899999999999995,"15min":1.919},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60599999999999998,"5min":0.81299999999999994,"15min":1.254},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.27300000000000002},"max":{"1min":0.69099999999999995,"5min":0.748,"15min":1.9390000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.72799999999999998,"5min":0.85199999999999998,"15min":1.6020000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.5309999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.35999999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.401},"last":0.626},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.77700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.443},"max":{"1min":1.0189999999999999,"5min":1.1439999999999999,"15min":3.306},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.46200000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.508},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.621,"5min":0.55200000000000005,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.4910000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.5620000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73699999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.48099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.3140000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.48799999999999999},"max":{"1min":1.0920000000000001,"5min":1.1040000000000001,"15min":1.3640000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.573},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68300000000000005,"15min":0.628},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85499999999999998,"5min":0.98199999999999998,"15min":1.022},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.47699999999999998}]},{"osd":1,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70599999999999996,"15min":0.65700000000000003},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.54600000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.751}]},{"osd":2,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.98699999999999999,"15min":1.492},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77500000000000002,"15min":0.72199999999999998},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.0149999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.72399999999999998},"min":{"1min":0.63800000000000001,"5min":0.56399999999999995,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.5149999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.871,"5min":0.98299999999999998,"15min":1.0429999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.37},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0209999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.90200000000000002,"5min":1.0409999999999999,"15min":1.45},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.57599999999999996,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.91700000000000004,"5min":1.028,"15min":1.0649999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47999999999999998,"15min":0.45700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.016},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.93300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86499999999999999,"5min":0.96199999999999997,"15min":0.98199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.008},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.92900000000000005,"15min":0.97899999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":0.95899999999999996,"15min":1.0449999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.67200000000000004},"min":{"1min":0.42799999999999999,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70199999999999996,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95899999999999996,"15min":1.044},"last":0.82499999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70599999999999996,"15min":0.67300000000000004},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.72899999999999998,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.96799999999999997,"15min":0.97599999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76900000000000002,"5min":0.89100000000000001,"15min":0.95299999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":1.081},"last":0.77700000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78500000000000003,"5min":0.90900000000000003,"15min":1.03},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.083},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.45900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":1.0700000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[]}} 2023-09-30T23:04:48.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:04:48.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.496+0000 7f0da1dff700 1 Processor -- start 2023-09-30T23:04:48.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.496+0000 7f0da1dff700 1 -- start start 2023-09-30T23:04:48.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.497+0000 7f0da1dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0d9c0af020 0x7f0d9c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.497+0000 7f0da1dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c06d3e0 con 0x7f0d9c06e820 2023-09-30T23:04:48.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.497+0000 7f0da1dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c06dc80 con 0x7f0d9c0b00d0 2023-09-30T23:04:48.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.497+0000 7f0da1dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c06eca0 con 0x7f0d9c0af020 2023-09-30T23:04:48.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0d9c06e820 0x7f0d9c15a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42782/0 (socket says 172.21.15.142:42782) 2023-09-30T23:04:48.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9bfff700 1 -- 172.21.15.142:0/720537551 learned_addr learned my addr 172.21.15.142:0/720537551 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:48.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9b7fe700 1 --2- 172.21.15.142:0/720537551 >> v2:172.21.15.148:3300/0 conn(0x7f0d9c0af020 0x7f0d9c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9a7fc700 1 -- 172.21.15.142:0/720537551 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001013250 0 0) 0x7f0d9c06d3e0 con 0x7f0d9c06e820 2023-09-30T23:04:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9a7fc700 1 -- 172.21.15.142:0/720537551 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d84003570 con 0x7f0d9c06e820 2023-09-30T23:04:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9a7fc700 1 -- 172.21.15.142:0/720537551 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493663478 0 0) 0x7f0d9c06dc80 con 0x7f0d9c0b00d0 2023-09-30T23:04:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9a7fc700 1 -- 172.21.15.142:0/720537551 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c06d3e0 con 0x7f0d9c0b00d0 2023-09-30T23:04:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/720537551 >> v1:172.21.15.148:6789/0 conn(0x7f0d9c0b00d0 legacy=0x7f0d9c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/720537551 >> v1:172.21.15.142:6789/0 conn(0x7f0d9c06e820 legacy=0x7f0d9c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.498+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/720537551 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c06b790 con 0x7f0d9c0af020 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.499+0000 7f0d9b7fe700 1 --2- 172.21.15.142:0/720537551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0af020 0x7f0d9c156d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009910 tx=0x7f0d8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d56268a68a02deff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.499+0000 7f0d9a7fc700 1 -- 172.21.15.142:0/720537551 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c011630 con 0x7f0d9c0af020 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.499+0000 7f0d9a7fc700 1 -- 172.21.15.142:0/720537551 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c011790 con 0x7f0d9c0af020 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.499+0000 7f0d9a7fc700 1 -- 172.21.15.142:0/720537551 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c011b30 con 0x7f0d9c0af020 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.499+0000 7f0da1dff700 1 -- 172.21.15.142:0/720537551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0af020 msgr2=0x7f0d9c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.499+0000 7f0da1dff700 1 --2- 172.21.15.142:0/720537551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0af020 0x7f0d9c156d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009910 tx=0x7f0d8c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.500+0000 7f0da1dff700 1 -- 172.21.15.142:0/720537551 shutdown_connections 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.500+0000 7f0da1dff700 1 --2- 172.21.15.142:0/720537551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0af020 0x7f0d9c156d80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.500+0000 7f0da1dff700 1 -- 172.21.15.142:0/720537551 >> 172.21.15.142:0/720537551 conn(0x7f0d9c0680c0 msgr2=0x7f0d9c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.500+0000 7f0da1dff700 1 -- 172.21.15.142:0/720537551 shutdown_connections 2023-09-30T23:04:48.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.500+0000 7f0da1dff700 1 -- 172.21.15.142:0/720537551 wait complete. 2023-09-30T23:04:48.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.501+0000 7f0da1dff700 1 Processor -- start 2023-09-30T23:04:48.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.501+0000 7f0da1dff700 1 -- start start 2023-09-30T23:04:48.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.502+0000 7f0da1dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9c06e820 0x7f0d9c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.502+0000 7f0da1dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c0af020 0x7f0d9c1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.502+0000 7f0da1dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0b00d0 0x7f0d9c0c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.502+0000 7f0da1dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c16d4c0 con 0x7f0d9c0af020 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.502+0000 7f0da1dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c16e2e0 con 0x7f0d9c0b00d0 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.502+0000 7f0da1dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c15b250 con 0x7f0d9c06e820 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.502+0000 7f0d9affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c0af020 0x7f0d9c1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c0af020 0x7f0d9c1533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45868/0 (socket says 172.21.15.142:45868) 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 -- 172.21.15.142:0/3076196279 learned_addr learned my addr 172.21.15.142:0/3076196279 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9b7fe700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9c06e820 0x7f0d9c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9bfff700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0b00d0 0x7f0d9c0c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 -- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9c06e820 msgr2=0x7f0d9c15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9c06e820 0x7f0d9c15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 -- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0b00d0 msgr2=0x7f0d9c0c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0b00d0 0x7f0d9c0c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 -- 172.21.15.142:0/3076196279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c009420 con 0x7f0d9c0af020 2023-09-30T23:04:48.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d9affd700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c0af020 0x7f0d9c1533f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000c5b0 tx=0x7f0d90007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.503+0000 7f0d837fe700 1 -- 172.21.15.142:0/3076196279 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90010510 con 0x7f0d9c0af020 2023-09-30T23:04:48.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.504+0000 7f0d837fe700 1 -- 172.21.15.142:0/3076196279 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90010670 con 0x7f0d9c0af020 2023-09-30T23:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.504+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c16d6d0 con 0x7f0d9c0af020 2023-09-30T23:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.504+0000 7f0d837fe700 1 -- 172.21.15.142:0/3076196279 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90010a30 con 0x7f0d9c0af020 2023-09-30T23:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.504+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c16dc90 con 0x7f0d9c0af020 2023-09-30T23:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.505+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c16e470 con 0x7f0d9c0af020 2023-09-30T23:04:48.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.505+0000 7f0d837fe700 1 -- 172.21.15.142:0/3076196279 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0d9001b400 con 0x7f0d9c0af020 2023-09-30T23:04:48.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.506+0000 7f0d837fe700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d88067330 0x7f0d880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.506+0000 7f0d837fe700 1 -- 172.21.15.142:0/3076196279 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0d90084410 con 0x7f0d9c0af020 2023-09-30T23:04:48.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.507+0000 7f0d9b7fe700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d88067330 0x7f0d880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.507+0000 7f0d9b7fe700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d88067330 0x7f0d880697e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0093f0 tx=0x7f0d8c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.511+0000 7f0d837fe700 1 -- 172.21.15.142:0/3076196279 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0d90051570 con 0x7f0d9c0af020 2023-09-30T23:04:48.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.704+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d9c06fc10 con 0x7f0d88067330 2023-09-30T23:04:48.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.707+0000 7f0d837fe700 1 -- 172.21.15.142:0/3076196279 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69979 (secure 0 0 0) 0x7f0d9c06fc10 con 0x7f0d88067330 2023-09-30T23:04:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d88067330 msgr2=0x7f0d880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d88067330 0x7f0d880697e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0093f0 tx=0x7f0d8c017000 comp rx=0 tx=0).stop 2023-09-30T23:04:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c0af020 msgr2=0x7f0d9c1533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c0af020 0x7f0d9c1533f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000c5b0 tx=0x7f0d90007e10 comp rx=0 tx=0).stop 2023-09-30T23:04:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 shutdown_connections 2023-09-30T23:04:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0d88067330 0x7f0d880697e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d9c0b00d0 0x7f0d9c0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9c06e820 0x7f0d9c15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 --2- 172.21.15.142:0/3076196279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c0af020 0x7f0d9c1533f0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 >> 172.21.15.142:0/3076196279 conn(0x7f0d9c0680c0 msgr2=0x7f0d9c069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 shutdown_connections 2023-09-30T23:04:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.709+0000 7f0da1dff700 1 -- 172.21.15.142:0/3076196279 wait complete. 2023-09-30T23:04:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:04:48.726 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":565,"stamp":"2023-09-30T23:04:48.279440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10489,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552010,"statfs":{"total":1600000000,"available":1589258256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489347,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-119,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.148562"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.522920+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:04:44.522920+0000","last_peered":"2023-09-30T23:04:44.522920+0000","last_clean":"2023-09-30T23:04:44.522920+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:04:44.522920+0000","last_undegraded":"2023-09-30T23:04:44.522920+0000","last_fullsized":"2023-09-30T23:04:44.522920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520779+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:04:44.520779+0000","last_peered":"2023-09-30T23:04:44.520779+0000","last_clean":"2023-09-30T23:04:44.520779+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:04:44.520779+0000","last_undegraded":"2023-09-30T23:04:44.520779+0000","last_fullsized":"2023-09-30T23:04:44.520779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.526291+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:04:44.526291+0000","last_peered":"2023-09-30T23:04:44.526291+0000","last_clean":"2023-09-30T23:04:44.526291+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:04:44.526291+0000","last_undegraded":"2023-09-30T23:04:44.526291+0000","last_fullsized":"2023-09-30T23:04:44.526291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.521592+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:04:44.521592+0000","last_peered":"2023-09-30T23:04:44.521592+0000","last_clean":"2023-09-30T23:04:44.521592+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:04:44.521592+0000","last_undegraded":"2023-09-30T23:04:44.521592+0000","last_fullsized":"2023-09-30T23:04:44.521592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":324,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519406+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:04:44.519406+0000","last_peered":"2023-09-30T23:04:44.519406+0000","last_clean":"2023-09-30T23:04:44.519406+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:04:44.519406+0000","last_undegraded":"2023-09-30T23:04:44.519406+0000","last_fullsized":"2023-09-30T23:04:44.519406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519573+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:04:44.519573+0000","last_peered":"2023-09-30T23:04:44.519573+0000","last_clean":"2023-09-30T23:04:44.519573+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:04:44.519573+0000","last_undegraded":"2023-09-30T23:04:44.519573+0000","last_fullsized":"2023-09-30T23:04:44.519573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519496+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:04:44.519496+0000","last_peered":"2023-09-30T23:04:44.519496+0000","last_clean":"2023-09-30T23:04:44.519496+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:04:44.519496+0000","last_undegraded":"2023-09-30T23:04:44.519496+0000","last_fullsized":"2023-09-30T23:04:44.519496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.525759+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:04:44.525759+0000","last_peered":"2023-09-30T23:04:44.525759+0000","last_clean":"2023-09-30T23:04:44.525759+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:04:44.525759+0000","last_undegraded":"2023-09-30T23:04:44.525759+0000","last_fullsized":"2023-09-30T23:04:44.525759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520700+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:04:44.520700+0000","last_peered":"2023-09-30T23:04:44.520700+0000","last_clean":"2023-09-30T23:04:44.520700+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:04:44.520700+0000","last_undegraded":"2023-09-30T23:04:44.520700+0000","last_fullsized":"2023-09-30T23:04:44.520700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.315},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.0309999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.86699999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.95699999999999996,"15min":1.004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52600000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.43099999999999999},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89700000000000002,"5min":1.028,"15min":1.028},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.93999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.434},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.056},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.44,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.35999999999999999},"max":{"1min":0.82599999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90800000000000003,"5min":1.03,"15min":1.135},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.004},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.147,"15min":1.147},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.754,"15min":0.72299999999999998},"min":{"1min":0.53900000000000003,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.071},"last":0.49099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71699999999999997,"15min":0.81000000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.85299999999999998,"5min":0.96699999999999997,"15min":6.5190000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.752},"min":{"1min":0.435,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.89300000000000002,"5min":1.0269999999999999,"15min":4.3680000000000003},"last":0.497}]},{"osd":1,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.77000000000000002},"min":{"1min":0.48799999999999999,"5min":0.45900000000000002,"15min":0.42699999999999999},"max":{"1min":0.876,"5min":1.123,"15min":3.6339999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.83899999999999997},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.034,"15min":8.4339999999999993},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40799999999999997},"max":{"1min":0.82399999999999995,"5min":0.92000000000000004,"15min":3.4580000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.83499999999999996},"min":{"1min":0.57399999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":5.7110000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.55800000000000005,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.86299999999999999,"5min":0.96599999999999997,"15min":1.5249999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.65800000000000003},"min":{"1min":0.441,"5min":0.41399999999999998,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.4670000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93899999999999995,"5min":0.999,"15min":5.9279999999999999},"last":0.746}]},{"osd":5,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.321},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":1.018,"15min":1.4590000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.999,"5min":0.999,"15min":6.0599999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.98799999999999999,"5min":1.0469999999999999,"15min":1.3620000000000001},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.61099999999999999,"5min":0.69699999999999995,"15min":1.083},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.745},"last":0.44}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":0.61799999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.40400000000000003,"5min":0.35899999999999999,"15min":0.27400000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.70899999999999996},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":1.091,"15min":1.091},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.73999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48399999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1499999999999999,"15min":1.22},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.75},"min":{"1min":0.59599999999999997,"5min":0.53900000000000003,"15min":0.53100000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.3560000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.1160000000000001,"15min":1.127},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.48099999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.4059999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1240000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.79100000000000004},"min":{"1min":0.64900000000000002,"5min":0.53900000000000003,"15min":0.504},"max":{"1min":1.153,"5min":1.153,"15min":1.3779999999999999},"last":0.69699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":0.748,"15min":0.85699999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":0.63700000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.0289999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.879},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.749,"15min":1.0029999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.98899999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.27},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.171},"last":0.627}]},{"osd":5,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.75,"15min":0.73599999999999999},"min":{"1min":0.57799999999999996,"5min":0.502,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.099,"15min":1.2649999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.752},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91700000000000004,"5min":1.091,"15min":4.0419999999999998},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.434},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.6059999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.48399999999999999},"max":{"1min":1.032,"5min":1.0669999999999999,"15min":7.2610000000000001},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.65700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0660000000000001,"15min":2.4569999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.149,"5min":1.149,"15min":4.0220000000000002},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.77500000000000002,"15min":1.4630000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.48199999999999998,"15min":0.45500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.249},"max":{"1min":0.62,"5min":0.876,"15min":1.542},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.627,"5min":1.0109999999999999,"15min":1.494},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38900000000000001,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48599999999999999,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.28999999999999998},"max":{"1min":0.51000000000000001,"5min":0.94399999999999995,"15min":1.649},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.309},"max":{"1min":0.58899999999999997,"5min":0.98099999999999998,"15min":1.3220000000000001},"last":0.504}]},{"osd":4,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.44400000000000001},"max":{"1min":0.93799999999999994,"5min":1.1819999999999999,"15min":1.234},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.38},"max":{"1min":1.0049999999999999,"5min":1.167,"15min":1.4910000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.179},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":1.22,"15min":2.7320000000000002},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":1.161,"15min":1.615},"last":0.753},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77200000000000002,"15min":0.752},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.1879999999999999,"15min":1.4199999999999999},"last":0.628}]},{"osd":7,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.46000000000000002},"max":{"1min":0.92000000000000004,"5min":1.206,"15min":1.206},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":1.2330000000000001,"15min":2.7730000000000001},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.21199999999999999},"max":{"1min":0.57799999999999996,"5min":0.66900000000000004,"15min":1.1519999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.69899999999999995,"15min":1.919},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60599999999999998,"5min":0.81299999999999994,"15min":1.254},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.27300000000000002},"max":{"1min":0.69099999999999995,"5min":0.748,"15min":1.9390000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.72799999999999998,"5min":0.85199999999999998,"15min":1.6020000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.5309999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.35999999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.401},"last":0.626},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.77700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.443},"max":{"1min":1.0189999999999999,"5min":1.1439999999999999,"15min":3.306},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.46200000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.508},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.621,"5min":0.55200000000000005,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.4910000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.5620000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73699999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.48099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.3140000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.48799999999999999},"max":{"1min":1.0920000000000001,"5min":1.1040000000000001,"15min":1.3640000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.573},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68300000000000005,"15min":0.628},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85499999999999998,"5min":0.98199999999999998,"15min":1.022},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.47699999999999998}]},{"osd":1,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70599999999999996,"15min":0.65700000000000003},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.54600000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.751}]},{"osd":2,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.98699999999999999,"15min":1.492},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77500000000000002,"15min":0.72199999999999998},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.0149999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.72399999999999998},"min":{"1min":0.63800000000000001,"5min":0.56399999999999995,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.5149999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.871,"5min":0.98299999999999998,"15min":1.0429999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.37},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0209999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.90200000000000002,"5min":1.0409999999999999,"15min":1.45},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.57599999999999996,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.91700000000000004,"5min":1.028,"15min":1.0649999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47999999999999998,"15min":0.45700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.016},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.93300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86499999999999999,"5min":0.96199999999999997,"15min":0.98199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.008},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.92900000000000005,"15min":0.97899999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":0.95899999999999996,"15min":1.0449999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.67200000000000004},"min":{"1min":0.42799999999999999,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70199999999999996,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95899999999999996,"15min":1.044},"last":0.82499999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70599999999999996,"15min":0.67300000000000004},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.72899999999999998,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.96799999999999997,"15min":0.97599999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76900000000000002,"5min":0.89100000000000001,"15min":0.95299999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":1.081},"last":0.77700000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78500000000000003,"5min":0.90900000000000003,"15min":1.03},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.083},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.45900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":1.0700000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[]}} 2023-09-30T23:04:48.729 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T23:04:48.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:04:48.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.917+0000 7f4f95dff700 1 Processor -- start 2023-09-30T23:04:48.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.918+0000 7f4f95dff700 1 -- start start 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f95dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f900af020 0x7f4f90156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f95dff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f900b00d0 0x7f4f9006e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f95dff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9006d3e0 con 0x7f4f9006e650 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f95dff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9015b400 con 0x7f4f900b00d0 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f95dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9006dc80 con 0x7f4f900af020 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f8effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f900b00d0 0x7f4f9006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f8effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f900b00d0 0x7f4f9006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45872/0 (socket says 172.21.15.142:45872) 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f8effd700 1 -- 172.21.15.142:0/2454555676 learned_addr learned my addr 172.21.15.142:0/2454555676 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:48.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.919+0000 7f4f8f7fe700 1 --2- 172.21.15.142:0/2454555676 >> v2:172.21.15.148:3300/0 conn(0x7f4f900af020 0x7f4f90156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8effd700 1 -- 172.21.15.142:0/2454555676 >> v2:172.21.15.148:3300/0 conn(0x7f4f900af020 msgr2=0x7f4f90156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8effd700 1 --2- 172.21.15.142:0/2454555676 >> v2:172.21.15.148:3300/0 conn(0x7f4f900af020 0x7f4f90156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8effd700 1 -- 172.21.15.142:0/2454555676 >> v1:172.21.15.148:6789/0 conn(0x7f4f9006e650 legacy=0x7f4f900b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8effd700 1 -- 172.21.15.142:0/2454555676 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9006b790 con 0x7f4f900b00d0 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8effd700 1 --2- 172.21.15.142:0/2454555676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900b00d0 0x7f4f9006e110 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f4f840099b0 tx=0x7f4f84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c9f07c5a714884 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8e7fc700 1 -- 172.21.15.142:0/2454555676 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84009ea0 con 0x7f4f900b00d0 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8e7fc700 1 -- 172.21.15.142:0/2454555676 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400b820 con 0x7f4f900b00d0 2023-09-30T23:04:48.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.920+0000 7f4f8e7fc700 1 -- 172.21.15.142:0/2454555676 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400bbc0 con 0x7f4f900b00d0 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 -- 172.21.15.142:0/2454555676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900b00d0 msgr2=0x7f4f9006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 --2- 172.21.15.142:0/2454555676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900b00d0 0x7f4f9006e110 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f4f840099b0 tx=0x7f4f84009250 comp rx=0 tx=0).stop 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 -- 172.21.15.142:0/2454555676 shutdown_connections 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 --2- 172.21.15.142:0/2454555676 >> v2:172.21.15.148:3300/0 conn(0x7f4f900af020 0x7f4f90156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 --2- 172.21.15.142:0/2454555676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900b00d0 0x7f4f9006e110 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 -- 172.21.15.142:0/2454555676 >> 172.21.15.142:0/2454555676 conn(0x7f4f900680c0 msgr2=0x7f4f900c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 -- 172.21.15.142:0/2454555676 shutdown_connections 2023-09-30T23:04:48.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.921+0000 7f4f95dff700 1 -- 172.21.15.142:0/2454555676 wait complete. 2023-09-30T23:04:48.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.922+0000 7f4f95dff700 1 Processor -- start 2023-09-30T23:04:48.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.923+0000 7f4f95dff700 1 -- start start 2023-09-30T23:04:48.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.923+0000 7f4f95dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9006e650 0x7f4f900a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.923+0000 7f4f95dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900af020 0x7f4f900c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.923+0000 7f4f95dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f900b00d0 0x7f4f900cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.923+0000 7f4f95dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c5d50 con 0x7f4f900af020 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.923+0000 7f4f95dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900a5a90 con 0x7f4f9006e650 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.923+0000 7f4f95dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900a5d70 con 0x7f4f900b00d0 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900af020 0x7f4f900c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900af020 0x7f4f900c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45886/0 (socket says 172.21.15.142:45886) 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 -- 172.21.15.142:0/4076819347 learned_addr learned my addr 172.21.15.142:0/4076819347 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8f7fe700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9006e650 0x7f4f900a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8ffff700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f900b00d0 0x7f4f900cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 -- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f900b00d0 msgr2=0x7f4f900cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f900b00d0 0x7f4f900cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 -- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9006e650 msgr2=0x7f4f900a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9006e650 0x7f4f900a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 -- 172.21.15.142:0/4076819347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840094f0 con 0x7f4f900af020 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.924+0000 7f4f8effd700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900af020 0x7f4f900c5810 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f4f840094c0 tx=0x7f4f84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.925+0000 7f4f777fe700 1 -- 172.21.15.142:0/4076819347 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400bba0 con 0x7f4f900af020 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.925+0000 7f4f777fe700 1 -- 172.21.15.142:0/4076819347 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f84011420 con 0x7f4f900af020 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.925+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900a6050 con 0x7f4f900af020 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.925+0000 7f4f777fe700 1 -- 172.21.15.142:0/4076819347 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840117e0 con 0x7f4f900af020 2023-09-30T23:04:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.925+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900a6610 con 0x7f4f900af020 2023-09-30T23:04:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.926+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f900a6800 con 0x7f4f900af020 2023-09-30T23:04:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.927+0000 7f4f777fe700 1 -- 172.21.15.142:0/4076819347 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4f84011b90 con 0x7f4f900af020 2023-09-30T23:04:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.928+0000 7f4f777fe700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4f7c067330 0x7f4f7c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.928+0000 7f4f777fe700 1 -- 172.21.15.142:0/4076819347 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4f84086290 con 0x7f4f900af020 2023-09-30T23:04:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.928+0000 7f4f8f7fe700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4f7c067330 0x7f4f7c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.928+0000 7f4f8f7fe700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4f7c067330 0x7f4f7c0697e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009db0 tx=0x7f4f800091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:48.932+0000 7f4f777fe700 1 -- 172.21.15.142:0/4076819347 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4f840533f0 con 0x7f4f900af020 2023-09-30T23:04:49.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.120+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f9006fc10 con 0x7f4f7c067330 2023-09-30T23:04:49.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.123+0000 7f4f777fe700 1 -- 172.21.15.142:0/4076819347 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69979 (secure 0 0 0) 0x7f4f9006fc10 con 0x7f4f7c067330 2023-09-30T23:04:49.124 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4f7c067330 msgr2=0x7f4f7c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4f7c067330 0x7f4f7c0697e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009db0 tx=0x7f4f800091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900af020 msgr2=0x7f4f900c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900af020 0x7f4f900c5810 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f4f840094c0 tx=0x7f4f84017000 comp rx=0 tx=0).stop 2023-09-30T23:04:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 shutdown_connections 2023-09-30T23:04:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4f7c067330 0x7f4f7c0697e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4f900b00d0 0x7f4f900cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9006e650 0x7f4f900a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 --2- 172.21.15.142:0/4076819347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f900af020 0x7f4f900c5810 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.125+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 >> 172.21.15.142:0/4076819347 conn(0x7f4f900680c0 msgr2=0x7f4f90156230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:49.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.126+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 shutdown_connections 2023-09-30T23:04:49.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.126+0000 7f4f95dff700 1 -- 172.21.15.142:0/4076819347 wait complete. 2023-09-30T23:04:49.128 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:04:49.142 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":565,"stamp":"2023-09-30T23:04:48.279440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10489,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552010,"statfs":{"total":1600000000,"available":1589258256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489347,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-119,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.148562"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.522920+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:04:44.522920+0000","last_peered":"2023-09-30T23:04:44.522920+0000","last_clean":"2023-09-30T23:04:44.522920+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:04:44.522920+0000","last_undegraded":"2023-09-30T23:04:44.522920+0000","last_fullsized":"2023-09-30T23:04:44.522920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520779+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:04:44.520779+0000","last_peered":"2023-09-30T23:04:44.520779+0000","last_clean":"2023-09-30T23:04:44.520779+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:04:44.520779+0000","last_undegraded":"2023-09-30T23:04:44.520779+0000","last_fullsized":"2023-09-30T23:04:44.520779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.526291+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:04:44.526291+0000","last_peered":"2023-09-30T23:04:44.526291+0000","last_clean":"2023-09-30T23:04:44.526291+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:04:44.526291+0000","last_undegraded":"2023-09-30T23:04:44.526291+0000","last_fullsized":"2023-09-30T23:04:44.526291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.521592+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:04:44.521592+0000","last_peered":"2023-09-30T23:04:44.521592+0000","last_clean":"2023-09-30T23:04:44.521592+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:04:44.521592+0000","last_undegraded":"2023-09-30T23:04:44.521592+0000","last_fullsized":"2023-09-30T23:04:44.521592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":324,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519406+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:04:44.519406+0000","last_peered":"2023-09-30T23:04:44.519406+0000","last_clean":"2023-09-30T23:04:44.519406+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:04:44.519406+0000","last_undegraded":"2023-09-30T23:04:44.519406+0000","last_fullsized":"2023-09-30T23:04:44.519406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:52:06.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519573+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:04:44.519573+0000","last_peered":"2023-09-30T23:04:44.519573+0000","last_clean":"2023-09-30T23:04:44.519573+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:04:44.519573+0000","last_undegraded":"2023-09-30T23:04:44.519573+0000","last_fullsized":"2023-09-30T23:04:44.519573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519496+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:04:44.519496+0000","last_peered":"2023-09-30T23:04:44.519496+0000","last_clean":"2023-09-30T23:04:44.519496+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:04:44.519496+0000","last_undegraded":"2023-09-30T23:04:44.519496+0000","last_fullsized":"2023-09-30T23:04:44.519496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.525759+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:04:44.525759+0000","last_peered":"2023-09-30T23:04:44.525759+0000","last_clean":"2023-09-30T23:04:44.525759+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:04:44.525759+0000","last_undegraded":"2023-09-30T23:04:44.525759+0000","last_fullsized":"2023-09-30T23:04:44.525759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520700+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:04:44.520700+0000","last_peered":"2023-09-30T23:04:44.520700+0000","last_clean":"2023-09-30T23:04:44.520700+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:04:44.520700+0000","last_undegraded":"2023-09-30T23:04:44.520700+0000","last_fullsized":"2023-09-30T23:04:44.520700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.315},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.0309999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.86699999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.95699999999999996,"15min":1.004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52600000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.43099999999999999},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89700000000000002,"5min":1.028,"15min":1.028},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.93999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.434},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.056},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.44,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.35999999999999999},"max":{"1min":0.82599999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90800000000000003,"5min":1.03,"15min":1.135},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.004},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.147,"15min":1.147},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.754,"15min":0.72299999999999998},"min":{"1min":0.53900000000000003,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.071},"last":0.49099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71699999999999997,"15min":0.81000000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.85299999999999998,"5min":0.96699999999999997,"15min":6.5190000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.752},"min":{"1min":0.435,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.89300000000000002,"5min":1.0269999999999999,"15min":4.3680000000000003},"last":0.497}]},{"osd":1,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.77000000000000002},"min":{"1min":0.48799999999999999,"5min":0.45900000000000002,"15min":0.42699999999999999},"max":{"1min":0.876,"5min":1.123,"15min":3.6339999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.83899999999999997},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.034,"15min":8.4339999999999993},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40799999999999997},"max":{"1min":0.82399999999999995,"5min":0.92000000000000004,"15min":3.4580000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.83499999999999996},"min":{"1min":0.57399999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":5.7110000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.55800000000000005,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.86299999999999999,"5min":0.96599999999999997,"15min":1.5249999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.65800000000000003},"min":{"1min":0.441,"5min":0.41399999999999998,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.4670000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93899999999999995,"5min":0.999,"15min":5.9279999999999999},"last":0.746}]},{"osd":5,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.321},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":1.018,"15min":1.4590000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.999,"5min":0.999,"15min":6.0599999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.98799999999999999,"5min":1.0469999999999999,"15min":1.3620000000000001},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.61099999999999999,"5min":0.69699999999999995,"15min":1.083},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.745},"last":0.44}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":0.61799999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.40400000000000003,"5min":0.35899999999999999,"15min":0.27400000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.70899999999999996},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":1.091,"15min":1.091},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.73999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48399999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1499999999999999,"15min":1.22},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.75},"min":{"1min":0.59599999999999997,"5min":0.53900000000000003,"15min":0.53100000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.3560000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.1160000000000001,"15min":1.127},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.48099999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.4059999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1240000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.79100000000000004},"min":{"1min":0.64900000000000002,"5min":0.53900000000000003,"15min":0.504},"max":{"1min":1.153,"5min":1.153,"15min":1.3779999999999999},"last":0.69699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":0.748,"15min":0.85699999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":0.63700000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.0289999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.879},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.749,"15min":1.0029999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.98899999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.27},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.171},"last":0.627}]},{"osd":5,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.75,"15min":0.73599999999999999},"min":{"1min":0.57799999999999996,"5min":0.502,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.099,"15min":1.2649999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.752},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91700000000000004,"5min":1.091,"15min":4.0419999999999998},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.434},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.6059999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.48399999999999999},"max":{"1min":1.032,"5min":1.0669999999999999,"15min":7.2610000000000001},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.65700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0660000000000001,"15min":2.4569999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.149,"5min":1.149,"15min":4.0220000000000002},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.77500000000000002,"15min":1.4630000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.48199999999999998,"15min":0.45500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.249},"max":{"1min":0.62,"5min":0.876,"15min":1.542},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.627,"5min":1.0109999999999999,"15min":1.494},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38900000000000001,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48599999999999999,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.28999999999999998},"max":{"1min":0.51000000000000001,"5min":0.94399999999999995,"15min":1.649},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.309},"max":{"1min":0.58899999999999997,"5min":0.98099999999999998,"15min":1.3220000000000001},"last":0.504}]},{"osd":4,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.44400000000000001},"max":{"1min":0.93799999999999994,"5min":1.1819999999999999,"15min":1.234},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.38},"max":{"1min":1.0049999999999999,"5min":1.167,"15min":1.4910000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.179},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":1.22,"15min":2.7320000000000002},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":1.161,"15min":1.615},"last":0.753},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77200000000000002,"15min":0.752},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.1879999999999999,"15min":1.4199999999999999},"last":0.628}]},{"osd":7,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.46000000000000002},"max":{"1min":0.92000000000000004,"5min":1.206,"15min":1.206},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":1.2330000000000001,"15min":2.7730000000000001},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.21199999999999999},"max":{"1min":0.57799999999999996,"5min":0.66900000000000004,"15min":1.1519999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.69899999999999995,"15min":1.919},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60599999999999998,"5min":0.81299999999999994,"15min":1.254},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.27300000000000002},"max":{"1min":0.69099999999999995,"5min":0.748,"15min":1.9390000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.72799999999999998,"5min":0.85199999999999998,"15min":1.6020000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.5309999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.35999999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.401},"last":0.626},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.77700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.443},"max":{"1min":1.0189999999999999,"5min":1.1439999999999999,"15min":3.306},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.46200000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.508},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.621,"5min":0.55200000000000005,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.4910000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.5620000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73699999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.48099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.3140000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.48799999999999999},"max":{"1min":1.0920000000000001,"5min":1.1040000000000001,"15min":1.3640000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.573},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68300000000000005,"15min":0.628},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85499999999999998,"5min":0.98199999999999998,"15min":1.022},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.63700000000000001},"min":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.47699999999999998}]},{"osd":1,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70599999999999996,"15min":0.65700000000000003},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.65400000000000003},"min":{"1min":0.54600000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94199999999999995,"5min":1.012,"15min":1.012},"last":0.751}]},{"osd":2,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.68700000000000006},"min":{"1min":0.48199999999999998,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.98699999999999999,"15min":1.492},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77500000000000002,"15min":0.72199999999999998},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.0149999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.72399999999999998},"min":{"1min":0.63800000000000001,"5min":0.56399999999999995,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.5149999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.871,"5min":0.98299999999999998,"15min":1.0429999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.37},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0209999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.90200000000000002,"5min":1.0409999999999999,"15min":1.45},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.57599999999999996,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.91700000000000004,"5min":1.028,"15min":1.0649999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Sep 30 23:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47999999999999998,"15min":0.45700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.016},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.93300000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86499999999999999,"5min":0.96199999999999997,"15min":0.98199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.008},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.92900000000000005,"15min":0.97899999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":0.95899999999999996,"15min":1.0449999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.67200000000000004},"min":{"1min":0.42799999999999999,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70199999999999996,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95899999999999996,"15min":1.044},"last":0.82499999999999996}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70599999999999996,"15min":0.67300000000000004},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.72899999999999998,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.96799999999999997,"15min":0.97599999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76900000000000002,"5min":0.89100000000000001,"15min":0.95299999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":1.081},"last":0.77700000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78500000000000003,"5min":0.90900000000000003,"15min":1.03},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.083},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.45900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":1.0700000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[]}} 2023-09-30T23:04:49.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T23:04:49.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.335+0000 7f4e047ff700 1 Processor -- start 2023-09-30T23:04:49.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.335+0000 7f4e047ff700 1 -- start start 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.336+0000 7f4e047ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4dfc157a90 0x7f4dfc15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.336+0000 7f4e047ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc06b3d0 0x7f4dfc0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.336+0000 7f4e047ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4dfc0b1f40 0x7f4dfc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.336+0000 7f4e047ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0b23e0 con 0x7f4dfc0b1f40 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.336+0000 7f4e047ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc06d470 con 0x7f4dfc157a90 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.336+0000 7f4e047ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc157e60 con 0x7f4dfc06b3d0 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.336+0000 7f4e02d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4dfc0b1f40 0x7f4dfc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4dfc0b1f40 0x7f4dfc069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45896/0 (socket says 172.21.15.142:45896) 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3063042971 learned_addr learned my addr 172.21.15.142:0/3063042971 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e0259b700 1 --2- 172.21.15.142:0/3063042971 >> v2:172.21.15.148:3300/0 conn(0x7f4dfc157a90 0x7f4dfc15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e01d9a700 1 --2- 172.21.15.142:0/3063042971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc06b3d0 0x7f4dfc0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3063042971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc06b3d0 msgr2=0x7f4dfc0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 --2- 172.21.15.142:0/3063042971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc06b3d0 0x7f4dfc0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3063042971 >> v2:172.21.15.148:3300/0 conn(0x7f4dfc157a90 msgr2=0x7f4dfc15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 --2- 172.21.15.142:0/3063042971 >> v2:172.21.15.148:3300/0 conn(0x7f4dfc157a90 0x7f4dfc15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3063042971 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc15c430 con 0x7f4dfc0b1f40 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e01d9a700 1 --2- 172.21.15.142:0/3063042971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc06b3d0 0x7f4dfc0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e02d9c700 1 --2- 172.21.15.142:0/3063042971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0b1f40 0x7f4dfc069f10 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc06d1e0 tx=0x7f4df4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c9b7961343336b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e01599700 1 -- 172.21.15.142:0/3063042971 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400e070 con 0x7f4dfc0b1f40 2023-09-30T23:04:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e01599700 1 -- 172.21.15.142:0/3063042971 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400ba20 con 0x7f4dfc0b1f40 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.337+0000 7f4e01599700 1 -- 172.21.15.142:0/3063042971 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40092e0 con 0x7f4dfc0b1f40 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 -- 172.21.15.142:0/3063042971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0b1f40 msgr2=0x7f4dfc069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3063042971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0b1f40 0x7f4dfc069f10 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc06d1e0 tx=0x7f4df4009840 comp rx=0 tx=0).stop 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 -- 172.21.15.142:0/3063042971 shutdown_connections 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3063042971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0b1f40 0x7f4dfc069f10 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3063042971 >> v2:172.21.15.148:3300/0 conn(0x7f4dfc157a90 0x7f4dfc15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3063042971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc06b3d0 0x7f4dfc0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 -- 172.21.15.142:0/3063042971 >> 172.21.15.142:0/3063042971 conn(0x7f4dfc0680c0 msgr2=0x7f4dfc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 -- 172.21.15.142:0/3063042971 shutdown_connections 2023-09-30T23:04:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.338+0000 7f4e047ff700 1 -- 172.21.15.142:0/3063042971 wait complete. 2023-09-30T23:04:49.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.340+0000 7f4e047ff700 1 Processor -- start 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.340+0000 7f4e047ff700 1 -- start start 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.340+0000 7f4e047ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc06b3d0 0x7f4dfc153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e047ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc0b1f40 0x7f4dfc167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e047ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc157a90 0x7f4dfc168210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e047ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc154750 con 0x7f4dfc157a90 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e047ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc153b40 con 0x7f4dfc06b3d0 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e047ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc153e20 con 0x7f4dfc0b1f40 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc157a90 0x7f4dfc168210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc157a90 0x7f4dfc168210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45906/0 (socket says 172.21.15.142:45906) 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3148328893 learned_addr learned my addr 172.21.15.142:0/3148328893 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e01d9a700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc0b1f40 0x7f4dfc167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e0259b700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc06b3d0 0x7f4dfc153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc0b1f40 msgr2=0x7f4dfc167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc0b1f40 0x7f4dfc167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc06b3d0 msgr2=0x7f4dfc153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc06b3d0 0x7f4dfc153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 -- 172.21.15.142:0/3148328893 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009ae0 con 0x7f4dfc157a90 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.341+0000 7f4e02d9c700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc157a90 0x7f4dfc168210 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc068600 tx=0x7f4df4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.342+0000 7f4df27fc700 1 -- 172.21.15.142:0/3148328893 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40032f0 con 0x7f4dfc157a90 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.342+0000 7f4df27fc700 1 -- 172.21.15.142:0/3148328893 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df4025460 con 0x7f4dfc157a90 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.342+0000 7f4df27fc700 1 -- 172.21.15.142:0/3148328893 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4025800 con 0x7f4dfc157a90 2023-09-30T23:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.342+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc154100 con 0x7f4dfc157a90 2023-09-30T23:04:49.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.342+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc153750 con 0x7f4dfc157a90 2023-09-30T23:04:49.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.343+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc153910 con 0x7f4dfc157a90 2023-09-30T23:04:49.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.344+0000 7f4df27fc700 1 -- 172.21.15.142:0/3148328893 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4df4003040 con 0x7f4dfc157a90 2023-09-30T23:04:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.345+0000 7f4df27fc700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4de0067330 0x7f4de00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.345+0000 7f4df27fc700 1 -- 172.21.15.142:0/3148328893 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4df4086870 con 0x7f4dfc157a90 2023-09-30T23:04:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.345+0000 7f4e0259b700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4de0067330 0x7f4de00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.346+0000 7f4e0259b700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4de0067330 0x7f4de00697e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009ca0 tx=0x7f4df8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.349+0000 7f4df27fc700 1 -- 172.21.15.142:0/3148328893 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4df4053b20 con 0x7f4dfc157a90 2023-09-30T23:04:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.541+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dfc0c85d0 con 0x7f4dfc157a90 2023-09-30T23:04:49.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.542+0000 7f4df27fc700 1 -- 172.21.15.142:0/3148328893 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+13937 (secure 0 0 0) 0x7f4df4057140 con 0x7f4dfc157a90 2023-09-30T23:04:49.542 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:49.542 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":199,"fsid":"45159191-1b2c-47ed-b172-96c0a1a05709","created":"2023-09-30T22:52:09.454789+0000","modified":"2023-09-30T23:04:45.515854+0000","last_up_change":"2023-09-30T22:52:15.884868+0000","last_in_change":"2023-09-30T22:52:12.869187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:52:16.153348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:52:22.038262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":109694},{"type":"v1","addr":"172.21.15.142:6809","nonce":109694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":109694},{"type":"v1","addr":"172.21.15.142:6811","nonce":109694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":109694},{"type":"v1","addr":"172.21.15.142:6819","nonce":109694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":109694},{"type":"v1","addr":"172.21.15.142:6815","nonce":109694}]},"public_addr":"172.21.15.142:6809/109694","cluster_addr":"172.21.15.142:6811/109694","heartbeat_back_addr":"172.21.15.142:6819/109694","heartbeat_front_addr":"172.21.15.142:6815/109694","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":109693},{"type":"v1","addr":"172.21.15.142:6801","nonce":109693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":109693},{"type":"v1","addr":"172.21.15.142:6803","nonce":109693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":109693},{"type":"v1","addr":"172.21.15.142:6807","nonce":109693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":109693},{"type":"v1","addr":"172.21.15.142:6805","nonce":109693}]},"public_addr":"172.21.15.142:6801/109693","cluster_addr":"172.21.15.142:6803/109693","heartbeat_back_addr":"172.21.15.142:6807/109693","heartbeat_front_addr":"172.21.15.142:6805/109693","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":109702},{"type":"v1","addr":"172.21.15.142:6823","nonce":109702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":109702},{"type":"v1","addr":"172.21.15.142:6827","nonce":109702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":109702},{"type":"v1","addr":"172.21.15.142:6831","nonce":109702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":109702},{"type":"v1","addr":"172.21.15.142:6829","nonce":109702}]},"public_addr":"172.21.15.142:6823/109702","cluster_addr":"172.21.15.142:6827/109702","heartbeat_back_addr":"172.21.15.142:6831/109702","heartbeat_front_addr":"172.21.15.142:6829/109702","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":109696},{"type":"v1","addr":"172.21.15.142:6814","nonce":109696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":109696},{"type":"v1","addr":"172.21.15.142:6818","nonce":109696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":109696},{"type":"v1","addr":"172.21.15.142:6826","nonce":109696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":109696},{"type":"v1","addr":"172.21.15.142:6822","nonce":109696}]},"public_addr":"172.21.15.142:6814/109696","cluster_addr":"172.21.15.142:6818/109696","heartbeat_back_addr":"172.21.15.142:6826/109696","heartbeat_front_addr":"172.21.15.142:6822/109696","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":109934},{"type":"v1","addr":"172.21.15.148:6801","nonce":109934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":109934},{"type":"v1","addr":"172.21.15.148:6803","nonce":109934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":109934},{"type":"v1","addr":"172.21.15.148:6807","nonce":109934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":109934},{"type":"v1","addr":"172.21.15.148:6805","nonce":109934}]},"public_addr":"172.21.15.148:6801/109934","cluster_addr":"172.21.15.148:6803/109934","heartbeat_back_addr":"172.21.15.148:6807/109934","heartbeat_front_addr":"172.21.15.148:6805/109934","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":109935},{"type":"v1","addr":"172.21.15.148:6809","nonce":109935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":109935},{"type":"v1","addr":"172.21.15.148:6811","nonce":109935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":109935},{"type":"v1","addr":"172.21.15.148:6817","nonce":109935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":109935},{"type":"v1","addr":"172.21.15.148:6813","nonce":109935}]},"public_addr":"172.21.15.148:6809/109935","cluster_addr":"172.21.15.148:6811/109935","heartbeat_back_addr":"172.21.15.148:6817/109935","heartbeat_front_addr":"172.21.15.148:6813/109935","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":109936},{"type":"v1","addr":"172.21.15.148:6816","nonce":109936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":109936},{"type":"v1","addr":"172.21.15.148:6819","nonce":109936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":109936},{"type":"v1","addr":"172.21.15.148:6823","nonce":109936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":109936},{"type":"v1","addr":"172.21.15.148:6821","nonce":109936}]},"public_addr":"172.21.15.148:6816/109936","cluster_addr":"172.21.15.148:6819/109936","heartbeat_back_addr":"172.21.15.148:6823/109936","heartbeat_front_addr":"172.21.15.148:6821/109936","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":109961},{"type":"v1","addr":"172.21.15.148:6825","nonce":109961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":109961},{"type":"v1","addr":"172.21.15.148:6827","nonce":109961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":109961},{"type":"v1","addr":"172.21.15.148:6831","nonce":109961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":109961},{"type":"v1","addr":"172.21.15.148:6829","nonce":109961}]},"public_addr":"172.21.15.148:6825/109961","cluster_addr":"172.21.15.148:6827/109961","heartbeat_back_addr":"172.21.15.148:6831/109961","heartbeat_front_addr":"172.21.15.148:6829/109961","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.101471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.153799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.166580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.171976+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.124458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.179023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.116494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:52:14.195003+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:6835/3975475300":"2023-10-01T23:04:42.126280+0000","172.21.15.148:6833/3975475300":"2023-10-01T23:04:42.126280+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4de0067330 msgr2=0x7f4de00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4de0067330 0x7f4de00697e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009ca0 tx=0x7f4df8008040 comp rx=0 tx=0).stop 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc157a90 msgr2=0x7f4dfc168210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc157a90 0x7f4dfc168210 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc068600 tx=0x7f4df4018000 comp rx=0 tx=0).stop 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 shutdown_connections 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f4de0067330 0x7f4de00697e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc157a90 0x7f4dfc168210 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dfc06b3d0 0x7f4dfc153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 --2- 172.21.15.142:0/3148328893 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4dfc0b1f40 0x7f4dfc167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 >> 172.21.15.142:0/3148328893 conn(0x7f4dfc0680c0 msgr2=0x7f4dfc0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:49.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 shutdown_connections 2023-09-30T23:04:49.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:49.545+0000 7f4e047ff700 1 -- 172.21.15.142:0/3148328893 wait complete. 2023-09-30T23:04:50.564 INFO:tasks.ceph:Scrubbing osd.0 2023-09-30T23:04:50.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:50.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.766+0000 7f10667ff700 1 Processor -- start 2023-09-30T23:04:50.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.766+0000 7f10667ff700 1 -- start start 2023-09-30T23:04:50.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.767+0000 7f10667ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1060157000 0x7f10600ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:50.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.767+0000 7f10667ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600c7b30 con 0x7f10601573d0 2023-09-30T23:04:50.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.767+0000 7f10667ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600c5970 con 0x7f10600c76c0 2023-09-30T23:04:50.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.767+0000 7f10667ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c7d60 con 0x7f1060157000 2023-09-30T23:04:50.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f1064d9c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f10601573d0 0x7f1060157830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42796/0 (socket says 172.21.15.142:42796) 2023-09-30T23:04:50.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f1064d9c700 1 -- 172.21.15.142:0/1205034062 learned_addr learned my addr 172.21.15.142:0/1205034062 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:50.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105ffff700 1 --2- 172.21.15.142:0/1205034062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1060157000 0x7f10600ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:50.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105effd700 1 -- 172.21.15.142:0/1205034062 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419865467 0 0) 0x7f10600c7b30 con 0x7f10601573d0 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105effd700 1 -- 172.21.15.142:0/1205034062 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1048003570 con 0x7f10601573d0 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105effd700 1 -- 172.21.15.142:0/1205034062 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264631616 0 0) 0x7f10600c5970 con 0x7f10600c76c0 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105effd700 1 -- 172.21.15.142:0/1205034062 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10600c7b30 con 0x7f10600c76c0 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105ffff700 1 -- 172.21.15.142:0/1205034062 >> v1:172.21.15.148:6789/0 conn(0x7f10600c76c0 legacy=0x7f10600c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105ffff700 1 -- 172.21.15.142:0/1205034062 >> v1:172.21.15.142:6789/0 conn(0x7f10601573d0 legacy=0x7f1060157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.768+0000 7f105ffff700 1 -- 172.21.15.142:0/1205034062 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600c5320 con 0x7f1060157000 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.769+0000 7f105ffff700 1 --2- 172.21.15.142:0/1205034062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1060157000 0x7f10600ca240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1050009910 tx=0x7f10500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ef8bcd29c88aa8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.769+0000 7f105effd700 1 -- 172.21.15.142:0/1205034062 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011630 con 0x7f1060157000 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.769+0000 7f105effd700 1 -- 172.21.15.142:0/1205034062 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050011790 con 0x7f1060157000 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.769+0000 7f105effd700 1 -- 172.21.15.142:0/1205034062 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011b30 con 0x7f1060157000 2023-09-30T23:04:50.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.769+0000 7f10667ff700 1 -- 172.21.15.142:0/1205034062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1060157000 msgr2=0x7f10600ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.769+0000 7f10667ff700 1 --2- 172.21.15.142:0/1205034062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1060157000 0x7f10600ca240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1050009910 tx=0x7f10500091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:50.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.770+0000 7f10667ff700 1 -- 172.21.15.142:0/1205034062 shutdown_connections 2023-09-30T23:04:50.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.770+0000 7f10667ff700 1 --2- 172.21.15.142:0/1205034062 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1060157000 0x7f10600ca240 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:50.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.770+0000 7f10667ff700 1 -- 172.21.15.142:0/1205034062 >> 172.21.15.142:0/1205034062 conn(0x7f10600cc670 msgr2=0x7f10600cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:50.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.770+0000 7f10667ff700 1 -- 172.21.15.142:0/1205034062 shutdown_connections 2023-09-30T23:04:50.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.770+0000 7f10667ff700 1 -- 172.21.15.142:0/1205034062 wait complete. 2023-09-30T23:04:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.771+0000 7f10667ff700 1 Processor -- start 2023-09-30T23:04:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.771+0000 7f10667ff700 1 -- start start 2023-09-30T23:04:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.772+0000 7f10667ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c76c0 0x7f1060158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:50.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.772+0000 7f10667ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1060157000 0x7f1060159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.772+0000 7f10667ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10601573d0 0x7f10601662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.772+0000 7f10667ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106013e1a0 con 0x7f10601573d0 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.772+0000 7f10667ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10601596b0 con 0x7f1060157000 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.772+0000 7f10667ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106013e440 con 0x7f10600c76c0 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10601573d0 0x7f10601662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10601573d0 0x7f10601662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45908/0 (socket says 172.21.15.142:45908) 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 -- 172.21.15.142:0/2351548578 learned_addr learned my addr 172.21.15.142:0/2351548578 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f105ffff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c76c0 0x7f1060158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f105f7fe700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1060157000 0x7f1060159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 -- 172.21.15.142:0/2351548578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c76c0 msgr2=0x7f1060158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f10600c76c0 0x7f1060158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 -- 172.21.15.142:0/2351548578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1060157000 msgr2=0x7f1060159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1060157000 0x7f1060159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 -- 172.21.15.142:0/2351548578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050009420 con 0x7f10601573d0 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f105f7fe700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1060157000 0x7f1060159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1064d9c700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10601573d0 0x7f10601662f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f105800cc20 tx=0x7f1058001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800a8b0 con 0x7f10601573d0 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800aa10 con 0x7f10601573d0 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.773+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106013e720 con 0x7f10601573d0 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.774+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800add0 con 0x7f10601573d0 2023-09-30T23:04:50.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.774+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600c2cc0 con 0x7f10601573d0 2023-09-30T23:04:50.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.774+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1060069a50 con 0x7f10601573d0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.775+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1058007300 con 0x7f10601573d0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.776+0000 7f1047fff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f104c067330 0x7f104c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.776+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1058084c90 con 0x7f10601573d0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.777+0000 7f105ffff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f104c067330 0x7f104c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.777+0000 7f1047fff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f104c06d7a0 0x7f104c06fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.777+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 --> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f104c070280 con 0x7f104c06d7a0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.777+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10580871f0 con 0x7f10601573d0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.777+0000 7f105f7fe700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f104c06d7a0 0x7f104c06fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.777+0000 7f105ffff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f104c067330 0x7f104c0697e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1050009860 tx=0x7f1050017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:50.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.777+0000 7f105f7fe700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f104c06d7a0 0x7f104c06fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:50.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.778+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== osd.0 v2:172.21.15.142:6808/109694 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f104c070280 con 0x7f104c06d7a0 2023-09-30T23:04:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.791+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 --> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1060157ae0 con 0x7f104c06d7a0 2023-09-30T23:04:50.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.791+0000 7f1047fff700 1 -- 172.21.15.142:0/2351548578 <== osd.0 v2:172.21.15.142:6808/109694 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f1060157ae0 con 0x7f104c06d7a0 2023-09-30T23:04:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:50.791 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:50.791 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f104c06d7a0 msgr2=0x7f104c06fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6808/109694,v1:172.21.15.142:6809/109694] conn(0x7f104c06d7a0 0x7f104c06fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:50.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f104c067330 msgr2=0x7f104c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f104c067330 0x7f104c0697e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1050009860 tx=0x7f1050017000 comp rx=0 tx=0).stop 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10601573d0 msgr2=0x7f10601662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 --2- 172.21.15.142:0/2351548578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10601573d0 0x7f10601662f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f105800cc20 tx=0x7f1058001a40 comp rx=0 tx=0).stop 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f1064d9c700 1 -- 172.21.15.142:0/2351548578 reap_dead start 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 shutdown_connections 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 >> 172.21.15.142:0/2351548578 conn(0x7f10600cc670 msgr2=0x7f10600cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 shutdown_connections 2023-09-30T23:04:50.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:50.792+0000 7f10667ff700 1 -- 172.21.15.142:0/2351548578 wait complete. 2023-09-30T23:04:50.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-30T23:04:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.000+0000 7fca02fff700 1 Processor -- start 2023-09-30T23:04:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.000+0000 7fca02fff700 1 -- start start 2023-09-30T23:04:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.001+0000 7fca02fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9fc15ac70 0x7fc9fc06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.001+0000 7fca02fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc15dde0 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.001+0000 7fca02fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc06b840 con 0x7fc9fc0c6da0 2023-09-30T23:04:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.001+0000 7fca02fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc15d7d0 con 0x7fc9fc15ac70 2023-09-30T23:04:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.001+0000 7fca0159c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9fc15ac70 0x7fc9fc06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.001+0000 7fca00d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc9fc06d3f0 0x7fc9fc06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53142/0 (socket says 172.21.15.142:53142) 2023-09-30T23:04:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.001+0000 7fca00d9b700 1 -- 172.21.15.142:0/1964002453 learned_addr learned my addr 172.21.15.142:0/1964002453 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fc9fb7fe700 1 -- 172.21.15.142:0/1964002453 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330982700 0 0) 0x7fc9fc15dde0 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fca0159c700 1 -- 172.21.15.142:0/1964002453 >> v1:172.21.15.148:6789/0 conn(0x7fc9fc0c6da0 legacy=0x7fc9fc159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fca0159c700 1 -- 172.21.15.142:0/1964002453 >> v1:172.21.15.142:6789/0 conn(0x7fc9fc06d3f0 legacy=0x7fc9fc06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fca0159c700 1 -- 172.21.15.142:0/1964002453 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0c7230 con 0x7fc9fc15ac70 2023-09-30T23:04:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fca0159c700 1 --2- 172.21.15.142:0/1964002453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc15ac70 0x7fc9fc06d7c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009e60 tx=0x7fc9f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f24a33cc027381 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fc9fb7fe700 1 -- 172.21.15.142:0/1964002453 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400e070 con 0x7fc9fc15ac70 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fc9fb7fe700 1 -- 172.21.15.142:0/1964002453 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f400bc30 con 0x7fc9fc15ac70 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.002+0000 7fc9fb7fe700 1 -- 172.21.15.142:0/1964002453 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4012430 con 0x7fc9fc15ac70 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.003+0000 7fca02fff700 1 -- 172.21.15.142:0/1964002453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc15ac70 msgr2=0x7fc9fc06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.003+0000 7fca02fff700 1 --2- 172.21.15.142:0/1964002453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc15ac70 0x7fc9fc06d7c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009e60 tx=0x7fc9f4009780 comp rx=0 tx=0).stop 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.003+0000 7fca02fff700 1 -- 172.21.15.142:0/1964002453 shutdown_connections 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.003+0000 7fca02fff700 1 --2- 172.21.15.142:0/1964002453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc15ac70 0x7fc9fc06d7c0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.003+0000 7fca02fff700 1 -- 172.21.15.142:0/1964002453 >> 172.21.15.142:0/1964002453 conn(0x7fc9fc067e30 msgr2=0x7fc9fc068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.003+0000 7fca02fff700 1 -- 172.21.15.142:0/1964002453 shutdown_connections 2023-09-30T23:04:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.003+0000 7fca02fff700 1 -- 172.21.15.142:0/1964002453 wait complete. 2023-09-30T23:04:51.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.004+0000 7fca02fff700 1 Processor -- start 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.005+0000 7fca02fff700 1 -- start start 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.005+0000 7fca02fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc06d3f0 0x7fc9fc0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.005+0000 7fca02fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9fc0c6da0 0x7fc9fc157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.005+0000 7fca02fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9fc157d80 0x7fc9fc14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.005+0000 7fca02fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc1581e0 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.005+0000 7fca02fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc13dcb0 con 0x7fc9fc157d80 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.005+0000 7fca02fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc13d0e0 con 0x7fc9fc0c6da0 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc06d3f0 0x7fc9fc0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc06d3f0 0x7fc9fc0cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41500/0 (socket says 172.21.15.142:41500) 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 -- 172.21.15.142:0/3773705738 learned_addr learned my addr 172.21.15.142:0/3773705738 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca0159c700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9fc157d80 0x7fc9fc14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fc9fbfff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9fc0c6da0 0x7fc9fc157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 -- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9fc0c6da0 msgr2=0x7fc9fc157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9fc0c6da0 0x7fc9fc157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 -- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9fc157d80 msgr2=0x7fc9fc14a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9fc157d80 0x7fc9fc14a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 -- 172.21.15.142:0/3773705738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4009a20 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca0159c700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9fc157d80 0x7fc9fc14a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:51.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fc9fbfff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9fc0c6da0 0x7fc9fc157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:51.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.006+0000 7fca00d9b700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc06d3f0 0x7fc9fc0cf120 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000c7e0 tx=0x7fc9f0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.007+0000 7fc9f8ff9700 1 -- 172.21.15.142:0/3773705738 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0005b30 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.007+0000 7fc9f8ff9700 1 -- 172.21.15.142:0/3773705738 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f0005c90 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.007+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc13d380 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.007+0000 7fc9f8ff9700 1 -- 172.21.15.142:0/3773705738 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0007300 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.007+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc13d940 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.008+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc069420 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.009+0000 7fc9f8ff9700 1 -- 172.21.15.142:0/3773705738 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc9f001b400 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.009+0000 7fc9f8ff9700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc9e0067330 0x7fc9e00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.010+0000 7fc9f8ff9700 1 -- 172.21.15.142:0/3773705738 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc9f0084470 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.010+0000 7fc9fbfff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc9e0067330 0x7fc9e00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.010+0000 7fc9fbfff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc9e0067330 0x7fc9e00697e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc06abc0 tx=0x7fc9e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.014+0000 7fc9f8ff9700 1 -- 172.21.15.142:0/3773705738 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc9f0051650 con 0x7fc9fc06d3f0 2023-09-30T23:04:51.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.203+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9fc13ddf0 con 0x7fc9e0067330 2023-09-30T23:04:51.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.204+0000 7fc9f8ff9700 1 -- 172.21.15.142:0/3773705738 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc9e8001490 con 0x7fc9e0067330 2023-09-30T23:04:51.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc9e0067330 msgr2=0x7fc9e00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc9e0067330 0x7fc9e00697e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc06abc0 tx=0x7fc9e8009040 comp rx=0 tx=0).stop 2023-09-30T23:04:51.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc06d3f0 msgr2=0x7fc9fc0cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc06d3f0 0x7fc9fc0cf120 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000c7e0 tx=0x7fc9f0007df0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 shutdown_connections 2023-09-30T23:04:51.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fc9e0067330 0x7fc9e00697e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9fc157d80 0x7fc9fc14a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc06d3f0 0x7fc9fc0cf120 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 --2- 172.21.15.142:0/3773705738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9fc0c6da0 0x7fc9fc157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 >> 172.21.15.142:0/3773705738 conn(0x7fc9fc067e30 msgr2=0x7fc9fc0cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 shutdown_connections 2023-09-30T23:04:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.206+0000 7fca02fff700 1 -- 172.21.15.142:0/3773705738 wait complete. 2023-09-30T23:04:51.207 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 0 to deep-scrub 2023-09-30T23:04:51.223 INFO:tasks.ceph:Scrubbing osd.1 2023-09-30T23:04:51.223 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.416+0000 7f17625ff700 1 Processor -- start 2023-09-30T23:04:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.416+0000 7f17625ff700 1 -- start start 2023-09-30T23:04:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.417+0000 7f17625ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f175c0b0e80 0x7f175c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.417+0000 7f17625ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f175c06afb0 0x7f175c06b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.417+0000 7f17625ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c0cbed0 con 0x7f175c159d30 2023-09-30T23:04:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.417+0000 7f17625ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0cb2c0 con 0x7f175c0b0e80 2023-09-30T23:04:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.417+0000 7f17625ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0cb5a0 con 0x7f175c06afb0 2023-09-30T23:04:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f175c0b0e80 0x7f175c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f175c0b0e80 0x7f175c0cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41514/0 (socket says 172.21.15.142:41514) 2023-09-30T23:04:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 -- 172.21.15.142:0/821130756 learned_addr learned my addr 172.21.15.142:0/821130756 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f1760b9c700 1 --2- 172.21.15.142:0/821130756 >> v2:172.21.15.148:3300/0 conn(0x7f175c06afb0 0x7f175c06b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 -- 172.21.15.142:0/821130756 >> v2:172.21.15.148:3300/0 conn(0x7f175c06afb0 msgr2=0x7f175c06b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:51.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 --2- 172.21.15.142:0/821130756 >> v2:172.21.15.148:3300/0 conn(0x7f175c06afb0 0x7f175c06b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 -- 172.21.15.142:0/821130756 >> v1:172.21.15.148:6789/0 conn(0x7f175c159d30 legacy=0x7f175c0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 -- 172.21.15.142:0/821130756 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0cb880 con 0x7f175c0b0e80 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.418+0000 7f175b7fe700 1 --2- 172.21.15.142:0/821130756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c0cc360 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f175c0649d0 tx=0x7f1750009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2dcc4d08c9cc0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f175affd700 1 -- 172.21.15.142:0/821130756 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750009e70 con 0x7f175c0b0e80 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f175affd700 1 -- 172.21.15.142:0/821130756 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175000b860 con 0x7f175c0b0e80 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f175affd700 1 -- 172.21.15.142:0/821130756 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000bc00 con 0x7f175c0b0e80 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 -- 172.21.15.142:0/821130756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 msgr2=0x7f175c0cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 --2- 172.21.15.142:0/821130756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c0cc360 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f175c0649d0 tx=0x7f1750009250 comp rx=0 tx=0).stop 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 -- 172.21.15.142:0/821130756 shutdown_connections 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 --2- 172.21.15.142:0/821130756 >> v2:172.21.15.148:3300/0 conn(0x7f175c06afb0 0x7f175c06b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 --2- 172.21.15.142:0/821130756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c0cc360 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 -- 172.21.15.142:0/821130756 >> 172.21.15.142:0/821130756 conn(0x7f175c0cf2e0 msgr2=0x7f175c0b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:51.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 -- 172.21.15.142:0/821130756 shutdown_connections 2023-09-30T23:04:51.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.419+0000 7f17625ff700 1 -- 172.21.15.142:0/821130756 wait complete. 2023-09-30T23:04:51.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.421+0000 7f17625ff700 1 Processor -- start 2023-09-30T23:04:51.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.421+0000 7f17625ff700 1 -- start start 2023-09-30T23:04:51.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f17625ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f175c06afb0 0x7f175c16b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f17625ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c16abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f17625ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f175c159d30 0x7f175c0a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f17625ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c157000 con 0x7f175c0b0e80 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f17625ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c1572e0 con 0x7f175c159d30 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f17625ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c1575c0 con 0x7f175c06afb0 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c16abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c16abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41516/0 (socket says 172.21.15.142:41516) 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 -- 172.21.15.142:0/4022573399 learned_addr learned my addr 172.21.15.142:0/4022573399 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 -- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f175c06afb0 msgr2=0x7f175c16b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f1760b9c700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f175c159d30 0x7f175c0a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175bfff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f175c06afb0 0x7f175c16b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f175c06afb0 0x7f175c16b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 -- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f175c159d30 msgr2=0x7f175c0a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f175c159d30 0x7f175c0a5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175b7fe700 1 -- 172.21.15.142:0/4022573399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500094f0 con 0x7f175c0b0e80 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f1760b9c700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f175c159d30 0x7f175c0a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.422+0000 7f175bfff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f175c06afb0 0x7f175c16b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.423+0000 7f175b7fe700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c16abd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f175c070610 tx=0x7f1750017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.423+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750011420 con 0x7f175c0b0e80 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.423+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17500115a0 con 0x7f175c0b0e80 2023-09-30T23:04:51.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.423+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c1578a0 con 0x7f175c0b0e80 2023-09-30T23:04:51.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.423+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750011960 con 0x7f175c0b0e80 2023-09-30T23:04:51.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.423+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c157e60 con 0x7f175c0b0e80 2023-09-30T23:04:51.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.424+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f175c06e330 con 0x7f175c0b0e80 2023-09-30T23:04:51.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.425+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f17500253f0 con 0x7f175c0b0e80 2023-09-30T23:04:51.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.426+0000 7f1743fff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1748067330 0x7f17480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.426+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1750086350 con 0x7f175c0b0e80 2023-09-30T23:04:51.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.426+0000 7f175bfff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1748067330 0x7f17480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.426+0000 7f1743fff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f174806d7a0 0x7f174806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.426+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 --> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1748070280 con 0x7f174806d7a0 2023-09-30T23:04:51.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.426+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17500888b0 con 0x7f175c0b0e80 2023-09-30T23:04:51.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.426+0000 7f1760b9c700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f174806d7a0 0x7f174806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.427+0000 7f175bfff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1748067330 0x7f17480697e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f175c0ce650 tx=0x7f174c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.427+0000 7f1760b9c700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f174806d7a0 0x7f174806fbb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.428+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== osd.1 v2:172.21.15.142:6800/109693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1748070280 con 0x7f174806d7a0 2023-09-30T23:04:51.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.441+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 --> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f175c0cbb60 con 0x7f174806d7a0 2023-09-30T23:04:51.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.441+0000 7f1743fff700 1 -- 172.21.15.142:0/4022573399 <== osd.1 v2:172.21.15.142:6800/109693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f175c0cbb60 con 0x7f174806d7a0 2023-09-30T23:04:51.441 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:51.441 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:51.442 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:51.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.441+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f174806d7a0 msgr2=0x7f174806fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.441+0000 7f17625ff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6800/109693,v1:172.21.15.142:6801/109693] conn(0x7f174806d7a0 0x7f174806fbb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1748067330 msgr2=0x7f17480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f1748067330 0x7f17480697e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f175c0ce650 tx=0x7f174c009040 comp rx=0 tx=0).stop 2023-09-30T23:04:51.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 msgr2=0x7f175c16abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 --2- 172.21.15.142:0/4022573399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f175c0b0e80 0x7f175c16abd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f175c070610 tx=0x7f1750017000 comp rx=0 tx=0).stop 2023-09-30T23:04:51.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f1760b9c700 1 -- 172.21.15.142:0/4022573399 reap_dead start 2023-09-30T23:04:51.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 shutdown_connections 2023-09-30T23:04:51.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 >> 172.21.15.142:0/4022573399 conn(0x7f175c0cf2e0 msgr2=0x7f175c0b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:51.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 shutdown_connections 2023-09-30T23:04:51.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.442+0000 7f17625ff700 1 -- 172.21.15.142:0/4022573399 wait complete. 2023-09-30T23:04:51.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-30T23:04:51.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.648+0000 7f53f63ff700 1 Processor -- start 2023-09-30T23:04:51.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.648+0000 7f53f63ff700 1 -- start start 2023-09-30T23:04:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53f63ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53f0159b90 0x7f53f015a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53f63ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0069f10 0x7f53f006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53f63ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f00b0ee0 con 0x7f53f00aebf0 2023-09-30T23:04:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53f63ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f00aefc0 con 0x7f53f0159b90 2023-09-30T23:04:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53f63ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015a550 con 0x7f53f0069f10 2023-09-30T23:04:51.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53ef7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53f0159b90 0x7f53f015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53f499c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0069f10 0x7f53f006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53ef7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53f0159b90 0x7f53f015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.142:34174/0 (socket says 172.21.15.142:34174) 2023-09-30T23:04:51.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3433232047 learned_addr learned my addr 172.21.15.142:0/3433232047 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:51.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.650+0000 7f53effff700 1 --1- 172.21.15.142:0/3433232047 >> v1:172.21.15.148:6789/0 conn(0x7f53f00aebf0 0x7f53f006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:55514/0 (socket says 172.21.15.142:55514) 2023-09-30T23:04:51.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53eeffd700 1 -- 172.21.15.142:0/3433232047 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764360780 0 0) 0x7f53f00b0ee0 con 0x7f53f00aebf0 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0069f10 msgr2=0x7f53f006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53ef7fe700 1 --2- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0069f10 0x7f53f006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3433232047 >> v1:172.21.15.148:6789/0 conn(0x7f53f00aebf0 legacy=0x7f53f006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3433232047 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f006f360 con 0x7f53f0159b90 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53f499c700 1 --2- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0069f10 0x7f53f006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53ef7fe700 1 --2- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0159b90 0x7f53f015a010 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f53e40099e0 tx=0x7f53e4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9210df5f5b30d17a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53eeffd700 1 -- 172.21.15.142:0/3433232047 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400b820 con 0x7f53f0159b90 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53eeffd700 1 -- 172.21.15.142:0/3433232047 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e400b980 con 0x7f53f0159b90 2023-09-30T23:04:51.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.651+0000 7f53eeffd700 1 -- 172.21.15.142:0/3433232047 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400bd20 con 0x7f53f0159b90 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 -- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0159b90 msgr2=0x7f53f015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0159b90 0x7f53f015a010 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f53e40099e0 tx=0x7f53e4009250 comp rx=0 tx=0).stop 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 -- 172.21.15.142:0/3433232047 shutdown_connections 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0069f10 0x7f53f006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3433232047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0159b90 0x7f53f015a010 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 -- 172.21.15.142:0/3433232047 >> 172.21.15.142:0/3433232047 conn(0x7f53f00680c0 msgr2=0x7f53f00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 -- 172.21.15.142:0/3433232047 shutdown_connections 2023-09-30T23:04:51.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.652+0000 7f53f63ff700 1 -- 172.21.15.142:0/3433232047 wait complete. 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.654+0000 7f53f63ff700 1 Processor -- start 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.654+0000 7f53f63ff700 1 -- start start 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.655+0000 7f53f63ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0069f10 0x7f53f0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.655+0000 7f53f63ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f00aebf0 0x7f53f015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53f63ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0159b90 0x7f53f015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53f63ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015abd0 con 0x7f53f00aebf0 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53f63ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f0152b50 con 0x7f53f0069f10 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53f63ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f0151f40 con 0x7f53f0159b90 2023-09-30T23:04:51.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f00aebf0 0x7f53f015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f00aebf0 0x7f53f015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41532/0 (socket says 172.21.15.142:41532) 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3146651851 learned_addr learned my addr 172.21.15.142:0/3146651851 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53effff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0069f10 0x7f53f0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53f499c700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0159b90 0x7f53f015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0159b90 msgr2=0x7f53f015b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0159b90 0x7f53f015b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0069f10 msgr2=0x7f53f0152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0069f10 0x7f53f0152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 -- 172.21.15.142:0/3146651851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8009a20 con 0x7f53f00aebf0 2023-09-30T23:04:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.656+0000 7f53ef7fe700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f00aebf0 0x7f53f015a690 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f53f00685b0 tx=0x7f53e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.657+0000 7f53d7fff700 1 -- 172.21.15.142:0/3146651851 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400b820 con 0x7f53f00aebf0 2023-09-30T23:04:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.657+0000 7f53d7fff700 1 -- 172.21.15.142:0/3146651851 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e401a450 con 0x7f53f00aebf0 2023-09-30T23:04:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.657+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e40094f0 con 0x7f53f00aebf0 2023-09-30T23:04:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.657+0000 7f53d7fff700 1 -- 172.21.15.142:0/3146651851 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e401a7f0 con 0x7f53f00aebf0 2023-09-30T23:04:51.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.657+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f0152500 con 0x7f53f00aebf0 2023-09-30T23:04:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.658+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f0152cc0 con 0x7f53f00aebf0 2023-09-30T23:04:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.659+0000 7f53d7fff700 1 -- 172.21.15.142:0/3146651851 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f53e401ab60 con 0x7f53f00aebf0 2023-09-30T23:04:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.659+0000 7f53d7fff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53dc067330 0x7f53dc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.659+0000 7f53d7fff700 1 -- 172.21.15.142:0/3146651851 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f53e4085ee0 con 0x7f53f00aebf0 2023-09-30T23:04:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.660+0000 7f53effff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53dc067330 0x7f53dc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:51.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.660+0000 7f53effff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53dc067330 0x7f53dc0697e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f53f006a630 tx=0x7f53e0007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:51.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.664+0000 7f53d7fff700 1 -- 172.21.15.142:0/3146651851 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f53e4053190 con 0x7f53f00aebf0 2023-09-30T23:04:51.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.854+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f53f006fc10 con 0x7f53dc067330 2023-09-30T23:04:51.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.854+0000 7f53d7fff700 1 -- 172.21.15.142:0/3146651851 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f53f006fc10 con 0x7f53dc067330 2023-09-30T23:04:51.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53dc067330 msgr2=0x7f53dc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53dc067330 0x7f53dc0697e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f53f006a630 tx=0x7f53e0007bf0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f00aebf0 msgr2=0x7f53f015a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f00aebf0 0x7f53f015a690 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f53f00685b0 tx=0x7f53e4017000 comp rx=0 tx=0).stop 2023-09-30T23:04:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 shutdown_connections 2023-09-30T23:04:51.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f53dc067330 0x7f53dc0697e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f53f0159b90 0x7f53f015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53f0069f10 0x7f53f0152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 --2- 172.21.15.142:0/3146651851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53f00aebf0 0x7f53f015a690 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 >> 172.21.15.142:0/3146651851 conn(0x7f53f00680c0 msgr2=0x7f53f0150140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 shutdown_connections 2023-09-30T23:04:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:51.857+0000 7f53f63ff700 1 -- 172.21.15.142:0/3146651851 wait complete. 2023-09-30T23:04:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 1 to deep-scrub 2023-09-30T23:04:51.874 INFO:tasks.ceph:Scrubbing osd.2 2023-09-30T23:04:51.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:52.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.067+0000 7f5e37fff700 1 Processor -- start 2023-09-30T23:04:52.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.067+0000 7f5e37fff700 1 -- start start 2023-09-30T23:04:52.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.068+0000 7f5e37fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e30141310 0x7f5e300c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.068+0000 7f5e37fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.068+0000 7f5e37fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300c6a80 con 0x7f5e300c6240 2023-09-30T23:04:52.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.068+0000 7f5e37fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e300c4ac0 con 0x7f5e30141310 2023-09-30T23:04:52.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.068+0000 7f5e37fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301416e0 con 0x7f5e300c40e0 2023-09-30T23:04:52.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e3659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e35d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e30141310 0x7f5e300c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e3659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:37694/0 (socket says 172.21.15.142:37694) 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e3659c700 1 -- 172.21.15.142:0/1766342168 learned_addr learned my addr 172.21.15.142:0/1766342168 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e3659c700 1 -- 172.21.15.142:0/1766342168 >> v2:172.21.15.148:3300/0 conn(0x7f5e30141310 msgr2=0x7f5e300c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e3659c700 1 --2- 172.21.15.142:0/1766342168 >> v2:172.21.15.148:3300/0 conn(0x7f5e30141310 0x7f5e300c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e3659c700 1 -- 172.21.15.142:0/1766342168 >> v1:172.21.15.148:6789/0 conn(0x7f5e300c6240 legacy=0x7f5e30158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.069+0000 7f5e3659c700 1 -- 172.21.15.142:0/1766342168 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300c3250 con 0x7f5e300c40e0 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.070+0000 7f5e3659c700 1 --2- 172.21.15.142:0/1766342168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300c4580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009f20 tx=0x7f5e28009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43bfa762a837dc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.070+0000 7f5e34d99700 1 -- 172.21.15.142:0/1766342168 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800e070 con 0x7f5e300c40e0 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.070+0000 7f5e34d99700 1 -- 172.21.15.142:0/1766342168 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2800b9d0 con 0x7f5e300c40e0 2023-09-30T23:04:52.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.070+0000 7f5e34d99700 1 -- 172.21.15.142:0/1766342168 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280092e0 con 0x7f5e300c40e0 2023-09-30T23:04:52.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.070+0000 7f5e37fff700 1 -- 172.21.15.142:0/1766342168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 msgr2=0x7f5e300c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.070+0000 7f5e37fff700 1 --2- 172.21.15.142:0/1766342168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300c4580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009f20 tx=0x7f5e28009840 comp rx=0 tx=0).stop 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.071+0000 7f5e37fff700 1 -- 172.21.15.142:0/1766342168 shutdown_connections 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.071+0000 7f5e37fff700 1 --2- 172.21.15.142:0/1766342168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300c4580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.071+0000 7f5e37fff700 1 --2- 172.21.15.142:0/1766342168 >> v2:172.21.15.148:3300/0 conn(0x7f5e30141310 0x7f5e300c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.071+0000 7f5e37fff700 1 -- 172.21.15.142:0/1766342168 >> 172.21.15.142:0/1766342168 conn(0x7f5e300cc670 msgr2=0x7f5e300cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.071+0000 7f5e37fff700 1 -- 172.21.15.142:0/1766342168 shutdown_connections 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.071+0000 7f5e37fff700 1 -- 172.21.15.142:0/1766342168 wait complete. 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.072+0000 7f5e37fff700 1 Processor -- start 2023-09-30T23:04:52.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.072+0000 7f5e37fff700 1 -- start start 2023-09-30T23:04:52.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.073+0000 7f5e37fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.073+0000 7f5e37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e300c6240 0x7f5e300c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.073+0000 7f5e37fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e30141310 0x7f5e3016a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.073+0000 7f5e37fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300cb2e0 con 0x7f5e300c6240 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.073+0000 7f5e37fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3013db40 con 0x7f5e30141310 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.073+0000 7f5e37fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300ca6d0 con 0x7f5e300c40e0 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e300c6240 0x7f5e300c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e300c6240 0x7f5e300c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41536/0 (socket says 172.21.15.142:41536) 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 -- 172.21.15.142:0/1436830320 learned_addr learned my addr 172.21.15.142:0/1436830320 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e35d9b700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3659c700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e30141310 0x7f5e3016a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 -- 172.21.15.142:0/1436830320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 msgr2=0x7f5e300cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5e300c40e0 0x7f5e300cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 -- 172.21.15.142:0/1436830320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e30141310 msgr2=0x7f5e3016a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e30141310 0x7f5e3016a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 -- 172.21.15.142:0/1436830320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28009ae0 con 0x7f5e300c6240 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.074+0000 7f5e3559a700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e300c6240 0x7f5e300c8c80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c590 tx=0x7f5e2000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.075+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20011590 con 0x7f5e300c6240 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.075+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e300ca9b0 con 0x7f5e300c6240 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.075+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e20011710 con 0x7f5e300c6240 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.075+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20011ad0 con 0x7f5e300c6240 2023-09-30T23:04:52.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.075+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e300caf70 con 0x7f5e300c6240 2023-09-30T23:04:52.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.076+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e30069a50 con 0x7f5e300c6240 2023-09-30T23:04:52.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.077+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5e2001b3b0 con 0x7f5e300c6240 2023-09-30T23:04:52.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.077+0000 7f5e25ffb700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e14067330 0x7f5e140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.078+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5e20084520 con 0x7f5e300c6240 2023-09-30T23:04:52.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.078+0000 7f5e35d9b700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e14067330 0x7f5e140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.078+0000 7f5e25ffb700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f5e1406d7a0 0x7f5e1406fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.078+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 --> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e14070280 con 0x7f5e1406d7a0 2023-09-30T23:04:52.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.078+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e200848f0 con 0x7f5e300c6240 2023-09-30T23:04:52.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.078+0000 7f5e3659c700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f5e1406d7a0 0x7f5e1406fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.078+0000 7f5e35d9b700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e14067330 0x7f5e140697e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009d10 tx=0x7f5e2c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.079+0000 7f5e3659c700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f5e1406d7a0 0x7f5e1406fbb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.079+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== osd.2 v2:172.21.15.142:6821/109702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5e14070280 con 0x7f5e1406d7a0 2023-09-30T23:04:52.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.092+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 --> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5e300cb130 con 0x7f5e1406d7a0 2023-09-30T23:04:52.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.092+0000 7f5e25ffb700 1 -- 172.21.15.142:0/1436830320 <== osd.2 v2:172.21.15.142:6821/109702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f5e300cb130 con 0x7f5e1406d7a0 2023-09-30T23:04:52.092 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:52.092 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:52.092 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f5e1406d7a0 msgr2=0x7f5e1406fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6821/109702,v1:172.21.15.142:6823/109702] conn(0x7f5e1406d7a0 0x7f5e1406fbb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e14067330 msgr2=0x7f5e140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f5e14067330 0x7f5e140697e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009d10 tx=0x7f5e2c0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e300c6240 msgr2=0x7f5e300c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 --2- 172.21.15.142:0/1436830320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e300c6240 0x7f5e300c8c80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c590 tx=0x7f5e2000c8a0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e3659c700 1 -- 172.21.15.142:0/1436830320 reap_dead start 2023-09-30T23:04:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 shutdown_connections 2023-09-30T23:04:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 >> 172.21.15.142:0/1436830320 conn(0x7f5e300cc670 msgr2=0x7f5e3013de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 shutdown_connections 2023-09-30T23:04:52.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.093+0000 7f5e37fff700 1 -- 172.21.15.142:0/1436830320 wait complete. 2023-09-30T23:04:52.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-30T23:04:52.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.302+0000 7f99125ff700 1 Processor -- start 2023-09-30T23:04:52.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.302+0000 7f99125ff700 1 -- start start 2023-09-30T23:04:52.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f99125ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f990c143350 0x7f990c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f99125ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f990c0692f0 0x7f990c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f99125ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c0cc6b0 con 0x7f990c15dc50 2023-09-30T23:04:52.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f99125ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c15e050 con 0x7f990c143350 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f99125ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0cb7d0 con 0x7f990c0692f0 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f990c143350 0x7f990c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f990c143350 0x7f990c0cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41548/0 (socket says 172.21.15.142:41548) 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990bfff700 1 -- 172.21.15.142:0/2653469931 learned_addr learned my addr 172.21.15.142:0/2653469931 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990b7fe700 1 --2- 172.21.15.142:0/2653469931 >> v2:172.21.15.148:3300/0 conn(0x7f990c0692f0 0x7f990c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990bfff700 1 -- 172.21.15.142:0/2653469931 >> v2:172.21.15.148:3300/0 conn(0x7f990c0692f0 msgr2=0x7f990c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990bfff700 1 --2- 172.21.15.142:0/2653469931 >> v2:172.21.15.148:3300/0 conn(0x7f990c0692f0 0x7f990c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990bfff700 1 -- 172.21.15.142:0/2653469931 >> v1:172.21.15.148:6789/0 conn(0x7f990c15dc50 legacy=0x7f990c068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990bfff700 1 -- 172.21.15.142:0/2653469931 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0cbaa0 con 0x7f990c143350 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.304+0000 7f990b7fe700 1 --2- 172.21.15.142:0/2653469931 >> v2:172.21.15.148:3300/0 conn(0x7f990c0692f0 0x7f990c15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.305+0000 7f990bfff700 1 --2- 172.21.15.142:0/2653469931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c0cb290 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f990c069c90 tx=0x7f98fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b6d6f20cdf7e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.305+0000 7f990affd700 1 -- 172.21.15.142:0/2653469931 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00b820 con 0x7f990c143350 2023-09-30T23:04:52.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.305+0000 7f990affd700 1 -- 172.21.15.142:0/2653469931 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00b980 con 0x7f990c143350 2023-09-30T23:04:52.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.305+0000 7f990affd700 1 -- 172.21.15.142:0/2653469931 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00bd20 con 0x7f990c143350 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.305+0000 7f99125ff700 1 -- 172.21.15.142:0/2653469931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 msgr2=0x7f990c0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.305+0000 7f99125ff700 1 --2- 172.21.15.142:0/2653469931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c0cb290 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f990c069c90 tx=0x7f98fc009250 comp rx=0 tx=0).stop 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.306+0000 7f99125ff700 1 -- 172.21.15.142:0/2653469931 shutdown_connections 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.306+0000 7f99125ff700 1 --2- 172.21.15.142:0/2653469931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c0cb290 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.306+0000 7f99125ff700 1 --2- 172.21.15.142:0/2653469931 >> v2:172.21.15.148:3300/0 conn(0x7f990c0692f0 0x7f990c15d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.306+0000 7f99125ff700 1 -- 172.21.15.142:0/2653469931 >> 172.21.15.142:0/2653469931 conn(0x7f990c0ce8e0 msgr2=0x7f990c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.306+0000 7f99125ff700 1 -- 172.21.15.142:0/2653469931 shutdown_connections 2023-09-30T23:04:52.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.306+0000 7f99125ff700 1 -- 172.21.15.142:0/2653469931 wait complete. 2023-09-30T23:04:52.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.307+0000 7f99125ff700 1 Processor -- start 2023-09-30T23:04:52.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.307+0000 7f99125ff700 1 -- start start 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f99125ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990c0692f0 0x7f990c158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f99125ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f99125ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990c15dc50 0x7f990c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f99125ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c15b020 con 0x7f990c143350 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f99125ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c139d30 con 0x7f990c15dc50 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f99125ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c15a260 con 0x7f990c0692f0 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41550/0 (socket says 172.21.15.142:41550) 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.308+0000 7f990b7fe700 1 -- 172.21.15.142:0/3106302349 learned_addr learned my addr 172.21.15.142:0/3106302349 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f990bfff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990c0692f0 0x7f990c158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f9910b9c700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990c15dc50 0x7f990c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f990b7fe700 1 -- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990c0692f0 msgr2=0x7f990c158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f990b7fe700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990c0692f0 0x7f990c158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f990b7fe700 1 -- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990c15dc50 msgr2=0x7f990c15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f990b7fe700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990c15dc50 0x7f990c15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f990b7fe700 1 -- 172.21.15.142:0/3106302349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0094f0 con 0x7f990c143350 2023-09-30T23:04:52.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f9910b9c700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990c15dc50 0x7f990c15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:52.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f990b7fe700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c15b880 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f990000c830 tx=0x7f9900008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f98f3fff700 1 -- 172.21.15.142:0/3106302349 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900011600 con 0x7f990c143350 2023-09-30T23:04:52.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f98f3fff700 1 -- 172.21.15.142:0/3106302349 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9900011760 con 0x7f990c143350 2023-09-30T23:04:52.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f98f3fff700 1 -- 172.21.15.142:0/3106302349 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900011b20 con 0x7f990c143350 2023-09-30T23:04:52.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.309+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c15a540 con 0x7f990c143350 2023-09-30T23:04:52.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.310+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c15ab00 con 0x7f990c143350 2023-09-30T23:04:52.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.310+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c06ea70 con 0x7f990c143350 2023-09-30T23:04:52.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.312+0000 7f98f3fff700 1 -- 172.21.15.142:0/3106302349 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f99000193b0 con 0x7f990c143350 2023-09-30T23:04:52.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.313+0000 7f98f3fff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98f8067330 0x7f98f80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.313+0000 7f98f3fff700 1 -- 172.21.15.142:0/3106302349 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9900084950 con 0x7f990c143350 2023-09-30T23:04:52.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.313+0000 7f990bfff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98f8067330 0x7f98f80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.313+0000 7f990bfff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98f8067330 0x7f98f80697e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f990c069c90 tx=0x7f98fc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.317+0000 7f98f3fff700 1 -- 172.21.15.142:0/3106302349 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9900051ab0 con 0x7f990c143350 2023-09-30T23:04:52.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.505+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f990c0cbd80 con 0x7f98f8067330 2023-09-30T23:04:52.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.505+0000 7f98f3fff700 1 -- 172.21.15.142:0/3106302349 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f990c0cbd80 con 0x7f98f8067330 2023-09-30T23:04:52.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98f8067330 msgr2=0x7f98f80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98f8067330 0x7f98f80697e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f990c069c90 tx=0x7f98fc016000 comp rx=0 tx=0).stop 2023-09-30T23:04:52.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 msgr2=0x7f990c15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c15b880 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f990000c830 tx=0x7f9900008040 comp rx=0 tx=0).stop 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 shutdown_connections 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f98f8067330 0x7f98f80697e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990c15dc50 0x7f990c15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990c0692f0 0x7f990c158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 --2- 172.21.15.142:0/3106302349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f990c143350 0x7f990c15b880 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.507+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 >> 172.21.15.142:0/3106302349 conn(0x7f990c0ce8e0 msgr2=0x7f990c1411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.508+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 shutdown_connections 2023-09-30T23:04:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.508+0000 7f99125ff700 1 -- 172.21.15.142:0/3106302349 wait complete. 2023-09-30T23:04:52.511 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 2 to deep-scrub 2023-09-30T23:04:52.525 INFO:tasks.ceph:Scrubbing osd.3 2023-09-30T23:04:52.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:52.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.720+0000 7f7fb4dff700 1 Processor -- start 2023-09-30T23:04:52.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.720+0000 7f7fb4dff700 1 -- start start 2023-09-30T23:04:52.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.721+0000 7f7fb4dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7fb00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.721+0000 7f7fb4dff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7fb00b1aa0 0x7f7fb00ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.721+0000 7f7fb4dff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb0068230 con 0x7f7fb0159de0 2023-09-30T23:04:52.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.721+0000 7f7fb4dff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00696d0 con 0x7f7fb00b1aa0 2023-09-30T23:04:52.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.721+0000 7f7fb4dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0067620 con 0x7f7fb0159a10 2023-09-30T23:04:52.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fadd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7fb0159de0 0x7f7fb015d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53148/0 (socket says 172.21.15.142:53148) 2023-09-30T23:04:52.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fadd9b700 1 -- 172.21.15.142:0/1553929136 learned_addr learned my addr 172.21.15.142:0/1553929136 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:52.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7faed9d700 1 --2- 172.21.15.142:0/1553929136 >> v2:172.21.15.148:3300/0 conn(0x7f7fb00b1aa0 0x7f7fb00ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fae59c700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7fb00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254208888 0 0) 0x7f7fb0068230 con 0x7f7fb0159de0 2023-09-30T23:04:52.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f98003570 con 0x7f7fb0159de0 2023-09-30T23:04:52.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 794759281 0 0) 0x7f7f98003570 con 0x7f7fb0159de0 2023-09-30T23:04:52.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 msgr2=0x7f7fb00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7fb00c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 >> v2:172.21.15.148:3300/0 conn(0x7f7fb00b1aa0 msgr2=0x7f7fb00ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 --2- 172.21.15.142:0/1553929136 >> v2:172.21.15.148:3300/0 conn(0x7f7fb00b1aa0 0x7f7fb00ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0067900 con 0x7f7fb0159de0 2023-09-30T23:04:52.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7f7fa4001470 con 0x7f7fb0159de0 2023-09-30T23:04:52.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fae59c700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7fb00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:52.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.722+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 >> v1:172.21.15.142:6789/0 conn(0x7f7fb0159de0 legacy=0x7f7fb015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fad59a700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f98003a60 0x7f7f98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fad59a700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7f98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fad59a700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f98004d50 0x7f7f980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00696d0 con 0x7f7f98004d50 2023-09-30T23:04:52.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0067620 con 0x7f7f98003a60 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9800ba60 con 0x7f7fb0159a10 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7faed9d700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f98004d50 0x7f7f980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fae59c700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f98003a60 0x7f7f98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fadd9b700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7f98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7faed9d700 1 -- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 msgr2=0x7f7f98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7faed9d700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7f98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7faed9d700 1 -- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f98003a60 msgr2=0x7f7f98003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7faed9d700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f98003a60 0x7f7f98003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7faed9d700 1 -- 172.21.15.142:0/1553929136 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0009420 con 0x7f7f98004d50 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7fadd9b700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7fb0159a10 0x7f7f98004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:52.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.723+0000 7f7faed9d700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f98004d50 0x7f7f980051c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7fb006f500 tx=0x7f7fa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88ac29df9b679de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800ea30 con 0x7f7f98004d50 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa800f040 con 0x7f7f98004d50 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fad59a700 1 -- 172.21.15.142:0/1553929136 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800edc0 con 0x7f7f98004d50 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fb4dff700 1 -- 172.21.15.142:0/1553929136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f98004d50 msgr2=0x7f7f980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fb4dff700 1 --2- 172.21.15.142:0/1553929136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f98004d50 0x7f7f980051c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7fb006f500 tx=0x7f7fa800b040 comp rx=0 tx=0).stop 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7faed9d700 1 -- 172.21.15.142:0/1553929136 reap_dead start 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fb4dff700 1 -- 172.21.15.142:0/1553929136 shutdown_connections 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fb4dff700 1 -- 172.21.15.142:0/1553929136 >> 172.21.15.142:0/1553929136 conn(0x7f7fb00cb2f0 msgr2=0x7f7fb00cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fb4dff700 1 -- 172.21.15.142:0/1553929136 shutdown_connections 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.724+0000 7f7fb4dff700 1 -- 172.21.15.142:0/1553929136 wait complete. 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.726+0000 7f7fb4dff700 1 Processor -- start 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.726+0000 7f7fb4dff700 1 -- start start 2023-09-30T23:04:52.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fb4dff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f98004d50 0x7f7fb014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fb4dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb014f8d0 0x7f7fb00c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fb4dff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fb00c6e40 0x7f7fb0153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fb4dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0154ab0 con 0x7f7fb014f8d0 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fb4dff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00c5930 con 0x7f7fb00c6e40 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fb4dff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00c72b0 con 0x7f7f98004d50 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb014f8d0 0x7f7fb00c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb014f8d0 0x7f7fb00c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41570/0 (socket says 172.21.15.142:41570) 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 -- 172.21.15.142:0/2022709861 learned_addr learned my addr 172.21.15.142:0/2022709861 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fae59c700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f98004d50 0x7f7fb014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7faed9d700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fb00c6e40 0x7f7fb0153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 -- 172.21.15.142:0/2022709861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f98004d50 msgr2=0x7f7fb014f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f98004d50 0x7f7fb014f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 -- 172.21.15.142:0/2022709861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fb00c6e40 msgr2=0x7f7fb0153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fb00c6e40 0x7f7fb0153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.727+0000 7f7fadd9b700 1 -- 172.21.15.142:0/2022709861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00c6470 con 0x7f7fb014f8d0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.728+0000 7f7fadd9b700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb014f8d0 0x7f7fb00c6900 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4001ed0 tx=0x7f7fa4000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.728+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4004a40 con 0x7f7fb014f8d0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.728+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4010040 con 0x7f7fb014f8d0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.728+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4004db0 con 0x7f7fb014f8d0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.728+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb00c5b40 con 0x7f7fb014f8d0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.728+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00c6100 con 0x7f7fb014f8d0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.729+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fb006e4b0 con 0x7f7fb014f8d0 2023-09-30T23:04:52.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.730+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7fa4005260 con 0x7f7fb014f8d0 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.731+0000 7f7f9e7fc700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7f90067330 0x7f7f900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.731+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7fa4083b30 con 0x7f7fb014f8d0 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.731+0000 7f7fae59c700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7f90067330 0x7f7f900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.731+0000 7f7f9e7fc700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f7f9006d7a0 0x7f7f9006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.731+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 --> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f90070280 con 0x7f7f9006d7a0 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.731+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fa4088220 con 0x7f7fb014f8d0 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.732+0000 7f7faed9d700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f7f9006d7a0 0x7f7f9006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.732+0000 7f7fae59c700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7f90067330 0x7f7f900697e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0006f00 tx=0x7f7fa00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.732+0000 7f7faed9d700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f7f9006d7a0 0x7f7f9006fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.733+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== osd.3 v2:172.21.15.142:6812/109696 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f7f90070280 con 0x7f7f9006d7a0 2023-09-30T23:04:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 --> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7fb0067be0 con 0x7f7f9006d7a0 2023-09-30T23:04:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7f9e7fc700 1 -- 172.21.15.142:0/2022709861 <== osd.3 v2:172.21.15.142:6812/109696 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f7fb0067be0 con 0x7f7f9006d7a0 2023-09-30T23:04:52.746 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:52.746 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:52.746 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f7f9006d7a0 msgr2=0x7f7f9006fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7fb4dff700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6812/109696,v1:172.21.15.142:6814/109696] conn(0x7f7f9006d7a0 0x7f7f9006fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7f90067330 msgr2=0x7f7f900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7fb4dff700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f7f90067330 0x7f7f900697e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0006f00 tx=0x7f7fa00091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb014f8d0 msgr2=0x7f7fb00c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7fb4dff700 1 --2- 172.21.15.142:0/2022709861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb014f8d0 0x7f7fb00c6900 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4001ed0 tx=0x7f7fa4000c30 comp rx=0 tx=0).stop 2023-09-30T23:04:52.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.746+0000 7f7faed9d700 1 -- 172.21.15.142:0/2022709861 reap_dead start 2023-09-30T23:04:52.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.747+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 shutdown_connections 2023-09-30T23:04:52.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.747+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 >> 172.21.15.142:0/2022709861 conn(0x7f7fb00cb2f0 msgr2=0x7f7fb00c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:52.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.747+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 shutdown_connections 2023-09-30T23:04:52.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.747+0000 7f7fb4dff700 1 -- 172.21.15.142:0/2022709861 wait complete. 2023-09-30T23:04:52.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-30T23:04:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.954+0000 7f22265ff700 1 Processor -- start 2023-09-30T23:04:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.954+0000 7f22265ff700 1 -- start start 2023-09-30T23:04:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.955+0000 7f22265ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200aebf0 0x7f222006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.955+0000 7f22265ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f222015a2a0 0x7f2220069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f22265ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200b0ee0 con 0x7f222006f190 2023-09-30T23:04:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f22265ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200aefc0 con 0x7f222015a2a0 2023-09-30T23:04:52.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f22265ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200b02d0 con 0x7f22200aebf0 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f222006f190 0x7f2220159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53164/0 (socket says 172.21.15.142:53164) 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221f7fe700 1 -- 172.21.15.142:0/3465415448 learned_addr learned my addr 172.21.15.142:0/3465415448 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221ffff700 1 --2- 172.21.15.142:0/3465415448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200aebf0 0x7f222006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f2224b9c700 1 --2- 172.21.15.142:0/3465415448 >> v2:172.21.15.148:3300/0 conn(0x7f222015a2a0 0x7f2220069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221effd700 1 -- 172.21.15.142:0/3465415448 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460258419 0 0) 0x7f22200b0ee0 con 0x7f222006f190 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221effd700 1 -- 172.21.15.142:0/3465415448 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2208003570 con 0x7f222006f190 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221ffff700 1 -- 172.21.15.142:0/3465415448 >> v2:172.21.15.148:3300/0 conn(0x7f222015a2a0 msgr2=0x7f2220069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221ffff700 1 --2- 172.21.15.142:0/3465415448 >> v2:172.21.15.148:3300/0 conn(0x7f222015a2a0 0x7f2220069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221ffff700 1 -- 172.21.15.142:0/3465415448 >> v1:172.21.15.142:6789/0 conn(0x7f222006f190 legacy=0x7f2220159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.956+0000 7f221ffff700 1 -- 172.21.15.142:0/3465415448 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200b05b0 con 0x7f22200aebf0 2023-09-30T23:04:52.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.957+0000 7f221ffff700 1 --2- 172.21.15.142:0/3465415448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200aebf0 0x7f222006ec50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f221000aa90 tx=0x7f221000a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86e548f7d2a013f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.957+0000 7f221effd700 1 -- 172.21.15.142:0/3465415448 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000c970 con 0x7f22200aebf0 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.957+0000 7f221effd700 1 -- 172.21.15.142:0/3465415448 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000cad0 con 0x7f22200aebf0 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.957+0000 7f221effd700 1 -- 172.21.15.142:0/3465415448 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000ce50 con 0x7f22200aebf0 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 -- 172.21.15.142:0/3465415448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200aebf0 msgr2=0x7f222006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 --2- 172.21.15.142:0/3465415448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200aebf0 0x7f222006ec50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f221000aa90 tx=0x7f221000a330 comp rx=0 tx=0).stop 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 -- 172.21.15.142:0/3465415448 shutdown_connections 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 --2- 172.21.15.142:0/3465415448 >> v2:172.21.15.148:3300/0 conn(0x7f222015a2a0 0x7f2220069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 --2- 172.21.15.142:0/3465415448 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22200aebf0 0x7f222006ec50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 -- 172.21.15.142:0/3465415448 >> 172.21.15.142:0/3465415448 conn(0x7f22200680c0 msgr2=0x7f22200c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 -- 172.21.15.142:0/3465415448 shutdown_connections 2023-09-30T23:04:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.958+0000 7f22265ff700 1 -- 172.21.15.142:0/3465415448 wait complete. 2023-09-30T23:04:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.960+0000 7f22265ff700 1 Processor -- start 2023-09-30T23:04:52.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.960+0000 7f22265ff700 1 -- start start 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.961+0000 7f22265ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f222006f190 0x7f22201486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.961+0000 7f22265ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22200aebf0 0x7f22201524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.961+0000 7f22265ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f222015a2a0 0x7f2220158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.961+0000 7f22265ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22201491d0 con 0x7f22200aebf0 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.961+0000 7f22265ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220151900 con 0x7f222015a2a0 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.961+0000 7f22265ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2220150d30 con 0x7f222006f190 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.961+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22200aebf0 0x7f22201524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22200aebf0 0x7f22201524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41574/0 (socket says 172.21.15.142:41574) 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 -- 172.21.15.142:0/3467058174 learned_addr learned my addr 172.21.15.142:0/3467058174 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221ffff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f222006f190 0x7f22201486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 -- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f222006f190 msgr2=0x7f22201486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f2224b9c700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f222015a2a0 0x7f2220158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f222006f190 0x7f22201486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 -- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f222015a2a0 msgr2=0x7f2220158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f222015a2a0 0x7f2220158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 -- 172.21.15.142:0/3467058174 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221000a5d0 con 0x7f22200aebf0 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221ffff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f222006f190 0x7f22201486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f2224b9c700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f222015a2a0 0x7f2220158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f221f7fe700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22200aebf0 0x7f22201524d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f221400c7c0 tx=0x7f2214007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f2207fff700 1 -- 172.21.15.142:0/3467058174 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214005c00 con 0x7f22200aebf0 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f2207fff700 1 -- 172.21.15.142:0/3467058174 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214005d60 con 0x7f22200aebf0 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2220150fd0 con 0x7f22200aebf0 2023-09-30T23:04:52.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.962+0000 7f2207fff700 1 -- 172.21.15.142:0/3467058174 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140072e0 con 0x7f22200aebf0 2023-09-30T23:04:52.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.963+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2220151590 con 0x7f22200aebf0 2023-09-30T23:04:52.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.964+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200695b0 con 0x7f22200aebf0 2023-09-30T23:04:52.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.964+0000 7f2207fff700 1 -- 172.21.15.142:0/3467058174 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2214007650 con 0x7f22200aebf0 2023-09-30T23:04:52.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.965+0000 7f2207fff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f220c067330 0x7f220c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:52.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.965+0000 7f2207fff700 1 -- 172.21.15.142:0/3467058174 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2214083c90 con 0x7f22200aebf0 2023-09-30T23:04:52.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.965+0000 7f221ffff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f220c067330 0x7f220c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:52.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.966+0000 7f221ffff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f220c067330 0x7f220c0697e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f221000aa90 tx=0x7f221001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:52.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:52.969+0000 7f2207fff700 1 -- 172.21.15.142:0/3467058174 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f221404b570 con 0x7f22200aebf0 2023-09-30T23:04:53.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.159+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f22200ae540 con 0x7f220c067330 2023-09-30T23:04:53.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.159+0000 7f2207fff700 1 -- 172.21.15.142:0/3467058174 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22200ae540 con 0x7f220c067330 2023-09-30T23:04:53.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.161+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f220c067330 msgr2=0x7f220c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.161+0000 7f22265ff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f220c067330 0x7f220c0697e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f221000aa90 tx=0x7f221001a000 comp rx=0 tx=0).stop 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.161+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22200aebf0 msgr2=0x7f22201524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.161+0000 7f22265ff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22200aebf0 0x7f22201524d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f221400c7c0 tx=0x7f2214007d90 comp rx=0 tx=0).stop 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 shutdown_connections 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f220c067330 0x7f220c0697e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f222015a2a0 0x7f2220158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f222006f190 0x7f22201486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 --2- 172.21.15.142:0/3467058174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22200aebf0 0x7f22201524d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 >> 172.21.15.142:0/3467058174 conn(0x7f22200680c0 msgr2=0x7f2220154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 shutdown_connections 2023-09-30T23:04:53.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.162+0000 7f22265ff700 1 -- 172.21.15.142:0/3467058174 wait complete. 2023-09-30T23:04:53.163 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 3 to deep-scrub 2023-09-30T23:04:53.178 INFO:tasks.ceph:Scrubbing osd.4 2023-09-30T23:04:53.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.371+0000 7f6a643ff700 1 Processor -- start 2023-09-30T23:04:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.371+0000 7f6a643ff700 1 -- start start 2023-09-30T23:04:53.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.372+0000 7f6a643ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a5c0c6240 0x7f6a5c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.372+0000 7f6a643ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a5c0c40e0 0x7f6a5c0c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.372+0000 7f6a643ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0c6a80 con 0x7f6a5c141310 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.372+0000 7f6a643ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c1416e0 con 0x7f6a5c0c40e0 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.372+0000 7f6a643ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c4a60 con 0x7f6a5c0c6240 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.372+0000 7f6a6299c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a5c0c40e0 0x7f6a5c0c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6299c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a5c0c40e0 0x7f6a5c0c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41576/0 (socket says 172.21.15.142:41576) 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6299c700 1 -- 172.21.15.142:0/1976031094 learned_addr learned my addr 172.21.15.142:0/1976031094 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6199a700 1 --2- 172.21.15.142:0/1976031094 >> v2:172.21.15.148:3300/0 conn(0x7f6a5c0c6240 0x7f6a5c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6299c700 1 -- 172.21.15.142:0/1976031094 >> v2:172.21.15.148:3300/0 conn(0x7f6a5c0c6240 msgr2=0x7f6a5c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6299c700 1 --2- 172.21.15.142:0/1976031094 >> v2:172.21.15.148:3300/0 conn(0x7f6a5c0c6240 0x7f6a5c0c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6299c700 1 -- 172.21.15.142:0/1976031094 >> v1:172.21.15.148:6789/0 conn(0x7f6a5c141310 legacy=0x7f6a5c158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6299c700 1 -- 172.21.15.142:0/1976031094 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0c3250 con 0x7f6a5c0c40e0 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a6299c700 1 --2- 172.21.15.142:0/1976031094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c0c40e0 0x7f6a5c0c4520 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0ca1a0 tx=0x7f6a54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ff5de740e0aaa9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a61199700 1 -- 172.21.15.142:0/1976031094 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400e070 con 0x7f6a5c0c40e0 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a61199700 1 -- 172.21.15.142:0/1976031094 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5400ba10 con 0x7f6a5c0c40e0 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.373+0000 7f6a61199700 1 -- 172.21.15.142:0/1976031094 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540092e0 con 0x7f6a5c0c40e0 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 -- 172.21.15.142:0/1976031094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c0c40e0 msgr2=0x7f6a5c0c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 --2- 172.21.15.142:0/1976031094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c0c40e0 0x7f6a5c0c4520 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0ca1a0 tx=0x7f6a54009840 comp rx=0 tx=0).stop 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 -- 172.21.15.142:0/1976031094 shutdown_connections 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 --2- 172.21.15.142:0/1976031094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c0c40e0 0x7f6a5c0c4520 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 --2- 172.21.15.142:0/1976031094 >> v2:172.21.15.148:3300/0 conn(0x7f6a5c0c6240 0x7f6a5c0c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 -- 172.21.15.142:0/1976031094 >> 172.21.15.142:0/1976031094 conn(0x7f6a5c0cc670 msgr2=0x7f6a5c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 -- 172.21.15.142:0/1976031094 shutdown_connections 2023-09-30T23:04:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.374+0000 7f6a643ff700 1 -- 172.21.15.142:0/1976031094 wait complete. 2023-09-30T23:04:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.376+0000 7f6a643ff700 1 Processor -- start 2023-09-30T23:04:53.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.376+0000 7f6a643ff700 1 -- start start 2023-09-30T23:04:53.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.376+0000 7f6a643ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a5c0c40e0 0x7f6a5c155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a643ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a5c0c6240 0x7f6a5c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a643ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c141310 0x7f6a5c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a643ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0b5420 con 0x7f6a5c141310 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a643ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0b4460 con 0x7f6a5c0c40e0 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a643ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0b4850 con 0x7f6a5c0c6240 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c141310 0x7f6a5c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c141310 0x7f6a5c0b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41592/0 (socket says 172.21.15.142:41592) 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 -- 172.21.15.142:0/4017511303 learned_addr learned my addr 172.21.15.142:0/4017511303 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6199a700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a5c0c6240 0x7f6a5c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6219b700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a5c0c40e0 0x7f6a5c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 -- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a5c0c6240 msgr2=0x7f6a5c0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a5c0c6240 0x7f6a5c0b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 -- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a5c0c40e0 msgr2=0x7f6a5c155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a5c0c40e0 0x7f6a5c155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 -- 172.21.15.142:0/4017511303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54009ae0 con 0x7f6a5c141310 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6199a700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a5c0c6240 0x7f6a5c0b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6219b700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a5c0c40e0 0x7f6a5c155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.377+0000 7f6a6299c700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c141310 0x7f6a5c0b58b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009fd0 tx=0x7f6a54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.378+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400bee0 con 0x7f6a5c141310 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.378+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54012e90 con 0x7f6a5c141310 2023-09-30T23:04:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.378+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c0b4af0 con 0x7f6a5c141310 2023-09-30T23:04:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.378+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5401d650 con 0x7f6a5c141310 2023-09-30T23:04:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.378+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c0b50b0 con 0x7f6a5c141310 2023-09-30T23:04:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.379+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a5c069a50 con 0x7f6a5c141310 2023-09-30T23:04:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.380+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6a5401da80 con 0x7f6a5c141310 2023-09-30T23:04:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.380+0000 7f6a527fc700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a40067330 0x7f6a400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.381+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6a54086820 con 0x7f6a5c141310 2023-09-30T23:04:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.381+0000 7f6a6219b700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a40067330 0x7f6a400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.381+0000 7f6a527fc700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7f6a4006d7a0 0x7f6a4006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.381+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 --> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a40070280 con 0x7f6a4006d7a0 2023-09-30T23:04:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.381+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a54086b10 con 0x7f6a5c141310 2023-09-30T23:04:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.381+0000 7f6a6219b700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a40067330 0x7f6a400697e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6a58006fd0 tx=0x7f6a58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.381+0000 7f6a6199a700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7f6a4006d7a0 0x7f6a4006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.382+0000 7f6a6199a700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7f6a4006d7a0 0x7f6a4006fbb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.383+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== osd.4 v2:172.21.15.148:6800/109934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f6a40070280 con 0x7f6a4006d7a0 2023-09-30T23:04:53.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.396+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 --> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a5c0b45a0 con 0x7f6a4006d7a0 2023-09-30T23:04:53.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a527fc700 1 -- 172.21.15.142:0/4017511303 <== osd.4 v2:172.21.15.148:6800/109934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f6a4c009b60 con 0x7f6a4006d7a0 2023-09-30T23:04:53.396 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:53.396 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:53.397 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:53.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7f6a4006d7a0 msgr2=0x7f6a4006fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.148:6800/109934,v1:172.21.15.148:6801/109934] conn(0x7f6a4006d7a0 0x7f6a4006fbb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a40067330 msgr2=0x7f6a400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6a40067330 0x7f6a400697e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6a58006fd0 tx=0x7f6a58008040 comp rx=0 tx=0).stop 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c141310 msgr2=0x7f6a5c0b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 --2- 172.21.15.142:0/4017511303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c141310 0x7f6a5c0b58b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009fd0 tx=0x7f6a54017000 comp rx=0 tx=0).stop 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a6299c700 1 -- 172.21.15.142:0/4017511303 reap_dead start 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 shutdown_connections 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 >> 172.21.15.142:0/4017511303 conn(0x7f6a5c0cc670 msgr2=0x7f6a5c0c9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 shutdown_connections 2023-09-30T23:04:53.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.397+0000 7f6a643ff700 1 -- 172.21.15.142:0/4017511303 wait complete. 2023-09-30T23:04:53.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-30T23:04:53.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.604+0000 7f6cd0fff700 1 Processor -- start 2023-09-30T23:04:53.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.604+0000 7f6cd0fff700 1 -- start start 2023-09-30T23:04:53.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.605+0000 7f6cd0fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ccc0af020 0x7f6ccc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.605+0000 7f6cd0fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc0b00d0 0x7f6ccc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.605+0000 7f6cd0fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6ccc06e650 0x7f6ccc0b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.605+0000 7f6cd0fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc06d3e0 con 0x7f6ccc0af020 2023-09-30T23:04:53.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.605+0000 7f6cd0fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc06dc80 con 0x7f6ccc06e650 2023-09-30T23:04:53.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.605+0000 7f6cd0fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc06b790 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ccc0af020 0x7f6ccc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ccc0af020 0x7f6ccc156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41594/0 (socket says 172.21.15.142:41594) 2023-09-30T23:04:53.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 -- 172.21.15.142:0/1914049589 learned_addr learned my addr 172.21.15.142:0/1914049589 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:53.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6ccad9d700 1 --2- 172.21.15.142:0/1914049589 >> v2:172.21.15.148:3300/0 conn(0x7f6ccc06e650 0x7f6ccc0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cc9d9b700 1 --2- 172.21.15.142:0/1914049589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc0b00d0 0x7f6ccc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 -- 172.21.15.142:0/1914049589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc0b00d0 msgr2=0x7f6ccc06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:53.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 --2- 172.21.15.142:0/1914049589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc0b00d0 0x7f6ccc06e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 -- 172.21.15.142:0/1914049589 >> v2:172.21.15.148:3300/0 conn(0x7f6ccc06e650 msgr2=0x7f6ccc0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:53.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 --2- 172.21.15.142:0/1914049589 >> v2:172.21.15.148:3300/0 conn(0x7f6ccc06e650 0x7f6ccc0b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.606+0000 7f6cca59c700 1 -- 172.21.15.142:0/1914049589 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0b0650 con 0x7f6ccc0af020 2023-09-30T23:04:53.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cca59c700 1 --2- 172.21.15.142:0/1914049589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0af020 0x7f6ccc156d80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0c9c40 tx=0x7f6cbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7851c682a19b4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:53.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cc959a700 1 -- 172.21.15.142:0/1914049589 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00b860 con 0x7f6ccc0af020 2023-09-30T23:04:53.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cc959a700 1 -- 172.21.15.142:0/1914049589 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc00b9c0 con 0x7f6ccc0af020 2023-09-30T23:04:53.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cc959a700 1 -- 172.21.15.142:0/1914049589 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00bd60 con 0x7f6ccc0af020 2023-09-30T23:04:53.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1914049589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0af020 msgr2=0x7f6ccc156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1914049589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0af020 0x7f6ccc156d80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0c9c40 tx=0x7f6cbc009250 comp rx=0 tx=0).stop 2023-09-30T23:04:53.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1914049589 shutdown_connections 2023-09-30T23:04:53.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1914049589 >> v2:172.21.15.148:3300/0 conn(0x7f6ccc06e650 0x7f6ccc0b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1914049589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0af020 0x7f6ccc156d80 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1914049589 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc0b00d0 0x7f6ccc06e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1914049589 >> 172.21.15.142:0/1914049589 conn(0x7f6ccc0680c0 msgr2=0x7f6ccc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:53.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.607+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1914049589 shutdown_connections 2023-09-30T23:04:53.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.608+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1914049589 wait complete. 2023-09-30T23:04:53.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.609+0000 7f6cd0fff700 1 Processor -- start 2023-09-30T23:04:53.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.609+0000 7f6cd0fff700 1 -- start start 2023-09-30T23:04:53.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cd0fff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc06e650 0x7f6ccc146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cd0fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ccc0af020 0x7f6ccc1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cd0fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b00d0 0x7f6ccc15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cd0fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc158b20 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cd0fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc146750 con 0x7f6ccc0af020 2023-09-30T23:04:53.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cd0fff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc157d20 con 0x7f6ccc06e650 2023-09-30T23:04:53.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6ccad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b00d0 0x7f6ccc15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6ccad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b00d0 0x7f6ccc15a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41600/0 (socket says 172.21.15.142:41600) 2023-09-30T23:04:53.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6ccad9d700 1 -- 172.21.15.142:0/1580319146 learned_addr learned my addr 172.21.15.142:0/1580319146 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:53.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cc9d9b700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ccc0af020 0x7f6ccc1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.610+0000 7f6cca59c700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc06e650 0x7f6ccc146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6ccad9d700 1 -- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc06e650 msgr2=0x7f6ccc146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6ccad9d700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc06e650 0x7f6ccc146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6ccad9d700 1 -- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ccc0af020 msgr2=0x7f6ccc1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6ccad9d700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ccc0af020 0x7f6ccc1577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6ccad9d700 1 -- 172.21.15.142:0/1580319146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0094f0 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6cca59c700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc06e650 0x7f6ccc146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:53.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6ccad9d700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b00d0 0x7f6ccc15a100 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4007f20 tx=0x7f6cc4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:53.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6cba7fc700 1 -- 172.21.15.142:0/1580319146 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400eca0 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6cba7fc700 1 -- 172.21.15.142:0/1580319146 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400ee20 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc159650 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6cba7fc700 1 -- 172.21.15.142:0/1580319146 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4014670 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.611+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc159000 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.612+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc0695b0 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.613+0000 7f6cba7fc700 1 -- 172.21.15.142:0/1580319146 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6cc40149e0 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.614+0000 7f6cba7fc700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6cac067330 0x7f6cac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:53.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.614+0000 7f6cba7fc700 1 -- 172.21.15.142:0/1580319146 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6cc4085000 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.615+0000 7f6cca59c700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6cac067330 0x7f6cac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:53.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.615+0000 7f6cca59c700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6cac067330 0x7f6cac0697e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0c9c40 tx=0x7f6cbc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:53.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.618+0000 7f6cba7fc700 1 -- 172.21.15.142:0/1580319146 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6cc4052200 con 0x7f6ccc0b00d0 2023-09-30T23:04:53.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.809+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ccc153b40 con 0x7f6cac067330 2023-09-30T23:04:53.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.809+0000 7f6cba7fc700 1 -- 172.21.15.142:0/1580319146 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6cbc00bc50 con 0x7f6cac067330 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6cac067330 msgr2=0x7f6cac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6cac067330 0x7f6cac0697e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0c9c40 tx=0x7f6cbc017000 comp rx=0 tx=0).stop 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b00d0 msgr2=0x7f6ccc15a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b00d0 0x7f6ccc15a100 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4007f20 tx=0x7f6cc4009860 comp rx=0 tx=0).stop 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 shutdown_connections 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f6cac067330 0x7f6cac0697e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc0b00d0 0x7f6ccc15a100 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ccc06e650 0x7f6ccc146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 --2- 172.21.15.142:0/1580319146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ccc0af020 0x7f6ccc1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:53.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 >> 172.21.15.142:0/1580319146 conn(0x7f6ccc0680c0 msgr2=0x7f6ccc0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:53.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 shutdown_connections 2023-09-30T23:04:53.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:53.812+0000 7f6cd0fff700 1 -- 172.21.15.142:0/1580319146 wait complete. 2023-09-30T23:04:53.813 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 4 to deep-scrub 2023-09-30T23:04:53.829 INFO:tasks.ceph:Scrubbing osd.5 2023-09-30T23:04:53.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:54.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.023+0000 7f68fb3ff700 1 Processor -- start 2023-09-30T23:04:54.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.023+0000 7f68fb3ff700 1 -- start start 2023-09-30T23:04:54.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.024+0000 7f68fb3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68f40cc280 0x7f68f415a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68fb3ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f40d04e0 con 0x7f68f40cf180 2023-09-30T23:04:54.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68fb3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f40cc8f0 con 0x7f68f415ac40 2023-09-30T23:04:54.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68fb3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f40cf8d0 con 0x7f68f40cc280 2023-09-30T23:04:54.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68f899a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68f40cc280 0x7f68f415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68f999c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f68f40cf180 0x7f68f406a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53174/0 (socket says 172.21.15.142:53174) 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68f999c700 1 -- 172.21.15.142:0/1717557322 learned_addr learned my addr 172.21.15.142:0/1717557322 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68f899a700 1 -- 172.21.15.142:0/1717557322 >> v1:172.21.15.148:6789/0 conn(0x7f68f415ac40 legacy=0x7f68f40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68f899a700 1 -- 172.21.15.142:0/1717557322 >> v1:172.21.15.142:6789/0 conn(0x7f68f40cf180 legacy=0x7f68f406a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68f899a700 1 -- 172.21.15.142:0/1717557322 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40cfbb0 con 0x7f68f40cc280 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.025+0000 7f68ebfff700 1 -- 172.21.15.142:0/1717557322 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656645293 0 0) 0x7f68f40d04e0 con 0x7f68f40cf180 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68f899a700 1 --2- 172.21.15.142:0/1717557322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f40cc280 0x7f68f415a220 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f68e40098e0 tx=0x7f68e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15398ed896e803c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68ebfff700 1 -- 172.21.15.142:0/1717557322 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4009e80 con 0x7f68f40cc280 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68ebfff700 1 -- 172.21.15.142:0/1717557322 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e400b820 con 0x7f68f40cc280 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68ebfff700 1 -- 172.21.15.142:0/1717557322 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e400bba0 con 0x7f68f40cc280 2023-09-30T23:04:54.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68fb3ff700 1 -- 172.21.15.142:0/1717557322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f40cc280 msgr2=0x7f68f415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68fb3ff700 1 --2- 172.21.15.142:0/1717557322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f40cc280 0x7f68f415a220 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f68e40098e0 tx=0x7f68e40091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68fb3ff700 1 -- 172.21.15.142:0/1717557322 shutdown_connections 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68fb3ff700 1 --2- 172.21.15.142:0/1717557322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f40cc280 0x7f68f415a220 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.026+0000 7f68fb3ff700 1 -- 172.21.15.142:0/1717557322 >> 172.21.15.142:0/1717557322 conn(0x7f68f40d0a80 msgr2=0x7f68f40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.027+0000 7f68fb3ff700 1 -- 172.21.15.142:0/1717557322 shutdown_connections 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.027+0000 7f68fb3ff700 1 -- 172.21.15.142:0/1717557322 wait complete. 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.028+0000 7f68fb3ff700 1 Processor -- start 2023-09-30T23:04:54.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.028+0000 7f68fb3ff700 1 -- start start 2023-09-30T23:04:54.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68fb3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f40cc280 0x7f68f414a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68fb3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f40cf180 0x7f68f4156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68fb3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f415ac40 0x7f68f406af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68fb3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f413af40 con 0x7f68f415ac40 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68fb3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4157ae0 con 0x7f68f40cf180 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68fb3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f41519f0 con 0x7f68f40cc280 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68f999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f415ac40 0x7f68f406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68f999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f415ac40 0x7f68f406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41620/0 (socket says 172.21.15.142:41620) 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68f999c700 1 -- 172.21.15.142:0/3031028143 learned_addr learned my addr 172.21.15.142:0/3031028143 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68f899a700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f40cf180 0x7f68f4156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.029+0000 7f68f919b700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f40cc280 0x7f68f414a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68f999c700 1 -- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f40cc280 msgr2=0x7f68f414a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68f999c700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68f40cc280 0x7f68f414a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68f999c700 1 -- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f40cf180 msgr2=0x7f68f4156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68f999c700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f40cf180 0x7f68f4156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68f999c700 1 -- 172.21.15.142:0/3031028143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009420 con 0x7f68f415ac40 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68f999c700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f415ac40 0x7f68f406af10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00cc90 tx=0x7f68ec001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00a870 con 0x7f68f415ac40 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00a9d0 con 0x7f68f415ac40 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00ad90 con 0x7f68f415ac40 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f4151cd0 con 0x7f68f415ac40 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.030+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f4152290 con 0x7f68f415ac40 2023-09-30T23:04:54.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.031+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68f4069770 con 0x7f68f415ac40 2023-09-30T23:04:54.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.032+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f68ec007300 con 0x7f68f415ac40 2023-09-30T23:04:54.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.033+0000 7f68e97fa700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d8067330 0x7f68d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.033+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f68ec084b80 con 0x7f68f415ac40 2023-09-30T23:04:54.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.033+0000 7f68f919b700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d8067330 0x7f68d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.034+0000 7f68e97fa700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7f68d806d7a0 0x7f68d806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.034+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 --> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68d8070280 con 0x7f68d806d7a0 2023-09-30T23:04:54.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.034+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68ec0891e0 con 0x7f68f415ac40 2023-09-30T23:04:54.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.034+0000 7f68f899a700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7f68d806d7a0 0x7f68d806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.034+0000 7f68f919b700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d8067330 0x7f68d80697e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009af0 tx=0x7f68f0009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.035+0000 7f68f899a700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7f68d806d7a0 0x7f68d806fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.035+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== osd.5 v2:172.21.15.148:6808/109935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f68d8070280 con 0x7f68d806d7a0 2023-09-30T23:04:54.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.048+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 --> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68f4157c80 con 0x7f68d806d7a0 2023-09-30T23:04:54.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.049+0000 7f68e97fa700 1 -- 172.21.15.142:0/3031028143 <== osd.5 v2:172.21.15.148:6808/109935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f68f4157c80 con 0x7f68d806d7a0 2023-09-30T23:04:54.049 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:54.049 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:54.049 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7f68d806d7a0 msgr2=0x7f68d806fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.148:6808/109935,v1:172.21.15.148:6809/109935] conn(0x7f68d806d7a0 0x7f68d806fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d8067330 msgr2=0x7f68d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f68d8067330 0x7f68d80697e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009af0 tx=0x7f68f0009060 comp rx=0 tx=0).stop 2023-09-30T23:04:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f415ac40 msgr2=0x7f68f406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 --2- 172.21.15.142:0/3031028143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68f415ac40 0x7f68f406af10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00cc90 tx=0x7f68ec001a20 comp rx=0 tx=0).stop 2023-09-30T23:04:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68f999c700 1 -- 172.21.15.142:0/3031028143 reap_dead start 2023-09-30T23:04:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 shutdown_connections 2023-09-30T23:04:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 >> 172.21.15.142:0/3031028143 conn(0x7f68f40d0a80 msgr2=0x7f68f4150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 shutdown_connections 2023-09-30T23:04:54.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.050+0000 7f68fb3ff700 1 -- 172.21.15.142:0/3031028143 wait complete. 2023-09-30T23:04:54.066 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-30T23:04:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.257+0000 7f07809ff700 1 Processor -- start 2023-09-30T23:04:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.258+0000 7f07809ff700 1 -- start start 2023-09-30T23:04:54.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f07809ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f077c157a90 0x7f077c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f07809ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f077c06b3d0 0x7f077c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f07809ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c06d470 con 0x7f077c0b1f40 2023-09-30T23:04:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f07809ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c157e60 con 0x7f077c06b3d0 2023-09-30T23:04:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f07809ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0b2380 con 0x7f077c157a90 2023-09-30T23:04:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f0779d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f077c06b3d0 0x7f077c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f0779d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f077c06b3d0 0x7f077c0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41624/0 (socket says 172.21.15.142:41624) 2023-09-30T23:04:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f0779d9b700 1 -- 172.21.15.142:0/2391699063 learned_addr learned my addr 172.21.15.142:0/2391699063 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.259+0000 7f077a59c700 1 --2- 172.21.15.142:0/2391699063 >> v2:172.21.15.148:3300/0 conn(0x7f077c157a90 0x7f077c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f0779d9b700 1 -- 172.21.15.142:0/2391699063 >> v2:172.21.15.148:3300/0 conn(0x7f077c157a90 msgr2=0x7f077c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f0779d9b700 1 --2- 172.21.15.142:0/2391699063 >> v2:172.21.15.148:3300/0 conn(0x7f077c157a90 0x7f077c15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f0779d9b700 1 -- 172.21.15.142:0/2391699063 >> v1:172.21.15.148:6789/0 conn(0x7f077c0b1f40 legacy=0x7f077c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f0779d9b700 1 -- 172.21.15.142:0/2391699063 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c15c430 con 0x7f077c06b3d0 2023-09-30T23:04:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f0779d9b700 1 --2- 172.21.15.142:0/2391699063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c06b3d0 0x7f077c0b1a00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f077c06d1e0 tx=0x7f0770009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf05f94946644fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f077959a700 1 -- 172.21.15.142:0/2391699063 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000b860 con 0x7f077c06b3d0 2023-09-30T23:04:54.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f077959a700 1 -- 172.21.15.142:0/2391699063 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077000b9c0 con 0x7f077c06b3d0 2023-09-30T23:04:54.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.260+0000 7f077959a700 1 -- 172.21.15.142:0/2391699063 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000bd60 con 0x7f077c06b3d0 2023-09-30T23:04:54.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 -- 172.21.15.142:0/2391699063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c06b3d0 msgr2=0x7f077c0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 --2- 172.21.15.142:0/2391699063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c06b3d0 0x7f077c0b1a00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f077c06d1e0 tx=0x7f0770009250 comp rx=0 tx=0).stop 2023-09-30T23:04:54.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 -- 172.21.15.142:0/2391699063 shutdown_connections 2023-09-30T23:04:54.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 --2- 172.21.15.142:0/2391699063 >> v2:172.21.15.148:3300/0 conn(0x7f077c157a90 0x7f077c15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 --2- 172.21.15.142:0/2391699063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c06b3d0 0x7f077c0b1a00 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 -- 172.21.15.142:0/2391699063 >> 172.21.15.142:0/2391699063 conn(0x7f077c0680c0 msgr2=0x7f077c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 -- 172.21.15.142:0/2391699063 shutdown_connections 2023-09-30T23:04:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.261+0000 7f07809ff700 1 -- 172.21.15.142:0/2391699063 wait complete. 2023-09-30T23:04:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.262+0000 7f07809ff700 1 Processor -- start 2023-09-30T23:04:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.262+0000 7f07809ff700 1 -- start start 2023-09-30T23:04:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.263+0000 7f07809ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c06b3d0 0x7f077c148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.263+0000 7f07809ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c0b1f40 0x7f077c154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.263+0000 7f07809ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f077c157a90 0x7f077c155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.263+0000 7f07809ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c14ab60 con 0x7f077c0b1f40 2023-09-30T23:04:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.263+0000 7f07809ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c154980 con 0x7f077c06b3d0 2023-09-30T23:04:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.263+0000 7f07809ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c154c60 con 0x7f077c157a90 2023-09-30T23:04:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c0b1f40 0x7f077c154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c0b1f40 0x7f077c154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41630/0 (socket says 172.21.15.142:41630) 2023-09-30T23:04:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 -- 172.21.15.142:0/1626921246 learned_addr learned my addr 172.21.15.142:0/1626921246 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f077a59c700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c06b3d0 0x7f077c148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f077ad9d700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f077c157a90 0x7f077c155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 -- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f077c157a90 msgr2=0x7f077c155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f077c157a90 0x7f077c155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 -- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c06b3d0 msgr2=0x7f077c148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c06b3d0 0x7f077c148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 -- 172.21.15.142:0/1626921246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700094f0 con 0x7f077c0b1f40 2023-09-30T23:04:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f0779d9b700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c0b1f40 0x7f077c154020 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f077c068600 tx=0x7f0770017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f076a7fc700 1 -- 172.21.15.142:0/1626921246 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770011e60 con 0x7f077c0b1f40 2023-09-30T23:04:54.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f076a7fc700 1 -- 172.21.15.142:0/1626921246 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077001a630 con 0x7f077c0b1f40 2023-09-30T23:04:54.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c14a7f0 con 0x7f077c0b1f40 2023-09-30T23:04:54.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.264+0000 7f076a7fc700 1 -- 172.21.15.142:0/1626921246 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077001a9f0 con 0x7f077c0b1f40 2023-09-30T23:04:54.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.265+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c148650 con 0x7f077c0b1f40 2023-09-30T23:04:54.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.266+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c14acd0 con 0x7f077c0b1f40 2023-09-30T23:04:54.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.266+0000 7f076a7fc700 1 -- 172.21.15.142:0/1626921246 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f077002d440 con 0x7f077c0b1f40 2023-09-30T23:04:54.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.267+0000 7f076a7fc700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f075c067330 0x7f075c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.268+0000 7f076a7fc700 1 -- 172.21.15.142:0/1626921246 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f07700863a0 con 0x7f077c0b1f40 2023-09-30T23:04:54.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.268+0000 7f077a59c700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f075c067330 0x7f075c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.268+0000 7f077a59c700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f075c067330 0x7f075c0697e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f076c006fd0 tx=0x7f076c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.272+0000 7f076a7fc700 1 -- 172.21.15.142:0/1626921246 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0770053580 con 0x7f077c0b1f40 2023-09-30T23:04:54.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.463+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f077c06fc10 con 0x7f075c067330 2023-09-30T23:04:54.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.463+0000 7f076a7fc700 1 -- 172.21.15.142:0/1626921246 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f077c06fc10 con 0x7f075c067330 2023-09-30T23:04:54.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f075c067330 msgr2=0x7f075c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f075c067330 0x7f075c0697e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f076c006fd0 tx=0x7f076c008040 comp rx=0 tx=0).stop 2023-09-30T23:04:54.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c0b1f40 msgr2=0x7f077c154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c0b1f40 0x7f077c154020 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f077c068600 tx=0x7f0770017000 comp rx=0 tx=0).stop 2023-09-30T23:04:54.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 shutdown_connections 2023-09-30T23:04:54.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f075c067330 0x7f075c0697e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f077c157a90 0x7f077c155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c06b3d0 0x7f077c148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 --2- 172.21.15.142:0/1626921246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f077c0b1f40 0x7f077c154020 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 >> 172.21.15.142:0/1626921246 conn(0x7f077c0680c0 msgr2=0x7f077c0cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:54.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 shutdown_connections 2023-09-30T23:04:54.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.466+0000 7f07809ff700 1 -- 172.21.15.142:0/1626921246 wait complete. 2023-09-30T23:04:54.469 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 5 to deep-scrub 2023-09-30T23:04:54.483 INFO:tasks.ceph:Scrubbing osd.6 2023-09-30T23:04:54.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:54.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.678+0000 7f64607ff700 1 Processor -- start 2023-09-30T23:04:54.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.678+0000 7f64607ff700 1 -- start start 2023-09-30T23:04:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f64607ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6458150730 0x7f6458157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f64607ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 0x7f645806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f64607ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645806b120 con 0x7f645806ace0 2023-09-30T23:04:54.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f64607ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64580cc340 con 0x7f6458150730 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f64607ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64580ca790 con 0x7f64580ca240 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645e59b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6458150730 0x7f6458157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645e59b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6458150730 0x7f6458157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41646/0 (socket says 172.21.15.142:41646) 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645e59b700 1 -- 172.21.15.142:0/1705808441 learned_addr learned my addr 172.21.15.142:0/1705808441 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645dd9a700 1 --2- 172.21.15.142:0/1705808441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 0x7f645806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645e59b700 1 -- 172.21.15.142:0/1705808441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 msgr2=0x7f645806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645e59b700 1 --2- 172.21.15.142:0/1705808441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 0x7f645806a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645e59b700 1 -- 172.21.15.142:0/1705808441 >> v1:172.21.15.148:6789/0 conn(0x7f645806ace0 legacy=0x7f6458159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.680+0000 7f645e59b700 1 -- 172.21.15.142:0/1705808441 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580caa70 con 0x7f6458150730 2023-09-30T23:04:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.681+0000 7f645e59b700 1 --2- 172.21.15.142:0/1705808441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f6458157150 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f645400ab50 tx=0x7f645400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a36be4f9741569 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.681+0000 7f645d599700 1 -- 172.21.15.142:0/1705808441 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400ca60 con 0x7f6458150730 2023-09-30T23:04:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.681+0000 7f645d599700 1 -- 172.21.15.142:0/1705808441 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400cbc0 con 0x7f6458150730 2023-09-30T23:04:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.681+0000 7f645d599700 1 -- 172.21.15.142:0/1705808441 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454018400 con 0x7f6458150730 2023-09-30T23:04:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.681+0000 7f64607ff700 1 -- 172.21.15.142:0/1705808441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 msgr2=0x7f6458157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.681+0000 7f64607ff700 1 --2- 172.21.15.142:0/1705808441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f6458157150 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f645400ab50 tx=0x7f645400a3f0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.682+0000 7f64607ff700 1 -- 172.21.15.142:0/1705808441 shutdown_connections 2023-09-30T23:04:54.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.682+0000 7f64607ff700 1 --2- 172.21.15.142:0/1705808441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f6458157150 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.682+0000 7f64607ff700 1 --2- 172.21.15.142:0/1705808441 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 0x7f645806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.682+0000 7f64607ff700 1 -- 172.21.15.142:0/1705808441 >> 172.21.15.142:0/1705808441 conn(0x7f64580cc670 msgr2=0x7f64580cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:54.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.682+0000 7f64607ff700 1 -- 172.21.15.142:0/1705808441 shutdown_connections 2023-09-30T23:04:54.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.682+0000 7f64607ff700 1 -- 172.21.15.142:0/1705808441 wait complete. 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.683+0000 7f64607ff700 1 Processor -- start 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.683+0000 7f64607ff700 1 -- start start 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f64607ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f645806ace0 0x7f6458154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f64607ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 0x7f6458155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f64607ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f645814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f64607ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645816a6a0 con 0x7f6458150730 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f64607ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645814d790 con 0x7f645806ace0 2023-09-30T23:04:54.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f64607ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645814da70 con 0x7f64580ca240 2023-09-30T23:04:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f645ed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f645814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f645ed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f645814ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41656/0 (socket says 172.21.15.142:41656) 2023-09-30T23:04:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f645ed9c700 1 -- 172.21.15.142:0/2332892707 learned_addr learned my addr 172.21.15.142:0/2332892707 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.684+0000 7f645e59b700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f645806ace0 0x7f6458154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f645dd9a700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 0x7f6458155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f645ed9c700 1 -- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 msgr2=0x7f6458155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f645ed9c700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64580ca240 0x7f6458155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f645ed9c700 1 -- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f645806ace0 msgr2=0x7f6458154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f645ed9c700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f645806ace0 0x7f6458154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f645ed9c700 1 -- 172.21.15.142:0/2332892707 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645400a690 con 0x7f6458150730 2023-09-30T23:04:54.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f645ed9c700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f645814ca20 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f645000c8e0 tx=0x7f6450001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450012630 con 0x7f6458150730 2023-09-30T23:04:54.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450012790 con 0x7f6458150730 2023-09-30T23:04:54.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450012b50 con 0x7f6458150730 2023-09-30T23:04:54.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.685+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645814dd50 con 0x7f6458150730 2023-09-30T23:04:54.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.686+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6458147630 con 0x7f6458150730 2023-09-30T23:04:54.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.686+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6458069a50 con 0x7f6458150730 2023-09-30T23:04:54.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.687+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f645001a3a0 con 0x7f6458150730 2023-09-30T23:04:54.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.688+0000 7f644e7fc700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f643c067330 0x7f643c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.688+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6450084aa0 con 0x7f6458150730 2023-09-30T23:04:54.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.688+0000 7f645e59b700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f643c067330 0x7f643c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.689+0000 7f644e7fc700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f643c06d7a0 0x7f643c06fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.689+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 --> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f643c070280 con 0x7f643c06d7a0 2023-09-30T23:04:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.689+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6450089220 con 0x7f6458150730 2023-09-30T23:04:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.689+0000 7f645e59b700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f643c067330 0x7f643c0697e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f645400ab50 tx=0x7f645401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.689+0000 7f645dd9a700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f643c06d7a0 0x7f643c06fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.690+0000 7f645dd9a700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f643c06d7a0 0x7f643c06fbb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.691+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== osd.6 v2:172.21.15.148:6815/109936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f643c070280 con 0x7f643c06d7a0 2023-09-30T23:04:54.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.703+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 --> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f645814e960 con 0x7f643c06d7a0 2023-09-30T23:04:54.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.704+0000 7f644e7fc700 1 -- 172.21.15.142:0/2332892707 <== osd.6 v2:172.21.15.148:6815/109936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f645814e960 con 0x7f643c06d7a0 2023-09-30T23:04:54.704 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:54.704 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:54.705 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f643c06d7a0 msgr2=0x7f643c06fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.148:6815/109936,v1:172.21.15.148:6816/109936] conn(0x7f643c06d7a0 0x7f643c06fbb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f643c067330 msgr2=0x7f643c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f643c067330 0x7f643c0697e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f645400ab50 tx=0x7f645401a000 comp rx=0 tx=0).stop 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 msgr2=0x7f645814ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 --2- 172.21.15.142:0/2332892707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6458150730 0x7f645814ca20 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f645000c8e0 tx=0x7f6450001710 comp rx=0 tx=0).stop 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f645ed9c700 1 -- 172.21.15.142:0/2332892707 reap_dead start 2023-09-30T23:04:54.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 shutdown_connections 2023-09-30T23:04:54.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 >> 172.21.15.142:0/2332892707 conn(0x7f64580cc670 msgr2=0x7f64580c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:54.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 shutdown_connections 2023-09-30T23:04:54.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.705+0000 7f64607ff700 1 -- 172.21.15.142:0/2332892707 wait complete. 2023-09-30T23:04:54.721 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-30T23:04:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.913+0000 7f014cdff700 1 Processor -- start 2023-09-30T23:04:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.913+0000 7f014cdff700 1 -- start start 2023-09-30T23:04:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014cdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f01480b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014cdff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01480b1f40 0x7f014806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014cdff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014806d470 con 0x7f0148157a90 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014cdff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480b23e0 con 0x7f01480b1f40 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014cdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0148157e60 con 0x7f014806b3d0 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014659c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0148157a90 0x7f014815bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53176/0 (socket says 172.21.15.142:53176) 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014659c700 1 -- 172.21.15.142:0/1928289078 learned_addr learned my addr 172.21.15.142:0/1928289078 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f0146d9d700 1 --2- 172.21.15.142:0/1928289078 >> v2:172.21.15.142:3300/0 conn(0x7f01480b1f40 0x7f014806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f0145d9b700 1 --2- 172.21.15.142:0/1928289078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f01480b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f014559a700 1 -- 172.21.15.142:0/1928289078 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882330620 0 0) 0x7f014806d470 con 0x7f0148157a90 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f0146d9d700 1 -- 172.21.15.142:0/1928289078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 msgr2=0x7f01480b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f0146d9d700 1 --2- 172.21.15.142:0/1928289078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f01480b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f0146d9d700 1 -- 172.21.15.142:0/1928289078 >> v1:172.21.15.142:6789/0 conn(0x7f0148157a90 legacy=0x7f014815bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f0146d9d700 1 -- 172.21.15.142:0/1928289078 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480ae880 con 0x7f01480b1f40 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.915+0000 7f0145d9b700 1 --2- 172.21.15.142:0/1928289078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f01480b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.916+0000 7f0146d9d700 1 --2- 172.21.15.142:0/1928289078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01480b1f40 0x7f014806d900 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f0140009e60 tx=0x7f0140009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9a486a55ab469b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.916+0000 7f014559a700 1 -- 172.21.15.142:0/1928289078 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000e070 con 0x7f01480b1f40 2023-09-30T23:04:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.916+0000 7f014559a700 1 -- 172.21.15.142:0/1928289078 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000bb60 con 0x7f01480b1f40 2023-09-30T23:04:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.916+0000 7f014559a700 1 -- 172.21.15.142:0/1928289078 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140012430 con 0x7f01480b1f40 2023-09-30T23:04:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.916+0000 7f014cdff700 1 -- 172.21.15.142:0/1928289078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01480b1f40 msgr2=0x7f014806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.916+0000 7f014cdff700 1 --2- 172.21.15.142:0/1928289078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01480b1f40 0x7f014806d900 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f0140009e60 tx=0x7f0140009780 comp rx=0 tx=0).stop 2023-09-30T23:04:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.917+0000 7f014cdff700 1 -- 172.21.15.142:0/1928289078 shutdown_connections 2023-09-30T23:04:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.917+0000 7f014cdff700 1 --2- 172.21.15.142:0/1928289078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01480b1f40 0x7f014806d900 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.917+0000 7f014cdff700 1 --2- 172.21.15.142:0/1928289078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f01480b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.917+0000 7f014cdff700 1 -- 172.21.15.142:0/1928289078 >> 172.21.15.142:0/1928289078 conn(0x7f01480680c0 msgr2=0x7f01480c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.917+0000 7f014cdff700 1 -- 172.21.15.142:0/1928289078 shutdown_connections 2023-09-30T23:04:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.917+0000 7f014cdff700 1 -- 172.21.15.142:0/1928289078 wait complete. 2023-09-30T23:04:54.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.919+0000 7f014cdff700 1 Processor -- start 2023-09-30T23:04:54.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.919+0000 7f014cdff700 1 -- start start 2023-09-30T23:04:54.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f014cdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f0148152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f014cdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01480b1f40 0x7f01480b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f014cdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0148157a90 0x7f01480cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f014cdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c8260 con 0x7f0148157a90 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f014cdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c7650 con 0x7f01480b1f40 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f014cdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c7930 con 0x7f014806b3d0 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f014659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f0148152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.920+0000 7f0146d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0148157a90 0x7f01480cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f014659c700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f0148152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:37828/0 (socket says 172.21.15.142:37828) 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f014659c700 1 -- 172.21.15.142:0/1098009111 learned_addr learned my addr 172.21.15.142:0/1098009111 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f0145d9b700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01480b1f40 0x7f01480b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f0146d9d700 1 -- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 msgr2=0x7f0148152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f0146d9d700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f0148152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f0146d9d700 1 -- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01480b1f40 msgr2=0x7f01480b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f0146d9d700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01480b1f40 0x7f01480b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f0146d9d700 1 -- 172.21.15.142:0/1098009111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009420 con 0x7f0148157a90 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f014659c700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f0148152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f0146d9d700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0148157a90 0x7f01480cbfd0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f0140016000 tx=0x7f0140019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f01367fc700 1 -- 172.21.15.142:0/1098009111 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140027470 con 0x7f0148157a90 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f01367fc700 1 -- 172.21.15.142:0/1098009111 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01400275d0 con 0x7f0148157a90 2023-09-30T23:04:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f01367fc700 1 -- 172.21.15.142:0/1098009111 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140027990 con 0x7f0148157a90 2023-09-30T23:04:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.921+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140009a20 con 0x7f0148157a90 2023-09-30T23:04:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.922+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01480c7ef0 con 0x7f0148157a90 2023-09-30T23:04:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.923+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01480695b0 con 0x7f0148157a90 2023-09-30T23:04:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.923+0000 7f01367fc700 1 -- 172.21.15.142:0/1098009111 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0140024070 con 0x7f0148157a90 2023-09-30T23:04:54.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.924+0000 7f01367fc700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0128067330 0x7f01280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:54.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.925+0000 7f01367fc700 1 -- 172.21.15.142:0/1098009111 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f01400871d0 con 0x7f0148157a90 2023-09-30T23:04:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.925+0000 7f014659c700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0128067330 0x7f01280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.925+0000 7f014659c700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0128067330 0x7f01280697e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f01380017b0 tx=0x7f0138001070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:54.929+0000 7f01367fc700 1 -- 172.21.15.142:0/1098009111 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0140054330 con 0x7f0148157a90 2023-09-30T23:04:55.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.121+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f01481527d0 con 0x7f0128067330 2023-09-30T23:04:55.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.122+0000 7f01367fc700 1 -- 172.21.15.142:0/1098009111 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f01481527d0 con 0x7f0128067330 2023-09-30T23:04:55.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0128067330 msgr2=0x7f01280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0128067330 0x7f01280697e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f01380017b0 tx=0x7f0138001070 comp rx=0 tx=0).stop 2023-09-30T23:04:55.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0148157a90 msgr2=0x7f01480cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0148157a90 0x7f01480cbfd0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f0140016000 tx=0x7f0140019000 comp rx=0 tx=0).stop 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 shutdown_connections 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f0128067330 0x7f01280697e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0148157a90 0x7f01480cbfd0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f014806b3d0 0x7f0148152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 --2- 172.21.15.142:0/1098009111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01480b1f40 0x7f01480b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 >> 172.21.15.142:0/1098009111 conn(0x7f01480680c0 msgr2=0x7f014806d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 shutdown_connections 2023-09-30T23:04:55.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.124+0000 7f014cdff700 1 -- 172.21.15.142:0/1098009111 wait complete. 2023-09-30T23:04:55.126 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 6 to deep-scrub 2023-09-30T23:04:55.142 INFO:tasks.ceph:Scrubbing osd.7 2023-09-30T23:04:55.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-30T23:04:55.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.336+0000 7fb34d3ff700 1 Processor -- start 2023-09-30T23:04:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.336+0000 7fb34d3ff700 1 -- start start 2023-09-30T23:04:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.337+0000 7fb34d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 0x7fb3480b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.337+0000 7fb34d3ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3480afda0 0x7fb34815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.337+0000 7fb34d3ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3480af000 con 0x7fb3480aeb70 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.337+0000 7fb34d3ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3480afb80 con 0x7fb3480afda0 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.337+0000 7fb34d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34815a600 con 0x7fb34815d010 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3480afda0 0x7fb34815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3480afda0 0x7fb34815a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41674/0 (socket says 172.21.15.142:41674) 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 -- 172.21.15.142:0/509038347 learned_addr learned my addr 172.21.15.142:0/509038347 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb346ffd700 1 --2- 172.21.15.142:0/509038347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 0x7fb3480b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 -- 172.21.15.142:0/509038347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 msgr2=0x7fb3480b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 --2- 172.21.15.142:0/509038347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 0x7fb3480b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 -- 172.21.15.142:0/509038347 >> v1:172.21.15.148:6789/0 conn(0x7fb3480aeb70 legacy=0x7fb34806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 -- 172.21.15.142:0/509038347 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3480af2e0 con 0x7fb3480afda0 2023-09-30T23:04:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb3477fe700 1 --2- 172.21.15.142:0/509038347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb34815a0c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fb340009f20 tx=0x7fb340009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afaf9355a13195a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.338+0000 7fb345ffb700 1 -- 172.21.15.142:0/509038347 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000e070 con 0x7fb3480afda0 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb345ffb700 1 -- 172.21.15.142:0/509038347 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000b9d0 con 0x7fb3480afda0 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb345ffb700 1 -- 172.21.15.142:0/509038347 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400092e0 con 0x7fb3480afda0 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 -- 172.21.15.142:0/509038347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 msgr2=0x7fb34815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 --2- 172.21.15.142:0/509038347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb34815a0c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fb340009f20 tx=0x7fb340009840 comp rx=0 tx=0).stop 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 -- 172.21.15.142:0/509038347 shutdown_connections 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 --2- 172.21.15.142:0/509038347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb34815a0c0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 --2- 172.21.15.142:0/509038347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 0x7fb3480b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 -- 172.21.15.142:0/509038347 >> 172.21.15.142:0/509038347 conn(0x7fb3480cd790 msgr2=0x7fb3480cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 -- 172.21.15.142:0/509038347 shutdown_connections 2023-09-30T23:04:55.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.339+0000 7fb34d3ff700 1 -- 172.21.15.142:0/509038347 wait complete. 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.341+0000 7fb34d3ff700 1 Processor -- start 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.341+0000 7fb34d3ff700 1 -- start start 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb34d3ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480aeb70 0x7fb34814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb34d3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb348150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb34d3ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 0x7fb34815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb34d3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480ab360 con 0x7fb3480afda0 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb34d3ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3481517d0 con 0x7fb3480aeb70 2023-09-30T23:04:55.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb34d3ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb348151ab0 con 0x7fb34815d010 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb348150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb346ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480aeb70 0x7fb34814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb348150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41684/0 (socket says 172.21.15.142:41684) 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 -- 172.21.15.142:0/3470521741 learned_addr learned my addr 172.21.15.142:0/3470521741 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3477fe700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 0x7fb34815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 -- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 msgr2=0x7fb34815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb34815d010 0x7fb34815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 -- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480aeb70 msgr2=0x7fb34814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3480aeb70 0x7fb34814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.342+0000 7fb3467fc700 1 -- 172.21.15.142:0/3470521741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009ae0 con 0x7fb3480afda0 2023-09-30T23:04:55.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.343+0000 7fb3467fc700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb348150cf0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c590 tx=0x7fb33c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.343+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c011590 con 0x7fb3480afda0 2023-09-30T23:04:55.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.343+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c011710 con 0x7fb3480afda0 2023-09-30T23:04:55.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.343+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c011ad0 con 0x7fb3480afda0 2023-09-30T23:04:55.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.343+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb348151d90 con 0x7fb3480afda0 2023-09-30T23:04:55.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.343+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb348152ce0 con 0x7fb3480afda0 2023-09-30T23:04:55.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.344+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb34806d320 con 0x7fb3480afda0 2023-09-30T23:04:55.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.345+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb33c01b3b0 con 0x7fb3480afda0 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.346+0000 7fb32effd700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb334067330 0x7fb3340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.346+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb33c083cc0 con 0x7fb3480afda0 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.346+0000 7fb346ffd700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb334067330 0x7fb3340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.346+0000 7fb32effd700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7fb33406d7a0 0x7fb33406fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.347+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 --> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb334070280 con 0x7fb33406d7a0 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.347+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=199) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb33c089070 con 0x7fb3480afda0 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.347+0000 7fb346ffd700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb334067330 0x7fb3340697e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb338009d10 tx=0x7fb3380091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.347+0000 7fb3477fe700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7fb33406d7a0 0x7fb33406fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.348+0000 7fb3477fe700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7fb33406d7a0 0x7fb33406fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.348+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== osd.7 v2:172.21.15.148:6824/109961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fb334070280 con 0x7fb33406d7a0 2023-09-30T23:04:55.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.362+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 --> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb3480af5c0 con 0x7fb33406d7a0 2023-09-30T23:04:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.362+0000 7fb32effd700 1 -- 172.21.15.142:0/3470521741 <== osd.7 v2:172.21.15.148:6824/109961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fb3480af5c0 con 0x7fb33406d7a0 2023-09-30T23:04:55.362 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-30T23:04:55.362 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T23:04:55.362 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-30T23:04:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7fb33406d7a0 msgr2=0x7fb33406fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.148:6824/109961,v1:172.21.15.148:6825/109961] conn(0x7fb33406d7a0 0x7fb33406fbb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb334067330 msgr2=0x7fb3340697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fb334067330 0x7fb3340697e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb338009d10 tx=0x7fb3380091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 msgr2=0x7fb348150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 --2- 172.21.15.142:0/3470521741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3480afda0 0x7fb348150cf0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c590 tx=0x7fb33c00c8a0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb3477fe700 1 -- 172.21.15.142:0/3470521741 reap_dead start 2023-09-30T23:04:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 shutdown_connections 2023-09-30T23:04:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 >> 172.21.15.142:0/3470521741 conn(0x7fb3480cd790 msgr2=0x7fb3480ad370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 shutdown_connections 2023-09-30T23:04:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.363+0000 7fb34d3ff700 1 -- 172.21.15.142:0/3470521741 wait complete. 2023-09-30T23:04:55.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-30T23:04:55.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.569+0000 7fd1c35ff700 1 Processor -- start 2023-09-30T23:04:55.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.569+0000 7fd1c35ff700 1 -- start start 2023-09-30T23:04:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.570+0000 7fd1c35ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1bc1598e0 0x7fd1bc159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.570+0000 7fd1c35ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c35ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0cff40 con 0x7fd1bc06b1c0 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c35ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d0910 con 0x7fd1bc1598e0 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c35ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0cf330 con 0x7fd1bc0cee50 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c139b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1bc1598e0 0x7fd1bc159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c0b9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c1b9c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd1bc06b1c0 0x7fd1bc15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.142:55584/0 (socket says 172.21.15.142:55584) 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c0b9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.142:37864/0 (socket says 172.21.15.142:37864) 2023-09-30T23:04:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c1b9c700 1 -- 172.21.15.142:0/1541133066 learned_addr learned my addr 172.21.15.142:0/1541133066 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:55.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c0b9a700 1 -- 172.21.15.142:0/1541133066 >> v2:172.21.15.148:3300/0 conn(0x7fd1bc1598e0 msgr2=0x7fd1bc159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:55.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c0b9a700 1 --2- 172.21.15.142:0/1541133066 >> v2:172.21.15.148:3300/0 conn(0x7fd1bc1598e0 0x7fd1bc159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.571+0000 7fd1c0b9a700 1 -- 172.21.15.142:0/1541133066 >> v1:172.21.15.148:6789/0 conn(0x7fd1bc06b1c0 legacy=0x7fd1bc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.572+0000 7fd1c0b9a700 1 -- 172.21.15.142:0/1541133066 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0cf610 con 0x7fd1bc0cee50 2023-09-30T23:04:55.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.572+0000 7fd1c0b9a700 1 --2- 172.21.15.142:0/1541133066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0d03d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0098e0 tx=0x7fd1ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e58b70a0b7965a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.573+0000 7fd1b3fff700 1 -- 172.21.15.142:0/1541133066 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00b640 con 0x7fd1bc0cee50 2023-09-30T23:04:55.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1b3fff700 1 -- 172.21.15.142:0/1541133066 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00b7a0 con 0x7fd1bc0cee50 2023-09-30T23:04:55.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1b3fff700 1 -- 172.21.15.142:0/1541133066 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00bb40 con 0x7fd1bc0cee50 2023-09-30T23:04:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 -- 172.21.15.142:0/1541133066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 msgr2=0x7fd1bc0d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/1541133066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0d03d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0098e0 tx=0x7fd1ac0091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 -- 172.21.15.142:0/1541133066 shutdown_connections 2023-09-30T23:04:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/1541133066 >> v2:172.21.15.148:3300/0 conn(0x7fd1bc1598e0 0x7fd1bc159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/1541133066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0d03d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 -- 172.21.15.142:0/1541133066 >> 172.21.15.142:0/1541133066 conn(0x7fd1bc0cd540 msgr2=0x7fd1bc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 -- 172.21.15.142:0/1541133066 shutdown_connections 2023-09-30T23:04:55.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.574+0000 7fd1c35ff700 1 -- 172.21.15.142:0/1541133066 wait complete. 2023-09-30T23:04:55.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.576+0000 7fd1c35ff700 1 Processor -- start 2023-09-30T23:04:55.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.576+0000 7fd1c35ff700 1 -- start start 2023-09-30T23:04:55.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c35ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1bc06b1c0 0x7fd1bc16ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c35ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c35ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1bc1598e0 0x7fd1bc0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c35ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c7b80 con 0x7fd1bc1598e0 2023-09-30T23:04:55.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c35ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc16b1c0 con 0x7fd1bc06b1c0 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c35ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c77b0 con 0x7fd1bc0cee50 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c1b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1bc1598e0 0x7fd1bc0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c0b9a700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c139b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1bc06b1c0 0x7fd1bc16ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c1b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1bc1598e0 0x7fd1bc0c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41692/0 (socket says 172.21.15.142:41692) 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.577+0000 7fd1c1b9c700 1 -- 172.21.15.142:0/792719459 learned_addr learned my addr 172.21.15.142:0/792719459 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c1b9c700 1 -- 172.21.15.142:0/792719459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 msgr2=0x7fd1bc0c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c1b9c700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c1b9c700 1 -- 172.21.15.142:0/792719459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1bc06b1c0 msgr2=0x7fd1bc16ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c1b9c700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1bc06b1c0 0x7fd1bc16ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c1b9c700 1 -- 172.21.15.142:0/792719459 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009420 con 0x7fd1bc1598e0 2023-09-30T23:04:55.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c1b9c700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1bc1598e0 0x7fd1bc0c7110 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400cbc0 tx=0x7fd1b40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1b17fa700 1 -- 172.21.15.142:0/792719459 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400a7e0 con 0x7fd1bc1598e0 2023-09-30T23:04:55.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1b17fa700 1 -- 172.21.15.142:0/792719459 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400a940 con 0x7fd1bc1598e0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1b17fa700 1 -- 172.21.15.142:0/792719459 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400acc0 con 0x7fd1bc1598e0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0c7e20 con 0x7fd1bc1598e0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.578+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc0c83e0 con 0x7fd1bc1598e0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.579+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc0c8600 con 0x7fd1bc1598e0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.580+0000 7fd1b17fa700 1 -- 172.21.15.142:0/792719459 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd1b4007300 con 0x7fd1bc1598e0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.581+0000 7fd1b17fa700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd1a0067330 0x7fd1a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.581+0000 7fd1b17fa700 1 -- 172.21.15.142:0/792719459 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd1b4084b70 con 0x7fd1bc1598e0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.581+0000 7fd1c139b700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd1a0067330 0x7fd1a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.582+0000 7fd1c139b700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd1a0067330 0x7fd1a00697e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0b5fe0 tx=0x7fd1b80091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.585+0000 7fd1b17fa700 1 -- 172.21.15.142:0/792719459 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd1b4051d60 con 0x7fd1bc1598e0 2023-09-30T23:04:55.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.774+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1bc06fc10 con 0x7fd1a0067330 2023-09-30T23:04:55.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.774+0000 7fd1b17fa700 1 -- 172.21.15.142:0/792719459 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd1bc06fc10 con 0x7fd1a0067330 2023-09-30T23:04:55.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.776+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd1a0067330 msgr2=0x7fd1a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.776+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd1a0067330 0x7fd1a00697e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0b5fe0 tx=0x7fd1b80091a0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.776+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1bc1598e0 msgr2=0x7fd1bc0c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.776+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1bc1598e0 0x7fd1bc0c7110 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400cbc0 tx=0x7fd1b40019c0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 shutdown_connections 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd1a0067330 0x7fd1a00697e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1bc1598e0 0x7fd1bc0c7110 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1bc06b1c0 0x7fd1bc16ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 --2- 172.21.15.142:0/792719459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd1bc0cee50 0x7fd1bc0c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 >> 172.21.15.142:0/792719459 conn(0x7fd1bc0cd540 msgr2=0x7fd1bc158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:55.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 shutdown_connections 2023-09-30T23:04:55.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.777+0000 7fd1c35ff700 1 -- 172.21.15.142:0/792719459 wait complete. 2023-09-30T23:04:55.778 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 7 to deep-scrub 2023-09-30T23:04:55.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:04:55.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.985+0000 7ff7015ff700 1 Processor -- start 2023-09-30T23:04:55.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.985+0000 7ff7015ff700 1 -- start start 2023-09-30T23:04:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff7015ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff6fc0b00d0 0x7ff6fc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff7015ff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6fc06e650 0x7ff6fc15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff7015ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc06d3e0 con 0x7ff6fc0af020 2023-09-30T23:04:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff7015ff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc06dc80 con 0x7ff6fc06e650 2023-09-30T23:04:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff7015ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc06b790 con 0x7ff6fc0b00d0 2023-09-30T23:04:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff6fb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6fc06e650 0x7ff6fc15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff6faffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff6fc0af020 0x7ff6fc156d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53180/0 (socket says 172.21.15.142:53180) 2023-09-30T23:04:55.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.986+0000 7ff6faffd700 1 -- 172.21.15.142:0/390754848 learned_addr learned my addr 172.21.15.142:0/390754848 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:04:55.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6fb7fe700 1 -- 172.21.15.142:0/390754848 >> v2:172.21.15.148:3300/0 conn(0x7ff6fc0b00d0 msgr2=0x7ff6fc06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:04:55.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6fa7fc700 1 --2- 172.21.15.142:0/390754848 >> v2:172.21.15.148:3300/0 conn(0x7ff6fc0b00d0 0x7ff6fc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6fb7fe700 1 --2- 172.21.15.142:0/390754848 >> v2:172.21.15.148:3300/0 conn(0x7ff6fc0b00d0 0x7ff6fc06e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6f9ffb700 1 -- 172.21.15.142:0/390754848 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378326005 0 0) 0x7ff6fc06d3e0 con 0x7ff6fc0af020 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6fb7fe700 1 -- 172.21.15.142:0/390754848 >> v1:172.21.15.142:6789/0 conn(0x7ff6fc0af020 legacy=0x7ff6fc156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6fb7fe700 1 -- 172.21.15.142:0/390754848 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0b0650 con 0x7ff6fc06e650 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6fa7fc700 1 --2- 172.21.15.142:0/390754848 >> v2:172.21.15.148:3300/0 conn(0x7ff6fc0b00d0 0x7ff6fc06e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6fb7fe700 1 --2- 172.21.15.142:0/390754848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc15a3f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009e60 tx=0x7ff6f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfae1750be5b377 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6f9ffb700 1 -- 172.21.15.142:0/390754848 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400e070 con 0x7ff6fc06e650 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6f9ffb700 1 -- 172.21.15.142:0/390754848 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400bbf0 con 0x7ff6fc06e650 2023-09-30T23:04:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.987+0000 7ff6f9ffb700 1 -- 172.21.15.142:0/390754848 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4012430 con 0x7ff6fc06e650 2023-09-30T23:04:55.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 -- 172.21.15.142:0/390754848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 msgr2=0x7ff6fc15a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 --2- 172.21.15.142:0/390754848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc15a3f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009e60 tx=0x7ff6f4009780 comp rx=0 tx=0).stop 2023-09-30T23:04:55.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 -- 172.21.15.142:0/390754848 shutdown_connections 2023-09-30T23:04:55.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 --2- 172.21.15.142:0/390754848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc15a3f0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 --2- 172.21.15.142:0/390754848 >> v2:172.21.15.148:3300/0 conn(0x7ff6fc0b00d0 0x7ff6fc06e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 -- 172.21.15.142:0/390754848 >> 172.21.15.142:0/390754848 conn(0x7ff6fc0680c0 msgr2=0x7ff6fc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 -- 172.21.15.142:0/390754848 shutdown_connections 2023-09-30T23:04:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.988+0000 7ff7015ff700 1 -- 172.21.15.142:0/390754848 wait complete. 2023-09-30T23:04:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.989+0000 7ff7015ff700 1 Processor -- start 2023-09-30T23:04:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.990+0000 7ff7015ff700 1 -- start start 2023-09-30T23:04:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff7015ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff7015ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc0af020 0x7ff6fc0aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff7015ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6fc0b00d0 0x7ff6fc14c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff7015ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0aa810 con 0x7ff6fc06e650 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff7015ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0adca0 con 0x7ff6fc0af020 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff7015ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0aaa20 con 0x7ff6fc0b00d0 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41710/0 (socket says 172.21.15.142:41710) 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 -- 172.21.15.142:0/619934090 learned_addr learned my addr 172.21.15.142:0/619934090 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:04:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6fa7fc700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc0af020 0x7ff6fc0aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6fb7fe700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6fc0b00d0 0x7ff6fc14c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:55.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 -- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6fc0b00d0 msgr2=0x7ff6fc14c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6fc0b00d0 0x7ff6fc14c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 -- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc0af020 msgr2=0x7ff6fc0aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:55.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc0af020 0x7ff6fc0aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:55.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6faffd700 1 -- 172.21.15.142:0/619934090 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009a20 con 0x7ff6fc06e650 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.991+0000 7ff6fa7fc700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc0af020 0x7ff6fc0aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.992+0000 7ff6faffd700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc0c84d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c810 tx=0x7ff6ec007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.992+0000 7ff6e2ffd700 1 -- 172.21.15.142:0/619934090 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005b30 con 0x7ff6fc06e650 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.992+0000 7ff6e2ffd700 1 -- 172.21.15.142:0/619934090 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec005c90 con 0x7ff6fc06e650 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.992+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc0ad370 con 0x7ff6fc06e650 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.992+0000 7ff6e2ffd700 1 -- 172.21.15.142:0/619934090 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec007300 con 0x7ff6fc06e650 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.992+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc0ad930 con 0x7ff6fc06e650 2023-09-30T23:04:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.993+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0695b0 con 0x7ff6fc06e650 2023-09-30T23:04:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.994+0000 7ff6e2ffd700 1 -- 172.21.15.142:0/619934090 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff6ec01b400 con 0x7ff6fc06e650 2023-09-30T23:04:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.995+0000 7ff6e2ffd700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff6e8067330 0x7ff6e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:04:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.995+0000 7ff6e2ffd700 1 -- 172.21.15.142:0/619934090 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff6ec0843b0 con 0x7ff6fc06e650 2023-09-30T23:04:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.995+0000 7ff6fa7fc700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff6e8067330 0x7ff6e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:04:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.995+0000 7ff6fa7fc700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff6e8067330 0x7ff6e80697e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0c7470 tx=0x7ff6f0006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:04:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:55.999+0000 7ff6e2ffd700 1 -- 172.21.15.142:0/619934090 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff6ec051630 con 0x7ff6fc06e650 2023-09-30T23:04:56.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.183+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6fc0adde0 con 0x7ff6e8067330 2023-09-30T23:04:56.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.186+0000 7ff6e2ffd700 1 -- 172.21.15.142:0/619934090 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69887 (secure 0 0 0) 0x7ff6f000f790 con 0x7ff6e8067330 2023-09-30T23:04:56.187 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:04:56.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff6e8067330 msgr2=0x7ff6e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:56.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff6e8067330 0x7ff6e80697e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0c7470 tx=0x7ff6f0006f90 comp rx=0 tx=0).stop 2023-09-30T23:04:56.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 msgr2=0x7ff6fc0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:04:56.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc0c84d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c810 tx=0x7ff6ec007df0 comp rx=0 tx=0).stop 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 shutdown_connections 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7ff6e8067330 0x7ff6e80697e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff6fc0b00d0 0x7ff6fc14c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc06e650 0x7ff6fc0c84d0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 --2- 172.21.15.142:0/619934090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc0af020 0x7ff6fc0aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.188+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 >> 172.21.15.142:0/619934090 conn(0x7ff6fc0680c0 msgr2=0x7ff6fc069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.189+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 shutdown_connections 2023-09-30T23:04:56.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:04:56.189+0000 7ff7015ff700 1 -- 172.21.15.142:0/619934090 wait complete. 2023-09-30T23:04:56.191 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:04:56.207 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2023-09-30T23:04:54.280436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10489,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552010,"statfs":{"total":1600000000,"available":1589258256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.764179"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.522920+0000","last_change":"2023-09-30T22:52:23.949632+0000","last_active":"2023-09-30T23:04:44.522920+0000","last_peered":"2023-09-30T23:04:44.522920+0000","last_clean":"2023-09-30T23:04:44.522920+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:04:44.522920+0000","last_undegraded":"2023-09-30T23:04:44.522920+0000","last_fullsized":"2023-09-30T23:04:44.522920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520779+0000","last_change":"2023-09-30T22:52:23.946640+0000","last_active":"2023-09-30T23:04:44.520779+0000","last_peered":"2023-09-30T23:04:44.520779+0000","last_clean":"2023-09-30T23:04:44.520779+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:04:44.520779+0000","last_undegraded":"2023-09-30T23:04:44.520779+0000","last_fullsized":"2023-09-30T23:04:44.520779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:41.875979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.526291+0000","last_change":"2023-09-30T22:52:23.950038+0000","last_active":"2023-09-30T23:04:44.526291+0000","last_peered":"2023-09-30T23:04:44.526291+0000","last_clean":"2023-09-30T23:04:44.526291+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:04:44.526291+0000","last_undegraded":"2023-09-30T23:04:44.526291+0000","last_fullsized":"2023-09-30T23:04:44.526291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:09:00.501542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.521592+0000","last_change":"2023-09-30T22:52:23.946545+0000","last_active":"2023-09-30T23:04:44.521592+0000","last_peered":"2023-09-30T23:04:44.521592+0000","last_clean":"2023-09-30T23:04:44.521592+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:04:44.521592+0000","last_undegraded":"2023-09-30T23:04:44.521592+0000","last_fullsized":"2023-09-30T23:04:44.521592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:54:11.896991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":325,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:45.522472+0000","last_change":"2023-09-30T22:52:18.109881+0000","last_active":"2023-09-30T23:04:45.522472+0000","last_peered":"2023-09-30T23:04:45.522472+0000","last_clean":"2023-09-30T23:04:45.522472+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:04:45.522472+0000","last_undegraded":"2023-09-30T23:04:45.522472+0000","last_fullsized":"2023-09-30T23:04:45.522472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:16.897930+0000","last_clean_scrub_stamp":"2023-09-30T22:52:16.897930+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519573+0000","last_change":"2023-09-30T22:52:23.949534+0000","last_active":"2023-09-30T23:04:44.519573+0000","last_peered":"2023-09-30T23:04:44.519573+0000","last_clean":"2023-09-30T23:04:44.519573+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:04:44.519573+0000","last_undegraded":"2023-09-30T23:04:44.519573+0000","last_fullsized":"2023-09-30T23:04:44.519573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:28:55.451987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.519496+0000","last_change":"2023-09-30T22:52:23.949087+0000","last_active":"2023-09-30T23:04:44.519496+0000","last_peered":"2023-09-30T23:04:44.519496+0000","last_clean":"2023-09-30T23:04:44.519496+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:04:44.519496+0000","last_undegraded":"2023-09-30T23:04:44.519496+0000","last_fullsized":"2023-09-30T23:04:44.519496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:22:50.017197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.525759+0000","last_change":"2023-09-30T22:52:24.177510+0000","last_active":"2023-09-30T23:04:44.525759+0000","last_peered":"2023-09-30T23:04:44.525759+0000","last_clean":"2023-09-30T23:04:44.525759+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:04:44.525759+0000","last_undegraded":"2023-09-30T23:04:44.525759+0000","last_fullsized":"2023-09-30T23:04:44.525759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:29:04.698183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-09-30T23:04:44.520700+0000","last_change":"2023-09-30T22:52:24.177369+0000","last_active":"2023-09-30T23:04:44.520700+0000","last_peered":"2023-09-30T23:04:44.520700+0000","last_clean":"2023-09-30T23:04:44.520700+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:04:44.520700+0000","last_undegraded":"2023-09-30T23:04:44.520700+0000","last_fullsized":"2023-09-30T23:04:44.520700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:52:22.935874+0000","last_clean_scrub_stamp":"2023-09-30T22:52:22.935874+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:31:06.919233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.315},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.0309999999999999},"last":0.876},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.86699999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69599999999999995}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.95699999999999996,"15min":1.004},"last":0.755},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.627}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.43099999999999999},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89700000000000002,"5min":1.028,"15min":1.028},"last":0.84799999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.93999999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.434},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.056},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.44,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.35999999999999999},"max":{"1min":0.82599999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90800000000000003,"5min":1.03,"15min":1.135},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.004},"last":0.73099999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.147,"15min":1.147},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.754,"15min":0.72299999999999998},"min":{"1min":0.53900000000000003,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.071},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71699999999999997,"15min":0.81000000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.85299999999999998,"5min":0.96699999999999997,"15min":6.5190000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.752},"min":{"1min":0.435,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.89300000000000002,"5min":1.0269999999999999,"15min":4.3680000000000003},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.77000000000000002},"min":{"1min":0.48799999999999999,"5min":0.45900000000000002,"15min":0.42699999999999999},"max":{"1min":0.876,"5min":1.123,"15min":3.6339999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.83899999999999997},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.034,"15min":8.4339999999999993},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40799999999999997},"max":{"1min":0.82399999999999995,"5min":0.92000000000000004,"15min":3.4580000000000002},"last":0.626},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.67400000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.83499999999999996},"min":{"1min":0.57399999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":5.7110000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.55800000000000005,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.86299999999999999,"5min":0.96599999999999997,"15min":1.5249999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.65800000000000003},"min":{"1min":0.441,"5min":0.41399999999999998,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.4670000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93899999999999995,"5min":0.999,"15min":5.9279999999999999},"last":0.73199999999999998}]},{"osd":5,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.321},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":1.018,"15min":1.4590000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.999,"5min":0.999,"15min":6.0599999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.98799999999999999,"5min":1.0469999999999999,"15min":1.3620000000000001},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.61099999999999999,"5min":0.69699999999999995,"15min":1.083},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.745},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":0.61799999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.40400000000000003,"5min":0.35899999999999999,"15min":0.27400000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.495}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.70899999999999996},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":1.091,"15min":1.091},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.73999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48399999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.86499999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1499999999999999,"15min":1.22},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.75},"min":{"1min":0.59599999999999997,"5min":0.53900000000000003,"15min":0.53100000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.3560000000000001},"last":0.94499999999999995}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.1160000000000001,"15min":1.127},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.48099999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.4059999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1240000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.79100000000000004},"min":{"1min":0.64900000000000002,"5min":0.53900000000000003,"15min":0.504},"max":{"1min":1.153,"5min":1.153,"15min":1.3779999999999999},"last":0.85099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":0.748,"15min":0.85699999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":0.63700000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.0289999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.879},"last":0.65200000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.749,"15min":1.0029999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.98899999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.27},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.171},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.75,"15min":0.73599999999999999},"min":{"1min":0.57799999999999996,"5min":0.502,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.099,"15min":1.2649999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.752},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91700000000000004,"5min":1.091,"15min":4.0419999999999998},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.434},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.6059999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.48399999999999999},"max":{"1min":1.032,"5min":1.0669999999999999,"15min":7.2610000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.65700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0660000000000001,"15min":2.4569999999999999},"last":0.627},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.149,"5min":1.149,"15min":4.0220000000000002},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.77500000000000002,"15min":1.4630000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.48199999999999998,"15min":0.45500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.249},"max":{"1min":0.62,"5min":0.876,"15min":1.542},"last":0.376}]},{"osd":1,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.627,"5min":1.0109999999999999,"15min":1.494},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38900000000000001,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48599999999999999,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.28999999999999998},"max":{"1min":0.51000000000000001,"5min":0.94399999999999995,"15min":1.649},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.309},"max":{"1min":0.58899999999999997,"5min":0.98099999999999998,"15min":1.3220000000000001},"last":0.499}]},{"osd":4,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.44400000000000001},"max":{"1min":0.93799999999999994,"5min":1.1819999999999999,"15min":1.234},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.38},"max":{"1min":1.0049999999999999,"5min":1.167,"15min":1.4910000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.179},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":1.22,"15min":2.7320000000000002},"last":0.76300000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":1.161,"15min":1.615},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77200000000000002,"15min":0.752},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.1879999999999999,"15min":1.4199999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.46000000000000002},"max":{"1min":0.92000000000000004,"5min":1.206,"15min":1.206},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":1.2330000000000001,"15min":2.7730000000000001},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.21199999999999999},"max":{"1min":0.57799999999999996,"5min":0.66900000000000004,"15min":1.1519999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.69899999999999995,"15min":1.919},"last":0.30499999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60599999999999998,"5min":0.81299999999999994,"15min":1.254},"last":0.441},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.27300000000000002},"max":{"1min":0.69099999999999995,"5min":0.748,"15min":1.9390000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.72799999999999998,"5min":0.85199999999999998,"15min":1.6020000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.5309999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.35999999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.401},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.77700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.443},"max":{"1min":1.0189999999999999,"5min":1.1439999999999999,"15min":3.306},"last":0.86499999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.46200000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.508},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.621,"5min":0.55200000000000005,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.4910000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.5620000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73699999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.48099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.3140000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.48799999999999999},"max":{"1min":1.0920000000000001,"5min":1.1040000000000001,"15min":1.3640000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.573},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.67600000000000005,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.98199999999999998,"15min":1.022},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79900000000000004,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77600000000000002,"5min":1.012,"15min":1.012},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.59399999999999997,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":0.77400000000000002,"5min":0.98699999999999999,"15min":1.492},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77400000000000002,"15min":0.72599999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.442},"max":{"1min":0.83499999999999996,"5min":0.96599999999999997,"15min":1.0149999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72399999999999998,"15min":0.69099999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.85399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":1.0620000000000001,"15min":1.5149999999999999},"last":0.89600000000000002}]},{"osd":5,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.98299999999999998,"15min":1.0429999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":0.98499999999999999,"15min":1.0209999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.44700000000000001,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.94999999999999996,"5min":1.0409999999999999,"15min":1.45},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73899999999999999,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.432},"max":{"1min":0.87,"5min":1.028,"15min":1.0649999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.71899999999999997},"min":{"1min":0.52300000000000002,"5min":0.47999999999999998,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":1.012,"15min":1.016},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.98099999999999998,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.98099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86499999999999999,"5min":0.96199999999999997,"15min":0.98199999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.008},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.92900000000000005,"15min":0.97899999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":0.95899999999999996,"15min":1.0449999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.67200000000000004},"min":{"1min":0.42799999999999999,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.95299999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70199999999999996,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95899999999999996,"15min":1.044},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70599999999999996,"15min":0.67300000000000004},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.72899999999999998,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.96799999999999997,"15min":0.97599999999999998},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76900000000000002,"5min":0.89100000000000001,"15min":0.95299999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":1.081},"last":0.629}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78500000000000003,"5min":0.90900000000000003,"15min":1.03},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.083},"last":0.751},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.45900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":1.0700000000000001},"last":0.87}]}]}],"pool_statfs":[]}} 2023-09-30T23:04:56.213 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.214 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.215 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.217 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.219 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-30T22:52:16.897930+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.220 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.220 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.220 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.220 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-30T22:52:22.935874+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=22, tm_min=52, tm_sec=22, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=23, tm_min=4, tm_sec=49, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T23:04:56.220 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-30T23:05:16.173 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:16.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:16.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T23:05:16.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.414+0000 7fa2fbdff700 1 Processor -- start 2023-09-30T23:05:16.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.415+0000 7fa2fbdff700 1 -- start start 2023-09-30T23:05:16.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2fbdff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2f4157a90 0x7fa2f415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2fbdff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f406d470 con 0x7fa2f406b3d0 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2fbdff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f4157e60 con 0x7fa2f40b2110 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2fbdff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f415c430 con 0x7fa2f4157a90 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2f9b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2f4157a90 0x7fa2f415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2f939a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa2f406b3d0 0x7fa2f40b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54670/0 (socket says 172.21.15.142:54670) 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2f9b9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2f4157a90 0x7fa2f415bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59702/0 (socket says 172.21.15.142:59702) 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.416+0000 7fa2f939a700 1 -- 172.21.15.142:0/773601292 learned_addr learned my addr 172.21.15.142:0/773601292 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f9b9b700 1 -- 172.21.15.142:0/773601292 >> v1:172.21.15.148:6789/0 conn(0x7fa2f40b2110 legacy=0x7fa2f406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f9b9b700 1 -- 172.21.15.142:0/773601292 >> v1:172.21.15.142:6789/0 conn(0x7fa2f406b3d0 legacy=0x7fa2f40b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f9b9b700 1 -- 172.21.15.142:0/773601292 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40ae880 con 0x7fa2f4157a90 2023-09-30T23:05:16.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f8b99700 1 -- 172.21.15.142:0/773601292 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785144194 0 0) 0x7fa2f406d470 con 0x7fa2f406b3d0 2023-09-30T23:05:16.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f9b9b700 1 --2- 172.21.15.142:0/773601292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f4157a90 0x7fa2f415bef0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00098e0 tx=0x7fa2f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1800d6b65e1dce87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:16.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f8b99700 1 -- 172.21.15.142:0/773601292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0009e80 con 0x7fa2f4157a90 2023-09-30T23:05:16.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f8b99700 1 -- 172.21.15.142:0/773601292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000b860 con 0x7fa2f4157a90 2023-09-30T23:05:16.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.417+0000 7fa2f8b99700 1 -- 172.21.15.142:0/773601292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000bbe0 con 0x7fa2f4157a90 2023-09-30T23:05:16.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.418+0000 7fa2fbdff700 1 -- 172.21.15.142:0/773601292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f4157a90 msgr2=0x7fa2f415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.418+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/773601292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f4157a90 0x7fa2f415bef0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00098e0 tx=0x7fa2f00091a0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.418+0000 7fa2fbdff700 1 -- 172.21.15.142:0/773601292 shutdown_connections 2023-09-30T23:05:16.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.418+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/773601292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f4157a90 0x7fa2f415bef0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.418+0000 7fa2fbdff700 1 -- 172.21.15.142:0/773601292 >> 172.21.15.142:0/773601292 conn(0x7fa2f40680c0 msgr2=0x7fa2f40c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:05:16.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.418+0000 7fa2fbdff700 1 -- 172.21.15.142:0/773601292 shutdown_connections 2023-09-30T23:05:16.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.418+0000 7fa2fbdff700 1 -- 172.21.15.142:0/773601292 wait complete. 2023-09-30T23:05:16.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.419+0000 7fa2fbdff700 1 Processor -- start 2023-09-30T23:05:16.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.419+0000 7fa2fbdff700 1 -- start start 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.420+0000 7fa2fbdff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f406b3d0 0x7fa2f40b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.420+0000 7fa2fbdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f40b2110 0x7fa2f416a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.420+0000 7fa2fbdff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2f4157a90 0x7fa2f40aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.420+0000 7fa2fbdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4156d20 con 0x7fa2f40b2110 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.420+0000 7fa2fbdff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40af7f0 con 0x7fa2f4157a90 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.420+0000 7fa2fbdff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40afad0 con 0x7fa2f406b3d0 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.420+0000 7fa2f939a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f40b2110 0x7fa2f416a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f40b2110 0x7fa2f416a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59706/0 (socket says 172.21.15.142:59706) 2023-09-30T23:05:16.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 -- 172.21.15.142:0/2486945306 learned_addr learned my addr 172.21.15.142:0/2486945306 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f9b9b700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f406b3d0 0x7fa2f40b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2fa39c700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2f4157a90 0x7fa2f40aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 -- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f406b3d0 msgr2=0x7fa2f40b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f406b3d0 0x7fa2f40b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 -- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2f4157a90 msgr2=0x7fa2f40aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2f4157a90 0x7fa2f40aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 -- 172.21.15.142:0/2486945306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009420 con 0x7fa2f40b2110 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2f939a700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f40b2110 0x7fa2f416a7f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c560 tx=0x7fa2e4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2e9ffb700 1 -- 172.21.15.142:0/2486945306 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4005b30 con 0x7fa2f40b2110 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2e9ffb700 1 -- 172.21.15.142:0/2486945306 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e4005c90 con 0x7fa2f40b2110 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f416b040 con 0x7fa2f40b2110 2023-09-30T23:05:16.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.421+0000 7fa2e9ffb700 1 -- 172.21.15.142:0/2486945306 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4007320 con 0x7fa2f40b2110 2023-09-30T23:05:16.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.422+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f416b600 con 0x7fa2f40b2110 2023-09-30T23:05:16.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.422+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f40afc60 con 0x7fa2f40b2110 2023-09-30T23:05:16.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.423+0000 7fa2e9ffb700 1 -- 172.21.15.142:0/2486945306 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa2e401b3b0 con 0x7fa2f40b2110 2023-09-30T23:05:16.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.425+0000 7fa2e9ffb700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2d8067330 0x7fa2d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.425+0000 7fa2e9ffb700 1 -- 172.21.15.142:0/2486945306 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa2e4083cb0 con 0x7fa2f40b2110 2023-09-30T23:05:16.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.425+0000 7fa2f9b9b700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2d8067330 0x7fa2d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.425+0000 7fa2f9b9b700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2d8067330 0x7fa2d80697e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00093f0 tx=0x7fa2f0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:16.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.429+0000 7fa2e9ffb700 1 -- 172.21.15.142:0/2486945306 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa2e4050e10 con 0x7fa2f40b2110 2023-09-30T23:05:16.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.615+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 --> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2f40cc400 con 0x7fa2d8067330 2023-09-30T23:05:16.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.618+0000 7fa2e9ffb700 1 -- 172.21.15.142:0/2486945306 <== mgr.4105 v2:172.21.15.142:6832/109332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70111 (secure 0 0 0) 0x7fa2f40cc400 con 0x7fa2d8067330 2023-09-30T23:05:16.619 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:05:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2d8067330 msgr2=0x7fa2d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2d8067330 0x7fa2d80697e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00093f0 tx=0x7fa2f0017000 comp rx=0 tx=0).stop 2023-09-30T23:05:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f40b2110 msgr2=0x7fa2f416a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f40b2110 0x7fa2f416a7f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c560 tx=0x7fa2e4007f90 comp rx=0 tx=0).stop 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 shutdown_connections 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fa2d8067330 0x7fa2d80697e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2f4157a90 0x7fa2f40aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa2f406b3d0 0x7fa2f40b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 --2- 172.21.15.142:0/2486945306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2f40b2110 0x7fa2f416a7f0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 >> 172.21.15.142:0/2486945306 conn(0x7fa2f40680c0 msgr2=0x7fa2f40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 shutdown_connections 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.621+0000 7fa2fbdff700 1 -- 172.21.15.142:0/2486945306 wait complete. 2023-09-30T23:05:16.622 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-30T23:05:16.639 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":579,"stamp":"2023-09-30T23:05:16.285259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10489,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552010,"statfs":{"total":1600000000,"available":1589258256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002727"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:58.746755+0000","last_change":"2023-09-30T23:04:58.746722+0000","last_active":"2023-09-30T23:04:58.746755+0000","last_peered":"2023-09-30T23:04:58.746755+0000","last_clean":"2023-09-30T23:04:58.746755+0000","last_became_active":"2023-09-30T22:52:23.949380+0000","last_became_peered":"2023-09-30T22:52:23.949380+0000","last_unstale":"2023-09-30T23:04:58.746755+0000","last_undegraded":"2023-09-30T23:04:58.746755+0000","last_fullsized":"2023-09-30T23:04:58.746755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:58.746668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:58.746668+0000","last_clean_scrub_stamp":"2023-09-30T23:04:58.746668+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:41:22.618223+0000","scrub_duration":0.0013093849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":184,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:56.610820+0000","last_change":"2023-09-30T23:04:56.610792+0000","last_active":"2023-09-30T23:04:56.610820+0000","last_peered":"2023-09-30T23:04:56.610820+0000","last_clean":"2023-09-30T23:04:56.610820+0000","last_became_active":"2023-09-30T22:52:23.946408+0000","last_became_peered":"2023-09-30T22:52:23.946408+0000","last_unstale":"2023-09-30T23:04:56.610820+0000","last_undegraded":"2023-09-30T23:04:56.610820+0000","last_fullsized":"2023-09-30T23:04:56.610820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:56.610738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:56.610738+0000","last_clean_scrub_stamp":"2023-09-30T23:04:56.610738+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:46:47.430286+0000","scrub_duration":0.002133589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":180,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:58.671693+0000","last_change":"2023-09-30T23:04:58.671645+0000","last_active":"2023-09-30T23:04:58.671693+0000","last_peered":"2023-09-30T23:04:58.671693+0000","last_clean":"2023-09-30T23:04:58.671693+0000","last_became_active":"2023-09-30T22:52:23.949779+0000","last_became_peered":"2023-09-30T22:52:23.949779+0000","last_unstale":"2023-09-30T23:04:58.671693+0000","last_undegraded":"2023-09-30T23:04:58.671693+0000","last_fullsized":"2023-09-30T23:04:58.671693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:58.671567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:58.671567+0000","last_clean_scrub_stamp":"2023-09-30T23:04:58.671567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:59:56.522594+0000","scrub_duration":0.0013911629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:53.711935+0000","last_change":"2023-09-30T23:04:53.711913+0000","last_active":"2023-09-30T23:04:53.711935+0000","last_peered":"2023-09-30T23:04:53.711935+0000","last_clean":"2023-09-30T23:04:53.711935+0000","last_became_active":"2023-09-30T22:52:23.946356+0000","last_became_peered":"2023-09-30T22:52:23.946356+0000","last_unstale":"2023-09-30T23:04:53.711935+0000","last_undegraded":"2023-09-30T23:04:53.711935+0000","last_fullsized":"2023-09-30T23:04:53.711935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:53.711865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:53.711865+0000","last_clean_scrub_stamp":"2023-09-30T23:04:53.711865+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:15:01.801252+0000","scrub_duration":0.00095882499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"199'119","reported_seq":337,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:58.891253+0000","last_change":"2023-09-30T23:04:58.891212+0000","last_active":"2023-09-30T23:04:58.891253+0000","last_peered":"2023-09-30T23:04:58.891253+0000","last_clean":"2023-09-30T23:04:58.891253+0000","last_became_active":"2023-09-30T22:52:18.109097+0000","last_became_peered":"2023-09-30T22:52:18.109097+0000","last_unstale":"2023-09-30T23:04:58.891253+0000","last_undegraded":"2023-09-30T23:04:58.891253+0000","last_fullsized":"2023-09-30T23:04:58.891253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"199'119","last_scrub_stamp":"2023-09-30T23:04:58.891114+0000","last_deep_scrub":"199'119","last_deep_scrub_stamp":"2023-09-30T23:04:58.891114+0000","last_clean_scrub_stamp":"2023-09-30T23:04:58.891114+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:03:51.213616+0000","scrub_duration":0.003838125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:57.562024+0000","last_change":"2023-09-30T23:04:57.561990+0000","last_active":"2023-09-30T23:04:57.562024+0000","last_peered":"2023-09-30T23:04:57.562024+0000","last_clean":"2023-09-30T23:04:57.562024+0000","last_became_active":"2023-09-30T22:52:23.949353+0000","last_became_peered":"2023-09-30T22:52:23.949353+0000","last_unstale":"2023-09-30T23:04:57.562024+0000","last_undegraded":"2023-09-30T23:04:57.562024+0000","last_fullsized":"2023-09-30T23:04:57.562024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:57.561930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:57.561930+0000","last_clean_scrub_stamp":"2023-09-30T23:04:57.561930+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T08:36:44.803019+0000","scrub_duration":0.002093728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:58.522793+0000","last_change":"2023-09-30T23:04:58.522764+0000","last_active":"2023-09-30T23:04:58.522793+0000","last_peered":"2023-09-30T23:04:58.522793+0000","last_clean":"2023-09-30T23:04:58.522793+0000","last_became_active":"2023-09-30T22:52:23.948893+0000","last_became_peered":"2023-09-30T22:52:23.948893+0000","last_unstale":"2023-09-30T23:04:58.522793+0000","last_undegraded":"2023-09-30T23:04:58.522793+0000","last_fullsized":"2023-09-30T23:04:58.522793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:58.522703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:58.522703+0000","last_clean_scrub_stamp":"2023-09-30T23:04:58.522703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T07:17:36.636884+0000","scrub_duration":0.0016667100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:54.075271+0000","last_change":"2023-09-30T23:04:54.075245+0000","last_active":"2023-09-30T23:04:54.075271+0000","last_peered":"2023-09-30T23:04:54.075271+0000","last_clean":"2023-09-30T23:04:54.075271+0000","last_became_active":"2023-09-30T22:52:24.177345+0000","last_became_peered":"2023-09-30T22:52:24.177345+0000","last_unstale":"2023-09-30T23:04:54.075271+0000","last_undegraded":"2023-09-30T23:04:54.075271+0000","last_fullsized":"2023-09-30T23:04:54.075271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:54.075171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:54.075171+0000","last_clean_scrub_stamp":"2023-09-30T23:04:54.075171+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:58:47.752688+0000","scrub_duration":0.0011730449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":185,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-09-30T23:04:59.543702+0000","last_change":"2023-09-30T23:04:59.543662+0000","last_active":"2023-09-30T23:04:59.543702+0000","last_peered":"2023-09-30T23:04:59.543702+0000","last_clean":"2023-09-30T23:04:59.543702+0000","last_became_active":"2023-09-30T22:52:24.177212+0000","last_became_peered":"2023-09-30T22:52:24.177212+0000","last_unstale":"2023-09-30T23:04:59.543702+0000","last_undegraded":"2023-09-30T23:04:59.543702+0000","last_fullsized":"2023-09-30T23:04:59.543702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T23:04:59.543568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T23:04:59.543568+0000","last_clean_scrub_stamp":"2023-09-30T23:04:59.543568+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T06:26:53.093674+0000","scrub_duration":0.001427768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.315},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.0309999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.67400000000000004},"min":{"1min":0.49199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.86699999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.95699999999999996,"15min":1.004},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.61799999999999999}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.45500000000000002,"15min":0.43099999999999999},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89700000000000002,"5min":1.028,"15min":1.028},"last":0.85299999999999998}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.93999999999999995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.434},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.056},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.44,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.95999999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.35999999999999999},"max":{"1min":0.82599999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90800000000000003,"5min":1.03,"15min":1.135},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.004},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.147,"15min":1.147},"last":0.752},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.754,"15min":0.72299999999999998},"min":{"1min":0.53900000000000003,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.97899999999999998,"5min":1.016,"15min":1.071},"last":0.86599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71699999999999997,"15min":0.81000000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29299999999999998},"max":{"1min":0.85299999999999998,"5min":0.96699999999999997,"15min":6.5190000000000001},"last":0.623},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.752},"min":{"1min":0.435,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.89300000000000002,"5min":1.0269999999999999,"15min":4.3680000000000003},"last":0.65500000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72699999999999998,"15min":0.77000000000000002},"min":{"1min":0.48799999999999999,"5min":0.45900000000000002,"15min":0.42699999999999999},"max":{"1min":0.876,"5min":1.123,"15min":3.6339999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.83899999999999997},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.034,"15min":8.4339999999999993},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40799999999999997},"max":{"1min":0.82399999999999995,"5min":0.92000000000000004,"15min":3.4580000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":1.0780000000000001,"15min":6.5730000000000004},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75800000000000001,"15min":0.83499999999999996},"min":{"1min":0.57399999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":5.7110000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.55800000000000005,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":0.86299999999999999,"5min":0.96599999999999997,"15min":1.5249999999999999},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.65800000000000003},"min":{"1min":0.441,"5min":0.41399999999999998,"15min":0.309},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.4670000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.51500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93899999999999995,"5min":0.999,"15min":5.9279999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.321},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":1.018,"15min":1.4590000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Sat Sep 30 23:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.999,"5min":0.999,"15min":6.0599999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.98799999999999999,"5min":1.0469999999999999,"15min":1.3620000000000001},"last":0.79100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":0.61099999999999999,"5min":0.69699999999999995,"15min":1.083},"last":0.435},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.745},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":0.61799999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.80900000000000005,"15min":1.1240000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.40400000000000003,"5min":0.35899999999999999,"15min":0.27400000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.70899999999999996},"min":{"1min":0.51900000000000002,"5min":0.49199999999999999,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":1.091,"15min":1.091},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.73999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48399999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.745}]},{"osd":5,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":1.0600000000000001,"5min":1.1499999999999999,"15min":1.22},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.75},"min":{"1min":0.59599999999999997,"5min":0.53900000000000003,"15min":0.53100000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.3560000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.1160000000000001,"15min":1.127},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.48099999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.4059999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1240000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.79100000000000004},"min":{"1min":0.64900000000000002,"5min":0.53900000000000003,"15min":0.504},"max":{"1min":1.153,"5min":1.153,"15min":1.3779999999999999},"last":0.82599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":0.748,"15min":0.85699999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.26800000000000002,"15min":0.25},"max":{"1min":0.63700000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.0289999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41199999999999998,"5min":0.312,"15min":0.30499999999999999},"max":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.879},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.63900000000000001,"5min":0.749,"15min":1.0029999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52200000000000002},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.98899999999999999},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.27},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.171},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.75,"15min":0.73599999999999999},"min":{"1min":0.57799999999999996,"5min":0.502,"15min":0.41099999999999998},"max":{"1min":0.95999999999999996,"5min":1.099,"15min":1.2649999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.752},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91700000000000004,"5min":1.091,"15min":4.0419999999999998},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.434},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.6059999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.48399999999999999},"max":{"1min":1.032,"5min":1.0669999999999999,"15min":7.2610000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Sat Sep 30 23:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.65700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0660000000000001,"15min":2.4569999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.149,"5min":1.149,"15min":4.0220000000000002},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.77500000000000002,"15min":1.4630000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.48199999999999998,"15min":0.45500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.249},"max":{"1min":0.62,"5min":0.876,"15min":1.542},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.498},"min":{"1min":0.32400000000000001,"5min":0.32100000000000001,"15min":0.28899999999999998},"max":{"1min":0.627,"5min":1.0109999999999999,"15min":1.494},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.38900000000000001,"15min":0.29599999999999999},"max":{"1min":0.64800000000000002,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48599999999999999,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.28999999999999998},"max":{"1min":0.51000000000000001,"5min":0.94399999999999995,"15min":1.649},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.309},"max":{"1min":0.58899999999999997,"5min":0.98099999999999998,"15min":1.3220000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.44400000000000001},"max":{"1min":0.93799999999999994,"5min":1.1819999999999999,"15min":1.234},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.38},"max":{"1min":1.0049999999999999,"5min":1.167,"15min":1.4910000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1459999999999999,"15min":1.179},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.42899999999999999},"max":{"1min":0.96799999999999997,"5min":1.22,"15min":2.7320000000000002},"last":0.84299999999999997}]},{"osd":6,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":1.161,"15min":1.615},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77200000000000002,"15min":0.752},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.1879999999999999,"15min":1.4199999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Sep 30 23:04:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78900000000000003,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.46000000000000002},"max":{"1min":0.92000000000000004,"5min":1.206,"15min":1.206},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.98099999999999998,"5min":1.2330000000000001,"15min":2.7730000000000001},"last":0.88200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.21199999999999999},"max":{"1min":0.57799999999999996,"5min":0.66900000000000004,"15min":1.1519999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.69899999999999995,"15min":1.919},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60599999999999998,"5min":0.81299999999999994,"15min":1.254},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.48699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.27300000000000002},"max":{"1min":0.69099999999999995,"5min":0.748,"15min":1.9390000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.39600000000000002,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.72799999999999998,"5min":0.85199999999999998,"15min":1.6020000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.5309999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.35999999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.401},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.77700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.443},"max":{"1min":1.0189999999999999,"5min":1.1439999999999999,"15min":3.306},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.46200000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.508},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.75900000000000001},"min":{"1min":0.621,"5min":0.55200000000000005,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.4910000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.5620000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73699999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.48099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.3140000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Sep 30 23:04:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.48799999999999999},"max":{"1min":1.0920000000000001,"5min":1.1040000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.573},"last":0.75}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1167,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194145,"statfs":{"total":200000000,"available":198804874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.67600000000000005,"15min":0.63400000000000001},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.98199999999999998,"15min":1.022},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79900000000000004,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.443},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77600000000000002,"5min":1.012,"15min":1.012},"last":0.47799999999999998}]},{"osd":2,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.59399999999999997,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":0.77400000000000002,"5min":0.98699999999999999,"15min":1.492},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77400000000000002,"15min":0.72599999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.442},"max":{"1min":0.83499999999999996,"5min":0.96599999999999997,"15min":1.0149999999999999},"last":0.626}]},{"osd":3,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72399999999999998,"15min":0.69099999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.85399999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.42599999999999999},"max":{"1min":0.89600000000000002,"5min":1.0620000000000001,"15min":1.5149999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.98299999999999998,"15min":1.0429999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":0.98499999999999999,"15min":1.0209999999999999},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.44700000000000001,"5min":0.41099999999999998,"15min":0.376},"max":{"1min":0.94999999999999996,"5min":1.0409999999999999,"15min":1.45},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73899999999999999,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.432},"max":{"1min":0.87,"5min":1.028,"15min":1.0649999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Sep 30 23:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.71899999999999997},"min":{"1min":0.52300000000000002,"5min":0.47999999999999998,"15min":0.45700000000000002},"max":{"1min":0.86799999999999999,"5min":1.012,"15min":1.016},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.98099999999999998,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.84399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1743,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193568,"statfs":{"total":200000000,"available":198214506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86499999999999999,"5min":0.96199999999999997,"15min":0.98199999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.008},"last":0.74199999999999999}]},{"osd":1,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.89800000000000002,"5min":0.92900000000000005,"15min":0.97899999999999998},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.68899999999999995},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":0.95899999999999996,"15min":1.0449999999999999},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.67200000000000004},"min":{"1min":0.42799999999999999,"5min":0.38700000000000001,"15min":0.27400000000000002},"max":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.95299999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70199999999999996,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.95899999999999996,"15min":1.044},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70599999999999996,"15min":0.67300000000000004},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":1.0189999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.72899999999999998,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.96799999999999997,"15min":0.97599999999999998},"last":0.91800000000000004}]},{"osd":4,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76900000000000002,"5min":0.89100000000000001,"15min":0.95299999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.36799999999999999},"max":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":1.081},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78500000000000003,"5min":0.90900000000000003,"15min":1.03},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Sep 30 23:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.37},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.083},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.45900000000000002},"max":{"1min":0.85899999999999999,"5min":0.98299999999999998,"15min":1.0700000000000001},"last":0.96599999999999997}]}]}],"pool_statfs":[]}} 2023-09-30T23:05:16.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-30T23:05:16.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.825+0000 7f12077ff700 1 Processor -- start 2023-09-30T23:05:16.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.825+0000 7f12077ff700 1 -- start start 2023-09-30T23:05:16.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.826+0000 7f12077ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f12000cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.826+0000 7f12077ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12000cbed0 con 0x7f12000b0770 2023-09-30T23:05:16.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.826+0000 7f12077ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12000cb2c0 con 0x7f120006b780 2023-09-30T23:05:16.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.826+0000 7f12077ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12000cc8a0 con 0x7f1200159d30 2023-09-30T23:05:16.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f1204d9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f12000b0770 0x7f120006b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54682/0 (socket says 172.21.15.142:54682) 2023-09-30T23:05:16.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f1204d9a700 1 -- 172.21.15.142:0/4065347566 learned_addr learned my addr 172.21.15.142:0/4065347566 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:05:16.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f120559b700 1 --2- 172.21.15.142:0/4065347566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f12000cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f11f7fff700 1 -- 172.21.15.142:0/4065347566 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869837058 0 0) 0x7f12000cbed0 con 0x7f12000b0770 2023-09-30T23:05:16.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f11f7fff700 1 -- 172.21.15.142:0/4065347566 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11ec003570 con 0x7f12000b0770 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f11f7fff700 1 -- 172.21.15.142:0/4065347566 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459623353 0 0) 0x7f12000cb2c0 con 0x7f120006b780 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f11f7fff700 1 -- 172.21.15.142:0/4065347566 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12000cbed0 con 0x7f120006b780 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f120559b700 1 -- 172.21.15.142:0/4065347566 >> v1:172.21.15.148:6789/0 conn(0x7f120006b780 legacy=0x7f1200067620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f120559b700 1 -- 172.21.15.142:0/4065347566 >> v1:172.21.15.142:6789/0 conn(0x7f12000b0770 legacy=0x7f120006b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.827+0000 7f120559b700 1 -- 172.21.15.142:0/4065347566 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000cb5a0 con 0x7f1200159d30 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.828+0000 7f120559b700 1 --2- 172.21.15.142:0/4065347566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f12000cc360 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009910 tx=0x7f11fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6797438e594ce38c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.828+0000 7f11f7fff700 1 -- 172.21.15.142:0/4065347566 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc011630 con 0x7f1200159d30 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.828+0000 7f11f7fff700 1 -- 172.21.15.142:0/4065347566 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc011790 con 0x7f1200159d30 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.828+0000 7f11f7fff700 1 -- 172.21.15.142:0/4065347566 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc011b10 con 0x7f1200159d30 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.828+0000 7f12077ff700 1 -- 172.21.15.142:0/4065347566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 msgr2=0x7f12000cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.828+0000 7f12077ff700 1 --2- 172.21.15.142:0/4065347566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f12000cc360 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009910 tx=0x7f11fc0091a0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.829+0000 7f12077ff700 1 -- 172.21.15.142:0/4065347566 shutdown_connections 2023-09-30T23:05:16.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.829+0000 7f12077ff700 1 --2- 172.21.15.142:0/4065347566 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f12000cc360 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.829+0000 7f12077ff700 1 -- 172.21.15.142:0/4065347566 >> 172.21.15.142:0/4065347566 conn(0x7f12000cf2e0 msgr2=0x7f12000b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:05:16.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.829+0000 7f12077ff700 1 -- 172.21.15.142:0/4065347566 shutdown_connections 2023-09-30T23:05:16.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.829+0000 7f12077ff700 1 -- 172.21.15.142:0/4065347566 wait complete. 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.830+0000 7f12077ff700 1 Processor -- start 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.830+0000 7f12077ff700 1 -- start start 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f12077ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120006b780 0x7f120015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f12077ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12000b0770 0x7f1200142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f12077ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f1200155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f12077ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200156cd0 con 0x7f120006b780 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f12077ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12001560c0 con 0x7f12000b0770 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f12077ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12001563a0 con 0x7f1200159d30 2023-09-30T23:05:16.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f120559b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120006b780 0x7f120015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f120559b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120006b780 0x7f120015bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59712/0 (socket says 172.21.15.142:59712) 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.831+0000 7f120559b700 1 -- 172.21.15.142:0/2476020424 learned_addr learned my addr 172.21.15.142:0/2476020424 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f120559b700 1 -- 172.21.15.142:0/2476020424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 msgr2=0x7f1200155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f120559b700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f1200155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f120559b700 1 -- 172.21.15.142:0/2476020424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12000b0770 msgr2=0x7f1200142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f120559b700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12000b0770 0x7f1200142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f120559b700 1 -- 172.21.15.142:0/2476020424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009420 con 0x7f120006b780 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f120559b700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120006b780 0x7f120015bd50 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009860 tx=0x7f11fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc011900 con 0x7f120006b780 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc011a60 con 0x7f120006b780 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc025650 con 0x7f120006b780 2023-09-30T23:05:16.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1200156680 con 0x7f120006b780 2023-09-30T23:05:16.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.832+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12001425a0 con 0x7f120006b780 2023-09-30T23:05:16.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.833+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120006e330 con 0x7f120006b780 2023-09-30T23:05:16.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.834+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f11fc023070 con 0x7f120006b780 2023-09-30T23:05:16.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.835+0000 7f11f57fa700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11e4067330 0x7f11e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:16.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.835+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f11fc085d30 con 0x7f120006b780 2023-09-30T23:05:16.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.835+0000 7f1204d9a700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11e4067330 0x7f11e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:16.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.836+0000 7f1204d9a700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11e4067330 0x7f11e40697e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f11f00058d0 tx=0x7f11f00079f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:16.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:16.839+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f11fc052e90 con 0x7f120006b780 2023-09-30T23:05:17.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.031+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f12000cb880 con 0x7f120006b780 2023-09-30T23:05:17.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.035+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f11fc052e90 con 0x7f120006b780 2023-09-30T23:05:17.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.036+0000 7f11f57fa700 1 -- 172.21.15.142:0/2476020424 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f11fc015020 con 0x7f120006b780 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11e4067330 msgr2=0x7f11e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11e4067330 0x7f11e40697e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f11f00058d0 tx=0x7f11f00079f0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120006b780 msgr2=0x7f120015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120006b780 0x7f120015bd50 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009860 tx=0x7f11fc017000 comp rx=0 tx=0).stop 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 shutdown_connections 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7f11e4067330 0x7f11e40697e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1200159d30 0x7f1200155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120006b780 0x7f120015bd50 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 --2- 172.21.15.142:0/2476020424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12000b0770 0x7f1200142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 >> 172.21.15.142:0/2476020424 conn(0x7f12000cf2e0 msgr2=0x7f1200152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:05:17.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 shutdown_connections 2023-09-30T23:05:17.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.039+0000 7f12077ff700 1 -- 172.21.15.142:0/2476020424 wait complete. 2023-09-30T23:05:17.320 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T23:05:17.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T23:05:17.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.511+0000 7fd9607ff700 1 Processor -- start 2023-09-30T23:05:17.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.512+0000 7fd9607ff700 1 -- start start 2023-09-30T23:05:17.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd9607ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd9581598e0 0x7fd958159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd9607ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 0x7fd95815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd9607ff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95806b8d0 con 0x7fd9580cee50 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd9607ff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9580cff40 con 0x7fd9581598e0 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd9607ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580cf330 con 0x7fd9580d03d0 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd95dd9a700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd9580cee50 0x7fd95806b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:54686/0 (socket says 172.21.15.142:54686) 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd95dd9a700 1 -- 172.21.15.142:0/101362049 learned_addr learned my addr 172.21.15.142:0/101362049 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd95ed9c700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 0x7fd95815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.513+0000 7fd95e59b700 1 --2- 172.21.15.142:0/101362049 >> v2:172.21.15.148:3300/0 conn(0x7fd9581598e0 0x7fd958159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204372463 0 0) 0x7fd95806b8d0 con 0x7fd9580cee50 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd944003570 con 0x7fd9580cee50 2023-09-30T23:05:17.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197646549 0 0) 0x7fd944003570 con 0x7fd9580cee50 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 msgr2=0x7fd95815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 0x7fd95815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 >> v2:172.21.15.148:3300/0 conn(0x7fd9581598e0 msgr2=0x7fd958159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 --2- 172.21.15.142:0/101362049 >> v2:172.21.15.148:3300/0 conn(0x7fd9581598e0 0x7fd958159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9580cf610 con 0x7fd9580cee50 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1706240587 0 0) 0x7fd948001470 con 0x7fd9580cee50 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 >> v1:172.21.15.142:6789/0 conn(0x7fd9580cee50 legacy=0x7fd95806b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd944003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 0x7fd944004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944004d50 0x7fd9440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580cff40 con 0x7fd944003a60 2023-09-30T23:05:17.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580cf330 con 0x7fd944004d50 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94400ba60 con 0x7fd9580d03d0 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95e59b700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd944003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95dd9a700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 0x7fd944004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.514+0000 7fd95ed9c700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944004d50 0x7fd9440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95e59b700 1 -- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 msgr2=0x7fd944004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95e59b700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 0x7fd944004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95e59b700 1 -- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944004d50 msgr2=0x7fd9440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95e59b700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944004d50 0x7fd9440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95e59b700 1 -- 172.21.15.142:0/101362049 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944003570 con 0x7fd944003a60 2023-09-30T23:05:17.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95ed9c700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944004d50 0x7fd9440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:05:17.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95dd9a700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9580d03d0 0x7fd944004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:05:17.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95e59b700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd944003e70 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fd954009c00 tx=0x7fd9540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4192d7a198cb430b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:17.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400e6b0 con 0x7fd944003a60 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd95400e810 con 0x7fd944003a60 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.515+0000 7fd95d599700 1 -- 172.21.15.142:0/101362049 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400ebf0 con 0x7fd944003a60 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.516+0000 7fd9607ff700 1 -- 172.21.15.142:0/101362049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 msgr2=0x7fd944003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.516+0000 7fd9607ff700 1 --2- 172.21.15.142:0/101362049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd944003e70 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fd954009c00 tx=0x7fd9540091a0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.516+0000 7fd95ed9c700 1 -- 172.21.15.142:0/101362049 reap_dead start 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.516+0000 7fd9607ff700 1 -- 172.21.15.142:0/101362049 shutdown_connections 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.516+0000 7fd9607ff700 1 -- 172.21.15.142:0/101362049 >> 172.21.15.142:0/101362049 conn(0x7fd9580cd540 msgr2=0x7fd9580cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.516+0000 7fd9607ff700 1 -- 172.21.15.142:0/101362049 shutdown_connections 2023-09-30T23:05:17.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.516+0000 7fd9607ff700 1 -- 172.21.15.142:0/101362049 wait complete. 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.517+0000 7fd9607ff700 1 Processor -- start 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.517+0000 7fd9607ff700 1 -- start start 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.518+0000 7fd9607ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd958147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.518+0000 7fd9607ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd95815a810 0x7fd9580c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.518+0000 7fd9607ff700 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd95815ac80 0x7fd9580c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.518+0000 7fd9607ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95816e8e0 con 0x7fd944003a60 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.518+0000 7fd9607ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958148420 con 0x7fd95815a810 2023-09-30T23:05:17.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.518+0000 7fd9607ff700 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95816dcd0 con 0x7fd95815ac80 2023-09-30T23:05:17.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd958147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd958147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59730/0 (socket says 172.21.15.142:59730) 2023-09-30T23:05:17.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 -- 172.21.15.142:0/294077542 learned_addr learned my addr 172.21.15.142:0/294077542 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-30T23:05:17.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95dd9a700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd95815a810 0x7fd9580c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95ed9c700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd95815ac80 0x7fd9580c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 -- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd95815ac80 msgr2=0x7fd9580c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd95815ac80 0x7fd9580c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 -- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd95815a810 msgr2=0x7fd9580c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd95815a810 0x7fd9580c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 -- 172.21.15.142:0/294077542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95816dfb0 con 0x7fd944003a60 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95ed9c700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd95815ac80 0x7fd9580c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd95e59b700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd958147ee0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fd95400e4b0 tx=0x7fd9540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.519+0000 7fd94e7fc700 1 -- 172.21.15.142:0/294077542 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954022070 con 0x7fd944003a60 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.520+0000 7fd94e7fc700 1 -- 172.21.15.142:0/294077542 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd954013c20 con 0x7fd944003a60 2023-09-30T23:05:17.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.520+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95816e290 con 0x7fd944003a60 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.520+0000 7fd94e7fc700 1 -- 172.21.15.142:0/294077542 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400e6b0 con 0x7fd944003a60 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.520+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95815a4c0 con 0x7fd944003a60 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.521+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9580697b0 con 0x7fd944003a60 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.522+0000 7fd94e7fc700 1 -- 172.21.15.142:0/294077542 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd95401c450 con 0x7fd944003a60 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.522+0000 7fd94e7fc700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd93c067330 0x7fd93c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.522+0000 7fd94e7fc700 1 -- 172.21.15.142:0/294077542 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd954086320 con 0x7fd944003a60 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.523+0000 7fd95dd9a700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd93c067330 0x7fd93c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.523+0000 7fd95dd9a700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd93c067330 0x7fd93c0697e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd948001010 tx=0x7fd948007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T23:05:17.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.527+0000 7fd94e7fc700 1 -- 172.21.15.142:0/294077542 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd9540535a0 con 0x7fd944003a60 2023-09-30T23:05:17.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.760+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd95806fc10 con 0x7fd944003a60 2023-09-30T23:05:17.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.761+0000 7fd94e7fc700 1 -- 172.21.15.142:0/294077542 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fd954017de0 con 0x7fd944003a60 2023-09-30T23:05:17.761 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-30T23:05:17.761 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":93,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4024029385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4024029385},{"type":"v1","addr":"172.21.15.142:6837","nonce":4024029385}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7666,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1125428433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1125428433},{"type":"v1","addr":"172.21.15.148:6834","nonce":1125428433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7963,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3600577114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3600577114},{"type":"v1","addr":"172.21.15.148:6835","nonce":3600577114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/66966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":66966573},{"type":"v1","addr":"172.21.15.142:6836","nonce":66966573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[]} 2023-09-30T23:05:17.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.763+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd93c067330 msgr2=0x7fd93c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.763+0000 7fd9607ff700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd93c067330 0x7fd93c0697e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd948001010 tx=0x7fd948007040 comp rx=0 tx=0).stop 2023-09-30T23:05:17.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.763+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 msgr2=0x7fd958147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.763+0000 7fd9607ff700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd958147ee0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fd95400e4b0 tx=0x7fd9540091a0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.763+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 shutdown_connections 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.763+0000 7fd9607ff700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:6832/109332,v1:172.21.15.142:6833/109332] conn(0x7fd93c067330 0x7fd93c0697e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.764+0000 7fd9607ff700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd95815ac80 0x7fd9580c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.764+0000 7fd9607ff700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd944003a60 0x7fd958147ee0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.764+0000 7fd9607ff700 1 --2- 172.21.15.142:0/294077542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd95815a810 0x7fd9580c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.764+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 >> 172.21.15.142:0/294077542 conn(0x7fd9580cd540 msgr2=0x7fd958157600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.764+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 shutdown_connections 2023-09-30T23:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-30T23:05:17.764+0000 7fd9607ff700 1 -- 172.21.15.142:0/294077542 wait complete. 2023-09-30T23:05:17.765 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 93 2023-09-30T23:05:17.781 DEBUG:tasks.cephfs.filesystem:already dead... 2023-09-30T23:05:17.781 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T23:05:17.781 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T23:05:17.781 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:17.793 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T23:05:17.793 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T23:05:17.794 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:17.845 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T23:05:17.846 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T23:05:17.846 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:17.861 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T23:05:17.861 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T23:05:17.861 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:17.916 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T23:05:17.916 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T23:05:17.916 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T23:05:17.917 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:17.957 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T23:05:17.957 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T23:05:17.958 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:22.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-09-30T23:05:24.059 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T23:05:24.060 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T23:05:24.060 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.108 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T23:05:24.108 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T23:05:24.108 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.153 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T23:05:24.153 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-30T23:05:24.153 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.204 INFO:tasks.ceph.osd.4:Stopped 2023-09-30T23:05:24.204 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-30T23:05:24.204 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.255 INFO:tasks.ceph.osd.5:Stopped 2023-09-30T23:05:24.255 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-30T23:05:24.255 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.305 INFO:tasks.ceph.osd.6:Stopped 2023-09-30T23:05:24.305 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-30T23:05:24.305 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.352 INFO:tasks.ceph.osd.7:Stopped 2023-09-30T23:05:24.353 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T23:05:24.353 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-30T23:05:24.353 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.416 INFO:tasks.ceph.mgr.y:Stopped 2023-09-30T23:05:24.416 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T23:05:24.417 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.472 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T23:05:24.472 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T23:05:24.472 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T23:05:24.473 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.493 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T23:05:24.494 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T23:05:24.494 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.511 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T23:05:24.511 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T23:05:24.511 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T23:05:24.569 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T23:05:24.570 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T23:05:24.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-30T23:05:24.661 INFO:teuthology.orchestra.run.smithi142.stdout:1696114334.9089632 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 139222.688175 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-09-30T23:05:24.662 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-09-30T23:05:24.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-30T23:05:24.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-30T23:05:24.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-30T23:05:24.935 INFO:teuthology.orchestra.run.smithi142.stdout:1696114334.9089632 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 139222.688175 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-09-30T23:05:24.936 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:05:24.936 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T23:05:25.268 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:05:25.269 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T23:05:25.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:05:25.447 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T23:05:25.631 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:05:25.631 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-30T23:05:25.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:05:25.800 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-30T23:05:26.111 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:05:26.111 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-30T23:05:26.289 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:05:26.289 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-30T23:05:26.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:05:26.511 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-30T23:05:26.682 INFO:tasks.ceph:Archiving mon data... 2023-09-30T23:05:26.683 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/data/mon.a.tgz 2023-09-30T23:05:26.683 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-09-30T23:05:26.732 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.esVojg71FW 2023-09-30T23:05:26.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.esVojg71FW 2023-09-30T23:05:26.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.esVojg71FW 2023-09-30T23:05:27.021 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.esVojg71FW is 439KB 2023-09-30T23:05:27.121 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.esVojg71FW 2023-09-30T23:05:27.166 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/data/mon.b.tgz 2023-09-30T23:05:27.166 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-09-30T23:05:27.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-09-30T23:05:27.214 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.xAliwD4ywu 2023-09-30T23:05:27.214 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xAliwD4ywu 2023-09-30T23:05:27.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.xAliwD4ywu 2023-09-30T23:05:27.497 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.xAliwD4ywu is 456KB 2023-09-30T23:05:27.596 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.xAliwD4ywu 2023-09-30T23:05:27.642 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/data/mon.c.tgz 2023-09-30T23:05:27.642 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-09-30T23:05:27.728 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.3q5ZnxPP1k 2023-09-30T23:05:27.728 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3q5ZnxPP1k 2023-09-30T23:05:27.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.3q5ZnxPP1k 2023-09-30T23:05:28.046 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.3q5ZnxPP1k is 456KB 2023-09-30T23:05:28.145 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.3q5ZnxPP1k 2023-09-30T23:05:28.191 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T23:05:28.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T23:05:28.196 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T23:05:28.299 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T23:05:28.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T23:05:28.304 DEBUG:teuthology.orchestra.run.smithi148:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T23:05:28.385 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T23:05:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T23:05:28.413 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T23:05:28.415 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/remote/smithi142/crash 2023-09-30T23:05:28.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T23:05:28.485 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/remote/smithi148/crash 2023-09-30T23:05:28.486 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T23:05:28.555 INFO:tasks.ceph:Shutting down logrotate 2023-09-30T23:05:28.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:28.560 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:28.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:28.735 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:28.804 INFO:tasks.ceph:Compressing logs... 2023-09-30T23:05:28.804 DEBUG:teuthology.orchestra.run.smithi142:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T23:05:28.808 DEBUG:teuthology.orchestra.run.smithi148:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T23:05:33.913 INFO:tasks.ceph:Archiving logs... 2023-09-30T23:05:33.913 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/remote/smithi142/log 2023-09-30T23:05:33.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T23:05:35.032 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/remote/smithi148/log 2023-09-30T23:05:35.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T23:05:35.631 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T23:05:35.640 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T23:05:35.641 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T23:05:35.646 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T23:05:35.767 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T23:05:35.777 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T23:05:35.777 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T23:05:35.782 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T23:05:35.823 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2023-09-30T23:05:35.826 INFO:teuthology.orchestra.run.smithi148.stderr:bash: ntpq: command not found 2023-09-30T23:05:35.830 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T23:05:35.830 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-09-30T23:05:35.830 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +207us[ +207us] +/- 75ms 2023-09-30T23:05:35.831 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -352us[ -340us] +/- 54ms 2023-09-30T23:05:35.831 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +534us[ +534us] +/- 86ms 2023-09-30T23:05:35.831 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T23:05:35.833 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T23:05:35.833 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-09-30T23:05:35.833 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +186us[ +186us] +/- 75ms 2023-09-30T23:05:35.833 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv02.front.sepia.ceph.com 3 6 377 11 -400us[ -387us] +/- 54ms 2023-09-30T23:05:35.833 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +510us[ +523us] +/- 86ms 2023-09-30T23:05:35.833 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T23:05:35.834 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T23:05:35.843 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T23:05:35.843 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T23:05:35.852 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T23:05:36.058 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T23:05:36.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T23:05:36.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T23:05:36.304 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T23:05:36.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T23:05:36.381 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T23:05:36.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T23:05:36.405 INFO:teuthology.task.internal:Duration was 1608.040993 seconds 2023-09-30T23:05:36.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T23:05:36.415 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T23:05:36.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T23:05:36.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T23:05:36.531 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T23:05:36.538 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T23:05:36.848 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T23:05:36.849 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2023-09-30T23:05:36.849 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T23:05:36.911 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2023-09-30T23:05:36.911 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T23:05:36.972 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T23:05:36.972 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T23:05:36.977 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T23:05:37.063 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T23:05:37.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T23:05:37.068 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T23:05:37.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T23:05:37.205 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T23:05:37.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T23:05:37.274 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T23:05:37.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T23:05:37.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T23:05:37.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T23:05:37.424 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2023-09-30T23:05:37.429 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2023-09-30T23:05:37.464 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T23:05:37.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T23:05:37.509 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T23:05:37.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T23:05:37.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T23:05:37.580 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T23:05:37.581 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/remote/smithi142 2023-09-30T23:05:37.581 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T23:05:37.690 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047/remote/smithi148 2023-09-30T23:05:37.690 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T23:05:37.775 INFO:teuthology.task.internal:Removing archive directory... 2023-09-30T23:05:37.775 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T23:05:37.781 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T23:05:37.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T23:05:37.845 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T23:05:37.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T23:05:37.859 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T23:05:37.859 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T23:05:37.869 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T23:05:37.911 INFO:teuthology.orchestra.run.smithi142.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 23:05 /home/ubuntu/cephtest 2023-09-30T23:05:37.916 INFO:teuthology.orchestra.run.smithi148.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 23:05 /home/ubuntu/cephtest 2023-09-30T23:05:37.919 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T23:05:37.935 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T23:05:37.984 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T23:05:38.011 DEBUG:teuthology.nuke:shortname: smithi142 2023-09-30T23:05:38.011 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T23:05:38.033 DEBUG:teuthology.nuke:shortname: smithi148 2023-09-30T23:05:38.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T23:05:38.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:27:47.297208', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPjHJzUbT8LI1oBZ32NJHx/e6yhR1zgIw13aTk2LFkoimAF0f9BlkmwrQc2NtklmWZRwoMcz1GRVP6CwYnGK8Y='} 2023-09-30T23:05:38.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-29_10:09:00-fs-wip-vshankar-testing-quincy-20230929.071619-testing-default-smithi/7406047', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:27:47.298864', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs3M+ZD0mL3oGrX2NgbVTeR/pu1+UfZoiItbPE6GhioE77ykHjbJQ1hdDXdvRbobPyPZaWX/JbKSX9mGlMul/I='} 2023-09-30T23:05:38.081 INFO:teuthology.orchestra.console.smithi142:Power off 2023-09-30T23:05:38.082 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T23:05:38.103 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-09-30T23:05:38.103 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:38.116 INFO:teuthology.orchestra.console.smithi148:Power off 2023-09-30T23:05:38.117 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T23:05:38.125 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-30T23:05:38.136 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-09-30T23:05:38.137 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:38.157 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-30T23:05:42.125 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:42.158 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:42.234 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-30T23:05:42.266 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-30T23:05:46.240 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:46.267 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:46.350 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-30T23:05:46.375 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-09-30T23:05:50.355 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:50.376 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T23:05:50.464 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-09-30T23:05:50.486 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-09-30T23:05:50.565 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-09-30T23:05:50.587 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-09-30T23:05:50.692 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1608.0409927368164 failure_reason: '"1696114334.9089632 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 139222.688175 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-09-30T23:05:50.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T23:05:50.772 INFO:teuthology.run:FAIL